2024-09-10T08:16:57.498 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T08:16:57.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:16:57.605 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916 branch: wip-rishabh-testing-20240909.165402-squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} email: null first_in_suite: false job_id: '7898916' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlYPsE/lrQmOaIUu/p+u0HKeYeTMLAgWtIGh3G54m18eMJ6Y46iZl8tNnBb/r+IX9xjUlQMadfHteVT2IYhN3Q= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzuEbRuX4l4MrssWmm04VjUiqn8pfFF1o/gbwNVJK9UW6Rl3p3LaeU1MS5KfcgIm+FxgR82NfZejorBik5hV68= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T08:16:57.605 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T08:16:57.606 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T08:16:57.606 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T08:16:57.608 INFO:teuthology.task.internal:Checking packages... 2024-09-10T08:16:57.631 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T08:16:57.632 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T08:16:57.632 INFO:teuthology.packaging:ref: None 2024-09-10T08:16:57.632 INFO:teuthology.packaging:tag: None 2024-09-10T08:16:57.632 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:16:57.632 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:16:57.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:16:57.785 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T08:16:57.787 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T08:16:57.796 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T08:16:57.796 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T08:16:57.829 INFO:teuthology.task.internal:Saving configuration 2024-09-10T08:16:57.845 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T08:16:57.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T08:16:57.885 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:11:59.814580', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlYPsE/lrQmOaIUu/p+u0HKeYeTMLAgWtIGh3G54m18eMJ6Y46iZl8tNnBb/r+IX9xjUlQMadfHteVT2IYhN3Q='} 2024-09-10T08:16:57.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:11:59.815615', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzuEbRuX4l4MrssWmm04VjUiqn8pfFF1o/gbwNVJK9UW6Rl3p3LaeU1MS5KfcgIm+FxgR82NfZejorBik5hV68='} 2024-09-10T08:16:57.902 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T08:16:57.914 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T08:16:57.914 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T08:16:57.914 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T08:16:57.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f04cc6afbe0>, signals=[15]) 2024-09-10T08:16:57.988 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T08:16:57.998 INFO:teuthology.task.internal:Opening connections... 2024-09-10T08:16:57.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:16:58.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:16:58.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:16:58.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:16:58.150 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T08:16:58.162 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-10T08:16:58.180 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-10T08:16:58.180 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:16:58.237 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:16:58.238 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:16:58.239 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-10T08:16:58.274 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-10T08:16:58.293 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-10T08:16:58.293 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:16:58.351 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:16:58.352 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:16:58.352 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-10T08:16:58.390 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T08:16:58.402 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T08:16:58.436 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T08:16:58.436 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:16:58.439 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:16:58.457 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T08:16:58.469 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T08:16:58.470 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:16:58.497 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:16:58.522 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T08:16:58.579 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T08:16:58.598 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T08:16:58.598 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-10T08:16:58.599 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-10T08:16:58.599 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:16:58.599 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:16:58.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:16:58.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T08:16:58.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:16:58.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T08:16:58.827 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:16:58.827 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T08:16:58.827 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-10T08:16:58.836 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:16:58.836 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T08:16:58.836 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T08:16:58.845 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:16:58.845 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:16:58.845 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T08:16:58.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum upgrade -y linux-firmware 2024-09-10T08:16:58.853 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:16:58.853 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:16:58.854 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T08:16:58.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum upgrade -y linux-firmware 2024-09-10T08:17:00.943 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-10T08:17:03.182 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-10T08:17:06.027 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-10T08:17:10.837 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.5 MB 00:00 2024-09-10T08:17:11.623 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-10T08:17:13.179 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-10T08:17:13.908 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 38 MB/s | 23 MB 00:00 2024-09-10T08:17:16.057 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T08:17:17.591 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-10T08:17:18.462 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T08:17:19.439 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T08:17:21.612 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-10T08:17:21.613 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-10T08:17:21.613 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-10T08:17:21.724 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T08:17:21.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:17:21.882 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T08:17:21.883 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T08:17:21.888 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi052.front.sepia.ceph.com to complete... 2024-09-10T08:17:23.934 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-10T08:17:26.038 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-10T08:17:26.039 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-10T08:17:26.039 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-10T08:17:26.217 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T08:17:26.218 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:17:26.360 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T08:17:26.360 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T08:17:26.363 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi176.front.sepia.ceph.com to complete... 2024-09-10T08:17:28.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10 08:17:28 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T08:17:28.833 INFO:teuthology.orchestra.run.smithi052.stderr:FINISHED --2024-09-10 08:17:28-- 2024-09-10T08:17:28.833 INFO:teuthology.orchestra.run.smithi052.stderr:Total wall clock time: 6.9s 2024-09-10T08:17:28.834 INFO:teuthology.orchestra.run.smithi052.stderr:Downloaded: 1 files, 343M in 6.6s (51.8 MB/s) 2024-09-10T08:17:28.836 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T08:17:28.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T08:17:31.060 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying... ######################################## 2024-09-10T08:17:31.234 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing... ######################################## 2024-09-10T08:17:31.345 INFO:teuthology.orchestra.run.smithi052.stdout:Updating / installing... 2024-09-10T08:17:34.104 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10 08:17:34 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T08:17:34.105 INFO:teuthology.orchestra.run.smithi176.stderr:FINISHED --2024-09-10 08:17:34-- 2024-09-10T08:17:34.105 INFO:teuthology.orchestra.run.smithi176.stderr:Total wall clock time: 7.7s 2024-09-10T08:17:34.105 INFO:teuthology.orchestra.run.smithi176.stderr:Downloaded: 1 files, 343M in 7.3s (47.0 MB/s) 2024-09-10T08:17:34.108 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T08:17:34.108 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T08:17:36.266 INFO:teuthology.orchestra.run.smithi176.stdout:Verifying... ######################################## 2024-09-10T08:17:36.512 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing... ######################################## 2024-09-10T08:17:36.633 INFO:teuthology.orchestra.run.smithi176.stdout:Updating / installing... 2024-09-10T08:17:39.701 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T08:17:44.629 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T08:18:19.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T08:18:19.715 DEBUG:teuthology.orchestra.run.smithi052:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T08:18:19.795 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:19.795 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:19.795 INFO:teuthology.orchestra.run.smithi052.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T08:18:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T08:18:19.797 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T08:18:19.798 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T08:18:19.799 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T08:18:19.800 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T08:18:19.800 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T08:18:19.800 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T08:18:19.800 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T08:18:19.800 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T08:18:19.801 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T08:18:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T08:18:19.803 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T08:18:19.804 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T08:18:19.805 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T08:18:19.806 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T08:18:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T08:18:19.808 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T08:18:19.808 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T08:18:19.808 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T08:18:19.808 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T08:18:19.808 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T08:18:19.809 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T08:18:19.810 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T08:18:19.811 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T08:18:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T08:18:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T08:18:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T08:18:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T08:18:19.812 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T08:18:19.813 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T08:18:19.814 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T08:18:19.815 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T08:18:19.816 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T08:18:19.817 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T08:18:19.818 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T08:18:19.819 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T08:18:19.820 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T08:18:19.821 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T08:18:19.822 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T08:18:19.823 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T08:18:19.824 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T08:18:19.825 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T08:18:19.826 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T08:18:19.827 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T08:18:19.828 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T08:18:19.829 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T08:18:19.830 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T08:18:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T08:18:19.832 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T08:18:19.833 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T08:18:19.834 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T08:18:19.835 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T08:18:19.836 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T08:18:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T08:18:19.838 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T08:18:19.839 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T08:18:19.840 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T08:18:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T08:18:19.842 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T08:18:19.843 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T08:18:19.844 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T08:18:19.845 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T08:18:19.846 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T08:18:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T08:18:19.848 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T08:18:19.849 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T08:18:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T08:18:19.851 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T08:18:19.852 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T08:18:19.853 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T08:18:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T08:18:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T08:18:19.856 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T08:18:19.857 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T08:18:19.858 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T08:18:19.859 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T08:18:19.860 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T08:18:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T08:18:19.862 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T08:18:19.863 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T08:18:19.864 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T08:18:19.865 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T08:18:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T08:18:19.867 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T08:18:19.868 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T08:18:19.869 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T08:18:19.870 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T08:18:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T08:18:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T08:18:19.873 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T08:18:19.874 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T08:18:19.875 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T08:18:19.876 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T08:18:19.877 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T08:18:19.878 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T08:18:19.879 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T08:18:19.880 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T08:18:19.881 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T08:18:19.882 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T08:18:19.883 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T08:18:19.884 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T08:18:19.885 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T08:18:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T08:18:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T08:18:19.888 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T08:18:19.889 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T08:18:19.890 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T08:18:19.891 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T08:18:19.892 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T08:18:19.893 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T08:18:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T08:18:19.895 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T08:18:19.896 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T08:18:19.897 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T08:18:19.898 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T08:18:19.899 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T08:18:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T08:18:19.901 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T08:18:19.902 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T08:18:19.903 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T08:18:19.904 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T08:18:19.905 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T08:18:19.906 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T08:18:19.907 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T08:18:19.908 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T08:18:19.909 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T08:18:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T08:18:19.911 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T08:18:19.912 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T08:18:19.913 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T08:18:19.914 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T08:18:19.915 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T08:18:19.916 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T08:18:19.917 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T08:18:19.918 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T08:18:19.919 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T08:18:19.920 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T08:18:19.921 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T08:18:19.922 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T08:18:19.923 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T08:18:19.924 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T08:18:19.925 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T08:18:19.926 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T08:18:19.927 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T08:18:19.928 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T08:18:19.929 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T08:18:19.930 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T08:18:19.931 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T08:18:19.932 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T08:18:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T08:18:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T08:18:19.935 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T08:18:19.936 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T08:18:19.937 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T08:18:19.938 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T08:18:19.939 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T08:18:19.940 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T08:18:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T08:18:19.942 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T08:18:19.943 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T08:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T08:18:19.945 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T08:18:19.946 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T08:18:19.947 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T08:18:19.948 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T08:18:19.949 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T08:18:19.950 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T08:18:19.951 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T08:18:19.952 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T08:18:19.953 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T08:18:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T08:18:19.955 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T08:18:19.956 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T08:18:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T08:18:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T08:18:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T08:18:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T08:18:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T08:18:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T08:18:19.959 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T08:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T08:18:19.961 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T08:18:19.962 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T08:18:19.963 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T08:18:19.964 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T08:18:19.965 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T08:18:19.966 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T08:18:19.967 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T08:18:19.968 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T08:18:19.968 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T08:18:19.968 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T08:18:19.968 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T08:18:19.968 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T08:18:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T08:18:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T08:18:19.971 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T08:18:19.972 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T08:18:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T08:18:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T08:18:19.975 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T08:18:19.976 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T08:18:19.977 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T08:18:19.978 INFO:teuthology.orchestra.run.smithi052.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:18:19.984 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:19.985 DEBUG:teuthology.orchestra.run.smithi052:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T08:18:20.013 INFO:teuthology.orchestra.run.smithi052.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T08:18:20.013 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:18:20.013 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:18:20.013 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout:for file in vmlinuz System.map config; do 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout: fi 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T08:18:20.014 INFO:teuthology.orchestra.run.smithi052.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T08:18:20.015 INFO:teuthology.orchestra.run.smithi052.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T08:18:20.016 INFO:teuthology.orchestra.run.smithi052.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:18:20.016 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:20.016 INFO:teuthology.orchestra.run.smithi052.stdout:fi 2024-09-10T08:18:20.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 82.el9 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8274670 2024-09-10T08:18:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:18:20.090 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:18:20.091 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-09-10T08:18:20.091 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:18:20.091 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:18:20.092 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:18:20.092 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:20.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:18:20.671 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-10T08:18:22.103 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:18:22.130 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-10T08:18:22.132 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-10T08:18:22.167 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.IDxN3ikBOB 2024-09-10T08:18:22.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IDxN3ikBOB 2024-09-10T08:18:22.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.IDxN3ikBOB 2024-09-10T08:18:22.372 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.IDxN3ikBOB is 6KB 2024-09-10T08:18:22.420 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.IDxN3ikBOB 2024-09-10T08:18:22.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:18:22.498 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:18:22.498 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:18:22.498 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:18:22.498 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T08:18:22.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:22.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-10T08:18:24.029 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T08:18:24.029 DEBUG:teuthology.orchestra.run.smithi176:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T08:18:24.158 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T08:18:24.159 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T08:18:24.160 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T08:18:24.161 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T08:18:24.162 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T08:18:24.163 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T08:18:24.164 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T08:18:24.165 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T08:18:24.166 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T08:18:24.167 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T08:18:24.168 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T08:18:24.169 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T08:18:24.170 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T08:18:24.171 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T08:18:24.172 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T08:18:24.173 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T08:18:24.174 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T08:18:24.175 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T08:18:24.176 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T08:18:24.177 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T08:18:24.178 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T08:18:24.179 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T08:18:24.180 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T08:18:24.181 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T08:18:24.182 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T08:18:24.183 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T08:18:24.184 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T08:18:24.185 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T08:18:24.186 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T08:18:24.187 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T08:18:24.188 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T08:18:24.189 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T08:18:24.190 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T08:18:24.191 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T08:18:24.192 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T08:18:24.193 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T08:18:24.194 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T08:18:24.195 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T08:18:24.196 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T08:18:24.197 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T08:18:24.198 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T08:18:24.199 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T08:18:24.200 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T08:18:24.201 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T08:18:24.202 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T08:18:24.203 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T08:18:24.204 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T08:18:24.205 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T08:18:24.206 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T08:18:24.207 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T08:18:24.208 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T08:18:24.209 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T08:18:24.209 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T08:18:24.209 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T08:18:24.209 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T08:18:24.212 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T08:18:24.213 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T08:18:24.214 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T08:18:24.215 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T08:18:24.216 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T08:18:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T08:18:24.218 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T08:18:24.219 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T08:18:24.220 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T08:18:24.221 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T08:18:24.222 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T08:18:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T08:18:24.224 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T08:18:24.225 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T08:18:24.226 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T08:18:24.227 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T08:18:24.228 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T08:18:24.229 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T08:18:24.230 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T08:18:24.231 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T08:18:24.232 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T08:18:24.233 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T08:18:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T08:18:24.235 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T08:18:24.236 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T08:18:24.237 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T08:18:24.238 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T08:18:24.239 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T08:18:24.240 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T08:18:24.241 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T08:18:24.242 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T08:18:24.243 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T08:18:24.244 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T08:18:24.245 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T08:18:24.246 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T08:18:24.247 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T08:18:24.248 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T08:18:24.249 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T08:18:24.250 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T08:18:24.251 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T08:18:24.252 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T08:18:24.253 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T08:18:24.254 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T08:18:24.255 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T08:18:24.256 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T08:18:24.257 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T08:18:24.258 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T08:18:24.259 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T08:18:24.260 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T08:18:24.261 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T08:18:24.262 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T08:18:24.263 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T08:18:24.264 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T08:18:24.265 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T08:18:24.266 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T08:18:24.267 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T08:18:24.268 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T08:18:24.269 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T08:18:24.270 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T08:18:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T08:18:24.272 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T08:18:24.273 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T08:18:24.274 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T08:18:24.275 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T08:18:24.276 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T08:18:24.277 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T08:18:24.278 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T08:18:24.279 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T08:18:24.280 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T08:18:24.281 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T08:18:24.282 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T08:18:24.283 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T08:18:24.284 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T08:18:24.285 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T08:18:24.286 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T08:18:24.287 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T08:18:24.288 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T08:18:24.289 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T08:18:24.290 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T08:18:24.291 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T08:18:24.292 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T08:18:24.293 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T08:18:24.294 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T08:18:24.295 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T08:18:24.296 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T08:18:24.297 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T08:18:24.298 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T08:18:24.299 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T08:18:24.300 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T08:18:24.301 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T08:18:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T08:18:24.303 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T08:18:24.304 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T08:18:24.305 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T08:18:24.306 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T08:18:24.307 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T08:18:24.308 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T08:18:24.309 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T08:18:24.310 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T08:18:24.311 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T08:18:24.312 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T08:18:24.313 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T08:18:24.314 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T08:18:24.315 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T08:18:24.316 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T08:18:24.317 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T08:18:24.318 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T08:18:24.319 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T08:18:24.320 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T08:18:24.321 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T08:18:24.322 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T08:18:24.323 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T08:18:24.324 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T08:18:24.325 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T08:18:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T08:18:24.327 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T08:18:24.328 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T08:18:24.329 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T08:18:24.330 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T08:18:24.331 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T08:18:24.332 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T08:18:24.333 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T08:18:24.334 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T08:18:24.335 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T08:18:24.336 INFO:teuthology.orchestra.run.smithi176.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:18:24.340 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.340 DEBUG:teuthology.orchestra.run.smithi176:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T08:18:24.364 INFO:teuthology.orchestra.run.smithi176.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T08:18:24.364 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:18:24.364 INFO:teuthology.orchestra.run.smithi176.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:18:24.364 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-10T08:18:24.364 INFO:teuthology.orchestra.run.smithi176.stdout:for file in vmlinuz System.map config; do 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: fi 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout:done 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T08:18:24.365 INFO:teuthology.orchestra.run.smithi176.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.366 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-10T08:18:24.366 INFO:teuthology.orchestra.run.smithi176.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T08:18:24.366 INFO:teuthology.orchestra.run.smithi176.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:18:24.366 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.366 INFO:teuthology.orchestra.run.smithi176.stdout:fi 2024-09-10T08:18:24.367 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-10T08:18:24.441 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:18:24.442 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:18:24.443 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-10T08:18:24.444 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:18:24.444 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:18:24.445 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:18:24.445 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:24.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:18:25.011 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-10T08:18:26.410 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:18:26.426 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-10T08:18:26.429 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-10T08:18:26.444 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.KReSQQfSS9 2024-09-10T08:18:26.444 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KReSQQfSS9 2024-09-10T08:18:26.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.KReSQQfSS9 2024-09-10T08:18:26.660 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.KReSQQfSS9 is 6KB 2024-09-10T08:18:26.708 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.KReSQQfSS9 2024-09-10T08:18:26.724 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:18:26.786 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:18:26.786 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:18:26.786 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:18:26.786 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T08:18:26.787 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:18:26.936 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-10T08:18:52.692 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T08:18:52.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:18:52.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:18:56.943 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T08:18:56.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:18:56.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:19:11.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-09-10T08:19:15.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-10T08:19:20.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:19:20.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:19:24.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:19:24.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:19:27.457 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-10T08:19:39.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:19:39.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:11.333 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-10T08:20:11.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:20:11.872 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T08:20:11.873 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-10T08:20:11.907 INFO:teuthology.orchestra.run.smithi176.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:20:11.907 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:20:11.907 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:20:11.907 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:20:12.909 DEBUG:teuthology.parallel:result is None 2024-09-10T08:20:20.045 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T08:20:32.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:20:32.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:20:32.399 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T08:20:32.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:20:32.838 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T08:20:32.838 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-10T08:20:32.872 INFO:teuthology.orchestra.run.smithi052.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:20:32.873 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:20:32.873 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:20:32.873 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:20:33.876 DEBUG:teuthology.parallel:result is None 2024-09-10T08:20:33.876 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T08:20:33.884 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T08:20:33.884 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:20:33.888 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:20:33.930 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T08:20:33.938 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T08:20:34.000 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T08:20:34.000 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:20:34.005 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:20:34.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T08:20:34.085 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T08:20:34.085 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:20:34.091 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:20:34.175 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:20:34.203 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:20:34.217 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:20:34.242 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:20:34.245 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T08:20:34.256 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T08:20:34.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:20:34.261 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:20:34.318 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T08:20:34.327 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T08:20:34.328 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:20:34.331 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:20:34.365 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:20:34.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:20:34.539 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:20:34.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:20:34.674 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:20:34.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:20:34.729 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:20:34.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:20:34.873 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:20:34.937 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:20:35.006 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:20:35.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:20:35.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-10T08:20:35.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-10T08:20:35.146 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:20:35.192 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:20:35.708 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T08:20:35.717 INFO:teuthology.task.internal:Starting timer... 2024-09-10T08:20:35.717 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T08:20:35.768 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T08:20:35.809 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-10T08:20:35.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-10T08:20:35.884 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-10T08:20:35.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-10T08:20:35.972 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-10T08:20:35.975 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T08:20:35.975 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-10T08:20:36.013 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-10T08:20:36.013 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-10T08:20:36.050 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-10T08:20:36.050 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-10T08:20:36.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:20:36.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:20:36.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:20:36.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:20:36.170 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T08:20:36.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:20:36.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:20:36.299 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T08:20:36.310 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T08:20:36.313 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T08:20:36.424 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T08:20:36.437 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T08:20:36.438 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T08:25:19.755 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-10T08:25:19.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:25:19.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:25:19.851 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T08:25:19.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T08:25:19.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:25:19.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:25:20.058 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-10T08:25:20.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-10T08:25:20.167 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T08:25:20.177 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T08:25:20.177 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:25:20.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:25:20.182 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:25:20.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:25:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:25:20.267 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:25:20.274 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:25:20.297 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:25:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-10T08:25:20.348 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-10T08:25:20.350 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-10T08:25:20.374 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-10T08:25:20.379 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:25:20.403 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:25:20.408 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:25:20.432 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:25:20.500 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.507 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.532 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:25:20.538 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:25:20.539 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-10T08:25:20.539 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.539 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.539 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.539 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:25:20.540 INFO:teuthology.run_tasks:Running task install... 2024-09-10T08:25:20.548 DEBUG:teuthology.task.install:project ceph 2024-09-10T08:25:20.548 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T08:25:20.548 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T08:25:20.549 INFO:teuthology.task.install:Using flavor: default 2024-09-10T08:25:20.554 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T08:25:20.554 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T08:25:20.554 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:25:20.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:25:20.557 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:25:20.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:25:20.706 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:25:20.707 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:25:20.719 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:25:20.719 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:25:20.818 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:25:20.818 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:25:20.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:25:20.830 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:25:20.831 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:25:20.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:25:20.876 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:25:20.876 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:25:20.887 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:25:20.887 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:25:20.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:25:20.984 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:25:21.053 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:25:21.062 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:25:21.108 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-10T08:25:21.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-10T08:25:21.116 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-10T08:25:21.119 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-10T08:25:21.383 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-10T08:25:21.389 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-10T08:25:21.416 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:25:21.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:25:22.085 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T08:25:22.119 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-10T08:25:22.369 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T08:25:22.420 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-10T08:25:22.645 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T08:25:22.704 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-10T08:25:24.403 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-10T08:25:24.404 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T08:25:38.528 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 20 MB 00:12 2024-09-10T08:25:43.170 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-10T08:25:44.528 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-10T08:25:46.288 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-10T08:25:47.083 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T08:25:49.296 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-10T08:25:50.996 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-10T08:25:51.800 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T08:25:53.431 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-10T08:25:55.921 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:25:55.922 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:25:55.936 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:25:55.937 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:25:55.938 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:25:55.939 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:25:55.941 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:25:55.944 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:25:55.945 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:25:56.011 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-10T08:25:56.046 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-10T08:25:56.046 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-10T08:25:56.046 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-10T08:25:56.046 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:25:56.047 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:25:56.048 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:25:56.049 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:25:56.050 INFO:teuthology.orchestra.run.smithi176.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:25:56.051 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:25:56.052 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:25:56.053 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:25:56.054 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:25:56.055 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:25:56.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:25:56.057 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:25:56.058 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:25:56.059 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:25:56.060 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout:Install 148 Packages 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 8 Packages 2024-09-10T08:25:56.061 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:25:56.062 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 226 M 2024-09-10T08:25:56.062 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-10T08:25:56.857 INFO:teuthology.orchestra.run.smithi176.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-10T08:25:57.158 INFO:teuthology.orchestra.run.smithi176.stdout:(2/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-10T08:25:57.199 INFO:teuthology.orchestra.run.smithi176.stdout:(3/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 2.6 MB/s | 897 kB 00:00 2024-09-10T08:25:57.225 INFO:teuthology.orchestra.run.smithi176.stdout:(4/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T08:25:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-10T08:25:57.625 INFO:teuthology.orchestra.run.smithi176.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 5.6 MB/s | 2.4 MB 00:00 2024-09-10T08:25:57.876 INFO:teuthology.orchestra.run.smithi176.stdout:(7/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 18 MB/s | 21 MB 00:01 2024-09-10T08:25:57.959 INFO:teuthology.orchestra.run.smithi176.stdout:(8/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 7.7 MB/s | 4.7 MB 00:00 2024-09-10T08:25:58.018 INFO:teuthology.orchestra.run.smithi176.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 432 kB/s | 25 kB 00:00 2024-09-10T08:25:58.399 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-09-10T08:25:58.418 INFO:teuthology.orchestra.run.smithi176.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 20 MB/s | 11 MB 00:00 2024-09-10T08:25:58.468 INFO:teuthology.orchestra.run.smithi176.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 4.5 MB/s | 228 kB 00:00 2024-09-10T08:25:58.535 INFO:teuthology.orchestra.run.smithi176.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 407 kB/s | 27 kB 00:00 2024-09-10T08:25:58.635 INFO:teuthology.orchestra.run.smithi176.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 318 kB/s | 32 kB 00:00 2024-09-10T08:25:58.719 INFO:teuthology.orchestra.run.smithi176.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-10T08:25:58.794 INFO:teuthology.orchestra.run.smithi176.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.1 MB/s | 164 kB 00:00 2024-09-10T08:25:58.880 INFO:teuthology.orchestra.run.smithi176.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 1.5 MB/s | 127 kB 00:00 2024-09-10T08:25:59.047 INFO:teuthology.orchestra.run.smithi176.stdout:(17/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 12 MB/s | 17 MB 00:01 2024-09-10T08:25:59.081 INFO:teuthology.orchestra.run.smithi176.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 2.5 MB/s | 506 kB 00:00 2024-09-10T08:25:59.148 INFO:teuthology.orchestra.run.smithi176.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 678 kB/s | 45 kB 00:00 2024-09-10T08:25:59.231 INFO:teuthology.orchestra.run.smithi176.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.6 MB/s | 136 kB 00:00 2024-09-10T08:25:59.340 INFO:teuthology.orchestra.run.smithi176.stdout:(21/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-10T08:25:59.365 INFO:teuthology.orchestra.run.smithi176.stdout:(22/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.2 MB/s | 161 kB 00:00 2024-09-10T08:25:59.398 INFO:teuthology.orchestra.run.smithi176.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T08:25:59.423 INFO:teuthology.orchestra.run.smithi176.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.0 MB/s | 301 kB 00:00 2024-09-10T08:25:59.457 INFO:teuthology.orchestra.run.smithi176.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T08:25:59.483 INFO:teuthology.orchestra.run.smithi176.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-10T08:25:59.550 INFO:teuthology.orchestra.run.smithi176.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-10T08:25:59.658 INFO:teuthology.orchestra.run.smithi176.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-10T08:25:59.683 INFO:teuthology.orchestra.run.smithi176.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 239 kB/s | 32 kB 00:00 2024-09-10T08:25:59.725 INFO:teuthology.orchestra.run.smithi176.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.2 MB/s | 146 kB 00:00 2024-09-10T08:26:00.326 INFO:teuthology.orchestra.run.smithi176.stdout:(31/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 21 MB/s | 49 MB 00:02 2024-09-10T08:26:00.393 INFO:teuthology.orchestra.run.smithi176.stdout:(32/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 5.0 MB/s | 3.6 MB 00:00 2024-09-10T08:26:00.418 INFO:teuthology.orchestra.run.smithi176.stdout:(33/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.7 MB/s | 249 kB 00:00 2024-09-10T08:26:00.435 INFO:teuthology.orchestra.run.smithi176.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 1.2 MB/s | 49 kB 00:00 2024-09-10T08:26:00.460 INFO:teuthology.orchestra.run.smithi176.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 395 kB/s | 16 kB 00:00 2024-09-10T08:26:00.560 INFO:teuthology.orchestra.run.smithi176.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 2.2 MB/s | 285 kB 00:00 2024-09-10T08:26:00.594 INFO:teuthology.orchestra.run.smithi176.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 5.6 MB/s | 766 kB 00:00 2024-09-10T08:26:00.611 INFO:teuthology.orchestra.run.smithi176.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 364 kB/s | 18 kB 00:00 2024-09-10T08:26:00.703 INFO:teuthology.orchestra.run.smithi176.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.5 MB/s | 7.4 MB 00:00 2024-09-10T08:26:01.004 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:26:01.005 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:26:01.017 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:26:01.018 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:26:01.019 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:26:01.020 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:26:01.022 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:26:01.025 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:26:01.025 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:26:01.045 INFO:teuthology.orchestra.run.smithi176.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 177 kB/s | 80 kB 00:00 2024-09-10T08:26:01.096 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:26:01.120 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:26:01.121 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:26:01.122 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:26:01.123 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:26:01.124 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:26:01.125 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:26:01.126 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:26:01.127 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:26:01.128 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:26:01.129 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:26:01.130 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:26:01.131 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:26:01.132 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:26:01.133 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:Install 148 Packages 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 8 Packages 2024-09-10T08:26:01.134 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:26:01.135 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 226 M 2024-09-10T08:26:01.135 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-10T08:26:01.228 INFO:teuthology.orchestra.run.smithi176.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 364 kB/s | 191 kB 00:00 2024-09-10T08:26:01.329 INFO:teuthology.orchestra.run.smithi176.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 894 kB/s | 253 kB 00:00 2024-09-10T08:26:01.370 INFO:teuthology.orchestra.run.smithi176.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-10T08:26:01.437 INFO:teuthology.orchestra.run.smithi176.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-10T08:26:01.479 INFO:teuthology.orchestra.run.smithi176.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T08:26:01.555 INFO:teuthology.orchestra.run.smithi176.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-10T08:26:01.588 INFO:teuthology.orchestra.run.smithi176.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-10T08:26:01.672 INFO:teuthology.orchestra.run.smithi176.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-10T08:26:01.756 INFO:teuthology.orchestra.run.smithi176.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-10T08:26:01.781 INFO:teuthology.orchestra.run.smithi176.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-09-10T08:26:01.823 INFO:teuthology.orchestra.run.smithi176.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-10T08:26:01.848 INFO:teuthology.orchestra.run.smithi176.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-10T08:26:01.873 INFO:teuthology.orchestra.run.smithi176.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-10T08:26:01.898 INFO:teuthology.orchestra.run.smithi176.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T08:26:01.924 INFO:teuthology.orchestra.run.smithi176.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-10T08:26:01.949 INFO:teuthology.orchestra.run.smithi176.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T08:26:01.974 INFO:teuthology.orchestra.run.smithi176.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T08:26:01.999 INFO:teuthology.orchestra.run.smithi176.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-09-10T08:26:02.008 INFO:teuthology.orchestra.run.smithi052.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-10T08:26:02.033 INFO:teuthology.orchestra.run.smithi176.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-10T08:26:02.067 INFO:teuthology.orchestra.run.smithi176.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-10T08:26:02.092 INFO:teuthology.orchestra.run.smithi176.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-10T08:26:02.117 INFO:teuthology.orchestra.run.smithi176.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-10T08:26:02.142 INFO:teuthology.orchestra.run.smithi176.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T08:26:02.196 INFO:teuthology.orchestra.run.smithi176.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.3 MB/s | 188 kB 00:00 2024-09-10T08:26:02.226 INFO:teuthology.orchestra.run.smithi176.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 462 kB/s | 38 kB 00:00 2024-09-10T08:26:02.277 INFO:teuthology.orchestra.run.smithi176.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-10T08:26:02.452 INFO:teuthology.orchestra.run.smithi176.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-10T08:26:02.458 INFO:teuthology.orchestra.run.smithi052.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.9 MB/s | 897 kB 00:00 2024-09-10T08:26:02.519 INFO:teuthology.orchestra.run.smithi176.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T08:26:02.550 INFO:teuthology.orchestra.run.smithi052.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.6 MB/s | 145 kB 00:00 2024-09-10T08:26:02.561 INFO:teuthology.orchestra.run.smithi176.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-10T08:26:02.586 INFO:teuthology.orchestra.run.smithi176.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T08:26:02.628 INFO:teuthology.orchestra.run.smithi176.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-10T08:26:02.670 INFO:teuthology.orchestra.run.smithi176.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T08:26:02.687 INFO:teuthology.orchestra.run.smithi176.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T08:26:02.721 INFO:teuthology.orchestra.run.smithi176.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-10T08:26:02.759 INFO:teuthology.orchestra.run.smithi052.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-10T08:26:02.812 INFO:teuthology.orchestra.run.smithi176.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-10T08:26:02.846 INFO:teuthology.orchestra.run.smithi176.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T08:26:02.851 INFO:teuthology.orchestra.run.smithi052.stdout:(5/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-09-10T08:26:02.914 INFO:teuthology.orchestra.run.smithi176.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-10T08:26:02.932 INFO:teuthology.orchestra.run.smithi176.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 307 kB/s | 26 kB 00:00 2024-09-10T08:26:02.943 INFO:teuthology.orchestra.run.smithi052.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-10T08:26:02.947 INFO:teuthology.orchestra.run.smithi176.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 583 kB/s | 19 kB 00:00 2024-09-10T08:26:02.981 INFO:teuthology.orchestra.run.smithi176.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-10T08:26:03.023 INFO:teuthology.orchestra.run.smithi176.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-09-10T08:26:03.106 INFO:teuthology.orchestra.run.smithi176.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-10T08:26:03.132 INFO:teuthology.orchestra.run.smithi176.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-10T08:26:03.157 INFO:teuthology.orchestra.run.smithi176.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-10T08:26:03.182 INFO:teuthology.orchestra.run.smithi176.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T08:26:03.207 INFO:teuthology.orchestra.run.smithi176.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-10T08:26:03.232 INFO:teuthology.orchestra.run.smithi176.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T08:26:03.258 INFO:teuthology.orchestra.run.smithi176.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T08:26:03.283 INFO:teuthology.orchestra.run.smithi176.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-10T08:26:03.308 INFO:teuthology.orchestra.run.smithi176.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T08:26:03.309 INFO:teuthology.orchestra.run.smithi052.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-10T08:26:03.333 INFO:teuthology.orchestra.run.smithi176.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T08:26:03.375 INFO:teuthology.orchestra.run.smithi176.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-10T08:26:03.442 INFO:teuthology.orchestra.run.smithi176.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T08:26:03.467 INFO:teuthology.orchestra.run.smithi176.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-09-10T08:26:03.493 INFO:teuthology.orchestra.run.smithi176.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T08:26:03.518 INFO:teuthology.orchestra.run.smithi176.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-10T08:26:03.543 INFO:teuthology.orchestra.run.smithi052.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 21 MB 00:01 2024-09-10T08:26:03.544 INFO:teuthology.orchestra.run.smithi176.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-10T08:26:03.569 INFO:teuthology.orchestra.run.smithi176.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-10T08:26:03.594 INFO:teuthology.orchestra.run.smithi176.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T08:26:03.610 INFO:teuthology.orchestra.run.smithi052.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 378 kB/s | 25 kB 00:00 2024-09-10T08:26:03.619 INFO:teuthology.orchestra.run.smithi176.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T08:26:03.644 INFO:teuthology.orchestra.run.smithi176.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T08:26:03.670 INFO:teuthology.orchestra.run.smithi176.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-10T08:26:03.904 INFO:teuthology.orchestra.run.smithi176.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-10T08:26:03.970 INFO:teuthology.orchestra.run.smithi176.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T08:26:04.004 INFO:teuthology.orchestra.run.smithi176.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T08:26:04.029 INFO:teuthology.orchestra.run.smithi176.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-10T08:26:04.180 INFO:teuthology.orchestra.run.smithi176.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-10T08:26:04.205 INFO:teuthology.orchestra.run.smithi176.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T08:26:04.222 INFO:teuthology.orchestra.run.smithi176.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-10T08:26:04.247 INFO:teuthology.orchestra.run.smithi176.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T08:26:04.260 INFO:teuthology.orchestra.run.smithi052.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 13 MB/s | 17 MB 00:01 2024-09-10T08:26:04.272 INFO:teuthology.orchestra.run.smithi176.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-10T08:26:04.323 INFO:teuthology.orchestra.run.smithi176.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T08:26:04.356 INFO:teuthology.orchestra.run.smithi176.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T08:26:04.373 INFO:teuthology.orchestra.run.smithi176.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T08:26:04.377 INFO:teuthology.orchestra.run.smithi052.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 9.9 MB/s | 11 MB 00:01 2024-09-10T08:26:04.390 INFO:teuthology.orchestra.run.smithi176.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T08:26:04.402 INFO:teuthology.orchestra.run.smithi052.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.6 MB/s | 228 kB 00:00 2024-09-10T08:26:04.407 INFO:teuthology.orchestra.run.smithi176.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 850 kB/s | 14 kB 00:00 2024-09-10T08:26:04.428 INFO:teuthology.orchestra.run.smithi052.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 542 kB/s | 27 kB 00:00 2024-09-10T08:26:04.432 INFO:teuthology.orchestra.run.smithi176.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T08:26:04.449 INFO:teuthology.orchestra.run.smithi176.stdout:(118/156): lua-devel-5.4.4-4.el9.x86_64.rpm 28 kB/s | 22 kB 00:00 2024-09-10T08:26:04.453 INFO:teuthology.orchestra.run.smithi052.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 630 kB/s | 32 kB 00:00 2024-09-10T08:26:04.491 INFO:teuthology.orchestra.run.smithi176.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.1 MB/s | 358 kB 00:00 2024-09-10T08:26:04.503 INFO:teuthology.orchestra.run.smithi052.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T08:26:04.525 INFO:teuthology.orchestra.run.smithi176.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-09-10T08:26:04.537 INFO:teuthology.orchestra.run.smithi052.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 6.7 MB/s | 751 kB 00:00 2024-09-10T08:26:04.562 INFO:teuthology.orchestra.run.smithi052.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T08:26:04.575 INFO:teuthology.orchestra.run.smithi176.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-10T08:26:04.604 INFO:teuthology.orchestra.run.smithi052.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T08:26:04.608 INFO:teuthology.orchestra.run.smithi176.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T08:26:04.626 INFO:teuthology.orchestra.run.smithi176.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 649 kB/s | 11 kB 00:00 2024-09-10T08:26:04.643 INFO:teuthology.orchestra.run.smithi176.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-10T08:26:04.659 INFO:teuthology.orchestra.run.smithi176.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T08:26:04.663 INFO:teuthology.orchestra.run.smithi052.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 775 kB/s | 45 kB 00:00 2024-09-10T08:26:04.685 INFO:teuthology.orchestra.run.smithi176.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-10T08:26:04.710 INFO:teuthology.orchestra.run.smithi176.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-10T08:26:04.721 INFO:teuthology.orchestra.run.smithi052.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.3 MB/s | 136 kB 00:00 2024-09-10T08:26:04.760 INFO:teuthology.orchestra.run.smithi176.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-10T08:26:04.777 INFO:teuthology.orchestra.run.smithi176.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-10T08:26:04.780 INFO:teuthology.orchestra.run.smithi052.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.7 MB/s | 161 kB 00:00 2024-09-10T08:26:04.811 INFO:teuthology.orchestra.run.smithi176.stdout:(130/156): protobuf-compiler-3.14.0-13.el9.x86_ 757 kB/s | 863 kB 00:01 2024-09-10T08:26:04.837 INFO:teuthology.orchestra.run.smithi176.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-10T08:26:04.878 INFO:teuthology.orchestra.run.smithi176.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.4 MB/s | 272 kB 00:00 2024-09-10T08:26:04.889 INFO:teuthology.orchestra.run.smithi052.stdout:(22/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-10T08:26:04.903 INFO:teuthology.orchestra.run.smithi176.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 714 kB/s | 16 kB 00:00 2024-09-10T08:26:04.914 INFO:teuthology.orchestra.run.smithi052.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 2.3 MB/s | 320 kB 00:00 2024-09-10T08:26:04.929 INFO:teuthology.orchestra.run.smithi176.stdout:(134/156): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-09-10T08:26:04.954 INFO:teuthology.orchestra.run.smithi176.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T08:26:04.956 INFO:teuthology.orchestra.run.smithi052.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 4.4 MB/s | 301 kB 00:00 2024-09-10T08:26:04.979 INFO:teuthology.orchestra.run.smithi176.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-10T08:26:04.981 INFO:teuthology.orchestra.run.smithi052.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.4 MB/s | 99 kB 00:00 2024-09-10T08:26:05.005 INFO:teuthology.orchestra.run.smithi176.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-10T08:26:05.007 INFO:teuthology.orchestra.run.smithi052.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T08:26:05.038 INFO:teuthology.orchestra.run.smithi176.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-09-10T08:26:05.064 INFO:teuthology.orchestra.run.smithi176.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-10T08:26:05.065 INFO:teuthology.orchestra.run.smithi052.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-10T08:26:05.089 INFO:teuthology.orchestra.run.smithi176.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T08:26:05.114 INFO:teuthology.orchestra.run.smithi176.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-10T08:26:05.140 INFO:teuthology.orchestra.run.smithi176.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-10T08:26:05.157 INFO:teuthology.orchestra.run.smithi052.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 348 kB/s | 32 kB 00:00 2024-09-10T08:26:05.164 INFO:teuthology.orchestra.run.smithi176.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T08:26:05.190 INFO:teuthology.orchestra.run.smithi176.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T08:26:05.215 INFO:teuthology.orchestra.run.smithi176.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T08:26:05.216 INFO:teuthology.orchestra.run.smithi052.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-10T08:26:05.240 INFO:teuthology.orchestra.run.smithi176.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T08:26:05.258 INFO:teuthology.orchestra.run.smithi052.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.4 MB/s | 146 kB 00:00 2024-09-10T08:26:05.266 INFO:teuthology.orchestra.run.smithi176.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T08:26:05.316 INFO:teuthology.orchestra.run.smithi176.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T08:26:05.508 INFO:teuthology.orchestra.run.smithi052.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 12 MB/s | 3.6 MB 00:00 2024-09-10T08:26:05.600 INFO:teuthology.orchestra.run.smithi052.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.7 MB/s | 249 kB 00:00 2024-09-10T08:26:05.709 INFO:teuthology.orchestra.run.smithi052.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 456 kB/s | 49 kB 00:00 2024-09-10T08:26:05.750 INFO:teuthology.orchestra.run.smithi176.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-10T08:26:05.801 INFO:teuthology.orchestra.run.smithi052.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 179 kB/s | 16 kB 00:00 2024-09-10T08:26:05.850 INFO:teuthology.orchestra.run.smithi176.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 5.4 MB/s | 3.2 MB 00:00 2024-09-10T08:26:05.893 INFO:teuthology.orchestra.run.smithi052.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-10T08:26:05.918 INFO:teuthology.orchestra.run.smithi052.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 2.4 MB/s | 285 kB 00:00 2024-09-10T08:26:05.968 INFO:teuthology.orchestra.run.smithi052.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 10 MB/s | 766 kB 00:00 2024-09-10T08:26:05.996 INFO:teuthology.orchestra.run.smithi052.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 243 kB/s | 18 kB 00:00 2024-09-10T08:26:06.033 INFO:teuthology.orchestra.run.smithi176.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 223 kB/s | 41 kB 00:00 2024-09-10T08:26:06.119 INFO:teuthology.orchestra.run.smithi052.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-10T08:26:06.234 INFO:teuthology.orchestra.run.smithi176.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 2.5 MB/s | 2.3 MB 00:00 2024-09-10T08:26:06.300 INFO:teuthology.orchestra.run.smithi176.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 931 kB/s | 249 kB 00:00 2024-09-10T08:26:06.368 INFO:teuthology.orchestra.run.smithi176.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-10T08:26:06.518 INFO:teuthology.orchestra.run.smithi176.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 2.4 MB/s | 1.8 MB 00:00 2024-09-10T08:26:06.553 INFO:teuthology.orchestra.run.smithi052.stdout:(40/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 17 MB/s | 49 MB 00:02 2024-09-10T08:26:06.578 INFO:teuthology.orchestra.run.smithi052.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 417 kB/s | 191 kB 00:00 2024-09-10T08:26:06.653 INFO:teuthology.orchestra.run.smithi052.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-10T08:26:06.703 INFO:teuthology.orchestra.run.smithi052.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-10T08:26:06.728 INFO:teuthology.orchestra.run.smithi052.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T08:26:06.754 INFO:teuthology.orchestra.run.smithi052.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T08:26:06.759 INFO:teuthology.orchestra.run.smithi176.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 2.4 MB 00:00 2024-09-10T08:26:06.765 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:26:06.765 INFO:teuthology.orchestra.run.smithi176.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-10T08:26:06.779 INFO:teuthology.orchestra.run.smithi052.stdout:(46/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-10T08:26:06.805 INFO:teuthology.orchestra.run.smithi052.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-10T08:26:06.830 INFO:teuthology.orchestra.run.smithi052.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-10T08:26:07.005 INFO:teuthology.orchestra.run.smithi052.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-10T08:26:07.055 INFO:teuthology.orchestra.run.smithi052.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-10T08:26:07.080 INFO:teuthology.orchestra.run.smithi052.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T08:26:07.122 INFO:teuthology.orchestra.run.smithi052.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-10T08:26:07.156 INFO:teuthology.orchestra.run.smithi052.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-10T08:26:07.182 INFO:teuthology.orchestra.run.smithi052.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T08:26:07.207 INFO:teuthology.orchestra.run.smithi052.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T08:26:07.232 INFO:teuthology.orchestra.run.smithi052.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-10T08:26:07.265 INFO:teuthology.orchestra.run.smithi052.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T08:26:07.291 INFO:teuthology.orchestra.run.smithi052.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-10T08:26:07.366 INFO:teuthology.orchestra.run.smithi052.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-10T08:26:07.416 INFO:teuthology.orchestra.run.smithi052.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 495 kB/s | 24 kB 00:00 2024-09-10T08:26:07.441 INFO:teuthology.orchestra.run.smithi052.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-10T08:26:07.467 INFO:teuthology.orchestra.run.smithi052.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-10T08:26:07.500 INFO:teuthology.orchestra.run.smithi052.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T08:26:07.551 INFO:teuthology.orchestra.run.smithi052.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 776 kB/s | 38 kB 00:00 2024-09-10T08:26:07.567 INFO:teuthology.orchestra.run.smithi052.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T08:26:08.351 INFO:teuthology.orchestra.run.smithi052.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-09-10T08:26:08.818 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-10T08:26:08.998 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-10T08:26:08.998 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-10T08:26:09.135 INFO:teuthology.orchestra.run.smithi052.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-10T08:26:09.624 INFO:teuthology.orchestra.run.smithi052.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-10T08:26:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 2.3 MB/s | 4.9 MB 00:02 2024-09-10T08:26:09.777 INFO:teuthology.orchestra.run.smithi052.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 901 kB/s | 137 kB 00:00 2024-09-10T08:26:09.836 INFO:teuthology.orchestra.run.smithi052.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-10T08:26:09.928 INFO:teuthology.orchestra.run.smithi052.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 956 kB/s | 87 kB 00:00 2024-09-10T08:26:10.353 INFO:teuthology.orchestra.run.smithi052.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-10T08:26:10.420 INFO:teuthology.orchestra.run.smithi052.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-10T08:26:10.562 INFO:teuthology.orchestra.run.smithi052.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-10T08:26:10.712 INFO:teuthology.orchestra.run.smithi052.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-10T08:26:10.779 INFO:teuthology.orchestra.run.smithi052.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-09-10T08:26:10.846 INFO:teuthology.orchestra.run.smithi052.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-09-10T08:26:10.971 INFO:teuthology.orchestra.run.smithi052.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T08:26:11.038 INFO:teuthology.orchestra.run.smithi052.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 523 kB/s | 35 kB 00:00 2024-09-10T08:26:11.356 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-10T08:26:11.356 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-10T08:26:12.514 INFO:teuthology.orchestra.run.smithi052.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-09-10T08:26:12.655 INFO:teuthology.orchestra.run.smithi052.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-10T08:26:12.797 INFO:teuthology.orchestra.run.smithi052.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-10T08:26:12.881 INFO:teuthology.orchestra.run.smithi052.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 928 kB/s | 77 kB 00:00 2024-09-10T08:26:12.956 INFO:teuthology.orchestra.run.smithi052.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 564 kB/s | 42 kB 00:00 2024-09-10T08:26:13.065 INFO:teuthology.orchestra.run.smithi052.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-10T08:26:13.207 INFO:teuthology.orchestra.run.smithi052.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.1 MB/s | 269 kB 00:00 2024-09-10T08:26:13.232 INFO:teuthology.orchestra.run.smithi052.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 952 kB/s | 159 kB 00:00 2024-09-10T08:26:13.308 INFO:teuthology.orchestra.run.smithi052.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 680 kB/s | 51 kB 00:00 2024-09-10T08:26:13.383 INFO:teuthology.orchestra.run.smithi052.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 718 kB/s | 54 kB 00:00 2024-09-10T08:26:13.441 INFO:teuthology.orchestra.run.smithi052.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.2 MB/s | 279 kB 00:00 2024-09-10T08:26:13.516 INFO:teuthology.orchestra.run.smithi052.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 557 kB/s | 42 kB 00:00 2024-09-10T08:26:13.592 INFO:teuthology.orchestra.run.smithi052.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-09-10T08:26:13.759 INFO:teuthology.orchestra.run.smithi052.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-10T08:26:13.784 INFO:teuthology.orchestra.run.smithi052.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.1 MB/s | 221 kB 00:00 2024-09-10T08:26:13.842 INFO:teuthology.orchestra.run.smithi052.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 431 kB/s | 36 kB 00:00 2024-09-10T08:26:13.893 INFO:teuthology.orchestra.run.smithi052.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-10T08:26:13.976 INFO:teuthology.orchestra.run.smithi052.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 697 kB/s | 58 kB 00:00 2024-09-10T08:26:14.069 INFO:teuthology.orchestra.run.smithi052.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-10T08:26:14.113 INFO:teuthology.orchestra.run.smithi052.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 717 kB/s | 96 kB 00:00 2024-09-10T08:26:14.186 INFO:teuthology.orchestra.run.smithi052.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 546 kB/s | 64 kB 00:00 2024-09-10T08:26:14.236 INFO:teuthology.orchestra.run.smithi052.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 358 kB/s | 45 kB 00:00 2024-09-10T08:26:14.795 INFO:teuthology.orchestra.run.smithi052.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-09-10T08:26:14.853 INFO:teuthology.orchestra.run.smithi052.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-10T08:26:14.887 INFO:teuthology.orchestra.run.smithi052.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T08:26:14.937 INFO:teuthology.orchestra.run.smithi052.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 391 kB/s | 19 kB 00:00 2024-09-10T08:26:15.071 INFO:teuthology.orchestra.run.smithi052.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-10T08:26:15.121 INFO:teuthology.orchestra.run.smithi052.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 524 kB/s | 26 kB 00:00 2024-09-10T08:26:15.171 INFO:teuthology.orchestra.run.smithi052.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 972 kB/s | 49 kB 00:00 2024-09-10T08:26:15.196 INFO:teuthology.orchestra.run.smithi052.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-10T08:26:15.238 INFO:teuthology.orchestra.run.smithi052.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 862 kB/s | 863 kB 00:01 2024-09-10T08:26:15.289 INFO:teuthology.orchestra.run.smithi052.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-10T08:26:15.331 INFO:teuthology.orchestra.run.smithi052.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-10T08:26:15.373 INFO:teuthology.orchestra.run.smithi052.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-10T08:26:15.415 INFO:teuthology.orchestra.run.smithi052.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 773 kB/s | 32 kB 00:00 2024-09-10T08:26:15.457 INFO:teuthology.orchestra.run.smithi052.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-10T08:26:15.490 INFO:teuthology.orchestra.run.smithi052.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-10T08:26:15.532 INFO:teuthology.orchestra.run.smithi052.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.8 MB/s | 839 kB 00:00 2024-09-10T08:26:15.566 INFO:teuthology.orchestra.run.smithi052.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-10T08:26:15.591 INFO:teuthology.orchestra.run.smithi052.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-10T08:26:15.625 INFO:teuthology.orchestra.run.smithi052.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T08:26:15.658 INFO:teuthology.orchestra.run.smithi052.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T08:26:15.700 INFO:teuthology.orchestra.run.smithi052.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-09-10T08:26:15.749 INFO:teuthology.orchestra.run.smithi052.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 365 kB/s | 18 kB 00:00 2024-09-10T08:26:15.791 INFO:teuthology.orchestra.run.smithi052.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 557 kB/s | 23 kB 00:00 2024-09-10T08:26:15.834 INFO:teuthology.orchestra.run.smithi052.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 467 kB/s | 19 kB 00:00 2024-09-10T08:26:15.900 INFO:teuthology.orchestra.run.smithi052.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 296 kB/s | 20 kB 00:00 2024-09-10T08:26:15.951 INFO:teuthology.orchestra.run.smithi052.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-10T08:26:15.993 INFO:teuthology.orchestra.run.smithi052.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-10T08:26:16.043 INFO:teuthology.orchestra.run.smithi052.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-10T08:26:16.068 INFO:teuthology.orchestra.run.smithi052.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-10T08:26:16.110 INFO:teuthology.orchestra.run.smithi052.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 868 kB/s | 58 kB 00:00 2024-09-10T08:26:16.152 INFO:teuthology.orchestra.run.smithi052.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-09-10T08:26:16.177 INFO:teuthology.orchestra.run.smithi052.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-10T08:26:16.203 INFO:teuthology.orchestra.run.smithi052.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-10T08:26:16.245 INFO:teuthology.orchestra.run.smithi052.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-09-10T08:26:16.287 INFO:teuthology.orchestra.run.smithi052.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-10T08:26:16.329 INFO:teuthology.orchestra.run.smithi052.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-10T08:26:16.371 INFO:teuthology.orchestra.run.smithi052.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 863 kB/s | 36 kB 00:00 2024-09-10T08:26:16.396 INFO:teuthology.orchestra.run.smithi052.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T08:26:16.421 INFO:teuthology.orchestra.run.smithi052.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T08:26:16.446 INFO:teuthology.orchestra.run.smithi052.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T08:26:16.471 INFO:teuthology.orchestra.run.smithi052.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T08:26:16.513 INFO:teuthology.orchestra.run.smithi052.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 480 kB/s | 20 kB 00:00 2024-09-10T08:26:16.547 INFO:teuthology.orchestra.run.smithi052.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-10T08:26:16.572 INFO:teuthology.orchestra.run.smithi052.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T08:26:16.631 INFO:teuthology.orchestra.run.smithi052.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T08:26:16.848 INFO:teuthology.orchestra.run.smithi052.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T08:26:16.932 INFO:teuthology.orchestra.run.smithi052.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-10T08:26:17.107 INFO:teuthology.orchestra.run.smithi052.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.0 MB/s | 2.3 MB 00:00 2024-09-10T08:26:17.316 INFO:teuthology.orchestra.run.smithi052.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 196 kB/s | 41 kB 00:00 2024-09-10T08:26:17.366 INFO:teuthology.orchestra.run.smithi052.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-10T08:26:17.416 INFO:teuthology.orchestra.run.smithi052.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 3.7 MB/s | 1.8 MB 00:00 2024-09-10T08:26:17.458 INFO:teuthology.orchestra.run.smithi052.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-10T08:26:17.525 INFO:teuthology.orchestra.run.smithi052.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-10T08:26:18.004 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-10T08:26:18.173 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:26:18.228 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:26:18.305 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:26:18.350 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:26:18.382 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:26:18.439 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:26:18.802 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:26:18.899 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:19.044 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:19.075 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:19.188 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:19.229 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:26:19.447 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:26:19.511 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:26:19.538 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:19.688 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:19.714 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:19.773 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:19.798 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:19.841 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:20.078 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:20.272 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:20.485 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:26:20.596 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:20.698 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:20.978 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:21.112 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:26:21.229 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:26:21.279 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:26:21.388 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:26:21.630 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:26:21.685 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:26:21.723 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:26:21.778 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:26:21.816 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:26:21.850 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:26:21.937 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:26:21.967 INFO:teuthology.orchestra.run.smithi052.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-09-10T08:26:21.971 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:26:21.971 INFO:teuthology.orchestra.run.smithi052.stdout:Total 11 MB/s | 226 MB 00:20 2024-09-10T08:26:22.010 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:26:22.046 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:26:22.123 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:26:22.214 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:26:22.250 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:26:22.293 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:26:22.321 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:26:22.412 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:26:22.465 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:26:22.554 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:26:22.714 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:26:22.776 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:26:23.411 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:26:23.509 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:26:23.555 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:26:23.599 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:26:23.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:26:23.689 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:26:23.873 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:26:23.940 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:26:24.000 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:26:24.086 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:26:24.099 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-10T08:26:24.124 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:26:24.160 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:26:24.219 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:26:24.260 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:26:24.297 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-10T08:26:24.297 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-10T08:26:24.304 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:26:24.355 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:26:24.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:26:24.580 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:26:24.623 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:26:24.740 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:26:24.781 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:26:24.822 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:26:24.852 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:26:24.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:26:25.030 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:26:25.185 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:26:25.230 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:26:25.266 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:26:25.325 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:26:25.366 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:26:25.405 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:26:25.443 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:26:25.477 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:26:25.510 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:26:25.553 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:26:25.586 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:26:25.684 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:26:25.736 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:26:25.773 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:26:25.896 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:26:25.970 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:26:26.747 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-10T08:26:26.748 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-10T08:26:26.843 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:26:26.913 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:26:26.947 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:26:27.059 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:26:27.122 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:26:27.174 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:26:27.272 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:26:27.315 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:26:27.557 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:26:27.596 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:26:27.692 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:26:28.490 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:26:28.635 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:26:30.176 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:26:30.276 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:26:30.311 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:26:30.345 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:26:30.684 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:26:30.723 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:30.869 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:30.904 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:26:30.953 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:26:31.478 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:26:31.509 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:31.953 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:26:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-10T08:26:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:26:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:26:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:26:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:26:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:26:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:26:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:26:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:34.510 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:34.549 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:26:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:26:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:26:35.000 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:26:35.068 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:26:35.094 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:35.175 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:35.219 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:26:35.254 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:35.343 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:26:35.349 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:35.349 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:26:35.349 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:26:35.349 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:35.371 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:35.395 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:35.410 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:26:35.799 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:35.969 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:26:36.128 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:26:36.270 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:36.346 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:36.650 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:26:36.801 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:26:36.935 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:26:36.978 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:26:37.022 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:26:37.109 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:26:37.167 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:26:37.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:26:37.260 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:26:37.307 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:26:37.340 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:26:37.455 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:26:37.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:26:37.552 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:26:37.599 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:26:37.682 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:26:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:26:37.759 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:26:37.794 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:26:37.890 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:26:37.947 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:26:38.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:26:38.214 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:26:38.275 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:26:38.954 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:26:39.062 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:26:39.102 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:26:39.147 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:26:39.218 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:26:39.271 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:26:39.476 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:26:39.537 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:26:39.607 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:26:39.694 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:26:39.729 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:26:39.766 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:26:39.825 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:26:39.873 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:26:39.919 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:26:39.981 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:26:40.162 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:26:40.213 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:26:40.265 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:26:40.397 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:26:40.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:26:40.480 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:26:40.510 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:26:40.535 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:26:40.659 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:26:40.827 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:26:40.867 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:26:40.904 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:26:40.947 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:26:41.013 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:26:41.052 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:26:41.097 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:26:41.132 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:26:41.165 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:26:41.209 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:26:41.240 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:26:41.344 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:26:41.400 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:26:41.443 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:26:41.571 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:26:41.640 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:26:42.575 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:26:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:26:42.666 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:26:42.785 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:26:42.849 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:26:42.903 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:26:43.011 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:26:43.051 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:26:43.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:26:43.331 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:26:43.432 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:26:44.287 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:26:44.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:26:46.124 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:26:46.226 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:26:46.263 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:26:46.295 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:26:46.686 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:26:46.731 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:46.897 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:26:46.931 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:26:46.981 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:26:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:26:47.561 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:47.652 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:26:47.679 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:26:48.619 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:48.619 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-10T08:26:48.619 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-10T08:26:48.619 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-10T08:26:48.620 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-10T08:26:48.620 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-10T08:26:48.620 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-10T08:26:48.620 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-10T08:26:48.620 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:48.816 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:26:48.851 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:26:48.851 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:48.851 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:26:48.851 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:50.486 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:26:50.546 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:26:50.546 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:50.547 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:26:50.547 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:26:50.547 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:26:50.547 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:50.578 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:50.618 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:50.804 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:26:50.855 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:26:50.855 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:50.855 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:26:50.855 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:26:50.856 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:26:50.856 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:51.278 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:26:51.329 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:51.338 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:26:51.389 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:51.507 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:26:51.508 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:26:51.508 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:26:51.508 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:26:51.513 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:26:51.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:26:51.572 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:26:51.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:26:51.870 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:26:51.941 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:26:52.027 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:26:52.137 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:26:52.303 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:26:52.355 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:26:52.398 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:26:52.423 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:26:52.930 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:26:52.964 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:26:52.997 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:26:53.064 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:26:53.095 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:26:54.310 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:26:54.363 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:26:55.448 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:26:55.488 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:26:55.627 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:26:55.803 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:26:55.841 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:26:55.892 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:26:55.892 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:55.892 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:26:55.892 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:26:55.892 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:26:55.893 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:55.954 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:26:55.975 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:26:56.083 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:26:56.154 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:26:57.160 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:26:57.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:26:57.245 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:57.294 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:26:57.344 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:26:57.345 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.345 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:26:57.345 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:57.433 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:26:57.485 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:26:57.812 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:26:57.863 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:26:57.863 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:26:57.864 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:26:57.864 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:26:57.864 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:26:57.864 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:02.808 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:27:02.868 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:27:02.919 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:27:02.948 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:27:02.983 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:27:03.212 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:27:03.255 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:27:03.285 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:27:03.316 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:27:03.352 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:27:04.147 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:04.192 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:04.233 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:04.857 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:27:04.857 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-10T08:27:04.857 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-10T08:27:04.858 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:05.083 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:27:05.121 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:27:05.121 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:05.121 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:27:05.121 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:05.504 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:27:05.597 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:27:05.651 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:27:05.764 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:27:05.799 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:27:05.825 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:27:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:27:05.861 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:05.969 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:05.969 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:06.078 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:06.102 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:27:06.117 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:06.117 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:06.363 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:06.473 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:06.547 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:06.750 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:06.750 INFO:teuthology.orchestra.run.smithi176.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T08:27:06.750 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:06.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:27:06.836 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:27:06.837 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:06.837 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:27:06.837 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:27:06.837 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:27:06.837 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:07.102 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:27:07.155 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:27:07.155 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:07.155 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:27:07.155 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:27:07.155 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:27:07.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:07.686 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:27:07.738 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:27:07.738 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:07.738 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:27:07.738 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:27:07.739 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:27:07.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:07.870 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:27:07.933 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:27:08.036 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:27:08.282 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:27:08.341 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:27:08.464 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:27:08.572 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:27:08.751 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:27:08.802 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:27:08.838 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:27:08.896 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:27:09.354 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:27:09.414 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:27:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:27:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:27:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:27:10.867 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:27:10.912 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:27:12.067 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:27:12.095 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:27:12.241 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:27:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:27:12.311 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:27:12.312 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:27:12.324 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:27:12.324 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:27:12.325 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:27:12.326 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:27:12.327 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:27:12.328 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:27:12.329 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:27:12.330 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:27:12.331 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:27:12.332 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:27:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:27:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:27:12.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:27:12.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:27:12.481 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:27:12.534 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:12.598 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:27:12.626 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:27:12.736 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:27:12.810 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:27:13.870 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:27:13.900 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:27:13.953 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:14.001 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:27:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:27:14.052 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:14.052 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:27:14.052 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:14.118 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:27:14.171 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.443 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.444 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.445 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:27:14.446 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:27:14.447 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:27:14.448 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:27:14.449 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:27:14.450 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:27:14.451 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:27:14.452 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:27:14.453 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.454 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:14.455 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-10T08:27:14.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:27:14.730 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:27:14.730 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:27:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:27:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:27:14.731 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:27:14.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:15.115 DEBUG:teuthology.parallel:result is None 2024-09-10T08:27:20.000 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:27:20.042 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:27:20.087 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:27:20.123 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:27:20.191 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:27:20.429 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:27:20.488 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:27:20.544 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:27:20.582 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:27:20.626 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:27:21.614 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:21.666 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:21.710 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:27:23.090 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:27:23.238 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:27:23.291 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:27:23.398 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:27:23.431 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:27:23.465 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:27:23.502 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:27:23.502 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:23.617 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:27:23.617 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:23.726 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:27:23.751 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:27:23.768 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:23.768 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:24.012 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:27:24.012 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:24.138 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:27:24.215 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:24.459 INFO:teuthology.orchestra.run.smithi052.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T08:27:24.459 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:27:29.991 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:27:29.992 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:27:29.993 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:27:29.993 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:27:29.993 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:27:29.993 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:27:30.007 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:27:30.008 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:27:30.009 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:27:30.010 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:27:30.011 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:27:30.012 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:27:30.012 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:27:30.012 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:27:30.012 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:27:30.013 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:27:30.014 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:27:30.015 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:27:30.016 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:27:30.017 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:27:30.018 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:27:30.019 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:27:30.020 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:27:30.021 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:27:30.022 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:27:32.168 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:27:32.168 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:27:32.169 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.170 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.171 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:27:32.172 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:27:32.173 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:27:32.174 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:27:32.175 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:27:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:27:32.177 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.178 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:27:32.179 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:27:32.180 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:27:32.181 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:27:32.181 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:27:32.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:32.181 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-10T08:27:32.870 DEBUG:teuthology.parallel:result is None 2024-09-10T08:27:32.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:27:33.025 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:27:33.076 INFO:teuthology.orchestra.run.smithi052.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:33.076 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:33.077 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:27:33.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:27:33.271 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:27:33.322 INFO:teuthology.orchestra.run.smithi176.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:33.323 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:27:33.323 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:27:33.325 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T08:27:33.325 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:33.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:27:33.385 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:33.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:27:33.447 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T08:27:33.447 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:33.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:27:33.504 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:27:33.600 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:33.600 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:27:33.659 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:27:33.759 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T08:27:33.759 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:33.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:27:33.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:27:33.920 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:33.920 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:27:33.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:27:34.075 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T08:27:34.075 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:34.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:27:34.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:27:34.234 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:34.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:27:34.294 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:27:34.390 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T08:27:34.476 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T08:27:34.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-09-10T08:27:34.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2024-09-10T08:27:34.536 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T08:27:34.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:27:34.540 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:27:34.595 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T08:27:34.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:27:34.600 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:27:34.662 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T08:27:34.663 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T08:27:34.663 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T08:27:34.663 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:34.663 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:27:34.698 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:34.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:34.921 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:34.921 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:27:34.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:35.122 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:27:35.183 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T08:27:35.183 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T08:27:35.183 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916', 'branch': 'wip-rishabh-testing-20240909.165402-squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': None, 'first_in_suite': False, 'job_id': '7898916', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240909.165402-squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240909.165402-squid', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9893, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'sleep_before_teardown': 0, 'subset': '197/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240909.165402-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlYPsE/lrQmOaIUu/p+u0HKeYeTMLAgWtIGh3G54m18eMJ6Y46iZl8tNnBb/r+IX9xjUlQMadfHteVT2IYhN3Q=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzuEbRuX4l4MrssWmm04VjUiqn8pfFF1o/gbwNVJK9UW6Rl3p3LaeU1MS5KfcgIm+FxgR82NfZejorBik5hV68='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_06:58:10', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T08:27:35.184 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:27:35.188 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:27:35.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:27:35.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:27:35.322 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:35.322 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:27:35.359 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:27:35.359 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-10T08:27:35.435 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:27:35.435 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:35.435 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-10T08:27:35.435 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:35.436 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:35.436 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 08:27:24.815309921 +0000 2024-09-10T08:27:35.436 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 08:24:54.562584841 +0000 2024-09-10T08:27:35.436 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 08:24:54.562584841 +0000 2024-09-10T08:27:35.436 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 08:24:54.562584841 +0000 2024-09-10T08:27:35.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:27:35.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:27:35.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:27:35.528 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000221918 s, 2.3 MB/s 2024-09-10T08:27:35.532 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:27:35.570 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-10T08:27:35.650 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 08:27:24.817309894 +0000 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 08:24:55.007578887 +0000 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 08:24:55.007578887 +0000 2024-09-10T08:27:35.651 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 08:24:55.007578887 +0000 2024-09-10T08:27:35.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:27:35.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:27:35.749 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:27:35.749 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00019194 s, 2.7 MB/s 2024-09-10T08:27:35.751 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:27:35.790 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-10T08:27:35.876 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:27:35.876 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:35.876 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 08:27:24.817309894 +0000 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 08:24:55.468572719 +0000 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 08:24:55.468572719 +0000 2024-09-10T08:27:35.877 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 08:24:55.468572719 +0000 2024-09-10T08:27:35.878 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:27:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:27:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:27:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000182163 s, 2.8 MB/s 2024-09-10T08:27:35.977 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:27:36.017 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 08:27:24.818309880 +0000 2024-09-10T08:27:36.096 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 08:24:55.945566337 +0000 2024-09-10T08:27:36.097 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 08:24:55.945566337 +0000 2024-09-10T08:27:36.097 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 08:24:55.945566337 +0000 2024-09-10T08:27:36.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:27:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:27:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:27:36.192 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000175068 s, 2.9 MB/s 2024-09-10T08:27:36.196 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:27:36.233 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:36.233 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:36.233 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:27:36.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:27:36.270 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-10T08:27:36.346 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-10 08:27:07.107713716 +0000 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-10 08:24:52.611040305 +0000 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-10 08:24:52.611040305 +0000 2024-09-10T08:27:36.347 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-10 08:24:52.611040305 +0000 2024-09-10T08:27:36.347 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:27:36.439 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-10T08:27:36.440 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-10T08:27:36.440 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000297733 s, 1.7 MB/s 2024-09-10T08:27:36.442 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:27:36.479 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-10 08:27:07.109713696 +0000 2024-09-10T08:27:36.555 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-10 08:24:53.078035710 +0000 2024-09-10T08:27:36.556 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-10 08:24:53.078035710 +0000 2024-09-10T08:27:36.556 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-10 08:24:53.078035710 +0000 2024-09-10T08:27:36.556 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:27:36.647 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-10T08:27:36.648 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-10T08:27:36.648 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000251881 s, 2.0 MB/s 2024-09-10T08:27:36.650 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:27:36.687 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-10 08:27:07.109713696 +0000 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-10 08:24:53.557030997 +0000 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-10 08:24:53.557030997 +0000 2024-09-10T08:27:36.763 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-10 08:24:53.557030997 +0000 2024-09-10T08:27:36.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:27:36.855 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-10T08:27:36.855 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-10T08:27:36.855 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000257139 s, 2.0 MB/s 2024-09-10T08:27:36.858 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:27:36.894 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-10T08:27:36.970 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:27:36.970 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-10 08:27:07.110713686 +0000 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-10 08:24:54.017026471 +0000 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-10 08:24:54.017026471 +0000 2024-09-10T08:27:36.971 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-10 08:24:54.017026471 +0000 2024-09-10T08:27:36.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:27:37.064 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-10T08:27:37.064 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-10T08:27:37.064 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000295786 s, 1.7 MB/s 2024-09-10T08:27:37.066 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:27:37.102 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:37.103 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:27:37.103 INFO:tasks.ceph:Generating config... 2024-09-10T08:27:37.104 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-10T08:27:37.104 INFO:tasks.ceph:[client] debug client = 20 2024-09-10T08:27:37.104 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T08:27:37.104 INFO:tasks.ceph:[client] pid file = 2024-09-10T08:27:37.105 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-10T08:27:37.105 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-10T08:27:37.105 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T08:27:37.105 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-10T08:27:37.105 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-10T08:27:37.105 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-10T08:27:37.105 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-10T08:27:37.105 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T08:27:37.106 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T08:27:37.107 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T08:27:37.107 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-10T08:27:37.107 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T08:27:37.107 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T08:27:37.108 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-10T08:27:37.108 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T08:27:37.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T08:27:37.230 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T08:27:37.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T08:27:37.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:37.381 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2024-09-10T08:27:37.382 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-10T08:27:37.383 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:37.383 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:27:37.418 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-09-10T08:27:37.538077+0000 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-10T08:27:37.538077+0000 2024-09-10T08:27:37.537 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-09-10T08:27:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-09-10T08:27:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-10T08:27:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2024-09-10T08:27:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2024-09-10T08:27:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T08:27:37.540 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:27:37.574 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4eb61a63-2a53-4336-9780-430e4b9fd90b... 2024-09-10T08:27:37.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:27:37.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:27:37.714 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-10T08:27:37.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.716 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-10T08:27:37.717 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-10T08:27:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-09-10T08:27:37.719 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:37.720 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-10T08:27:37.721 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.722 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: mon down mkfs grace = 300 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on pool no app = False 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:27:37.723 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:27:37.724 INFO:teuthology.orchestra.run.smithi052.stdout: mds cache max size = 1000 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: mds log max segments = 1 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:27:37.725 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-10T08:27:37.726 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.727 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:27:37.728 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-10T08:27:37.729 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.730 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-10T08:27:37.731 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-10T08:27:37.732 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:27:37.733 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:27:37.734 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:27:37.735 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on pool no app = False 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-09-10T08:27:37.736 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-10T08:27:37.737 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds cache max size = 1000 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds log max segments = 1 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:27:37.738 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:27:37.744 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T08:27:37.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T08:27:37.843 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T08:27:37.843 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:37.843 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T08:27:37.877 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:37.878 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T08:27:37.953 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:27:37.953 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:37.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:27:37.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:38.070 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:27:38.070 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:38.145 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:27:38.146 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:38.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:27:38.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:27:38.223 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:27:38.223 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:38.298 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T08:27:38.298 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T08:27:38.298 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:27:38.401 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:27:38.408 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:27:38.529 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:27:38.536 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T08:27:38.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:27:38.641 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:27:38.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T08:27:38.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:27:38.804 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:27:38.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T08:27:38.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:27:38.968 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:27:38.974 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T08:27:39.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:27:39.131 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:27:39.136 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T08:27:39.191 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T08:27:39.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T08:27:39.274 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T08:27:39.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T08:27:39.382 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T08:27:39.410 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T08:27:39.491 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T08:27:39.518 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T08:27:39.598 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T08:27:39.626 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T08:27:39.626 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:27:39.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:39.683 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:39.683 INFO:tasks.ceph:role: osd.0 2024-09-10T08:27:39.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:27:39.683 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:27:39.738 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:39.738 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:39.739 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:39.773 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-10T08:27:39.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-10T08:27:39.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:39.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:39.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:39.977 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:39.977 INFO:tasks.ceph:role: osd.1 2024-09-10T08:27:39.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:27:39.977 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:40.034 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:40.035 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:40.035 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:40.035 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:40.035 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:40.067 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-10T08:27:40.072 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-10T08:27:40.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:40.153 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:40.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:40.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:40.272 INFO:tasks.ceph:role: osd.2 2024-09-10T08:27:40.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:27:40.272 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:27:40.328 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:40.328 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:40.328 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:40.328 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:40.328 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:40.329 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:40.329 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:40.329 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:40.329 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:40.329 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:40.361 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-10T08:27:40.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-10T08:27:40.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:40.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:40.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:40.579 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:40.579 INFO:tasks.ceph:role: osd.3 2024-09-10T08:27:40.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:27:40.579 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:40.636 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:40.669 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-10T08:27:40.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-10T08:27:40.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:40.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:40.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:40.918+0000 7f14d920e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T08:27:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:40.918+0000 7f14d920e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T08:27:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:40.918+0000 7f14d920e640 -1 bdev(0x55fb9c865800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:40.919+0000 7f14d920e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T08:27:44.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T08:27:45.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:45.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:45.102+0000 7fd3ffd89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T08:27:45.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:45.103+0000 7fd3ffd89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T08:27:45.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:45.103+0000 7fd3ffd89640 -1 bdev(0x558555fe5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:45.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:45.103+0000 7fd3ffd89640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T08:27:48.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T08:27:48.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:49.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:49.011+0000 7f0141a2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T08:27:49.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:49.011+0000 7f0141a2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T08:27:49.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:49.011+0000 7f0141a2f640 -1 bdev(0x55624ded1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:49.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:49.012+0000 7f0141a2f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T08:27:52.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T08:27:53.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:27:53.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:53.145+0000 7f213d9b0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T08:27:53.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:53.145+0000 7f213d9b0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T08:27:53.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:53.145+0000 7f213d9b0640 -1 bdev(0x55e4c9fbb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T08:27:53.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:27:53.146+0000 7f213d9b0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T08:27:57.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T08:27:57.221 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:57.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:57.284 INFO:tasks.ceph:role: osd.4 2024-09-10T08:27:57.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:27:57.284 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:27:57.349 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:57.349 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:57.350 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:57.758 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-10T08:27:57.763 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-10T08:27:57.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:57.902 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T08:27:57.968 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:58.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:58.025 INFO:tasks.ceph:role: osd.5 2024-09-10T08:27:58.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:27:58.025 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:58.091 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:58.092 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:58.448 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-10T08:27:58.451 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-10T08:27:58.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:58.539 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T08:27:58.602 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:58.678 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:58.678 INFO:tasks.ceph:role: osd.6 2024-09-10T08:27:58.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:27:58.678 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:58.744 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:58.745 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:58.745 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:58.745 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:59.128 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-10T08:27:59.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-10T08:27:59.132 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:59.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T08:27:59.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T08:27:59.352 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:27:59.352 INFO:tasks.ceph:role: osd.7 2024-09-10T08:27:59.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:27:59.352 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:27:59.415 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:27:59.415 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:27:59.415 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:27:59.416 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:27:59.835 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2024-09-10T08:27:59.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2024-09-10T08:27:59.839 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T08:27:59.980 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T08:28:00.044 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:00.149 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:00.149+0000 7f3c8ac16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T08:28:00.153 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:00.154+0000 7f3c8ac16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T08:28:00.153 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:00.154+0000 7f3c8ac16640 -1 bdev(0x55d9dac9d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:00.154 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:00.154+0000 7f3c8ac16640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T08:28:04.174 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T08:28:04.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:04.323 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:04.323+0000 7f2863839640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T08:28:04.324 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:04.324+0000 7f2863839640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T08:28:04.324 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:04.324+0000 7f2863839640 -1 bdev(0x55bb2d895800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:04.324 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:04.324+0000 7f2863839640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T08:28:05.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:05.189 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:07.855 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T08:28:07.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:08.007 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:08.008+0000 7fe23f5b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T08:28:08.008 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:08.008+0000 7fe23f5b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T08:28:08.008 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:08.008+0000 7fe23f5b2640 -1 bdev(0x55b75d627800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:08.008 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:08.009+0000 7fe23f5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T08:28:11.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T08:28:12.065 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:12.159 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:12.159+0000 7f2d6e71e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T08:28:12.159 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:12.159+0000 7f2d6e71e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T08:28:12.159 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:12.159+0000 7f2d6e71e640 -1 bdev(0x55ee015c9800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T08:28:12.160 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:12.160+0000 7f2d6e71e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T08:28:15.922 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T08:28:15.983 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T08:28:15.983 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:15.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T08:28:16.045 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T08:28:16.144 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T08:28:16.242 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T08:28:16.338 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T08:28:16.434 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T08:28:16.529 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:16.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T08:28:16.624 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:16.625 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T08:28:16.686 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:16.686 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T08:28:16.787 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:16.787 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T08:28:16.893 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:16.893 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T08:28:16.993 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:16.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T08:28:17.101 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:17.101 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T08:28:17.202 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:17.202 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T08:28:17.299 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:17.299 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T08:28:17.341 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:17.341 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T08:28:17.419 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:17.419 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T08:28:17.454 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:17.455 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T08:28:17.529 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T08:28:17.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:28:17.534 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:28:17.587 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-09-10T08:28:17.587 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g== 2024-09-10T08:28:17.587 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA== 2024-09-10T08:28:17.588 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ== 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2024-09-10T08:28:17.589 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA== 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout:[client.2] 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA== 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw== 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout:[client.3] 2024-09-10T08:28:17.590 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA== 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g== 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg== 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ== 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2024-09-10T08:28:17.622 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A== 2024-09-10T08:28:17.623 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA== 2024-09-10T08:28:17.624 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-09-10T08:28:17.625 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw== 2024-09-10T08:28:17.625 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2024-09-10T08:28:17.625 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA== 2024-09-10T08:28:17.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:17.635 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:17.760 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:17.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:17.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:17.867 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:17.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:17.970 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.166 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.264 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:18.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:28:18.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:18.458 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:18.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:18.559 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:28:18.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.660 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.758 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.858 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:18.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:28:19.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.056 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.153 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.257 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.355 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:28:19.457 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T08:28:19.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T08:28:19.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:19.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T08:28:19.676 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T08:28:19.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:19.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T08:28:19.899 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T08:28:19.954 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:28:20.061 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T08:28:20.117 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:20.122 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:28:20.156 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T08:28:20.156 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:28:20.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:28:20.199 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:28:20.199 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:28:20.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:28:20.203 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:28:20.203 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:28:20.203 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:28:20.207 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:28:20.207 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T08:28:20.207 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T08:28:20.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T08:28:20.212 INFO:tasks.ceph.mgr.y:Started 2024-09-10T08:28:20.212 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T08:28:20.212 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T08:28:20.217 INFO:tasks.ceph.mgr.x:Started 2024-09-10T08:28:20.217 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T08:28:20.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T08:28:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.372+0000 7ff8de000640 1 Processor -- start 2024-09-10T08:28:20.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.372+0000 7ff8de000640 1 -- start start 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d80b78a0 con 0x7ff8d80b38a0 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d80cffb0 con 0x7ff8d80b3350 2024-09-10T08:28:20.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.373+0000 7ff8de000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d806c8f0 con 0x7ff8d806bfd0 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50012/0 (socket says 172.21.15.52:50012) 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 learned_addr learned my addr 172.21.15.52:0/1361247113 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 msgr2=0x7ff8d81628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 msgr2=0x7ff8d81628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7400640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7400640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:20.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:20.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d6a00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 msgr2=0x7ff8d81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:28:20.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d6a00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 msgr2=0x7ff8d81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:20.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:20.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:28:20.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.374+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.52:3300/0 conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d6a00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 msgr2=0x7ff8d81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d6a00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 msgr2=0x7ff8d81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7400640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7400640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:28:20.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7400640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d806c3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 msgr2=0x7ff8d81623a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.575+0000 7ff8d7e00640 1 -- 172.21.15.52:0/1361247113 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d80cf710 con 0x7ff8d80b38a0 2024-09-10T08:28:20.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.576+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81628e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80688f0 tx=0x7ff8d002a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f7124931c95c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:20.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.577+0000 7ff8d6000640 1 -- 172.21.15.52:0/1361247113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0030480 con 0x7ff8d80b38a0 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.577+0000 7ff8d6000640 1 -- 172.21.15.52:0/1361247113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d0030620 con 0x7ff8d80b38a0 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.577+0000 7ff8d6000640 1 -- 172.21.15.52:0/1361247113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0030a10 con 0x7ff8d80b38a0 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 -- 172.21.15.52:0/1361247113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d80b38a0 msgr2=0x7ff8d81628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81628e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80688f0 tx=0x7ff8d002a7e0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 -- 172.21.15.52:0/1361247113 shutdown_connections 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 --2- 172.21.15.52:0/1361247113 >> v2:172.21.15.176:3300/0 conn(0x7ff8d80b3350 0x7ff8d81623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81628e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 --2- 172.21.15.52:0/1361247113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d806bfd0 0x7ff8d806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 -- 172.21.15.52:0/1361247113 >> 172.21.15.52:0/1361247113 conn(0x7ff8d80d11c0 msgr2=0x7ff8d80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 -- 172.21.15.52:0/1361247113 shutdown_connections 2024-09-10T08:28:20.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.578+0000 7ff8de000640 1 -- 172.21.15.52:0/1361247113 wait complete. 2024-09-10T08:28:20.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.580+0000 7ff8de000640 1 Processor -- start 2024-09-10T08:28:20.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.580+0000 7ff8de000640 1 -- start start 2024-09-10T08:28:20.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d806bfd0 0x7ff8d8161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d80d2400 con 0x7ff8d806bfd0 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d80cfcd0 con 0x7ff8d80b38a0 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8de000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d806cd50 con 0x7ff8d80b3350 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8d6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8d6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:38532/0 (socket says 172.21.15.52:38532) 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8d6a00640 1 -- 172.21.15.52:0/2348843022 learned_addr learned my addr 172.21.15.52:0/2348843022 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8d7400640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d806bfd0 0x7ff8d8161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.581+0000 7ff8d7e00640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 -- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8d80b38a0 msgr2=0x7ff8d81f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:20.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 -- 172.21.15.52:0/2348843022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d806bfd0 msgr2=0x7ff8d8161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d806bfd0 0x7ff8d8161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 -- 172.21.15.52:0/2348843022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d815fef0 con 0x7ff8d80b3350 2024-09-10T08:28:20.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.582+0000 7ff8d6a00640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400f550 tx=0x7ff8c400fa10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.586+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4019020 con 0x7ff8d80b3350 2024-09-10T08:28:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.586+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c4014890 con 0x7ff8d80b3350 2024-09-10T08:28:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.586+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4014c80 con 0x7ff8d80b3350 2024-09-10T08:28:20.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.586+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d81601d0 con 0x7ff8d80b3350 2024-09-10T08:28:20.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.586+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d8160790 con 0x7ff8d80b3350 2024-09-10T08:28:20.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.588+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d815eae0 con 0x7ff8d80b3350 2024-09-10T08:28:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.592+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff8c401c020 con 0x7ff8d80b3350 2024-09-10T08:28:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.592+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff8c4015410 con 0x7ff8d80b3350 2024-09-10T08:28:20.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.595+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff8c4023020 con 0x7ff8d80b3350 2024-09-10T08:28:20.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.663+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff8d80ba3d0 con 0x7ff8d80b3350 2024-09-10T08:28:20.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.672+0000 7ff8cf400640 1 -- 172.21.15.52:0/2348843022 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff8c4005990 con 0x7ff8d80b3350 2024-09-10T08:28:20.672 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 msgr2=0x7ff8d8150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400f550 tx=0x7ff8c400fa10 comp rx=0 tx=0).stop 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 shutdown_connections 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8d80b38a0 0x7ff8d81f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8d80b3350 0x7ff8d8150ba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 --2- 172.21.15.52:0/2348843022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d806bfd0 0x7ff8d8161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 >> 172.21.15.52:0/2348843022 conn(0x7ff8d80d11c0 msgr2=0x7ff8d8162330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 shutdown_connections 2024-09-10T08:28:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:20.673+0000 7ff8de000640 1 -- 172.21.15.52:0/2348843022 wait complete. 2024-09-10T08:28:20.689 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T08:28:20.690 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T08:28:20.690 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:20.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T08:28:20.698 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:20.697+0000 7fd10d41a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:28:20.711 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:20.711+0000 7fc5c2b88040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:28:20.745 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:20.744+0000 7fd10d41a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:20.746 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:20.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T08:28:20.762 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:20.762+0000 7fc5c2b88040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:20.817 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:20.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T08:28:20.910 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:20.909+0000 7fd10d41a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:28:20.914 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:28:20.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T08:28:20.946 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:20.945+0000 7fc5c2b88040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:28:20.968 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:20.967+0000 7fd10d41a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:28:21.002 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:21.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T08:28:21.008 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.008+0000 7fc5c2b88040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:28:21.061 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:21.061 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T08:28:21.157 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:21.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T08:28:21.164 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:21.163+0000 7fd10d41a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:21.195 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.195+0000 7fc5c2b88040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:21.218 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:28:21.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T08:28:21.298 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:21.297+0000 7fd10d41a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:28:21.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 71611936-9673-4c2d-b97d-5e0f36bda32a 0 2024-09-10T08:28:21.326 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.326+0000 7fc5c2b88040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:28:21.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.505+0000 7f7359000640 1 Processor -- start 2024-09-10T08:28:21.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.505+0000 7f7359000640 1 -- start start 2024-09-10T08:28:21.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.506+0000 7f7359000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73541619b0 0x7f73540b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.506+0000 7f7359000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 0x7f73540d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.506+0000 7f7359000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f735406e100 con 0x7f73540b6630 2024-09-10T08:28:21.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.506+0000 7f7359000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f73540b6aa0 con 0x7f735406dae0 2024-09-10T08:28:21.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.506+0000 7f7359000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f735406dee0 con 0x7f73541619b0 2024-09-10T08:28:21.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73541619b0 0x7f73540b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73541619b0 0x7f73540b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38356/0 (socket says 172.21.15.176:38356) 2024-09-10T08:28:21.508 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 -- 172.21.15.176:0/526756970 learned_addr learned my addr 172.21.15.176:0/526756970 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353e00640 1 --2- 172.21.15.176:0/526756970 >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 0x7f73540d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 -- 172.21.15.176:0/526756970 >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 msgr2=0x7f73540d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 --2- 172.21.15.176:0/526756970 >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 0x7f73540d2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 -- 172.21.15.176:0/526756970 >> v1:172.21.15.52:6789/0 conn(0x7f73540b6630 legacy=0x7f735406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353400640 1 -- 172.21.15.176:0/526756970 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73540d2370 con 0x7f73541619b0 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.507+0000 7f7353e00640 1 --2- 172.21.15.176:0/526756970 >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 0x7f73540d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:21.509 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.508+0000 7f7353400640 1 --2- 172.21.15.176:0/526756970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73541619b0 0x7f73540b60f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73540d1f40 tx=0x7f734402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc33638352cf4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:21.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.508+0000 7f7352a00640 1 -- 172.21.15.176:0/526756970 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344037070 con 0x7f73541619b0 2024-09-10T08:28:21.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.508+0000 7f7352a00640 1 -- 172.21.15.176:0/526756970 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7344032440 con 0x7f73541619b0 2024-09-10T08:28:21.510 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.508+0000 7f7352a00640 1 -- 172.21.15.176:0/526756970 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344032810 con 0x7f73541619b0 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 -- 172.21.15.176:0/526756970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73541619b0 msgr2=0x7f73540b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 --2- 172.21.15.176:0/526756970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73541619b0 0x7f73540b60f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73540d1f40 tx=0x7f734402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 -- 172.21.15.176:0/526756970 shutdown_connections 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 --2- 172.21.15.176:0/526756970 >> v2:172.21.15.52:3300/0 conn(0x7f735406dae0 0x7f73540d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 --2- 172.21.15.176:0/526756970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73541619b0 0x7f73540b60f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 -- 172.21.15.176:0/526756970 >> 172.21.15.176:0/526756970 conn(0x7f73540d10f0 msgr2=0x7f73540d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 -- 172.21.15.176:0/526756970 shutdown_connections 2024-09-10T08:28:21.511 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.509+0000 7f7359000640 1 -- 172.21.15.176:0/526756970 wait complete. 2024-09-10T08:28:21.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.511+0000 7f7359000640 1 Processor -- start 2024-09-10T08:28:21.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.511+0000 7f7359000640 1 -- start start 2024-09-10T08:28:21.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73540b6630 0x7f73540cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.513 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73541619b0 0x7f73540cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73540d2930 con 0x7f73540b6630 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f735406e3e0 con 0x7f735406dae0 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7359000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7354161d90 con 0x7f73541619b0 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38370/0 (socket says 172.21.15.176:38370) 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 -- 172.21.15.176:0/2935250507 learned_addr learned my addr 172.21.15.176:0/2935250507 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f734aa00640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73540b6630 0x7f73540cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353e00640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73541619b0 0x7f73540cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 -- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73541619b0 msgr2=0x7f73540cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73541619b0 0x7f73540cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 -- 172.21.15.176:0/2935250507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73540b6630 msgr2=0x7f73540cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.514 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73540b6630 0x7f73540cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.515 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.512+0000 7f7353400640 1 -- 172.21.15.176:0/2935250507 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7354152bf0 con 0x7f735406dae0 2024-09-10T08:28:21.515 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f7353400640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f73440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344037040 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7344042070 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344030bb0 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7354156410 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7354156130 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7344047460 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.513+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f734403d440 con 0x7f735406dae0 2024-09-10T08:28:21.516 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.514+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73540b60f0 con 0x7f735406dae0 2024-09-10T08:28:21.518 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.517+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7344030d50 con 0x7f735406dae0 2024-09-10T08:28:21.637 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.636+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71611936-9673-4c2d-b97d-5e0f36bda32a", "id": 0} v 0) -- 0x7f73540b8d80 con 0x7f735406dae0 2024-09-10T08:28:21.640 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.640+0000 7f734be00640 1 -- 172.21.15.176:0/2935250507 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71611936-9673-4c2d-b97d-5e0f36bda32a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f73440478e0 con 0x7f735406dae0 2024-09-10T08:28:21.641 INFO:teuthology.orchestra.run.smithi176.stdout:0 2024-09-10T08:28:21.642 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 msgr2=0x7f73540cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.642 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f73440046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 shutdown_connections 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73541619b0 0x7f73540cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73540b6630 0x7f73540cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 --2- 172.21.15.176:0/2935250507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f735406dae0 0x7f73540cbfe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.641+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 >> 172.21.15.176:0/2935250507 conn(0x7f73540d10f0 msgr2=0x7f73540d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.642+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 shutdown_connections 2024-09-10T08:28:21.643 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.642+0000 7f7359000640 1 -- 172.21.15.176:0/2935250507 wait complete. 2024-09-10T08:28:21.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 52c53592-b794-49f6-93a6-17973ccd98bf 1 2024-09-10T08:28:21.717 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:21.716+0000 7fd10d41a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:28:21.729 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.729+0000 7fc5c2b88040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:28:21.779 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:21.778+0000 7fd10d41a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:28:21.788 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.788+0000 7fc5c2b88040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:28:21.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.805+0000 7f4b4f200640 1 Processor -- start 2024-09-10T08:28:21.806 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.805+0000 7f4b4f200640 1 -- start start 2024-09-10T08:28:21.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5006e100 con 0x7f4b500b6630 2024-09-10T08:28:21.807 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b500d2370 con 0x7f4b5006dae0 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b500b6a70 con 0x7f4b501619b0 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4e800640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f4b5006dae0 0x7f4b500d2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:55080/0 (socket says 172.21.15.176:55080) 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43768/0 (socket says 172.21.15.176:43768) 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.806+0000 7f4b4e800640 1 -- 172.21.15.176:0/3096869310 learned_addr learned my addr 172.21.15.176:0/3096869310 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.807+0000 7f4b4de00640 1 -- 172.21.15.176:0/3096869310 >> v1:172.21.15.176:6789/0 conn(0x7f4b5006dae0 legacy=0x7f4b500d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.807+0000 7f4b4de00640 1 -- 172.21.15.176:0/3096869310 >> v1:172.21.15.52:6789/0 conn(0x7f4b500b6630 legacy=0x7f4b5006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.808 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.807+0000 7f4b4de00640 1 -- 172.21.15.176:0/3096869310 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500d2650 con 0x7f4b501619b0 2024-09-10T08:28:21.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.808+0000 7f4b4de00640 1 --2- 172.21.15.176:0/3096869310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b500b6bf0 tx=0x7f4b4002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da4e4ee02d031ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:21.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.808+0000 7f4b4ca00640 1 -- 172.21.15.176:0/3096869310 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40037070 con 0x7f4b501619b0 2024-09-10T08:28:21.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.808+0000 7f4b4ca00640 1 -- 172.21.15.176:0/3096869310 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40032440 con 0x7f4b501619b0 2024-09-10T08:28:21.809 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.808+0000 7f4b4ca00640 1 -- 172.21.15.176:0/3096869310 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40032810 con 0x7f4b501619b0 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 -- 172.21.15.176:0/3096869310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 msgr2=0x7f4b500b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 --2- 172.21.15.176:0/3096869310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b500b6bf0 tx=0x7f4b4002a160 comp rx=0 tx=0).stop 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 -- 172.21.15.176:0/3096869310 shutdown_connections 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 --2- 172.21.15.176:0/3096869310 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500b60f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 -- 172.21.15.176:0/3096869310 >> 172.21.15.176:0/3096869310 conn(0x7f4b500d10f0 msgr2=0x7f4b500d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 -- 172.21.15.176:0/3096869310 shutdown_connections 2024-09-10T08:28:21.810 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.809+0000 7f4b4f200640 1 -- 172.21.15.176:0/3096869310 wait complete. 2024-09-10T08:28:21.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.811+0000 7f4b4f200640 1 Processor -- start 2024-09-10T08:28:21.812 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.812+0000 7f4b4f200640 1 -- start start 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 0x7f4b5015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50161d90 con 0x7f4b5006dae0 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5006e3e0 con 0x7f4b500b6630 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b50161f10 con 0x7f4b501619b0 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.816 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38372/0 (socket says 172.21.15.176:38372) 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4d400640 1 -- 172.21.15.176:0/2576949731 learned_addr learned my addr 172.21.15.176:0/2576949731 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.813+0000 7f4b4de00640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 0x7f4b5015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 -- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 msgr2=0x7f4b500c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 -- 172.21.15.176:0/2576949731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 msgr2=0x7f4b5015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 0x7f4b5015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 -- 172.21.15.176:0/2576949731 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500ac3b0 con 0x7f4b500b6630 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4e800640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4de00640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 0x7f4b5015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4d400640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c430 tx=0x7f4b3c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c017070 con 0x7f4b500b6630 2024-09-10T08:28:21.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c0052d0 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c003830 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.814+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b500ac690 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.815+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b500ca8a0 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.815+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b3c01a070 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.815+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f4b3c011d80 con 0x7f4b500b6630 2024-09-10T08:28:21.818 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.816+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5006e5e0 con 0x7f4b500b6630 2024-09-10T08:28:21.820 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.820+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4b3c011590 con 0x7f4b500b6630 2024-09-10T08:28:21.892 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.891+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52c53592-b794-49f6-93a6-17973ccd98bf", "id": 1} v 0) -- 0x7f4b500b8730 con 0x7f4b500b6630 2024-09-10T08:28:21.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.896+0000 7f4b46000640 1 -- 172.21.15.176:0/2576949731 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52c53592-b794-49f6-93a6-17973ccd98bf", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f4b3c011770 con 0x7f4b500b6630 2024-09-10T08:28:21.897 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-10T08:28:21.898 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 msgr2=0x7f4b500abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:21.898 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c430 tx=0x7f4b3c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 shutdown_connections 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b501619b0 0x7f4b500c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b500b6630 0x7f4b500abcb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 --2- 172.21.15.176:0/2576949731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b5006dae0 0x7f4b5015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.897+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 >> 172.21.15.176:0/2576949731 conn(0x7f4b500d10f0 msgr2=0x7f4b500b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.898+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 shutdown_connections 2024-09-10T08:28:21.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:21.898+0000 7f4b4f200640 1 -- 172.21.15.176:0/2576949731 wait complete. 2024-09-10T08:28:21.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 69446be2-2b12-4e43-925b-7fcda144509e 2 2024-09-10T08:28:21.965 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:21.964+0000 7fd10d41a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:28:21.967 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:21.967+0000 7fc5c2b88040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:28:22.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.062+0000 7f112f000640 1 Processor -- start 2024-09-10T08:28:22.063 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.062+0000 7f112f000640 1 -- start start 2024-09-10T08:28:22.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112f000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f11281619b0 0x7f11280b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112f000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11280b6630 0x7f112806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112806e100 con 0x7f112806d910 2024-09-10T08:28:22.065 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112f000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f11280b6aa0 con 0x7f11281619b0 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112f000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f112806e3e0 con 0x7f11280b6630 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.063+0000 7f112d200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11280b6630 0x7f112806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f11280b6630 0x7f112806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38382/0 (socket says 172.21.15.176:38382) 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 -- 172.21.15.176:0/3394133829 learned_addr learned my addr 172.21.15.176:0/3394133829 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112dc00640 1 --2- 172.21.15.176:0/3394133829 >> v2:172.21.15.52:3300/0 conn(0x7f11281619b0 0x7f11280b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 -- 172.21.15.176:0/3394133829 >> v2:172.21.15.52:3300/0 conn(0x7f11281619b0 msgr2=0x7f11280b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 --2- 172.21.15.176:0/3394133829 >> v2:172.21.15.52:3300/0 conn(0x7f11281619b0 0x7f11280b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 -- 172.21.15.176:0/3394133829 >> v1:172.21.15.52:6789/0 conn(0x7f112806d910 legacy=0x7f11281621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.066 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.064+0000 7f112d200640 1 -- 172.21.15.176:0/3394133829 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11280d2370 con 0x7f11280b6630 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.065+0000 7f112d200640 1 --2- 172.21.15.176:0/3394133829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11280b6630 0x7f112806d3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11280d2190 tx=0x7f111402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f554b339c2364a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.065+0000 7f1127e00640 1 -- 172.21.15.176:0/3394133829 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114037070 con 0x7f11280b6630 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.065+0000 7f1127e00640 1 -- 172.21.15.176:0/3394133829 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114032440 con 0x7f11280b6630 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.065+0000 7f1127e00640 1 -- 172.21.15.176:0/3394133829 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114032810 con 0x7f11280b6630 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 -- 172.21.15.176:0/3394133829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11280b6630 msgr2=0x7f112806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 --2- 172.21.15.176:0/3394133829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11280b6630 0x7f112806d3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11280d2190 tx=0x7f111402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 -- 172.21.15.176:0/3394133829 shutdown_connections 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 --2- 172.21.15.176:0/3394133829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11280b6630 0x7f112806d3d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 --2- 172.21.15.176:0/3394133829 >> v2:172.21.15.52:3300/0 conn(0x7f11281619b0 0x7f11280b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 -- 172.21.15.176:0/3394133829 >> 172.21.15.176:0/3394133829 conn(0x7f11280d10f0 msgr2=0x7f11280d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.068 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 -- 172.21.15.176:0/3394133829 shutdown_connections 2024-09-10T08:28:22.069 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.066+0000 7f112f000640 1 -- 172.21.15.176:0/3394133829 wait complete. 2024-09-10T08:28:22.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.067+0000 7f112f000640 1 Processor -- start 2024-09-10T08:28:22.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 -- start start 2024-09-10T08:28:22.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112806d910 0x7f11280cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.071 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 0x7f112814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f112806dd10 con 0x7f112806d910 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11280d2930 con 0x7f11281619b0 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.068+0000 7f112f000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f112806de90 con 0x7f11280b6630 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 0x7f112814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112806d910 0x7f11280cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43782/0 (socket says 172.21.15.176:43782) 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112d200640 1 -- 172.21.15.176:0/2622893735 learned_addr learned my addr 172.21.15.176:0/2622893735 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.072 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 -- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 msgr2=0x7f11281e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 -- 172.21.15.176:0/2622893735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112806d910 msgr2=0x7f11280cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112806d910 0x7f11280cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 -- 172.21.15.176:0/2622893735 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112814dfe0 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112d200640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.069+0000 7f112e600640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 0x7f112814daa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f112000c690 tx=0x7f112000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120003b70 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1120003d10 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120005310 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11281e74b0 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11281e7a70 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f11200054b0 con 0x7f11281619b0 2024-09-10T08:28:22.073 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.070+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f11200057a0 con 0x7f11281619b0 2024-09-10T08:28:22.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.071+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11280b9ab0 con 0x7f11281619b0 2024-09-10T08:28:22.074 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.073+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f11280b9ab0 con 0x7f11281619b0 2024-09-10T08:28:22.146 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.145+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "69446be2-2b12-4e43-925b-7fcda144509e", "id": 2} v 0) -- 0x7f1128161e20 con 0x7f11281619b0 2024-09-10T08:28:22.150 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.149+0000 7f1125600640 1 -- 172.21.15.176:0/2622893735 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69446be2-2b12-4e43-925b-7fcda144509e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f112814dfe0 con 0x7f11281619b0 2024-09-10T08:28:22.150 INFO:teuthology.orchestra.run.smithi176.stdout:2 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 msgr2=0x7f112814daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 0x7f112814daa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f112000c690 tx=0x7f112000cb50 comp rx=0 tx=0).stop 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 shutdown_connections 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11281619b0 0x7f112814daa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f11280b6630 0x7f11281e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 --2- 172.21.15.176:0/2622893735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112806d910 0x7f11280cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.151 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 >> 172.21.15.176:0/2622893735 conn(0x7f11280d10f0 msgr2=0x7f11280b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.152 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 shutdown_connections 2024-09-10T08:28:22.152 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.150+0000 7f112f000640 1 -- 172.21.15.176:0/2622893735 wait complete. 2024-09-10T08:28:22.165 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 6edb6ab1-d412-42e9-b66c-74e019cd481f 3 2024-09-10T08:28:22.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.317+0000 7f4cd8e00640 1 Processor -- start 2024-09-10T08:28:22.318 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.317+0000 7f4cd8e00640 1 -- start start 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cd8e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4cd40ccf30 0x7f4cd40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cd8e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd40cf2e0 con 0x7f4cd40cead0 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cd8e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd4070fe0 con 0x7f4cd415b7c0 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cd8e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd40712c0 con 0x7f4cd40ccf30 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cc9e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4cd40ccf30 0x7f4cd40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cc9e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4cd40ccf30 0x7f4cd40b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38406/0 (socket says 172.21.15.176:38406) 2024-09-10T08:28:22.319 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.318+0000 7f4cc9e00640 1 -- 172.21.15.176:0/4243760231 learned_addr learned my addr 172.21.15.176:0/4243760231 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.319+0000 7f4cc9e00640 1 -- 172.21.15.176:0/4243760231 >> v1:172.21.15.176:6789/0 conn(0x7f4cd415b7c0 legacy=0x7f4cd40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.319+0000 7f4cc9e00640 1 -- 172.21.15.176:0/4243760231 >> v1:172.21.15.52:6789/0 conn(0x7f4cd40cead0 legacy=0x7f4cd4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.320 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.319+0000 7f4cc9e00640 1 -- 172.21.15.176:0/4243760231 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd40715a0 con 0x7f4cd40ccf30 2024-09-10T08:28:22.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.320+0000 7f4cc9e00640 1 --2- 172.21.15.176:0/4243760231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd40ccf30 0x7f4cd40b2c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009870 tx=0x7f4cc402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb4cf353e4c615c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.320+0000 7f4cd1400640 1 -- 172.21.15.176:0/4243760231 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4037070 con 0x7f4cd40ccf30 2024-09-10T08:28:22.321 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.320+0000 7f4cd1400640 1 -- 172.21.15.176:0/4243760231 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4032440 con 0x7f4cd40ccf30 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.320+0000 7f4cd1400640 1 -- 172.21.15.176:0/4243760231 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4032810 con 0x7f4cd40ccf30 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 -- 172.21.15.176:0/4243760231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd40ccf30 msgr2=0x7f4cd40b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/4243760231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd40ccf30 0x7f4cd40b2c50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009870 tx=0x7f4cc402a210 comp rx=0 tx=0).stop 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 -- 172.21.15.176:0/4243760231 shutdown_connections 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/4243760231 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd40ccf30 0x7f4cd40b2c50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 -- 172.21.15.176:0/4243760231 >> 172.21.15.176:0/4243760231 conn(0x7f4cd406d0f0 msgr2=0x7f4cd406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 -- 172.21.15.176:0/4243760231 shutdown_connections 2024-09-10T08:28:22.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.321+0000 7f4cd8e00640 1 -- 172.21.15.176:0/4243760231 wait complete. 2024-09-10T08:28:22.323 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.322+0000 7f4cd8e00640 1 Processor -- start 2024-09-10T08:28:22.323 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.322+0000 7f4cd8e00640 1 -- start start 2024-09-10T08:28:22.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 0x7f4cd41f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd415b7c0 0x7f4cd4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40cf080 con 0x7f4cd40ccf30 2024-09-10T08:28:22.325 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40cef00 con 0x7f4cd415b7c0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.323+0000 7f4cd8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd40721d0 con 0x7f4cd40cead0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd415b7c0 0x7f4cd4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43786/0 (socket says 172.21.15.176:43786) 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 -- 172.21.15.176:0/812672555 learned_addr learned my addr 172.21.15.176:0/812672555 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cc9e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 0x7f4cd41f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 -- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd415b7c0 msgr2=0x7f4cd4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd415b7c0 0x7f4cd4150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 -- 172.21.15.176:0/812672555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 msgr2=0x7f4cd41f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 0x7f4cd41f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 -- 172.21.15.176:0/812672555 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd414a490 con 0x7f4cd40cead0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cc9e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 0x7f4cd41f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4cd1e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c3c0 tx=0x7f4cbc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.326 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.324+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0052d0 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc005490 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd414a770 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc007260 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd414ad30 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4cbc007400 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.325+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4cbc011590 con 0x7f4cd40cead0 2024-09-10T08:28:22.327 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.326+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd40cfb90 con 0x7f4cd40cead0 2024-09-10T08:28:22.329 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.328+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4cbc020070 con 0x7f4cd40cead0 2024-09-10T08:28:22.402 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.401+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6edb6ab1-d412-42e9-b66c-74e019cd481f", "id": 3} v 0) -- 0x7f4cd40cc960 con 0x7f4cd40cead0 2024-09-10T08:28:22.406 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.405+0000 7f4ccaa00640 1 -- 172.21.15.176:0/812672555 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6edb6ab1-d412-42e9-b66c-74e019cd481f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4cbc003690 con 0x7f4cd40cead0 2024-09-10T08:28:22.407 INFO:teuthology.orchestra.run.smithi176.stdout:3 2024-09-10T08:28:22.407 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 msgr2=0x7f4cd4149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00c3c0 tx=0x7f4cbc00c880 comp rx=0 tx=0).stop 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 shutdown_connections 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd415b7c0 0x7f4cd4150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cd40cead0 0x7f4cd4149b20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 --2- 172.21.15.176:0/812672555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd40ccf30 0x7f4cd41f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 >> 172.21.15.176:0/812672555 conn(0x7f4cd406d0f0 msgr2=0x7f4cd4157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 shutdown_connections 2024-09-10T08:28:22.408 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.407+0000 7f4cd8e00640 1 -- 172.21.15.176:0/812672555 wait complete. 2024-09-10T08:28:22.422 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new e2f37f64-92fa-4e7f-b26b-629c2efc74ba 4 2024-09-10T08:28:22.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.572+0000 7faa9da00640 1 Processor -- start 2024-09-10T08:28:22.573 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.572+0000 7faa9da00640 1 -- start start 2024-09-10T08:28:22.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa9da00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa980b5fd0 0x7faa980d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.574 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa9da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faa980b7c10 0x7faa980b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa9da00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa980d3950 con 0x7faa980b63b0 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa9da00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faa980d3c30 con 0x7faa980b7c10 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa9da00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faa980d3f10 con 0x7faa980b5fd0 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa97e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa980b5fd0 0x7faa980d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa97e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa980b5fd0 0x7faa980d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38422/0 (socket says 172.21.15.176:38422) 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.573+0000 7faa97e00640 1 -- 172.21.15.176:0/2653171292 learned_addr learned my addr 172.21.15.176:0/2653171292 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa9d000640 1 --2- 172.21.15.176:0/2653171292 >> v2:172.21.15.52:3300/0 conn(0x7faa980b7c10 0x7faa980b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa97e00640 1 -- 172.21.15.176:0/2653171292 >> v2:172.21.15.52:3300/0 conn(0x7faa980b7c10 msgr2=0x7faa980b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa97e00640 1 --2- 172.21.15.176:0/2653171292 >> v2:172.21.15.52:3300/0 conn(0x7faa980b7c10 0x7faa980b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa97e00640 1 -- 172.21.15.176:0/2653171292 >> v1:172.21.15.176:6789/0 conn(0x7faa980b63b0 legacy=0x7faa980cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa97e00640 1 -- 172.21.15.176:0/2653171292 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa980d41f0 con 0x7faa980b5fd0 2024-09-10T08:28:22.575 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.574+0000 7faa97400640 1 -- 172.21.15.176:0/2653171292 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900848117 0 0) 0x7faa980d3950 con 0x7faa980b63b0 2024-09-10T08:28:22.576 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.575+0000 7faa97e00640 1 --2- 172.21.15.176:0/2653171292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa980d32c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa980d5620 tx=0x7faa8802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c651c61c2c06f402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.578 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.577+0000 7faa97400640 1 -- 172.21.15.176:0/2653171292 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88037070 con 0x7faa980b5fd0 2024-09-10T08:28:22.578 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.577+0000 7faa97400640 1 -- 172.21.15.176:0/2653171292 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8802ae50 con 0x7faa980b5fd0 2024-09-10T08:28:22.578 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.577+0000 7faa97400640 1 -- 172.21.15.176:0/2653171292 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88032860 con 0x7faa980b5fd0 2024-09-10T08:28:22.579 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 -- 172.21.15.176:0/2653171292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 msgr2=0x7faa980d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.579 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 --2- 172.21.15.176:0/2653171292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa980d32c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa980d5620 tx=0x7faa8802a300 comp rx=0 tx=0).stop 2024-09-10T08:28:22.579 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 -- 172.21.15.176:0/2653171292 shutdown_connections 2024-09-10T08:28:22.579 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 --2- 172.21.15.176:0/2653171292 >> v2:172.21.15.52:3300/0 conn(0x7faa980b7c10 0x7faa980b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.579 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 --2- 172.21.15.176:0/2653171292 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa980d32c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.580 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 -- 172.21.15.176:0/2653171292 >> 172.21.15.176:0/2653171292 conn(0x7faa980d0fd0 msgr2=0x7faa980d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.580 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 -- 172.21.15.176:0/2653171292 shutdown_connections 2024-09-10T08:28:22.580 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.578+0000 7faa9da00640 1 -- 172.21.15.176:0/2653171292 wait complete. 2024-09-10T08:28:22.580 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.580+0000 7faa9da00640 1 Processor -- start 2024-09-10T08:28:22.581 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.580+0000 7faa9da00640 1 -- start start 2024-09-10T08:28:22.583 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.583 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa980b63b0 0x7faa98153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.583 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 0x7faa980ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.583 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa980b6950 con 0x7faa980b63b0 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa980b67d0 con 0x7faa980b5fd0 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa9815e7f0 con 0x7faa980b7c10 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa97e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa97e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38438/0 (socket says 172.21.15.176:38438) 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa97e00640 1 -- 172.21.15.176:0/851779325 learned_addr learned my addr 172.21.15.176:0/851779325 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa9d000640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 0x7faa980ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.581+0000 7faa8fe00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa980b63b0 0x7faa98153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 -- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 msgr2=0x7faa9815b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 -- 172.21.15.176:0/851779325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa980b63b0 msgr2=0x7faa98153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa980b63b0 0x7faa98153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.584 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 -- 172.21.15.176:0/851779325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa98160620 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa97e00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9d000640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 0x7faa980ca420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faa90007d90 tx=0x7faa9000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9000edd0 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa90003990 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa98160890 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90003d80 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.582+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9815abf0 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.583+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa9001b020 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.583+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7faa90014420 con 0x7faa980b7c10 2024-09-10T08:28:22.585 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.583+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa980d32c0 con 0x7faa980b7c10 2024-09-10T08:28:22.586 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.586+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faa90014a60 con 0x7faa980b7c10 2024-09-10T08:28:22.658 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.657+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2f37f64-92fa-4e7f-b26b-629c2efc74ba", "id": 4} v 0) -- 0x7faa980b3d80 con 0x7faa980b7c10 2024-09-10T08:28:22.662 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.661+0000 7faa94c00640 1 -- 172.21.15.176:0/851779325 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2f37f64-92fa-4e7f-b26b-629c2efc74ba", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7faa90014c40 con 0x7faa980b7c10 2024-09-10T08:28:22.662 INFO:teuthology.orchestra.run.smithi176.stdout:4 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 msgr2=0x7faa980ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 0x7faa980ca420 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faa90007d90 tx=0x7faa9000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 shutdown_connections 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa980b7c10 0x7faa980ca420 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa980b63b0 0x7faa98153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.663 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 --2- 172.21.15.176:0/851779325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa980b5fd0 0x7faa9815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.664 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 >> 172.21.15.176:0/851779325 conn(0x7faa980d0fd0 msgr2=0x7faa980d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.664 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 shutdown_connections 2024-09-10T08:28:22.664 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.662+0000 7faa9da00640 1 -- 172.21.15.176:0/851779325 wait complete. 2024-09-10T08:28:22.678 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8c723a8f-71d7-4383-8719-e025137f685c 5 2024-09-10T08:28:22.827 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.826+0000 7f0ccd800640 1 Processor -- start 2024-09-10T08:28:22.827 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.827+0000 7f0ccd800640 1 -- start start 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0ccd800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0cc80b38a0 0x7f0cc80d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0ccd800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc80cf710 con 0x7f0cc80b3350 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0ccd800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc80cf9f0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0ccd800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc80b78a0 con 0x7f0cc80b38a0 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0cc6a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0cc806bfd0 0x7f0cc806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:55100/0 (socket says 172.21.15.176:55100) 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0cc6a00640 1 -- 172.21.15.176:0/864106137 learned_addr learned my addr 172.21.15.176:0/864106137 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-10T08:28:22.829 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0cc7400640 1 --2- 172.21.15.176:0/864106137 >> v2:172.21.15.176:3300/0 conn(0x7f0cc80b38a0 0x7f0cc80d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908858488 0 0) 0x7f0cc80cf9f0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.828+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cac003520 con 0x7f0cc806bfd0 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.829+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027108284 0 0) 0x7f0cc80cf710 con 0x7f0cc80b3350 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.829+0000 7f0cc7400640 1 -- 172.21.15.176:0/864106137 >> v1:172.21.15.176:6789/0 conn(0x7f0cc806bfd0 legacy=0x7f0cc806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.829+0000 7f0cc7400640 1 -- 172.21.15.176:0/864106137 >> v1:172.21.15.52:6789/0 conn(0x7f0cc80b3350 legacy=0x7f0cc80d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.830 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.829+0000 7f0cc7400640 1 -- 172.21.15.176:0/864106137 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80cfcd0 con 0x7f0cc80b38a0 2024-09-10T08:28:22.831 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0cc7400640 1 --2- 172.21.15.176:0/864106137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc80d3030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009d90 tx=0x7f0cc002a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb11abd7fe32199 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.831 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0037070 con 0x7f0cc80b38a0 2024-09-10T08:28:22.831 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0007740 con 0x7f0cc80b38a0 2024-09-10T08:28:22.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0cc5600640 1 -- 172.21.15.176:0/864106137 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0007b10 con 0x7f0cc80b38a0 2024-09-10T08:28:22.832 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0ccd800640 1 -- 172.21.15.176:0/864106137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 msgr2=0x7f0cc80d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0ccd800640 1 --2- 172.21.15.176:0/864106137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc80d3030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009d90 tx=0x7f0cc002a780 comp rx=0 tx=0).stop 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0ccd800640 1 -- 172.21.15.176:0/864106137 shutdown_connections 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0ccd800640 1 --2- 172.21.15.176:0/864106137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc80d3030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.831+0000 7f0ccd800640 1 -- 172.21.15.176:0/864106137 >> 172.21.15.176:0/864106137 conn(0x7f0cc80d11c0 msgr2=0x7f0cc80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.832+0000 7f0ccd800640 1 -- 172.21.15.176:0/864106137 shutdown_connections 2024-09-10T08:28:22.833 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.832+0000 7f0ccd800640 1 -- 172.21.15.176:0/864106137 wait complete. 2024-09-10T08:28:22.834 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.833+0000 7f0ccd800640 1 Processor -- start 2024-09-10T08:28:22.834 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.833+0000 7f0ccd800640 1 -- start start 2024-09-10T08:28:22.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cc80b3350 0x7f0cc8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc81607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:22.835 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc806cd50 con 0x7f0cc80b3350 2024-09-10T08:28:22.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc80cffb0 con 0x7f0cc80b38a0 2024-09-10T08:28:22.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0ccd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc815eae0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0cc6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.834+0000 7f0cc7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc81607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.837 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43810/0 (socket says 172.21.15.176:43810) 2024-09-10T08:28:22.837 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 -- 172.21.15.176:0/2749990069 learned_addr learned my addr 172.21.15.176:0/2749990069 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:22.837 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6000640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cc80b3350 0x7f0cc8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:22.838 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 -- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 msgr2=0x7f0cc81607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.838 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc81607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.838 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 -- 172.21.15.176:0/2749990069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cc80b3350 msgr2=0x7f0cc8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cc80b3350 0x7f0cc8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 -- 172.21.15.176:0/2749990069 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc81610b0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.835+0000 7f0cc6a00640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c430 tx=0x7f0cb800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8017070 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8005ce0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc8161390 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80072f0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc8161950 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0cb801a070 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.836+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0cb8012980 con 0x7f0cc806bfd0 2024-09-10T08:28:22.839 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.837+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc80b8190 con 0x7f0cc806bfd0 2024-09-10T08:28:22.840 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.839+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0cc80b8190 con 0x7f0cc806bfd0 2024-09-10T08:28:22.912 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.911+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c723a8f-71d7-4383-8719-e025137f685c", "id": 5} v 0) -- 0x7f0cc806c3b0 con 0x7f0cc806bfd0 2024-09-10T08:28:22.916 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.915+0000 7f0cbea00640 1 -- 172.21.15.176:0/2749990069 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c723a8f-71d7-4383-8719-e025137f685c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0cb8021020 con 0x7f0cc806bfd0 2024-09-10T08:28:22.916 INFO:teuthology.orchestra.run.smithi176.stdout:5 2024-09-10T08:28:22.917 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 msgr2=0x7f0cc81f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:22.917 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c430 tx=0x7f0cb800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.917 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 shutdown_connections 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cc80b38a0 0x7f0cc81607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cc80b3350 0x7f0cc8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 --2- 172.21.15.176:0/2749990069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cc806bfd0 0x7f0cc81f5880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 >> 172.21.15.176:0/2749990069 conn(0x7f0cc80d11c0 msgr2=0x7f0cc80b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 shutdown_connections 2024-09-10T08:28:22.918 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:22.916+0000 7f0ccd800640 1 -- 172.21.15.176:0/2749990069 wait complete. 2024-09-10T08:28:22.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7988e82e-4517-4a19-8ab8-72a4fa8a8263 6 2024-09-10T08:28:23.082 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.081+0000 7f8d8e800640 1 Processor -- start 2024-09-10T08:28:23.082 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.081+0000 7f8d8e800640 1 -- start start 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d8e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d880b38a0 0x7f8d880d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d8e800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d880cf710 con 0x7f8d8806bfd0 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d8e800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d880cf9f0 con 0x7f8d880b3350 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d8e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8d880b78a0 con 0x7f8d880b38a0 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d86a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8d880b3350 0x7f8d880d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:55106/0 (socket says 172.21.15.176:55106) 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d86a00640 1 -- 172.21.15.176:0/1121267934 learned_addr learned my addr 172.21.15.176:0/1121267934 (peer_addr_for_me v1:172.21.15.176:0/0) 2024-09-10T08:28:23.083 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.082+0000 7f8d87e00640 1 --2- 172.21.15.176:0/1121267934 >> v2:172.21.15.52:3300/0 conn(0x7f8d880b38a0 0x7f8d880d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429176776 0 0) 0x7f8d880cf9f0 con 0x7f8d880b3350 2024-09-10T08:28:23.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6c003520 con 0x7f8d880b3350 2024-09-10T08:28:23.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d87e00640 1 -- 172.21.15.176:0/1121267934 >> v1:172.21.15.176:6789/0 conn(0x7f8d880b3350 legacy=0x7f8d880d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d87e00640 1 -- 172.21.15.176:0/1121267934 >> v1:172.21.15.52:6789/0 conn(0x7f8d8806bfd0 legacy=0x7f8d8806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.084 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524713723 0 0) 0x7f8d880cf710 con 0x7f8d8806bfd0 2024-09-10T08:28:23.085 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.083+0000 7f8d87e00640 1 -- 172.21.15.176:0/1121267934 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d880cfcd0 con 0x7f8d880b38a0 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.084+0000 7f8d87e00640 1 --2- 172.21.15.176:0/1121267934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b38a0 0x7f8d880d3030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b12b4ffe607af6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.084+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80037070 con 0x7f8d880b38a0 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.084+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d80007740 con 0x7f8d880b38a0 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.084+0000 7f8d86000640 1 -- 172.21.15.176:0/1121267934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80007b10 con 0x7f8d880b38a0 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 -- 172.21.15.176:0/1121267934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b38a0 msgr2=0x7f8d880d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 --2- 172.21.15.176:0/1121267934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b38a0 0x7f8d880d3030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002a780 comp rx=0 tx=0).stop 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 -- 172.21.15.176:0/1121267934 shutdown_connections 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 --2- 172.21.15.176:0/1121267934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b38a0 0x7f8d880d3030 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 -- 172.21.15.176:0/1121267934 >> 172.21.15.176:0/1121267934 conn(0x7f8d880d11c0 msgr2=0x7f8d880d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 -- 172.21.15.176:0/1121267934 shutdown_connections 2024-09-10T08:28:23.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.085+0000 7f8d8e800640 1 -- 172.21.15.176:0/1121267934 wait complete. 2024-09-10T08:28:23.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.087+0000 7f8d8e800640 1 Processor -- start 2024-09-10T08:28:23.087 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.087+0000 7f8d8e800640 1 -- start start 2024-09-10T08:28:23.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.087+0000 7f8d8e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d8e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b3350 0x7f8d88150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d8e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 0x7f8d880cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d8e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8806cd50 con 0x7f8d880b3350 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d8e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d880cffb0 con 0x7f8d8806bfd0 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d8e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8815eae0 con 0x7f8d880b38a0 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 0x7f8d880cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 0x7f8d880cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43814/0 (socket says 172.21.15.176:43814) 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38466/0 (socket says 172.21.15.176:38466) 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87e00640 1 -- 172.21.15.176:0/7295687 learned_addr learned my addr 172.21.15.176:0/7295687 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:23.089 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d86a00640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b3350 0x7f8d88150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 -- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 msgr2=0x7f8d880cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 0x7f8d880cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 -- 172.21.15.176:0/7295687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b3350 msgr2=0x7f8d88150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b3350 0x7f8d88150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.088+0000 7f8d87400640 1 -- 172.21.15.176:0/7295687 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d880ce800 con 0x7f8d8806bfd0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d87400640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c450 tx=0x7f8d7800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78017070 con 0x7f8d8806bfd0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d780035f0 con 0x7f8d8806bfd0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d780039e0 con 0x7f8d8806bfd0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d880cdf60 con 0x7f8d8806bfd0 2024-09-10T08:28:23.091 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d880ce520 con 0x7f8d8806bfd0 2024-09-10T08:28:23.092 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d7801a070 con 0x7f8d8806bfd0 2024-09-10T08:28:23.092 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.089+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8d78003b80 con 0x7f8d8806bfd0 2024-09-10T08:28:23.092 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.090+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8806c3b0 con 0x7f8d8806bfd0 2024-09-10T08:28:23.093 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.092+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8d78021020 con 0x7f8d8806bfd0 2024-09-10T08:28:23.128 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:23.128+0000 7fc5c2b88040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:28:23.153 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:23.152+0000 7fd10d41a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:28:23.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.164+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7988e82e-4517-4a19-8ab8-72a4fa8a8263", "id": 6} v 0) -- 0x7f8d880d0cf0 con 0x7f8d8806bfd0 2024-09-10T08:28:23.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.168+0000 7f8d7f400640 1 -- 172.21.15.176:0/7295687 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7988e82e-4517-4a19-8ab8-72a4fa8a8263", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8d7801c440 con 0x7f8d8806bfd0 2024-09-10T08:28:23.169 INFO:teuthology.orchestra.run.smithi176.stdout:6 2024-09-10T08:28:23.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 msgr2=0x7f8d88161980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c450 tx=0x7f8d7800c910 comp rx=0 tx=0).stop 2024-09-10T08:28:23.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 shutdown_connections 2024-09-10T08:28:23.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d880b38a0 0x7f8d880cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d880b3350 0x7f8d88150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 --2- 172.21.15.176:0/7295687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d8806bfd0 0x7f8d88161980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 >> 172.21.15.176:0/7295687 conn(0x7f8d880d11c0 msgr2=0x7f8d880b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 shutdown_connections 2024-09-10T08:28:23.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.169+0000 7f8d8e800640 1 -- 172.21.15.176:0/7295687 wait complete. 2024-09-10T08:28:23.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 62727aea-e9e4-44d1-a44b-7f83de2b2656 7 2024-09-10T08:28:23.193 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:23.193+0000 7fc5c2b88040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:28:23.221 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:23.220+0000 7fd10d41a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:28:23.336 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.335+0000 7fc6afe00640 1 Processor -- start 2024-09-10T08:28:23.336 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.335+0000 7fc6afe00640 1 -- start start 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6afe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 0x7fc6b00b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6afe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6b00b6630 0x7fc6b006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6afe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b006e100 con 0x7fc6b006d910 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6afe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b00b6aa0 con 0x7fc6b00b6630 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6afe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b006e3e0 con 0x7fc6b01619b0 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6aea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 0x7fc6b00b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6aea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 0x7fc6b00b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38474/0 (socket says 172.21.15.176:38474) 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6aea00640 1 -- 172.21.15.176:0/4055605551 learned_addr learned my addr 172.21.15.176:0/4055605551 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.336+0000 7fc6ae000640 1 --2- 172.21.15.176:0/4055605551 >> v2:172.21.15.52:3300/0 conn(0x7fc6b00b6630 0x7fc6b006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.337+0000 7fc6ae000640 1 -- 172.21.15.176:0/4055605551 >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 msgr2=0x7fc6b00b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:23.338 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.337+0000 7fc6ae000640 1 --2- 172.21.15.176:0/4055605551 >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 0x7fc6b00b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.339 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.337+0000 7fc6ae000640 1 -- 172.21.15.176:0/4055605551 >> v1:172.21.15.52:6789/0 conn(0x7fc6b006d910 legacy=0x7fc6b01621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.339 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.337+0000 7fc6ae000640 1 -- 172.21.15.176:0/4055605551 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b00d2370 con 0x7fc6b00b6630 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.338+0000 7fc6ae000640 1 --2- 172.21.15.176:0/4055605551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b00b6630 0x7fc6b006d3d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00d1f40 tx=0x7fc69c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc5dad2c62b9822 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.338+0000 7fc6ad600640 1 -- 172.21.15.176:0/4055605551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c037070 con 0x7fc6b00b6630 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.338+0000 7fc6ad600640 1 -- 172.21.15.176:0/4055605551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c02ae50 con 0x7fc6b00b6630 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.338+0000 7fc6ad600640 1 -- 172.21.15.176:0/4055605551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c032660 con 0x7fc6b00b6630 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 -- 172.21.15.176:0/4055605551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b00b6630 msgr2=0x7fc6b006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 --2- 172.21.15.176:0/4055605551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b00b6630 0x7fc6b006d3d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00d1f40 tx=0x7fc69c02a140 comp rx=0 tx=0).stop 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 -- 172.21.15.176:0/4055605551 shutdown_connections 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 --2- 172.21.15.176:0/4055605551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b00b6630 0x7fc6b006d3d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 --2- 172.21.15.176:0/4055605551 >> v2:172.21.15.176:3300/0 conn(0x7fc6b01619b0 0x7fc6b00b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 -- 172.21.15.176:0/4055605551 >> 172.21.15.176:0/4055605551 conn(0x7fc6b00d10f0 msgr2=0x7fc6b00d1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 -- 172.21.15.176:0/4055605551 shutdown_connections 2024-09-10T08:28:23.341 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.339+0000 7fc6afe00640 1 -- 172.21.15.176:0/4055605551 wait complete. 2024-09-10T08:28:23.342 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.341+0000 7fc6afe00640 1 Processor -- start 2024-09-10T08:28:23.342 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.341+0000 7fc6afe00640 1 -- start start 2024-09-10T08:28:23.344 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.341+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b006d910 0x7fc6b01f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.344 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.341+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.344 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 0x7fc6b015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6afe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b006dd10 con 0x7fc6b006d910 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6afe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b00d2930 con 0x7fc6b01619b0 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6afe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b006de90 con 0x7fc6b00b6630 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6af400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 0x7fc6b015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:43818/0 (socket says 172.21.15.176:43818) 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 -- 172.21.15.176:0/31090598 learned_addr learned my addr 172.21.15.176:0/31090598 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6aea00640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b006d910 0x7fc6b01f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 -- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 msgr2=0x7fc6b015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.345 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 0x7fc6b015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 -- 172.21.15.176:0/31090598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b006d910 msgr2=0x7fc6b01f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b006d910 0x7fc6b01f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6ae000640 1 -- 172.21.15.176:0/31090598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b01f8850 con 0x7fc6b00b6630 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.342+0000 7fc6af400640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 0x7fc6b015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6ae000640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc69c035040 tx=0x7fc69c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c041070 con 0x7fc6b00b6630 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c03c460 con 0x7fc6b00b6630 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c037040 con 0x7fc6b00b6630 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b01f8b30 con 0x7fc6b00b6630 2024-09-10T08:28:23.346 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b01f8490 con 0x7fc6b00b6630 2024-09-10T08:28:23.347 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc69c03a070 con 0x7fc6b00b6630 2024-09-10T08:28:23.347 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.343+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc69c045d80 con 0x7fc6b00b6630 2024-09-10T08:28:23.347 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.344+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b0161e20 con 0x7fc6b00b6630 2024-09-10T08:28:23.347 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.346+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc69c045930 con 0x7fc6b00b6630 2024-09-10T08:28:23.420 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.419+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "62727aea-e9e4-44d1-a44b-7f83de2b2656", "id": 7} v 0) -- 0x7fc6b00d1640 con 0x7fc6b00b6630 2024-09-10T08:28:23.423 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.423+0000 7fc6a6a00640 1 -- 172.21.15.176:0/31090598 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62727aea-e9e4-44d1-a44b-7f83de2b2656", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc69c045b10 con 0x7fc6b00b6630 2024-09-10T08:28:23.424 INFO:teuthology.orchestra.run.smithi176.stdout:7 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 msgr2=0x7fc6b015e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc69c035040 tx=0x7fc69c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 shutdown_connections 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6b01619b0 0x7fc6b015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc6b00b6630 0x7fc6b015e0f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.425 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 --2- 172.21.15.176:0/31090598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b006d910 0x7fc6b01f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 >> 172.21.15.176:0/31090598 conn(0x7fc6b00d10f0 msgr2=0x7fc6b00b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 shutdown_connections 2024-09-10T08:28:23.426 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:28:23.424+0000 7fc6afe00640 1 -- 172.21.15.176:0/31090598 wait complete. 2024-09-10T08:28:23.441 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T08:28:23.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T08:28:23.447 INFO:tasks.ceph.osd.0:Started 2024-09-10T08:28:23.447 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T08:28:23.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T08:28:23.452 INFO:tasks.ceph.osd.1:Started 2024-09-10T08:28:23.452 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T08:28:23.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T08:28:23.456 INFO:tasks.ceph.osd.2:Started 2024-09-10T08:28:23.457 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T08:28:23.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T08:28:23.462 INFO:tasks.ceph.osd.3:Started 2024-09-10T08:28:23.462 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T08:28:23.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T08:28:23.487 INFO:tasks.ceph.osd.4:Started 2024-09-10T08:28:23.487 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T08:28:23.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T08:28:23.495 INFO:tasks.ceph.osd.5:Started 2024-09-10T08:28:23.496 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T08:28:23.496 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T08:28:23.501 INFO:tasks.ceph.osd.6:Started 2024-09-10T08:28:23.501 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T08:28:23.501 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T08:28:23.506 INFO:tasks.ceph.osd.7:Started 2024-09-10T08:28:23.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:23.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.710+0000 7f10e6a00640 1 Processor -- start 2024-09-10T08:28:23.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.710+0000 7f10e6a00640 1 -- start start 2024-09-10T08:28:23.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.711+0000 7f10e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e00d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.711+0000 7f10e6a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e00d4410 con 0x7f10e00cf030 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.711+0000 7f10e6a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e00d3370 con 0x7f10e00b6910 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.711+0000 7f10e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10e00d3650 con 0x7f10e015e990 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10d7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f10e00cf030 0x7f10e00b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33718/0 (socket says 172.21.15.52:33718) 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10d7e00640 1 -- 172.21.15.52:0/3824720068 learned_addr learned my addr 172.21.15.52:0/3824720068 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:23.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10dfe00640 1 --2- 172.21.15.52:0/3824720068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e00d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668557255 0 0) 0x7f10e00d4410 con 0x7f10e00cf030 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10c4003520 con 0x7f10e00cf030 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733036627 0 0) 0x7f10e00d3370 con 0x7f10e00b6910 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10e00d4410 con 0x7f10e00b6910 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10dfe00640 1 -- 172.21.15.52:0/3824720068 >> v1:172.21.15.176:6789/0 conn(0x7f10e00b6910 legacy=0x7f10e00b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10dfe00640 1 -- 172.21.15.52:0/3824720068 >> v1:172.21.15.52:6789/0 conn(0x7f10e00cf030 legacy=0x7f10e00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.712+0000 7f10dfe00640 1 -- 172.21.15.52:0/3824720068 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e00d3930 con 0x7f10e015e990 2024-09-10T08:28:23.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.713+0000 7f10dfe00640 1 --2- 172.21.15.52:0/3824720068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e00d2a00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097d0 tx=0x7f10d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1066091d74290d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0037070 con 0x7f10e015e990 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0032440 con 0x7f10e015e990 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10df400640 1 -- 172.21.15.52:0/3824720068 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0032810 con 0x7f10e015e990 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 -- 172.21.15.52:0/3824720068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 msgr2=0x7f10e00d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 --2- 172.21.15.52:0/3824720068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e00d2a00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097d0 tx=0x7f10d002a180 comp rx=0 tx=0).stop 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 -- 172.21.15.52:0/3824720068 shutdown_connections 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 --2- 172.21.15.52:0/3824720068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e00d2a00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 -- 172.21.15.52:0/3824720068 >> 172.21.15.52:0/3824720068 conn(0x7f10e00d4780 msgr2=0x7f10e00d4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 -- 172.21.15.52:0/3824720068 shutdown_connections 2024-09-10T08:28:23.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.714+0000 7f10e6a00640 1 -- 172.21.15.52:0/3824720068 wait complete. 2024-09-10T08:28:23.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.716+0000 7f10e6a00640 1 Processor -- start 2024-09-10T08:28:23.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.716+0000 7f10e6a00640 1 -- start start 2024-09-10T08:28:23.717 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:23.717+0000 7fc5c2b88040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 0x7f10e0161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10e015ed70 con 0x7f10e00b6910 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10e00d3ef0 con 0x7f10e00cf030 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10e015eef0 con 0x7f10e015e990 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.717+0000 7f10dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50068/0 (socket says 172.21.15.52:50068) 2024-09-10T08:28:23.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 0x7f10e0161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10dfe00640 1 -- 172.21.15.52:0/2046271807 learned_addr learned my addr 172.21.15.52:0/2046271807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10e4a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 -- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 msgr2=0x7f10e015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 -- 172.21.15.52:0/2046271807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 msgr2=0x7f10e01f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 -- 172.21.15.52:0/2046271807 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e0162230 con 0x7f10e00cf030 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10dfe00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10e4a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.718+0000 7f10d7e00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 0x7f10e0161cf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10e006d390 tx=0x7f10c800c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8017070 con 0x7f10e00cf030 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c8005ce0 con 0x7f10e00cf030 2024-09-10T08:28:23.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c80072d0 con 0x7f10e00cf030 2024-09-10T08:28:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e01f4db0 con 0x7f10e00cf030 2024-09-10T08:28:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01f5370 con 0x7f10e00cf030 2024-09-10T08:28:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10c801a070 con 0x7f10e00cf030 2024-09-10T08:28:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.719+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f10c801cc10 con 0x7f10e00cf030 2024-09-10T08:28:23.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.720+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e00d2fd0 con 0x7f10e00cf030 2024-09-10T08:28:23.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.723+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f10c8007470 con 0x7f10e00cf030 2024-09-10T08:28:23.733 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:23.732+0000 7fd10d41a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:28:23.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.785+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10e00b5720 con 0x7f10e00cf030 2024-09-10T08:28:23.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.786+0000 7f10dcc00640 1 -- 172.21.15.52:0/2046271807 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f10c8007650 con 0x7f10e00cf030 2024-09-10T08:28:23.786 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:23.786 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:23.422237+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:23.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 msgr2=0x7f10e0161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:23.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 0x7f10e0161cf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10e006d390 tx=0x7f10c800c870 comp rx=0 tx=0).stop 2024-09-10T08:28:23.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 shutdown_connections 2024-09-10T08:28:23.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10e015e990 0x7f10e015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10e00cf030 0x7f10e0161cf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 --2- 172.21.15.52:0/2046271807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10e00b6910 0x7f10e01f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 >> 172.21.15.52:0/2046271807 conn(0x7f10e00d4780 msgr2=0x7f10e00b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 shutdown_connections 2024-09-10T08:28:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:23.788+0000 7f10e6a00640 1 -- 172.21.15.52:0/2046271807 wait complete. 2024-09-10T08:28:23.809 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T08:28:23.809 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T08:28:23.828 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:23.829+0000 7fc5c2b88040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:28:23.831 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:23.830+0000 7fd10d41a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:28:23.955 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:23.954+0000 7fd10d41a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:23.956 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:23.956+0000 7fc5c2b88040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:28:24.009 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.009+0000 7fd10d41a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:28:24.011 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.012+0000 7fc5c2b88040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:28:24.135 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.134+0000 7fd10d41a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:28:24.145 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.145+0000 7fc5c2b88040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:28:24.199 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.198+0000 7fd10d41a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:28:24.210 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.210+0000 7fc5c2b88040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:28:24.254 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.254+0000 7fd10d41a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:28:24.265 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.265+0000 7fc5c2b88040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:28:24.379 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.378+0000 7fd10d41a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:28:24.397 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.397+0000 7fc5c2b88040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:28:24.437 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.436+0000 7fd10d41a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:28:24.458 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.458+0000 7fc5c2b88040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:28:24.499 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.498+0000 7fd10d41a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:28:24.520 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.520+0000 7fc5c2b88040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:28:24.578 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.578+0000 7fd10d41a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:24.602 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.602+0000 7fc5c2b88040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:28:24.613 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:24.632 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.631+0000 7fd10d41a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:28:24.657 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.657+0000 7fc5c2b88040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:28:24.684 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:24.683+0000 7fd10d41a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:28:24.712 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:24.712+0000 7fc5c2b88040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:28:24.752 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.752+0000 7f7394600640 1 Processor -- start 2024-09-10T08:28:24.752 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.752+0000 7f7394600640 1 -- start start 2024-09-10T08:28:24.753 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7394600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3890 0x7f738c15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:24.753 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7394600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f738c0d3cd0 0x7f738c1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:24.753 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7394600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738c160900 con 0x7f738c0d1740 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7394600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f738c15fc60 con 0x7f738c0d3cd0 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7394600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f738c0d3400 con 0x7f738c0d3890 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7391c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f738c0d1740 0x7f738c0d1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39852/0 (socket says 172.21.15.52:39852) 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7391c00640 1 -- 172.21.15.52:0/2530516349 learned_addr learned my addr 172.21.15.52:0/2530516349 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.753+0000 7f7392600640 1 --2- 172.21.15.52:0/2530516349 >> v2:172.21.15.52:3300/0 conn(0x7f738c0d3cd0 0x7f738c1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:24.754 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f7391200640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3890 0x7f738c15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f7392600640 1 -- 172.21.15.52:0/2530516349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3890 msgr2=0x7f738c15fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f7392600640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3890 0x7f738c15fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f7392600640 1 -- 172.21.15.52:0/2530516349 >> v1:172.21.15.52:6789/0 conn(0x7f738c0d1740 legacy=0x7f738c0d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f7392600640 1 -- 172.21.15.52:0/2530516349 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c0d2ad0 con 0x7f738c0d3cd0 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.754+0000 7f738be00640 1 -- 172.21.15.52:0/2530516349 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741073234 0 0) 0x7f738c160900 con 0x7f738c0d1740 2024-09-10T08:28:24.755 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.755+0000 7f7392600640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d3cd0 0x7f738c1603c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7384009d90 tx=0x7f738402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81b3153621d6acc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:24.756 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.755+0000 7f738be00640 1 -- 172.21.15.52:0/2530516349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384031600 con 0x7f738c0d3cd0 2024-09-10T08:28:24.756 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.755+0000 7f738be00640 1 -- 172.21.15.52:0/2530516349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73840317a0 con 0x7f738c0d3cd0 2024-09-10T08:28:24.756 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.755+0000 7f738be00640 1 -- 172.21.15.52:0/2530516349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384031b70 con 0x7f738c0d3cd0 2024-09-10T08:28:24.756 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 -- 172.21.15.52:0/2530516349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d3cd0 msgr2=0x7f738c1603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d3cd0 0x7f738c1603c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7384009d90 tx=0x7f738402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 -- 172.21.15.52:0/2530516349 shutdown_connections 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d3cd0 0x7f738c1603c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 --2- 172.21.15.52:0/2530516349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3890 0x7f738c15fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 -- 172.21.15.52:0/2530516349 >> 172.21.15.52:0/2530516349 conn(0x7f738c067cf0 msgr2=0x7f738c068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 -- 172.21.15.52:0/2530516349 shutdown_connections 2024-09-10T08:28:24.757 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.756+0000 7f7394600640 1 -- 172.21.15.52:0/2530516349 wait complete. 2024-09-10T08:28:24.758 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.758+0000 7f7394600640 1 Processor -- start 2024-09-10T08:28:24.758 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.758+0000 7f7394600640 1 -- start start 2024-09-10T08:28:24.759 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f738c0d3890 0x7f738c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3cd0 0x7f738c1e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f738c15e9c0 con 0x7f738c0d1740 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f738c0d3090 con 0x7f738c0d3890 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7394600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f738c15eb40 con 0x7f738c0d3cd0 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35648/0 (socket says 172.21.15.52:35648) 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 -- 172.21.15.52:0/1872314366 learned_addr learned my addr 172.21.15.52:0/1872314366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7392600640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3cd0 0x7f738c1e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391200640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f738c0d3890 0x7f738c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 -- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3cd0 msgr2=0x7f738c1e9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:24.760 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3cd0 0x7f738c1e9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.761 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 -- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f738c0d3890 msgr2=0x7f738c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:24.761 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f738c0d3890 0x7f738c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.761 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.759+0000 7f7391c00640 1 -- 172.21.15.52:0/1872314366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1e7330 con 0x7f738c0d1740 2024-09-10T08:28:24.761 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7391c00640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f738000c430 tx=0x7f738000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73800074e0 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73800047e0 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c0c9e50 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380004bd0 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c0ca410 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.760+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7380011070 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.761+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7380013a90 con 0x7f738c0d1740 2024-09-10T08:28:24.762 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.761+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c0691c0 con 0x7f738c0d1740 2024-09-10T08:28:24.764 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.764+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7380004dc0 con 0x7f738c0d1740 2024-09-10T08:28:24.827 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.827+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f738c0d1b20 con 0x7f738c0d1740 2024-09-10T08:28:24.828 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.828+0000 7f7389600640 1 -- 172.21.15.52:0/1872314366 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7380013c90 con 0x7f738c0d1740 2024-09-10T08:28:24.828 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T08:28:24.828 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:23.422237+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 msgr2=0x7f738c15d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f738000c430 tx=0x7f738000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 shutdown_connections 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f738c0d3cd0 0x7f738c1e9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f738c0d3890 0x7f738c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 --2- 172.21.15.52:0/1872314366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f738c0d1740 0x7f738c15d0d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:24.829 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 >> 172.21.15.52:0/1872314366 conn(0x7f738c067cf0 msgr2=0x7f738c160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:24.830 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 shutdown_connections 2024-09-10T08:28:24.830 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:24.829+0000 7f7394600640 1 -- 172.21.15.52:0/1872314366 wait complete. 2024-09-10T08:28:24.841 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T08:28:25.437 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:25.436+0000 7fd10d41a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:28:25.486 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-10T08:28:25.486+0000 7f2180c16640 -1 Falling back to public interface 2024-09-10T08:28:25.493 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-09-10T08:28:25.493+0000 7fc5c2b88040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:28:25.499 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-10T08:28:25.500+0000 7ff6c3e1e640 -1 Falling back to public interface 2024-09-10T08:28:25.508 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T08:28:25.508+0000 7f7ff701c640 -1 Falling back to public interface 2024-09-10T08:28:25.509 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-10T08:28:25.510+0000 7fd94660d640 -1 Falling back to public interface 2024-09-10T08:28:25.522 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-10T08:28:25.523+0000 7fa6b6a18640 -1 Falling back to public interface 2024-09-10T08:28:25.553 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-10T08:28:25.552+0000 7f10c712e640 -1 Falling back to public interface 2024-09-10T08:28:25.580 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-10T08:28:25.579+0000 7fea46a9c640 -1 Falling back to public interface 2024-09-10T08:28:25.585 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-10T08:28:25.584+0000 7f0b60927640 -1 Falling back to public interface 2024-09-10T08:28:26.458 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:26.457+0000 7fd0aca00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T08:28:26.459 INFO:tasks.ceph.mgr.x.smithi176.stderr:2024-09-10T08:28:26.458+0000 7fd0aca00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T08:28:29.849 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-10T08:28:29.848+0000 7f0b60927640 -1 osd.5 0 log_to_monitors true 2024-09-10T08:28:30.135 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-10T08:28:30.134+0000 7f2180c16640 -1 osd.4 0 log_to_monitors true 2024-09-10T08:28:30.166 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-10T08:28:30.166+0000 7ff6c3e1e640 -1 osd.1 0 log_to_monitors true 2024-09-10T08:28:30.178 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-10T08:28:30.177+0000 7f10c712e640 -1 osd.7 0 log_to_monitors true 2024-09-10T08:28:30.198 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-10T08:28:30.198+0000 7fa6b6a18640 -1 osd.2 0 log_to_monitors true 2024-09-10T08:28:30.211 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-10T08:28:30.211+0000 7fd94660d640 -1 osd.3 0 log_to_monitors true 2024-09-10T08:28:30.214 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T08:28:30.215+0000 7f7ff701c640 -1 osd.0 0 log_to_monitors true 2024-09-10T08:28:30.287 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-10T08:28:30.287+0000 7fea46a9c640 -1 osd.6 0 log_to_monitors true 2024-09-10T08:28:31.649 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:31.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.796+0000 7facaf200640 1 Processor -- start 2024-09-10T08:28:31.796 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.796+0000 7facaf200640 1 -- start start 2024-09-10T08:28:31.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.797+0000 7facaf200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facb00d51a0 0x7facb015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.797+0000 7facaf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.797+0000 7facaf200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb00d5610 con 0x7facb00cf830 2024-09-10T08:28:31.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.797+0000 7facaf200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7facb015fc90 con 0x7facb00d51a0 2024-09-10T08:28:31.797 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.797+0000 7facaf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facb00d43e0 con 0x7facb015f460 2024-09-10T08:28:31.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.798 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facad400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facb00d51a0 0x7facb015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facade00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7facb00cf830 0x7facb00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:55872/0 (socket says 172.21.15.52:55872) 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36284/0 (socket says 172.21.15.52:36284) 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facade00640 1 -- 172.21.15.52:0/224483308 learned_addr learned my addr 172.21.15.52:0/224483308 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 -- 172.21.15.52:0/224483308 >> v2:172.21.15.176:3300/0 conn(0x7facb00d51a0 msgr2=0x7facb015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 --2- 172.21.15.52:0/224483308 >> v2:172.21.15.176:3300/0 conn(0x7facb00d51a0 0x7facb015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 -- 172.21.15.52:0/224483308 >> v1:172.21.15.176:6789/0 conn(0x7facb00cf830 legacy=0x7facb00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facae800640 1 -- 172.21.15.52:0/224483308 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb00d46c0 con 0x7facb015f460 2024-09-10T08:28:31.799 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.798+0000 7facaca00640 1 -- 172.21.15.52:0/224483308 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952925683 0 0) 0x7facb00d5610 con 0x7facb00cf830 2024-09-10T08:28:31.800 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.799+0000 7facae800640 1 --2- 172.21.15.52:0/224483308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d90 tx=0x7faca802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a811f06dc354284 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:31.800 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.799+0000 7facaca00640 1 -- 172.21.15.52:0/224483308 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8031600 con 0x7facb015f460 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.799+0000 7facaca00640 1 -- 172.21.15.52:0/224483308 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca80317a0 con 0x7facb015f460 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.799+0000 7facaca00640 1 -- 172.21.15.52:0/224483308 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8031b70 con 0x7facb015f460 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 -- 172.21.15.52:0/224483308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 msgr2=0x7facb00d28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 --2- 172.21.15.52:0/224483308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca8009d90 tx=0x7faca802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 -- 172.21.15.52:0/224483308 shutdown_connections 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 --2- 172.21.15.52:0/224483308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb015f460 0x7facb00d28e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 --2- 172.21.15.52:0/224483308 >> v2:172.21.15.176:3300/0 conn(0x7facb00d51a0 0x7facb015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 -- 172.21.15.52:0/224483308 >> 172.21.15.52:0/224483308 conn(0x7facb0067cf0 msgr2=0x7facb0068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 -- 172.21.15.52:0/224483308 shutdown_connections 2024-09-10T08:28:31.801 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.800+0000 7facaf200640 1 -- 172.21.15.52:0/224483308 wait complete. 2024-09-10T08:28:31.802 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.802+0000 7facaf200640 1 Processor -- start 2024-09-10T08:28:31.802 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.802+0000 7facaf200640 1 -- start start 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb015f460 0x7facb00b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7facb015fa30 con 0x7facb00d51a0 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7facb015f8b0 con 0x7facb015f460 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facaf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facb015c670 con 0x7facb00cf830 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.803 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facade00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.804 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facae800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb015f460 0x7facb00b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.804 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35690/0 (socket says 172.21.15.52:35690) 2024-09-10T08:28:31.804 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facade00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36298/0 (socket says 172.21.15.52:36298) 2024-09-10T08:28:31.804 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 -- 172.21.15.52:0/3201297408 learned_addr learned my addr 172.21.15.52:0/3201297408 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:31.805 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 -- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 msgr2=0x7facb014e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:31.805 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.805 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 -- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb015f460 msgr2=0x7facb00b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:31.805 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.803+0000 7facad400640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb015f460 0x7facb00b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:31.805 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7facad400640 1 -- 172.21.15.52:0/3201297408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb015ffd0 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7facade00640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7facad400640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00e930 tx=0x7fac9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c017070 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9c00ca00 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00cdb0 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb0160270 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.804+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb0160830 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.805+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb00b66b0 con 0x7facb00d51a0 2024-09-10T08:28:31.806 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.806+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fac9c01a070 con 0x7facb00d51a0 2024-09-10T08:28:31.807 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.807+0000 7faca6000640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 0x7fac9006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:31.807 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.807+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2009+0+0 (secure 0 0 0) 0x7fac9c08a230 con 0x7facb00d51a0 2024-09-10T08:28:31.807 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.807+0000 7facade00640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 0x7fac9006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:31.808 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.808+0000 7facade00640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 0x7fac9006e260 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faca0000f60 tx=0x7faca0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:31.812 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:31.812+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facb00b66b0 con 0x7facb00d51a0 2024-09-10T08:28:32.043 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.043+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facb015ef20 con 0x7facb00d51a0 2024-09-10T08:28:32.044 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.044+0000 7faca6000640 1 -- 172.21.15.52:0/3201297408 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7fac9c059500 con 0x7facb00d51a0 2024-09-10T08:28:32.045 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T08:28:32.045 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":13,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:31.912617+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:32.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 msgr2=0x7fac9006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 0x7fac9006e260 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faca0000f60 tx=0x7faca0009040 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 msgr2=0x7facb0161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00e930 tx=0x7fac9c00edf0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 shutdown_connections 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac9006bda0 0x7fac9006e260 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb015f460 0x7facb00b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facb00d51a0 0x7facb0161030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 --2- 172.21.15.52:0/3201297408 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb00cf830 0x7facb014e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.048+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 >> 172.21.15.52:0/3201297408 conn(0x7facb0067cf0 msgr2=0x7facb00680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:32.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.052+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 shutdown_connections 2024-09-10T08:28:32.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:32.052+0000 7facaf200640 1 -- 172.21.15.52:0/3201297408 wait complete. 2024-09-10T08:28:32.072 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-10T08:28:32.071+0000 7f0b5ae00640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T08:28:32.075 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T08:28:32.252 INFO:tasks.ceph.osd.5.smithi176.stderr:2024-09-10T08:28:32.252+0000 7f0b51800640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.646 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T08:28:33.645+0000 7f7ff1400640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T08:28:33.646 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-10T08:28:33.647+0000 7fd940400640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T08:28:33.652 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-10T08:28:33.652+0000 7f7fe7e00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.654 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-10T08:28:33.654+0000 7ff6bdc00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T08:28:33.654 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-10T08:28:33.654+0000 7fd936e00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.672 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-10T08:28:33.672+0000 7fa6b1e00640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T08:28:33.673 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-10T08:28:33.674+0000 7ff6b4600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.684 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-10T08:28:33.684+0000 7fa6a7400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.692 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-10T08:28:33.692+0000 7fea41000640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T08:28:33.701 INFO:tasks.ceph.osd.6.smithi176.stderr:2024-09-10T08:28:33.701+0000 7fea37a00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.749 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-10T08:28:33.748+0000 7f10c1600640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T08:28:33.757 INFO:tasks.ceph.osd.7.smithi176.stderr:2024-09-10T08:28:33.756+0000 7f10b8000640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:33.759 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-10T08:28:33.759+0000 7f217aa00640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T08:28:33.763 INFO:tasks.ceph.osd.4.smithi176.stderr:2024-09-10T08:28:33.763+0000 7f2171400640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:28:35.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:35.307 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:28:38.881 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:39.018 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.018+0000 7f9977400640 1 Processor -- start 2024-09-10T08:28:39.018 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.018+0000 7f9977400640 1 -- start start 2024-09-10T08:28:39.019 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.019+0000 7f9977400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 0x7f997015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.019+0000 7f9977400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99701605e0 con 0x7f99700c6000 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.019+0000 7f9977400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99701608c0 con 0x7f997015c6a0 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.019+0000 7f9977400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99700c5e40 con 0x7f99700b60f0 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99700c6000 0x7f99700b59e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51816/0 (socket says 172.21.15.52:51816) 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996fe00640 1 -- 172.21.15.52:0/383173325 learned_addr learned my addr 172.21.15.52:0/383173325 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:39.020 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f9975400640 1 --2- 172.21.15.52:0/383173325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 0x7f997015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560611891 0 0) 0x7f99701605e0 con 0x7f99700c6000 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958003520 con 0x7f99700c6000 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261875009 0 0) 0x7f99701608c0 con 0x7f997015c6a0 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99701605e0 con 0x7f997015c6a0 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f9975400640 1 -- 172.21.15.52:0/383173325 >> v1:172.21.15.176:6789/0 conn(0x7f997015c6a0 legacy=0x7f997015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f9975400640 1 -- 172.21.15.52:0/383173325 >> v1:172.21.15.52:6789/0 conn(0x7f99700c6000 legacy=0x7f99700b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.020+0000 7f9975400640 1 -- 172.21.15.52:0/383173325 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970160ba0 con 0x7f99700b60f0 2024-09-10T08:28:39.021 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.021+0000 7f9975400640 1 --2- 172.21.15.52:0/383173325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 0x7f997015cfd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9968009dc0 tx=0x7f996802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4926fe28197f4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.021+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996802ae60 con 0x7f99700b60f0 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.021+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9968007740 con 0x7f99700b60f0 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.021+0000 7f996f400640 1 -- 172.21.15.52:0/383173325 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968007af0 con 0x7f99700b60f0 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 -- 172.21.15.52:0/383173325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 msgr2=0x7f997015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 --2- 172.21.15.52:0/383173325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 0x7f997015cfd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9968009dc0 tx=0x7f996802a640 comp rx=0 tx=0).stop 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 -- 172.21.15.52:0/383173325 shutdown_connections 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 --2- 172.21.15.52:0/383173325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99700b60f0 0x7f997015cfd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 -- 172.21.15.52:0/383173325 >> 172.21.15.52:0/383173325 conn(0x7f997006bc10 msgr2=0x7f997006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 -- 172.21.15.52:0/383173325 shutdown_connections 2024-09-10T08:28:39.023 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.022+0000 7f9977400640 1 -- 172.21.15.52:0/383173325 wait complete. 2024-09-10T08:28:39.024 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.024+0000 7f9977400640 1 Processor -- start 2024-09-10T08:28:39.024 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.024+0000 7f9977400640 1 -- start start 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99700c6000 0x7f99700b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f997015c6a0 0x7f9970156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9970160190 con 0x7f99700b60f0 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f997015ca80 con 0x7f99700c6000 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9977400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9970160310 con 0x7f997015c6a0 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54046/0 (socket says 172.21.15.52:54046) 2024-09-10T08:28:39.026 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 -- 172.21.15.52:0/246300637 learned_addr learned my addr 172.21.15.52:0/246300637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f996fe00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99700c6000 0x7f99700b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9975400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f997015c6a0 0x7f9970156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 -- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f997015c6a0 msgr2=0x7f9970156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f997015c6a0 0x7f9970156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 -- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99700c6000 msgr2=0x7f99700b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99700c6000 0x7f99700b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.025+0000 7f9974a00640 1 -- 172.21.15.52:0/246300637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970153830 con 0x7f99700b60f0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f9974a00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f996400c430 tx=0x7f996400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964017070 con 0x7f99700b60f0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99640052f0 con 0x7f99700b60f0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964003830 con 0x7f99700b60f0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9970153ad0 con 0x7f99700b60f0 2024-09-10T08:28:39.027 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.026+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9970154090 con 0x7f99700b60f0 2024-09-10T08:28:39.028 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.027+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99700c6490 con 0x7f99700b60f0 2024-09-10T08:28:39.028 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.028+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f996401a070 con 0x7f99700b60f0 2024-09-10T08:28:39.029 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.029+0000 7f996cc00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 0x7f995006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.029 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.029+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9964089e00 con 0x7f99700b60f0 2024-09-10T08:28:39.029 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.029+0000 7f996fe00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 0x7f995006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.030 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.030+0000 7f996fe00640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 0x7f995006e260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f997015b600 tx=0x7f995c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.034 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.034+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9964058580 con 0x7f99700b60f0 2024-09-10T08:28:39.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.219+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f997015ff00 con 0x7f99700b60f0 2024-09-10T08:28:39.219 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.220+0000 7f996cc00640 1 -- 172.21.15.52:0/246300637 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12908 (secure 0 0 0) 0x7f996405c880 con 0x7f99700b60f0 2024-09-10T08:28:39.220 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-10T08:28:39.220 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":18,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:37.955682+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:39.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 msgr2=0x7f995006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 0x7f995006e260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f997015b600 tx=0x7f995c007d30 comp rx=0 tx=0).stop 2024-09-10T08:28:39.222 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 msgr2=0x7f99700b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f996400c430 tx=0x7f996400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 shutdown_connections 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995006bda0 0x7f995006e260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f997015c6a0 0x7f9970156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99700c6000 0x7f99700b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 --2- 172.21.15.52:0/246300637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99700b60f0 0x7f99700b2040 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 >> 172.21.15.52:0/246300637 conn(0x7f997006bc10 msgr2=0x7f9970158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 shutdown_connections 2024-09-10T08:28:39.223 INFO:teuthology.misc.health.smithi052.stderr:2024-09-10T08:28:39.222+0000 7f9977400640 1 -- 172.21.15.52:0/246300637 wait complete. 2024-09-10T08:28:39.238 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T08:28:39.238 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T08:28:39.238 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:28:39.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:28:39.243 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:28:39.243 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:28:39.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:28:39.246 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:28:39.246 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:28:39.247 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:28:39.251 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:28:39.251 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:28:39.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:28:39.255 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:28:39.255 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T08:28:39.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:39.375 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:28:39.379 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:28:39.379 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:28:39.381 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:28:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.422+0000 7fa72d400640 1 Processor -- start 2024-09-10T08:28:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.423+0000 7fa72d400640 1 -- start start 2024-09-10T08:28:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa72815e4c0 0x7fa7280cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa728162b70 0x7fa7280b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 0x7fa72806be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa7280b6a10 con 0x7fa7280b65c0 2024-09-10T08:28:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa7280cf5e0 con 0x7fa72815e4c0 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7280cf8c0 con 0x7fa728162b70 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 0x7fa72806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa727e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa72815e4c0 0x7fa7280cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 0x7fa72806be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54092/0 (socket says 172.21.15.52:54092) 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa727400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa728162b70 0x7fa7280b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.424+0000 7fa72ca00640 1 -- 172.21.15.52:0/1067396804 learned_addr learned my addr 172.21.15.52:0/1067396804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.425+0000 7fa727e00640 1 -- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa728162b70 msgr2=0x7fa7280b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.425+0000 7fa727e00640 1 --2- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa728162b70 0x7fa7280b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.425+0000 7fa727e00640 1 -- 172.21.15.52:0/1067396804 >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 msgr2=0x7fa72806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.425+0000 7fa727e00640 1 --2- 172.21.15.52:0/1067396804 >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 0x7fa72806be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.425+0000 7fa727e00640 1 -- 172.21.15.52:0/1067396804 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280d2980 con 0x7fa72815e4c0 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa727e00640 1 --2- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa72815e4c0 0x7fa7280cef50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7280687d0 tx=0x7fa71802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abf8ffe9a0f13396 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa726a00640 1 -- 172.21.15.52:0/1067396804 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718037070 con 0x7fa72815e4c0 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa726a00640 1 -- 172.21.15.52:0/1067396804 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa718032440 con 0x7fa72815e4c0 2024-09-10T08:28:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa726a00640 1 -- 172.21.15.52:0/1067396804 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71802ae60 con 0x7fa72815e4c0 2024-09-10T08:28:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa72d400640 1 -- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa72815e4c0 msgr2=0x7fa7280cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.426+0000 7fa72d400640 1 --2- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa72815e4c0 0x7fa7280cef50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa7280687d0 tx=0x7fa71802a110 comp rx=0 tx=0).stop 2024-09-10T08:28:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 -- 172.21.15.52:0/1067396804 shutdown_connections 2024-09-10T08:28:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 --2- 172.21.15.52:0/1067396804 >> v2:172.21.15.52:3300/0 conn(0x7fa7280b65c0 0x7fa72806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 --2- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa728162b70 0x7fa7280b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 --2- 172.21.15.52:0/1067396804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa72815e4c0 0x7fa7280cef50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 -- 172.21.15.52:0/1067396804 >> 172.21.15.52:0/1067396804 conn(0x7fa7280d1080 msgr2=0x7fa7280d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 -- 172.21.15.52:0/1067396804 shutdown_connections 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.427+0000 7fa72d400640 1 -- 172.21.15.52:0/1067396804 wait complete. 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.428+0000 7fa72d400640 1 Processor -- start 2024-09-10T08:28:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 -- start start 2024-09-10T08:28:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 0x7fa72815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa728162b70 0x7fa72814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7280cfba0 con 0x7fa728162b70 2024-09-10T08:28:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa728163000 con 0x7fa7280b65c0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.429+0000 7fa72d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa72815e8a0 con 0x7fa72815e4c0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 0x7fa72815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:47384/0 (socket says 172.21.15.52:47384) 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727e00640 1 -- 172.21.15.52:0/3714186282 learned_addr learned my addr 172.21.15.52:0/3714186282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa72ca00640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa728162b70 0x7fa72814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 -- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 msgr2=0x7fa72814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 -- 172.21.15.52:0/3714186282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa728162b70 msgr2=0x7fa72814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa728162b70 0x7fa72814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727400640 1 -- 172.21.15.52:0/3714186282 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa728161390 con 0x7fa72815e4c0 2024-09-10T08:28:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.430+0000 7fa727e00640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:39.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.431+0000 7fa727400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 0x7fa72815ebe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e870 tx=0x7fa71400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.437+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714017070 con 0x7fa72815e4c0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.437+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71400ee60 con 0x7fa72815e4c0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.437+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa728161670 con 0x7fa72815e4c0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.438+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71400cb60 con 0x7fa72815e4c0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.438+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa728161c30 con 0x7fa72815e4c0 2024-09-10T08:28:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.439+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7280cef50 con 0x7fa72815e4c0 2024-09-10T08:28:39.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.440+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fa71401a070 con 0x7fa72815e4c0 2024-09-10T08:28:39.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.440+0000 7fa71fe00640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 0x7fa70806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:39.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.440+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa71408ab00 con 0x7fa72815e4c0 2024-09-10T08:28:39.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.441+0000 7fa727e00640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 0x7fa70806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:39.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.441+0000 7fa727e00640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 0x7fa70806e260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa71802a150 tx=0x7fa71802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.446+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7140591f0 con 0x7fa72815e4c0 2024-09-10T08:28:39.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.669+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7280ba580 con 0x7fa72815e4c0 2024-09-10T08:28:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.714+0000 7fa71fe00640 1 -- 172.21.15.52:0/3714186282 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7fa71405d4f0 con 0x7fa72815e4c0 2024-09-10T08:28:39.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:39.714 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"btime":"2024-09-10T08:28:39:429785+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T08:28:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 msgr2=0x7fa70806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 0x7fa70806e260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa71802a150 tx=0x7fa71802e000 comp rx=0 tx=0).stop 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 msgr2=0x7fa72815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 0x7fa72815ebe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa71400e870 tx=0x7fa71400ed30 comp rx=0 tx=0).stop 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 shutdown_connections 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa70806bda0 0x7fa70806e260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa728162b70 0x7fa72814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa72815e4c0 0x7fa72815ebe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.715+0000 7fa72d400640 1 --2- 172.21.15.52:0/3714186282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7280b65c0 0x7fa72814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.716+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 >> 172.21.15.52:0/3714186282 conn(0x7fa7280d1080 msgr2=0x7fa7280b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.716+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 shutdown_connections 2024-09-10T08:28:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:39.716+0000 7fa72d400640 1 -- 172.21.15.52:0/3714186282 wait complete. 2024-09-10T08:28:41.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:41.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.898+0000 7f0a67600640 1 Processor -- start 2024-09-10T08:28:41.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.898+0000 7f0a67600640 1 -- start start 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a67600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a6015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a67600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a60071180 con 0x7f0a600b2d40 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a67600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a60071460 con 0x7f0a6013eb20 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a67600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a60071ab0 con 0x7f0a6006c320 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a64c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0a600b2d40 0x7f0a6006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51830/0 (socket says 172.21.15.52:51830) 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a64c00640 1 -- 172.21.15.52:0/2658633871 learned_addr learned my addr 172.21.15.52:0/2658633871 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a5fe00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a6015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286405105 0 0) 0x7f0a60071180 con 0x7f0a600b2d40 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.900+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a48003520 con 0x7f0a600b2d40 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321984588 0 0) 0x7f0a60071460 con 0x7f0a6013eb20 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a60071180 con 0x7f0a6013eb20 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532992590 0 0) 0x7f0a48003520 con 0x7f0a600b2d40 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 msgr2=0x7f0a6015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a6015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 >> v1:172.21.15.176:6789/0 conn(0x7f0a6013eb20 legacy=0x7f0a6015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:41.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a60071740 con 0x7f0a600b2d40 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f0a54001670 con 0x7f0a600b2d40 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 >> v1:172.21.15.52:6789/0 conn(0x7f0a600b2d40 legacy=0x7f0a6006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48003b70 0x7f0a48003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a48004d40 0x7f0a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a60071ab0 con 0x7f0a48003b70 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4800baa0 con 0x7f0a48004d40 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4800bca0 con 0x7f0a6006c320 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a64c00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48003b70 0x7f0a48003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a5fe00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.901+0000 7f0a65600640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a48004d40 0x7f0a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a64c00640 1 -- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 msgr2=0x7f0a48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a64c00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a6006c320 0x7f0a48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a64c00640 1 -- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a48004d40 msgr2=0x7f0a480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a64c00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a48004d40 0x7f0a480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a64c00640 1 -- 172.21.15.52:0/2658633871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48003520 con 0x7f0a48003b70 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.902+0000 7f0a65600640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a48004d40 0x7f0a480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a64c00640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48003b70 0x7f0a48003f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a54007fc0 tx=0x7f0a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c7143beaea5b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54007be0 con 0x7f0a48003b70 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a54005ad0 con 0x7f0a48003b70 2024-09-10T08:28:41.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a5f400640 1 -- 172.21.15.52:0/2658633871 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54007070 con 0x7f0a48003b70 2024-09-10T08:28:41.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a67600640 1 -- 172.21.15.52:0/2658633871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48003b70 msgr2=0x7f0a48003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:41.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a67600640 1 --2- 172.21.15.52:0/2658633871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48003b70 0x7f0a48003f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a54007fc0 tx=0x7f0a48005830 comp rx=0 tx=0).stop 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.903+0000 7f0a65600640 1 -- 172.21.15.52:0/2658633871 reap_dead start 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.904+0000 7f0a67600640 1 -- 172.21.15.52:0/2658633871 shutdown_connections 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.904+0000 7f0a67600640 1 -- 172.21.15.52:0/2658633871 >> 172.21.15.52:0/2658633871 conn(0x7f0a600ccec0 msgr2=0x7f0a600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.904+0000 7f0a67600640 1 -- 172.21.15.52:0/2658633871 shutdown_connections 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.904+0000 7f0a67600640 1 -- 172.21.15.52:0/2658633871 wait complete. 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.905+0000 7f0a67600640 1 Processor -- start 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.905+0000 7f0a67600640 1 -- start start 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a48003b70 0x7f0a600b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a60157a50 0x7f0a60157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6015bf00 con 0x7f0a6015efd0 2024-09-10T08:28:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6013e8a0 con 0x7f0a60157a50 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.906+0000 7f0a67600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6015c080 con 0x7f0a48003b70 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54134/0 (socket says 172.21.15.52:54134) 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 -- 172.21.15.52:0/299638790 learned_addr learned my addr 172.21.15.52:0/299638790 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a64c00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a48003b70 0x7f0a600b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 -- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a48003b70 msgr2=0x7f0a600b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a48003b70 0x7f0a600b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 -- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a60157a50 msgr2=0x7f0a60157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a60157a50 0x7f0a60157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 -- 172.21.15.52:0/299638790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a60156090 con 0x7f0a6015efd0 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5fe00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011970 tx=0x7f0a4c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c019070 con 0x7f0a6015efd0 2024-09-10T08:28:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4c004240 con 0x7f0a6015efd0 2024-09-10T08:28:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a60156370 con 0x7f0a6015efd0 2024-09-10T08:28:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.907+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00f860 con 0x7f0a6015efd0 2024-09-10T08:28:41.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.908+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a60156930 con 0x7f0a6015efd0 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.909+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6006bc10 con 0x7f0a6015efd0 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.909+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a4c01c070 con 0x7f0a6015efd0 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.910+0000 7f0a5cc00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 0x7f0a4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.910+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f0a4c08aff0 con 0x7f0a6015efd0 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.911+0000 7f0a64c00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 0x7f0a4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:41.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.911+0000 7f0a64c00640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 0x7f0a4006e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a54032000 tx=0x7f0a54009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:41.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:41.915+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a4c059c90 con 0x7f0a6015efd0 2024-09-10T08:28:42.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.137+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a60072d30 con 0x7f0a6015efd0 2024-09-10T08:28:42.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.138+0000 7f0a5cc00640 1 -- 172.21.15.52:0/299638790 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f0a4c059590 con 0x7f0a6015efd0 2024-09-10T08:28:42.138 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:42.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"btime":"2024-09-10T08:28:40:431915+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T08:28:42.139 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2024-09-10T08:28:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 msgr2=0x7f0a4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 0x7f0a4006e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0a54032000 tx=0x7f0a54009030 comp rx=0 tx=0).stop 2024-09-10T08:28:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 msgr2=0x7f0a6015f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011970 tx=0x7f0a4c011e30 comp rx=0 tx=0).stop 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 shutdown_connections 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a4006be30 0x7f0a4006e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a60157a50 0x7f0a60157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a6015efd0 0x7f0a6015f450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 --2- 172.21.15.52:0/299638790 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a48003b70 0x7f0a600b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 >> 172.21.15.52:0/299638790 conn(0x7f0a600ccec0 msgr2=0x7f0a6013dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 shutdown_connections 2024-09-10T08:28:42.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.140+0000 7f0a67600640 1 -- 172.21.15.52:0/299638790 wait complete. 2024-09-10T08:28:42.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:28:42.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.312+0000 7fee3c200640 1 Processor -- start 2024-09-10T08:28:42.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.312+0000 7fee3c200640 1 -- start start 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.313+0000 7fee3c200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee3415e6d0 0x7fee34071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.313+0000 7fee3c200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee34070b80 0x7fee341622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.313+0000 7fee3c200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee3415eab0 con 0x7fee3406cd20 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.313+0000 7fee3c200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fee3415ed70 con 0x7fee34070b80 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.313+0000 7fee3c200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fee3415f050 con 0x7fee3415e6d0 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee34070b80 0x7fee341622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fee34070b80 0x7fee341622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54144/0 (socket says 172.21.15.52:54144) 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 -- 172.21.15.52:0/3678738834 learned_addr learned my addr 172.21.15.52:0/3678738834 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee39800640 1 --2- 172.21.15.52:0/3678738834 >> v2:172.21.15.176:3300/0 conn(0x7fee3415e6d0 0x7fee34071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 -- 172.21.15.52:0/3678738834 >> v2:172.21.15.176:3300/0 conn(0x7fee3415e6d0 msgr2=0x7fee34071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 --2- 172.21.15.52:0/3678738834 >> v2:172.21.15.176:3300/0 conn(0x7fee3415e6d0 0x7fee34071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 -- 172.21.15.52:0/3678738834 >> v1:172.21.15.176:6789/0 conn(0x7fee3406cd20 legacy=0x7fee340b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.314+0000 7fee3a200640 1 -- 172.21.15.52:0/3678738834 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3415f330 con 0x7fee34070b80 2024-09-10T08:28:42.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.315+0000 7fee3a200640 1 --2- 172.21.15.52:0/3678738834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee34070b80 0x7fee341622a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee3406fb10 tx=0x7fee2c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99becb09130eb4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.315+0000 7fee33e00640 1 -- 172.21.15.52:0/3678738834 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c036070 con 0x7fee34070b80 2024-09-10T08:28:42.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.315+0000 7fee33e00640 1 -- 172.21.15.52:0/3678738834 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c031600 con 0x7fee34070b80 2024-09-10T08:28:42.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.315+0000 7fee33e00640 1 -- 172.21.15.52:0/3678738834 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0319d0 con 0x7fee34070b80 2024-09-10T08:28:42.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 -- 172.21.15.52:0/3678738834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee34070b80 msgr2=0x7fee341622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 --2- 172.21.15.52:0/3678738834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee34070b80 0x7fee341622a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee3406fb10 tx=0x7fee2c02a730 comp rx=0 tx=0).stop 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 -- 172.21.15.52:0/3678738834 shutdown_connections 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 --2- 172.21.15.52:0/3678738834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee34070b80 0x7fee341622a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 --2- 172.21.15.52:0/3678738834 >> v2:172.21.15.176:3300/0 conn(0x7fee3415e6d0 0x7fee34071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 -- 172.21.15.52:0/3678738834 >> 172.21.15.52:0/3678738834 conn(0x7fee34067fb0 msgr2=0x7fee3406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 -- 172.21.15.52:0/3678738834 shutdown_connections 2024-09-10T08:28:42.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.316+0000 7fee3c200640 1 -- 172.21.15.52:0/3678738834 wait complete. 2024-09-10T08:28:42.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.318+0000 7fee3c200640 1 Processor -- start 2024-09-10T08:28:42.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.318+0000 7fee3c200640 1 -- start start 2024-09-10T08:28:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee3406cd20 0x7fee340b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee34070b80 0x7fee340b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee340718d0 con 0x7fee3415e6d0 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee3415f8f0 con 0x7fee34070b80 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee34071a50 con 0x7fee3406cd20 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54146/0 (socket says 172.21.15.52:54146) 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 -- 172.21.15.52:0/3584439889 learned_addr learned my addr 172.21.15.52:0/3584439889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee39800640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee3406cd20 0x7fee340b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee38e00640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee34070b80 0x7fee340b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 -- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee3406cd20 msgr2=0x7fee340b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee3406cd20 0x7fee340b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 -- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee34070b80 msgr2=0x7fee340b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee34070b80 0x7fee340b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.319+0000 7fee3a200640 1 -- 172.21.15.52:0/3584439889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee34158290 con 0x7fee3415e6d0 2024-09-10T08:28:42.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee3a200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee2c02ad20 tx=0x7fee2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c03f020 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c037040 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c036070 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee340b4ca0 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.320+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee34157a90 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.321+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee34071390 con 0x7fee3415e6d0 2024-09-10T08:28:42.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.322+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee2c042020 con 0x7fee3415e6d0 2024-09-10T08:28:42.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.323+0000 7fee31600640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.323+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fee2c0aadd0 con 0x7fee3415e6d0 2024-09-10T08:28:42.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.323+0000 7fee39800640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.324+0000 7fee39800640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 0x7fee1406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee28009aa0 tx=0x7fee28009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.327+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee2c049030 con 0x7fee3415e6d0 2024-09-10T08:28:42.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.514+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fee3406ebc0 con 0x7fee3415e6d0 2024-09-10T08:28:42.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.514+0000 7fee31600640 1 -- 172.21.15.52:0/3584439889 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7fee2c0ad060 con 0x7fee3415e6d0 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:28:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.516+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 msgr2=0x7fee1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.516+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 0x7fee1406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee28009aa0 tx=0x7fee28009190 comp rx=0 tx=0).stop 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.516+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 msgr2=0x7fee340b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.516+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee2c02ad20 tx=0x7fee2c004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 shutdown_connections 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee1406be30 0x7fee1406e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee3415e6d0 0x7fee340b4680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee34070b80 0x7fee340b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 --2- 172.21.15.52:0/3584439889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee3406cd20 0x7fee340b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 >> 172.21.15.52:0/3584439889 conn(0x7fee34067fb0 msgr2=0x7fee34161d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:42.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 shutdown_connections 2024-09-10T08:28:42.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.517+0000 7fee3c200640 1 -- 172.21.15.52:0/3584439889 wait complete. 2024-09-10T08:28:42.532 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:28:42.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:28:42.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.691+0000 7f778a800640 1 Processor -- start 2024-09-10T08:28:42.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.691+0000 7f778a800640 1 -- start start 2024-09-10T08:28:42.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.692+0000 7f778a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77840af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.692+0000 7f778a800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f778406c320 0x7f778406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.692+0000 7f778a800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778406e340 con 0x7f77840af800 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.692+0000 7f778a800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f77840b0140 con 0x7f778406c320 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.692+0000 7f778a800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77840ae870 con 0x7f7784148170 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f777be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f77840af800 0x7f778406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51846/0 (socket says 172.21.15.52:51846) 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f777be00640 1 -- 172.21.15.52:0/3003661602 learned_addr learned my addr 172.21.15.52:0/3003661602 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7783400640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77840af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7783e00640 1 --2- 172.21.15.52:0/3003661602 >> v2:172.21.15.176:3300/0 conn(0x7f778406c320 0x7f778406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556135520 0 0) 0x7f778406e340 con 0x7f77840af800 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7768003520 con 0x7f77840af800 2024-09-10T08:28:42.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2989192170 0 0) 0x7f7768003520 con 0x7f77840af800 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 msgr2=0x7f77840af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77840af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 >> v2:172.21.15.176:3300/0 conn(0x7f778406c320 msgr2=0x7f778406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.693+0000 7f7782a00640 1 --2- 172.21.15.52:0/3003661602 >> v2:172.21.15.176:3300/0 conn(0x7f778406c320 0x7f778406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778406e620 con 0x7f77840af800 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f776c001670 con 0x7f77840af800 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 >> v1:172.21.15.52:6789/0 conn(0x7f77840af800 legacy=0x7f778406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7768003f30 0x7f7768004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768004d40 0x7f77680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77840b0140 con 0x7f7768003f30 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77840ae870 con 0x7f7768004d40 2024-09-10T08:28:42.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f776800ba10 con 0x7f7784148170 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7768003f30 0x7f7768004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7783400640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f7783e00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768004d40 0x7f77680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 -- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 msgr2=0x7f77680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7784148170 0x7f77680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 -- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768004d40 msgr2=0x7f77680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768004d40 0x7f77680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.694+0000 7f777be00640 1 -- 172.21.15.52:0/3003661602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7768003520 con 0x7f7768003f30 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.695+0000 7f777be00640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7768003f30 0x7f7768004800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c270 tx=0x7f7768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4835ab20561627ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c007cf0 con 0x7f7768003f30 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c005af0 con 0x7f7768003f30 2024-09-10T08:28:42.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f7782a00640 1 -- 172.21.15.52:0/3003661602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c007070 con 0x7f7768003f30 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 -- 172.21.15.52:0/3003661602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7768003f30 msgr2=0x7f7768004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 --2- 172.21.15.52:0/3003661602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7768003f30 0x7f7768004800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c270 tx=0x7f7768005830 comp rx=0 tx=0).stop 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f7783e00640 1 -- 172.21.15.52:0/3003661602 reap_dead start 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 -- 172.21.15.52:0/3003661602 shutdown_connections 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 -- 172.21.15.52:0/3003661602 >> 172.21.15.52:0/3003661602 conn(0x7f77840b2580 msgr2=0x7f77840b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 -- 172.21.15.52:0/3003661602 shutdown_connections 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.696+0000 7f778a800640 1 -- 172.21.15.52:0/3003661602 wait complete. 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.698+0000 7f778a800640 1 Processor -- start 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.698+0000 7f778a800640 1 -- start start 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768003f30 0x7f7784154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77841604c0 0x7f7784160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7784148550 con 0x7f77840cf370 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77840aee30 con 0x7f7768003f30 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f778a800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77841486d0 con 0x7f77841604c0 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f777be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f777be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54158/0 (socket says 172.21.15.52:54158) 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f777be00640 1 -- 172.21.15.52:0/2218026377 learned_addr learned my addr 172.21.15.52:0/2218026377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f7783400640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768003f30 0x7f7784154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.699+0000 7f7783e00640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77841604c0 0x7f7784160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 -- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77841604c0 msgr2=0x7f7784160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77841604c0 0x7f7784160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 -- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768003f30 msgr2=0x7f7784154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768003f30 0x7f7784154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 -- 172.21.15.52:0/2218026377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7784154670 con 0x7f77840cf370 2024-09-10T08:28:42.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777be00640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c210 tx=0x7f778406e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c038040 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f776c042070 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77840cf930 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c001c30 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.700+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77840cfef0 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.701+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77840af2c0 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.702+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f776c031070 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.703+0000 7f777b400640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 0x7f776006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.704+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f776c0aa5c0 con 0x7f77840cf370 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.704+0000 7f7783400640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 0x7f776006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.705+0000 7f7783400640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 0x7f776006e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7774009ae0 tx=0x7f7774009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.708+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f776c007d90 con 0x7f77840cf370 2024-09-10T08:28:42.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:42.891+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f77840b22d0 con 0x7f77840cf370 2024-09-10T08:28:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.449+0000 7f777b400640 1 -- 172.21.15.52:0/2218026377 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f776c078bd0 con 0x7f77840cf370 2024-09-10T08:28:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.453+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 msgr2=0x7f776006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.453+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 0x7f776006e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7774009ae0 tx=0x7f7774009190 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.453+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 msgr2=0x7f77840d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.453+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c210 tx=0x7f778406e7f0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 shutdown_connections 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f776006be60 0x7f776006e320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77841604c0 0x7f7784160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77840cf370 0x7f77840d1130 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 --2- 172.21.15.52:0/2218026377 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7768003f30 0x7f7784154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.454+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 >> 172.21.15.52:0/2218026377 conn(0x7f77840b2580 msgr2=0x7f778406d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.456+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 shutdown_connections 2024-09-10T08:28:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.457+0000 7f778a800640 1 -- 172.21.15.52:0/2218026377 wait complete. 2024-09-10T08:28:43.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:28:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.643+0000 7f7a1fe00640 1 Processor -- start 2024-09-10T08:28:43.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.643+0000 7f7a1fe00640 1 -- start start 2024-09-10T08:28:43.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a200d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7a200b63b0 0x7f7a200cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a20067950 0x7f7a20067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7a200d3950 con 0x7f7a200b63b0 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7a200d3c30 con 0x7f7a20067950 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a200d3f10 con 0x7f7a200b5fd0 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7a200b63b0 0x7f7a200cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7a200b63b0 0x7f7a200cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54170/0 (socket says 172.21.15.52:54170) 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.644+0000 7f7a1e000640 1 -- 172.21.15.52:0/241137307 learned_addr learned my addr 172.21.15.52:0/241137307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1f400640 1 --2- 172.21.15.52:0/241137307 >> v2:172.21.15.176:3300/0 conn(0x7f7a20067950 0x7f7a20067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1ea00640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a200d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1e000640 1 -- 172.21.15.52:0/241137307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 msgr2=0x7f7a200d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1e000640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a200d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1e000640 1 -- 172.21.15.52:0/241137307 >> v2:172.21.15.176:3300/0 conn(0x7f7a20067950 msgr2=0x7f7a20067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1e000640 1 --2- 172.21.15.52:0/241137307 >> v2:172.21.15.176:3300/0 conn(0x7f7a20067950 0x7f7a20067e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.645+0000 7f7a1e000640 1 -- 172.21.15.52:0/241137307 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a200d41f0 con 0x7f7a200b63b0 2024-09-10T08:28:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.646+0000 7f7a1e000640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a200b63b0 0x7f7a200cf650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a2006d090 tx=0x7f7a0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c13c2819a52495 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.646+0000 7f7a1d600640 1 -- 172.21.15.52:0/241137307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c037070 con 0x7f7a200b63b0 2024-09-10T08:28:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.646+0000 7f7a1d600640 1 -- 172.21.15.52:0/241137307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c032440 con 0x7f7a200b63b0 2024-09-10T08:28:43.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.646+0000 7f7a1d600640 1 -- 172.21.15.52:0/241137307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c032810 con 0x7f7a200b63b0 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 -- 172.21.15.52:0/241137307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a200b63b0 msgr2=0x7f7a200cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a200b63b0 0x7f7a200cf650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a2006d090 tx=0x7f7a0c02a270 comp rx=0 tx=0).stop 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 -- 172.21.15.52:0/241137307 shutdown_connections 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/241137307 >> v2:172.21.15.176:3300/0 conn(0x7f7a20067950 0x7f7a20067e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a200b63b0 0x7f7a200cf650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/241137307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a200d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 -- 172.21.15.52:0/241137307 >> 172.21.15.52:0/241137307 conn(0x7f7a200d0fd0 msgr2=0x7f7a200d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 -- 172.21.15.52:0/241137307 shutdown_connections 2024-09-10T08:28:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.647+0000 7f7a1fe00640 1 -- 172.21.15.52:0/241137307 wait complete. 2024-09-10T08:28:43.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.648+0000 7f7a1fe00640 1 Processor -- start 2024-09-10T08:28:43.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 -- start start 2024-09-10T08:28:43.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a20160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a200b63b0 0x7f7a20160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200cfd10 con 0x7f7a20067950 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200cfb90 con 0x7f7a200b63b0 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.649+0000 7f7a1fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a200b67d0 con 0x7f7a200b5fd0 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54172/0 (socket says 172.21.15.52:54172) 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 -- 172.21.15.52:0/1655604737 learned_addr learned my addr 172.21.15.52:0/1655604737 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1e000640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a20160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1f400640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a200b63b0 0x7f7a20160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 -- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 msgr2=0x7f7a20160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a20160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 -- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a200b63b0 msgr2=0x7f7a20160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a200b63b0 0x7f7a20160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 -- 172.21.15.52:0/1655604737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a200ce960 con 0x7f7a20067950 2024-09-10T08:28:43.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.650+0000 7f7a1ea00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000e9b0 tx=0x7f7a1000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.651+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10017070 con 0x7f7a20067950 2024-09-10T08:28:43.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.651+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1000c9a0 con 0x7f7a20067950 2024-09-10T08:28:43.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.651+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000cd90 con 0x7f7a20067950 2024-09-10T08:28:43.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.651+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a200c8e00 con 0x7f7a20067950 2024-09-10T08:28:43.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.651+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a200c93c0 con 0x7f7a20067950 2024-09-10T08:28:43.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.652+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a200c9a10 con 0x7f7a20067950 2024-09-10T08:28:43.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.653+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a1001a070 con 0x7f7a20067950 2024-09-10T08:28:43.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.654+0000 7f7a16a00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 0x7f7a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:43.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.654+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f7a1008aca0 con 0x7f7a20067950 2024-09-10T08:28:43.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.654+0000 7f7a1e000640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 0x7f7a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:43.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.655+0000 7f7a1e000640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 0x7f7a0006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c034000 tx=0x7f7a0c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:43.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.659+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a10059140 con 0x7f7a20067950 2024-09-10T08:28:43.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:43.841+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7a200b3bb0 con 0x7f7a20067950 2024-09-10T08:28:44.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.456+0000 7f7a16a00640 1 -- 172.21.15.52:0/1655604737 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f7a1005d440 con 0x7f7a20067950 2024-09-10T08:28:44.456 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:28:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.460+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 msgr2=0x7f7a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.460+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 0x7f7a0006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c034000 tx=0x7f7a0c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.460+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 msgr2=0x7f7a200ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.460+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000e9b0 tx=0x7f7a1000ee70 comp rx=0 tx=0).stop 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 shutdown_connections 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a0006be30 0x7f7a0006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a200b63b0 0x7f7a20160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a200b5fd0 0x7f7a20160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 --2- 172.21.15.52:0/1655604737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a20067950 0x7f7a200ce420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 >> 172.21.15.52:0/1655604737 conn(0x7f7a200d0fd0 msgr2=0x7f7a200b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 shutdown_connections 2024-09-10T08:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.461+0000 7f7a1fe00640 1 -- 172.21.15.52:0/1655604737 wait complete. 2024-09-10T08:28:44.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:28:44.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.655+0000 7f897be00640 1 Processor -- start 2024-09-10T08:28:44.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.656+0000 7f897be00640 1 -- start start 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f897c15e620 0x7f897c0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897c0d3250 con 0x7f897c0d2660 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897be00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897c0b78b0 con 0x7f897c0d1670 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897be00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f897c0b7680 con 0x7f897c15e620 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f8973e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f897c0d2660 0x7f897c0d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33654/0 (socket says 172.21.15.52:33654) 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f8973e00640 1 -- 172.21.15.52:0/3420233833 learned_addr learned my addr 172.21.15.52:0/3420233833 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:44.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897aa00640 1 --2- 172.21.15.52:0/3420233833 >> v2:172.21.15.176:3300/0 conn(0x7f897c15e620 0x7f897c0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661504297 0 0) 0x7f897c0d3250 con 0x7f897c0d2660 2024-09-10T08:28:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8960003520 con 0x7f897c0d2660 2024-09-10T08:28:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282056740 0 0) 0x7f897c0b78b0 con 0x7f897c0d1670 2024-09-10T08:28:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.657+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f897c0d3250 con 0x7f897c0d1670 2024-09-10T08:28:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.658+0000 7f897aa00640 1 -- 172.21.15.52:0/3420233833 >> v1:172.21.15.176:6789/0 conn(0x7f897c0d1670 legacy=0x7f897c0b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.658+0000 7f897aa00640 1 -- 172.21.15.52:0/3420233833 >> v1:172.21.15.52:6789/0 conn(0x7f897c0d2660 legacy=0x7f897c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.658+0000 7f897aa00640 1 -- 172.21.15.52:0/3420233833 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c15ea00 con 0x7f897c15e620 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897aa00640 1 --2- 172.21.15.52:0/3420233833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c15e620 0x7f897c0d2120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097a0 tx=0x7f896c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc4b5a94fd4bb3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c037070 con 0x7f897c15e620 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f896c032440 con 0x7f897c15e620 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897a000640 1 -- 172.21.15.52:0/3420233833 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c0327f0 con 0x7f897c15e620 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897be00640 1 -- 172.21.15.52:0/3420233833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c15e620 msgr2=0x7f897c0d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897be00640 1 --2- 172.21.15.52:0/3420233833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c15e620 0x7f897c0d2120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f896c0097a0 tx=0x7f896c02a230 comp rx=0 tx=0).stop 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897be00640 1 -- 172.21.15.52:0/3420233833 shutdown_connections 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897be00640 1 --2- 172.21.15.52:0/3420233833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c15e620 0x7f897c0d2120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.659+0000 7f897be00640 1 -- 172.21.15.52:0/3420233833 >> 172.21.15.52:0/3420233833 conn(0x7f897c067950 msgr2=0x7f897c067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.660+0000 7f897be00640 1 -- 172.21.15.52:0/3420233833 shutdown_connections 2024-09-10T08:28:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.660+0000 7f897be00640 1 -- 172.21.15.52:0/3420233833 wait complete. 2024-09-10T08:28:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.661+0000 7f897be00640 1 Processor -- start 2024-09-10T08:28:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.661+0000 7f897be00640 1 -- start start 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c0d1670 0x7f897c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f897c0d2660 0x7f897c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0d40a0 con 0x7f897c15e620 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0d2f70 con 0x7f897c0d1670 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f897c0b8780 con 0x7f897c0d2660 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39958/0 (socket says 172.21.15.52:39958) 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.662+0000 7f897b400640 1 -- 172.21.15.52:0/1397163435 learned_addr learned my addr 172.21.15.52:0/1397163435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897aa00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c0d1670 0x7f897c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f8973e00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f897c0d2660 0x7f897c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 -- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f897c0d2660 msgr2=0x7f897c158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f897c0d2660 0x7f897c158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 -- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c0d1670 msgr2=0x7f897c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c0d1670 0x7f897c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 -- 172.21.15.52:0/1397163435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c1560e0 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897b400640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f897400c790 tx=0x7f897400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974003b70 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974003d10 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c159570 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.663+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400a9f0 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.664+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c159b30 con 0x7f897c15e620 2024-09-10T08:28:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.665+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c0d2120 con 0x7f897c15e620 2024-09-10T08:28:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.666+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f897400ab90 con 0x7f897c15e620 2024-09-10T08:28:44.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.667+0000 7f8972a00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 0x7f895806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:44.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.667+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f897408ad00 con 0x7f897c15e620 2024-09-10T08:28:44.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.668+0000 7f897aa00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 0x7f895806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:44.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.669+0000 7f897aa00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 0x7f895806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f896c034000 tx=0x7f896c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:44.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.672+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8974058f90 con 0x7f897c15e620 2024-09-10T08:28:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:44.894+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f897c0ba1e0 con 0x7f897c15e620 2024-09-10T08:28:45.470 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T08:28:45.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.467+0000 7f8972a00640 1 -- 172.21.15.52:0/1397163435 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f897405d290 con 0x7f897c15e620 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.476+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 msgr2=0x7f895806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.476+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 0x7f895806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f896c034000 tx=0x7f896c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.476+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 msgr2=0x7f897c0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.476+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f897400c790 tx=0x7f897400cc50 comp rx=0 tx=0).stop 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 shutdown_connections 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895806be30 0x7f895806e2f0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f896c034000 tx=0x7f896c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f897c15e620 0x7f897c0c7440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f897c0d2660 0x7f897c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 --2- 172.21.15.52:0/1397163435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f897c0d1670 0x7f897c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.477+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 >> 172.21.15.52:0/1397163435 conn(0x7f897c067950 msgr2=0x7f897c0c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:45.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.480+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 shutdown_connections 2024-09-10T08:28:45.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.480+0000 7f897be00640 1 -- 172.21.15.52:0/1397163435 wait complete. 2024-09-10T08:28:45.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:45.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.666+0000 7fac4ca00640 1 Processor -- start 2024-09-10T08:28:45.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.666+0000 7fac4ca00640 1 -- start start 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac48158cf0 0x7fac480cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac4ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac4815f3f0 0x7fac4806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac4ca00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac48072a70 con 0x7fac480cef80 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac4ca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fac480cdfa0 con 0x7fac4815f3f0 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac4ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac4815f8b0 con 0x7fac48158cf0 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac46800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac4815f3f0 0x7fac4806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac46800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac4815f3f0 0x7fac4806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39968/0 (socket says 172.21.15.52:39968) 2024-09-10T08:28:45.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac46800640 1 -- 172.21.15.52:0/3099351377 learned_addr learned my addr 172.21.15.52:0/3099351377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.667+0000 7fac45e00640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac48158cf0 0x7fac480cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.668+0000 7fac46800640 1 -- 172.21.15.52:0/3099351377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac48158cf0 msgr2=0x7fac480cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.668+0000 7fac46800640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac48158cf0 0x7fac480cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.668+0000 7fac46800640 1 -- 172.21.15.52:0/3099351377 >> v1:172.21.15.52:6789/0 conn(0x7fac480cef80 legacy=0x7fac4815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.668+0000 7fac46800640 1 -- 172.21.15.52:0/3099351377 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4815fb90 con 0x7fac4815f3f0 2024-09-10T08:28:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.668+0000 7fac45400640 1 -- 172.21.15.52:0/3099351377 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400483141 0 0) 0x7fac48072a70 con 0x7fac480cef80 2024-09-10T08:28:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac46800640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac4806bc10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e50 tx=0x7fac4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a07662bcf9fb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac45400640 1 -- 172.21.15.52:0/3099351377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40036070 con 0x7fac4815f3f0 2024-09-10T08:28:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac45400640 1 -- 172.21.15.52:0/3099351377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40031600 con 0x7fac4815f3f0 2024-09-10T08:28:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac45400640 1 -- 172.21.15.52:0/3099351377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac400319d0 con 0x7fac4815f3f0 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 -- 172.21.15.52:0/3099351377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 msgr2=0x7fac4806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac4806bc10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e50 tx=0x7fac4002a710 comp rx=0 tx=0).stop 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 -- 172.21.15.52:0/3099351377 shutdown_connections 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac4806bc10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 --2- 172.21.15.52:0/3099351377 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac48158cf0 0x7fac480cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.669+0000 7fac4ca00640 1 -- 172.21.15.52:0/3099351377 >> 172.21.15.52:0/3099351377 conn(0x7fac4806cd20 msgr2=0x7fac4806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.670+0000 7fac4ca00640 1 -- 172.21.15.52:0/3099351377 shutdown_connections 2024-09-10T08:28:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.670+0000 7fac4ca00640 1 -- 172.21.15.52:0/3099351377 wait complete. 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.671+0000 7fac4ca00640 1 Processor -- start 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.671+0000 7fac4ca00640 1 -- start start 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac480cef80 0x7fac48143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48158cf0 0x7fac48159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac481590d0 con 0x7fac4815f3f0 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac480ce520 con 0x7fac48158cf0 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac4ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac48159250 con 0x7fac480cef80 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39976/0 (socket says 172.21.15.52:39976) 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.672+0000 7fac46800640 1 -- 172.21.15.52:0/1029986989 learned_addr learned my addr 172.21.15.52:0/1029986989 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac45e00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac480cef80 0x7fac48143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac3fe00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48158cf0 0x7fac48159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 -- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac480cef80 msgr2=0x7fac48143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac480cef80 0x7fac48143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 -- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48158cf0 msgr2=0x7fac48159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48158cf0 0x7fac48159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 -- 172.21.15.52:0/1029986989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac481438a0 con 0x7fac4815f3f0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac46800640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac40034040 tx=0x7fac40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40041020 con 0x7fac4815f3f0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40007780 con 0x7fac4815f3f0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40036040 con 0x7fac4815f3f0 2024-09-10T08:28:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.673+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac48143b80 con 0x7fac4815f3f0 2024-09-10T08:28:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.674+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481f4d20 con 0x7fac4815f3f0 2024-09-10T08:28:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.675+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480cea40 con 0x7fac4815f3f0 2024-09-10T08:28:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.676+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac40044020 con 0x7fac4815f3f0 2024-09-10T08:28:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.676+0000 7fac3e000640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 0x7fac2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:45.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.676+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac400ab9d0 con 0x7fac4815f3f0 2024-09-10T08:28:45.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.677+0000 7fac45e00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 0x7fac2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:45.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.677+0000 7fac45e00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 0x7fac2406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac38006fd0 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:45.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.681+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac4004b030 con 0x7fac4815f3f0 2024-09-10T08:28:45.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.866+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac4806bcb0 con 0x7fac4815f3f0 2024-09-10T08:28:45.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.867+0000 7fac3e000640 1 -- 172.21.15.52:0/1029986989 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16694 (secure 0 0 0) 0x7fac40079d30 con 0x7fac4815f3f0 2024-09-10T08:28:45.868 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:45.868 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:44.895805+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 msgr2=0x7fac2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 0x7fac2406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac38006fd0 tx=0x7fac38008040 comp rx=0 tx=0).stop 2024-09-10T08:28:45.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 msgr2=0x7fac480cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac40034040 tx=0x7fac40004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 shutdown_connections 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac2406be30 0x7fac2406e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac4815f3f0 0x7fac480cadd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac48158cf0 0x7fac48159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 --2- 172.21.15.52:0/1029986989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac480cef80 0x7fac48143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 >> 172.21.15.52:0/1029986989 conn(0x7fac4806cd20 msgr2=0x7fac4806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 shutdown_connections 2024-09-10T08:28:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:45.870+0000 7fac4ca00640 1 -- 172.21.15.52:0/1029986989 wait complete. 2024-09-10T08:28:45.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:46.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.041+0000 7f5730200640 1 Processor -- start 2024-09-10T08:28:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.041+0000 7f5730200640 1 -- start start 2024-09-10T08:28:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f5730200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57280b2d40 0x7f572806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f5730200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f572806c150 0x7f572815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f5730200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5728071180 con 0x7f572813eb20 2024-09-10T08:28:46.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f5730200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5728071ab0 con 0x7f57280b2d40 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f5730200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5728071460 con 0x7f572806c150 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57280b2d40 0x7f572806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572ce00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f572813eb20 0x7f572815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33684/0 (socket says 172.21.15.52:33684) 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572ce00640 1 -- 172.21.15.52:0/1871069092 learned_addr learned my addr 172.21.15.52:0/1871069092 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 --2- 172.21.15.52:0/1871069092 >> v2:172.21.15.52:3300/0 conn(0x7f57280b2d40 0x7f572806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39984/0 (socket says 172.21.15.52:39984) 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572e200640 1 --2- 172.21.15.52:0/1871069092 >> v2:172.21.15.176:3300/0 conn(0x7f572806c150 0x7f572815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 -- 172.21.15.52:0/1871069092 >> v2:172.21.15.176:3300/0 conn(0x7f572806c150 msgr2=0x7f572815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 --2- 172.21.15.52:0/1871069092 >> v2:172.21.15.176:3300/0 conn(0x7f572806c150 0x7f572815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 -- 172.21.15.52:0/1871069092 >> v1:172.21.15.52:6789/0 conn(0x7f572813eb20 legacy=0x7f572815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.043+0000 7f572d800640 1 -- 172.21.15.52:0/1871069092 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5728071740 con 0x7f57280b2d40 2024-09-10T08:28:46.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.044+0000 7f572d800640 1 --2- 172.21.15.52:0/1871069092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57280b2d40 0x7f572806bc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5728070d30 tx=0x7f571c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e20759291a69d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5727e00640 1 -- 172.21.15.52:0/1871069092 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c037070 con 0x7f57280b2d40 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5727e00640 1 -- 172.21.15.52:0/1871069092 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c032440 con 0x7f57280b2d40 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5727e00640 1 -- 172.21.15.52:0/1871069092 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c032810 con 0x7f57280b2d40 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 -- 172.21.15.52:0/1871069092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57280b2d40 msgr2=0x7f572806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 --2- 172.21.15.52:0/1871069092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57280b2d40 0x7f572806bc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5728070d30 tx=0x7f571c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 -- 172.21.15.52:0/1871069092 shutdown_connections 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 --2- 172.21.15.52:0/1871069092 >> v2:172.21.15.176:3300/0 conn(0x7f572806c150 0x7f572815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 --2- 172.21.15.52:0/1871069092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57280b2d40 0x7f572806bc10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 -- 172.21.15.52:0/1871069092 >> 172.21.15.52:0/1871069092 conn(0x7f57280ccec0 msgr2=0x7f57280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 -- 172.21.15.52:0/1871069092 shutdown_connections 2024-09-10T08:28:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.045+0000 7f5730200640 1 -- 172.21.15.52:0/1871069092 wait complete. 2024-09-10T08:28:46.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.047+0000 7f5730200640 1 Processor -- start 2024-09-10T08:28:46.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.047+0000 7f5730200640 1 -- start start 2024-09-10T08:28:46.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57280b2d40 0x7f57281595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f572813eb20 0x7f5728167360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57280722d0 con 0x7f572806c150 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5728072150 con 0x7f57280b2d40 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f5730200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5728072450 con 0x7f572813eb20 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39998/0 (socket says 172.21.15.52:39998) 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 -- 172.21.15.52:0/3861540081 learned_addr learned my addr 172.21.15.52:0/3861540081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 -- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f572813eb20 msgr2=0x7f5728167360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f572813eb20 0x7f5728167360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 -- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57280b2d40 msgr2=0x7f57281595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57280b2d40 0x7f57281595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.048+0000 7f572d800640 1 -- 172.21.15.52:0/3861540081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572813e2d0 con 0x7f572806c150 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f572d800640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f571c009890 tx=0x7f571c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c037040 con 0x7f572806c150 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f571c042070 con 0x7f572806c150 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c030bd0 con 0x7f572806c150 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57281665a0 con 0x7f572806c150 2024-09-10T08:28:46.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.049+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5728166b60 con 0x7f572806c150 2024-09-10T08:28:46.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.050+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572806bc10 con 0x7f572806c150 2024-09-10T08:28:46.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.051+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f571c047460 con 0x7f572806c150 2024-09-10T08:28:46.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.052+0000 7f5725600640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 0x7f570806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.052+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f571c0aba80 con 0x7f572806c150 2024-09-10T08:28:46.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.052+0000 7f572ce00640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 0x7f570806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.053+0000 7f572ce00640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 0x7f570806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5714000f60 tx=0x7f5714007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.057+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f571c0ade20 con 0x7f572806c150 2024-09-10T08:28:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.243+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f572806c9c0 con 0x7f572806c150 2024-09-10T08:28:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.244+0000 7f5725600640 1 -- 172.21.15.52:0/3861540081 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16694 (secure 0 0 0) 0x7f572813e2d0 con 0x7f572806c150 2024-09-10T08:28:46.244 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:46.244 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:44.895805+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 msgr2=0x7f570806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 0x7f570806e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5714000f60 tx=0x7f5714007a80 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 msgr2=0x7f5728138530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f571c009890 tx=0x7f571c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 shutdown_connections 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f570806be60 0x7f570806e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f572813eb20 0x7f5728167360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57280b2d40 0x7f57281595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 --2- 172.21.15.52:0/3861540081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f572806c150 0x7f5728138530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 >> 172.21.15.52:0/3861540081 conn(0x7f57280ccec0 msgr2=0x7f57281581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:46.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 shutdown_connections 2024-09-10T08:28:46.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.246+0000 7f5730200640 1 -- 172.21.15.52:0/3861540081 wait complete. 2024-09-10T08:28:46.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:28:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.422+0000 7fa0e0e00640 1 Processor -- start 2024-09-10T08:28:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.422+0000 7fa0e0e00640 1 -- start start 2024-09-10T08:28:46.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.423+0000 7fa0e0e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0dc0ccf30 0x7fa0dc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.423+0000 7fa0e0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 0x7fa0dc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.423+0000 7fa0e0e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0dc0cf2e0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.423+0000 7fa0e0e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa0dc070fe0 con 0x7fa0dc0ccf30 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.423+0000 7fa0e0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc0712c0 con 0x7fa0dc0cead0 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0d9400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa0dc15b7c0 0x7fa0dc0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33686/0 (socket says 172.21.15.52:33686) 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0d9400640 1 -- 172.21.15.52:0/1601771643 learned_addr learned my addr 172.21.15.52:0/1601771643 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0d9e00640 1 --2- 172.21.15.52:0/1601771643 >> v2:172.21.15.176:3300/0 conn(0x7fa0dc0ccf30 0x7fa0dc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0da800640 1 --2- 172.21.15.52:0/1601771643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 0x7fa0dc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0d8a00640 1 -- 172.21.15.52:0/1601771643 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514863257 0 0) 0x7fa0dc0cf2e0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0d8a00640 1 -- 172.21.15.52:0/1601771643 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0c0003520 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0da800640 1 -- 172.21.15.52:0/1601771643 >> v2:172.21.15.176:3300/0 conn(0x7fa0dc0ccf30 msgr2=0x7fa0dc0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:46.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0da800640 1 --2- 172.21.15.52:0/1601771643 >> v2:172.21.15.176:3300/0 conn(0x7fa0dc0ccf30 0x7fa0dc0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0da800640 1 -- 172.21.15.52:0/1601771643 >> v1:172.21.15.52:6789/0 conn(0x7fa0dc15b7c0 legacy=0x7fa0dc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.424+0000 7fa0da800640 1 -- 172.21.15.52:0/1601771643 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc0715a0 con 0x7fa0dc0cead0 2024-09-10T08:28:46.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.425+0000 7fa0da800640 1 --2- 172.21.15.52:0/1601771643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 0x7fa0dc071ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb9c5c05de610db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0d8a00640 1 -- 172.21.15.52:0/1601771643 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4031600 con 0x7fa0dc0cead0 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0d8a00640 1 -- 172.21.15.52:0/1601771643 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d40317a0 con 0x7fa0dc0cead0 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0d8a00640 1 -- 172.21.15.52:0/1601771643 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4031b50 con 0x7fa0dc0cead0 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 -- 172.21.15.52:0/1601771643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 msgr2=0x7fa0dc071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/1601771643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 0x7fa0dc071ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 -- 172.21.15.52:0/1601771643 shutdown_connections 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/1601771643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0cead0 0x7fa0dc071ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/1601771643 >> v2:172.21.15.176:3300/0 conn(0x7fa0dc0ccf30 0x7fa0dc0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 -- 172.21.15.52:0/1601771643 >> 172.21.15.52:0/1601771643 conn(0x7fa0dc06d0f0 msgr2=0x7fa0dc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:46.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 -- 172.21.15.52:0/1601771643 shutdown_connections 2024-09-10T08:28:46.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.426+0000 7fa0e0e00640 1 -- 172.21.15.52:0/1601771643 wait complete. 2024-09-10T08:28:46.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.428+0000 7fa0e0e00640 1 Processor -- start 2024-09-10T08:28:46.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.428+0000 7fa0e0e00640 1 -- start start 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0ccf30 0x7fa0dc1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0dc0cead0 0x7fa0dc147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc0cf0c0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc0cef40 con 0x7fa0dc0cead0 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0e0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc072000 con 0x7fa0dc0ccf30 2024-09-10T08:28:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0da800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0da800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40010/0 (socket says 172.21.15.52:40010) 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0da800640 1 -- 172.21.15.52:0/2319763796 learned_addr learned my addr 172.21.15.52:0/2319763796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0d9e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0ccf30 0x7fa0dc1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.429+0000 7fa0d9400640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0dc0cead0 0x7fa0dc147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 -- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0ccf30 msgr2=0x7fa0dc1f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0ccf30 0x7fa0dc1f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 -- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0dc0cead0 msgr2=0x7fa0dc147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0dc0cead0 0x7fa0dc147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 -- 172.21.15.52:0/2319763796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc15cf00 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0da800640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4040070 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d4004260 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc15d1e0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.430+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4009450 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.431+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc149270 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.431+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc071ac0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.432+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d4039040 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.433+0000 7fa0d2000640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 0x7fa0bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:46.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.433+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d40abf60 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.434+0000 7fa0d9e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 0x7fa0bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:46.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.434+0000 7fa0d9e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 0x7fa0bc06e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc14a5b0 tx=0x7fa0cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:46.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.437+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0d407a2b0 con 0x7fa0dc15b7c0 2024-09-10T08:28:46.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:46.662+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0dc0cc960 con 0x7fa0dc15b7c0 2024-09-10T08:28:47.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.477+0000 7fa0d2000640 1 -- 172.21.15.52:0/2319763796 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa0d407e5b0 con 0x7fa0dc15b7c0 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.480+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 msgr2=0x7fa0bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.480+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 0x7fa0bc06e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc14a5b0 tx=0x7fa0cc009190 comp rx=0 tx=0).stop 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.480+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 msgr2=0x7fa0dc1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.480+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d4004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 shutdown_connections 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0bc06be30 0x7fa0bc06e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0dc15b7c0 0x7fa0dc1487f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0dc0cead0 0x7fa0dc147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 --2- 172.21.15.52:0/2319763796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0dc0ccf30 0x7fa0dc1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 >> 172.21.15.52:0/2319763796 conn(0x7fa0dc06d0f0 msgr2=0x7fa0dc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 shutdown_connections 2024-09-10T08:28:47.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.481+0000 7fa0e0e00640 1 -- 172.21.15.52:0/2319763796 wait complete. 2024-09-10T08:28:47.500 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:28:47.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:28:47.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.663+0000 7f8b11000640 1 Processor -- start 2024-09-10T08:28:47.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.663+0000 7f8b11000640 1 -- start start 2024-09-10T08:28:47.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.664+0000 7f8b11000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b0c0b5fd0 0x7f8b0c0d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.664+0000 7f8b11000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0d3950 con 0x7f8b0c0b63b0 2024-09-10T08:28:47.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.664+0000 7f8b11000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0d3c30 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.664+0000 7f8b11000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8b0c0d3f10 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.664+0000 7f8b0aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8b0c0b63b0 0x7f8b0c0cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33690/0 (socket says 172.21.15.52:33690) 2024-09-10T08:28:47.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0aa00640 1 -- 172.21.15.52:0/4020119662 learned_addr learned my addr 172.21.15.52:0/4020119662 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0b400640 1 --2- 172.21.15.52:0/4020119662 >> v2:172.21.15.176:3300/0 conn(0x7f8b0c0b5fd0 0x7f8b0c0d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966965953 0 0) 0x7f8b0c0d3950 con 0x7f8b0c0b63b0 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af0003520 con 0x7f8b0c0b63b0 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785595035 0 0) 0x7f8b0c0d3c30 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c0d3950 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0b400640 1 -- 172.21.15.52:0/4020119662 >> v1:172.21.15.176:6789/0 conn(0x7f8b0c0b7c10 legacy=0x7f8b0c0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0b400640 1 -- 172.21.15.52:0/4020119662 >> v1:172.21.15.52:6789/0 conn(0x7f8b0c0b63b0 legacy=0x7f8b0c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.665+0000 7f8b0b400640 1 -- 172.21.15.52:0/4020119662 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c0d41f0 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.666+0000 7f8b0b400640 1 --2- 172.21.15.52:0/4020119662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b5fd0 0x7f8b0c0d32c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0097a0 tx=0x7f8afc02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4966ec9c62d5cca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc037070 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc032640 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b0a000640 1 -- 172.21.15.52:0/4020119662 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc032a10 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 -- 172.21.15.52:0/4020119662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b5fd0 msgr2=0x7f8b0c0d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 --2- 172.21.15.52:0/4020119662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b5fd0 0x7f8b0c0d32c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0097a0 tx=0x7f8afc02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 -- 172.21.15.52:0/4020119662 shutdown_connections 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 --2- 172.21.15.52:0/4020119662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b5fd0 0x7f8b0c0d32c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 -- 172.21.15.52:0/4020119662 >> 172.21.15.52:0/4020119662 conn(0x7f8b0c0d0fd0 msgr2=0x7f8b0c0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 -- 172.21.15.52:0/4020119662 shutdown_connections 2024-09-10T08:28:47.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.667+0000 7f8b11000640 1 -- 172.21.15.52:0/4020119662 wait complete. 2024-09-10T08:28:47.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.669+0000 7f8b11000640 1 Processor -- start 2024-09-10T08:28:47.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.669+0000 7f8b11000640 1 -- start start 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b0c0b5fd0 0x7f8b0c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b63b0 0x7f8b0c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c0b6950 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0c0b67d0 con 0x7f8b0c0b63b0 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b11000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0c15e7f0 con 0x7f8b0c0b5fd0 2024-09-10T08:28:47.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40024/0 (socket says 172.21.15.52:40024) 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b0be00640 1 -- 172.21.15.52:0/384100688 learned_addr learned my addr 172.21.15.52:0/384100688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b0aa00640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b63b0 0x7f8b0c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.670+0000 7f8b0b400640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b0c0b5fd0 0x7f8b0c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 -- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b0c0b5fd0 msgr2=0x7f8b0c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b0c0b5fd0 0x7f8b0c153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 -- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b63b0 msgr2=0x7f8b0c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b63b0 0x7f8b0c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 -- 172.21.15.52:0/384100688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c15fd60 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b0be00640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c710 tx=0x7f8b0400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04003b70 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04003d10 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400aa50 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c160040 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.671+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0c157cf0 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.672+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0c0d32c0 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.673+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b0400abf0 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.674+0000 7f8b03400640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 0x7f8aec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.674+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b0408ac90 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.675+0000 7f8b0b400640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 0x7f8aec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.675+0000 7f8b0b400640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 0x7f8aec06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8afc034000 tx=0x7f8afc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:47.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.679+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b0400ce20 con 0x7f8b0c0b7c10 2024-09-10T08:28:47.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:47.903+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8b0c0c7a60 con 0x7f8b0c0b7c10 2024-09-10T08:28:48.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.485+0000 7f8b03400640 1 -- 172.21.15.52:0/384100688 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8b04058f50 con 0x7f8b0c0b7c10 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 msgr2=0x7f8aec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 0x7f8aec06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8afc034000 tx=0x7f8afc02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 msgr2=0x7f8b0c0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c710 tx=0x7f8b0400cbd0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 shutdown_connections 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8aec06be30 0x7f8aec06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b0c0b7c10 0x7f8b0c0cacb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b0c0b63b0 0x7f8b0c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.488+0000 7f8b11000640 1 --2- 172.21.15.52:0/384100688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b0c0b5fd0 0x7f8b0c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.489+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 >> 172.21.15.52:0/384100688 conn(0x7f8b0c0d0fd0 msgr2=0x7f8b0c0b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.489+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 shutdown_connections 2024-09-10T08:28:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.489+0000 7f8b11000640 1 -- 172.21.15.52:0/384100688 wait complete. 2024-09-10T08:28:48.506 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:28:48.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:28:48.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.667+0000 7f5132600640 1 Processor -- start 2024-09-10T08:28:48.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.667+0000 7f5132600640 1 -- start start 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.668+0000 7f5132600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f5132600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c0b4020 con 0x7f512c073180 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f5132600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c0b42c0 con 0x7f512c0b5f90 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f5132600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f512c0b45a0 con 0x7f512c145ed0 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f5123e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f512c073180 0x7f512c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33704/0 (socket says 172.21.15.52:33704) 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f5123e00640 1 -- 172.21.15.52:0/3407206047 learned_addr learned my addr 172.21.15.52:0/3407206047 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512b400640 1 --2- 172.21.15.52:0/3407206047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788112167 0 0) 0x7f512c0b4020 con 0x7f512c073180 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5110003520 con 0x7f512c073180 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192147867 0 0) 0x7f512c0b42c0 con 0x7f512c0b5f90 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512c0b4020 con 0x7f512c0b5f90 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512b400640 1 -- 172.21.15.52:0/3407206047 >> v1:172.21.15.176:6789/0 conn(0x7f512c0b5f90 legacy=0x7f512c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512b400640 1 -- 172.21.15.52:0/3407206047 >> v1:172.21.15.52:6789/0 conn(0x7f512c073180 legacy=0x7f512c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.669+0000 7f512b400640 1 -- 172.21.15.52:0/3407206047 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c0b4880 con 0x7f512c145ed0 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.670+0000 7f512b400640 1 --2- 172.21.15.52:0/3407206047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c0b5080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f511c0097d0 tx=0x7f511c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d40d1926019908 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c037070 con 0x7f512c145ed0 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c032440 con 0x7f512c145ed0 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f512aa00640 1 -- 172.21.15.52:0/3407206047 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c032810 con 0x7f512c145ed0 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 -- 172.21.15.52:0/3407206047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 msgr2=0x7f512c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 --2- 172.21.15.52:0/3407206047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c0b5080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f511c0097d0 tx=0x7f511c02a210 comp rx=0 tx=0).stop 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 -- 172.21.15.52:0/3407206047 shutdown_connections 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 --2- 172.21.15.52:0/3407206047 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c0b5080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 -- 172.21.15.52:0/3407206047 >> 172.21.15.52:0/3407206047 conn(0x7f512c0ccec0 msgr2=0x7f512c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.671+0000 7f5132600640 1 -- 172.21.15.52:0/3407206047 shutdown_connections 2024-09-10T08:28:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.672+0000 7f5132600640 1 -- 172.21.15.52:0/3407206047 wait complete. 2024-09-10T08:28:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.673+0000 7f5132600640 1 Processor -- start 2024-09-10T08:28:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.673+0000 7f5132600640 1 -- start start 2024-09-10T08:28:48.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 0x7f512c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c1f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f512c146430 con 0x7f512c0b5f90 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1462b0 con 0x7f512c073180 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5132600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f512c0735c0 con 0x7f512c145ed0 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.674+0000 7f5123e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40026/0 (socket says 172.21.15.52:40026) 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 -- 172.21.15.52:0/3568010923 learned_addr learned my addr 172.21.15.52:0/3568010923 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f512b400640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 0x7f512c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f512be00640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c1f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 -- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 msgr2=0x7f512c1f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c1f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 -- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 msgr2=0x7f512c070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 0x7f512c070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 -- 172.21.15.52:0/3568010923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c071550 con 0x7f512c0b5f90 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f512b400640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 0x7f512c070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f512be00640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c1f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123e00640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f511400c4d0 tx=0x7f511400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114017070 con 0x7f512c0b5f90 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114005ce0 con 0x7f512c0b5f90 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.675+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114007270 con 0x7f512c0b5f90 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.676+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c071830 con 0x7f512c0b5f90 2024-09-10T08:28:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.676+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c071df0 con 0x7f512c0b5f90 2024-09-10T08:28:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.677+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c073960 con 0x7f512c0b5f90 2024-09-10T08:28:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.677+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f511401a070 con 0x7f512c0b5f90 2024-09-10T08:28:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.679+0000 7f5123400640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 0x7f510806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.679+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f511408a1c0 con 0x7f512c0b5f90 2024-09-10T08:28:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.679+0000 7f512b400640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 0x7f510806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.680+0000 7f512b400640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 0x7f510806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f511c034000 tx=0x7f511c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:48.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.683+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5114058480 con 0x7f512c0b5f90 2024-09-10T08:28:48.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.906+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f512c0cf280 con 0x7f512c0b5f90 2024-09-10T08:28:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.907+0000 7f5123400640 1 -- 172.21.15.52:0/3568010923 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f511405c780 con 0x7f512c0b5f90 2024-09-10T08:28:48.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:48.908 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:28:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:28:48.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 msgr2=0x7f510806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 0x7f510806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f511c034000 tx=0x7f511c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 msgr2=0x7f512c1f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f511400c4d0 tx=0x7f511400c990 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 shutdown_connections 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f510806be30 0x7f510806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f512c145ed0 0x7f512c1f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c0b5f90 0x7f512c1f5240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 --2- 172.21.15.52:0/3568010923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f512c073180 0x7f512c070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 >> 172.21.15.52:0/3568010923 conn(0x7f512c0ccec0 msgr2=0x7f512c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 shutdown_connections 2024-09-10T08:28:48.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:48.909+0000 7f5132600640 1 -- 172.21.15.52:0/3568010923 wait complete. 2024-09-10T08:28:48.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:49.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.080+0000 7f03f3c00640 1 Processor -- start 2024-09-10T08:28:49.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.080+0000 7f03f3c00640 1 -- start start 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f3c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03ec145ed0 0x7f03ec0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f3c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03ec0b5f90 0x7f03ec0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f3c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec0b4020 con 0x7f03ec073180 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f3c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec0b63d0 con 0x7f03ec145ed0 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f3c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec073b00 con 0x7f03ec0b5f90 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.081+0000 7f03f1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03ec145ed0 0x7f03ec0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f03ec145ed0 0x7f03ec0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40032/0 (socket says 172.21.15.52:40032) 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 -- 172.21.15.52:0/4198467231 learned_addr learned my addr 172.21.15.52:0/4198467231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1c00640 1 --2- 172.21.15.52:0/4198467231 >> v2:172.21.15.176:3300/0 conn(0x7f03ec0b5f90 0x7f03ec0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 -- 172.21.15.52:0/4198467231 >> v2:172.21.15.176:3300/0 conn(0x7f03ec0b5f90 msgr2=0x7f03ec0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:49.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 --2- 172.21.15.52:0/4198467231 >> v2:172.21.15.176:3300/0 conn(0x7f03ec0b5f90 0x7f03ec0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 -- 172.21.15.52:0/4198467231 >> v1:172.21.15.52:6789/0 conn(0x7f03ec073180 legacy=0x7f03ec0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.082+0000 7f03f1200640 1 -- 172.21.15.52:0/4198467231 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec0b42c0 con 0x7f03ec145ed0 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.083+0000 7f03f1200640 1 --2- 172.21.15.52:0/4198467231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec145ed0 0x7f03ec0b5080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03ec070080 tx=0x7f03e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4226875cd66985b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.083+0000 7f03eb400640 1 -- 172.21.15.52:0/4198467231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0037070 con 0x7f03ec145ed0 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.083+0000 7f03eb400640 1 -- 172.21.15.52:0/4198467231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e0032440 con 0x7f03ec145ed0 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.083+0000 7f03eb400640 1 -- 172.21.15.52:0/4198467231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0032810 con 0x7f03ec145ed0 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 -- 172.21.15.52:0/4198467231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec145ed0 msgr2=0x7f03ec0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 --2- 172.21.15.52:0/4198467231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec145ed0 0x7f03ec0b5080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03ec070080 tx=0x7f03e002a270 comp rx=0 tx=0).stop 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 -- 172.21.15.52:0/4198467231 shutdown_connections 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 --2- 172.21.15.52:0/4198467231 >> v2:172.21.15.176:3300/0 conn(0x7f03ec0b5f90 0x7f03ec0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 --2- 172.21.15.52:0/4198467231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec145ed0 0x7f03ec0b5080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 -- 172.21.15.52:0/4198467231 >> 172.21.15.52:0/4198467231 conn(0x7f03ec0ccec0 msgr2=0x7f03ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 -- 172.21.15.52:0/4198467231 shutdown_connections 2024-09-10T08:28:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.084+0000 7f03f3c00640 1 -- 172.21.15.52:0/4198467231 wait complete. 2024-09-10T08:28:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.085+0000 7f03f3c00640 1 Processor -- start 2024-09-10T08:28:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 -- start start 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ec0b5f90 0x7f03ec158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 0x7f03ec1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0b4b60 con 0x7f03ec073180 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0b4880 con 0x7f03ec145ed0 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.086+0000 7f03f3c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec1462b0 con 0x7f03ec0b5f90 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40038/0 (socket says 172.21.15.52:40038) 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 -- 172.21.15.52:0/3303319541 learned_addr learned my addr 172.21.15.52:0/3303319541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 0x7f03ec1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03ebe00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ec0b5f90 0x7f03ec158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 -- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ec0b5f90 msgr2=0x7f03ec158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ec0b5f90 0x7f03ec158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 -- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 msgr2=0x7f03ec1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 0x7f03ec1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 -- 172.21.15.52:0/3303319541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec13f130 con 0x7f03ec073180 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 0x7f03ec1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.087+0000 7f03f1200640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03e002a2b0 tx=0x7f03e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.088+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0041020 con 0x7f03ec073180 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.088+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e00306c0 con 0x7f03ec073180 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.088+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e0037040 con 0x7f03ec073180 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.088+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec13f410 con 0x7f03ec073180 2024-09-10T08:28:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.088+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec13f9d0 con 0x7f03ec073180 2024-09-10T08:28:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.089+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec0735c0 con 0x7f03ec073180 2024-09-10T08:28:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.090+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03e0044020 con 0x7f03ec073180 2024-09-10T08:28:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.090+0000 7f03e8c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 0x7f03cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.091+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f03e00ab6a0 con 0x7f03ec073180 2024-09-10T08:28:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.091+0000 7f03ebe00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 0x7f03cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.092+0000 7f03ebe00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 0x7f03cc06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0cc8b0 tx=0x7f03d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.095+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03e004b030 con 0x7f03ec073180 2024-09-10T08:28:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.279+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03ec0b3c20 con 0x7f03ec073180 2024-09-10T08:28:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.280+0000 7f03e8c00640 1 -- 172.21.15.52:0/3303319541 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7f03e007a050 con 0x7f03ec073180 2024-09-10T08:28:49.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:49.281 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 msgr2=0x7f03cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 0x7f03cc06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0cc8b0 tx=0x7f03d8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 msgr2=0x7f03ec141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03e002a2b0 tx=0x7f03e00046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 shutdown_connections 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f03cc06be30 0x7f03cc06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ec145ed0 0x7f03ec1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ec0b5f90 0x7f03ec158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 --2- 172.21.15.52:0/3303319541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03ec073180 0x7f03ec141e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.282+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 >> 172.21.15.52:0/3303319541 conn(0x7f03ec0ccec0 msgr2=0x7f03ec0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.283+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 shutdown_connections 2024-09-10T08:28:49.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.283+0000 7f03f3c00640 1 -- 172.21.15.52:0/3303319541 wait complete. 2024-09-10T08:28:49.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:28:49.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:49.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.454+0000 7fcb01400640 1 Processor -- start 2024-09-10T08:28:49.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.454+0000 7fcb01400640 1 -- start start 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.455+0000 7fcb01400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcafc073890 0x7fcafc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcb01400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcb01400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcafc0b4020 con 0x7fcafc145ed0 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcb01400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcafc0b42c0 con 0x7fcafc073890 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcb01400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0b45a0 con 0x7fcafc0b5880 2024-09-10T08:28:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcafa800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcafc145ed0 0x7fcafc073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33724/0 (socket says 172.21.15.52:33724) 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcafa800640 1 -- 172.21.15.52:0/3872476473 learned_addr learned my addr 172.21.15.52:0/3872476473 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/3872476473 >> v2:172.21.15.52:3300/0 conn(0x7fcafc073890 0x7fcafc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcafb200640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf1e00640 1 -- 172.21.15.52:0/3872476473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 msgr2=0x7fcafc0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc0b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf1e00640 1 -- 172.21.15.52:0/3872476473 >> v1:172.21.15.52:6789/0 conn(0x7fcafc145ed0 legacy=0x7fcafc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf1e00640 1 -- 172.21.15.52:0/3872476473 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc0b4880 con 0x7fcafc073890 2024-09-10T08:28:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.456+0000 7fcaf9e00640 1 -- 172.21.15.52:0/3872476473 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032088978 0 0) 0x7fcafc0b4020 con 0x7fcafc145ed0 2024-09-10T08:28:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.457+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc0b5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcae40097a0 tx=0x7fcae402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e56375ce340f8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.457+0000 7fcaf9e00640 1 -- 172.21.15.52:0/3872476473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4037070 con 0x7fcafc073890 2024-09-10T08:28:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.457+0000 7fcaf9e00640 1 -- 172.21.15.52:0/3872476473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae4032440 con 0x7fcafc073890 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcaf9e00640 1 -- 172.21.15.52:0/3872476473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4032810 con 0x7fcafc073890 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 -- 172.21.15.52:0/3872476473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 msgr2=0x7fcafc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc0b5080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcae40097a0 tx=0x7fcae402a180 comp rx=0 tx=0).stop 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 -- 172.21.15.52:0/3872476473 shutdown_connections 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc0b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 --2- 172.21.15.52:0/3872476473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc0b5080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 -- 172.21.15.52:0/3872476473 >> 172.21.15.52:0/3872476473 conn(0x7fcafc0ccec0 msgr2=0x7fcafc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 -- 172.21.15.52:0/3872476473 shutdown_connections 2024-09-10T08:28:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.458+0000 7fcb01400640 1 -- 172.21.15.52:0/3872476473 wait complete. 2024-09-10T08:28:49.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.460+0000 7fcb01400640 1 Processor -- start 2024-09-10T08:28:49.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.460+0000 7fcb01400640 1 -- start start 2024-09-10T08:28:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcafc145ed0 0x7fcafc158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0b6270 con 0x7fcafc073890 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1462b0 con 0x7fcafc145ed0 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcb01400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0712e0 con 0x7fcafc0b5880 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40052/0 (socket says 172.21.15.52:40052) 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafa800640 1 -- 172.21.15.52:0/2113479832 learned_addr learned my addr 172.21.15.52:0/2113479832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafb200640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcafc145ed0 0x7fcafc158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafa800640 1 -- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 msgr2=0x7fcafc13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.461+0000 7fcafa800640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc13cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcafa800640 1 -- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcafc145ed0 msgr2=0x7fcafc158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcafa800640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcafc145ed0 0x7fcafc158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcafa800640 1 -- 172.21.15.52:0/2113479832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc13e660 con 0x7fcafc073890 2024-09-10T08:28:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcafa800640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c400 tx=0x7fcaec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec017070 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec005ce0 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec007310 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc13e940 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.462+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc070f70 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.463+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc144950 con 0x7fcafc073890 2024-09-10T08:28:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.464+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcaec01a070 con 0x7fcafc073890 2024-09-10T08:28:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.465+0000 7fcaf3400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 0x7fcad806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.466+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcaec08a1f0 con 0x7fcafc073890 2024-09-10T08:28:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.466+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 0x7fcad806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.466+0000 7fcaf1e00640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 0x7fcad806e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcae4034000 tx=0x7fcae402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.470+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaec058540 con 0x7fcafc073890 2024-09-10T08:28:49.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.652+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcafc144670 con 0x7fcad806be60 2024-09-10T08:28:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.660+0000 7fcaf3400640 1 -- 172.21.15.52:0/2113479832 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247620 (secure 0 0 0) 0x7fcafc144670 con 0x7fcad806be60 2024-09-10T08:28:49.663 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:49.664 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.663+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 msgr2=0x7fcad806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.663+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 0x7fcad806e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcae4034000 tx=0x7fcae402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.663+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 msgr2=0x7fcafc140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.663+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c400 tx=0x7fcaec00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 shutdown_connections 2024-09-10T08:28:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcad806be60 0x7fcad806e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcafc145ed0 0x7fcafc158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcafc0b5880 0x7fcafc13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 --2- 172.21.15.52:0/2113479832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcafc073890 0x7fcafc140780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 >> 172.21.15.52:0/2113479832 conn(0x7fcafc0ccec0 msgr2=0x7fcafc0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 shutdown_connections 2024-09-10T08:28:49.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.664+0000 7fcb01400640 1 -- 172.21.15.52:0/2113479832 wait complete. 2024-09-10T08:28:49.680 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T08:28:49.451373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235512,"kb_used_data":2644,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739208,"statfs":{"total":773094113280,"available":772852948992,"internally_reserved":0,"allocated":2707456,"data_stored":1655650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000474"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464948+0000","last_change":"2024-09-10T08:28:44.464948+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464948+0000","last_undegraded":"2024-09-10T08:28:44.464948+0000","last_fullsized":"2024-09-10T08:28:44.464948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465834+0000","last_change":"2024-09-10T08:28:44.465834+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465834+0000","last_undegraded":"2024-09-10T08:28:44.465834+0000","last_fullsized":"2024-09-10T08:28:44.465834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463831+0000","last_change":"2024-09-10T08:28:44.463831+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463831+0000","last_undegraded":"2024-09-10T08:28:44.463831+0000","last_fullsized":"2024-09-10T08:28:44.463831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470032+0000","last_change":"2024-09-10T08:28:44.470032+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470032+0000","last_undegraded":"2024-09-10T08:28:44.470032+0000","last_fullsized":"2024-09-10T08:28:44.470032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468722+0000","last_change":"2024-09-10T08:28:44.468722+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468722+0000","last_undegraded":"2024-09-10T08:28:44.468722+0000","last_fullsized":"2024-09-10T08:28:44.468722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472403+0000","last_change":"2024-09-10T08:28:44.472403+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472403+0000","last_undegraded":"2024-09-10T08:28:44.472403+0000","last_fullsized":"2024-09-10T08:28:44.472403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464164+0000","last_change":"2024-09-10T08:28:44.464164+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464164+0000","last_undegraded":"2024-09-10T08:28:44.464164+0000","last_fullsized":"2024-09-10T08:28:44.464164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467546+0000","last_change":"2024-09-10T08:28:44.467546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467546+0000","last_undegraded":"2024-09-10T08:28:44.467546+0000","last_fullsized":"2024-09-10T08:28:44.467546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463149+0000","last_change":"2024-09-10T08:28:44.463149+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463149+0000","last_undegraded":"2024-09-10T08:28:44.463149+0000","last_fullsized":"2024-09-10T08:28:44.463149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472178+0000","last_change":"2024-09-10T08:28:44.472178+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472178+0000","last_undegraded":"2024-09-10T08:28:44.472178+0000","last_fullsized":"2024-09-10T08:28:44.472178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469334+0000","last_change":"2024-09-10T08:28:44.469334+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469334+0000","last_undegraded":"2024-09-10T08:28:44.469334+0000","last_fullsized":"2024-09-10T08:28:44.469334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464382+0000","last_change":"2024-09-10T08:28:44.464382+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464382+0000","last_undegraded":"2024-09-10T08:28:44.464382+0000","last_fullsized":"2024-09-10T08:28:44.464382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464140+0000","last_change":"2024-09-10T08:28:44.464140+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464140+0000","last_undegraded":"2024-09-10T08:28:44.464140+0000","last_fullsized":"2024-09-10T08:28:44.464140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.471477+0000","last_change":"2024-09-10T08:28:44.471477+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.471477+0000","last_undegraded":"2024-09-10T08:28:44.471477+0000","last_fullsized":"2024-09-10T08:28:44.471477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462610+0000","last_change":"2024-09-10T08:28:44.462610+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462610+0000","last_undegraded":"2024-09-10T08:28:44.462610+0000","last_fullsized":"2024-09-10T08:28:44.462610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468289+0000","last_change":"2024-09-10T08:28:44.468289+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468289+0000","last_undegraded":"2024-09-10T08:28:44.468289+0000","last_fullsized":"2024-09-10T08:28:44.468289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466405+0000","last_change":"2024-09-10T08:28:44.466405+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466405+0000","last_undegraded":"2024-09-10T08:28:44.466405+0000","last_fullsized":"2024-09-10T08:28:44.466405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466327+0000","last_change":"2024-09-10T08:28:44.466327+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466327+0000","last_undegraded":"2024-09-10T08:28:44.466327+0000","last_fullsized":"2024-09-10T08:28:44.466327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466890+0000","last_change":"2024-09-10T08:28:44.466890+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466890+0000","last_undegraded":"2024-09-10T08:28:44.466890+0000","last_fullsized":"2024-09-10T08:28:44.466890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468225+0000","last_change":"2024-09-10T08:28:44.468225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468225+0000","last_undegraded":"2024-09-10T08:28:44.468225+0000","last_fullsized":"2024-09-10T08:28:44.468225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467661+0000","last_change":"2024-09-10T08:28:44.467661+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467661+0000","last_undegraded":"2024-09-10T08:28:44.467661+0000","last_fullsized":"2024-09-10T08:28:44.467661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468909+0000","last_change":"2024-09-10T08:28:44.468909+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468909+0000","last_undegraded":"2024-09-10T08:28:44.468909+0000","last_fullsized":"2024-09-10T08:28:44.468909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462868+0000","last_change":"2024-09-10T08:28:44.462868+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462868+0000","last_undegraded":"2024-09-10T08:28:44.462868+0000","last_fullsized":"2024-09-10T08:28:44.462868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486855+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:44.486855+0000","last_peered":"2024-09-10T08:28:44.486855+0000","last_clean":"2024-09-10T08:28:44.486855+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:44.486855+0000","last_undegraded":"2024-09-10T08:28:44.486855+0000","last_fullsized":"2024-09-10T08:28:44.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487859+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:44.487859+0000","last_peered":"2024-09-10T08:28:44.487859+0000","last_clean":"2024-09-10T08:28:44.487859+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:44.487859+0000","last_undegraded":"2024-09-10T08:28:44.487859+0000","last_fullsized":"2024-09-10T08:28:44.487859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488101+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:44.488101+0000","last_peered":"2024-09-10T08:28:44.488101+0000","last_clean":"2024-09-10T08:28:44.488101+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:44.488101+0000","last_undegraded":"2024-09-10T08:28:44.488101+0000","last_fullsized":"2024-09-10T08:28:44.488101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464568+0000","last_change":"2024-09-10T08:28:44.464568+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464568+0000","last_undegraded":"2024-09-10T08:28:44.464568+0000","last_fullsized":"2024-09-10T08:28:44.464568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.478952+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:44.478952+0000","last_peered":"2024-09-10T08:28:44.478952+0000","last_clean":"2024-09-10T08:28:44.478952+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:44.478952+0000","last_undegraded":"2024-09-10T08:28:44.478952+0000","last_fullsized":"2024-09-10T08:28:44.478952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464997+0000","last_change":"2024-09-10T08:28:44.464997+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464997+0000","last_undegraded":"2024-09-10T08:28:44.464997+0000","last_fullsized":"2024-09-10T08:28:44.464997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.493014+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:44.493014+0000","last_peered":"2024-09-10T08:28:44.493014+0000","last_clean":"2024-09-10T08:28:44.493014+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:44.493014+0000","last_undegraded":"2024-09-10T08:28:44.493014+0000","last_fullsized":"2024-09-10T08:28:44.493014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.483991+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:44.483991+0000","last_peered":"2024-09-10T08:28:44.483991+0000","last_clean":"2024-09-10T08:28:44.483991+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:44.483991+0000","last_undegraded":"2024-09-10T08:28:44.483991+0000","last_fullsized":"2024-09-10T08:28:44.483991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463865+0000","last_change":"2024-09-10T08:28:44.463865+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463865+0000","last_undegraded":"2024-09-10T08:28:44.463865+0000","last_fullsized":"2024-09-10T08:28:44.463865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.479494+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:44.479494+0000","last_peered":"2024-09-10T08:28:44.479494+0000","last_clean":"2024-09-10T08:28:44.479494+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:44.479494+0000","last_undegraded":"2024-09-10T08:28:44.479494+0000","last_fullsized":"2024-09-10T08:28:44.479494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469515+0000","last_change":"2024-09-10T08:28:44.469515+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469515+0000","last_undegraded":"2024-09-10T08:28:44.469515+0000","last_fullsized":"2024-09-10T08:28:44.469515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487219+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:44.487219+0000","last_peered":"2024-09-10T08:28:44.487219+0000","last_clean":"2024-09-10T08:28:44.487219+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:44.487219+0000","last_undegraded":"2024-09-10T08:28:44.487219+0000","last_fullsized":"2024-09-10T08:28:44.487219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466029+0000","last_change":"2024-09-10T08:28:44.466029+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466029+0000","last_undegraded":"2024-09-10T08:28:44.466029+0000","last_fullsized":"2024-09-10T08:28:44.466029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488159+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:44.488159+0000","last_peered":"2024-09-10T08:28:44.488159+0000","last_clean":"2024-09-10T08:28:44.488159+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:44.488159+0000","last_undegraded":"2024-09-10T08:28:44.488159+0000","last_fullsized":"2024-09-10T08:28:44.488159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466100+0000","last_change":"2024-09-10T08:28:44.466100+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466100+0000","last_undegraded":"2024-09-10T08:28:44.466100+0000","last_fullsized":"2024-09-10T08:28:44.466100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.492559+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:44.492559+0000","last_peered":"2024-09-10T08:28:44.492559+0000","last_clean":"2024-09-10T08:28:44.492559+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:44.492559+0000","last_undegraded":"2024-09-10T08:28:44.492559+0000","last_fullsized":"2024-09-10T08:28:44.492559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473518+0000","last_change":"2024-09-10T08:28:44.473518+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473518+0000","last_undegraded":"2024-09-10T08:28:44.473518+0000","last_fullsized":"2024-09-10T08:28:44.473518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.476866+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:44.476866+0000","last_peered":"2024-09-10T08:28:44.476866+0000","last_clean":"2024-09-10T08:28:44.476866+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:44.476866+0000","last_undegraded":"2024-09-10T08:28:44.476866+0000","last_fullsized":"2024-09-10T08:28:44.476866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473292+0000","last_change":"2024-09-10T08:28:44.473292+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473292+0000","last_undegraded":"2024-09-10T08:28:44.473292+0000","last_fullsized":"2024-09-10T08:28:44.473292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489495+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:44.489495+0000","last_peered":"2024-09-10T08:28:44.489495+0000","last_clean":"2024-09-10T08:28:44.489495+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:44.489495+0000","last_undegraded":"2024-09-10T08:28:44.489495+0000","last_fullsized":"2024-09-10T08:28:44.489495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464499+0000","last_change":"2024-09-10T08:28:44.464499+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464499+0000","last_undegraded":"2024-09-10T08:28:44.464499+0000","last_fullsized":"2024-09-10T08:28:44.464499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.480962+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:44.480962+0000","last_peered":"2024-09-10T08:28:44.480962+0000","last_clean":"2024-09-10T08:28:44.480962+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:44.480962+0000","last_undegraded":"2024-09-10T08:28:44.480962+0000","last_fullsized":"2024-09-10T08:28:44.480962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464418+0000","last_change":"2024-09-10T08:28:44.464418+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464418+0000","last_undegraded":"2024-09-10T08:28:44.464418+0000","last_fullsized":"2024-09-10T08:28:44.464418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462277+0000","last_change":"2024-09-10T08:28:44.462277+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462277+0000","last_undegraded":"2024-09-10T08:28:44.462277+0000","last_fullsized":"2024-09-10T08:28:44.462277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484991+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:44.484991+0000","last_peered":"2024-09-10T08:28:44.484991+0000","last_clean":"2024-09-10T08:28:44.484991+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:44.484991+0000","last_undegraded":"2024-09-10T08:28:44.484991+0000","last_fullsized":"2024-09-10T08:28:44.484991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473725+0000","last_change":"2024-09-10T08:28:44.473725+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473725+0000","last_undegraded":"2024-09-10T08:28:44.473725+0000","last_fullsized":"2024-09-10T08:28:44.473725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.474865+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:44.474865+0000","last_peered":"2024-09-10T08:28:44.474865+0000","last_clean":"2024-09-10T08:28:44.474865+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:44.474865+0000","last_undegraded":"2024-09-10T08:28:44.474865+0000","last_fullsized":"2024-09-10T08:28:44.474865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486706+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:44.486706+0000","last_peered":"2024-09-10T08:28:44.486706+0000","last_clean":"2024-09-10T08:28:44.486706+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:44.486706+0000","last_undegraded":"2024-09-10T08:28:44.486706+0000","last_fullsized":"2024-09-10T08:28:44.486706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462807+0000","last_change":"2024-09-10T08:28:44.462807+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462807+0000","last_undegraded":"2024-09-10T08:28:44.462807+0000","last_fullsized":"2024-09-10T08:28:44.462807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489376+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:44.489376+0000","last_peered":"2024-09-10T08:28:44.489376+0000","last_clean":"2024-09-10T08:28:44.489376+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:44.489376+0000","last_undegraded":"2024-09-10T08:28:44.489376+0000","last_fullsized":"2024-09-10T08:28:44.489376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464115+0000","last_change":"2024-09-10T08:28:44.464115+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464115+0000","last_undegraded":"2024-09-10T08:28:44.464115+0000","last_fullsized":"2024-09-10T08:28:44.464115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486486+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:44.486486+0000","last_peered":"2024-09-10T08:28:44.486486+0000","last_clean":"2024-09-10T08:28:44.486486+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:44.486486+0000","last_undegraded":"2024-09-10T08:28:44.486486+0000","last_fullsized":"2024-09-10T08:28:44.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486439+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:44.486439+0000","last_peered":"2024-09-10T08:28:44.486439+0000","last_clean":"2024-09-10T08:28:44.486439+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:44.486439+0000","last_undegraded":"2024-09-10T08:28:44.486439+0000","last_fullsized":"2024-09-10T08:28:44.486439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462505+0000","last_change":"2024-09-10T08:28:44.462505+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462505+0000","last_undegraded":"2024-09-10T08:28:44.462505+0000","last_fullsized":"2024-09-10T08:28:44.462505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466542+0000","last_change":"2024-09-10T08:28:44.466542+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466542+0000","last_undegraded":"2024-09-10T08:28:44.466542+0000","last_fullsized":"2024-09-10T08:28:44.466542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488191+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:44.488191+0000","last_peered":"2024-09-10T08:28:44.488191+0000","last_clean":"2024-09-10T08:28:44.488191+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:44.488191+0000","last_undegraded":"2024-09-10T08:28:44.488191+0000","last_fullsized":"2024-09-10T08:28:44.488191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465225+0000","last_change":"2024-09-10T08:28:44.465225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465225+0000","last_undegraded":"2024-09-10T08:28:44.465225+0000","last_fullsized":"2024-09-10T08:28:44.465225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488277+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:44.488277+0000","last_peered":"2024-09-10T08:28:44.488277+0000","last_clean":"2024-09-10T08:28:44.488277+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:44.488277+0000","last_undegraded":"2024-09-10T08:28:44.488277+0000","last_fullsized":"2024-09-10T08:28:44.488277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464412+0000","last_change":"2024-09-10T08:28:44.464412+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464412+0000","last_undegraded":"2024-09-10T08:28:44.464412+0000","last_fullsized":"2024-09-10T08:28:44.464412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488009+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:44.488009+0000","last_peered":"2024-09-10T08:28:44.488009+0000","last_clean":"2024-09-10T08:28:44.488009+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:44.488009+0000","last_undegraded":"2024-09-10T08:28:44.488009+0000","last_fullsized":"2024-09-10T08:28:44.488009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464650+0000","last_change":"2024-09-10T08:28:44.464650+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464650+0000","last_undegraded":"2024-09-10T08:28:44.464650+0000","last_fullsized":"2024-09-10T08:28:44.464650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487226+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:44.487226+0000","last_peered":"2024-09-10T08:28:44.487226+0000","last_clean":"2024-09-10T08:28:44.487226+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:44.487226+0000","last_undegraded":"2024-09-10T08:28:44.487226+0000","last_fullsized":"2024-09-10T08:28:44.487226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470279+0000","last_change":"2024-09-10T08:28:44.470279+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470279+0000","last_undegraded":"2024-09-10T08:28:44.470279+0000","last_fullsized":"2024-09-10T08:28:44.470279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488292+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:44.488292+0000","last_peered":"2024-09-10T08:28:44.488292+0000","last_clean":"2024-09-10T08:28:44.488292+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:44.488292+0000","last_undegraded":"2024-09-10T08:28:44.488292+0000","last_fullsized":"2024-09-10T08:28:44.488292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464538+0000","last_change":"2024-09-10T08:28:44.464538+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464538+0000","last_undegraded":"2024-09-10T08:28:44.464538+0000","last_fullsized":"2024-09-10T08:28:44.464538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.482311+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:44.482311+0000","last_peered":"2024-09-10T08:28:44.482311+0000","last_clean":"2024-09-10T08:28:44.482311+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:44.482311+0000","last_undegraded":"2024-09-10T08:28:44.482311+0000","last_fullsized":"2024-09-10T08:28:44.482311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469520+0000","last_change":"2024-09-10T08:28:44.469520+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469520+0000","last_undegraded":"2024-09-10T08:28:44.469520+0000","last_fullsized":"2024-09-10T08:28:44.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486728+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:44.486728+0000","last_peered":"2024-09-10T08:28:44.486728+0000","last_clean":"2024-09-10T08:28:44.486728+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:44.486728+0000","last_undegraded":"2024-09-10T08:28:44.486728+0000","last_fullsized":"2024-09-10T08:28:44.486728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466546+0000","last_change":"2024-09-10T08:28:44.466546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466546+0000","last_undegraded":"2024-09-10T08:28:44.466546+0000","last_fullsized":"2024-09-10T08:28:44.466546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.479129+0000","last_change":"2024-09-10T08:28:44.479129+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.479129+0000","last_undegraded":"2024-09-10T08:28:44.479129+0000","last_fullsized":"2024-09-10T08:28:44.479129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489080+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:44.489080+0000","last_peered":"2024-09-10T08:28:44.489080+0000","last_clean":"2024-09-10T08:28:44.489080+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:44.489080+0000","last_undegraded":"2024-09-10T08:28:44.489080+0000","last_fullsized":"2024-09-10T08:28:44.489080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.474354+0000","last_change":"2024-09-10T08:28:44.474354+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.474354+0000","last_undegraded":"2024-09-10T08:28:44.474354+0000","last_fullsized":"2024-09-10T08:28:44.474354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484152+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:44.484152+0000","last_peered":"2024-09-10T08:28:44.484152+0000","last_clean":"2024-09-10T08:28:44.484152+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:44.484152+0000","last_undegraded":"2024-09-10T08:28:44.484152+0000","last_fullsized":"2024-09-10T08:28:44.484152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.490790+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:44.490790+0000","last_peered":"2024-09-10T08:28:44.490790+0000","last_clean":"2024-09-10T08:28:44.490790+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:44.490790+0000","last_undegraded":"2024-09-10T08:28:44.490790+0000","last_fullsized":"2024-09-10T08:28:44.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:49.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.877+0000 7ffa1fc00640 1 Processor -- start 2024-09-10T08:28:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.877+0000 7ffa1fc00640 1 -- start start 2024-09-10T08:28:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.878+0000 7ffa1fc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa180b6970 0x7ffa180b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.878+0000 7ffa1fc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa180d23b0 0x7ffa180b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.878+0000 7ffa1fc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa180d0e70 con 0x7ffa1815ed20 2024-09-10T08:28:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.878+0000 7ffa1fc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffa180d41c0 con 0x7ffa180d23b0 2024-09-10T08:28:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.878+0000 7ffa1fc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ffa180d35b0 con 0x7ffa180b6970 2024-09-10T08:28:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa17e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa180b6970 0x7ffa180b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1d200640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ffa1815ed20 0x7ffa180b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:42976/0 (socket says 172.21.15.52:42976) 2024-09-10T08:28:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1d200640 1 -- 172.21.15.52:0/345446870 learned_addr learned my addr 172.21.15.52:0/345446870 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/345446870 >> v2:172.21.15.52:3300/0 conn(0x7ffa180d23b0 0x7ffa180b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1dc00640 1 -- 172.21.15.52:0/345446870 >> v2:172.21.15.176:3300/0 conn(0x7ffa180b6970 msgr2=0x7ffa180b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/345446870 >> v2:172.21.15.176:3300/0 conn(0x7ffa180b6970 0x7ffa180b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1dc00640 1 -- 172.21.15.52:0/345446870 >> v1:172.21.15.176:6789/0 conn(0x7ffa1815ed20 legacy=0x7ffa180b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.879+0000 7ffa1dc00640 1 -- 172.21.15.52:0/345446870 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa180d3890 con 0x7ffa180d23b0 2024-09-10T08:28:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.880+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/345446870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa180d23b0 0x7ffa180b8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa180d4690 tx=0x7ffa1002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94b843c54824c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.880+0000 7ffa17400640 1 -- 172.21.15.52:0/345446870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10007740 con 0x7ffa180d23b0 2024-09-10T08:28:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.880+0000 7ffa17400640 1 -- 172.21.15.52:0/345446870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa100078e0 con 0x7ffa180d23b0 2024-09-10T08:28:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.880+0000 7ffa17400640 1 -- 172.21.15.52:0/345446870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10007cb0 con 0x7ffa180d23b0 2024-09-10T08:28:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 -- 172.21.15.52:0/345446870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa180d23b0 msgr2=0x7ffa180b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/345446870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa180d23b0 0x7ffa180b8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa180d4690 tx=0x7ffa1002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 -- 172.21.15.52:0/345446870 shutdown_connections 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/345446870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa180d23b0 0x7ffa180b8610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/345446870 >> v2:172.21.15.176:3300/0 conn(0x7ffa180b6970 0x7ffa180b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 -- 172.21.15.52:0/345446870 >> 172.21.15.52:0/345446870 conn(0x7ffa180d1260 msgr2=0x7ffa180d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 -- 172.21.15.52:0/345446870 shutdown_connections 2024-09-10T08:28:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.881+0000 7ffa1fc00640 1 -- 172.21.15.52:0/345446870 wait complete. 2024-09-10T08:28:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.883+0000 7ffa1fc00640 1 Processor -- start 2024-09-10T08:28:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.883+0000 7ffa1fc00640 1 -- start start 2024-09-10T08:28:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180b6970 0x7ffa180adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa180d23b0 0x7ffa1815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180d32a0 con 0x7ffa1815ed20 2024-09-10T08:28:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180d3e50 con 0x7ffa180d23b0 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1fc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1815f100 con 0x7ffa180b6970 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40060/0 (socket says 172.21.15.52:40060) 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 -- 172.21.15.52:0/2297407054 learned_addr learned my addr 172.21.15.52:0/2297407054 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1d200640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180b6970 0x7ffa180adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa17e00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa180d23b0 0x7ffa1815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 -- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180b6970 msgr2=0x7ffa180adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180b6970 0x7ffa180adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 -- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa180d23b0 msgr2=0x7ffa1815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.884+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa180d23b0 0x7ffa1815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa1dc00640 1 -- 172.21.15.52:0/2297407054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa180acaa0 con 0x7ffa1815ed20 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa1dc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002abe0 tx=0x7ffa10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10040070 con 0x7ffa1815ed20 2024-09-10T08:28:49.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10031bc0 con 0x7ffa1815ed20 2024-09-10T08:28:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10009450 con 0x7ffa1815ed20 2024-09-10T08:28:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa180acd80 con 0x7ffa1815ed20 2024-09-10T08:28:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.885+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa180ad340 con 0x7ffa1815ed20 2024-09-10T08:28:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.886+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa180b7010 con 0x7ffa1815ed20 2024-09-10T08:28:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.887+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa10039040 con 0x7ffa1815ed20 2024-09-10T08:28:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.888+0000 7ffa14c00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.888+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffa100ac5e0 con 0x7ffa1815ed20 2024-09-10T08:28:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.888+0000 7ffa1d200640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:49.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.889+0000 7ffa1d200640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005880 tx=0x7ffa0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:49.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:49.892+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa1007a930 con 0x7ffa1815ed20 2024-09-10T08:28:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.072+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa180b65d0 con 0x7ff9f806be30 2024-09-10T08:28:50.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.079+0000 7ffa14c00640 1 -- 172.21.15.52:0/2297407054 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247620 (secure 0 0 0) 0x7ffa180b65d0 con 0x7ff9f806be30 2024-09-10T08:28:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 msgr2=0x7ff9f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005880 tx=0x7ffa0c009040 comp rx=0 tx=0).stop 2024-09-10T08:28:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 msgr2=0x7ffa180af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002abe0 tx=0x7ffa10004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 shutdown_connections 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1815ed20 0x7ffa180af360 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa180d23b0 0x7ffa1815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 --2- 172.21.15.52:0/2297407054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa180b6970 0x7ffa180adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 >> 172.21.15.52:0/2297407054 conn(0x7ffa180d1260 msgr2=0x7ffa180ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 shutdown_connections 2024-09-10T08:28:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.083+0000 7ffa1fc00640 1 -- 172.21.15.52:0/2297407054 wait complete. 2024-09-10T08:28:50.099 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T08:28:49.451373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235512,"kb_used_data":2644,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739208,"statfs":{"total":773094113280,"available":772852948992,"internally_reserved":0,"allocated":2707456,"data_stored":1655650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000474"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464948+0000","last_change":"2024-09-10T08:28:44.464948+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464948+0000","last_undegraded":"2024-09-10T08:28:44.464948+0000","last_fullsized":"2024-09-10T08:28:44.464948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465834+0000","last_change":"2024-09-10T08:28:44.465834+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465834+0000","last_undegraded":"2024-09-10T08:28:44.465834+0000","last_fullsized":"2024-09-10T08:28:44.465834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463831+0000","last_change":"2024-09-10T08:28:44.463831+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463831+0000","last_undegraded":"2024-09-10T08:28:44.463831+0000","last_fullsized":"2024-09-10T08:28:44.463831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470032+0000","last_change":"2024-09-10T08:28:44.470032+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470032+0000","last_undegraded":"2024-09-10T08:28:44.470032+0000","last_fullsized":"2024-09-10T08:28:44.470032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468722+0000","last_change":"2024-09-10T08:28:44.468722+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468722+0000","last_undegraded":"2024-09-10T08:28:44.468722+0000","last_fullsized":"2024-09-10T08:28:44.468722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472403+0000","last_change":"2024-09-10T08:28:44.472403+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472403+0000","last_undegraded":"2024-09-10T08:28:44.472403+0000","last_fullsized":"2024-09-10T08:28:44.472403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464164+0000","last_change":"2024-09-10T08:28:44.464164+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464164+0000","last_undegraded":"2024-09-10T08:28:44.464164+0000","last_fullsized":"2024-09-10T08:28:44.464164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467546+0000","last_change":"2024-09-10T08:28:44.467546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467546+0000","last_undegraded":"2024-09-10T08:28:44.467546+0000","last_fullsized":"2024-09-10T08:28:44.467546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463149+0000","last_change":"2024-09-10T08:28:44.463149+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463149+0000","last_undegraded":"2024-09-10T08:28:44.463149+0000","last_fullsized":"2024-09-10T08:28:44.463149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472178+0000","last_change":"2024-09-10T08:28:44.472178+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472178+0000","last_undegraded":"2024-09-10T08:28:44.472178+0000","last_fullsized":"2024-09-10T08:28:44.472178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469334+0000","last_change":"2024-09-10T08:28:44.469334+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469334+0000","last_undegraded":"2024-09-10T08:28:44.469334+0000","last_fullsized":"2024-09-10T08:28:44.469334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464382+0000","last_change":"2024-09-10T08:28:44.464382+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464382+0000","last_undegraded":"2024-09-10T08:28:44.464382+0000","last_fullsized":"2024-09-10T08:28:44.464382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464140+0000","last_change":"2024-09-10T08:28:44.464140+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464140+0000","last_undegraded":"2024-09-10T08:28:44.464140+0000","last_fullsized":"2024-09-10T08:28:44.464140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.471477+0000","last_change":"2024-09-10T08:28:44.471477+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.471477+0000","last_undegraded":"2024-09-10T08:28:44.471477+0000","last_fullsized":"2024-09-10T08:28:44.471477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462610+0000","last_change":"2024-09-10T08:28:44.462610+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462610+0000","last_undegraded":"2024-09-10T08:28:44.462610+0000","last_fullsized":"2024-09-10T08:28:44.462610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468289+0000","last_change":"2024-09-10T08:28:44.468289+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468289+0000","last_undegraded":"2024-09-10T08:28:44.468289+0000","last_fullsized":"2024-09-10T08:28:44.468289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466405+0000","last_change":"2024-09-10T08:28:44.466405+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466405+0000","last_undegraded":"2024-09-10T08:28:44.466405+0000","last_fullsized":"2024-09-10T08:28:44.466405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466327+0000","last_change":"2024-09-10T08:28:44.466327+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466327+0000","last_undegraded":"2024-09-10T08:28:44.466327+0000","last_fullsized":"2024-09-10T08:28:44.466327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466890+0000","last_change":"2024-09-10T08:28:44.466890+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466890+0000","last_undegraded":"2024-09-10T08:28:44.466890+0000","last_fullsized":"2024-09-10T08:28:44.466890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468225+0000","last_change":"2024-09-10T08:28:44.468225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468225+0000","last_undegraded":"2024-09-10T08:28:44.468225+0000","last_fullsized":"2024-09-10T08:28:44.468225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467661+0000","last_change":"2024-09-10T08:28:44.467661+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467661+0000","last_undegraded":"2024-09-10T08:28:44.467661+0000","last_fullsized":"2024-09-10T08:28:44.467661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468909+0000","last_change":"2024-09-10T08:28:44.468909+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468909+0000","last_undegraded":"2024-09-10T08:28:44.468909+0000","last_fullsized":"2024-09-10T08:28:44.468909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462868+0000","last_change":"2024-09-10T08:28:44.462868+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462868+0000","last_undegraded":"2024-09-10T08:28:44.462868+0000","last_fullsized":"2024-09-10T08:28:44.462868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486855+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:44.486855+0000","last_peered":"2024-09-10T08:28:44.486855+0000","last_clean":"2024-09-10T08:28:44.486855+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:44.486855+0000","last_undegraded":"2024-09-10T08:28:44.486855+0000","last_fullsized":"2024-09-10T08:28:44.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487859+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:44.487859+0000","last_peered":"2024-09-10T08:28:44.487859+0000","last_clean":"2024-09-10T08:28:44.487859+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:44.487859+0000","last_undegraded":"2024-09-10T08:28:44.487859+0000","last_fullsized":"2024-09-10T08:28:44.487859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488101+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:44.488101+0000","last_peered":"2024-09-10T08:28:44.488101+0000","last_clean":"2024-09-10T08:28:44.488101+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:44.488101+0000","last_undegraded":"2024-09-10T08:28:44.488101+0000","last_fullsized":"2024-09-10T08:28:44.488101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464568+0000","last_change":"2024-09-10T08:28:44.464568+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464568+0000","last_undegraded":"2024-09-10T08:28:44.464568+0000","last_fullsized":"2024-09-10T08:28:44.464568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.478952+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:44.478952+0000","last_peered":"2024-09-10T08:28:44.478952+0000","last_clean":"2024-09-10T08:28:44.478952+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:44.478952+0000","last_undegraded":"2024-09-10T08:28:44.478952+0000","last_fullsized":"2024-09-10T08:28:44.478952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464997+0000","last_change":"2024-09-10T08:28:44.464997+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464997+0000","last_undegraded":"2024-09-10T08:28:44.464997+0000","last_fullsized":"2024-09-10T08:28:44.464997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.493014+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:44.493014+0000","last_peered":"2024-09-10T08:28:44.493014+0000","last_clean":"2024-09-10T08:28:44.493014+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:44.493014+0000","last_undegraded":"2024-09-10T08:28:44.493014+0000","last_fullsized":"2024-09-10T08:28:44.493014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.483991+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:44.483991+0000","last_peered":"2024-09-10T08:28:44.483991+0000","last_clean":"2024-09-10T08:28:44.483991+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:44.483991+0000","last_undegraded":"2024-09-10T08:28:44.483991+0000","last_fullsized":"2024-09-10T08:28:44.483991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463865+0000","last_change":"2024-09-10T08:28:44.463865+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463865+0000","last_undegraded":"2024-09-10T08:28:44.463865+0000","last_fullsized":"2024-09-10T08:28:44.463865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.479494+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:44.479494+0000","last_peered":"2024-09-10T08:28:44.479494+0000","last_clean":"2024-09-10T08:28:44.479494+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:44.479494+0000","last_undegraded":"2024-09-10T08:28:44.479494+0000","last_fullsized":"2024-09-10T08:28:44.479494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469515+0000","last_change":"2024-09-10T08:28:44.469515+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469515+0000","last_undegraded":"2024-09-10T08:28:44.469515+0000","last_fullsized":"2024-09-10T08:28:44.469515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487219+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:44.487219+0000","last_peered":"2024-09-10T08:28:44.487219+0000","last_clean":"2024-09-10T08:28:44.487219+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:44.487219+0000","last_undegraded":"2024-09-10T08:28:44.487219+0000","last_fullsized":"2024-09-10T08:28:44.487219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466029+0000","last_change":"2024-09-10T08:28:44.466029+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466029+0000","last_undegraded":"2024-09-10T08:28:44.466029+0000","last_fullsized":"2024-09-10T08:28:44.466029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488159+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:44.488159+0000","last_peered":"2024-09-10T08:28:44.488159+0000","last_clean":"2024-09-10T08:28:44.488159+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:44.488159+0000","last_undegraded":"2024-09-10T08:28:44.488159+0000","last_fullsized":"2024-09-10T08:28:44.488159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466100+0000","last_change":"2024-09-10T08:28:44.466100+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466100+0000","last_undegraded":"2024-09-10T08:28:44.466100+0000","last_fullsized":"2024-09-10T08:28:44.466100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.492559+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:44.492559+0000","last_peered":"2024-09-10T08:28:44.492559+0000","last_clean":"2024-09-10T08:28:44.492559+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:44.492559+0000","last_undegraded":"2024-09-10T08:28:44.492559+0000","last_fullsized":"2024-09-10T08:28:44.492559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473518+0000","last_change":"2024-09-10T08:28:44.473518+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473518+0000","last_undegraded":"2024-09-10T08:28:44.473518+0000","last_fullsized":"2024-09-10T08:28:44.473518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.476866+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:44.476866+0000","last_peered":"2024-09-10T08:28:44.476866+0000","last_clean":"2024-09-10T08:28:44.476866+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:44.476866+0000","last_undegraded":"2024-09-10T08:28:44.476866+0000","last_fullsized":"2024-09-10T08:28:44.476866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473292+0000","last_change":"2024-09-10T08:28:44.473292+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473292+0000","last_undegraded":"2024-09-10T08:28:44.473292+0000","last_fullsized":"2024-09-10T08:28:44.473292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489495+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:44.489495+0000","last_peered":"2024-09-10T08:28:44.489495+0000","last_clean":"2024-09-10T08:28:44.489495+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:44.489495+0000","last_undegraded":"2024-09-10T08:28:44.489495+0000","last_fullsized":"2024-09-10T08:28:44.489495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464499+0000","last_change":"2024-09-10T08:28:44.464499+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464499+0000","last_undegraded":"2024-09-10T08:28:44.464499+0000","last_fullsized":"2024-09-10T08:28:44.464499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.480962+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:44.480962+0000","last_peered":"2024-09-10T08:28:44.480962+0000","last_clean":"2024-09-10T08:28:44.480962+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:44.480962+0000","last_undegraded":"2024-09-10T08:28:44.480962+0000","last_fullsized":"2024-09-10T08:28:44.480962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464418+0000","last_change":"2024-09-10T08:28:44.464418+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464418+0000","last_undegraded":"2024-09-10T08:28:44.464418+0000","last_fullsized":"2024-09-10T08:28:44.464418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462277+0000","last_change":"2024-09-10T08:28:44.462277+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462277+0000","last_undegraded":"2024-09-10T08:28:44.462277+0000","last_fullsized":"2024-09-10T08:28:44.462277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484991+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:44.484991+0000","last_peered":"2024-09-10T08:28:44.484991+0000","last_clean":"2024-09-10T08:28:44.484991+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:44.484991+0000","last_undegraded":"2024-09-10T08:28:44.484991+0000","last_fullsized":"2024-09-10T08:28:44.484991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473725+0000","last_change":"2024-09-10T08:28:44.473725+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473725+0000","last_undegraded":"2024-09-10T08:28:44.473725+0000","last_fullsized":"2024-09-10T08:28:44.473725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.474865+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:44.474865+0000","last_peered":"2024-09-10T08:28:44.474865+0000","last_clean":"2024-09-10T08:28:44.474865+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:44.474865+0000","last_undegraded":"2024-09-10T08:28:44.474865+0000","last_fullsized":"2024-09-10T08:28:44.474865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486706+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:44.486706+0000","last_peered":"2024-09-10T08:28:44.486706+0000","last_clean":"2024-09-10T08:28:44.486706+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:44.486706+0000","last_undegraded":"2024-09-10T08:28:44.486706+0000","last_fullsized":"2024-09-10T08:28:44.486706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462807+0000","last_change":"2024-09-10T08:28:44.462807+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462807+0000","last_undegraded":"2024-09-10T08:28:44.462807+0000","last_fullsized":"2024-09-10T08:28:44.462807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489376+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:44.489376+0000","last_peered":"2024-09-10T08:28:44.489376+0000","last_clean":"2024-09-10T08:28:44.489376+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:44.489376+0000","last_undegraded":"2024-09-10T08:28:44.489376+0000","last_fullsized":"2024-09-10T08:28:44.489376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464115+0000","last_change":"2024-09-10T08:28:44.464115+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464115+0000","last_undegraded":"2024-09-10T08:28:44.464115+0000","last_fullsized":"2024-09-10T08:28:44.464115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486486+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:44.486486+0000","last_peered":"2024-09-10T08:28:44.486486+0000","last_clean":"2024-09-10T08:28:44.486486+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:44.486486+0000","last_undegraded":"2024-09-10T08:28:44.486486+0000","last_fullsized":"2024-09-10T08:28:44.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486439+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:44.486439+0000","last_peered":"2024-09-10T08:28:44.486439+0000","last_clean":"2024-09-10T08:28:44.486439+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:44.486439+0000","last_undegraded":"2024-09-10T08:28:44.486439+0000","last_fullsized":"2024-09-10T08:28:44.486439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462505+0000","last_change":"2024-09-10T08:28:44.462505+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462505+0000","last_undegraded":"2024-09-10T08:28:44.462505+0000","last_fullsized":"2024-09-10T08:28:44.462505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466542+0000","last_change":"2024-09-10T08:28:44.466542+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466542+0000","last_undegraded":"2024-09-10T08:28:44.466542+0000","last_fullsized":"2024-09-10T08:28:44.466542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488191+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:44.488191+0000","last_peered":"2024-09-10T08:28:44.488191+0000","last_clean":"2024-09-10T08:28:44.488191+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:44.488191+0000","last_undegraded":"2024-09-10T08:28:44.488191+0000","last_fullsized":"2024-09-10T08:28:44.488191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465225+0000","last_change":"2024-09-10T08:28:44.465225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465225+0000","last_undegraded":"2024-09-10T08:28:44.465225+0000","last_fullsized":"2024-09-10T08:28:44.465225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488277+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:44.488277+0000","last_peered":"2024-09-10T08:28:44.488277+0000","last_clean":"2024-09-10T08:28:44.488277+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:44.488277+0000","last_undegraded":"2024-09-10T08:28:44.488277+0000","last_fullsized":"2024-09-10T08:28:44.488277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464412+0000","last_change":"2024-09-10T08:28:44.464412+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464412+0000","last_undegraded":"2024-09-10T08:28:44.464412+0000","last_fullsized":"2024-09-10T08:28:44.464412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488009+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:44.488009+0000","last_peered":"2024-09-10T08:28:44.488009+0000","last_clean":"2024-09-10T08:28:44.488009+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:44.488009+0000","last_undegraded":"2024-09-10T08:28:44.488009+0000","last_fullsized":"2024-09-10T08:28:44.488009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464650+0000","last_change":"2024-09-10T08:28:44.464650+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464650+0000","last_undegraded":"2024-09-10T08:28:44.464650+0000","last_fullsized":"2024-09-10T08:28:44.464650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487226+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:44.487226+0000","last_peered":"2024-09-10T08:28:44.487226+0000","last_clean":"2024-09-10T08:28:44.487226+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:44.487226+0000","last_undegraded":"2024-09-10T08:28:44.487226+0000","last_fullsized":"2024-09-10T08:28:44.487226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470279+0000","last_change":"2024-09-10T08:28:44.470279+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470279+0000","last_undegraded":"2024-09-10T08:28:44.470279+0000","last_fullsized":"2024-09-10T08:28:44.470279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488292+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:44.488292+0000","last_peered":"2024-09-10T08:28:44.488292+0000","last_clean":"2024-09-10T08:28:44.488292+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:44.488292+0000","last_undegraded":"2024-09-10T08:28:44.488292+0000","last_fullsized":"2024-09-10T08:28:44.488292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464538+0000","last_change":"2024-09-10T08:28:44.464538+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464538+0000","last_undegraded":"2024-09-10T08:28:44.464538+0000","last_fullsized":"2024-09-10T08:28:44.464538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.482311+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:44.482311+0000","last_peered":"2024-09-10T08:28:44.482311+0000","last_clean":"2024-09-10T08:28:44.482311+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:44.482311+0000","last_undegraded":"2024-09-10T08:28:44.482311+0000","last_fullsized":"2024-09-10T08:28:44.482311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469520+0000","last_change":"2024-09-10T08:28:44.469520+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469520+0000","last_undegraded":"2024-09-10T08:28:44.469520+0000","last_fullsized":"2024-09-10T08:28:44.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486728+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:44.486728+0000","last_peered":"2024-09-10T08:28:44.486728+0000","last_clean":"2024-09-10T08:28:44.486728+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:44.486728+0000","last_undegraded":"2024-09-10T08:28:44.486728+0000","last_fullsized":"2024-09-10T08:28:44.486728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466546+0000","last_change":"2024-09-10T08:28:44.466546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466546+0000","last_undegraded":"2024-09-10T08:28:44.466546+0000","last_fullsized":"2024-09-10T08:28:44.466546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.479129+0000","last_change":"2024-09-10T08:28:44.479129+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.479129+0000","last_undegraded":"2024-09-10T08:28:44.479129+0000","last_fullsized":"2024-09-10T08:28:44.479129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489080+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:44.489080+0000","last_peered":"2024-09-10T08:28:44.489080+0000","last_clean":"2024-09-10T08:28:44.489080+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:44.489080+0000","last_undegraded":"2024-09-10T08:28:44.489080+0000","last_fullsized":"2024-09-10T08:28:44.489080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.474354+0000","last_change":"2024-09-10T08:28:44.474354+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.474354+0000","last_undegraded":"2024-09-10T08:28:44.474354+0000","last_fullsized":"2024-09-10T08:28:44.474354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484152+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:44.484152+0000","last_peered":"2024-09-10T08:28:44.484152+0000","last_clean":"2024-09-10T08:28:44.484152+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:44.484152+0000","last_undegraded":"2024-09-10T08:28:44.484152+0000","last_fullsized":"2024-09-10T08:28:44.484152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.490790+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:44.490790+0000","last_peered":"2024-09-10T08:28:44.490790+0000","last_clean":"2024-09-10T08:28:44.490790+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:44.490790+0000","last_undegraded":"2024-09-10T08:28:44.490790+0000","last_fullsized":"2024-09-10T08:28:44.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:50.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.295+0000 7f5462400640 1 Processor -- start 2024-09-10T08:28:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.295+0000 7f5462400640 1 -- start start 2024-09-10T08:28:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.296+0000 7f5462400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f545c0b6970 0x7f545c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.296+0000 7f5462400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f545c0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.296+0000 7f5462400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545c0d0e70 con 0x7f545c15ed20 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.296+0000 7f5462400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f545c0d41c0 con 0x7f545c0b6970 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.296+0000 7f5462400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f545c0d35b0 con 0x7f545c0d23b0 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f545c15ed20 0x7f545c0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33730/0 (socket says 172.21.15.52:33730) 2024-09-10T08:28:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545b400640 1 -- 172.21.15.52:0/493230259 learned_addr learned my addr 172.21.15.52:0/493230259 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464580819 0 0) 0x7f544c001110 con 0x7f545c15ed20 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545aa00640 1 --2- 172.21.15.52:0/493230259 >> v2:172.21.15.176:3300/0 conn(0x7f545c0b6970 0x7f545c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5440003520 con 0x7f545c15ed20 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545be00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f545c0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 599057722 0 0) 0x7f5440003520 con 0x7f545c15ed20 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 msgr2=0x7f545c0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f545c0b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 >> v2:172.21.15.176:3300/0 conn(0x7f545c0b6970 msgr2=0x7f545c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 --2- 172.21.15.52:0/493230259 >> v2:172.21.15.176:3300/0 conn(0x7f545c0b6970 0x7f545c0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c0d3890 con 0x7f545c15ed20 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f544c001840 con 0x7f545c15ed20 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 >> v1:172.21.15.52:6789/0 conn(0x7f545c15ed20 legacy=0x7f545c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f54400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5440003f30 0x7f5440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.297+0000 7f545a000640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5440004d40 0x7f54400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0d41c0 con 0x7f5440004d40 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0d35b0 con 0x7f5440003f30 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f544000ba10 con 0x7f545c0d23b0 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5440004d40 0x7f54400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545aa00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5440003f30 0x7f5440004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545b400640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f54400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 -- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 msgr2=0x7f54400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:50.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0d23b0 0x7f54400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 -- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5440003f30 msgr2=0x7f5440004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5440003f30 0x7f5440004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.298+0000 7f545be00640 1 -- 172.21.15.52:0/493230259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5440003520 con 0x7f5440004d40 2024-09-10T08:28:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.299+0000 7f545be00640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5440004d40 0x7f54400051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f545400e170 tx=0x7f5440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b62e424056211e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.299+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454034020 con 0x7f5440004d40 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.299+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54540305f0 con 0x7f5440004d40 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.299+0000 7f545a000640 1 -- 172.21.15.52:0/493230259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454009c10 con 0x7f5440004d40 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 -- 172.21.15.52:0/493230259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5440004d40 msgr2=0x7f54400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 --2- 172.21.15.52:0/493230259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5440004d40 0x7f54400051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f545400e170 tx=0x7f5440005830 comp rx=0 tx=0).stop 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f545be00640 1 -- 172.21.15.52:0/493230259 reap_dead start 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 -- 172.21.15.52:0/493230259 shutdown_connections 2024-09-10T08:28:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 -- 172.21.15.52:0/493230259 >> 172.21.15.52:0/493230259 conn(0x7f545c0d1260 msgr2=0x7f545c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 -- 172.21.15.52:0/493230259 shutdown_connections 2024-09-10T08:28:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.300+0000 7f5462400640 1 -- 172.21.15.52:0/493230259 wait complete. 2024-09-10T08:28:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.302+0000 7f5462400640 1 Processor -- start 2024-09-10T08:28:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.302+0000 7f5462400640 1 -- start start 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 0x7f545c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 0x7f545c1e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0d32a0 con 0x7f545c15cf30 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0d3e50 con 0x7f545c0c81d0 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f5462400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f545c15f100 con 0x7f5440004d40 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40074/0 (socket says 172.21.15.52:40074) 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 -- 172.21.15.52:0/1652661389 learned_addr learned my addr 172.21.15.52:0/1652661389 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545b400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 0x7f545c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545aa00640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 0x7f545c1e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 -- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 msgr2=0x7f545c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 0x7f545c15c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 -- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 msgr2=0x7f545c1e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 0x7f545c1e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545be00640 1 -- 172.21.15.52:0/1652661389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c0c8660 con 0x7f545c15cf30 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545b400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 0x7f545c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.303+0000 7f545aa00640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 0x7f545c1e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f545be00640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5454009f90 tx=0x7f5454009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454034030 con 0x7f545c15cf30 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5454003990 con 0x7f545c15cf30 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454009c10 con 0x7f545c15cf30 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c0c8940 con 0x7f545c15cf30 2024-09-10T08:28:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.304+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c0c8f00 con 0x7f545c15cf30 2024-09-10T08:28:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.305+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c0d1f60 con 0x7f545c15cf30 2024-09-10T08:28:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.306+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5454037020 con 0x7f545c15cf30 2024-09-10T08:28:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.307+0000 7f5453400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 0x7f543c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.307+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f54540ab150 con 0x7f545c15cf30 2024-09-10T08:28:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.307+0000 7f545b400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 0x7f543c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.308+0000 7f545b400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 0x7f543c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c1e7570 tx=0x7f544c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.311+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f545c0d1f60 con 0x7f545c15cf30 2024-09-10T08:28:50.447 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:28:50.447+0000 7eff0c200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:28:50.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.491+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f545c0b7010 con 0x7f543c06be30 2024-09-10T08:28:50.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.500+0000 7f5453400640 1 -- 172.21.15.52:0/1652661389 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247620 (secure 0 0 0) 0x7f545c0b7010 con 0x7f543c06be30 2024-09-10T08:28:50.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 msgr2=0x7f543c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 0x7f543c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c1e7570 tx=0x7f544c009040 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 msgr2=0x7f545c0cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5454009f90 tx=0x7f5454009750 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 shutdown_connections 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f543c06be30 0x7f543c06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f545c15cf30 0x7f545c0cda80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c0c81d0 0x7f545c1e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 --2- 172.21.15.52:0/1652661389 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5440004d40 0x7f545c15c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 >> 172.21.15.52:0/1652661389 conn(0x7f545c0d1260 msgr2=0x7f545c0b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 shutdown_connections 2024-09-10T08:28:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.504+0000 7f5462400640 1 -- 172.21.15.52:0/1652661389 wait complete. 2024-09-10T08:28:50.519 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T08:28:49.451373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235512,"kb_used_data":2644,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739208,"statfs":{"total":773094113280,"available":772852948992,"internally_reserved":0,"allocated":2707456,"data_stored":1655650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000474"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464948+0000","last_change":"2024-09-10T08:28:44.464948+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464948+0000","last_undegraded":"2024-09-10T08:28:44.464948+0000","last_fullsized":"2024-09-10T08:28:44.464948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465834+0000","last_change":"2024-09-10T08:28:44.465834+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465834+0000","last_undegraded":"2024-09-10T08:28:44.465834+0000","last_fullsized":"2024-09-10T08:28:44.465834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463831+0000","last_change":"2024-09-10T08:28:44.463831+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463831+0000","last_undegraded":"2024-09-10T08:28:44.463831+0000","last_fullsized":"2024-09-10T08:28:44.463831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470032+0000","last_change":"2024-09-10T08:28:44.470032+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470032+0000","last_undegraded":"2024-09-10T08:28:44.470032+0000","last_fullsized":"2024-09-10T08:28:44.470032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468722+0000","last_change":"2024-09-10T08:28:44.468722+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468722+0000","last_undegraded":"2024-09-10T08:28:44.468722+0000","last_fullsized":"2024-09-10T08:28:44.468722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472403+0000","last_change":"2024-09-10T08:28:44.472403+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472403+0000","last_undegraded":"2024-09-10T08:28:44.472403+0000","last_fullsized":"2024-09-10T08:28:44.472403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464164+0000","last_change":"2024-09-10T08:28:44.464164+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464164+0000","last_undegraded":"2024-09-10T08:28:44.464164+0000","last_fullsized":"2024-09-10T08:28:44.464164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467546+0000","last_change":"2024-09-10T08:28:44.467546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467546+0000","last_undegraded":"2024-09-10T08:28:44.467546+0000","last_fullsized":"2024-09-10T08:28:44.467546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463149+0000","last_change":"2024-09-10T08:28:44.463149+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463149+0000","last_undegraded":"2024-09-10T08:28:44.463149+0000","last_fullsized":"2024-09-10T08:28:44.463149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472178+0000","last_change":"2024-09-10T08:28:44.472178+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472178+0000","last_undegraded":"2024-09-10T08:28:44.472178+0000","last_fullsized":"2024-09-10T08:28:44.472178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469334+0000","last_change":"2024-09-10T08:28:44.469334+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469334+0000","last_undegraded":"2024-09-10T08:28:44.469334+0000","last_fullsized":"2024-09-10T08:28:44.469334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464382+0000","last_change":"2024-09-10T08:28:44.464382+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464382+0000","last_undegraded":"2024-09-10T08:28:44.464382+0000","last_fullsized":"2024-09-10T08:28:44.464382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464140+0000","last_change":"2024-09-10T08:28:44.464140+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464140+0000","last_undegraded":"2024-09-10T08:28:44.464140+0000","last_fullsized":"2024-09-10T08:28:44.464140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.471477+0000","last_change":"2024-09-10T08:28:44.471477+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.471477+0000","last_undegraded":"2024-09-10T08:28:44.471477+0000","last_fullsized":"2024-09-10T08:28:44.471477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462610+0000","last_change":"2024-09-10T08:28:44.462610+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462610+0000","last_undegraded":"2024-09-10T08:28:44.462610+0000","last_fullsized":"2024-09-10T08:28:44.462610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468289+0000","last_change":"2024-09-10T08:28:44.468289+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468289+0000","last_undegraded":"2024-09-10T08:28:44.468289+0000","last_fullsized":"2024-09-10T08:28:44.468289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466405+0000","last_change":"2024-09-10T08:28:44.466405+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466405+0000","last_undegraded":"2024-09-10T08:28:44.466405+0000","last_fullsized":"2024-09-10T08:28:44.466405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466327+0000","last_change":"2024-09-10T08:28:44.466327+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466327+0000","last_undegraded":"2024-09-10T08:28:44.466327+0000","last_fullsized":"2024-09-10T08:28:44.466327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466890+0000","last_change":"2024-09-10T08:28:44.466890+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466890+0000","last_undegraded":"2024-09-10T08:28:44.466890+0000","last_fullsized":"2024-09-10T08:28:44.466890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468225+0000","last_change":"2024-09-10T08:28:44.468225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468225+0000","last_undegraded":"2024-09-10T08:28:44.468225+0000","last_fullsized":"2024-09-10T08:28:44.468225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467661+0000","last_change":"2024-09-10T08:28:44.467661+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467661+0000","last_undegraded":"2024-09-10T08:28:44.467661+0000","last_fullsized":"2024-09-10T08:28:44.467661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468909+0000","last_change":"2024-09-10T08:28:44.468909+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468909+0000","last_undegraded":"2024-09-10T08:28:44.468909+0000","last_fullsized":"2024-09-10T08:28:44.468909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462868+0000","last_change":"2024-09-10T08:28:44.462868+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462868+0000","last_undegraded":"2024-09-10T08:28:44.462868+0000","last_fullsized":"2024-09-10T08:28:44.462868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486855+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:44.486855+0000","last_peered":"2024-09-10T08:28:44.486855+0000","last_clean":"2024-09-10T08:28:44.486855+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:44.486855+0000","last_undegraded":"2024-09-10T08:28:44.486855+0000","last_fullsized":"2024-09-10T08:28:44.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487859+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:44.487859+0000","last_peered":"2024-09-10T08:28:44.487859+0000","last_clean":"2024-09-10T08:28:44.487859+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:44.487859+0000","last_undegraded":"2024-09-10T08:28:44.487859+0000","last_fullsized":"2024-09-10T08:28:44.487859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488101+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:44.488101+0000","last_peered":"2024-09-10T08:28:44.488101+0000","last_clean":"2024-09-10T08:28:44.488101+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:44.488101+0000","last_undegraded":"2024-09-10T08:28:44.488101+0000","last_fullsized":"2024-09-10T08:28:44.488101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464568+0000","last_change":"2024-09-10T08:28:44.464568+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464568+0000","last_undegraded":"2024-09-10T08:28:44.464568+0000","last_fullsized":"2024-09-10T08:28:44.464568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.478952+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:44.478952+0000","last_peered":"2024-09-10T08:28:44.478952+0000","last_clean":"2024-09-10T08:28:44.478952+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:44.478952+0000","last_undegraded":"2024-09-10T08:28:44.478952+0000","last_fullsized":"2024-09-10T08:28:44.478952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464997+0000","last_change":"2024-09-10T08:28:44.464997+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464997+0000","last_undegraded":"2024-09-10T08:28:44.464997+0000","last_fullsized":"2024-09-10T08:28:44.464997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.493014+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:44.493014+0000","last_peered":"2024-09-10T08:28:44.493014+0000","last_clean":"2024-09-10T08:28:44.493014+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:44.493014+0000","last_undegraded":"2024-09-10T08:28:44.493014+0000","last_fullsized":"2024-09-10T08:28:44.493014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.483991+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:44.483991+0000","last_peered":"2024-09-10T08:28:44.483991+0000","last_clean":"2024-09-10T08:28:44.483991+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:44.483991+0000","last_undegraded":"2024-09-10T08:28:44.483991+0000","last_fullsized":"2024-09-10T08:28:44.483991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463865+0000","last_change":"2024-09-10T08:28:44.463865+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463865+0000","last_undegraded":"2024-09-10T08:28:44.463865+0000","last_fullsized":"2024-09-10T08:28:44.463865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.479494+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:44.479494+0000","last_peered":"2024-09-10T08:28:44.479494+0000","last_clean":"2024-09-10T08:28:44.479494+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:44.479494+0000","last_undegraded":"2024-09-10T08:28:44.479494+0000","last_fullsized":"2024-09-10T08:28:44.479494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469515+0000","last_change":"2024-09-10T08:28:44.469515+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469515+0000","last_undegraded":"2024-09-10T08:28:44.469515+0000","last_fullsized":"2024-09-10T08:28:44.469515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487219+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:44.487219+0000","last_peered":"2024-09-10T08:28:44.487219+0000","last_clean":"2024-09-10T08:28:44.487219+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:44.487219+0000","last_undegraded":"2024-09-10T08:28:44.487219+0000","last_fullsized":"2024-09-10T08:28:44.487219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466029+0000","last_change":"2024-09-10T08:28:44.466029+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466029+0000","last_undegraded":"2024-09-10T08:28:44.466029+0000","last_fullsized":"2024-09-10T08:28:44.466029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488159+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:44.488159+0000","last_peered":"2024-09-10T08:28:44.488159+0000","last_clean":"2024-09-10T08:28:44.488159+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:44.488159+0000","last_undegraded":"2024-09-10T08:28:44.488159+0000","last_fullsized":"2024-09-10T08:28:44.488159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466100+0000","last_change":"2024-09-10T08:28:44.466100+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466100+0000","last_undegraded":"2024-09-10T08:28:44.466100+0000","last_fullsized":"2024-09-10T08:28:44.466100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.492559+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:44.492559+0000","last_peered":"2024-09-10T08:28:44.492559+0000","last_clean":"2024-09-10T08:28:44.492559+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:44.492559+0000","last_undegraded":"2024-09-10T08:28:44.492559+0000","last_fullsized":"2024-09-10T08:28:44.492559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473518+0000","last_change":"2024-09-10T08:28:44.473518+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473518+0000","last_undegraded":"2024-09-10T08:28:44.473518+0000","last_fullsized":"2024-09-10T08:28:44.473518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.476866+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:44.476866+0000","last_peered":"2024-09-10T08:28:44.476866+0000","last_clean":"2024-09-10T08:28:44.476866+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:44.476866+0000","last_undegraded":"2024-09-10T08:28:44.476866+0000","last_fullsized":"2024-09-10T08:28:44.476866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473292+0000","last_change":"2024-09-10T08:28:44.473292+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473292+0000","last_undegraded":"2024-09-10T08:28:44.473292+0000","last_fullsized":"2024-09-10T08:28:44.473292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489495+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:44.489495+0000","last_peered":"2024-09-10T08:28:44.489495+0000","last_clean":"2024-09-10T08:28:44.489495+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:44.489495+0000","last_undegraded":"2024-09-10T08:28:44.489495+0000","last_fullsized":"2024-09-10T08:28:44.489495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464499+0000","last_change":"2024-09-10T08:28:44.464499+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464499+0000","last_undegraded":"2024-09-10T08:28:44.464499+0000","last_fullsized":"2024-09-10T08:28:44.464499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.480962+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:44.480962+0000","last_peered":"2024-09-10T08:28:44.480962+0000","last_clean":"2024-09-10T08:28:44.480962+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:44.480962+0000","last_undegraded":"2024-09-10T08:28:44.480962+0000","last_fullsized":"2024-09-10T08:28:44.480962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464418+0000","last_change":"2024-09-10T08:28:44.464418+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464418+0000","last_undegraded":"2024-09-10T08:28:44.464418+0000","last_fullsized":"2024-09-10T08:28:44.464418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462277+0000","last_change":"2024-09-10T08:28:44.462277+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462277+0000","last_undegraded":"2024-09-10T08:28:44.462277+0000","last_fullsized":"2024-09-10T08:28:44.462277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484991+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:44.484991+0000","last_peered":"2024-09-10T08:28:44.484991+0000","last_clean":"2024-09-10T08:28:44.484991+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:44.484991+0000","last_undegraded":"2024-09-10T08:28:44.484991+0000","last_fullsized":"2024-09-10T08:28:44.484991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473725+0000","last_change":"2024-09-10T08:28:44.473725+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473725+0000","last_undegraded":"2024-09-10T08:28:44.473725+0000","last_fullsized":"2024-09-10T08:28:44.473725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.474865+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:44.474865+0000","last_peered":"2024-09-10T08:28:44.474865+0000","last_clean":"2024-09-10T08:28:44.474865+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:44.474865+0000","last_undegraded":"2024-09-10T08:28:44.474865+0000","last_fullsized":"2024-09-10T08:28:44.474865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486706+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:44.486706+0000","last_peered":"2024-09-10T08:28:44.486706+0000","last_clean":"2024-09-10T08:28:44.486706+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:44.486706+0000","last_undegraded":"2024-09-10T08:28:44.486706+0000","last_fullsized":"2024-09-10T08:28:44.486706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462807+0000","last_change":"2024-09-10T08:28:44.462807+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462807+0000","last_undegraded":"2024-09-10T08:28:44.462807+0000","last_fullsized":"2024-09-10T08:28:44.462807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489376+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:44.489376+0000","last_peered":"2024-09-10T08:28:44.489376+0000","last_clean":"2024-09-10T08:28:44.489376+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:44.489376+0000","last_undegraded":"2024-09-10T08:28:44.489376+0000","last_fullsized":"2024-09-10T08:28:44.489376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464115+0000","last_change":"2024-09-10T08:28:44.464115+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464115+0000","last_undegraded":"2024-09-10T08:28:44.464115+0000","last_fullsized":"2024-09-10T08:28:44.464115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486486+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:44.486486+0000","last_peered":"2024-09-10T08:28:44.486486+0000","last_clean":"2024-09-10T08:28:44.486486+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:44.486486+0000","last_undegraded":"2024-09-10T08:28:44.486486+0000","last_fullsized":"2024-09-10T08:28:44.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486439+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:44.486439+0000","last_peered":"2024-09-10T08:28:44.486439+0000","last_clean":"2024-09-10T08:28:44.486439+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:44.486439+0000","last_undegraded":"2024-09-10T08:28:44.486439+0000","last_fullsized":"2024-09-10T08:28:44.486439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462505+0000","last_change":"2024-09-10T08:28:44.462505+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462505+0000","last_undegraded":"2024-09-10T08:28:44.462505+0000","last_fullsized":"2024-09-10T08:28:44.462505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466542+0000","last_change":"2024-09-10T08:28:44.466542+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466542+0000","last_undegraded":"2024-09-10T08:28:44.466542+0000","last_fullsized":"2024-09-10T08:28:44.466542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488191+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:44.488191+0000","last_peered":"2024-09-10T08:28:44.488191+0000","last_clean":"2024-09-10T08:28:44.488191+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:44.488191+0000","last_undegraded":"2024-09-10T08:28:44.488191+0000","last_fullsized":"2024-09-10T08:28:44.488191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465225+0000","last_change":"2024-09-10T08:28:44.465225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465225+0000","last_undegraded":"2024-09-10T08:28:44.465225+0000","last_fullsized":"2024-09-10T08:28:44.465225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488277+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:44.488277+0000","last_peered":"2024-09-10T08:28:44.488277+0000","last_clean":"2024-09-10T08:28:44.488277+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:44.488277+0000","last_undegraded":"2024-09-10T08:28:44.488277+0000","last_fullsized":"2024-09-10T08:28:44.488277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464412+0000","last_change":"2024-09-10T08:28:44.464412+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464412+0000","last_undegraded":"2024-09-10T08:28:44.464412+0000","last_fullsized":"2024-09-10T08:28:44.464412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488009+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:44.488009+0000","last_peered":"2024-09-10T08:28:44.488009+0000","last_clean":"2024-09-10T08:28:44.488009+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:44.488009+0000","last_undegraded":"2024-09-10T08:28:44.488009+0000","last_fullsized":"2024-09-10T08:28:44.488009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464650+0000","last_change":"2024-09-10T08:28:44.464650+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464650+0000","last_undegraded":"2024-09-10T08:28:44.464650+0000","last_fullsized":"2024-09-10T08:28:44.464650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487226+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:44.487226+0000","last_peered":"2024-09-10T08:28:44.487226+0000","last_clean":"2024-09-10T08:28:44.487226+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:44.487226+0000","last_undegraded":"2024-09-10T08:28:44.487226+0000","last_fullsized":"2024-09-10T08:28:44.487226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470279+0000","last_change":"2024-09-10T08:28:44.470279+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470279+0000","last_undegraded":"2024-09-10T08:28:44.470279+0000","last_fullsized":"2024-09-10T08:28:44.470279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488292+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:44.488292+0000","last_peered":"2024-09-10T08:28:44.488292+0000","last_clean":"2024-09-10T08:28:44.488292+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:44.488292+0000","last_undegraded":"2024-09-10T08:28:44.488292+0000","last_fullsized":"2024-09-10T08:28:44.488292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464538+0000","last_change":"2024-09-10T08:28:44.464538+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464538+0000","last_undegraded":"2024-09-10T08:28:44.464538+0000","last_fullsized":"2024-09-10T08:28:44.464538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.482311+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:44.482311+0000","last_peered":"2024-09-10T08:28:44.482311+0000","last_clean":"2024-09-10T08:28:44.482311+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:44.482311+0000","last_undegraded":"2024-09-10T08:28:44.482311+0000","last_fullsized":"2024-09-10T08:28:44.482311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469520+0000","last_change":"2024-09-10T08:28:44.469520+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469520+0000","last_undegraded":"2024-09-10T08:28:44.469520+0000","last_fullsized":"2024-09-10T08:28:44.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486728+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:44.486728+0000","last_peered":"2024-09-10T08:28:44.486728+0000","last_clean":"2024-09-10T08:28:44.486728+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:44.486728+0000","last_undegraded":"2024-09-10T08:28:44.486728+0000","last_fullsized":"2024-09-10T08:28:44.486728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466546+0000","last_change":"2024-09-10T08:28:44.466546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466546+0000","last_undegraded":"2024-09-10T08:28:44.466546+0000","last_fullsized":"2024-09-10T08:28:44.466546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.479129+0000","last_change":"2024-09-10T08:28:44.479129+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.479129+0000","last_undegraded":"2024-09-10T08:28:44.479129+0000","last_fullsized":"2024-09-10T08:28:44.479129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489080+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:44.489080+0000","last_peered":"2024-09-10T08:28:44.489080+0000","last_clean":"2024-09-10T08:28:44.489080+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:44.489080+0000","last_undegraded":"2024-09-10T08:28:44.489080+0000","last_fullsized":"2024-09-10T08:28:44.489080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.474354+0000","last_change":"2024-09-10T08:28:44.474354+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.474354+0000","last_undegraded":"2024-09-10T08:28:44.474354+0000","last_fullsized":"2024-09-10T08:28:44.474354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484152+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:44.484152+0000","last_peered":"2024-09-10T08:28:44.484152+0000","last_clean":"2024-09-10T08:28:44.484152+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:44.484152+0000","last_undegraded":"2024-09-10T08:28:44.484152+0000","last_fullsized":"2024-09-10T08:28:44.484152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.490790+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:44.490790+0000","last_peered":"2024-09-10T08:28:44.490790+0000","last_clean":"2024-09-10T08:28:44.490790+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:44.490790+0000","last_undegraded":"2024-09-10T08:28:44.490790+0000","last_fullsized":"2024-09-10T08:28:44.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464948+0000', 'last_change': '2024-09-10T08:28:44.464948+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464948+0000', 'last_undegraded': '2024-09-10T08:28:44.464948+0000', 'last_fullsized': '2024-09-10T08:28:44.464948+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.463983+0000', 'last_change': '2024-09-10T08:28:44.463983+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.463983+0000', 'last_undegraded': '2024-09-10T08:28:44.463983+0000', 'last_fullsized': '2024-09-10T08:28:44.463983+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-10T08:28:50.523 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.465834+0000', 'last_change': '2024-09-10T08:28:44.465834+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.465834+0000', 'last_undegraded': '2024-09-10T08:28:44.465834+0000', 'last_fullsized': '2024-09-10T08:28:44.465834+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.463831+0000', 'last_change': '2024-09-10T08:28:44.463831+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.463831+0000', 'last_undegraded': '2024-09-10T08:28:44.463831+0000', 'last_fullsized': '2024-09-10T08:28:44.463831+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.470032+0000', 'last_change': '2024-09-10T08:28:44.470032+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.470032+0000', 'last_undegraded': '2024-09-10T08:28:44.470032+0000', 'last_fullsized': '2024-09-10T08:28:44.470032+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.468722+0000', 'last_change': '2024-09-10T08:28:44.468722+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.468722+0000', 'last_undegraded': '2024-09-10T08:28:44.468722+0000', 'last_fullsized': '2024-09-10T08:28:44.468722+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464526+0000', 'last_change': '2024-09-10T08:28:44.464526+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464526+0000', 'last_undegraded': '2024-09-10T08:28:44.464526+0000', 'last_fullsized': '2024-09-10T08:28:44.464526+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-10T08:28:50.524 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.472403+0000', 'last_change': '2024-09-10T08:28:44.472403+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.472403+0000', 'last_undegraded': '2024-09-10T08:28:44.472403+0000', 'last_fullsized': '2024-09-10T08:28:44.472403+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464526+0000', 'last_change': '2024-09-10T08:28:44.464526+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464526+0000', 'last_undegraded': '2024-09-10T08:28:44.464526+0000', 'last_fullsized': '2024-09-10T08:28:44.464526+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464164+0000', 'last_change': '2024-09-10T08:28:44.464164+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464164+0000', 'last_undegraded': '2024-09-10T08:28:44.464164+0000', 'last_fullsized': '2024-09-10T08:28:44.464164+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.467546+0000', 'last_change': '2024-09-10T08:28:44.467546+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.467546+0000', 'last_undegraded': '2024-09-10T08:28:44.467546+0000', 'last_fullsized': '2024-09-10T08:28:44.467546+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.463149+0000', 'last_change': '2024-09-10T08:28:44.463149+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.463149+0000', 'last_undegraded': '2024-09-10T08:28:44.463149+0000', 'last_fullsized': '2024-09-10T08:28:44.463149+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.472178+0000', 'last_change': '2024-09-10T08:28:44.472178+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.472178+0000', 'last_undegraded': '2024-09-10T08:28:44.472178+0000', 'last_fullsized': '2024-09-10T08:28:44.472178+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-10T08:28:50.525 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.469334+0000', 'last_change': '2024-09-10T08:28:44.469334+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.469334+0000', 'last_undegraded': '2024-09-10T08:28:44.469334+0000', 'last_fullsized': '2024-09-10T08:28:44.469334+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464382+0000', 'last_change': '2024-09-10T08:28:44.464382+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464382+0000', 'last_undegraded': '2024-09-10T08:28:44.464382+0000', 'last_fullsized': '2024-09-10T08:28:44.464382+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.463983+0000', 'last_change': '2024-09-10T08:28:44.463983+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.463983+0000', 'last_undegraded': '2024-09-10T08:28:44.463983+0000', 'last_fullsized': '2024-09-10T08:28:44.463983+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464140+0000', 'last_change': '2024-09-10T08:28:44.464140+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464140+0000', 'last_undegraded': '2024-09-10T08:28:44.464140+0000', 'last_fullsized': '2024-09-10T08:28:44.464140+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.471477+0000', 'last_change': '2024-09-10T08:28:44.471477+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.471477+0000', 'last_undegraded': '2024-09-10T08:28:44.471477+0000', 'last_fullsized': '2024-09-10T08:28:44.471477+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.462610+0000', 'last_change': '2024-09-10T08:28:44.462610+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.462610+0000', 'last_undegraded': '2024-09-10T08:28:44.462610+0000', 'last_fullsized': '2024-09-10T08:28:44.462610+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-10T08:28:50.526 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.468289+0000', 'last_change': '2024-09-10T08:28:44.468289+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.468289+0000', 'last_undegraded': '2024-09-10T08:28:44.468289+0000', 'last_fullsized': '2024-09-10T08:28:44.468289+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466405+0000', 'last_change': '2024-09-10T08:28:44.466405+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466405+0000', 'last_undegraded': '2024-09-10T08:28:44.466405+0000', 'last_fullsized': '2024-09-10T08:28:44.466405+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466327+0000', 'last_change': '2024-09-10T08:28:44.466327+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466327+0000', 'last_undegraded': '2024-09-10T08:28:44.466327+0000', 'last_fullsized': '2024-09-10T08:28:44.466327+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466890+0000', 'last_change': '2024-09-10T08:28:44.466890+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466890+0000', 'last_undegraded': '2024-09-10T08:28:44.466890+0000', 'last_fullsized': '2024-09-10T08:28:44.466890+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.468225+0000', 'last_change': '2024-09-10T08:28:44.468225+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.468225+0000', 'last_undegraded': '2024-09-10T08:28:44.468225+0000', 'last_fullsized': '2024-09-10T08:28:44.468225+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-10T08:28:50.527 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.467661+0000', 'last_change': '2024-09-10T08:28:44.467661+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.467661+0000', 'last_undegraded': '2024-09-10T08:28:44.467661+0000', 'last_fullsized': '2024-09-10T08:28:44.467661+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.468909+0000', 'last_change': '2024-09-10T08:28:44.468909+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.468909+0000', 'last_undegraded': '2024-09-10T08:28:44.468909+0000', 'last_fullsized': '2024-09-10T08:28:44.468909+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.462868+0000', 'last_change': '2024-09-10T08:28:44.462868+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.462868+0000', 'last_undegraded': '2024-09-10T08:28:44.462868+0000', 'last_fullsized': '2024-09-10T08:28:44.462868+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464568+0000', 'last_change': '2024-09-10T08:28:44.464568+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464568+0000', 'last_undegraded': '2024-09-10T08:28:44.464568+0000', 'last_fullsized': '2024-09-10T08:28:44.464568+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464997+0000', 'last_change': '2024-09-10T08:28:44.464997+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464997+0000', 'last_undegraded': '2024-09-10T08:28:44.464997+0000', 'last_fullsized': '2024-09-10T08:28:44.464997+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.463865+0000', 'last_change': '2024-09-10T08:28:44.463865+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.463865+0000', 'last_undegraded': '2024-09-10T08:28:44.463865+0000', 'last_fullsized': '2024-09-10T08:28:44.463865+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-10T08:28:50.528 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.469515+0000', 'last_change': '2024-09-10T08:28:44.469515+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.469515+0000', 'last_undegraded': '2024-09-10T08:28:44.469515+0000', 'last_fullsized': '2024-09-10T08:28:44.469515+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466029+0000', 'last_change': '2024-09-10T08:28:44.466029+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466029+0000', 'last_undegraded': '2024-09-10T08:28:44.466029+0000', 'last_fullsized': '2024-09-10T08:28:44.466029+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466100+0000', 'last_change': '2024-09-10T08:28:44.466100+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466100+0000', 'last_undegraded': '2024-09-10T08:28:44.466100+0000', 'last_fullsized': '2024-09-10T08:28:44.466100+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.473518+0000', 'last_change': '2024-09-10T08:28:44.473518+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.473518+0000', 'last_undegraded': '2024-09-10T08:28:44.473518+0000', 'last_fullsized': '2024-09-10T08:28:44.473518+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.473292+0000', 'last_change': '2024-09-10T08:28:44.473292+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.473292+0000', 'last_undegraded': '2024-09-10T08:28:44.473292+0000', 'last_fullsized': '2024-09-10T08:28:44.473292+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464499+0000', 'last_change': '2024-09-10T08:28:44.464499+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464499+0000', 'last_undegraded': '2024-09-10T08:28:44.464499+0000', 'last_fullsized': '2024-09-10T08:28:44.464499+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.529 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464418+0000', 'last_change': '2024-09-10T08:28:44.464418+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464418+0000', 'last_undegraded': '2024-09-10T08:28:44.464418+0000', 'last_fullsized': '2024-09-10T08:28:44.464418+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.462277+0000', 'last_change': '2024-09-10T08:28:44.462277+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.462277+0000', 'last_undegraded': '2024-09-10T08:28:44.462277+0000', 'last_fullsized': '2024-09-10T08:28:44.462277+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.473725+0000', 'last_change': '2024-09-10T08:28:44.473725+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.473725+0000', 'last_undegraded': '2024-09-10T08:28:44.473725+0000', 'last_fullsized': '2024-09-10T08:28:44.473725+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.462807+0000', 'last_change': '2024-09-10T08:28:44.462807+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.462807+0000', 'last_undegraded': '2024-09-10T08:28:44.462807+0000', 'last_fullsized': '2024-09-10T08:28:44.462807+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464115+0000', 'last_change': '2024-09-10T08:28:44.464115+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464115+0000', 'last_undegraded': '2024-09-10T08:28:44.464115+0000', 'last_fullsized': '2024-09-10T08:28:44.464115+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-10T08:28:50.530 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.462505+0000', 'last_change': '2024-09-10T08:28:44.462505+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.462505+0000', 'last_undegraded': '2024-09-10T08:28:44.462505+0000', 'last_fullsized': '2024-09-10T08:28:44.462505+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466542+0000', 'last_change': '2024-09-10T08:28:44.466542+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466542+0000', 'last_undegraded': '2024-09-10T08:28:44.466542+0000', 'last_fullsized': '2024-09-10T08:28:44.466542+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.465225+0000', 'last_change': '2024-09-10T08:28:44.465225+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.465225+0000', 'last_undegraded': '2024-09-10T08:28:44.465225+0000', 'last_fullsized': '2024-09-10T08:28:44.465225+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464412+0000', 'last_change': '2024-09-10T08:28:44.464412+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464412+0000', 'last_undegraded': '2024-09-10T08:28:44.464412+0000', 'last_fullsized': '2024-09-10T08:28:44.464412+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464650+0000', 'last_change': '2024-09-10T08:28:44.464650+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464650+0000', 'last_undegraded': '2024-09-10T08:28:44.464650+0000', 'last_fullsized': '2024-09-10T08:28:44.464650+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.470279+0000', 'last_change': '2024-09-10T08:28:44.470279+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.470279+0000', 'last_undegraded': '2024-09-10T08:28:44.470279+0000', 'last_fullsized': '2024-09-10T08:28:44.470279+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.531 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.464538+0000', 'last_change': '2024-09-10T08:28:44.464538+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.464538+0000', 'last_undegraded': '2024-09-10T08:28:44.464538+0000', 'last_fullsized': '2024-09-10T08:28:44.464538+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.469520+0000', 'last_change': '2024-09-10T08:28:44.469520+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.469520+0000', 'last_undegraded': '2024-09-10T08:28:44.469520+0000', 'last_fullsized': '2024-09-10T08:28:44.469520+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.466546+0000', 'last_change': '2024-09-10T08:28:44.466546+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.466546+0000', 'last_undegraded': '2024-09-10T08:28:44.466546+0000', 'last_fullsized': '2024-09-10T08:28:44.466546+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.479129+0000', 'last_change': '2024-09-10T08:28:44.479129+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.479129+0000', 'last_undegraded': '2024-09-10T08:28:44.479129+0000', 'last_fullsized': '2024-09-10T08:28:44.479129+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-10T08:28:50.532 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:28:44.474354+0000', 'last_change': '2024-09-10T08:28:44.474354+0000', 'last_active': '2024-09-10T08:28:44.450725+0000', 'last_peered': '2024-09-10T08:28:44.450725+0000', 'last_clean': '2024-09-10T08:28:44.450725+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:28:44.474354+0000', 'last_undegraded': '2024-09-10T08:28:44.474354+0000', 'last_fullsized': '2024-09-10T08:28:44.474354+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'last_clean_scrub_stamp': '2024-09-10T08:28:44.450725+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:28:50.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:28:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.714+0000 7f4764e00640 1 Processor -- start 2024-09-10T08:28:50.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.714+0000 7f4764e00640 1 -- start start 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4764e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47600b49a0 0x7f4760071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4764e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4760072fb0 con 0x7f47601482b0 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4764e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4760073290 con 0x7f476006efb0 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4764e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4760073570 con 0x7f47600b49a0 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47600b49a0 0x7f4760071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47600b49a0 0x7f4760071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40080/0 (socket says 172.21.15.52:40080) 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 -- 172.21.15.52:0/3372092840 learned_addr learned my addr 172.21.15.52:0/3372092840 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:50.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f475de00640 1 --1- 172.21.15.52:0/3372092840 >> v1:172.21.15.52:6789/0 conn(0x7f47601482b0 0x7f47600b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33740/0 (socket says 172.21.15.52:33740) 2024-09-10T08:28:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 -- 172.21.15.52:0/3372092840 >> v1:172.21.15.176:6789/0 conn(0x7f476006efb0 legacy=0x7f4760071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 -- 172.21.15.52:0/3372092840 >> v1:172.21.15.52:6789/0 conn(0x7f47601482b0 legacy=0x7f47600b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.716+0000 7f4755400640 1 -- 172.21.15.52:0/3372092840 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476006da80 con 0x7f47600b49a0 2024-09-10T08:28:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f4755400640 1 --2- 172.21.15.52:0/3372092840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47600b49a0 0x7f4760071430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4748009870 tx=0x7f474802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6886e324bd3b0983 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f475d400640 1 -- 172.21.15.52:0/3372092840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4748037070 con 0x7f47600b49a0 2024-09-10T08:28:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f475d400640 1 -- 172.21.15.52:0/3372092840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4748032440 con 0x7f47600b49a0 2024-09-10T08:28:50.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f475d400640 1 -- 172.21.15.52:0/3372092840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4748032810 con 0x7f47600b49a0 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f4764e00640 1 -- 172.21.15.52:0/3372092840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47600b49a0 msgr2=0x7f4760071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.718+0000 7f4764e00640 1 --2- 172.21.15.52:0/3372092840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47600b49a0 0x7f4760071430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4748009870 tx=0x7f474802a210 comp rx=0 tx=0).stop 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.719+0000 7f4764e00640 1 -- 172.21.15.52:0/3372092840 shutdown_connections 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.719+0000 7f4764e00640 1 --2- 172.21.15.52:0/3372092840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47600b49a0 0x7f4760071430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.719+0000 7f4764e00640 1 -- 172.21.15.52:0/3372092840 >> 172.21.15.52:0/3372092840 conn(0x7f476006c240 msgr2=0x7f47600b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.719+0000 7f4764e00640 1 -- 172.21.15.52:0/3372092840 shutdown_connections 2024-09-10T08:28:50.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.719+0000 7f4764e00640 1 -- 172.21.15.52:0/3372092840 wait complete. 2024-09-10T08:28:50.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.720+0000 7f4764e00640 1 Processor -- start 2024-09-10T08:28:50.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.720+0000 7f4764e00640 1 -- start start 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006efb0 0x7f47601604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47600b49a0 0x7f476015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f476006d6a0 con 0x7f47601482b0 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4760148690 con 0x7f47600b49a0 2024-09-10T08:28:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f4764e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f476006d820 con 0x7f476006efb0 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f475e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.721+0000 7f475e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40084/0 (socket says 172.21.15.52:40084) 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 -- 172.21.15.52:0/1085949835 learned_addr learned my addr 172.21.15.52:0/1085949835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475de00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006efb0 0x7f47601604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f4755400640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47600b49a0 0x7f476015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 -- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006efb0 msgr2=0x7f47601604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006efb0 0x7f47601604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 -- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47600b49a0 msgr2=0x7f476015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47600b49a0 0x7f476015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 -- 172.21.15.52:0/1085949835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47600c5fd0 con 0x7f47601482b0 2024-09-10T08:28:50.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.722+0000 7f475e800640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f475800c730 tx=0x7f475800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.723+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758016020 con 0x7f47601482b0 2024-09-10T08:28:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.723+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475800aa50 con 0x7f47601482b0 2024-09-10T08:28:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.723+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475800ce40 con 0x7f47601482b0 2024-09-10T08:28:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.723+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47600c62b0 con 0x7f47601482b0 2024-09-10T08:28:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.723+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601f8240 con 0x7f47601482b0 2024-09-10T08:28:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.724+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47600b4290 con 0x7f47601482b0 2024-09-10T08:28:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.725+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4758019020 con 0x7f47601482b0 2024-09-10T08:28:50.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.726+0000 7f4756a00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 0x7f473c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:50.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.726+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f475808add0 con 0x7f47601482b0 2024-09-10T08:28:50.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.726+0000 7f475de00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 0x7f473c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:50.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.727+0000 7f475de00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 0x7f473c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4760141290 tx=0x7f4750007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:50.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.731+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4758020030 con 0x7f47601482b0 2024-09-10T08:28:50.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.982+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4760161f40 con 0x7f47601482b0 2024-09-10T08:28:50.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.983+0000 7f4756a00640 1 -- 172.21.15.52:0/1085949835 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1137 (secure 0 0 0) 0x7f4758059090 con 0x7f47601482b0 2024-09-10T08:28:50.983 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:50.983 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590438,"bytes_used":241164288,"bytes_avail":772852948992,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-10T08:28:20.564291+0000","services":{}},"progress_events":{}} 2024-09-10T08:28:50.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 msgr2=0x7f473c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 0x7f473c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4760141290 tx=0x7f4750007e80 comp rx=0 tx=0).stop 2024-09-10T08:28:50.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 msgr2=0x7f47601f8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:50.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f475800c730 tx=0x7f475800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 shutdown_connections 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f473c06be30 0x7f473c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47601482b0 0x7f47601f8760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47600b49a0 0x7f476015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 --2- 172.21.15.52:0/1085949835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f476006efb0 0x7f47601604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 >> 172.21.15.52:0/1085949835 conn(0x7f476006c240 msgr2=0x7f47600726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 shutdown_connections 2024-09-10T08:28:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:50.985+0000 7f4764e00640 1 -- 172.21.15.52:0/1085949835 wait complete. 2024-09-10T08:28:51.001 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:28:51.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.157+0000 7f08f0600640 1 Processor -- start 2024-09-10T08:28:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.157+0000 7f08f0600640 1 -- start start 2024-09-10T08:28:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08f0600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08e80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08f0600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08e80b90e0 0x7f08e80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08f0600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e80d0e70 con 0x7f08e80d23b0 2024-09-10T08:28:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08f0600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f08e80d41c0 con 0x7f08e80b90e0 2024-09-10T08:28:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08f0600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08e80d35b0 con 0x7f08e815ed20 2024-09-10T08:28:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08ed200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f08e80d23b0 0x7f08e80cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33752/0 (socket says 172.21.15.52:33752) 2024-09-10T08:28:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.158+0000 7f08ed200640 1 -- 172.21.15.52:0/1007845066 learned_addr learned my addr 172.21.15.52:0/1007845066 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08ee600640 1 --2- 172.21.15.52:0/1007845066 >> v2:172.21.15.176:3300/0 conn(0x7f08e80b90e0 0x7f08e80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08edc00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08e80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255339185 0 0) 0x7f08d4001110 con 0x7f08e80d23b0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d0003520 con 0x7f08e80d23b0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622894686 0 0) 0x7f08d0003520 con 0x7f08e80d23b0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 msgr2=0x7f08e80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08e80b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 >> v2:172.21.15.176:3300/0 conn(0x7f08e80b90e0 msgr2=0x7f08e80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 --2- 172.21.15.52:0/1007845066 >> v2:172.21.15.176:3300/0 conn(0x7f08e80b90e0 0x7f08e80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e80d3890 con 0x7f08e80d23b0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f08d4001840 con 0x7f08e80d23b0 2024-09-10T08:28:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 >> v1:172.21.15.52:6789/0 conn(0x7f08e80d23b0 legacy=0x7f08e80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08d00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d0003f30 0x7f08d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0004d40 0x7f08d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e80d41c0 con 0x7f08d0003f30 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08e80d35b0 con 0x7f08d0004d40 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.159+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08d000b9c0 con 0x7f08e815ed20 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d0003f30 0x7f08d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08edc00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08d00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ee600640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0004d40 0x7f08d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 -- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 msgr2=0x7f08d00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08d00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 -- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0004d40 msgr2=0x7f08d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0004d40 0x7f08d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08ed200640 1 -- 172.21.15.52:0/1007845066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d0003520 con 0x7f08d0003f30 2024-09-10T08:28:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.160+0000 7f08edc00640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e815ed20 0x7f08d00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.161+0000 7f08ed200640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d0003f30 0x7f08d0004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c3b0 tx=0x7f08d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84dfd8bef4d5cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.161+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d400c0e0 con 0x7f08d0003f30 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.161+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4034070 con 0x7f08d0003f30 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.161+0000 7f08e7e00640 1 -- 172.21.15.52:0/1007845066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005d70 con 0x7f08d0003f30 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 -- 172.21.15.52:0/1007845066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d0003f30 msgr2=0x7f08d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 --2- 172.21.15.52:0/1007845066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d0003f30 0x7f08d0004800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c3b0 tx=0x7f08d0005830 comp rx=0 tx=0).stop 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08ee600640 1 -- 172.21.15.52:0/1007845066 reap_dead start 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 -- 172.21.15.52:0/1007845066 shutdown_connections 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 -- 172.21.15.52:0/1007845066 >> 172.21.15.52:0/1007845066 conn(0x7f08e80d1260 msgr2=0x7f08e80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 -- 172.21.15.52:0/1007845066 shutdown_connections 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.162+0000 7f08f0600640 1 -- 172.21.15.52:0/1007845066 wait complete. 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.164+0000 7f08f0600640 1 Processor -- start 2024-09-10T08:28:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.164+0000 7f08f0600640 1 -- start start 2024-09-10T08:28:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0003f30 0x7f08e815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 0x7f08e80b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e80d32a0 con 0x7f08e80adc60 2024-09-10T08:28:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08e80d3e50 con 0x7f08d0003f30 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08f0600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08e815f100 con 0x7f08e81f8590 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40096/0 (socket says 172.21.15.52:40096) 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 -- 172.21.15.52:0/2348410894 learned_addr learned my addr 172.21.15.52:0/2348410894 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ed200640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 0x7f08e80b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08edc00640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0003f30 0x7f08e815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 -- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 msgr2=0x7f08e80b95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 0x7f08e80b95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 -- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0003f30 msgr2=0x7f08e815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0003f30 0x7f08e815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ee600640 1 -- 172.21.15.52:0/2348410894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e81f8a20 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.165+0000 7f08ed200640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 0x7f08e80b95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08ee600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f08e80d4130 tx=0x7f08e000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc009690 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e001c070 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e81f8d00 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e000fb70 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.166+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e81f92c0 con 0x7f08e80adc60 2024-09-10T08:28:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.167+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e80b7010 con 0x7f08e80adc60 2024-09-10T08:28:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.168+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08e000fd10 con 0x7f08e80adc60 2024-09-10T08:28:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.169+0000 7f08e5600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 0x7f08c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.169+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f08e008b670 con 0x7f08e80adc60 2024-09-10T08:28:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.169+0000 7f08edc00640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 0x7f08c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.170+0000 7f08edc00640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 0x7f08c806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009c80 tx=0x7f08dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:51.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.173+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08e0010040 con 0x7f08e80adc60 2024-09-10T08:28:51.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.354+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08e81f9500 con 0x7f08c806be30 2024-09-10T08:28:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.361+0000 7f08e5600640 1 -- 172.21.15.52:0/2348410894 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247620 (secure 0 0 0) 0x7f08dc009cb0 con 0x7f08c806be30 2024-09-10T08:28:51.363 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:51.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 msgr2=0x7f08c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 0x7f08c806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009c80 tx=0x7f08dc009190 comp rx=0 tx=0).stop 2024-09-10T08:28:51.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 msgr2=0x7f08e80b9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:51.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f08e80d4130 tx=0x7f08e000f1b0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 shutdown_connections 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c806be30 0x7f08c806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e80adc60 0x7f08e80b9ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e81f8590 0x7f08e80b95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 --2- 172.21.15.52:0/2348410894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08d0003f30 0x7f08e815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 >> 172.21.15.52:0/2348410894 conn(0x7f08e80d1260 msgr2=0x7f08e815de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 shutdown_connections 2024-09-10T08:28:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:51.364+0000 7f08f0600640 1 -- 172.21.15.52:0/2348410894 wait complete. 2024-09-10T08:28:51.380 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T08:28:49.451373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235512,"kb_used_data":2644,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739208,"statfs":{"total":773094113280,"available":772852948992,"internally_reserved":0,"allocated":2707456,"data_stored":1655650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000474"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464948+0000","last_change":"2024-09-10T08:28:44.464948+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464948+0000","last_undegraded":"2024-09-10T08:28:44.464948+0000","last_fullsized":"2024-09-10T08:28:44.464948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465834+0000","last_change":"2024-09-10T08:28:44.465834+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465834+0000","last_undegraded":"2024-09-10T08:28:44.465834+0000","last_fullsized":"2024-09-10T08:28:44.465834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463831+0000","last_change":"2024-09-10T08:28:44.463831+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463831+0000","last_undegraded":"2024-09-10T08:28:44.463831+0000","last_fullsized":"2024-09-10T08:28:44.463831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470032+0000","last_change":"2024-09-10T08:28:44.470032+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470032+0000","last_undegraded":"2024-09-10T08:28:44.470032+0000","last_fullsized":"2024-09-10T08:28:44.470032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468722+0000","last_change":"2024-09-10T08:28:44.468722+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468722+0000","last_undegraded":"2024-09-10T08:28:44.468722+0000","last_fullsized":"2024-09-10T08:28:44.468722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472403+0000","last_change":"2024-09-10T08:28:44.472403+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472403+0000","last_undegraded":"2024-09-10T08:28:44.472403+0000","last_fullsized":"2024-09-10T08:28:44.472403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464526+0000","last_change":"2024-09-10T08:28:44.464526+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464526+0000","last_undegraded":"2024-09-10T08:28:44.464526+0000","last_fullsized":"2024-09-10T08:28:44.464526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464164+0000","last_change":"2024-09-10T08:28:44.464164+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464164+0000","last_undegraded":"2024-09-10T08:28:44.464164+0000","last_fullsized":"2024-09-10T08:28:44.464164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467546+0000","last_change":"2024-09-10T08:28:44.467546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467546+0000","last_undegraded":"2024-09-10T08:28:44.467546+0000","last_fullsized":"2024-09-10T08:28:44.467546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463149+0000","last_change":"2024-09-10T08:28:44.463149+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463149+0000","last_undegraded":"2024-09-10T08:28:44.463149+0000","last_fullsized":"2024-09-10T08:28:44.463149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.472178+0000","last_change":"2024-09-10T08:28:44.472178+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.472178+0000","last_undegraded":"2024-09-10T08:28:44.472178+0000","last_fullsized":"2024-09-10T08:28:44.472178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469334+0000","last_change":"2024-09-10T08:28:44.469334+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469334+0000","last_undegraded":"2024-09-10T08:28:44.469334+0000","last_fullsized":"2024-09-10T08:28:44.469334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464382+0000","last_change":"2024-09-10T08:28:44.464382+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464382+0000","last_undegraded":"2024-09-10T08:28:44.464382+0000","last_fullsized":"2024-09-10T08:28:44.464382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463983+0000","last_change":"2024-09-10T08:28:44.463983+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463983+0000","last_undegraded":"2024-09-10T08:28:44.463983+0000","last_fullsized":"2024-09-10T08:28:44.463983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464140+0000","last_change":"2024-09-10T08:28:44.464140+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464140+0000","last_undegraded":"2024-09-10T08:28:44.464140+0000","last_fullsized":"2024-09-10T08:28:44.464140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.471477+0000","last_change":"2024-09-10T08:28:44.471477+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.471477+0000","last_undegraded":"2024-09-10T08:28:44.471477+0000","last_fullsized":"2024-09-10T08:28:44.471477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462610+0000","last_change":"2024-09-10T08:28:44.462610+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462610+0000","last_undegraded":"2024-09-10T08:28:44.462610+0000","last_fullsized":"2024-09-10T08:28:44.462610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468289+0000","last_change":"2024-09-10T08:28:44.468289+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468289+0000","last_undegraded":"2024-09-10T08:28:44.468289+0000","last_fullsized":"2024-09-10T08:28:44.468289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466405+0000","last_change":"2024-09-10T08:28:44.466405+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466405+0000","last_undegraded":"2024-09-10T08:28:44.466405+0000","last_fullsized":"2024-09-10T08:28:44.466405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466327+0000","last_change":"2024-09-10T08:28:44.466327+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466327+0000","last_undegraded":"2024-09-10T08:28:44.466327+0000","last_fullsized":"2024-09-10T08:28:44.466327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466890+0000","last_change":"2024-09-10T08:28:44.466890+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466890+0000","last_undegraded":"2024-09-10T08:28:44.466890+0000","last_fullsized":"2024-09-10T08:28:44.466890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468225+0000","last_change":"2024-09-10T08:28:44.468225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468225+0000","last_undegraded":"2024-09-10T08:28:44.468225+0000","last_fullsized":"2024-09-10T08:28:44.468225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.467661+0000","last_change":"2024-09-10T08:28:44.467661+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.467661+0000","last_undegraded":"2024-09-10T08:28:44.467661+0000","last_fullsized":"2024-09-10T08:28:44.467661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.468909+0000","last_change":"2024-09-10T08:28:44.468909+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.468909+0000","last_undegraded":"2024-09-10T08:28:44.468909+0000","last_fullsized":"2024-09-10T08:28:44.468909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462868+0000","last_change":"2024-09-10T08:28:44.462868+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462868+0000","last_undegraded":"2024-09-10T08:28:44.462868+0000","last_fullsized":"2024-09-10T08:28:44.462868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486855+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:44.486855+0000","last_peered":"2024-09-10T08:28:44.486855+0000","last_clean":"2024-09-10T08:28:44.486855+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:44.486855+0000","last_undegraded":"2024-09-10T08:28:44.486855+0000","last_fullsized":"2024-09-10T08:28:44.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487859+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:44.487859+0000","last_peered":"2024-09-10T08:28:44.487859+0000","last_clean":"2024-09-10T08:28:44.487859+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:44.487859+0000","last_undegraded":"2024-09-10T08:28:44.487859+0000","last_fullsized":"2024-09-10T08:28:44.487859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488101+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:44.488101+0000","last_peered":"2024-09-10T08:28:44.488101+0000","last_clean":"2024-09-10T08:28:44.488101+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:44.488101+0000","last_undegraded":"2024-09-10T08:28:44.488101+0000","last_fullsized":"2024-09-10T08:28:44.488101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464568+0000","last_change":"2024-09-10T08:28:44.464568+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464568+0000","last_undegraded":"2024-09-10T08:28:44.464568+0000","last_fullsized":"2024-09-10T08:28:44.464568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.478952+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:44.478952+0000","last_peered":"2024-09-10T08:28:44.478952+0000","last_clean":"2024-09-10T08:28:44.478952+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:44.478952+0000","last_undegraded":"2024-09-10T08:28:44.478952+0000","last_fullsized":"2024-09-10T08:28:44.478952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464997+0000","last_change":"2024-09-10T08:28:44.464997+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464997+0000","last_undegraded":"2024-09-10T08:28:44.464997+0000","last_fullsized":"2024-09-10T08:28:44.464997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.493014+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:44.493014+0000","last_peered":"2024-09-10T08:28:44.493014+0000","last_clean":"2024-09-10T08:28:44.493014+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:44.493014+0000","last_undegraded":"2024-09-10T08:28:44.493014+0000","last_fullsized":"2024-09-10T08:28:44.493014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.483991+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:44.483991+0000","last_peered":"2024-09-10T08:28:44.483991+0000","last_clean":"2024-09-10T08:28:44.483991+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:44.483991+0000","last_undegraded":"2024-09-10T08:28:44.483991+0000","last_fullsized":"2024-09-10T08:28:44.483991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.463865+0000","last_change":"2024-09-10T08:28:44.463865+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.463865+0000","last_undegraded":"2024-09-10T08:28:44.463865+0000","last_fullsized":"2024-09-10T08:28:44.463865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.479494+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:44.479494+0000","last_peered":"2024-09-10T08:28:44.479494+0000","last_clean":"2024-09-10T08:28:44.479494+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:44.479494+0000","last_undegraded":"2024-09-10T08:28:44.479494+0000","last_fullsized":"2024-09-10T08:28:44.479494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469515+0000","last_change":"2024-09-10T08:28:44.469515+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469515+0000","last_undegraded":"2024-09-10T08:28:44.469515+0000","last_fullsized":"2024-09-10T08:28:44.469515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487219+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:44.487219+0000","last_peered":"2024-09-10T08:28:44.487219+0000","last_clean":"2024-09-10T08:28:44.487219+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:44.487219+0000","last_undegraded":"2024-09-10T08:28:44.487219+0000","last_fullsized":"2024-09-10T08:28:44.487219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466029+0000","last_change":"2024-09-10T08:28:44.466029+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466029+0000","last_undegraded":"2024-09-10T08:28:44.466029+0000","last_fullsized":"2024-09-10T08:28:44.466029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488159+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:44.488159+0000","last_peered":"2024-09-10T08:28:44.488159+0000","last_clean":"2024-09-10T08:28:44.488159+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:44.488159+0000","last_undegraded":"2024-09-10T08:28:44.488159+0000","last_fullsized":"2024-09-10T08:28:44.488159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466100+0000","last_change":"2024-09-10T08:28:44.466100+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466100+0000","last_undegraded":"2024-09-10T08:28:44.466100+0000","last_fullsized":"2024-09-10T08:28:44.466100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.492559+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:44.492559+0000","last_peered":"2024-09-10T08:28:44.492559+0000","last_clean":"2024-09-10T08:28:44.492559+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:44.492559+0000","last_undegraded":"2024-09-10T08:28:44.492559+0000","last_fullsized":"2024-09-10T08:28:44.492559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473518+0000","last_change":"2024-09-10T08:28:44.473518+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473518+0000","last_undegraded":"2024-09-10T08:28:44.473518+0000","last_fullsized":"2024-09-10T08:28:44.473518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.476866+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:44.476866+0000","last_peered":"2024-09-10T08:28:44.476866+0000","last_clean":"2024-09-10T08:28:44.476866+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:44.476866+0000","last_undegraded":"2024-09-10T08:28:44.476866+0000","last_fullsized":"2024-09-10T08:28:44.476866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473292+0000","last_change":"2024-09-10T08:28:44.473292+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473292+0000","last_undegraded":"2024-09-10T08:28:44.473292+0000","last_fullsized":"2024-09-10T08:28:44.473292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489495+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:44.489495+0000","last_peered":"2024-09-10T08:28:44.489495+0000","last_clean":"2024-09-10T08:28:44.489495+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:44.489495+0000","last_undegraded":"2024-09-10T08:28:44.489495+0000","last_fullsized":"2024-09-10T08:28:44.489495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464499+0000","last_change":"2024-09-10T08:28:44.464499+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464499+0000","last_undegraded":"2024-09-10T08:28:44.464499+0000","last_fullsized":"2024-09-10T08:28:44.464499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.480962+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:44.480962+0000","last_peered":"2024-09-10T08:28:44.480962+0000","last_clean":"2024-09-10T08:28:44.480962+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:44.480962+0000","last_undegraded":"2024-09-10T08:28:44.480962+0000","last_fullsized":"2024-09-10T08:28:44.480962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464418+0000","last_change":"2024-09-10T08:28:44.464418+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464418+0000","last_undegraded":"2024-09-10T08:28:44.464418+0000","last_fullsized":"2024-09-10T08:28:44.464418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462277+0000","last_change":"2024-09-10T08:28:44.462277+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462277+0000","last_undegraded":"2024-09-10T08:28:44.462277+0000","last_fullsized":"2024-09-10T08:28:44.462277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484991+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:44.484991+0000","last_peered":"2024-09-10T08:28:44.484991+0000","last_clean":"2024-09-10T08:28:44.484991+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:44.484991+0000","last_undegraded":"2024-09-10T08:28:44.484991+0000","last_fullsized":"2024-09-10T08:28:44.484991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.473725+0000","last_change":"2024-09-10T08:28:44.473725+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.473725+0000","last_undegraded":"2024-09-10T08:28:44.473725+0000","last_fullsized":"2024-09-10T08:28:44.473725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.474865+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:44.474865+0000","last_peered":"2024-09-10T08:28:44.474865+0000","last_clean":"2024-09-10T08:28:44.474865+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:44.474865+0000","last_undegraded":"2024-09-10T08:28:44.474865+0000","last_fullsized":"2024-09-10T08:28:44.474865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486706+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:44.486706+0000","last_peered":"2024-09-10T08:28:44.486706+0000","last_clean":"2024-09-10T08:28:44.486706+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:44.486706+0000","last_undegraded":"2024-09-10T08:28:44.486706+0000","last_fullsized":"2024-09-10T08:28:44.486706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462807+0000","last_change":"2024-09-10T08:28:44.462807+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462807+0000","last_undegraded":"2024-09-10T08:28:44.462807+0000","last_fullsized":"2024-09-10T08:28:44.462807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489376+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:44.489376+0000","last_peered":"2024-09-10T08:28:44.489376+0000","last_clean":"2024-09-10T08:28:44.489376+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:44.489376+0000","last_undegraded":"2024-09-10T08:28:44.489376+0000","last_fullsized":"2024-09-10T08:28:44.489376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464115+0000","last_change":"2024-09-10T08:28:44.464115+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464115+0000","last_undegraded":"2024-09-10T08:28:44.464115+0000","last_fullsized":"2024-09-10T08:28:44.464115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486486+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:44.486486+0000","last_peered":"2024-09-10T08:28:44.486486+0000","last_clean":"2024-09-10T08:28:44.486486+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:44.486486+0000","last_undegraded":"2024-09-10T08:28:44.486486+0000","last_fullsized":"2024-09-10T08:28:44.486486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486439+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:44.486439+0000","last_peered":"2024-09-10T08:28:44.486439+0000","last_clean":"2024-09-10T08:28:44.486439+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:44.486439+0000","last_undegraded":"2024-09-10T08:28:44.486439+0000","last_fullsized":"2024-09-10T08:28:44.486439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.462505+0000","last_change":"2024-09-10T08:28:44.462505+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.462505+0000","last_undegraded":"2024-09-10T08:28:44.462505+0000","last_fullsized":"2024-09-10T08:28:44.462505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466542+0000","last_change":"2024-09-10T08:28:44.466542+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466542+0000","last_undegraded":"2024-09-10T08:28:44.466542+0000","last_fullsized":"2024-09-10T08:28:44.466542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488191+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:44.488191+0000","last_peered":"2024-09-10T08:28:44.488191+0000","last_clean":"2024-09-10T08:28:44.488191+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:44.488191+0000","last_undegraded":"2024-09-10T08:28:44.488191+0000","last_fullsized":"2024-09-10T08:28:44.488191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.465225+0000","last_change":"2024-09-10T08:28:44.465225+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.465225+0000","last_undegraded":"2024-09-10T08:28:44.465225+0000","last_fullsized":"2024-09-10T08:28:44.465225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488277+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:44.488277+0000","last_peered":"2024-09-10T08:28:44.488277+0000","last_clean":"2024-09-10T08:28:44.488277+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:44.488277+0000","last_undegraded":"2024-09-10T08:28:44.488277+0000","last_fullsized":"2024-09-10T08:28:44.488277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464412+0000","last_change":"2024-09-10T08:28:44.464412+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464412+0000","last_undegraded":"2024-09-10T08:28:44.464412+0000","last_fullsized":"2024-09-10T08:28:44.464412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488009+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:44.488009+0000","last_peered":"2024-09-10T08:28:44.488009+0000","last_clean":"2024-09-10T08:28:44.488009+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:44.488009+0000","last_undegraded":"2024-09-10T08:28:44.488009+0000","last_fullsized":"2024-09-10T08:28:44.488009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464650+0000","last_change":"2024-09-10T08:28:44.464650+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464650+0000","last_undegraded":"2024-09-10T08:28:44.464650+0000","last_fullsized":"2024-09-10T08:28:44.464650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.487226+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:44.487226+0000","last_peered":"2024-09-10T08:28:44.487226+0000","last_clean":"2024-09-10T08:28:44.487226+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:44.487226+0000","last_undegraded":"2024-09-10T08:28:44.487226+0000","last_fullsized":"2024-09-10T08:28:44.487226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:32.784400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.470279+0000","last_change":"2024-09-10T08:28:44.470279+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.470279+0000","last_undegraded":"2024-09-10T08:28:44.470279+0000","last_fullsized":"2024-09-10T08:28:44.470279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.488292+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:44.488292+0000","last_peered":"2024-09-10T08:28:44.488292+0000","last_clean":"2024-09-10T08:28:44.488292+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:44.488292+0000","last_undegraded":"2024-09-10T08:28:44.488292+0000","last_fullsized":"2024-09-10T08:28:44.488292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:11.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.464538+0000","last_change":"2024-09-10T08:28:44.464538+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.464538+0000","last_undegraded":"2024-09-10T08:28:44.464538+0000","last_fullsized":"2024-09-10T08:28:44.464538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.482311+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:44.482311+0000","last_peered":"2024-09-10T08:28:44.482311+0000","last_clean":"2024-09-10T08:28:44.482311+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:44.482311+0000","last_undegraded":"2024-09-10T08:28:44.482311+0000","last_fullsized":"2024-09-10T08:28:44.482311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.469520+0000","last_change":"2024-09-10T08:28:44.469520+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.469520+0000","last_undegraded":"2024-09-10T08:28:44.469520+0000","last_fullsized":"2024-09-10T08:28:44.469520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.486728+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:44.486728+0000","last_peered":"2024-09-10T08:28:44.486728+0000","last_clean":"2024-09-10T08:28:44.486728+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:44.486728+0000","last_undegraded":"2024-09-10T08:28:44.486728+0000","last_fullsized":"2024-09-10T08:28:44.486728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.466546+0000","last_change":"2024-09-10T08:28:44.466546+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.466546+0000","last_undegraded":"2024-09-10T08:28:44.466546+0000","last_fullsized":"2024-09-10T08:28:44.466546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.479129+0000","last_change":"2024-09-10T08:28:44.479129+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.479129+0000","last_undegraded":"2024-09-10T08:28:44.479129+0000","last_fullsized":"2024-09-10T08:28:44.479129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.489080+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:44.489080+0000","last_peered":"2024-09-10T08:28:44.489080+0000","last_clean":"2024-09-10T08:28:44.489080+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:44.489080+0000","last_undegraded":"2024-09-10T08:28:44.489080+0000","last_fullsized":"2024-09-10T08:28:44.489080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-10T08:28:44.474354+0000","last_change":"2024-09-10T08:28:44.474354+0000","last_active":"2024-09-10T08:28:44.450725+0000","last_peered":"2024-09-10T08:28:44.450725+0000","last_clean":"2024-09-10T08:28:44.450725+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:28:44.474354+0000","last_undegraded":"2024-09-10T08:28:44.474354+0000","last_fullsized":"2024-09-10T08:28:44.474354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.484152+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:44.484152+0000","last_peered":"2024-09-10T08:28:44.484152+0000","last_clean":"2024-09-10T08:28:44.484152+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:44.484152+0000","last_undegraded":"2024-09-10T08:28:44.484152+0000","last_fullsized":"2024-09-10T08:28:44.484152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:02.266060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T08:28:44.490790+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:44.490790+0000","last_peered":"2024-09-10T08:28:44.490790+0000","last_clean":"2024-09-10T08:28:44.490790+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:44.490790+0000","last_undegraded":"2024-09-10T08:28:44.490790+0000","last_fullsized":"2024-09-10T08:28:44.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:54.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.552+0000 7f84b7800640 1 Processor -- start 2024-09-10T08:28:54.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.552+0000 7f84b7800640 1 -- start start 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84b7800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84b0073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84b7800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00d1000 con 0x7f84b0070fa0 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84b7800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b00d1770 con 0x7f84b00cf300 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84b7800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84b00cdec0 con 0x7f84b015c6b0 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84afe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f84b0070fa0 0x7f84b00d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48210/0 (socket says 172.21.15.52:48210) 2024-09-10T08:28:54.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84afe00640 1 -- 172.21.15.52:0/3820586202 learned_addr learned my addr 172.21.15.52:0/3820586202 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84b4e00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84b0073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777729855 0 0) 0x7f84b00d1000 con 0x7f84b0070fa0 2024-09-10T08:28:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.554+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8498003520 con 0x7f84b0070fa0 2024-09-10T08:28:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1788785950 0 0) 0x7f8498003520 con 0x7f84b0070fa0 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 msgr2=0x7f84b0073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84b0073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 >> v1:172.21.15.176:6789/0 conn(0x7f84b00cf300 legacy=0x7f84b00d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b00d1a50 con 0x7f84b0070fa0 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f849c001670 con 0x7f84b0070fa0 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 >> v1:172.21.15.52:6789/0 conn(0x7f84b0070fa0 legacy=0x7f84b00d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84980039e0 0x7f8498003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f849800ba70 con 0x7f84980039e0 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f849800bbf0 con 0x7f8498004800 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f849800bda0 con 0x7f84b015c6b0 2024-09-10T08:28:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84b4e00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84980039e0 0x7f8498003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84afe00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.555+0000 7f84b5800640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b4e00640 1 -- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 msgr2=0x7f84980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b4e00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b4e00640 1 -- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8498004800 msgr2=0x7f8498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b4e00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b4e00640 1 -- 172.21.15.52:0/3820586202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8498003520 con 0x7f84980039e0 2024-09-10T08:28:54.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.556+0000 7f84b5800640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015c6b0 0x7f84980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84b4e00640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84980039e0 0x7f8498003dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009a70 tx=0x7f8498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a337b324af4f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4036070 con 0x7f84980039e0 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a4031400 con 0x7f84980039e0 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84af400640 1 -- 172.21.15.52:0/3820586202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4009670 con 0x7f84980039e0 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84b7800640 1 -- 172.21.15.52:0/3820586202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84980039e0 msgr2=0x7f8498003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.557+0000 7f84b7800640 1 --2- 172.21.15.52:0/3820586202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84980039e0 0x7f8498003dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009a70 tx=0x7f8498005830 comp rx=0 tx=0).stop 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.558+0000 7f84b5800640 1 -- 172.21.15.52:0/3820586202 reap_dead start 2024-09-10T08:28:54.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.558+0000 7f84b7800640 1 -- 172.21.15.52:0/3820586202 shutdown_connections 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.558+0000 7f84b7800640 1 -- 172.21.15.52:0/3820586202 >> 172.21.15.52:0/3820586202 conn(0x7f84b00b4300 msgr2=0x7f84b00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.558+0000 7f84b7800640 1 -- 172.21.15.52:0/3820586202 shutdown_connections 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.558+0000 7f84b7800640 1 -- 172.21.15.52:0/3820586202 wait complete. 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.559+0000 7f84b7800640 1 Processor -- start 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 -- start start 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980039e0 0x7f84b00cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015cc10 0x7f84b015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84b015ca90 con 0x7f84b00caf30 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84b00d2010 con 0x7f84980039e0 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.560+0000 7f84b7800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84b00d22f0 con 0x7f84b015cc10 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45326/0 (socket says 172.21.15.52:45326) 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 -- 172.21.15.52:0/2247176608 learned_addr learned my addr 172.21.15.52:0/2247176608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84afe00640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015cc10 0x7f84b015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b4e00640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980039e0 0x7f84b00cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 -- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015cc10 msgr2=0x7f84b015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015cc10 0x7f84b015f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 -- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980039e0 msgr2=0x7f84b00cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980039e0 0x7f84b00cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 -- 172.21.15.52:0/2247176608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b015d160 con 0x7f84b00caf30 2024-09-10T08:28:54.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.561+0000 7f84b5800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84b00d0090 tx=0x7f84a800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.562+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a800ee50 con 0x7f84b00caf30 2024-09-10T08:28:54.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.562+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a8018070 con 0x7f84b00caf30 2024-09-10T08:28:54.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.562+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8003dc0 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.562+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b015d440 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.562+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b01f1f80 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.563+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b01f2180 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.564+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84a80050d0 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.564+0000 7f84acc00640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 0x7f849006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.564+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f84a808abc0 con 0x7f84b00caf30 2024-09-10T08:28:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.565+0000 7f84b4e00640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 0x7f849006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.565+0000 7f84b4e00640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 0x7f849006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84a4033000 tx=0x7f84a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.568+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84b01f2180 con 0x7f84b00caf30 2024-09-10T08:28:54.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.752+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84b00d1400 con 0x7f849006be30 2024-09-10T08:28:54.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.759+0000 7f84acc00640 1 -- 172.21.15.52:0/2247176608 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f84b00d1400 con 0x7f849006be30 2024-09-10T08:28:54.762 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:54.763 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:54.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.762+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 msgr2=0x7f849006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.762+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 0x7f849006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84a4033000 tx=0x7f84a4008030 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.762+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 msgr2=0x7f84b00cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.762+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84b00d0090 tx=0x7f84a800ec00 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 shutdown_connections 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be30 0x7f849006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84b00caf30 0x7f84b00cb3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84b015cc10 0x7f84b015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 --2- 172.21.15.52:0/2247176608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84980039e0 0x7f84b00cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 >> 172.21.15.52:0/2247176608 conn(0x7f84b00b4300 msgr2=0x7f84b0159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 shutdown_connections 2024-09-10T08:28:54.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.763+0000 7f84b7800640 1 -- 172.21.15.52:0/2247176608 wait complete. 2024-09-10T08:28:54.778 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-10T08:28:53.452403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235860,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738860,"statfs":{"total":773094113280,"available":772852592640,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002141"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495538+0000","last_change":"2024-09-10T08:28:45.504174+0000","last_active":"2024-09-10T08:28:46.495538+0000","last_peered":"2024-09-10T08:28:46.495538+0000","last_clean":"2024-09-10T08:28:46.495538+0000","last_became_active":"2024-09-10T08:28:45.503695+0000","last_became_peered":"2024-09-10T08:28:45.503695+0000","last_unstale":"2024-09-10T08:28:46.495538+0000","last_undegraded":"2024-09-10T08:28:46.495538+0000","last_fullsized":"2024-09-10T08:28:46.495538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475469+0000","last_change":"2024-09-10T08:28:45.484363+0000","last_active":"2024-09-10T08:28:46.475469+0000","last_peered":"2024-09-10T08:28:46.475469+0000","last_clean":"2024-09-10T08:28:46.475469+0000","last_became_active":"2024-09-10T08:28:45.483998+0000","last_became_peered":"2024-09-10T08:28:45.483998+0000","last_unstale":"2024-09-10T08:28:46.475469+0000","last_undegraded":"2024-09-10T08:28:46.475469+0000","last_fullsized":"2024-09-10T08:28:46.475469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494959+0000","last_change":"2024-09-10T08:28:45.484207+0000","last_active":"2024-09-10T08:28:46.494959+0000","last_peered":"2024-09-10T08:28:46.494959+0000","last_clean":"2024-09-10T08:28:46.494959+0000","last_became_active":"2024-09-10T08:28:45.483957+0000","last_became_peered":"2024-09-10T08:28:45.483957+0000","last_unstale":"2024-09-10T08:28:46.494959+0000","last_undegraded":"2024-09-10T08:28:46.494959+0000","last_fullsized":"2024-09-10T08:28:46.494959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475156+0000","last_change":"2024-09-10T08:28:45.485743+0000","last_active":"2024-09-10T08:28:46.475156+0000","last_peered":"2024-09-10T08:28:46.475156+0000","last_clean":"2024-09-10T08:28:46.475156+0000","last_became_active":"2024-09-10T08:28:45.485383+0000","last_became_peered":"2024-09-10T08:28:45.485383+0000","last_unstale":"2024-09-10T08:28:46.475156+0000","last_undegraded":"2024-09-10T08:28:46.475156+0000","last_fullsized":"2024-09-10T08:28:46.475156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494789+0000","last_change":"2024-09-10T08:28:45.477978+0000","last_active":"2024-09-10T08:28:46.494789+0000","last_peered":"2024-09-10T08:28:46.494789+0000","last_clean":"2024-09-10T08:28:46.494789+0000","last_became_active":"2024-09-10T08:28:45.477714+0000","last_became_peered":"2024-09-10T08:28:45.477714+0000","last_unstale":"2024-09-10T08:28:46.494789+0000","last_undegraded":"2024-09-10T08:28:46.494789+0000","last_fullsized":"2024-09-10T08:28:46.494789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587564+0000","last_change":"2024-09-10T08:28:45.502893+0000","last_active":"2024-09-10T08:28:46.587564+0000","last_peered":"2024-09-10T08:28:46.587564+0000","last_clean":"2024-09-10T08:28:46.587564+0000","last_became_active":"2024-09-10T08:28:45.501191+0000","last_became_peered":"2024-09-10T08:28:45.501191+0000","last_unstale":"2024-09-10T08:28:46.587564+0000","last_undegraded":"2024-09-10T08:28:46.587564+0000","last_fullsized":"2024-09-10T08:28:46.587564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495282+0000","last_change":"2024-09-10T08:28:45.475050+0000","last_active":"2024-09-10T08:28:46.495282+0000","last_peered":"2024-09-10T08:28:46.495282+0000","last_clean":"2024-09-10T08:28:46.495282+0000","last_became_active":"2024-09-10T08:28:45.474777+0000","last_became_peered":"2024-09-10T08:28:45.474777+0000","last_unstale":"2024-09-10T08:28:46.495282+0000","last_undegraded":"2024-09-10T08:28:46.495282+0000","last_fullsized":"2024-09-10T08:28:46.495282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:18.566505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495181+0000","last_change":"2024-09-10T08:28:45.507663+0000","last_active":"2024-09-10T08:28:46.495181+0000","last_peered":"2024-09-10T08:28:46.495181+0000","last_clean":"2024-09-10T08:28:46.495181+0000","last_became_active":"2024-09-10T08:28:45.507403+0000","last_became_peered":"2024-09-10T08:28:45.507403+0000","last_unstale":"2024-09-10T08:28:46.495181+0000","last_undegraded":"2024-09-10T08:28:46.495181+0000","last_fullsized":"2024-09-10T08:28:46.495181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:17.524518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495035+0000","last_change":"2024-09-10T08:28:45.478452+0000","last_active":"2024-09-10T08:28:46.495035+0000","last_peered":"2024-09-10T08:28:46.495035+0000","last_clean":"2024-09-10T08:28:46.495035+0000","last_became_active":"2024-09-10T08:28:45.477167+0000","last_became_peered":"2024-09-10T08:28:45.477167+0000","last_unstale":"2024-09-10T08:28:46.495035+0000","last_undegraded":"2024-09-10T08:28:46.495035+0000","last_fullsized":"2024-09-10T08:28:46.495035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587518+0000","last_change":"2024-09-10T08:28:45.477960+0000","last_active":"2024-09-10T08:28:46.587518+0000","last_peered":"2024-09-10T08:28:46.587518+0000","last_clean":"2024-09-10T08:28:46.587518+0000","last_became_active":"2024-09-10T08:28:45.477375+0000","last_became_peered":"2024-09-10T08:28:45.477375+0000","last_unstale":"2024-09-10T08:28:46.587518+0000","last_undegraded":"2024-09-10T08:28:46.587518+0000","last_fullsized":"2024-09-10T08:28:46.587518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:10.245108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587184+0000","last_change":"2024-09-10T08:28:45.483734+0000","last_active":"2024-09-10T08:28:46.587184+0000","last_peered":"2024-09-10T08:28:46.587184+0000","last_clean":"2024-09-10T08:28:46.587184+0000","last_became_active":"2024-09-10T08:28:45.483301+0000","last_became_peered":"2024-09-10T08:28:45.483301+0000","last_unstale":"2024-09-10T08:28:46.587184+0000","last_undegraded":"2024-09-10T08:28:46.587184+0000","last_fullsized":"2024-09-10T08:28:46.587184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475915+0000","last_change":"2024-09-10T08:28:45.494626+0000","last_active":"2024-09-10T08:28:46.475915+0000","last_peered":"2024-09-10T08:28:46.475915+0000","last_clean":"2024-09-10T08:28:46.475915+0000","last_became_active":"2024-09-10T08:28:45.494433+0000","last_became_peered":"2024-09-10T08:28:45.494433+0000","last_unstale":"2024-09-10T08:28:46.475915+0000","last_undegraded":"2024-09-10T08:28:46.475915+0000","last_fullsized":"2024-09-10T08:28:46.475915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476903+0000","last_change":"2024-09-10T08:28:45.504534+0000","last_active":"2024-09-10T08:28:46.476903+0000","last_peered":"2024-09-10T08:28:46.476903+0000","last_clean":"2024-09-10T08:28:46.476903+0000","last_became_active":"2024-09-10T08:28:45.504293+0000","last_became_peered":"2024-09-10T08:28:45.504293+0000","last_unstale":"2024-09-10T08:28:46.476903+0000","last_undegraded":"2024-09-10T08:28:46.476903+0000","last_fullsized":"2024-09-10T08:28:46.476903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:46.778411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476383+0000","last_change":"2024-09-10T08:28:45.481198+0000","last_active":"2024-09-10T08:28:46.476383+0000","last_peered":"2024-09-10T08:28:46.476383+0000","last_clean":"2024-09-10T08:28:46.476383+0000","last_became_active":"2024-09-10T08:28:45.480055+0000","last_became_peered":"2024-09-10T08:28:45.480055+0000","last_unstale":"2024-09-10T08:28:46.476383+0000","last_undegraded":"2024-09-10T08:28:46.476383+0000","last_fullsized":"2024-09-10T08:28:46.476383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:17.438395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476674+0000","last_change":"2024-09-10T08:28:45.492075+0000","last_active":"2024-09-10T08:28:46.476674+0000","last_peered":"2024-09-10T08:28:46.476674+0000","last_clean":"2024-09-10T08:28:46.476674+0000","last_became_active":"2024-09-10T08:28:45.491741+0000","last_became_peered":"2024-09-10T08:28:45.491741+0000","last_unstale":"2024-09-10T08:28:46.476674+0000","last_undegraded":"2024-09-10T08:28:46.476674+0000","last_fullsized":"2024-09-10T08:28:46.476674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:43.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495042+0000","last_change":"2024-09-10T08:28:45.478902+0000","last_active":"2024-09-10T08:28:46.495042+0000","last_peered":"2024-09-10T08:28:46.495042+0000","last_clean":"2024-09-10T08:28:46.495042+0000","last_became_active":"2024-09-10T08:28:45.475888+0000","last_became_peered":"2024-09-10T08:28:45.475888+0000","last_unstale":"2024-09-10T08:28:46.495042+0000","last_undegraded":"2024-09-10T08:28:46.495042+0000","last_fullsized":"2024-09-10T08:28:46.495042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491948+0000","last_change":"2024-09-10T08:28:45.478099+0000","last_active":"2024-09-10T08:28:46.491948+0000","last_peered":"2024-09-10T08:28:46.491948+0000","last_clean":"2024-09-10T08:28:46.491948+0000","last_became_active":"2024-09-10T08:28:45.477815+0000","last_became_peered":"2024-09-10T08:28:45.477815+0000","last_unstale":"2024-09-10T08:28:46.491948+0000","last_undegraded":"2024-09-10T08:28:46.491948+0000","last_fullsized":"2024-09-10T08:28:46.491948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587254+0000","last_change":"2024-09-10T08:28:45.488544+0000","last_active":"2024-09-10T08:28:46.587254+0000","last_peered":"2024-09-10T08:28:46.587254+0000","last_clean":"2024-09-10T08:28:46.587254+0000","last_became_active":"2024-09-10T08:28:45.485592+0000","last_became_peered":"2024-09-10T08:28:45.485592+0000","last_unstale":"2024-09-10T08:28:46.587254+0000","last_undegraded":"2024-09-10T08:28:46.587254+0000","last_fullsized":"2024-09-10T08:28:46.587254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475989+0000","last_change":"2024-09-10T08:28:45.490048+0000","last_active":"2024-09-10T08:28:46.475989+0000","last_peered":"2024-09-10T08:28:46.475989+0000","last_clean":"2024-09-10T08:28:46.475989+0000","last_became_active":"2024-09-10T08:28:45.489782+0000","last_became_peered":"2024-09-10T08:28:45.489782+0000","last_unstale":"2024-09-10T08:28:46.475989+0000","last_undegraded":"2024-09-10T08:28:46.475989+0000","last_fullsized":"2024-09-10T08:28:46.475989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475766+0000","last_change":"2024-09-10T08:28:45.500890+0000","last_active":"2024-09-10T08:28:46.475766+0000","last_peered":"2024-09-10T08:28:46.475766+0000","last_clean":"2024-09-10T08:28:46.475766+0000","last_became_active":"2024-09-10T08:28:45.500394+0000","last_became_peered":"2024-09-10T08:28:45.500394+0000","last_unstale":"2024-09-10T08:28:46.475766+0000","last_undegraded":"2024-09-10T08:28:46.475766+0000","last_fullsized":"2024-09-10T08:28:46.475766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587511+0000","last_change":"2024-09-10T08:28:45.485960+0000","last_active":"2024-09-10T08:28:46.587511+0000","last_peered":"2024-09-10T08:28:46.587511+0000","last_clean":"2024-09-10T08:28:46.587511+0000","last_became_active":"2024-09-10T08:28:45.485438+0000","last_became_peered":"2024-09-10T08:28:45.485438+0000","last_unstale":"2024-09-10T08:28:46.587511+0000","last_undegraded":"2024-09-10T08:28:46.587511+0000","last_fullsized":"2024-09-10T08:28:46.587511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:26.564059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587099+0000","last_change":"2024-09-10T08:28:45.487123+0000","last_active":"2024-09-10T08:28:46.587099+0000","last_peered":"2024-09-10T08:28:46.587099+0000","last_clean":"2024-09-10T08:28:46.587099+0000","last_became_active":"2024-09-10T08:28:45.486850+0000","last_became_peered":"2024-09-10T08:28:45.486850+0000","last_unstale":"2024-09-10T08:28:46.587099+0000","last_undegraded":"2024-09-10T08:28:46.587099+0000","last_fullsized":"2024-09-10T08:28:46.587099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476757+0000","last_change":"2024-09-10T08:28:45.490464+0000","last_active":"2024-09-10T08:28:46.476757+0000","last_peered":"2024-09-10T08:28:46.476757+0000","last_clean":"2024-09-10T08:28:46.476757+0000","last_became_active":"2024-09-10T08:28:45.490227+0000","last_became_peered":"2024-09-10T08:28:45.490227+0000","last_unstale":"2024-09-10T08:28:46.476757+0000","last_undegraded":"2024-09-10T08:28:46.476757+0000","last_fullsized":"2024-09-10T08:28:46.476757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:04.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476111+0000","last_change":"2024-09-10T08:28:45.474822+0000","last_active":"2024-09-10T08:28:46.476111+0000","last_peered":"2024-09-10T08:28:46.476111+0000","last_clean":"2024-09-10T08:28:46.476111+0000","last_became_active":"2024-09-10T08:28:45.474528+0000","last_became_peered":"2024-09-10T08:28:45.474528+0000","last_unstale":"2024-09-10T08:28:46.476111+0000","last_undegraded":"2024-09-10T08:28:46.476111+0000","last_fullsized":"2024-09-10T08:28:46.476111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:12.822933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.474975+0000","last_change":"2024-09-10T08:28:45.486413+0000","last_active":"2024-09-10T08:28:46.474975+0000","last_peered":"2024-09-10T08:28:46.474975+0000","last_clean":"2024-09-10T08:28:46.474975+0000","last_became_active":"2024-09-10T08:28:45.486145+0000","last_became_peered":"2024-09-10T08:28:45.486145+0000","last_unstale":"2024-09-10T08:28:46.474975+0000","last_undegraded":"2024-09-10T08:28:46.474975+0000","last_fullsized":"2024-09-10T08:28:46.474975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587269+0000","last_change":"2024-09-10T08:28:45.489031+0000","last_active":"2024-09-10T08:28:46.587269+0000","last_peered":"2024-09-10T08:28:46.587269+0000","last_clean":"2024-09-10T08:28:46.587269+0000","last_became_active":"2024-09-10T08:28:45.484546+0000","last_became_peered":"2024-09-10T08:28:45.484546+0000","last_unstale":"2024-09-10T08:28:46.587269+0000","last_undegraded":"2024-09-10T08:28:46.587269+0000","last_fullsized":"2024-09-10T08:28:46.587269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492039+0000","last_change":"2024-09-10T08:28:45.476390+0000","last_active":"2024-09-10T08:28:46.492039+0000","last_peered":"2024-09-10T08:28:46.492039+0000","last_clean":"2024-09-10T08:28:46.492039+0000","last_became_active":"2024-09-10T08:28:45.476112+0000","last_became_peered":"2024-09-10T08:28:45.476112+0000","last_unstale":"2024-09-10T08:28:46.492039+0000","last_undegraded":"2024-09-10T08:28:46.492039+0000","last_fullsized":"2024-09-10T08:28:46.492039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476535+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:46.476535+0000","last_peered":"2024-09-10T08:28:46.476535+0000","last_clean":"2024-09-10T08:28:46.476535+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:46.476535+0000","last_undegraded":"2024-09-10T08:28:46.476535+0000","last_fullsized":"2024-09-10T08:28:46.476535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586792+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:46.586792+0000","last_peered":"2024-09-10T08:28:46.586792+0000","last_clean":"2024-09-10T08:28:46.586792+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:46.586792+0000","last_undegraded":"2024-09-10T08:28:46.586792+0000","last_fullsized":"2024-09-10T08:28:46.586792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476011+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:46.476011+0000","last_peered":"2024-09-10T08:28:46.476011+0000","last_clean":"2024-09-10T08:28:46.476011+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:46.476011+0000","last_undegraded":"2024-09-10T08:28:46.476011+0000","last_fullsized":"2024-09-10T08:28:46.476011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492099+0000","last_change":"2024-09-10T08:28:45.474325+0000","last_active":"2024-09-10T08:28:46.492099+0000","last_peered":"2024-09-10T08:28:46.492099+0000","last_clean":"2024-09-10T08:28:46.492099+0000","last_became_active":"2024-09-10T08:28:45.472800+0000","last_became_peered":"2024-09-10T08:28:45.472800+0000","last_unstale":"2024-09-10T08:28:46.492099+0000","last_undegraded":"2024-09-10T08:28:46.492099+0000","last_fullsized":"2024-09-10T08:28:46.492099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587520+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:46.587520+0000","last_peered":"2024-09-10T08:28:46.587520+0000","last_clean":"2024-09-10T08:28:46.587520+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:46.587520+0000","last_undegraded":"2024-09-10T08:28:46.587520+0000","last_fullsized":"2024-09-10T08:28:46.587520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476000+0000","last_change":"2024-09-10T08:28:45.500677+0000","last_active":"2024-09-10T08:28:46.476000+0000","last_peered":"2024-09-10T08:28:46.476000+0000","last_clean":"2024-09-10T08:28:46.476000+0000","last_became_active":"2024-09-10T08:28:45.500018+0000","last_became_peered":"2024-09-10T08:28:45.500018+0000","last_unstale":"2024-09-10T08:28:46.476000+0000","last_undegraded":"2024-09-10T08:28:46.476000+0000","last_fullsized":"2024-09-10T08:28:46.476000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495320+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:46.495320+0000","last_peered":"2024-09-10T08:28:46.495320+0000","last_clean":"2024-09-10T08:28:46.495320+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:46.495320+0000","last_undegraded":"2024-09-10T08:28:46.495320+0000","last_fullsized":"2024-09-10T08:28:46.495320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476352+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:46.476352+0000","last_peered":"2024-09-10T08:28:46.476352+0000","last_clean":"2024-09-10T08:28:46.476352+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:46.476352+0000","last_undegraded":"2024-09-10T08:28:46.476352+0000","last_fullsized":"2024-09-10T08:28:46.476352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476424+0000","last_change":"2024-09-10T08:28:45.494242+0000","last_active":"2024-09-10T08:28:46.476424+0000","last_peered":"2024-09-10T08:28:46.476424+0000","last_clean":"2024-09-10T08:28:46.476424+0000","last_became_active":"2024-09-10T08:28:45.493862+0000","last_became_peered":"2024-09-10T08:28:45.493862+0000","last_unstale":"2024-09-10T08:28:46.476424+0000","last_undegraded":"2024-09-10T08:28:46.476424+0000","last_fullsized":"2024-09-10T08:28:46.476424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:07.008683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475570+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:46.475570+0000","last_peered":"2024-09-10T08:28:46.475570+0000","last_clean":"2024-09-10T08:28:46.475570+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:46.475570+0000","last_undegraded":"2024-09-10T08:28:46.475570+0000","last_fullsized":"2024-09-10T08:28:46.475570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495323+0000","last_change":"2024-09-10T08:28:45.486498+0000","last_active":"2024-09-10T08:28:46.495323+0000","last_peered":"2024-09-10T08:28:46.495323+0000","last_clean":"2024-09-10T08:28:46.495323+0000","last_became_active":"2024-09-10T08:28:45.486234+0000","last_became_peered":"2024-09-10T08:28:45.486234+0000","last_unstale":"2024-09-10T08:28:46.495323+0000","last_undegraded":"2024-09-10T08:28:46.495323+0000","last_fullsized":"2024-09-10T08:28:46.495323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476571+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:46.476571+0000","last_peered":"2024-09-10T08:28:46.476571+0000","last_clean":"2024-09-10T08:28:46.476571+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:46.476571+0000","last_undegraded":"2024-09-10T08:28:46.476571+0000","last_fullsized":"2024-09-10T08:28:46.476571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587068+0000","last_change":"2024-09-10T08:28:45.482539+0000","last_active":"2024-09-10T08:28:46.587068+0000","last_peered":"2024-09-10T08:28:46.587068+0000","last_clean":"2024-09-10T08:28:46.587068+0000","last_became_active":"2024-09-10T08:28:45.482187+0000","last_became_peered":"2024-09-10T08:28:45.482187+0000","last_unstale":"2024-09-10T08:28:46.587068+0000","last_undegraded":"2024-09-10T08:28:46.587068+0000","last_fullsized":"2024-09-10T08:28:46.587068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476642+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:46.476642+0000","last_peered":"2024-09-10T08:28:46.476642+0000","last_clean":"2024-09-10T08:28:46.476642+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:46.476642+0000","last_undegraded":"2024-09-10T08:28:46.476642+0000","last_fullsized":"2024-09-10T08:28:46.476642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476909+0000","last_change":"2024-09-10T08:28:45.487081+0000","last_active":"2024-09-10T08:28:46.476909+0000","last_peered":"2024-09-10T08:28:46.476909+0000","last_clean":"2024-09-10T08:28:46.476909+0000","last_became_active":"2024-09-10T08:28:45.482234+0000","last_became_peered":"2024-09-10T08:28:45.482234+0000","last_unstale":"2024-09-10T08:28:46.476909+0000","last_undegraded":"2024-09-10T08:28:46.476909+0000","last_fullsized":"2024-09-10T08:28:46.476909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:44.005147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494969+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:46.494969+0000","last_peered":"2024-09-10T08:28:46.494969+0000","last_clean":"2024-09-10T08:28:46.494969+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:46.494969+0000","last_undegraded":"2024-09-10T08:28:46.494969+0000","last_fullsized":"2024-09-10T08:28:46.494969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587115+0000","last_change":"2024-09-10T08:28:45.487663+0000","last_active":"2024-09-10T08:28:46.587115+0000","last_peered":"2024-09-10T08:28:46.587115+0000","last_clean":"2024-09-10T08:28:46.587115+0000","last_became_active":"2024-09-10T08:28:45.487375+0000","last_became_peered":"2024-09-10T08:28:45.487375+0000","last_unstale":"2024-09-10T08:28:46.587115+0000","last_undegraded":"2024-09-10T08:28:46.587115+0000","last_fullsized":"2024-09-10T08:28:46.587115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491724+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:46.491724+0000","last_peered":"2024-09-10T08:28:46.491724+0000","last_clean":"2024-09-10T08:28:46.491724+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:46.491724+0000","last_undegraded":"2024-09-10T08:28:46.491724+0000","last_fullsized":"2024-09-10T08:28:46.491724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475927+0000","last_change":"2024-09-10T08:28:45.497379+0000","last_active":"2024-09-10T08:28:46.475927+0000","last_peered":"2024-09-10T08:28:46.475927+0000","last_clean":"2024-09-10T08:28:46.475927+0000","last_became_active":"2024-09-10T08:28:45.494750+0000","last_became_peered":"2024-09-10T08:28:45.494750+0000","last_unstale":"2024-09-10T08:28:46.475927+0000","last_undegraded":"2024-09-10T08:28:46.475927+0000","last_fullsized":"2024-09-10T08:28:46.475927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495578+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:46.495578+0000","last_peered":"2024-09-10T08:28:46.495578+0000","last_clean":"2024-09-10T08:28:46.495578+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:46.495578+0000","last_undegraded":"2024-09-10T08:28:46.495578+0000","last_fullsized":"2024-09-10T08:28:46.495578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476148+0000","last_change":"2024-09-10T08:28:45.474379+0000","last_active":"2024-09-10T08:28:46.476148+0000","last_peered":"2024-09-10T08:28:46.476148+0000","last_clean":"2024-09-10T08:28:46.476148+0000","last_became_active":"2024-09-10T08:28:45.474059+0000","last_became_peered":"2024-09-10T08:28:45.474059+0000","last_unstale":"2024-09-10T08:28:46.476148+0000","last_undegraded":"2024-09-10T08:28:46.476148+0000","last_fullsized":"2024-09-10T08:28:46.476148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492219+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:46.492219+0000","last_peered":"2024-09-10T08:28:46.492219+0000","last_clean":"2024-09-10T08:28:46.492219+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:46.492219+0000","last_undegraded":"2024-09-10T08:28:46.492219+0000","last_fullsized":"2024-09-10T08:28:46.492219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495529+0000","last_change":"2024-09-10T08:28:45.474925+0000","last_active":"2024-09-10T08:28:46.495529+0000","last_peered":"2024-09-10T08:28:46.495529+0000","last_clean":"2024-09-10T08:28:46.495529+0000","last_became_active":"2024-09-10T08:28:45.474629+0000","last_became_peered":"2024-09-10T08:28:45.474629+0000","last_unstale":"2024-09-10T08:28:46.495529+0000","last_undegraded":"2024-09-10T08:28:46.495529+0000","last_fullsized":"2024-09-10T08:28:46.495529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495213+0000","last_change":"2024-09-10T08:28:45.480093+0000","last_active":"2024-09-10T08:28:46.495213+0000","last_peered":"2024-09-10T08:28:46.495213+0000","last_clean":"2024-09-10T08:28:46.495213+0000","last_became_active":"2024-09-10T08:28:45.479791+0000","last_became_peered":"2024-09-10T08:28:45.479791+0000","last_unstale":"2024-09-10T08:28:46.495213+0000","last_undegraded":"2024-09-10T08:28:46.495213+0000","last_fullsized":"2024-09-10T08:28:46.495213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.251795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587813+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:46.587813+0000","last_peered":"2024-09-10T08:28:46.587813+0000","last_clean":"2024-09-10T08:28:46.587813+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:46.587813+0000","last_undegraded":"2024-09-10T08:28:46.587813+0000","last_fullsized":"2024-09-10T08:28:46.587813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476639+0000","last_change":"2024-09-10T08:28:45.498356+0000","last_active":"2024-09-10T08:28:46.476639+0000","last_peered":"2024-09-10T08:28:46.476639+0000","last_clean":"2024-09-10T08:28:46.476639+0000","last_became_active":"2024-09-10T08:28:45.498050+0000","last_became_peered":"2024-09-10T08:28:45.498050+0000","last_unstale":"2024-09-10T08:28:46.476639+0000","last_undegraded":"2024-09-10T08:28:46.476639+0000","last_fullsized":"2024-09-10T08:28:46.476639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:44.474059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587209+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:46.587209+0000","last_peered":"2024-09-10T08:28:46.587209+0000","last_clean":"2024-09-10T08:28:46.587209+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:46.587209+0000","last_undegraded":"2024-09-10T08:28:46.587209+0000","last_fullsized":"2024-09-10T08:28:46.587209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477118+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:46.477118+0000","last_peered":"2024-09-10T08:28:46.477118+0000","last_clean":"2024-09-10T08:28:46.477118+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:46.477118+0000","last_undegraded":"2024-09-10T08:28:46.477118+0000","last_fullsized":"2024-09-10T08:28:46.477118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:41.681095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491913+0000","last_change":"2024-09-10T08:28:45.473182+0000","last_active":"2024-09-10T08:28:46.491913+0000","last_peered":"2024-09-10T08:28:46.491913+0000","last_clean":"2024-09-10T08:28:46.491913+0000","last_became_active":"2024-09-10T08:28:45.472864+0000","last_became_peered":"2024-09-10T08:28:45.472864+0000","last_unstale":"2024-09-10T08:28:46.491913+0000","last_undegraded":"2024-09-10T08:28:46.491913+0000","last_fullsized":"2024-09-10T08:28:46.491913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:56.237650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476087+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:46.476087+0000","last_peered":"2024-09-10T08:28:46.476087+0000","last_clean":"2024-09-10T08:28:46.476087+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:46.476087+0000","last_undegraded":"2024-09-10T08:28:46.476087+0000","last_fullsized":"2024-09-10T08:28:46.476087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586884+0000","last_change":"2024-09-10T08:28:45.483743+0000","last_active":"2024-09-10T08:28:46.586884+0000","last_peered":"2024-09-10T08:28:46.586884+0000","last_clean":"2024-09-10T08:28:46.586884+0000","last_became_active":"2024-09-10T08:28:45.483380+0000","last_became_peered":"2024-09-10T08:28:45.483380+0000","last_unstale":"2024-09-10T08:28:46.586884+0000","last_undegraded":"2024-09-10T08:28:46.586884+0000","last_fullsized":"2024-09-10T08:28:46.586884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476025+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:46.476025+0000","last_peered":"2024-09-10T08:28:46.476025+0000","last_clean":"2024-09-10T08:28:46.476025+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:46.476025+0000","last_undegraded":"2024-09-10T08:28:46.476025+0000","last_fullsized":"2024-09-10T08:28:46.476025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476741+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:46.476741+0000","last_peered":"2024-09-10T08:28:46.476741+0000","last_clean":"2024-09-10T08:28:46.476741+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:46.476741+0000","last_undegraded":"2024-09-10T08:28:46.476741+0000","last_fullsized":"2024-09-10T08:28:46.476741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:09.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495127+0000","last_change":"2024-09-10T08:28:45.473303+0000","last_active":"2024-09-10T08:28:46.495127+0000","last_peered":"2024-09-10T08:28:46.495127+0000","last_clean":"2024-09-10T08:28:46.495127+0000","last_became_active":"2024-09-10T08:28:45.473012+0000","last_became_peered":"2024-09-10T08:28:45.473012+0000","last_unstale":"2024-09-10T08:28:46.495127+0000","last_undegraded":"2024-09-10T08:28:46.495127+0000","last_fullsized":"2024-09-10T08:28:46.495127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475344+0000","last_change":"2024-09-10T08:28:45.496343+0000","last_active":"2024-09-10T08:28:46.475344+0000","last_peered":"2024-09-10T08:28:46.475344+0000","last_clean":"2024-09-10T08:28:46.475344+0000","last_became_active":"2024-09-10T08:28:45.495838+0000","last_became_peered":"2024-09-10T08:28:45.495838+0000","last_unstale":"2024-09-10T08:28:46.475344+0000","last_undegraded":"2024-09-10T08:28:46.475344+0000","last_fullsized":"2024-09-10T08:28:46.475344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476696+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:46.476696+0000","last_peered":"2024-09-10T08:28:46.476696+0000","last_clean":"2024-09-10T08:28:46.476696+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:46.476696+0000","last_undegraded":"2024-09-10T08:28:46.476696+0000","last_fullsized":"2024-09-10T08:28:46.476696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:25.557353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587711+0000","last_change":"2024-09-10T08:28:45.485170+0000","last_active":"2024-09-10T08:28:46.587711+0000","last_peered":"2024-09-10T08:28:46.587711+0000","last_clean":"2024-09-10T08:28:46.587711+0000","last_became_active":"2024-09-10T08:28:45.484866+0000","last_became_peered":"2024-09-10T08:28:45.484866+0000","last_unstale":"2024-09-10T08:28:46.587711+0000","last_undegraded":"2024-09-10T08:28:46.587711+0000","last_fullsized":"2024-09-10T08:28:46.587711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:09.096890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492375+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:46.492375+0000","last_peered":"2024-09-10T08:28:46.492375+0000","last_clean":"2024-09-10T08:28:46.492375+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:46.492375+0000","last_undegraded":"2024-09-10T08:28:46.492375+0000","last_fullsized":"2024-09-10T08:28:46.492375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492290+0000","last_change":"2024-09-10T08:28:45.486103+0000","last_active":"2024-09-10T08:28:46.492290+0000","last_peered":"2024-09-10T08:28:46.492290+0000","last_clean":"2024-09-10T08:28:46.492290+0000","last_became_active":"2024-09-10T08:28:45.485815+0000","last_became_peered":"2024-09-10T08:28:45.485815+0000","last_unstale":"2024-09-10T08:28:46.492290+0000","last_undegraded":"2024-09-10T08:28:46.492290+0000","last_fullsized":"2024-09-10T08:28:46.492290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476929+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:46.476929+0000","last_peered":"2024-09-10T08:28:46.476929+0000","last_clean":"2024-09-10T08:28:46.476929+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:46.476929+0000","last_undegraded":"2024-09-10T08:28:46.476929+0000","last_fullsized":"2024-09-10T08:28:46.476929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:06.800613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492233+0000","last_change":"2024-09-10T08:28:45.489780+0000","last_active":"2024-09-10T08:28:46.492233+0000","last_peered":"2024-09-10T08:28:46.492233+0000","last_clean":"2024-09-10T08:28:46.492233+0000","last_became_active":"2024-09-10T08:28:45.487680+0000","last_became_peered":"2024-09-10T08:28:45.487680+0000","last_unstale":"2024-09-10T08:28:46.492233+0000","last_undegraded":"2024-09-10T08:28:46.492233+0000","last_fullsized":"2024-09-10T08:28:46.492233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494602+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:46.494602+0000","last_peered":"2024-09-10T08:28:46.494602+0000","last_clean":"2024-09-10T08:28:46.494602+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:46.494602+0000","last_undegraded":"2024-09-10T08:28:46.494602+0000","last_fullsized":"2024-09-10T08:28:46.494602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476096+0000","last_change":"2024-09-10T08:28:45.495819+0000","last_active":"2024-09-10T08:28:46.476096+0000","last_peered":"2024-09-10T08:28:46.476096+0000","last_clean":"2024-09-10T08:28:46.476096+0000","last_became_active":"2024-09-10T08:28:45.493467+0000","last_became_peered":"2024-09-10T08:28:45.493467+0000","last_unstale":"2024-09-10T08:28:46.476096+0000","last_undegraded":"2024-09-10T08:28:46.476096+0000","last_fullsized":"2024-09-10T08:28:46.476096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:39.629101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492054+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:46.492054+0000","last_peered":"2024-09-10T08:28:46.492054+0000","last_clean":"2024-09-10T08:28:46.492054+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:46.492054+0000","last_undegraded":"2024-09-10T08:28:46.492054+0000","last_fullsized":"2024-09-10T08:28:46.492054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491845+0000","last_change":"2024-09-10T08:28:45.486692+0000","last_active":"2024-09-10T08:28:46.491845+0000","last_peered":"2024-09-10T08:28:46.491845+0000","last_clean":"2024-09-10T08:28:46.491845+0000","last_became_active":"2024-09-10T08:28:45.486384+0000","last_became_peered":"2024-09-10T08:28:45.486384+0000","last_unstale":"2024-09-10T08:28:46.491845+0000","last_undegraded":"2024-09-10T08:28:46.491845+0000","last_fullsized":"2024-09-10T08:28:46.491845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.807320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587173+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:46.587173+0000","last_peered":"2024-09-10T08:28:46.587173+0000","last_clean":"2024-09-10T08:28:46.587173+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:46.587173+0000","last_undegraded":"2024-09-10T08:28:46.587173+0000","last_fullsized":"2024-09-10T08:28:46.587173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476507+0000","last_change":"2024-09-10T08:28:45.486876+0000","last_active":"2024-09-10T08:28:46.476507+0000","last_peered":"2024-09-10T08:28:46.476507+0000","last_clean":"2024-09-10T08:28:46.476507+0000","last_became_active":"2024-09-10T08:28:45.486594+0000","last_became_peered":"2024-09-10T08:28:45.486594+0000","last_unstale":"2024-09-10T08:28:46.476507+0000","last_undegraded":"2024-09-10T08:28:46.476507+0000","last_fullsized":"2024-09-10T08:28:46.476507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477005+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:46.477005+0000","last_peered":"2024-09-10T08:28:46.477005+0000","last_clean":"2024-09-10T08:28:46.477005+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:46.477005+0000","last_undegraded":"2024-09-10T08:28:46.477005+0000","last_fullsized":"2024-09-10T08:28:46.477005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:33.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476431+0000","last_change":"2024-09-10T08:28:45.498396+0000","last_active":"2024-09-10T08:28:46.476431+0000","last_peered":"2024-09-10T08:28:46.476431+0000","last_clean":"2024-09-10T08:28:46.476431+0000","last_became_active":"2024-09-10T08:28:45.498155+0000","last_became_peered":"2024-09-10T08:28:45.498155+0000","last_unstale":"2024-09-10T08:28:46.476431+0000","last_undegraded":"2024-09-10T08:28:46.476431+0000","last_fullsized":"2024-09-10T08:28:46.476431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:14.869919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476523+0000","last_change":"2024-09-10T08:28:45.489899+0000","last_active":"2024-09-10T08:28:46.476523+0000","last_peered":"2024-09-10T08:28:46.476523+0000","last_clean":"2024-09-10T08:28:46.476523+0000","last_became_active":"2024-09-10T08:28:45.489475+0000","last_became_peered":"2024-09-10T08:28:45.489475+0000","last_unstale":"2024-09-10T08:28:46.476523+0000","last_undegraded":"2024-09-10T08:28:46.476523+0000","last_fullsized":"2024-09-10T08:28:46.476523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:31.730082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495257+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:46.495257+0000","last_peered":"2024-09-10T08:28:46.495257+0000","last_clean":"2024-09-10T08:28:46.495257+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:46.495257+0000","last_undegraded":"2024-09-10T08:28:46.495257+0000","last_fullsized":"2024-09-10T08:28:46.495257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587327+0000","last_change":"2024-09-10T08:28:45.490936+0000","last_active":"2024-09-10T08:28:46.587327+0000","last_peered":"2024-09-10T08:28:46.587327+0000","last_clean":"2024-09-10T08:28:46.587327+0000","last_became_active":"2024-09-10T08:28:45.490450+0000","last_became_peered":"2024-09-10T08:28:45.490450+0000","last_unstale":"2024-09-10T08:28:46.587327+0000","last_undegraded":"2024-09-10T08:28:46.587327+0000","last_fullsized":"2024-09-10T08:28:46.587327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495301+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:46.495301+0000","last_peered":"2024-09-10T08:28:46.495301+0000","last_clean":"2024-09-10T08:28:46.495301+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:46.495301+0000","last_undegraded":"2024-09-10T08:28:46.495301+0000","last_fullsized":"2024-09-10T08:28:46.495301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492316+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:46.492316+0000","last_peered":"2024-09-10T08:28:46.492316+0000","last_clean":"2024-09-10T08:28:46.492316+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:46.492316+0000","last_undegraded":"2024-09-10T08:28:46.492316+0000","last_fullsized":"2024-09-10T08:28:46.492316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":78568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":666722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:54.783 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:28:54.783 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T08:28:54.783 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T08:28:54.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T08:28:54.784 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T08:28:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.975+0000 7fa1fbe00640 1 Processor -- start 2024-09-10T08:28:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.975+0000 7fa1fbe00640 1 -- start start 2024-09-10T08:28:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.976+0000 7fa1fbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.976+0000 7fa1fbe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.976+0000 7fa1fbe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0d3990 con 0x7fa1fc0b6540 2024-09-10T08:28:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.976+0000 7fa1fbe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa1fc0b69b0 con 0x7fa1fc0cf450 2024-09-10T08:28:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.976+0000 7fa1fbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc0d3c70 con 0x7fa1fc15e440 2024-09-10T08:28:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1fa000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1fa000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41652/0 (socket says 172.21.15.52:41652) 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1fa000640 1 -- 172.21.15.52:0/190947987 learned_addr learned my addr 172.21.15.52:0/190947987 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:52902/0 (socket says 172.21.15.52:52902) 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1fb400640 1 --1- 172.21.15.52:0/190947987 >> v1:172.21.15.176:6789/0 conn(0x7fa1fc0b6540 0x7fa1fc06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59234/0 (socket says 172.21.15.52:59234) 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1f9600640 1 -- 172.21.15.52:0/190947987 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806249790 0 0) 0x7fa1fc0d3990 con 0x7fa1fc0b6540 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 -- 172.21.15.52:0/190947987 >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 msgr2=0x7fa1fc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 --2- 172.21.15.52:0/190947987 >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 -- 172.21.15.52:0/190947987 >> v1:172.21.15.176:6789/0 conn(0x7fa1fc0b6540 legacy=0x7fa1fc06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1faa00640 1 -- 172.21.15.52:0/190947987 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc0d3f50 con 0x7fa1fc15e440 2024-09-10T08:28:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.977+0000 7fa1fa000640 1 --2- 172.21.15.52:0/190947987 >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.978+0000 7fa1faa00640 1 --2- 172.21.15.52:0/190947987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0097a0 tx=0x7fa1ec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a336d0f33ac773d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1f9600640 1 -- 172.21.15.52:0/190947987 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec037070 con 0x7fa1fc15e440 2024-09-10T08:28:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1f9600640 1 -- 172.21.15.52:0/190947987 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec032440 con 0x7fa1fc15e440 2024-09-10T08:28:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1f9600640 1 -- 172.21.15.52:0/190947987 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec032810 con 0x7fa1fc15e440 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 -- 172.21.15.52:0/190947987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 msgr2=0x7fa1fc0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/190947987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0097a0 tx=0x7fa1ec02a210 comp rx=0 tx=0).stop 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 -- 172.21.15.52:0/190947987 shutdown_connections 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/190947987 >> v2:172.21.15.176:3300/0 conn(0x7fa1fc0cf450 0x7fa1fc0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/190947987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc15e440 0x7fa1fc0d3240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 -- 172.21.15.52:0/190947987 >> 172.21.15.52:0/190947987 conn(0x7fa1fc067f80 msgr2=0x7fa1fc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 -- 172.21.15.52:0/190947987 shutdown_connections 2024-09-10T08:28:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.979+0000 7fa1fbe00640 1 -- 172.21.15.52:0/190947987 wait complete. 2024-09-10T08:28:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.981+0000 7fa1fbe00640 1 Processor -- start 2024-09-10T08:28:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.981+0000 7fa1fbe00640 1 -- start start 2024-09-10T08:28:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc0b6540 0x7fa1fc157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc0cf450 0x7fa1fc0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0b7540 con 0x7fa1fc15e440 2024-09-10T08:28:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc15e820 con 0x7fa1fc0cf450 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc0b76c0 con 0x7fa1fc0b6540 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45332/0 (socket says 172.21.15.52:45332) 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fb400640 1 -- 172.21.15.52:0/3430456342 learned_addr learned my addr 172.21.15.52:0/3430456342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1fa000640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc0cf450 0x7fa1fc0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.982+0000 7fa1faa00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc0b6540 0x7fa1fc157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 -- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc0b6540 msgr2=0x7fa1fc157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc0b6540 0x7fa1fc157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 -- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc0cf450 msgr2=0x7fa1fc0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc0cf450 0x7fa1fc0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 -- 172.21.15.52:0/3430456342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc160890 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fb400640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c7a0 tx=0x7fa1f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4018070 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f400a640 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400aab0 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.983+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc160b70 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.984+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc161130 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.985+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc0b6000 con 0x7fa1fc15e440 2024-09-10T08:28:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.985+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1f400ac50 con 0x7fa1fc15e440 2024-09-10T08:28:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.986+0000 7fa1f2a00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.986+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f408a520 con 0x7fa1fc15e440 2024-09-10T08:28:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.987+0000 7fa1faa00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.987+0000 7fa1faa00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:54.990+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1f40587e0 con 0x7fa1fc15e440 2024-09-10T08:28:55.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.224+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa1fc0b8010 con 0x7fa1fc15e440 2024-09-10T08:28:55.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.228+0000 7fa1f2a00640 1 -- 172.21.15.52:0/3430456342 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172946 (secure 0 0 0) 0x7fa1f405cae0 con 0x7fa1fc15e440 2024-09-10T08:28:55.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 msgr2=0x7fa1dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 msgr2=0x7fa1fc0ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c7a0 tx=0x7fa1f400cc60 comp rx=0 tx=0).stop 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 shutdown_connections 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1fc15e440 0x7fa1fc0ca780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1fc0cf450 0x7fa1fc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 --2- 172.21.15.52:0/3430456342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1fc0b6540 0x7fa1fc157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 >> 172.21.15.52:0/3430456342 conn(0x7fa1fc067f80 msgr2=0x7fa1fc0b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:55.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 shutdown_connections 2024-09-10T08:28:55.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.231+0000 7fa1fbe00640 1 -- 172.21.15.52:0/3430456342 wait complete. 2024-09-10T08:28:55.247 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1001247372},{"type":"v1","addr":"172.21.15.176:6801","nonce":1001247372}]},"active_addr":"172.21.15.176:6801/1001247372","active_change":"2024-09-10T08:28:25.440137+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3586425235}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":2899530258}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3738704805}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.176:0","nonce":3264979841}]}]} 2024-09-10T08:28:55.251 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T08:28:55.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T08:28:55.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.407+0000 7f9985c00640 1 Processor -- start 2024-09-10T08:28:55.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.408+0000 7f9985c00640 1 -- start start 2024-09-10T08:28:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9985c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99800b2d40 0x7f998006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9985c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f998013eb20 0x7f998006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9985c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980071180 con 0x7f998015bcf0 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9985c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f998015c890 con 0x7f99800b2d40 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9985c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9980071ab0 con 0x7f998013eb20 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99800b2d40 0x7f998006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99800b2d40 0x7f998006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45340/0 (socket says 172.21.15.52:45340) 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 -- 172.21.15.52:0/3670356247 learned_addr learned my addr 172.21.15.52:0/3670356247 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f9977e00640 1 --2- 172.21.15.52:0/3670356247 >> v2:172.21.15.176:3300/0 conn(0x7f998013eb20 0x7f998006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 -- 172.21.15.52:0/3670356247 >> v2:172.21.15.176:3300/0 conn(0x7f998013eb20 msgr2=0x7f998006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 --2- 172.21.15.52:0/3670356247 >> v2:172.21.15.176:3300/0 conn(0x7f998013eb20 0x7f998006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 -- 172.21.15.52:0/3670356247 >> v1:172.21.15.176:6789/0 conn(0x7f998015bcf0 legacy=0x7f998015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:55.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.409+0000 7f997ea00640 1 -- 172.21.15.52:0/3670356247 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980071460 con 0x7f99800b2d40 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.410+0000 7f997ea00640 1 --2- 172.21.15.52:0/3670356247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998006bc10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99800d1500 tx=0x7f997002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b145507db67f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f997e000640 1 -- 172.21.15.52:0/3670356247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970037070 con 0x7f99800b2d40 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f997e000640 1 -- 172.21.15.52:0/3670356247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9970032440 con 0x7f99800b2d40 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f997e000640 1 -- 172.21.15.52:0/3670356247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970032810 con 0x7f99800b2d40 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 -- 172.21.15.52:0/3670356247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 msgr2=0x7f998006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 --2- 172.21.15.52:0/3670356247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998006bc10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99800d1500 tx=0x7f997002a230 comp rx=0 tx=0).stop 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 -- 172.21.15.52:0/3670356247 shutdown_connections 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 --2- 172.21.15.52:0/3670356247 >> v2:172.21.15.176:3300/0 conn(0x7f998013eb20 0x7f998006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 --2- 172.21.15.52:0/3670356247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998006bc10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 -- 172.21.15.52:0/3670356247 >> 172.21.15.52:0/3670356247 conn(0x7f99800ccec0 msgr2=0x7f99800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 -- 172.21.15.52:0/3670356247 shutdown_connections 2024-09-10T08:28:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.411+0000 7f9985c00640 1 -- 172.21.15.52:0/3670356247 wait complete. 2024-09-10T08:28:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.413+0000 7f9985c00640 1 Processor -- start 2024-09-10T08:28:55.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.413+0000 7f9985c00640 1 -- start start 2024-09-10T08:28:55.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998013eb20 0x7f9980154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998015bcf0 0x7f9980154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99800720c0 con 0x7f99800b2d40 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9980071f40 con 0x7f998015bcf0 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9985c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9980072240 con 0x7f998013eb20 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f997ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f997ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45350/0 (socket says 172.21.15.52:45350) 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f997ea00640 1 -- 172.21.15.52:0/110286225 learned_addr learned my addr 172.21.15.52:0/110286225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f9977e00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998013eb20 0x7f9980154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.414+0000 7f997f400640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998015bcf0 0x7f9980154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 -- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998013eb20 msgr2=0x7f9980154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998013eb20 0x7f9980154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 -- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998015bcf0 msgr2=0x7f9980154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998015bcf0 0x7f9980154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 -- 172.21.15.52:0/110286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998013b3b0 con 0x7f99800b2d40 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f997ea00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f99700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970041020 con 0x7f99800b2d40 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99700306c0 con 0x7f99800b2d40 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998013b690 con 0x7f99800b2d40 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970037040 con 0x7f99800b2d40 2024-09-10T08:28:55.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.415+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f998013bc50 con 0x7f99800b2d40 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.416+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998015c180 con 0x7f99800b2d40 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.417+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9970044020 con 0x7f99800b2d40 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.418+0000 7f9976a00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 0x7f995c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.418+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f99700ab680 con 0x7f99800b2d40 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.418+0000 7f9977e00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 0x7f995c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.419+0000 7f9977e00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 0x7f995c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9980167f90 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.423+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f997004b030 con 0x7f99800b2d40 2024-09-10T08:28:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.610+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9980140830 con 0x7f99800b2d40 2024-09-10T08:28:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.611+0000 7f9976a00640 1 -- 172.21.15.52:0/110286225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7f997007a030 con 0x7f99800b2d40 2024-09-10T08:28:55.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:55.612 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 msgr2=0x7f995c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 0x7f995c06e320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9980167f90 tx=0x7f9968008040 comp rx=0 tx=0).stop 2024-09-10T08:28:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 msgr2=0x7f998013dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f99700046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 shutdown_connections 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f995c06be60 0x7f995c06e320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f998015bcf0 0x7f9980154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f998013eb20 0x7f9980154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 --2- 172.21.15.52:0/110286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99800b2d40 0x7f998013dde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 >> 172.21.15.52:0/110286225 conn(0x7f99800ccec0 msgr2=0x7f998013faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 shutdown_connections 2024-09-10T08:28:55.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.614+0000 7f9985c00640 1 -- 172.21.15.52:0/110286225 wait complete. 2024-09-10T08:28:55.630 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T08:28:55.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:28:55.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.786+0000 7fb918000640 1 Processor -- start 2024-09-10T08:28:55.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.786+0000 7fb918000640 1 -- start start 2024-09-10T08:28:55.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.787+0000 7fb918000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb91006c320 0x7fb91015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.787+0000 7fb918000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb91015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb918000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb910071180 con 0x7fb9100b2d40 2024-09-10T08:28:55.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb918000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb910071ab0 con 0x7fb91006c320 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb918000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb910071460 con 0x7fb91013eb20 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb914c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb91006c320 0x7fb91015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb915600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb9100b2d40 0x7fb91006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48218/0 (socket says 172.21.15.52:48218) 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb915600640 1 -- 172.21.15.52:0/326875070 learned_addr learned my addr 172.21.15.52:0/326875070 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb916000640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb91015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb914c00640 1 -- 172.21.15.52:0/326875070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 msgr2=0x7fb91015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb914c00640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb91015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb914c00640 1 -- 172.21.15.52:0/326875070 >> v1:172.21.15.52:6789/0 conn(0x7fb9100b2d40 legacy=0x7fb91006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb914c00640 1 -- 172.21.15.52:0/326875070 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb910071740 con 0x7fb91006c320 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb90fe00640 1 -- 172.21.15.52:0/326875070 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190342968 0 0) 0x7fb910071180 con 0x7fb9100b2d40 2024-09-10T08:28:55.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.788+0000 7fb916000640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb91015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.789+0000 7fb914c00640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91006c320 0x7fb91015bcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0097a0 tx=0x7fb8fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e0a114835f6bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.789+0000 7fb90fe00640 1 -- 172.21.15.52:0/326875070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc037070 con 0x7fb91006c320 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.789+0000 7fb90fe00640 1 -- 172.21.15.52:0/326875070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc032440 con 0x7fb91006c320 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.789+0000 7fb90fe00640 1 -- 172.21.15.52:0/326875070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc032810 con 0x7fb91006c320 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 -- 172.21.15.52:0/326875070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91006c320 msgr2=0x7fb91015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91006c320 0x7fb91015bcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0097a0 tx=0x7fb8fc02a180 comp rx=0 tx=0).stop 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 -- 172.21.15.52:0/326875070 shutdown_connections 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb91015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 --2- 172.21.15.52:0/326875070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb91006c320 0x7fb91015bcf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 -- 172.21.15.52:0/326875070 >> 172.21.15.52:0/326875070 conn(0x7fb9100ccec0 msgr2=0x7fb9100cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 -- 172.21.15.52:0/326875070 shutdown_connections 2024-09-10T08:28:55.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.790+0000 7fb918000640 1 -- 172.21.15.52:0/326875070 wait complete. 2024-09-10T08:28:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.792+0000 7fb918000640 1 Processor -- start 2024-09-10T08:28:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.792+0000 7fb918000640 1 -- start start 2024-09-10T08:28:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb91006c320 0x7fb91013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb9100c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100720c0 con 0x7fb9100b2d40 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb910071f40 con 0x7fb91006c320 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb918000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb910072240 con 0x7fb91013eb20 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45358/0 (socket says 172.21.15.52:45358) 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 -- 172.21.15.52:0/489420755 learned_addr learned my addr 172.21.15.52:0/489420755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 -- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 msgr2=0x7fb9100c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb9100c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 -- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb91006c320 msgr2=0x7fb91013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb91006c320 0x7fb91013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.793+0000 7fb914c00640 1 -- 172.21.15.52:0/489420755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100c5920 con 0x7fb9100b2d40 2024-09-10T08:28:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb914c00640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc035040 tx=0x7fb8fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc037040 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc030770 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc030b40 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9100c5bc0 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.794+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9100c6180 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.795+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb91006bc10 con 0x7fb9100b2d40 2024-09-10T08:28:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.796+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8fc044020 con 0x7fb9100b2d40 2024-09-10T08:28:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.797+0000 7fb90d600640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 0x7fb8f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.797+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb8fc0ab440 con 0x7fb9100b2d40 2024-09-10T08:28:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.797+0000 7fb915600640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 0x7fb8f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.798+0000 7fb915600640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 0x7fb8f006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb904007fd0 tx=0x7fb904007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.801+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8fc032e20 con 0x7fb9100b2d40 2024-09-10T08:28:55.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.987+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9100739c0 con 0x7fb9100b2d40 2024-09-10T08:28:55.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.988+0000 7fb90d600640 1 -- 172.21.15.52:0/489420755 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7fb8fc079d50 con 0x7fb9100b2d40 2024-09-10T08:28:55.989 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:55.989 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 msgr2=0x7fb8f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 0x7fb8f006e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb904007fd0 tx=0x7fb904007920 comp rx=0 tx=0).stop 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 msgr2=0x7fb9100c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc035040 tx=0x7fb8fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 shutdown_connections 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8f006be30 0x7fb8f006e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb91013eb20 0x7fb9100c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9100b2d40 0x7fb9100c6c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 --2- 172.21.15.52:0/489420755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb91006c320 0x7fb91013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:55.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.990+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 >> 172.21.15.52:0/489420755 conn(0x7fb9100ccec0 msgr2=0x7fb910157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:55.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.991+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 shutdown_connections 2024-09-10T08:28:55.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:55.991+0000 7fb918000640 1 -- 172.21.15.52:0/489420755 wait complete. 2024-09-10T08:28:56.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T08:28:56.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T08:28:56.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T08:28:56.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T08:28:56.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T08:28:56.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T08:28:56.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T08:28:56.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T08:28:56.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.280+0000 7f562cc00640 1 Processor -- start 2024-09-10T08:28:56.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.280+0000 7f562cc00640 1 -- start start 2024-09-10T08:28:56.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.282+0000 7f562cc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5628147570 0x7f56280b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.282+0000 7f562cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.282+0000 7f562cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 0x7f56280b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f562cc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5628147950 con 0x7f562806e8c0 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f562cc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f56280b5ed0 con 0x7f5628147570 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f562cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56280b61b0 con 0x7f56280b59c0 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f5626a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f5626a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:52970/0 (socket says 172.21.15.52:52970) 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f5626a00640 1 -- 172.21.15.52:0/2211213466 learned_addr learned my addr 172.21.15.52:0/2211213466 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.283+0000 7f5627e00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 0x7f56280b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.284+0000 7f5627400640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.176:3300/0 conn(0x7f5628147570 0x7f56280b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.284+0000 7f5626a00640 1 -- 172.21.15.52:0/2211213466 >> v2:172.21.15.176:3300/0 conn(0x7f5628147570 msgr2=0x7f56280b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.284+0000 7f5626a00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.176:3300/0 conn(0x7f5628147570 0x7f56280b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.284+0000 7f5626a00640 1 -- 172.21.15.52:0/2211213466 >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 msgr2=0x7f56280b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.284+0000 7f3182800640 1 Processor -- start 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.285+0000 7f5626a00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 0x7f56280b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.285+0000 7f5626a00640 1 -- 172.21.15.52:0/2211213466 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56280b6490 con 0x7f56280b59c0 2024-09-10T08:28:56.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.285+0000 7f5627e00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 0x7f56280b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.286+0000 7f6f69a00640 1 Processor -- start 2024-09-10T08:28:56.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.286+0000 7f6f69a00640 1 -- start start 2024-09-10T08:28:56.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.285+0000 7f3182800640 1 -- start start 2024-09-10T08:28:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.286+0000 7f5626a00640 1 --2- 172.21.15.52:0/2211213466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56280730f0 tx=0x7f561802a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e780d988da937a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.287+0000 7f3182800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.287+0000 7f5626000640 1 -- 172.21.15.52:0/2211213466 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618037070 con 0x7f56280b59c0 2024-09-10T08:28:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.287+0000 7f5626000640 1 -- 172.21.15.52:0/2211213466 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5618032440 con 0x7f56280b59c0 2024-09-10T08:28:56.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.287+0000 7f5626000640 1 -- 172.21.15.52:0/2211213466 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618032850 con 0x7f56280b59c0 2024-09-10T08:28:56.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.287+0000 7f3182800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3174057400 0x7f3174052ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3182800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31740516f0 con 0x7f31740524b0 2024-09-10T08:28:56.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3182800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3174052020 con 0x7f3174057400 2024-09-10T08:28:56.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3182800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31740519d0 con 0x7f31740e1860 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3181400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3181400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:52978/0 (socket says 172.21.15.52:52978) 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f3181400640 1 -- 172.21.15.52:0/1031915002 learned_addr learned my addr 172.21.15.52:0/1031915002 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f3180a00640 1 --2- 172.21.15.52:0/1031915002 >> v2:172.21.15.52:3300/0 conn(0x7f3174057400 0x7f3174052ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f3181400640 1 -- 172.21.15.52:0/1031915002 >> v2:172.21.15.52:3300/0 conn(0x7f3174057400 msgr2=0x7f3174052ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f3181400640 1 --2- 172.21.15.52:0/1031915002 >> v2:172.21.15.52:3300/0 conn(0x7f3174057400 0x7f3174052ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f3181400640 1 -- 172.21.15.52:0/1031915002 >> v1:172.21.15.52:6789/0 conn(0x7f31740524b0 legacy=0x7f31740e4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f3181400640 1 -- 172.21.15.52:0/1031915002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3174051cb0 con 0x7f31740e1860 2024-09-10T08:28:56.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 -- 172.21.15.52:0/2211213466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 msgr2=0x7f562806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 --2- 172.21.15.52:0/2211213466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56280730f0 tx=0x7f561802a160 comp rx=0 tx=0).stop 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f3181400640 1 --2- 172.21.15.52:0/1031915002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3168009870 tx=0x7f316802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed6ad5744c45044 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 -- 172.21.15.52:0/2211213466 shutdown_connections 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.52:3300/0 conn(0x7f562806e8c0 0x7f56280b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 --2- 172.21.15.52:0/2211213466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56280b59c0 0x7f562806e380 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 --2- 172.21.15.52:0/2211213466 >> v2:172.21.15.176:3300/0 conn(0x7f5628147570 0x7f56280b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.291+0000 7f562cc00640 1 -- 172.21.15.52:0/2211213466 >> 172.21.15.52:0/2211213466 conn(0x7f562806bdf0 msgr2=0x7f562806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f69a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 0x7f6f5c01d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f69a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f5c053580 0x7f6f5c0e9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f69a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5c01db70 con 0x7f6f5c006470 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f69a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5c032770 con 0x7f6f5c053580 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f69a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c0520e0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 0x7f6f5c01d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f63400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6f5c006470 0x7f6f5c050040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59248/0 (socket says 172.21.15.52:59248) 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.288+0000 7f6f63400640 1 -- 172.21.15.52:0/3965498374 learned_addr learned my addr 172.21.15.52:0/3965498374 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f6f69000640 1 --2- 172.21.15.52:0/3965498374 >> v2:172.21.15.52:3300/0 conn(0x7f6f5c053580 0x7f6f5c0e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642545686 0 0) 0x7f6f5c01db70 con 0x7f6f5c006470 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f4c003520 con 0x7f6f5c006470 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f6f63e00640 1 -- 172.21.15.52:0/3965498374 >> v2:172.21.15.52:3300/0 conn(0x7f6f5c053580 msgr2=0x7f6f5c0e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.289+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85765110 0 0) 0x7f6f4c003520 con 0x7f6f5c006470 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.290+0000 7f6f63e00640 1 --2- 172.21.15.52:0/3965498374 >> v2:172.21.15.52:3300/0 conn(0x7f6f5c053580 0x7f6f5c0e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.290+0000 7f6f63e00640 1 -- 172.21.15.52:0/3965498374 >> v1:172.21.15.176:6789/0 conn(0x7f6f5c006470 legacy=0x7f6f5c050040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.290+0000 7f6f63e00640 1 -- 172.21.15.52:0/3965498374 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c006930 con 0x7f6f5c04fc60 2024-09-10T08:28:56.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f317be00640 1 -- 172.21.15.52:0/1031915002 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168037070 con 0x7f31740e1860 2024-09-10T08:28:56.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f317be00640 1 -- 172.21.15.52:0/1031915002 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3168032440 con 0x7f31740e1860 2024-09-10T08:28:56.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f317be00640 1 -- 172.21.15.52:0/1031915002 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168032810 con 0x7f31740e1860 2024-09-10T08:28:56.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f6f63e00640 1 --2- 172.21.15.52:0/3965498374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 0x7f6f5c01d630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009790 tx=0x7f6f5802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87af4175e75f36d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f562cc00640 1 -- 172.21.15.52:0/2211213466 shutdown_connections 2024-09-10T08:28:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 -- 172.21.15.52:0/1031915002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 msgr2=0x7f3174056ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 --2- 172.21.15.52:0/1031915002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3168009870 tx=0x7f316802a210 comp rx=0 tx=0).stop 2024-09-10T08:28:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58037070 con 0x7f6f5c04fc60 2024-09-10T08:28:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5802ab90 con 0x7f6f5c04fc60 2024-09-10T08:28:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7fd3b6c00640 1 Processor -- start 2024-09-10T08:28:56.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f6f62a00640 1 -- 172.21.15.52:0/3965498374 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50001670 con 0x7f6f5c04fc60 2024-09-10T08:28:56.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 -- 172.21.15.52:0/1031915002 shutdown_connections 2024-09-10T08:28:56.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 --2- 172.21.15.52:0/1031915002 >> v2:172.21.15.52:3300/0 conn(0x7f3174057400 0x7f3174052ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 --2- 172.21.15.52:0/1031915002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31740e1860 0x7f3174056ec0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3168009870 tx=0x7f316802a210 comp rx=0 tx=0).stop 2024-09-10T08:28:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 -- 172.21.15.52:0/1031915002 >> 172.21.15.52:0/1031915002 conn(0x7f317401fb40 msgr2=0x7f31740567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 -- 172.21.15.52:0/1031915002 shutdown_connections 2024-09-10T08:28:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7fd3b6c00640 1 -- start start 2024-09-10T08:28:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 -- 172.21.15.52:0/3965498374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 msgr2=0x7f6f5c01d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3965498374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 0x7f6f5c01d630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009790 tx=0x7f6f5802a100 comp rx=0 tx=0).stop 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 -- 172.21.15.52:0/3965498374 shutdown_connections 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3965498374 >> v2:172.21.15.52:3300/0 conn(0x7f6f5c053580 0x7f6f5c0e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3965498374 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c04fc60 0x7f6f5c01d630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.294+0000 7f6f69a00640 1 -- 172.21.15.52:0/3965498374 >> 172.21.15.52:0/3965498374 conn(0x7f6f5c036090 msgr2=0x7f6f5c0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.292+0000 7f562cc00640 1 -- 172.21.15.52:0/2211213466 wait complete. 2024-09-10T08:28:56.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.295+0000 7f6f69a00640 1 -- 172.21.15.52:0/3965498374 shutdown_connections 2024-09-10T08:28:56.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.295+0000 7f562cc00640 1 Processor -- start 2024-09-10T08:28:56.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.295+0000 7f562cc00640 1 -- start start 2024-09-10T08:28:56.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3b6c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3b015e950 0x7fd3b00d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.293+0000 7f3182800640 1 -- 172.21.15.52:0/1031915002 wait complete. 2024-09-10T08:28:56.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7f3182800640 1 Processor -- start 2024-09-10T08:28:56.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3b6c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00cf9c0 0x7fd3b00b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3b6c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b00d47e0 con 0x7fd3b00d1bd0 2024-09-10T08:28:56.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3b6c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b00d2040 con 0x7fd3b015e950 2024-09-10T08:28:56.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7f3182800640 1 -- start start 2024-09-10T08:28:56.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3b6c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b015ed30 con 0x7fd3b00cf9c0 2024-09-10T08:28:56.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3af400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd3b00d1bd0 0x7fd3b00cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59262/0 (socket says 172.21.15.52:59262) 2024-09-10T08:28:56.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3af400640 1 -- 172.21.15.52:0/1835973657 learned_addr learned my addr 172.21.15.52:0/1835973657 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.296+0000 7fd3afe00640 1 --2- 172.21.15.52:0/1835973657 >> v2:172.21.15.176:3300/0 conn(0x7fd3b015e950 0x7fd3b00d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.295+0000 7f6f69a00640 1 -- 172.21.15.52:0/3965498374 wait complete. 2024-09-10T08:28:56.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.297+0000 7f6f69a00640 1 Processor -- start 2024-09-10T08:28:56.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.297+0000 7fd3b4c00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00cf9c0 0x7fd3b00b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f6f69a00640 1 -- start start 2024-09-10T08:28:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f562cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f562806e8c0 0x7f56282005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3aea00640 1 -- 172.21.15.52:0/1835973657 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033693770 0 0) 0x7fd3b00d47e0 con 0x7fd3b00d1bd0 2024-09-10T08:28:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3aea00640 1 -- 172.21.15.52:0/1835973657 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd394003520 con 0x7fd3b00d1bd0 2024-09-10T08:28:56.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f3182800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31740524b0 0x7f31740ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f562cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56280b59c0 0x7f5628200b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f3182800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 0x7f31740e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7f562cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 0x7f56280c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3182800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31740db680 0x7f31740dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3180a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 0x7f31740e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3180a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 0x7f31740e32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53020/0 (socket says 172.21.15.52:53020) 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3180a00640 1 -- 172.21.15.52:0/3835559883 learned_addr learned my addr 172.21.15.52:0/3835559883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31740e1c40 con 0x7f31740524b0 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31740e1dc0 con 0x7f31740db680 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3181e00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31740db680 0x7f31740dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3174053430 con 0x7f3174057400 2024-09-10T08:28:56.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f562cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5628147d20 con 0x7f5628147570 2024-09-10T08:28:56.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f562cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f562815ed30 con 0x7f56280b59c0 2024-09-10T08:28:56.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3afe00640 1 -- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00cf9c0 msgr2=0x7fd3b00b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3afe00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00cf9c0 0x7fd3b00b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3afe00640 1 -- 172.21.15.52:0/1835973657 >> v1:172.21.15.176:6789/0 conn(0x7fd3b00d1bd0 legacy=0x7fd3b00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.298+0000 7fd3afe00640 1 -- 172.21.15.52:0/1835973657 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b00d4a80 con 0x7fd3b015e950 2024-09-10T08:28:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f5627e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 0x7f56280c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f5627e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 0x7f56280c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45414/0 (socket says 172.21.15.52:45414) 2024-09-10T08:28:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f5627e00640 1 -- 172.21.15.52:0/230355439 learned_addr learned my addr 172.21.15.52:0/230355439 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5628147ea0 con 0x7f562806e8c0 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5626a00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56280b59c0 0x7f5628200b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 -- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 msgr2=0x7f31740e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 0x7f31740e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 -- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31740524b0 msgr2=0x7f31740ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31740524b0 0x7f31740ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317404a910 con 0x7f31740db680 2024-09-10T08:28:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.299+0000 7f5627400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f562806e8c0 0x7f56282005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627e00640 1 -- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f562806e8c0 msgr2=0x7f56282005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c006470 0x7f6f5c0373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 0x7f6f5c04c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5c053580 0x7f6f5c04c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c0071d0 con 0x7f6f5c053580 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c006ef0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f6f69a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c050750 con 0x7f6f5c006470 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3180a00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3174057400 0x7f31740e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627e00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f562806e8c0 0x7f56282005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627e00640 1 -- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56280b59c0 msgr2=0x7f5628200b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627e00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56280b59c0 0x7f5628200b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627e00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56280c6bd0 con 0x7f5628147570 2024-09-10T08:28:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f3181e00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31740db680 0x7f31740dbb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3174010d60 tx=0x7f317c0697d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5626a00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56280b59c0 0x7f5628200b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.300+0000 7f5627400640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f562806e8c0 0x7f56282005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:56.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c006470 0x7f6f5c0373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 0x7f6f5c04c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 0x7f6f5c04c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41716/0 (socket says 172.21.15.52:41716) 2024-09-10T08:28:56.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 -- 172.21.15.52:0/3280773240 learned_addr learned my addr 172.21.15.52:0/3280773240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c074260 con 0x7f31740db680 2024-09-10T08:28:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f69000640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5c053580 0x7f6f5c04c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c0959b0 con 0x7f31740db680 2024-09-10T08:28:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c095e60 con 0x7f31740db680 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 -- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c006470 msgr2=0x7f6f5c0373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c006470 0x7f6f5c0373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 -- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5c053580 msgr2=0x7f6f5c04c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f5c053580 0x7f6f5c04c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f6f63400640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c04bbf0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317404abf0 con 0x7f31740db680 2024-09-10T08:28:56.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f5627e00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 0x7f56280c7d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5620012370 tx=0x7f5620012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.301+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317404b1b0 con 0x7f31740db680 2024-09-10T08:28:56.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f6f63400640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 0x7f6f5c04c180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f50001eb0 tx=0x7f6f5000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f6f63e00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f5c006470 0x7f6f5c0373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562000f2e0 con 0x7f5628147570 2024-09-10T08:28:56.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56280cae60 con 0x7f5628147570 2024-09-10T08:28:56.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56280cb100 con 0x7f5628147570 2024-09-10T08:28:56.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620003990 con 0x7f5628147570 2024-09-10T08:28:56.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.302+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620003d60 con 0x7f5628147570 2024-09-10T08:28:56.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50017070 con 0x7f6f5c04fc60 2024-09-10T08:28:56.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50005ad0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007070 con 0x7f6f5c04fc60 2024-09-10T08:28:56.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7fd3afe00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b00d1690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00097a0 tx=0x7fd3a002a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=803e71ff0664bfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f317404a6c0 con 0x7f31740db680 2024-09-10T08:28:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.304+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5600001030 con 0x7f5628147570 2024-09-10T08:28:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.303+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c04bed0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.304+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c039ce0 con 0x7f6f5c04fc60 2024-09-10T08:28:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.304+0000 7fd3aea00640 1 -- 172.21.15.52:0/1835973657 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0037070 con 0x7fd3b015e950 2024-09-10T08:28:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.304+0000 7fd3aea00640 1 -- 172.21.15.52:0/1835973657 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a002adc0 con 0x7fd3b015e950 2024-09-10T08:28:56.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.304+0000 7fd3aea00640 1 -- 172.21.15.52:0/1835973657 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0032660 con 0x7fd3b015e950 2024-09-10T08:28:56.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.305+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f5c050040 con 0x7f6f5c04fc60 2024-09-10T08:28:56.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.305+0000 7f9e8b200640 1 Processor -- start 2024-09-10T08:28:56.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.305+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f317c09d030 con 0x7f31740db680 2024-09-10T08:28:56.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.305+0000 7f9e8b200640 1 -- start start 2024-09-10T08:28:56.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.306+0000 7fd3b6c00640 1 -- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 msgr2=0x7fd3b00d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.306+0000 7fd3b6c00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b00d1690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00097a0 tx=0x7fd3a002a0b0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.306+0000 7f3179600640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f315c06be30 0x7f315c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f317c10ec20 con 0x7f31740db680 2024-09-10T08:28:56.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.306+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5620004030 con 0x7f5628147570 2024-09-10T08:28:56.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f3179600640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f315c074050 0x7f315c076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f317c098e80 con 0x7f315c074050 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f317c10f010 con 0x7f31740db680 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f3181400640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f315c06be30 0x7f315c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f3180a00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f315c074050 0x7f315c076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f3181400640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f315c06be30 0x7f315c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3168034000 tx=0x7f316802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f5001a070 con 0x7f6f5c04fc60 2024-09-10T08:28:56.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f9e8b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f9e8b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9e84073750 0x7f9e84073b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f9e8b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e84164120 con 0x7f9e84164650 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f9e8b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9e840732c0 con 0x7f9e84073750 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.307+0000 7f9e8b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e840712a0 con 0x7f9e8414c480 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53048/0 (socket says 172.21.15.52:53048) 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 -- 172.21.15.52:0/827813559 learned_addr learned my addr 172.21.15.52:0/827813559 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 -- 172.21.15.52:0/827813559 >> v2:172.21.15.176:3300/0 conn(0x7f9e84073750 msgr2=0x7f9e84073b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 --2- 172.21.15.52:0/827813559 >> v2:172.21.15.176:3300/0 conn(0x7f9e84073750 0x7f9e84073b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 -- 172.21.15.52:0/827813559 >> v1:172.21.15.176:6789/0 conn(0x7f9e84164650 legacy=0x7f9e8406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.308+0000 7f9e83e00640 1 -- 172.21.15.52:0/827813559 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84072c70 con 0x7f9e8414c480 2024-09-10T08:28:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f561f400640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f560806be30 0x7f560806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f562008b9a0 con 0x7f5628147570 2024-09-10T08:28:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f3180a00640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f315c074050 0x7f315c076470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f6f57e00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f4406bf00 0x7f6f4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6f5008a810 con 0x7f6f5c04fc60 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f6f57e00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f6f44074120 0x7f6f44076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f50016ec0 con 0x7f6f44074120 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6f5008ac00 con 0x7f6f5c04fc60 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd3b6c00640 1 -- 172.21.15.52:0/1835973657 shutdown_connections 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd3b6c00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00cf9c0 0x7fd3b00b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd3b6c00640 1 --2- 172.21.15.52:0/1835973657 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b00d1690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd3b6c00640 1 -- 172.21.15.52:0/1835973657 >> 172.21.15.52:0/1835973657 conn(0x7fd3b0067b30 msgr2=0x7fd3b0067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f561f400640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f56080740b0 0x7f56080764d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5620014120 con 0x7f56080740b0 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f562008bd90 con 0x7f5628147570 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7f5627400640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f560806be30 0x7f560806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd3b6c00640 1 -- 172.21.15.52:0/1835973657 shutdown_connections 2024-09-10T08:28:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.309+0000 7fd0f1000640 1 Processor -- start 2024-09-10T08:28:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.310+0000 7fd3b6c00640 1 -- 172.21.15.52:0/1835973657 wait complete. 2024-09-10T08:28:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.310+0000 7f6f63e00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f4406bf00 0x7f6f4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.310+0000 7f6f69000640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f6f44074120 0x7f6f44076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.310+0000 7f5626a00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f56080740b0 0x7f56080764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== osd.0 v2:172.21.15.52:6808/702157345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f317c098e80 con 0x7f315c074050 2024-09-10T08:28:56.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f9e83e00640 1 --2- 172.21.15.52:0/827813559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6265e32514b144df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7fa52e200640 1 Processor -- start 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7fa52e200640 1 -- start start 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f6f63e00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f4406bf00 0x7f6f4406e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f58034000 tx=0x7f6f5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f6f69000640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f6f44074120 0x7f6f44076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f9e82a00640 1 -- 172.21.15.52:0/827813559 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74037070 con 0x7f9e8414c480 2024-09-10T08:28:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f9e82a00640 1 -- 172.21.15.52:0/827813559 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e74032440 con 0x7f9e8414c480 2024-09-10T08:28:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.311+0000 7f9e82a00640 1 -- 172.21.15.52:0/827813559 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74032810 con 0x7f9e8414c480 2024-09-10T08:28:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.310+0000 7fd0f1000640 1 -- start start 2024-09-10T08:28:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd0f1000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd0ec073750 0x7fd0ec073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd3b6c00640 1 Processor -- start 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd0f1000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd0ec164650 0x7fd0ec164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd0f1000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec0712a0 con 0x7fd0ec14c480 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd0f1000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec0732c0 con 0x7fd0ec073750 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7fd0f1000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec072c70 con 0x7fd0ec164650 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fd0ea800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd0ec164650 0x7fd0ec164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fd0e9e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd0ec14c480 0x7fd0ec163be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48222/0 (socket says 172.21.15.52:48222) 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fd0e9e00640 1 -- 172.21.15.52:0/3070719485 learned_addr learned my addr 172.21.15.52:0/3070719485 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fd0e1400640 1 --2- 172.21.15.52:0/3070719485 >> v2:172.21.15.52:3300/0 conn(0x7fd0ec073750 0x7fd0ec073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd0ea800640 1 -- 172.21.15.52:0/3070719485 >> v2:172.21.15.52:3300/0 conn(0x7fd0ec073750 msgr2=0x7fd0ec073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd0ea800640 1 --2- 172.21.15.52:0/3070719485 >> v2:172.21.15.52:3300/0 conn(0x7fd0ec073750 0x7fd0ec073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd0ea800640 1 -- 172.21.15.52:0/3070719485 >> v1:172.21.15.52:6789/0 conn(0x7fd0ec14c480 legacy=0x7fd0ec163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd0ea800640 1 -- 172.21.15.52:0/3070719485 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec072f50 con 0x7fd0ec164650 2024-09-10T08:28:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f5627400640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f560806be30 0x7f560806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5614008890 tx=0x7f5614008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== osd.2 v2:172.21.15.52:6824/3947975143 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f50016ec0 con 0x7f6f44074120 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7f9e8b200640 1 -- 172.21.15.52:0/827813559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 msgr2=0x7f9e84163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.312+0000 7f9e8b200640 1 --2- 172.21.15.52:0/827813559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009870 tx=0x7f9e7402a230 comp rx=0 tx=0).stop 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f9e8b200640 1 -- 172.21.15.52:0/827813559 shutdown_connections 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f9e8b200640 1 --2- 172.21.15.52:0/827813559 >> v2:172.21.15.176:3300/0 conn(0x7f9e84073750 0x7f9e84073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f9e8b200640 1 --2- 172.21.15.52:0/827813559 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e84163be0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f9e8b200640 1 -- 172.21.15.52:0/827813559 >> 172.21.15.52:0/827813559 conn(0x7f9e840ccec0 msgr2=0x7f9e840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f1667400640 1 Processor -- start 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7f1667400640 1 -- start start 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fa52e200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa52815b1c0 0x7fa5280b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fa52e200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa52815b5a0 0x7fa5280b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fa52e200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5280b4590 con 0x7fa5280ce190 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fa52e200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa5280ceee0 con 0x7fa52815b5a0 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fa52e200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa5280cf1c0 con 0x7fa52815b1c0 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fa52ce00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa52815b1c0 0x7fa5280b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fa52d800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa5280ce190 0x7fa5280ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48236/0 (socket says 172.21.15.52:48236) 2024-09-10T08:28:56.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fa52d800640 1 -- 172.21.15.52:0/302771244 learned_addr learned my addr 172.21.15.52:0/302771244 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fa527400640 1 -- 172.21.15.52:0/302771244 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744468384 0 0) 0x7fa5280b4590 con 0x7fa5280ce190 2024-09-10T08:28:56.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa527400640 1 -- 172.21.15.52:0/302771244 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa510003520 con 0x7fa5280ce190 2024-09-10T08:28:56.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.313+0000 7fd3b6c00640 1 -- start start 2024-09-10T08:28:56.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa527e00640 1 --2- 172.21.15.52:0/302771244 >> v2:172.21.15.52:3300/0 conn(0x7fa52815b5a0 0x7fa5280b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7f9e8b200640 1 -- 172.21.15.52:0/827813559 shutdown_connections 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3b00cf9c0 0x7fd3b0150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00d1bd0 0x7fd3b01fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b0161320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b00d5040 con 0x7fd3b00cf9c0 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b00cfe10 con 0x7fd3b015e950 2024-09-10T08:28:56.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7fd3b6c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b00b7d10 con 0x7fd3b00d1bd0 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa52ce00640 1 -- 172.21.15.52:0/302771244 >> v2:172.21.15.52:3300/0 conn(0x7fa52815b5a0 msgr2=0x7fa5280b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b0161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b0161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41738/0 (socket says 172.21.15.52:41738) 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 -- 172.21.15.52:0/654979491 learned_addr learned my addr 172.21.15.52:0/654979491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 -- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00d1bd0 msgr2=0x7fd3b01fb4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:56.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3b00d1bd0 0x7fd3b01fb4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 -- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3b00cf9c0 msgr2=0x7fd3b0150700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3b00cf9c0 0x7fd3b0150700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fd3b4c00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b0153190 con 0x7fd3b015e950 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7f1667400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1660145ed0 0x7f16600b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7f1667400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660073180 0x7f16600735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7f1667400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16600b4020 con 0x7f16600b5880 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7f1667400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1660073b00 con 0x7f1660145ed0 2024-09-10T08:28:56.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7f1667400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16600b42c0 con 0x7f1660073180 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa52ce00640 1 --2- 172.21.15.52:0/302771244 >> v2:172.21.15.52:3300/0 conn(0x7fa52815b5a0 0x7fa5280b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa52ce00640 1 -- 172.21.15.52:0/302771244 >> v1:172.21.15.52:6789/0 conn(0x7fa5280ce190 legacy=0x7fa5280ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.315+0000 7fa52ce00640 1 -- 172.21.15.52:0/302771244 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280b4830 con 0x7fa52815b1c0 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7f1665400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f16600b5880 0x7f16600b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59276/0 (socket says 172.21.15.52:59276) 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7f1665400640 1 -- 172.21.15.52:0/1899159580 learned_addr learned my addr 172.21.15.52:0/1899159580 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7fd3b4c00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b0161320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8007e40 tx=0x7fd3a800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.316+0000 7f1664a00640 1 --2- 172.21.15.52:0/1899159580 >> v2:172.21.15.52:3300/0 conn(0x7f1660145ed0 0x7f16600b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.314+0000 7f5626a00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f56080740b0 0x7f56080764d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== osd.1 v2:172.21.15.52:6800/2452593582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5620014120 con 0x7f56080740b0 2024-09-10T08:28:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f9e8b200640 1 -- 172.21.15.52:0/827813559 wait complete. 2024-09-10T08:28:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8014620 con 0x7fd3b015e950 2024-09-10T08:28:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f165fe00640 1 -- 172.21.15.52:0/1899159580 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858541239 0 0) 0x7f16600b4020 con 0x7f16600b5880 2024-09-10T08:28:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f165fe00640 1 -- 172.21.15.52:0/1899159580 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1644003520 con 0x7f16600b5880 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a8019070 con 0x7fd3b015e950 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8014a20 con 0x7fd3b015e950 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd3b6c00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b00cb9f0 con 0x7fd3b015e950 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd3b6c00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b00cbfb0 con 0x7fd3b015e950 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fa52ce00640 1 --2- 172.21.15.52:0/302771244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa52815b1c0 0x7fa5280b3680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa52806efc0 tx=0x7fa51402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd97a4b2a74cc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.318+0000 7fa527400640 1 -- 172.21.15.52:0/302771244 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514037070 con 0x7fa52815b1c0 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f1664a00640 1 -- 172.21.15.52:0/1899159580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660073180 msgr2=0x7f16600735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f1664a00640 1 --2- 172.21.15.52:0/1899159580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660073180 0x7f16600735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f1664a00640 1 -- 172.21.15.52:0/1899159580 >> v1:172.21.15.176:6789/0 conn(0x7f16600b5880 legacy=0x7f16600b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7f1664a00640 1 -- 172.21.15.52:0/1899159580 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16600b45a0 con 0x7f1660145ed0 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.318+0000 7fa527400640 1 -- 172.21.15.52:0/302771244 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51402aba0 con 0x7fa52815b1c0 2024-09-10T08:28:56.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.318+0000 7fa527400640 1 -- 172.21.15.52:0/302771244 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514037070 con 0x7fa52815b1c0 2024-09-10T08:28:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fd3b6c00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd3b00b77d0 con 0x7fd3b015e950 2024-09-10T08:28:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd0ea800640 1 --2- 172.21.15.52:0/3070719485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec164650 0x7fd0ec164ae0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b6700 tx=0x7fd0e402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3fb971d45108cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd0e9400640 1 -- 172.21.15.52:0/3070719485 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4037070 con 0x7fd0ec164650 2024-09-10T08:28:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd0e9400640 1 -- 172.21.15.52:0/3070719485 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e4032440 con 0x7fd0ec164650 2024-09-10T08:28:56.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.317+0000 7fd0e9400640 1 -- 172.21.15.52:0/3070719485 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e402ae60 con 0x7fd0ec164650 2024-09-10T08:28:56.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7f9e8b200640 1 Processor -- start 2024-09-10T08:28:56.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fa52e200640 1 -- 172.21.15.52:0/302771244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa52815b1c0 msgr2=0x7fa5280b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fa52e200640 1 --2- 172.21.15.52:0/302771244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa52815b1c0 0x7fa5280b3680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa52806efc0 tx=0x7fa51402a110 comp rx=0 tx=0).stop 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fa52e200640 1 -- 172.21.15.52:0/302771244 shutdown_connections 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fa52e200640 1 --2- 172.21.15.52:0/302771244 >> v2:172.21.15.52:3300/0 conn(0x7fa52815b5a0 0x7fa5280b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7fa52e200640 1 --2- 172.21.15.52:0/302771244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa52815b1c0 0x7fa5280b3680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fa52e200640 1 -- 172.21.15.52:0/302771244 >> 172.21.15.52:0/302771244 conn(0x7fa52806e200 msgr2=0x7fa52806e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 -- 172.21.15.52:0/3070719485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec164650 msgr2=0x7fd0ec164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 --2- 172.21.15.52:0/3070719485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec164650 0x7fd0ec164ae0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b6700 tx=0x7fd0e402a110 comp rx=0 tx=0).stop 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fa52e200640 1 -- 172.21.15.52:0/302771244 shutdown_connections 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fa52e200640 1 -- 172.21.15.52:0/302771244 wait complete. 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 -- 172.21.15.52:0/3070719485 shutdown_connections 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 --2- 172.21.15.52:0/3070719485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec164650 0x7fd0ec164ae0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 --2- 172.21.15.52:0/3070719485 >> v2:172.21.15.52:3300/0 conn(0x7fd0ec073750 0x7fd0ec073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7fd0f1000640 1 -- 172.21.15.52:0/3070719485 >> 172.21.15.52:0/3070719485 conn(0x7fd0ec0ccec0 msgr2=0x7fd0ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.320+0000 7f1664a00640 1 --2- 172.21.15.52:0/1899159580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660145ed0 0x7f16600b5080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1650009d90 tx=0x7f165002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf49cc6a0f13ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f165fe00640 1 -- 172.21.15.52:0/1899159580 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650007740 con 0x7f1660145ed0 2024-09-10T08:28:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.319+0000 7f9e8b200640 1 -- start start 2024-09-10T08:28:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f165fe00640 1 -- 172.21.15.52:0/1899159580 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16500078e0 con 0x7f1660145ed0 2024-09-10T08:28:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e84073750 0x7f9e841603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e840b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f165fe00640 1 -- 172.21.15.52:0/1899159580 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650007740 con 0x7f1660145ed0 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 0x7f9e840b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84071580 con 0x7f9e84073750 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84070f70 con 0x7f9e84164650 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.321+0000 7f9e8b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e840b6350 con 0x7f9e8414c480 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f9e89200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 0x7f9e840b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f9e89200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 0x7f9e840b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41742/0 (socket says 172.21.15.52:41742) 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f9e89200640 1 -- 172.21.15.52:0/831371755 learned_addr learned my addr 172.21.15.52:0/831371755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7fd0f1000640 1 -- 172.21.15.52:0/3070719485 shutdown_connections 2024-09-10T08:28:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f1667400640 1 -- 172.21.15.52:0/1899159580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660145ed0 msgr2=0x7f16600b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f1667400640 1 --2- 172.21.15.52:0/1899159580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660145ed0 0x7f16600b5080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1650009d90 tx=0x7f165002a660 comp rx=0 tx=0).stop 2024-09-10T08:28:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7f9e83e00640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e84073750 0x7f9e841603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3a8014bc0 con 0x7fd3b015e950 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7fa52e200640 1 Processor -- start 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7fa52e200640 1 -- start start 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7f9e89200640 1 -- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 msgr2=0x7f9e840b3fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7f9e89200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e8414c480 0x7f9e840b3fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7f9e89200640 1 -- 172.21.15.52:0/831371755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e84073750 msgr2=0x7f9e841603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7f9e89200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e84073750 0x7f9e841603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7f9e89200640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e840c6280 con 0x7f9e84164650 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.322+0000 7fd0f1000640 1 -- 172.21.15.52:0/3070719485 wait complete. 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7fd3a7e00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd39006be30 0x7fd39006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd3a808c5d0 con 0x7fd3b015e950 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7fd3a7e00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7fd390073fd0 0x7fd3900763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3a8019e70 con 0x7fd390073fd0 2024-09-10T08:28:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.323+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd3a808c980 con 0x7fd3b015e950 2024-09-10T08:28:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f9e89200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 0x7f9e840b44f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b970 tx=0x7f9e7c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f1667400640 1 -- 172.21.15.52:0/1899159580 shutdown_connections 2024-09-10T08:28:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f1667400640 1 --2- 172.21.15.52:0/1899159580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660073180 0x7f16600735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f1667400640 1 --2- 172.21.15.52:0/1899159580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660145ed0 0x7f16600b5080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f1667400640 1 -- 172.21.15.52:0/1899159580 >> 172.21.15.52:0/1899159580 conn(0x7f16600ccec0 msgr2=0x7f16600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 0x7fa528143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 0x7fa5280b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 0x7fa52814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c019070 con 0x7f9e84164650 2024-09-10T08:28:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f1667400640 1 -- 172.21.15.52:0/1899159580 shutdown_connections 2024-09-10T08:28:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa527e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 0x7fa5280b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00cb40 con 0x7f9e84164650 2024-09-10T08:28:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fd3afe00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd39006be30 0x7fd39006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fd3af400640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7fd390073fd0 0x7fd3900763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7f1667400640 1 -- 172.21.15.52:0/1899159580 wait complete. 2024-09-10T08:28:56.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fd0f1000640 1 Processor -- start 2024-09-10T08:28:56.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fd0f1000640 1 -- start start 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fd3af400640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7fd390073fd0 0x7fd3900763f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fd3afe00640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd39006be30 0x7fd39006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0034000 tx=0x7fd3a002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e840c6560 con 0x7f9e84164650 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e841608e0 con 0x7f9e84164650 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c014440 con 0x7f9e84164650 2024-09-10T08:28:56.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e5c001030 con 0x7f9e84164650 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa527e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 0x7fa5280b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53084/0 (socket says 172.21.15.52:53084) 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 0x7fa52814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 0x7fa52814ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45464/0 (socket says 172.21.15.52:45464) 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa52806bd90 con 0x7fa52815b5a0 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa52806bc10 con 0x7fa5280ce190 2024-09-10T08:28:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.324+0000 7fa52e200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa52806bf10 con 0x7fa52815b1c0 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fa52ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 0x7fa528143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fa52ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 0x7fa528143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41758/0 (socket says 172.21.15.52:41758) 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.325+0000 7fa52ce00640 1 -- 172.21.15.52:0/1852849709 learned_addr learned my addr 172.21.15.52:0/1852849709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fa52ce00640 1 -- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 msgr2=0x7fa5280b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fa52ce00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 0x7fa5280b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fa52ce00640 1 -- 172.21.15.52:0/1852849709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 msgr2=0x7fa52814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fa52ce00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 0x7fa52814ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.326+0000 7fa52ce00640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52814a3f0 con 0x7fa5280ce190 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fa52ce00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 0x7fa528143220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa514035040 tx=0x7fa5140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fa527e00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa52815b1c0 0x7fa5280b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-10T08:28:56.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fa52d800640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa52815b5a0 0x7fa52814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-10T08:28:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 0x7fd0ec13d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0ec14c480 0x7fd0ec149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0ec164650 0x7fd0ec13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec0b6350 con 0x7fd0ec164650 2024-09-10T08:28:56.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec071580 con 0x7fd0ec073750 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0f1000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec0b64d0 con 0x7fd0ec14c480 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0e9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 0x7fd0ec13d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0ec164650 0x7fd0ec13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0e9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 0x7fd0ec13d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41760/0 (socket says 172.21.15.52:41760) 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.327+0000 7fd0e9e00640 1 -- 172.21.15.52:0/2792500910 learned_addr learned my addr 172.21.15.52:0/2792500910 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7f1667400640 1 Processor -- start 2024-09-10T08:28:56.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7fd0e1400640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0ec14c480 0x7fd0ec149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== osd.3 v2:172.21.15.52:6812/3392514564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3a8019e70 con 0x7fd390073fd0 2024-09-10T08:28:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7f1667400640 1 -- start start 2024-09-10T08:28:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fd0e9e00640 1 -- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0ec14c480 msgr2=0x7fd0ec149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fd0e9e00640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0ec14c480 0x7fd0ec149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fd0e9e00640 1 -- 172.21.15.52:0/2792500910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0ec164650 msgr2=0x7fd0ec13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660073180 0x7f16601534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514042020 con 0x7fa5280ce190 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa514003bc0 con 0x7fa5280ce190 2024-09-10T08:28:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa514037040 con 0x7fa5280ce190 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 0x7f16601539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660145ed0 0x7f166013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f16601462b0 con 0x7f1660073180 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16600b4b60 con 0x7f16600b5880 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1667400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1660146430 con 0x7f1660145ed0 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1657e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 0x7f16601539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa528149870 con 0x7fa5280ce190 2024-09-10T08:28:56.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa528149e30 con 0x7fa5280ce190 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.328+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e7c01c070 con 0x7f9e84164650 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e7be00640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e6406bf30 0x7f9e6406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9e7c08af70 con 0x7f9e84164650 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e83e00640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e6406bf30 0x7f9e6406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e7be00640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f9e64074150 0x7f9e64076570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e7c013ec0 con 0x7f9e64074150 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1657e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 0x7f16601539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41766/0 (socket says 172.21.15.52:41766) 2024-09-10T08:28:56.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1657e00640 1 -- 172.21.15.52:0/3795053447 learned_addr learned my addr 172.21.15.52:0/3795053447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f1664a00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660073180 0x7f16601534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c08b360 con 0x7f9e84164650 2024-09-10T08:28:56.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.329+0000 7fd0e9e00640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0ec164650 0x7fd0ec13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7fd0e9e00640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec149590 con 0x7fd0ec073750 2024-09-10T08:28:56.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.330+0000 7fd0ea800640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0ec164650 0x7fd0ec13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.331+0000 7f9e83400640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f9e64074150 0x7f9e64076570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.331+0000 7f1665400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660145ed0 0x7f166013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.331+0000 7fd0e9e00640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 0x7fd0ec13d5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00cb10 tx=0x7fd0dc00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f9e83e00640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e6406bf30 0x7f9e6406e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e74034000 tx=0x7f9e7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f1665400640 1 -- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 msgr2=0x7f16601539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f1665400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 0x7f16601539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f1665400640 1 -- 172.21.15.52:0/3795053447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660073180 msgr2=0x7f16601534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f1665400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660073180 0x7f16601534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7f1665400640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166013ccc0 con 0x7f1660145ed0 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc017070 con 0x7fd0ec073750 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00ac70 con 0x7fd0ec073750 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.332+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc012620 con 0x7fd0ec073750 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec149840 con 0x7fd0ec073750 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7f1664a00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1660073180 0x7f16601534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7f9e83400640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f9e64074150 0x7f9e64076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7f1657e00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16600b5880 0x7f16601539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7f1665400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660145ed0 0x7f166013ac00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f165800c390 tx=0x7f165800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec14a0a0 con 0x7fd0ec073750 2024-09-10T08:28:56.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.333+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa528072c30 con 0x7fa5280ce190 2024-09-10T08:28:56.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.334+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658017070 con 0x7f1660145ed0 2024-09-10T08:28:56.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.334+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658005ce0 con 0x7f1660145ed0 2024-09-10T08:28:56.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.334+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16580072f0 con 0x7f1660145ed0 2024-09-10T08:28:56.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.334+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0ec0b2d90 con 0x7fd0ec073750 2024-09-10T08:28:56.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.334+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166013c420 con 0x7f1660145ed0 2024-09-10T08:28:56.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.335+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa514045020 con 0x7fa5280ce190 2024-09-10T08:28:56.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.335+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== osd.4 v2:172.21.15.176:6802/3190346421 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e7c013ec0 con 0x7f9e64074150 2024-09-10T08:28:56.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.335+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f166013c9e0 con 0x7f1660145ed0 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.336+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16600735c0 con 0x7f1660145ed0 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.336+0000 7fa524c00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa50806be80 0x7fa50806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.336+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa5140ab3c0 con 0x7fa5280ce190 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.337+0000 7fa524c00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7fa508074020 0x7fa508076440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.337+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa514038e50 con 0x7fa508074020 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.337+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa5140b2050 con 0x7fa5280ce190 2024-09-10T08:28:56.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.337+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 --> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3174056ec0 con 0x7f315c074050 2024-09-10T08:28:56.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7fa527e00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa50806be80 0x7fa50806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7fa52d800640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7fa508074020 0x7fa508076440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.336+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0dc01a070 con 0x7fd0ec073750 2024-09-10T08:28:56.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7fd0e2a00640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0c806be80 0x7fd0c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7f3179600640 1 -- 172.21.15.52:0/3835559883 <== osd.0 v2:172.21.15.52:6808/702157345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3174056ec0 con 0x7f315c074050 2024-09-10T08:28:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd0dc08ae70 con 0x7fd0ec073750 2024-09-10T08:28:56.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.338+0000 7fd0e1400640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0c806be80 0x7fd0c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fa527e00640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa50806be80 0x7fa50806e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa51c006fd0 tx=0x7fa51c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fd0e2a00640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7fd0c80740a0 0x7fd0c80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0dc015e70 con 0x7fd0c80740a0 2024-09-10T08:28:56.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f165801a070 con 0x7f1660145ed0 2024-09-10T08:28:56.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd0dc08b350 con 0x7fd0ec073750 2024-09-10T08:28:56.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fd0e1400640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0c806be80 0x7fd0c806e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec1fc680 tx=0x7fd0d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fd0ea800640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7fd0c80740a0 0x7fd0c80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.339+0000 7fa52d800640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7fa508074020 0x7fa508076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f315c074050 msgr2=0x7f315c076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f315c074050 0x7f315c076470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f315c06be30 msgr2=0x7f315c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f315c06be30 0x7f315c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3168034000 tx=0x7f316802c000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31740db680 msgr2=0x7f31740dbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 --2- 172.21.15.52:0/3835559883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31740db680 0x7f31740dbb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3174010d60 tx=0x7f317c0697d0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3181e00640 1 -- 172.21.15.52:0/3835559883 reap_dead start 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 shutdown_connections 2024-09-10T08:28:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 >> 172.21.15.52:0/3835559883 conn(0x7f317401fb40 msgr2=0x7f31740dca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.340+0000 7f165d600640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163c06be80 0x7f163c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1658089ff0 con 0x7f1660145ed0 2024-09-10T08:28:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== osd.6 v2:172.21.15.176:6818/2589759932 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa514038e50 con 0x7fa508074020 2024-09-10T08:28:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 shutdown_connections 2024-09-10T08:28:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7fd0ea800640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7fd0c80740a0 0x7fd0c80764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f3182800640 1 -- 172.21.15.52:0/3835559883 wait complete. 2024-09-10T08:28:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f1664a00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163c06be80 0x7f163c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f165d600640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f163c074100 0x7f163c076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1658009e50 con 0x7f163c074100 2024-09-10T08:28:56.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.341+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1658091050 con 0x7f1660145ed0 2024-09-10T08:28:56.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.342+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== osd.7 v2:172.21.15.176:6810/2943871986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0dc015e70 con 0x7fd0c80740a0 2024-09-10T08:28:56.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.342+0000 7f1657e00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f163c074100 0x7f163c076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.342+0000 7f1664a00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163c06be80 0x7f163c06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1650034000 tx=0x7f165002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.343+0000 7f1657e00640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f163c074100 0x7f163c076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.344+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== osd.5 v2:172.21.15.176:6824/1819402016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1658009e50 con 0x7f163c074100 2024-09-10T08:28:56.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.345+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 --> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f5c009f70 con 0x7f6f44074120 2024-09-10T08:28:56.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.347+0000 7f6f57e00640 1 -- 172.21.15.52:0/3280773240 <== osd.2 v2:172.21.15.52:6824/3947975143 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f5c009f70 con 0x7f6f44074120 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.348+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f6f44074120 msgr2=0x7f6f44076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.348+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f6f44074120 0x7f6f44076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f4406bf00 msgr2=0x7f6f4406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f4406bf00 0x7f6f4406e3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6f58034000 tx=0x7f6f5802e000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 msgr2=0x7f6f5c04c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 --2- 172.21.15.52:0/3280773240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f5c04fc60 0x7f6f5c04c180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f50001eb0 tx=0x7f6f5000cbe0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69000640 1 -- 172.21.15.52:0/3280773240 reap_dead start 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 shutdown_connections 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 >> 172.21.15.52:0/3280773240 conn(0x7f6f5c036090 msgr2=0x7f6f5c034470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 shutdown_connections 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.351+0000 7f6f69a00640 1 -- 172.21.15.52:0/3280773240 wait complete. 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.354+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5600002dd0 con 0x7f56080740b0 2024-09-10T08:28:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.356+0000 7f561f400640 1 -- 172.21.15.52:0/230355439 <== osd.1 v2:172.21.15.52:6800/2452593582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5600002dd0 con 0x7f56080740b0 2024-09-10T08:28:56.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.357+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f56080740b0 msgr2=0x7f56080764d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.357+0000 7f562cc00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f56080740b0 0x7f56080764d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.358+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f560806be30 msgr2=0x7f560806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.358+0000 7f562cc00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f560806be30 0x7f560806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5614008890 tx=0x7f5614008040 comp rx=0 tx=0).stop 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.358+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 msgr2=0x7f56280c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.358+0000 7f562cc00640 1 --2- 172.21.15.52:0/230355439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5628147570 0x7f56280c7d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5620012370 tx=0x7f5620012830 comp rx=0 tx=0).stop 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.358+0000 7f5627e00640 1 -- 172.21.15.52:0/230355439 reap_dead start 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.359+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 shutdown_connections 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.359+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 >> 172.21.15.52:0/230355439 conn(0x7f562806bdf0 msgr2=0x7f5628144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.359+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 shutdown_connections 2024-09-10T08:28:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.359+0000 7f562cc00640 1 -- 172.21.15.52:0/230355439 wait complete. 2024-09-10T08:28:56.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.361+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 --> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e5c002dd0 con 0x7f9e64074150 2024-09-10T08:28:56.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.363+0000 7f9e7be00640 1 -- 172.21.15.52:0/831371755 <== osd.4 v2:172.21.15.176:6802/3190346421 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e5c002dd0 con 0x7f9e64074150 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.363+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f9e64074150 msgr2=0x7f9e64076570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.363+0000 7f9e8b200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f9e64074150 0x7f9e64076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.364+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e6406bf30 msgr2=0x7f9e6406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.364+0000 7f9e8b200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e6406bf30 0x7f9e6406e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e74034000 tx=0x7f9e7402e000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.364+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 msgr2=0x7f9e840b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.364+0000 7f9e8b200640 1 --2- 172.21.15.52:0/831371755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e84164650 0x7f9e840b44f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b970 tx=0x7f9e7c00be30 comp rx=0 tx=0).stop 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.364+0000 7f9e89200640 1 -- 172.21.15.52:0/831371755 reap_dead start 2024-09-10T08:28:56.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.365+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 shutdown_connections 2024-09-10T08:28:56.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.365+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 >> 172.21.15.52:0/831371755 conn(0x7f9e840ccec0 msgr2=0x7f9e840cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.365+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 shutdown_connections 2024-09-10T08:28:56.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.365+0000 7f9e8b200640 1 -- 172.21.15.52:0/831371755 wait complete. 2024-09-10T08:28:56.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.366+0000 7fd3b6c00640 1 -- 172.21.15.52:0/654979491 --> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd3b00b8f00 con 0x7fd390073fd0 2024-09-10T08:28:56.393 INFO:teuthology.orchestra.run.smithi052.stdout:64424509449 2024-09-10T08:28:56.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.366+0000 7fd3a7e00640 1 -- 172.21.15.52:0/654979491 <== osd.3 v2:172.21.15.52:6812/3392514564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd3b00b8f00 con 0x7fd390073fd0 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.367+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7fd390073fd0 msgr2=0x7fd3900763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.367+0000 7fd3a5600640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7fd390073fd0 0x7fd3900763f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd39006be30 msgr2=0x7fd39006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd39006be30 0x7fd39006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0034000 tx=0x7fd3a002e000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 msgr2=0x7fd3b0161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 --2- 172.21.15.52:0/654979491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3b015e950 0x7fd3b0161320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8007e40 tx=0x7fd3a800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3b4c00640 1 -- 172.21.15.52:0/654979491 reap_dead start 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 shutdown_connections 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.368+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 >> 172.21.15.52:0/654979491 conn(0x7fd3b0067b30 msgr2=0x7fd3b00b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.369+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 shutdown_connections 2024-09-10T08:28:56.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.369+0000 7fd3a5600640 1 -- 172.21.15.52:0/654979491 wait complete. 2024-09-10T08:28:56.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T08:28:56.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.369+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 --> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0ec0cdbf0 con 0x7fd0c80740a0 2024-09-10T08:28:56.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.370+0000 7fd0e2a00640 1 -- 172.21.15.52:0/2792500910 <== osd.7 v2:172.21.15.176:6810/2943871986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0ec0cdbf0 con 0x7fd0c80740a0 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.371+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7fd0c80740a0 msgr2=0x7fd0c80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.371+0000 7fd0f1000640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7fd0c80740a0 0x7fd0c80764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0c806be80 msgr2=0x7fd0c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0c806be80 0x7fd0c806e340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec1fc680 tx=0x7fd0d4008040 comp rx=0 tx=0).stop 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 msgr2=0x7fd0ec13d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 --2- 172.21.15.52:0/2792500910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0ec073750 0x7fd0ec13d5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00cb10 tx=0x7fd0dc00a060 comp rx=0 tx=0).stop 2024-09-10T08:28:56.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0ea800640 1 -- 172.21.15.52:0/2792500910 reap_dead start 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 shutdown_connections 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 >> 172.21.15.52:0/2792500910 conn(0x7fd0ec0ccec0 msgr2=0x7fd0ec1614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 shutdown_connections 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.372+0000 7fd0f1000640 1 -- 172.21.15.52:0/2792500910 wait complete. 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.375+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 --> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16600ceaf0 con 0x7f163c074100 2024-09-10T08:28:56.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.376+0000 7f165d600640 1 -- 172.21.15.52:0/3795053447 <== osd.5 v2:172.21.15.176:6824/1819402016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f16600ceaf0 con 0x7f163c074100 2024-09-10T08:28:56.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.376+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f163c074100 msgr2=0x7f163c076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 --> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5280ce5c0 con 0x7fa508074020 2024-09-10T08:28:56.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1667400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f163c074100 0x7f163c076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7fa524c00640 1 -- 172.21.15.52:0/1852849709 <== osd.6 v2:172.21.15.176:6818/2589759932 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa5280ce5c0 con 0x7fa508074020 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi052.stdout:64424509448 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163c06be80 msgr2=0x7f163c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1667400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163c06be80 0x7f163c06e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1650034000 tx=0x7f165002f000 comp rx=0 tx=0).stop 2024-09-10T08:28:56.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660145ed0 msgr2=0x7f166013ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1667400640 1 --2- 172.21.15.52:0/3795053447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1660145ed0 0x7f166013ac00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f165800c390 tx=0x7f165800c850 comp rx=0 tx=0).stop 2024-09-10T08:28:56.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T08:28:56.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.377+0000 7f1665400640 1 -- 172.21.15.52:0/3795053447 reap_dead start 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7fa508074020 msgr2=0x7fa508076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7fa508074020 0x7fa508076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 shutdown_connections 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 >> 172.21.15.52:0/3795053447 conn(0x7f16600ccec0 msgr2=0x7f16600d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 shutdown_connections 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa50806be80 msgr2=0x7fa50806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa50806be80 0x7fa50806e340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa51c006fd0 tx=0x7fa51c008040 comp rx=0 tx=0).stop 2024-09-10T08:28:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7f1667400640 1 -- 172.21.15.52:0/3795053447 wait complete. 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 msgr2=0x7fa528143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 --2- 172.21.15.52:0/1852849709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5280ce190 0x7fa528143220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa514035040 tx=0x7fa5140046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52d800640 1 -- 172.21.15.52:0/1852849709 reap_dead start 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 shutdown_connections 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.378+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 >> 172.21.15.52:0/1852849709 conn(0x7fa52806e200 msgr2=0x7fa528072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.379+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 shutdown_connections 2024-09-10T08:28:56.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.379+0000 7fa52e200640 1 -- 172.21.15.52:0/1852849709 wait complete. 2024-09-10T08:28:56.406 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:56.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T08:28:56.407 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:56.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T08:28:56.408 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:56.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T08:28:56.410 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:56.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T08:28:56.410 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2024-09-10T08:28:56.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T08:28:56.411 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:56.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T08:28:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.719+0000 7f7521000640 1 Processor -- start 2024-09-10T08:28:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.720+0000 7f7521000640 1 -- start start 2024-09-10T08:28:56.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f7521000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7514035a80 0x7f75140556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f7521000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75140354c0 0x7f7514038940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f151c600640 1 Processor -- start 2024-09-10T08:28:56.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f7521000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7514038e80 con 0x7f75140e09c0 2024-09-10T08:28:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f151c600640 1 -- start start 2024-09-10T08:28:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f7521000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7514039100 con 0x7f75140354c0 2024-09-10T08:28:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f7521000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7514057400 con 0x7f7514035a80 2024-09-10T08:28:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.723+0000 7f751be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75140354c0 0x7f7514038940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f751be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75140354c0 0x7f7514038940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41774/0 (socket says 172.21.15.52:41774) 2024-09-10T08:28:56.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f751be00640 1 -- 172.21.15.52:0/2080467949 learned_addr learned my addr 172.21.15.52:0/2080467949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f751be00640 1 -- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7514035a80 msgr2=0x7f75140556a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:56.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f751be00640 1 --2- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7514035a80 0x7f75140556a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.724+0000 7f751be00640 1 -- 172.21.15.52:0/2080467949 >> v1:172.21.15.52:6789/0 conn(0x7f75140e09c0 legacy=0x7f7514038230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:56.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.726+0000 7f151c600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1514145ed0 0x7f15140b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.725+0000 7f751be00640 1 -- 172.21.15.52:0/2080467949 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514054ea0 con 0x7f75140354c0 2024-09-10T08:28:56.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.726+0000 7f751be00640 1 --2- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f7514038940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f751c050b40 tx=0x7f751c0a6540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f810d7b25347a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f151c600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15140b4020 con 0x7f15140b5f90 2024-09-10T08:28:56.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f151c600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15140b42c0 con 0x7f1514073180 2024-09-10T08:28:56.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1514145ed0 0x7f15140b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f151c600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f15140b63d0 con 0x7f1514145ed0 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1514145ed0 0x7f15140b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45504/0 (socket says 172.21.15.52:45504) 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 -- 172.21.15.52:0/4076065840 learned_addr learned my addr 172.21.15.52:0/4076065840 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 -- 172.21.15.52:0/4076065840 >> v1:172.21.15.176:6789/0 conn(0x7f1514073180 legacy=0x7f15140b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 -- 172.21.15.52:0/4076065840 >> v1:172.21.15.52:6789/0 conn(0x7f15140b5f90 legacy=0x7f151415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.727+0000 7f1519c00640 1 -- 172.21.15.52:0/4076065840 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15140b45a0 con 0x7f1514145ed0 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.728+0000 7f751a000640 1 -- 172.21.15.52:0/2080467949 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0b2070 con 0x7f75140354c0 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.728+0000 7f751a000640 1 -- 172.21.15.52:0/2080467949 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751c0ab7d0 con 0x7f75140354c0 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.728+0000 7f751a000640 1 -- 172.21.15.52:0/2080467949 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0abc40 con 0x7f75140354c0 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 -- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 msgr2=0x7f7514038940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 --2- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f7514038940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f751c050b40 tx=0x7f751c0a6540 comp rx=0 tx=0).stop 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 -- 172.21.15.52:0/2080467949 shutdown_connections 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 --2- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f7514038940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 --2- 172.21.15.52:0/2080467949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7514035a80 0x7f75140556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f7521000640 1 -- 172.21.15.52:0/2080467949 >> 172.21.15.52:0/2080467949 conn(0x7f75140567b0 msgr2=0x7f7514056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.730+0000 7f7521000640 1 -- 172.21.15.52:0/2080467949 shutdown_connections 2024-09-10T08:28:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.730+0000 7f7521000640 1 -- 172.21.15.52:0/2080467949 wait complete. 2024-09-10T08:28:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.729+0000 7f1519c00640 1 --2- 172.21.15.52:0/4076065840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1514145ed0 0x7f15140b5080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15140d1490 tx=0x7f150c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5cfa3370eb09ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.730+0000 7f1513e00640 1 -- 172.21.15.52:0/4076065840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037070 con 0x7f1514145ed0 2024-09-10T08:28:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.730+0000 7f1513e00640 1 -- 172.21.15.52:0/4076065840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c032440 con 0x7f1514145ed0 2024-09-10T08:28:56.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.730+0000 7f1513e00640 1 -- 172.21.15.52:0/4076065840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037070 con 0x7f1514145ed0 2024-09-10T08:28:56.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f151c600640 1 -- 172.21.15.52:0/4076065840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1514145ed0 msgr2=0x7f15140b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f151c600640 1 --2- 172.21.15.52:0/4076065840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1514145ed0 0x7f15140b5080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f15140d1490 tx=0x7f150c02a250 comp rx=0 tx=0).stop 2024-09-10T08:28:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7ff0bd200640 1 Processor -- start 2024-09-10T08:28:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f7521000640 1 Processor -- start 2024-09-10T08:28:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f151c600640 1 -- 172.21.15.52:0/4076065840 shutdown_connections 2024-09-10T08:28:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7ff0bd200640 1 -- start start 2024-09-10T08:28:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.733+0000 7f7521000640 1 -- start start 2024-09-10T08:28:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f151c600640 1 --2- 172.21.15.52:0/4076065840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1514145ed0 0x7f15140b5080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.732+0000 7f151c600640 1 -- 172.21.15.52:0/4076065840 >> 172.21.15.52:0/4076065840 conn(0x7f15140ccec0 msgr2=0x7f15140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.733+0000 7f151c600640 1 -- 172.21.15.52:0/4076065840 shutdown_connections 2024-09-10T08:28:56.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.734+0000 7ff0bd200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0b815e440 0x7ff0b80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.734+0000 7f7521000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f751404d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.733+0000 7f151c600640 1 -- 172.21.15.52:0/4076065840 wait complete. 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.735+0000 7f7521000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7514035a80 0x7f75140d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.735+0000 7ff0bd200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b80d3990 con 0x7ff0b80cf450 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.735+0000 7ff0bd200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b80d3c70 con 0x7ff0b80b6710 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.735+0000 7ff0bd200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b80d3f50 con 0x7ff0b815e440 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7ff0b7e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff0b80b6710 0x7ff0b80b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59298/0 (socket says 172.21.15.52:59298) 2024-09-10T08:28:56.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7ff0b7e00640 1 -- 172.21.15.52:0/2576084289 learned_addr learned my addr 172.21.15.52:0/2576084289 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7f7521000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 0x7f75140e3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7f751b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f751404d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7f751b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f751404d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41778/0 (socket says 172.21.15.52:41778) 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7f751b400640 1 -- 172.21.15.52:0/1259510163 learned_addr learned my addr 172.21.15.52:0/1259510163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.736+0000 7ff0b7400640 1 --2- 172.21.15.52:0/2576084289 >> v2:172.21.15.52:3300/0 conn(0x7ff0b815e440 0x7ff0b80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f151c600640 1 Processor -- start 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f151c600640 1 -- start start 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7514051620 con 0x7f7514035a80 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852168045 0 0) 0x7ff0b80d3990 con 0x7ff0b80cf450 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c003520 con 0x7ff0b80cf450 2024-09-10T08:28:56.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655434748 0 0) 0x7ff0b80d3c70 con 0x7ff0b80b6710 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b80d3990 con 0x7ff0b80b6710 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f751be00640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 0x7f75140e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75140514a0 con 0x7f75140354c0 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75140517a0 con 0x7f75140e09c0 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.737+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2787900195 0 0) 0x7ff09c003520 con 0x7ff0b80cf450 2024-09-10T08:28:56.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 >> v2:172.21.15.52:3300/0 conn(0x7ff0b815e440 msgr2=0x7ff0b80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7f2200a00640 1 Processor -- start 2024-09-10T08:28:56.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 --2- 172.21.15.52:0/2576084289 >> v2:172.21.15.52:3300/0 conn(0x7ff0b815e440 0x7ff0b80d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 >> v1:172.21.15.176:6789/0 conn(0x7ff0b80b6710 legacy=0x7ff0b80b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b80d4230 con 0x7ff0b80cf450 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7ff0a8001670 con 0x7ff0b80cf450 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 >> v1:172.21.15.52:6789/0 conn(0x7ff0b80cf450 legacy=0x7ff0b80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c004c40 0x7ff09c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c0037a0 0x7ff09c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 0x7ff09c00ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80d3f50 con 0x7ff09c0037a0 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c00c0b0 con 0x7ff09c004160 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c00c2b0 con 0x7ff09c004c40 2024-09-10T08:28:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7ff0b7400640 1 --2- 172.21.15.52:0/2576084289 >> v2:172.21.15.52:3300/0 conn(0x7ff0b815e440 0x7ff0b80d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f151c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f151c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 0x7f1514140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7ff0b7e00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 0x7ff09c00ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f1519c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f1519c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53116/0 (socket says 172.21.15.52:53116) 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f1519c00640 1 -- 172.21.15.52:0/4168125213 learned_addr learned my addr 172.21.15.52:0/4168125213 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 0x7f15140cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7f1519200640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 0x7f1514140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7ff0b7400640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c004c40 0x7ff09c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f751be00640 1 -- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 msgr2=0x7f751404d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f751be00640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f751404d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f751be00640 1 -- 172.21.15.52:0/1259510163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7514035a80 msgr2=0x7f75140d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f751be00640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7514035a80 0x7f75140d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.739+0000 7f751be00640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75140d3120 con 0x7f75140e09c0 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15141462b0 con 0x7f15140b5f90 2024-09-10T08:28:56.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15140b4b60 con 0x7f1514145ed0 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1514146430 con 0x7f1514073180 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7f151a600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 0x7f15140cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7ff0aea00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c0037a0 0x7ff09c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7ff0b7e00640 1 -- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c004c40 msgr2=0x7ff09c005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7ff0b7e00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09c004c40 0x7ff09c005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.740+0000 7ff0b7e00640 1 -- 172.21.15.52:0/2576084289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c0037a0 msgr2=0x7ff09c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7ff0b7e00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c0037a0 0x7ff09c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f751be00640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 0x7f75140e3390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f751c065710 tx=0x7f751c069a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f151a600640 1 -- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 msgr2=0x7f151413a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f151a600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f151a600640 1 -- 172.21.15.52:0/4168125213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 msgr2=0x7f1514140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.738+0000 7f2200a00640 1 -- start start 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f2200a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21fc14c480 0x7f21fc163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f2200a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 0x7f21fc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f2200a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21fc164120 con 0x7f21fc073750 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f2200a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f21fc0732c0 con 0x7f21fc14c480 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f2200a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc0712a0 con 0x7f21fc073bc0 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f21f9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21fc14c480 0x7f21fc163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f21f9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21fc14c480 0x7f21fc163be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45544/0 (socket says 172.21.15.52:45544) 2024-09-10T08:28:56.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f21f9e00640 1 -- 172.21.15.52:0/2823875099 learned_addr learned my addr 172.21.15.52:0/2823875099 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f151a600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 0x7f1514140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f151a600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15141443a0 con 0x7f1514145ed0 2024-09-10T08:28:56.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7f1519c00640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f21fa800640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 0x7f21fc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.741+0000 7ff0b7e00640 1 -- 172.21.15.52:0/2576084289 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c003520 con 0x7ff09c004160 2024-09-10T08:28:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7ff0aea00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c0037a0 0x7ff09c003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0bd020 con 0x7f75140e09c0 2024-09-10T08:28:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751c0adb30 con 0x7f75140e09c0 2024-09-10T08:28:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c0b2040 con 0x7f75140e09c0 2024-09-10T08:28:56.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f1519200640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 0x7f1514140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751404f5a0 con 0x7f75140e09c0 2024-09-10T08:28:56.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.742+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f751404f1c0 con 0x7f75140e09c0 2024-09-10T08:28:56.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f21f9e00640 1 -- 172.21.15.52:0/2823875099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 msgr2=0x7f21fc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f151a600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 0x7f15140cec20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f150400c7b0 tx=0x7f150400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7ff0b7e00640 1 -- 172.21.15.52:0/2576084289 reap_dead start 2024-09-10T08:28:56.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f61bf000640 1 Processor -- start 2024-09-10T08:28:56.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f21f9e00640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 0x7f21fc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f21f9e00640 1 -- 172.21.15.52:0/2823875099 >> v1:172.21.15.52:6789/0 conn(0x7f21fc073750 legacy=0x7f21fc164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504017070 con 0x7f1514145ed0 2024-09-10T08:28:56.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1504003b70 con 0x7f1514145ed0 2024-09-10T08:28:56.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504005070 con 0x7f1514145ed0 2024-09-10T08:28:56.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f61bf000640 1 -- start start 2024-09-10T08:28:56.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1514144680 con 0x7f1514145ed0 2024-09-10T08:28:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f21f8a00640 1 -- 172.21.15.52:0/2823875099 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904199564 0 0) 0x7f21e8001110 con 0x7f21fc073750 2024-09-10T08:28:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.743+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1514144c40 con 0x7f1514145ed0 2024-09-10T08:28:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.744+0000 7ff0b7e00640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 0x7ff09c00ba40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000c160 tx=0x7ff09c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e77f7ea12c5300 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.744+0000 7f21f9e00640 1 -- 172.21.15.52:0/2823875099 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc072c70 con 0x7f21fc14c480 2024-09-10T08:28:56.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.744+0000 7f21fa800640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 0x7f21fc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:56.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.744+0000 7f61bf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 0x7f61b80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0001f10 con 0x7ff09c004160 2024-09-10T08:28:56.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f7517800640 1 Processor -- start 2024-09-10T08:28:56.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0032630 con 0x7ff09c004160 2024-09-10T08:28:56.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61bf000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 0x7f61b80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61bf000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b80d0e70 con 0x7f61b80d23b0 2024-09-10T08:28:56.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61bf000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f61b80d41c0 con 0x7f61b80b90e0 2024-09-10T08:28:56.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61bf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61b80d35b0 con 0x7f61b815ed20 2024-09-10T08:28:56.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15140b28f0 con 0x7f1514145ed0 2024-09-10T08:28:56.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61b7400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f61b80d23b0 0x7f61b80cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59314/0 (socket says 172.21.15.52:59314) 2024-09-10T08:28:56.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f61b7400640 1 -- 172.21.15.52:0/1191480697 learned_addr learned my addr 172.21.15.52:0/1191480697 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.745+0000 7f7517800640 1 -- start start 2024-09-10T08:28:56.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.746+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f751c0c0020 con 0x7f75140e09c0 2024-09-10T08:28:56.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.746+0000 7f21f9e00640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc163be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009870 tx=0x7f21ec02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27bdc44b9886357 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.746+0000 7ff0b6a00640 1 -- 172.21.15.52:0/2576084289 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0032a00 con 0x7ff09c004160 2024-09-10T08:28:56.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 -- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 msgr2=0x7ff09c00ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f21f8a00640 1 -- 172.21.15.52:0/2823875099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec037070 con 0x7f21fc14c480 2024-09-10T08:28:56.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 0x7ff09c00ba40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000c160 tx=0x7ff09c005830 comp rx=0 tx=0).stop 2024-09-10T08:28:56.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f21f8a00640 1 -- 172.21.15.52:0/2823875099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec032440 con 0x7f21fc14c480 2024-09-10T08:28:56.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f21f8a00640 1 -- 172.21.15.52:0/2823875099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec032810 con 0x7f21fc14c480 2024-09-10T08:28:56.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 -- 172.21.15.52:0/2576084289 shutdown_connections 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 --2- 172.21.15.52:0/2576084289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff09c004160 0x7ff09c00ba40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 -- 172.21.15.52:0/2576084289 >> 172.21.15.52:0/2576084289 conn(0x7ff0b8067f80 msgr2=0x7ff0b80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751404d5b0 con 0x7f75140e09c0 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.746+0000 7f61b7e00640 1 --2- 172.21.15.52:0/1191480697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 0x7f61b80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.746+0000 7f61bd000640 1 --2- 172.21.15.52:0/1191480697 >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 0x7f61b80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f61b6a00640 1 -- 172.21.15.52:0/1191480697 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213810744 0 0) 0x7f61a4001110 con 0x7f61b80d23b0 2024-09-10T08:28:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f61b6a00640 1 -- 172.21.15.52:0/1191480697 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f619c003520 con 0x7f61b80d23b0 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7ff0bd200640 1 -- 172.21.15.52:0/2576084289 shutdown_connections 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f61b7e00640 1 -- 172.21.15.52:0/1191480697 >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 msgr2=0x7f61b80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f61b7e00640 1 --2- 172.21.15.52:0/1191480697 >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 0x7f61b80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f61b7e00640 1 -- 172.21.15.52:0/1191480697 >> v1:172.21.15.176:6789/0 conn(0x7f61b80d23b0 legacy=0x7f61b80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f61b7e00640 1 -- 172.21.15.52:0/1191480697 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b80d3890 con 0x7f61b815ed20 2024-09-10T08:28:56.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f61bd000640 1 --2- 172.21.15.52:0/1191480697 >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 0x7f61b80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7517800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 0x7f75100b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7ff24e400640 1 Processor -- start 2024-09-10T08:28:56.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7517800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f75100d23b0 0x7f75100b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7517800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75100d0e70 con 0x7f751015ed20 2024-09-10T08:28:56.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7517800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f75100d41c0 con 0x7f75100b6970 2024-09-10T08:28:56.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.747+0000 7f7517800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f75100d35b0 con 0x7f75100d23b0 2024-09-10T08:28:56.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f30fb000640 1 Processor -- start 2024-09-10T08:28:56.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7ff24e400640 1 -- start start 2024-09-10T08:28:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f7514e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f751015ed20 0x7f75100b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59316/0 (socket says 172.21.15.52:59316) 2024-09-10T08:28:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f7514e00640 1 -- 172.21.15.52:0/2410943720 learned_addr learned my addr 172.21.15.52:0/2410943720 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f2200a00640 1 -- 172.21.15.52:0/2823875099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 msgr2=0x7f21fc163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f2200a00640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc163be0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009870 tx=0x7f21ec02a250 comp rx=0 tx=0).stop 2024-09-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f750fe00640 1 --2- 172.21.15.52:0/2410943720 >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 0x7f75100b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f750f400640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 0x7f74fc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f7515800640 1 --2- 172.21.15.52:0/2410943720 >> v2:172.21.15.176:3300/0 conn(0x7f75100d23b0 0x7f75100b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f30fb000640 1 -- start start 2024-09-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f751c127620 con 0x7f75140e09c0 2024-09-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7ff0bd200640 1 -- 172.21.15.52:0/2576084289 wait complete. 2024-09-10T08:28:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.748+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1504005210 con 0x7f1514145ed0 2024-09-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f751b400640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 0x7f74fc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f61b7e00640 1 --2- 172.21.15.52:0/1191480697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 0x7f61b80b6260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61a80097a0 tx=0x7f61a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c814dc1a82ac8ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.749+0000 7f2200a00640 1 -- 172.21.15.52:0/2823875099 shutdown_connections 2024-09-10T08:28:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f2200a00640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073bc0 0x7f21fc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f7515800640 1 -- 172.21.15.52:0/2410943720 >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 msgr2=0x7f75100b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f7515800640 1 --2- 172.21.15.52:0/2410943720 >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 0x7f75100b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f7515800640 1 -- 172.21.15.52:0/2410943720 >> v1:172.21.15.176:6789/0 conn(0x7f751015ed20 legacy=0x7f75100b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f7515800640 1 -- 172.21.15.52:0/2410943720 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100d3890 con 0x7f75100d23b0 2024-09-10T08:28:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f2200a00640 1 --2- 172.21.15.52:0/2823875099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc163be0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f750fe00640 1 --2- 172.21.15.52:0/2410943720 >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 0x7f75100b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f1511600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff0bd200640 1 Processor -- start 2024-09-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f2200a00640 1 -- 172.21.15.52:0/2823875099 >> 172.21.15.52:0/2823875099 conn(0x7f21fc0ccec0 msgr2=0x7f21fc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff0bd200640 1 -- start start 2024-09-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f150408a3c0 con 0x7f1514145ed0 2024-09-10T08:28:56.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff24e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff2480cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff24e400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2480d47e0 con 0x7ff2480d1da0 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff24e400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2480d4a80 con 0x7ff24815e950 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.750+0000 7ff24e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2480b8c20 con 0x7ff2480b87e0 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fb000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fb000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f40d0dc0 con 0x7f30f40b6790 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fb000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f40d2770 con 0x7f30f41629c0 2024-09-10T08:28:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fb000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30f4162da0 con 0x7f30f40d3e50 2024-09-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f751b400640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 0x7f74fc06e3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7508001800 tx=0x7f7508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7ff247400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff24815e950 0x7ff2480d1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59322/0 (socket says 172.21.15.52:59322) 2024-09-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7ff247400640 1 -- 172.21.15.52:0/267970891 learned_addr learned my addr 172.21.15.52:0/267970891 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:56.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f1519c00640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fa600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fa600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53136/0 (socket says 172.21.15.52:53136) 2024-09-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f30fa600640 1 -- 172.21.15.52:0/2119327169 learned_addr learned my addr 172.21.15.52:0/2119327169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f2200a00640 1 -- 172.21.15.52:0/2823875099 shutdown_connections 2024-09-10T08:28:56.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7f2200a00640 1 -- 172.21.15.52:0/2823875099 wait complete. 2024-09-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.751+0000 7ff247e00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff2480cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7f30fa600640 1 -- 172.21.15.52:0/2119327169 >> v1:172.21.15.176:6789/0 conn(0x7f30f41629c0 legacy=0x7f30f40b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7f7515800640 1 --2- 172.21.15.52:0/2410943720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100d23b0 0x7f75100b8610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75100d4130 tx=0x7f750802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3d49fefa9844c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7f30fa600640 1 -- 172.21.15.52:0/2119327169 >> v1:172.21.15.52:6789/0 conn(0x7f30f40b6790 legacy=0x7f30f40b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7f30fa600640 1 -- 172.21.15.52:0/2119327169 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f40d2a50 con 0x7f30f40d3e50 2024-09-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355410124 0 0) 0x7ff2480d47e0 con 0x7ff2480d1da0 2024-09-10T08:28:56.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff22c003520 con 0x7ff2480d1da0 2024-09-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7f1519c00640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 0x7f14f406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f150c035040 tx=0x7f150c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3575066547 0 0) 0x7ff22c003520 con 0x7ff2480d1da0 2024-09-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 msgr2=0x7ff2480cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff2480cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 >> v1:172.21.15.176:6789/0 conn(0x7ff24815e950 legacy=0x7ff2480d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff0bd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480d4d60 con 0x7ff2480d1da0 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7ff2340015c0 con 0x7ff2480d1da0 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 >> v1:172.21.15.52:6789/0 conn(0x7ff2480d1da0 legacy=0x7ff2480cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.752+0000 7ff246000640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22c003a30 0x7ff22c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246000640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff22c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246000640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004d40 0x7ff22c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480b8c20 con 0x7ff22c003a30 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c014390 con 0x7ff22c004d40 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff22c014590 con 0x7ff2480b87e0 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff247400640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22c003a30 0x7ff22c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246a00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff22c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff247e00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004d40 0x7ff22c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7f30fa600640 1 --2- 172.21.15.52:0/2119327169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f30e00098a0 tx=0x7f30e002a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4a0b7b1149f00f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45556/0 (socket says 172.21.15.52:45556) 2024-09-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff0bd200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b81f41a0 0x7ff0b815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246a00640 1 -- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004d40 msgr2=0x7ff22c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246a00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff22c004d40 0x7ff22c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.753+0000 7ff246a00640 1 -- 172.21.15.52:0/267970891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22c003a30 msgr2=0x7ff22c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff246a00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22c003a30 0x7ff22c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff246a00640 1 -- 172.21.15.52:0/267970891 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c003520 con 0x7ff2480b87e0 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff247400640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22c003a30 0x7ff22c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0b7400640 1 -- 172.21.15.52:0/3463748497 learned_addr learned my addr 172.21.15.52:0/3463748497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0aea00640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b81f41a0 0x7ff0b815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b80d4580 0x7ff0b80d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f30f3e00640 1 -- 172.21.15.52:0/2119327169 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0037070 con 0x7f30f40d3e50 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f30f3e00640 1 -- 172.21.15.52:0/2119327169 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e0032640 con 0x7f30f40d3e50 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f30f3e00640 1 -- 172.21.15.52:0/2119327169 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0032a10 con 0x7f30f40d3e50 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f61b6a00640 1 -- 172.21.15.52:0/1191480697 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8037070 con 0x7f61b815ed20 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f61b6a00640 1 -- 172.21.15.52:0/1191480697 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8032440 con 0x7f61b815ed20 2024-09-10T08:28:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7f61b6a00640 1 -- 172.21.15.52:0/1191480697 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8032810 con 0x7f61b815ed20 2024-09-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80b76c0 con 0x7ff09c004160 2024-09-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80b7540 con 0x7ff0b81f41a0 2024-09-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.754+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b80d3240 con 0x7ff0b80d4580 2024-09-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7e00640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b80d4580 0x7ff0b80d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7400640 1 -- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b80d4580 msgr2=0x7ff0b80d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7400640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b80d4580 0x7ff0b80d4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7400640 1 -- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b81f41a0 msgr2=0x7ff0b815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7400640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b81f41a0 0x7ff0b815f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7ff0b7400640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b815f950 con 0x7ff09c004160 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f750f400640 1 -- 172.21.15.52:0/2410943720 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508007740 con 0x7f75100d23b0 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f750f400640 1 -- 172.21.15.52:0/2410943720 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080078e0 con 0x7f75100d23b0 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f750f400640 1 -- 172.21.15.52:0/2410943720 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508007cb0 con 0x7f75100d23b0 2024-09-10T08:28:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f751c0c7070 con 0x7f75140e09c0 2024-09-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f61bf000640 1 -- 172.21.15.52:0/1191480697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 msgr2=0x7f61b80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f61bf000640 1 --2- 172.21.15.52:0/1191480697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 0x7f61b80b6260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61a80097a0 tx=0x7f61a802a180 comp rx=0 tx=0).stop 2024-09-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 -- 172.21.15.52:0/1191480697 shutdown_connections 2024-09-10T08:28:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 --2- 172.21.15.52:0/1191480697 >> v2:172.21.15.176:3300/0 conn(0x7f61b80b90e0 0x7f61b80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff0b7400640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00116f0 tx=0x7ff0a0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 --2- 172.21.15.52:0/1191480697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b815ed20 0x7f61b80b6260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 -- 172.21.15.52:0/1191480697 >> 172.21.15.52:0/1191480697 conn(0x7f61b80d1260 msgr2=0x7f61b80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 -- 172.21.15.52:0/1191480697 shutdown_connections 2024-09-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff246a00640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff22c004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff234000f80 tx=0x7ff22c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a53e72aa38bcd9d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f61bf000640 1 -- 172.21.15.52:0/1191480697 wait complete. 2024-09-10T08:28:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 -- 172.21.15.52:0/2410943720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100d23b0 msgr2=0x7f75100b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 --2- 172.21.15.52:0/2410943720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100d23b0 0x7f75100b8610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75100d4130 tx=0x7f750802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1504058d60 con 0x7f1514145ed0 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f30fb000640 1 -- 172.21.15.52:0/2119327169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 msgr2=0x7f30f40b7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.755+0000 7f30fb000640 1 --2- 172.21.15.52:0/2119327169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f30e00098a0 tx=0x7f30e002a2e0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f30fb000640 1 -- 172.21.15.52:0/2119327169 shutdown_connections 2024-09-10T08:28:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f30fb000640 1 --2- 172.21.15.52:0/2119327169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f40b7c40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f30fb000640 1 -- 172.21.15.52:0/2119327169 >> 172.21.15.52:0/2119327169 conn(0x7f30f40d1080 msgr2=0x7f30f40d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f30fb000640 1 -- 172.21.15.52:0/2119327169 shutdown_connections 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f30fb000640 1 -- 172.21.15.52:0/2119327169 wait complete. 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f2200a00640 1 Processor -- start 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234007af0 con 0x7ff2480b87e0 2024-09-10T08:28:56.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff234031600 con 0x7ff2480b87e0 2024-09-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff246000640 1 -- 172.21.15.52:0/267970891 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234031a30 con 0x7ff2480b87e0 2024-09-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 -- 172.21.15.52:0/2410943720 shutdown_connections 2024-09-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f2200a00640 1 -- start start 2024-09-10T08:28:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 --2- 172.21.15.52:0/2410943720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100d23b0 0x7f75100b8610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 --2- 172.21.15.52:0/2410943720 >> v2:172.21.15.52:3300/0 conn(0x7f75100b6970 0x7f75100b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7f7517800640 1 -- 172.21.15.52:0/2410943720 >> 172.21.15.52:0/2410943720 conn(0x7f75100d1260 msgr2=0x7f75100d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000f9c0 con 0x7ff09c004160 2024-09-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a000fb60 con 0x7ff09c004160 2024-09-10T08:28:56.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.757+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0015460 con 0x7ff09c004160 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073750 0x7f21fc166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21fc073bc0 0x7f21fc15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc071580 con 0x7f21fc14c480 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21fc070f70 con 0x7f21fc073bc0 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f2200a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21fc0b6350 con 0x7f21fc073750 2024-09-10T08:28:56.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f7517800640 1 -- 172.21.15.52:0/2410943720 shutdown_connections 2024-09-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f7517800640 1 -- 172.21.15.52:0/2410943720 wait complete. 2024-09-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b81f4740 con 0x7ff09c004160 2024-09-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b81f4d00 con 0x7ff09c004160 2024-09-10T08:28:56.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f61bf000640 1 Processor -- start 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f21fa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f21fa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45584/0 (socket says 172.21.15.52:45584) 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f21fa800640 1 -- 172.21.15.52:0/3140422393 learned_addr learned my addr 172.21.15.52:0/3140422393 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.759+0000 7f61bf000640 1 -- start start 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff24e400640 1 -- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 msgr2=0x7ff22c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff24e400640 1 --2- 172.21.15.52:0/267970891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2480b87e0 0x7ff22c004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff234000f80 tx=0x7ff22c005830 comp rx=0 tx=0).stop 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff247e00640 1 -- 172.21.15.52:0/267970891 reap_dead start 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff24e400640 1 -- 172.21.15.52:0/267970891 shutdown_connections 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7ff24e400640 1 -- 172.21.15.52:0/267970891 >> 172.21.15.52:0/267970891 conn(0x7ff248067b30 msgr2=0x7ff248067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7ff24e400640 1 -- 172.21.15.52:0/267970891 shutdown_connections 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 -- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073750 msgr2=0x7f21fc166340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073750 0x7f21fc166340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 -- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21fc073bc0 msgr2=0x7f21fc15da00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21fc073bc0 0x7f21fc15da00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 -- 172.21.15.52:0/3140422393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21fc1646f0 con 0x7f21fc14c480 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b80d4f40 con 0x7ff09c004160 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0a0015600 con 0x7ff09c004160 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7ff0afe00640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 0x7ff09406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff0a008b7e0 con 0x7ff09c004160 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f21fa800640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21f400cef0 tx=0x7f21f400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f401a070 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f400d860 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f400dc50 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21fc1649d0 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21fc164f90 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21fc163be0 con 0x7f21fc14c480 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7ff24e400640 1 -- 172.21.15.52:0/267970891 wait complete. 2024-09-10T08:28:56.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7ff24e400640 1 Processor -- start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7ff24e400640 1 -- start start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f7517800640 1 Processor -- start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f7517800640 1 -- start start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.758+0000 7f30fb000640 1 Processor -- start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.759+0000 7f30fb000640 1 -- start start 2024-09-10T08:28:56.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f30fb000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f30fb000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f4200370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f30fb000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f41629c0 0x7f30f40d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30fb000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30f40d3010 con 0x7f30f40b6790 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30fb000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30f40d3380 con 0x7f30f41629c0 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30fb000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f30f40d42c0 con 0x7f30f40d3e50 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30f9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30f9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45594/0 (socket says 172.21.15.52:45594) 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30f9c00640 1 -- 172.21.15.52:0/3941278249 learned_addr learned my addr 172.21.15.52:0/3941278249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30f9200640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f4200370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f30fa600640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f41629c0 0x7f30f40d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f30f9c00640 1 -- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 msgr2=0x7f30f4200370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f30f9c00640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f4200370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f30f9c00640 1 -- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f41629c0 msgr2=0x7f30f40d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f30f9c00640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f41629c0 0x7f30f40d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f30f9c00640 1 -- 172.21.15.52:0/3941278249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f40ce030 con 0x7f30f40b6790 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b80b90e0 0x7f61b814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b80d23b0 0x7f61b806ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d32a0 con 0x7f61b815ed20 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61b80d3e50 con 0x7f61b80d23b0 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.760+0000 7f61bf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61b815f100 con 0x7f61b80b90e0 2024-09-10T08:28:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f61bd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f61bd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45604/0 (socket says 172.21.15.52:45604) 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f61bd000640 1 -- 172.21.15.52:0/3461245277 learned_addr learned my addr 172.21.15.52:0/3461245277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.761+0000 7f61b7400640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b80d23b0 0x7f61b806ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f61bd000640 1 -- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b80b90e0 msgr2=0x7f61b814d2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f61bd000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b80b90e0 0x7f61b814d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f61bd000640 1 -- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b80d23b0 msgr2=0x7f61b806ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f61bd000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b80d23b0 0x7f61b806ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.762+0000 7f61bd000640 1 -- 172.21.15.52:0/3461245277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b814a7e0 con 0x7f61b815ed20 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.763+0000 7f61bd000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61b0015950 tx=0x7f61b0015e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f30f9c00640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c730 tx=0x7f30ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 0x7f75100abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 0x7f75100cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75100d32a0 con 0x7f75100d23b0 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75100d3e50 con 0x7f75100b6970 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7517800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f751015f100 con 0x7f751015ed20 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7515800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 0x7f75100cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7514e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7515800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 0x7f75100cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53210/0 (socket says 172.21.15.52:53210) 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7514e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41876/0 (socket says 172.21.15.52:41876) 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7f7515800640 1 -- 172.21.15.52:0/1645439475 learned_addr learned my addr 172.21.15.52:0/1645439475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.764+0000 7ff0aea00640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 0x7ff09406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f750fe00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 0x7f75100abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 -- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 msgr2=0x7f75100cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 0x7f75100cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 -- 172.21.15.52:0/1645439475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 msgr2=0x7f75100abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 0x7f75100abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 -- 172.21.15.52:0/1645439475 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100ac1a0 con 0x7f75100b6970 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f7514e00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f750400c440 tx=0x7f7504001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.765+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504017070 con 0x7f75100b6970 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7504005ce0 con 0x7f75100b6970 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040072d0 con 0x7f75100b6970 2024-09-10T08:28:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751006f310 con 0x7f75100b6970 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7ff24e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7ff24e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 0x7ff2480cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7ff24e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 0x7ff2481f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff24e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480cf9c0 con 0x7ff2481591a0 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff24e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2480cfb40 con 0x7ff2481f7e80 2024-09-10T08:28:56.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff24e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2480cfcc0 con 0x7ff248159580 2024-09-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751006f8d0 con 0x7f75100b6970 2024-09-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff247400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.766+0000 7ff0aea00640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 0x7ff09406e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b4e00 tx=0x7ff0a8016040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff247400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45636/0 (socket says 172.21.15.52:45636) 2024-09-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7ff247400640 1 -- 172.21.15.52:0/1310128122 learned_addr learned my addr 172.21.15.52:0/1310128122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:56.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.767+0000 7f750fe00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 0x7f75100abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247e00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 0x7ff2481f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff246a00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 0x7ff2480cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247400640 1 -- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 msgr2=0x7ff2480cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 0x7ff2480cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247400640 1 -- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 msgr2=0x7ff2481f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 0x7ff2481f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ec005290 con 0x7f75100b6970 2024-09-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247400640 1 -- 172.21.15.52:0/1310128122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480cc420 con 0x7ff2481591a0 2024-09-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff246a00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 0x7ff2480cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.768+0000 7ff247e00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 0x7ff2481f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.769+0000 7ff247400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2380018b0 tx=0x7ff238001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.769+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21f401d070 con 0x7f21fc14c480 2024-09-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.769+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f750401a070 con 0x7f75100b6970 2024-09-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.770+0000 7f750cc00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 0x7f74f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.770+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f750408a030 con 0x7f75100b6970 2024-09-10T08:28:56.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.771+0000 7f21f2000640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 0x7f21dc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.771+0000 7f750fe00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 0x7f74f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.771+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f21f408bc40 con 0x7f21fc14c480 2024-09-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7f21f9e00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 0x7f21dc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7f750fe00640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 0x7f74f006e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f75100b2e40 tx=0x7f74fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23800f9c0 con 0x7ff2481591a0 2024-09-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b001e070 con 0x7f61b815ed20 2024-09-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b814aac0 con 0x7f61b815ed20 2024-09-10T08:28:56.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.772+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2480cc700 con 0x7ff2481591a0 2024-09-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.773+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b80b5310 con 0x7f61b815ed20 2024-09-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.773+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2480cccc0 con 0x7ff2481591a0 2024-09-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.773+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0a0019030 con 0x7ff09c004160 2024-09-10T08:28:56.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.773+0000 7f21f9e00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 0x7f21dc06e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21ec034000 tx=0x7f21ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.774+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b80b7010 con 0x7f61b815ed20 2024-09-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.774+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2480cf2b0 con 0x7ff2481591a0 2024-09-10T08:28:56.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.776+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75100d0e70 con 0x7f75100b6970 2024-09-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff238018070 con 0x7ff2481591a0 2024-09-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec003b70 con 0x7f30f40b6790 2024-09-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec003d10 con 0x7f30f40b6790 2024-09-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00aa50 con 0x7f30f40b6790 2024-09-10T08:28:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21f4024020 con 0x7f21fc14c480 2024-09-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23800fd60 con 0x7ff2481591a0 2024-09-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f40ce310 con 0x7f30f40b6790 2024-09-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.781+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f40ce8d0 con 0x7f30f40b6790 2024-09-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.783+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0013c20 con 0x7f61b815ed20 2024-09-10T08:28:56.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.783+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0028060 con 0x7f61b815ed20 2024-09-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.783+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f40d2390 con 0x7f30f40b6790 2024-09-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.785+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2380133f0 con 0x7ff2481591a0 2024-09-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.787+0000 7ff23f400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 0x7ff22806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.787+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff23808b970 con 0x7ff2481591a0 2024-09-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.786+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61b0021070 con 0x7f61b815ed20 2024-09-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.787+0000 7f61afe00640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.787+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f61b0094170 con 0x7f61b815ed20 2024-09-10T08:28:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.788+0000 7ff246a00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 0x7ff22806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.788+0000 7f61b7e00640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.789+0000 7f61b7e00640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 0x7f619806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61a8034000 tx=0x7f61a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.789+0000 7ff246a00640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 0x7ff22806e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff234034000 tx=0x7ff23402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.790+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61b0062b90 con 0x7f61b815ed20 2024-09-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.800+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff23805a300 con 0x7ff2481591a0 2024-09-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.801+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30ec00abf0 con 0x7f30f40b6790 2024-09-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.802+0000 7f30f1600640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 0x7f30d406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.802+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f30ec08b670 con 0x7f30f40b6790 2024-09-10T08:28:56.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.807+0000 7f30f9200640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 0x7f30d406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.808+0000 7f30f9200640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 0x7f30d406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30e8000f60 tx=0x7f30e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:56.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:56.808+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30ec059a40 con 0x7f30f40b6790 2024-09-10T08:28:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.181+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f15140b5080 con 0x7f1514145ed0 2024-09-10T08:28:57.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.181+0000 7f1511600640 1 -- 172.21.15.52:0/4168125213 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1504058660 con 0x7f1514145ed0 2024-09-10T08:28:57.182 INFO:teuthology.orchestra.run.smithi052.stdout:64424509448 2024-09-10T08:28:57.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.185+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 msgr2=0x7f14f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.185+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f75140108d0 con 0x7f75140e09c0 2024-09-10T08:28:57.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 0x7f14f406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f150c035040 tx=0x7f150c02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:57.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 msgr2=0x7f15140cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 0x7f15140cec20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f150400c7b0 tx=0x7f150400cc70 comp rx=0 tx=0).stop 2024-09-10T08:28:57.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 shutdown_connections 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14f406be30 0x7f14f406e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1514145ed0 0x7f15140cec20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15140b5f90 0x7f1514140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 --2- 172.21.15.52:0/4168125213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1514073180 0x7f151413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.186+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 >> 172.21.15.52:0/4168125213 conn(0x7f15140ccec0 msgr2=0x7f15140cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.187+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 shutdown_connections 2024-09-10T08:28:57.188 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:57.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.187+0000 7f151c600640 1 -- 172.21.15.52:0/4168125213 wait complete. 2024-09-10T08:28:57.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.187+0000 7f750f400640 1 -- 172.21.15.52:0/1259510163 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7514038e80 con 0x7f75140e09c0 2024-09-10T08:28:57.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.190+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f74ec005580 con 0x7f75100b6970 2024-09-10T08:28:57.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.190+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 msgr2=0x7f74fc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.190+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 0x7f74fc06e3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7508001800 tx=0x7f7508009040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.190+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 msgr2=0x7f75140e3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.190+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 0x7f75140e3390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f751c065710 tx=0x7f751c069a70 comp rx=0 tx=0).stop 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f750cc00640 1 -- 172.21.15.52:0/1645439475 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7504058400 con 0x7f75100b6970 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 shutdown_connections 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06bf30 0x7f74fc06e3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75140e09c0 0x7f75140e3390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7514035a80 0x7f75140d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 --2- 172.21.15.52:0/1259510163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75140354c0 0x7f751404d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.191+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 >> 172.21.15.52:0/1259510163 conn(0x7f75140567b0 msgr2=0x7f7514034b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.192 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:57.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.192+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 shutdown_connections 2024-09-10T08:28:57.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.192+0000 7f7521000640 1 -- 172.21.15.52:0/1259510163 wait complete. 2024-09-10T08:28:57.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.194+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff0b80d3570 con 0x7ff09c004160 2024-09-10T08:28:57.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.194+0000 7ff0afe00640 1 -- 172.21.15.52:0/3463748497 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0a0059bb0 con 0x7ff09c004160 2024-09-10T08:28:57.195 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:57.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.195+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 msgr2=0x7f74f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.195+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 0x7f74f006e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f75100b2e40 tx=0x7f74fc008040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.195+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 msgr2=0x7f75101f89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.195+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f750400c440 tx=0x7f7504001e70 comp rx=0 tx=0).stop 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 shutdown_connections 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74f006be80 0x7f74f006e340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f751015ed20 0x7f75100cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75100d23b0 0x7f75100abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 --2- 172.21.15.52:0/1645439475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75100b6970 0x7f75101f89a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 >> 172.21.15.52:0/1645439475 conn(0x7f75100d1260 msgr2=0x7f75100b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 shutdown_connections 2024-09-10T08:28:57.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.196+0000 7f7517800640 1 -- 172.21.15.52:0/1645439475 wait complete. 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.198+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 msgr2=0x7ff09406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.198+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 0x7ff09406e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b4e00 tx=0x7ff0a8016040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.198+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 msgr2=0x7ff0b815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.198+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00116f0 tx=0x7ff0a0011bb0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 shutdown_connections 2024-09-10T08:28:57.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff09406bf00 0x7ff09406e3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0b80d4580 0x7ff0b80d4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0b81f41a0 0x7ff0b815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 --2- 172.21.15.52:0/3463748497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff09c004160 0x7ff0b815ab90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 >> 172.21.15.52:0/3463748497 conn(0x7ff0b8067f80 msgr2=0x7ff0b80b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 shutdown_connections 2024-09-10T08:28:57.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.199+0000 7ff0bd200640 1 -- 172.21.15.52:0/3463748497 wait complete. 2024-09-10T08:28:57.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.204+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f21fc0b2890 con 0x7f21fc14c480 2024-09-10T08:28:57.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.205+0000 7f21f2000640 1 -- 172.21.15.52:0/3140422393 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21f405a690 con 0x7f21fc14c480 2024-09-10T08:28:57.208 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.211+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f61b80b3f20 con 0x7f61b815ed20 2024-09-10T08:28:57.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.211+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 msgr2=0x7f21dc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.211+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 0x7f21dc06e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21ec034000 tx=0x7f21ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:28:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.211+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 msgr2=0x7f21fc160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.211+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21f400cef0 tx=0x7f21f400a710 comp rx=0 tx=0).stop 2024-09-10T08:28:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 shutdown_connections 2024-09-10T08:28:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21dc06bf00 0x7f21dc06e3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21fc14c480 0x7f21fc160150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21fc073bc0 0x7f21fc15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 --2- 172.21.15.52:0/3140422393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21fc073750 0x7f21fc166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 >> 172.21.15.52:0/3140422393 conn(0x7f21fc0ccec0 msgr2=0x7f21fc0cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 shutdown_connections 2024-09-10T08:28:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.212+0000 7f2200a00640 1 -- 172.21.15.52:0/3140422393 wait complete. 2024-09-10T08:28:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.213+0000 7f61afe00640 1 -- 172.21.15.52:0/3461245277 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61b0062490 con 0x7f61b815ed20 2024-09-10T08:28:57.214 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:57.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 msgr2=0x7f619806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 0x7f619806e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61a8034000 tx=0x7f61a802e000 comp rx=0 tx=0).stop 2024-09-10T08:28:57.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 msgr2=0x7f61b806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61b0015950 tx=0x7f61b0015e10 comp rx=0 tx=0).stop 2024-09-10T08:28:57.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 shutdown_connections 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f619806be30 0x7f619806e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61b815ed20 0x7f61b806f470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61b80d23b0 0x7f61b806ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 --2- 172.21.15.52:0/3461245277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61b80b90e0 0x7f61b814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 >> 172.21.15.52:0/3461245277 conn(0x7f61b80d1260 msgr2=0x7f61b80b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 shutdown_connections 2024-09-10T08:28:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.217+0000 7f61bf000640 1 -- 172.21.15.52:0/3461245277 wait complete. 2024-09-10T08:28:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.222+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff2480b60c0 con 0x7ff2481591a0 2024-09-10T08:28:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.222+0000 7ff23f400640 1 -- 172.21.15.52:0/1310128122 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff238059c00 con 0x7ff2481591a0 2024-09-10T08:28:57.226 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:57.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-09-10T08:28:57.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-09-10T08:28:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.226+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 msgr2=0x7ff22806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.226+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f30f40cad80 con 0x7f30f40b6790 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.226+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 0x7ff22806e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff234034000 tx=0x7ff23402f000 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.226+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 msgr2=0x7ff248202590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.226+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff2380018b0 tx=0x7ff238001d70 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 shutdown_connections 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff22806be60 0x7ff22806e320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2481f7e80 0x7ff2481f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff248159580 0x7ff2480cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 --2- 172.21.15.52:0/1310128122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2481591a0 0x7ff248202590 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 >> 172.21.15.52:0/1310128122 conn(0x7ff248067b30 msgr2=0x7ff2480b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 shutdown_connections 2024-09-10T08:28:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7ff24e400640 1 -- 172.21.15.52:0/1310128122 wait complete. 2024-09-10T08:28:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.227+0000 7f30f1600640 1 -- 172.21.15.52:0/3941278249 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30ec05dd40 con 0x7f30f40b6790 2024-09-10T08:28:57.230 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-10T08:28:57.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 msgr2=0x7f30d406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 0x7f30d406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f30e8000f60 tx=0x7f30e8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 msgr2=0x7f30f40cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c730 tx=0x7f30ec00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 shutdown_connections 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f30d406bf00 0x7f30d406e3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30f41629c0 0x7f30f40d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f30f40d3e50 0x7f30f4200370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 --2- 172.21.15.52:0/3941278249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30f40b6790 0x7f30f40cb6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 >> 172.21.15.52:0/3941278249 conn(0x7f30f40d1080 msgr2=0x7f30f40c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 shutdown_connections 2024-09-10T08:28:57.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:57.230+0000 7f30fb000640 1 -- 172.21.15.52:0/3941278249 wait complete. 2024-09-10T08:28:57.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-10T08:28:57.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-09-10T08:28:57.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-10T08:28:57.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-10T08:28:58.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T08:28:58.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T08:28:58.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T08:28:58.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T08:28:58.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T08:28:58.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T08:28:58.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T08:28:58.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T08:28:58.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.468+0000 7f8e99000640 1 Processor -- start 2024-09-10T08:28:58.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.468+0000 7f8e99000640 1 -- start start 2024-09-10T08:28:58.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 0x7f8e8c053a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8e8c053f40 0x7f8e8c03be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8c0e2f70 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8c0577a0 con 0x7f8e8c053f40 2024-09-10T08:28:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.470+0000 7f8e99000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c057a60 con 0x7f8e8c03c380 2024-09-10T08:28:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.472+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.472+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53232/0 (socket says 172.21.15.52:53232) 2024-09-10T08:28:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.472+0000 7f8e93e00640 1 -- 172.21.15.52:0/1180499225 learned_addr learned my addr 172.21.15.52:0/1180499225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.472+0000 7f8e92a00640 1 --2- 172.21.15.52:0/1180499225 >> v2:172.21.15.176:3300/0 conn(0x7f8e8c053f40 0x7f8e8c03be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.472+0000 7f8e93400640 1 --2- 172.21.15.52:0/1180499225 >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 0x7f8e8c053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e92a00640 1 -- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 msgr2=0x7f8e8c03c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e92a00640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e92a00640 1 -- 172.21.15.52:0/1180499225 >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 msgr2=0x7f8e8c053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e92a00640 1 --2- 172.21.15.52:0/1180499225 >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 0x7f8e8c053a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e92a00640 1 -- 172.21.15.52:0/1180499225 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c057d40 con 0x7f8e8c053f40 2024-09-10T08:28:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.474+0000 7f8e93400640 1 --2- 172.21.15.52:0/1180499225 >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 0x7f8e8c053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.475+0000 7f8e93e00640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:58.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.477+0000 7f8e92a00640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c053f40 0x7f8e8c03be40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c011e70 tx=0x7f8e8802a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4374f1fcd7a37447 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.477+0000 7f8e92000640 1 -- 172.21.15.52:0/1180499225 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88037070 con 0x7f8e8c053f40 2024-09-10T08:28:58.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.478+0000 7f8e92000640 1 -- 172.21.15.52:0/1180499225 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e8802ad80 con 0x7f8e8c053f40 2024-09-10T08:28:58.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.478+0000 7f8e92000640 1 -- 172.21.15.52:0/1180499225 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88032660 con 0x7f8e8c053f40 2024-09-10T08:28:58.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.479+0000 7f8e99000640 1 -- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c053f40 msgr2=0x7f8e8c03be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.479+0000 7f8e99000640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c053f40 0x7f8e8c03be40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c011e70 tx=0x7f8e8802a030 comp rx=0 tx=0).stop 2024-09-10T08:28:58.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.479+0000 7f8e99000640 1 -- 172.21.15.52:0/1180499225 shutdown_connections 2024-09-10T08:28:58.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c053f40 0x7f8e8c03be40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 --2- 172.21.15.52:0/1180499225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c03c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 --2- 172.21.15.52:0/1180499225 >> v2:172.21.15.52:3300/0 conn(0x7f8e8c0e2b90 0x7f8e8c053a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 -- 172.21.15.52:0/1180499225 >> 172.21.15.52:0/1180499225 conn(0x7f8e8c03a520 msgr2=0x7f8e8c03a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 -- 172.21.15.52:0/1180499225 shutdown_connections 2024-09-10T08:28:58.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.480+0000 7f8e99000640 1 -- 172.21.15.52:0/1180499225 wait complete. 2024-09-10T08:28:58.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.484+0000 7f8e99000640 1 Processor -- start 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.485+0000 7f8e99000640 1 -- start start 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 0x7f8e8c0e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c03cd10 con 0x7f8e8c053f40 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c058300 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.486+0000 7f8e99000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c03ce90 con 0x7f8e8c03c380 2024-09-10T08:28:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.488+0000 7f8e93400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.488+0000 7f8e93400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53248/0 (socket says 172.21.15.52:53248) 2024-09-10T08:28:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.488+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.488+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41908/0 (socket says 172.21.15.52:41908) 2024-09-10T08:28:58.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.488+0000 7f8e93e00640 1 -- 172.21.15.52:0/302980117 learned_addr learned my addr 172.21.15.52:0/302980117 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.489+0000 7f8e92a00640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 0x7f8e8c0e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e93e00640 1 -- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 msgr2=0x7f8e8c0ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e93e00640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e93e00640 1 -- 172.21.15.52:0/302980117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 msgr2=0x7f8e8c0e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e93e00640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 0x7f8e8c0e47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e93e00640 1 -- 172.21.15.52:0/302980117 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c0c7cc0 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.490+0000 7f8e92a00640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 0x7f8e8c0e47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:58.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.491+0000 7f8e93400640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:28:58.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.491+0000 7f8e93e00640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e94050d60 tx=0x7f8e940697d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.491+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94095670 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.492+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e94090070 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.492+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94095670 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.492+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c0de5f0 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.492+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c0c4d00 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.494+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c0d9ce0 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.496+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e940733e0 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.498+0000 7f8e87400640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 0x7f8e7406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.499+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8e94106940 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.499+0000 7f8e93400640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 0x7f8e7406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.500+0000 7f8e93400640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 0x7f8e7406e4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009af0 tx=0x7f8e80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.504+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e8c0d9ce0 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.540+0000 7fd1ea800640 1 Processor -- start 2024-09-10T08:28:58.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.540+0000 7fd1ea800640 1 -- start start 2024-09-10T08:28:58.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1ea800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 0x7fd1dc006200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1ea800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd1dc033a00 0x7fd1dc036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1ea800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1dc00b6c0 con 0x7fd1dc047c10 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1ea800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd1dc047780 con 0x7fd1dc0e6f80 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1ea800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd1dc00b9a0 con 0x7fd1dc033a00 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1e8a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd1dc047c10 0x7fd1dc006740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59342/0 (socket says 172.21.15.52:59342) 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1e8a00640 1 -- 172.21.15.52:0/2741045328 learned_addr learned my addr 172.21.15.52:0/2741045328 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1e9400640 1 --2- 172.21.15.52:0/2741045328 >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 0x7fd1dc006200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.542+0000 7fd1e9e00640 1 --2- 172.21.15.52:0/2741045328 >> v2:172.21.15.176:3300/0 conn(0x7fd1dc033a00 0x7fd1dc036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e3e00640 1 -- 172.21.15.52:0/2741045328 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946654141 0 0) 0x7fd1dc00b6c0 con 0x7fd1dc047c10 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e3e00640 1 -- 172.21.15.52:0/2741045328 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1cc003520 con 0x7fd1dc047c10 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e9e00640 1 -- 172.21.15.52:0/2741045328 >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 msgr2=0x7fd1dc006200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e9e00640 1 --2- 172.21.15.52:0/2741045328 >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 0x7fd1dc006200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e9e00640 1 -- 172.21.15.52:0/2741045328 >> v1:172.21.15.176:6789/0 conn(0x7fd1dc047c10 legacy=0x7fd1dc006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e9e00640 1 -- 172.21.15.52:0/2741045328 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc005ba0 con 0x7fd1dc033a00 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.543+0000 7fd1e9400640 1 --2- 172.21.15.52:0/2741045328 >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 0x7fd1dc006200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.544+0000 7fd1e9e00640 1 --2- 172.21.15.52:0/2741045328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc033a00 0x7fd1dc036020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4050d60 tx=0x7fd1e40a64b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa79614183de747e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.544+0000 7fd1e3e00640 1 -- 172.21.15.52:0/2741045328 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40b2070 con 0x7fd1dc033a00 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.544+0000 7fd1e3e00640 1 -- 172.21.15.52:0/2741045328 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e40ab7d0 con 0x7fd1dc033a00 2024-09-10T08:28:58.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.544+0000 7fd1e3e00640 1 -- 172.21.15.52:0/2741045328 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e40abc00 con 0x7fd1dc033a00 2024-09-10T08:28:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 -- 172.21.15.52:0/2741045328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc033a00 msgr2=0x7fd1dc036020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 --2- 172.21.15.52:0/2741045328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc033a00 0x7fd1dc036020 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4050d60 tx=0x7fd1e40a64b0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 -- 172.21.15.52:0/2741045328 shutdown_connections 2024-09-10T08:28:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 --2- 172.21.15.52:0/2741045328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc033a00 0x7fd1dc036020 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 --2- 172.21.15.52:0/2741045328 >> v2:172.21.15.52:3300/0 conn(0x7fd1dc0e6f80 0x7fd1dc006200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.546+0000 7fd1ea800640 1 -- 172.21.15.52:0/2741045328 >> 172.21.15.52:0/2741045328 conn(0x7fd1dc01d930 msgr2=0x7fd1dc0545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.547+0000 7fd1ea800640 1 -- 172.21.15.52:0/2741045328 shutdown_connections 2024-09-10T08:28:58.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.547+0000 7fd1ea800640 1 -- 172.21.15.52:0/2741045328 wait complete. 2024-09-10T08:28:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.550+0000 7fd1ea800640 1 Processor -- start 2024-09-10T08:28:58.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.550+0000 7fd1ea800640 1 -- start start 2024-09-10T08:28:58.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.551+0000 7fdba7400640 1 Processor -- start 2024-09-10T08:28:58.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.551+0000 7f4f2ae00640 1 Processor -- start 2024-09-10T08:28:58.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.551+0000 7fdba7400640 1 -- start start 2024-09-10T08:28:58.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.552+0000 7f4f2ae00640 1 -- start start 2024-09-10T08:28:58.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.552+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 0x7fd1dc04c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1e9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1ea800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc0e6f80 0x7fd1dc180150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1e9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45672/0 (socket says 172.21.15.52:45672) 2024-09-10T08:28:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1e9400640 1 -- 172.21.15.52:0/1890968241 learned_addr learned my addr 172.21.15.52:0/1890968241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7fd1e9e00640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc0e6f80 0x7fd1dc180150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7fdba7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdba014c480 0x7fdba0163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.553+0000 7fd1e8a00640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 0x7fd1dc04c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc0e7360 con 0x7fd1dc033a00 2024-09-10T08:28:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7f4f2ae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4f240cf5c0 0x7f4f240b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1dc006e50 con 0x7fd1dc0e6f80 2024-09-10T08:28:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1dc050d30 con 0x7fd1dc047c10 2024-09-10T08:28:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7f4f2ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7f4f2ae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f240b40a0 con 0x7f4f240cf9a0 2024-09-10T08:28:58.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7f4f2ae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4f240b4650 con 0x7f4f240cf5c0 2024-09-10T08:28:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.554+0000 7f4f2ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f240b4370 con 0x7f4f240b3c30 2024-09-10T08:28:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fdba7400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba0164120 con 0x7fdba0073750 2024-09-10T08:28:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7f4f2a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7f4f2a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53270/0 (socket says 172.21.15.52:53270) 2024-09-10T08:28:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7f4f2a400640 1 -- 172.21.15.52:0/2792989060 learned_addr learned my addr 172.21.15.52:0/2792989060 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fd1e9400640 1 -- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 msgr2=0x7fd1dc04c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fd1e9400640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 0x7fd1dc04c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fd1e9400640 1 -- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc0e6f80 msgr2=0x7fd1dc180150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fd1e9400640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc0e6f80 0x7fd1dc180150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fd1e9400640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1dc032fa0 con 0x7fd1dc033a00 2024-09-10T08:28:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7fd1e8a00640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 0x7fd1dc04c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:58.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fdba5400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdba0073bc0 0x7fdba006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59350/0 (socket says 172.21.15.52:59350) 2024-09-10T08:28:58.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7fdba5400640 1 -- 172.21.15.52:0/1841041257 learned_addr learned my addr 172.21.15.52:0/1841041257 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:58.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7f0166c00640 1 Processor -- start 2024-09-10T08:28:58.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fdba4a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdba014c480 0x7fdba0163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.555+0000 7fdb9fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdba0073750 0x7fdba0164650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48322/0 (socket says 172.21.15.52:48322) 2024-09-10T08:28:58.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7fd1e9400640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e9b0 tx=0x7fd1d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7f0166c00640 1 -- start start 2024-09-10T08:28:58.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00712a0 con 0x7fdba0073bc0 2024-09-10T08:28:58.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.556+0000 7f4f29a00640 1 --2- 172.21.15.52:0/2792989060 >> v2:172.21.15.52:3300/0 conn(0x7f4f240cf5c0 0x7f4f240b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00732c0 con 0x7fdba014c480 2024-09-10T08:28:58.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7f4f2a400640 1 -- 172.21.15.52:0/2792989060 >> v2:172.21.15.52:3300/0 conn(0x7f4f240cf5c0 msgr2=0x7f4f240b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7f4f2a400640 1 --2- 172.21.15.52:0/2792989060 >> v2:172.21.15.52:3300/0 conn(0x7f4f240cf5c0 0x7f4f240b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7f4f2a400640 1 -- 172.21.15.52:0/2792989060 >> v1:172.21.15.176:6789/0 conn(0x7f4f240cf9a0 legacy=0x7f4f241600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7f4f2a400640 1 -- 172.21.15.52:0/2792989060 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f240b4dc0 con 0x7f4f240b3c30 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781803454 0 0) 0x7fdba00712a0 con 0x7fdba0073bc0 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.557+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb84003520 con 0x7fdba0073bc0 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 662124936 0 0) 0x7fdb84003520 con 0x7fdba0073bc0 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8005990 con 0x7fd1dc033a00 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d8005b30 con 0x7fd1dc033a00 2024-09-10T08:28:58.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800c9a0 con 0x7fd1dc033a00 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7f4f2a400640 1 --2- 172.21.15.52:0/2792989060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009870 tx=0x7f4f1002a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21206352a63092a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 >> v2:172.21.15.52:3300/0 conn(0x7fdba014c480 msgr2=0x7fdba0163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 --2- 172.21.15.52:0/1841041257 >> v2:172.21.15.52:3300/0 conn(0x7fdba014c480 0x7fdba0163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 >> v1:172.21.15.52:6789/0 conn(0x7fdba0073750 legacy=0x7fdba0164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0072c70 con 0x7fdba0073bc0 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fdb980019f0 con 0x7fdba0073bc0 2024-09-10T08:28:58.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 >> v1:172.21.15.176:6789/0 conn(0x7fdba0073bc0 legacy=0x7fdba006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdb84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb840043b0 0x7fdb84004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84005080 0x7fdb8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00732c0 con 0x7fdb84005080 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8400bfe0 con 0x7fdb840039b0 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8400c1e0 con 0x7fdb840043b0 2024-09-10T08:28:58.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f4f23e00640 1 -- 172.21.15.52:0/2792989060 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10037070 con 0x7f4f240b3c30 2024-09-10T08:28:58.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.558+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1dc033280 con 0x7fd1dc033a00 2024-09-10T08:28:58.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1dc031ca0 con 0x7fd1dc033a00 2024-09-10T08:28:58.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f0166c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f0166c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f01600d23b0 0x7f01600b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f0166c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01600d0e70 con 0x7f016015ed20 2024-09-10T08:28:58.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f0166c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f01600d41c0 con 0x7f01600d23b0 2024-09-10T08:28:58.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f0166c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01600d35b0 con 0x7f01600b6970 2024-09-10T08:28:58.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.559+0000 7f4f23e00640 1 -- 172.21.15.52:0/2792989060 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f10032440 con 0x7f4f240b3c30 2024-09-10T08:28:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdb84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba5400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84005080 0x7fdb8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2792989060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 msgr2=0x7f4f24160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7f015f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7f015f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53296/0 (socket says 172.21.15.52:53296) 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7f015f400640 1 -- 172.21.15.52:0/3430032779 learned_addr learned my addr 172.21.15.52:0/3430032779 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 -- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb840043b0 msgr2=0x7fdb84004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb840043b0 0x7fdb84004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 -- 172.21.15.52:0/1841041257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84005080 msgr2=0x7fdb8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84005080 0x7fdb8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.560+0000 7fdba4a00640 1 -- 172.21.15.52:0/1841041257 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0072c70 con 0x7fdb840039b0 2024-09-10T08:28:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1dc006200 con 0x7fd1dc033a00 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f015f400640 1 -- 172.21.15.52:0/3430032779 >> v2:172.21.15.176:3300/0 conn(0x7f01600d23b0 msgr2=0x7f01600b8610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f015f400640 1 --2- 172.21.15.52:0/3430032779 >> v2:172.21.15.176:3300/0 conn(0x7f01600d23b0 0x7f01600b8610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f015f400640 1 -- 172.21.15.52:0/3430032779 >> v1:172.21.15.176:6789/0 conn(0x7f016015ed20 legacy=0x7f01600b6260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f015f400640 1 -- 172.21.15.52:0/3430032779 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01600d3890 con 0x7f01600b6970 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f23e00640 1 -- 172.21.15.52:0/2792989060 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10037070 con 0x7f4f240b3c30 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2792989060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009870 tx=0x7f4f1002a140 comp rx=0 tx=0).stop 2024-09-10T08:28:58.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2792989060 shutdown_connections 2024-09-10T08:28:58.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2792989060 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240b3c30 0x7f4f24160800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2792989060 >> v2:172.21.15.52:3300/0 conn(0x7f4f240cf5c0 0x7f4f240b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.561+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2792989060 >> 172.21.15.52:0/2792989060 conn(0x7f4f2406c240 msgr2=0x7f4f2406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.562+0000 7fdba5400640 1 -- 172.21.15.52:0/1841041257 reap_dead start 2024-09-10T08:28:58.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.562+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2792989060 shutdown_connections 2024-09-10T08:28:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.562+0000 7fdba4a00640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdb84003d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009ac0 tx=0x7fdb84005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a1715167a937fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.562+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2792989060 wait complete. 2024-09-10T08:28:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.563+0000 7f015f400640 1 --2- 172.21.15.52:0/3430032779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f014c009870 tx=0x7f014c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44a477e0010da22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.563+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90036070 con 0x7fdb840039b0 2024-09-10T08:28:58.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.563+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb90031400 con 0x7fdb840039b0 2024-09-10T08:28:58.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.563+0000 7fdb9f400640 1 -- 172.21.15.52:0/1841041257 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90009690 con 0x7fdb840039b0 2024-09-10T08:28:58.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.563+0000 7f015ea00640 1 -- 172.21.15.52:0/3430032779 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c037070 con 0x7f01600b6970 2024-09-10T08:28:58.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.564+0000 7f015ea00640 1 -- 172.21.15.52:0/3430032779 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c032440 con 0x7f01600b6970 2024-09-10T08:28:58.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.564+0000 7f015ea00640 1 -- 172.21.15.52:0/3430032779 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c032810 con 0x7f01600b6970 2024-09-10T08:28:58.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.564+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 msgr2=0x7fdb84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.564+0000 7fdba7400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdb84003d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009ac0 tx=0x7fdb84005830 comp rx=0 tx=0).stop 2024-09-10T08:28:58.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.564+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1d800cb40 con 0x7fd1dc033a00 2024-09-10T08:28:58.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 shutdown_connections 2024-09-10T08:28:58.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7fdba7400640 1 --2- 172.21.15.52:0/1841041257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdb84003d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 >> 172.21.15.52:0/1841041257 conn(0x7fdba00ccec0 msgr2=0x7fdba00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 shutdown_connections 2024-09-10T08:28:58.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7fdba7400640 1 -- 172.21.15.52:0/1841041257 wait complete. 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.566+0000 7f4f2ae00640 1 Processor -- start 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.566+0000 7f4f2ae00640 1 -- start start 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 -- 172.21.15.52:0/3430032779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 msgr2=0x7f01600b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 --2- 172.21.15.52:0/3430032779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f014c009870 tx=0x7f014c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 -- 172.21.15.52:0/3430032779 shutdown_connections 2024-09-10T08:28:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 --2- 172.21.15.52:0/3430032779 >> v2:172.21.15.176:3300/0 conn(0x7f01600d23b0 0x7f01600b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 --2- 172.21.15.52:0/3430032779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600b6970 0x7f01600b80d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 -- 172.21.15.52:0/3430032779 >> 172.21.15.52:0/3430032779 conn(0x7f01600d1260 msgr2=0x7f01600d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 -- 172.21.15.52:0/3430032779 shutdown_connections 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.565+0000 7f0166c00640 1 -- 172.21.15.52:0/3430032779 wait complete. 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.568+0000 7f0166c00640 1 Processor -- start 2024-09-10T08:28:58.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.568+0000 7fdba7400640 1 Processor -- start 2024-09-10T08:28:58.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.568+0000 7f0166c00640 1 -- start start 2024-09-10T08:28:58.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.568+0000 7fdba7400640 1 -- start start 2024-09-10T08:28:58.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7fd1e1600640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 0x7fd1c406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f4f2ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f240b3c30 0x7f4f241552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f4f2ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f4f2ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 0x7f4f241535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01600b6970 0x7f0160154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 0x7f0160160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 0x7f016015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01600d32a0 con 0x7f01600b6970 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01600d3e50 con 0x7f016015ed20 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0166c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f016015f100 con 0x7f01600d23b0 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f015f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 0x7f0160160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f015f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 0x7f0160160d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53302/0 (socket says 172.21.15.52:53302) 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f015f400640 1 -- 172.21.15.52:0/3826258309 learned_addr learned my addr 172.21.15.52:0/3826258309 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.570+0000 7f0164c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 0x7f016015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f0164c00640 1 -- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 msgr2=0x7f0160160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f0164c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 0x7f0160160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f0164c00640 1 -- 172.21.15.52:0/3826258309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01600b6970 msgr2=0x7f0160154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f0164c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01600b6970 0x7f0160154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7f0164c00640 1 -- 172.21.15.52:0/3826258309 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01601e9ad0 con 0x7f016015ed20 2024-09-10T08:28:58.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7fbaefe00640 1 Processor -- start 2024-09-10T08:28:58.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7fbaefe00640 1 -- start start 2024-09-10T08:28:58.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.571+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd1d808b220 con 0x7fd1dc033a00 2024-09-10T08:28:58.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7fd1e8a00640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 0x7fd1c406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7fdba7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdba0165b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7fdba7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 0x7fdba0164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f0164c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 0x7f016015d5c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f015800be50 tx=0x7f015800bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f4f29000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f4f2a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 0x7f4f241535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f4f29000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53306/0 (socket says 172.21.15.52:53306) 2024-09-10T08:28:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f2df8e00640 1 Processor -- start 2024-09-10T08:28:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f4f2a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 0x7f4f241535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41964/0 (socket says 172.21.15.52:41964) 2024-09-10T08:28:58.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f4f29a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f240b3c30 0x7f4f241552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7fdba4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdba0165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7fdba4a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdba0165b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41976/0 (socket says 172.21.15.52:41976) 2024-09-10T08:28:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158019070 con 0x7f016015ed20 2024-09-10T08:28:58.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158014440 con 0x7f016015ed20 2024-09-10T08:28:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.572+0000 7f2df8e00640 1 -- start start 2024-09-10T08:28:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4f24160d40 con 0x7f4f240b3c30 2024-09-10T08:28:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f240b5380 con 0x7f4f240cf9a0 2024-09-10T08:28:58.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fd1e8a00640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 0x7fd1c406e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc050fa0 tx=0x7fd1d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4f24160ec0 con 0x7f4f240cf5c0 2024-09-10T08:28:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158014830 con 0x7f016015ed20 2024-09-10T08:28:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01601e9230 con 0x7f016015ed20 2024-09-10T08:28:58.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01601e97f0 con 0x7f016015ed20 2024-09-10T08:28:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdba4a00640 1 -- 172.21.15.52:0/833616594 learned_addr learned my addr 172.21.15.52:0/833616594 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdb9fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 0x7fdba0164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdba7400640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba0164dd0 0x7fdba0165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7f4f29000640 1 -- 172.21.15.52:0/2747202261 learned_addr learned my addr 172.21.15.52:0/2747202261 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf00b6790 0x7fbaf00cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdba7400640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdba0071580 con 0x7fdba0164dd0 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fbaefe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbaf0162b70 0x7fbaf00d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fbaefe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf00cf5e0 con 0x7fbaf015e4c0 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fbaefe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf00cf8c0 con 0x7fbaf0162b70 2024-09-10T08:28:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fbaefe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf00d2980 con 0x7fbaf00b6790 2024-09-10T08:28:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdba7400640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdba0070f70 con 0x7fdb840039b0 2024-09-10T08:28:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.573+0000 7fdba7400640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdba00b6350 con 0x7fdba0166070 2024-09-10T08:28:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fbaee000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf00b6790 0x7fbaf00cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fcb4d600640 1 Processor -- start 2024-09-10T08:28:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fbaef400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbaf0162b70 0x7fbaf00d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fbaef400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbaf0162b70 0x7fbaf00d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41988/0 (socket says 172.21.15.52:41988) 2024-09-10T08:28:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fbaef400640 1 -- 172.21.15.52:0/3210011337 learned_addr learned my addr 172.21.15.52:0/3210011337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7f4f29000640 1 -- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 msgr2=0x7f4f241535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7f4f29000640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 0x7f4f241535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7f4f29000640 1 -- 172.21.15.52:0/2747202261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f240b3c30 msgr2=0x7f4f241552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7fbaef400640 1 -- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf00b6790 msgr2=0x7fbaf00cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7fbaef400640 1 --2- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf00b6790 0x7fbaf00cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7fbaef400640 1 -- 172.21.15.52:0/3210011337 >> v1:172.21.15.52:6789/0 conn(0x7fbaf015e4c0 legacy=0x7fbaf00b6080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:28:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f4f29000640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f240b3c30 0x7f4f241552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7fbaef400640 1 -- 172.21.15.52:0/3210011337 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf00d2c60 con 0x7fbaf0162b70 2024-09-10T08:28:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7f2df8e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2df406f6a0 0x7f2df415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f2df8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df40715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f2df8e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df40b4a60 con 0x7f2df4068cf0 2024-09-10T08:28:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f2df8e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2df406fe60 con 0x7f2df406f6a0 2024-09-10T08:28:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f2df8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2df40b4d40 con 0x7f2df406daf0 2024-09-10T08:28:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f4f29000640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f24153b00 con 0x7f4f240cf5c0 2024-09-10T08:28:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01600b7010 con 0x7f016015ed20 2024-09-10T08:28:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fdba5400640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba0164dd0 0x7fdba0165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fdb9fe00640 1 -- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 msgr2=0x7fdba0165b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fdb9fe00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdba0165b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fdb9fe00640 1 -- 172.21.15.52:0/833616594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba0164dd0 msgr2=0x7fdba0165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fdb9fe00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba0164dd0 0x7fdba0165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.575+0000 7fdb9fe00640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0143f80 con 0x7fdba0166070 2024-09-10T08:28:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7fdb9fe00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 0x7fdba0164890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c007fd0 tx=0x7fdb8c00cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7f2df1400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2df4068cf0 0x7f2df406d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48330/0 (socket says 172.21.15.52:48330) 2024-09-10T08:28:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7f2df1400640 1 -- 172.21.15.52:0/3041750499 learned_addr learned my addr 172.21.15.52:0/3041750499 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7f2df1e00640 1 --2- 172.21.15.52:0/3041750499 >> v2:172.21.15.52:3300/0 conn(0x7f2df406f6a0 0x7f2df415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7f4f29000640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c430 tx=0x7f4f1800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.576+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c018070 con 0x7fdba0166070 2024-09-10T08:28:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0072d0 con 0x7fdba0166070 2024-09-10T08:28:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0047e0 con 0x7fdba0166070 2024-09-10T08:28:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fbaef400640 1 --2- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf00d3180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009870 tx=0x7fbadc02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da5eafef937d15e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7f2df2800640 1 --2- 172.21.15.52:0/3041750499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df40715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18017070 con 0x7f4f240cf5c0 2024-09-10T08:28:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fdba7400640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba0144260 con 0x7fdba0166070 2024-09-10T08:28:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fdba7400640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba0144820 con 0x7fdba0166070 2024-09-10T08:28:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f24153d80 con 0x7f4f240cf5c0 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.574+0000 7fcb4d600640 1 -- start start 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb4d600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb480b2c70 0x7fcb481497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb4d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 0x7fcb480ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb4d600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480b36f0 con 0x7fcb481490b0 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb4d600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480ce630 con 0x7fcb480cdc80 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb4d600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480b4000 con 0x7fcb480b2c70 2024-09-10T08:28:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb47e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fcb481490b0 0x7fcb480b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:59394/0 (socket says 172.21.15.52:59394) 2024-09-10T08:28:58.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.577+0000 7fcb47e00640 1 -- 172.21.15.52:0/826943082 learned_addr learned my addr 172.21.15.52:0/826943082 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:28:58.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7fcb4cc00640 1 --2- 172.21.15.52:0/826943082 >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 0x7fcb480ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0158003a10 con 0x7f016015ed20 2024-09-10T08:28:58.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f180052d0 con 0x7f4f240cf5c0 2024-09-10T08:28:58.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f24154340 con 0x7f4f240cf5c0 2024-09-10T08:28:58.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18017070 con 0x7f4f240cf5c0 2024-09-10T08:28:58.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.579+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1d8017020 con 0x7fd1dc033a00 2024-09-10T08:28:58.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f2df2800640 1 -- 172.21.15.52:0/3041750499 >> v2:172.21.15.52:3300/0 conn(0x7f2df406f6a0 msgr2=0x7f2df415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f2df2800640 1 --2- 172.21.15.52:0/3041750499 >> v2:172.21.15.52:3300/0 conn(0x7f2df406f6a0 0x7f2df415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f2df2800640 1 -- 172.21.15.52:0/3041750499 >> v1:172.21.15.52:6789/0 conn(0x7f2df4068cf0 legacy=0x7f2df406d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.578+0000 7f2df2800640 1 -- 172.21.15.52:0/3041750499 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df40b5020 con 0x7f2df406daf0 2024-09-10T08:28:58.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.579+0000 7fcb47400640 1 --2- 172.21.15.52:0/826943082 >> v2:172.21.15.176:3300/0 conn(0x7fcb480b2c70 0x7fcb481497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.579+0000 7f0153e00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 0x7f014006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.579+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f00005290 con 0x7f4f240cf5c0 2024-09-10T08:28:58.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.579+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba0163be0 con 0x7fdba0166070 2024-09-10T08:28:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f015808b4a0 con 0x7f016015ed20 2024-09-10T08:28:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7f015fe00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 0x7f014006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7fcb47400640 1 -- 172.21.15.52:0/826943082 >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 msgr2=0x7fcb480ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7fcb47400640 1 --2- 172.21.15.52:0/826943082 >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 0x7fcb480ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7fcb47400640 1 -- 172.21.15.52:0/826943082 >> v1:172.21.15.176:6789/0 conn(0x7fcb481490b0 legacy=0x7fcb480b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7fcb47400640 1 -- 172.21.15.52:0/826943082 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48149490 con 0x7fcb480b2c70 2024-09-10T08:28:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.580+0000 7fcb4cc00640 1 --2- 172.21.15.52:0/826943082 >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 0x7fcb480ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.581+0000 7f2df2800640 1 --2- 172.21.15.52:0/3041750499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df40715e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2df406ffe0 tx=0x7f2dec02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91544d5625f3bd79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.581+0000 7fcb47400640 1 --2- 172.21.15.52:0/826943082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480b2c70 0x7fcb481497d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806f530 tx=0x7fcb4002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f6152ea5f905920 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.581+0000 7f015fe00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 0x7f014006e320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0154009650 tx=0x7f0154006ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb46a00640 1 -- 172.21.15.52:0/826943082 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40037070 con 0x7fcb480b2c70 2024-09-10T08:28:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb46a00640 1 -- 172.21.15.52:0/826943082 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40032440 con 0x7fcb480b2c70 2024-09-10T08:28:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb46a00640 1 -- 172.21.15.52:0/826943082 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40032810 con 0x7fcb480b2c70 2024-09-10T08:28:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fbaed600640 1 -- 172.21.15.52:0/3210011337 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc037070 con 0x7fbaf0162b70 2024-09-10T08:28:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fbaed600640 1 -- 172.21.15.52:0/3210011337 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc032440 con 0x7fbaf0162b70 2024-09-10T08:28:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fbaed600640 1 -- 172.21.15.52:0/3210011337 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc032810 con 0x7fbaf0162b70 2024-09-10T08:28:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01580597e0 con 0x7f016015ed20 2024-09-10T08:28:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 -- 172.21.15.52:0/826943082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480b2c70 msgr2=0x7fcb481497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 --2- 172.21.15.52:0/826943082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480b2c70 0x7fcb481497d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806f530 tx=0x7fcb4002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f1801a070 con 0x7f4f240cf5c0 2024-09-10T08:28:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 -- 172.21.15.52:0/826943082 shutdown_connections 2024-09-10T08:28:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 --2- 172.21.15.52:0/826943082 >> v2:172.21.15.52:3300/0 conn(0x7fcb480cdc80 0x7fcb480ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 --2- 172.21.15.52:0/826943082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480b2c70 0x7fcb481497d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.582+0000 7fcb4d600640 1 -- 172.21.15.52:0/826943082 >> 172.21.15.52:0/826943082 conn(0x7fcb4806c240 msgr2=0x7fcb4806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fcb4d600640 1 -- 172.21.15.52:0/826943082 shutdown_connections 2024-09-10T08:28:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fcb4d600640 1 -- 172.21.15.52:0/826943082 wait complete. 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 -- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 msgr2=0x7fbaf00d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 --2- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf00d3180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009870 tx=0x7fbadc02a210 comp rx=0 tx=0).stop 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 -- 172.21.15.52:0/3210011337 shutdown_connections 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 --2- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf00d3180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 --2- 172.21.15.52:0/3210011337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf00b6790 0x7fbaf00cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 -- 172.21.15.52:0/3210011337 >> 172.21.15.52:0/3210011337 conn(0x7fbaf00d1080 msgr2=0x7fbaf00d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.584+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb8c01b070 con 0x7fdba0166070 2024-09-10T08:28:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.584+0000 7f4f21600640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 0x7f4f0406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.584+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4f1808a100 con 0x7f4f240cf5c0 2024-09-10T08:28:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.583+0000 7fbaefe00640 1 -- 172.21.15.52:0/3210011337 shutdown_connections 2024-09-10T08:28:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.584+0000 7fbaefe00640 1 -- 172.21.15.52:0/3210011337 wait complete. 2024-09-10T08:28:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.585+0000 7f4f29a00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 0x7f4f0406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.585+0000 7fcb4d600640 1 Processor -- start 2024-09-10T08:28:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.585+0000 7fcb4d600640 1 -- start start 2024-09-10T08:28:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7f2df0a00640 1 -- 172.21.15.52:0/3041750499 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec007740 con 0x7f2df406daf0 2024-09-10T08:28:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480b2c70 0x7fcb4812e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480cdc80 0x7fcb48145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b3c90 con 0x7fcb480cdc80 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b39b0 con 0x7fcb481490b0 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb4d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480b4490 con 0x7fcb480b2c70 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fcb47400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480cdc80 0x7fcb48145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:42006/0 (socket says 172.21.15.52:42006) 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 -- 172.21.15.52:0/2434252553 learned_addr learned my addr 172.21.15.52:0/2434252553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 -- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480b2c70 msgr2=0x7fcb4812e2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480b2c70 0x7fcb4812e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 -- 172.21.15.52:0/2434252553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480cdc80 msgr2=0x7fcb48145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480cdc80 0x7fcb48145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 -- 172.21.15.52:0/2434252553 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48148920 con 0x7fcb481490b0 2024-09-10T08:28:58.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fdb9cc00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 0x7fdb8006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7fbaefe00640 1 Processor -- start 2024-09-10T08:28:58.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fbaefe00640 1 -- start start 2024-09-10T08:28:58.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdb8c08a240 con 0x7fdba0166070 2024-09-10T08:28:58.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fdba4a00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 0x7fdb8006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.586+0000 7f4f29a00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 0x7f4f0406e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c003b80 tx=0x7f4f1c0098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f24153b00 con 0x7f4f240cf5c0 2024-09-10T08:28:58.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.587+0000 7fcb4cc00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000e960 tx=0x7fcb3000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30017070 con 0x7fcb481490b0 2024-09-10T08:28:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb30004020 con 0x7fcb481490b0 2024-09-10T08:28:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30004410 con 0x7fcb481490b0 2024-09-10T08:28:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 0x7fbaf015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fdba4a00640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 0x7fdb8006e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb900098e0 tx=0x7fdb90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb48145780 con 0x7fcb481490b0 2024-09-10T08:28:58.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf0160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf015e8a0 con 0x7fbaf00b6790 2024-09-10T08:28:58.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0162f70 con 0x7fbaf0162b70 2024-09-10T08:28:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.588+0000 7fbaefe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf015ea20 con 0x7fbaf015e4c0 2024-09-10T08:28:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4812d7c0 con 0x7fcb481490b0 2024-09-10T08:28:58.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fbaeea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 0x7fbaf015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fbaee000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fbaef400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf0160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fbaee000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53358/0 (socket says 172.21.15.52:53358) 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.589+0000 7fbaee000640 1 -- 172.21.15.52:0/449929080 learned_addr learned my addr 172.21.15.52:0/449929080 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.590+0000 7fbaef400640 1 -- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 msgr2=0x7fbaf00cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaef400640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaef400640 1 -- 172.21.15.52:0/449929080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 msgr2=0x7fbaf015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaef400640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 0x7fbaf015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaef400640 1 -- 172.21.15.52:0/449929080 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01fc010 con 0x7fbaf0162b70 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaee000640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaeea00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 0x7fbaf015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fbaef400640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf0160c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbadc031000 tx=0x7fbadc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7f2df0a00640 1 -- 172.21.15.52:0/3041750499 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec0078e0 con 0x7f2df406daf0 2024-09-10T08:28:58.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb3000ca00 con 0x7fcb481490b0 2024-09-10T08:28:58.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc041020 con 0x7fbaf0162b70 2024-09-10T08:28:58.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7f2df0a00640 1 -- 172.21.15.52:0/3041750499 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec007cb0 con 0x7f2df406daf0 2024-09-10T08:28:58.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc030700 con 0x7fbaf0162b70 2024-09-10T08:28:58.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc037040 con 0x7fbaf0162b70 2024-09-10T08:28:58.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7f2df8e00640 1 -- 172.21.15.52:0/3041750499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 msgr2=0x7f2df40715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3041750499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df40715e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2df406ffe0 tx=0x7f2dec02a5b0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.592+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 0x7fcb2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcb3008ad70 con 0x7fcb481490b0 2024-09-10T08:28:58.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48069400 con 0x7fcb481490b0 2024-09-10T08:28:58.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf01fc2f0 con 0x7fbaf0162b70 2024-09-10T08:28:58.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01fc8b0 con 0x7fbaf0162b70 2024-09-10T08:28:58.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.593+0000 7f2df8e00640 1 -- 172.21.15.52:0/3041750499 shutdown_connections 2024-09-10T08:28:58.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.591+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdba0164120 con 0x7fdba0166070 2024-09-10T08:28:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.594+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3041750499 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df40715e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.594+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3041750499 >> v2:172.21.15.52:3300/0 conn(0x7f2df406f6a0 0x7f2df415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.594+0000 7f2df8e00640 1 -- 172.21.15.52:0/3041750499 >> 172.21.15.52:0/3041750499 conn(0x7f2df406c240 msgr2=0x7f2df40b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.594+0000 7fcb47e00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 0x7fcb2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.595+0000 7f2df8e00640 1 -- 172.21.15.52:0/3041750499 shutdown_connections 2024-09-10T08:28:58.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.595+0000 7f2df8e00640 1 -- 172.21.15.52:0/3041750499 wait complete. 2024-09-10T08:28:58.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.595+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf00cef50 con 0x7fbaf0162b70 2024-09-10T08:28:58.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.596+0000 7fcb47e00640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 0x7fcb2406e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb380012e0 tx=0x7fcb38001510 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.597+0000 7f2df8e00640 1 Processor -- start 2024-09-10T08:28:58.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.598+0000 7f2df8e00640 1 -- start start 2024-09-10T08:28:58.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb48069400 con 0x7fcb481490b0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 0x7f2df415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df41fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2df40b5420 con 0x7f2df4068cf0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2df415ab20 con 0x7f2df406f6a0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.599+0000 7f2df8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2df40b55a0 con 0x7f2df406daf0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.600+0000 7f2df2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.600+0000 7f2df2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:42010/0 (socket says 172.21.15.52:42010) 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.600+0000 7f2df2800640 1 -- 172.21.15.52:0/3316919145 learned_addr learned my addr 172.21.15.52:0/3316919145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.601+0000 7f2df1e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 0x7f2df415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.601+0000 7f2df1400640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df41fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.602+0000 7f2df2800640 1 -- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 msgr2=0x7f2df41fbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.603+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbadc044020 con 0x7fbaf0162b70 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.602+0000 7f2df2800640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df41fbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.602+0000 7f2df2800640 1 -- 172.21.15.52:0/3316919145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 msgr2=0x7f2df415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.603+0000 7f2df2800640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 0x7f2df415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.603+0000 7f2df2800640 1 -- 172.21.15.52:0/3316919145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df40aafa0 con 0x7f2df406f6a0 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.603+0000 7f2df1e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 0x7f2df415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.603+0000 7f2df1400640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df41fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.604+0000 7f2df2800640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009e50 tx=0x7f2dec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec040070 con 0x7f2df406f6a0 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec031bf0 con 0x7f2df406f6a0 2024-09-10T08:28:58.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec009450 con 0x7f2df406f6a0 2024-09-10T08:28:58.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df40ab280 con 0x7f2df406f6a0 2024-09-10T08:28:58.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7fbae7400640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 0x7fbad006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.605+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbadc0ab8b0 con 0x7fbaf0162b70 2024-09-10T08:28:58.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.606+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbadc04b030 con 0x7fbaf0162b70 2024-09-10T08:28:58.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.606+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df415e8e0 con 0x7f2df406f6a0 2024-09-10T08:28:58.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.606+0000 7fbaeea00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 0x7fbad006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.608+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df40b5990 con 0x7f2df406f6a0 2024-09-10T08:28:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.609+0000 7fbaeea00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 0x7fbad006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbae800f2e0 tx=0x7fbae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.611+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dec039040 con 0x7f2df406f6a0 2024-09-10T08:28:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.613+0000 7f2dea000640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 0x7f2dd406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.613+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2dec0ace70 con 0x7f2df406f6a0 2024-09-10T08:28:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.613+0000 7f2df1e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 0x7f2dd406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:58.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.615+0000 7f2df1e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 0x7f2dd406e370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e90 tx=0x7f2de4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:58.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.615+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2dec07b890 con 0x7f2df406f6a0 2024-09-10T08:28:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.923+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8e8c03be40 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.924+0000 7f8e87400640 1 -- 172.21.15.52:0/302980117 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e9409c030 con 0x7f8e8c0e2b90 2024-09-10T08:28:58.925 INFO:teuthology.orchestra.run.smithi052.stdout:64424509449 2024-09-10T08:28:58.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.928+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 msgr2=0x7f8e7406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.929+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 0x7f8e7406e4f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009af0 tx=0x7f8e80008040 comp rx=0 tx=0).stop 2024-09-10T08:28:58.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.929+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 msgr2=0x7f8e8c0e4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.929+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e94050d60 tx=0x7f8e940697d0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.929+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 shutdown_connections 2024-09-10T08:28:58.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.929+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e7406c030 0x7f8e7406e4f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.930+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e8c0e2b90 0x7f8e8c0e4ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.930+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c053f40 0x7f8e8c0e47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.930+0000 7f8e99000640 1 --2- 172.21.15.52:0/302980117 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e8c03c380 0x7f8e8c0ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.930+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 >> 172.21.15.52:0/302980117 conn(0x7f8e8c03a520 msgr2=0x7f8e8c038770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.930+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 shutdown_connections 2024-09-10T08:28:58.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.931+0000 7f8e99000640 1 -- 172.21.15.52:0/302980117 wait complete. 2024-09-10T08:28:58.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-10T08:28:58.955 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:58.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.976+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f016015c8e0 con 0x7f016015ed20 2024-09-10T08:28:58.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.977+0000 7f0153e00640 1 -- 172.21.15.52:0/3826258309 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f015805dae0 con 0x7f016015ed20 2024-09-10T08:28:58.976 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 msgr2=0x7f014006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 0x7f014006e320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0154009650 tx=0x7f0154006ba0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 msgr2=0x7f016015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:58.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 0x7f016015d5c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f015800be50 tx=0x7f015800bf40 comp rx=0 tx=0).stop 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 shutdown_connections 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014006be60 0x7f014006e320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f016015ed20 0x7f016015d5c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01600d23b0 0x7f0160160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 --2- 172.21.15.52:0/3826258309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01600b6970 0x7f0160154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:58.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 >> 172.21.15.52:0/3826258309 conn(0x7f01600d1260 msgr2=0x7f01600cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 shutdown_connections 2024-09-10T08:28:58.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:58.979+0000 7f0166c00640 1 -- 172.21.15.52:0/3826258309 wait complete. 2024-09-10T08:28:58.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-10T08:28:58.995 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.001+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1dc0321d0 con 0x7fd1dc033a00 2024-09-10T08:28:59.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.002+0000 7fd1e1600640 1 -- 172.21.15.52:0/1890968241 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1d8059bb0 con 0x7fd1dc033a00 2024-09-10T08:28:59.001 INFO:teuthology.orchestra.run.smithi052.stdout:64424509448 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.005+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 msgr2=0x7fd1c406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.005+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 0x7fd1c406e3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc050fa0 tx=0x7fd1d0009040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.005+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 msgr2=0x7fd1dc04c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.005+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e9b0 tx=0x7fd1d800ee70 comp rx=0 tx=0).stop 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.005+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 shutdown_connections 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1c406bf00 0x7fd1c406e3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1dc0e6f80 0x7fd1dc180150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1dc047c10 0x7fd1dc04c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 --2- 172.21.15.52:0/1890968241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1dc033a00 0x7fd1dc04c300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 >> 172.21.15.52:0/1890968241 conn(0x7fd1dc01d930 msgr2=0x7fd1dc0066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 shutdown_connections 2024-09-10T08:28:59.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.006+0000 7fd1ea800640 1 -- 172.21.15.52:0/1890968241 wait complete. 2024-09-10T08:28:59.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.013+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdba00cdbf0 con 0x7fdba0166070 2024-09-10T08:28:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.014+0000 7fdb9cc00640 1 -- 172.21.15.52:0/833616594 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdb8c058610 con 0x7fdba0166070 2024-09-10T08:28:59.014 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:59.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.015+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4f00005850 con 0x7f4f240cf5c0 2024-09-10T08:28:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.016+0000 7f4f21600640 1 -- 172.21.15.52:0/2747202261 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4f18058440 con 0x7f4f240cf5c0 2024-09-10T08:28:59.015 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-10T08:28:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbaf00ba580 con 0x7fbaf0162b70 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 msgr2=0x7fdb8006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 0x7fdb8006e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdb900098e0 tx=0x7fdb90008030 comp rx=0 tx=0).stop 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 msgr2=0x7fdba0164890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 0x7fdba0164890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c007fd0 tx=0x7fdb8c00cbe0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.017+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 shutdown_connections 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb8006bf00 0x7fdb8006e3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdba0164dd0 0x7fdba0165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdba0166070 0x7fdba0164890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 --2- 172.21.15.52:0/833616594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb840039b0 0x7fdba0165b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 >> 172.21.15.52:0/833616594 conn(0x7fdba00ccec0 msgr2=0x7fdba006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 shutdown_connections 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fbae7400640 1 -- 172.21.15.52:0/449929080 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbadc079c80 con 0x7fbaf0162b70 2024-09-10T08:28:59.018 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:59.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7fdb96000640 1 -- 172.21.15.52:0/833616594 wait complete. 2024-09-10T08:28:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 msgr2=0x7f4f0406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 0x7f4f0406e4f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c003b80 tx=0x7f4f1c0098d0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 msgr2=0x7f4f2414f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.018+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c430 tx=0x7f4f1800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 shutdown_connections 2024-09-10T08:28:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4f0406c030 0x7f4f0406e4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f240cf9a0 0x7f4f241535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f240cf5c0 0x7f4f2414f930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 --2- 172.21.15.52:0/2747202261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f240b3c30 0x7f4f241552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 >> 172.21.15.52:0/2747202261 conn(0x7f4f2406c240 msgr2=0x7f4f240cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 shutdown_connections 2024-09-10T08:28:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.019+0000 7f4f2ae00640 1 -- 172.21.15.52:0/2747202261 wait complete. 2024-09-10T08:28:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 msgr2=0x7fbad006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 0x7fbad006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbae800f2e0 tx=0x7fbae8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 msgr2=0x7fbaf0160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf0160c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbadc031000 tx=0x7fbadc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 shutdown_connections 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbad006bf00 0x7fbad006e3c0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbae800f2e0 tx=0x7fbae8009040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbaf0162b70 0x7fbaf0160c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbaf015e4c0 0x7fbaf00cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 --2- 172.21.15.52:0/449929080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaf00b6790 0x7fbaf015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 >> 172.21.15.52:0/449929080 conn(0x7fbaf00d1080 msgr2=0x7fbaf00b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 shutdown_connections 2024-09-10T08:28:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.021+0000 7fbaefe00640 1 -- 172.21.15.52:0/449929080 wait complete. 2024-09-10T08:28:59.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.026+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcb4812d5b0 con 0x7fcb481490b0 2024-09-10T08:28:59.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-10T08:28:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.026+0000 7fcb3fe00640 1 -- 172.21.15.52:0/2434252553 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb30059680 con 0x7fcb481490b0 2024-09-10T08:28:59.026 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.026 INFO:teuthology.orchestra.run.smithi052.stdout:64424509447 2024-09-10T08:28:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.030+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 msgr2=0x7fcb2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.030+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 0x7fcb2406e320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcb380012e0 tx=0x7fcb38001510 comp rx=0 tx=0).stop 2024-09-10T08:28:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.030+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 msgr2=0x7fcb4812b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000e960 tx=0x7fcb3000ee20 comp rx=0 tx=0).stop 2024-09-10T08:28:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 shutdown_connections 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be60 0x7fcb2406e320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb481490b0 0x7fcb4812b580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480cdc80 0x7fcb48145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 --2- 172.21.15.52:0/2434252553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480b2c70 0x7fcb4812e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 >> 172.21.15.52:0/2434252553 conn(0x7fcb4806c240 msgr2=0x7fcb4806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 shutdown_connections 2024-09-10T08:28:59.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.031+0000 7fcb4d600640 1 -- 172.21.15.52:0/2434252553 wait complete. 2024-09-10T08:28:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.034+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2df414cb50 con 0x7f2df406f6a0 2024-09-10T08:28:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.034+0000 7f2dea000640 1 -- 172.21.15.52:0/3316919145 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2dec07b190 con 0x7f2df406f6a0 2024-09-10T08:28:59.034 INFO:teuthology.orchestra.run.smithi052.stdout:60129542150 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 msgr2=0x7f2dd406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 0x7f2dd406e370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e90 tx=0x7f2de4009190 comp rx=0 tx=0).stop 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 msgr2=0x7f2df41fc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009e50 tx=0x7f2dec004a40 comp rx=0 tx=0).stop 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 shutdown_connections 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2dd406beb0 0x7f2dd406e370 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e90 tx=0x7f2de4009190 comp rx=0 tx=0).stop 2024-09-10T08:28:59.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2df406f6a0 0x7f2df41fc3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2df406daf0 0x7f2df41fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 --2- 172.21.15.52:0/3316919145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df4068cf0 0x7f2df415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 >> 172.21.15.52:0/3316919145 conn(0x7f2df406c240 msgr2=0x7f2df40afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.038+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 shutdown_connections 2024-09-10T08:28:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.039+0000 7f2df8e00640 1 -- 172.21.15.52:0/3316919145 wait complete. 2024-09-10T08:28:59.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-10T08:28:59.040 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-10T08:28:59.042 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-10T08:28:59.042 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-10T08:28:59.050 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-10T08:28:59.055 DEBUG:teuthology.parallel:result is None 2024-09-10T08:28:59.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:28:59.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:59.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.252+0000 7f4957a00640 1 Processor -- start 2024-09-10T08:28:59.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.252+0000 7f4957a00640 1 -- start start 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.253+0000 7f4957a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49500b2d40 0x7f495006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.253+0000 7f4957a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f495013eb20 0x7f495006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4957a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4950071180 con 0x7f495015bcf0 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4957a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f495015c890 con 0x7f49500b2d40 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4957a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4950071ab0 con 0x7f495013eb20 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49500b2d40 0x7f495006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f49500b2d40 0x7f495006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45792/0 (socket says 172.21.15.52:45792) 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 -- 172.21.15.52:0/3398606608 learned_addr learned my addr 172.21.15.52:0/3398606608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:59.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f495015bcf0 0x7f495015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48344/0 (socket says 172.21.15.52:48344) 2024-09-10T08:28:59.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f494fe00640 1 --2- 172.21.15.52:0/3398606608 >> v2:172.21.15.176:3300/0 conn(0x7f495013eb20 0x7f495006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 -- 172.21.15.52:0/3398606608 >> v2:172.21.15.176:3300/0 conn(0x7f495013eb20 msgr2=0x7f495006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 --2- 172.21.15.52:0/3398606608 >> v2:172.21.15.176:3300/0 conn(0x7f495013eb20 0x7f495006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 -- 172.21.15.52:0/3398606608 >> v1:172.21.15.52:6789/0 conn(0x7f495015bcf0 legacy=0x7f495015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.254+0000 7f4955000640 1 -- 172.21.15.52:0/3398606608 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4950071460 con 0x7f49500b2d40 2024-09-10T08:28:59.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.255+0000 7f4955000640 1 --2- 172.21.15.52:0/3398606608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f495006bc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49500d1500 tx=0x7f494402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50af0df8e6c45ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.255+0000 7f494f400640 1 -- 172.21.15.52:0/3398606608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944037070 con 0x7f49500b2d40 2024-09-10T08:28:59.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.255+0000 7f494f400640 1 -- 172.21.15.52:0/3398606608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4944032440 con 0x7f49500b2d40 2024-09-10T08:28:59.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f494f400640 1 -- 172.21.15.52:0/3398606608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944032810 con 0x7f49500b2d40 2024-09-10T08:28:59.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 -- 172.21.15.52:0/3398606608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 msgr2=0x7f495006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 --2- 172.21.15.52:0/3398606608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f495006bc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f49500d1500 tx=0x7f494402a270 comp rx=0 tx=0).stop 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 -- 172.21.15.52:0/3398606608 shutdown_connections 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 --2- 172.21.15.52:0/3398606608 >> v2:172.21.15.176:3300/0 conn(0x7f495013eb20 0x7f495006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 --2- 172.21.15.52:0/3398606608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f495006bc10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 -- 172.21.15.52:0/3398606608 >> 172.21.15.52:0/3398606608 conn(0x7f49500ccec0 msgr2=0x7f49500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 -- 172.21.15.52:0/3398606608 shutdown_connections 2024-09-10T08:28:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.256+0000 7f4957a00640 1 -- 172.21.15.52:0/3398606608 wait complete. 2024-09-10T08:28:59.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.258+0000 7f4957a00640 1 Processor -- start 2024-09-10T08:28:59.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.258+0000 7f4957a00640 1 -- start start 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495013eb20 0x7f4950154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f495015bcf0 0x7f495015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49500720c0 con 0x7f49500b2d40 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4950071f40 con 0x7f495013eb20 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4957a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4950072240 con 0x7f495015bcf0 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45800/0 (socket says 172.21.15.52:45800) 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 -- 172.21.15.52:0/3308839258 learned_addr learned my addr 172.21.15.52:0/3308839258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f495015bcf0 0x7f495015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 -- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f495015bcf0 msgr2=0x7f495015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f494fe00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495013eb20 0x7f4950154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f495015bcf0 0x7f495015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 -- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495013eb20 msgr2=0x7f4950154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495013eb20 0x7f4950154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.259+0000 7f4955000640 1 -- 172.21.15.52:0/3308839258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495015cb60 con 0x7f49500b2d40 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f4955000640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f494402a2b0 tx=0x7f49440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944041020 con 0x7f49500b2d40 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49440306c0 con 0x7f49500b2d40 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49501f2de0 con 0x7f49500b2d40 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944037040 con 0x7f49500b2d40 2024-09-10T08:28:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.260+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49501f33a0 con 0x7f49500b2d40 2024-09-10T08:28:59.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.261+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495015c180 con 0x7f49500b2d40 2024-09-10T08:28:59.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.262+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4944044020 con 0x7f49500b2d40 2024-09-10T08:28:59.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.263+0000 7f494cc00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.263+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f49440ab700 con 0x7f49500b2d40 2024-09-10T08:28:59.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.264+0000 7f494fe00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.264+0000 7f494fe00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 0x7f493006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4950158c20 tx=0x7f493c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.268+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f494404b030 con 0x7f49500b2d40 2024-09-10T08:28:59.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.448+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f495006c000 con 0x7f493006be30 2024-09-10T08:28:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.454+0000 7f494cc00640 1 -- 172.21.15.52:0/3308839258 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f495006c000 con 0x7f493006be30 2024-09-10T08:28:59.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:59.457 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 msgr2=0x7f493006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 0x7f493006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4950158c20 tx=0x7f493c008040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 msgr2=0x7f49501f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f494402a2b0 tx=0x7f49440046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 shutdown_connections 2024-09-10T08:28:59.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f495015bcf0 0x7f495015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f495013eb20 0x7f4950154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 --2- 172.21.15.52:0/3308839258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49500b2d40 0x7f49501f2730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 >> 172.21.15.52:0/3308839258 conn(0x7f49500ccec0 msgr2=0x7f495013dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.458+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 shutdown_connections 2024-09-10T08:28:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.459+0000 7f4957a00640 1 -- 172.21.15.52:0/3308839258 wait complete. 2024-09-10T08:28:59.473 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-10T08:28:57.453400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235860,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738860,"statfs":{"total":773094113280,"available":772852592640,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.980275"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495538+0000","last_change":"2024-09-10T08:28:45.504174+0000","last_active":"2024-09-10T08:28:46.495538+0000","last_peered":"2024-09-10T08:28:46.495538+0000","last_clean":"2024-09-10T08:28:46.495538+0000","last_became_active":"2024-09-10T08:28:45.503695+0000","last_became_peered":"2024-09-10T08:28:45.503695+0000","last_unstale":"2024-09-10T08:28:46.495538+0000","last_undegraded":"2024-09-10T08:28:46.495538+0000","last_fullsized":"2024-09-10T08:28:46.495538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475469+0000","last_change":"2024-09-10T08:28:45.484363+0000","last_active":"2024-09-10T08:28:46.475469+0000","last_peered":"2024-09-10T08:28:46.475469+0000","last_clean":"2024-09-10T08:28:46.475469+0000","last_became_active":"2024-09-10T08:28:45.483998+0000","last_became_peered":"2024-09-10T08:28:45.483998+0000","last_unstale":"2024-09-10T08:28:46.475469+0000","last_undegraded":"2024-09-10T08:28:46.475469+0000","last_fullsized":"2024-09-10T08:28:46.475469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494959+0000","last_change":"2024-09-10T08:28:45.484207+0000","last_active":"2024-09-10T08:28:46.494959+0000","last_peered":"2024-09-10T08:28:46.494959+0000","last_clean":"2024-09-10T08:28:46.494959+0000","last_became_active":"2024-09-10T08:28:45.483957+0000","last_became_peered":"2024-09-10T08:28:45.483957+0000","last_unstale":"2024-09-10T08:28:46.494959+0000","last_undegraded":"2024-09-10T08:28:46.494959+0000","last_fullsized":"2024-09-10T08:28:46.494959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475156+0000","last_change":"2024-09-10T08:28:45.485743+0000","last_active":"2024-09-10T08:28:46.475156+0000","last_peered":"2024-09-10T08:28:46.475156+0000","last_clean":"2024-09-10T08:28:46.475156+0000","last_became_active":"2024-09-10T08:28:45.485383+0000","last_became_peered":"2024-09-10T08:28:45.485383+0000","last_unstale":"2024-09-10T08:28:46.475156+0000","last_undegraded":"2024-09-10T08:28:46.475156+0000","last_fullsized":"2024-09-10T08:28:46.475156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494789+0000","last_change":"2024-09-10T08:28:45.477978+0000","last_active":"2024-09-10T08:28:46.494789+0000","last_peered":"2024-09-10T08:28:46.494789+0000","last_clean":"2024-09-10T08:28:46.494789+0000","last_became_active":"2024-09-10T08:28:45.477714+0000","last_became_peered":"2024-09-10T08:28:45.477714+0000","last_unstale":"2024-09-10T08:28:46.494789+0000","last_undegraded":"2024-09-10T08:28:46.494789+0000","last_fullsized":"2024-09-10T08:28:46.494789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587564+0000","last_change":"2024-09-10T08:28:45.502893+0000","last_active":"2024-09-10T08:28:46.587564+0000","last_peered":"2024-09-10T08:28:46.587564+0000","last_clean":"2024-09-10T08:28:46.587564+0000","last_became_active":"2024-09-10T08:28:45.501191+0000","last_became_peered":"2024-09-10T08:28:45.501191+0000","last_unstale":"2024-09-10T08:28:46.587564+0000","last_undegraded":"2024-09-10T08:28:46.587564+0000","last_fullsized":"2024-09-10T08:28:46.587564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495282+0000","last_change":"2024-09-10T08:28:45.475050+0000","last_active":"2024-09-10T08:28:46.495282+0000","last_peered":"2024-09-10T08:28:46.495282+0000","last_clean":"2024-09-10T08:28:46.495282+0000","last_became_active":"2024-09-10T08:28:45.474777+0000","last_became_peered":"2024-09-10T08:28:45.474777+0000","last_unstale":"2024-09-10T08:28:46.495282+0000","last_undegraded":"2024-09-10T08:28:46.495282+0000","last_fullsized":"2024-09-10T08:28:46.495282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:18.566505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495181+0000","last_change":"2024-09-10T08:28:45.507663+0000","last_active":"2024-09-10T08:28:46.495181+0000","last_peered":"2024-09-10T08:28:46.495181+0000","last_clean":"2024-09-10T08:28:46.495181+0000","last_became_active":"2024-09-10T08:28:45.507403+0000","last_became_peered":"2024-09-10T08:28:45.507403+0000","last_unstale":"2024-09-10T08:28:46.495181+0000","last_undegraded":"2024-09-10T08:28:46.495181+0000","last_fullsized":"2024-09-10T08:28:46.495181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:17.524518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495035+0000","last_change":"2024-09-10T08:28:45.478452+0000","last_active":"2024-09-10T08:28:46.495035+0000","last_peered":"2024-09-10T08:28:46.495035+0000","last_clean":"2024-09-10T08:28:46.495035+0000","last_became_active":"2024-09-10T08:28:45.477167+0000","last_became_peered":"2024-09-10T08:28:45.477167+0000","last_unstale":"2024-09-10T08:28:46.495035+0000","last_undegraded":"2024-09-10T08:28:46.495035+0000","last_fullsized":"2024-09-10T08:28:46.495035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587518+0000","last_change":"2024-09-10T08:28:45.477960+0000","last_active":"2024-09-10T08:28:46.587518+0000","last_peered":"2024-09-10T08:28:46.587518+0000","last_clean":"2024-09-10T08:28:46.587518+0000","last_became_active":"2024-09-10T08:28:45.477375+0000","last_became_peered":"2024-09-10T08:28:45.477375+0000","last_unstale":"2024-09-10T08:28:46.587518+0000","last_undegraded":"2024-09-10T08:28:46.587518+0000","last_fullsized":"2024-09-10T08:28:46.587518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:10.245108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587184+0000","last_change":"2024-09-10T08:28:45.483734+0000","last_active":"2024-09-10T08:28:46.587184+0000","last_peered":"2024-09-10T08:28:46.587184+0000","last_clean":"2024-09-10T08:28:46.587184+0000","last_became_active":"2024-09-10T08:28:45.483301+0000","last_became_peered":"2024-09-10T08:28:45.483301+0000","last_unstale":"2024-09-10T08:28:46.587184+0000","last_undegraded":"2024-09-10T08:28:46.587184+0000","last_fullsized":"2024-09-10T08:28:46.587184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475915+0000","last_change":"2024-09-10T08:28:45.494626+0000","last_active":"2024-09-10T08:28:46.475915+0000","last_peered":"2024-09-10T08:28:46.475915+0000","last_clean":"2024-09-10T08:28:46.475915+0000","last_became_active":"2024-09-10T08:28:45.494433+0000","last_became_peered":"2024-09-10T08:28:45.494433+0000","last_unstale":"2024-09-10T08:28:46.475915+0000","last_undegraded":"2024-09-10T08:28:46.475915+0000","last_fullsized":"2024-09-10T08:28:46.475915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476903+0000","last_change":"2024-09-10T08:28:45.504534+0000","last_active":"2024-09-10T08:28:46.476903+0000","last_peered":"2024-09-10T08:28:46.476903+0000","last_clean":"2024-09-10T08:28:46.476903+0000","last_became_active":"2024-09-10T08:28:45.504293+0000","last_became_peered":"2024-09-10T08:28:45.504293+0000","last_unstale":"2024-09-10T08:28:46.476903+0000","last_undegraded":"2024-09-10T08:28:46.476903+0000","last_fullsized":"2024-09-10T08:28:46.476903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:46.778411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476383+0000","last_change":"2024-09-10T08:28:45.481198+0000","last_active":"2024-09-10T08:28:46.476383+0000","last_peered":"2024-09-10T08:28:46.476383+0000","last_clean":"2024-09-10T08:28:46.476383+0000","last_became_active":"2024-09-10T08:28:45.480055+0000","last_became_peered":"2024-09-10T08:28:45.480055+0000","last_unstale":"2024-09-10T08:28:46.476383+0000","last_undegraded":"2024-09-10T08:28:46.476383+0000","last_fullsized":"2024-09-10T08:28:46.476383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:17.438395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476674+0000","last_change":"2024-09-10T08:28:45.492075+0000","last_active":"2024-09-10T08:28:46.476674+0000","last_peered":"2024-09-10T08:28:46.476674+0000","last_clean":"2024-09-10T08:28:46.476674+0000","last_became_active":"2024-09-10T08:28:45.491741+0000","last_became_peered":"2024-09-10T08:28:45.491741+0000","last_unstale":"2024-09-10T08:28:46.476674+0000","last_undegraded":"2024-09-10T08:28:46.476674+0000","last_fullsized":"2024-09-10T08:28:46.476674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:43.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495042+0000","last_change":"2024-09-10T08:28:45.478902+0000","last_active":"2024-09-10T08:28:46.495042+0000","last_peered":"2024-09-10T08:28:46.495042+0000","last_clean":"2024-09-10T08:28:46.495042+0000","last_became_active":"2024-09-10T08:28:45.475888+0000","last_became_peered":"2024-09-10T08:28:45.475888+0000","last_unstale":"2024-09-10T08:28:46.495042+0000","last_undegraded":"2024-09-10T08:28:46.495042+0000","last_fullsized":"2024-09-10T08:28:46.495042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491948+0000","last_change":"2024-09-10T08:28:45.478099+0000","last_active":"2024-09-10T08:28:46.491948+0000","last_peered":"2024-09-10T08:28:46.491948+0000","last_clean":"2024-09-10T08:28:46.491948+0000","last_became_active":"2024-09-10T08:28:45.477815+0000","last_became_peered":"2024-09-10T08:28:45.477815+0000","last_unstale":"2024-09-10T08:28:46.491948+0000","last_undegraded":"2024-09-10T08:28:46.491948+0000","last_fullsized":"2024-09-10T08:28:46.491948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587254+0000","last_change":"2024-09-10T08:28:45.488544+0000","last_active":"2024-09-10T08:28:46.587254+0000","last_peered":"2024-09-10T08:28:46.587254+0000","last_clean":"2024-09-10T08:28:46.587254+0000","last_became_active":"2024-09-10T08:28:45.485592+0000","last_became_peered":"2024-09-10T08:28:45.485592+0000","last_unstale":"2024-09-10T08:28:46.587254+0000","last_undegraded":"2024-09-10T08:28:46.587254+0000","last_fullsized":"2024-09-10T08:28:46.587254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475989+0000","last_change":"2024-09-10T08:28:45.490048+0000","last_active":"2024-09-10T08:28:46.475989+0000","last_peered":"2024-09-10T08:28:46.475989+0000","last_clean":"2024-09-10T08:28:46.475989+0000","last_became_active":"2024-09-10T08:28:45.489782+0000","last_became_peered":"2024-09-10T08:28:45.489782+0000","last_unstale":"2024-09-10T08:28:46.475989+0000","last_undegraded":"2024-09-10T08:28:46.475989+0000","last_fullsized":"2024-09-10T08:28:46.475989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475766+0000","last_change":"2024-09-10T08:28:45.500890+0000","last_active":"2024-09-10T08:28:46.475766+0000","last_peered":"2024-09-10T08:28:46.475766+0000","last_clean":"2024-09-10T08:28:46.475766+0000","last_became_active":"2024-09-10T08:28:45.500394+0000","last_became_peered":"2024-09-10T08:28:45.500394+0000","last_unstale":"2024-09-10T08:28:46.475766+0000","last_undegraded":"2024-09-10T08:28:46.475766+0000","last_fullsized":"2024-09-10T08:28:46.475766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587511+0000","last_change":"2024-09-10T08:28:45.485960+0000","last_active":"2024-09-10T08:28:46.587511+0000","last_peered":"2024-09-10T08:28:46.587511+0000","last_clean":"2024-09-10T08:28:46.587511+0000","last_became_active":"2024-09-10T08:28:45.485438+0000","last_became_peered":"2024-09-10T08:28:45.485438+0000","last_unstale":"2024-09-10T08:28:46.587511+0000","last_undegraded":"2024-09-10T08:28:46.587511+0000","last_fullsized":"2024-09-10T08:28:46.587511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:26.564059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587099+0000","last_change":"2024-09-10T08:28:45.487123+0000","last_active":"2024-09-10T08:28:46.587099+0000","last_peered":"2024-09-10T08:28:46.587099+0000","last_clean":"2024-09-10T08:28:46.587099+0000","last_became_active":"2024-09-10T08:28:45.486850+0000","last_became_peered":"2024-09-10T08:28:45.486850+0000","last_unstale":"2024-09-10T08:28:46.587099+0000","last_undegraded":"2024-09-10T08:28:46.587099+0000","last_fullsized":"2024-09-10T08:28:46.587099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476757+0000","last_change":"2024-09-10T08:28:45.490464+0000","last_active":"2024-09-10T08:28:46.476757+0000","last_peered":"2024-09-10T08:28:46.476757+0000","last_clean":"2024-09-10T08:28:46.476757+0000","last_became_active":"2024-09-10T08:28:45.490227+0000","last_became_peered":"2024-09-10T08:28:45.490227+0000","last_unstale":"2024-09-10T08:28:46.476757+0000","last_undegraded":"2024-09-10T08:28:46.476757+0000","last_fullsized":"2024-09-10T08:28:46.476757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:04.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476111+0000","last_change":"2024-09-10T08:28:45.474822+0000","last_active":"2024-09-10T08:28:46.476111+0000","last_peered":"2024-09-10T08:28:46.476111+0000","last_clean":"2024-09-10T08:28:46.476111+0000","last_became_active":"2024-09-10T08:28:45.474528+0000","last_became_peered":"2024-09-10T08:28:45.474528+0000","last_unstale":"2024-09-10T08:28:46.476111+0000","last_undegraded":"2024-09-10T08:28:46.476111+0000","last_fullsized":"2024-09-10T08:28:46.476111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:12.822933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.474975+0000","last_change":"2024-09-10T08:28:45.486413+0000","last_active":"2024-09-10T08:28:46.474975+0000","last_peered":"2024-09-10T08:28:46.474975+0000","last_clean":"2024-09-10T08:28:46.474975+0000","last_became_active":"2024-09-10T08:28:45.486145+0000","last_became_peered":"2024-09-10T08:28:45.486145+0000","last_unstale":"2024-09-10T08:28:46.474975+0000","last_undegraded":"2024-09-10T08:28:46.474975+0000","last_fullsized":"2024-09-10T08:28:46.474975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587269+0000","last_change":"2024-09-10T08:28:45.489031+0000","last_active":"2024-09-10T08:28:46.587269+0000","last_peered":"2024-09-10T08:28:46.587269+0000","last_clean":"2024-09-10T08:28:46.587269+0000","last_became_active":"2024-09-10T08:28:45.484546+0000","last_became_peered":"2024-09-10T08:28:45.484546+0000","last_unstale":"2024-09-10T08:28:46.587269+0000","last_undegraded":"2024-09-10T08:28:46.587269+0000","last_fullsized":"2024-09-10T08:28:46.587269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492039+0000","last_change":"2024-09-10T08:28:45.476390+0000","last_active":"2024-09-10T08:28:46.492039+0000","last_peered":"2024-09-10T08:28:46.492039+0000","last_clean":"2024-09-10T08:28:46.492039+0000","last_became_active":"2024-09-10T08:28:45.476112+0000","last_became_peered":"2024-09-10T08:28:45.476112+0000","last_unstale":"2024-09-10T08:28:46.492039+0000","last_undegraded":"2024-09-10T08:28:46.492039+0000","last_fullsized":"2024-09-10T08:28:46.492039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476535+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:46.476535+0000","last_peered":"2024-09-10T08:28:46.476535+0000","last_clean":"2024-09-10T08:28:46.476535+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:46.476535+0000","last_undegraded":"2024-09-10T08:28:46.476535+0000","last_fullsized":"2024-09-10T08:28:46.476535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586792+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:46.586792+0000","last_peered":"2024-09-10T08:28:46.586792+0000","last_clean":"2024-09-10T08:28:46.586792+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:46.586792+0000","last_undegraded":"2024-09-10T08:28:46.586792+0000","last_fullsized":"2024-09-10T08:28:46.586792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476011+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:46.476011+0000","last_peered":"2024-09-10T08:28:46.476011+0000","last_clean":"2024-09-10T08:28:46.476011+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:46.476011+0000","last_undegraded":"2024-09-10T08:28:46.476011+0000","last_fullsized":"2024-09-10T08:28:46.476011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492099+0000","last_change":"2024-09-10T08:28:45.474325+0000","last_active":"2024-09-10T08:28:46.492099+0000","last_peered":"2024-09-10T08:28:46.492099+0000","last_clean":"2024-09-10T08:28:46.492099+0000","last_became_active":"2024-09-10T08:28:45.472800+0000","last_became_peered":"2024-09-10T08:28:45.472800+0000","last_unstale":"2024-09-10T08:28:46.492099+0000","last_undegraded":"2024-09-10T08:28:46.492099+0000","last_fullsized":"2024-09-10T08:28:46.492099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587520+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:46.587520+0000","last_peered":"2024-09-10T08:28:46.587520+0000","last_clean":"2024-09-10T08:28:46.587520+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:46.587520+0000","last_undegraded":"2024-09-10T08:28:46.587520+0000","last_fullsized":"2024-09-10T08:28:46.587520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476000+0000","last_change":"2024-09-10T08:28:45.500677+0000","last_active":"2024-09-10T08:28:46.476000+0000","last_peered":"2024-09-10T08:28:46.476000+0000","last_clean":"2024-09-10T08:28:46.476000+0000","last_became_active":"2024-09-10T08:28:45.500018+0000","last_became_peered":"2024-09-10T08:28:45.500018+0000","last_unstale":"2024-09-10T08:28:46.476000+0000","last_undegraded":"2024-09-10T08:28:46.476000+0000","last_fullsized":"2024-09-10T08:28:46.476000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495320+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:46.495320+0000","last_peered":"2024-09-10T08:28:46.495320+0000","last_clean":"2024-09-10T08:28:46.495320+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:46.495320+0000","last_undegraded":"2024-09-10T08:28:46.495320+0000","last_fullsized":"2024-09-10T08:28:46.495320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476352+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:46.476352+0000","last_peered":"2024-09-10T08:28:46.476352+0000","last_clean":"2024-09-10T08:28:46.476352+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:46.476352+0000","last_undegraded":"2024-09-10T08:28:46.476352+0000","last_fullsized":"2024-09-10T08:28:46.476352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476424+0000","last_change":"2024-09-10T08:28:45.494242+0000","last_active":"2024-09-10T08:28:46.476424+0000","last_peered":"2024-09-10T08:28:46.476424+0000","last_clean":"2024-09-10T08:28:46.476424+0000","last_became_active":"2024-09-10T08:28:45.493862+0000","last_became_peered":"2024-09-10T08:28:45.493862+0000","last_unstale":"2024-09-10T08:28:46.476424+0000","last_undegraded":"2024-09-10T08:28:46.476424+0000","last_fullsized":"2024-09-10T08:28:46.476424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:07.008683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475570+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:46.475570+0000","last_peered":"2024-09-10T08:28:46.475570+0000","last_clean":"2024-09-10T08:28:46.475570+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:46.475570+0000","last_undegraded":"2024-09-10T08:28:46.475570+0000","last_fullsized":"2024-09-10T08:28:46.475570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495323+0000","last_change":"2024-09-10T08:28:45.486498+0000","last_active":"2024-09-10T08:28:46.495323+0000","last_peered":"2024-09-10T08:28:46.495323+0000","last_clean":"2024-09-10T08:28:46.495323+0000","last_became_active":"2024-09-10T08:28:45.486234+0000","last_became_peered":"2024-09-10T08:28:45.486234+0000","last_unstale":"2024-09-10T08:28:46.495323+0000","last_undegraded":"2024-09-10T08:28:46.495323+0000","last_fullsized":"2024-09-10T08:28:46.495323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476571+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:46.476571+0000","last_peered":"2024-09-10T08:28:46.476571+0000","last_clean":"2024-09-10T08:28:46.476571+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:46.476571+0000","last_undegraded":"2024-09-10T08:28:46.476571+0000","last_fullsized":"2024-09-10T08:28:46.476571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587068+0000","last_change":"2024-09-10T08:28:45.482539+0000","last_active":"2024-09-10T08:28:46.587068+0000","last_peered":"2024-09-10T08:28:46.587068+0000","last_clean":"2024-09-10T08:28:46.587068+0000","last_became_active":"2024-09-10T08:28:45.482187+0000","last_became_peered":"2024-09-10T08:28:45.482187+0000","last_unstale":"2024-09-10T08:28:46.587068+0000","last_undegraded":"2024-09-10T08:28:46.587068+0000","last_fullsized":"2024-09-10T08:28:46.587068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476642+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:46.476642+0000","last_peered":"2024-09-10T08:28:46.476642+0000","last_clean":"2024-09-10T08:28:46.476642+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:46.476642+0000","last_undegraded":"2024-09-10T08:28:46.476642+0000","last_fullsized":"2024-09-10T08:28:46.476642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476909+0000","last_change":"2024-09-10T08:28:45.487081+0000","last_active":"2024-09-10T08:28:46.476909+0000","last_peered":"2024-09-10T08:28:46.476909+0000","last_clean":"2024-09-10T08:28:46.476909+0000","last_became_active":"2024-09-10T08:28:45.482234+0000","last_became_peered":"2024-09-10T08:28:45.482234+0000","last_unstale":"2024-09-10T08:28:46.476909+0000","last_undegraded":"2024-09-10T08:28:46.476909+0000","last_fullsized":"2024-09-10T08:28:46.476909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:44.005147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494969+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:46.494969+0000","last_peered":"2024-09-10T08:28:46.494969+0000","last_clean":"2024-09-10T08:28:46.494969+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:46.494969+0000","last_undegraded":"2024-09-10T08:28:46.494969+0000","last_fullsized":"2024-09-10T08:28:46.494969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587115+0000","last_change":"2024-09-10T08:28:45.487663+0000","last_active":"2024-09-10T08:28:46.587115+0000","last_peered":"2024-09-10T08:28:46.587115+0000","last_clean":"2024-09-10T08:28:46.587115+0000","last_became_active":"2024-09-10T08:28:45.487375+0000","last_became_peered":"2024-09-10T08:28:45.487375+0000","last_unstale":"2024-09-10T08:28:46.587115+0000","last_undegraded":"2024-09-10T08:28:46.587115+0000","last_fullsized":"2024-09-10T08:28:46.587115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491724+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:46.491724+0000","last_peered":"2024-09-10T08:28:46.491724+0000","last_clean":"2024-09-10T08:28:46.491724+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:46.491724+0000","last_undegraded":"2024-09-10T08:28:46.491724+0000","last_fullsized":"2024-09-10T08:28:46.491724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475927+0000","last_change":"2024-09-10T08:28:45.497379+0000","last_active":"2024-09-10T08:28:46.475927+0000","last_peered":"2024-09-10T08:28:46.475927+0000","last_clean":"2024-09-10T08:28:46.475927+0000","last_became_active":"2024-09-10T08:28:45.494750+0000","last_became_peered":"2024-09-10T08:28:45.494750+0000","last_unstale":"2024-09-10T08:28:46.475927+0000","last_undegraded":"2024-09-10T08:28:46.475927+0000","last_fullsized":"2024-09-10T08:28:46.475927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495578+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:46.495578+0000","last_peered":"2024-09-10T08:28:46.495578+0000","last_clean":"2024-09-10T08:28:46.495578+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:46.495578+0000","last_undegraded":"2024-09-10T08:28:46.495578+0000","last_fullsized":"2024-09-10T08:28:46.495578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476148+0000","last_change":"2024-09-10T08:28:45.474379+0000","last_active":"2024-09-10T08:28:46.476148+0000","last_peered":"2024-09-10T08:28:46.476148+0000","last_clean":"2024-09-10T08:28:46.476148+0000","last_became_active":"2024-09-10T08:28:45.474059+0000","last_became_peered":"2024-09-10T08:28:45.474059+0000","last_unstale":"2024-09-10T08:28:46.476148+0000","last_undegraded":"2024-09-10T08:28:46.476148+0000","last_fullsized":"2024-09-10T08:28:46.476148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492219+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:46.492219+0000","last_peered":"2024-09-10T08:28:46.492219+0000","last_clean":"2024-09-10T08:28:46.492219+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:46.492219+0000","last_undegraded":"2024-09-10T08:28:46.492219+0000","last_fullsized":"2024-09-10T08:28:46.492219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495529+0000","last_change":"2024-09-10T08:28:45.474925+0000","last_active":"2024-09-10T08:28:46.495529+0000","last_peered":"2024-09-10T08:28:46.495529+0000","last_clean":"2024-09-10T08:28:46.495529+0000","last_became_active":"2024-09-10T08:28:45.474629+0000","last_became_peered":"2024-09-10T08:28:45.474629+0000","last_unstale":"2024-09-10T08:28:46.495529+0000","last_undegraded":"2024-09-10T08:28:46.495529+0000","last_fullsized":"2024-09-10T08:28:46.495529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495213+0000","last_change":"2024-09-10T08:28:45.480093+0000","last_active":"2024-09-10T08:28:46.495213+0000","last_peered":"2024-09-10T08:28:46.495213+0000","last_clean":"2024-09-10T08:28:46.495213+0000","last_became_active":"2024-09-10T08:28:45.479791+0000","last_became_peered":"2024-09-10T08:28:45.479791+0000","last_unstale":"2024-09-10T08:28:46.495213+0000","last_undegraded":"2024-09-10T08:28:46.495213+0000","last_fullsized":"2024-09-10T08:28:46.495213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.251795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587813+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:46.587813+0000","last_peered":"2024-09-10T08:28:46.587813+0000","last_clean":"2024-09-10T08:28:46.587813+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:46.587813+0000","last_undegraded":"2024-09-10T08:28:46.587813+0000","last_fullsized":"2024-09-10T08:28:46.587813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476639+0000","last_change":"2024-09-10T08:28:45.498356+0000","last_active":"2024-09-10T08:28:46.476639+0000","last_peered":"2024-09-10T08:28:46.476639+0000","last_clean":"2024-09-10T08:28:46.476639+0000","last_became_active":"2024-09-10T08:28:45.498050+0000","last_became_peered":"2024-09-10T08:28:45.498050+0000","last_unstale":"2024-09-10T08:28:46.476639+0000","last_undegraded":"2024-09-10T08:28:46.476639+0000","last_fullsized":"2024-09-10T08:28:46.476639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:44.474059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587209+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:46.587209+0000","last_peered":"2024-09-10T08:28:46.587209+0000","last_clean":"2024-09-10T08:28:46.587209+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:46.587209+0000","last_undegraded":"2024-09-10T08:28:46.587209+0000","last_fullsized":"2024-09-10T08:28:46.587209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477118+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:46.477118+0000","last_peered":"2024-09-10T08:28:46.477118+0000","last_clean":"2024-09-10T08:28:46.477118+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:46.477118+0000","last_undegraded":"2024-09-10T08:28:46.477118+0000","last_fullsized":"2024-09-10T08:28:46.477118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:41.681095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491913+0000","last_change":"2024-09-10T08:28:45.473182+0000","last_active":"2024-09-10T08:28:46.491913+0000","last_peered":"2024-09-10T08:28:46.491913+0000","last_clean":"2024-09-10T08:28:46.491913+0000","last_became_active":"2024-09-10T08:28:45.472864+0000","last_became_peered":"2024-09-10T08:28:45.472864+0000","last_unstale":"2024-09-10T08:28:46.491913+0000","last_undegraded":"2024-09-10T08:28:46.491913+0000","last_fullsized":"2024-09-10T08:28:46.491913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:56.237650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476087+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:46.476087+0000","last_peered":"2024-09-10T08:28:46.476087+0000","last_clean":"2024-09-10T08:28:46.476087+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:46.476087+0000","last_undegraded":"2024-09-10T08:28:46.476087+0000","last_fullsized":"2024-09-10T08:28:46.476087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586884+0000","last_change":"2024-09-10T08:28:45.483743+0000","last_active":"2024-09-10T08:28:46.586884+0000","last_peered":"2024-09-10T08:28:46.586884+0000","last_clean":"2024-09-10T08:28:46.586884+0000","last_became_active":"2024-09-10T08:28:45.483380+0000","last_became_peered":"2024-09-10T08:28:45.483380+0000","last_unstale":"2024-09-10T08:28:46.586884+0000","last_undegraded":"2024-09-10T08:28:46.586884+0000","last_fullsized":"2024-09-10T08:28:46.586884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476025+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:46.476025+0000","last_peered":"2024-09-10T08:28:46.476025+0000","last_clean":"2024-09-10T08:28:46.476025+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:46.476025+0000","last_undegraded":"2024-09-10T08:28:46.476025+0000","last_fullsized":"2024-09-10T08:28:46.476025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476741+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:46.476741+0000","last_peered":"2024-09-10T08:28:46.476741+0000","last_clean":"2024-09-10T08:28:46.476741+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:46.476741+0000","last_undegraded":"2024-09-10T08:28:46.476741+0000","last_fullsized":"2024-09-10T08:28:46.476741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:09.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495127+0000","last_change":"2024-09-10T08:28:45.473303+0000","last_active":"2024-09-10T08:28:46.495127+0000","last_peered":"2024-09-10T08:28:46.495127+0000","last_clean":"2024-09-10T08:28:46.495127+0000","last_became_active":"2024-09-10T08:28:45.473012+0000","last_became_peered":"2024-09-10T08:28:45.473012+0000","last_unstale":"2024-09-10T08:28:46.495127+0000","last_undegraded":"2024-09-10T08:28:46.495127+0000","last_fullsized":"2024-09-10T08:28:46.495127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475344+0000","last_change":"2024-09-10T08:28:45.496343+0000","last_active":"2024-09-10T08:28:46.475344+0000","last_peered":"2024-09-10T08:28:46.475344+0000","last_clean":"2024-09-10T08:28:46.475344+0000","last_became_active":"2024-09-10T08:28:45.495838+0000","last_became_peered":"2024-09-10T08:28:45.495838+0000","last_unstale":"2024-09-10T08:28:46.475344+0000","last_undegraded":"2024-09-10T08:28:46.475344+0000","last_fullsized":"2024-09-10T08:28:46.475344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476696+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:46.476696+0000","last_peered":"2024-09-10T08:28:46.476696+0000","last_clean":"2024-09-10T08:28:46.476696+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:46.476696+0000","last_undegraded":"2024-09-10T08:28:46.476696+0000","last_fullsized":"2024-09-10T08:28:46.476696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:25.557353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587711+0000","last_change":"2024-09-10T08:28:45.485170+0000","last_active":"2024-09-10T08:28:46.587711+0000","last_peered":"2024-09-10T08:28:46.587711+0000","last_clean":"2024-09-10T08:28:46.587711+0000","last_became_active":"2024-09-10T08:28:45.484866+0000","last_became_peered":"2024-09-10T08:28:45.484866+0000","last_unstale":"2024-09-10T08:28:46.587711+0000","last_undegraded":"2024-09-10T08:28:46.587711+0000","last_fullsized":"2024-09-10T08:28:46.587711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:09.096890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492375+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:46.492375+0000","last_peered":"2024-09-10T08:28:46.492375+0000","last_clean":"2024-09-10T08:28:46.492375+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:46.492375+0000","last_undegraded":"2024-09-10T08:28:46.492375+0000","last_fullsized":"2024-09-10T08:28:46.492375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492290+0000","last_change":"2024-09-10T08:28:45.486103+0000","last_active":"2024-09-10T08:28:46.492290+0000","last_peered":"2024-09-10T08:28:46.492290+0000","last_clean":"2024-09-10T08:28:46.492290+0000","last_became_active":"2024-09-10T08:28:45.485815+0000","last_became_peered":"2024-09-10T08:28:45.485815+0000","last_unstale":"2024-09-10T08:28:46.492290+0000","last_undegraded":"2024-09-10T08:28:46.492290+0000","last_fullsized":"2024-09-10T08:28:46.492290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476929+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:46.476929+0000","last_peered":"2024-09-10T08:28:46.476929+0000","last_clean":"2024-09-10T08:28:46.476929+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:46.476929+0000","last_undegraded":"2024-09-10T08:28:46.476929+0000","last_fullsized":"2024-09-10T08:28:46.476929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:06.800613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492233+0000","last_change":"2024-09-10T08:28:45.489780+0000","last_active":"2024-09-10T08:28:46.492233+0000","last_peered":"2024-09-10T08:28:46.492233+0000","last_clean":"2024-09-10T08:28:46.492233+0000","last_became_active":"2024-09-10T08:28:45.487680+0000","last_became_peered":"2024-09-10T08:28:45.487680+0000","last_unstale":"2024-09-10T08:28:46.492233+0000","last_undegraded":"2024-09-10T08:28:46.492233+0000","last_fullsized":"2024-09-10T08:28:46.492233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494602+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:46.494602+0000","last_peered":"2024-09-10T08:28:46.494602+0000","last_clean":"2024-09-10T08:28:46.494602+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:46.494602+0000","last_undegraded":"2024-09-10T08:28:46.494602+0000","last_fullsized":"2024-09-10T08:28:46.494602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476096+0000","last_change":"2024-09-10T08:28:45.495819+0000","last_active":"2024-09-10T08:28:46.476096+0000","last_peered":"2024-09-10T08:28:46.476096+0000","last_clean":"2024-09-10T08:28:46.476096+0000","last_became_active":"2024-09-10T08:28:45.493467+0000","last_became_peered":"2024-09-10T08:28:45.493467+0000","last_unstale":"2024-09-10T08:28:46.476096+0000","last_undegraded":"2024-09-10T08:28:46.476096+0000","last_fullsized":"2024-09-10T08:28:46.476096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:39.629101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492054+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:46.492054+0000","last_peered":"2024-09-10T08:28:46.492054+0000","last_clean":"2024-09-10T08:28:46.492054+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:46.492054+0000","last_undegraded":"2024-09-10T08:28:46.492054+0000","last_fullsized":"2024-09-10T08:28:46.492054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491845+0000","last_change":"2024-09-10T08:28:45.486692+0000","last_active":"2024-09-10T08:28:46.491845+0000","last_peered":"2024-09-10T08:28:46.491845+0000","last_clean":"2024-09-10T08:28:46.491845+0000","last_became_active":"2024-09-10T08:28:45.486384+0000","last_became_peered":"2024-09-10T08:28:45.486384+0000","last_unstale":"2024-09-10T08:28:46.491845+0000","last_undegraded":"2024-09-10T08:28:46.491845+0000","last_fullsized":"2024-09-10T08:28:46.491845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.807320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587173+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:46.587173+0000","last_peered":"2024-09-10T08:28:46.587173+0000","last_clean":"2024-09-10T08:28:46.587173+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:46.587173+0000","last_undegraded":"2024-09-10T08:28:46.587173+0000","last_fullsized":"2024-09-10T08:28:46.587173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476507+0000","last_change":"2024-09-10T08:28:45.486876+0000","last_active":"2024-09-10T08:28:46.476507+0000","last_peered":"2024-09-10T08:28:46.476507+0000","last_clean":"2024-09-10T08:28:46.476507+0000","last_became_active":"2024-09-10T08:28:45.486594+0000","last_became_peered":"2024-09-10T08:28:45.486594+0000","last_unstale":"2024-09-10T08:28:46.476507+0000","last_undegraded":"2024-09-10T08:28:46.476507+0000","last_fullsized":"2024-09-10T08:28:46.476507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477005+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:46.477005+0000","last_peered":"2024-09-10T08:28:46.477005+0000","last_clean":"2024-09-10T08:28:46.477005+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:46.477005+0000","last_undegraded":"2024-09-10T08:28:46.477005+0000","last_fullsized":"2024-09-10T08:28:46.477005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:33.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476431+0000","last_change":"2024-09-10T08:28:45.498396+0000","last_active":"2024-09-10T08:28:46.476431+0000","last_peered":"2024-09-10T08:28:46.476431+0000","last_clean":"2024-09-10T08:28:46.476431+0000","last_became_active":"2024-09-10T08:28:45.498155+0000","last_became_peered":"2024-09-10T08:28:45.498155+0000","last_unstale":"2024-09-10T08:28:46.476431+0000","last_undegraded":"2024-09-10T08:28:46.476431+0000","last_fullsized":"2024-09-10T08:28:46.476431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:14.869919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476523+0000","last_change":"2024-09-10T08:28:45.489899+0000","last_active":"2024-09-10T08:28:46.476523+0000","last_peered":"2024-09-10T08:28:46.476523+0000","last_clean":"2024-09-10T08:28:46.476523+0000","last_became_active":"2024-09-10T08:28:45.489475+0000","last_became_peered":"2024-09-10T08:28:45.489475+0000","last_unstale":"2024-09-10T08:28:46.476523+0000","last_undegraded":"2024-09-10T08:28:46.476523+0000","last_fullsized":"2024-09-10T08:28:46.476523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:31.730082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495257+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:46.495257+0000","last_peered":"2024-09-10T08:28:46.495257+0000","last_clean":"2024-09-10T08:28:46.495257+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:46.495257+0000","last_undegraded":"2024-09-10T08:28:46.495257+0000","last_fullsized":"2024-09-10T08:28:46.495257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587327+0000","last_change":"2024-09-10T08:28:45.490936+0000","last_active":"2024-09-10T08:28:46.587327+0000","last_peered":"2024-09-10T08:28:46.587327+0000","last_clean":"2024-09-10T08:28:46.587327+0000","last_became_active":"2024-09-10T08:28:45.490450+0000","last_became_peered":"2024-09-10T08:28:45.490450+0000","last_unstale":"2024-09-10T08:28:46.587327+0000","last_undegraded":"2024-09-10T08:28:46.587327+0000","last_fullsized":"2024-09-10T08:28:46.587327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495301+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:46.495301+0000","last_peered":"2024-09-10T08:28:46.495301+0000","last_clean":"2024-09-10T08:28:46.495301+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:46.495301+0000","last_undegraded":"2024-09-10T08:28:46.495301+0000","last_fullsized":"2024-09-10T08:28:46.495301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492316+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:46.492316+0000","last_peered":"2024-09-10T08:28:46.492316+0000","last_clean":"2024-09-10T08:28:46.492316+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:46.492316+0000","last_undegraded":"2024-09-10T08:28:46.492316+0000","last_fullsized":"2024-09-10T08:28:46.492316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":78568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":666722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:59.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:28:59.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.671+0000 7feede600640 1 Processor -- start 2024-09-10T08:28:59.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.671+0000 7feede600640 1 -- start start 2024-09-10T08:28:59.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.672+0000 7feede600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feed8145ed0 0x7feed80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.672+0000 7feede600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 0x7feed80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.672+0000 7feede600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feed80b4020 con 0x7feed80b5880 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.672+0000 7feede600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7feed8073b00 con 0x7feed8145ed0 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.672+0000 7feede600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7feed80b63d0 con 0x7feed8073180 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feed8145ed0 0x7feed80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feed8145ed0 0x7feed80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45812/0 (socket says 172.21.15.52:45812) 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feed80b5880 0x7feed80b5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48350/0 (socket says 172.21.15.52:48350) 2024-09-10T08:28:59.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 -- 172.21.15.52:0/4278251985 learned_addr learned my addr 172.21.15.52:0/4278251985 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:59.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed6a00640 1 --2- 172.21.15.52:0/4278251985 >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 0x7feed80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 -- 172.21.15.52:0/4278251985 >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 msgr2=0x7feed80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:28:59.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 --2- 172.21.15.52:0/4278251985 >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 0x7feed80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 -- 172.21.15.52:0/4278251985 >> v1:172.21.15.52:6789/0 conn(0x7feed80b5880 legacy=0x7feed80b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed7400640 1 -- 172.21.15.52:0/4278251985 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed80b42c0 con 0x7feed8145ed0 2024-09-10T08:28:59.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.673+0000 7feed6a00640 1 --2- 172.21.15.52:0/4278251985 >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 0x7feed80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:28:59.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.674+0000 7feed7400640 1 --2- 172.21.15.52:0/4278251985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8145ed0 0x7feed80b5080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feed80d1490 tx=0x7feec802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8957fddfba5daa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.674+0000 7feed6000640 1 -- 172.21.15.52:0/4278251985 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8037070 con 0x7feed8145ed0 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feed6000640 1 -- 172.21.15.52:0/4278251985 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8032440 con 0x7feed8145ed0 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feed6000640 1 -- 172.21.15.52:0/4278251985 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8032810 con 0x7feed8145ed0 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 -- 172.21.15.52:0/4278251985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8145ed0 msgr2=0x7feed80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 --2- 172.21.15.52:0/4278251985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8145ed0 0x7feed80b5080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feed80d1490 tx=0x7feec802a270 comp rx=0 tx=0).stop 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 -- 172.21.15.52:0/4278251985 shutdown_connections 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 --2- 172.21.15.52:0/4278251985 >> v2:172.21.15.176:3300/0 conn(0x7feed8073180 0x7feed80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 --2- 172.21.15.52:0/4278251985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8145ed0 0x7feed80b5080 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 -- 172.21.15.52:0/4278251985 >> 172.21.15.52:0/4278251985 conn(0x7feed80ccec0 msgr2=0x7feed80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 -- 172.21.15.52:0/4278251985 shutdown_connections 2024-09-10T08:28:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.675+0000 7feede600640 1 -- 172.21.15.52:0/4278251985 wait complete. 2024-09-10T08:28:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.677+0000 7feede600640 1 Processor -- start 2024-09-10T08:28:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.677+0000 7feede600640 1 -- start start 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feed80b5880 0x7feed81f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feed8145ed0 0x7feed8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feed80b4b60 con 0x7feed8073180 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feed80b4880 con 0x7feed80b5880 2024-09-10T08:28:59.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feede600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feed81462b0 con 0x7feed8145ed0 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45818/0 (socket says 172.21.15.52:45818) 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 -- 172.21.15.52:0/576015688 learned_addr learned my addr 172.21.15.52:0/576015688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed6a00640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feed80b5880 0x7feed81f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7e00640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feed8145ed0 0x7feed8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 -- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feed8145ed0 msgr2=0x7feed8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feed8145ed0 0x7feed8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 -- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feed80b5880 msgr2=0x7feed81f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feed80b5880 0x7feed81f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.678+0000 7feed7400640 1 -- 172.21.15.52:0/576015688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed81e1c50 con 0x7feed8073180 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feed7400640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feec802a2b0 tx=0x7feec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8037040 con 0x7feed8073180 2024-09-10T08:28:59.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8042070 con 0x7feed8073180 2024-09-10T08:28:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8030bb0 con 0x7feed8073180 2024-09-10T08:28:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feede600640 1 -- 172.21.15.52:0/576015688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed81e1f30 con 0x7feed8073180 2024-09-10T08:28:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.679+0000 7feede600640 1 -- 172.21.15.52:0/576015688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81f4a80 con 0x7feed8073180 2024-09-10T08:28:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.680+0000 7feede600640 1 -- 172.21.15.52:0/576015688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed80735c0 con 0x7feed8073180 2024-09-10T08:28:59.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.681+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feec8047460 con 0x7feed8073180 2024-09-10T08:28:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.682+0000 7feecf400640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:28:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.682+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feec80abb80 con 0x7feed8073180 2024-09-10T08:28:59.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.682+0000 7feed6a00640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:28:59.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.683+0000 7feed6a00640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 0x7feeb806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feed81e7780 tx=0x7feec4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:28:59.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.686+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feec8045360 con 0x7feed8073180 2024-09-10T08:28:59.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.868+0000 7feede600640 1 -- 172.21.15.52:0/576015688 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feed813d600 con 0x7feeb806be30 2024-09-10T08:28:59.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.875+0000 7feecf400640 1 -- 172.21.15.52:0/576015688 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7feed813d600 con 0x7feeb806be30 2024-09-10T08:28:59.876 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:28:59.878 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:28:59.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 msgr2=0x7feeb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 0x7feeb806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feed81e7780 tx=0x7feec4008040 comp rx=0 tx=0).stop 2024-09-10T08:28:59.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 msgr2=0x7feed81e2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:28:59.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feec802a2b0 tx=0x7feec80046c0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 shutdown_connections 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feeb806be30 0x7feeb806e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feed8145ed0 0x7feed8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feed80b5880 0x7feed81f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 --2- 172.21.15.52:0/576015688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feed8073180 0x7feed81e2450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 >> 172.21.15.52:0/576015688 conn(0x7feed80ccec0 msgr2=0x7feed8144330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 shutdown_connections 2024-09-10T08:28:59.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:28:59.878+0000 7feede600640 1 -- 172.21.15.52:0/576015688 wait complete. 2024-09-10T08:28:59.896 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-10T08:28:59.454158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235860,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738860,"statfs":{"total":773094113280,"available":772852592640,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003289"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495538+0000","last_change":"2024-09-10T08:28:45.504174+0000","last_active":"2024-09-10T08:28:46.495538+0000","last_peered":"2024-09-10T08:28:46.495538+0000","last_clean":"2024-09-10T08:28:46.495538+0000","last_became_active":"2024-09-10T08:28:45.503695+0000","last_became_peered":"2024-09-10T08:28:45.503695+0000","last_unstale":"2024-09-10T08:28:46.495538+0000","last_undegraded":"2024-09-10T08:28:46.495538+0000","last_fullsized":"2024-09-10T08:28:46.495538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587937+0000","last_change":"2024-09-10T08:28:45.493481+0000","last_active":"2024-09-10T08:28:46.587937+0000","last_peered":"2024-09-10T08:28:46.587937+0000","last_clean":"2024-09-10T08:28:46.587937+0000","last_became_active":"2024-09-10T08:28:45.492736+0000","last_became_peered":"2024-09-10T08:28:45.492736+0000","last_unstale":"2024-09-10T08:28:46.587937+0000","last_undegraded":"2024-09-10T08:28:46.587937+0000","last_fullsized":"2024-09-10T08:28:46.587937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.648030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587869+0000","last_change":"2024-09-10T08:28:45.487606+0000","last_active":"2024-09-10T08:28:46.587869+0000","last_peered":"2024-09-10T08:28:46.587869+0000","last_clean":"2024-09-10T08:28:46.587869+0000","last_became_active":"2024-09-10T08:28:45.487142+0000","last_became_peered":"2024-09-10T08:28:45.487142+0000","last_unstale":"2024-09-10T08:28:46.587869+0000","last_undegraded":"2024-09-10T08:28:46.587869+0000","last_fullsized":"2024-09-10T08:28:46.587869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:28.949399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475469+0000","last_change":"2024-09-10T08:28:45.484363+0000","last_active":"2024-09-10T08:28:46.475469+0000","last_peered":"2024-09-10T08:28:46.475469+0000","last_clean":"2024-09-10T08:28:46.475469+0000","last_became_active":"2024-09-10T08:28:45.483998+0000","last_became_peered":"2024-09-10T08:28:45.483998+0000","last_unstale":"2024-09-10T08:28:46.475469+0000","last_undegraded":"2024-09-10T08:28:46.475469+0000","last_fullsized":"2024-09-10T08:28:46.475469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494959+0000","last_change":"2024-09-10T08:28:45.484207+0000","last_active":"2024-09-10T08:28:46.494959+0000","last_peered":"2024-09-10T08:28:46.494959+0000","last_clean":"2024-09-10T08:28:46.494959+0000","last_became_active":"2024-09-10T08:28:45.483957+0000","last_became_peered":"2024-09-10T08:28:45.483957+0000","last_unstale":"2024-09-10T08:28:46.494959+0000","last_undegraded":"2024-09-10T08:28:46.494959+0000","last_fullsized":"2024-09-10T08:28:46.494959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475156+0000","last_change":"2024-09-10T08:28:45.485743+0000","last_active":"2024-09-10T08:28:46.475156+0000","last_peered":"2024-09-10T08:28:46.475156+0000","last_clean":"2024-09-10T08:28:46.475156+0000","last_became_active":"2024-09-10T08:28:45.485383+0000","last_became_peered":"2024-09-10T08:28:45.485383+0000","last_unstale":"2024-09-10T08:28:46.475156+0000","last_undegraded":"2024-09-10T08:28:46.475156+0000","last_fullsized":"2024-09-10T08:28:46.475156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494789+0000","last_change":"2024-09-10T08:28:45.477978+0000","last_active":"2024-09-10T08:28:46.494789+0000","last_peered":"2024-09-10T08:28:46.494789+0000","last_clean":"2024-09-10T08:28:46.494789+0000","last_became_active":"2024-09-10T08:28:45.477714+0000","last_became_peered":"2024-09-10T08:28:45.477714+0000","last_unstale":"2024-09-10T08:28:46.494789+0000","last_undegraded":"2024-09-10T08:28:46.494789+0000","last_fullsized":"2024-09-10T08:28:46.494789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587297+0000","last_change":"2024-09-10T08:28:45.480911+0000","last_active":"2024-09-10T08:28:46.587297+0000","last_peered":"2024-09-10T08:28:46.587297+0000","last_clean":"2024-09-10T08:28:46.587297+0000","last_became_active":"2024-09-10T08:28:45.480425+0000","last_became_peered":"2024-09-10T08:28:45.480425+0000","last_unstale":"2024-09-10T08:28:46.587297+0000","last_undegraded":"2024-09-10T08:28:46.587297+0000","last_fullsized":"2024-09-10T08:28:46.587297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:45.744861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587564+0000","last_change":"2024-09-10T08:28:45.502893+0000","last_active":"2024-09-10T08:28:46.587564+0000","last_peered":"2024-09-10T08:28:46.587564+0000","last_clean":"2024-09-10T08:28:46.587564+0000","last_became_active":"2024-09-10T08:28:45.501191+0000","last_became_peered":"2024-09-10T08:28:45.501191+0000","last_unstale":"2024-09-10T08:28:46.587564+0000","last_undegraded":"2024-09-10T08:28:46.587564+0000","last_fullsized":"2024-09-10T08:28:46.587564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495282+0000","last_change":"2024-09-10T08:28:45.475050+0000","last_active":"2024-09-10T08:28:46.495282+0000","last_peered":"2024-09-10T08:28:46.495282+0000","last_clean":"2024-09-10T08:28:46.495282+0000","last_became_active":"2024-09-10T08:28:45.474777+0000","last_became_peered":"2024-09-10T08:28:45.474777+0000","last_unstale":"2024-09-10T08:28:46.495282+0000","last_undegraded":"2024-09-10T08:28:46.495282+0000","last_fullsized":"2024-09-10T08:28:46.495282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:18.566505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495181+0000","last_change":"2024-09-10T08:28:45.507663+0000","last_active":"2024-09-10T08:28:46.495181+0000","last_peered":"2024-09-10T08:28:46.495181+0000","last_clean":"2024-09-10T08:28:46.495181+0000","last_became_active":"2024-09-10T08:28:45.507403+0000","last_became_peered":"2024-09-10T08:28:45.507403+0000","last_unstale":"2024-09-10T08:28:46.495181+0000","last_undegraded":"2024-09-10T08:28:46.495181+0000","last_fullsized":"2024-09-10T08:28:46.495181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:17.524518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495035+0000","last_change":"2024-09-10T08:28:45.478452+0000","last_active":"2024-09-10T08:28:46.495035+0000","last_peered":"2024-09-10T08:28:46.495035+0000","last_clean":"2024-09-10T08:28:46.495035+0000","last_became_active":"2024-09-10T08:28:45.477167+0000","last_became_peered":"2024-09-10T08:28:45.477167+0000","last_unstale":"2024-09-10T08:28:46.495035+0000","last_undegraded":"2024-09-10T08:28:46.495035+0000","last_fullsized":"2024-09-10T08:28:46.495035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587518+0000","last_change":"2024-09-10T08:28:45.477960+0000","last_active":"2024-09-10T08:28:46.587518+0000","last_peered":"2024-09-10T08:28:46.587518+0000","last_clean":"2024-09-10T08:28:46.587518+0000","last_became_active":"2024-09-10T08:28:45.477375+0000","last_became_peered":"2024-09-10T08:28:45.477375+0000","last_unstale":"2024-09-10T08:28:46.587518+0000","last_undegraded":"2024-09-10T08:28:46.587518+0000","last_fullsized":"2024-09-10T08:28:46.587518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:10.245108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587184+0000","last_change":"2024-09-10T08:28:45.483734+0000","last_active":"2024-09-10T08:28:46.587184+0000","last_peered":"2024-09-10T08:28:46.587184+0000","last_clean":"2024-09-10T08:28:46.587184+0000","last_became_active":"2024-09-10T08:28:45.483301+0000","last_became_peered":"2024-09-10T08:28:45.483301+0000","last_unstale":"2024-09-10T08:28:46.587184+0000","last_undegraded":"2024-09-10T08:28:46.587184+0000","last_fullsized":"2024-09-10T08:28:46.587184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587401+0000","last_change":"2024-09-10T08:28:45.479471+0000","last_active":"2024-09-10T08:28:46.587401+0000","last_peered":"2024-09-10T08:28:46.587401+0000","last_clean":"2024-09-10T08:28:46.587401+0000","last_became_active":"2024-09-10T08:28:45.478665+0000","last_became_peered":"2024-09-10T08:28:45.478665+0000","last_unstale":"2024-09-10T08:28:46.587401+0000","last_undegraded":"2024-09-10T08:28:46.587401+0000","last_fullsized":"2024-09-10T08:28:46.587401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:36.570790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475915+0000","last_change":"2024-09-10T08:28:45.494626+0000","last_active":"2024-09-10T08:28:46.475915+0000","last_peered":"2024-09-10T08:28:46.475915+0000","last_clean":"2024-09-10T08:28:46.475915+0000","last_became_active":"2024-09-10T08:28:45.494433+0000","last_became_peered":"2024-09-10T08:28:45.494433+0000","last_unstale":"2024-09-10T08:28:46.475915+0000","last_undegraded":"2024-09-10T08:28:46.475915+0000","last_fullsized":"2024-09-10T08:28:46.475915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476903+0000","last_change":"2024-09-10T08:28:45.504534+0000","last_active":"2024-09-10T08:28:46.476903+0000","last_peered":"2024-09-10T08:28:46.476903+0000","last_clean":"2024-09-10T08:28:46.476903+0000","last_became_active":"2024-09-10T08:28:45.504293+0000","last_became_peered":"2024-09-10T08:28:45.504293+0000","last_unstale":"2024-09-10T08:28:46.476903+0000","last_undegraded":"2024-09-10T08:28:46.476903+0000","last_fullsized":"2024-09-10T08:28:46.476903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:08:46.778411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476383+0000","last_change":"2024-09-10T08:28:45.481198+0000","last_active":"2024-09-10T08:28:46.476383+0000","last_peered":"2024-09-10T08:28:46.476383+0000","last_clean":"2024-09-10T08:28:46.476383+0000","last_became_active":"2024-09-10T08:28:45.480055+0000","last_became_peered":"2024-09-10T08:28:45.480055+0000","last_unstale":"2024-09-10T08:28:46.476383+0000","last_undegraded":"2024-09-10T08:28:46.476383+0000","last_fullsized":"2024-09-10T08:28:46.476383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:17.438395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476674+0000","last_change":"2024-09-10T08:28:45.492075+0000","last_active":"2024-09-10T08:28:46.476674+0000","last_peered":"2024-09-10T08:28:46.476674+0000","last_clean":"2024-09-10T08:28:46.476674+0000","last_became_active":"2024-09-10T08:28:45.491741+0000","last_became_peered":"2024-09-10T08:28:45.491741+0000","last_unstale":"2024-09-10T08:28:46.476674+0000","last_undegraded":"2024-09-10T08:28:46.476674+0000","last_fullsized":"2024-09-10T08:28:46.476674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:43.242128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495042+0000","last_change":"2024-09-10T08:28:45.478902+0000","last_active":"2024-09-10T08:28:46.495042+0000","last_peered":"2024-09-10T08:28:46.495042+0000","last_clean":"2024-09-10T08:28:46.495042+0000","last_became_active":"2024-09-10T08:28:45.475888+0000","last_became_peered":"2024-09-10T08:28:45.475888+0000","last_unstale":"2024-09-10T08:28:46.495042+0000","last_undegraded":"2024-09-10T08:28:46.495042+0000","last_fullsized":"2024-09-10T08:28:46.495042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491948+0000","last_change":"2024-09-10T08:28:45.478099+0000","last_active":"2024-09-10T08:28:46.491948+0000","last_peered":"2024-09-10T08:28:46.491948+0000","last_clean":"2024-09-10T08:28:46.491948+0000","last_became_active":"2024-09-10T08:28:45.477815+0000","last_became_peered":"2024-09-10T08:28:45.477815+0000","last_unstale":"2024-09-10T08:28:46.491948+0000","last_undegraded":"2024-09-10T08:28:46.491948+0000","last_fullsized":"2024-09-10T08:28:46.491948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:44.367508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587254+0000","last_change":"2024-09-10T08:28:45.488544+0000","last_active":"2024-09-10T08:28:46.587254+0000","last_peered":"2024-09-10T08:28:46.587254+0000","last_clean":"2024-09-10T08:28:46.587254+0000","last_became_active":"2024-09-10T08:28:45.485592+0000","last_became_peered":"2024-09-10T08:28:45.485592+0000","last_unstale":"2024-09-10T08:28:46.587254+0000","last_undegraded":"2024-09-10T08:28:46.587254+0000","last_fullsized":"2024-09-10T08:28:46.587254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:45.213744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587693+0000","last_change":"2024-09-10T08:28:45.481216+0000","last_active":"2024-09-10T08:28:46.587693+0000","last_peered":"2024-09-10T08:28:46.587693+0000","last_clean":"2024-09-10T08:28:46.587693+0000","last_became_active":"2024-09-10T08:28:45.478869+0000","last_became_peered":"2024-09-10T08:28:45.478869+0000","last_unstale":"2024-09-10T08:28:46.587693+0000","last_undegraded":"2024-09-10T08:28:46.587693+0000","last_fullsized":"2024-09-10T08:28:46.587693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:35.411913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475989+0000","last_change":"2024-09-10T08:28:45.490048+0000","last_active":"2024-09-10T08:28:46.475989+0000","last_peered":"2024-09-10T08:28:46.475989+0000","last_clean":"2024-09-10T08:28:46.475989+0000","last_became_active":"2024-09-10T08:28:45.489782+0000","last_became_peered":"2024-09-10T08:28:45.489782+0000","last_unstale":"2024-09-10T08:28:46.475989+0000","last_undegraded":"2024-09-10T08:28:46.475989+0000","last_fullsized":"2024-09-10T08:28:46.475989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:47.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587964+0000","last_change":"2024-09-10T08:28:45.495291+0000","last_active":"2024-09-10T08:28:46.587964+0000","last_peered":"2024-09-10T08:28:46.587964+0000","last_clean":"2024-09-10T08:28:46.587964+0000","last_became_active":"2024-09-10T08:28:45.494992+0000","last_became_peered":"2024-09-10T08:28:45.494992+0000","last_unstale":"2024-09-10T08:28:46.587964+0000","last_undegraded":"2024-09-10T08:28:46.587964+0000","last_fullsized":"2024-09-10T08:28:46.587964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:08.671005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475766+0000","last_change":"2024-09-10T08:28:45.500890+0000","last_active":"2024-09-10T08:28:46.475766+0000","last_peered":"2024-09-10T08:28:46.475766+0000","last_clean":"2024-09-10T08:28:46.475766+0000","last_became_active":"2024-09-10T08:28:45.500394+0000","last_became_peered":"2024-09-10T08:28:45.500394+0000","last_unstale":"2024-09-10T08:28:46.475766+0000","last_undegraded":"2024-09-10T08:28:46.475766+0000","last_fullsized":"2024-09-10T08:28:46.475766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587511+0000","last_change":"2024-09-10T08:28:45.485960+0000","last_active":"2024-09-10T08:28:46.587511+0000","last_peered":"2024-09-10T08:28:46.587511+0000","last_clean":"2024-09-10T08:28:46.587511+0000","last_became_active":"2024-09-10T08:28:45.485438+0000","last_became_peered":"2024-09-10T08:28:45.485438+0000","last_unstale":"2024-09-10T08:28:46.587511+0000","last_undegraded":"2024-09-10T08:28:46.587511+0000","last_fullsized":"2024-09-10T08:28:46.587511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:26.564059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587099+0000","last_change":"2024-09-10T08:28:45.487123+0000","last_active":"2024-09-10T08:28:46.587099+0000","last_peered":"2024-09-10T08:28:46.587099+0000","last_clean":"2024-09-10T08:28:46.587099+0000","last_became_active":"2024-09-10T08:28:45.486850+0000","last_became_peered":"2024-09-10T08:28:45.486850+0000","last_unstale":"2024-09-10T08:28:46.587099+0000","last_undegraded":"2024-09-10T08:28:46.587099+0000","last_fullsized":"2024-09-10T08:28:46.587099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587566+0000","last_change":"2024-09-10T08:28:45.487584+0000","last_active":"2024-09-10T08:28:46.587566+0000","last_peered":"2024-09-10T08:28:46.587566+0000","last_clean":"2024-09-10T08:28:46.587566+0000","last_became_active":"2024-09-10T08:28:45.484398+0000","last_became_peered":"2024-09-10T08:28:45.484398+0000","last_unstale":"2024-09-10T08:28:46.587566+0000","last_undegraded":"2024-09-10T08:28:46.587566+0000","last_fullsized":"2024-09-10T08:28:46.587566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:09.816972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476757+0000","last_change":"2024-09-10T08:28:45.490464+0000","last_active":"2024-09-10T08:28:46.476757+0000","last_peered":"2024-09-10T08:28:46.476757+0000","last_clean":"2024-09-10T08:28:46.476757+0000","last_became_active":"2024-09-10T08:28:45.490227+0000","last_became_peered":"2024-09-10T08:28:45.490227+0000","last_unstale":"2024-09-10T08:28:46.476757+0000","last_undegraded":"2024-09-10T08:28:46.476757+0000","last_fullsized":"2024-09-10T08:28:46.476757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:04.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476111+0000","last_change":"2024-09-10T08:28:45.474822+0000","last_active":"2024-09-10T08:28:46.476111+0000","last_peered":"2024-09-10T08:28:46.476111+0000","last_clean":"2024-09-10T08:28:46.476111+0000","last_became_active":"2024-09-10T08:28:45.474528+0000","last_became_peered":"2024-09-10T08:28:45.474528+0000","last_unstale":"2024-09-10T08:28:46.476111+0000","last_undegraded":"2024-09-10T08:28:46.476111+0000","last_fullsized":"2024-09-10T08:28:46.476111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:12.822933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.474975+0000","last_change":"2024-09-10T08:28:45.486413+0000","last_active":"2024-09-10T08:28:46.474975+0000","last_peered":"2024-09-10T08:28:46.474975+0000","last_clean":"2024-09-10T08:28:46.474975+0000","last_became_active":"2024-09-10T08:28:45.486145+0000","last_became_peered":"2024-09-10T08:28:45.486145+0000","last_unstale":"2024-09-10T08:28:46.474975+0000","last_undegraded":"2024-09-10T08:28:46.474975+0000","last_fullsized":"2024-09-10T08:28:46.474975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587269+0000","last_change":"2024-09-10T08:28:45.489031+0000","last_active":"2024-09-10T08:28:46.587269+0000","last_peered":"2024-09-10T08:28:46.587269+0000","last_clean":"2024-09-10T08:28:46.587269+0000","last_became_active":"2024-09-10T08:28:45.484546+0000","last_became_peered":"2024-09-10T08:28:45.484546+0000","last_unstale":"2024-09-10T08:28:46.587269+0000","last_undegraded":"2024-09-10T08:28:46.587269+0000","last_fullsized":"2024-09-10T08:28:46.587269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587678+0000","last_change":"2024-09-10T08:28:44.484098+0000","last_active":"2024-09-10T08:28:46.587678+0000","last_peered":"2024-09-10T08:28:46.587678+0000","last_clean":"2024-09-10T08:28:46.587678+0000","last_became_active":"2024-09-10T08:28:44.483770+0000","last_became_peered":"2024-09-10T08:28:44.483770+0000","last_unstale":"2024-09-10T08:28:46.587678+0000","last_undegraded":"2024-09-10T08:28:46.587678+0000","last_fullsized":"2024-09-10T08:28:46.587678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:22.138876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492039+0000","last_change":"2024-09-10T08:28:45.476390+0000","last_active":"2024-09-10T08:28:46.492039+0000","last_peered":"2024-09-10T08:28:46.492039+0000","last_clean":"2024-09-10T08:28:46.492039+0000","last_became_active":"2024-09-10T08:28:45.476112+0000","last_became_peered":"2024-09-10T08:28:45.476112+0000","last_unstale":"2024-09-10T08:28:46.492039+0000","last_undegraded":"2024-09-10T08:28:46.492039+0000","last_fullsized":"2024-09-10T08:28:46.492039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:51.215646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476535+0000","last_change":"2024-09-10T08:28:44.484898+0000","last_active":"2024-09-10T08:28:46.476535+0000","last_peered":"2024-09-10T08:28:46.476535+0000","last_clean":"2024-09-10T08:28:46.476535+0000","last_became_active":"2024-09-10T08:28:44.484418+0000","last_became_peered":"2024-09-10T08:28:44.484418+0000","last_unstale":"2024-09-10T08:28:46.476535+0000","last_undegraded":"2024-09-10T08:28:46.476535+0000","last_fullsized":"2024-09-10T08:28:46.476535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586792+0000","last_change":"2024-09-10T08:28:44.486387+0000","last_active":"2024-09-10T08:28:46.586792+0000","last_peered":"2024-09-10T08:28:46.586792+0000","last_clean":"2024-09-10T08:28:46.586792+0000","last_became_active":"2024-09-10T08:28:44.486051+0000","last_became_peered":"2024-09-10T08:28:44.486051+0000","last_unstale":"2024-09-10T08:28:46.586792+0000","last_undegraded":"2024-09-10T08:28:46.586792+0000","last_fullsized":"2024-09-10T08:28:46.586792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588210+0000","last_change":"2024-09-10T08:28:45.493999+0000","last_active":"2024-09-10T08:28:46.588210+0000","last_peered":"2024-09-10T08:28:46.588210+0000","last_clean":"2024-09-10T08:28:46.588210+0000","last_became_active":"2024-09-10T08:28:45.493771+0000","last_became_peered":"2024-09-10T08:28:45.493771+0000","last_unstale":"2024-09-10T08:28:46.588210+0000","last_undegraded":"2024-09-10T08:28:46.588210+0000","last_fullsized":"2024-09-10T08:28:46.588210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:07.229071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476011+0000","last_change":"2024-09-10T08:28:44.481746+0000","last_active":"2024-09-10T08:28:46.476011+0000","last_peered":"2024-09-10T08:28:46.476011+0000","last_clean":"2024-09-10T08:28:46.476011+0000","last_became_active":"2024-09-10T08:28:44.481377+0000","last_became_peered":"2024-09-10T08:28:44.481377+0000","last_unstale":"2024-09-10T08:28:46.476011+0000","last_undegraded":"2024-09-10T08:28:46.476011+0000","last_fullsized":"2024-09-10T08:28:46.476011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492099+0000","last_change":"2024-09-10T08:28:45.474325+0000","last_active":"2024-09-10T08:28:46.492099+0000","last_peered":"2024-09-10T08:28:46.492099+0000","last_clean":"2024-09-10T08:28:46.492099+0000","last_became_active":"2024-09-10T08:28:45.472800+0000","last_became_peered":"2024-09-10T08:28:45.472800+0000","last_unstale":"2024-09-10T08:28:46.492099+0000","last_undegraded":"2024-09-10T08:28:46.492099+0000","last_fullsized":"2024-09-10T08:28:46.492099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:27:43.380671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587520+0000","last_change":"2024-09-10T08:28:44.478178+0000","last_active":"2024-09-10T08:28:46.587520+0000","last_peered":"2024-09-10T08:28:46.587520+0000","last_clean":"2024-09-10T08:28:46.587520+0000","last_became_active":"2024-09-10T08:28:44.476425+0000","last_became_peered":"2024-09-10T08:28:44.476425+0000","last_unstale":"2024-09-10T08:28:46.587520+0000","last_undegraded":"2024-09-10T08:28:46.587520+0000","last_fullsized":"2024-09-10T08:28:46.587520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476000+0000","last_change":"2024-09-10T08:28:45.500677+0000","last_active":"2024-09-10T08:28:46.476000+0000","last_peered":"2024-09-10T08:28:46.476000+0000","last_clean":"2024-09-10T08:28:46.476000+0000","last_became_active":"2024-09-10T08:28:45.500018+0000","last_became_peered":"2024-09-10T08:28:45.500018+0000","last_unstale":"2024-09-10T08:28:46.476000+0000","last_undegraded":"2024-09-10T08:28:46.476000+0000","last_fullsized":"2024-09-10T08:28:46.476000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:42.687801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495320+0000","last_change":"2024-09-10T08:28:44.491815+0000","last_active":"2024-09-10T08:28:46.495320+0000","last_peered":"2024-09-10T08:28:46.495320+0000","last_clean":"2024-09-10T08:28:46.495320+0000","last_became_active":"2024-09-10T08:28:44.490174+0000","last_became_peered":"2024-09-10T08:28:44.490174+0000","last_unstale":"2024-09-10T08:28:46.495320+0000","last_undegraded":"2024-09-10T08:28:46.495320+0000","last_fullsized":"2024-09-10T08:28:46.495320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588161+0000","last_change":"2024-09-10T08:28:45.503052+0000","last_active":"2024-09-10T08:28:46.588161+0000","last_peered":"2024-09-10T08:28:46.588161+0000","last_clean":"2024-09-10T08:28:46.588161+0000","last_became_active":"2024-09-10T08:28:45.502682+0000","last_became_peered":"2024-09-10T08:28:45.502682+0000","last_unstale":"2024-09-10T08:28:46.588161+0000","last_undegraded":"2024-09-10T08:28:46.588161+0000","last_fullsized":"2024-09-10T08:28:46.588161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:06.321359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476352+0000","last_change":"2024-09-10T08:28:44.478755+0000","last_active":"2024-09-10T08:28:46.476352+0000","last_peered":"2024-09-10T08:28:46.476352+0000","last_clean":"2024-09-10T08:28:46.476352+0000","last_became_active":"2024-09-10T08:28:44.477498+0000","last_became_peered":"2024-09-10T08:28:44.477498+0000","last_unstale":"2024-09-10T08:28:46.476352+0000","last_undegraded":"2024-09-10T08:28:46.476352+0000","last_fullsized":"2024-09-10T08:28:46.476352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476424+0000","last_change":"2024-09-10T08:28:45.494242+0000","last_active":"2024-09-10T08:28:46.476424+0000","last_peered":"2024-09-10T08:28:46.476424+0000","last_clean":"2024-09-10T08:28:46.476424+0000","last_became_active":"2024-09-10T08:28:45.493862+0000","last_became_peered":"2024-09-10T08:28:45.493862+0000","last_unstale":"2024-09-10T08:28:46.476424+0000","last_undegraded":"2024-09-10T08:28:46.476424+0000","last_fullsized":"2024-09-10T08:28:46.476424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:07.008683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475570+0000","last_change":"2024-09-10T08:28:44.475383+0000","last_active":"2024-09-10T08:28:46.475570+0000","last_peered":"2024-09-10T08:28:46.475570+0000","last_clean":"2024-09-10T08:28:46.475570+0000","last_became_active":"2024-09-10T08:28:44.474864+0000","last_became_peered":"2024-09-10T08:28:44.474864+0000","last_unstale":"2024-09-10T08:28:46.475570+0000","last_undegraded":"2024-09-10T08:28:46.475570+0000","last_fullsized":"2024-09-10T08:28:46.475570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:51.156834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495323+0000","last_change":"2024-09-10T08:28:45.486498+0000","last_active":"2024-09-10T08:28:46.495323+0000","last_peered":"2024-09-10T08:28:46.495323+0000","last_clean":"2024-09-10T08:28:46.495323+0000","last_became_active":"2024-09-10T08:28:45.486234+0000","last_became_peered":"2024-09-10T08:28:45.486234+0000","last_unstale":"2024-09-10T08:28:46.495323+0000","last_undegraded":"2024-09-10T08:28:46.495323+0000","last_fullsized":"2024-09-10T08:28:46.495323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.864900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476571+0000","last_change":"2024-09-10T08:28:44.485513+0000","last_active":"2024-09-10T08:28:46.476571+0000","last_peered":"2024-09-10T08:28:46.476571+0000","last_clean":"2024-09-10T08:28:46.476571+0000","last_became_active":"2024-09-10T08:28:44.485111+0000","last_became_peered":"2024-09-10T08:28:44.485111+0000","last_unstale":"2024-09-10T08:28:46.476571+0000","last_undegraded":"2024-09-10T08:28:46.476571+0000","last_fullsized":"2024-09-10T08:28:46.476571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587068+0000","last_change":"2024-09-10T08:28:45.482539+0000","last_active":"2024-09-10T08:28:46.587068+0000","last_peered":"2024-09-10T08:28:46.587068+0000","last_clean":"2024-09-10T08:28:46.587068+0000","last_became_active":"2024-09-10T08:28:45.482187+0000","last_became_peered":"2024-09-10T08:28:45.482187+0000","last_unstale":"2024-09-10T08:28:46.587068+0000","last_undegraded":"2024-09-10T08:28:46.587068+0000","last_fullsized":"2024-09-10T08:28:46.587068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:34.265731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476642+0000","last_change":"2024-09-10T08:28:44.486448+0000","last_active":"2024-09-10T08:28:46.476642+0000","last_peered":"2024-09-10T08:28:46.476642+0000","last_clean":"2024-09-10T08:28:46.476642+0000","last_became_active":"2024-09-10T08:28:44.486156+0000","last_became_peered":"2024-09-10T08:28:44.486156+0000","last_unstale":"2024-09-10T08:28:46.476642+0000","last_undegraded":"2024-09-10T08:28:46.476642+0000","last_fullsized":"2024-09-10T08:28:46.476642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476909+0000","last_change":"2024-09-10T08:28:45.487081+0000","last_active":"2024-09-10T08:28:46.476909+0000","last_peered":"2024-09-10T08:28:46.476909+0000","last_clean":"2024-09-10T08:28:46.476909+0000","last_became_active":"2024-09-10T08:28:45.482234+0000","last_became_peered":"2024-09-10T08:28:45.482234+0000","last_unstale":"2024-09-10T08:28:46.476909+0000","last_undegraded":"2024-09-10T08:28:46.476909+0000","last_fullsized":"2024-09-10T08:28:46.476909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:44.005147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494969+0000","last_change":"2024-09-10T08:28:44.491475+0000","last_active":"2024-09-10T08:28:46.494969+0000","last_peered":"2024-09-10T08:28:46.494969+0000","last_clean":"2024-09-10T08:28:46.494969+0000","last_became_active":"2024-09-10T08:28:44.490696+0000","last_became_peered":"2024-09-10T08:28:44.490696+0000","last_unstale":"2024-09-10T08:28:46.494969+0000","last_undegraded":"2024-09-10T08:28:46.494969+0000","last_fullsized":"2024-09-10T08:28:46.494969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:20.909415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587115+0000","last_change":"2024-09-10T08:28:45.487663+0000","last_active":"2024-09-10T08:28:46.587115+0000","last_peered":"2024-09-10T08:28:46.587115+0000","last_clean":"2024-09-10T08:28:46.587115+0000","last_became_active":"2024-09-10T08:28:45.487375+0000","last_became_peered":"2024-09-10T08:28:45.487375+0000","last_unstale":"2024-09-10T08:28:46.587115+0000","last_undegraded":"2024-09-10T08:28:46.587115+0000","last_fullsized":"2024-09-10T08:28:46.587115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491724+0000","last_change":"2024-09-10T08:28:44.474160+0000","last_active":"2024-09-10T08:28:46.491724+0000","last_peered":"2024-09-10T08:28:46.491724+0000","last_clean":"2024-09-10T08:28:46.491724+0000","last_became_active":"2024-09-10T08:28:44.473213+0000","last_became_peered":"2024-09-10T08:28:44.473213+0000","last_unstale":"2024-09-10T08:28:46.491724+0000","last_undegraded":"2024-09-10T08:28:46.491724+0000","last_fullsized":"2024-09-10T08:28:46.491724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475927+0000","last_change":"2024-09-10T08:28:45.497379+0000","last_active":"2024-09-10T08:28:46.475927+0000","last_peered":"2024-09-10T08:28:46.475927+0000","last_clean":"2024-09-10T08:28:46.475927+0000","last_became_active":"2024-09-10T08:28:45.494750+0000","last_became_peered":"2024-09-10T08:28:45.494750+0000","last_unstale":"2024-09-10T08:28:46.475927+0000","last_undegraded":"2024-09-10T08:28:46.475927+0000","last_fullsized":"2024-09-10T08:28:46.475927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495578+0000","last_change":"2024-09-10T08:28:44.487500+0000","last_active":"2024-09-10T08:28:46.495578+0000","last_peered":"2024-09-10T08:28:46.495578+0000","last_clean":"2024-09-10T08:28:46.495578+0000","last_became_active":"2024-09-10T08:28:44.484780+0000","last_became_peered":"2024-09-10T08:28:44.484780+0000","last_unstale":"2024-09-10T08:28:46.495578+0000","last_undegraded":"2024-09-10T08:28:46.495578+0000","last_fullsized":"2024-09-10T08:28:46.495578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:11.816227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476148+0000","last_change":"2024-09-10T08:28:45.474379+0000","last_active":"2024-09-10T08:28:46.476148+0000","last_peered":"2024-09-10T08:28:46.476148+0000","last_clean":"2024-09-10T08:28:46.476148+0000","last_became_active":"2024-09-10T08:28:45.474059+0000","last_became_peered":"2024-09-10T08:28:45.474059+0000","last_unstale":"2024-09-10T08:28:46.476148+0000","last_undegraded":"2024-09-10T08:28:46.476148+0000","last_fullsized":"2024-09-10T08:28:46.476148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:36.633587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492219+0000","last_change":"2024-09-10T08:28:44.479282+0000","last_active":"2024-09-10T08:28:46.492219+0000","last_peered":"2024-09-10T08:28:46.492219+0000","last_clean":"2024-09-10T08:28:46.492219+0000","last_became_active":"2024-09-10T08:28:44.478751+0000","last_became_peered":"2024-09-10T08:28:44.478751+0000","last_unstale":"2024-09-10T08:28:46.492219+0000","last_undegraded":"2024-09-10T08:28:46.492219+0000","last_fullsized":"2024-09-10T08:28:46.492219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495529+0000","last_change":"2024-09-10T08:28:45.474925+0000","last_active":"2024-09-10T08:28:46.495529+0000","last_peered":"2024-09-10T08:28:46.495529+0000","last_clean":"2024-09-10T08:28:46.495529+0000","last_became_active":"2024-09-10T08:28:45.474629+0000","last_became_peered":"2024-09-10T08:28:45.474629+0000","last_unstale":"2024-09-10T08:28:46.495529+0000","last_undegraded":"2024-09-10T08:28:46.495529+0000","last_fullsized":"2024-09-10T08:28:46.495529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:00.964591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587916+0000","last_change":"2024-09-10T08:28:44.482167+0000","last_active":"2024-09-10T08:28:46.587916+0000","last_peered":"2024-09-10T08:28:46.587916+0000","last_clean":"2024-09-10T08:28:46.587916+0000","last_became_active":"2024-09-10T08:28:44.481268+0000","last_became_peered":"2024-09-10T08:28:44.481268+0000","last_unstale":"2024-09-10T08:28:46.587916+0000","last_undegraded":"2024-09-10T08:28:46.587916+0000","last_fullsized":"2024-09-10T08:28:46.587916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:10.272681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495213+0000","last_change":"2024-09-10T08:28:45.480093+0000","last_active":"2024-09-10T08:28:46.495213+0000","last_peered":"2024-09-10T08:28:46.495213+0000","last_clean":"2024-09-10T08:28:46.495213+0000","last_became_active":"2024-09-10T08:28:45.479791+0000","last_became_peered":"2024-09-10T08:28:45.479791+0000","last_unstale":"2024-09-10T08:28:46.495213+0000","last_undegraded":"2024-09-10T08:28:46.495213+0000","last_fullsized":"2024-09-10T08:28:46.495213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:53.251795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587813+0000","last_change":"2024-09-10T08:28:44.482940+0000","last_active":"2024-09-10T08:28:46.587813+0000","last_peered":"2024-09-10T08:28:46.587813+0000","last_clean":"2024-09-10T08:28:46.587813+0000","last_became_active":"2024-09-10T08:28:44.482611+0000","last_became_peered":"2024-09-10T08:28:44.482611+0000","last_unstale":"2024-09-10T08:28:46.587813+0000","last_undegraded":"2024-09-10T08:28:46.587813+0000","last_fullsized":"2024-09-10T08:28:46.587813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:46:49.488130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476639+0000","last_change":"2024-09-10T08:28:45.498356+0000","last_active":"2024-09-10T08:28:46.476639+0000","last_peered":"2024-09-10T08:28:46.476639+0000","last_clean":"2024-09-10T08:28:46.476639+0000","last_became_active":"2024-09-10T08:28:45.498050+0000","last_became_peered":"2024-09-10T08:28:45.498050+0000","last_unstale":"2024-09-10T08:28:46.476639+0000","last_undegraded":"2024-09-10T08:28:46.476639+0000","last_fullsized":"2024-09-10T08:28:46.476639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:44.474059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587209+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:28:46.587209+0000","last_peered":"2024-09-10T08:28:46.587209+0000","last_clean":"2024-09-10T08:28:46.587209+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:28:46.587209+0000","last_undegraded":"2024-09-10T08:28:46.587209+0000","last_fullsized":"2024-09-10T08:28:46.587209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477118+0000","last_change":"2024-09-10T08:28:44.482174+0000","last_active":"2024-09-10T08:28:46.477118+0000","last_peered":"2024-09-10T08:28:46.477118+0000","last_clean":"2024-09-10T08:28:46.477118+0000","last_became_active":"2024-09-10T08:28:44.481625+0000","last_became_peered":"2024-09-10T08:28:44.481625+0000","last_unstale":"2024-09-10T08:28:46.477118+0000","last_undegraded":"2024-09-10T08:28:46.477118+0000","last_fullsized":"2024-09-10T08:28:46.477118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:41.681095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491913+0000","last_change":"2024-09-10T08:28:45.473182+0000","last_active":"2024-09-10T08:28:46.491913+0000","last_peered":"2024-09-10T08:28:46.491913+0000","last_clean":"2024-09-10T08:28:46.491913+0000","last_became_active":"2024-09-10T08:28:45.472864+0000","last_became_peered":"2024-09-10T08:28:45.472864+0000","last_unstale":"2024-09-10T08:28:46.491913+0000","last_undegraded":"2024-09-10T08:28:46.491913+0000","last_fullsized":"2024-09-10T08:28:46.491913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:56.237650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476087+0000","last_change":"2024-09-10T08:28:44.487580+0000","last_active":"2024-09-10T08:28:46.476087+0000","last_peered":"2024-09-10T08:28:46.476087+0000","last_clean":"2024-09-10T08:28:46.476087+0000","last_became_active":"2024-09-10T08:28:44.485986+0000","last_became_peered":"2024-09-10T08:28:44.485986+0000","last_unstale":"2024-09-10T08:28:46.476087+0000","last_undegraded":"2024-09-10T08:28:46.476087+0000","last_fullsized":"2024-09-10T08:28:46.476087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.586884+0000","last_change":"2024-09-10T08:28:45.483743+0000","last_active":"2024-09-10T08:28:46.586884+0000","last_peered":"2024-09-10T08:28:46.586884+0000","last_clean":"2024-09-10T08:28:46.586884+0000","last_became_active":"2024-09-10T08:28:45.483380+0000","last_became_peered":"2024-09-10T08:28:45.483380+0000","last_unstale":"2024-09-10T08:28:46.586884+0000","last_undegraded":"2024-09-10T08:28:46.586884+0000","last_fullsized":"2024-09-10T08:28:46.586884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476025+0000","last_change":"2024-09-10T08:28:44.483176+0000","last_active":"2024-09-10T08:28:46.476025+0000","last_peered":"2024-09-10T08:28:46.476025+0000","last_clean":"2024-09-10T08:28:46.476025+0000","last_became_active":"2024-09-10T08:28:44.482877+0000","last_became_peered":"2024-09-10T08:28:44.482877+0000","last_unstale":"2024-09-10T08:28:46.476025+0000","last_undegraded":"2024-09-10T08:28:46.476025+0000","last_fullsized":"2024-09-10T08:28:46.476025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:12.104336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587466+0000","last_change":"2024-09-10T08:28:45.489152+0000","last_active":"2024-09-10T08:28:46.587466+0000","last_peered":"2024-09-10T08:28:46.587466+0000","last_clean":"2024-09-10T08:28:46.587466+0000","last_became_active":"2024-09-10T08:28:45.485308+0000","last_became_peered":"2024-09-10T08:28:45.485308+0000","last_unstale":"2024-09-10T08:28:46.587466+0000","last_undegraded":"2024-09-10T08:28:46.587466+0000","last_fullsized":"2024-09-10T08:28:46.587466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:33.523284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476741+0000","last_change":"2024-09-10T08:28:44.479338+0000","last_active":"2024-09-10T08:28:46.476741+0000","last_peered":"2024-09-10T08:28:46.476741+0000","last_clean":"2024-09-10T08:28:46.476741+0000","last_became_active":"2024-09-10T08:28:44.474661+0000","last_became_peered":"2024-09-10T08:28:44.474661+0000","last_unstale":"2024-09-10T08:28:46.476741+0000","last_undegraded":"2024-09-10T08:28:46.476741+0000","last_fullsized":"2024-09-10T08:28:46.476741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:09.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495127+0000","last_change":"2024-09-10T08:28:45.473303+0000","last_active":"2024-09-10T08:28:46.495127+0000","last_peered":"2024-09-10T08:28:46.495127+0000","last_clean":"2024-09-10T08:28:46.495127+0000","last_became_active":"2024-09-10T08:28:45.473012+0000","last_became_peered":"2024-09-10T08:28:45.473012+0000","last_unstale":"2024-09-10T08:28:46.495127+0000","last_undegraded":"2024-09-10T08:28:46.495127+0000","last_fullsized":"2024-09-10T08:28:46.495127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587563+0000","last_change":"2024-09-10T08:28:44.479643+0000","last_active":"2024-09-10T08:28:46.587563+0000","last_peered":"2024-09-10T08:28:46.587563+0000","last_clean":"2024-09-10T08:28:46.587563+0000","last_became_active":"2024-09-10T08:28:44.479368+0000","last_became_peered":"2024-09-10T08:28:44.479368+0000","last_unstale":"2024-09-10T08:28:46.587563+0000","last_undegraded":"2024-09-10T08:28:46.587563+0000","last_fullsized":"2024-09-10T08:28:46.587563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:41.662970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.475344+0000","last_change":"2024-09-10T08:28:45.496343+0000","last_active":"2024-09-10T08:28:46.475344+0000","last_peered":"2024-09-10T08:28:46.475344+0000","last_clean":"2024-09-10T08:28:46.475344+0000","last_became_active":"2024-09-10T08:28:45.495838+0000","last_became_peered":"2024-09-10T08:28:45.495838+0000","last_unstale":"2024-09-10T08:28:46.475344+0000","last_undegraded":"2024-09-10T08:28:46.475344+0000","last_fullsized":"2024-09-10T08:28:46.475344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:29.850932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476696+0000","last_change":"2024-09-10T08:28:44.486776+0000","last_active":"2024-09-10T08:28:46.476696+0000","last_peered":"2024-09-10T08:28:46.476696+0000","last_clean":"2024-09-10T08:28:46.476696+0000","last_became_active":"2024-09-10T08:28:44.486492+0000","last_became_peered":"2024-09-10T08:28:44.486492+0000","last_unstale":"2024-09-10T08:28:46.476696+0000","last_undegraded":"2024-09-10T08:28:46.476696+0000","last_fullsized":"2024-09-10T08:28:46.476696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:25.557353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587711+0000","last_change":"2024-09-10T08:28:45.485170+0000","last_active":"2024-09-10T08:28:46.587711+0000","last_peered":"2024-09-10T08:28:46.587711+0000","last_clean":"2024-09-10T08:28:46.587711+0000","last_became_active":"2024-09-10T08:28:45.484866+0000","last_became_peered":"2024-09-10T08:28:45.484866+0000","last_unstale":"2024-09-10T08:28:46.587711+0000","last_undegraded":"2024-09-10T08:28:46.587711+0000","last_fullsized":"2024-09-10T08:28:46.587711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:09.096890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492375+0000","last_change":"2024-09-10T08:28:44.486909+0000","last_active":"2024-09-10T08:28:46.492375+0000","last_peered":"2024-09-10T08:28:46.492375+0000","last_clean":"2024-09-10T08:28:46.492375+0000","last_became_active":"2024-09-10T08:28:44.486577+0000","last_became_peered":"2024-09-10T08:28:44.486577+0000","last_unstale":"2024-09-10T08:28:46.492375+0000","last_undegraded":"2024-09-10T08:28:46.492375+0000","last_fullsized":"2024-09-10T08:28:46.492375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:56:28.844226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492290+0000","last_change":"2024-09-10T08:28:45.486103+0000","last_active":"2024-09-10T08:28:46.492290+0000","last_peered":"2024-09-10T08:28:46.492290+0000","last_clean":"2024-09-10T08:28:46.492290+0000","last_became_active":"2024-09-10T08:28:45.485815+0000","last_became_peered":"2024-09-10T08:28:45.485815+0000","last_unstale":"2024-09-10T08:28:46.492290+0000","last_undegraded":"2024-09-10T08:28:46.492290+0000","last_fullsized":"2024-09-10T08:28:46.492290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:59.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476929+0000","last_change":"2024-09-10T08:28:44.482535+0000","last_active":"2024-09-10T08:28:46.476929+0000","last_peered":"2024-09-10T08:28:46.476929+0000","last_clean":"2024-09-10T08:28:46.476929+0000","last_became_active":"2024-09-10T08:28:44.482260+0000","last_became_peered":"2024-09-10T08:28:44.482260+0000","last_unstale":"2024-09-10T08:28:46.476929+0000","last_undegraded":"2024-09-10T08:28:46.476929+0000","last_fullsized":"2024-09-10T08:28:46.476929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:06.800613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492233+0000","last_change":"2024-09-10T08:28:45.489780+0000","last_active":"2024-09-10T08:28:46.492233+0000","last_peered":"2024-09-10T08:28:46.492233+0000","last_clean":"2024-09-10T08:28:46.492233+0000","last_became_active":"2024-09-10T08:28:45.487680+0000","last_became_peered":"2024-09-10T08:28:45.487680+0000","last_unstale":"2024-09-10T08:28:46.492233+0000","last_undegraded":"2024-09-10T08:28:46.492233+0000","last_fullsized":"2024-09-10T08:28:46.492233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:30.707293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.494602+0000","last_change":"2024-09-10T08:28:44.481406+0000","last_active":"2024-09-10T08:28:46.494602+0000","last_peered":"2024-09-10T08:28:46.494602+0000","last_clean":"2024-09-10T08:28:46.494602+0000","last_became_active":"2024-09-10T08:28:44.480577+0000","last_became_peered":"2024-09-10T08:28:44.480577+0000","last_unstale":"2024-09-10T08:28:46.494602+0000","last_undegraded":"2024-09-10T08:28:46.494602+0000","last_fullsized":"2024-09-10T08:28:46.494602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:35.545019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476096+0000","last_change":"2024-09-10T08:28:45.495819+0000","last_active":"2024-09-10T08:28:46.476096+0000","last_peered":"2024-09-10T08:28:46.476096+0000","last_clean":"2024-09-10T08:28:46.476096+0000","last_became_active":"2024-09-10T08:28:45.493467+0000","last_became_peered":"2024-09-10T08:28:45.493467+0000","last_unstale":"2024-09-10T08:28:46.476096+0000","last_undegraded":"2024-09-10T08:28:46.476096+0000","last_fullsized":"2024-09-10T08:28:46.476096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:39.629101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492054+0000","last_change":"2024-09-10T08:28:44.487119+0000","last_active":"2024-09-10T08:28:46.492054+0000","last_peered":"2024-09-10T08:28:46.492054+0000","last_clean":"2024-09-10T08:28:46.492054+0000","last_became_active":"2024-09-10T08:28:44.486578+0000","last_became_peered":"2024-09-10T08:28:44.486578+0000","last_unstale":"2024-09-10T08:28:46.492054+0000","last_undegraded":"2024-09-10T08:28:46.492054+0000","last_fullsized":"2024-09-10T08:28:46.492054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.491845+0000","last_change":"2024-09-10T08:28:45.486692+0000","last_active":"2024-09-10T08:28:46.491845+0000","last_peered":"2024-09-10T08:28:46.491845+0000","last_clean":"2024-09-10T08:28:46.491845+0000","last_became_active":"2024-09-10T08:28:45.486384+0000","last_became_peered":"2024-09-10T08:28:45.486384+0000","last_unstale":"2024-09-10T08:28:46.491845+0000","last_undegraded":"2024-09-10T08:28:46.491845+0000","last_fullsized":"2024-09-10T08:28:46.491845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:07.807320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587173+0000","last_change":"2024-09-10T08:28:44.480564+0000","last_active":"2024-09-10T08:28:46.587173+0000","last_peered":"2024-09-10T08:28:46.587173+0000","last_clean":"2024-09-10T08:28:46.587173+0000","last_became_active":"2024-09-10T08:28:44.480159+0000","last_became_peered":"2024-09-10T08:28:44.480159+0000","last_unstale":"2024-09-10T08:28:46.587173+0000","last_undegraded":"2024-09-10T08:28:46.587173+0000","last_fullsized":"2024-09-10T08:28:46.587173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:37:16.208219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476507+0000","last_change":"2024-09-10T08:28:45.486876+0000","last_active":"2024-09-10T08:28:46.476507+0000","last_peered":"2024-09-10T08:28:46.476507+0000","last_clean":"2024-09-10T08:28:46.476507+0000","last_became_active":"2024-09-10T08:28:45.486594+0000","last_became_peered":"2024-09-10T08:28:45.486594+0000","last_unstale":"2024-09-10T08:28:46.476507+0000","last_undegraded":"2024-09-10T08:28:46.476507+0000","last_fullsized":"2024-09-10T08:28:46.476507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:46.755077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.477005+0000","last_change":"2024-09-10T08:28:44.482432+0000","last_active":"2024-09-10T08:28:46.477005+0000","last_peered":"2024-09-10T08:28:46.477005+0000","last_clean":"2024-09-10T08:28:46.477005+0000","last_became_active":"2024-09-10T08:28:44.481828+0000","last_became_peered":"2024-09-10T08:28:44.481828+0000","last_unstale":"2024-09-10T08:28:46.477005+0000","last_undegraded":"2024-09-10T08:28:46.477005+0000","last_fullsized":"2024-09-10T08:28:46.477005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:50:33.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476431+0000","last_change":"2024-09-10T08:28:45.498396+0000","last_active":"2024-09-10T08:28:46.476431+0000","last_peered":"2024-09-10T08:28:46.476431+0000","last_clean":"2024-09-10T08:28:46.476431+0000","last_became_active":"2024-09-10T08:28:45.498155+0000","last_became_peered":"2024-09-10T08:28:45.498155+0000","last_unstale":"2024-09-10T08:28:46.476431+0000","last_undegraded":"2024-09-10T08:28:46.476431+0000","last_fullsized":"2024-09-10T08:28:46.476431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:14.869919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.476523+0000","last_change":"2024-09-10T08:28:45.489899+0000","last_active":"2024-09-10T08:28:46.476523+0000","last_peered":"2024-09-10T08:28:46.476523+0000","last_clean":"2024-09-10T08:28:46.476523+0000","last_became_active":"2024-09-10T08:28:45.489475+0000","last_became_peered":"2024-09-10T08:28:45.489475+0000","last_unstale":"2024-09-10T08:28:46.476523+0000","last_undegraded":"2024-09-10T08:28:46.476523+0000","last_fullsized":"2024-09-10T08:28:46.476523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:31.730082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495257+0000","last_change":"2024-09-10T08:28:44.487129+0000","last_active":"2024-09-10T08:28:46.495257+0000","last_peered":"2024-09-10T08:28:46.495257+0000","last_clean":"2024-09-10T08:28:46.495257+0000","last_became_active":"2024-09-10T08:28:44.486880+0000","last_became_peered":"2024-09-10T08:28:44.486880+0000","last_unstale":"2024-09-10T08:28:46.495257+0000","last_undegraded":"2024-09-10T08:28:46.495257+0000","last_fullsized":"2024-09-10T08:28:46.495257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:13:44.207037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587327+0000","last_change":"2024-09-10T08:28:45.490936+0000","last_active":"2024-09-10T08:28:46.587327+0000","last_peered":"2024-09-10T08:28:46.587327+0000","last_clean":"2024-09-10T08:28:46.587327+0000","last_became_active":"2024-09-10T08:28:45.490450+0000","last_became_peered":"2024-09-10T08:28:45.490450+0000","last_unstale":"2024-09-10T08:28:46.587327+0000","last_undegraded":"2024-09-10T08:28:46.587327+0000","last_fullsized":"2024-09-10T08:28:46.587327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:10.734486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.495301+0000","last_change":"2024-09-10T08:28:44.480764+0000","last_active":"2024-09-10T08:28:46.495301+0000","last_peered":"2024-09-10T08:28:46.495301+0000","last_clean":"2024-09-10T08:28:46.495301+0000","last_became_active":"2024-09-10T08:28:44.476426+0000","last_became_peered":"2024-09-10T08:28:44.476426+0000","last_unstale":"2024-09-10T08:28:46.495301+0000","last_undegraded":"2024-09-10T08:28:46.495301+0000","last_fullsized":"2024-09-10T08:28:46.495301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:16.431688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588065+0000","last_change":"2024-09-10T08:28:45.496797+0000","last_active":"2024-09-10T08:28:46.588065+0000","last_peered":"2024-09-10T08:28:46.588065+0000","last_clean":"2024-09-10T08:28:46.588065+0000","last_became_active":"2024-09-10T08:28:45.496539+0000","last_became_peered":"2024-09-10T08:28:45.496539+0000","last_unstale":"2024-09-10T08:28:46.588065+0000","last_undegraded":"2024-09-10T08:28:46.588065+0000","last_fullsized":"2024-09-10T08:28:46.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:09.491944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.588032+0000","last_change":"2024-09-10T08:28:44.486240+0000","last_active":"2024-09-10T08:28:46.588032+0000","last_peered":"2024-09-10T08:28:46.588032+0000","last_clean":"2024-09-10T08:28:46.588032+0000","last_became_active":"2024-09-10T08:28:44.485305+0000","last_became_peered":"2024-09-10T08:28:44.485305+0000","last_unstale":"2024-09-10T08:28:46.588032+0000","last_undegraded":"2024-09-10T08:28:46.588032+0000","last_fullsized":"2024-09-10T08:28:46.588032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:00.278463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.587963+0000","last_change":"2024-09-10T08:28:45.479176+0000","last_active":"2024-09-10T08:28:46.587963+0000","last_peered":"2024-09-10T08:28:46.587963+0000","last_clean":"2024-09-10T08:28:46.587963+0000","last_became_active":"2024-09-10T08:28:45.478864+0000","last_became_peered":"2024-09-10T08:28:45.478864+0000","last_unstale":"2024-09-10T08:28:46.587963+0000","last_undegraded":"2024-09-10T08:28:46.587963+0000","last_fullsized":"2024-09-10T08:28:46.587963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:44.450725+0000","last_clean_scrub_stamp":"2024-09-10T08:28:44.450725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:21.653889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-10T08:28:46.492316+0000","last_change":"2024-09-10T08:28:44.489195+0000","last_active":"2024-09-10T08:28:46.492316+0000","last_peered":"2024-09-10T08:28:46.492316+0000","last_clean":"2024-09-10T08:28:46.492316+0000","last_became_active":"2024-09-10T08:28:44.488893+0000","last_became_peered":"2024-09-10T08:28:44.488893+0000","last_unstale":"2024-09-10T08:28:46.492316+0000","last_undegraded":"2024-09-10T08:28:46.492316+0000","last_fullsized":"2024-09-10T08:28:46.492316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:43.444018+0000","last_clean_scrub_stamp":"2024-09-10T08:28:43.444018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:45.748371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":241664,"data_stored":78568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":666722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:28:59.900 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:28:59.900 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T08:28:59.900 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T08:28:59.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T08:29:00.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.089+0000 7f76dd800640 1 Processor -- start 2024-09-10T08:29:00.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.089+0000 7f76dd800640 1 -- start start 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.090+0000 7f76dd800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76d8145ed0 0x7f76d80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.090+0000 7f76dd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d80b5f90 0x7f76d80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.090+0000 7f76dd800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d80b4020 con 0x7f76d8073180 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.090+0000 7f76dd800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f76d8073b00 con 0x7f76d8145ed0 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.090+0000 7f76dd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76d80b42c0 con 0x7f76d80b5f90 2024-09-10T08:29:00.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76d8145ed0 0x7f76d80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76d8145ed0 0x7f76d80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45822/0 (socket says 172.21.15.52:45822) 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 -- 172.21.15.52:0/1639536601 learned_addr learned my addr 172.21.15.52:0/1639536601 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d7400640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d80b5f90 0x7f76d80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 -- 172.21.15.52:0/1639536601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d80b5f90 msgr2=0x7f76d80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d80b5f90 0x7f76d80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 -- 172.21.15.52:0/1639536601 >> v1:172.21.15.52:6789/0 conn(0x7f76d8073180 legacy=0x7f76d80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d6a00640 1 -- 172.21.15.52:0/1639536601 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d80b45a0 con 0x7f76d8145ed0 2024-09-10T08:29:00.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.091+0000 7f76d5600640 1 -- 172.21.15.52:0/1639536601 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058024563 0 0) 0x7f76d80b4020 con 0x7f76d8073180 2024-09-10T08:29:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.092+0000 7f76d6a00640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d8145ed0 0x7f76d80b5080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76d8073c80 tx=0x7f76c802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33dc234ea3e075e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.092+0000 7f76d5600640 1 -- 172.21.15.52:0/1639536601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8037070 con 0x7f76d8145ed0 2024-09-10T08:29:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.092+0000 7f76d5600640 1 -- 172.21.15.52:0/1639536601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c8032440 con 0x7f76d8145ed0 2024-09-10T08:29:00.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.092+0000 7f76d5600640 1 -- 172.21.15.52:0/1639536601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8032810 con 0x7f76d8145ed0 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 -- 172.21.15.52:0/1639536601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d8145ed0 msgr2=0x7f76d80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d8145ed0 0x7f76d80b5080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f76d8073c80 tx=0x7f76c802a250 comp rx=0 tx=0).stop 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 -- 172.21.15.52:0/1639536601 shutdown_connections 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d80b5f90 0x7f76d80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 --2- 172.21.15.52:0/1639536601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d8145ed0 0x7f76d80b5080 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 -- 172.21.15.52:0/1639536601 >> 172.21.15.52:0/1639536601 conn(0x7f76d80ccec0 msgr2=0x7f76d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 -- 172.21.15.52:0/1639536601 shutdown_connections 2024-09-10T08:29:00.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.093+0000 7f76dd800640 1 -- 172.21.15.52:0/1639536601 wait complete. 2024-09-10T08:29:00.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.095+0000 7f76dd800640 1 Processor -- start 2024-09-10T08:29:00.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.095+0000 7f76dd800640 1 -- start start 2024-09-10T08:29:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d8073180 0x7f76d81596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 0x7f76d8144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76d81462b0 con 0x7f76d80b5f90 2024-09-10T08:29:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76d80b4b60 con 0x7f76d8145ed0 2024-09-10T08:29:00.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76dd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76d8146430 con 0x7f76d8073180 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45838/0 (socket says 172.21.15.52:45838) 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 -- 172.21.15.52:0/248083122 learned_addr learned my addr 172.21.15.52:0/248083122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6a00640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d8073180 0x7f76d81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d7400640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 0x7f76d8144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 -- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d8073180 msgr2=0x7f76d81596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d8073180 0x7f76d81596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 -- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 msgr2=0x7f76d8144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 0x7f76d8144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d6000640 1 -- 172.21.15.52:0/248083122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d80c73a0 con 0x7f76d80b5f90 2024-09-10T08:29:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.096+0000 7f76d7400640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 0x7f76d8144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76d6000640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c520 tx=0x7f76c400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c40052d0 con 0x7f76d80b5f90 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4005470 con 0x7f76d80b5f90 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4012850 con 0x7f76d80b5f90 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d80c7680 con 0x7f76d80b5f90 2024-09-10T08:29:00.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.097+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d80c7c40 con 0x7f76d80b5f90 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.098+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d80735c0 con 0x7f76d80b5f90 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.099+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76c40129f0 con 0x7f76d80b5f90 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.100+0000 7f76cea00640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.100+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f76c408aa70 con 0x7f76d80b5f90 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.100+0000 7f76d6a00640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.101+0000 7f76d6a00640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 0x7f76b806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76c8034000 tx=0x7f76c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.104+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76c4059390 con 0x7f76d80b5f90 2024-09-10T08:29:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.326+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f76d80cd9b0 con 0x7f76d80b5f90 2024-09-10T08:29:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.327+0000 7f76cea00640 1 -- 172.21.15.52:0/248083122 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f76c4058c90 con 0x7f76d80b5f90 2024-09-10T08:29:00.326 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:00.326 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:29:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 msgr2=0x7f76b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 0x7f76b806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76c8034000 tx=0x7f76c802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 msgr2=0x7f76d8141410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c520 tx=0x7f76c400c9e0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 shutdown_connections 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d8145ed0 0x7f76d8144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d80b5f90 0x7f76d8141410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 --2- 172.21.15.52:0/248083122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76d8073180 0x7f76d81596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 >> 172.21.15.52:0/248083122 conn(0x7f76d80ccec0 msgr2=0x7f76d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 shutdown_connections 2024-09-10T08:29:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.329+0000 7f76dd800640 1 -- 172.21.15.52:0/248083122 wait complete. 2024-09-10T08:29:00.345 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T08:29:00.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:00.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.503+0000 7fddd9400640 1 Processor -- start 2024-09-10T08:29:00.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.503+0000 7fddd9400640 1 -- start start 2024-09-10T08:29:00.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd9400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fddd415e440 0x7fddd40d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd9400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddd40b6710 0x7fddd40b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd9400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40d3990 con 0x7fddd40cf450 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd9400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40d3c70 con 0x7fddd40b6710 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd9400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40d3f50 con 0x7fddd415e440 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.504+0000 7fddd8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddd40b6710 0x7fddd40b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddd40b6710 0x7fddd40b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45854/0 (socket says 172.21.15.52:45854) 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 -- 172.21.15.52:0/129994931 learned_addr learned my addr 172.21.15.52:0/129994931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd3e00640 1 --2- 172.21.15.52:0/129994931 >> v2:172.21.15.176:3300/0 conn(0x7fddd415e440 0x7fddd40d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 -- 172.21.15.52:0/129994931 >> v2:172.21.15.176:3300/0 conn(0x7fddd415e440 msgr2=0x7fddd40d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 --2- 172.21.15.52:0/129994931 >> v2:172.21.15.176:3300/0 conn(0x7fddd415e440 0x7fddd40d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 -- 172.21.15.52:0/129994931 >> v1:172.21.15.176:6789/0 conn(0x7fddd40cf450 legacy=0x7fddd40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.505+0000 7fddd8a00640 1 -- 172.21.15.52:0/129994931 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40d4230 con 0x7fddd40b6710 2024-09-10T08:29:00.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.506+0000 7fddd8a00640 1 --2- 172.21.15.52:0/129994931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd40b7b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddd4068870 tx=0x7fddcc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94153f5aad920319 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.506+0000 7fddd2a00640 1 -- 172.21.15.52:0/129994931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc037070 con 0x7fddd40b6710 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.506+0000 7fddd2a00640 1 -- 172.21.15.52:0/129994931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc02ae50 con 0x7fddd40b6710 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.506+0000 7fddd2a00640 1 -- 172.21.15.52:0/129994931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc032860 con 0x7fddd40b6710 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 -- 172.21.15.52:0/129994931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 msgr2=0x7fddd40b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 --2- 172.21.15.52:0/129994931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd40b7b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddd4068870 tx=0x7fddcc02a300 comp rx=0 tx=0).stop 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 -- 172.21.15.52:0/129994931 shutdown_connections 2024-09-10T08:29:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 --2- 172.21.15.52:0/129994931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd40b7b60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 --2- 172.21.15.52:0/129994931 >> v2:172.21.15.176:3300/0 conn(0x7fddd415e440 0x7fddd40d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 -- 172.21.15.52:0/129994931 >> 172.21.15.52:0/129994931 conn(0x7fddd4067f80 msgr2=0x7fddd40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 -- 172.21.15.52:0/129994931 shutdown_connections 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.507+0000 7fddd9400640 1 -- 172.21.15.52:0/129994931 wait complete. 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.508+0000 7fddd9400640 1 Processor -- start 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.509+0000 7fddd9400640 1 -- start start 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.509+0000 7fddd9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.509+0000 7fddd9400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddd40cf450 0x7fddd40b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddd415e440 0x7fddd415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd9400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40b76c0 con 0x7fddd40b6710 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd9400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40b7540 con 0x7fddd415e440 2024-09-10T08:29:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd9400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40b80a0 con 0x7fddd40cf450 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45856/0 (socket says 172.21.15.52:45856) 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 -- 172.21.15.52:0/404466052 learned_addr learned my addr 172.21.15.52:0/404466052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddd40cf450 0x7fddd40b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd8a00640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddd415e440 0x7fddd415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 -- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddd40cf450 msgr2=0x7fddd40b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddd40cf450 0x7fddd40b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 -- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddd415e440 msgr2=0x7fddd415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddd415e440 0x7fddd415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 -- 172.21.15.52:0/404466052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40cba90 con 0x7fddd40b6710 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.510+0000 7fddd3e00640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fddc400efc0 tx=0x7fddc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.511+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4018020 con 0x7fddd40b6710 2024-09-10T08:29:00.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.511+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4014480 con 0x7fddd40b6710 2024-09-10T08:29:00.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.511+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd40cbd70 con 0x7fddd40b6710 2024-09-10T08:29:00.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.511+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4014850 con 0x7fddd40b6710 2024-09-10T08:29:00.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.511+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd4157bf0 con 0x7fddd40b6710 2024-09-10T08:29:00.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.512+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd40cc160 con 0x7fddd40b6710 2024-09-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.513+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddc4005d10 con 0x7fddd40b6710 2024-09-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.514+0000 7fddcbe00640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 0x7fddb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.514+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fddc408b9a0 con 0x7fddd40b6710 2024-09-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.514+0000 7fddd3400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 0x7fddb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.515+0000 7fddd3400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 0x7fddb406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b97f0 tx=0x7fddc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.518+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddc4022070 con 0x7fddd40b6710 2024-09-10T08:29:00.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.739+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddd40cbf40 con 0x7fddd40b6710 2024-09-10T08:29:00.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.740+0000 7fddcbe00640 1 -- 172.21.15.52:0/404466052 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fddc4010040 con 0x7fddd40b6710 2024-09-10T08:29:00.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:00.739 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:00.739 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 msgr2=0x7fddb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 0x7fddb406e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b97f0 tx=0x7fddc0009040 comp rx=0 tx=0).stop 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 msgr2=0x7fddd41586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fddc400efc0 tx=0x7fddc400c490 comp rx=0 tx=0).stop 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 shutdown_connections 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddb406be30 0x7fddb406e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddd415e440 0x7fddd415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddd40cf450 0x7fddd40b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 --2- 172.21.15.52:0/404466052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddd40b6710 0x7fddd41586e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 >> 172.21.15.52:0/404466052 conn(0x7fddd4067f80 msgr2=0x7fddd40b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 shutdown_connections 2024-09-10T08:29:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.742+0000 7fddd9400640 1 -- 172.21.15.52:0/404466052 wait complete. 2024-09-10T08:29:00.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.913+0000 7f36f2a00640 1 Processor -- start 2024-09-10T08:29:00.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.913+0000 7f36f2a00640 1 -- start start 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.914+0000 7f36f2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec06c320 0x7f36ec15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.914+0000 7f36f2a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f36ec13eb20 0x7f36ec15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.914+0000 7f36f2a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec071180 con 0x7f36ec0b2d40 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.914+0000 7f36f2a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec071ab0 con 0x7f36ec06c320 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.914+0000 7f36f2a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec071460 con 0x7f36ec13eb20 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec06c320 0x7f36ec15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f36ec06c320 0x7f36ec15bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45864/0 (socket says 172.21.15.52:45864) 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 -- 172.21.15.52:0/2848196432 learned_addr learned my addr 172.21.15.52:0/2848196432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36f0a00640 1 --2- 172.21.15.52:0/2848196432 >> v2:172.21.15.176:3300/0 conn(0x7f36ec13eb20 0x7f36ec15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 -- 172.21.15.52:0/2848196432 >> v2:172.21.15.176:3300/0 conn(0x7f36ec13eb20 msgr2=0x7f36ec15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 --2- 172.21.15.52:0/2848196432 >> v2:172.21.15.176:3300/0 conn(0x7f36ec13eb20 0x7f36ec15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 -- 172.21.15.52:0/2848196432 >> v1:172.21.15.176:6789/0 conn(0x7f36ec0b2d40 legacy=0x7f36ec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.915+0000 7f36e3e00640 1 -- 172.21.15.52:0/2848196432 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec071740 con 0x7f36ec06c320 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.916+0000 7f36e3e00640 1 --2- 172.21.15.52:0/2848196432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec06c320 0x7f36ec15bcf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f36ec1595c0 tx=0x7f36d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f188171c7548b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.916+0000 7f36eb400640 1 -- 172.21.15.52:0/2848196432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037070 con 0x7f36ec06c320 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.916+0000 7f36eb400640 1 -- 172.21.15.52:0/2848196432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4032440 con 0x7f36ec06c320 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.916+0000 7f36eb400640 1 -- 172.21.15.52:0/2848196432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4032810 con 0x7f36ec06c320 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 -- 172.21.15.52:0/2848196432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec06c320 msgr2=0x7f36ec15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2848196432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec06c320 0x7f36ec15bcf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f36ec1595c0 tx=0x7f36d402a230 comp rx=0 tx=0).stop 2024-09-10T08:29:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 -- 172.21.15.52:0/2848196432 shutdown_connections 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2848196432 >> v2:172.21.15.176:3300/0 conn(0x7f36ec13eb20 0x7f36ec15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2848196432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec06c320 0x7f36ec15bcf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 -- 172.21.15.52:0/2848196432 >> 172.21.15.52:0/2848196432 conn(0x7f36ec0ccec0 msgr2=0x7f36ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 -- 172.21.15.52:0/2848196432 shutdown_connections 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.917+0000 7f36f2a00640 1 -- 172.21.15.52:0/2848196432 wait complete. 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.919+0000 7f36f2a00640 1 Processor -- start 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.919+0000 7f36f2a00640 1 -- start start 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36ec06c320 0x7f36ec151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 0x7f36ec154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec0720c0 con 0x7f36ec0b2d40 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec071f40 con 0x7f36ec06c320 2024-09-10T08:29:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec072240 con 0x7f36ec13eb20 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45874/0 (socket says 172.21.15.52:45874) 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 -- 172.21.15.52:0/2930124413 learned_addr learned my addr 172.21.15.52:0/2930124413 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f0a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 0x7f36ec154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36ebe00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36ec06c320 0x7f36ec151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 -- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 msgr2=0x7f36ec154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 0x7f36ec154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 -- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36ec06c320 msgr2=0x7f36ec151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36ec06c320 0x7f36ec151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36e3e00640 1 -- 172.21.15.52:0/2930124413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec138f70 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.920+0000 7f36f0a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 0x7f36ec154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36e3e00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d4000c00 tx=0x7f36d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4041020 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d40306c0 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037040 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec1383f0 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.921+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec1389b0 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.922+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec06bc10 con 0x7f36ec0b2d40 2024-09-10T08:29:00.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.923+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36d4044020 con 0x7f36ec0b2d40 2024-09-10T08:29:00.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.924+0000 7f36e8c00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 0x7f36c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:00.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.924+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f36d40ab6a0 con 0x7f36ec0b2d40 2024-09-10T08:29:00.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.925+0000 7f36ebe00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 0x7f36c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:00.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.925+0000 7f36ebe00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 0x7f36c806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004f60 tx=0x7f36dc007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:00.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:00.929+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36d404b030 con 0x7f36ec0b2d40 2024-09-10T08:29:01.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.147+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36ec1517c0 con 0x7f36ec0b2d40 2024-09-10T08:29:01.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.147+0000 7f36e8c00640 1 -- 172.21.15.52:0/2930124413 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f36d4079fb0 con 0x7f36ec0b2d40 2024-09-10T08:29:01.147 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:01.147 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:01.147 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 msgr2=0x7f36c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 0x7f36c806e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004f60 tx=0x7f36dc007e30 comp rx=0 tx=0).stop 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 msgr2=0x7f36ec134dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36d4000c00 tx=0x7f36d40046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 shutdown_connections 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f36c806be30 0x7f36c806e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f36ec13eb20 0x7f36ec154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36ec0b2d40 0x7f36ec134dd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 --2- 172.21.15.52:0/2930124413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36ec06c320 0x7f36ec151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.149+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 >> 172.21.15.52:0/2930124413 conn(0x7f36ec0ccec0 msgr2=0x7f36ec0d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.150+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 shutdown_connections 2024-09-10T08:29:01.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.150+0000 7f36f2a00640 1 -- 172.21.15.52:0/2930124413 wait complete. 2024-09-10T08:29:01.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.320+0000 7f6846a00640 1 Processor -- start 2024-09-10T08:29:01.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.320+0000 7f6846a00640 1 -- start start 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6846a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f68400b2d40 0x7f684006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6846a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684013eb20 0x7f684006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6846a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6840071180 con 0x7f684015bcf0 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6846a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6840071ab0 con 0x7f68400b2d40 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6846a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6840071460 con 0x7f684013eb20 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.321+0000 7f6844a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f684015bcf0 0x7f684015c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48362/0 (socket says 172.21.15.52:48362) 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f6844a00640 1 -- 172.21.15.52:0/370515824 learned_addr learned my addr 172.21.15.52:0/370515824 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683fe00640 1 --2- 172.21.15.52:0/370515824 >> v2:172.21.15.176:3300/0 conn(0x7f68400b2d40 0x7f684006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683f400640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684013eb20 0x7f684006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683ea00640 1 -- 172.21.15.52:0/370515824 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945661543 0 0) 0x7f6840071180 con 0x7f684015bcf0 2024-09-10T08:29:01.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683ea00640 1 -- 172.21.15.52:0/370515824 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824003520 con 0x7f684015bcf0 2024-09-10T08:29:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683fe00640 1 -- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684013eb20 msgr2=0x7f684006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683fe00640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684013eb20 0x7f684006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683fe00640 1 -- 172.21.15.52:0/370515824 >> v1:172.21.15.52:6789/0 conn(0x7f684015bcf0 legacy=0x7f684015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.322+0000 7f683fe00640 1 -- 172.21.15.52:0/370515824 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840071740 con 0x7f68400b2d40 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.323+0000 7f683fe00640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68400b2d40 0x7f684006bc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6840071c30 tx=0x7f683002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6622e3d560e5315 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f683ea00640 1 -- 172.21.15.52:0/370515824 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830037070 con 0x7f68400b2d40 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f683ea00640 1 -- 172.21.15.52:0/370515824 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6830032440 con 0x7f68400b2d40 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f683ea00640 1 -- 172.21.15.52:0/370515824 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68300327f0 con 0x7f68400b2d40 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 -- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68400b2d40 msgr2=0x7f684006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68400b2d40 0x7f684006bc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6840071c30 tx=0x7f683002a180 comp rx=0 tx=0).stop 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 -- 172.21.15.52:0/370515824 shutdown_connections 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684013eb20 0x7f684006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 --2- 172.21.15.52:0/370515824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68400b2d40 0x7f684006bc10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 -- 172.21.15.52:0/370515824 >> 172.21.15.52:0/370515824 conn(0x7f68400ccec0 msgr2=0x7f68400cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 -- 172.21.15.52:0/370515824 shutdown_connections 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.324+0000 7f6846a00640 1 -- 172.21.15.52:0/370515824 wait complete. 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.326+0000 7f6846a00640 1 Processor -- start 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.326+0000 7f6846a00640 1 -- start start 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f684013eb20 0x7f68400b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684015bcf0 0x7f68400b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68400722d0 con 0x7f68400b2d40 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6840072150 con 0x7f684013eb20 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6846a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6840072450 con 0x7f684015bcf0 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f683fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f683fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45886/0 (socket says 172.21.15.52:45886) 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f683fe00640 1 -- 172.21.15.52:0/82133300 learned_addr learned my addr 172.21.15.52:0/82133300 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f6844a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684015bcf0 0x7f68400b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.327+0000 7f683f400640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f684013eb20 0x7f68400b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 -- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684015bcf0 msgr2=0x7f68400b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684015bcf0 0x7f68400b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 -- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f684013eb20 msgr2=0x7f68400b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f684013eb20 0x7f68400b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 -- 172.21.15.52:0/82133300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684015cf50 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f683fe00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f683002a1c0 tx=0x7f68300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830041030 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683003d420 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830037040 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.328+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684015d230 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.329+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684015d7f0 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.330+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6840072840 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.330+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6830044070 con 0x7f68400b2d40 2024-09-10T08:29:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.331+0000 7f6837e00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.331+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f68300ab460 con 0x7f68400b2d40 2024-09-10T08:29:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.332+0000 7f683f400640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.332+0000 7f683f400640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68400b2990 tx=0x7f682c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.335+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6830079730 con 0x7f68400b2d40 2024-09-10T08:29:01.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.523+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f684006c9c0 con 0x7f68400b2d40 2024-09-10T08:29:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.525+0000 7f6837e00640 1 -- 172.21.15.52:0/82133300 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7f683007da30 con 0x7f68400b2d40 2024-09-10T08:29:01.524 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:01.524 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 msgr2=0x7f682006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 0x7f682006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68400b2990 tx=0x7f682c009190 comp rx=0 tx=0).stop 2024-09-10T08:29:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 msgr2=0x7f684015f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f683002a1c0 tx=0x7f68300046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 shutdown_connections 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f682006be30 0x7f682006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f684015bcf0 0x7f68400b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f684013eb20 0x7f68400b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 --2- 172.21.15.52:0/82133300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68400b2d40 0x7f684015f280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 >> 172.21.15.52:0/82133300 conn(0x7f68400ccec0 msgr2=0x7f68401595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 shutdown_connections 2024-09-10T08:29:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.527+0000 7f6846a00640 1 -- 172.21.15.52:0/82133300 wait complete. 2024-09-10T08:29:01.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:01.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.698+0000 7fc7c7c00640 1 Processor -- start 2024-09-10T08:29:01.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.698+0000 7fc7c7c00640 1 -- start start 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7c7c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc7c0145ed0 0x7fc7c00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7c7c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7c0073180 0x7fc7c00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7c7c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c00b4020 con 0x7fc7c00b5880 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7c7c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c0073b00 con 0x7fc7c0073180 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7c7c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c00b63d0 con 0x7fc7c0145ed0 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.699+0000 7fc7bfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7c0073180 0x7fc7c00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7c0073180 0x7fc7c00735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45894/0 (socket says 172.21.15.52:45894) 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 -- 172.21.15.52:0/2809932004 learned_addr learned my addr 172.21.15.52:0/2809932004 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:01.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7c5200640 1 --2- 172.21.15.52:0/2809932004 >> v2:172.21.15.176:3300/0 conn(0x7fc7c0145ed0 0x7fc7c00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 -- 172.21.15.52:0/2809932004 >> v2:172.21.15.176:3300/0 conn(0x7fc7c0145ed0 msgr2=0x7fc7c00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:01.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 --2- 172.21.15.52:0/2809932004 >> v2:172.21.15.176:3300/0 conn(0x7fc7c0145ed0 0x7fc7c00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 -- 172.21.15.52:0/2809932004 >> v1:172.21.15.176:6789/0 conn(0x7fc7c00b5880 legacy=0x7fc7c00b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.700+0000 7fc7bfe00640 1 -- 172.21.15.52:0/2809932004 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c00b42c0 con 0x7fc7c0073180 2024-09-10T08:29:01.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.701+0000 7fc7bfe00640 1 --2- 172.21.15.52:0/2809932004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0073180 0x7fc7c00735c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0069cd0 tx=0x7fc7ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4b0da295af07b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.701+0000 7fc7bf400640 1 -- 172.21.15.52:0/2809932004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac037070 con 0x7fc7c0073180 2024-09-10T08:29:01.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.701+0000 7fc7bf400640 1 -- 172.21.15.52:0/2809932004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac032440 con 0x7fc7c0073180 2024-09-10T08:29:01.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.701+0000 7fc7bf400640 1 -- 172.21.15.52:0/2809932004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac032810 con 0x7fc7c0073180 2024-09-10T08:29:01.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 -- 172.21.15.52:0/2809932004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0073180 msgr2=0x7fc7c00735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/2809932004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0073180 0x7fc7c00735c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0069cd0 tx=0x7fc7ac02a270 comp rx=0 tx=0).stop 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 -- 172.21.15.52:0/2809932004 shutdown_connections 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/2809932004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0073180 0x7fc7c00735c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/2809932004 >> v2:172.21.15.176:3300/0 conn(0x7fc7c0145ed0 0x7fc7c00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 -- 172.21.15.52:0/2809932004 >> 172.21.15.52:0/2809932004 conn(0x7fc7c00ccec0 msgr2=0x7fc7c00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 -- 172.21.15.52:0/2809932004 shutdown_connections 2024-09-10T08:29:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.702+0000 7fc7c7c00640 1 -- 172.21.15.52:0/2809932004 wait complete. 2024-09-10T08:29:01.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.703+0000 7fc7c7c00640 1 Processor -- start 2024-09-10T08:29:01.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 -- start start 2024-09-10T08:29:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c00b5880 0x7fc7c0143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 0x7fc7c0143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00b4b60 con 0x7fc7c0145ed0 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.704+0000 7fc7c7c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c00b4880 con 0x7fc7c0073180 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c7c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c01462b0 con 0x7fc7c00b5880 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 0x7fc7c0143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:42150/0 (socket says 172.21.15.52:42150) 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5200640 1 -- 172.21.15.52:0/445375463 learned_addr learned my addr 172.21.15.52:0/445375463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7bfe00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c00b5880 0x7fc7c0143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 -- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c00b5880 msgr2=0x7fc7c0143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c00b5880 0x7fc7c0143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 -- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 msgr2=0x7fc7c015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5c00640 1 -- 172.21.15.52:0/445375463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c00cc220 con 0x7fc7c0145ed0 2024-09-10T08:29:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.705+0000 7fc7c5200640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7c5c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 0x7fc7c0143da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c730 tx=0x7fc7b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8003b90 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b8003d50 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8005310 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c00cb980 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.706+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c00cbf40 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.707+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c00735c0 con 0x7fc7c0145ed0 2024-09-10T08:29:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.708+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7b80056c0 con 0x7fc7c0145ed0 2024-09-10T08:29:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.709+0000 7fc7bcc00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 0x7fc7a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.709+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc7b808adc0 con 0x7fc7c0145ed0 2024-09-10T08:29:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.709+0000 7fc7c5200640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 0x7fc7a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.710+0000 7fc7c5200640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 0x7fc7a006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0142330 tx=0x7fc7b4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.713+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7b8059080 con 0x7fc7c0145ed0 2024-09-10T08:29:01.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.931+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7c00cc6e0 con 0x7fc7c0145ed0 2024-09-10T08:29:01.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.932+0000 7fc7bcc00640 1 -- 172.21.15.52:0/445375463 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fc7b805d380 con 0x7fc7c0145ed0 2024-09-10T08:29:01.931 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:01.931 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:01.932 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 msgr2=0x7fc7a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 0x7fc7a006e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0142330 tx=0x7fc7b4009190 comp rx=0 tx=0).stop 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 msgr2=0x7fc7c0143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 0x7fc7c0143da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c730 tx=0x7fc7b800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 shutdown_connections 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7a006be30 0x7fc7a006e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7c0145ed0 0x7fc7c0143da0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7c00b5880 0x7fc7c0143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 --2- 172.21.15.52:0/445375463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7c0073180 0x7fc7c015c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 >> 172.21.15.52:0/445375463 conn(0x7fc7c00ccec0 msgr2=0x7fc7c0140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 shutdown_connections 2024-09-10T08:29:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:01.934+0000 7fc7c7c00640 1 -- 172.21.15.52:0/445375463 wait complete. 2024-09-10T08:29:02.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:28:44.896156+0000', 'modified': '2024-09-10T08:28:47.904970+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/1971878185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 1971878185}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 1971878185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-09-10T08:29:02.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:29:02.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:29:02.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.513+0000 7f8486600640 1 Processor -- start 2024-09-10T08:29:02.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.513+0000 7f8486600640 1 -- start start 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f8486600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84800b6710 0x7f84800d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f8486600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800cf450 0x7f84800b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f8486600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84800d3990 con 0x7f848015e440 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f8486600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f84800d3c70 con 0x7f84800b6710 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f8486600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84800d3f50 con 0x7f84800cf450 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f847fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84800b6710 0x7f84800d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f847fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84800b6710 0x7f84800d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45914/0 (socket says 172.21.15.52:45914) 2024-09-10T08:29:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.514+0000 7f847fe00640 1 -- 172.21.15.52:0/1819858112 learned_addr learned my addr 172.21.15.52:0/1819858112 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.515+0000 7f8485c00640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800cf450 0x7f84800b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.515+0000 7f847fe00640 1 -- 172.21.15.52:0/1819858112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800cf450 msgr2=0x7f84800b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.515+0000 7f847fe00640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800cf450 0x7f84800b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.515+0000 7f847fe00640 1 -- 172.21.15.52:0/1819858112 >> v1:172.21.15.176:6789/0 conn(0x7f848015e440 legacy=0x7f84800b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.515+0000 7f847fe00640 1 -- 172.21.15.52:0/1819858112 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84800d4230 con 0x7f84800b6710 2024-09-10T08:29:02.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f847fe00640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800b6710 0x7f84800d3240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f846c009870 tx=0x7f846c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e376801463cefd3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f847f400640 1 -- 172.21.15.52:0/1819858112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c037070 con 0x7f84800b6710 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f847f400640 1 -- 172.21.15.52:0/1819858112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c02ae50 con 0x7f84800b6710 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f847f400640 1 -- 172.21.15.52:0/1819858112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c032860 con 0x7f84800b6710 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f8486600640 1 -- 172.21.15.52:0/1819858112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800b6710 msgr2=0x7f84800d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.516+0000 7f8486600640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800b6710 0x7f84800d3240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f846c009870 tx=0x7f846c02a300 comp rx=0 tx=0).stop 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 -- 172.21.15.52:0/1819858112 shutdown_connections 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800cf450 0x7f84800b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 --2- 172.21.15.52:0/1819858112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800b6710 0x7f84800d3240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 -- 172.21.15.52:0/1819858112 >> 172.21.15.52:0/1819858112 conn(0x7f8480067f80 msgr2=0x7f84800d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 -- 172.21.15.52:0/1819858112 shutdown_connections 2024-09-10T08:29:02.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.517+0000 7f8486600640 1 -- 172.21.15.52:0/1819858112 wait complete. 2024-09-10T08:29:02.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.518+0000 7f8486600640 1 Processor -- start 2024-09-10T08:29:02.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.518+0000 7f8486600640 1 -- start start 2024-09-10T08:29:02.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800b6710 0x7f84800cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f848015e440 0x7f84800aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84800b76c0 con 0x7f84800cf450 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84800b7540 con 0x7f848015e440 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f8486600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84800b80a0 con 0x7f84800b6710 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f847fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.519+0000 7f847fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45918/0 (socket says 172.21.15.52:45918) 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 -- 172.21.15.52:0/1097260304 learned_addr learned my addr 172.21.15.52:0/1097260304 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f8485200640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800b6710 0x7f84800cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f8485c00640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f848015e440 0x7f84800aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 -- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800b6710 msgr2=0x7f84800cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800b6710 0x7f84800cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 -- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f848015e440 msgr2=0x7f84800aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f848015e440 0x7f84800aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 -- 172.21.15.52:0/1097260304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84800ceb20 con 0x7f84800cf450 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847fe00640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f846c000c00 tx=0x7f846c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847cc00640 1 -- 172.21.15.52:0/1097260304 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c041070 con 0x7f84800cf450 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847cc00640 1 -- 172.21.15.52:0/1097260304 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f846c03c670 con 0x7f84800cf450 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f847cc00640 1 -- 172.21.15.52:0/1097260304 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c037040 con 0x7f84800cf450 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.520+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84800cd2c0 con 0x7f84800cf450 2024-09-10T08:29:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.521+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84800ce7d0 con 0x7f84800cf450 2024-09-10T08:29:02.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.522+0000 7f847cc00640 1 -- 172.21.15.52:0/1097260304 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f846c044070 con 0x7f84800cf450 2024-09-10T08:29:02.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.523+0000 7f847cc00640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 0x7f846006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.523+0000 7f847cc00640 1 -- 172.21.15.52:0/1097260304 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f846c0ab760 con 0x7f84800cf450 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.524+0000 7f8485200640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 0x7f846006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.524+0000 7f848aa43740 1 Processor -- start 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.524+0000 7f848aa43740 1 -- start start 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.524+0000 7f8485200640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 0x7f846006e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8474000f60 tx=0x7f8474009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6392660 0x564cd6395280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564cd62f33b0 con 0x564cd6396630 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564cd62f8410 con 0x564cd6392660 2024-09-10T08:29:02.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564cd62a0620 con 0x564cd6394ea0 2024-09-10T08:29:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f8485c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f8485c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45924/0 (socket says 172.21.15.52:45924) 2024-09-10T08:29:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.525+0000 7f8485c00640 1 -- 172.21.15.52:0/775881994 learned_addr learned my addr 172.21.15.52:0/775881994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f847fe00640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6392660 0x564cd6395280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485200640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 -- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 msgr2=0x564cd63da640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63da640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 -- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6392660 msgr2=0x564cd6395280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6392660 0x564cd6395280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 -- 172.21.15.52:0/775881994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd600b2d0 con 0x564cd6396630 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485200640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63da640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8485c00640 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8478003a40 tx=0x7f8478003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99c71ac9566dc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8471600640 1 -- 172.21.15.52:0/775881994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478015420 con 0x564cd6396630 2024-09-10T08:29:02.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8471600640 1 -- 172.21.15.52:0/775881994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847801a070 con 0x564cd6396630 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.526+0000 7f8471600640 1 -- 172.21.15.52:0/775881994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84780157c0 con 0x564cd6396630 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 -- 172.21.15.52:0/775881994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 msgr2=0x564cd638f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8478003a40 tx=0x7f8478003f00 comp rx=0 tx=0).stop 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 -- 172.21.15.52:0/775881994 shutdown_connections 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd638f720 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6392660 0x564cd6395280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 --2- 172.21.15.52:0/775881994 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63da640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 -- 172.21.15.52:0/775881994 >> 172.21.15.52:0/775881994 conn(0x564cd63918f0 msgr2=0x564cd63d9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 -- 172.21.15.52:0/775881994 shutdown_connections 2024-09-10T08:29:02.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.527+0000 7f848aa43740 1 -- 172.21.15.52:0/775881994 wait complete. 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.528+0000 7f848aa43740 1 -- start start 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.528+0000 7f848aa43740 1 Processor -- start 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd63be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564cd62b3780 con 0x564cd6396630 2024-09-10T08:29:02.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564cd62f43d0 con 0x564cd63b7d10 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564cd6390d90 con 0x564cd6394ea0 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f848aa43740 10 client.0 _ll_register_callbacks cb 0x564cd62f15d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f847fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f847fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45930/0 (socket says 172.21.15.52:45930) 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f847fe00640 1 -- 172.21.15.52:0/3233340759 learned_addr learned my addr 172.21.15.52:0/3233340759 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f8485c00640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd63be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.529+0000 7f8485200640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 -- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 msgr2=0x564cd63bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 -- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 msgr2=0x564cd63be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd63be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 -- 172.21.15.52:0/3233340759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd60d56b0 con 0x564cd6396630 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8485c00640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd63be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f847fe00640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f846c082140 tx=0x7f846c079ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2557b7b62e5de636 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846c04b040 con 0x564cd6396630 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f846c0823e0 con 0x564cd6396630 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f847801a070 con 0x564cd6396630 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f846c082670 con 0x564cd6396630 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f848aa43740 10 client.4596 fetch_fsmap learned FSMap version 8 2024-09-10T08:29:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564cd63900c0 con 0x564cd6396630 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847801a070 con 0x564cd6396630 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.530+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f846c078f00 con 0x564cd6396630 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 10 client.4596 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 10 client.4596 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 20 client.4596 populate_metadata read hostname 'smithi052' 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63ea2a0 0x564cd63f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 4 client.4596 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 --> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cd6305b40 con 0x564cd63ea2a0 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f8485200640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63ea2a0 0x564cd63f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f8485200640 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63ea2a0 0x564cd63f7c60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73e54b57d5da60c server_cookie=7aa9c70b55f031e4 in_seq=0 out_seq=0 2024-09-10T08:29:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.531+0000 7f8466000640 10 client.4596 ms_handle_connect on v2:172.21.15.52:6834/1971878185 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.532+0000 7f8466000640 1 -- 172.21.15.52:0/3233340759 <== mds.0 v2:172.21.15.52:6834/1971878185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564cd6305b40 con 0x564cd63ea2a0 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.532+0000 7f8466000640 10 client.4596 handle_command_reply: tid=0 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.532+0000 7f848aa43740 1 client.4596 shutdown 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 msgr2=0x564cd63bdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f846c082140 tx=0x7f846c079ab0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 shutdown_connections 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63ea2a0 0x564cd63f7c60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd63be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6396630 0x564cd63bdc60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 --2- 172.21.15.52:0/3233340759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f8466000640 0 client.4596 ms_handle_reset on v2:172.21.15.52:6834/1971878185 2024-09-10T08:29:02.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 >> 172.21.15.52:0/3233340759 conn(0x564cd6392660 msgr2=0x564cd63d7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 shutdown_connections 2024-09-10T08:29:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 1 -- 172.21.15.52:0/3233340759 wait complete. 2024-09-10T08:29:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.533+0000 7f848aa43740 20 client.4596 trim_cache size 0 max 16384 2024-09-10T08:29:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.552+0000 7f848aa43740 1 Processor -- start 2024-09-10T08:29:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.552+0000 7f848aa43740 1 -- start start 2024-09-10T08:29:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 0x564cd63bb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd64525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84800ade10 con 0x564cd6394ea0 2024-09-10T08:29:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84800ad170 con 0x564cd63b7d10 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84800ad7c0 con 0x564cd6396630 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45944/0 (socket says 172.21.15.52:45944) 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 -- 172.21.15.52:0/4087229209 learned_addr learned my addr 172.21.15.52:0/4087229209 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485c00640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd64525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f847fe00640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 0x564cd63bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 -- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 msgr2=0x564cd63bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 0x564cd63bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 -- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 msgr2=0x564cd64525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd64525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f8485200640 1 -- 172.21.15.52:0/4087229209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd6452ae0 con 0x564cd6394ea0 2024-09-10T08:29:02.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.553+0000 7f847fe00640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 0x564cd63bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.554+0000 7f8485200640 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8474007a60 tx=0x7f8474012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62af30022c36940c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.554+0000 7f8470c00640 1 -- 172.21.15.52:0/4087229209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474030070 con 0x564cd6394ea0 2024-09-10T08:29:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.554+0000 7f8470c00640 1 -- 172.21.15.52:0/4087229209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847401b040 con 0x564cd6394ea0 2024-09-10T08:29:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.554+0000 7f8470c00640 1 -- 172.21.15.52:0/4087229209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474024960 con 0x564cd6394ea0 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- 172.21.15.52:0/4087229209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 msgr2=0x564cd63e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8474007a60 tx=0x7f8474012000 comp rx=0 tx=0).stop 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- 172.21.15.52:0/4087229209 shutdown_connections 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd63b7d10 0x564cd64525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6396630 0x564cd63bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 --2- 172.21.15.52:0/4087229209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd6394ea0 0x564cd63e9ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- 172.21.15.52:0/4087229209 >> 172.21.15.52:0/4087229209 conn(0x564cd6392660 msgr2=0x564cd63db670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- 172.21.15.52:0/4087229209 shutdown_connections 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- 172.21.15.52:0/4087229209 wait complete. 2024-09-10T08:29:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.555+0000 7f848aa43740 1 -- start start 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.556+0000 7f848aa43740 1 Processor -- start 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.556+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6396630 0x564cd63d9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 0x564cd63d9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564cd63ea120 con 0x564cd63b7d10 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564cd62b3780 con 0x564cd6396630 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564cd63ea710 con 0x564cd6394ea0 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f848aa43740 10 client.0 _ll_register_callbacks cb 0x7f8474007cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53492/0 (socket says 172.21.15.52:53492) 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 0x564cd63d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 -- 172.21.15.52:0/181633825 learned_addr learned my addr 172.21.15.52:0/181633825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f847fe00640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6396630 0x564cd63d9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 -- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6396630 msgr2=0x564cd63d9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6396630 0x564cd63d9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 -- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 msgr2=0x564cd63d9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 0x564cd63d9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485200640 1 -- 172.21.15.52:0/181633825 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x564cd63b6bb0 con 0x564cd6394ea0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.557+0000 7f8485c00640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 0x564cd63d9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f8485200640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f847402e040 tx=0x7f8474001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb77f3e0127c347a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f8466000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3301/0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474030070 con 0x564cd6394ea0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f847401b040 con 0x564cd6394ea0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mon.2 v2:172.21.15.176:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8474036b10 con 0x564cd6394ea0 2024-09-10T08:29:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8474001500 con 0x564cd6394ea0 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f848aa43740 10 client.4451 fetch_fsmap learned FSMap version 8 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.558+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564cd63dd750 con 0x564cd6394ea0 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mon.2 v2:172.21.15.176:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847401b040 con 0x564cd6394ea0 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mon.2 v2:172.21.15.176:3301/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f847402a030 con 0x564cd6394ea0 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 10 client.4451 fetch_fsmap finished waiting for FSMap version 8 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 10 client.4451 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 20 client.4451 populate_metadata read hostname 'smithi052' 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63e8580 0x564cd63e8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 4 client.4451 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 --> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] -- command(tid 0: {"prefix": "status"}) -- 0x564cd62ffe90 con 0x564cd63e8580 2024-09-10T08:29:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f847fe00640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63e8580 0x564cd63e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.559+0000 7f847fe00640 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63e8580 0x564cd63e8960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39708d16b2bc4bde server_cookie=33587c869f4d8a58 in_seq=0 out_seq=0 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f8466000640 10 client.4451 ms_handle_connect on v2:172.21.15.52:6834/1971878185 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f8466000640 1 -- 172.21.15.52:0/181633825 <== mds.0 v2:172.21.15.52:6834/1971878185 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x564cd62ffe90 con 0x564cd63e8580 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f8466000640 10 client.4451 handle_command_reply: tid=0 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 client.4451 shutdown 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 msgr2=0x564cd63dd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f847402e040 tx=0x7f8474001080 comp rx=0 tx=0).stop 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 shutdown_connections 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:6834/1971878185,v1:172.21.15.52:6835/1971878185] conn(0x564cd63e8580 0x564cd63e8960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564cd63b7d10 0x564cd63d9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564cd6396630 0x564cd63d9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 --2- 172.21.15.52:0/181633825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564cd6394ea0 0x564cd63dd210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 >> 172.21.15.52:0/181633825 conn(0x564cd6392660 msgr2=0x564cd63faeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f8466000640 0 client.4451 ms_handle_reset on v2:172.21.15.52:6834/1971878185 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 shutdown_connections 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 1 -- 172.21.15.52:0/181633825 wait complete. 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.560+0000 7f848aa43740 20 client.4451 trim_cache size 0 max 16384 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:29:02.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4282, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 17.088630253000002, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 8, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 22, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 22, 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 23.175286978999999 2024-09-10T08:29:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:29:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 msgr2=0x7f846006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 0x7f846006e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8474000f60 tx=0x7f8474009040 comp rx=0 tx=0).stop 2024-09-10T08:29:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 msgr2=0x7f848015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f846c000c00 tx=0x7f846c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 shutdown_connections 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f846006be30 0x7f846006e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f848015e440 0x7f84800aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84800cf450 0x7f848015b410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 --2- 172.21.15.52:0/1097260304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84800b6710 0x7f84800cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 >> 172.21.15.52:0/1097260304 conn(0x7f8480067f80 msgr2=0x7f84800d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 shutdown_connections 2024-09-10T08:29:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:02.561+0000 7f8486600640 1 -- 172.21.15.52:0/1097260304 wait complete. 2024-09-10T08:29:02.577 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T08:29:02.589 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T08:29:02.589 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T08:29:02.589 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T08:29:02.589 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T08:29:02.631 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T08:29:02.631 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T08:29:02.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.631 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:29:02.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-10T08:29:02.767 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:02.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:02.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.770 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:29:02.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-10T08:29:02.903 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:02.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:02.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.906 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:29:02.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:02.947 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-10T08:29:03.051 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:03.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:03.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:03.055 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:29:03.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:03.092 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-10T08:29:03.189 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-10T08:29:03.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:29:03.192 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-10T08:29:03.193 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:03.193 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:03.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:03.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.349+0000 7f5f8cc00640 1 Processor -- start 2024-09-10T08:29:03.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.349+0000 7f5f8cc00640 1 -- start start 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f88145ed0 0x7f5f880b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 0x7f5f880735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880b5880 0x7f5f880b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5f88073b00 con 0x7f5f88145ed0 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5f880b4020 con 0x7f5f88073180 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f8cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f880b42c0 con 0x7f5f880b5880 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f88145ed0 0x7f5f880b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f88145ed0 0x7f5f880b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45950/0 (socket says 172.21.15.52:45950) 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f85e00640 1 -- 172.21.15.52:0/2246062879 learned_addr learned my addr 172.21.15.52:0/2246062879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/2246062879 >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 0x7f5f880735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.350+0000 7f5f86800640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880b5880 0x7f5f880b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f85e00640 1 -- 172.21.15.52:0/2246062879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880b5880 msgr2=0x7f5f880b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f85e00640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880b5880 0x7f5f880b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f85e00640 1 -- 172.21.15.52:0/2246062879 >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 msgr2=0x7f5f880735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f85e00640 1 --2- 172.21.15.52:0/2246062879 >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 0x7f5f880735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f85e00640 1 -- 172.21.15.52:0/2246062879 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f880b45a0 con 0x7f5f88145ed0 2024-09-10T08:29:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.351+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/2246062879 >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 0x7f5f880735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:03.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f85e00640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88145ed0 0x7f5f880b5080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f880d1490 tx=0x7f5f7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb30dfe19eb53120 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f85400640 1 -- 172.21.15.52:0/2246062879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78037070 con 0x7f5f88145ed0 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f85400640 1 -- 172.21.15.52:0/2246062879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78032440 con 0x7f5f88145ed0 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f85400640 1 -- 172.21.15.52:0/2246062879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78032810 con 0x7f5f88145ed0 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f8cc00640 1 -- 172.21.15.52:0/2246062879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88145ed0 msgr2=0x7f5f880b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.352+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88145ed0 0x7f5f880b5080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5f880d1490 tx=0x7f5f7802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 -- 172.21.15.52:0/2246062879 shutdown_connections 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/2246062879 >> v2:172.21.15.176:3300/0 conn(0x7f5f88073180 0x7f5f880735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f880b5880 0x7f5f880b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/2246062879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88145ed0 0x7f5f880b5080 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 -- 172.21.15.52:0/2246062879 >> 172.21.15.52:0/2246062879 conn(0x7f5f880ccec0 msgr2=0x7f5f880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 -- 172.21.15.52:0/2246062879 shutdown_connections 2024-09-10T08:29:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.353+0000 7f5f8cc00640 1 -- 172.21.15.52:0/2246062879 wait complete. 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.354+0000 7f5f8cc00640 1 Processor -- start 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.354+0000 7f5f8cc00640 1 -- start start 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 0x7f5f88158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88145ed0 0x7f5f881592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f880b6250 con 0x7f5f88073180 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f880b4b60 con 0x7f5f880b5880 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.355+0000 7f5f8cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f880b63d0 con 0x7f5f88145ed0 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45964/0 (socket says 172.21.15.52:45964) 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 -- 172.21.15.52:0/3522113671 learned_addr learned my addr 172.21.15.52:0/3522113671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 0x7f5f88158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f86800640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88145ed0 0x7f5f881592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 -- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88145ed0 msgr2=0x7f5f881592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88145ed0 0x7f5f881592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 -- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 msgr2=0x7f5f88158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 0x7f5f88158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 -- 172.21.15.52:0/3522113671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f88142390 con 0x7f5f88073180 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 0x7f5f88158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.356+0000 7f5f85e00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f7802a220 tx=0x7f5f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.357+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78041020 con 0x7f5f88073180 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.357+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7803d620 con 0x7f5f88073180 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.357+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78037040 con 0x7f5f88073180 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.357+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f88142670 con 0x7f5f88073180 2024-09-10T08:29:03.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.357+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8813f600 con 0x7f5f88073180 2024-09-10T08:29:03.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.358+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f881462b0 con 0x7f5f88073180 2024-09-10T08:29:03.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.359+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f78044020 con 0x7f5f88073180 2024-09-10T08:29:03.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.360+0000 7f5f7e000640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 0x7f5f6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:03.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.360+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5f780ab590 con 0x7f5f88073180 2024-09-10T08:29:03.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.360+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 0x7f5f6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:03.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.361+0000 7f5f7fe00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 0x7f5f6406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5f88144250 tx=0x7f5f70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.364+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f7804b030 con 0x7f5f88073180 2024-09-10T08:29:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.586+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5f880cf900 con 0x7f5f88073180 2024-09-10T08:29:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.586+0000 7f5f7e000640 1 -- 172.21.15.52:0/3522113671 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f5f78079ea0 con 0x7f5f88073180 2024-09-10T08:29:03.587 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:29:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 msgr2=0x7f5f6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 0x7f5f6406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5f88144250 tx=0x7f5f70008040 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 msgr2=0x7f5f8813d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5f7802a220 tx=0x7f5f780046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 shutdown_connections 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5f6406be60 0x7f5f6406e320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f88145ed0 0x7f5f881592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f880b5880 0x7f5f88158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 --2- 172.21.15.52:0/3522113671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f88073180 0x7f5f8813d290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 >> 172.21.15.52:0/3522113671 conn(0x7f5f880ccec0 msgr2=0x7f5f880d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 shutdown_connections 2024-09-10T08:29:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03.588+0000 7f5f8cc00640 1 -- 172.21.15.52:0/3522113671 wait complete. 2024-09-10T08:29:03.605 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:03.606 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:03.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:03.607 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:03.645 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42659sec preferred_lft 42659sec 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:03.646 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:03.647 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:29:03.647 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:29:03.647 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:03.647 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:03.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:29:03.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-09-10T08:29:03.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-09-10T08:29:03.648 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:29:03.648 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:03.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:04.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:04.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:04.063 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:04.119 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:29:04.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:04.122 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:29:04.177 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:29:04.177 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:04.177 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:29:04.178 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:29:04.178 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:29:04.178 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:04.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:04.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:04.801 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:29:04.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:04.837 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-09-10T08:29:04.914 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:04.914 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:04.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:04.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T08:29:04.914 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:05.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:05.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:05.092 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T08:29:05.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T08:29:05.093 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:05.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:05.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:05.330 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:05.330 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:05.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:29:05.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:29:05.330 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:05.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:05.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:05.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:05.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:05.499 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:05.536 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:05.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:05.536 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:05.620 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:29:05.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:05.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:05.760 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:05.760 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:06.362 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:06.362 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:06.362 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:29:06.362 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:29:06.362 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:29:06.364 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:29:06.364 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:29:06.364 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:29:06.364 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:29:06.364 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:29:06.367 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:29:06.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:06.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:06.425 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.523 INFO:teuthology.orchestra.run.smithi052.stdout:client4460 2024-09-10T08:29:06.523 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:06.524 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:06.561 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:06.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.696 INFO:teuthology.orchestra.run.smithi052.stdout:client4460 2024-09-10T08:29:06.696 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:06.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:06.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.792 INFO:teuthology.orchestra.run.smithi052.stdout:client4460 2024-09-10T08:29:06.792 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4eb61a63-2a53-4336-9780-430e4b9fd90b.client4460/status') 2024-09-10T08:29:06.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:06.896 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.4460 (3)172.21.15.52:0/3191878931 2024-09-10T08:29:06.896 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-09-10T08:29:06.896 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-09-10T08:29:06.896 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-09-10T08:29:06.896 INFO:teuthology.orchestra.run.smithi052.stderr:70 bytes copied, 5.9093e-05 s, 1.2 MB/s 2024-09-10T08:29:06.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:06.906 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-10T08:29:06.907 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:06.907 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T08:29:06.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:07.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.063+0000 7f3b63000640 1 Processor -- start 2024-09-10T08:29:07.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.063+0000 7f3b63000640 1 -- start start 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b63000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0b6710 0x7f3b5c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b63000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b63000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c0d3990 con 0x7f3b5c15e440 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b63000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0d3c70 con 0x7f3b5c0b6710 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b63000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0d3f50 con 0x7f3b5c0cf450 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b61200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0b6710 0x7f3b5c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b61200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b5c0b6710 0x7f3b5c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35984/0 (socket says 172.21.15.52:35984) 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.064+0000 7f3b61200640 1 -- 172.21.15.52:0/699484984 learned_addr learned my addr 172.21.15.52:0/699484984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.065+0000 7f3b62600640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.065+0000 7f3b61200640 1 -- 172.21.15.52:0/699484984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 msgr2=0x7f3b5c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.065+0000 7f3b61200640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.065+0000 7f3b61200640 1 -- 172.21.15.52:0/699484984 >> v1:172.21.15.176:6789/0 conn(0x7f3b5c15e440 legacy=0x7f3b5c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:07.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.065+0000 7f3b61200640 1 -- 172.21.15.52:0/699484984 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0d4230 con 0x7f3b5c0b6710 2024-09-10T08:29:07.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.066+0000 7f3b61200640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0d3240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce61f73449d4b6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.066+0000 7f3b5be00640 1 -- 172.21.15.52:0/699484984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48037070 con 0x7f3b5c0b6710 2024-09-10T08:29:07.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.066+0000 7f3b5be00640 1 -- 172.21.15.52:0/699484984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48032440 con 0x7f3b5c0b6710 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.066+0000 7f3b5be00640 1 -- 172.21.15.52:0/699484984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48032810 con 0x7f3b5c0b6710 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 -- 172.21.15.52:0/699484984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 msgr2=0x7f3b5c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0d3240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4802a2a0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 -- 172.21.15.52:0/699484984 shutdown_connections 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 --2- 172.21.15.52:0/699484984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0d3240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 -- 172.21.15.52:0/699484984 >> 172.21.15.52:0/699484984 conn(0x7f3b5c067f80 msgr2=0x7f3b5c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 -- 172.21.15.52:0/699484984 shutdown_connections 2024-09-10T08:29:07.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.067+0000 7f3b63000640 1 -- 172.21.15.52:0/699484984 wait complete. 2024-09-10T08:29:07.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.068+0000 7f3b63000640 1 Processor -- start 2024-09-10T08:29:07.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 -- start start 2024-09-10T08:29:07.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c15e440 0x7f3b5c0b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b76c0 con 0x7f3b5c0b6710 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b7540 con 0x7f3b5c15e440 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.069+0000 7f3b63000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b80a0 con 0x7f3b5c0cf450 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35994/0 (socket says 172.21.15.52:35994) 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 -- 172.21.15.52:0/2040758748 learned_addr learned my addr 172.21.15.52:0/2040758748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61200640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b62600640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c15e440 0x7f3b5c0b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 -- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 msgr2=0x7f3b5c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 -- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c15e440 msgr2=0x7f3b5c0b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c15e440 0x7f3b5c0b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.070+0000 7f3b61c00640 1 -- 172.21.15.52:0/2040758748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1e4f90 con 0x7f3b5c0b6710 2024-09-10T08:29:07.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b61c00640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c390 tx=0x7f3b5000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50011790 con 0x7f3b5c0b6710 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50017070 con 0x7f3b5c0b6710 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50011b70 con 0x7f3b5c0b6710 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1f8710 con 0x7f3b5c0b6710 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.071+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1e5510 con 0x7f3b5c0b6710 2024-09-10T08:29:07.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.072+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c0b7b60 con 0x7f3b5c0b6710 2024-09-10T08:29:07.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.073+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b50011d10 con 0x7f3b5c0b6710 2024-09-10T08:29:07.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.074+0000 7f3b59600640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 0x7f3b3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:07.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.074+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b5008ab70 con 0x7f3b5c0b6710 2024-09-10T08:29:07.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.074+0000 7f3b61200640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 0x7f3b3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:07.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.075+0000 7f3b61200640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 0x7f3b3c06e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b48034000 tx=0x7f3b4802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:07.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.078+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b50058e30 con 0x7f3b5c0b6710 2024-09-10T08:29:07.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.297+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3b5c156230 con 0x7f3b5c0b6710 2024-09-10T08:29:07.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.298+0000 7f3b59600640 1 -- 172.21.15.52:0/2040758748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3b5005d130 con 0x7f3b5c0b6710 2024-09-10T08:29:07.298 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:29:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 msgr2=0x7f3b3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 0x7f3b3c06e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3b48034000 tx=0x7f3b4802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 msgr2=0x7f3b5c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000c390 tx=0x7f3b5000c850 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 shutdown_connections 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3c06be30 0x7f3b3c06e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c15e440 0x7f3b5c0b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c0cf450 0x7f3b5c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 --2- 172.21.15.52:0/2040758748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c0b6710 0x7f3b5c0cc8b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 >> 172.21.15.52:0/2040758748 conn(0x7f3b5c067f80 msgr2=0x7f3b5c0d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 shutdown_connections 2024-09-10T08:29:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07.300+0000 7f3b63000640 1 -- 172.21.15.52:0/2040758748 wait complete. 2024-09-10T08:29:07.316 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:29:07.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:07.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:29:07.316 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T08:29:07.317 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T08:29:07.317 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:29:07.317 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:07.317 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:07.317 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T08:29:07.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.317 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.353 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:29:07.354 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42655sec preferred_lft 42655sec 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:29:07.355 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:07.356 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:29:07.356 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:07.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.356 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:07.448 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:29:07.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.451 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:29:07.487 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:29:07.488 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:07.488 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:29:07.488 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:29:07.488 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:07.488 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:07.488 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:07.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:29:07.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:29:07.489 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:29:07.489 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:07.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:07.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.686 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:29:07.721 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:29:07.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.722 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-09-10T08:29:07.797 INFO:teuthology.orchestra.run.smithi052.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T08:29:07.797 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:07.797 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:07.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:29:07.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T08:29:07.798 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:07.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:07.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:07.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:07.975 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T08:29:08.030 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.031 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:08.032 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 92:ab:3c:47:3c:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:29:08.032 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:29:08.032 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.032 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::90ab:3cff:fe47:3c2f/64 scope link 2024-09-10T08:29:08.032 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T08:29:08.089 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 92:ab:3c:47:3c:2f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::90ab:3cff:fe47:3c2f/64 scope link 2024-09-10T08:29:08.090 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:08.092 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T08:29:08.093 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:08.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.311 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:08.311 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:08.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.1 up 2024-09-10T08:29:08.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T08:29:08.311 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:08.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:08.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:08.478 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T08:29:08.514 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T08:29:08.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:08.515 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T08:29:08.589 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-10T08:29:08.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:08.718 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:08.718 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:08.745 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:08.745 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:08.746 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:29:08.746 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 2@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:29:08.746 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:29:08.747 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-10T08:29:08.747 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:29:08.747 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:29:08.747 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:29:08.747 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:29:08.750 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:29:08.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:08.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T08:29:08.806 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:08.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:08.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:08.894 INFO:teuthology.orchestra.run.smithi052.stdout:client4617 2024-09-10T08:29:08.895 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:08.895 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:08.930 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:09.059 INFO:teuthology.orchestra.run.smithi052.stdout:client4617 2024-09-10T08:29:09.059 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:09.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:09.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:09.148 INFO:teuthology.orchestra.run.smithi052.stdout:client4617 2024-09-10T08:29:09.149 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4eb61a63-2a53-4336-9780-430e4b9fd90b.client4617/status') 2024-09-10T08:29:09.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:09.248 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.4617 (3)192.168.0.2:0/2494936695 2024-09-10T08:29:09.248 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-09-10T08:29:09.248 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-09-10T08:29:09.248 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-09-10T08:29:09.249 INFO:teuthology.orchestra.run.smithi052.stderr:69 bytes copied, 6.9783e-05 s, 989 kB/s 2024-09-10T08:29:09.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:09.259 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-10T08:29:09.259 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:09.259 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:09.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:09.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.414+0000 7fc2eb200640 1 Processor -- start 2024-09-10T08:29:09.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.414+0000 7fc2eb200640 1 -- start start 2024-09-10T08:29:09.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.415+0000 7fc2eb200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2e4145ed0 0x7fc2e40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.415+0000 7fc2eb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2e40735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2eb200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e40b4020 con 0x7fc2e4073180 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2eb200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e4073b00 con 0x7fc2e4145ed0 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2eb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e40b42c0 con 0x7fc2e40b5f90 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2db400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc2e4073180 0x7fc2e40b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44184/0 (socket says 172.21.15.52:44184) 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2db400640 1 -- 172.21.15.52:0/3132359028 learned_addr learned my addr 172.21.15.52:0/3132359028 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2e3e00640 1 --2- 172.21.15.52:0/3132359028 >> v2:172.21.15.176:3300/0 conn(0x7fc2e4145ed0 0x7fc2e40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2e9200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2e40735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569085127 0 0) 0x7fc2e40b4020 con 0x7fc2e4073180 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.416+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c8003520 con 0x7fc2e4073180 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2821616435 0 0) 0x7fc2c8003520 con 0x7fc2e4073180 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 msgr2=0x7fc2e40735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2e40735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 >> v2:172.21.15.176:3300/0 conn(0x7fc2e4145ed0 msgr2=0x7fc2e40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 --2- 172.21.15.52:0/3132359028 >> v2:172.21.15.176:3300/0 conn(0x7fc2e4145ed0 0x7fc2e40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e40b45a0 con 0x7fc2e4073180 2024-09-10T08:29:09.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc2cc001690 con 0x7fc2e4073180 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 >> v1:172.21.15.52:6789/0 conn(0x7fc2e4073180 legacy=0x7fc2e40b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2c80039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8003f50 0x7fc2c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2c8004d40 0x7fc2c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4073b00 con 0x7fc2c8004d40 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e40b42c0 con 0x7fc2c8003f50 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c800b9c0 con 0x7fc2e40b5f90 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2c8004d40 0x7fc2c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e3e00640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2c80039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2db400640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8003f50 0x7fc2c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 -- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 msgr2=0x7fc2c80039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40b5f90 0x7fc2c80039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 -- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8003f50 msgr2=0x7fc2c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8003f50 0x7fc2c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.417+0000 7fc2e9200640 1 -- 172.21.15.52:0/3132359028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c8003520 con 0x7fc2c8004d40 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.418+0000 7fc2e9200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2c8004d40 0x7fc2c80051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e170 tx=0x7fc2c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d7021f603d7728 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc034020 con 0x7fc2c8004d40 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0305f0 con 0x7fc2c8004d40 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2e3400640 1 -- 172.21.15.52:0/3132359028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc009c10 con 0x7fc2c8004d40 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 -- 172.21.15.52:0/3132359028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2c8004d40 msgr2=0x7fc2c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 --2- 172.21.15.52:0/3132359028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2c8004d40 0x7fc2c80051c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e170 tx=0x7fc2c8005830 comp rx=0 tx=0).stop 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2e9200640 1 -- 172.21.15.52:0/3132359028 reap_dead start 2024-09-10T08:29:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 -- 172.21.15.52:0/3132359028 shutdown_connections 2024-09-10T08:29:09.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 -- 172.21.15.52:0/3132359028 >> 172.21.15.52:0/3132359028 conn(0x7fc2e40ccec0 msgr2=0x7fc2e40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:09.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 -- 172.21.15.52:0/3132359028 shutdown_connections 2024-09-10T08:29:09.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.419+0000 7fc2eb200640 1 -- 172.21.15.52:0/3132359028 wait complete. 2024-09-10T08:29:09.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.421+0000 7fc2eb200640 1 Processor -- start 2024-09-10T08:29:09.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.421+0000 7fc2eb200640 1 -- start start 2024-09-10T08:29:09.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8004d40 0x7fc2e415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40713f0 0x7fc2e40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e41462b0 con 0x7fc2e4070f70 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e40b4b60 con 0x7fc2c8004d40 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2eb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e4146430 con 0x7fc2e40713f0 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36006/0 (socket says 172.21.15.52:36006) 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.422+0000 7fc2db400640 1 -- 172.21.15.52:0/2156044810 learned_addr learned my addr 172.21.15.52:0/2156044810 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2e3e00640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8004d40 0x7fc2e415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2e9200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40713f0 0x7fc2e40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 -- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40713f0 msgr2=0x7fc2e40c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40713f0 0x7fc2e40c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 -- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8004d40 msgr2=0x7fc2e415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8004d40 0x7fc2e415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 -- 172.21.15.52:0/2156044810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e40719c0 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2db400640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001800 tx=0x7fc2cc0076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc004e10 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc018070 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00fc20 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.423+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e4071ca0 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.424+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e4072260 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.425+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e40b5080 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.425+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2cc01d460 con 0x7fc2e4070f70 2024-09-10T08:29:09.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.426+0000 7fc2e0c00640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 0x7fc2c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:09.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.426+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2cc08ae50 con 0x7fc2e4070f70 2024-09-10T08:29:09.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.427+0000 7fc2e3e00640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 0x7fc2c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:09.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.427+0000 7fc2e3e00640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 0x7fc2c006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4130d30 tx=0x7fc2d4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:09.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.430+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2cc059760 con 0x7fc2e4070f70 2024-09-10T08:29:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.654+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc2e40cfc90 con 0x7fc2e4070f70 2024-09-10T08:29:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.654+0000 7fc2e0c00640 1 -- 172.21.15.52:0/2156044810 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc2cc059060 con 0x7fc2e4070f70 2024-09-10T08:29:09.655 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:29:09.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 msgr2=0x7fc2c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 0x7fc2c006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4130d30 tx=0x7fc2d4009190 comp rx=0 tx=0).stop 2024-09-10T08:29:09.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 msgr2=0x7fc2e40c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:09.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc001800 tx=0x7fc2cc0076e0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 shutdown_connections 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc2c006be60 0x7fc2c006e320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2e40713f0 0x7fc2e40c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4070f70 0x7fc2e40c8610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 --2- 172.21.15.52:0/2156044810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2c8004d40 0x7fc2e415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 >> 172.21.15.52:0/2156044810 conn(0x7fc2e40ccec0 msgr2=0x7fc2e4143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:09.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 shutdown_connections 2024-09-10T08:29:09.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:09.657+0000 7fc2eb200640 1 -- 172.21.15.52:0/2156044810 wait complete. 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:29:09.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:09.674 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:09.674 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:29:09.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:09.674 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:09.714 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42658sec preferred_lft 42658sec 2024-09-10T08:29:09.715 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-10T08:29:09.716 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:09.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:29:09.716 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:09.836 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:10.129 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:10.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:10.138 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:10.193 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-10T08:29:10.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:10.197 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-10T08:29:10.244 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-10T08:29:10.244 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:10.244 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:29:10.244 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:29:10.244 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:29:10.245 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:10.323 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:10.794 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:10.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:10.802 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:29:10.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:10.838 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-10T08:29:10.913 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:10.913 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:10.913 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:10.914 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T08:29:10.914 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:11.032 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:11.086 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:11.094 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T08:29:11.095 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:11.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:11.351 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:11.360 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:11.360 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:11.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-10T08:29:11.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:29:11.360 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:11.438 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:11.521 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:11.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:11.528 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:11.563 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:29:11.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:11.564 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:11.639 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T08:29:11.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:11.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:11.778 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:11.779 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:12.421 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:29:12.422 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 1@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:29:12.422 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:29:12.423 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T08:29:12.423 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:29:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:29:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:29:12.424 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:29:12.427 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:29:12.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:12.427 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:29:12.483 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:12.563 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:12.567 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:12.575 INFO:teuthology.orchestra.run.smithi176.stdout:client4475 2024-09-10T08:29:12.576 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:12.576 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:12.611 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:12.728 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:12.731 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:12.739 INFO:teuthology.orchestra.run.smithi176.stdout:client4475 2024-09-10T08:29:12.740 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:12.817 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:12.821 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:12.828 INFO:teuthology.orchestra.run.smithi176.stdout:client4475 2024-09-10T08:29:12.829 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4eb61a63-2a53-4336-9780-430e4b9fd90b.client4475/status') 2024-09-10T08:29:12.906 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4475 (3)192.168.0.1:0/1053517306 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-10T08:29:12.926 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 6.676e-05 s, 1.0 MB/s 2024-09-10T08:29:12.929 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:12.937 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-10T08:29:12.937 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:29:12.937 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T08:29:12.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.105+0000 7f4041e00640 1 Processor -- start 2024-09-10T08:29:13.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.105+0000 7f4041e00640 1 -- start start 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f403c0b3e00 0x7f403c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f403c0b4370 con 0x7f403c0cf5c0 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f403c0b4650 con 0x7f403c0b3e00 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f403c0b4dc0 con 0x7f403c0cf9a0 2024-09-10T08:29:13.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f403be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f403c0b3e00 0x7f403c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f403be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f403c0b3e00 0x7f403c15bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36022/0 (socket says 172.21.15.52:36022) 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f403be00640 1 -- 172.21.15.52:0/2336646741 learned_addr learned my addr 172.21.15.52:0/2336646741 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f4041400640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f403be00640 1 -- 172.21.15.52:0/2336646741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 msgr2=0x7f403c15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.107+0000 7f403be00640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.108+0000 7f403be00640 1 -- 172.21.15.52:0/2336646741 >> v1:172.21.15.176:6789/0 conn(0x7f403c0cf5c0 legacy=0x7f403c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.108+0000 7f403be00640 1 -- 172.21.15.52:0/2336646741 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c0b50a0 con 0x7f403c0b3e00 2024-09-10T08:29:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f403be00640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c15bfe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f402802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6722f392b5512 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f403b400640 1 -- 172.21.15.52:0/2336646741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028037070 con 0x7f403c0b3e00 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f403b400640 1 -- 172.21.15.52:0/2336646741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4028032440 con 0x7f403c0b3e00 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f403b400640 1 -- 172.21.15.52:0/2336646741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028032810 con 0x7f403c0b3e00 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 -- 172.21.15.52:0/2336646741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 msgr2=0x7f403c15bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c15bfe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f402802a130 comp rx=0 tx=0).stop 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 -- 172.21.15.52:0/2336646741 shutdown_connections 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 --2- 172.21.15.52:0/2336646741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c15bfe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.109+0000 7f4041e00640 1 -- 172.21.15.52:0/2336646741 >> 172.21.15.52:0/2336646741 conn(0x7f403c06c240 msgr2=0x7f403c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.110+0000 7f4041e00640 1 -- 172.21.15.52:0/2336646741 shutdown_connections 2024-09-10T08:29:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.110+0000 7f4041e00640 1 -- 172.21.15.52:0/2336646741 wait complete. 2024-09-10T08:29:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.111+0000 7f4041e00640 1 Processor -- start 2024-09-10T08:29:13.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.111+0000 7f4041e00640 1 -- start start 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f403c0cf5c0 0x7f403c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f403c15cbe0 con 0x7f403c0b3e00 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f403c15ca60 con 0x7f403c0cf5c0 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4041e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f403c15cd60 con 0x7f403c0cf9a0 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.112+0000 7f4040a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36034/0 (socket says 172.21.15.52:36034) 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 -- 172.21.15.52:0/692484867 learned_addr learned my addr 172.21.15.52:0/692484867 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f403be00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f403c0cf5c0 0x7f403c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4041400640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 -- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 msgr2=0x7f403c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 -- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f403c0cf5c0 msgr2=0x7f403c14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f403c0cf5c0 0x7f403c14ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 -- 172.21.15.52:0/692484867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c14e8b0 con 0x7f403c0b3e00 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.113+0000 7f4040a00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f403000c430 tx=0x7f403000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.114+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40300052d0 con 0x7f403c0b3e00 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.114+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4030005490 con 0x7f403c0b3e00 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.114+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4030007260 con 0x7f403c0b3e00 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.114+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c14eb90 con 0x7f403c0b3e00 2024-09-10T08:29:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.114+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c14f150 con 0x7f403c0b3e00 2024-09-10T08:29:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.115+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c0b36f0 con 0x7f403c0b3e00 2024-09-10T08:29:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.116+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4030007400 con 0x7f403c0b3e00 2024-09-10T08:29:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.116+0000 7f4038c00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 0x7f401c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.117+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f403008a3d0 con 0x7f403c0b3e00 2024-09-10T08:29:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.117+0000 7f403be00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 0x7f401c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.118+0000 7f403be00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 0x7f401c06e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4028034000 tx=0x7f402802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.121+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4030058690 con 0x7f403c0b3e00 2024-09-10T08:29:13.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.344+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f403c06e780 con 0x7f403c0b3e00 2024-09-10T08:29:13.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.345+0000 7f4038c00640 1 -- 172.21.15.52:0/692484867 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f403005c990 con 0x7f403c0b3e00 2024-09-10T08:29:13.345 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.346+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 msgr2=0x7f401c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.346+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 0x7f401c06e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4028034000 tx=0x7f402802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.346+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 msgr2=0x7f403c141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.346+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f403000c430 tx=0x7f403000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 shutdown_connections 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f401c06be60 0x7f401c06e320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f403c0cf9a0 0x7f403c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f403c0cf5c0 0x7f403c14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 --2- 172.21.15.52:0/692484867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f403c0b3e00 0x7f403c141030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:13.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 >> 172.21.15.52:0/692484867 conn(0x7f403c06c240 msgr2=0x7f403c0c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:13.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 shutdown_connections 2024-09-10T08:29:13.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:13.347+0000 7f4041e00640 1 -- 172.21.15.52:0/692484867 wait complete. 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:29:13.363 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:13.364 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T08:29:13.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:13.364 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-10T08:29:13.400 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:13.400 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:13.400 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:13.400 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.400 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:13.401 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 66:6b:80:03:2b:43 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::b030:abff:fee4:3c39/64 scope link 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 66:6b:80:03:2b:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::646b:80ff:fe03:2b43/64 scope link 2024-09-10T08:29:13.402 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:13.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:13.403 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:13.494 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-10T08:29:13.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:13.497 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-10T08:29:13.533 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-10T08:29:13.536 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:13.536 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:29:13.536 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:29:13.536 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:13.536 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:13.536 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:13.537 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:29:13.537 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:29:13.537 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:29:13.537 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:13.652 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:13.724 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:13.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:13.732 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:29:13.767 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T08:29:13.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:13.767 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-10T08:29:13.840 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T08:29:13.841 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:13.841 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:13.841 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T08:29:13.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T08:29:13.842 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:13.958 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:14.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:14.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:14.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T08:29:14.072 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:14.072 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 12:0b:a9:31:0c:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::100b:a9ff:fe31:ca7/64 scope link 2024-09-10T08:29:14.073 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:14.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 12:0b:a9:31:0c:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:29:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:29:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::100b:a9ff:fe31:ca7/64 scope link 2024-09-10T08:29:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:14.133 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T08:29:14.134 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:14.212 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:14.340 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:14.349 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:14.349 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-10T08:29:14.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2024-09-10T08:29:14.350 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T08:29:14.350 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-10T08:29:14.427 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:14.507 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:14.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:14.515 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T08:29:14.550 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T08:29:14.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:14.550 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T08:29:14.626 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-10T08:29:14.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:14.627 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:14.753 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:14.754 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:14.781 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:14.782 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:14.782 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:29:14.782 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with new device syntax: 3@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:29:14.782 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:29:14.783 INFO:teuthology.orchestra.run.smithi176.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-10T08:29:14.783 INFO:teuthology.orchestra.run.smithi176.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:29:14.783 INFO:teuthology.orchestra.run.smithi176.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:29:14.783 INFO:teuthology.orchestra.run.smithi176.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:29:14.783 INFO:teuthology.orchestra.run.smithi176.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:29:14.786 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:29:14.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:14.787 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T08:29:14.842 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:14.920 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:14.923 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:14.932 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-09-10T08:29:14.932 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:14.932 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:14.968 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:15.085 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:15.088 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:15.096 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-09-10T08:29:15.096 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:15.173 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:15.177 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:15.185 INFO:teuthology.orchestra.run.smithi176.stdout:client4484 2024-09-10T08:29:15.186 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4eb61a63-2a53-4336-9780-430e4b9fd90b.client4484/status') 2024-09-10T08:29:15.262 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:15.283 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4484 (3)192.168.0.2:0/751866577 2024-09-10T08:29:15.283 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2024-09-10T08:29:15.284 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2024-09-10T08:29:15.284 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2024-09-10T08:29:15.284 INFO:teuthology.orchestra.run.smithi176.stderr:68 bytes copied, 9.9567e-05 s, 683 kB/s 2024-09-10T08:29:15.286 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-10T08:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:15.294 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T08:29:15.383 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-10T08:29:15.383 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:29:15.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:15.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.551+0000 7fcab4200640 1 Processor -- start 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.551+0000 7fcab4200640 1 -- start start 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.552+0000 7fcab4200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac15b380 0x7fcaac0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.552+0000 7fcab4200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcaac0cd090 0x7fcaac0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.552+0000 7fcab4200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaac070260 con 0x7fcaac06f740 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.552+0000 7fcab4200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcaac067c90 con 0x7fcaac0cd090 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.552+0000 7fcab4200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcaac06fd30 con 0x7fcaac15b380 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab0e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcaac0cd090 0x7fcaac0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac15b380 0x7fcaac0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab2200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcaac06f740 0x7fcaac0cf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38564/0 (socket says 172.21.15.52:38564) 2024-09-10T08:29:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab2200640 1 -- 172.21.15.52:0/1377855013 learned_addr learned my addr 172.21.15.52:0/1377855013 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab0e00640 1 -- 172.21.15.52:0/1377855013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac15b380 msgr2=0x7fcaac0b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab0e00640 1 --2- 172.21.15.52:0/1377855013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac15b380 0x7fcaac0b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab0e00640 1 -- 172.21.15.52:0/1377855013 >> v1:172.21.15.52:6789/0 conn(0x7fcaac06f740 legacy=0x7fcaac0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.553+0000 7fcab0e00640 1 -- 172.21.15.52:0/1377855013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac06ff80 con 0x7fcaac0cd090 2024-09-10T08:29:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.554+0000 7fcab0e00640 1 --2- 172.21.15.52:0/1377855013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac0b6470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaac06feb0 tx=0x7fca9802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdd77316203270b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.554+0000 7fcaabe00640 1 -- 172.21.15.52:0/1377855013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98037070 con 0x7fcaac0cd090 2024-09-10T08:29:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.554+0000 7fcaabe00640 1 -- 172.21.15.52:0/1377855013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98032440 con 0x7fcaac0cd090 2024-09-10T08:29:15.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.554+0000 7fcaabe00640 1 -- 172.21.15.52:0/1377855013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98032810 con 0x7fcaac0cd090 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 -- 172.21.15.52:0/1377855013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 msgr2=0x7fcaac0b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 --2- 172.21.15.52:0/1377855013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac0b6470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaac06feb0 tx=0x7fca9802a180 comp rx=0 tx=0).stop 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 -- 172.21.15.52:0/1377855013 shutdown_connections 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 --2- 172.21.15.52:0/1377855013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac0b6470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 --2- 172.21.15.52:0/1377855013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac15b380 0x7fcaac0b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 -- 172.21.15.52:0/1377855013 >> 172.21.15.52:0/1377855013 conn(0x7fcaac0b0a80 msgr2=0x7fcaac0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 -- 172.21.15.52:0/1377855013 shutdown_connections 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.555+0000 7fcab4200640 1 -- 172.21.15.52:0/1377855013 wait complete. 2024-09-10T08:29:15.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.557+0000 7fcab4200640 1 Processor -- start 2024-09-10T08:29:15.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.557+0000 7fcab4200640 1 -- start start 2024-09-10T08:29:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac06f740 0x7fcaac159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 0x7fcaac151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac0cf1b0 con 0x7fcaac0cd090 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac0cf520 con 0x7fcaac15b380 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab4200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcaac15b760 con 0x7fcaac06f740 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44622/0 (socket says 172.21.15.52:44622) 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 -- 172.21.15.52:0/1361322276 learned_addr learned my addr 172.21.15.52:0/1361322276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:15.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab1800640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac06f740 0x7fcaac159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab2200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 0x7fcaac151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 -- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac06f740 msgr2=0x7fcaac159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac06f740 0x7fcaac159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 -- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 msgr2=0x7fcaac151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 0x7fcaac151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab0e00640 1 -- 172.21.15.52:0/1361322276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac15d070 con 0x7fcaac0cd090 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.558+0000 7fcab2200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 0x7fcaac151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:15.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcab0e00640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca98009890 tx=0x7fca980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98037040 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98042070 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaac15bfd0 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98030960 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.559+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaac15c590 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.560+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac0b3e10 con 0x7fcaac0cd090 2024-09-10T08:29:15.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.561+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca98030b00 con 0x7fcaac0cd090 2024-09-10T08:29:15.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.562+0000 7fcaa9600640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.562+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca980ab7c0 con 0x7fcaac0cd090 2024-09-10T08:29:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.563+0000 7fcab1800640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.564+0000 7fcab1800640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 0x7fca8c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009a30 tx=0x7fcaa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.567+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca98045360 con 0x7fcaac0cd090 2024-09-10T08:29:15.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.754+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcaac0b1930 con 0x7fcaac0cd090 2024-09-10T08:29:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.755+0000 7fcaa9600640 1 -- 172.21.15.52:0/1361322276 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7fca9807a160 con 0x7fcaac0cd090 2024-09-10T08:29:15.755 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:15.755 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 msgr2=0x7fca8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 0x7fca8c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009a30 tx=0x7fcaa0008040 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 msgr2=0x7fcaac15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca98009890 tx=0x7fca980046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 shutdown_connections 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca8c06be30 0x7fca8c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcaac15b380 0x7fcaac151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcaac0cd090 0x7fcaac15a360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 --2- 172.21.15.52:0/1361322276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcaac06f740 0x7fcaac159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 >> 172.21.15.52:0/1361322276 conn(0x7fcaac0b0a80 msgr2=0x7fcaac0b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 shutdown_connections 2024-09-10T08:29:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.757+0000 7fcab4200640 1 -- 172.21.15.52:0/1361322276 wait complete. 2024-09-10T08:29:15.774 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T08:28:42.933485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T08:28:43.883402+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:29:15.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:29:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.933+0000 7f91b6e00640 1 Processor -- start 2024-09-10T08:29:15.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.933+0000 7f91b6e00640 1 -- start start 2024-09-10T08:29:15.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91b00732e0 0x7f91b00736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b00cce30 0x7f91b00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b0071c70 0x7f91b00720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f91b00714b0 con 0x7f91b00cce30 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91b0073c00 con 0x7f91b00732e0 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.934+0000 7f91b6e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00cd880 con 0x7f91b0071c70 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b00cce30 0x7f91b00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b00cce30 0x7f91b00cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44630/0 (socket says 172.21.15.52:44630) 2024-09-10T08:29:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 -- 172.21.15.52:0/2197200369 learned_addr learned my addr 172.21.15.52:0/2197200369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91afe00640 1 --2- 172.21.15.52:0/2197200369 >> v2:172.21.15.176:3300/0 conn(0x7f91b00732e0 0x7f91b00736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91b4e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b0071c70 0x7f91b00720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 -- 172.21.15.52:0/2197200369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b0071c70 msgr2=0x7f91b00720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b0071c70 0x7f91b00720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 -- 172.21.15.52:0/2197200369 >> v2:172.21.15.176:3300/0 conn(0x7f91b00732e0 msgr2=0x7f91b00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 --2- 172.21.15.52:0/2197200369 >> v2:172.21.15.176:3300/0 conn(0x7f91b00732e0 0x7f91b00736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.935+0000 7f91a7e00640 1 -- 172.21.15.52:0/2197200369 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b00cdb60 con 0x7f91b00cce30 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.936+0000 7f91a7e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00cd2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f91b00b6780 tx=0x7f919802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f738e0f194ee91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.936+0000 7f91af400640 1 -- 172.21.15.52:0/2197200369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198037070 con 0x7f91b00cce30 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.936+0000 7f91af400640 1 -- 172.21.15.52:0/2197200369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9198032440 con 0x7f91b00cce30 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.936+0000 7f91af400640 1 -- 172.21.15.52:0/2197200369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198032810 con 0x7f91b00cce30 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 -- 172.21.15.52:0/2197200369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 msgr2=0x7f91b00cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00cd2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f91b00b6780 tx=0x7f919802a140 comp rx=0 tx=0).stop 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 -- 172.21.15.52:0/2197200369 shutdown_connections 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b0071c70 0x7f91b00720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 --2- 172.21.15.52:0/2197200369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00cd2a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 --2- 172.21.15.52:0/2197200369 >> v2:172.21.15.176:3300/0 conn(0x7f91b00732e0 0x7f91b00736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 -- 172.21.15.52:0/2197200369 >> 172.21.15.52:0/2197200369 conn(0x7f91b006d0f0 msgr2=0x7f91b006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 -- 172.21.15.52:0/2197200369 shutdown_connections 2024-09-10T08:29:15.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.937+0000 7f91b6e00640 1 -- 172.21.15.52:0/2197200369 wait complete. 2024-09-10T08:29:15.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.939+0000 7f91b6e00640 1 Processor -- start 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.939+0000 7f91b6e00640 1 -- start start 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b0071c70 0x7f91b0151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b00732e0 0x7f91b00c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91b006bf70 con 0x7f91b00cce30 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91b006bdf0 con 0x7f91b0071c70 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b6e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91b015c8d0 con 0x7f91b00732e0 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44634/0 (socket says 172.21.15.52:44634) 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 -- 172.21.15.52:0/1027517090 learned_addr learned my addr 172.21.15.52:0/1027517090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91a7e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b00732e0 0x7f91b00c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91afe00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b0071c70 0x7f91b0151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 -- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b00732e0 msgr2=0x7f91b00c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b00732e0 0x7f91b00c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 -- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b0071c70 msgr2=0x7f91b0151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b0071c70 0x7f91b0151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.940+0000 7f91b4e00640 1 -- 172.21.15.52:0/1027517090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b0157f70 con 0x7f91b00cce30 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91b4e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007e60 tx=0x7f91a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8014620 con 0x7f91b00cce30 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8019070 con 0x7f91b00cce30 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b0158250 con 0x7f91b00cce30 2024-09-10T08:29:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8014a20 con 0x7f91b00cce30 2024-09-10T08:29:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.941+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b00c9380 con 0x7f91b00cce30 2024-09-10T08:29:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.942+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b00736c0 con 0x7f91b00cce30 2024-09-10T08:29:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.943+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a8014bc0 con 0x7f91b00cce30 2024-09-10T08:29:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.944+0000 7f91acc00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 0x7f918c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.944+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91a808b630 con 0x7f91b00cce30 2024-09-10T08:29:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.944+0000 7f91afe00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 0x7f918c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.945+0000 7f91afe00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 0x7f918c06e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:15.948+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91a80598f0 con 0x7f91b00cce30 2024-09-10T08:29:16.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.129+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f91b00711f0 con 0x7f91b00cce30 2024-09-10T08:29:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.130+0000 7f91acc00640 1 -- 172.21.15.52:0/1027517090 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f91a805dbf0 con 0x7f91b00cce30 2024-09-10T08:29:16.130 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:29:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 msgr2=0x7f918c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 0x7f918c06e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0008040 comp rx=0 tx=0).stop 2024-09-10T08:29:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 msgr2=0x7f91b00b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91a8007e60 tx=0x7f91a800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 shutdown_connections 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f918c06be30 0x7f918c06e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b00cce30 0x7f91b00b28a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b00732e0 0x7f91b00c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 --2- 172.21.15.52:0/1027517090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b0071c70 0x7f91b0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 >> 172.21.15.52:0/1027517090 conn(0x7f91b006d0f0 msgr2=0x7f91b00cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 shutdown_connections 2024-09-10T08:29:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.132+0000 7f91b6e00640 1 -- 172.21.15.52:0/1027517090 wait complete. 2024-09-10T08:29:16.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T08:29:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.308+0000 7f8fa9000640 1 Processor -- start 2024-09-10T08:29:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.308+0000 7f8fa9000640 1 -- start start 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.309+0000 7f8fa9000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fa415b7c0 0x7f8fa40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa9000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa40cf2e0 con 0x7f8fa40cead0 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa9000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa4070fe0 con 0x7f8fa40ccf30 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa9000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa40712c0 con 0x7f8fa415b7c0 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa2800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8fa40cead0 0x7f8fa4071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38578/0 (socket says 172.21.15.52:38578) 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa2800640 1 -- 172.21.15.52:0/3251316447 learned_addr learned my addr 172.21.15.52:0/3251316447 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8f99400640 1 --2- 172.21.15.52:0/3251316447 >> v2:172.21.15.176:3300/0 conn(0x7f8fa415b7c0 0x7f8fa40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8f99400640 1 -- 172.21.15.52:0/3251316447 >> v1:172.21.15.176:6789/0 conn(0x7f8fa40ccf30 legacy=0x7f8fa40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8f99400640 1 -- 172.21.15.52:0/3251316447 >> v1:172.21.15.52:6789/0 conn(0x7f8fa40cead0 legacy=0x7f8fa4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8f99400640 1 -- 172.21.15.52:0/3251316447 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa40715a0 con 0x7f8fa415b7c0 2024-09-10T08:29:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.310+0000 7f8fa1400640 1 -- 172.21.15.52:0/3251316447 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653174194 0 0) 0x7f8fa40cf2e0 con 0x7f8fa40cead0 2024-09-10T08:29:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.311+0000 7f8f99400640 1 --2- 172.21.15.52:0/3251316447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa415b7c0 0x7f8fa40b2c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097a0 tx=0x7f8f8c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea0508c2393056f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa1400640 1 -- 172.21.15.52:0/3251316447 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c037070 con 0x7f8fa415b7c0 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa1400640 1 -- 172.21.15.52:0/3251316447 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c032440 con 0x7f8fa415b7c0 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa1400640 1 -- 172.21.15.52:0/3251316447 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c032810 con 0x7f8fa415b7c0 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 -- 172.21.15.52:0/3251316447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa415b7c0 msgr2=0x7f8fa40b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 --2- 172.21.15.52:0/3251316447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa415b7c0 0x7f8fa40b2c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0097a0 tx=0x7f8f8c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 -- 172.21.15.52:0/3251316447 shutdown_connections 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 --2- 172.21.15.52:0/3251316447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa415b7c0 0x7f8fa40b2c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 -- 172.21.15.52:0/3251316447 >> 172.21.15.52:0/3251316447 conn(0x7f8fa406d0f0 msgr2=0x7f8fa406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 -- 172.21.15.52:0/3251316447 shutdown_connections 2024-09-10T08:29:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.312+0000 7f8fa9000640 1 -- 172.21.15.52:0/3251316447 wait complete. 2024-09-10T08:29:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.314+0000 7f8fa9000640 1 Processor -- start 2024-09-10T08:29:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.314+0000 7f8fa9000640 1 -- start start 2024-09-10T08:29:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa40ccf30 0x7f8fa415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa40cead0 0x7f8fa414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa40cf080 con 0x7f8fa415b7c0 2024-09-10T08:29:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa40cef00 con 0x7f8fa40ccf30 2024-09-10T08:29:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa9000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa40721d0 con 0x7f8fa40cead0 2024-09-10T08:29:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44648/0 (socket says 172.21.15.52:44648) 2024-09-10T08:29:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.315+0000 7f8fa2800640 1 -- 172.21.15.52:0/2586017892 learned_addr learned my addr 172.21.15.52:0/2586017892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa1e00640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa40ccf30 0x7f8fa415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8f99400640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa40cead0 0x7f8fa414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 -- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa40cead0 msgr2=0x7f8fa414c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa40cead0 0x7f8fa414c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 -- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa40ccf30 msgr2=0x7f8fa415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa40ccf30 0x7f8fa415d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 -- 172.21.15.52:0/2586017892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa4152690 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa2800640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c7a0 tx=0x7f8f9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c018070 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00a640 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00aab0 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa4158db0 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.316+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa4159370 con 0x7f8fa415b7c0 2024-09-10T08:29:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.317+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa40b2c50 con 0x7f8fa415b7c0 2024-09-10T08:29:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.318+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f9c00ac50 con 0x7f8fa415b7c0 2024-09-10T08:29:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.319+0000 7f8f9aa00640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.319+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8f9c08a590 con 0x7f8fa415b7c0 2024-09-10T08:29:16.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.320+0000 7f8fa1e00640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.320+0000 7f8fa1e00640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 0x7f8f8006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f60 tx=0x7f8f94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.323+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fa4152690 con 0x7f8fa415b7c0 2024-09-10T08:29:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.508+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8fa40cc960 con 0x7f8fa415b7c0 2024-09-10T08:29:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.508+0000 7f8f9aa00640 1 -- 172.21.15.52:0/2586017892 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f8f9c058ea0 con 0x7f8fa415b7c0 2024-09-10T08:29:16.509 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 msgr2=0x7f8f8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 0x7f8f8006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f60 tx=0x7f8f94009040 comp rx=0 tx=0).stop 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 msgr2=0x7f8fa413ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00c7a0 tx=0x7f8f9c00cc60 comp rx=0 tx=0).stop 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 shutdown_connections 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fa415b7c0 0x7f8fa413ba50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fa40cead0 0x7f8fa414c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 --2- 172.21.15.52:0/2586017892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fa40ccf30 0x7f8fa415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 >> 172.21.15.52:0/2586017892 conn(0x7f8fa406d0f0 msgr2=0x7f8fa40b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 shutdown_connections 2024-09-10T08:29:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.511+0000 7f8fa9000640 1 -- 172.21.15.52:0/2586017892 wait complete. 2024-09-10T08:29:16.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T08:29:16.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.686+0000 7f5d06a00640 1 Processor -- start 2024-09-10T08:29:16.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.686+0000 7f5d06a00640 1 -- start start 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d000b5fd0 0x7f5d000d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d000d3950 con 0x7f5d00067950 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5d000d3c30 con 0x7f5d000b5fd0 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d000d3f10 con 0x7f5d000b63b0 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d05600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d000b5fd0 0x7f5d000d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d00067950 0x7f5d00067e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38586/0 (socket says 172.21.15.52:38586) 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.687+0000 7f5d06000640 1 -- 172.21.15.52:0/1199700132 learned_addr learned my addr 172.21.15.52:0/1199700132 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d05600640 1 -- 172.21.15.52:0/1199700132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 msgr2=0x7f5d000cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d05600640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d05600640 1 -- 172.21.15.52:0/1199700132 >> v1:172.21.15.52:6789/0 conn(0x7f5d00067950 legacy=0x7f5d00067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d05600640 1 -- 172.21.15.52:0/1199700132 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000d41f0 con 0x7f5d000b5fd0 2024-09-10T08:29:16.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.688+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:16.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.689+0000 7f5d05600640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d000b5fd0 0x7f5d000d32c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40097a0 tx=0x7f5cf402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605f74d73463763f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.689+0000 7f5cffe00640 1 -- 172.21.15.52:0/1199700132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4037070 con 0x7f5d000b5fd0 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.689+0000 7f5cffe00640 1 -- 172.21.15.52:0/1199700132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4032440 con 0x7f5d000b5fd0 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.689+0000 7f5cffe00640 1 -- 172.21.15.52:0/1199700132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4032810 con 0x7f5d000b5fd0 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 -- 172.21.15.52:0/1199700132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d000b5fd0 msgr2=0x7f5d000d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d000b5fd0 0x7f5d000d32c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40097a0 tx=0x7f5cf402a210 comp rx=0 tx=0).stop 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 -- 172.21.15.52:0/1199700132 shutdown_connections 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1199700132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d000b5fd0 0x7f5d000d32c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 -- 172.21.15.52:0/1199700132 >> 172.21.15.52:0/1199700132 conn(0x7f5d000d0fd0 msgr2=0x7f5d000d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 -- 172.21.15.52:0/1199700132 shutdown_connections 2024-09-10T08:29:16.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.690+0000 7f5d06a00640 1 -- 172.21.15.52:0/1199700132 wait complete. 2024-09-10T08:29:16.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.691+0000 7f5d06a00640 1 Processor -- start 2024-09-10T08:29:16.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.692+0000 7f5d06a00640 1 -- start start 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.692+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 0x7f5d000cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000cfd10 con 0x7f5d00067950 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000cfb90 con 0x7f5d000b5fd0 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d000b67d0 con 0x7f5d000b63b0 2024-09-10T08:29:16.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44674/0 (socket says 172.21.15.52:44674) 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 -- 172.21.15.52:0/1096221528 learned_addr learned my addr 172.21.15.52:0/1096221528 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 -- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 msgr2=0x7f5d000b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d06000640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 0x7f5d000cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 -- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 msgr2=0x7f5d000cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 0x7f5d000cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d05600640 1 -- 172.21.15.52:0/1096221528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000c9b40 con 0x7f5d00067950 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.693+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 0x7f5d000cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:16.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5d05600640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4035040 tx=0x7f5cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4037040 con 0x7f5d00067950 2024-09-10T08:29:16.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4030770 con 0x7f5d00067950 2024-09-10T08:29:16.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d000c9e80 con 0x7f5d00067950 2024-09-10T08:29:16.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4030b80 con 0x7f5d00067950 2024-09-10T08:29:16.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.694+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d000ca6c0 con 0x7f5d00067950 2024-09-10T08:29:16.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.695+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d000c9890 con 0x7f5d00067950 2024-09-10T08:29:16.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.696+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf4044020 con 0x7f5d00067950 2024-09-10T08:29:16.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.697+0000 7f5cfd600640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 0x7f5ce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:16.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.697+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf40ab530 con 0x7f5d00067950 2024-09-10T08:29:16.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.697+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 0x7f5ce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.698+0000 7f5d04c00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 0x7f5ce006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006fd0 tx=0x7f5cec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.701+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d000c9e80 con 0x7f5d00067950 2024-09-10T08:29:16.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.882+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5d0015e7f0 con 0x7f5d00067950 2024-09-10T08:29:16.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.883+0000 7f5cfd600640 1 -- 172.21.15.52:0/1096221528 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5cf4032e20 con 0x7f5d00067950 2024-09-10T08:29:16.883 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-09-10T08:29:16.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 msgr2=0x7f5ce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 0x7f5ce006e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006fd0 tx=0x7f5cec008040 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 msgr2=0x7f5d000c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4035040 tx=0x7f5cf40046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 shutdown_connections 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ce006be30 0x7f5ce006e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d000b63b0 0x7f5d000b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d000b5fd0 0x7f5d000cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 --2- 172.21.15.52:0/1096221528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d00067950 0x7f5d000c92f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 >> 172.21.15.52:0/1096221528 conn(0x7f5d000d0fd0 msgr2=0x7f5d000b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 shutdown_connections 2024-09-10T08:29:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:16.885+0000 7f5d06a00640 1 -- 172.21.15.52:0/1096221528 wait complete. 2024-09-10T08:29:16.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-10T08:29:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.055+0000 7f291d200640 1 Processor -- start 2024-09-10T08:29:17.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.055+0000 7f291d200640 1 -- start start 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f291d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f291815c610 0x7f291806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f291d200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2918161040 con 0x7f291806eaf0 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f291d200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2918072e50 con 0x7f291806dea0 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f291d200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f291806e3d0 con 0x7f291815c610 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2915e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f291815c610 0x7f291806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2916800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f291806eaf0 0x7f2918160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38600/0 (socket says 172.21.15.52:38600) 2024-09-10T08:29:17.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2916800640 1 -- 172.21.15.52:0/2944381887 learned_addr learned my addr 172.21.15.52:0/2944381887 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:17.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2915e00640 1 -- 172.21.15.52:0/2944381887 >> v1:172.21.15.176:6789/0 conn(0x7f291806dea0 legacy=0x7f2918160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:17.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2915e00640 1 -- 172.21.15.52:0/2944381887 >> v1:172.21.15.52:6789/0 conn(0x7f291806eaf0 legacy=0x7f2918160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2915e00640 1 -- 172.21.15.52:0/2944381887 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291806e6b0 con 0x7f291815c610 2024-09-10T08:29:17.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.057+0000 7f2914a00640 1 -- 172.21.15.52:0/2944381887 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047726066 0 0) 0x7f2918161040 con 0x7f291806eaf0 2024-09-10T08:29:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.058+0000 7f2915e00640 1 --2- 172.21.15.52:0/2944381887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291815c610 0x7f291806f1f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fa427a6a5e4c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f2914a00640 1 -- 172.21.15.52:0/2944381887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908007740 con 0x7f291815c610 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f2914a00640 1 -- 172.21.15.52:0/2944381887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29080078e0 con 0x7f291815c610 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f2914a00640 1 -- 172.21.15.52:0/2944381887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908007cb0 con 0x7f291815c610 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 -- 172.21.15.52:0/2944381887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291815c610 msgr2=0x7f291806f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 --2- 172.21.15.52:0/2944381887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291815c610 0x7f291806f1f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290802a6f0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 -- 172.21.15.52:0/2944381887 shutdown_connections 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 --2- 172.21.15.52:0/2944381887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291815c610 0x7f291806f1f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 -- 172.21.15.52:0/2944381887 >> 172.21.15.52:0/2944381887 conn(0x7f291806c240 msgr2=0x7f29180b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 -- 172.21.15.52:0/2944381887 shutdown_connections 2024-09-10T08:29:17.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.059+0000 7f291d200640 1 -- 172.21.15.52:0/2944381887 wait complete. 2024-09-10T08:29:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.061+0000 7f291d200640 1 Processor -- start 2024-09-10T08:29:17.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.061+0000 7f291d200640 1 -- start start 2024-09-10T08:29:17.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f291806eaf0 0x7f29181f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 0x7f2918152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f29180b2d70 con 0x7f291806dea0 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f291815c9f0 con 0x7f291815c610 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f291d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f29180b2ef0 con 0x7f291806eaf0 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f2915e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f2915e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44678/0 (socket says 172.21.15.52:44678) 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.062+0000 7f2915e00640 1 -- 172.21.15.52:0/2892686972 learned_addr learned my addr 172.21.15.52:0/2892686972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915400640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f291806eaf0 0x7f29181f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2916800640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 0x7f2918152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 -- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f291806eaf0 msgr2=0x7f29181f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f291806eaf0 0x7f29181f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 -- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 msgr2=0x7f2918152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 0x7f2918152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 -- 172.21.15.52:0/2892686972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2918153140 con 0x7f291806dea0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2916800640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 0x7f2918152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f2915e00640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f2908004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290803f070 con 0x7f291806dea0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908031d00 con 0x7f291806dea0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908044660 con 0x7f291806dea0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2918153420 con 0x7f291806dea0 2024-09-10T08:29:17.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.063+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2918156180 con 0x7f291806dea0 2024-09-10T08:29:17.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.065+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29180ce710 con 0x7f291806dea0 2024-09-10T08:29:17.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.065+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f290803b410 con 0x7f291806dea0 2024-09-10T08:29:17.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.066+0000 7f290e000640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 0x7f28f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.066+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f29080ac7e0 con 0x7f291806dea0 2024-09-10T08:29:17.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.067+0000 7f2915400640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 0x7f28f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.067+0000 7f2915400640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 0x7f28f806e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29180ccc40 tx=0x7f2904009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.070+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f290807aaa0 con 0x7f291806dea0 2024-09-10T08:29:17.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.324+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f29181f1e60 con 0x7f291806dea0 2024-09-10T08:29:17.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.589+0000 7f290e000640 1 -- 172.21.15.52:0/2892686972 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v51) ==== 151+0+0 (secure 0 0 0) 0x7f290807eda0 con 0x7f291806dea0 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 msgr2=0x7f28f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 0x7f28f806e320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29180ccc40 tx=0x7f2904009040 comp rx=0 tx=0).stop 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 msgr2=0x7f291815e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f2908004a40 comp rx=0 tx=0).stop 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 shutdown_connections 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f28f806be60 0x7f28f806e320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f291815c610 0x7f2918152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f291806eaf0 0x7f29181f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 --2- 172.21.15.52:0/2892686972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f291806dea0 0x7f291815e6a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.591+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 >> 172.21.15.52:0/2892686972 conn(0x7f291806c240 msgr2=0x7f29180d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.592+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 shutdown_connections 2024-09-10T08:29:17.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.592+0000 7f291d200640 1 -- 172.21.15.52:0/2892686972 wait complete. 2024-09-10T08:29:17.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:29:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.767+0000 7f2584c00640 1 Processor -- start 2024-09-10T08:29:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.768+0000 7f2584c00640 1 -- start start 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25800732e0 0x7f25800736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25800cce30 0x7f25800cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f25800714b0 con 0x7f25800732e0 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2580073c00 con 0x7f25800cce30 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2584c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25800cd880 con 0x7f2580071c70 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f257de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25800732e0 0x7f25800736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f257de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f25800732e0 0x7f25800736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44692/0 (socket says 172.21.15.52:44692) 2024-09-10T08:29:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f257de00640 1 -- 172.21.15.52:0/3186080564 learned_addr learned my addr 172.21.15.52:0/3186080564 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f257e800640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.769+0000 7f2577e00640 1 --2- 172.21.15.52:0/3186080564 >> v2:172.21.15.176:3300/0 conn(0x7f25800cce30 0x7f25800cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.770+0000 7f257de00640 1 -- 172.21.15.52:0/3186080564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 msgr2=0x7f25800720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.770+0000 7f257de00640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.770+0000 7f257de00640 1 -- 172.21.15.52:0/3186080564 >> v2:172.21.15.176:3300/0 conn(0x7f25800cce30 msgr2=0x7f25800cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.770+0000 7f257de00640 1 --2- 172.21.15.52:0/3186080564 >> v2:172.21.15.176:3300/0 conn(0x7f25800cce30 0x7f25800cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.770+0000 7f257de00640 1 -- 172.21.15.52:0/3186080564 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25800cdb60 con 0x7f25800732e0 2024-09-10T08:29:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f257de00640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800736c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25800c57f0 tx=0x7f257002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba0ea3c3463cab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f257d400640 1 -- 172.21.15.52:0/3186080564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570037070 con 0x7f25800732e0 2024-09-10T08:29:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f257d400640 1 -- 172.21.15.52:0/3186080564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2570032440 con 0x7f25800732e0 2024-09-10T08:29:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f257d400640 1 -- 172.21.15.52:0/3186080564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570032810 con 0x7f25800732e0 2024-09-10T08:29:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f2584c00640 1 -- 172.21.15.52:0/3186080564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 msgr2=0x7f25800736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.771+0000 7f2584c00640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800736c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f25800c57f0 tx=0x7f257002a140 comp rx=0 tx=0).stop 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 -- 172.21.15.52:0/3186080564 shutdown_connections 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 --2- 172.21.15.52:0/3186080564 >> v2:172.21.15.176:3300/0 conn(0x7f25800cce30 0x7f25800cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 --2- 172.21.15.52:0/3186080564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800736c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 -- 172.21.15.52:0/3186080564 >> 172.21.15.52:0/3186080564 conn(0x7f258006d0f0 msgr2=0x7f258006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 -- 172.21.15.52:0/3186080564 shutdown_connections 2024-09-10T08:29:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.772+0000 7f2584c00640 1 -- 172.21.15.52:0/3186080564 wait complete. 2024-09-10T08:29:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.773+0000 7f2584c00640 1 Processor -- start 2024-09-10T08:29:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.773+0000 7f2584c00640 1 -- start start 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 0x7f25801e6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f258006bf70 con 0x7f25800732e0 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f258006bdf0 con 0x7f25800cce30 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2584c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f258015c8d0 con 0x7f2580071c70 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2577e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2577e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44700/0 (socket says 172.21.15.52:44700) 2024-09-10T08:29:17.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.774+0000 7f2577e00640 1 -- 172.21.15.52:0/1645988998 learned_addr learned my addr 172.21.15.52:0/1645988998 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f257de00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f257e800640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 0x7f25801e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 -- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 msgr2=0x7f25800c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 -- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 msgr2=0x7f25801e6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 0x7f25801e6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 -- 172.21.15.52:0/1645988998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25800c7440 con 0x7f25800732e0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f257e800640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 0x7f25801e6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2577e00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f256800d620 tx=0x7f256800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256800b620 con 0x7f25800732e0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2568019070 con 0x7f25800732e0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256800ba00 con 0x7f25800732e0 2024-09-10T08:29:17.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.775+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25800c7720 con 0x7f25800732e0 2024-09-10T08:29:17.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.776+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25800c7ce0 con 0x7f25800732e0 2024-09-10T08:29:17.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.777+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25800736c0 con 0x7f25800732e0 2024-09-10T08:29:17.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.778+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f256800bba0 con 0x7f25800732e0 2024-09-10T08:29:17.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.778+0000 7f2576000640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 0x7f255c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:17.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.779+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f256808b120 con 0x7f25800732e0 2024-09-10T08:29:17.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.779+0000 7f257de00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 0x7f255c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:17.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.780+0000 7f257de00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 0x7f255c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2570034000 tx=0x7f257002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:17.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.783+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2568059b60 con 0x7f25800732e0 2024-09-10T08:29:17.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.968+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25800b5940 con 0x7f25800732e0 2024-09-10T08:29:17.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.972+0000 7f2576000640 1 -- 172.21.15.52:0/1645988998 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f2568059460 con 0x7f25800732e0 2024-09-10T08:29:17.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 msgr2=0x7f255c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 0x7f255c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2570034000 tx=0x7f257002e000 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 msgr2=0x7f25800c6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f256800d620 tx=0x7f256800dae0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 shutdown_connections 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f255c06be30 0x7f255c06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25800cce30 0x7f25801e6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25800732e0 0x7f25800c6a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 --2- 172.21.15.52:0/1645988998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2580071c70 0x7f25800c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 >> 172.21.15.52:0/1645988998 conn(0x7f258006d0f0 msgr2=0x7f25800cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 shutdown_connections 2024-09-10T08:29:17.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:17.974+0000 7f2584c00640 1 -- 172.21.15.52:0/1645988998 wait complete. 2024-09-10T08:29:17.990 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:29:17.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:29:18.082 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:29:18.177 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:29:18.177 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:18.177 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:18.213 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:18.213 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:18.288 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:18.288 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:18.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:29:18.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.561+0000 7feb59400640 1 Processor -- start 2024-09-10T08:29:18.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.561+0000 7feb59400640 1 -- start start 2024-09-10T08:29:18.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb59400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb54162c60 0x7feb54073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb59400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 0x7feb5406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb59400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb541631c0 con 0x7feb5415e790 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb59400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7feb5415eb70 con 0x7feb54162c60 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb59400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb540ae9a0 con 0x7feb5406f730 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb52800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb5415e790 0x7feb540b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38606/0 (socket says 172.21.15.52:38606) 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb4be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb54162c60 0x7feb54073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb52800640 1 -- 172.21.15.52:0/2880515232 learned_addr learned my addr 172.21.15.52:0/2880515232 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb53200640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 0x7feb5406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb4be00640 1 -- 172.21.15.52:0/2880515232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 msgr2=0x7feb5406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb4be00640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 0x7feb5406fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb4be00640 1 -- 172.21.15.52:0/2880515232 >> v1:172.21.15.52:6789/0 conn(0x7feb5415e790 legacy=0x7feb540b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb4be00640 1 -- 172.21.15.52:0/2880515232 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb540aec40 con 0x7feb54162c60 2024-09-10T08:29:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb53200640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 0x7feb5406fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:18.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.563+0000 7feb51e00640 1 -- 172.21.15.52:0/2880515232 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776899399 0 0) 0x7feb541631c0 con 0x7feb5415e790 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.564+0000 7feb4be00640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb54162c60 0x7feb54073a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097a0 tx=0x7feb3c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc91969e425b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb51e00640 1 -- 172.21.15.52:0/2880515232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c037070 con 0x7feb54162c60 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb51e00640 1 -- 172.21.15.52:0/2880515232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3c02ae50 con 0x7feb54162c60 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb51e00640 1 -- 172.21.15.52:0/2880515232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3c032660 con 0x7feb54162c60 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 -- 172.21.15.52:0/2880515232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb54162c60 msgr2=0x7feb54073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb54162c60 0x7feb54073a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0097a0 tx=0x7feb3c02a100 comp rx=0 tx=0).stop 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 -- 172.21.15.52:0/2880515232 shutdown_connections 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5406f730 0x7feb5406fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 --2- 172.21.15.52:0/2880515232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb54162c60 0x7feb54073a40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 -- 172.21.15.52:0/2880515232 >> 172.21.15.52:0/2880515232 conn(0x7feb540b0a80 msgr2=0x7feb540b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 -- 172.21.15.52:0/2880515232 shutdown_connections 2024-09-10T08:29:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.565+0000 7feb59400640 1 -- 172.21.15.52:0/2880515232 wait complete. 2024-09-10T08:29:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.567+0000 7feb59400640 1 Processor -- start 2024-09-10T08:29:18.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.567+0000 7feb59400640 1 -- start start 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 0x7feb54157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb54162c60 0x7feb540cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb540b5b40 con 0x7feb5406f730 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb540af200 con 0x7feb54162c60 2024-09-10T08:29:18.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb59400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb5406f430 con 0x7feb5415e790 2024-09-10T08:29:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb52800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb52800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44720/0 (socket says 172.21.15.52:44720) 2024-09-10T08:29:18.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb52800640 1 -- 172.21.15.52:0/4167491807 learned_addr learned my addr 172.21.15.52:0/4167491807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.568+0000 7feb4be00640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 0x7feb54157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb53200640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb54162c60 0x7feb540cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 -- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 msgr2=0x7feb54157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 0x7feb54157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 -- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb54162c60 msgr2=0x7feb540cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb54162c60 0x7feb540cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 -- 172.21.15.52:0/4167491807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb540cec30 con 0x7feb5406f730 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb4be00640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 0x7feb54157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb52800640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c4d0 tx=0x7feb4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44018070 con 0x7feb5406f730 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb44007500 con 0x7feb5406f730 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44004a20 con 0x7feb5406f730 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb54156d80 con 0x7feb5406f730 2024-09-10T08:29:18.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.569+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb540ceea0 con 0x7feb5406f730 2024-09-10T08:29:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.571+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb54073a40 con 0x7feb5406f730 2024-09-10T08:29:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.572+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb44004bc0 con 0x7feb5406f730 2024-09-10T08:29:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.572+0000 7feb4aa00640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:18.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.572+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feb4408a120 con 0x7feb5406f730 2024-09-10T08:29:18.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.573+0000 7feb4be00640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:18.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.574+0000 7feb4be00640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 0x7feb3006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb3c034000 tx=0x7feb3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:18.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.577+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb44058ac0 con 0x7feb5406f730 2024-09-10T08:29:18.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.774+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feb540b1da0 con 0x7feb5406f730 2024-09-10T08:29:18.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.775+0000 7feb4aa00640 1 -- 172.21.15.52:0/4167491807 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7feb440583c0 con 0x7feb5406f730 2024-09-10T08:29:18.775 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 msgr2=0x7feb3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 0x7feb3006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb3c034000 tx=0x7feb3c02e000 comp rx=0 tx=0).stop 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 msgr2=0x7feb5414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb4400c4d0 tx=0x7feb4400c990 comp rx=0 tx=0).stop 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 shutdown_connections 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb3006be30 0x7feb3006e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb54162c60 0x7feb540cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb5415e790 0x7feb54157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 --2- 172.21.15.52:0/4167491807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb5406f730 0x7feb5414a5b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:18.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 >> 172.21.15.52:0/4167491807 conn(0x7feb540b0a80 msgr2=0x7feb5406fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:18.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 shutdown_connections 2024-09-10T08:29:18.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:18.777+0000 7feb59400640 1 -- 172.21.15.52:0/4167491807 wait complete. 2024-09-10T08:29:18.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:29:18.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:18.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T08:29:18.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:29:18.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:18.856 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:29:18.896 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:18.896 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:18.937 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:18.937 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:19.014 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:19.014 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:19.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:29:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.248+0000 7ff500400640 1 Processor -- start 2024-09-10T08:29:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.248+0000 7ff500400640 1 -- start start 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.249+0000 7ff500400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4f806f390 0x7ff4f806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.249+0000 7ff500400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f80b4270 con 0x7ff4f8158d80 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff500400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f80b3f90 con 0x7ff4f815fab0 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff500400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f815efd0 con 0x7ff4f806f390 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fda00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4f8158d80 0x7ff4f80b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38612/0 (socket says 172.21.15.52:38612) 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fda00640 1 -- 172.21.15.52:0/1733175593 learned_addr learned my addr 172.21.15.52:0/1733175593 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fd000640 1 --2- 172.21.15.52:0/1733175593 >> v2:172.21.15.52:3300/0 conn(0x7ff4f806f390 0x7ff4f806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4f7e00640 1 -- 172.21.15.52:0/1733175593 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176724586 0 0) 0x7ff4f80b4270 con 0x7ff4f8158d80 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4f7e00640 1 -- 172.21.15.52:0/1733175593 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4e0003520 con 0x7ff4f8158d80 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fd000640 1 -- 172.21.15.52:0/1733175593 >> v1:172.21.15.176:6789/0 conn(0x7ff4f815fab0 legacy=0x7ff4f806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fd000640 1 -- 172.21.15.52:0/1733175593 >> v1:172.21.15.52:6789/0 conn(0x7ff4f8158d80 legacy=0x7ff4f80b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.250+0000 7ff4fd000640 1 -- 172.21.15.52:0/1733175593 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f815f2b0 con 0x7ff4f806f390 2024-09-10T08:29:19.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.251+0000 7ff4fd000640 1 --2- 172.21.15.52:0/1733175593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f806f390 0x7ff4f806bc10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097a0 tx=0x7ff4e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deff15647db211c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff4f7e00640 1 -- 172.21.15.52:0/1733175593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037070 con 0x7ff4f806f390 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff4f7e00640 1 -- 172.21.15.52:0/1733175593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4032440 con 0x7ff4f806f390 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff4f7e00640 1 -- 172.21.15.52:0/1733175593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4032810 con 0x7ff4f806f390 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 -- 172.21.15.52:0/1733175593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f806f390 msgr2=0x7ff4f806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 --2- 172.21.15.52:0/1733175593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f806f390 0x7ff4f806bc10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097a0 tx=0x7ff4e402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 -- 172.21.15.52:0/1733175593 shutdown_connections 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 --2- 172.21.15.52:0/1733175593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f806f390 0x7ff4f806bc10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 -- 172.21.15.52:0/1733175593 >> 172.21.15.52:0/1733175593 conn(0x7ff4f806cd20 msgr2=0x7ff4f806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 -- 172.21.15.52:0/1733175593 shutdown_connections 2024-09-10T08:29:19.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.252+0000 7ff500400640 1 -- 172.21.15.52:0/1733175593 wait complete. 2024-09-10T08:29:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.254+0000 7ff500400640 1 Processor -- start 2024-09-10T08:29:19.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.254+0000 7ff500400640 1 -- start start 2024-09-10T08:29:19.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f806f390 0x7ff4f81e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f815fab0 0x7ff4f8147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f81592e0 con 0x7ff4f8158d80 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f8159160 con 0x7ff4f806f390 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff500400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f806c150 con 0x7ff4f815fab0 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44746/0 (socket says 172.21.15.52:44746) 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff4fd000640 1 -- 172.21.15.52:0/1842803257 learned_addr learned my addr 172.21.15.52:0/1842803257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff4fd000640 1 -- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f815fab0 msgr2=0x7ff4f8147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.255+0000 7ff4fd000640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f815fab0 0x7ff4f8147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4fd000640 1 -- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f806f390 msgr2=0x7ff4f81e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4fd000640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f806f390 0x7ff4f81e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4fd000640 1 -- 172.21.15.52:0/1842803257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f80b4690 con 0x7ff4f8158d80 2024-09-10T08:29:19.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4fd000640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c00 tx=0x7ff4e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037040 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4042070 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4030940 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f80b4970 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.256+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f8156080 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.257+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f806c490 con 0x7ff4f8158d80 2024-09-10T08:29:19.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.258+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4e4030ae0 con 0x7ff4f8158d80 2024-09-10T08:29:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.259+0000 7ff4f5600640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.259+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4e40ab7d0 con 0x7ff4f8158d80 2024-09-10T08:29:19.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.260+0000 7ff4fda00640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.260+0000 7ff4fda00640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000f60 tx=0x7ff4ec0078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.264+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4e4045360 con 0x7ff4f8158d80 2024-09-10T08:29:19.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.460+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4f80b3cd0 con 0x7ff4f8158d80 2024-09-10T08:29:19.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.461+0000 7ff4f5600640 1 -- 172.21.15.52:0/1842803257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7ff4e407a170 con 0x7ff4f8158d80 2024-09-10T08:29:19.461 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:29:19.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 msgr2=0x7ff4d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 0x7ff4d806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000f60 tx=0x7ff4ec0078f0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 msgr2=0x7ff4f80b6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c00 tx=0x7ff4e40046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 shutdown_connections 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff4d806be30 0x7ff4d806e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff4f815fab0 0x7ff4f8147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f8158d80 0x7ff4f80b6e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 --2- 172.21.15.52:0/1842803257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff4f806f390 0x7ff4f81e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 >> 172.21.15.52:0/1842803257 conn(0x7ff4f806cd20 msgr2=0x7ff4f80cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 shutdown_connections 2024-09-10T08:29:19.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.463+0000 7ff500400640 1 -- 172.21.15.52:0/1842803257 wait complete. 2024-09-10T08:29:19.479 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T08:29:19.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:19.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-10T08:29:19.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:29:19.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:19.544 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T08:29:19.593 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:19.594 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:19.630 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:19.630 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:19.706 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:19.706 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:19.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:29:19.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.979+0000 7fd090a00640 1 Processor -- start 2024-09-10T08:29:19.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.979+0000 7fd090a00640 1 -- start start 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd090a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd08c145ed0 0x7fd08c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd090a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c073180 0x7fd08c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd090a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08c0b4020 con 0x7fd08c0b5880 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd090a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd08c073b00 con 0x7fd08c145ed0 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd090a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c0b42c0 con 0x7fd08c073180 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd08a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd08c0b5880 0x7fd08c0b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38622/0 (socket says 172.21.15.52:38622) 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd08a800640 1 -- 172.21.15.52:0/1303599457 learned_addr learned my addr 172.21.15.52:0/1303599457 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:19.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd089e00640 1 --2- 172.21.15.52:0/1303599457 >> v2:172.21.15.176:3300/0 conn(0x7fd08c145ed0 0x7fd08c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd081400640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c073180 0x7fd08c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd089400640 1 -- 172.21.15.52:0/1303599457 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134115455 0 0) 0x7fd08c0b4020 con 0x7fd08c0b5880 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.981+0000 7fd089400640 1 -- 172.21.15.52:0/1303599457 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd070003520 con 0x7fd08c0b5880 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.982+0000 7fd089e00640 1 -- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c073180 msgr2=0x7fd08c0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.982+0000 7fd089e00640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c073180 0x7fd08c0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.982+0000 7fd089e00640 1 -- 172.21.15.52:0/1303599457 >> v1:172.21.15.52:6789/0 conn(0x7fd08c0b5880 legacy=0x7fd08c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.982+0000 7fd089e00640 1 -- 172.21.15.52:0/1303599457 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c0b45a0 con 0x7fd08c145ed0 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.983+0000 7fd089e00640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c145ed0 0x7fd08c0b5080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=195ddc07dcba0dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.983+0000 7fd089400640 1 -- 172.21.15.52:0/1303599457 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c037070 con 0x7fd08c145ed0 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.983+0000 7fd089400640 1 -- 172.21.15.52:0/1303599457 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c032440 con 0x7fd08c145ed0 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.983+0000 7fd089400640 1 -- 172.21.15.52:0/1303599457 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c032810 con 0x7fd08c145ed0 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 -- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c145ed0 msgr2=0x7fd08c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c145ed0 0x7fd08c0b5080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02a180 comp rx=0 tx=0).stop 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 -- 172.21.15.52:0/1303599457 shutdown_connections 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c073180 0x7fd08c0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 --2- 172.21.15.52:0/1303599457 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c145ed0 0x7fd08c0b5080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 -- 172.21.15.52:0/1303599457 >> 172.21.15.52:0/1303599457 conn(0x7fd08c0ccec0 msgr2=0x7fd08c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 -- 172.21.15.52:0/1303599457 shutdown_connections 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.984+0000 7fd090a00640 1 -- 172.21.15.52:0/1303599457 wait complete. 2024-09-10T08:29:19.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.985+0000 7fd090a00640 1 Processor -- start 2024-09-10T08:29:19.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.985+0000 7fd090a00640 1 -- start start 2024-09-10T08:29:19.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c073180 0x7fd08c13d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c145ed0 0x7fd08c141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c1462b0 con 0x7fd08c0b5880 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c0b4b60 con 0x7fd08c073180 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.986+0000 7fd090a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd08c146430 con 0x7fd08c145ed0 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44762/0 (socket says 172.21.15.52:44762) 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 -- 172.21.15.52:0/351547676 learned_addr learned my addr 172.21.15.52:0/351547676 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd08a800640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c145ed0 0x7fd08c141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd089e00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c073180 0x7fd08c13d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 -- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c145ed0 msgr2=0x7fd08c141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c145ed0 0x7fd08c141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 -- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c073180 msgr2=0x7fd08c13d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c073180 0x7fd08c13d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:19.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 -- 172.21.15.52:0/351547676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c154d30 con 0x7fd08c0b5880 2024-09-10T08:29:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.987+0000 7fd081400640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd07400e9b0 tx=0x7fd07400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.988+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074017070 con 0x7fd08c0b5880 2024-09-10T08:29:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.988+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07400c9a0 con 0x7fd08c0b5880 2024-09-10T08:29:19.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.988+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c155010 con 0x7fd08c0b5880 2024-09-10T08:29:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.988+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07400cd90 con 0x7fd08c0b5880 2024-09-10T08:29:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.988+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1555d0 con 0x7fd08c0b5880 2024-09-10T08:29:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.989+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c0735c0 con 0x7fd08c0b5880 2024-09-10T08:29:19.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.990+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd07401a070 con 0x7fd08c0b5880 2024-09-10T08:29:19.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.991+0000 7fd082a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:19.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.991+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd07408b250 con 0x7fd08c0b5880 2024-09-10T08:29:19.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.992+0000 7fd089e00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:19.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.992+0000 7fd089e00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:19.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:19.996+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd074059510 con 0x7fd08c0b5880 2024-09-10T08:29:20.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.189+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd08c0ce6a0 con 0x7fd08c0b5880 2024-09-10T08:29:20.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.190+0000 7fd082a00640 1 -- 172.21.15.52:0/351547676 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fd07405d810 con 0x7fd08c0b5880 2024-09-10T08:29:20.190 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:29:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 msgr2=0x7fd06806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c02e000 comp rx=0 tx=0).stop 2024-09-10T08:29:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 msgr2=0x7fd08c1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd07400e9b0 tx=0x7fd07400ee70 comp rx=0 tx=0).stop 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 shutdown_connections 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd08c145ed0 0x7fd08c141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd08c0b5880 0x7fd08c1568f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 --2- 172.21.15.52:0/351547676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd08c073180 0x7fd08c13d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 >> 172.21.15.52:0/351547676 conn(0x7fd08c0ccec0 msgr2=0x7fd08c0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 shutdown_connections 2024-09-10T08:29:20.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.192+0000 7fd090a00640 1 -- 172.21.15.52:0/351547676 wait complete. 2024-09-10T08:29:20.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-10T08:29:20.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:20.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-10T08:29:20.267 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:29:20.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:20.267 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T08:29:20.303 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:20.303 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:20.341 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:20.341 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:20.417 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:29:20.417 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:20.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:29:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.651+0000 7fa12c600640 1 Processor -- start 2024-09-10T08:29:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.651+0000 7fa12c600640 1 -- start start 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa12415e990 0x7fa1240d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1240b6740 0x7fa12406c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d4410 con 0x7fa1240b6740 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d3370 con 0x7fa12415e990 2024-09-10T08:29:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.652+0000 7fa12c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa1240d3650 con 0x7fa1240cf030 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1240b6740 0x7fa12406c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa1240b6740 0x7fa12406c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44778/0 (socket says 172.21.15.52:44778) 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa129c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa12415e990 0x7fa1240d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa129200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 -- 172.21.15.52:0/1903554196 learned_addr learned my addr 172.21.15.52:0/1903554196 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 -- 172.21.15.52:0/1903554196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 msgr2=0x7fa1240b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 --2- 172.21.15.52:0/1903554196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240b6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 -- 172.21.15.52:0/1903554196 >> v2:172.21.15.176:3300/0 conn(0x7fa12415e990 msgr2=0x7fa1240d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 --2- 172.21.15.52:0/1903554196 >> v2:172.21.15.176:3300/0 conn(0x7fa12415e990 0x7fa1240d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.653+0000 7fa12a600640 1 -- 172.21.15.52:0/1903554196 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240d3930 con 0x7fa1240b6740 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.654+0000 7fa12a600640 1 --2- 172.21.15.52:0/1903554196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1240b6740 0x7fa12406c0e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa124069550 tx=0x7fa11c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bbad0a51cfd043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.654+0000 7fa123e00640 1 -- 172.21.15.52:0/1903554196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c036070 con 0x7fa1240b6740 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.654+0000 7fa123e00640 1 -- 172.21.15.52:0/1903554196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c031600 con 0x7fa1240b6740 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.654+0000 7fa123e00640 1 -- 172.21.15.52:0/1903554196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0319d0 con 0x7fa1240b6740 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 -- 172.21.15.52:0/1903554196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1240b6740 msgr2=0x7fa12406c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 --2- 172.21.15.52:0/1903554196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1240b6740 0x7fa12406c0e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa124069550 tx=0x7fa11c02a610 comp rx=0 tx=0).stop 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 -- 172.21.15.52:0/1903554196 shutdown_connections 2024-09-10T08:29:20.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 --2- 172.21.15.52:0/1903554196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1240b6740 0x7fa12406c0e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 --2- 172.21.15.52:0/1903554196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240b6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 --2- 172.21.15.52:0/1903554196 >> v2:172.21.15.176:3300/0 conn(0x7fa12415e990 0x7fa1240d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 -- 172.21.15.52:0/1903554196 >> 172.21.15.52:0/1903554196 conn(0x7fa1240d4780 msgr2=0x7fa1240d4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 -- 172.21.15.52:0/1903554196 shutdown_connections 2024-09-10T08:29:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.655+0000 7fa12c600640 1 -- 172.21.15.52:0/1903554196 wait complete. 2024-09-10T08:29:20.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.657+0000 7fa12c600640 1 Processor -- start 2024-09-10T08:29:20.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.657+0000 7fa12c600640 1 -- start start 2024-09-10T08:29:20.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240b6740 0x7fa1240cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa12415ed70 con 0x7fa12415e990 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240d3ef0 con 0x7fa1240b6740 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa12415eef0 con 0x7fa1240cf030 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44784/0 (socket says 172.21.15.52:44784) 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 -- 172.21.15.52:0/873646368 learned_addr learned my addr 172.21.15.52:0/873646368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa129200640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa129c00640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240b6740 0x7fa1240cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 -- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 msgr2=0x7fa1240ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 -- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240b6740 msgr2=0x7fa1240cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240b6740 0x7fa1240cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.658+0000 7fa12a600640 1 -- 172.21.15.52:0/873646368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240c8d60 con 0x7fa12415e990 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa12a600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009f40 tx=0x7fa11c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c036050 con 0x7fa12415e990 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c042070 con 0x7fa12415e990 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240c9040 con 0x7fa12415e990 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c009510 con 0x7fa12415e990 2024-09-10T08:29:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.659+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240c98e0 con 0x7fa12415e990 2024-09-10T08:29:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.660+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1240c96d0 con 0x7fa12415e990 2024-09-10T08:29:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.661+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa11c007bf0 con 0x7fa12415e990 2024-09-10T08:29:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.662+0000 7fa121600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.662+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa11c0aba10 con 0x7fa12415e990 2024-09-10T08:29:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.662+0000 7fa129c00640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:20.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.663+0000 7fa129c00640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 0x7fa10406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b40 tx=0x7fa118009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.666+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa11c079d60 con 0x7fa12415e990 2024-09-10T08:29:20.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.862+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa1240b6200 con 0x7fa12415e990 2024-09-10T08:29:20.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.862+0000 7fa121600640 1 -- 172.21.15.52:0/873646368 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fa11c07e060 con 0x7fa12415e990 2024-09-10T08:29:20.862 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 msgr2=0x7fa10406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 0x7fa10406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa118009b40 tx=0x7fa118009190 comp rx=0 tx=0).stop 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 msgr2=0x7fa1240b7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009f40 tx=0x7fa11c004a40 comp rx=0 tx=0).stop 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 shutdown_connections 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa10406be30 0x7fa10406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa12415e990 0x7fa1240b7ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa1240cf030 0x7fa1240ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 --2- 172.21.15.52:0/873646368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1240b6740 0x7fa1240cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:20.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 >> 172.21.15.52:0/873646368 conn(0x7fa1240d4780 msgr2=0x7fa12406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:20.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 shutdown_connections 2024-09-10T08:29:20.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:20.864+0000 7fa12c600640 1 -- 172.21.15.52:0/873646368 wait complete. 2024-09-10T08:29:20.880 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-10T08:29:20.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:20.880 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-10T08:29:20.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:29:20.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:20.940 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T08:29:20.975 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:29:20.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.131+0000 7fd8a3400640 1 Processor -- start 2024-09-10T08:29:21.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.131+0000 7fd8a3400640 1 -- start start 2024-09-10T08:29:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c158d80 0x7fd89c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 0x7fd89c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd89c15fab0 0x7fd89c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0b4270 con 0x7fd89c15fab0 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd89c0b3f90 con 0x7fd89c06f390 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c15efd0 con 0x7fd89c158d80 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd89c15fab0 0x7fd89c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd89c15fab0 0x7fd89c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44786/0 (socket says 172.21.15.52:44786) 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 -- 172.21.15.52:0/3221544594 learned_addr learned my addr 172.21.15.52:0/3221544594 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a0a00640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c158d80 0x7fd89c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd89be00640 1 --2- 172.21.15.52:0/3221544594 >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 0x7fd89c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 -- 172.21.15.52:0/3221544594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c158d80 msgr2=0x7fd89c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c158d80 0x7fd89c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 -- 172.21.15.52:0/3221544594 >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 msgr2=0x7fd89c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 --2- 172.21.15.52:0/3221544594 >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 0x7fd89c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd8a1400640 1 -- 172.21.15.52:0/3221544594 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c15f2b0 con 0x7fd89c15fab0 2024-09-10T08:29:21.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.133+0000 7fd89be00640 1 --2- 172.21.15.52:0/3221544594 >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 0x7fd89c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.134+0000 7fd8a1400640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c15fab0 0x7fd89c06c150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd89c06c790 tx=0x7fd89402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d987661d2a720cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd89b400640 1 -- 172.21.15.52:0/3221544594 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894036070 con 0x7fd89c15fab0 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd89b400640 1 -- 172.21.15.52:0/3221544594 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894031600 con 0x7fd89c15fab0 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd89b400640 1 -- 172.21.15.52:0/3221544594 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8940319d0 con 0x7fd89c15fab0 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 -- 172.21.15.52:0/3221544594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c15fab0 msgr2=0x7fd89c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c15fab0 0x7fd89c06c150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd89c06c790 tx=0x7fd89402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 -- 172.21.15.52:0/3221544594 shutdown_connections 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 --2- 172.21.15.52:0/3221544594 >> v2:172.21.15.176:3300/0 conn(0x7fd89c06f390 0x7fd89c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c15fab0 0x7fd89c06c150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 --2- 172.21.15.52:0/3221544594 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c158d80 0x7fd89c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.135+0000 7fd8a3400640 1 -- 172.21.15.52:0/3221544594 >> 172.21.15.52:0/3221544594 conn(0x7fd89c06cd20 msgr2=0x7fd89c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.136+0000 7fd8a3400640 1 -- 172.21.15.52:0/3221544594 shutdown_connections 2024-09-10T08:29:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.136+0000 7fd8a3400640 1 -- 172.21.15.52:0/3221544594 wait complete. 2024-09-10T08:29:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.137+0000 7fd8a3400640 1 Processor -- start 2024-09-10T08:29:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.137+0000 7fd8a3400640 1 -- start start 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 0x7fd89c146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c15fab0 0x7fd89c0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c159160 con 0x7fd89c158d80 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c0b3c40 con 0x7fd89c06f390 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd8a3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd89c1592e0 con 0x7fd89c15fab0 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd89be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd89be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44792/0 (socket says 172.21.15.52:44792) 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.138+0000 7fd89be00640 1 -- 172.21.15.52:0/770912895 learned_addr learned my addr 172.21.15.52:0/770912895 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd8a1400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c15fab0 0x7fd89c0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd8a0a00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 0x7fd89c146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 -- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c15fab0 msgr2=0x7fd89c0b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c15fab0 0x7fd89c0b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 -- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 msgr2=0x7fd89c146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 0x7fd89c146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 -- 172.21.15.52:0/770912895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c146550 con 0x7fd89c158d80 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd8a0a00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 0x7fd89c146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd89be00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd88800d800 tx=0x7fd88800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888018030 con 0x7fd89c158d80 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8880096a0 con 0x7fd89c158d80 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888009870 con 0x7fd89c158d80 2024-09-10T08:29:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.139+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c15ae20 con 0x7fd89c158d80 2024-09-10T08:29:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.140+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c15b3e0 con 0x7fd89c158d80 2024-09-10T08:29:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.141+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c0b3700 con 0x7fd89c158d80 2024-09-10T08:29:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.141+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd88801b070 con 0x7fd89c158d80 2024-09-10T08:29:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.142+0000 7fd898c00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 0x7fd87c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.142+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd88808afb0 con 0x7fd89c158d80 2024-09-10T08:29:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.143+0000 7fd8a0a00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 0x7fd87c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.143+0000 7fd8a0a00640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 0x7fd87c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd890009af0 tx=0x7fd890008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.147+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd89c146550 con 0x7fd89c158d80 2024-09-10T08:29:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.368+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd89c0cef20 con 0x7fd89c158d80 2024-09-10T08:29:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.369+0000 7fd898c00640 1 -- 172.21.15.52:0/770912895 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fd888059950 con 0x7fd89c158d80 2024-09-10T08:29:21.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:21.370 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 msgr2=0x7fd87c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 0x7fd87c06e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd890009af0 tx=0x7fd890008040 comp rx=0 tx=0).stop 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 msgr2=0x7fd89c15bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd88800d800 tx=0x7fd88800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 shutdown_connections 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87c06be30 0x7fd87c06e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89c15fab0 0x7fd89c0b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd89c158d80 0x7fd89c15bec0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 --2- 172.21.15.52:0/770912895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd89c06f390 0x7fd89c146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 >> 172.21.15.52:0/770912895 conn(0x7fd89c06cd20 msgr2=0x7fd89c15d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:21.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 shutdown_connections 2024-09-10T08:29:21.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.371+0000 7fd8a3400640 1 -- 172.21.15.52:0/770912895 wait complete. 2024-09-10T08:29:21.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.547+0000 7f514f000640 1 Processor -- start 2024-09-10T08:29:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.547+0000 7f514f000640 1 -- start start 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.548+0000 7f514f000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5148073890 0x7f51480b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.548+0000 7f514f000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51480b5880 0x7f51480b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.548+0000 7f514f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480b4020 con 0x7f5148145ed0 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.548+0000 7f514f000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f51480b42c0 con 0x7f51480b5880 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.548+0000 7f514f000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f51480b45a0 con 0x7f5148073890 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f514d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51480b5880 0x7f51480b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f5147e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5148145ed0 0x7f5148073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38624/0 (socket says 172.21.15.52:38624) 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2312510672 learned_addr learned my addr 172.21.15.52:0/2312510672 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f5147400640 1 --2- 172.21.15.52:0/2312510672 >> v2:172.21.15.176:3300/0 conn(0x7f5148073890 0x7f51480b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f514d000640 1 -- 172.21.15.52:0/2312510672 >> v2:172.21.15.176:3300/0 conn(0x7f5148073890 msgr2=0x7f51480b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f514d000640 1 --2- 172.21.15.52:0/2312510672 >> v2:172.21.15.176:3300/0 conn(0x7f5148073890 0x7f51480b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f514d000640 1 -- 172.21.15.52:0/2312510672 >> v1:172.21.15.52:6789/0 conn(0x7f5148145ed0 legacy=0x7f5148073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.549+0000 7f514d000640 1 -- 172.21.15.52:0/2312510672 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480b4880 con 0x7f51480b5880 2024-09-10T08:29:21.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.550+0000 7f514d000640 1 --2- 172.21.15.52:0/2312510672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480b5880 0x7f51480b5ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51480d1490 tx=0x7f514002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5249436846ad50b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.550+0000 7f5146a00640 1 -- 172.21.15.52:0/2312510672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140007740 con 0x7f51480b5880 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.550+0000 7f5146a00640 1 -- 172.21.15.52:0/2312510672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51400078e0 con 0x7f51480b5880 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.550+0000 7f5146a00640 1 -- 172.21.15.52:0/2312510672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140007cb0 con 0x7f51480b5880 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 -- 172.21.15.52:0/2312510672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480b5880 msgr2=0x7f51480b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 --2- 172.21.15.52:0/2312510672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480b5880 0x7f51480b5ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f51480d1490 tx=0x7f514002a680 comp rx=0 tx=0).stop 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 -- 172.21.15.52:0/2312510672 shutdown_connections 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 --2- 172.21.15.52:0/2312510672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480b5880 0x7f51480b5ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 --2- 172.21.15.52:0/2312510672 >> v2:172.21.15.176:3300/0 conn(0x7f5148073890 0x7f51480b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 -- 172.21.15.52:0/2312510672 >> 172.21.15.52:0/2312510672 conn(0x7f51480ccec0 msgr2=0x7f51480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 -- 172.21.15.52:0/2312510672 shutdown_connections 2024-09-10T08:29:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.551+0000 7f514f000640 1 -- 172.21.15.52:0/2312510672 wait complete. 2024-09-10T08:29:21.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.553+0000 7f514f000640 1 Processor -- start 2024-09-10T08:29:21.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.553+0000 7f514f000640 1 -- start start 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5148073890 0x7f51481f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480b5880 0x7f514813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51480b63a0 con 0x7f5148145ed0 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51480b6220 con 0x7f5148073890 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514f000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51481462b0 con 0x7f51480b5880 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44814/0 (socket says 172.21.15.52:44814) 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514d000640 1 -- 172.21.15.52:0/3951283128 learned_addr learned my addr 172.21.15.52:0/3951283128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:21.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f5147e00640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5148073890 0x7f51481f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f5147400640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480b5880 0x7f514813dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.554+0000 7f514d000640 1 -- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480b5880 msgr2=0x7f514813dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514d000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480b5880 0x7f514813dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514d000640 1 -- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5148073890 msgr2=0x7f51481f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514d000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5148073890 0x7f51481f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514d000640 1 -- 172.21.15.52:0/3951283128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51481f46c0 con 0x7f5148145ed0 2024-09-10T08:29:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514d000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f514002ac70 tx=0x7f5140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140040070 con 0x7f5148145ed0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5140031bc0 con 0x7f5148145ed0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140009450 con 0x7f5148145ed0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51481eb5b0 con 0x7f5148145ed0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.555+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51481f4c60 con 0x7f5148145ed0 2024-09-10T08:29:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.557+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51480cdf30 con 0x7f5148145ed0 2024-09-10T08:29:21.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.557+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5140039040 con 0x7f5148145ed0 2024-09-10T08:29:21.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.558+0000 7f513fe00640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 0x7f512806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.558+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f51400ac590 con 0x7f5148145ed0 2024-09-10T08:29:21.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.559+0000 7f5147e00640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 0x7f512806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.559+0000 7f5147e00640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 0x7f512806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5138000f60 tx=0x7f5138007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.563+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f514007a8e0 con 0x7f5148145ed0 2024-09-10T08:29:21.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.784+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51480b5080 con 0x7f5148145ed0 2024-09-10T08:29:21.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.785+0000 7f513fe00640 1 -- 172.21.15.52:0/3951283128 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f514007ebe0 con 0x7f5148145ed0 2024-09-10T08:29:21.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:21.785 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:21.786 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:21.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.787+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 msgr2=0x7f512806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.787+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 0x7f512806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5138000f60 tx=0x7f5138007e80 comp rx=0 tx=0).stop 2024-09-10T08:29:21.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.787+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 msgr2=0x7f51481eb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.787+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f514002ac70 tx=0x7f5140004a40 comp rx=0 tx=0).stop 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 shutdown_connections 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be30 0x7f512806e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5148145ed0 0x7f51481eb070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480b5880 0x7f514813dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 --2- 172.21.15.52:0/3951283128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5148073890 0x7f51481f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 >> 172.21.15.52:0/3951283128 conn(0x7f51480ccec0 msgr2=0x7f51480d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 shutdown_connections 2024-09-10T08:29:21.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.788+0000 7f514f000640 1 -- 172.21.15.52:0/3951283128 wait complete. 2024-09-10T08:29:21.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.962+0000 7f5356400640 1 Processor -- start 2024-09-10T08:29:21.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.962+0000 7f5356400640 1 -- start start 2024-09-10T08:29:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 0x7f53500b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f535015fab0 0x7f535006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f53500b4270 con 0x7f535015fab0 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f53500b3f90 con 0x7f5350158d80 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.964+0000 7f5356400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f535015efd0 con 0x7f535006f390 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f535015fab0 0x7f535006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534f400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 0x7f53500b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f535015fab0 0x7f535006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44830/0 (socket says 172.21.15.52:44830) 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:59286/0 (socket says 172.21.15.52:59286) 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 -- 172.21.15.52:0/3448297395 learned_addr learned my addr 172.21.15.52:0/3448297395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 -- 172.21.15.52:0/3448297395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 msgr2=0x7f535006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 --2- 172.21.15.52:0/3448297395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 -- 172.21.15.52:0/3448297395 >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 msgr2=0x7f53500b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:21.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 --2- 172.21.15.52:0/3448297395 >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 0x7f53500b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534fe00640 1 -- 172.21.15.52:0/3448297395 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535015f2b0 con 0x7f535015fab0 2024-09-10T08:29:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.965+0000 7f534f400640 1 --2- 172.21.15.52:0/3448297395 >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 0x7f53500b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.967+0000 7f534fe00640 1 --2- 172.21.15.52:0/3448297395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535015fab0 0x7f535006c150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53500d2650 tx=0x7f534802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5815e3f029f955f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.967+0000 7f534e000640 1 -- 172.21.15.52:0/3448297395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348036070 con 0x7f535015fab0 2024-09-10T08:29:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.967+0000 7f534e000640 1 -- 172.21.15.52:0/3448297395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348031600 con 0x7f535015fab0 2024-09-10T08:29:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.967+0000 7f534e000640 1 -- 172.21.15.52:0/3448297395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53480319d0 con 0x7f535015fab0 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 -- 172.21.15.52:0/3448297395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535015fab0 msgr2=0x7f535006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 --2- 172.21.15.52:0/3448297395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535015fab0 0x7f535006c150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f53500d2650 tx=0x7f534802a610 comp rx=0 tx=0).stop 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 -- 172.21.15.52:0/3448297395 shutdown_connections 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 --2- 172.21.15.52:0/3448297395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f535015fab0 0x7f535006c150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 --2- 172.21.15.52:0/3448297395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 --2- 172.21.15.52:0/3448297395 >> v2:172.21.15.176:3300/0 conn(0x7f5350158d80 0x7f53500b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 -- 172.21.15.52:0/3448297395 >> 172.21.15.52:0/3448297395 conn(0x7f535006cd20 msgr2=0x7f535006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 -- 172.21.15.52:0/3448297395 shutdown_connections 2024-09-10T08:29:21.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.968+0000 7f5356400640 1 -- 172.21.15.52:0/3448297395 wait complete. 2024-09-10T08:29:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.970+0000 7f5356400640 1 Processor -- start 2024-09-10T08:29:21.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.970+0000 7f5356400640 1 -- start start 2024-09-10T08:29:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535015fab0 0x7f5350156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5350159160 con 0x7f5350158d80 2024-09-10T08:29:21.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53500b3c40 con 0x7f535015fab0 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f5356400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53501592e0 con 0x7f535006f390 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f534ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f534ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44834/0 (socket says 172.21.15.52:44834) 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f534ea00640 1 -- 172.21.15.52:0/1325460282 learned_addr learned my addr 172.21.15.52:0/1325460282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.971+0000 7f534fe00640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535015fab0 0x7f5350156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534f400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 -- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 msgr2=0x7f535014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535014e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 -- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535015fab0 msgr2=0x7f5350156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535015fab0 0x7f5350156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 -- 172.21.15.52:0/1325460282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535014e980 con 0x7f5350158d80 2024-09-10T08:29:21.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f534ea00640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e890 tx=0x7f533c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c017070 con 0x7f5350158d80 2024-09-10T08:29:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c00c940 con 0x7f5350158d80 2024-09-10T08:29:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cd10 con 0x7f5350158d80 2024-09-10T08:29:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.972+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53500b4690 con 0x7f5350158d80 2024-09-10T08:29:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.973+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53500b4c10 con 0x7f5350158d80 2024-09-10T08:29:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.974+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53500b3700 con 0x7f5350158d80 2024-09-10T08:29:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.975+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f533c01a070 con 0x7f5350158d80 2024-09-10T08:29:21.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.976+0000 7f5347400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:21.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.976+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f533c08ae60 con 0x7f5350158d80 2024-09-10T08:29:21.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.976+0000 7f534f400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:21.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.977+0000 7f534f400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 0x7f533006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5340009560 tx=0x7f5340009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:21.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:21.980+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f533c059120 con 0x7f5350158d80 2024-09-10T08:29:22.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.167+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53500cf490 con 0x7f5350158d80 2024-09-10T08:29:22.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.168+0000 7f5347400640 1 -- 172.21.15.52:0/1325460282 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7f533c05d420 con 0x7f5350158d80 2024-09-10T08:29:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:22.169 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:22.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 msgr2=0x7f533006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 0x7f533006e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5340009560 tx=0x7f5340009190 comp rx=0 tx=0).stop 2024-09-10T08:29:22.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 msgr2=0x7f535015bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e890 tx=0x7f533c00ed50 comp rx=0 tx=0).stop 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 shutdown_connections 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f533006be30 0x7f533006e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f535015fab0 0x7f5350156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5350158d80 0x7f535015bfa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 --2- 172.21.15.52:0/1325460282 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f535006f390 0x7f535014e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 >> 172.21.15.52:0/1325460282 conn(0x7f535006cd20 msgr2=0x7f5350161110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 shutdown_connections 2024-09-10T08:29:22.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.171+0000 7f5356400640 1 -- 172.21.15.52:0/1325460282 wait complete. 2024-09-10T08:29:22.187 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:29:22.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:22.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.344+0000 7fb072e00640 1 Processor -- start 2024-09-10T08:29:22.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.344+0000 7fb072e00640 1 -- start start 2024-09-10T08:29:22.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.345+0000 7fb072e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb06c0b6710 0x7fb06c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.345+0000 7fb072e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06c0d3990 con 0x7fb06c15e440 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.345+0000 7fb072e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06c0d3c70 con 0x7fb06c0cf450 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.345+0000 7fb072e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb06c0d3f50 con 0x7fb06c0b6710 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb06c0b6710 0x7fb06c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb06c0b6710 0x7fb06c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44846/0 (socket says 172.21.15.52:44846) 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 -- 172.21.15.52:0/3227113396 learned_addr learned my addr 172.21.15.52:0/3227113396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071a00640 1 --1- 172.21.15.52:0/3227113396 >> v1:172.21.15.52:6789/0 conn(0x7fb06c15e440 0x7fb06c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38628/0 (socket says 172.21.15.52:38628) 2024-09-10T08:29:22.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 -- 172.21.15.52:0/3227113396 >> v1:172.21.15.176:6789/0 conn(0x7fb06c0cf450 legacy=0x7fb06c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 -- 172.21.15.52:0/3227113396 >> v1:172.21.15.52:6789/0 conn(0x7fb06c15e440 legacy=0x7fb06c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.346+0000 7fb071000640 1 -- 172.21.15.52:0/3227113396 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c0d4230 con 0x7fb06c0b6710 2024-09-10T08:29:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.347+0000 7fb071000640 1 --2- 172.21.15.52:0/3227113396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0b6710 0x7fb06c0d3240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb058009870 tx=0x7fb05802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8477062532cb4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.347+0000 7fb06be00640 1 -- 172.21.15.52:0/3227113396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058037070 con 0x7fb06c0b6710 2024-09-10T08:29:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.347+0000 7fb06be00640 1 -- 172.21.15.52:0/3227113396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058032640 con 0x7fb06c0b6710 2024-09-10T08:29:22.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.347+0000 7fb06be00640 1 -- 172.21.15.52:0/3227113396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058032a10 con 0x7fb06c0b6710 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 -- 172.21.15.52:0/3227113396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0b6710 msgr2=0x7fb06c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 --2- 172.21.15.52:0/3227113396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0b6710 0x7fb06c0d3240 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb058009870 tx=0x7fb05802a3c0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 -- 172.21.15.52:0/3227113396 shutdown_connections 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 --2- 172.21.15.52:0/3227113396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0b6710 0x7fb06c0d3240 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 -- 172.21.15.52:0/3227113396 >> 172.21.15.52:0/3227113396 conn(0x7fb06c067f80 msgr2=0x7fb06c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 -- 172.21.15.52:0/3227113396 shutdown_connections 2024-09-10T08:29:22.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.348+0000 7fb072e00640 1 -- 172.21.15.52:0/3227113396 wait complete. 2024-09-10T08:29:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.350+0000 7fb072e00640 1 Processor -- start 2024-09-10T08:29:22.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.350+0000 7fb072e00640 1 -- start start 2024-09-10T08:29:22.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb06c0b6710 0x7fb06c1e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb06c15e440 0x7fb06c0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c0b76c0 con 0x7fb06c0cf450 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c0b7540 con 0x7fb06c15e440 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb06c0b8270 con 0x7fb06c0b6710 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb071000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb071000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44856/0 (socket says 172.21.15.52:44856) 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb071000640 1 -- 172.21.15.52:0/1789449180 learned_addr learned my addr 172.21.15.52:0/1789449180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb071a00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb06c0b6710 0x7fb06c1e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.351+0000 7fb072400640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb06c15e440 0x7fb06c0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 -- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb06c0b6710 msgr2=0x7fb06c1e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb06c0b6710 0x7fb06c1e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 -- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb06c15e440 msgr2=0x7fb06c0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb06c15e440 0x7fb06c0c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 -- 172.21.15.52:0/1789449180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c0cac10 con 0x7fb06c0cf450 2024-09-10T08:29:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb071000640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058037040 con 0x7fb06c0cf450 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058042070 con 0x7fb06c0cf450 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c149be0 con 0x7fb06c0cf450 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058030bd0 con 0x7fb06c0cf450 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.352+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c14a1a0 con 0x7fb06c0cf450 2024-09-10T08:29:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.354+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c0d3240 con 0x7fb06c0cf450 2024-09-10T08:29:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.355+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb058032500 con 0x7fb06c0cf450 2024-09-10T08:29:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.356+0000 7fb069600640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 0x7fb04c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.357+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0580ab810 con 0x7fb06c0cf450 2024-09-10T08:29:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.357+0000 7fb071a00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 0x7fb04c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.358+0000 7fb071a00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 0x7fb04c06e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb060000f60 tx=0x7fb060000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.361+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb058079ad0 con 0x7fb06c0cf450 2024-09-10T08:29:22.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.583+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb06c0b9150 con 0x7fb06c0cf450 2024-09-10T08:29:22.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.584+0000 7fb069600640 1 -- 172.21.15.52:0/1789449180 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fb05807ddd0 con 0x7fb06c0cf450 2024-09-10T08:29:22.584 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:22.584 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:22.585 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:22.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 msgr2=0x7fb04c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 0x7fb04c06e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb060000f60 tx=0x7fb060000ed0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 msgr2=0x7fb06c1e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb0580046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 shutdown_connections 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04c06be30 0x7fb04c06e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb06c15e440 0x7fb06c0c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb06c0cf450 0x7fb06c1e6e60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 --2- 172.21.15.52:0/1789449180 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb06c0b6710 0x7fb06c1e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 >> 172.21.15.52:0/1789449180 conn(0x7fb06c067f80 msgr2=0x7fb06c0b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 shutdown_connections 2024-09-10T08:29:22.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.586+0000 7fb072e00640 1 -- 172.21.15.52:0/1789449180 wait complete. 2024-09-10T08:29:22.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:22.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.760+0000 7f19cc800640 1 Processor -- start 2024-09-10T08:29:22.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.760+0000 7f19cc800640 1 -- start start 2024-09-10T08:29:22.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.761+0000 7f19cc800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c415ed20 0x7f19c40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.761+0000 7f19cc800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f19c40d23b0 0x7f19c40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.761+0000 7f19cc800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c40d0e70 con 0x7f19c40cf2d0 2024-09-10T08:29:22.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.761+0000 7f19cc800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f19c40d41c0 con 0x7f19c40d23b0 2024-09-10T08:29:22.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.761+0000 7f19cc800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19c40d35b0 con 0x7f19c415ed20 2024-09-10T08:29:22.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19ca800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f19c40cf2d0 0x7f19c40cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38644/0 (socket says 172.21.15.52:38644) 2024-09-10T08:29:22.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19ca800640 1 -- 172.21.15.52:0/1642659475 learned_addr learned my addr 172.21.15.52:0/1642659475 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9400640 1 --2- 172.21.15.52:0/1642659475 >> v2:172.21.15.176:3300/0 conn(0x7f19c40d23b0 0x7f19c40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9e00640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c415ed20 0x7f19c40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c8a00640 1 -- 172.21.15.52:0/1642659475 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865523659 0 0) 0x7f19c0001490 con 0x7f19c40cf2d0 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c8a00640 1 -- 172.21.15.52:0/1642659475 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19ac003520 con 0x7f19c40cf2d0 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9400640 1 -- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c415ed20 msgr2=0x7f19c40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9400640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c415ed20 0x7f19c40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9400640 1 -- 172.21.15.52:0/1642659475 >> v1:172.21.15.52:6789/0 conn(0x7f19c40cf2d0 legacy=0x7f19c40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.762+0000 7f19c9400640 1 -- 172.21.15.52:0/1642659475 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c40d3890 con 0x7f19c40d23b0 2024-09-10T08:29:22.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.763+0000 7f19c9400640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40d23b0 0x7f19c40b67a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097a0 tx=0x7f19b402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f375a56713a950a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19c8a00640 1 -- 172.21.15.52:0/1642659475 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4037070 con 0x7f19c40d23b0 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19c8a00640 1 -- 172.21.15.52:0/1642659475 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4032440 con 0x7f19c40d23b0 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19c8a00640 1 -- 172.21.15.52:0/1642659475 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4032810 con 0x7f19c40d23b0 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 -- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40d23b0 msgr2=0x7f19c40b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40d23b0 0x7f19c40b67a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097a0 tx=0x7f19b402a180 comp rx=0 tx=0).stop 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 -- 172.21.15.52:0/1642659475 shutdown_connections 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40d23b0 0x7f19c40b67a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 --2- 172.21.15.52:0/1642659475 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c415ed20 0x7f19c40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 -- 172.21.15.52:0/1642659475 >> 172.21.15.52:0/1642659475 conn(0x7f19c40d1260 msgr2=0x7f19c40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 -- 172.21.15.52:0/1642659475 shutdown_connections 2024-09-10T08:29:22.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.764+0000 7f19cc800640 1 -- 172.21.15.52:0/1642659475 wait complete. 2024-09-10T08:29:22.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.766+0000 7f19cc800640 1 Processor -- start 2024-09-10T08:29:22.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.766+0000 7f19cc800640 1 -- start start 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 0x7f19c414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 0x7f19c40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40d32a0 con 0x7f19c415ed20 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19c40d3e50 con 0x7f19c40cf2d0 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19cc800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19c415f100 con 0x7f19c40d23b0 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19ca800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19ca800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44862/0 (socket says 172.21.15.52:44862) 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19ca800640 1 -- 172.21.15.52:0/709672904 learned_addr learned my addr 172.21.15.52:0/709672904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19c9400640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 0x7f19c40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.767+0000 7f19c9e00640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 0x7f19c414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 -- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 msgr2=0x7f19c40b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 0x7f19c40b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 -- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 msgr2=0x7f19c414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 0x7f19c414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 -- 172.21.15.52:0/709672904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c41f4d00 con 0x7f19c415ed20 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19c9e00640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 0x7f19c414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19c9400640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 0x7f19c40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:22.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19ca800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19c000cb50 tx=0x7f19c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0017070 con 0x7f19c415ed20 2024-09-10T08:29:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c000ace0 con 0x7f19c415ed20 2024-09-10T08:29:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c41f4fe0 con 0x7f19c415ed20 2024-09-10T08:29:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.768+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0012620 con 0x7f19c415ed20 2024-09-10T08:29:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.769+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c41f55a0 con 0x7f19c415ed20 2024-09-10T08:29:22.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.769+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c40b7010 con 0x7f19c415ed20 2024-09-10T08:29:22.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.771+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f19c001a070 con 0x7f19c415ed20 2024-09-10T08:29:22.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.772+0000 7f19be000640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 0x7f19a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.772+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f19c008aba0 con 0x7f19c415ed20 2024-09-10T08:29:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.773+0000 7f19c9e00640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 0x7f19a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.773+0000 7f19c9e00640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 0x7f19a806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009af0 tx=0x7f19b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:22.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:22.777+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19c40d0e70 con 0x7f19c415ed20 2024-09-10T08:29:23.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.000+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c40b3f20 con 0x7f19c415ed20 2024-09-10T08:29:23.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.000+0000 7f19be000640 1 -- 172.21.15.52:0/709672904 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f19c00595e0 con 0x7f19c415ed20 2024-09-10T08:29:23.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:23.001 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-10T08:28:48:479155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/3321273057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3321273057},{"type":"v1","addr":"172.21.15.176:6835","nonce":3321273057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2785599548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2785599548},{"type":"v1","addr":"172.21.15.176:6837","nonce":2785599548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/307081846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":307081846},{"type":"v1","addr":"172.21.15.52:6833","nonce":307081846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:28:44.896156+0000","modified":"2024-09-10T08:28:47.904970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/1971878185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1971878185},{"type":"v1","addr":"172.21.15.52:6835","nonce":1971878185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-09-10T08:29:23.001 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 msgr2=0x7f19a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 0x7f19a806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009af0 tx=0x7f19b8008040 comp rx=0 tx=0).stop 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 msgr2=0x7f19c40b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19c000cb50 tx=0x7f19c000a430 comp rx=0 tx=0).stop 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 shutdown_connections 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f19a806be30 0x7f19a806e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19c415ed20 0x7f19c40b4680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19c40d23b0 0x7f19c40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 --2- 172.21.15.52:0/709672904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19c40cf2d0 0x7f19c414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 >> 172.21.15.52:0/709672904 conn(0x7f19c40d1260 msgr2=0x7f19c4160ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 shutdown_connections 2024-09-10T08:29:23.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.003+0000 7f19cc800640 1 -- 172.21.15.52:0/709672904 wait complete. 2024-09-10T08:29:23.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.174+0000 7fe62e400640 1 Processor -- start 2024-09-10T08:29:23.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.175+0000 7fe62e400640 1 -- start start 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe62e400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe62815c420 0x7fe628160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe62e400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6280b1990 0x7fe6280d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe62e400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe628071b60 con 0x7fe6280d2a60 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe62e400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe6280d2ed0 con 0x7fe6280b1990 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe62e400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe6280d04c0 con 0x7fe62815c420 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe61fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6280b1990 0x7fe6280d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe627400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe62815c420 0x7fe628160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe61fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6280b1990 0x7fe6280d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44878/0 (socket says 172.21.15.52:44878) 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe61fe00640 1 -- 172.21.15.52:0/3079868186 learned_addr learned my addr 172.21.15.52:0/3079868186 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.176+0000 7fe627e00640 1 --1- 172.21.15.52:0/3079868186 >> v1:172.21.15.52:6789/0 conn(0x7fe6280d2a60 0x7fe6280731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38652/0 (socket says 172.21.15.52:38652) 2024-09-10T08:29:23.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.177+0000 7fe61fe00640 1 -- 172.21.15.52:0/3079868186 >> v2:172.21.15.176:3300/0 conn(0x7fe62815c420 msgr2=0x7fe628160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.177+0000 7fe61fe00640 1 --2- 172.21.15.52:0/3079868186 >> v2:172.21.15.176:3300/0 conn(0x7fe62815c420 0x7fe628160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.177+0000 7fe61fe00640 1 -- 172.21.15.52:0/3079868186 >> v1:172.21.15.52:6789/0 conn(0x7fe6280d2a60 legacy=0x7fe6280731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.177+0000 7fe61fe00640 1 -- 172.21.15.52:0/3079868186 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6280715a0 con 0x7fe6280b1990 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe61fe00640 1 --2- 172.21.15.52:0/3079868186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6280b1990 0x7fe6280d2520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6280743b0 tx=0x7fe61002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f102e2622827f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe626a00640 1 -- 172.21.15.52:0/3079868186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610037070 con 0x7fe6280b1990 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe626a00640 1 -- 172.21.15.52:0/3079868186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe610032440 con 0x7fe6280b1990 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe626a00640 1 -- 172.21.15.52:0/3079868186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610032810 con 0x7fe6280b1990 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 -- 172.21.15.52:0/3079868186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6280b1990 msgr2=0x7fe6280d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 --2- 172.21.15.52:0/3079868186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6280b1990 0x7fe6280d2520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe6280743b0 tx=0x7fe61002a160 comp rx=0 tx=0).stop 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 -- 172.21.15.52:0/3079868186 shutdown_connections 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 --2- 172.21.15.52:0/3079868186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6280b1990 0x7fe6280d2520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 --2- 172.21.15.52:0/3079868186 >> v2:172.21.15.176:3300/0 conn(0x7fe62815c420 0x7fe628160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.178+0000 7fe62e400640 1 -- 172.21.15.52:0/3079868186 >> 172.21.15.52:0/3079868186 conn(0x7fe628067fb0 msgr2=0x7fe62806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.179+0000 7fe62e400640 1 -- 172.21.15.52:0/3079868186 shutdown_connections 2024-09-10T08:29:23.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.179+0000 7fe62e400640 1 -- 172.21.15.52:0/3079868186 wait complete. 2024-09-10T08:29:23.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.180+0000 7fe62e400640 1 Processor -- start 2024-09-10T08:29:23.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.180+0000 7fe62e400640 1 -- start start 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 0x7fe6281493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6280d2a60 0x7fe62815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe62815c800 con 0x7fe62815c420 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6280b1dd0 con 0x7fe6280d2a60 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe62e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6280d1960 con 0x7fe6280b1990 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe627e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe627e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44882/0 (socket says 172.21.15.52:44882) 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.181+0000 7fe627e00640 1 -- 172.21.15.52:0/1527988879 learned_addr learned my addr 172.21.15.52:0/1527988879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe61fe00640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6280d2a60 0x7fe62815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 0x7fe6281493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 -- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 msgr2=0x7fe6281493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 0x7fe6281493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 -- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6280d2a60 msgr2=0x7fe62815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6280d2a60 0x7fe62815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 -- 172.21.15.52:0/1527988879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62815d3d0 con 0x7fe62815c420 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 0x7fe6281493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe627e00640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c780 tx=0x7fe62000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620017070 con 0x7fe62815c420 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62000a640 con 0x7fe62815c420 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62000aa30 con 0x7fe62815c420 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.182+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62815d6b0 con 0x7fe62815c420 2024-09-10T08:29:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.183+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62815dc70 con 0x7fe62815c420 2024-09-10T08:29:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.184+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6280b74f0 con 0x7fe62815c420 2024-09-10T08:29:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.184+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe62001a070 con 0x7fe62815c420 2024-09-10T08:29:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.185+0000 7fe61f400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.185+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe62008a3c0 con 0x7fe62815c420 2024-09-10T08:29:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.186+0000 7fe627400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.186+0000 7fe627400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe62815b1b0 tx=0x7fe618008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.190+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe620058710 con 0x7fe62815c420 2024-09-10T08:29:23.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.374+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6280b7210 con 0x7fe62815c420 2024-09-10T08:29:23.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.375+0000 7fe61f400640 1 -- 172.21.15.52:0/1527988879 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16681 (secure 0 0 0) 0x7fe62005ca10 con 0x7fe62815c420 2024-09-10T08:29:23.376 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:23.376 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:28:46.467692+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:28:42.933485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:28:43.883402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 msgr2=0x7fe60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe62815b1b0 tx=0x7fe618008040 comp rx=0 tx=0).stop 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 msgr2=0x7fe62815e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c780 tx=0x7fe62000cc40 comp rx=0 tx=0).stop 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 shutdown_connections 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62815c420 0x7fe62815e6f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6280d2a60 0x7fe62815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 --2- 172.21.15.52:0/1527988879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6280b1990 0x7fe6281493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.377+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 >> 172.21.15.52:0/1527988879 conn(0x7fe628067fb0 msgr2=0x7fe6280b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.378+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 shutdown_connections 2024-09-10T08:29:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.378+0000 7fe62e400640 1 -- 172.21.15.52:0/1527988879 wait complete. 2024-09-10T08:29:23.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.551+0000 7fca29400640 1 Processor -- start 2024-09-10T08:29:23.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.551+0000 7fca29400640 1 -- start start 2024-09-10T08:29:23.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca29400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca24158d80 0x7fca240b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca29400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240b4270 con 0x7fca2406c320 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca29400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240b3f90 con 0x7fca2406f390 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca29400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fca2415efd0 con 0x7fca24158d80 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca22800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca24158d80 0x7fca240b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca22800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca24158d80 0x7fca240b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44884/0 (socket says 172.21.15.52:44884) 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca22800640 1 -- 172.21.15.52:0/1315372326 learned_addr learned my addr 172.21.15.52:0/1315372326 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca23200640 1 --1- 172.21.15.52:0/1315372326 >> v1:172.21.15.52:6789/0 conn(0x7fca2406c320 0x7fca2406e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38660/0 (socket says 172.21.15.52:38660) 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.553+0000 7fca22800640 1 -- 172.21.15.52:0/1315372326 >> v1:172.21.15.176:6789/0 conn(0x7fca2406f390 legacy=0x7fca2406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.554+0000 7fca22800640 1 -- 172.21.15.52:0/1315372326 >> v1:172.21.15.52:6789/0 conn(0x7fca2406c320 legacy=0x7fca2406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.554+0000 7fca22800640 1 -- 172.21.15.52:0/1315372326 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2415f2b0 con 0x7fca24158d80 2024-09-10T08:29:23.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.554+0000 7fca21e00640 1 -- 172.21.15.52:0/1315372326 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467605648 0 0) 0x7fca240b4270 con 0x7fca2406c320 2024-09-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca22800640 1 --2- 172.21.15.52:0/1315372326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca24158d80 0x7fca240b3700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca14009870 tx=0x7fca1402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b58072fb33bd47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca21e00640 1 -- 172.21.15.52:0/1315372326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14037070 con 0x7fca24158d80 2024-09-10T08:29:23.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca21e00640 1 -- 172.21.15.52:0/1315372326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1402ae50 con 0x7fca24158d80 2024-09-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca21e00640 1 -- 172.21.15.52:0/1315372326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14032860 con 0x7fca24158d80 2024-09-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca29400640 1 -- 172.21.15.52:0/1315372326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca24158d80 msgr2=0x7fca240b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca29400640 1 --2- 172.21.15.52:0/1315372326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca24158d80 0x7fca240b3700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca14009870 tx=0x7fca1402a300 comp rx=0 tx=0).stop 2024-09-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca29400640 1 -- 172.21.15.52:0/1315372326 shutdown_connections 2024-09-10T08:29:23.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca29400640 1 --2- 172.21.15.52:0/1315372326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca24158d80 0x7fca240b3700 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.555+0000 7fca29400640 1 -- 172.21.15.52:0/1315372326 >> 172.21.15.52:0/1315372326 conn(0x7fca2406cd20 msgr2=0x7fca2406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.556+0000 7fca29400640 1 -- 172.21.15.52:0/1315372326 shutdown_connections 2024-09-10T08:29:23.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.556+0000 7fca29400640 1 -- 172.21.15.52:0/1315372326 wait complete. 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.557+0000 7fca29400640 1 Processor -- start 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.557+0000 7fca29400640 1 -- start start 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 0x7fca2415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca24158d80 0x7fca2414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca24159160 con 0x7fca2406f390 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca240b3c40 con 0x7fca2406c320 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca29400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca241592e0 con 0x7fca24158d80 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44900/0 (socket says 172.21.15.52:44900) 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.558+0000 7fca1be00640 1 -- 172.21.15.52:0/1369250735 learned_addr learned my addr 172.21.15.52:0/1369250735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca23200640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca24158d80 0x7fca2414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca22800640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 0x7fca2415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 -- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca24158d80 msgr2=0x7fca2414b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca24158d80 0x7fca2414b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 -- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 msgr2=0x7fca2415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 0x7fca2415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 -- 172.21.15.52:0/1369250735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24159680 con 0x7fca2406f390 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca22800640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 0x7fca2415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1be00640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c450 tx=0x7fca0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0052d0 con 0x7fca2406f390 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c005470 con 0x7fca2406f390 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c012870 con 0x7fca2406f390 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.559+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca24159920 con 0x7fca2406f390 2024-09-10T08:29:23.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.560+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2415c4f0 con 0x7fca2406f390 2024-09-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.561+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2415fab0 con 0x7fca2406f390 2024-09-10T08:29:23.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.561+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca0c012a10 con 0x7fca2406f390 2024-09-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.562+0000 7fca1aa00640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.562+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca0c08aae0 con 0x7fca2406f390 2024-09-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.563+0000 7fca22800640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.563+0000 7fca22800640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 0x7fca0006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca14034000 tx=0x7fca1402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.567+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca0c059400 con 0x7fca2406f390 2024-09-10T08:29:23.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.787+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fca240caab0 con 0x7fca2406f390 2024-09-10T08:29:23.788 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:29:23.787+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:29:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.790+0000 7fca1aa00640 1 -- 172.21.15.52:0/1369250735 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fca0c058d00 con 0x7fca2406f390 2024-09-10T08:29:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:29:23.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 msgr2=0x7fca0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 0x7fca0006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca14034000 tx=0x7fca1402e000 comp rx=0 tx=0).stop 2024-09-10T08:29:23.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 msgr2=0x7fca241f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00c450 tx=0x7fca0c00c910 comp rx=0 tx=0).stop 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 shutdown_connections 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca0006be30 0x7fca0006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca24158d80 0x7fca2414b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2406f390 0x7fca241f8810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 --2- 172.21.15.52:0/1369250735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2406c320 0x7fca2415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 >> 172.21.15.52:0/1369250735 conn(0x7fca2406cd20 msgr2=0x7fca2406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 shutdown_connections 2024-09-10T08:29:23.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.793+0000 7fca29400640 1 -- 172.21.15.52:0/1369250735 wait complete. 2024-09-10T08:29:23.805 INFO:tasks.ceph.mds.c.smithi052.stderr: -7012> 2024-09-10T08:28:50.447+0000 7eff0c200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:29:23.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:29:23.857 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:29:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.971+0000 7f3151800640 1 Processor -- start 2024-09-10T08:29:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.971+0000 7f3151800640 1 -- start start 2024-09-10T08:29:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.972+0000 7f3151800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 0x7f314c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.972+0000 7f3151800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f314c0cfcb0 0x7f314c071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.972+0000 7f3151800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314c15f120 con 0x7f314c144340 2024-09-10T08:29:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.972+0000 7f3151800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f314c141cd0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.972+0000 7f3151800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f314c15f400 con 0x7f314c0cf8d0 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f314aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 0x7f314c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f3143e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f314c0cfcb0 0x7f314c071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f314b400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f314c144340 0x7f314c1447d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39126/0 (socket says 172.21.15.52:39126) 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f314aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 0x7f314c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:59362/0 (socket says 172.21.15.52:59362) 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f314b400640 1 -- 172.21.15.52:0/1148312736 learned_addr learned my addr 172.21.15.52:0/1148312736 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f3143e00640 1 -- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 msgr2=0x7f314c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.973+0000 7f3143e00640 1 --2- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 0x7f314c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.974+0000 7f3143e00640 1 -- 172.21.15.52:0/1148312736 >> v1:172.21.15.176:6789/0 conn(0x7f314c144340 legacy=0x7f314c1447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.974+0000 7f3143e00640 1 -- 172.21.15.52:0/1148312736 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c15f6e0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.974+0000 7f314a000640 1 -- 172.21.15.52:0/1148312736 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690641336 0 0) 0x7f314c15f120 con 0x7f314c144340 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f3143e00640 1 --2- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cfcb0 0x7f314c071480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f31340097a0 tx=0x7f313402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa053e7cd4808113 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f314a000640 1 -- 172.21.15.52:0/1148312736 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134037070 con 0x7f314c0cfcb0 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f314a000640 1 -- 172.21.15.52:0/1148312736 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134032440 con 0x7f314c0cfcb0 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f314a000640 1 -- 172.21.15.52:0/1148312736 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134032810 con 0x7f314c0cfcb0 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f3151800640 1 -- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cfcb0 msgr2=0x7f314c071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.975+0000 7f3151800640 1 --2- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cfcb0 0x7f314c071480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f31340097a0 tx=0x7f313402a180 comp rx=0 tx=0).stop 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 -- 172.21.15.52:0/1148312736 shutdown_connections 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 --2- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cfcb0 0x7f314c071480 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 --2- 172.21.15.52:0/1148312736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c0cf8d0 0x7f314c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 -- 172.21.15.52:0/1148312736 >> 172.21.15.52:0/1148312736 conn(0x7f314c06d0f0 msgr2=0x7f314c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 -- 172.21.15.52:0/1148312736 shutdown_connections 2024-09-10T08:29:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.976+0000 7f3151800640 1 -- 172.21.15.52:0/1148312736 wait complete. 2024-09-10T08:29:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.977+0000 7f3151800640 1 Processor -- start 2024-09-10T08:29:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.977+0000 7f3151800640 1 -- start start 2024-09-10T08:29:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 0x7f314c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c144340 0x7f314c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f314c0ce0f0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f314c15ee30 con 0x7f314c0cf8d0 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3151800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f314c0ce270 con 0x7f314c144340 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3143e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3143e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44930/0 (socket says 172.21.15.52:44930) 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.978+0000 7f3143e00640 1 -- 172.21.15.52:0/3289644954 learned_addr learned my addr 172.21.15.52:0/3289644954 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f314aa00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 0x7f314c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f314b400640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c144340 0x7f314c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 -- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c144340 msgr2=0x7f314c0c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c144340 0x7f314c0c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 -- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 msgr2=0x7f314c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 0x7f314c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 -- 172.21.15.52:0/3289644954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c14b1e0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f314aa00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 0x7f314c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.979+0000 7f3143e00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f313402a770 tx=0x7f31340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.980+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134037050 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.980+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134043070 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.980+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313403cb30 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.980+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c14b4c0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.980+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c14ba80 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.981+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c1447d0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.982+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f313403ccd0 con 0x7f314c0cfcb0 2024-09-10T08:29:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.983+0000 7f3142a00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 0x7f312806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.983+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f31340abd40 con 0x7f314c0cfcb0 2024-09-10T08:29:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.984+0000 7f314aa00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 0x7f312806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.984+0000 7f314aa00640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 0x7f312806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f313c009af0 tx=0x7f313c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:23.987+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3134046360 con 0x7f314c0cfcb0 2024-09-10T08:29:24.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.207+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f314c0cdda0 con 0x7f314c0cfcb0 2024-09-10T08:29:24.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.791+0000 7f3142a00640 1 -- 172.21.15.52:0/3289644954 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f313407a560 con 0x7f314c0cfcb0 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.794+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 msgr2=0x7f312806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.794+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 0x7f312806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f313c009af0 tx=0x7f313c008040 comp rx=0 tx=0).stop 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.794+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 msgr2=0x7f314c0c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.794+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f313402a770 tx=0x7f31340046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.794+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 shutdown_connections 2024-09-10T08:29:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f312806be30 0x7f312806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f314c144340 0x7f314c0c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f314c0cfcb0 0x7f314c0c98d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 --2- 172.21.15.52:0/3289644954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f314c0cf8d0 0x7f314c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 >> 172.21.15.52:0/3289644954 conn(0x7f314c06d0f0 msgr2=0x7f314c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 shutdown_connections 2024-09-10T08:29:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.795+0000 7f3151800640 1 -- 172.21.15.52:0/3289644954 wait complete. 2024-09-10T08:29:24.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:29:24.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.974+0000 7f4c3a400640 1 Processor -- start 2024-09-10T08:29:24.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.974+0000 7f4c3a400640 1 -- start start 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c3a400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c3415c470 0x7f4c3415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 0x7f4c34072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c3a400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c34073910 con 0x7f4c34072e60 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c3a400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4c3415c850 con 0x7f4c3415c470 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c3a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c340732b0 con 0x7f4c340b4750 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c3415c470 0x7f4c3415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c3415c470 0x7f4c3415edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36372/0 (socket says 172.21.15.52:36372) 2024-09-10T08:29:24.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 -- 172.21.15.52:0/3205279268 learned_addr learned my addr 172.21.15.52:0/3205279268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:24.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c32a00640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 0x7f4c34072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 -- 172.21.15.52:0/3205279268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 msgr2=0x7f4c34072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:24.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 0x7f4c34072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 -- 172.21.15.52:0/3205279268 >> v1:172.21.15.176:6789/0 conn(0x7f4c34072e60 legacy=0x7f4c341623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:24.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c33400640 1 -- 172.21.15.52:0/3205279268 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c340b4de0 con 0x7f4c3415c470 2024-09-10T08:29:24.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.976+0000 7f4c32a00640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 0x7f4c34072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:24.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.977+0000 7f4c33400640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c3415c470 0x7f4c3415edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c2402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ade2a0973cfe46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c32000640 1 -- 172.21.15.52:0/3205279268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24037070 con 0x7f4c3415c470 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c32000640 1 -- 172.21.15.52:0/3205279268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c24032440 con 0x7f4c3415c470 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c32000640 1 -- 172.21.15.52:0/3205279268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24032810 con 0x7f4c3415c470 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 -- 172.21.15.52:0/3205279268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c3415c470 msgr2=0x7f4c3415edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c3415c470 0x7f4c3415edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c2402a200 comp rx=0 tx=0).stop 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 -- 172.21.15.52:0/3205279268 shutdown_connections 2024-09-10T08:29:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c340b4750 0x7f4c34072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3205279268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c3415c470 0x7f4c3415edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 -- 172.21.15.52:0/3205279268 >> 172.21.15.52:0/3205279268 conn(0x7f4c3406c030 msgr2=0x7f4c3406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:24.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 -- 172.21.15.52:0/3205279268 shutdown_connections 2024-09-10T08:29:24.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.978+0000 7f4c3a400640 1 -- 172.21.15.52:0/3205279268 wait complete. 2024-09-10T08:29:24.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.980+0000 7f4c3a400640 1 Processor -- start 2024-09-10T08:29:24.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.980+0000 7f4c3a400640 1 -- start start 2024-09-10T08:29:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 0x7f4c341497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 0x7f4c3406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c340b53a0 con 0x7f4c340b4750 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c340b4b90 con 0x7f4c34072e60 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c3a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c340b5680 con 0x7f4c3415c470 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c32a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c32a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36388/0 (socket says 172.21.15.52:36388) 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.981+0000 7f4c32a00640 1 -- 172.21.15.52:0/3196676134 learned_addr learned my addr 172.21.15.52:0/3196676134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c33400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 0x7f4c341497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c33e00640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 0x7f4c3406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 -- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 msgr2=0x7f4c3406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 0x7f4c3406ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 -- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 msgr2=0x7f4c341497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:24.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 0x7f4c341497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 -- 172.21.15.52:0/3196676134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c34149cf0 con 0x7f4c340b4750 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c33400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 0x7f4c341497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c33e00640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 0x7f4c3406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c32a00640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c7f0 tx=0x7f4c2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20015070 con 0x7f4c340b4750 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20007820 con 0x7f4c340b4750 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3414a200 con 0x7f4c340b4750 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20007bd0 con 0x7f4c340b4750 2024-09-10T08:29:24.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.982+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c340cdf00 con 0x7f4c340b4750 2024-09-10T08:29:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.984+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c34069400 con 0x7f4c340b4750 2024-09-10T08:29:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.984+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c20018070 con 0x7f4c340b4750 2024-09-10T08:29:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.985+0000 7f4c2b400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 0x7f4c1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:24.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.985+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f4c2008af30 con 0x7f4c340b4750 2024-09-10T08:29:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.986+0000 7f4c33400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 0x7f4c1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.987+0000 7f4c33400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 0x7f4c1406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c24034000 tx=0x7f4c2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:24.990+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c34149cf0 con 0x7f4c340b4750 2024-09-10T08:29:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.174+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4c3406e720 con 0x7f4c340b4750 2024-09-10T08:29:25.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.799+0000 7f4c2b400640 1 -- 172.21.15.52:0/3196676134 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f4c20059910 con 0x7f4c340b4750 2024-09-10T08:29:25.799 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:29:25.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 msgr2=0x7f4c1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:25.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 0x7f4c1406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c24034000 tx=0x7f4c2402e000 comp rx=0 tx=0).stop 2024-09-10T08:29:25.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 msgr2=0x7f4c3415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:25.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c7f0 tx=0x7f4c2000ccb0 comp rx=0 tx=0).stop 2024-09-10T08:29:25.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 shutdown_connections 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c1406be30 0x7f4c1406e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c3415c470 0x7f4c3406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c340b4750 0x7f4c3415b730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 --2- 172.21.15.52:0/3196676134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c34072e60 0x7f4c341497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.802+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 >> 172.21.15.52:0/3196676134 conn(0x7f4c3406c030 msgr2=0x7f4c3415d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.803+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 shutdown_connections 2024-09-10T08:29:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.803+0000 7f4c3a400640 1 -- 172.21.15.52:0/3196676134 wait complete. 2024-09-10T08:29:25.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:29:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.991+0000 7f09e3e00640 1 Processor -- start 2024-09-10T08:29:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.991+0000 7f09e3e00640 1 -- start start 2024-09-10T08:29:25.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09e4161c60 0x7f09e406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:25.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 0x7f09e40b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 0x7f09e40b8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f09e406e240 con 0x7f09e4161c60 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f09e4162040 con 0x7f09e40b7bf0 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.992+0000 7f09e3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f09e40d5040 con 0x7f09e406de00 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09e4161c60 0x7f09e406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:25.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09e4161c60 0x7f09e406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36404/0 (socket says 172.21.15.52:36404) 2024-09-10T08:29:25.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 -- 172.21.15.52:0/1429668277 learned_addr learned my addr 172.21.15.52:0/1429668277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:25.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e3400640 1 --2- 172.21.15.52:0/1429668277 >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 0x7f09e40b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:25.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09dbe00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 0x7f09e40b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:25.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 -- 172.21.15.52:0/1429668277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 msgr2=0x7f09e40b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:25.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 0x7f09e40b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 -- 172.21.15.52:0/1429668277 >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 msgr2=0x7f09e40b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1429668277 >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 0x7f09e40b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e2a00640 1 -- 172.21.15.52:0/1429668277 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e40d5320 con 0x7f09e4161c60 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09e3400640 1 --2- 172.21.15.52:0/1429668277 >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 0x7f09e40b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.993+0000 7f09dbe00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 0x7f09e40b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:26.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.994+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e4161c60 0x7f09e406d8c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f09e40b3f90 tx=0x7f09d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12219ba2709673e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.994+0000 7f09e2000640 1 -- 172.21.15.52:0/1429668277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4037070 con 0x7f09e4161c60 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.994+0000 7f09e2000640 1 -- 172.21.15.52:0/1429668277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4032440 con 0x7f09e4161c60 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.994+0000 7f09e2000640 1 -- 172.21.15.52:0/1429668277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4032810 con 0x7f09e4161c60 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 -- 172.21.15.52:0/1429668277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e4161c60 msgr2=0x7f09e406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e4161c60 0x7f09e406d8c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f09e40b3f90 tx=0x7f09d402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 -- 172.21.15.52:0/1429668277 shutdown_connections 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1429668277 >> v2:172.21.15.176:3300/0 conn(0x7f09e40b7bf0 0x7f09e40b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e406de00 0x7f09e40b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1429668277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e4161c60 0x7f09e406d8c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 -- 172.21.15.52:0/1429668277 >> 172.21.15.52:0/1429668277 conn(0x7f09e40d1630 msgr2=0x7f09e40d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 -- 172.21.15.52:0/1429668277 shutdown_connections 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.995+0000 7f09e3e00640 1 -- 172.21.15.52:0/1429668277 wait complete. 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.997+0000 7f09e3e00640 1 Processor -- start 2024-09-10T08:29:26.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.997+0000 7f09e3e00640 1 -- start start 2024-09-10T08:29:26.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 0x7f09e41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:26.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 0x7f09e40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f09e40d42c0 con 0x7f09e40b7bf0 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09e40cfc80 con 0x7f09e406de00 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f09e40b3920 con 0x7f09e4161c60 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36420/0 (socket says 172.21.15.52:36420) 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 -- 172.21.15.52:0/1209875906 learned_addr learned my addr 172.21.15.52:0/1209875906 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 0x7f09e41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 -- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 msgr2=0x7f09e40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3400640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 0x7f09e40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 0x7f09e40ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 -- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 msgr2=0x7f09e41574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:26.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 0x7f09e41574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09dbe00640 1 -- 172.21.15.52:0/1209875906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e4158400 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 0x7f09e41574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.998+0000 7f09e3400640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 0x7f09e40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09dbe00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c7c0 tx=0x7f09cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc015070 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc007a30 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc007e00 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e41586a0 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:25.999+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e4158c60 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.000+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e40d3640 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.001+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09cc018070 con 0x7f09e40b7bf0 2024-09-10T08:29:26.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.002+0000 7f09db400640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 0x7f09c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:26.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.002+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5386+0+0 (secure 0 0 0) 0x7f09cc08ab90 con 0x7f09e40b7bf0 2024-09-10T08:29:26.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.002+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 0x7f09c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:26.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.003+0000 7f09e2a00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 0x7f09c006e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09d4034000 tx=0x7f09d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:26.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.007+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09cc059710 con 0x7f09e40b7bf0 2024-09-10T08:29:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.190+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f09e40cba60 con 0x7f09e40b7bf0 2024-09-10T08:29:26.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.805+0000 7f09db400640 1 -- 172.21.15.52:0/1209875906 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f09cc059010 con 0x7f09e40b7bf0 2024-09-10T08:29:26.806 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 msgr2=0x7f09c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 0x7f09c006e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f09d4034000 tx=0x7f09d402e000 comp rx=0 tx=0).stop 2024-09-10T08:29:26.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 msgr2=0x7f09e40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c7c0 tx=0x7f09cc00cc80 comp rx=0 tx=0).stop 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 shutdown_connections 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c006be30 0x7f09c006e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e4161c60 0x7f09e40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e40b7bf0 0x7f09e40c9d80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 --2- 172.21.15.52:0/1209875906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e406de00 0x7f09e41574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 >> 172.21.15.52:0/1209875906 conn(0x7f09e40d1630 msgr2=0x7f09e40b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.809+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 shutdown_connections 2024-09-10T08:29:26.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:26.810+0000 7f09e3e00640 1 -- 172.21.15.52:0/1209875906 wait complete. 2024-09-10T08:29:26.829 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:29:26.829 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:29:26.829 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:29:26.829 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:29:26.830 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:29:26.830 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:29:26.830 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:29:26.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:29:26.830 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:29:26.830 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:29:26.830 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:29:26.831 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:29:26.831 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:29:26.831 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:29:26.831 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:29:26.831 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:29:26.845 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:29:26.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:29:26.846 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:29:26.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:29:26.850 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:29:26.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:29:26.851 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:29:26.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:29:26.890 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:29:26.890 DEBUG:teuthology.parallel:result is None 2024-09-10T08:29:26.892 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:29:26.893 DEBUG:teuthology.parallel:result is None 2024-09-10T08:29:26.896 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:29:26.896 DEBUG:teuthology.parallel:result is None 2024-09-10T08:29:26.898 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:29:26.899 DEBUG:teuthology.parallel:result is None 2024-09-10T08:29:26.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:29:27.024 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:29:27.024 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:29:27.030 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:29:27.030 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.064+0000 7f8563e00640 1 Processor -- start 2024-09-10T08:29:27.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.064+0000 7f8563e00640 1 -- start start 2024-09-10T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.065+0000 7f8563e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 0x7f855c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.065+0000 7f8563e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f855c0d23b0 0x7f855c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.065+0000 7f8563e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c0d0e70 con 0x7f855c0cf2d0 2024-09-10T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8563e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f855c0d41c0 con 0x7f855c0d23b0 2024-09-10T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8563e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f855c0d35b0 con 0x7f855c15ed20 2024-09-10T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f855c0d23b0 0x7f855c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:27.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8561400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 0x7f855c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f855c0d23b0 0x7f855c0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36470/0 (socket says 172.21.15.52:36470) 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 -- 172.21.15.52:0/2407576709 learned_addr learned my addr 172.21.15.52:0/2407576709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8561e00640 1 --1- 172.21.15.52:0/2407576709 >> v1:172.21.15.176:6789/0 conn(0x7f855c0cf2d0 0x7f855c0cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:49770/0 (socket says 172.21.15.52:49770) 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 -- 172.21.15.52:0/2407576709 >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 msgr2=0x7f855c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 --2- 172.21.15.52:0/2407576709 >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 0x7f855c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 -- 172.21.15.52:0/2407576709 >> v1:172.21.15.176:6789/0 conn(0x7f855c0cf2d0 legacy=0x7f855c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8560a00640 1 -- 172.21.15.52:0/2407576709 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c0d3890 con 0x7f855c0d23b0 2024-09-10T08:29:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.066+0000 7f8561400640 1 --2- 172.21.15.52:0/2407576709 >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 0x7f855c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:27.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.067+0000 7f8560a00640 1 --2- 172.21.15.52:0/2407576709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c0d23b0 0x7f855c0b67a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f855c0d47b0 tx=0x7f854802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886c73bb6e94be2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:27.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f855be00640 1 -- 172.21.15.52:0/2407576709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548037070 con 0x7f855c0d23b0 2024-09-10T08:29:27.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f855be00640 1 -- 172.21.15.52:0/2407576709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548032440 con 0x7f855c0d23b0 2024-09-10T08:29:27.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f855be00640 1 -- 172.21.15.52:0/2407576709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548032810 con 0x7f855c0d23b0 2024-09-10T08:29:27.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 -- 172.21.15.52:0/2407576709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c0d23b0 msgr2=0x7f855c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 --2- 172.21.15.52:0/2407576709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c0d23b0 0x7f855c0b67a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f855c0d47b0 tx=0x7f854802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 -- 172.21.15.52:0/2407576709 shutdown_connections 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 --2- 172.21.15.52:0/2407576709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c0d23b0 0x7f855c0b67a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 --2- 172.21.15.52:0/2407576709 >> v2:172.21.15.176:3300/0 conn(0x7f855c15ed20 0x7f855c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 -- 172.21.15.52:0/2407576709 >> 172.21.15.52:0/2407576709 conn(0x7f855c0d1260 msgr2=0x7f855c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 -- 172.21.15.52:0/2407576709 shutdown_connections 2024-09-10T08:29:27.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.068+0000 7f8563e00640 1 -- 172.21.15.52:0/2407576709 wait complete. 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.070+0000 7f8563e00640 1 Processor -- start 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.070+0000 7f8563e00640 1 -- start start 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 0x7f855c15d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855c0d23b0 0x7f855c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f855c0d32a0 con 0x7f855c15ed20 2024-09-10T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f855c0d3e50 con 0x7f855c0cf2d0 2024-09-10T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8563e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f855c15f100 con 0x7f855c0d23b0 2024-09-10T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8561e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8561e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36478/0 (socket says 172.21.15.52:36478) 2024-09-10T08:29:27.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.071+0000 7f8561e00640 1 -- 172.21.15.52:0/1243657015 learned_addr learned my addr 172.21.15.52:0/1243657015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 -- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855c0d23b0 msgr2=0x7f855c0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855c0d23b0 0x7f855c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 -- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 msgr2=0x7f855c15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561400640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 0x7f855c15d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:27.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 0x7f855c15d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 -- 172.21.15.52:0/1243657015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c0cb0c0 con 0x7f855c15ed20 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561400640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 0x7f855c15d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8561e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f855400c730 tx=0x7f855400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554018070 con 0x7f855c15ed20 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8554004d60 con 0x7f855c15ed20 2024-09-10T08:29:27.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c0cc350 con 0x7f855c15ed20 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.072+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855400a880 con 0x7f855c15ed20 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.073+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c0c9260 con 0x7f855c15ed20 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.074+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c0b7010 con 0x7f855c15ed20 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.075+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f855401b070 con 0x7f855c15ed20 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.075+0000 7f8559600640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 0x7f853c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.076+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f8554089ff0 con 0x7f855c15ed20 2024-09-10T08:29:27.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.076+0000 7f8561400640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 0x7f853c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:27.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.077+0000 7f8561400640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 0x7f853c06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f855c0b62a0 tx=0x7f8550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:27.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.080+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f855c0d0e70 con 0x7f855c15ed20 2024-09-10T08:29:27.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.274+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f855c0d0a90 con 0x7f855c15ed20 2024-09-10T08:29:27.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.819+0000 7f8559600640 1 -- 172.21.15.52:0/1243657015 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f8554058cf0 con 0x7f855c15ed20 2024-09-10T08:29:27.819 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:29:27.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 msgr2=0x7f853c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 0x7f853c06e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f855c0b62a0 tx=0x7f8550008040 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 msgr2=0x7f855c14dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f855400c730 tx=0x7f855400cb30 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 shutdown_connections 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853c06be30 0x7f853c06e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f855c15ed20 0x7f855c14dcf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855c0d23b0 0x7f855c0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 --2- 172.21.15.52:0/1243657015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855c0cf2d0 0x7f855c15d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 >> 172.21.15.52:0/1243657015 conn(0x7f855c0d1260 msgr2=0x7f855c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 shutdown_connections 2024-09-10T08:29:27.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:27.822+0000 7f8563e00640 1 -- 172.21.15.52:0/1243657015 wait complete. 2024-09-10T08:29:27.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:29:28.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.008+0000 7fdd6f600640 1 Processor -- start 2024-09-10T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.008+0000 7fdd6f600640 1 -- start start 2024-09-10T08:29:28.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd6815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6f600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd680b66a0 0x7fdd680b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6f600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6815f590 con 0x7fdd6815eb60 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6f600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdd680b7070 con 0x7fdd680b66a0 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6815f870 con 0x7fdd681624b0 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.009+0000 7fdd6d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd680b66a0 0x7fdd680b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd680b66a0 0x7fdd680b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36492/0 (socket says 172.21.15.52:36492) 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 -- 172.21.15.52:0/1211911940 learned_addr learned my addr 172.21.15.52:0/1211911940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:28.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd67e00640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd6815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 -- 172.21.15.52:0/1211911940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 msgr2=0x7fdd6815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd6815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 -- 172.21.15.52:0/1211911940 >> v1:172.21.15.176:6789/0 conn(0x7fdd6815eb60 legacy=0x7fdd680d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.010+0000 7fdd6d600640 1 -- 172.21.15.52:0/1211911940 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6815fb50 con 0x7fdd680b66a0 2024-09-10T08:29:28.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.011+0000 7fdd6d600640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680b6b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009e50 tx=0x7fdd6002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e0ac785f36f242 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.011+0000 7fdd67400640 1 -- 172.21.15.52:0/1211911940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60036070 con 0x7fdd680b66a0 2024-09-10T08:29:28.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.011+0000 7fdd67400640 1 -- 172.21.15.52:0/1211911940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd60031600 con 0x7fdd680b66a0 2024-09-10T08:29:28.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.011+0000 7fdd67400640 1 -- 172.21.15.52:0/1211911940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd600319d0 con 0x7fdd680b66a0 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 -- 172.21.15.52:0/1211911940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 msgr2=0x7fdd680b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680b6b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009e50 tx=0x7fdd6002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 -- 172.21.15.52:0/1211911940 shutdown_connections 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680b6b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 --2- 172.21.15.52:0/1211911940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd6815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 -- 172.21.15.52:0/1211911940 >> 172.21.15.52:0/1211911940 conn(0x7fdd680d16f0 msgr2=0x7fdd680d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 -- 172.21.15.52:0/1211911940 shutdown_connections 2024-09-10T08:29:28.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.012+0000 7fdd6f600640 1 -- 172.21.15.52:0/1211911940 wait complete. 2024-09-10T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.014+0000 7fdd6f600640 1 Processor -- start 2024-09-10T08:29:28.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.014+0000 7fdd6f600640 1 -- start start 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815eb60 0x7fdd680cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd680b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680d4480 con 0x7fdd680b66a0 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd680cef40 con 0x7fdd6815eb60 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd680d4600 con 0x7fdd681624b0 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36502/0 (socket says 172.21.15.52:36502) 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 -- 172.21.15.52:0/4150978961 learned_addr learned my addr 172.21.15.52:0/4150978961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6d600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd680b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd67e00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815eb60 0x7fdd680cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 -- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 msgr2=0x7fdd680b8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd680b8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 -- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815eb60 msgr2=0x7fdd680cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815eb60 0x7fdd680cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.015+0000 7fdd6cc00640 1 -- 172.21.15.52:0/4150978961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd680ca5d0 con 0x7fdd680b66a0 2024-09-10T08:29:28.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd6cc00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00c3c0 tx=0x7fdd5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0052d0 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c005490 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd680ca8b0 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c007260 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.016+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd680ce500 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.017+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd680b6b30 con 0x7fdd680b66a0 2024-09-10T08:29:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.018+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd5c007400 con 0x7fdd680b66a0 2024-09-10T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.019+0000 7fdd64c00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 0x7fdd4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.019+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fdd5c089fe0 con 0x7fdd680b66a0 2024-09-10T08:29:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.020+0000 7fdd67e00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 0x7fdd4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.020+0000 7fdd67e00640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 0x7fdd4806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd681610f0 tx=0x7fdd54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.023+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5c0585f0 con 0x7fdd680b66a0 2024-09-10T08:29:28.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.274+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdd680d2520 con 0x7fdd680b66a0 2024-09-10T08:29:28.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.275+0000 7fdd64c00640 1 -- 172.21.15.52:0/4150978961 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fdd5c05c8f0 con 0x7fdd680b66a0 2024-09-10T08:29:28.276 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:28.276 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:29:28.276 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:29:28.276 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.276 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:29:28.277 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:29:28.278 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.279 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.279 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:29:28.279 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:29:28.279 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.279 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.280 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.281 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:29:28.281 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:29:28.281 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.281 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.282 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.283 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:29:28.284 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:29:28.284 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.284 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.284 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.284 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:29:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.286 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.286 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.286 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.286 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.286 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.287 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.288 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.288 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.288 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.288 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.289 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.290 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.291 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.291 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.291 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.291 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:29:28.291 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.293 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.293 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:29:28.293 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:29:28.293 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.293 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.294 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.295 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:29:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:29:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.297 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.297 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:29:28.297 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:29:28.297 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:29:28.297 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.298 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.298 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.298 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:29:28.298 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:29:28.298 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.299 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.300 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.300 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:29:28.300 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:29:28.300 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.300 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.301 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:29:28.302 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:29:28.303 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.304 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.305 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.305 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.305 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mds", 2024-09-10T08:29:28.305 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+Bm7KSVIRAAHqsjUU0m/U0+No8MHW251Q==", 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.306 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+Bmh6+VIRAAXtZMM3PHBv33uhxqz4tgxg==", 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.307 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-osd", 2024-09-10T08:29:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+BmIbiVIRAAJpypEgJrDl8qUh4Q61dTrA==", 2024-09-10T08:29:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T08:29:28.308 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.309 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.309 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.309 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T08:29:28.309 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+Bmc8CVIRAAbVEztYcvpb3vDBVDerpg8w==", 2024-09-10T08:29:28.309 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T08:29:28.310 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+Bm3siVIRAA5gACC7nd9Lrgm76BmMTSsg==", 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.311 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAkA+BmpNGVIRAA0RauP0ZXHcix0DN2BB9Vxg==", 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.312 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.313 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:29:28.313 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:29:28.313 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.313 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:29:28.313 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:29:28.314 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:28.315 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:29:28.316 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:29:28.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 msgr2=0x7fdd4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 0x7fdd4806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd681610f0 tx=0x7fdd54009190 comp rx=0 tx=0).stop 2024-09-10T08:29:28.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 msgr2=0x7fdd680cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00c3c0 tx=0x7fdd5c00c880 comp rx=0 tx=0).stop 2024-09-10T08:29:28.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 shutdown_connections 2024-09-10T08:29:28.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd4806be30 0x7fdd4806e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd681624b0 0x7fdd680b8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd6815eb60 0x7fdd680cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 --2- 172.21.15.52:0/4150978961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd680b66a0 0x7fdd680cd8b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 >> 172.21.15.52:0/4150978961 conn(0x7fdd680d16f0 msgr2=0x7fdd6806e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 shutdown_connections 2024-09-10T08:29:28.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.277+0000 7fdd6f600640 1 -- 172.21.15.52:0/4150978961 wait complete. 2024-09-10T08:29:28.321 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T08:29:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.480+0000 7f08ad000640 1 Processor -- start 2024-09-10T08:29:28.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.480+0000 7f08ad000640 1 -- start start 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08ad000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08a80b6710 0x7f08a80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08ad000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a80cf450 0x7f08a80b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08ad000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a80d3990 con 0x7f08a815e440 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08ad000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f08a80d3c70 con 0x7f08a80b6710 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08ad000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08a80d3f50 con 0x7f08a80cf450 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08a6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08a80b6710 0x7f08a80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08a6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08a80b6710 0x7f08a80d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36518/0 (socket says 172.21.15.52:36518) 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08a6a00640 1 -- 172.21.15.52:0/3540636216 learned_addr learned my addr 172.21.15.52:0/3540636216 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.481+0000 7f08a7e00640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a80cf450 0x7f08a80b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.482+0000 7f08a6a00640 1 -- 172.21.15.52:0/3540636216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a80cf450 msgr2=0x7f08a80b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.482+0000 7f08a6a00640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a80cf450 0x7f08a80b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.482+0000 7f08a6a00640 1 -- 172.21.15.52:0/3540636216 >> v1:172.21.15.176:6789/0 conn(0x7f08a815e440 legacy=0x7f08a80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.482+0000 7f08a6a00640 1 -- 172.21.15.52:0/3540636216 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a80d4230 con 0x7f08a80b6710 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08a6a00640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80b6710 0x7f08a80d3240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0894009870 tx=0x7f089402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96da0cd12fd23d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08a6000640 1 -- 172.21.15.52:0/3540636216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894037070 con 0x7f08a80b6710 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08a6000640 1 -- 172.21.15.52:0/3540636216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089402ae50 con 0x7f08a80b6710 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08a6000640 1 -- 172.21.15.52:0/3540636216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894032860 con 0x7f08a80b6710 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08ad000640 1 -- 172.21.15.52:0/3540636216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80b6710 msgr2=0x7f08a80d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.483+0000 7f08ad000640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80b6710 0x7f08a80d3240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0894009870 tx=0x7f089402a300 comp rx=0 tx=0).stop 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 -- 172.21.15.52:0/3540636216 shutdown_connections 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a80cf450 0x7f08a80b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 --2- 172.21.15.52:0/3540636216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80b6710 0x7f08a80d3240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 -- 172.21.15.52:0/3540636216 >> 172.21.15.52:0/3540636216 conn(0x7f08a8067f80 msgr2=0x7f08a80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:28.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 -- 172.21.15.52:0/3540636216 shutdown_connections 2024-09-10T08:29:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.484+0000 7f08ad000640 1 -- 172.21.15.52:0/3540636216 wait complete. 2024-09-10T08:29:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.485+0000 7f08ad000640 1 Processor -- start 2024-09-10T08:29:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.485+0000 7f08ad000640 1 -- start start 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08a80b6710 0x7f08a80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a815e440 0x7f08a80aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08a80b76c0 con 0x7f08a80cf450 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08a80b7540 con 0x7f08a80b6710 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08ad000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08a80b80a0 con 0x7f08a815e440 2024-09-10T08:29:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.486+0000 7f08a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36534/0 (socket says 172.21.15.52:36534) 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 -- 172.21.15.52:0/927720301 learned_addr learned my addr 172.21.15.52:0/927720301 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a7400640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08a80b6710 0x7f08a80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a7e00640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a815e440 0x7f08a80aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 -- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a815e440 msgr2=0x7f08a80aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a815e440 0x7f08a80aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 -- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08a80b6710 msgr2=0x7f08a80cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08a80b6710 0x7f08a80cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 -- 172.21.15.52:0/927720301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a80ceb20 con 0x7f08a80cf450 2024-09-10T08:29:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.487+0000 7f08a6a00640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0894000c00 tx=0x7f08940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.488+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894041070 con 0x7f08a80cf450 2024-09-10T08:29:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.488+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089403c660 con 0x7f08a80cf450 2024-09-10T08:29:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.488+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894037040 con 0x7f08a80cf450 2024-09-10T08:29:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.488+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a80cd2c0 con 0x7f08a80cf450 2024-09-10T08:29:28.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.488+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a80ce7d0 con 0x7f08a80cf450 2024-09-10T08:29:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.489+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a80b7b60 con 0x7f08a80cf450 2024-09-10T08:29:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.490+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0894044070 con 0x7f08a80cf450 2024-09-10T08:29:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.490+0000 7f089f400640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.491+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f08940ab320 con 0x7f08a80cf450 2024-09-10T08:29:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.491+0000 7f08a7400640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.492+0000 7f08a7400640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0898000f60 tx=0x7f0898009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.495+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08940798a0 con 0x7f08a80cf450 2024-09-10T08:29:28.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.746+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f08a80d1eb0 con 0x7f08a80cf450 2024-09-10T08:29:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.748+0000 7f089f400640 1 -- 172.21.15.52:0/927720301 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f089407dba0 con 0x7f08a80cf450 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 msgr2=0x7f088806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 0x7f088806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0898000f60 tx=0x7f0898009040 comp rx=0 tx=0).stop 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 msgr2=0x7f08a815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0894000c00 tx=0x7f08940046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 shutdown_connections 2024-09-10T08:29:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f088806be30 0x7f088806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08a815e440 0x7f08a80aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08a80cf450 0x7f08a815b410 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 --2- 172.21.15.52:0/927720301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08a80b6710 0x7f08a80cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 >> 172.21.15.52:0/927720301 conn(0x7f08a8067f80 msgr2=0x7f08a80d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 shutdown_connections 2024-09-10T08:29:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.751+0000 7f08ad000640 1 -- 172.21.15.52:0/927720301 wait complete. 2024-09-10T08:29:28.767 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T08:29:28.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.925+0000 7f4823000640 1 Processor -- start 2024-09-10T08:29:28.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.925+0000 7f4823000640 1 -- start start 2024-09-10T08:29:28.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4823000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4823000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f481c0cf450 0x7f481c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4823000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481c0d3990 con 0x7f481c15e440 2024-09-10T08:29:28.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4823000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f481c0d3c70 con 0x7f481c0cf450 2024-09-10T08:29:28.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4823000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f481c0d3f50 con 0x7f481c0b6710 2024-09-10T08:29:28.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4821c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f481c15e440 0x7f481c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50694/0 (socket says 172.21.15.52:50694) 2024-09-10T08:29:28.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4821c00640 1 -- 172.21.15.52:0/2360839192 learned_addr learned my addr 172.21.15.52:0/2360839192 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:28.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4822600640 1 --2- 172.21.15.52:0/2360839192 >> v2:172.21.15.176:3300/0 conn(0x7f481c0cf450 0x7f481c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.926+0000 7f4821200640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f481be00640 1 -- 172.21.15.52:0/2360839192 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472788373 0 0) 0x7f481c0d3990 con 0x7f481c15e440 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f481be00640 1 -- 172.21.15.52:0/2360839192 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4804003520 con 0x7f481c15e440 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f4822600640 1 -- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 msgr2=0x7f481c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f4822600640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f4822600640 1 -- 172.21.15.52:0/2360839192 >> v1:172.21.15.52:6789/0 conn(0x7f481c15e440 legacy=0x7f481c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f4822600640 1 -- 172.21.15.52:0/2360839192 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c0d4230 con 0x7f481c0cf450 2024-09-10T08:29:28.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.927+0000 7f4821200640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:28.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.928+0000 7f4822600640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c0cf450 0x7f481c0b7b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4814009d90 tx=0x7f481402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449cacc281b2c4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.929+0000 7f481be00640 1 -- 172.21.15.52:0/2360839192 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814007740 con 0x7f481c0cf450 2024-09-10T08:29:28.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.929+0000 7f481be00640 1 -- 172.21.15.52:0/2360839192 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48140078e0 con 0x7f481c0cf450 2024-09-10T08:29:28.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.929+0000 7f481be00640 1 -- 172.21.15.52:0/2360839192 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814007cb0 con 0x7f481c0cf450 2024-09-10T08:29:28.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 -- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c0cf450 msgr2=0x7f481c0b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c0cf450 0x7f481c0b7b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4814009d90 tx=0x7f481402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 -- 172.21.15.52:0/2360839192 shutdown_connections 2024-09-10T08:29:28.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c0cf450 0x7f481c0b7b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 --2- 172.21.15.52:0/2360839192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 -- 172.21.15.52:0/2360839192 >> 172.21.15.52:0/2360839192 conn(0x7f481c067f80 msgr2=0x7f481c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:28.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 -- 172.21.15.52:0/2360839192 shutdown_connections 2024-09-10T08:29:28.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.930+0000 7f4823000640 1 -- 172.21.15.52:0/2360839192 wait complete. 2024-09-10T08:29:28.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.932+0000 7f4823000640 1 Processor -- start 2024-09-10T08:29:28.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.932+0000 7f4823000640 1 -- start start 2024-09-10T08:29:28.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c15e440 0x7f481c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f481c0b76c0 con 0x7f481c0cf450 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f481c0b7540 con 0x7f481c15e440 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4823000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f481c0b80a0 con 0x7f481c0b6710 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36540/0 (socket says 172.21.15.52:36540) 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 -- 172.21.15.52:0/2217458664 learned_addr learned my addr 172.21.15.52:0/2217458664 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821c00640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4822600640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c15e440 0x7f481c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 -- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 msgr2=0x7f481c14ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c14ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 -- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c15e440 msgr2=0x7f481c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c15e440 0x7f481c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.933+0000 7f4821200640 1 -- 172.21.15.52:0/2217458664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c1502d0 con 0x7f481c0cf450 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4821200640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f480800ebe0 tx=0x7f480800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808017070 con 0x7f481c0cf450 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480800cc30 con 0x7f481c0cf450 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c1505b0 con 0x7f481c0cf450 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808013470 con 0x7f481c0cf450 2024-09-10T08:29:28.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.934+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c150b70 con 0x7f481c0cf450 2024-09-10T08:29:28.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.935+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481c0b7b60 con 0x7f481c0cf450 2024-09-10T08:29:28.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.936+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f480801a070 con 0x7f481c0cf450 2024-09-10T08:29:28.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.937+0000 7f4819600640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:28.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.937+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f480808aed0 con 0x7f481c0cf450 2024-09-10T08:29:28.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.937+0000 7f4821c00640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:28.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.938+0000 7f4821c00640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 0x7f47fc06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4810007fd0 tx=0x7f4810009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:28.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:28.941+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4808059b30 con 0x7f481c0cf450 2024-09-10T08:29:29.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.199+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f481c0ba210 con 0x7f481c0cf450 2024-09-10T08:29:29.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.202+0000 7f4819600640 1 -- 172.21.15.52:0/2217458664 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4808059430 con 0x7f481c0cf450 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 msgr2=0x7f47fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 0x7f47fc06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4810007fd0 tx=0x7f4810009040 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 msgr2=0x7f481c0c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f480800ebe0 tx=0x7f480800c520 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 shutdown_connections 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47fc06be30 0x7f47fc06e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f481c15e440 0x7f481c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f481c0cf450 0x7f481c0c8530 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 --2- 172.21.15.52:0/2217458664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f481c0b6710 0x7f481c14ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.204+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 >> 172.21.15.52:0/2217458664 conn(0x7f481c067f80 msgr2=0x7f481c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.205+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 shutdown_connections 2024-09-10T08:29:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.205+0000 7f4823000640 1 -- 172.21.15.52:0/2217458664 wait complete. 2024-09-10T08:29:29.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T08:29:29.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.377+0000 7ff7c8e00640 1 Processor -- start 2024-09-10T08:29:29.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.378+0000 7ff7c8e00640 1 -- start start 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7c8e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff7c4071680 0x7ff7c4169750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7c8e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c4071b30 con 0x7ff7c4148260 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7c8e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c40b3510 con 0x7ff7c4147e80 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7c8e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c4074200 con 0x7ff7c4071680 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7bbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff7c4148260 0x7ff7c406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50704/0 (socket says 172.21.15.52:50704) 2024-09-10T08:29:29.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7bbe00640 1 -- 172.21.15.52:0/1834289740 learned_addr learned my addr 172.21.15.52:0/1834289740 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.379+0000 7ff7c2800640 1 --2- 172.21.15.52:0/1834289740 >> v2:172.21.15.52:3300/0 conn(0x7ff7c4071680 0x7ff7c4169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.380+0000 7ff7c2800640 1 -- 172.21.15.52:0/1834289740 >> v1:172.21.15.176:6789/0 conn(0x7ff7c4147e80 legacy=0x7ff7c4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.380+0000 7ff7c1400640 1 -- 172.21.15.52:0/1834289740 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181205890 0 0) 0x7ff7c4071b30 con 0x7ff7c4148260 2024-09-10T08:29:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.380+0000 7ff7c2800640 1 -- 172.21.15.52:0/1834289740 >> v1:172.21.15.52:6789/0 conn(0x7ff7c4148260 legacy=0x7ff7c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.380+0000 7ff7c2800640 1 -- 172.21.15.52:0/1834289740 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c40b37f0 con 0x7ff7c4071680 2024-09-10T08:29:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c2800640 1 --2- 172.21.15.52:0/1834289740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4071680 0x7ff7c4169750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b52f78bbadc0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c1400640 1 -- 172.21.15.52:0/1834289740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc007740 con 0x7ff7c4071680 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c1400640 1 -- 172.21.15.52:0/1834289740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0078e0 con 0x7ff7c4071680 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c1400640 1 -- 172.21.15.52:0/1834289740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc007cb0 con 0x7ff7c4071680 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 -- 172.21.15.52:0/1834289740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4071680 msgr2=0x7ff7c4169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/1834289740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4071680 0x7ff7c4169750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009d90 tx=0x7ff7bc02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 -- 172.21.15.52:0/1834289740 shutdown_connections 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/1834289740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4071680 0x7ff7c4169750 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 -- 172.21.15.52:0/1834289740 >> 172.21.15.52:0/1834289740 conn(0x7ff7c40ccec0 msgr2=0x7ff7c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 -- 172.21.15.52:0/1834289740 shutdown_connections 2024-09-10T08:29:29.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.381+0000 7ff7c8e00640 1 -- 172.21.15.52:0/1834289740 wait complete. 2024-09-10T08:29:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.383+0000 7ff7c8e00640 1 Processor -- start 2024-09-10T08:29:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.383+0000 7ff7c8e00640 1 -- start start 2024-09-10T08:29:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c4071680 0x7ff7c4145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c4148260 0x7ff7c41f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c406c320 con 0x7ff7c4147e80 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c40b3e40 con 0x7ff7c4148260 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c8e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c406c4a0 con 0x7ff7c4071680 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7bbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7bbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36558/0 (socket says 172.21.15.52:36558) 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7bbe00640 1 -- 172.21.15.52:0/3131271238 learned_addr learned my addr 172.21.15.52:0/3131271238 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c1e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c4071680 0x7ff7c4145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.384+0000 7ff7c2800640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c4148260 0x7ff7c41f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 -- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c4071680 msgr2=0x7ff7c4145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c4071680 0x7ff7c4145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 -- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c4148260 msgr2=0x7ff7c41f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c4148260 0x7ff7c41f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 -- 172.21.15.52:0/3131271238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41f8b20 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7bbe00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c3f0 tx=0x7ff7ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0074e0 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0047e0 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.385+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac004c10 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.386+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c41f8840 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.386+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c40ae0b0 con 0x7ff7c4147e80 2024-09-10T08:29:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.387+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c4070f70 con 0x7ff7c4147e80 2024-09-10T08:29:29.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.388+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7ac011070 con 0x7ff7c4147e80 2024-09-10T08:29:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.389+0000 7ff7ba000640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 0x7ff7a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.389+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff7ac08a5c0 con 0x7ff7c4147e80 2024-09-10T08:29:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.390+0000 7ff7c1e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 0x7ff7a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.390+0000 7ff7c1e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 0x7ff7a006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000f60 tx=0x7ff7b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.393+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7ac058c60 con 0x7ff7c4147e80 2024-09-10T08:29:29.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.646+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff7c41455c0 con 0x7ff7c4147e80 2024-09-10T08:29:29.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.648+0000 7ff7ba000640 1 -- 172.21.15.52:0/3131271238 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7ff7ac05cf60 con 0x7ff7c4147e80 2024-09-10T08:29:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.650+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 msgr2=0x7ff7a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 0x7ff7a006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4000f60 tx=0x7ff7b4009040 comp rx=0 tx=0).stop 2024-09-10T08:29:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 msgr2=0x7ff7c40ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00c3f0 tx=0x7ff7ac00c8b0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 shutdown_connections 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff7a006be30 0x7ff7a006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7c4148260 0x7ff7c41f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7c4147e80 0x7ff7c40ae890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 --2- 172.21.15.52:0/3131271238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7c4071680 0x7ff7c4145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 >> 172.21.15.52:0/3131271238 conn(0x7ff7c40ccec0 msgr2=0x7ff7c40cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 shutdown_connections 2024-09-10T08:29:29.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.651+0000 7ff7c8e00640 1 -- 172.21.15.52:0/3131271238 wait complete. 2024-09-10T08:29:29.667 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T08:29:29.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.823+0000 7f4bdb600640 1 Processor -- start 2024-09-10T08:29:29.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.823+0000 7f4bdb600640 1 -- start start 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 0x7f4bd406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd413eb20 0x7f4bd406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd415bcf0 0x7f4bd415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd4071ab0 con 0x7f4bd413eb20 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd4071180 con 0x7f4bd40b2d40 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bdb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd4071460 con 0x7f4bd415bcf0 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bd3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd413eb20 0x7f4bd406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bd3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bd413eb20 0x7f4bd406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36570/0 (socket says 172.21.15.52:36570) 2024-09-10T08:29:29.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bd3e00640 1 -- 172.21.15.52:0/3755779999 learned_addr learned my addr 172.21.15.52:0/3755779999 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bd8c00640 1 --2- 172.21.15.52:0/3755779999 >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 0x7f4bd406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.825+0000 7f4bd9600640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd415bcf0 0x7f4bd415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd3e00640 1 -- 172.21.15.52:0/3755779999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd415bcf0 msgr2=0x7f4bd415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd3e00640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd415bcf0 0x7f4bd415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd3e00640 1 -- 172.21.15.52:0/3755779999 >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 msgr2=0x7f4bd406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd3e00640 1 --2- 172.21.15.52:0/3755779999 >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 0x7f4bd406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd3e00640 1 -- 172.21.15.52:0/3755779999 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4071740 con 0x7f4bd413eb20 2024-09-10T08:29:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.826+0000 7f4bd8c00640 1 --2- 172.21.15.52:0/3755779999 >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 0x7f4bd406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.827+0000 7f4bd3e00640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd413eb20 0x7f4bd406c150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4069be0 tx=0x7f4bc002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a182595c6640d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.827+0000 7f4bd3400640 1 -- 172.21.15.52:0/3755779999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0032790 con 0x7f4bd413eb20 2024-09-10T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.827+0000 7f4bd3400640 1 -- 172.21.15.52:0/3755779999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc0038070 con 0x7f4bd413eb20 2024-09-10T08:29:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.827+0000 7f4bd3400640 1 -- 172.21.15.52:0/3755779999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0032b50 con 0x7f4bd413eb20 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 -- 172.21.15.52:0/3755779999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd413eb20 msgr2=0x7f4bd406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd413eb20 0x7f4bd406c150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4069be0 tx=0x7f4bc002c890 comp rx=0 tx=0).stop 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 -- 172.21.15.52:0/3755779999 shutdown_connections 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd415bcf0 0x7f4bd415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 --2- 172.21.15.52:0/3755779999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd413eb20 0x7f4bd406c150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 --2- 172.21.15.52:0/3755779999 >> v2:172.21.15.176:3300/0 conn(0x7f4bd40b2d40 0x7f4bd406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 -- 172.21.15.52:0/3755779999 >> 172.21.15.52:0/3755779999 conn(0x7f4bd40ccec0 msgr2=0x7f4bd40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 -- 172.21.15.52:0/3755779999 shutdown_connections 2024-09-10T08:29:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.828+0000 7f4bdb600640 1 -- 172.21.15.52:0/3755779999 wait complete. 2024-09-10T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.830+0000 7f4bdb600640 1 Processor -- start 2024-09-10T08:29:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.830+0000 7f4bdb600640 1 -- start start 2024-09-10T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd413eb20 0x7f4bd40b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 0x7f4bd40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd415f140 con 0x7f4bd415bcf0 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd415efc0 con 0x7f4bd40b2d40 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bdb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd415f2c0 con 0x7f4bd413eb20 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bd8c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bd9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 0x7f4bd40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bd8c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:35776/0 (socket says 172.21.15.52:35776) 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bd8c00640 1 -- 172.21.15.52:0/463073250 learned_addr learned my addr 172.21.15.52:0/463073250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.831+0000 7f4bd3e00640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd413eb20 0x7f4bd40b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 -- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd413eb20 msgr2=0x7f4bd40b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd413eb20 0x7f4bd40b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 -- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 msgr2=0x7f4bd41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 -- 172.21.15.52:0/463073250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd40b6340 con 0x7f4bd415bcf0 2024-09-10T08:29:29.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd8c00640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd9600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 0x7f4bd40cf000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc007d20 tx=0x7f4bcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00edd0 con 0x7f4bd415bcf0 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc003990 con 0x7f4bd415bcf0 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc003d80 con 0x7f4bd415bcf0 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd4155e60 con 0x7f4bd415bcf0 2024-09-10T08:29:29.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.832+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd4156420 con 0x7f4bd415bcf0 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.834+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd415c1a0 con 0x7f4bd415bcf0 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.834+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bcc01b020 con 0x7f4bd415bcf0 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.835+0000 7f4bd0c00640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 0x7f4bb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.835+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f4bcc08ac60 con 0x7f4bd415bcf0 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.836+0000 7f4bd8c00640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 0x7f4bb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.836+0000 7f4bd8c00640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 0x7f4bb406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8006fd0 tx=0x7f4bc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:29.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:29.839+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bcc059270 con 0x7f4bd415bcf0 2024-09-10T08:29:30.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.091+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f4bd406c9c0 con 0x7f4bd415bcf0 2024-09-10T08:29:30.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.094+0000 7f4bd0c00640 1 -- 172.21.15.52:0/463073250 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f4bcc05d570 con 0x7f4bd415bcf0 2024-09-10T08:29:30.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 msgr2=0x7f4bb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 0x7f4bb406e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8006fd0 tx=0x7f4bc8008040 comp rx=0 tx=0).stop 2024-09-10T08:29:30.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 msgr2=0x7f4bd40cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 0x7f4bd40cf000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc007d20 tx=0x7f4bcc00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 shutdown_connections 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4bb406be30 0x7f4bb406e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bd415bcf0 0x7f4bd40cf000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bd413eb20 0x7f4bd40b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 --2- 172.21.15.52:0/463073250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bd40b2d40 0x7f4bd41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 >> 172.21.15.52:0/463073250 conn(0x7f4bd40ccec0 msgr2=0x7f4bd413e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 shutdown_connections 2024-09-10T08:29:30.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.096+0000 7f4bdb600640 1 -- 172.21.15.52:0/463073250 wait complete. 2024-09-10T08:29:30.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T08:29:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.270+0000 7fbcb3200640 1 Processor -- start 2024-09-10T08:29:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.270+0000 7fbcb3200640 1 -- start start 2024-09-10T08:29:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.271+0000 7fbcb3200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcb40b6710 0x7fbcb40d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.271+0000 7fbcb3200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb40d3990 con 0x7fbcb415e440 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.271+0000 7fbcb3200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb40d3c70 con 0x7fbcb40cf450 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.271+0000 7fbcb3200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb40d3f50 con 0x7fbcb40b6710 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbcb415e440 0x7fbcb40b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50708/0 (socket says 172.21.15.52:50708) 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1e00640 1 -- 172.21.15.52:0/3691940250 learned_addr learned my addr 172.21.15.52:0/3691940250 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1400640 1 --2- 172.21.15.52:0/3691940250 >> v2:172.21.15.52:3300/0 conn(0x7fbcb40b6710 0x7fbcb40d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb0a00640 1 -- 172.21.15.52:0/3691940250 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228110762 0 0) 0x7fbcb40d3990 con 0x7fbcb415e440 2024-09-10T08:29:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb0a00640 1 -- 172.21.15.52:0/3691940250 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc98003520 con 0x7fbcb415e440 2024-09-10T08:29:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1400640 1 -- 172.21.15.52:0/3691940250 >> v1:172.21.15.176:6789/0 conn(0x7fbcb40cf450 legacy=0x7fbcb40b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1400640 1 -- 172.21.15.52:0/3691940250 >> v1:172.21.15.52:6789/0 conn(0x7fbcb415e440 legacy=0x7fbcb40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.272+0000 7fbcb1400640 1 -- 172.21.15.52:0/3691940250 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb40d4230 con 0x7fbcb40b6710 2024-09-10T08:29:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.273+0000 7fbcb1400640 1 --2- 172.21.15.52:0/3691940250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6710 0x7fbcb40d3240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097a0 tx=0x7fbca002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b665eb5060e2ff0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.273+0000 7fbcb0a00640 1 -- 172.21.15.52:0/3691940250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0037070 con 0x7fbcb40b6710 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb0a00640 1 -- 172.21.15.52:0/3691940250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca0032640 con 0x7fbcb40b6710 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb0a00640 1 -- 172.21.15.52:0/3691940250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca00329f0 con 0x7fbcb40b6710 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 -- 172.21.15.52:0/3691940250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6710 msgr2=0x7fbcb40d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3691940250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6710 0x7fbcb40d3240 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097a0 tx=0x7fbca002a2c0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 -- 172.21.15.52:0/3691940250 shutdown_connections 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3691940250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6710 0x7fbcb40d3240 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 -- 172.21.15.52:0/3691940250 >> 172.21.15.52:0/3691940250 conn(0x7fbcb4067f80 msgr2=0x7fbcb40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 -- 172.21.15.52:0/3691940250 shutdown_connections 2024-09-10T08:29:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.274+0000 7fbcb3200640 1 -- 172.21.15.52:0/3691940250 wait complete. 2024-09-10T08:29:30.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.276+0000 7fbcb3200640 1 Processor -- start 2024-09-10T08:29:30.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.276+0000 7fbcb3200640 1 -- start start 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb40b6710 0x7fbcb4158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 0x7fbcb40ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40b76c0 con 0x7fbcb415e440 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40b7540 con 0x7fbcb40cf450 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb40b8270 con 0x7fbcb40b6710 2024-09-10T08:29:30.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36598/0 (socket says 172.21.15.52:36598) 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 -- 172.21.15.52:0/3848251378 learned_addr learned my addr 172.21.15.52:0/3848251378 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb1e00640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb40b6710 0x7fbcb4158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb1400640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 0x7fbcb40ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 -- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb40b6710 msgr2=0x7fbcb4158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb40b6710 0x7fbcb4158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 -- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 msgr2=0x7fbcb40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 0x7fbcb40ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb2800640 1 -- 172.21.15.52:0/3848251378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb4158730 con 0x7fbcb415e440 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.277+0000 7fbcb1400640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 0x7fbcb40ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcb2800640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c7d0 tx=0x7fbcac00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac003b70 con 0x7fbcb415e440 2024-09-10T08:29:30.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac003d30 con 0x7fbcb415e440 2024-09-10T08:29:30.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00aa90 con 0x7fbcb415e440 2024-09-10T08:29:30.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb40ac4b0 con 0x7fbcb415e440 2024-09-10T08:29:30.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.278+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb40abef0 con 0x7fbcb415e440 2024-09-10T08:29:30.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.279+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb415a400 con 0x7fbcb415e440 2024-09-10T08:29:30.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.280+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcac00ac30 con 0x7fbcb415e440 2024-09-10T08:29:30.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.281+0000 7fbcaa000640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 0x7fbc9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.281+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fbcac08aad0 con 0x7fbcb415e440 2024-09-10T08:29:30.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.281+0000 7fbcb1e00640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 0x7fbc9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.282+0000 7fbcb1e00640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 0x7fbc9406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbca40011e0 tx=0x7fbca4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.285+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcb415a400 con 0x7fbcb415e440 2024-09-10T08:29:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.543+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbcb40ab950 con 0x7fbcb415e440 2024-09-10T08:29:30.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.546+0000 7fbcaa000640 1 -- 172.21.15.52:0/3848251378 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fbcac0597c0 con 0x7fbcb415e440 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 msgr2=0x7fbc9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 0x7fbc9406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbca40011e0 tx=0x7fbca4009040 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 msgr2=0x7fbcb40ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c7d0 tx=0x7fbcac00cc90 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 shutdown_connections 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc9406be30 0x7fbc9406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb415e440 0x7fbcb40ace20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb40cf450 0x7fbcb40ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 --2- 172.21.15.52:0/3848251378 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb40b6710 0x7fbcb4158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 >> 172.21.15.52:0/3848251378 conn(0x7fbcb4067f80 msgr2=0x7fbcb415a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.548+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 shutdown_connections 2024-09-10T08:29:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.549+0000 7fbcb3200640 1 -- 172.21.15.52:0/3848251378 wait complete. 2024-09-10T08:29:30.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T08:29:30.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.720+0000 7fc072200640 1 Processor -- start 2024-09-10T08:29:30.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.721+0000 7fc072200640 1 -- start start 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc072200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc06c0cb980 0x7fc06c162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc072200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 0x7fc06c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc072200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06c0cc990 con 0x7fc06c15e6d0 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc072200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc06c162440 con 0x7fc06c0cb980 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc072200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c0cc3d0 con 0x7fc06c06cf30 2024-09-10T08:29:30.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc063e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc06c0cb980 0x7fc06c162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc06b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc06c15e6d0 0x7fc06c15f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50714/0 (socket says 172.21.15.52:50714) 2024-09-10T08:29:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc06b400640 1 -- 172.21.15.52:0/1009727849 learned_addr learned my addr 172.21.15.52:0/1009727849 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.722+0000 7fc06be00640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 0x7fc06c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.723+0000 7fc063e00640 1 -- 172.21.15.52:0/1009727849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 msgr2=0x7fc06c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:30.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.723+0000 7fc063e00640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 0x7fc06c06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.723+0000 7fc063e00640 1 -- 172.21.15.52:0/1009727849 >> v1:172.21.15.52:6789/0 conn(0x7fc06c15e6d0 legacy=0x7fc06c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.723+0000 7fc063e00640 1 -- 172.21.15.52:0/1009727849 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c0cc6b0 con 0x7fc06c0cb980 2024-09-10T08:29:30.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.723+0000 7fc06be00640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 0x7fc06c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:30.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc063e00640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c162c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b767c6571ea4070 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc06aa00640 1 -- 172.21.15.52:0/1009727849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054037070 con 0x7fc06c0cb980 2024-09-10T08:29:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc06aa00640 1 -- 172.21.15.52:0/1009727849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05402adb0 con 0x7fc06c0cb980 2024-09-10T08:29:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc06aa00640 1 -- 172.21.15.52:0/1009727849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054032660 con 0x7fc06c0cb980 2024-09-10T08:29:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 -- 172.21.15.52:0/1009727849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 msgr2=0x7fc06c162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c162c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402a060 comp rx=0 tx=0).stop 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 -- 172.21.15.52:0/1009727849 shutdown_connections 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c06cf30 0x7fc06c06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 --2- 172.21.15.52:0/1009727849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c162c00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.724+0000 7fc072200640 1 -- 172.21.15.52:0/1009727849 >> 172.21.15.52:0/1009727849 conn(0x7fc06c0b4300 msgr2=0x7fc06c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.725+0000 7fc072200640 1 -- 172.21.15.52:0/1009727849 shutdown_connections 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.725+0000 7fc072200640 1 -- 172.21.15.52:0/1009727849 wait complete. 2024-09-10T08:29:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.726+0000 7fc072200640 1 Processor -- start 2024-09-10T08:29:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.726+0000 7fc072200640 1 -- start start 2024-09-10T08:29:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 0x7fc06c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c15e6d0 0x7fc06c160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c15eab0 con 0x7fc06c0cb980 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c163140 con 0x7fc06c06cf30 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc072200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c15ec30 con 0x7fc06c15e6d0 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc063e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc063e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36620/0 (socket says 172.21.15.52:36620) 2024-09-10T08:29:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.727+0000 7fc063e00640 1 -- 172.21.15.52:0/299167944 learned_addr learned my addr 172.21.15.52:0/299167944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:30.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc06be00640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c15e6d0 0x7fc06c160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc06b400640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 0x7fc06c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 -- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c15e6d0 msgr2=0x7fc06c160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c15e6d0 0x7fc06c160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 -- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 msgr2=0x7fc06c0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 0x7fc06c0b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 -- 172.21.15.52:0/299167944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c0b5be0 con 0x7fc06c0cb980 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc06b400640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 0x7fc06c0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063e00640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0540098c0 tx=0x7fc0540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.728+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054041030 con 0x7fc06c0cb980 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.729+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05402abb0 con 0x7fc06c0cb980 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.729+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054037040 con 0x7fc06c0cb980 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.729+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c0b5ec0 con 0x7fc06c0cb980 2024-09-10T08:29:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.729+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c0b6480 con 0x7fc06c0cb980 2024-09-10T08:29:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.730+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06c162c00 con 0x7fc06c0cb980 2024-09-10T08:29:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.731+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc054044070 con 0x7fc06c0cb980 2024-09-10T08:29:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.731+0000 7fc063400640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 0x7fc04806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.732+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc0540ab250 con 0x7fc06c0cb980 2024-09-10T08:29:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.732+0000 7fc06b400640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 0x7fc04806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:30.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.733+0000 7fc06b400640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 0x7fc04806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc05c000f60 tx=0x7fc05c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:30.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.736+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc054044e40 con 0x7fc06c0cb980 2024-09-10T08:29:30.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.986+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc06c0b3800 con 0x7fc06c0cb980 2024-09-10T08:29:30.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.989+0000 7fc063400640 1 -- 172.21.15.52:0/299167944 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fc054079eb0 con 0x7fc06c0cb980 2024-09-10T08:29:30.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.991+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 msgr2=0x7fc04806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.991+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 0x7fc04806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc05c000f60 tx=0x7fc05c009040 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.991+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 msgr2=0x7fc06c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.991+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc0540098c0 tx=0x7fc0540046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 shutdown_connections 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc04806be30 0x7fc04806e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc06c15e6d0 0x7fc06c160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc06c0cb980 0x7fc06c14da20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 --2- 172.21.15.52:0/299167944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc06c06cf30 0x7fc06c0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 >> 172.21.15.52:0/299167944 conn(0x7fc06c0b4300 msgr2=0x7fc06c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 shutdown_connections 2024-09-10T08:29:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:30.992+0000 7fc072200640 1 -- 172.21.15.52:0/299167944 wait complete. 2024-09-10T08:29:31.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:29:31.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.162+0000 7fd48c800640 1 Processor -- start 2024-09-10T08:29:31.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.162+0000 7fd48c800640 1 -- start start 2024-09-10T08:29:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd48c800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd484073890 0x7fd4840b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd48c800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840b4020 con 0x7fd484145ed0 2024-09-10T08:29:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd48c800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4840b42c0 con 0x7fd4840b5880 2024-09-10T08:29:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd48c800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd4840b63f0 con 0x7fd484073890 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd484073890 0x7fd4840b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd484145ed0 0x7fd484073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50720/0 (socket says 172.21.15.52:50720) 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489e00640 1 -- 172.21.15.52:0/1308824244 learned_addr learned my addr 172.21.15.52:0/1308824244 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489400640 1 -- 172.21.15.52:0/1308824244 >> v1:172.21.15.176:6789/0 conn(0x7fd4840b5880 legacy=0x7fd4840b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489400640 1 -- 172.21.15.52:0/1308824244 >> v1:172.21.15.52:6789/0 conn(0x7fd484145ed0 legacy=0x7fd484073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd489400640 1 -- 172.21.15.52:0/1308824244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840b45a0 con 0x7fd484073890 2024-09-10T08:29:31.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.164+0000 7fd488a00640 1 -- 172.21.15.52:0/1308824244 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754987134 0 0) 0x7fd4840b4020 con 0x7fd484145ed0 2024-09-10T08:29:31.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.165+0000 7fd489400640 1 --2- 172.21.15.52:0/1308824244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484073890 0x7fd4840b5080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19deb545712352c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd488a00640 1 -- 172.21.15.52:0/1308824244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474037070 con 0x7fd484073890 2024-09-10T08:29:31.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd488a00640 1 -- 172.21.15.52:0/1308824244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd474032440 con 0x7fd484073890 2024-09-10T08:29:31.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd488a00640 1 -- 172.21.15.52:0/1308824244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474032810 con 0x7fd484073890 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 -- 172.21.15.52:0/1308824244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484073890 msgr2=0x7fd4840b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 --2- 172.21.15.52:0/1308824244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484073890 0x7fd4840b5080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 -- 172.21.15.52:0/1308824244 shutdown_connections 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 --2- 172.21.15.52:0/1308824244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484073890 0x7fd4840b5080 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 -- 172.21.15.52:0/1308824244 >> 172.21.15.52:0/1308824244 conn(0x7fd4840ccec0 msgr2=0x7fd4840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 -- 172.21.15.52:0/1308824244 shutdown_connections 2024-09-10T08:29:31.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.166+0000 7fd48c800640 1 -- 172.21.15.52:0/1308824244 wait complete. 2024-09-10T08:29:31.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.168+0000 7fd48c800640 1 Processor -- start 2024-09-10T08:29:31.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.168+0000 7fd48c800640 1 -- start start 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd484073890 0x7fd4840ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4840b5880 0x7fd4840cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841462b0 con 0x7fd484145ed0 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840b4b60 con 0x7fd4840b5880 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48c800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd484146430 con 0x7fd484073890 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36626/0 (socket says 172.21.15.52:36626) 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd48a800640 1 -- 172.21.15.52:0/108789068 learned_addr learned my addr 172.21.15.52:0/108789068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd489400640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4840b5880 0x7fd4840cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.169+0000 7fd489e00640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd484073890 0x7fd4840ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 -- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd484073890 msgr2=0x7fd4840ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd484073890 0x7fd4840ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 -- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4840b5880 msgr2=0x7fd4840cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4840b5880 0x7fd4840cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 -- 172.21.15.52:0/108789068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840caaf0 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48a800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c780 tx=0x7fd48000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480017070 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480003da0 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4800052b0 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4840c97f0 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.170+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4840c9db0 con 0x7fd484145ed0 2024-09-10T08:29:31.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.172+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4840b5080 con 0x7fd484145ed0 2024-09-10T08:29:31.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.173+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd480005450 con 0x7fd484145ed0 2024-09-10T08:29:31.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.173+0000 7fd47e000640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 0x7fd46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.174+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd480089fb0 con 0x7fd484145ed0 2024-09-10T08:29:31.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.174+0000 7fd489e00640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 0x7fd46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.175+0000 7fd489e00640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 0x7fd46806e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd478000f60 tx=0x7fd478009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.178+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4800586f0 con 0x7fd484145ed0 2024-09-10T08:29:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.363+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd4840cd7d0 con 0x7fd484145ed0 2024-09-10T08:29:31.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.364+0000 7fd47e000640 1 -- 172.21.15.52:0/108789068 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fd48005c9f0 con 0x7fd484145ed0 2024-09-10T08:29:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:31.364 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:29:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:29:31.365 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:29:31.365 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:29:31.365 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:29:31.365 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 msgr2=0x7fd46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 0x7fd46806e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd478000f60 tx=0x7fd478009040 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 msgr2=0x7fd4840cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c780 tx=0x7fd48000cc40 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 shutdown_connections 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd46806be30 0x7fd46806e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd484145ed0 0x7fd4840cf7c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd4840b5880 0x7fd4840cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 --2- 172.21.15.52:0/108789068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd484073890 0x7fd4840ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 >> 172.21.15.52:0/108789068 conn(0x7fd4840ccec0 msgr2=0x7fd484144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 shutdown_connections 2024-09-10T08:29:31.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.366+0000 7fd48c800640 1 -- 172.21.15.52:0/108789068 wait complete. 2024-09-10T08:29:31.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:29:31.382 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:29:31.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.542+0000 7f8f30800640 1 Processor -- start 2024-09-10T08:29:31.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.543+0000 7f8f30800640 1 -- start start 2024-09-10T08:29:31.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f30800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 0x7f8f280b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f30800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f28146220 con 0x7f8f281454b0 2024-09-10T08:29:31.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f30800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f280cf640 con 0x7f8f280b6000 2024-09-10T08:29:31.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f30800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f280b1920 con 0x7f8f280b2dc0 2024-09-10T08:29:31.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f2de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f281454b0 0x7f8f280b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50722/0 (socket says 172.21.15.52:50722) 2024-09-10T08:29:31.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f2de00640 1 -- 172.21.15.52:0/2071830454 learned_addr learned my addr 172.21.15.52:0/2071830454 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.544+0000 7f8f2e800640 1 --2- 172.21.15.52:0/2071830454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 0x7f8f280b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816571240 0 0) 0x7f8f1c001110 con 0x7f8f281454b0 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f10003520 con 0x7f8f281454b0 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007818662 0 0) 0x7f8f280cf640 con 0x7f8f280b6000 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f1c001110 con 0x7f8f280b6000 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2e800640 1 -- 172.21.15.52:0/2071830454 >> v1:172.21.15.176:6789/0 conn(0x7f8f280b6000 legacy=0x7f8f280afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2e800640 1 -- 172.21.15.52:0/2071830454 >> v1:172.21.15.52:6789/0 conn(0x7f8f281454b0 legacy=0x7f8f280b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.545+0000 7f8f2e800640 1 -- 172.21.15.52:0/2071830454 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f280cf8e0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.546+0000 7f8f2e800640 1 --2- 172.21.15.52:0/2071830454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 0x7f8f280b0550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009dc0 tx=0x7f8f2402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9839bdd38d0d622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.546+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24007740 con 0x7f8f280b2dc0 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f240078e0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f2ca00640 1 -- 172.21.15.52:0/2071830454 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24007cb0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 -- 172.21.15.52:0/2071830454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 msgr2=0x7f8f280b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 --2- 172.21.15.52:0/2071830454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 0x7f8f280b0550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009dc0 tx=0x7f8f2402a760 comp rx=0 tx=0).stop 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 -- 172.21.15.52:0/2071830454 shutdown_connections 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 --2- 172.21.15.52:0/2071830454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b2dc0 0x7f8f280b0550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 -- 172.21.15.52:0/2071830454 >> 172.21.15.52:0/2071830454 conn(0x7f8f2806c240 msgr2=0x7f8f2806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 -- 172.21.15.52:0/2071830454 shutdown_connections 2024-09-10T08:29:31.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.547+0000 7f8f30800640 1 -- 172.21.15.52:0/2071830454 wait complete. 2024-09-10T08:29:31.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.549+0000 7f8f30800640 1 Processor -- start 2024-09-10T08:29:31.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.549+0000 7f8f30800640 1 -- start start 2024-09-10T08:29:31.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b6000 0x7f8f2813adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f281454b0 0x7f8f28071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280d0180 con 0x7f8f280b2dc0 2024-09-10T08:29:31.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280cfea0 con 0x7f8f281454b0 2024-09-10T08:29:31.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f30800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f281459a0 con 0x7f8f280b6000 2024-09-10T08:29:31.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f2de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f2de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36628/0 (socket says 172.21.15.52:36628) 2024-09-10T08:29:31.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.550+0000 7f8f2de00640 1 -- 172.21.15.52:0/2993747123 learned_addr learned my addr 172.21.15.52:0/2993747123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:31.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 -- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b6000 msgr2=0x7f8f2813adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b6000 0x7f8f2813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 -- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f281454b0 msgr2=0x7f8f28071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f281454b0 0x7f8f28071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 -- 172.21.15.52:0/2993747123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f28142390 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f2de00640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c730 tx=0x7f8f1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c017070 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c005ab0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c005e60 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f280c5ac0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.551+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f280c6080 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.552+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f280b58f0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.553+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f1c01a070 con 0x7f8f280b2dc0 2024-09-10T08:29:31.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.554+0000 7f8f22000640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:31.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.554+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f8f1c08a080 con 0x7f8f280b2dc0 2024-09-10T08:29:31.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.555+0000 7f8f2d400640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:31.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.555+0000 7f8f2d400640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f180011e0 tx=0x7f8f180078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:31.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.558+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f28146220 con 0x7f8f280b2dc0 2024-09-10T08:29:31.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.742+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8f280c57c0 con 0x7f8f280b2dc0 2024-09-10T08:29:31.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.994+0000 7f8f22000640 1 -- 172.21.15.52:0/2993747123 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f8f1c058690 con 0x7f8f280b2dc0 2024-09-10T08:29:31.995 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:29:31.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 msgr2=0x7f8f0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f180011e0 tx=0x7f8f180078f0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 msgr2=0x7f8f280b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:31.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c730 tx=0x7f8f1c00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 shutdown_connections 2024-09-10T08:29:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0c06be30 0x7f8f0c06e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f281454b0 0x7f8f28071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f280b6000 0x7f8f2813adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 --2- 172.21.15.52:0/2993747123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f280b2dc0 0x7f8f280b4030 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:31.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.997+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 >> 172.21.15.52:0/2993747123 conn(0x7f8f2806c240 msgr2=0x7f8f281445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:31.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.998+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 shutdown_connections 2024-09-10T08:29:31.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:31.998+0000 7f8f30800640 1 -- 172.21.15.52:0/2993747123 wait complete. 2024-09-10T08:29:32.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.180+0000 7fb0e2600640 1 Processor -- start 2024-09-10T08:29:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.181+0000 7fb0e2600640 1 -- start start 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0e2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0732e0 0x7fb0dc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0e2600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0dc0cce30 0x7fb0dc0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0e2600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc0714b0 con 0x7fb0dc071c70 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0e2600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc073c00 con 0x7fb0dc0cce30 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0e2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0cd880 con 0x7fb0dc0732e0 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0dbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb0dc071c70 0x7fb0dc15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50724/0 (socket says 172.21.15.52:50724) 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0dbe00640 1 -- 172.21.15.52:0/2548202520 learned_addr learned my addr 172.21.15.52:0/2548202520 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/2548202520 >> v2:172.21.15.176:3300/0 conn(0x7fb0dc0cce30 0x7fb0dc0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.182+0000 7fb0db400640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0732e0 0x7fb0dc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758062067 0 0) 0x7fb0dc0714b0 con 0x7fb0dc071c70 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c0003520 con 0x7fb0dc071c70 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0d3e00640 1 -- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0732e0 msgr2=0x7fb0dc0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0732e0 0x7fb0dc0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0d3e00640 1 -- 172.21.15.52:0/2548202520 >> v1:172.21.15.52:6789/0 conn(0x7fb0dc071c70 legacy=0x7fb0dc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3176134842 0 0) 0x7fb0c0003520 con 0x7fb0dc071c70 2024-09-10T08:29:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.183+0000 7fb0d3e00640 1 -- 172.21.15.52:0/2548202520 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0cdb60 con 0x7fb0dc0cce30 2024-09-10T08:29:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.184+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0cce30 0x7fb0dc0cd270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c1c856618a3a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.184+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4037070 con 0x7fb0dc0cce30 2024-09-10T08:29:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.184+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c402ab10 con 0x7fb0dc0cce30 2024-09-10T08:29:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.184+0000 7fb0daa00640 1 -- 172.21.15.52:0/2548202520 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40019f0 con 0x7fb0dc0cce30 2024-09-10T08:29:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 -- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0cce30 msgr2=0x7fb0dc0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0cce30 0x7fb0dc0cd270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40097a0 tx=0x7fb0c402a080 comp rx=0 tx=0).stop 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 -- 172.21.15.52:0/2548202520 shutdown_connections 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0cce30 0x7fb0dc0cd270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 --2- 172.21.15.52:0/2548202520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0732e0 0x7fb0dc0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 -- 172.21.15.52:0/2548202520 >> 172.21.15.52:0/2548202520 conn(0x7fb0dc06d0f0 msgr2=0x7fb0dc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 -- 172.21.15.52:0/2548202520 shutdown_connections 2024-09-10T08:29:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.185+0000 7fb0e2600640 1 -- 172.21.15.52:0/2548202520 wait complete. 2024-09-10T08:29:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.187+0000 7fb0e2600640 1 Processor -- start 2024-09-10T08:29:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.187+0000 7fb0e2600640 1 -- start start 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0732e0 0x7fb0dc0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 0x7fb0dc1f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc06bf70 con 0x7fb0dc071c70 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc06bdf0 con 0x7fb0dc0732e0 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0e2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc072120 con 0x7fb0dc0cce30 2024-09-10T08:29:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36630/0 (socket says 172.21.15.52:36630) 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 -- 172.21.15.52:0/1308169030 learned_addr learned my addr 172.21.15.52:0/1308169030 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0732e0 0x7fb0dc0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0dbe00640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 0x7fb0dc1f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 -- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 msgr2=0x7fb0dc1f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 0x7fb0dc1f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 -- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0732e0 msgr2=0x7fb0dc0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0732e0 0x7fb0dc0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0db400640 1 -- 172.21.15.52:0/1308169030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc1f2ba0 con 0x7fb0dc071c70 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.188+0000 7fb0dbe00640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 0x7fb0dc1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0db400640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00e9b0 tx=0x7fb0cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc017070 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc1f2e80 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc00c9a0 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00cd90 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.189+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc1568c0 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.190+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc1f3050 con 0x7fb0dc071c70 2024-09-10T08:29:32.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.191+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0cc01a070 con 0x7fb0dc071c70 2024-09-10T08:29:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.192+0000 7fb0d3400640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 0x7fb0b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.192+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fb0cc08b0c0 con 0x7fb0dc071c70 2024-09-10T08:29:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.193+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 0x7fb0b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.193+0000 7fb0d3e00640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 0x7fb0b806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4034000 tx=0x7fb0c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:32.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.197+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0cc059bc0 con 0x7fb0dc071c70 2024-09-10T08:29:32.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.382+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb0dc0724b0 con 0x7fb0dc071c70 2024-09-10T08:29:32.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:32.997+0000 7fb0d3400640 1 -- 172.21.15.52:0/1308169030 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fb0cc0594c0 con 0x7fb0dc071c70 2024-09-10T08:29:32.998 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:29:33.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 msgr2=0x7fb0b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 0x7fb0b806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4034000 tx=0x7fb0c402e000 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 msgr2=0x7fb0dc156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00e9b0 tx=0x7fb0cc00ee70 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 shutdown_connections 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb0b806be30 0x7fb0b806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0dc0cce30 0x7fb0dc1f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0dc0732e0 0x7fb0dc0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 --2- 172.21.15.52:0/1308169030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc071c70 0x7fb0dc156de0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.001+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 >> 172.21.15.52:0/1308169030 conn(0x7fb0dc06d0f0 msgr2=0x7fb0dc0cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.002+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 shutdown_connections 2024-09-10T08:29:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.005+0000 7fb0e2600640 1 -- 172.21.15.52:0/1308169030 wait complete. 2024-09-10T08:29:33.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:29:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.202+0000 7f3baf000640 1 Processor -- start 2024-09-10T08:29:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.202+0000 7f3baf000640 1 -- start start 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.203+0000 7f3baf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.203+0000 7f3baf000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.203+0000 7f3baf000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ba8073cc0 con 0x7f3ba8155950 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.203+0000 7f3baf000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3ba81631c0 con 0x7f3ba80afb20 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.203+0000 7f3baf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba8070370 con 0x7f3ba8073600 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3bad000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3bad000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:35832/0 (socket says 172.21.15.52:35832) 2024-09-10T08:29:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3bad000640 1 -- 172.21.15.52:0/3266775588 learned_addr learned my addr 172.21.15.52:0/3266775588 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba7400640 1 -- 172.21.15.52:0/3266775588 >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 msgr2=0x7f3ba80affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba7400640 1 --2- 172.21.15.52:0/3266775588 >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba7400640 1 -- 172.21.15.52:0/3266775588 >> v1:172.21.15.176:6789/0 conn(0x7f3ba8155950 legacy=0x7f3ba806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba6a00640 1 -- 172.21.15.52:0/3266775588 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433757952 0 0) 0x7f3ba8073cc0 con 0x7f3ba8155950 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3ba7400640 1 -- 172.21.15.52:0/3266775588 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba8071aa0 con 0x7f3ba8073600 2024-09-10T08:29:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.204+0000 7f3bad000640 1 --2- 172.21.15.52:0/3266775588 >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.205+0000 7f3ba7400640 1 --2- 172.21.15.52:0/3266775588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8162c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b940097a0 tx=0x7f3b9402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a55132745663396 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3ba6a00640 1 -- 172.21.15.52:0/3266775588 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94037070 con 0x7f3ba8073600 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3ba6a00640 1 -- 172.21.15.52:0/3266775588 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b94032440 con 0x7f3ba8073600 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3ba6a00640 1 -- 172.21.15.52:0/3266775588 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94032810 con 0x7f3ba8073600 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 -- 172.21.15.52:0/3266775588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 msgr2=0x7f3ba8162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 --2- 172.21.15.52:0/3266775588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8162c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b940097a0 tx=0x7f3b9402a180 comp rx=0 tx=0).stop 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 -- 172.21.15.52:0/3266775588 shutdown_connections 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 --2- 172.21.15.52:0/3266775588 >> v2:172.21.15.176:3300/0 conn(0x7f3ba80afb20 0x7f3ba80affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 --2- 172.21.15.52:0/3266775588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8162c80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 -- 172.21.15.52:0/3266775588 >> 172.21.15.52:0/3266775588 conn(0x7f3ba806db30 msgr2=0x7f3ba806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 -- 172.21.15.52:0/3266775588 shutdown_connections 2024-09-10T08:29:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.206+0000 7f3baf000640 1 -- 172.21.15.52:0/3266775588 wait complete. 2024-09-10T08:29:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.208+0000 7f3baf000640 1 Processor -- start 2024-09-10T08:29:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.208+0000 7f3baf000640 1 -- start start 2024-09-10T08:29:33.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 0x7f3ba81e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba806c320 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba8073a60 con 0x7f3ba80afb20 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3baf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ba8072060 con 0x7f3ba8073600 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3bad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3bad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36636/0 (socket says 172.21.15.52:36636) 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.209+0000 7f3bad000640 1 -- 172.21.15.52:0/3098374718 learned_addr learned my addr 172.21.15.52:0/3098374718 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3ba7400640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 0x7f3ba81e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3ba7e00640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 -- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 msgr2=0x7f3ba8143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 -- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 msgr2=0x7f3ba81e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 0x7f3ba81e8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 -- 172.21.15.52:0/3098374718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba8144490 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3ba7400640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 0x7f3ba81e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.210+0000 7f3bad000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000efc0 tx=0x7f3ba000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.211+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000cbe0 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.211+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba000cd80 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.211+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba8141870 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.211+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003bb0 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.211+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba8141e30 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.212+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba8162c80 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.213+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ba001b030 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.214+0000 7f3b9fe00640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 0x7f3b8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:33.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.214+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f3ba008bff0 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.214+0000 7f3ba7e00640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 0x7f3b8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:33.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.215+0000 7f3ba7e00640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 0x7f3b8806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b98000f60 tx=0x7f3b98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:33.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.217+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ba0022020 con 0x7f3ba81f3fa0 2024-09-10T08:29:33.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:33.439+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3ba80b6360 con 0x7f3ba81f3fa0 2024-09-10T08:29:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.017+0000 7f3b9fe00640 1 -- 172.21.15.52:0/3098374718 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f3ba0010040 con 0x7f3ba81f3fa0 2024-09-10T08:29:34.023 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 4 and data pool 5 2024-09-10T08:29:34.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.028+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 msgr2=0x7f3b8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.028+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 0x7f3b8806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b98000f60 tx=0x7f3b98009040 comp rx=0 tx=0).stop 2024-09-10T08:29:34.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.028+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 msgr2=0x7f3ba80b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.028+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000efc0 tx=0x7f3ba000c490 comp rx=0 tx=0).stop 2024-09-10T08:29:34.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 shutdown_connections 2024-09-10T08:29:34.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b8806be30 0x7f3b8806e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ba81f3fa0 0x7f3ba80b1150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ba80afb20 0x7f3ba81e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 --2- 172.21.15.52:0/3098374718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ba8073600 0x7f3ba8143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.029+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 >> 172.21.15.52:0/3098374718 conn(0x7f3ba806db30 msgr2=0x7f3ba806ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.032+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 shutdown_connections 2024-09-10T08:29:34.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.033+0000 7f3baf000640 1 -- 172.21.15.52:0/3098374718 wait complete. 2024-09-10T08:29:34.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.227+0000 7f6fc5a00640 1 Processor -- start 2024-09-10T08:29:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.227+0000 7f6fc5a00640 1 -- start start 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fc015e440 0x7f6fc00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 0x7f6fc00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6fc00b6540 0x7f6fc006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc00b69b0 con 0x7f6fc015e440 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6fc00d3990 con 0x7f6fc00b6540 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fc5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00d3c70 con 0x7f6fc00cf450 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fbfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fc015e440 0x7f6fc00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fbfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6fc015e440 0x7f6fc00d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59386/0 (socket says 172.21.15.52:59386) 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.228+0000 7f6fbfe00640 1 -- 172.21.15.52:0/3407276876 learned_addr learned my addr 172.21.15.52:0/3407276876 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fc5000640 1 --2- 172.21.15.52:0/3407276876 >> v2:172.21.15.176:3300/0 conn(0x7f6fc00b6540 0x7f6fc006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbf400640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 0x7f6fc00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbfe00640 1 -- 172.21.15.52:0/3407276876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 msgr2=0x7f6fc00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 0x7f6fc00b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbfe00640 1 -- 172.21.15.52:0/3407276876 >> v2:172.21.15.176:3300/0 conn(0x7f6fc00b6540 msgr2=0x7f6fc006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/3407276876 >> v2:172.21.15.176:3300/0 conn(0x7f6fc00b6540 0x7f6fc006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbfe00640 1 -- 172.21.15.52:0/3407276876 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc00d3f50 con 0x7f6fc015e440 2024-09-10T08:29:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.229+0000 7f6fbf400640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 0x7f6fc00b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.230+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc015e440 0x7f6fc00d3240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00d3ba0 tx=0x7f6fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ad72043d7d51b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.230+0000 7f6fbea00640 1 -- 172.21.15.52:0/3407276876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0037070 con 0x7f6fc015e440 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.230+0000 7f6fbea00640 1 -- 172.21.15.52:0/3407276876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb0032440 con 0x7f6fc015e440 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.230+0000 7f6fbea00640 1 -- 172.21.15.52:0/3407276876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0032810 con 0x7f6fc015e440 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 -- 172.21.15.52:0/3407276876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc015e440 msgr2=0x7f6fc00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc015e440 0x7f6fc00d3240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00d3ba0 tx=0x7f6fb002a270 comp rx=0 tx=0).stop 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 -- 172.21.15.52:0/3407276876 shutdown_connections 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/3407276876 >> v2:172.21.15.176:3300/0 conn(0x7f6fc00b6540 0x7f6fc006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc00cf450 0x7f6fc00b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/3407276876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc015e440 0x7f6fc00d3240 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 -- 172.21.15.52:0/3407276876 >> 172.21.15.52:0/3407276876 conn(0x7f6fc0067f80 msgr2=0x7f6fc00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 -- 172.21.15.52:0/3407276876 shutdown_connections 2024-09-10T08:29:34.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.231+0000 7f6fc5a00640 1 -- 172.21.15.52:0/3407276876 wait complete. 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.232+0000 7f6fc5a00640 1 Processor -- start 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.233+0000 7f6fc5a00640 1 -- start start 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.233+0000 7f6fc5a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fc00b6540 0x7f6fc00cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.233+0000 7f6fc5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.233+0000 7f6fc5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc015e440 0x7f6fc00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fc5a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00b7540 con 0x7f6fc00cf450 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fc5a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc015e820 con 0x7f6fc00b6540 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fc5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc00b76c0 con 0x7f6fc015e440 2024-09-10T08:29:34.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59402/0 (socket says 172.21.15.52:59402) 2024-09-10T08:29:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 -- 172.21.15.52:0/1401928230 learned_addr learned my addr 172.21.15.52:0/1401928230 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fc00b6540 0x7f6fc00cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fc5000640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc015e440 0x7f6fc00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 -- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc015e440 msgr2=0x7f6fc00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc015e440 0x7f6fc00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 -- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fc00b6540 msgr2=0x7f6fc00cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fc00b6540 0x7f6fc00cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.234+0000 7f6fbf400640 1 -- 172.21.15.52:0/1401928230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc00cc5a0 con 0x7f6fc00cf450 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fbf400640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c7f0 tx=0x7f6fac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac015070 con 0x7f6fc00cf450 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fac007a30 con 0x7f6fc00cf450 2024-09-10T08:29:34.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc00cc820 con 0x7f6fc00cf450 2024-09-10T08:29:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac007e00 con 0x7f6fc00cf450 2024-09-10T08:29:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.235+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc0158710 con 0x7f6fc00cf450 2024-09-10T08:29:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.236+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc00b6000 con 0x7f6fc00cf450 2024-09-10T08:29:34.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.237+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6fac018070 con 0x7f6fc00cf450 2024-09-10T08:29:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.238+0000 7f6fb7e00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.238+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6fac08ace0 con 0x7f6fc00cf450 2024-09-10T08:29:34.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.239+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.239+0000 7f6fbfe00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0034000 tx=0x7f6fb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.243+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fc00cc5a0 con 0x7f6fc00cf450 2024-09-10T08:29:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.430+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fc00b51b0 con 0x7f6fc00cf450 2024-09-10T08:29:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.431+0000 7f6fb7e00640 1 -- 172.21.15.52:0/1401928230 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16694 (secure 0 0 0) 0x7f6fac059040 con 0x7f6fc00cf450 2024-09-10T08:29:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:34.432 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:29:33.441144+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:29:31.784586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T08:29:32.424265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 msgr2=0x7f6fa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 0x7f6fa006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0034000 tx=0x7f6fb002e000 comp rx=0 tx=0).stop 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 msgr2=0x7f6fc014eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00c7f0 tx=0x7f6fac00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 shutdown_connections 2024-09-10T08:29:34.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6fa006be30 0x7f6fa006e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fc015e440 0x7f6fc00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fc00cf450 0x7f6fc014eb50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 --2- 172.21.15.52:0/1401928230 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fc00b6540 0x7f6fc00cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 >> 172.21.15.52:0/1401928230 conn(0x7f6fc0067f80 msgr2=0x7f6fc00d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 shutdown_connections 2024-09-10T08:29:34.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.434+0000 7f6fc5a00640 1 -- 172.21.15.52:0/1401928230 wait complete. 2024-09-10T08:29:34.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.606+0000 7f3eeec00640 1 Processor -- start 2024-09-10T08:29:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.606+0000 7f3eeec00640 1 -- start start 2024-09-10T08:29:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eeec00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3ee80cf450 0x7f3ee80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eeec00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee80d3990 con 0x7f3ee80b6710 2024-09-10T08:29:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eeec00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee80d3c70 con 0x7f3ee815e440 2024-09-10T08:29:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eeec00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3ee80d3f50 con 0x7f3ee80cf450 2024-09-10T08:29:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eece00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3ee80b6710 0x7f3ee80b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39312/0 (socket says 172.21.15.52:39312) 2024-09-10T08:29:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.607+0000 7f3eece00640 1 -- 172.21.15.52:0/587084535 learned_addr learned my addr 172.21.15.52:0/587084535 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3eee200640 1 --2- 172.21.15.52:0/587084535 >> v2:172.21.15.176:3300/0 conn(0x7f3ee80cf450 0x7f3ee80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195763732 0 0) 0x7f3ee80d3990 con 0x7f3ee80b6710 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed0003520 con 0x7f3ee80b6710 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709748313 0 0) 0x7f3ee80d3c70 con 0x7f3ee815e440 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee80d3990 con 0x7f3ee815e440 2024-09-10T08:29:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3eee200640 1 -- 172.21.15.52:0/587084535 >> v1:172.21.15.176:6789/0 conn(0x7f3ee815e440 legacy=0x7f3ee80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3502300274 0 0) 0x7f3ed0003520 con 0x7f3ee80b6710 2024-09-10T08:29:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3eee200640 1 -- 172.21.15.52:0/587084535 >> v1:172.21.15.52:6789/0 conn(0x7f3ee80b6710 legacy=0x7f3ee80b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.608+0000 7f3eee200640 1 -- 172.21.15.52:0/587084535 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee80d4230 con 0x7f3ee80cf450 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.609+0000 7f3eee200640 1 --2- 172.21.15.52:0/587084535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee80d3240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009d90 tx=0x7f3ee002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bad60a13890f13a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4001670 con 0x7f3ee80cf450 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee0007540 con 0x7f3ee80cf450 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3ee7e00640 1 -- 172.21.15.52:0/587084535 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00078f0 con 0x7f3ee80cf450 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 -- 172.21.15.52:0/587084535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 msgr2=0x7f3ee80d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 --2- 172.21.15.52:0/587084535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee80d3240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009d90 tx=0x7f3ee002a710 comp rx=0 tx=0).stop 2024-09-10T08:29:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 -- 172.21.15.52:0/587084535 shutdown_connections 2024-09-10T08:29:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 --2- 172.21.15.52:0/587084535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee80d3240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 -- 172.21.15.52:0/587084535 >> 172.21.15.52:0/587084535 conn(0x7f3ee8067f80 msgr2=0x7f3ee80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 -- 172.21.15.52:0/587084535 shutdown_connections 2024-09-10T08:29:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.610+0000 7f3eeec00640 1 -- 172.21.15.52:0/587084535 wait complete. 2024-09-10T08:29:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.612+0000 7f3eeec00640 1 Processor -- start 2024-09-10T08:29:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.612+0000 7f3eeec00640 1 -- start start 2024-09-10T08:29:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815e440 0x7f3ee81f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee80b76c0 con 0x7f3ee80b6710 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee80b7540 con 0x7f3ee80cf450 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eeec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee80b8270 con 0x7f3ee815e440 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eed800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eed800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59412/0 (socket says 172.21.15.52:59412) 2024-09-10T08:29:34.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.613+0000 7f3eed800640 1 -- 172.21.15.52:0/3009756486 learned_addr learned my addr 172.21.15.52:0/3009756486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 -- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815e440 msgr2=0x7f3ee81f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815e440 0x7f3ee81f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 -- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 msgr2=0x7f3ee8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 -- 172.21.15.52:0/3009756486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81f5680 con 0x7f3ee80b6710 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eed800640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c460 tx=0x7f3edc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0052d0 con 0x7f3ee80b6710 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3edc005490 con 0x7f3ee80b6710 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc012930 con 0x7f3ee80b6710 2024-09-10T08:29:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee81e85e0 con 0x7f3ee80b6710 2024-09-10T08:29:34.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.614+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81e6b90 con 0x7f3ee80b6710 2024-09-10T08:29:34.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.615+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee80d3240 con 0x7f3ee80b6710 2024-09-10T08:29:34.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.616+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3edc012ad0 con 0x7f3ee80b6710 2024-09-10T08:29:34.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.617+0000 7f3ee5600640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 0x7f3ec806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.617+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3edc08aa90 con 0x7f3ee80b6710 2024-09-10T08:29:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.618+0000 7f3eece00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 0x7f3ec806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.618+0000 7f3eece00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 0x7f3ec806e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001340 tx=0x7f3ed4000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.622+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3edc059430 con 0x7f3ee80b6710 2024-09-10T08:29:34.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.805+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ee80cfc60 con 0x7f3ee80b6710 2024-09-10T08:29:34.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.806+0000 7f3ee5600640 1 -- 172.21.15.52:0/3009756486 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16694 (secure 0 0 0) 0x7f3edc058d30 con 0x7f3ee80b6710 2024-09-10T08:29:34.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:34.807 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:29:33.441144+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:29:31.784586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T08:29:32.424265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 msgr2=0x7f3ec806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 0x7f3ec806e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4001340 tx=0x7f3ed4000f50 comp rx=0 tx=0).stop 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 msgr2=0x7f3ee81e62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c460 tx=0x7f3edc00c920 comp rx=0 tx=0).stop 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 shutdown_connections 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ec806be60 0x7f3ec806e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ee815e440 0x7f3ee81f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ee80cf450 0x7f3ee8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 --2- 172.21.15.52:0/3009756486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ee80b6710 0x7f3ee81e62d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 >> 172.21.15.52:0/3009756486 conn(0x7f3ee8067f80 msgr2=0x7f3ee80b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 shutdown_connections 2024-09-10T08:29:34.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.808+0000 7f3eeec00640 1 -- 172.21.15.52:0/3009756486 wait complete. 2024-09-10T08:29:34.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:29:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.984+0000 7f0d35c00640 1 Processor -- start 2024-09-10T08:29:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.984+0000 7f0d35c00640 1 -- start start 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.985+0000 7f0d35c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d3006f2f0 0x7f0d3006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.985+0000 7f0d35c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d300d1100 0x7f0d300d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.985+0000 7f0d35c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3015cc60 con 0x7f0d3015c880 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.985+0000 7f0d35c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0d300d0c70 con 0x7f0d300d1100 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.985+0000 7f0d35c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3006fc70 con 0x7f0d3006f2f0 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d300d1100 0x7f0d300d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d300d1100 0x7f0d300d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59420/0 (socket says 172.21.15.52:59420) 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 -- 172.21.15.52:0/2053483251 learned_addr learned my addr 172.21.15.52:0/2053483251 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d26000640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d3006f2f0 0x7f0d3006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 -- 172.21.15.52:0/2053483251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d3006f2f0 msgr2=0x7f0d3006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d3006f2f0 0x7f0d3006f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 -- 172.21.15.52:0/2053483251 >> v1:172.21.15.176:6789/0 conn(0x7f0d3015c880 legacy=0x7f0d30070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.986+0000 7f0d2f400640 1 -- 172.21.15.52:0/2053483251 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d300713a0 con 0x7f0d300d1100 2024-09-10T08:29:34.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.987+0000 7f0d2f400640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d300d1100 0x7f0d300d15b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009e50 tx=0x7f0d2802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cad479ef5e3a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.987+0000 7f0d2e000640 1 -- 172.21.15.52:0/2053483251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28036070 con 0x7f0d300d1100 2024-09-10T08:29:34.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.987+0000 7f0d2e000640 1 -- 172.21.15.52:0/2053483251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d28031600 con 0x7f0d300d1100 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.987+0000 7f0d2e000640 1 -- 172.21.15.52:0/2053483251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d280319d0 con 0x7f0d300d1100 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 -- 172.21.15.52:0/2053483251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d300d1100 msgr2=0x7f0d300d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d300d1100 0x7f0d300d15b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009e50 tx=0x7f0d2802a710 comp rx=0 tx=0).stop 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 -- 172.21.15.52:0/2053483251 shutdown_connections 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d300d1100 0x7f0d300d15b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2053483251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d3006f2f0 0x7f0d3006f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 -- 172.21.15.52:0/2053483251 >> 172.21.15.52:0/2053483251 conn(0x7f0d300d2550 msgr2=0x7f0d300d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 -- 172.21.15.52:0/2053483251 shutdown_connections 2024-09-10T08:29:34.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.988+0000 7f0d35c00640 1 -- 172.21.15.52:0/2053483251 wait complete. 2024-09-10T08:29:34.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.990+0000 7f0d35c00640 1 Processor -- start 2024-09-10T08:29:34.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.990+0000 7f0d35c00640 1 -- start start 2024-09-10T08:29:34.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d300d1100 0x7f0d301593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d3015c880 0x7f0d3014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d300d32f0 con 0x7f0d3006f2f0 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d300d0900 con 0x7f0d3015c880 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d35c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d300d05b0 con 0x7f0d300d1100 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d2ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d2ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59422/0 (socket says 172.21.15.52:59422) 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d2ea00640 1 -- 172.21.15.52:0/2014137953 learned_addr learned my addr 172.21.15.52:0/2014137953 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d26000640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d300d1100 0x7f0d301593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.991+0000 7f0d2f400640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d3015c880 0x7f0d3014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 -- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d300d1100 msgr2=0x7f0d301593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d300d1100 0x7f0d301593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 -- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d3015c880 msgr2=0x7f0d3014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d3015c880 0x7f0d3014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:34.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 -- 172.21.15.52:0/2014137953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d30150d70 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d2ea00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c3c0 tx=0x7f0d2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200052d0 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d20005490 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20007260 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d30151050 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.992+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d30151610 con 0x7f0d3006f2f0 2024-09-10T08:29:34.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.993+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d3006f730 con 0x7f0d3006f2f0 2024-09-10T08:29:34.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.994+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d20007400 con 0x7f0d3006f2f0 2024-09-10T08:29:34.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.995+0000 7f0d27400640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 0x7f0d0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:34.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.995+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0d2008a2a0 con 0x7f0d3006f2f0 2024-09-10T08:29:34.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.996+0000 7f0d26000640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 0x7f0d0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:34.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.996+0000 7f0d26000640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 0x7f0d0c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d30159350 tx=0x7f0d18009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:34.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:34.999+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d200585f0 con 0x7f0d3006f2f0 2024-09-10T08:29:35.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:35.223+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0d300b65b0 con 0x7f0d3006f2f0 2024-09-10T08:29:35.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:35.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:29:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.029+0000 7f0d27400640 1 -- 172.21.15.52:0/2014137953 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f0d2005c8f0 con 0x7f0d3006f2f0 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 msgr2=0x7f0d0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 0x7f0d0c06e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d30159350 tx=0x7f0d18009190 comp rx=0 tx=0).stop 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 msgr2=0x7f0d30151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c3c0 tx=0x7f0d2000c880 comp rx=0 tx=0).stop 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 shutdown_connections 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d0c06be30 0x7f0d0c06e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d3015c880 0x7f0d3014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d300d1100 0x7f0d301593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 --2- 172.21.15.52:0/2014137953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d3006f2f0 0x7f0d30151e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 >> 172.21.15.52:0/2014137953 conn(0x7f0d300d2550 msgr2=0x7f0d3006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:36.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 shutdown_connections 2024-09-10T08:29:36.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.031+0000 7f0d35c00640 1 -- 172.21.15.52:0/2014137953 wait complete. 2024-09-10T08:29:36.049 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:29:36.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:29:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.210+0000 7f4fd4800640 1 Processor -- start 2024-09-10T08:29:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.210+0000 7f4fd4800640 1 -- start start 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.211+0000 7f4fd4800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4fcc15ea80 0x7f4fcc0d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.211+0000 7f4fd4800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 0x7f4fcc0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd4800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc0d2c80 con 0x7f4fcc0d4390 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd4800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc0d2f60 con 0x7f4fcc15ea80 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd4800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d3240 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4fcc15ea80 0x7f4fcc0d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4fcc0d4390 0x7f4fcc0b6620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39316/0 (socket says 172.21.15.52:39316) 2024-09-10T08:29:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1400640 1 -- 172.21.15.52:0/886576482 learned_addr learned my addr 172.21.15.52:0/886576482 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd2800640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 0x7f4fcc0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1e00640 1 -- 172.21.15.52:0/886576482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 msgr2=0x7f4fcc0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1e00640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 0x7f4fcc0b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1e00640 1 -- 172.21.15.52:0/886576482 >> v1:172.21.15.52:6789/0 conn(0x7f4fcc0d4390 legacy=0x7f4fcc0b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd1e00640 1 -- 172.21.15.52:0/886576482 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc0d3520 con 0x7f4fcc15ea80 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd0a00640 1 -- 172.21.15.52:0/886576482 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891463905 0 0) 0x7f4fcc0d2c80 con 0x7f4fcc0d4390 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.212+0000 7f4fd2800640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 0x7f4fcc0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.213+0000 7f4fd1e00640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc0d3e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd4ca87d726e816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd0a00640 1 -- 172.21.15.52:0/886576482 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0037070 con 0x7f4fcc15ea80 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd0a00640 1 -- 172.21.15.52:0/886576482 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0032440 con 0x7f4fcc15ea80 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd0a00640 1 -- 172.21.15.52:0/886576482 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0032810 con 0x7f4fcc15ea80 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 -- 172.21.15.52:0/886576482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc15ea80 msgr2=0x7f4fcc0d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc0d3e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002a210 comp rx=0 tx=0).stop 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 -- 172.21.15.52:0/886576482 shutdown_connections 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc0b6d30 0x7f4fcc0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 --2- 172.21.15.52:0/886576482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc0d3e50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 -- 172.21.15.52:0/886576482 >> 172.21.15.52:0/886576482 conn(0x7f4fcc0d1620 msgr2=0x7f4fcc0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 -- 172.21.15.52:0/886576482 shutdown_connections 2024-09-10T08:29:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.214+0000 7f4fd4800640 1 -- 172.21.15.52:0/886576482 wait complete. 2024-09-10T08:29:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.216+0000 7f4fd4800640 1 Processor -- start 2024-09-10T08:29:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.216+0000 7f4fd4800640 1 -- start start 2024-09-10T08:29:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc161530 0x7f4fcc14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d2810 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc15ee60 con 0x7f4fcc15ea80 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd4800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d2990 con 0x7f4fcc161530 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59442/0 (socket says 172.21.15.52:59442) 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd1e00640 1 -- 172.21.15.52:0/1618503815 learned_addr learned my addr 172.21.15.52:0/1618503815 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd2800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc161530 0x7f4fcc14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.217+0000 7f4fd1400640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 -- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc161530 msgr2=0x7f4fcc14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc161530 0x7f4fcc14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 -- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fcc15ea80 msgr2=0x7f4fcc160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 -- 172.21.15.52:0/1618503815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc1542f0 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd1e00640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0035040 tx=0x7f4fc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0037050 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0038040 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004490 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc150bc0 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.218+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc14dfc0 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.219+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc161940 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.220+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fc0030900 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.221+0000 7f4fc6000640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 0x7f4fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.221+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4fc00ab9a0 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.222+0000 7f4fd1400640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 0x7f4fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.222+0000 7f4fd1400640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 0x7f4fb006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc1f7740 tx=0x7f4fbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.226+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fcc161940 con 0x7f4fcc0b6d30 2024-09-10T08:29:36.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:36.444+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4fcc0d3e50 con 0x7f4fcc0b6d30 2024-09-10T08:29:37.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.031+0000 7f4fc6000640 1 -- 172.21.15.52:0/1618503815 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f4fcc1542f0 con 0x7f4fcc0b6d30 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 msgr2=0x7f4fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 0x7f4fb006e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc1f7740 tx=0x7f4fbc009040 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 msgr2=0x7f4fcc14d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0035040 tx=0x7f4fc00046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 shutdown_connections 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fb006be30 0x7f4fb006e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4fcc161530 0x7f4fcc14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fcc15ea80 0x7f4fcc160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 --2- 172.21.15.52:0/1618503815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fcc0b6d30 0x7f4fcc14d740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.034+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 >> 172.21.15.52:0/1618503815 conn(0x7f4fcc0d1620 msgr2=0x7f4fcc0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:37.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.035+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 shutdown_connections 2024-09-10T08:29:37.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.035+0000 7f4fd4800640 1 -- 172.21.15.52:0/1618503815 wait complete. 2024-09-10T08:29:37.054 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:29:37.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:37.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.214+0000 7fbe9b200640 1 Processor -- start 2024-09-10T08:29:37.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.214+0000 7fbe9b200640 1 -- start start 2024-09-10T08:29:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe9b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe94070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe9b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9406c320 0x7fbe940714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe9b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe94071b30 con 0x7fbe94148260 2024-09-10T08:29:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe9b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbe94074200 con 0x7fbe9406c320 2024-09-10T08:29:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe9b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940b3e40 con 0x7fbe94147e80 2024-09-10T08:29:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe99200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9406c320 0x7fbe940714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe93e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe94070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe99200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9406c320 0x7fbe940714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59450/0 (socket says 172.21.15.52:59450) 2024-09-10T08:29:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe99200640 1 -- 172.21.15.52:0/198201087 learned_addr learned my addr 172.21.15.52:0/198201087 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.216+0000 7fbe8be00640 1 --1- 172.21.15.52:0/198201087 >> v1:172.21.15.176:6789/0 conn(0x7fbe94148260 0x7fbe9406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:44746/0 (socket says 172.21.15.52:44746) 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe99200640 1 -- 172.21.15.52:0/198201087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 msgr2=0x7fbe94070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe99200640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe94070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe99200640 1 -- 172.21.15.52:0/198201087 >> v1:172.21.15.176:6789/0 conn(0x7fbe94148260 legacy=0x7fbe9406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe99200640 1 -- 172.21.15.52:0/198201087 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940b3510 con 0x7fbe9406c320 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe93400640 1 -- 172.21.15.52:0/198201087 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147230624 0 0) 0x7fbe94071b30 con 0x7fbe94148260 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.217+0000 7fbe93e00640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe94070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe99200640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe940714b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009e50 tx=0x7fbe8c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b99576a12295ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe93400640 1 -- 172.21.15.52:0/198201087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c036070 con 0x7fbe9406c320 2024-09-10T08:29:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe93400640 1 -- 172.21.15.52:0/198201087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c031600 con 0x7fbe9406c320 2024-09-10T08:29:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe93400640 1 -- 172.21.15.52:0/198201087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0319d0 con 0x7fbe9406c320 2024-09-10T08:29:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 -- 172.21.15.52:0/198201087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 msgr2=0x7fbe940714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe940714b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009e50 tx=0x7fbe8c02a730 comp rx=0 tx=0).stop 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 -- 172.21.15.52:0/198201087 shutdown_connections 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe940714b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 --2- 172.21.15.52:0/198201087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe94070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 -- 172.21.15.52:0/198201087 >> 172.21.15.52:0/198201087 conn(0x7fbe940ccec0 msgr2=0x7fbe940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.218+0000 7fbe9b200640 1 -- 172.21.15.52:0/198201087 shutdown_connections 2024-09-10T08:29:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.219+0000 7fbe9b200640 1 -- 172.21.15.52:0/198201087 wait complete. 2024-09-10T08:29:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.220+0000 7fbe9b200640 1 Processor -- start 2024-09-10T08:29:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.220+0000 7fbe9b200640 1 -- start start 2024-09-10T08:29:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe940cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe94148260 0x7fbe940cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940b42d0 con 0x7fbe9406c320 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940b3ad0 con 0x7fbe94148260 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe9b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940b4450 con 0x7fbe94147e80 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe93e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe93e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59462/0 (socket says 172.21.15.52:59462) 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe93e00640 1 -- 172.21.15.52:0/814264871 learned_addr learned my addr 172.21.15.52:0/814264871 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.221+0000 7fbe99200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe94148260 0x7fbe940cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe8be00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe940cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 -- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 msgr2=0x7fbe940cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe940cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 -- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe94148260 msgr2=0x7fbe940cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe94148260 0x7fbe940cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 -- 172.21.15.52:0/814264871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940b17a0 con 0x7fbe9406c320 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe93e00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400ec10 tx=0x7fbe8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84017070 con 0x7fbe9406c320 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8400cc30 con 0x7fbe9406c320 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84013470 con 0x7fbe9406c320 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.222+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe940b1a80 con 0x7fbe9406c320 2024-09-10T08:29:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.223+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe940b2040 con 0x7fbe9406c320 2024-09-10T08:29:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.224+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9406bc10 con 0x7fbe9406c320 2024-09-10T08:29:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.224+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe8401a070 con 0x7fbe9406c320 2024-09-10T08:29:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.225+0000 7fbe90c00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 0x7fbe7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.225+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbe8408b0c0 con 0x7fbe9406c320 2024-09-10T08:29:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.226+0000 7fbe8be00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 0x7fbe7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.226+0000 7fbe8be00640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 0x7fbe7006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe940b0780 tx=0x7fbe7c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.230+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe84059410 con 0x7fbe9406c320 2024-09-10T08:29:37.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.452+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe940ca960 con 0x7fbe9406c320 2024-09-10T08:29:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.453+0000 7fbe90c00640 1 -- 172.21.15.52:0/814264871 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7fbe8405d710 con 0x7fbe9406c320 2024-09-10T08:29:37.453 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:37.453 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"btime":"2024-09-10T08:29:37:030497+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:36.446188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:29:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-09-10T08:29:37.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 msgr2=0x7fbe7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 0x7fbe7006e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe940b0780 tx=0x7fbe7c007de0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 msgr2=0x7fbe9415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400ec10 tx=0x7fbe8400c520 comp rx=0 tx=0).stop 2024-09-10T08:29:37.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 shutdown_connections 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe7006be30 0x7fbe7006e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe94148260 0x7fbe940cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe94147e80 0x7fbe940cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 --2- 172.21.15.52:0/814264871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9406c320 0x7fbe9415e430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 >> 172.21.15.52:0/814264871 conn(0x7fbe940ccec0 msgr2=0x7fbe940c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 shutdown_connections 2024-09-10T08:29:37.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.455+0000 7fbe9b200640 1 -- 172.21.15.52:0/814264871 wait complete. 2024-09-10T08:29:37.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:29:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.628+0000 7f441c000640 1 Processor -- start 2024-09-10T08:29:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.628+0000 7f441c000640 1 -- start start 2024-09-10T08:29:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f441c000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44140b6970 0x7f44140b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f441c000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140d0e70 con 0x7f441415ed20 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f441c000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140d41c0 con 0x7f44140d23b0 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f441c000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f44140d35b0 con 0x7f44140b6970 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f4419600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f441415ed20 0x7f44140b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39322/0 (socket says 172.21.15.52:39322) 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.629+0000 7f4419600640 1 -- 172.21.15.52:0/3010130309 learned_addr learned my addr 172.21.15.52:0/3010130309 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4418c00640 1 --2- 172.21.15.52:0/3010130309 >> v2:172.21.15.176:3300/0 conn(0x7f44140b6970 0x7f44140b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158226381 0 0) 0x7f4408001110 con 0x7f441415ed20 2024-09-10T08:29:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43fc003520 con 0x7f441415ed20 2024-09-10T08:29:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4418c00640 1 -- 172.21.15.52:0/3010130309 >> v1:172.21.15.176:6789/0 conn(0x7f44140d23b0 legacy=0x7f44140b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246427732 0 0) 0x7f44140d41c0 con 0x7f44140d23b0 2024-09-10T08:29:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4418c00640 1 -- 172.21.15.52:0/3010130309 >> v1:172.21.15.52:6789/0 conn(0x7f441415ed20 legacy=0x7f44140b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.630+0000 7f4418c00640 1 -- 172.21.15.52:0/3010130309 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44140d3890 con 0x7f44140b6970 2024-09-10T08:29:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.631+0000 7f4418c00640 1 --2- 172.21.15.52:0/3010130309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140b80d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44531edbc8d28aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.631+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400037070 con 0x7f44140b6970 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4400032440 con 0x7f44140b6970 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f4413e00640 1 -- 172.21.15.52:0/3010130309 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400032810 con 0x7f44140b6970 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 -- 172.21.15.52:0/3010130309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 msgr2=0x7f44140b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 --2- 172.21.15.52:0/3010130309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140b80d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 -- 172.21.15.52:0/3010130309 shutdown_connections 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 --2- 172.21.15.52:0/3010130309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140b80d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 -- 172.21.15.52:0/3010130309 >> 172.21.15.52:0/3010130309 conn(0x7f44140d1260 msgr2=0x7f44140d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 -- 172.21.15.52:0/3010130309 shutdown_connections 2024-09-10T08:29:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.632+0000 7f441c000640 1 -- 172.21.15.52:0/3010130309 wait complete. 2024-09-10T08:29:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.634+0000 7f441c000640 1 Processor -- start 2024-09-10T08:29:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.634+0000 7f441c000640 1 -- start start 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 0x7f441415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44140d32a0 con 0x7f44140d23b0 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44140d3e50 con 0x7f44140b6970 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f441415f100 con 0x7f441415ed20 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f4418c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f4418c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59474/0 (socket says 172.21.15.52:59474) 2024-09-10T08:29:37.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f4418c00640 1 -- 172.21.15.52:0/3681139086 learned_addr learned my addr 172.21.15.52:0/3681139086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f4419600640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f4418c00640 1 -- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 msgr2=0x7f441415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.635+0000 7f441a000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 0x7f441415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4418c00640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 0x7f441415dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4418c00640 1 -- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 msgr2=0x7f44140ac720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4418c00640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140ac720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4418c00640 1 -- 172.21.15.52:0/3681139086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441415e1e0 con 0x7f44140d23b0 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4419600640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f441a000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 0x7f441415dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4418c00640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44000098c0 tx=0x7f44000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400041020 con 0x7f44140d23b0 2024-09-10T08:29:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440003d6e0 con 0x7f44140d23b0 2024-09-10T08:29:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400037040 con 0x7f44140d23b0 2024-09-10T08:29:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44140cd9a0 con 0x7f44140d23b0 2024-09-10T08:29:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.636+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44140cdf60 con 0x7f44140d23b0 2024-09-10T08:29:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.637+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44140b7010 con 0x7f44140d23b0 2024-09-10T08:29:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.638+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4400044020 con 0x7f44140d23b0 2024-09-10T08:29:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.640+0000 7f4411600640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 0x7f43f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.640+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f44000ab6d0 con 0x7f44140d23b0 2024-09-10T08:29:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.640+0000 7f4419600640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 0x7f43f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.641+0000 7f4419600640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 0x7f43f406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44080012b0 tx=0x7f4408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:37.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.644+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f440004b030 con 0x7f44140d23b0 2024-09-10T08:29:37.821 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:29:37.821+0000 7fb0bbe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:29:37.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.834+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44140b3f20 con 0x7f44140d23b0 2024-09-10T08:29:37.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.835+0000 7f4411600640 1 -- 172.21.15.52:0/3681139086 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16681 (secure 0 0 0) 0x7f440007ee20 con 0x7f44140d23b0 2024-09-10T08:29:37.836 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:37.836 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":33,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:29:35.018698+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:29:31.784586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T08:29:32.424265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:29:37.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 msgr2=0x7f43f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 0x7f43f406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f44080012b0 tx=0x7f4408009040 comp rx=0 tx=0).stop 2024-09-10T08:29:37.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 msgr2=0x7f44140cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:37.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f44000098c0 tx=0x7f44000046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 shutdown_connections 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f43f406be30 0x7f43f406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f441415ed20 0x7f441415dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44140d23b0 0x7f44140cd200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 --2- 172.21.15.52:0/3681139086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44140b6970 0x7f44140ac720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 >> 172.21.15.52:0/3681139086 conn(0x7f44140d1260 msgr2=0x7f4414161c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 shutdown_connections 2024-09-10T08:29:37.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:37.838+0000 7f441c000640 1 -- 172.21.15.52:0/3681139086 wait complete. 2024-09-10T08:29:37.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:29:37.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:38.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.009+0000 7f71e9800640 1 Processor -- start 2024-09-10T08:29:38.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.009+0000 7f71e9800640 1 -- start start 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.010+0000 7f71e9800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f71e406fe40 0x7f71e4073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.010+0000 7f71e9800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e41631c0 con 0x7f71e415e790 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.010+0000 7f71e9800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e40ae9a0 con 0x7f71e4162c60 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.010+0000 7f71e9800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f71e415eb70 con 0x7f71e406fe40 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e2a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f71e415e790 0x7f71e40b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39336/0 (socket says 172.21.15.52:39336) 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e2a00640 1 -- 172.21.15.52:0/4148004874 learned_addr learned my addr 172.21.15.52:0/4148004874 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e3400640 1 --2- 172.21.15.52:0/4148004874 >> v2:172.21.15.176:3300/0 conn(0x7f71e406fe40 0x7f71e4073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e3400640 1 -- 172.21.15.52:0/4148004874 >> v1:172.21.15.176:6789/0 conn(0x7f71e4162c60 legacy=0x7f71e406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e3400640 1 -- 172.21.15.52:0/4148004874 >> v1:172.21.15.52:6789/0 conn(0x7f71e415e790 legacy=0x7f71e40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.011+0000 7f71e3400640 1 -- 172.21.15.52:0/4148004874 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e40aec40 con 0x7f71e406fe40 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.012+0000 7f71e3400640 1 --2- 172.21.15.52:0/4148004874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e4073a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009d90 tx=0x7f71dc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6103230d25d97483 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.012+0000 7f71e2000640 1 -- 172.21.15.52:0/4148004874 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc007740 con 0x7f71e406fe40 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e2000640 1 -- 172.21.15.52:0/4148004874 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc0078e0 con 0x7f71e406fe40 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e2000640 1 -- 172.21.15.52:0/4148004874 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc007cb0 con 0x7f71e406fe40 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 -- 172.21.15.52:0/4148004874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 msgr2=0x7f71e4073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 --2- 172.21.15.52:0/4148004874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e4073a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009d90 tx=0x7f71dc02a660 comp rx=0 tx=0).stop 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 -- 172.21.15.52:0/4148004874 shutdown_connections 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 --2- 172.21.15.52:0/4148004874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e4073a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 -- 172.21.15.52:0/4148004874 >> 172.21.15.52:0/4148004874 conn(0x7f71e40b0a80 msgr2=0x7f71e40b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 -- 172.21.15.52:0/4148004874 shutdown_connections 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.013+0000 7f71e9800640 1 -- 172.21.15.52:0/4148004874 wait complete. 2024-09-10T08:29:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.015+0000 7f71e9800640 1 Processor -- start 2024-09-10T08:29:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.015+0000 7f71e9800640 1 -- start start 2024-09-10T08:29:38.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e414b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e790 0x7f71e40cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40b5b40 con 0x7f71e4162c60 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40af200 con 0x7f71e406fe40 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e9800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71e406f430 con 0x7f71e415e790 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59480/0 (socket says 172.21.15.52:59480) 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 -- 172.21.15.52:0/2139110515 learned_addr learned my addr 172.21.15.52:0/2139110515 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e2a00640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e414b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71dbe00640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e790 0x7f71e40cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 -- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e790 msgr2=0x7f71e40cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e790 0x7f71e40cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 -- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 msgr2=0x7f71e414b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e414b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.016+0000 7f71e3400640 1 -- 172.21.15.52:0/2139110515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e4152130 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71e3400640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009eb0 tx=0x7f71dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc040070 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc031c90 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e4158a50 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc045680 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.017+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e4151e10 con 0x7f71e4162c60 2024-09-10T08:29:38.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.018+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e4158860 con 0x7f71e4162c60 2024-09-10T08:29:38.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.019+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71dc039040 con 0x7f71e4162c60 2024-09-10T08:29:38.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.020+0000 7f71daa00640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 0x7f71c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.020+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f71dc0ac830 con 0x7f71e4162c60 2024-09-10T08:29:38.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.020+0000 7f71e2a00640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 0x7f71c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.021+0000 7f71e2a00640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 0x7f71c006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005880 tx=0x7f71d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.025+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71dc07b3b0 con 0x7f71e4162c60 2024-09-10T08:29:38.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.211+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71e4073a40 con 0x7f71c006be30 2024-09-10T08:29:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.219+0000 7f71daa00640 1 -- 172.21.15.52:0/2139110515 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251477 (secure 0 0 0) 0x7f71e4073a40 con 0x7f71c006be30 2024-09-10T08:29:38.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:29:38.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 msgr2=0x7f71c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 0x7f71c006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f71d4005880 tx=0x7f71d4009040 comp rx=0 tx=0).stop 2024-09-10T08:29:38.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 msgr2=0x7f71e41518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009eb0 tx=0x7f71dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 shutdown_connections 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71c006be30 0x7f71c006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71e4162c60 0x7f71e41518d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e790 0x7f71e40cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 --2- 172.21.15.52:0/2139110515 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e406fe40 0x7f71e414b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 >> 172.21.15.52:0/2139110515 conn(0x7f71e40b0a80 msgr2=0x7f71e40b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:38.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 shutdown_connections 2024-09-10T08:29:38.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.223+0000 7f71e9800640 1 -- 172.21.15.52:0/2139110515 wait complete. 2024-09-10T08:29:38.238 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-10T08:29:37.462714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240996,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733724,"statfs":{"total":773094113280,"available":772847333376,"internally_reserved":0,"allocated":4042752,"data_stored":2238060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.466606"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053977+0000","last_change":"2024-09-10T08:29:34.050800+0000","last_active":"2024-09-10T08:29:34.053977+0000","last_peered":"2024-09-10T08:29:34.053977+0000","last_clean":"2024-09-10T08:29:34.053977+0000","last_became_active":"2024-09-10T08:29:34.050515+0000","last_became_peered":"2024-09-10T08:29:34.050515+0000","last_unstale":"2024-09-10T08:29:34.053977+0000","last_undegraded":"2024-09-10T08:29:34.053977+0000","last_fullsized":"2024-09-10T08:29:34.053977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011260+0000","last_change":"2024-09-10T08:29:33.011260+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011260+0000","last_undegraded":"2024-09-10T08:29:33.011260+0000","last_fullsized":"2024-09-10T08:29:33.011260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040297+0000","last_change":"2024-09-10T08:29:34.032147+0000","last_active":"2024-09-10T08:29:34.040297+0000","last_peered":"2024-09-10T08:29:34.040297+0000","last_clean":"2024-09-10T08:29:34.040297+0000","last_became_active":"2024-09-10T08:29:34.031869+0000","last_became_peered":"2024-09-10T08:29:34.031869+0000","last_unstale":"2024-09-10T08:29:34.040297+0000","last_undegraded":"2024-09-10T08:29:34.040297+0000","last_fullsized":"2024-09-10T08:29:34.040297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:07.111302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046602+0000","last_change":"2024-09-10T08:29:34.043864+0000","last_active":"2024-09-10T08:29:34.046602+0000","last_peered":"2024-09-10T08:29:34.046602+0000","last_clean":"2024-09-10T08:29:34.046602+0000","last_became_active":"2024-09-10T08:29:34.041475+0000","last_became_peered":"2024-09-10T08:29:34.041475+0000","last_unstale":"2024-09-10T08:29:34.046602+0000","last_undegraded":"2024-09-10T08:29:34.046602+0000","last_fullsized":"2024-09-10T08:29:34.046602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015866+0000","last_change":"2024-09-10T08:29:33.015866+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015866+0000","last_undegraded":"2024-09-10T08:29:33.015866+0000","last_fullsized":"2024-09-10T08:29:33.015866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043370+0000","last_change":"2024-09-10T08:29:34.039947+0000","last_active":"2024-09-10T08:29:34.043370+0000","last_peered":"2024-09-10T08:29:34.043370+0000","last_clean":"2024-09-10T08:29:34.043370+0000","last_became_active":"2024-09-10T08:29:34.039425+0000","last_became_peered":"2024-09-10T08:29:34.039425+0000","last_unstale":"2024-09-10T08:29:34.043370+0000","last_undegraded":"2024-09-10T08:29:34.043370+0000","last_fullsized":"2024-09-10T08:29:34.043370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039018+0000","last_change":"2024-09-10T08:29:34.035820+0000","last_active":"2024-09-10T08:29:34.039018+0000","last_peered":"2024-09-10T08:29:34.039018+0000","last_clean":"2024-09-10T08:29:34.039018+0000","last_became_active":"2024-09-10T08:29:34.035530+0000","last_became_peered":"2024-09-10T08:29:34.035530+0000","last_unstale":"2024-09-10T08:29:34.039018+0000","last_undegraded":"2024-09-10T08:29:34.039018+0000","last_fullsized":"2024-09-10T08:29:34.039018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:04.478284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036860+0000","last_change":"2024-09-10T08:29:34.032026+0000","last_active":"2024-09-10T08:29:34.036860+0000","last_peered":"2024-09-10T08:29:34.036860+0000","last_clean":"2024-09-10T08:29:34.036860+0000","last_became_active":"2024-09-10T08:29:34.031828+0000","last_became_peered":"2024-09-10T08:29:34.031828+0000","last_unstale":"2024-09-10T08:29:34.036860+0000","last_undegraded":"2024-09-10T08:29:34.036860+0000","last_fullsized":"2024-09-10T08:29:34.036860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048214+0000","last_change":"2024-09-10T08:29:34.044053+0000","last_active":"2024-09-10T08:29:34.048214+0000","last_peered":"2024-09-10T08:29:34.048214+0000","last_clean":"2024-09-10T08:29:34.048214+0000","last_became_active":"2024-09-10T08:29:34.043402+0000","last_became_peered":"2024-09-10T08:29:34.043402+0000","last_unstale":"2024-09-10T08:29:34.048214+0000","last_undegraded":"2024-09-10T08:29:34.048214+0000","last_fullsized":"2024-09-10T08:29:34.048214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:49.509388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036899+0000","last_change":"2024-09-10T08:29:34.034386+0000","last_active":"2024-09-10T08:29:34.036899+0000","last_peered":"2024-09-10T08:29:34.036899+0000","last_clean":"2024-09-10T08:29:34.036899+0000","last_became_active":"2024-09-10T08:29:34.034034+0000","last_became_peered":"2024-09-10T08:29:34.034034+0000","last_unstale":"2024-09-10T08:29:34.036899+0000","last_undegraded":"2024-09-10T08:29:34.036899+0000","last_fullsized":"2024-09-10T08:29:34.036899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041062+0000","last_change":"2024-09-10T08:29:34.035547+0000","last_active":"2024-09-10T08:29:34.041062+0000","last_peered":"2024-09-10T08:29:34.041062+0000","last_clean":"2024-09-10T08:29:34.041062+0000","last_became_active":"2024-09-10T08:29:34.035248+0000","last_became_peered":"2024-09-10T08:29:34.035248+0000","last_unstale":"2024-09-10T08:29:34.041062+0000","last_undegraded":"2024-09-10T08:29:34.041062+0000","last_fullsized":"2024-09-10T08:29:34.041062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:33.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040316+0000","last_change":"2024-09-10T08:29:34.037847+0000","last_active":"2024-09-10T08:29:34.040316+0000","last_peered":"2024-09-10T08:29:34.040316+0000","last_clean":"2024-09-10T08:29:34.040316+0000","last_became_active":"2024-09-10T08:29:34.036896+0000","last_became_peered":"2024-09-10T08:29:34.036896+0000","last_unstale":"2024-09-10T08:29:34.040316+0000","last_undegraded":"2024-09-10T08:29:34.040316+0000","last_fullsized":"2024-09-10T08:29:34.040316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:55.409697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043840+0000","last_change":"2024-09-10T08:29:34.037905+0000","last_active":"2024-09-10T08:29:34.043840+0000","last_peered":"2024-09-10T08:29:34.043840+0000","last_clean":"2024-09-10T08:29:34.043840+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.043840+0000","last_undegraded":"2024-09-10T08:29:34.043840+0000","last_fullsized":"2024-09-10T08:29:34.043840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.034400+0000","last_change":"2024-09-10T08:29:34.031148+0000","last_active":"2024-09-10T08:29:34.034400+0000","last_peered":"2024-09-10T08:29:34.034400+0000","last_clean":"2024-09-10T08:29:34.034400+0000","last_became_active":"2024-09-10T08:29:34.030897+0000","last_became_peered":"2024-09-10T08:29:34.030897+0000","last_unstale":"2024-09-10T08:29:34.034400+0000","last_undegraded":"2024-09-10T08:29:34.034400+0000","last_fullsized":"2024-09-10T08:29:34.034400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040141+0000","last_change":"2024-09-10T08:29:34.037889+0000","last_active":"2024-09-10T08:29:34.040141+0000","last_peered":"2024-09-10T08:29:34.040141+0000","last_clean":"2024-09-10T08:29:34.040141+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.040141+0000","last_undegraded":"2024-09-10T08:29:34.040141+0000","last_fullsized":"2024-09-10T08:29:34.040141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043902+0000","last_change":"2024-09-10T08:29:34.040898+0000","last_active":"2024-09-10T08:29:34.043902+0000","last_peered":"2024-09-10T08:29:34.043902+0000","last_clean":"2024-09-10T08:29:34.043902+0000","last_became_active":"2024-09-10T08:29:34.040166+0000","last_became_peered":"2024-09-10T08:29:34.040166+0000","last_unstale":"2024-09-10T08:29:34.043902+0000","last_undegraded":"2024-09-10T08:29:34.043902+0000","last_fullsized":"2024-09-10T08:29:34.043902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039039+0000","last_change":"2024-09-10T08:29:34.023343+0000","last_active":"2024-09-10T08:29:34.039039+0000","last_peered":"2024-09-10T08:29:34.039039+0000","last_clean":"2024-09-10T08:29:34.039039+0000","last_became_active":"2024-09-10T08:29:34.023036+0000","last_became_peered":"2024-09-10T08:29:34.023036+0000","last_unstale":"2024-09-10T08:29:34.039039+0000","last_undegraded":"2024-09-10T08:29:34.039039+0000","last_fullsized":"2024-09-10T08:29:34.039039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:43.993961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037399+0000","last_change":"2024-09-10T08:29:34.033658+0000","last_active":"2024-09-10T08:29:34.037399+0000","last_peered":"2024-09-10T08:29:34.037399+0000","last_clean":"2024-09-10T08:29:34.037399+0000","last_became_active":"2024-09-10T08:29:34.033379+0000","last_became_peered":"2024-09-10T08:29:34.033379+0000","last_unstale":"2024-09-10T08:29:34.037399+0000","last_undegraded":"2024-09-10T08:29:34.037399+0000","last_fullsized":"2024-09-10T08:29:34.037399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046363+0000","last_change":"2024-09-10T08:29:34.042026+0000","last_active":"2024-09-10T08:29:34.046363+0000","last_peered":"2024-09-10T08:29:34.046363+0000","last_clean":"2024-09-10T08:29:34.046363+0000","last_became_active":"2024-09-10T08:29:34.041674+0000","last_became_peered":"2024-09-10T08:29:34.041674+0000","last_unstale":"2024-09-10T08:29:34.046363+0000","last_undegraded":"2024-09-10T08:29:34.046363+0000","last_fullsized":"2024-09-10T08:29:34.046363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:20.274879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045151+0000","last_change":"2024-09-10T08:29:34.039736+0000","last_active":"2024-09-10T08:29:34.045151+0000","last_peered":"2024-09-10T08:29:34.045151+0000","last_clean":"2024-09-10T08:29:34.045151+0000","last_became_active":"2024-09-10T08:29:34.039447+0000","last_became_peered":"2024-09-10T08:29:34.039447+0000","last_unstale":"2024-09-10T08:29:34.045151+0000","last_undegraded":"2024-09-10T08:29:34.045151+0000","last_fullsized":"2024-09-10T08:29:34.045151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054596+0000","last_change":"2024-09-10T08:29:34.048898+0000","last_active":"2024-09-10T08:29:34.054596+0000","last_peered":"2024-09-10T08:29:34.054596+0000","last_clean":"2024-09-10T08:29:34.054596+0000","last_became_active":"2024-09-10T08:29:34.039978+0000","last_became_peered":"2024-09-10T08:29:34.039978+0000","last_unstale":"2024-09-10T08:29:34.054596+0000","last_undegraded":"2024-09-10T08:29:34.054596+0000","last_fullsized":"2024-09-10T08:29:34.054596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036710+0000","last_change":"2024-09-10T08:29:34.027611+0000","last_active":"2024-09-10T08:29:34.036710+0000","last_peered":"2024-09-10T08:29:34.036710+0000","last_clean":"2024-09-10T08:29:34.036710+0000","last_became_active":"2024-09-10T08:29:34.027316+0000","last_became_peered":"2024-09-10T08:29:34.027316+0000","last_unstale":"2024-09-10T08:29:34.036710+0000","last_undegraded":"2024-09-10T08:29:34.036710+0000","last_fullsized":"2024-09-10T08:29:34.036710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048984+0000","last_change":"2024-09-10T08:29:34.043504+0000","last_active":"2024-09-10T08:29:34.048984+0000","last_peered":"2024-09-10T08:29:34.048984+0000","last_clean":"2024-09-10T08:29:34.048984+0000","last_became_active":"2024-09-10T08:29:34.042661+0000","last_became_peered":"2024-09-10T08:29:34.042661+0000","last_unstale":"2024-09-10T08:29:34.048984+0000","last_undegraded":"2024-09-10T08:29:34.048984+0000","last_fullsized":"2024-09-10T08:29:34.048984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052679+0000","last_change":"2024-09-10T08:29:34.036454+0000","last_active":"2024-09-10T08:29:34.052679+0000","last_peered":"2024-09-10T08:29:34.052679+0000","last_clean":"2024-09-10T08:29:34.052679+0000","last_became_active":"2024-09-10T08:29:34.036101+0000","last_became_peered":"2024-09-10T08:29:34.036101+0000","last_unstale":"2024-09-10T08:29:34.052679+0000","last_undegraded":"2024-09-10T08:29:34.052679+0000","last_fullsized":"2024-09-10T08:29:34.052679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032825+0000","last_change":"2024-09-10T08:29:34.030162+0000","last_active":"2024-09-10T08:29:34.032825+0000","last_peered":"2024-09-10T08:29:34.032825+0000","last_clean":"2024-09-10T08:29:34.032825+0000","last_became_active":"2024-09-10T08:29:34.029892+0000","last_became_peered":"2024-09-10T08:29:34.029892+0000","last_unstale":"2024-09-10T08:29:34.032825+0000","last_undegraded":"2024-09-10T08:29:34.032825+0000","last_fullsized":"2024-09-10T08:29:34.032825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.035273+0000","last_change":"2024-09-10T08:29:34.024246+0000","last_active":"2024-09-10T08:29:34.035273+0000","last_peered":"2024-09-10T08:29:34.035273+0000","last_clean":"2024-09-10T08:29:34.035273+0000","last_became_active":"2024-09-10T08:29:34.023898+0000","last_became_peered":"2024-09-10T08:29:34.023898+0000","last_unstale":"2024-09-10T08:29:34.035273+0000","last_undegraded":"2024-09-10T08:29:34.035273+0000","last_fullsized":"2024-09-10T08:29:34.035273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011836+0000","last_change":"2024-09-10T08:29:33.011836+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011836+0000","last_undegraded":"2024-09-10T08:29:33.011836+0000","last_fullsized":"2024-09-10T08:29:33.011836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048276+0000","last_change":"2024-09-10T08:29:34.033479+0000","last_active":"2024-09-10T08:29:34.048276+0000","last_peered":"2024-09-10T08:29:34.048276+0000","last_clean":"2024-09-10T08:29:34.048276+0000","last_became_active":"2024-09-10T08:29:34.033007+0000","last_became_peered":"2024-09-10T08:29:34.033007+0000","last_unstale":"2024-09-10T08:29:34.048276+0000","last_undegraded":"2024-09-10T08:29:34.048276+0000","last_fullsized":"2024-09-10T08:29:34.048276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049296+0000","last_change":"2024-09-10T08:29:34.038693+0000","last_active":"2024-09-10T08:29:34.049296+0000","last_peered":"2024-09-10T08:29:34.049296+0000","last_clean":"2024-09-10T08:29:34.049296+0000","last_became_active":"2024-09-10T08:29:34.038418+0000","last_became_peered":"2024-09-10T08:29:34.038418+0000","last_unstale":"2024-09-10T08:29:34.049296+0000","last_undegraded":"2024-09-10T08:29:34.049296+0000","last_fullsized":"2024-09-10T08:29:34.049296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045846+0000","last_change":"2024-09-10T08:29:34.043411+0000","last_active":"2024-09-10T08:29:34.045846+0000","last_peered":"2024-09-10T08:29:34.045846+0000","last_clean":"2024-09-10T08:29:34.045846+0000","last_became_active":"2024-09-10T08:29:34.042873+0000","last_became_peered":"2024-09-10T08:29:34.042873+0000","last_unstale":"2024-09-10T08:29:34.045846+0000","last_undegraded":"2024-09-10T08:29:34.045846+0000","last_fullsized":"2024-09-10T08:29:34.045846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052450+0000","last_change":"2024-09-10T08:29:34.036484+0000","last_active":"2024-09-10T08:29:34.052450+0000","last_peered":"2024-09-10T08:29:34.052450+0000","last_clean":"2024-09-10T08:29:34.052450+0000","last_became_active":"2024-09-10T08:29:34.036196+0000","last_became_peered":"2024-09-10T08:29:34.036196+0000","last_unstale":"2024-09-10T08:29:34.052450+0000","last_undegraded":"2024-09-10T08:29:34.052450+0000","last_fullsized":"2024-09-10T08:29:34.052450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039363+0000","last_change":"2024-09-10T08:29:34.023550+0000","last_active":"2024-09-10T08:29:34.039363+0000","last_peered":"2024-09-10T08:29:34.039363+0000","last_clean":"2024-09-10T08:29:34.039363+0000","last_became_active":"2024-09-10T08:29:34.023253+0000","last_became_peered":"2024-09-10T08:29:34.023253+0000","last_unstale":"2024-09-10T08:29:34.039363+0000","last_undegraded":"2024-09-10T08:29:34.039363+0000","last_fullsized":"2024-09-10T08:29:34.039363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:54.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036626+0000","last_change":"2024-09-10T08:29:34.030313+0000","last_active":"2024-09-10T08:29:34.036626+0000","last_peered":"2024-09-10T08:29:34.036626+0000","last_clean":"2024-09-10T08:29:34.036626+0000","last_became_active":"2024-09-10T08:29:34.029987+0000","last_became_peered":"2024-09-10T08:29:34.029987+0000","last_unstale":"2024-09-10T08:29:34.036626+0000","last_undegraded":"2024-09-10T08:29:34.036626+0000","last_fullsized":"2024-09-10T08:29:34.036626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053023+0000","last_change":"2024-09-10T08:29:33.022598+0000","last_active":"2024-09-10T08:29:34.053023+0000","last_peered":"2024-09-10T08:29:34.053023+0000","last_clean":"2024-09-10T08:29:34.053023+0000","last_became_active":"2024-09-10T08:29:33.022302+0000","last_became_peered":"2024-09-10T08:29:33.022302+0000","last_unstale":"2024-09-10T08:29:34.053023+0000","last_undegraded":"2024-09-10T08:29:34.053023+0000","last_fullsized":"2024-09-10T08:29:34.053023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:20.408155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053197+0000","last_change":"2024-09-10T08:29:34.038139+0000","last_active":"2024-09-10T08:29:34.053197+0000","last_peered":"2024-09-10T08:29:34.053197+0000","last_clean":"2024-09-10T08:29:34.053197+0000","last_became_active":"2024-09-10T08:29:34.037740+0000","last_became_peered":"2024-09-10T08:29:34.037740+0000","last_unstale":"2024-09-10T08:29:34.053197+0000","last_undegraded":"2024-09-10T08:29:34.053197+0000","last_fullsized":"2024-09-10T08:29:34.053197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054715+0000","last_change":"2024-09-10T08:29:33.022704+0000","last_active":"2024-09-10T08:29:34.054715+0000","last_peered":"2024-09-10T08:29:34.054715+0000","last_clean":"2024-09-10T08:29:34.054715+0000","last_became_active":"2024-09-10T08:29:33.021966+0000","last_became_peered":"2024-09-10T08:29:33.021966+0000","last_unstale":"2024-09-10T08:29:34.054715+0000","last_undegraded":"2024-09-10T08:29:34.054715+0000","last_fullsized":"2024-09-10T08:29:34.054715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048250+0000","last_change":"2024-09-10T08:29:34.026982+0000","last_active":"2024-09-10T08:29:34.048250+0000","last_peered":"2024-09-10T08:29:34.048250+0000","last_clean":"2024-09-10T08:29:34.048250+0000","last_became_active":"2024-09-10T08:29:34.026660+0000","last_became_peered":"2024-09-10T08:29:34.026660+0000","last_unstale":"2024-09-10T08:29:34.048250+0000","last_undegraded":"2024-09-10T08:29:34.048250+0000","last_fullsized":"2024-09-10T08:29:34.048250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060566+0000","last_change":"2024-09-10T08:29:33.021777+0000","last_active":"2024-09-10T08:29:34.060566+0000","last_peered":"2024-09-10T08:29:34.060566+0000","last_clean":"2024-09-10T08:29:34.060566+0000","last_became_active":"2024-09-10T08:29:33.021502+0000","last_became_peered":"2024-09-10T08:29:33.021502+0000","last_unstale":"2024-09-10T08:29:34.060566+0000","last_undegraded":"2024-09-10T08:29:34.060566+0000","last_fullsized":"2024-09-10T08:29:34.060566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:34.767107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037102+0000","last_change":"2024-09-10T08:29:34.034652+0000","last_active":"2024-09-10T08:29:34.037102+0000","last_peered":"2024-09-10T08:29:34.037102+0000","last_clean":"2024-09-10T08:29:34.037102+0000","last_became_active":"2024-09-10T08:29:34.034324+0000","last_became_peered":"2024-09-10T08:29:34.034324+0000","last_unstale":"2024-09-10T08:29:34.037102+0000","last_undegraded":"2024-09-10T08:29:34.037102+0000","last_fullsized":"2024-09-10T08:29:34.037102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055947+0000","last_change":"2024-09-10T08:29:33.022304+0000","last_active":"2024-09-10T08:29:34.055947+0000","last_peered":"2024-09-10T08:29:34.055947+0000","last_clean":"2024-09-10T08:29:34.055947+0000","last_became_active":"2024-09-10T08:29:33.022083+0000","last_became_peered":"2024-09-10T08:29:33.022083+0000","last_unstale":"2024-09-10T08:29:34.055947+0000","last_undegraded":"2024-09-10T08:29:34.055947+0000","last_fullsized":"2024-09-10T08:29:34.055947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:00.602457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049083+0000","last_change":"2024-09-10T08:29:34.045812+0000","last_active":"2024-09-10T08:29:34.049083+0000","last_peered":"2024-09-10T08:29:34.049083+0000","last_clean":"2024-09-10T08:29:34.049083+0000","last_became_active":"2024-09-10T08:29:34.045608+0000","last_became_peered":"2024-09-10T08:29:34.045608+0000","last_unstale":"2024-09-10T08:29:34.049083+0000","last_undegraded":"2024-09-10T08:29:34.049083+0000","last_fullsized":"2024-09-10T08:29:34.049083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.057630+0000","last_change":"2024-09-10T08:29:33.024403+0000","last_active":"2024-09-10T08:29:34.057630+0000","last_peered":"2024-09-10T08:29:34.057630+0000","last_clean":"2024-09-10T08:29:34.057630+0000","last_became_active":"2024-09-10T08:29:33.023478+0000","last_became_peered":"2024-09-10T08:29:33.023478+0000","last_unstale":"2024-09-10T08:29:34.057630+0000","last_undegraded":"2024-09-10T08:29:34.057630+0000","last_fullsized":"2024-09-10T08:29:34.057630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053926+0000","last_change":"2024-09-10T08:29:34.049858+0000","last_active":"2024-09-10T08:29:34.053926+0000","last_peered":"2024-09-10T08:29:34.053926+0000","last_clean":"2024-09-10T08:29:34.053926+0000","last_became_active":"2024-09-10T08:29:34.036503+0000","last_became_peered":"2024-09-10T08:29:34.036503+0000","last_unstale":"2024-09-10T08:29:34.053926+0000","last_undegraded":"2024-09-10T08:29:34.053926+0000","last_fullsized":"2024-09-10T08:29:34.053926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.056845+0000","last_change":"2024-09-10T08:29:33.028410+0000","last_active":"2024-09-10T08:29:34.056845+0000","last_peered":"2024-09-10T08:29:34.056845+0000","last_clean":"2024-09-10T08:29:34.056845+0000","last_became_active":"2024-09-10T08:29:33.026040+0000","last_became_peered":"2024-09-10T08:29:33.026040+0000","last_unstale":"2024-09-10T08:29:34.056845+0000","last_undegraded":"2024-09-10T08:29:34.056845+0000","last_fullsized":"2024-09-10T08:29:34.056845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049142+0000","last_change":"2024-09-10T08:29:34.044121+0000","last_active":"2024-09-10T08:29:34.049142+0000","last_peered":"2024-09-10T08:29:34.049142+0000","last_clean":"2024-09-10T08:29:34.049142+0000","last_became_active":"2024-09-10T08:29:34.043839+0000","last_became_peered":"2024-09-10T08:29:34.043839+0000","last_unstale":"2024-09-10T08:29:34.049142+0000","last_undegraded":"2024-09-10T08:29:34.049142+0000","last_fullsized":"2024-09-10T08:29:34.049142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:35.771620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022302+0000","last_change":"2024-09-10T08:29:33.024132+0000","last_active":"2024-09-10T08:29:34.022302+0000","last_peered":"2024-09-10T08:29:34.022302+0000","last_clean":"2024-09-10T08:29:34.022302+0000","last_became_active":"2024-09-10T08:29:33.023879+0000","last_became_peered":"2024-09-10T08:29:33.023879+0000","last_unstale":"2024-09-10T08:29:34.022302+0000","last_undegraded":"2024-09-10T08:29:34.022302+0000","last_fullsized":"2024-09-10T08:29:34.022302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:54.405184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031899+0000","last_change":"2024-09-10T08:29:34.027671+0000","last_active":"2024-09-10T08:29:34.031899+0000","last_peered":"2024-09-10T08:29:34.031899+0000","last_clean":"2024-09-10T08:29:34.031899+0000","last_became_active":"2024-09-10T08:29:34.027289+0000","last_became_peered":"2024-09-10T08:29:34.027289+0000","last_unstale":"2024-09-10T08:29:34.031899+0000","last_undegraded":"2024-09-10T08:29:34.031899+0000","last_fullsized":"2024-09-10T08:29:34.031899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014607+0000","last_change":"2024-09-10T08:29:33.020211+0000","last_active":"2024-09-10T08:29:34.014607+0000","last_peered":"2024-09-10T08:29:34.014607+0000","last_clean":"2024-09-10T08:29:34.014607+0000","last_became_active":"2024-09-10T08:29:33.019698+0000","last_became_peered":"2024-09-10T08:29:33.019698+0000","last_unstale":"2024-09-10T08:29:34.014607+0000","last_undegraded":"2024-09-10T08:29:34.014607+0000","last_fullsized":"2024-09-10T08:29:34.014607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.545431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039052+0000","last_change":"2024-09-10T08:29:34.031164+0000","last_active":"2024-09-10T08:29:34.039052+0000","last_peered":"2024-09-10T08:29:34.039052+0000","last_clean":"2024-09-10T08:29:34.039052+0000","last_became_active":"2024-09-10T08:29:34.030791+0000","last_became_peered":"2024-09-10T08:29:34.030791+0000","last_unstale":"2024-09-10T08:29:34.039052+0000","last_undegraded":"2024-09-10T08:29:34.039052+0000","last_fullsized":"2024-09-10T08:29:34.039052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:53.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032910+0000","last_change":"2024-09-10T08:29:33.025504+0000","last_active":"2024-09-10T08:29:33.032910+0000","last_peered":"2024-09-10T08:29:33.032910+0000","last_clean":"2024-09-10T08:29:33.032910+0000","last_became_active":"2024-09-10T08:29:33.025250+0000","last_became_peered":"2024-09-10T08:29:33.025250+0000","last_unstale":"2024-09-10T08:29:33.032910+0000","last_undegraded":"2024-09-10T08:29:33.032910+0000","last_fullsized":"2024-09-10T08:29:33.032910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039895+0000","last_change":"2024-09-10T08:29:34.035478+0000","last_active":"2024-09-10T08:29:34.039895+0000","last_peered":"2024-09-10T08:29:34.039895+0000","last_clean":"2024-09-10T08:29:34.039895+0000","last_became_active":"2024-09-10T08:29:34.035094+0000","last_became_peered":"2024-09-10T08:29:34.035094+0000","last_unstale":"2024-09-10T08:29:34.039895+0000","last_undegraded":"2024-09-10T08:29:34.039895+0000","last_fullsized":"2024-09-10T08:29:34.039895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.029615+0000","last_change":"2024-09-10T08:29:33.022012+0000","last_active":"2024-09-10T08:29:33.029615+0000","last_peered":"2024-09-10T08:29:33.029615+0000","last_clean":"2024-09-10T08:29:33.029615+0000","last_became_active":"2024-09-10T08:29:33.021732+0000","last_became_peered":"2024-09-10T08:29:33.021732+0000","last_unstale":"2024-09-10T08:29:33.029615+0000","last_undegraded":"2024-09-10T08:29:33.029615+0000","last_fullsized":"2024-09-10T08:29:33.029615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:25.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031828+0000","last_change":"2024-09-10T08:29:34.027098+0000","last_active":"2024-09-10T08:29:34.031828+0000","last_peered":"2024-09-10T08:29:34.031828+0000","last_clean":"2024-09-10T08:29:34.031828+0000","last_became_active":"2024-09-10T08:29:34.026819+0000","last_became_peered":"2024-09-10T08:29:34.026819+0000","last_unstale":"2024-09-10T08:29:34.031828+0000","last_undegraded":"2024-09-10T08:29:34.031828+0000","last_fullsized":"2024-09-10T08:29:34.031828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052258+0000","last_change":"2024-09-10T08:29:33.024226+0000","last_active":"2024-09-10T08:29:34.052258+0000","last_peered":"2024-09-10T08:29:34.052258+0000","last_clean":"2024-09-10T08:29:34.052258+0000","last_became_active":"2024-09-10T08:29:33.023927+0000","last_became_peered":"2024-09-10T08:29:33.023927+0000","last_unstale":"2024-09-10T08:29:34.052258+0000","last_undegraded":"2024-09-10T08:29:34.052258+0000","last_fullsized":"2024-09-10T08:29:34.052258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.814661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031055+0000","last_change":"2024-09-10T08:29:34.028666+0000","last_active":"2024-09-10T08:29:34.031055+0000","last_peered":"2024-09-10T08:29:34.031055+0000","last_clean":"2024-09-10T08:29:34.031055+0000","last_became_active":"2024-09-10T08:29:34.023390+0000","last_became_peered":"2024-09-10T08:29:34.023390+0000","last_unstale":"2024-09-10T08:29:34.031055+0000","last_undegraded":"2024-09-10T08:29:34.031055+0000","last_fullsized":"2024-09-10T08:29:34.031055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:07.098553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060807+0000","last_change":"2024-09-10T08:29:33.024849+0000","last_active":"2024-09-10T08:29:34.060807+0000","last_peered":"2024-09-10T08:29:34.060807+0000","last_clean":"2024-09-10T08:29:34.060807+0000","last_became_active":"2024-09-10T08:29:33.024498+0000","last_became_peered":"2024-09-10T08:29:33.024498+0000","last_unstale":"2024-09-10T08:29:34.060807+0000","last_undegraded":"2024-09-10T08:29:34.060807+0000","last_fullsized":"2024-09-10T08:29:34.060807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046736+0000","last_change":"2024-09-10T08:29:34.043288+0000","last_active":"2024-09-10T08:29:34.046736+0000","last_peered":"2024-09-10T08:29:34.046736+0000","last_clean":"2024-09-10T08:29:34.046736+0000","last_became_active":"2024-09-10T08:29:34.042465+0000","last_became_peered":"2024-09-10T08:29:34.042465+0000","last_unstale":"2024-09-10T08:29:34.046736+0000","last_undegraded":"2024-09-10T08:29:34.046736+0000","last_fullsized":"2024-09-10T08:29:34.046736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058825+0000","last_change":"2024-09-10T08:29:33.028081+0000","last_active":"2024-09-10T08:29:34.058825+0000","last_peered":"2024-09-10T08:29:34.058825+0000","last_clean":"2024-09-10T08:29:34.058825+0000","last_became_active":"2024-09-10T08:29:33.027897+0000","last_became_peered":"2024-09-10T08:29:33.027897+0000","last_unstale":"2024-09-10T08:29:34.058825+0000","last_undegraded":"2024-09-10T08:29:34.058825+0000","last_fullsized":"2024-09-10T08:29:34.058825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:34.318695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051885+0000","last_change":"2024-09-10T08:29:34.045109+0000","last_active":"2024-09-10T08:29:34.051885+0000","last_peered":"2024-09-10T08:29:34.051885+0000","last_clean":"2024-09-10T08:29:34.051885+0000","last_became_active":"2024-09-10T08:29:34.043753+0000","last_became_peered":"2024-09-10T08:29:34.043753+0000","last_unstale":"2024-09-10T08:29:34.051885+0000","last_undegraded":"2024-09-10T08:29:34.051885+0000","last_fullsized":"2024-09-10T08:29:34.051885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015902+0000","last_change":"2024-09-10T08:29:33.024567+0000","last_active":"2024-09-10T08:29:34.015902+0000","last_peered":"2024-09-10T08:29:34.015902+0000","last_clean":"2024-09-10T08:29:34.015902+0000","last_became_active":"2024-09-10T08:29:33.024300+0000","last_became_peered":"2024-09-10T08:29:33.024300+0000","last_unstale":"2024-09-10T08:29:34.015902+0000","last_undegraded":"2024-09-10T08:29:34.015902+0000","last_fullsized":"2024-09-10T08:29:34.015902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:35.895300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036800+0000","last_change":"2024-09-10T08:29:34.029898+0000","last_active":"2024-09-10T08:29:34.036800+0000","last_peered":"2024-09-10T08:29:34.036800+0000","last_clean":"2024-09-10T08:29:34.036800+0000","last_became_active":"2024-09-10T08:29:34.025811+0000","last_became_peered":"2024-09-10T08:29:34.025811+0000","last_unstale":"2024-09-10T08:29:34.036800+0000","last_undegraded":"2024-09-10T08:29:34.036800+0000","last_fullsized":"2024-09-10T08:29:34.036800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015430+0000","last_change":"2024-09-10T08:29:33.027465+0000","last_active":"2024-09-10T08:29:34.015430+0000","last_peered":"2024-09-10T08:29:34.015430+0000","last_clean":"2024-09-10T08:29:34.015430+0000","last_became_active":"2024-09-10T08:29:33.027180+0000","last_became_peered":"2024-09-10T08:29:33.027180+0000","last_unstale":"2024-09-10T08:29:34.015430+0000","last_undegraded":"2024-09-10T08:29:34.015430+0000","last_fullsized":"2024-09-10T08:29:34.015430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:21.360437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038526+0000","last_change":"2024-09-10T08:29:34.030798+0000","last_active":"2024-09-10T08:29:34.038526+0000","last_peered":"2024-09-10T08:29:34.038526+0000","last_clean":"2024-09-10T08:29:34.038526+0000","last_became_active":"2024-09-10T08:29:34.030429+0000","last_became_peered":"2024-09-10T08:29:34.030429+0000","last_unstale":"2024-09-10T08:29:34.038526+0000","last_undegraded":"2024-09-10T08:29:34.038526+0000","last_fullsized":"2024-09-10T08:29:34.038526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:27.365540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.063388+0000","last_change":"2024-09-10T08:29:33.026315+0000","last_active":"2024-09-10T08:29:34.063388+0000","last_peered":"2024-09-10T08:29:34.063388+0000","last_clean":"2024-09-10T08:29:34.063388+0000","last_became_active":"2024-09-10T08:29:33.025999+0000","last_became_peered":"2024-09-10T08:29:33.025999+0000","last_unstale":"2024-09-10T08:29:34.063388+0000","last_undegraded":"2024-09-10T08:29:34.063388+0000","last_fullsized":"2024-09-10T08:29:34.063388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:06.106789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041040+0000","last_change":"2024-09-10T08:29:34.038925+0000","last_active":"2024-09-10T08:29:34.041040+0000","last_peered":"2024-09-10T08:29:34.041040+0000","last_clean":"2024-09-10T08:29:34.041040+0000","last_became_active":"2024-09-10T08:29:34.038615+0000","last_became_peered":"2024-09-10T08:29:34.038615+0000","last_unstale":"2024-09-10T08:29:34.041040+0000","last_undegraded":"2024-09-10T08:29:34.041040+0000","last_fullsized":"2024-09-10T08:29:34.041040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:14.933076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060433+0000","last_change":"2024-09-10T08:29:33.021747+0000","last_active":"2024-09-10T08:29:34.060433+0000","last_peered":"2024-09-10T08:29:34.060433+0000","last_clean":"2024-09-10T08:29:34.060433+0000","last_became_active":"2024-09-10T08:29:33.021377+0000","last_became_peered":"2024-09-10T08:29:33.021377+0000","last_unstale":"2024-09-10T08:29:34.060433+0000","last_undegraded":"2024-09-10T08:29:34.060433+0000","last_fullsized":"2024-09-10T08:29:34.060433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:48.504875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049038+0000","last_change":"2024-09-10T08:29:34.044290+0000","last_active":"2024-09-10T08:29:34.049038+0000","last_peered":"2024-09-10T08:29:34.049038+0000","last_clean":"2024-09-10T08:29:34.049038+0000","last_became_active":"2024-09-10T08:29:34.043797+0000","last_became_peered":"2024-09-10T08:29:34.043797+0000","last_unstale":"2024-09-10T08:29:34.049038+0000","last_undegraded":"2024-09-10T08:29:34.049038+0000","last_fullsized":"2024-09-10T08:29:34.049038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058819+0000","last_change":"2024-09-10T08:29:33.020918+0000","last_active":"2024-09-10T08:29:34.058819+0000","last_peered":"2024-09-10T08:29:34.058819+0000","last_clean":"2024-09-10T08:29:34.058819+0000","last_became_active":"2024-09-10T08:29:33.020658+0000","last_became_peered":"2024-09-10T08:29:33.020658+0000","last_unstale":"2024-09-10T08:29:34.058819+0000","last_undegraded":"2024-09-10T08:29:34.058819+0000","last_fullsized":"2024-09-10T08:29:34.058819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.010683+0000","last_change":"2024-09-10T08:29:33.010683+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.010683+0000","last_undegraded":"2024-09-10T08:29:33.010683+0000","last_fullsized":"2024-09-10T08:29:33.010683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051243+0000","last_change":"2024-09-10T08:29:33.026324+0000","last_active":"2024-09-10T08:29:34.051243+0000","last_peered":"2024-09-10T08:29:34.051243+0000","last_clean":"2024-09-10T08:29:34.051243+0000","last_became_active":"2024-09-10T08:29:33.025862+0000","last_became_peered":"2024-09-10T08:29:33.025862+0000","last_unstale":"2024-09-10T08:29:34.051243+0000","last_undegraded":"2024-09-10T08:29:34.051243+0000","last_fullsized":"2024-09-10T08:29:34.051243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:23.996817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048650+0000","last_change":"2024-09-10T08:29:34.043523+0000","last_active":"2024-09-10T08:29:34.048650+0000","last_peered":"2024-09-10T08:29:34.048650+0000","last_clean":"2024-09-10T08:29:34.048650+0000","last_became_active":"2024-09-10T08:29:34.043197+0000","last_became_peered":"2024-09-10T08:29:34.043197+0000","last_unstale":"2024-09-10T08:29:34.048650+0000","last_undegraded":"2024-09-10T08:29:34.048650+0000","last_fullsized":"2024-09-10T08:29:34.048650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:33.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025547+0000","last_change":"2024-09-10T08:29:33.023460+0000","last_active":"2024-09-10T08:29:34.025547+0000","last_peered":"2024-09-10T08:29:34.025547+0000","last_clean":"2024-09-10T08:29:34.025547+0000","last_became_active":"2024-09-10T08:29:33.023170+0000","last_became_peered":"2024-09-10T08:29:33.023170+0000","last_unstale":"2024-09-10T08:29:34.025547+0000","last_undegraded":"2024-09-10T08:29:34.025547+0000","last_fullsized":"2024-09-10T08:29:34.025547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052270+0000","last_change":"2024-09-10T08:29:34.048200+0000","last_active":"2024-09-10T08:29:34.052270+0000","last_peered":"2024-09-10T08:29:34.052270+0000","last_clean":"2024-09-10T08:29:34.052270+0000","last_became_active":"2024-09-10T08:29:34.047927+0000","last_became_peered":"2024-09-10T08:29:34.047927+0000","last_unstale":"2024-09-10T08:29:34.052270+0000","last_undegraded":"2024-09-10T08:29:34.052270+0000","last_fullsized":"2024-09-10T08:29:34.052270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032957+0000","last_change":"2024-09-10T08:29:33.027059+0000","last_active":"2024-09-10T08:29:33.032957+0000","last_peered":"2024-09-10T08:29:33.032957+0000","last_clean":"2024-09-10T08:29:33.032957+0000","last_became_active":"2024-09-10T08:29:33.026748+0000","last_became_peered":"2024-09-10T08:29:33.026748+0000","last_unstale":"2024-09-10T08:29:33.032957+0000","last_undegraded":"2024-09-10T08:29:33.032957+0000","last_fullsized":"2024-09-10T08:29:33.032957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:28.109424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015403+0000","last_change":"2024-09-10T08:29:33.015403+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015403+0000","last_undegraded":"2024-09-10T08:29:33.015403+0000","last_fullsized":"2024-09-10T08:29:33.015403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014220+0000","last_change":"2024-09-10T08:29:33.024913+0000","last_active":"2024-09-10T08:29:34.014220+0000","last_peered":"2024-09-10T08:29:34.014220+0000","last_clean":"2024-09-10T08:29:34.014220+0000","last_became_active":"2024-09-10T08:29:33.023124+0000","last_became_peered":"2024-09-10T08:29:33.023124+0000","last_unstale":"2024-09-10T08:29:34.014220+0000","last_undegraded":"2024-09-10T08:29:34.014220+0000","last_fullsized":"2024-09-10T08:29:34.014220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.044632+0000","last_change":"2024-09-10T08:29:34.039167+0000","last_active":"2024-09-10T08:29:34.044632+0000","last_peered":"2024-09-10T08:29:34.044632+0000","last_clean":"2024-09-10T08:29:34.044632+0000","last_became_active":"2024-09-10T08:29:34.037065+0000","last_became_peered":"2024-09-10T08:29:34.037065+0000","last_unstale":"2024-09-10T08:29:34.044632+0000","last_undegraded":"2024-09-10T08:29:34.044632+0000","last_fullsized":"2024-09-10T08:29:34.044632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.021311+0000","last_change":"2024-09-10T08:29:33.033458+0000","last_active":"2024-09-10T08:29:34.021311+0000","last_peered":"2024-09-10T08:29:34.021311+0000","last_clean":"2024-09-10T08:29:34.021311+0000","last_became_active":"2024-09-10T08:29:33.033161+0000","last_became_peered":"2024-09-10T08:29:33.033161+0000","last_unstale":"2024-09-10T08:29:34.021311+0000","last_undegraded":"2024-09-10T08:29:34.021311+0000","last_fullsized":"2024-09-10T08:29:34.021311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:40.792079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049514+0000","last_change":"2024-09-10T08:29:34.047377+0000","last_active":"2024-09-10T08:29:34.049514+0000","last_peered":"2024-09-10T08:29:34.049514+0000","last_clean":"2024-09-10T08:29:34.049514+0000","last_became_active":"2024-09-10T08:29:34.047055+0000","last_became_peered":"2024-09-10T08:29:34.047055+0000","last_unstale":"2024-09-10T08:29:34.049514+0000","last_undegraded":"2024-09-10T08:29:34.049514+0000","last_fullsized":"2024-09-10T08:29:34.049514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015675+0000","last_change":"2024-09-10T08:29:33.025805+0000","last_active":"2024-09-10T08:29:34.015675+0000","last_peered":"2024-09-10T08:29:34.015675+0000","last_clean":"2024-09-10T08:29:34.015675+0000","last_became_active":"2024-09-10T08:29:33.024658+0000","last_became_peered":"2024-09-10T08:29:33.024658+0000","last_unstale":"2024-09-10T08:29:34.015675+0000","last_undegraded":"2024-09-10T08:29:34.015675+0000","last_fullsized":"2024-09-10T08:29:34.015675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:23.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048661+0000","last_change":"2024-09-10T08:29:34.043724+0000","last_active":"2024-09-10T08:29:34.048661+0000","last_peered":"2024-09-10T08:29:34.048661+0000","last_clean":"2024-09-10T08:29:34.048661+0000","last_became_active":"2024-09-10T08:29:34.043471+0000","last_became_peered":"2024-09-10T08:29:34.043471+0000","last_unstale":"2024-09-10T08:29:34.048661+0000","last_undegraded":"2024-09-10T08:29:34.048661+0000","last_fullsized":"2024-09-10T08:29:34.048661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.786925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055249+0000","last_change":"2024-09-10T08:29:33.028935+0000","last_active":"2024-09-10T08:29:34.055249+0000","last_peered":"2024-09-10T08:29:34.055249+0000","last_clean":"2024-09-10T08:29:34.055249+0000","last_became_active":"2024-09-10T08:29:33.028629+0000","last_became_peered":"2024-09-10T08:29:33.028629+0000","last_unstale":"2024-09-10T08:29:34.055249+0000","last_undegraded":"2024-09-10T08:29:34.055249+0000","last_fullsized":"2024-09-10T08:29:34.055249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.029997+0000","last_change":"2024-09-10T08:29:34.028422+0000","last_active":"2024-09-10T08:29:34.029997+0000","last_peered":"2024-09-10T08:29:34.029997+0000","last_clean":"2024-09-10T08:29:34.029997+0000","last_became_active":"2024-09-10T08:29:34.028152+0000","last_became_peered":"2024-09-10T08:29:34.028152+0000","last_unstale":"2024-09-10T08:29:34.029997+0000","last_undegraded":"2024-09-10T08:29:34.029997+0000","last_fullsized":"2024-09-10T08:29:34.029997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:55.420525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032747+0000","last_change":"2024-09-10T08:29:33.024021+0000","last_active":"2024-09-10T08:29:33.032747+0000","last_peered":"2024-09-10T08:29:33.032747+0000","last_clean":"2024-09-10T08:29:33.032747+0000","last_became_active":"2024-09-10T08:29:33.023084+0000","last_became_peered":"2024-09-10T08:29:33.023084+0000","last_unstale":"2024-09-10T08:29:33.032747+0000","last_undegraded":"2024-09-10T08:29:33.032747+0000","last_fullsized":"2024-09-10T08:29:33.032747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:57.303843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038671+0000","last_change":"2024-09-10T08:29:34.037052+0000","last_active":"2024-09-10T08:29:34.038671+0000","last_peered":"2024-09-10T08:29:34.038671+0000","last_clean":"2024-09-10T08:29:34.038671+0000","last_became_active":"2024-09-10T08:29:34.036602+0000","last_became_peered":"2024-09-10T08:29:34.036602+0000","last_unstale":"2024-09-10T08:29:34.038671+0000","last_undegraded":"2024-09-10T08:29:34.038671+0000","last_fullsized":"2024-09-10T08:29:34.038671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025729+0000","last_change":"2024-09-10T08:29:33.024043+0000","last_active":"2024-09-10T08:29:34.025729+0000","last_peered":"2024-09-10T08:29:34.025729+0000","last_clean":"2024-09-10T08:29:34.025729+0000","last_became_active":"2024-09-10T08:29:33.023735+0000","last_became_peered":"2024-09-10T08:29:33.023735+0000","last_unstale":"2024-09-10T08:29:34.025729+0000","last_undegraded":"2024-09-10T08:29:34.025729+0000","last_fullsized":"2024-09-10T08:29:34.025729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.047928+0000","last_change":"2024-09-10T08:29:34.044817+0000","last_active":"2024-09-10T08:29:34.047928+0000","last_peered":"2024-09-10T08:29:34.047928+0000","last_clean":"2024-09-10T08:29:34.047928+0000","last_became_active":"2024-09-10T08:29:34.044489+0000","last_became_peered":"2024-09-10T08:29:34.044489+0000","last_unstale":"2024-09-10T08:29:34.047928+0000","last_undegraded":"2024-09-10T08:29:34.047928+0000","last_fullsized":"2024-09-10T08:29:34.047928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.023957+0000","last_change":"2024-09-10T08:29:33.030176+0000","last_active":"2024-09-10T08:29:34.023957+0000","last_peered":"2024-09-10T08:29:34.023957+0000","last_clean":"2024-09-10T08:29:34.023957+0000","last_became_active":"2024-09-10T08:29:33.028687+0000","last_became_peered":"2024-09-10T08:29:33.028687+0000","last_unstale":"2024-09-10T08:29:34.023957+0000","last_undegraded":"2024-09-10T08:29:34.023957+0000","last_fullsized":"2024-09-10T08:29:34.023957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032909+0000","last_change":"2024-09-10T08:29:34.031146+0000","last_active":"2024-09-10T08:29:34.032909+0000","last_peered":"2024-09-10T08:29:34.032909+0000","last_clean":"2024-09-10T08:29:34.032909+0000","last_became_active":"2024-09-10T08:29:34.030853+0000","last_became_peered":"2024-09-10T08:29:34.030853+0000","last_unstale":"2024-09-10T08:29:34.032909+0000","last_undegraded":"2024-09-10T08:29:34.032909+0000","last_fullsized":"2024-09-10T08:29:34.032909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022820+0000","last_change":"2024-09-10T08:29:33.028878+0000","last_active":"2024-09-10T08:29:34.022820+0000","last_peered":"2024-09-10T08:29:34.022820+0000","last_clean":"2024-09-10T08:29:34.022820+0000","last_became_active":"2024-09-10T08:29:33.028575+0000","last_became_peered":"2024-09-10T08:29:33.028575+0000","last_unstale":"2024-09-10T08:29:34.022820+0000","last_undegraded":"2024-09-10T08:29:34.022820+0000","last_fullsized":"2024-09-10T08:29:34.022820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.030519+0000","last_change":"2024-09-10T08:29:34.022980+0000","last_active":"2024-09-10T08:29:34.030519+0000","last_peered":"2024-09-10T08:29:34.030519+0000","last_clean":"2024-09-10T08:29:34.030519+0000","last_became_active":"2024-09-10T08:29:34.022678+0000","last_became_peered":"2024-09-10T08:29:34.022678+0000","last_unstale":"2024-09-10T08:29:34.030519+0000","last_undegraded":"2024-09-10T08:29:34.030519+0000","last_fullsized":"2024-09-10T08:29:34.030519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014357+0000","last_change":"2024-09-10T08:29:33.027084+0000","last_active":"2024-09-10T08:29:34.014357+0000","last_peered":"2024-09-10T08:29:34.014357+0000","last_clean":"2024-09-10T08:29:34.014357+0000","last_became_active":"2024-09-10T08:29:33.026802+0000","last_became_peered":"2024-09-10T08:29:33.026802+0000","last_unstale":"2024-09-10T08:29:34.014357+0000","last_undegraded":"2024-09-10T08:29:34.014357+0000","last_fullsized":"2024-09-10T08:29:34.014357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038540+0000","last_change":"2024-09-10T08:29:34.030886+0000","last_active":"2024-09-10T08:29:34.038540+0000","last_peered":"2024-09-10T08:29:34.038540+0000","last_clean":"2024-09-10T08:29:34.038540+0000","last_became_active":"2024-09-10T08:29:34.030659+0000","last_became_peered":"2024-09-10T08:29:34.030659+0000","last_unstale":"2024-09-10T08:29:34.038540+0000","last_undegraded":"2024-09-10T08:29:34.038540+0000","last_fullsized":"2024-09-10T08:29:34.038540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:46.321648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.016464+0000","last_change":"2024-09-10T08:29:33.029745+0000","last_active":"2024-09-10T08:29:34.016464+0000","last_peered":"2024-09-10T08:29:34.016464+0000","last_clean":"2024-09-10T08:29:34.016464+0000","last_became_active":"2024-09-10T08:29:33.029417+0000","last_became_peered":"2024-09-10T08:29:33.029417+0000","last_unstale":"2024-09-10T08:29:34.016464+0000","last_undegraded":"2024-09-10T08:29:34.016464+0000","last_fullsized":"2024-09-10T08:29:34.016464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:03.473771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048514+0000","last_change":"2024-09-10T08:29:34.046471+0000","last_active":"2024-09-10T08:29:34.048514+0000","last_peered":"2024-09-10T08:29:34.048514+0000","last_clean":"2024-09-10T08:29:34.048514+0000","last_became_active":"2024-09-10T08:29:34.046117+0000","last_became_peered":"2024-09-10T08:29:34.046117+0000","last_unstale":"2024-09-10T08:29:34.048514+0000","last_undegraded":"2024-09-10T08:29:34.048514+0000","last_fullsized":"2024-09-10T08:29:34.048514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022590+0000","last_change":"2024-09-10T08:29:33.026103+0000","last_active":"2024-09-10T08:29:34.022590+0000","last_peered":"2024-09-10T08:29:34.022590+0000","last_clean":"2024-09-10T08:29:34.022590+0000","last_became_active":"2024-09-10T08:29:33.025539+0000","last_became_peered":"2024-09-10T08:29:33.025539+0000","last_unstale":"2024-09-10T08:29:34.022590+0000","last_undegraded":"2024-09-10T08:29:34.022590+0000","last_fullsized":"2024-09-10T08:29:34.022590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:42.966093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.019288+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:29:34.019288+0000","last_peered":"2024-09-10T08:29:34.019288+0000","last_clean":"2024-09-10T08:29:34.019288+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:29:34.019288+0000","last_undegraded":"2024-09-10T08:29:34.019288+0000","last_fullsized":"2024-09-10T08:29:34.019288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":134879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":134901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":368640,"data_stored":134043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":950272,"data_stored":723705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":710585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:38.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.436+0000 7f7526a00640 1 Processor -- start 2024-09-10T08:29:38.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.437+0000 7f7526a00640 1 -- start start 2024-09-10T08:29:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7526a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520145ed0 0x7f75200b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7526a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7520073180 0x7f75200735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7526a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75200b4020 con 0x7f75200b5880 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7526a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7520073b00 con 0x7f7520145ed0 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7526a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f75200b63d0 con 0x7f7520073180 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f751fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520145ed0 0x7f75200b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f751fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520145ed0 0x7f75200b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59492/0 (socket says 172.21.15.52:59492) 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f751fe00640 1 -- 172.21.15.52:0/3471519259 learned_addr learned my addr 172.21.15.52:0/3471519259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.438+0000 7f7517e00640 1 --2- 172.21.15.52:0/3471519259 >> v2:172.21.15.176:3300/0 conn(0x7f7520073180 0x7f75200735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.439+0000 7f751fe00640 1 -- 172.21.15.52:0/3471519259 >> v2:172.21.15.176:3300/0 conn(0x7f7520073180 msgr2=0x7f75200735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.439+0000 7f751fe00640 1 --2- 172.21.15.52:0/3471519259 >> v2:172.21.15.176:3300/0 conn(0x7f7520073180 0x7f75200735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.439+0000 7f751fe00640 1 -- 172.21.15.52:0/3471519259 >> v1:172.21.15.176:6789/0 conn(0x7f75200b5880 legacy=0x7f75200b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.439+0000 7f751fe00640 1 -- 172.21.15.52:0/3471519259 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75200b42c0 con 0x7f7520145ed0 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f751fe00640 1 --2- 172.21.15.52:0/3471519259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520145ed0 0x7f75200b5080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75200d1490 tx=0x7f751002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2aa58a150d4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f751f400640 1 -- 172.21.15.52:0/3471519259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510037070 con 0x7f7520145ed0 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f751f400640 1 -- 172.21.15.52:0/3471519259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7510032440 con 0x7f7520145ed0 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f751f400640 1 -- 172.21.15.52:0/3471519259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510032810 con 0x7f7520145ed0 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f7526a00640 1 -- 172.21.15.52:0/3471519259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520145ed0 msgr2=0x7f75200b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.440+0000 7f7526a00640 1 --2- 172.21.15.52:0/3471519259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520145ed0 0x7f75200b5080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f75200d1490 tx=0x7f751002a270 comp rx=0 tx=0).stop 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 -- 172.21.15.52:0/3471519259 shutdown_connections 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 --2- 172.21.15.52:0/3471519259 >> v2:172.21.15.176:3300/0 conn(0x7f7520073180 0x7f75200735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 --2- 172.21.15.52:0/3471519259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520145ed0 0x7f75200b5080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 -- 172.21.15.52:0/3471519259 >> 172.21.15.52:0/3471519259 conn(0x7f75200ccec0 msgr2=0x7f75200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:38.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 -- 172.21.15.52:0/3471519259 shutdown_connections 2024-09-10T08:29:38.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.441+0000 7f7526a00640 1 -- 172.21.15.52:0/3471519259 wait complete. 2024-09-10T08:29:38.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.442+0000 7f7526a00640 1 Processor -- start 2024-09-10T08:29:38.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.442+0000 7f7526a00640 1 -- start start 2024-09-10T08:29:38.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520073180 0x7f7520157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520145ed0 0x7f752013df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75200b4b60 con 0x7f75200b5880 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75200b4880 con 0x7f7520073180 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7526a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75201462b0 con 0x7f7520145ed0 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.443+0000 7f7517e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59496/0 (socket says 172.21.15.52:59496) 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 -- 172.21.15.52:0/4062051112 learned_addr learned my addr 172.21.15.52:0/4062051112 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f751fe00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520073180 0x7f7520157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7524a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520145ed0 0x7f752013df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 -- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520145ed0 msgr2=0x7f752013df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520145ed0 0x7f752013df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 -- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520073180 msgr2=0x7f7520157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520073180 0x7f7520157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 -- 172.21.15.52:0/4062051112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7520141d20 con 0x7f75200b5880 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f7517e00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f750800e870 tx=0x7f750800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508017070 con 0x7f75200b5880 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750800c940 con 0x7f75200b5880 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.444+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750800cd30 con 0x7f75200b5880 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.445+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7520142020 con 0x7f75200b5880 2024-09-10T08:29:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.445+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7520140320 con 0x7f75200b5880 2024-09-10T08:29:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.446+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75200735c0 con 0x7f75200b5880 2024-09-10T08:29:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.447+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f750801a070 con 0x7f75200b5880 2024-09-10T08:29:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.447+0000 7f751cc00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 0x7f74fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.448+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f750808ad00 con 0x7f75200b5880 2024-09-10T08:29:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.448+0000 7f751fe00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 0x7f74fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.449+0000 7f751fe00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 0x7f74fc06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7510034000 tx=0x7f751002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.452+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7520142020 con 0x7f75200b5880 2024-09-10T08:29:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.631+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75200cf110 con 0x7f74fc06be30 2024-09-10T08:29:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.638+0000 7f751cc00640 1 -- 172.21.15.52:0/4062051112 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251477 (secure 0 0 0) 0x7f75200cf110 con 0x7f74fc06be30 2024-09-10T08:29:38.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 msgr2=0x7f74fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 0x7f74fc06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7510034000 tx=0x7f751002e000 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 msgr2=0x7f752013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f750800e870 tx=0x7f750800ed30 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 shutdown_connections 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f74fc06be30 0x7f74fc06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7520145ed0 0x7f752013df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b5880 0x7f752013d9d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 --2- 172.21.15.52:0/4062051112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520073180 0x7f7520157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 >> 172.21.15.52:0/4062051112 conn(0x7f75200ccec0 msgr2=0x7f75201444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 shutdown_connections 2024-09-10T08:29:38.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.642+0000 7f7526a00640 1 -- 172.21.15.52:0/4062051112 wait complete. 2024-09-10T08:29:38.658 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-10T08:29:37.462714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240996,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733724,"statfs":{"total":773094113280,"available":772847333376,"internally_reserved":0,"allocated":4042752,"data_stored":2238060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.466606"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053977+0000","last_change":"2024-09-10T08:29:34.050800+0000","last_active":"2024-09-10T08:29:34.053977+0000","last_peered":"2024-09-10T08:29:34.053977+0000","last_clean":"2024-09-10T08:29:34.053977+0000","last_became_active":"2024-09-10T08:29:34.050515+0000","last_became_peered":"2024-09-10T08:29:34.050515+0000","last_unstale":"2024-09-10T08:29:34.053977+0000","last_undegraded":"2024-09-10T08:29:34.053977+0000","last_fullsized":"2024-09-10T08:29:34.053977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011260+0000","last_change":"2024-09-10T08:29:33.011260+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011260+0000","last_undegraded":"2024-09-10T08:29:33.011260+0000","last_fullsized":"2024-09-10T08:29:33.011260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040297+0000","last_change":"2024-09-10T08:29:34.032147+0000","last_active":"2024-09-10T08:29:34.040297+0000","last_peered":"2024-09-10T08:29:34.040297+0000","last_clean":"2024-09-10T08:29:34.040297+0000","last_became_active":"2024-09-10T08:29:34.031869+0000","last_became_peered":"2024-09-10T08:29:34.031869+0000","last_unstale":"2024-09-10T08:29:34.040297+0000","last_undegraded":"2024-09-10T08:29:34.040297+0000","last_fullsized":"2024-09-10T08:29:34.040297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:07.111302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046602+0000","last_change":"2024-09-10T08:29:34.043864+0000","last_active":"2024-09-10T08:29:34.046602+0000","last_peered":"2024-09-10T08:29:34.046602+0000","last_clean":"2024-09-10T08:29:34.046602+0000","last_became_active":"2024-09-10T08:29:34.041475+0000","last_became_peered":"2024-09-10T08:29:34.041475+0000","last_unstale":"2024-09-10T08:29:34.046602+0000","last_undegraded":"2024-09-10T08:29:34.046602+0000","last_fullsized":"2024-09-10T08:29:34.046602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015866+0000","last_change":"2024-09-10T08:29:33.015866+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015866+0000","last_undegraded":"2024-09-10T08:29:33.015866+0000","last_fullsized":"2024-09-10T08:29:33.015866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043370+0000","last_change":"2024-09-10T08:29:34.039947+0000","last_active":"2024-09-10T08:29:34.043370+0000","last_peered":"2024-09-10T08:29:34.043370+0000","last_clean":"2024-09-10T08:29:34.043370+0000","last_became_active":"2024-09-10T08:29:34.039425+0000","last_became_peered":"2024-09-10T08:29:34.039425+0000","last_unstale":"2024-09-10T08:29:34.043370+0000","last_undegraded":"2024-09-10T08:29:34.043370+0000","last_fullsized":"2024-09-10T08:29:34.043370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039018+0000","last_change":"2024-09-10T08:29:34.035820+0000","last_active":"2024-09-10T08:29:34.039018+0000","last_peered":"2024-09-10T08:29:34.039018+0000","last_clean":"2024-09-10T08:29:34.039018+0000","last_became_active":"2024-09-10T08:29:34.035530+0000","last_became_peered":"2024-09-10T08:29:34.035530+0000","last_unstale":"2024-09-10T08:29:34.039018+0000","last_undegraded":"2024-09-10T08:29:34.039018+0000","last_fullsized":"2024-09-10T08:29:34.039018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:04.478284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036860+0000","last_change":"2024-09-10T08:29:34.032026+0000","last_active":"2024-09-10T08:29:34.036860+0000","last_peered":"2024-09-10T08:29:34.036860+0000","last_clean":"2024-09-10T08:29:34.036860+0000","last_became_active":"2024-09-10T08:29:34.031828+0000","last_became_peered":"2024-09-10T08:29:34.031828+0000","last_unstale":"2024-09-10T08:29:34.036860+0000","last_undegraded":"2024-09-10T08:29:34.036860+0000","last_fullsized":"2024-09-10T08:29:34.036860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048214+0000","last_change":"2024-09-10T08:29:34.044053+0000","last_active":"2024-09-10T08:29:34.048214+0000","last_peered":"2024-09-10T08:29:34.048214+0000","last_clean":"2024-09-10T08:29:34.048214+0000","last_became_active":"2024-09-10T08:29:34.043402+0000","last_became_peered":"2024-09-10T08:29:34.043402+0000","last_unstale":"2024-09-10T08:29:34.048214+0000","last_undegraded":"2024-09-10T08:29:34.048214+0000","last_fullsized":"2024-09-10T08:29:34.048214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:49.509388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036899+0000","last_change":"2024-09-10T08:29:34.034386+0000","last_active":"2024-09-10T08:29:34.036899+0000","last_peered":"2024-09-10T08:29:34.036899+0000","last_clean":"2024-09-10T08:29:34.036899+0000","last_became_active":"2024-09-10T08:29:34.034034+0000","last_became_peered":"2024-09-10T08:29:34.034034+0000","last_unstale":"2024-09-10T08:29:34.036899+0000","last_undegraded":"2024-09-10T08:29:34.036899+0000","last_fullsized":"2024-09-10T08:29:34.036899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041062+0000","last_change":"2024-09-10T08:29:34.035547+0000","last_active":"2024-09-10T08:29:34.041062+0000","last_peered":"2024-09-10T08:29:34.041062+0000","last_clean":"2024-09-10T08:29:34.041062+0000","last_became_active":"2024-09-10T08:29:34.035248+0000","last_became_peered":"2024-09-10T08:29:34.035248+0000","last_unstale":"2024-09-10T08:29:34.041062+0000","last_undegraded":"2024-09-10T08:29:34.041062+0000","last_fullsized":"2024-09-10T08:29:34.041062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:33.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040316+0000","last_change":"2024-09-10T08:29:34.037847+0000","last_active":"2024-09-10T08:29:34.040316+0000","last_peered":"2024-09-10T08:29:34.040316+0000","last_clean":"2024-09-10T08:29:34.040316+0000","last_became_active":"2024-09-10T08:29:34.036896+0000","last_became_peered":"2024-09-10T08:29:34.036896+0000","last_unstale":"2024-09-10T08:29:34.040316+0000","last_undegraded":"2024-09-10T08:29:34.040316+0000","last_fullsized":"2024-09-10T08:29:34.040316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:55.409697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043840+0000","last_change":"2024-09-10T08:29:34.037905+0000","last_active":"2024-09-10T08:29:34.043840+0000","last_peered":"2024-09-10T08:29:34.043840+0000","last_clean":"2024-09-10T08:29:34.043840+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.043840+0000","last_undegraded":"2024-09-10T08:29:34.043840+0000","last_fullsized":"2024-09-10T08:29:34.043840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.034400+0000","last_change":"2024-09-10T08:29:34.031148+0000","last_active":"2024-09-10T08:29:34.034400+0000","last_peered":"2024-09-10T08:29:34.034400+0000","last_clean":"2024-09-10T08:29:34.034400+0000","last_became_active":"2024-09-10T08:29:34.030897+0000","last_became_peered":"2024-09-10T08:29:34.030897+0000","last_unstale":"2024-09-10T08:29:34.034400+0000","last_undegraded":"2024-09-10T08:29:34.034400+0000","last_fullsized":"2024-09-10T08:29:34.034400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040141+0000","last_change":"2024-09-10T08:29:34.037889+0000","last_active":"2024-09-10T08:29:34.040141+0000","last_peered":"2024-09-10T08:29:34.040141+0000","last_clean":"2024-09-10T08:29:34.040141+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.040141+0000","last_undegraded":"2024-09-10T08:29:34.040141+0000","last_fullsized":"2024-09-10T08:29:34.040141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043902+0000","last_change":"2024-09-10T08:29:34.040898+0000","last_active":"2024-09-10T08:29:34.043902+0000","last_peered":"2024-09-10T08:29:34.043902+0000","last_clean":"2024-09-10T08:29:34.043902+0000","last_became_active":"2024-09-10T08:29:34.040166+0000","last_became_peered":"2024-09-10T08:29:34.040166+0000","last_unstale":"2024-09-10T08:29:34.043902+0000","last_undegraded":"2024-09-10T08:29:34.043902+0000","last_fullsized":"2024-09-10T08:29:34.043902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039039+0000","last_change":"2024-09-10T08:29:34.023343+0000","last_active":"2024-09-10T08:29:34.039039+0000","last_peered":"2024-09-10T08:29:34.039039+0000","last_clean":"2024-09-10T08:29:34.039039+0000","last_became_active":"2024-09-10T08:29:34.023036+0000","last_became_peered":"2024-09-10T08:29:34.023036+0000","last_unstale":"2024-09-10T08:29:34.039039+0000","last_undegraded":"2024-09-10T08:29:34.039039+0000","last_fullsized":"2024-09-10T08:29:34.039039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:43.993961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037399+0000","last_change":"2024-09-10T08:29:34.033658+0000","last_active":"2024-09-10T08:29:34.037399+0000","last_peered":"2024-09-10T08:29:34.037399+0000","last_clean":"2024-09-10T08:29:34.037399+0000","last_became_active":"2024-09-10T08:29:34.033379+0000","last_became_peered":"2024-09-10T08:29:34.033379+0000","last_unstale":"2024-09-10T08:29:34.037399+0000","last_undegraded":"2024-09-10T08:29:34.037399+0000","last_fullsized":"2024-09-10T08:29:34.037399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046363+0000","last_change":"2024-09-10T08:29:34.042026+0000","last_active":"2024-09-10T08:29:34.046363+0000","last_peered":"2024-09-10T08:29:34.046363+0000","last_clean":"2024-09-10T08:29:34.046363+0000","last_became_active":"2024-09-10T08:29:34.041674+0000","last_became_peered":"2024-09-10T08:29:34.041674+0000","last_unstale":"2024-09-10T08:29:34.046363+0000","last_undegraded":"2024-09-10T08:29:34.046363+0000","last_fullsized":"2024-09-10T08:29:34.046363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:20.274879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045151+0000","last_change":"2024-09-10T08:29:34.039736+0000","last_active":"2024-09-10T08:29:34.045151+0000","last_peered":"2024-09-10T08:29:34.045151+0000","last_clean":"2024-09-10T08:29:34.045151+0000","last_became_active":"2024-09-10T08:29:34.039447+0000","last_became_peered":"2024-09-10T08:29:34.039447+0000","last_unstale":"2024-09-10T08:29:34.045151+0000","last_undegraded":"2024-09-10T08:29:34.045151+0000","last_fullsized":"2024-09-10T08:29:34.045151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054596+0000","last_change":"2024-09-10T08:29:34.048898+0000","last_active":"2024-09-10T08:29:34.054596+0000","last_peered":"2024-09-10T08:29:34.054596+0000","last_clean":"2024-09-10T08:29:34.054596+0000","last_became_active":"2024-09-10T08:29:34.039978+0000","last_became_peered":"2024-09-10T08:29:34.039978+0000","last_unstale":"2024-09-10T08:29:34.054596+0000","last_undegraded":"2024-09-10T08:29:34.054596+0000","last_fullsized":"2024-09-10T08:29:34.054596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036710+0000","last_change":"2024-09-10T08:29:34.027611+0000","last_active":"2024-09-10T08:29:34.036710+0000","last_peered":"2024-09-10T08:29:34.036710+0000","last_clean":"2024-09-10T08:29:34.036710+0000","last_became_active":"2024-09-10T08:29:34.027316+0000","last_became_peered":"2024-09-10T08:29:34.027316+0000","last_unstale":"2024-09-10T08:29:34.036710+0000","last_undegraded":"2024-09-10T08:29:34.036710+0000","last_fullsized":"2024-09-10T08:29:34.036710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048984+0000","last_change":"2024-09-10T08:29:34.043504+0000","last_active":"2024-09-10T08:29:34.048984+0000","last_peered":"2024-09-10T08:29:34.048984+0000","last_clean":"2024-09-10T08:29:34.048984+0000","last_became_active":"2024-09-10T08:29:34.042661+0000","last_became_peered":"2024-09-10T08:29:34.042661+0000","last_unstale":"2024-09-10T08:29:34.048984+0000","last_undegraded":"2024-09-10T08:29:34.048984+0000","last_fullsized":"2024-09-10T08:29:34.048984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052679+0000","last_change":"2024-09-10T08:29:34.036454+0000","last_active":"2024-09-10T08:29:34.052679+0000","last_peered":"2024-09-10T08:29:34.052679+0000","last_clean":"2024-09-10T08:29:34.052679+0000","last_became_active":"2024-09-10T08:29:34.036101+0000","last_became_peered":"2024-09-10T08:29:34.036101+0000","last_unstale":"2024-09-10T08:29:34.052679+0000","last_undegraded":"2024-09-10T08:29:34.052679+0000","last_fullsized":"2024-09-10T08:29:34.052679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032825+0000","last_change":"2024-09-10T08:29:34.030162+0000","last_active":"2024-09-10T08:29:34.032825+0000","last_peered":"2024-09-10T08:29:34.032825+0000","last_clean":"2024-09-10T08:29:34.032825+0000","last_became_active":"2024-09-10T08:29:34.029892+0000","last_became_peered":"2024-09-10T08:29:34.029892+0000","last_unstale":"2024-09-10T08:29:34.032825+0000","last_undegraded":"2024-09-10T08:29:34.032825+0000","last_fullsized":"2024-09-10T08:29:34.032825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.035273+0000","last_change":"2024-09-10T08:29:34.024246+0000","last_active":"2024-09-10T08:29:34.035273+0000","last_peered":"2024-09-10T08:29:34.035273+0000","last_clean":"2024-09-10T08:29:34.035273+0000","last_became_active":"2024-09-10T08:29:34.023898+0000","last_became_peered":"2024-09-10T08:29:34.023898+0000","last_unstale":"2024-09-10T08:29:34.035273+0000","last_undegraded":"2024-09-10T08:29:34.035273+0000","last_fullsized":"2024-09-10T08:29:34.035273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011836+0000","last_change":"2024-09-10T08:29:33.011836+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011836+0000","last_undegraded":"2024-09-10T08:29:33.011836+0000","last_fullsized":"2024-09-10T08:29:33.011836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048276+0000","last_change":"2024-09-10T08:29:34.033479+0000","last_active":"2024-09-10T08:29:34.048276+0000","last_peered":"2024-09-10T08:29:34.048276+0000","last_clean":"2024-09-10T08:29:34.048276+0000","last_became_active":"2024-09-10T08:29:34.033007+0000","last_became_peered":"2024-09-10T08:29:34.033007+0000","last_unstale":"2024-09-10T08:29:34.048276+0000","last_undegraded":"2024-09-10T08:29:34.048276+0000","last_fullsized":"2024-09-10T08:29:34.048276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049296+0000","last_change":"2024-09-10T08:29:34.038693+0000","last_active":"2024-09-10T08:29:34.049296+0000","last_peered":"2024-09-10T08:29:34.049296+0000","last_clean":"2024-09-10T08:29:34.049296+0000","last_became_active":"2024-09-10T08:29:34.038418+0000","last_became_peered":"2024-09-10T08:29:34.038418+0000","last_unstale":"2024-09-10T08:29:34.049296+0000","last_undegraded":"2024-09-10T08:29:34.049296+0000","last_fullsized":"2024-09-10T08:29:34.049296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045846+0000","last_change":"2024-09-10T08:29:34.043411+0000","last_active":"2024-09-10T08:29:34.045846+0000","last_peered":"2024-09-10T08:29:34.045846+0000","last_clean":"2024-09-10T08:29:34.045846+0000","last_became_active":"2024-09-10T08:29:34.042873+0000","last_became_peered":"2024-09-10T08:29:34.042873+0000","last_unstale":"2024-09-10T08:29:34.045846+0000","last_undegraded":"2024-09-10T08:29:34.045846+0000","last_fullsized":"2024-09-10T08:29:34.045846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052450+0000","last_change":"2024-09-10T08:29:34.036484+0000","last_active":"2024-09-10T08:29:34.052450+0000","last_peered":"2024-09-10T08:29:34.052450+0000","last_clean":"2024-09-10T08:29:34.052450+0000","last_became_active":"2024-09-10T08:29:34.036196+0000","last_became_peered":"2024-09-10T08:29:34.036196+0000","last_unstale":"2024-09-10T08:29:34.052450+0000","last_undegraded":"2024-09-10T08:29:34.052450+0000","last_fullsized":"2024-09-10T08:29:34.052450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039363+0000","last_change":"2024-09-10T08:29:34.023550+0000","last_active":"2024-09-10T08:29:34.039363+0000","last_peered":"2024-09-10T08:29:34.039363+0000","last_clean":"2024-09-10T08:29:34.039363+0000","last_became_active":"2024-09-10T08:29:34.023253+0000","last_became_peered":"2024-09-10T08:29:34.023253+0000","last_unstale":"2024-09-10T08:29:34.039363+0000","last_undegraded":"2024-09-10T08:29:34.039363+0000","last_fullsized":"2024-09-10T08:29:34.039363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:54.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036626+0000","last_change":"2024-09-10T08:29:34.030313+0000","last_active":"2024-09-10T08:29:34.036626+0000","last_peered":"2024-09-10T08:29:34.036626+0000","last_clean":"2024-09-10T08:29:34.036626+0000","last_became_active":"2024-09-10T08:29:34.029987+0000","last_became_peered":"2024-09-10T08:29:34.029987+0000","last_unstale":"2024-09-10T08:29:34.036626+0000","last_undegraded":"2024-09-10T08:29:34.036626+0000","last_fullsized":"2024-09-10T08:29:34.036626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053023+0000","last_change":"2024-09-10T08:29:33.022598+0000","last_active":"2024-09-10T08:29:34.053023+0000","last_peered":"2024-09-10T08:29:34.053023+0000","last_clean":"2024-09-10T08:29:34.053023+0000","last_became_active":"2024-09-10T08:29:33.022302+0000","last_became_peered":"2024-09-10T08:29:33.022302+0000","last_unstale":"2024-09-10T08:29:34.053023+0000","last_undegraded":"2024-09-10T08:29:34.053023+0000","last_fullsized":"2024-09-10T08:29:34.053023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:20.408155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053197+0000","last_change":"2024-09-10T08:29:34.038139+0000","last_active":"2024-09-10T08:29:34.053197+0000","last_peered":"2024-09-10T08:29:34.053197+0000","last_clean":"2024-09-10T08:29:34.053197+0000","last_became_active":"2024-09-10T08:29:34.037740+0000","last_became_peered":"2024-09-10T08:29:34.037740+0000","last_unstale":"2024-09-10T08:29:34.053197+0000","last_undegraded":"2024-09-10T08:29:34.053197+0000","last_fullsized":"2024-09-10T08:29:34.053197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054715+0000","last_change":"2024-09-10T08:29:33.022704+0000","last_active":"2024-09-10T08:29:34.054715+0000","last_peered":"2024-09-10T08:29:34.054715+0000","last_clean":"2024-09-10T08:29:34.054715+0000","last_became_active":"2024-09-10T08:29:33.021966+0000","last_became_peered":"2024-09-10T08:29:33.021966+0000","last_unstale":"2024-09-10T08:29:34.054715+0000","last_undegraded":"2024-09-10T08:29:34.054715+0000","last_fullsized":"2024-09-10T08:29:34.054715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048250+0000","last_change":"2024-09-10T08:29:34.026982+0000","last_active":"2024-09-10T08:29:34.048250+0000","last_peered":"2024-09-10T08:29:34.048250+0000","last_clean":"2024-09-10T08:29:34.048250+0000","last_became_active":"2024-09-10T08:29:34.026660+0000","last_became_peered":"2024-09-10T08:29:34.026660+0000","last_unstale":"2024-09-10T08:29:34.048250+0000","last_undegraded":"2024-09-10T08:29:34.048250+0000","last_fullsized":"2024-09-10T08:29:34.048250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060566+0000","last_change":"2024-09-10T08:29:33.021777+0000","last_active":"2024-09-10T08:29:34.060566+0000","last_peered":"2024-09-10T08:29:34.060566+0000","last_clean":"2024-09-10T08:29:34.060566+0000","last_became_active":"2024-09-10T08:29:33.021502+0000","last_became_peered":"2024-09-10T08:29:33.021502+0000","last_unstale":"2024-09-10T08:29:34.060566+0000","last_undegraded":"2024-09-10T08:29:34.060566+0000","last_fullsized":"2024-09-10T08:29:34.060566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:34.767107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037102+0000","last_change":"2024-09-10T08:29:34.034652+0000","last_active":"2024-09-10T08:29:34.037102+0000","last_peered":"2024-09-10T08:29:34.037102+0000","last_clean":"2024-09-10T08:29:34.037102+0000","last_became_active":"2024-09-10T08:29:34.034324+0000","last_became_peered":"2024-09-10T08:29:34.034324+0000","last_unstale":"2024-09-10T08:29:34.037102+0000","last_undegraded":"2024-09-10T08:29:34.037102+0000","last_fullsized":"2024-09-10T08:29:34.037102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055947+0000","last_change":"2024-09-10T08:29:33.022304+0000","last_active":"2024-09-10T08:29:34.055947+0000","last_peered":"2024-09-10T08:29:34.055947+0000","last_clean":"2024-09-10T08:29:34.055947+0000","last_became_active":"2024-09-10T08:29:33.022083+0000","last_became_peered":"2024-09-10T08:29:33.022083+0000","last_unstale":"2024-09-10T08:29:34.055947+0000","last_undegraded":"2024-09-10T08:29:34.055947+0000","last_fullsized":"2024-09-10T08:29:34.055947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:00.602457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049083+0000","last_change":"2024-09-10T08:29:34.045812+0000","last_active":"2024-09-10T08:29:34.049083+0000","last_peered":"2024-09-10T08:29:34.049083+0000","last_clean":"2024-09-10T08:29:34.049083+0000","last_became_active":"2024-09-10T08:29:34.045608+0000","last_became_peered":"2024-09-10T08:29:34.045608+0000","last_unstale":"2024-09-10T08:29:34.049083+0000","last_undegraded":"2024-09-10T08:29:34.049083+0000","last_fullsized":"2024-09-10T08:29:34.049083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.057630+0000","last_change":"2024-09-10T08:29:33.024403+0000","last_active":"2024-09-10T08:29:34.057630+0000","last_peered":"2024-09-10T08:29:34.057630+0000","last_clean":"2024-09-10T08:29:34.057630+0000","last_became_active":"2024-09-10T08:29:33.023478+0000","last_became_peered":"2024-09-10T08:29:33.023478+0000","last_unstale":"2024-09-10T08:29:34.057630+0000","last_undegraded":"2024-09-10T08:29:34.057630+0000","last_fullsized":"2024-09-10T08:29:34.057630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053926+0000","last_change":"2024-09-10T08:29:34.049858+0000","last_active":"2024-09-10T08:29:34.053926+0000","last_peered":"2024-09-10T08:29:34.053926+0000","last_clean":"2024-09-10T08:29:34.053926+0000","last_became_active":"2024-09-10T08:29:34.036503+0000","last_became_peered":"2024-09-10T08:29:34.036503+0000","last_unstale":"2024-09-10T08:29:34.053926+0000","last_undegraded":"2024-09-10T08:29:34.053926+0000","last_fullsized":"2024-09-10T08:29:34.053926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.056845+0000","last_change":"2024-09-10T08:29:33.028410+0000","last_active":"2024-09-10T08:29:34.056845+0000","last_peered":"2024-09-10T08:29:34.056845+0000","last_clean":"2024-09-10T08:29:34.056845+0000","last_became_active":"2024-09-10T08:29:33.026040+0000","last_became_peered":"2024-09-10T08:29:33.026040+0000","last_unstale":"2024-09-10T08:29:34.056845+0000","last_undegraded":"2024-09-10T08:29:34.056845+0000","last_fullsized":"2024-09-10T08:29:34.056845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049142+0000","last_change":"2024-09-10T08:29:34.044121+0000","last_active":"2024-09-10T08:29:34.049142+0000","last_peered":"2024-09-10T08:29:34.049142+0000","last_clean":"2024-09-10T08:29:34.049142+0000","last_became_active":"2024-09-10T08:29:34.043839+0000","last_became_peered":"2024-09-10T08:29:34.043839+0000","last_unstale":"2024-09-10T08:29:34.049142+0000","last_undegraded":"2024-09-10T08:29:34.049142+0000","last_fullsized":"2024-09-10T08:29:34.049142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:35.771620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022302+0000","last_change":"2024-09-10T08:29:33.024132+0000","last_active":"2024-09-10T08:29:34.022302+0000","last_peered":"2024-09-10T08:29:34.022302+0000","last_clean":"2024-09-10T08:29:34.022302+0000","last_became_active":"2024-09-10T08:29:33.023879+0000","last_became_peered":"2024-09-10T08:29:33.023879+0000","last_unstale":"2024-09-10T08:29:34.022302+0000","last_undegraded":"2024-09-10T08:29:34.022302+0000","last_fullsized":"2024-09-10T08:29:34.022302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:54.405184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031899+0000","last_change":"2024-09-10T08:29:34.027671+0000","last_active":"2024-09-10T08:29:34.031899+0000","last_peered":"2024-09-10T08:29:34.031899+0000","last_clean":"2024-09-10T08:29:34.031899+0000","last_became_active":"2024-09-10T08:29:34.027289+0000","last_became_peered":"2024-09-10T08:29:34.027289+0000","last_unstale":"2024-09-10T08:29:34.031899+0000","last_undegraded":"2024-09-10T08:29:34.031899+0000","last_fullsized":"2024-09-10T08:29:34.031899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014607+0000","last_change":"2024-09-10T08:29:33.020211+0000","last_active":"2024-09-10T08:29:34.014607+0000","last_peered":"2024-09-10T08:29:34.014607+0000","last_clean":"2024-09-10T08:29:34.014607+0000","last_became_active":"2024-09-10T08:29:33.019698+0000","last_became_peered":"2024-09-10T08:29:33.019698+0000","last_unstale":"2024-09-10T08:29:34.014607+0000","last_undegraded":"2024-09-10T08:29:34.014607+0000","last_fullsized":"2024-09-10T08:29:34.014607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.545431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039052+0000","last_change":"2024-09-10T08:29:34.031164+0000","last_active":"2024-09-10T08:29:34.039052+0000","last_peered":"2024-09-10T08:29:34.039052+0000","last_clean":"2024-09-10T08:29:34.039052+0000","last_became_active":"2024-09-10T08:29:34.030791+0000","last_became_peered":"2024-09-10T08:29:34.030791+0000","last_unstale":"2024-09-10T08:29:34.039052+0000","last_undegraded":"2024-09-10T08:29:34.039052+0000","last_fullsized":"2024-09-10T08:29:34.039052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:53.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032910+0000","last_change":"2024-09-10T08:29:33.025504+0000","last_active":"2024-09-10T08:29:33.032910+0000","last_peered":"2024-09-10T08:29:33.032910+0000","last_clean":"2024-09-10T08:29:33.032910+0000","last_became_active":"2024-09-10T08:29:33.025250+0000","last_became_peered":"2024-09-10T08:29:33.025250+0000","last_unstale":"2024-09-10T08:29:33.032910+0000","last_undegraded":"2024-09-10T08:29:33.032910+0000","last_fullsized":"2024-09-10T08:29:33.032910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039895+0000","last_change":"2024-09-10T08:29:34.035478+0000","last_active":"2024-09-10T08:29:34.039895+0000","last_peered":"2024-09-10T08:29:34.039895+0000","last_clean":"2024-09-10T08:29:34.039895+0000","last_became_active":"2024-09-10T08:29:34.035094+0000","last_became_peered":"2024-09-10T08:29:34.035094+0000","last_unstale":"2024-09-10T08:29:34.039895+0000","last_undegraded":"2024-09-10T08:29:34.039895+0000","last_fullsized":"2024-09-10T08:29:34.039895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.029615+0000","last_change":"2024-09-10T08:29:33.022012+0000","last_active":"2024-09-10T08:29:33.029615+0000","last_peered":"2024-09-10T08:29:33.029615+0000","last_clean":"2024-09-10T08:29:33.029615+0000","last_became_active":"2024-09-10T08:29:33.021732+0000","last_became_peered":"2024-09-10T08:29:33.021732+0000","last_unstale":"2024-09-10T08:29:33.029615+0000","last_undegraded":"2024-09-10T08:29:33.029615+0000","last_fullsized":"2024-09-10T08:29:33.029615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:25.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031828+0000","last_change":"2024-09-10T08:29:34.027098+0000","last_active":"2024-09-10T08:29:34.031828+0000","last_peered":"2024-09-10T08:29:34.031828+0000","last_clean":"2024-09-10T08:29:34.031828+0000","last_became_active":"2024-09-10T08:29:34.026819+0000","last_became_peered":"2024-09-10T08:29:34.026819+0000","last_unstale":"2024-09-10T08:29:34.031828+0000","last_undegraded":"2024-09-10T08:29:34.031828+0000","last_fullsized":"2024-09-10T08:29:34.031828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052258+0000","last_change":"2024-09-10T08:29:33.024226+0000","last_active":"2024-09-10T08:29:34.052258+0000","last_peered":"2024-09-10T08:29:34.052258+0000","last_clean":"2024-09-10T08:29:34.052258+0000","last_became_active":"2024-09-10T08:29:33.023927+0000","last_became_peered":"2024-09-10T08:29:33.023927+0000","last_unstale":"2024-09-10T08:29:34.052258+0000","last_undegraded":"2024-09-10T08:29:34.052258+0000","last_fullsized":"2024-09-10T08:29:34.052258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.814661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031055+0000","last_change":"2024-09-10T08:29:34.028666+0000","last_active":"2024-09-10T08:29:34.031055+0000","last_peered":"2024-09-10T08:29:34.031055+0000","last_clean":"2024-09-10T08:29:34.031055+0000","last_became_active":"2024-09-10T08:29:34.023390+0000","last_became_peered":"2024-09-10T08:29:34.023390+0000","last_unstale":"2024-09-10T08:29:34.031055+0000","last_undegraded":"2024-09-10T08:29:34.031055+0000","last_fullsized":"2024-09-10T08:29:34.031055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:07.098553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060807+0000","last_change":"2024-09-10T08:29:33.024849+0000","last_active":"2024-09-10T08:29:34.060807+0000","last_peered":"2024-09-10T08:29:34.060807+0000","last_clean":"2024-09-10T08:29:34.060807+0000","last_became_active":"2024-09-10T08:29:33.024498+0000","last_became_peered":"2024-09-10T08:29:33.024498+0000","last_unstale":"2024-09-10T08:29:34.060807+0000","last_undegraded":"2024-09-10T08:29:34.060807+0000","last_fullsized":"2024-09-10T08:29:34.060807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046736+0000","last_change":"2024-09-10T08:29:34.043288+0000","last_active":"2024-09-10T08:29:34.046736+0000","last_peered":"2024-09-10T08:29:34.046736+0000","last_clean":"2024-09-10T08:29:34.046736+0000","last_became_active":"2024-09-10T08:29:34.042465+0000","last_became_peered":"2024-09-10T08:29:34.042465+0000","last_unstale":"2024-09-10T08:29:34.046736+0000","last_undegraded":"2024-09-10T08:29:34.046736+0000","last_fullsized":"2024-09-10T08:29:34.046736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058825+0000","last_change":"2024-09-10T08:29:33.028081+0000","last_active":"2024-09-10T08:29:34.058825+0000","last_peered":"2024-09-10T08:29:34.058825+0000","last_clean":"2024-09-10T08:29:34.058825+0000","last_became_active":"2024-09-10T08:29:33.027897+0000","last_became_peered":"2024-09-10T08:29:33.027897+0000","last_unstale":"2024-09-10T08:29:34.058825+0000","last_undegraded":"2024-09-10T08:29:34.058825+0000","last_fullsized":"2024-09-10T08:29:34.058825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:34.318695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051885+0000","last_change":"2024-09-10T08:29:34.045109+0000","last_active":"2024-09-10T08:29:34.051885+0000","last_peered":"2024-09-10T08:29:34.051885+0000","last_clean":"2024-09-10T08:29:34.051885+0000","last_became_active":"2024-09-10T08:29:34.043753+0000","last_became_peered":"2024-09-10T08:29:34.043753+0000","last_unstale":"2024-09-10T08:29:34.051885+0000","last_undegraded":"2024-09-10T08:29:34.051885+0000","last_fullsized":"2024-09-10T08:29:34.051885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015902+0000","last_change":"2024-09-10T08:29:33.024567+0000","last_active":"2024-09-10T08:29:34.015902+0000","last_peered":"2024-09-10T08:29:34.015902+0000","last_clean":"2024-09-10T08:29:34.015902+0000","last_became_active":"2024-09-10T08:29:33.024300+0000","last_became_peered":"2024-09-10T08:29:33.024300+0000","last_unstale":"2024-09-10T08:29:34.015902+0000","last_undegraded":"2024-09-10T08:29:34.015902+0000","last_fullsized":"2024-09-10T08:29:34.015902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:35.895300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036800+0000","last_change":"2024-09-10T08:29:34.029898+0000","last_active":"2024-09-10T08:29:34.036800+0000","last_peered":"2024-09-10T08:29:34.036800+0000","last_clean":"2024-09-10T08:29:34.036800+0000","last_became_active":"2024-09-10T08:29:34.025811+0000","last_became_peered":"2024-09-10T08:29:34.025811+0000","last_unstale":"2024-09-10T08:29:34.036800+0000","last_undegraded":"2024-09-10T08:29:34.036800+0000","last_fullsized":"2024-09-10T08:29:34.036800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015430+0000","last_change":"2024-09-10T08:29:33.027465+0000","last_active":"2024-09-10T08:29:34.015430+0000","last_peered":"2024-09-10T08:29:34.015430+0000","last_clean":"2024-09-10T08:29:34.015430+0000","last_became_active":"2024-09-10T08:29:33.027180+0000","last_became_peered":"2024-09-10T08:29:33.027180+0000","last_unstale":"2024-09-10T08:29:34.015430+0000","last_undegraded":"2024-09-10T08:29:34.015430+0000","last_fullsized":"2024-09-10T08:29:34.015430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:21.360437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038526+0000","last_change":"2024-09-10T08:29:34.030798+0000","last_active":"2024-09-10T08:29:34.038526+0000","last_peered":"2024-09-10T08:29:34.038526+0000","last_clean":"2024-09-10T08:29:34.038526+0000","last_became_active":"2024-09-10T08:29:34.030429+0000","last_became_peered":"2024-09-10T08:29:34.030429+0000","last_unstale":"2024-09-10T08:29:34.038526+0000","last_undegraded":"2024-09-10T08:29:34.038526+0000","last_fullsized":"2024-09-10T08:29:34.038526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:27.365540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.063388+0000","last_change":"2024-09-10T08:29:33.026315+0000","last_active":"2024-09-10T08:29:34.063388+0000","last_peered":"2024-09-10T08:29:34.063388+0000","last_clean":"2024-09-10T08:29:34.063388+0000","last_became_active":"2024-09-10T08:29:33.025999+0000","last_became_peered":"2024-09-10T08:29:33.025999+0000","last_unstale":"2024-09-10T08:29:34.063388+0000","last_undegraded":"2024-09-10T08:29:34.063388+0000","last_fullsized":"2024-09-10T08:29:34.063388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:06.106789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041040+0000","last_change":"2024-09-10T08:29:34.038925+0000","last_active":"2024-09-10T08:29:34.041040+0000","last_peered":"2024-09-10T08:29:34.041040+0000","last_clean":"2024-09-10T08:29:34.041040+0000","last_became_active":"2024-09-10T08:29:34.038615+0000","last_became_peered":"2024-09-10T08:29:34.038615+0000","last_unstale":"2024-09-10T08:29:34.041040+0000","last_undegraded":"2024-09-10T08:29:34.041040+0000","last_fullsized":"2024-09-10T08:29:34.041040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:14.933076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060433+0000","last_change":"2024-09-10T08:29:33.021747+0000","last_active":"2024-09-10T08:29:34.060433+0000","last_peered":"2024-09-10T08:29:34.060433+0000","last_clean":"2024-09-10T08:29:34.060433+0000","last_became_active":"2024-09-10T08:29:33.021377+0000","last_became_peered":"2024-09-10T08:29:33.021377+0000","last_unstale":"2024-09-10T08:29:34.060433+0000","last_undegraded":"2024-09-10T08:29:34.060433+0000","last_fullsized":"2024-09-10T08:29:34.060433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:48.504875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049038+0000","last_change":"2024-09-10T08:29:34.044290+0000","last_active":"2024-09-10T08:29:34.049038+0000","last_peered":"2024-09-10T08:29:34.049038+0000","last_clean":"2024-09-10T08:29:34.049038+0000","last_became_active":"2024-09-10T08:29:34.043797+0000","last_became_peered":"2024-09-10T08:29:34.043797+0000","last_unstale":"2024-09-10T08:29:34.049038+0000","last_undegraded":"2024-09-10T08:29:34.049038+0000","last_fullsized":"2024-09-10T08:29:34.049038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058819+0000","last_change":"2024-09-10T08:29:33.020918+0000","last_active":"2024-09-10T08:29:34.058819+0000","last_peered":"2024-09-10T08:29:34.058819+0000","last_clean":"2024-09-10T08:29:34.058819+0000","last_became_active":"2024-09-10T08:29:33.020658+0000","last_became_peered":"2024-09-10T08:29:33.020658+0000","last_unstale":"2024-09-10T08:29:34.058819+0000","last_undegraded":"2024-09-10T08:29:34.058819+0000","last_fullsized":"2024-09-10T08:29:34.058819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.010683+0000","last_change":"2024-09-10T08:29:33.010683+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.010683+0000","last_undegraded":"2024-09-10T08:29:33.010683+0000","last_fullsized":"2024-09-10T08:29:33.010683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051243+0000","last_change":"2024-09-10T08:29:33.026324+0000","last_active":"2024-09-10T08:29:34.051243+0000","last_peered":"2024-09-10T08:29:34.051243+0000","last_clean":"2024-09-10T08:29:34.051243+0000","last_became_active":"2024-09-10T08:29:33.025862+0000","last_became_peered":"2024-09-10T08:29:33.025862+0000","last_unstale":"2024-09-10T08:29:34.051243+0000","last_undegraded":"2024-09-10T08:29:34.051243+0000","last_fullsized":"2024-09-10T08:29:34.051243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:23.996817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048650+0000","last_change":"2024-09-10T08:29:34.043523+0000","last_active":"2024-09-10T08:29:34.048650+0000","last_peered":"2024-09-10T08:29:34.048650+0000","last_clean":"2024-09-10T08:29:34.048650+0000","last_became_active":"2024-09-10T08:29:34.043197+0000","last_became_peered":"2024-09-10T08:29:34.043197+0000","last_unstale":"2024-09-10T08:29:34.048650+0000","last_undegraded":"2024-09-10T08:29:34.048650+0000","last_fullsized":"2024-09-10T08:29:34.048650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:33.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025547+0000","last_change":"2024-09-10T08:29:33.023460+0000","last_active":"2024-09-10T08:29:34.025547+0000","last_peered":"2024-09-10T08:29:34.025547+0000","last_clean":"2024-09-10T08:29:34.025547+0000","last_became_active":"2024-09-10T08:29:33.023170+0000","last_became_peered":"2024-09-10T08:29:33.023170+0000","last_unstale":"2024-09-10T08:29:34.025547+0000","last_undegraded":"2024-09-10T08:29:34.025547+0000","last_fullsized":"2024-09-10T08:29:34.025547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052270+0000","last_change":"2024-09-10T08:29:34.048200+0000","last_active":"2024-09-10T08:29:34.052270+0000","last_peered":"2024-09-10T08:29:34.052270+0000","last_clean":"2024-09-10T08:29:34.052270+0000","last_became_active":"2024-09-10T08:29:34.047927+0000","last_became_peered":"2024-09-10T08:29:34.047927+0000","last_unstale":"2024-09-10T08:29:34.052270+0000","last_undegraded":"2024-09-10T08:29:34.052270+0000","last_fullsized":"2024-09-10T08:29:34.052270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032957+0000","last_change":"2024-09-10T08:29:33.027059+0000","last_active":"2024-09-10T08:29:33.032957+0000","last_peered":"2024-09-10T08:29:33.032957+0000","last_clean":"2024-09-10T08:29:33.032957+0000","last_became_active":"2024-09-10T08:29:33.026748+0000","last_became_peered":"2024-09-10T08:29:33.026748+0000","last_unstale":"2024-09-10T08:29:33.032957+0000","last_undegraded":"2024-09-10T08:29:33.032957+0000","last_fullsized":"2024-09-10T08:29:33.032957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:28.109424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015403+0000","last_change":"2024-09-10T08:29:33.015403+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015403+0000","last_undegraded":"2024-09-10T08:29:33.015403+0000","last_fullsized":"2024-09-10T08:29:33.015403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014220+0000","last_change":"2024-09-10T08:29:33.024913+0000","last_active":"2024-09-10T08:29:34.014220+0000","last_peered":"2024-09-10T08:29:34.014220+0000","last_clean":"2024-09-10T08:29:34.014220+0000","last_became_active":"2024-09-10T08:29:33.023124+0000","last_became_peered":"2024-09-10T08:29:33.023124+0000","last_unstale":"2024-09-10T08:29:34.014220+0000","last_undegraded":"2024-09-10T08:29:34.014220+0000","last_fullsized":"2024-09-10T08:29:34.014220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.044632+0000","last_change":"2024-09-10T08:29:34.039167+0000","last_active":"2024-09-10T08:29:34.044632+0000","last_peered":"2024-09-10T08:29:34.044632+0000","last_clean":"2024-09-10T08:29:34.044632+0000","last_became_active":"2024-09-10T08:29:34.037065+0000","last_became_peered":"2024-09-10T08:29:34.037065+0000","last_unstale":"2024-09-10T08:29:34.044632+0000","last_undegraded":"2024-09-10T08:29:34.044632+0000","last_fullsized":"2024-09-10T08:29:34.044632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.021311+0000","last_change":"2024-09-10T08:29:33.033458+0000","last_active":"2024-09-10T08:29:34.021311+0000","last_peered":"2024-09-10T08:29:34.021311+0000","last_clean":"2024-09-10T08:29:34.021311+0000","last_became_active":"2024-09-10T08:29:33.033161+0000","last_became_peered":"2024-09-10T08:29:33.033161+0000","last_unstale":"2024-09-10T08:29:34.021311+0000","last_undegraded":"2024-09-10T08:29:34.021311+0000","last_fullsized":"2024-09-10T08:29:34.021311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:40.792079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049514+0000","last_change":"2024-09-10T08:29:34.047377+0000","last_active":"2024-09-10T08:29:34.049514+0000","last_peered":"2024-09-10T08:29:34.049514+0000","last_clean":"2024-09-10T08:29:34.049514+0000","last_became_active":"2024-09-10T08:29:34.047055+0000","last_became_peered":"2024-09-10T08:29:34.047055+0000","last_unstale":"2024-09-10T08:29:34.049514+0000","last_undegraded":"2024-09-10T08:29:34.049514+0000","last_fullsized":"2024-09-10T08:29:34.049514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015675+0000","last_change":"2024-09-10T08:29:33.025805+0000","last_active":"2024-09-10T08:29:34.015675+0000","last_peered":"2024-09-10T08:29:34.015675+0000","last_clean":"2024-09-10T08:29:34.015675+0000","last_became_active":"2024-09-10T08:29:33.024658+0000","last_became_peered":"2024-09-10T08:29:33.024658+0000","last_unstale":"2024-09-10T08:29:34.015675+0000","last_undegraded":"2024-09-10T08:29:34.015675+0000","last_fullsized":"2024-09-10T08:29:34.015675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:23.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048661+0000","last_change":"2024-09-10T08:29:34.043724+0000","last_active":"2024-09-10T08:29:34.048661+0000","last_peered":"2024-09-10T08:29:34.048661+0000","last_clean":"2024-09-10T08:29:34.048661+0000","last_became_active":"2024-09-10T08:29:34.043471+0000","last_became_peered":"2024-09-10T08:29:34.043471+0000","last_unstale":"2024-09-10T08:29:34.048661+0000","last_undegraded":"2024-09-10T08:29:34.048661+0000","last_fullsized":"2024-09-10T08:29:34.048661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.786925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055249+0000","last_change":"2024-09-10T08:29:33.028935+0000","last_active":"2024-09-10T08:29:34.055249+0000","last_peered":"2024-09-10T08:29:34.055249+0000","last_clean":"2024-09-10T08:29:34.055249+0000","last_became_active":"2024-09-10T08:29:33.028629+0000","last_became_peered":"2024-09-10T08:29:33.028629+0000","last_unstale":"2024-09-10T08:29:34.055249+0000","last_undegraded":"2024-09-10T08:29:34.055249+0000","last_fullsized":"2024-09-10T08:29:34.055249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.029997+0000","last_change":"2024-09-10T08:29:34.028422+0000","last_active":"2024-09-10T08:29:34.029997+0000","last_peered":"2024-09-10T08:29:34.029997+0000","last_clean":"2024-09-10T08:29:34.029997+0000","last_became_active":"2024-09-10T08:29:34.028152+0000","last_became_peered":"2024-09-10T08:29:34.028152+0000","last_unstale":"2024-09-10T08:29:34.029997+0000","last_undegraded":"2024-09-10T08:29:34.029997+0000","last_fullsized":"2024-09-10T08:29:34.029997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:55.420525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032747+0000","last_change":"2024-09-10T08:29:33.024021+0000","last_active":"2024-09-10T08:29:33.032747+0000","last_peered":"2024-09-10T08:29:33.032747+0000","last_clean":"2024-09-10T08:29:33.032747+0000","last_became_active":"2024-09-10T08:29:33.023084+0000","last_became_peered":"2024-09-10T08:29:33.023084+0000","last_unstale":"2024-09-10T08:29:33.032747+0000","last_undegraded":"2024-09-10T08:29:33.032747+0000","last_fullsized":"2024-09-10T08:29:33.032747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:57.303843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038671+0000","last_change":"2024-09-10T08:29:34.037052+0000","last_active":"2024-09-10T08:29:34.038671+0000","last_peered":"2024-09-10T08:29:34.038671+0000","last_clean":"2024-09-10T08:29:34.038671+0000","last_became_active":"2024-09-10T08:29:34.036602+0000","last_became_peered":"2024-09-10T08:29:34.036602+0000","last_unstale":"2024-09-10T08:29:34.038671+0000","last_undegraded":"2024-09-10T08:29:34.038671+0000","last_fullsized":"2024-09-10T08:29:34.038671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025729+0000","last_change":"2024-09-10T08:29:33.024043+0000","last_active":"2024-09-10T08:29:34.025729+0000","last_peered":"2024-09-10T08:29:34.025729+0000","last_clean":"2024-09-10T08:29:34.025729+0000","last_became_active":"2024-09-10T08:29:33.023735+0000","last_became_peered":"2024-09-10T08:29:33.023735+0000","last_unstale":"2024-09-10T08:29:34.025729+0000","last_undegraded":"2024-09-10T08:29:34.025729+0000","last_fullsized":"2024-09-10T08:29:34.025729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.047928+0000","last_change":"2024-09-10T08:29:34.044817+0000","last_active":"2024-09-10T08:29:34.047928+0000","last_peered":"2024-09-10T08:29:34.047928+0000","last_clean":"2024-09-10T08:29:34.047928+0000","last_became_active":"2024-09-10T08:29:34.044489+0000","last_became_peered":"2024-09-10T08:29:34.044489+0000","last_unstale":"2024-09-10T08:29:34.047928+0000","last_undegraded":"2024-09-10T08:29:34.047928+0000","last_fullsized":"2024-09-10T08:29:34.047928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.023957+0000","last_change":"2024-09-10T08:29:33.030176+0000","last_active":"2024-09-10T08:29:34.023957+0000","last_peered":"2024-09-10T08:29:34.023957+0000","last_clean":"2024-09-10T08:29:34.023957+0000","last_became_active":"2024-09-10T08:29:33.028687+0000","last_became_peered":"2024-09-10T08:29:33.028687+0000","last_unstale":"2024-09-10T08:29:34.023957+0000","last_undegraded":"2024-09-10T08:29:34.023957+0000","last_fullsized":"2024-09-10T08:29:34.023957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032909+0000","last_change":"2024-09-10T08:29:34.031146+0000","last_active":"2024-09-10T08:29:34.032909+0000","last_peered":"2024-09-10T08:29:34.032909+0000","last_clean":"2024-09-10T08:29:34.032909+0000","last_became_active":"2024-09-10T08:29:34.030853+0000","last_became_peered":"2024-09-10T08:29:34.030853+0000","last_unstale":"2024-09-10T08:29:34.032909+0000","last_undegraded":"2024-09-10T08:29:34.032909+0000","last_fullsized":"2024-09-10T08:29:34.032909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022820+0000","last_change":"2024-09-10T08:29:33.028878+0000","last_active":"2024-09-10T08:29:34.022820+0000","last_peered":"2024-09-10T08:29:34.022820+0000","last_clean":"2024-09-10T08:29:34.022820+0000","last_became_active":"2024-09-10T08:29:33.028575+0000","last_became_peered":"2024-09-10T08:29:33.028575+0000","last_unstale":"2024-09-10T08:29:34.022820+0000","last_undegraded":"2024-09-10T08:29:34.022820+0000","last_fullsized":"2024-09-10T08:29:34.022820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.030519+0000","last_change":"2024-09-10T08:29:34.022980+0000","last_active":"2024-09-10T08:29:34.030519+0000","last_peered":"2024-09-10T08:29:34.030519+0000","last_clean":"2024-09-10T08:29:34.030519+0000","last_became_active":"2024-09-10T08:29:34.022678+0000","last_became_peered":"2024-09-10T08:29:34.022678+0000","last_unstale":"2024-09-10T08:29:34.030519+0000","last_undegraded":"2024-09-10T08:29:34.030519+0000","last_fullsized":"2024-09-10T08:29:34.030519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014357+0000","last_change":"2024-09-10T08:29:33.027084+0000","last_active":"2024-09-10T08:29:34.014357+0000","last_peered":"2024-09-10T08:29:34.014357+0000","last_clean":"2024-09-10T08:29:34.014357+0000","last_became_active":"2024-09-10T08:29:33.026802+0000","last_became_peered":"2024-09-10T08:29:33.026802+0000","last_unstale":"2024-09-10T08:29:34.014357+0000","last_undegraded":"2024-09-10T08:29:34.014357+0000","last_fullsized":"2024-09-10T08:29:34.014357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038540+0000","last_change":"2024-09-10T08:29:34.030886+0000","last_active":"2024-09-10T08:29:34.038540+0000","last_peered":"2024-09-10T08:29:34.038540+0000","last_clean":"2024-09-10T08:29:34.038540+0000","last_became_active":"2024-09-10T08:29:34.030659+0000","last_became_peered":"2024-09-10T08:29:34.030659+0000","last_unstale":"2024-09-10T08:29:34.038540+0000","last_undegraded":"2024-09-10T08:29:34.038540+0000","last_fullsized":"2024-09-10T08:29:34.038540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:46.321648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.016464+0000","last_change":"2024-09-10T08:29:33.029745+0000","last_active":"2024-09-10T08:29:34.016464+0000","last_peered":"2024-09-10T08:29:34.016464+0000","last_clean":"2024-09-10T08:29:34.016464+0000","last_became_active":"2024-09-10T08:29:33.029417+0000","last_became_peered":"2024-09-10T08:29:33.029417+0000","last_unstale":"2024-09-10T08:29:34.016464+0000","last_undegraded":"2024-09-10T08:29:34.016464+0000","last_fullsized":"2024-09-10T08:29:34.016464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:03.473771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048514+0000","last_change":"2024-09-10T08:29:34.046471+0000","last_active":"2024-09-10T08:29:34.048514+0000","last_peered":"2024-09-10T08:29:34.048514+0000","last_clean":"2024-09-10T08:29:34.048514+0000","last_became_active":"2024-09-10T08:29:34.046117+0000","last_became_peered":"2024-09-10T08:29:34.046117+0000","last_unstale":"2024-09-10T08:29:34.048514+0000","last_undegraded":"2024-09-10T08:29:34.048514+0000","last_fullsized":"2024-09-10T08:29:34.048514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022590+0000","last_change":"2024-09-10T08:29:33.026103+0000","last_active":"2024-09-10T08:29:34.022590+0000","last_peered":"2024-09-10T08:29:34.022590+0000","last_clean":"2024-09-10T08:29:34.022590+0000","last_became_active":"2024-09-10T08:29:33.025539+0000","last_became_peered":"2024-09-10T08:29:33.025539+0000","last_unstale":"2024-09-10T08:29:34.022590+0000","last_undegraded":"2024-09-10T08:29:34.022590+0000","last_fullsized":"2024-09-10T08:29:34.022590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:42.966093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.019288+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:29:34.019288+0000","last_peered":"2024-09-10T08:29:34.019288+0000","last_clean":"2024-09-10T08:29:34.019288+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:29:34.019288+0000","last_undegraded":"2024-09-10T08:29:34.019288+0000","last_fullsized":"2024-09-10T08:29:34.019288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":134879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":134901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":368640,"data_stored":134043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":950272,"data_stored":723705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":710585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:38.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:38.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.854+0000 7f71cbe00640 1 Processor -- start 2024-09-10T08:29:38.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.854+0000 7f71cbe00640 1 -- start start 2024-09-10T08:29:38.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cbe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f71cc15d7c0 0x7f71cc15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cbe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71cc0b6660 con 0x7f71cc1522d0 2024-09-10T08:29:38.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cbe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc15f860 con 0x7f71cc15d7c0 2024-09-10T08:29:38.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc15ca90 con 0x7f71cc15eec0 2024-09-10T08:29:38.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71c2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71cb400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f71cc15d7c0 0x7f71cc15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71caa00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f71cc1522d0 0x7f71cc0b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:44778/0 (socket says 172.21.15.52:44778) 2024-09-10T08:29:38.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.855+0000 7f71caa00640 1 -- 172.21.15.52:0/1233670142 learned_addr learned my addr 172.21.15.52:0/1233670142 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:38.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.856+0000 7f71c2000640 1 -- 172.21.15.52:0/1233670142 >> v2:172.21.15.176:3300/0 conn(0x7f71cc15d7c0 msgr2=0x7f71cc15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:38.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.856+0000 7f71c2000640 1 --2- 172.21.15.52:0/1233670142 >> v2:172.21.15.176:3300/0 conn(0x7f71cc15d7c0 0x7f71cc15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.856+0000 7f71c2000640 1 -- 172.21.15.52:0/1233670142 >> v1:172.21.15.176:6789/0 conn(0x7f71cc1522d0 legacy=0x7f71cc0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.856+0000 7f71c2000640 1 -- 172.21.15.52:0/1233670142 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc15cce0 con 0x7f71cc15eec0 2024-09-10T08:29:38.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.856+0000 7f71ca000640 1 -- 172.21.15.52:0/1233670142 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596050776 0 0) 0x7f71cc0b6660 con 0x7f71cc1522d0 2024-09-10T08:29:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.857+0000 7f71c2000640 1 --2- 172.21.15.52:0/1233670142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc15f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71b40097a0 tx=0x7f71b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1155f83801098ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.857+0000 7f71ca000640 1 -- 172.21.15.52:0/1233670142 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4037070 con 0x7f71cc15eec0 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.857+0000 7f71ca000640 1 -- 172.21.15.52:0/1233670142 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b4032440 con 0x7f71cc15eec0 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.857+0000 7f71ca000640 1 -- 172.21.15.52:0/1233670142 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4032810 con 0x7f71cc15eec0 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 -- 172.21.15.52:0/1233670142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 msgr2=0x7f71cc15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 --2- 172.21.15.52:0/1233670142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc15f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71b40097a0 tx=0x7f71b402a180 comp rx=0 tx=0).stop 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 -- 172.21.15.52:0/1233670142 shutdown_connections 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 --2- 172.21.15.52:0/1233670142 >> v2:172.21.15.176:3300/0 conn(0x7f71cc15d7c0 0x7f71cc15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 --2- 172.21.15.52:0/1233670142 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc15f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 -- 172.21.15.52:0/1233670142 >> 172.21.15.52:0/1233670142 conn(0x7f71cc06c240 msgr2=0x7f71cc06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 -- 172.21.15.52:0/1233670142 shutdown_connections 2024-09-10T08:29:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.858+0000 7f71cbe00640 1 -- 172.21.15.52:0/1233670142 wait complete. 2024-09-10T08:29:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.860+0000 7f71cbe00640 1 Processor -- start 2024-09-10T08:29:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.860+0000 7f71cbe00640 1 -- start start 2024-09-10T08:29:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc15d7c0 0x7f71cc155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc15fc80 con 0x7f71cc1522d0 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc15d2a0 con 0x7f71cc15d7c0 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0b62b0 con 0x7f71cc15eec0 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71caa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71caa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59498/0 (socket says 172.21.15.52:59498) 2024-09-10T08:29:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71caa00640 1 -- 172.21.15.52:0/3424528738 learned_addr learned my addr 172.21.15.52:0/3424528738 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71c2000640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc15d7c0 0x7f71cc155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.861+0000 7f71cb400640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 -- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 msgr2=0x7f71cc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 -- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc15d7c0 msgr2=0x7f71cc155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc15d7c0 0x7f71cc155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 -- 172.21.15.52:0/3424528738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc152bc0 con 0x7f71cc1522d0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71cb400640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71caa00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c430 tx=0x7f71bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0074e0 con 0x7f71cc1522d0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc0047e0 con 0x7f71cc1522d0 2024-09-10T08:29:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc004bd0 con 0x7f71cc1522d0 2024-09-10T08:29:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc14f960 con 0x7f71cc1522d0 2024-09-10T08:29:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.862+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc150200 con 0x7f71cc1522d0 2024-09-10T08:29:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.863+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc1526b0 con 0x7f71cc1522d0 2024-09-10T08:29:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.864+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f71bc011070 con 0x7f71cc1522d0 2024-09-10T08:29:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.865+0000 7f71c3e00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 0x7f71a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.865+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f71bc08aad0 con 0x7f71cc1522d0 2024-09-10T08:29:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.866+0000 7f71c2000640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 0x7f71a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.866+0000 7f71c2000640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 0x7f71a806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71b4034000 tx=0x7f71b402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:38.869+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71bc0593e0 con 0x7f71cc1522d0 2024-09-10T08:29:39.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.052+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71cc0b36f0 con 0x7f71a806be60 2024-09-10T08:29:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.059+0000 7f71c3e00640 1 -- 172.21.15.52:0/3424528738 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251477 (secure 0 0 0) 0x7f71cc0b36f0 con 0x7f71a806be60 2024-09-10T08:29:39.062 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 msgr2=0x7f71a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 0x7f71a806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71b4034000 tx=0x7f71b402e000 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 msgr2=0x7f71cc150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00c430 tx=0x7f71bc00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 shutdown_connections 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f71a806be60 0x7f71a806e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71cc15eec0 0x7f71cc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71cc15d7c0 0x7f71cc155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 --2- 172.21.15.52:0/3424528738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71cc1522d0 0x7f71cc150a00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 >> 172.21.15.52:0/3424528738 conn(0x7f71cc06c240 msgr2=0x7f71cc15dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 shutdown_connections 2024-09-10T08:29:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.063+0000 7f71cbe00640 1 -- 172.21.15.52:0/3424528738 wait complete. 2024-09-10T08:29:39.079 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-10T08:29:37.462714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240996,"kb_used_data":3948,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733724,"statfs":{"total":773094113280,"available":772847333376,"internally_reserved":0,"allocated":4042752,"data_stored":2238060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.466606"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053977+0000","last_change":"2024-09-10T08:29:34.050800+0000","last_active":"2024-09-10T08:29:34.053977+0000","last_peered":"2024-09-10T08:29:34.053977+0000","last_clean":"2024-09-10T08:29:34.053977+0000","last_became_active":"2024-09-10T08:29:34.050515+0000","last_became_peered":"2024-09-10T08:29:34.050515+0000","last_unstale":"2024-09-10T08:29:34.053977+0000","last_undegraded":"2024-09-10T08:29:34.053977+0000","last_fullsized":"2024-09-10T08:29:34.053977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011260+0000","last_change":"2024-09-10T08:29:33.011260+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011260+0000","last_undegraded":"2024-09-10T08:29:33.011260+0000","last_fullsized":"2024-09-10T08:29:33.011260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040297+0000","last_change":"2024-09-10T08:29:34.032147+0000","last_active":"2024-09-10T08:29:34.040297+0000","last_peered":"2024-09-10T08:29:34.040297+0000","last_clean":"2024-09-10T08:29:34.040297+0000","last_became_active":"2024-09-10T08:29:34.031869+0000","last_became_peered":"2024-09-10T08:29:34.031869+0000","last_unstale":"2024-09-10T08:29:34.040297+0000","last_undegraded":"2024-09-10T08:29:34.040297+0000","last_fullsized":"2024-09-10T08:29:34.040297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:07.111302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046602+0000","last_change":"2024-09-10T08:29:34.043864+0000","last_active":"2024-09-10T08:29:34.046602+0000","last_peered":"2024-09-10T08:29:34.046602+0000","last_clean":"2024-09-10T08:29:34.046602+0000","last_became_active":"2024-09-10T08:29:34.041475+0000","last_became_peered":"2024-09-10T08:29:34.041475+0000","last_unstale":"2024-09-10T08:29:34.046602+0000","last_undegraded":"2024-09-10T08:29:34.046602+0000","last_fullsized":"2024-09-10T08:29:34.046602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015866+0000","last_change":"2024-09-10T08:29:33.015866+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015866+0000","last_undegraded":"2024-09-10T08:29:33.015866+0000","last_fullsized":"2024-09-10T08:29:33.015866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043370+0000","last_change":"2024-09-10T08:29:34.039947+0000","last_active":"2024-09-10T08:29:34.043370+0000","last_peered":"2024-09-10T08:29:34.043370+0000","last_clean":"2024-09-10T08:29:34.043370+0000","last_became_active":"2024-09-10T08:29:34.039425+0000","last_became_peered":"2024-09-10T08:29:34.039425+0000","last_unstale":"2024-09-10T08:29:34.043370+0000","last_undegraded":"2024-09-10T08:29:34.043370+0000","last_fullsized":"2024-09-10T08:29:34.043370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039018+0000","last_change":"2024-09-10T08:29:34.035820+0000","last_active":"2024-09-10T08:29:34.039018+0000","last_peered":"2024-09-10T08:29:34.039018+0000","last_clean":"2024-09-10T08:29:34.039018+0000","last_became_active":"2024-09-10T08:29:34.035530+0000","last_became_peered":"2024-09-10T08:29:34.035530+0000","last_unstale":"2024-09-10T08:29:34.039018+0000","last_undegraded":"2024-09-10T08:29:34.039018+0000","last_fullsized":"2024-09-10T08:29:34.039018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:04.478284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036860+0000","last_change":"2024-09-10T08:29:34.032026+0000","last_active":"2024-09-10T08:29:34.036860+0000","last_peered":"2024-09-10T08:29:34.036860+0000","last_clean":"2024-09-10T08:29:34.036860+0000","last_became_active":"2024-09-10T08:29:34.031828+0000","last_became_peered":"2024-09-10T08:29:34.031828+0000","last_unstale":"2024-09-10T08:29:34.036860+0000","last_undegraded":"2024-09-10T08:29:34.036860+0000","last_fullsized":"2024-09-10T08:29:34.036860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048214+0000","last_change":"2024-09-10T08:29:34.044053+0000","last_active":"2024-09-10T08:29:34.048214+0000","last_peered":"2024-09-10T08:29:34.048214+0000","last_clean":"2024-09-10T08:29:34.048214+0000","last_became_active":"2024-09-10T08:29:34.043402+0000","last_became_peered":"2024-09-10T08:29:34.043402+0000","last_unstale":"2024-09-10T08:29:34.048214+0000","last_undegraded":"2024-09-10T08:29:34.048214+0000","last_fullsized":"2024-09-10T08:29:34.048214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:49.509388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036899+0000","last_change":"2024-09-10T08:29:34.034386+0000","last_active":"2024-09-10T08:29:34.036899+0000","last_peered":"2024-09-10T08:29:34.036899+0000","last_clean":"2024-09-10T08:29:34.036899+0000","last_became_active":"2024-09-10T08:29:34.034034+0000","last_became_peered":"2024-09-10T08:29:34.034034+0000","last_unstale":"2024-09-10T08:29:34.036899+0000","last_undegraded":"2024-09-10T08:29:34.036899+0000","last_fullsized":"2024-09-10T08:29:34.036899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041062+0000","last_change":"2024-09-10T08:29:34.035547+0000","last_active":"2024-09-10T08:29:34.041062+0000","last_peered":"2024-09-10T08:29:34.041062+0000","last_clean":"2024-09-10T08:29:34.041062+0000","last_became_active":"2024-09-10T08:29:34.035248+0000","last_became_peered":"2024-09-10T08:29:34.035248+0000","last_unstale":"2024-09-10T08:29:34.041062+0000","last_undegraded":"2024-09-10T08:29:34.041062+0000","last_fullsized":"2024-09-10T08:29:34.041062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:33.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040316+0000","last_change":"2024-09-10T08:29:34.037847+0000","last_active":"2024-09-10T08:29:34.040316+0000","last_peered":"2024-09-10T08:29:34.040316+0000","last_clean":"2024-09-10T08:29:34.040316+0000","last_became_active":"2024-09-10T08:29:34.036896+0000","last_became_peered":"2024-09-10T08:29:34.036896+0000","last_unstale":"2024-09-10T08:29:34.040316+0000","last_undegraded":"2024-09-10T08:29:34.040316+0000","last_fullsized":"2024-09-10T08:29:34.040316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:55.409697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043840+0000","last_change":"2024-09-10T08:29:34.037905+0000","last_active":"2024-09-10T08:29:34.043840+0000","last_peered":"2024-09-10T08:29:34.043840+0000","last_clean":"2024-09-10T08:29:34.043840+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.043840+0000","last_undegraded":"2024-09-10T08:29:34.043840+0000","last_fullsized":"2024-09-10T08:29:34.043840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.034400+0000","last_change":"2024-09-10T08:29:34.031148+0000","last_active":"2024-09-10T08:29:34.034400+0000","last_peered":"2024-09-10T08:29:34.034400+0000","last_clean":"2024-09-10T08:29:34.034400+0000","last_became_active":"2024-09-10T08:29:34.030897+0000","last_became_peered":"2024-09-10T08:29:34.030897+0000","last_unstale":"2024-09-10T08:29:34.034400+0000","last_undegraded":"2024-09-10T08:29:34.034400+0000","last_fullsized":"2024-09-10T08:29:34.034400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040141+0000","last_change":"2024-09-10T08:29:34.037889+0000","last_active":"2024-09-10T08:29:34.040141+0000","last_peered":"2024-09-10T08:29:34.040141+0000","last_clean":"2024-09-10T08:29:34.040141+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.040141+0000","last_undegraded":"2024-09-10T08:29:34.040141+0000","last_fullsized":"2024-09-10T08:29:34.040141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043902+0000","last_change":"2024-09-10T08:29:34.040898+0000","last_active":"2024-09-10T08:29:34.043902+0000","last_peered":"2024-09-10T08:29:34.043902+0000","last_clean":"2024-09-10T08:29:34.043902+0000","last_became_active":"2024-09-10T08:29:34.040166+0000","last_became_peered":"2024-09-10T08:29:34.040166+0000","last_unstale":"2024-09-10T08:29:34.043902+0000","last_undegraded":"2024-09-10T08:29:34.043902+0000","last_fullsized":"2024-09-10T08:29:34.043902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039039+0000","last_change":"2024-09-10T08:29:34.023343+0000","last_active":"2024-09-10T08:29:34.039039+0000","last_peered":"2024-09-10T08:29:34.039039+0000","last_clean":"2024-09-10T08:29:34.039039+0000","last_became_active":"2024-09-10T08:29:34.023036+0000","last_became_peered":"2024-09-10T08:29:34.023036+0000","last_unstale":"2024-09-10T08:29:34.039039+0000","last_undegraded":"2024-09-10T08:29:34.039039+0000","last_fullsized":"2024-09-10T08:29:34.039039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:43.993961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037399+0000","last_change":"2024-09-10T08:29:34.033658+0000","last_active":"2024-09-10T08:29:34.037399+0000","last_peered":"2024-09-10T08:29:34.037399+0000","last_clean":"2024-09-10T08:29:34.037399+0000","last_became_active":"2024-09-10T08:29:34.033379+0000","last_became_peered":"2024-09-10T08:29:34.033379+0000","last_unstale":"2024-09-10T08:29:34.037399+0000","last_undegraded":"2024-09-10T08:29:34.037399+0000","last_fullsized":"2024-09-10T08:29:34.037399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046363+0000","last_change":"2024-09-10T08:29:34.042026+0000","last_active":"2024-09-10T08:29:34.046363+0000","last_peered":"2024-09-10T08:29:34.046363+0000","last_clean":"2024-09-10T08:29:34.046363+0000","last_became_active":"2024-09-10T08:29:34.041674+0000","last_became_peered":"2024-09-10T08:29:34.041674+0000","last_unstale":"2024-09-10T08:29:34.046363+0000","last_undegraded":"2024-09-10T08:29:34.046363+0000","last_fullsized":"2024-09-10T08:29:34.046363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:20.274879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045151+0000","last_change":"2024-09-10T08:29:34.039736+0000","last_active":"2024-09-10T08:29:34.045151+0000","last_peered":"2024-09-10T08:29:34.045151+0000","last_clean":"2024-09-10T08:29:34.045151+0000","last_became_active":"2024-09-10T08:29:34.039447+0000","last_became_peered":"2024-09-10T08:29:34.039447+0000","last_unstale":"2024-09-10T08:29:34.045151+0000","last_undegraded":"2024-09-10T08:29:34.045151+0000","last_fullsized":"2024-09-10T08:29:34.045151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054596+0000","last_change":"2024-09-10T08:29:34.048898+0000","last_active":"2024-09-10T08:29:34.054596+0000","last_peered":"2024-09-10T08:29:34.054596+0000","last_clean":"2024-09-10T08:29:34.054596+0000","last_became_active":"2024-09-10T08:29:34.039978+0000","last_became_peered":"2024-09-10T08:29:34.039978+0000","last_unstale":"2024-09-10T08:29:34.054596+0000","last_undegraded":"2024-09-10T08:29:34.054596+0000","last_fullsized":"2024-09-10T08:29:34.054596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036710+0000","last_change":"2024-09-10T08:29:34.027611+0000","last_active":"2024-09-10T08:29:34.036710+0000","last_peered":"2024-09-10T08:29:34.036710+0000","last_clean":"2024-09-10T08:29:34.036710+0000","last_became_active":"2024-09-10T08:29:34.027316+0000","last_became_peered":"2024-09-10T08:29:34.027316+0000","last_unstale":"2024-09-10T08:29:34.036710+0000","last_undegraded":"2024-09-10T08:29:34.036710+0000","last_fullsized":"2024-09-10T08:29:34.036710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048984+0000","last_change":"2024-09-10T08:29:34.043504+0000","last_active":"2024-09-10T08:29:34.048984+0000","last_peered":"2024-09-10T08:29:34.048984+0000","last_clean":"2024-09-10T08:29:34.048984+0000","last_became_active":"2024-09-10T08:29:34.042661+0000","last_became_peered":"2024-09-10T08:29:34.042661+0000","last_unstale":"2024-09-10T08:29:34.048984+0000","last_undegraded":"2024-09-10T08:29:34.048984+0000","last_fullsized":"2024-09-10T08:29:34.048984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052679+0000","last_change":"2024-09-10T08:29:34.036454+0000","last_active":"2024-09-10T08:29:34.052679+0000","last_peered":"2024-09-10T08:29:34.052679+0000","last_clean":"2024-09-10T08:29:34.052679+0000","last_became_active":"2024-09-10T08:29:34.036101+0000","last_became_peered":"2024-09-10T08:29:34.036101+0000","last_unstale":"2024-09-10T08:29:34.052679+0000","last_undegraded":"2024-09-10T08:29:34.052679+0000","last_fullsized":"2024-09-10T08:29:34.052679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032825+0000","last_change":"2024-09-10T08:29:34.030162+0000","last_active":"2024-09-10T08:29:34.032825+0000","last_peered":"2024-09-10T08:29:34.032825+0000","last_clean":"2024-09-10T08:29:34.032825+0000","last_became_active":"2024-09-10T08:29:34.029892+0000","last_became_peered":"2024-09-10T08:29:34.029892+0000","last_unstale":"2024-09-10T08:29:34.032825+0000","last_undegraded":"2024-09-10T08:29:34.032825+0000","last_fullsized":"2024-09-10T08:29:34.032825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.035273+0000","last_change":"2024-09-10T08:29:34.024246+0000","last_active":"2024-09-10T08:29:34.035273+0000","last_peered":"2024-09-10T08:29:34.035273+0000","last_clean":"2024-09-10T08:29:34.035273+0000","last_became_active":"2024-09-10T08:29:34.023898+0000","last_became_peered":"2024-09-10T08:29:34.023898+0000","last_unstale":"2024-09-10T08:29:34.035273+0000","last_undegraded":"2024-09-10T08:29:34.035273+0000","last_fullsized":"2024-09-10T08:29:34.035273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.011836+0000","last_change":"2024-09-10T08:29:33.011836+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.011836+0000","last_undegraded":"2024-09-10T08:29:33.011836+0000","last_fullsized":"2024-09-10T08:29:33.011836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048276+0000","last_change":"2024-09-10T08:29:34.033479+0000","last_active":"2024-09-10T08:29:34.048276+0000","last_peered":"2024-09-10T08:29:34.048276+0000","last_clean":"2024-09-10T08:29:34.048276+0000","last_became_active":"2024-09-10T08:29:34.033007+0000","last_became_peered":"2024-09-10T08:29:34.033007+0000","last_unstale":"2024-09-10T08:29:34.048276+0000","last_undegraded":"2024-09-10T08:29:34.048276+0000","last_fullsized":"2024-09-10T08:29:34.048276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049296+0000","last_change":"2024-09-10T08:29:34.038693+0000","last_active":"2024-09-10T08:29:34.049296+0000","last_peered":"2024-09-10T08:29:34.049296+0000","last_clean":"2024-09-10T08:29:34.049296+0000","last_became_active":"2024-09-10T08:29:34.038418+0000","last_became_peered":"2024-09-10T08:29:34.038418+0000","last_unstale":"2024-09-10T08:29:34.049296+0000","last_undegraded":"2024-09-10T08:29:34.049296+0000","last_fullsized":"2024-09-10T08:29:34.049296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045846+0000","last_change":"2024-09-10T08:29:34.043411+0000","last_active":"2024-09-10T08:29:34.045846+0000","last_peered":"2024-09-10T08:29:34.045846+0000","last_clean":"2024-09-10T08:29:34.045846+0000","last_became_active":"2024-09-10T08:29:34.042873+0000","last_became_peered":"2024-09-10T08:29:34.042873+0000","last_unstale":"2024-09-10T08:29:34.045846+0000","last_undegraded":"2024-09-10T08:29:34.045846+0000","last_fullsized":"2024-09-10T08:29:34.045846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052450+0000","last_change":"2024-09-10T08:29:34.036484+0000","last_active":"2024-09-10T08:29:34.052450+0000","last_peered":"2024-09-10T08:29:34.052450+0000","last_clean":"2024-09-10T08:29:34.052450+0000","last_became_active":"2024-09-10T08:29:34.036196+0000","last_became_peered":"2024-09-10T08:29:34.036196+0000","last_unstale":"2024-09-10T08:29:34.052450+0000","last_undegraded":"2024-09-10T08:29:34.052450+0000","last_fullsized":"2024-09-10T08:29:34.052450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039363+0000","last_change":"2024-09-10T08:29:34.023550+0000","last_active":"2024-09-10T08:29:34.039363+0000","last_peered":"2024-09-10T08:29:34.039363+0000","last_clean":"2024-09-10T08:29:34.039363+0000","last_became_active":"2024-09-10T08:29:34.023253+0000","last_became_peered":"2024-09-10T08:29:34.023253+0000","last_unstale":"2024-09-10T08:29:34.039363+0000","last_undegraded":"2024-09-10T08:29:34.039363+0000","last_fullsized":"2024-09-10T08:29:34.039363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:54.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036626+0000","last_change":"2024-09-10T08:29:34.030313+0000","last_active":"2024-09-10T08:29:34.036626+0000","last_peered":"2024-09-10T08:29:34.036626+0000","last_clean":"2024-09-10T08:29:34.036626+0000","last_became_active":"2024-09-10T08:29:34.029987+0000","last_became_peered":"2024-09-10T08:29:34.029987+0000","last_unstale":"2024-09-10T08:29:34.036626+0000","last_undegraded":"2024-09-10T08:29:34.036626+0000","last_fullsized":"2024-09-10T08:29:34.036626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053023+0000","last_change":"2024-09-10T08:29:33.022598+0000","last_active":"2024-09-10T08:29:34.053023+0000","last_peered":"2024-09-10T08:29:34.053023+0000","last_clean":"2024-09-10T08:29:34.053023+0000","last_became_active":"2024-09-10T08:29:33.022302+0000","last_became_peered":"2024-09-10T08:29:33.022302+0000","last_unstale":"2024-09-10T08:29:34.053023+0000","last_undegraded":"2024-09-10T08:29:34.053023+0000","last_fullsized":"2024-09-10T08:29:34.053023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:20.408155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053197+0000","last_change":"2024-09-10T08:29:34.038139+0000","last_active":"2024-09-10T08:29:34.053197+0000","last_peered":"2024-09-10T08:29:34.053197+0000","last_clean":"2024-09-10T08:29:34.053197+0000","last_became_active":"2024-09-10T08:29:34.037740+0000","last_became_peered":"2024-09-10T08:29:34.037740+0000","last_unstale":"2024-09-10T08:29:34.053197+0000","last_undegraded":"2024-09-10T08:29:34.053197+0000","last_fullsized":"2024-09-10T08:29:34.053197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054715+0000","last_change":"2024-09-10T08:29:33.022704+0000","last_active":"2024-09-10T08:29:34.054715+0000","last_peered":"2024-09-10T08:29:34.054715+0000","last_clean":"2024-09-10T08:29:34.054715+0000","last_became_active":"2024-09-10T08:29:33.021966+0000","last_became_peered":"2024-09-10T08:29:33.021966+0000","last_unstale":"2024-09-10T08:29:34.054715+0000","last_undegraded":"2024-09-10T08:29:34.054715+0000","last_fullsized":"2024-09-10T08:29:34.054715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048250+0000","last_change":"2024-09-10T08:29:34.026982+0000","last_active":"2024-09-10T08:29:34.048250+0000","last_peered":"2024-09-10T08:29:34.048250+0000","last_clean":"2024-09-10T08:29:34.048250+0000","last_became_active":"2024-09-10T08:29:34.026660+0000","last_became_peered":"2024-09-10T08:29:34.026660+0000","last_unstale":"2024-09-10T08:29:34.048250+0000","last_undegraded":"2024-09-10T08:29:34.048250+0000","last_fullsized":"2024-09-10T08:29:34.048250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060566+0000","last_change":"2024-09-10T08:29:33.021777+0000","last_active":"2024-09-10T08:29:34.060566+0000","last_peered":"2024-09-10T08:29:34.060566+0000","last_clean":"2024-09-10T08:29:34.060566+0000","last_became_active":"2024-09-10T08:29:33.021502+0000","last_became_peered":"2024-09-10T08:29:33.021502+0000","last_unstale":"2024-09-10T08:29:34.060566+0000","last_undegraded":"2024-09-10T08:29:34.060566+0000","last_fullsized":"2024-09-10T08:29:34.060566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:34.767107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037102+0000","last_change":"2024-09-10T08:29:34.034652+0000","last_active":"2024-09-10T08:29:34.037102+0000","last_peered":"2024-09-10T08:29:34.037102+0000","last_clean":"2024-09-10T08:29:34.037102+0000","last_became_active":"2024-09-10T08:29:34.034324+0000","last_became_peered":"2024-09-10T08:29:34.034324+0000","last_unstale":"2024-09-10T08:29:34.037102+0000","last_undegraded":"2024-09-10T08:29:34.037102+0000","last_fullsized":"2024-09-10T08:29:34.037102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055947+0000","last_change":"2024-09-10T08:29:33.022304+0000","last_active":"2024-09-10T08:29:34.055947+0000","last_peered":"2024-09-10T08:29:34.055947+0000","last_clean":"2024-09-10T08:29:34.055947+0000","last_became_active":"2024-09-10T08:29:33.022083+0000","last_became_peered":"2024-09-10T08:29:33.022083+0000","last_unstale":"2024-09-10T08:29:34.055947+0000","last_undegraded":"2024-09-10T08:29:34.055947+0000","last_fullsized":"2024-09-10T08:29:34.055947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:00.602457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049083+0000","last_change":"2024-09-10T08:29:34.045812+0000","last_active":"2024-09-10T08:29:34.049083+0000","last_peered":"2024-09-10T08:29:34.049083+0000","last_clean":"2024-09-10T08:29:34.049083+0000","last_became_active":"2024-09-10T08:29:34.045608+0000","last_became_peered":"2024-09-10T08:29:34.045608+0000","last_unstale":"2024-09-10T08:29:34.049083+0000","last_undegraded":"2024-09-10T08:29:34.049083+0000","last_fullsized":"2024-09-10T08:29:34.049083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.057630+0000","last_change":"2024-09-10T08:29:33.024403+0000","last_active":"2024-09-10T08:29:34.057630+0000","last_peered":"2024-09-10T08:29:34.057630+0000","last_clean":"2024-09-10T08:29:34.057630+0000","last_became_active":"2024-09-10T08:29:33.023478+0000","last_became_peered":"2024-09-10T08:29:33.023478+0000","last_unstale":"2024-09-10T08:29:34.057630+0000","last_undegraded":"2024-09-10T08:29:34.057630+0000","last_fullsized":"2024-09-10T08:29:34.057630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053926+0000","last_change":"2024-09-10T08:29:34.049858+0000","last_active":"2024-09-10T08:29:34.053926+0000","last_peered":"2024-09-10T08:29:34.053926+0000","last_clean":"2024-09-10T08:29:34.053926+0000","last_became_active":"2024-09-10T08:29:34.036503+0000","last_became_peered":"2024-09-10T08:29:34.036503+0000","last_unstale":"2024-09-10T08:29:34.053926+0000","last_undegraded":"2024-09-10T08:29:34.053926+0000","last_fullsized":"2024-09-10T08:29:34.053926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.056845+0000","last_change":"2024-09-10T08:29:33.028410+0000","last_active":"2024-09-10T08:29:34.056845+0000","last_peered":"2024-09-10T08:29:34.056845+0000","last_clean":"2024-09-10T08:29:34.056845+0000","last_became_active":"2024-09-10T08:29:33.026040+0000","last_became_peered":"2024-09-10T08:29:33.026040+0000","last_unstale":"2024-09-10T08:29:34.056845+0000","last_undegraded":"2024-09-10T08:29:34.056845+0000","last_fullsized":"2024-09-10T08:29:34.056845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049142+0000","last_change":"2024-09-10T08:29:34.044121+0000","last_active":"2024-09-10T08:29:34.049142+0000","last_peered":"2024-09-10T08:29:34.049142+0000","last_clean":"2024-09-10T08:29:34.049142+0000","last_became_active":"2024-09-10T08:29:34.043839+0000","last_became_peered":"2024-09-10T08:29:34.043839+0000","last_unstale":"2024-09-10T08:29:34.049142+0000","last_undegraded":"2024-09-10T08:29:34.049142+0000","last_fullsized":"2024-09-10T08:29:34.049142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:35.771620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022302+0000","last_change":"2024-09-10T08:29:33.024132+0000","last_active":"2024-09-10T08:29:34.022302+0000","last_peered":"2024-09-10T08:29:34.022302+0000","last_clean":"2024-09-10T08:29:34.022302+0000","last_became_active":"2024-09-10T08:29:33.023879+0000","last_became_peered":"2024-09-10T08:29:33.023879+0000","last_unstale":"2024-09-10T08:29:34.022302+0000","last_undegraded":"2024-09-10T08:29:34.022302+0000","last_fullsized":"2024-09-10T08:29:34.022302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:54.405184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031899+0000","last_change":"2024-09-10T08:29:34.027671+0000","last_active":"2024-09-10T08:29:34.031899+0000","last_peered":"2024-09-10T08:29:34.031899+0000","last_clean":"2024-09-10T08:29:34.031899+0000","last_became_active":"2024-09-10T08:29:34.027289+0000","last_became_peered":"2024-09-10T08:29:34.027289+0000","last_unstale":"2024-09-10T08:29:34.031899+0000","last_undegraded":"2024-09-10T08:29:34.031899+0000","last_fullsized":"2024-09-10T08:29:34.031899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014607+0000","last_change":"2024-09-10T08:29:33.020211+0000","last_active":"2024-09-10T08:29:34.014607+0000","last_peered":"2024-09-10T08:29:34.014607+0000","last_clean":"2024-09-10T08:29:34.014607+0000","last_became_active":"2024-09-10T08:29:33.019698+0000","last_became_peered":"2024-09-10T08:29:33.019698+0000","last_unstale":"2024-09-10T08:29:34.014607+0000","last_undegraded":"2024-09-10T08:29:34.014607+0000","last_fullsized":"2024-09-10T08:29:34.014607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.545431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039052+0000","last_change":"2024-09-10T08:29:34.031164+0000","last_active":"2024-09-10T08:29:34.039052+0000","last_peered":"2024-09-10T08:29:34.039052+0000","last_clean":"2024-09-10T08:29:34.039052+0000","last_became_active":"2024-09-10T08:29:34.030791+0000","last_became_peered":"2024-09-10T08:29:34.030791+0000","last_unstale":"2024-09-10T08:29:34.039052+0000","last_undegraded":"2024-09-10T08:29:34.039052+0000","last_fullsized":"2024-09-10T08:29:34.039052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:53.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032910+0000","last_change":"2024-09-10T08:29:33.025504+0000","last_active":"2024-09-10T08:29:33.032910+0000","last_peered":"2024-09-10T08:29:33.032910+0000","last_clean":"2024-09-10T08:29:33.032910+0000","last_became_active":"2024-09-10T08:29:33.025250+0000","last_became_peered":"2024-09-10T08:29:33.025250+0000","last_unstale":"2024-09-10T08:29:33.032910+0000","last_undegraded":"2024-09-10T08:29:33.032910+0000","last_fullsized":"2024-09-10T08:29:33.032910+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:43.506924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039895+0000","last_change":"2024-09-10T08:29:34.035478+0000","last_active":"2024-09-10T08:29:34.039895+0000","last_peered":"2024-09-10T08:29:34.039895+0000","last_clean":"2024-09-10T08:29:34.039895+0000","last_became_active":"2024-09-10T08:29:34.035094+0000","last_became_peered":"2024-09-10T08:29:34.035094+0000","last_unstale":"2024-09-10T08:29:34.039895+0000","last_undegraded":"2024-09-10T08:29:34.039895+0000","last_fullsized":"2024-09-10T08:29:34.039895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.029615+0000","last_change":"2024-09-10T08:29:33.022012+0000","last_active":"2024-09-10T08:29:33.029615+0000","last_peered":"2024-09-10T08:29:33.029615+0000","last_clean":"2024-09-10T08:29:33.029615+0000","last_became_active":"2024-09-10T08:29:33.021732+0000","last_became_peered":"2024-09-10T08:29:33.021732+0000","last_unstale":"2024-09-10T08:29:33.029615+0000","last_undegraded":"2024-09-10T08:29:33.029615+0000","last_fullsized":"2024-09-10T08:29:33.029615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:25.214467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031828+0000","last_change":"2024-09-10T08:29:34.027098+0000","last_active":"2024-09-10T08:29:34.031828+0000","last_peered":"2024-09-10T08:29:34.031828+0000","last_clean":"2024-09-10T08:29:34.031828+0000","last_became_active":"2024-09-10T08:29:34.026819+0000","last_became_peered":"2024-09-10T08:29:34.026819+0000","last_unstale":"2024-09-10T08:29:34.031828+0000","last_undegraded":"2024-09-10T08:29:34.031828+0000","last_fullsized":"2024-09-10T08:29:34.031828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052258+0000","last_change":"2024-09-10T08:29:33.024226+0000","last_active":"2024-09-10T08:29:34.052258+0000","last_peered":"2024-09-10T08:29:34.052258+0000","last_clean":"2024-09-10T08:29:34.052258+0000","last_became_active":"2024-09-10T08:29:33.023927+0000","last_became_peered":"2024-09-10T08:29:33.023927+0000","last_unstale":"2024-09-10T08:29:34.052258+0000","last_undegraded":"2024-09-10T08:29:34.052258+0000","last_fullsized":"2024-09-10T08:29:34.052258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.814661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031055+0000","last_change":"2024-09-10T08:29:34.028666+0000","last_active":"2024-09-10T08:29:34.031055+0000","last_peered":"2024-09-10T08:29:34.031055+0000","last_clean":"2024-09-10T08:29:34.031055+0000","last_became_active":"2024-09-10T08:29:34.023390+0000","last_became_peered":"2024-09-10T08:29:34.023390+0000","last_unstale":"2024-09-10T08:29:34.031055+0000","last_undegraded":"2024-09-10T08:29:34.031055+0000","last_fullsized":"2024-09-10T08:29:34.031055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:07.098553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060807+0000","last_change":"2024-09-10T08:29:33.024849+0000","last_active":"2024-09-10T08:29:34.060807+0000","last_peered":"2024-09-10T08:29:34.060807+0000","last_clean":"2024-09-10T08:29:34.060807+0000","last_became_active":"2024-09-10T08:29:33.024498+0000","last_became_peered":"2024-09-10T08:29:33.024498+0000","last_unstale":"2024-09-10T08:29:34.060807+0000","last_undegraded":"2024-09-10T08:29:34.060807+0000","last_fullsized":"2024-09-10T08:29:34.060807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046736+0000","last_change":"2024-09-10T08:29:34.043288+0000","last_active":"2024-09-10T08:29:34.046736+0000","last_peered":"2024-09-10T08:29:34.046736+0000","last_clean":"2024-09-10T08:29:34.046736+0000","last_became_active":"2024-09-10T08:29:34.042465+0000","last_became_peered":"2024-09-10T08:29:34.042465+0000","last_unstale":"2024-09-10T08:29:34.046736+0000","last_undegraded":"2024-09-10T08:29:34.046736+0000","last_fullsized":"2024-09-10T08:29:34.046736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058825+0000","last_change":"2024-09-10T08:29:33.028081+0000","last_active":"2024-09-10T08:29:34.058825+0000","last_peered":"2024-09-10T08:29:34.058825+0000","last_clean":"2024-09-10T08:29:34.058825+0000","last_became_active":"2024-09-10T08:29:33.027897+0000","last_became_peered":"2024-09-10T08:29:33.027897+0000","last_unstale":"2024-09-10T08:29:34.058825+0000","last_undegraded":"2024-09-10T08:29:34.058825+0000","last_fullsized":"2024-09-10T08:29:34.058825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:34.318695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051885+0000","last_change":"2024-09-10T08:29:34.045109+0000","last_active":"2024-09-10T08:29:34.051885+0000","last_peered":"2024-09-10T08:29:34.051885+0000","last_clean":"2024-09-10T08:29:34.051885+0000","last_became_active":"2024-09-10T08:29:34.043753+0000","last_became_peered":"2024-09-10T08:29:34.043753+0000","last_unstale":"2024-09-10T08:29:34.051885+0000","last_undegraded":"2024-09-10T08:29:34.051885+0000","last_fullsized":"2024-09-10T08:29:34.051885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015902+0000","last_change":"2024-09-10T08:29:33.024567+0000","last_active":"2024-09-10T08:29:34.015902+0000","last_peered":"2024-09-10T08:29:34.015902+0000","last_clean":"2024-09-10T08:29:34.015902+0000","last_became_active":"2024-09-10T08:29:33.024300+0000","last_became_peered":"2024-09-10T08:29:33.024300+0000","last_unstale":"2024-09-10T08:29:34.015902+0000","last_undegraded":"2024-09-10T08:29:34.015902+0000","last_fullsized":"2024-09-10T08:29:34.015902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:35.895300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036800+0000","last_change":"2024-09-10T08:29:34.029898+0000","last_active":"2024-09-10T08:29:34.036800+0000","last_peered":"2024-09-10T08:29:34.036800+0000","last_clean":"2024-09-10T08:29:34.036800+0000","last_became_active":"2024-09-10T08:29:34.025811+0000","last_became_peered":"2024-09-10T08:29:34.025811+0000","last_unstale":"2024-09-10T08:29:34.036800+0000","last_undegraded":"2024-09-10T08:29:34.036800+0000","last_fullsized":"2024-09-10T08:29:34.036800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015430+0000","last_change":"2024-09-10T08:29:33.027465+0000","last_active":"2024-09-10T08:29:34.015430+0000","last_peered":"2024-09-10T08:29:34.015430+0000","last_clean":"2024-09-10T08:29:34.015430+0000","last_became_active":"2024-09-10T08:29:33.027180+0000","last_became_peered":"2024-09-10T08:29:33.027180+0000","last_unstale":"2024-09-10T08:29:34.015430+0000","last_undegraded":"2024-09-10T08:29:34.015430+0000","last_fullsized":"2024-09-10T08:29:34.015430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:21.360437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038526+0000","last_change":"2024-09-10T08:29:34.030798+0000","last_active":"2024-09-10T08:29:34.038526+0000","last_peered":"2024-09-10T08:29:34.038526+0000","last_clean":"2024-09-10T08:29:34.038526+0000","last_became_active":"2024-09-10T08:29:34.030429+0000","last_became_peered":"2024-09-10T08:29:34.030429+0000","last_unstale":"2024-09-10T08:29:34.038526+0000","last_undegraded":"2024-09-10T08:29:34.038526+0000","last_fullsized":"2024-09-10T08:29:34.038526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:27.365540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.063388+0000","last_change":"2024-09-10T08:29:33.026315+0000","last_active":"2024-09-10T08:29:34.063388+0000","last_peered":"2024-09-10T08:29:34.063388+0000","last_clean":"2024-09-10T08:29:34.063388+0000","last_became_active":"2024-09-10T08:29:33.025999+0000","last_became_peered":"2024-09-10T08:29:33.025999+0000","last_unstale":"2024-09-10T08:29:34.063388+0000","last_undegraded":"2024-09-10T08:29:34.063388+0000","last_fullsized":"2024-09-10T08:29:34.063388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:06.106789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041040+0000","last_change":"2024-09-10T08:29:34.038925+0000","last_active":"2024-09-10T08:29:34.041040+0000","last_peered":"2024-09-10T08:29:34.041040+0000","last_clean":"2024-09-10T08:29:34.041040+0000","last_became_active":"2024-09-10T08:29:34.038615+0000","last_became_peered":"2024-09-10T08:29:34.038615+0000","last_unstale":"2024-09-10T08:29:34.041040+0000","last_undegraded":"2024-09-10T08:29:34.041040+0000","last_fullsized":"2024-09-10T08:29:34.041040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:14.933076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060433+0000","last_change":"2024-09-10T08:29:33.021747+0000","last_active":"2024-09-10T08:29:34.060433+0000","last_peered":"2024-09-10T08:29:34.060433+0000","last_clean":"2024-09-10T08:29:34.060433+0000","last_became_active":"2024-09-10T08:29:33.021377+0000","last_became_peered":"2024-09-10T08:29:33.021377+0000","last_unstale":"2024-09-10T08:29:34.060433+0000","last_undegraded":"2024-09-10T08:29:34.060433+0000","last_fullsized":"2024-09-10T08:29:34.060433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:48.504875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049038+0000","last_change":"2024-09-10T08:29:34.044290+0000","last_active":"2024-09-10T08:29:34.049038+0000","last_peered":"2024-09-10T08:29:34.049038+0000","last_clean":"2024-09-10T08:29:34.049038+0000","last_became_active":"2024-09-10T08:29:34.043797+0000","last_became_peered":"2024-09-10T08:29:34.043797+0000","last_unstale":"2024-09-10T08:29:34.049038+0000","last_undegraded":"2024-09-10T08:29:34.049038+0000","last_fullsized":"2024-09-10T08:29:34.049038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058819+0000","last_change":"2024-09-10T08:29:33.020918+0000","last_active":"2024-09-10T08:29:34.058819+0000","last_peered":"2024-09-10T08:29:34.058819+0000","last_clean":"2024-09-10T08:29:34.058819+0000","last_became_active":"2024-09-10T08:29:33.020658+0000","last_became_peered":"2024-09-10T08:29:33.020658+0000","last_unstale":"2024-09-10T08:29:34.058819+0000","last_undegraded":"2024-09-10T08:29:34.058819+0000","last_fullsized":"2024-09-10T08:29:34.058819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.010683+0000","last_change":"2024-09-10T08:29:33.010683+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.010683+0000","last_undegraded":"2024-09-10T08:29:33.010683+0000","last_fullsized":"2024-09-10T08:29:33.010683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051243+0000","last_change":"2024-09-10T08:29:33.026324+0000","last_active":"2024-09-10T08:29:34.051243+0000","last_peered":"2024-09-10T08:29:34.051243+0000","last_clean":"2024-09-10T08:29:34.051243+0000","last_became_active":"2024-09-10T08:29:33.025862+0000","last_became_peered":"2024-09-10T08:29:33.025862+0000","last_unstale":"2024-09-10T08:29:34.051243+0000","last_undegraded":"2024-09-10T08:29:34.051243+0000","last_fullsized":"2024-09-10T08:29:34.051243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:23.996817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048650+0000","last_change":"2024-09-10T08:29:34.043523+0000","last_active":"2024-09-10T08:29:34.048650+0000","last_peered":"2024-09-10T08:29:34.048650+0000","last_clean":"2024-09-10T08:29:34.048650+0000","last_became_active":"2024-09-10T08:29:34.043197+0000","last_became_peered":"2024-09-10T08:29:34.043197+0000","last_unstale":"2024-09-10T08:29:34.048650+0000","last_undegraded":"2024-09-10T08:29:34.048650+0000","last_fullsized":"2024-09-10T08:29:34.048650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:33.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025547+0000","last_change":"2024-09-10T08:29:33.023460+0000","last_active":"2024-09-10T08:29:34.025547+0000","last_peered":"2024-09-10T08:29:34.025547+0000","last_clean":"2024-09-10T08:29:34.025547+0000","last_became_active":"2024-09-10T08:29:33.023170+0000","last_became_peered":"2024-09-10T08:29:33.023170+0000","last_unstale":"2024-09-10T08:29:34.025547+0000","last_undegraded":"2024-09-10T08:29:34.025547+0000","last_fullsized":"2024-09-10T08:29:34.025547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052270+0000","last_change":"2024-09-10T08:29:34.048200+0000","last_active":"2024-09-10T08:29:34.052270+0000","last_peered":"2024-09-10T08:29:34.052270+0000","last_clean":"2024-09-10T08:29:34.052270+0000","last_became_active":"2024-09-10T08:29:34.047927+0000","last_became_peered":"2024-09-10T08:29:34.047927+0000","last_unstale":"2024-09-10T08:29:34.052270+0000","last_undegraded":"2024-09-10T08:29:34.052270+0000","last_fullsized":"2024-09-10T08:29:34.052270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032957+0000","last_change":"2024-09-10T08:29:33.027059+0000","last_active":"2024-09-10T08:29:33.032957+0000","last_peered":"2024-09-10T08:29:33.032957+0000","last_clean":"2024-09-10T08:29:33.032957+0000","last_became_active":"2024-09-10T08:29:33.026748+0000","last_became_peered":"2024-09-10T08:29:33.026748+0000","last_unstale":"2024-09-10T08:29:33.032957+0000","last_undegraded":"2024-09-10T08:29:33.032957+0000","last_fullsized":"2024-09-10T08:29:33.032957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:53:28.109424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-10T08:29:33.015403+0000","last_change":"2024-09-10T08:29:33.015403+0000","last_active":"2024-09-10T08:29:32.995521+0000","last_peered":"2024-09-10T08:29:32.995521+0000","last_clean":"2024-09-10T08:29:32.995521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:29:33.015403+0000","last_undegraded":"2024-09-10T08:29:33.015403+0000","last_fullsized":"2024-09-10T08:29:33.015403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014220+0000","last_change":"2024-09-10T08:29:33.024913+0000","last_active":"2024-09-10T08:29:34.014220+0000","last_peered":"2024-09-10T08:29:34.014220+0000","last_clean":"2024-09-10T08:29:34.014220+0000","last_became_active":"2024-09-10T08:29:33.023124+0000","last_became_peered":"2024-09-10T08:29:33.023124+0000","last_unstale":"2024-09-10T08:29:34.014220+0000","last_undegraded":"2024-09-10T08:29:34.014220+0000","last_fullsized":"2024-09-10T08:29:34.014220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.044632+0000","last_change":"2024-09-10T08:29:34.039167+0000","last_active":"2024-09-10T08:29:34.044632+0000","last_peered":"2024-09-10T08:29:34.044632+0000","last_clean":"2024-09-10T08:29:34.044632+0000","last_became_active":"2024-09-10T08:29:34.037065+0000","last_became_peered":"2024-09-10T08:29:34.037065+0000","last_unstale":"2024-09-10T08:29:34.044632+0000","last_undegraded":"2024-09-10T08:29:34.044632+0000","last_fullsized":"2024-09-10T08:29:34.044632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.021311+0000","last_change":"2024-09-10T08:29:33.033458+0000","last_active":"2024-09-10T08:29:34.021311+0000","last_peered":"2024-09-10T08:29:34.021311+0000","last_clean":"2024-09-10T08:29:34.021311+0000","last_became_active":"2024-09-10T08:29:33.033161+0000","last_became_peered":"2024-09-10T08:29:33.033161+0000","last_unstale":"2024-09-10T08:29:34.021311+0000","last_undegraded":"2024-09-10T08:29:34.021311+0000","last_fullsized":"2024-09-10T08:29:34.021311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:40.792079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049514+0000","last_change":"2024-09-10T08:29:34.047377+0000","last_active":"2024-09-10T08:29:34.049514+0000","last_peered":"2024-09-10T08:29:34.049514+0000","last_clean":"2024-09-10T08:29:34.049514+0000","last_became_active":"2024-09-10T08:29:34.047055+0000","last_became_peered":"2024-09-10T08:29:34.047055+0000","last_unstale":"2024-09-10T08:29:34.049514+0000","last_undegraded":"2024-09-10T08:29:34.049514+0000","last_fullsized":"2024-09-10T08:29:34.049514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015675+0000","last_change":"2024-09-10T08:29:33.025805+0000","last_active":"2024-09-10T08:29:34.015675+0000","last_peered":"2024-09-10T08:29:34.015675+0000","last_clean":"2024-09-10T08:29:34.015675+0000","last_became_active":"2024-09-10T08:29:33.024658+0000","last_became_peered":"2024-09-10T08:29:33.024658+0000","last_unstale":"2024-09-10T08:29:34.015675+0000","last_undegraded":"2024-09-10T08:29:34.015675+0000","last_fullsized":"2024-09-10T08:29:34.015675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:23.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048661+0000","last_change":"2024-09-10T08:29:34.043724+0000","last_active":"2024-09-10T08:29:34.048661+0000","last_peered":"2024-09-10T08:29:34.048661+0000","last_clean":"2024-09-10T08:29:34.048661+0000","last_became_active":"2024-09-10T08:29:34.043471+0000","last_became_peered":"2024-09-10T08:29:34.043471+0000","last_unstale":"2024-09-10T08:29:34.048661+0000","last_undegraded":"2024-09-10T08:29:34.048661+0000","last_fullsized":"2024-09-10T08:29:34.048661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.786925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055249+0000","last_change":"2024-09-10T08:29:33.028935+0000","last_active":"2024-09-10T08:29:34.055249+0000","last_peered":"2024-09-10T08:29:34.055249+0000","last_clean":"2024-09-10T08:29:34.055249+0000","last_became_active":"2024-09-10T08:29:33.028629+0000","last_became_peered":"2024-09-10T08:29:33.028629+0000","last_unstale":"2024-09-10T08:29:34.055249+0000","last_undegraded":"2024-09-10T08:29:34.055249+0000","last_fullsized":"2024-09-10T08:29:34.055249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.029997+0000","last_change":"2024-09-10T08:29:34.028422+0000","last_active":"2024-09-10T08:29:34.029997+0000","last_peered":"2024-09-10T08:29:34.029997+0000","last_clean":"2024-09-10T08:29:34.029997+0000","last_became_active":"2024-09-10T08:29:34.028152+0000","last_became_peered":"2024-09-10T08:29:34.028152+0000","last_unstale":"2024-09-10T08:29:34.029997+0000","last_undegraded":"2024-09-10T08:29:34.029997+0000","last_fullsized":"2024-09-10T08:29:34.029997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:55.420525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-10T08:29:33.032747+0000","last_change":"2024-09-10T08:29:33.024021+0000","last_active":"2024-09-10T08:29:33.032747+0000","last_peered":"2024-09-10T08:29:33.032747+0000","last_clean":"2024-09-10T08:29:33.032747+0000","last_became_active":"2024-09-10T08:29:33.023084+0000","last_became_peered":"2024-09-10T08:29:33.023084+0000","last_unstale":"2024-09-10T08:29:33.032747+0000","last_undegraded":"2024-09-10T08:29:33.032747+0000","last_fullsized":"2024-09-10T08:29:33.032747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:57.303843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038671+0000","last_change":"2024-09-10T08:29:34.037052+0000","last_active":"2024-09-10T08:29:34.038671+0000","last_peered":"2024-09-10T08:29:34.038671+0000","last_clean":"2024-09-10T08:29:34.038671+0000","last_became_active":"2024-09-10T08:29:34.036602+0000","last_became_peered":"2024-09-10T08:29:34.036602+0000","last_unstale":"2024-09-10T08:29:34.038671+0000","last_undegraded":"2024-09-10T08:29:34.038671+0000","last_fullsized":"2024-09-10T08:29:34.038671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025729+0000","last_change":"2024-09-10T08:29:33.024043+0000","last_active":"2024-09-10T08:29:34.025729+0000","last_peered":"2024-09-10T08:29:34.025729+0000","last_clean":"2024-09-10T08:29:34.025729+0000","last_became_active":"2024-09-10T08:29:33.023735+0000","last_became_peered":"2024-09-10T08:29:33.023735+0000","last_unstale":"2024-09-10T08:29:34.025729+0000","last_undegraded":"2024-09-10T08:29:34.025729+0000","last_fullsized":"2024-09-10T08:29:34.025729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.047928+0000","last_change":"2024-09-10T08:29:34.044817+0000","last_active":"2024-09-10T08:29:34.047928+0000","last_peered":"2024-09-10T08:29:34.047928+0000","last_clean":"2024-09-10T08:29:34.047928+0000","last_became_active":"2024-09-10T08:29:34.044489+0000","last_became_peered":"2024-09-10T08:29:34.044489+0000","last_unstale":"2024-09-10T08:29:34.047928+0000","last_undegraded":"2024-09-10T08:29:34.047928+0000","last_fullsized":"2024-09-10T08:29:34.047928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.023957+0000","last_change":"2024-09-10T08:29:33.030176+0000","last_active":"2024-09-10T08:29:34.023957+0000","last_peered":"2024-09-10T08:29:34.023957+0000","last_clean":"2024-09-10T08:29:34.023957+0000","last_became_active":"2024-09-10T08:29:33.028687+0000","last_became_peered":"2024-09-10T08:29:33.028687+0000","last_unstale":"2024-09-10T08:29:34.023957+0000","last_undegraded":"2024-09-10T08:29:34.023957+0000","last_fullsized":"2024-09-10T08:29:34.023957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032909+0000","last_change":"2024-09-10T08:29:34.031146+0000","last_active":"2024-09-10T08:29:34.032909+0000","last_peered":"2024-09-10T08:29:34.032909+0000","last_clean":"2024-09-10T08:29:34.032909+0000","last_became_active":"2024-09-10T08:29:34.030853+0000","last_became_peered":"2024-09-10T08:29:34.030853+0000","last_unstale":"2024-09-10T08:29:34.032909+0000","last_undegraded":"2024-09-10T08:29:34.032909+0000","last_fullsized":"2024-09-10T08:29:34.032909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022820+0000","last_change":"2024-09-10T08:29:33.028878+0000","last_active":"2024-09-10T08:29:34.022820+0000","last_peered":"2024-09-10T08:29:34.022820+0000","last_clean":"2024-09-10T08:29:34.022820+0000","last_became_active":"2024-09-10T08:29:33.028575+0000","last_became_peered":"2024-09-10T08:29:33.028575+0000","last_unstale":"2024-09-10T08:29:34.022820+0000","last_undegraded":"2024-09-10T08:29:34.022820+0000","last_fullsized":"2024-09-10T08:29:34.022820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.030519+0000","last_change":"2024-09-10T08:29:34.022980+0000","last_active":"2024-09-10T08:29:34.030519+0000","last_peered":"2024-09-10T08:29:34.030519+0000","last_clean":"2024-09-10T08:29:34.030519+0000","last_became_active":"2024-09-10T08:29:34.022678+0000","last_became_peered":"2024-09-10T08:29:34.022678+0000","last_unstale":"2024-09-10T08:29:34.030519+0000","last_undegraded":"2024-09-10T08:29:34.030519+0000","last_fullsized":"2024-09-10T08:29:34.030519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014357+0000","last_change":"2024-09-10T08:29:33.027084+0000","last_active":"2024-09-10T08:29:34.014357+0000","last_peered":"2024-09-10T08:29:34.014357+0000","last_clean":"2024-09-10T08:29:34.014357+0000","last_became_active":"2024-09-10T08:29:33.026802+0000","last_became_peered":"2024-09-10T08:29:33.026802+0000","last_unstale":"2024-09-10T08:29:34.014357+0000","last_undegraded":"2024-09-10T08:29:34.014357+0000","last_fullsized":"2024-09-10T08:29:34.014357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038540+0000","last_change":"2024-09-10T08:29:34.030886+0000","last_active":"2024-09-10T08:29:34.038540+0000","last_peered":"2024-09-10T08:29:34.038540+0000","last_clean":"2024-09-10T08:29:34.038540+0000","last_became_active":"2024-09-10T08:29:34.030659+0000","last_became_peered":"2024-09-10T08:29:34.030659+0000","last_unstale":"2024-09-10T08:29:34.038540+0000","last_undegraded":"2024-09-10T08:29:34.038540+0000","last_fullsized":"2024-09-10T08:29:34.038540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:46.321648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.016464+0000","last_change":"2024-09-10T08:29:33.029745+0000","last_active":"2024-09-10T08:29:34.016464+0000","last_peered":"2024-09-10T08:29:34.016464+0000","last_clean":"2024-09-10T08:29:34.016464+0000","last_became_active":"2024-09-10T08:29:33.029417+0000","last_became_peered":"2024-09-10T08:29:33.029417+0000","last_unstale":"2024-09-10T08:29:34.016464+0000","last_undegraded":"2024-09-10T08:29:34.016464+0000","last_fullsized":"2024-09-10T08:29:34.016464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:03.473771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048514+0000","last_change":"2024-09-10T08:29:34.046471+0000","last_active":"2024-09-10T08:29:34.048514+0000","last_peered":"2024-09-10T08:29:34.048514+0000","last_clean":"2024-09-10T08:29:34.048514+0000","last_became_active":"2024-09-10T08:29:34.046117+0000","last_became_peered":"2024-09-10T08:29:34.046117+0000","last_unstale":"2024-09-10T08:29:34.048514+0000","last_undegraded":"2024-09-10T08:29:34.048514+0000","last_fullsized":"2024-09-10T08:29:34.048514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022590+0000","last_change":"2024-09-10T08:29:33.026103+0000","last_active":"2024-09-10T08:29:34.022590+0000","last_peered":"2024-09-10T08:29:34.022590+0000","last_clean":"2024-09-10T08:29:34.022590+0000","last_became_active":"2024-09-10T08:29:33.025539+0000","last_became_peered":"2024-09-10T08:29:33.025539+0000","last_unstale":"2024-09-10T08:29:34.022590+0000","last_undegraded":"2024-09-10T08:29:34.022590+0000","last_fullsized":"2024-09-10T08:29:34.022590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:42.966093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.019288+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:29:34.019288+0000","last_peered":"2024-09-10T08:29:34.019288+0000","last_clean":"2024-09-10T08:29:34.019288+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:29:34.019288+0000","last_undegraded":"2024-09-10T08:29:34.019288+0000","last_fullsized":"2024-09-10T08:29:34.019288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":134879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":134901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":368640,"data_stored":134043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":950272,"data_stored":723705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":710585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:29:33.011260+0000', 'last_change': '2024-09-10T08:29:33.011260+0000', 'last_active': '2024-09-10T08:29:32.995521+0000', 'last_peered': '2024-09-10T08:29:32.995521+0000', 'last_clean': '2024-09-10T08:29:32.995521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:29:33.011260+0000', 'last_undegraded': '2024-09-10T08:29:33.011260+0000', 'last_fullsized': '2024-09-10T08:29:33.011260+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_clean_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:29:33.015866+0000', 'last_change': '2024-09-10T08:29:33.015866+0000', 'last_active': '2024-09-10T08:29:32.995521+0000', 'last_peered': '2024-09-10T08:29:32.995521+0000', 'last_clean': '2024-09-10T08:29:32.995521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:29:33.015866+0000', 'last_undegraded': '2024-09-10T08:29:33.015866+0000', 'last_fullsized': '2024-09-10T08:29:33.015866+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_clean_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:29:33.011836+0000', 'last_change': '2024-09-10T08:29:33.011836+0000', 'last_active': '2024-09-10T08:29:32.995521+0000', 'last_peered': '2024-09-10T08:29:32.995521+0000', 'last_clean': '2024-09-10T08:29:32.995521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:29:33.011836+0000', 'last_undegraded': '2024-09-10T08:29:33.011836+0000', 'last_fullsized': '2024-09-10T08:29:33.011836+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_clean_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:29:33.010683+0000', 'last_change': '2024-09-10T08:29:33.010683+0000', 'last_active': '2024-09-10T08:29:32.995521+0000', 'last_peered': '2024-09-10T08:29:32.995521+0000', 'last_clean': '2024-09-10T08:29:32.995521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:29:33.010683+0000', 'last_undegraded': '2024-09-10T08:29:33.010683+0000', 'last_fullsized': '2024-09-10T08:29:33.010683+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_clean_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-10T08:29:39.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:29:33.015403+0000', 'last_change': '2024-09-10T08:29:33.015403+0000', 'last_active': '2024-09-10T08:29:32.995521+0000', 'last_peered': '2024-09-10T08:29:32.995521+0000', 'last_clean': '2024-09-10T08:29:32.995521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:29:33.015403+0000', 'last_undegraded': '2024-09-10T08:29:33.015403+0000', 'last_fullsized': '2024-09-10T08:29:33.015403+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'last_clean_scrub_stamp': '2024-09-10T08:29:32.995521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:29:39.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:29:39.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.274+0000 7f79b0a00640 1 Processor -- start 2024-09-10T08:29:39.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.274+0000 7f79b0a00640 1 -- start start 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79b0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79b0a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f79ac0cfce0 0x7f79ac0d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79b0a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0d2610 con 0x7f79ac15e5c0 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79b0a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0d2d10 con 0x7f79ac15e9a0 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79b0a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0d2ff0 con 0x7f79ac0cfce0 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79aaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79aaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59510/0 (socket says 172.21.15.52:59510) 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79aaa00640 1 -- 172.21.15.52:0/4106418566 learned_addr learned my addr 172.21.15.52:0/4106418566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.275+0000 7f79abe00640 1 --2- 172.21.15.52:0/4106418566 >> v2:172.21.15.176:3300/0 conn(0x7f79ac0cfce0 0x7f79ac0d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.276+0000 7f79aaa00640 1 -- 172.21.15.52:0/4106418566 >> v2:172.21.15.176:3300/0 conn(0x7f79ac0cfce0 msgr2=0x7f79ac0d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:39.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.276+0000 7f79aaa00640 1 --2- 172.21.15.52:0/4106418566 >> v2:172.21.15.176:3300/0 conn(0x7f79ac0cfce0 0x7f79ac0d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.276+0000 7f79aaa00640 1 -- 172.21.15.52:0/4106418566 >> v1:172.21.15.176:6789/0 conn(0x7f79ac15e5c0 legacy=0x7f79ac0d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.276+0000 7f79aaa00640 1 -- 172.21.15.52:0/4106418566 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0d32d0 con 0x7f79ac15e9a0 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.277+0000 7f79aaa00640 1 --2- 172.21.15.52:0/4106418566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0d04b0 tx=0x7f799802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f60a99f88c05747 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.277+0000 7f79aa000640 1 -- 172.21.15.52:0/4106418566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998037070 con 0x7f79ac15e9a0 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.277+0000 7f79aa000640 1 -- 172.21.15.52:0/4106418566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7998032440 con 0x7f79ac15e9a0 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.277+0000 7f79aa000640 1 -- 172.21.15.52:0/4106418566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998032810 con 0x7f79ac15e9a0 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 -- 172.21.15.52:0/4106418566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac15e9a0 msgr2=0x7f79ac0cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 --2- 172.21.15.52:0/4106418566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0d04b0 tx=0x7f799802a1f0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 -- 172.21.15.52:0/4106418566 shutdown_connections 2024-09-10T08:29:39.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 --2- 172.21.15.52:0/4106418566 >> v2:172.21.15.176:3300/0 conn(0x7f79ac0cfce0 0x7f79ac0d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 --2- 172.21.15.52:0/4106418566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac15e9a0 0x7f79ac0cf7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 -- 172.21.15.52:0/4106418566 >> 172.21.15.52:0/4106418566 conn(0x7f79ac06c030 msgr2=0x7f79ac06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:39.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 -- 172.21.15.52:0/4106418566 shutdown_connections 2024-09-10T08:29:39.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.278+0000 7f79b0a00640 1 -- 172.21.15.52:0/4106418566 wait complete. 2024-09-10T08:29:39.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.279+0000 7f79b0a00640 1 Processor -- start 2024-09-10T08:29:39.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 -- start start 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79ac15e5c0 0x7f79ac15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79ac15e9a0 0x7f79ac15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0d4c10 con 0x7f79ac0cfce0 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0d3890 con 0x7f79ac15e5c0 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.280+0000 7f79b0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0d4d90 con 0x7f79ac15e9a0 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59516/0 (socket says 172.21.15.52:59516) 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 -- 172.21.15.52:0/683839924 learned_addr learned my addr 172.21.15.52:0/683839924 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79aaa00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79ac15e5c0 0x7f79ac15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79abe00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79ac15e9a0 0x7f79ac15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 -- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79ac15e9a0 msgr2=0x7f79ac15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79ac15e9a0 0x7f79ac15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 -- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79ac15e5c0 msgr2=0x7f79ac15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79ac15e5c0 0x7f79ac15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 -- 172.21.15.52:0/683839924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0cbce0 con 0x7f79ac0cfce0 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.281+0000 7f79ab400640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c400 tx=0x7f799c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.282+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0052d0 con 0x7f79ac0cfce0 2024-09-10T08:29:39.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.282+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c005490 con 0x7f79ac0cfce0 2024-09-10T08:29:39.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.282+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c007260 con 0x7f79ac0cfce0 2024-09-10T08:29:39.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.282+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac0cbf80 con 0x7f79ac0cfce0 2024-09-10T08:29:39.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.282+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac0cc540 con 0x7f79ac0cfce0 2024-09-10T08:29:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.283+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac0d19d0 con 0x7f79ac0cfce0 2024-09-10T08:29:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.284+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f799c007400 con 0x7f79ac0cfce0 2024-09-10T08:29:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.284+0000 7f79a3400640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.285+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f799c08a390 con 0x7f79ac0cfce0 2024-09-10T08:29:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.285+0000 7f79aaa00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.286+0000 7f79aaa00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 0x7f798c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7998034000 tx=0x7f799802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.289+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79ac0d2610 con 0x7f79ac0cfce0 2024-09-10T08:29:39.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.539+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f79ac0cba80 con 0x7f79ac0cfce0 2024-09-10T08:29:39.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.539+0000 7f79a3400640 1 -- 172.21.15.52:0/683839924 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1688 (secure 0 0 0) 0x7f799c058650 con 0x7f79ac0cfce0 2024-09-10T08:29:39.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:39.540 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":246779904,"bytes_avail":772847333376,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2622,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"btime":"2024-09-10T08:29:37:030497+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4797}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-10T08:29:35.462206+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:29:39.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 msgr2=0x7f798c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 0x7f798c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7998034000 tx=0x7f799802e000 comp rx=0 tx=0).stop 2024-09-10T08:29:39.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 msgr2=0x7f79ac0b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c400 tx=0x7f799c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 shutdown_connections 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79ac15e9a0 0x7f79ac15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79ac15e5c0 0x7f79ac15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 --2- 172.21.15.52:0/683839924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79ac0cfce0 0x7f79ac0b55c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 >> 172.21.15.52:0/683839924 conn(0x7f79ac06c030 msgr2=0x7f79ac160160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 shutdown_connections 2024-09-10T08:29:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.542+0000 7f79b0a00640 1 -- 172.21.15.52:0/683839924 wait complete. 2024-09-10T08:29:39.558 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:29:39.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:39.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.714+0000 7fe950a00640 1 Processor -- start 2024-09-10T08:29:39.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.714+0000 7fe950a00640 1 -- start start 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe950a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe94c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe950a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe94c0b5f90 0x7fe94c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe950a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe94c0b4020 con 0x7fe94c073180 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe950a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe94c073b00 con 0x7fe94c0b5f90 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe950a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c0b42c0 con 0x7fe94c145ed0 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe943e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe94c073180 0x7fe94c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39342/0 (socket says 172.21.15.52:39342) 2024-09-10T08:29:39.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe943e00640 1 -- 172.21.15.52:0/4018786660 learned_addr learned my addr 172.21.15.52:0/4018786660 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe949e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe94c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe94a800640 1 --2- 172.21.15.52:0/4018786660 >> v2:172.21.15.176:3300/0 conn(0x7fe94c0b5f90 0x7fe94c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651982990 0 0) 0x7fe94c0b4020 con 0x7fe94c073180 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.716+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe930003520 con 0x7fe94c073180 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3102298752 0 0) 0x7fe930003520 con 0x7fe94c073180 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 msgr2=0x7fe94c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe94c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 >> v2:172.21.15.176:3300/0 conn(0x7fe94c0b5f90 msgr2=0x7fe94c0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 --2- 172.21.15.52:0/4018786660 >> v2:172.21.15.176:3300/0 conn(0x7fe94c0b5f90 0x7fe94c0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c0b45a0 con 0x7fe94c073180 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fe934001670 con 0x7fe94c073180 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 >> v1:172.21.15.52:6789/0 conn(0x7fe94c073180 legacy=0x7fe94c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300039b0 0x7fe930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe930004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe930004d40 0x7fe9300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c073b00 con 0x7fe9300039b0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c0b42c0 con 0x7fe930004d40 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe93000b9c0 con 0x7fe94c145ed0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe949e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300039b0 0x7fe930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe943e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe930004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.717+0000 7fe94a800640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe930004d40 0x7fe9300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 -- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 msgr2=0x7fe930004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c145ed0 0x7fe930004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 -- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe930004d40 msgr2=0x7fe9300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe930004d40 0x7fe9300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 -- 172.21.15.52:0/4018786660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe930003520 con 0x7fe9300039b0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.718+0000 7fe949e00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300039b0 0x7fe930003dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009ac0 tx=0x7fe930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bd5180eb720b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c036070 con 0x7fe9300039b0 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93c031400 con 0x7fe9300039b0 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe949400640 1 -- 172.21.15.52:0/4018786660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93c009690 con 0x7fe9300039b0 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe950a00640 1 -- 172.21.15.52:0/4018786660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300039b0 msgr2=0x7fe930003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe950a00640 1 --2- 172.21.15.52:0/4018786660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9300039b0 0x7fe930003dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009ac0 tx=0x7fe930005830 comp rx=0 tx=0).stop 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe94a800640 1 -- 172.21.15.52:0/4018786660 reap_dead start 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe950a00640 1 -- 172.21.15.52:0/4018786660 shutdown_connections 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe950a00640 1 -- 172.21.15.52:0/4018786660 >> 172.21.15.52:0/4018786660 conn(0x7fe94c0ccec0 msgr2=0x7fe94c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.719+0000 7fe950a00640 1 -- 172.21.15.52:0/4018786660 shutdown_connections 2024-09-10T08:29:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.720+0000 7fe950a00640 1 -- 172.21.15.52:0/4018786660 wait complete. 2024-09-10T08:29:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.721+0000 7fe950a00640 1 Processor -- start 2024-09-10T08:29:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.721+0000 7fe950a00640 1 -- start start 2024-09-10T08:29:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9300039b0 0x7fe94c13d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c13b690 0x7fe94c139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c1462b0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c0b4b60 con 0x7fe9300039b0 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe950a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe94c146430 con 0x7fe94c13b690 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe943e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe943e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59536/0 (socket says 172.21.15.52:59536) 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.722+0000 7fe943e00640 1 -- 172.21.15.52:0/719279648 learned_addr learned my addr 172.21.15.52:0/719279648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe949e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9300039b0 0x7fe94c13d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe94a800640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c13b690 0x7fe94c139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 -- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c13b690 msgr2=0x7fe94c139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c13b690 0x7fe94c139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 -- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9300039b0 msgr2=0x7fe94c13d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9300039b0 0x7fe94c13d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 -- 172.21.15.52:0/719279648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c13bbe0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe943e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e8a0 tx=0x7fe93400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93400c8d0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe934018070 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93400ccd0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.723+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c13bec0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.724+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c13c480 con 0x7fe94c1f1db0 2024-09-10T08:29:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.725+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe94c0735c0 con 0x7fe94c1f1db0 2024-09-10T08:29:39.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.726+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe934013420 con 0x7fe94c1f1db0 2024-09-10T08:29:39.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.727+0000 7fe942000640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 0x7fe92806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:39.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.727+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe93408a900 con 0x7fe94c1f1db0 2024-09-10T08:29:39.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.727+0000 7fe949e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 0x7fe92806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:39.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.728+0000 7fe949e00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 0x7fe92806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe93c033000 tx=0x7fe93c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:39.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.731+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe934058c40 con 0x7fe94c1f1db0 2024-09-10T08:29:39.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.914+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe94c0cee40 con 0x7fe92806be60 2024-09-10T08:29:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.921+0000 7fe942000640 1 -- 172.21.15.52:0/719279648 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251894 (secure 0 0 0) 0x7fe94c0cee40 con 0x7fe92806be60 2024-09-10T08:29:39.924 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:39.925 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 msgr2=0x7fe92806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 0x7fe92806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe93c033000 tx=0x7fe93c008030 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 msgr2=0x7fe94c1390e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe93400e8a0 tx=0x7fe93400ed60 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 shutdown_connections 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe92806be60 0x7fe92806e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe94c13b690 0x7fe94c139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe94c1f1db0 0x7fe94c1390e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 --2- 172.21.15.52:0/719279648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9300039b0 0x7fe94c13d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.924+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 >> 172.21.15.52:0/719279648 conn(0x7fe94c0ccec0 msgr2=0x7fe94c0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.925+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 shutdown_connections 2024-09-10T08:29:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:39.925+0000 7fe950a00640 1 -- 172.21.15.52:0/719279648 wait complete. 2024-09-10T08:29:39.940 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-10T08:29:39.463110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241040,"kb_used_data":3988,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733680,"statfs":{"total":773094113280,"available":772847288320,"internally_reserved":0,"allocated":4083712,"data_stored":2257992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.463393"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053977+0000","last_change":"2024-09-10T08:29:34.050800+0000","last_active":"2024-09-10T08:29:34.053977+0000","last_peered":"2024-09-10T08:29:34.053977+0000","last_clean":"2024-09-10T08:29:34.053977+0000","last_became_active":"2024-09-10T08:29:34.050515+0000","last_became_peered":"2024-09-10T08:29:34.050515+0000","last_unstale":"2024-09-10T08:29:34.053977+0000","last_undegraded":"2024-09-10T08:29:34.053977+0000","last_fullsized":"2024-09-10T08:29:34.053977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040881+0000","last_change":"2024-09-10T08:29:34.038328+0000","last_active":"2024-09-10T08:29:35.040881+0000","last_peered":"2024-09-10T08:29:35.040881+0000","last_clean":"2024-09-10T08:29:35.040881+0000","last_became_active":"2024-09-10T08:29:34.036819+0000","last_became_peered":"2024-09-10T08:29:34.036819+0000","last_unstale":"2024-09-10T08:29:35.040881+0000","last_undegraded":"2024-09-10T08:29:35.040881+0000","last_fullsized":"2024-09-10T08:29:35.040881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:36.294753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040297+0000","last_change":"2024-09-10T08:29:34.032147+0000","last_active":"2024-09-10T08:29:34.040297+0000","last_peered":"2024-09-10T08:29:34.040297+0000","last_clean":"2024-09-10T08:29:34.040297+0000","last_became_active":"2024-09-10T08:29:34.031869+0000","last_became_peered":"2024-09-10T08:29:34.031869+0000","last_unstale":"2024-09-10T08:29:34.040297+0000","last_undegraded":"2024-09-10T08:29:34.040297+0000","last_fullsized":"2024-09-10T08:29:34.040297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:07.111302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046602+0000","last_change":"2024-09-10T08:29:34.043864+0000","last_active":"2024-09-10T08:29:34.046602+0000","last_peered":"2024-09-10T08:29:34.046602+0000","last_clean":"2024-09-10T08:29:34.046602+0000","last_became_active":"2024-09-10T08:29:34.041475+0000","last_became_peered":"2024-09-10T08:29:34.041475+0000","last_unstale":"2024-09-10T08:29:34.046602+0000","last_undegraded":"2024-09-10T08:29:34.046602+0000","last_fullsized":"2024-09-10T08:29:34.046602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040660+0000","last_change":"2024-09-10T08:29:34.033970+0000","last_active":"2024-09-10T08:29:35.040660+0000","last_peered":"2024-09-10T08:29:35.040660+0000","last_clean":"2024-09-10T08:29:35.040660+0000","last_became_active":"2024-09-10T08:29:34.030766+0000","last_became_peered":"2024-09-10T08:29:34.030766+0000","last_unstale":"2024-09-10T08:29:35.040660+0000","last_undegraded":"2024-09-10T08:29:35.040660+0000","last_fullsized":"2024-09-10T08:29:35.040660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:32.708847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043370+0000","last_change":"2024-09-10T08:29:34.039947+0000","last_active":"2024-09-10T08:29:34.043370+0000","last_peered":"2024-09-10T08:29:34.043370+0000","last_clean":"2024-09-10T08:29:34.043370+0000","last_became_active":"2024-09-10T08:29:34.039425+0000","last_became_peered":"2024-09-10T08:29:34.039425+0000","last_unstale":"2024-09-10T08:29:34.043370+0000","last_undegraded":"2024-09-10T08:29:34.043370+0000","last_fullsized":"2024-09-10T08:29:34.043370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039018+0000","last_change":"2024-09-10T08:29:34.035820+0000","last_active":"2024-09-10T08:29:34.039018+0000","last_peered":"2024-09-10T08:29:34.039018+0000","last_clean":"2024-09-10T08:29:34.039018+0000","last_became_active":"2024-09-10T08:29:34.035530+0000","last_became_peered":"2024-09-10T08:29:34.035530+0000","last_unstale":"2024-09-10T08:29:34.039018+0000","last_undegraded":"2024-09-10T08:29:34.039018+0000","last_fullsized":"2024-09-10T08:29:34.039018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:04.478284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036860+0000","last_change":"2024-09-10T08:29:34.032026+0000","last_active":"2024-09-10T08:29:34.036860+0000","last_peered":"2024-09-10T08:29:34.036860+0000","last_clean":"2024-09-10T08:29:34.036860+0000","last_became_active":"2024-09-10T08:29:34.031828+0000","last_became_peered":"2024-09-10T08:29:34.031828+0000","last_unstale":"2024-09-10T08:29:34.036860+0000","last_undegraded":"2024-09-10T08:29:34.036860+0000","last_fullsized":"2024-09-10T08:29:34.036860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048214+0000","last_change":"2024-09-10T08:29:34.044053+0000","last_active":"2024-09-10T08:29:34.048214+0000","last_peered":"2024-09-10T08:29:34.048214+0000","last_clean":"2024-09-10T08:29:34.048214+0000","last_became_active":"2024-09-10T08:29:34.043402+0000","last_became_peered":"2024-09-10T08:29:34.043402+0000","last_unstale":"2024-09-10T08:29:34.048214+0000","last_undegraded":"2024-09-10T08:29:34.048214+0000","last_fullsized":"2024-09-10T08:29:34.048214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:49.509388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036899+0000","last_change":"2024-09-10T08:29:34.034386+0000","last_active":"2024-09-10T08:29:34.036899+0000","last_peered":"2024-09-10T08:29:34.036899+0000","last_clean":"2024-09-10T08:29:34.036899+0000","last_became_active":"2024-09-10T08:29:34.034034+0000","last_became_peered":"2024-09-10T08:29:34.034034+0000","last_unstale":"2024-09-10T08:29:34.036899+0000","last_undegraded":"2024-09-10T08:29:34.036899+0000","last_fullsized":"2024-09-10T08:29:34.036899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041062+0000","last_change":"2024-09-10T08:29:34.035547+0000","last_active":"2024-09-10T08:29:34.041062+0000","last_peered":"2024-09-10T08:29:34.041062+0000","last_clean":"2024-09-10T08:29:34.041062+0000","last_became_active":"2024-09-10T08:29:34.035248+0000","last_became_peered":"2024-09-10T08:29:34.035248+0000","last_unstale":"2024-09-10T08:29:34.041062+0000","last_undegraded":"2024-09-10T08:29:34.041062+0000","last_fullsized":"2024-09-10T08:29:34.041062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:33.032756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040316+0000","last_change":"2024-09-10T08:29:34.037847+0000","last_active":"2024-09-10T08:29:34.040316+0000","last_peered":"2024-09-10T08:29:34.040316+0000","last_clean":"2024-09-10T08:29:34.040316+0000","last_became_active":"2024-09-10T08:29:34.036896+0000","last_became_peered":"2024-09-10T08:29:34.036896+0000","last_unstale":"2024-09-10T08:29:34.040316+0000","last_undegraded":"2024-09-10T08:29:34.040316+0000","last_fullsized":"2024-09-10T08:29:34.040316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:55.409697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043840+0000","last_change":"2024-09-10T08:29:34.037905+0000","last_active":"2024-09-10T08:29:34.043840+0000","last_peered":"2024-09-10T08:29:34.043840+0000","last_clean":"2024-09-10T08:29:34.043840+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.043840+0000","last_undegraded":"2024-09-10T08:29:34.043840+0000","last_fullsized":"2024-09-10T08:29:34.043840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.034400+0000","last_change":"2024-09-10T08:29:34.031148+0000","last_active":"2024-09-10T08:29:34.034400+0000","last_peered":"2024-09-10T08:29:34.034400+0000","last_clean":"2024-09-10T08:29:34.034400+0000","last_became_active":"2024-09-10T08:29:34.030897+0000","last_became_peered":"2024-09-10T08:29:34.030897+0000","last_unstale":"2024-09-10T08:29:34.034400+0000","last_undegraded":"2024-09-10T08:29:34.034400+0000","last_fullsized":"2024-09-10T08:29:34.034400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.040141+0000","last_change":"2024-09-10T08:29:34.037889+0000","last_active":"2024-09-10T08:29:34.040141+0000","last_peered":"2024-09-10T08:29:34.040141+0000","last_clean":"2024-09-10T08:29:34.040141+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:34.040141+0000","last_undegraded":"2024-09-10T08:29:34.040141+0000","last_fullsized":"2024-09-10T08:29:34.040141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.043902+0000","last_change":"2024-09-10T08:29:34.040898+0000","last_active":"2024-09-10T08:29:34.043902+0000","last_peered":"2024-09-10T08:29:34.043902+0000","last_clean":"2024-09-10T08:29:34.043902+0000","last_became_active":"2024-09-10T08:29:34.040166+0000","last_became_peered":"2024-09-10T08:29:34.040166+0000","last_unstale":"2024-09-10T08:29:34.043902+0000","last_undegraded":"2024-09-10T08:29:34.043902+0000","last_fullsized":"2024-09-10T08:29:34.043902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039039+0000","last_change":"2024-09-10T08:29:34.023343+0000","last_active":"2024-09-10T08:29:34.039039+0000","last_peered":"2024-09-10T08:29:34.039039+0000","last_clean":"2024-09-10T08:29:34.039039+0000","last_became_active":"2024-09-10T08:29:34.023036+0000","last_became_peered":"2024-09-10T08:29:34.023036+0000","last_unstale":"2024-09-10T08:29:34.039039+0000","last_undegraded":"2024-09-10T08:29:34.039039+0000","last_fullsized":"2024-09-10T08:29:34.039039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:43.993961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037399+0000","last_change":"2024-09-10T08:29:34.033658+0000","last_active":"2024-09-10T08:29:34.037399+0000","last_peered":"2024-09-10T08:29:34.037399+0000","last_clean":"2024-09-10T08:29:34.037399+0000","last_became_active":"2024-09-10T08:29:34.033379+0000","last_became_peered":"2024-09-10T08:29:34.033379+0000","last_unstale":"2024-09-10T08:29:34.037399+0000","last_undegraded":"2024-09-10T08:29:34.037399+0000","last_fullsized":"2024-09-10T08:29:34.037399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046363+0000","last_change":"2024-09-10T08:29:34.042026+0000","last_active":"2024-09-10T08:29:34.046363+0000","last_peered":"2024-09-10T08:29:34.046363+0000","last_clean":"2024-09-10T08:29:34.046363+0000","last_became_active":"2024-09-10T08:29:34.041674+0000","last_became_peered":"2024-09-10T08:29:34.041674+0000","last_unstale":"2024-09-10T08:29:34.046363+0000","last_undegraded":"2024-09-10T08:29:34.046363+0000","last_fullsized":"2024-09-10T08:29:34.046363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:20.274879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045151+0000","last_change":"2024-09-10T08:29:34.039736+0000","last_active":"2024-09-10T08:29:34.045151+0000","last_peered":"2024-09-10T08:29:34.045151+0000","last_clean":"2024-09-10T08:29:34.045151+0000","last_became_active":"2024-09-10T08:29:34.039447+0000","last_became_peered":"2024-09-10T08:29:34.039447+0000","last_unstale":"2024-09-10T08:29:34.045151+0000","last_undegraded":"2024-09-10T08:29:34.045151+0000","last_fullsized":"2024-09-10T08:29:34.045151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054596+0000","last_change":"2024-09-10T08:29:34.048898+0000","last_active":"2024-09-10T08:29:34.054596+0000","last_peered":"2024-09-10T08:29:34.054596+0000","last_clean":"2024-09-10T08:29:34.054596+0000","last_became_active":"2024-09-10T08:29:34.039978+0000","last_became_peered":"2024-09-10T08:29:34.039978+0000","last_unstale":"2024-09-10T08:29:34.054596+0000","last_undegraded":"2024-09-10T08:29:34.054596+0000","last_fullsized":"2024-09-10T08:29:34.054596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036710+0000","last_change":"2024-09-10T08:29:34.027611+0000","last_active":"2024-09-10T08:29:34.036710+0000","last_peered":"2024-09-10T08:29:34.036710+0000","last_clean":"2024-09-10T08:29:34.036710+0000","last_became_active":"2024-09-10T08:29:34.027316+0000","last_became_peered":"2024-09-10T08:29:34.027316+0000","last_unstale":"2024-09-10T08:29:34.036710+0000","last_undegraded":"2024-09-10T08:29:34.036710+0000","last_fullsized":"2024-09-10T08:29:34.036710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048984+0000","last_change":"2024-09-10T08:29:34.043504+0000","last_active":"2024-09-10T08:29:34.048984+0000","last_peered":"2024-09-10T08:29:34.048984+0000","last_clean":"2024-09-10T08:29:34.048984+0000","last_became_active":"2024-09-10T08:29:34.042661+0000","last_became_peered":"2024-09-10T08:29:34.042661+0000","last_unstale":"2024-09-10T08:29:34.048984+0000","last_undegraded":"2024-09-10T08:29:34.048984+0000","last_fullsized":"2024-09-10T08:29:34.048984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052679+0000","last_change":"2024-09-10T08:29:34.036454+0000","last_active":"2024-09-10T08:29:34.052679+0000","last_peered":"2024-09-10T08:29:34.052679+0000","last_clean":"2024-09-10T08:29:34.052679+0000","last_became_active":"2024-09-10T08:29:34.036101+0000","last_became_peered":"2024-09-10T08:29:34.036101+0000","last_unstale":"2024-09-10T08:29:34.052679+0000","last_undegraded":"2024-09-10T08:29:34.052679+0000","last_fullsized":"2024-09-10T08:29:34.052679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032825+0000","last_change":"2024-09-10T08:29:34.030162+0000","last_active":"2024-09-10T08:29:34.032825+0000","last_peered":"2024-09-10T08:29:34.032825+0000","last_clean":"2024-09-10T08:29:34.032825+0000","last_became_active":"2024-09-10T08:29:34.029892+0000","last_became_peered":"2024-09-10T08:29:34.029892+0000","last_unstale":"2024-09-10T08:29:34.032825+0000","last_undegraded":"2024-09-10T08:29:34.032825+0000","last_fullsized":"2024-09-10T08:29:34.032825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.035273+0000","last_change":"2024-09-10T08:29:34.024246+0000","last_active":"2024-09-10T08:29:34.035273+0000","last_peered":"2024-09-10T08:29:34.035273+0000","last_clean":"2024-09-10T08:29:34.035273+0000","last_became_active":"2024-09-10T08:29:34.023898+0000","last_became_peered":"2024-09-10T08:29:34.023898+0000","last_unstale":"2024-09-10T08:29:34.035273+0000","last_undegraded":"2024-09-10T08:29:34.035273+0000","last_fullsized":"2024-09-10T08:29:34.035273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040773+0000","last_change":"2024-09-10T08:29:34.041244+0000","last_active":"2024-09-10T08:29:35.040773+0000","last_peered":"2024-09-10T08:29:35.040773+0000","last_clean":"2024-09-10T08:29:35.040773+0000","last_became_active":"2024-09-10T08:29:34.040889+0000","last_became_peered":"2024-09-10T08:29:34.040889+0000","last_unstale":"2024-09-10T08:29:35.040773+0000","last_undegraded":"2024-09-10T08:29:35.040773+0000","last_fullsized":"2024-09-10T08:29:35.040773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:04.012827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048276+0000","last_change":"2024-09-10T08:29:34.033479+0000","last_active":"2024-09-10T08:29:34.048276+0000","last_peered":"2024-09-10T08:29:34.048276+0000","last_clean":"2024-09-10T08:29:34.048276+0000","last_became_active":"2024-09-10T08:29:34.033007+0000","last_became_peered":"2024-09-10T08:29:34.033007+0000","last_unstale":"2024-09-10T08:29:34.048276+0000","last_undegraded":"2024-09-10T08:29:34.048276+0000","last_fullsized":"2024-09-10T08:29:34.048276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049296+0000","last_change":"2024-09-10T08:29:34.038693+0000","last_active":"2024-09-10T08:29:34.049296+0000","last_peered":"2024-09-10T08:29:34.049296+0000","last_clean":"2024-09-10T08:29:34.049296+0000","last_became_active":"2024-09-10T08:29:34.038418+0000","last_became_peered":"2024-09-10T08:29:34.038418+0000","last_unstale":"2024-09-10T08:29:34.049296+0000","last_undegraded":"2024-09-10T08:29:34.049296+0000","last_fullsized":"2024-09-10T08:29:34.049296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.045846+0000","last_change":"2024-09-10T08:29:34.043411+0000","last_active":"2024-09-10T08:29:34.045846+0000","last_peered":"2024-09-10T08:29:34.045846+0000","last_clean":"2024-09-10T08:29:34.045846+0000","last_became_active":"2024-09-10T08:29:34.042873+0000","last_became_peered":"2024-09-10T08:29:34.042873+0000","last_unstale":"2024-09-10T08:29:34.045846+0000","last_undegraded":"2024-09-10T08:29:34.045846+0000","last_fullsized":"2024-09-10T08:29:34.045846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052450+0000","last_change":"2024-09-10T08:29:34.036484+0000","last_active":"2024-09-10T08:29:34.052450+0000","last_peered":"2024-09-10T08:29:34.052450+0000","last_clean":"2024-09-10T08:29:34.052450+0000","last_became_active":"2024-09-10T08:29:34.036196+0000","last_became_peered":"2024-09-10T08:29:34.036196+0000","last_unstale":"2024-09-10T08:29:34.052450+0000","last_undegraded":"2024-09-10T08:29:34.052450+0000","last_fullsized":"2024-09-10T08:29:34.052450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039363+0000","last_change":"2024-09-10T08:29:34.023550+0000","last_active":"2024-09-10T08:29:34.039363+0000","last_peered":"2024-09-10T08:29:34.039363+0000","last_clean":"2024-09-10T08:29:34.039363+0000","last_became_active":"2024-09-10T08:29:34.023253+0000","last_became_peered":"2024-09-10T08:29:34.023253+0000","last_unstale":"2024-09-10T08:29:34.039363+0000","last_undegraded":"2024-09-10T08:29:34.039363+0000","last_fullsized":"2024-09-10T08:29:34.039363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:54.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036626+0000","last_change":"2024-09-10T08:29:34.030313+0000","last_active":"2024-09-10T08:29:34.036626+0000","last_peered":"2024-09-10T08:29:34.036626+0000","last_clean":"2024-09-10T08:29:34.036626+0000","last_became_active":"2024-09-10T08:29:34.029987+0000","last_became_peered":"2024-09-10T08:29:34.029987+0000","last_unstale":"2024-09-10T08:29:34.036626+0000","last_undegraded":"2024-09-10T08:29:34.036626+0000","last_fullsized":"2024-09-10T08:29:34.036626+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053023+0000","last_change":"2024-09-10T08:29:33.022598+0000","last_active":"2024-09-10T08:29:34.053023+0000","last_peered":"2024-09-10T08:29:34.053023+0000","last_clean":"2024-09-10T08:29:34.053023+0000","last_became_active":"2024-09-10T08:29:33.022302+0000","last_became_peered":"2024-09-10T08:29:33.022302+0000","last_unstale":"2024-09-10T08:29:34.053023+0000","last_undegraded":"2024-09-10T08:29:34.053023+0000","last_fullsized":"2024-09-10T08:29:34.053023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:20.408155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053197+0000","last_change":"2024-09-10T08:29:34.038139+0000","last_active":"2024-09-10T08:29:34.053197+0000","last_peered":"2024-09-10T08:29:34.053197+0000","last_clean":"2024-09-10T08:29:34.053197+0000","last_became_active":"2024-09-10T08:29:34.037740+0000","last_became_peered":"2024-09-10T08:29:34.037740+0000","last_unstale":"2024-09-10T08:29:34.053197+0000","last_undegraded":"2024-09-10T08:29:34.053197+0000","last_fullsized":"2024-09-10T08:29:34.053197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.054715+0000","last_change":"2024-09-10T08:29:33.022704+0000","last_active":"2024-09-10T08:29:34.054715+0000","last_peered":"2024-09-10T08:29:34.054715+0000","last_clean":"2024-09-10T08:29:34.054715+0000","last_became_active":"2024-09-10T08:29:33.021966+0000","last_became_peered":"2024-09-10T08:29:33.021966+0000","last_unstale":"2024-09-10T08:29:34.054715+0000","last_undegraded":"2024-09-10T08:29:34.054715+0000","last_fullsized":"2024-09-10T08:29:34.054715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048250+0000","last_change":"2024-09-10T08:29:34.026982+0000","last_active":"2024-09-10T08:29:34.048250+0000","last_peered":"2024-09-10T08:29:34.048250+0000","last_clean":"2024-09-10T08:29:34.048250+0000","last_became_active":"2024-09-10T08:29:34.026660+0000","last_became_peered":"2024-09-10T08:29:34.026660+0000","last_unstale":"2024-09-10T08:29:34.048250+0000","last_undegraded":"2024-09-10T08:29:34.048250+0000","last_fullsized":"2024-09-10T08:29:34.048250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060566+0000","last_change":"2024-09-10T08:29:33.021777+0000","last_active":"2024-09-10T08:29:34.060566+0000","last_peered":"2024-09-10T08:29:34.060566+0000","last_clean":"2024-09-10T08:29:34.060566+0000","last_became_active":"2024-09-10T08:29:33.021502+0000","last_became_peered":"2024-09-10T08:29:33.021502+0000","last_unstale":"2024-09-10T08:29:34.060566+0000","last_undegraded":"2024-09-10T08:29:34.060566+0000","last_fullsized":"2024-09-10T08:29:34.060566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:34.767107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.037102+0000","last_change":"2024-09-10T08:29:34.034652+0000","last_active":"2024-09-10T08:29:34.037102+0000","last_peered":"2024-09-10T08:29:34.037102+0000","last_clean":"2024-09-10T08:29:34.037102+0000","last_became_active":"2024-09-10T08:29:34.034324+0000","last_became_peered":"2024-09-10T08:29:34.034324+0000","last_unstale":"2024-09-10T08:29:34.037102+0000","last_undegraded":"2024-09-10T08:29:34.037102+0000","last_fullsized":"2024-09-10T08:29:34.037102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055947+0000","last_change":"2024-09-10T08:29:33.022304+0000","last_active":"2024-09-10T08:29:34.055947+0000","last_peered":"2024-09-10T08:29:34.055947+0000","last_clean":"2024-09-10T08:29:34.055947+0000","last_became_active":"2024-09-10T08:29:33.022083+0000","last_became_peered":"2024-09-10T08:29:33.022083+0000","last_unstale":"2024-09-10T08:29:34.055947+0000","last_undegraded":"2024-09-10T08:29:34.055947+0000","last_fullsized":"2024-09-10T08:29:34.055947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:00.602457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049083+0000","last_change":"2024-09-10T08:29:34.045812+0000","last_active":"2024-09-10T08:29:34.049083+0000","last_peered":"2024-09-10T08:29:34.049083+0000","last_clean":"2024-09-10T08:29:34.049083+0000","last_became_active":"2024-09-10T08:29:34.045608+0000","last_became_peered":"2024-09-10T08:29:34.045608+0000","last_unstale":"2024-09-10T08:29:34.049083+0000","last_undegraded":"2024-09-10T08:29:34.049083+0000","last_fullsized":"2024-09-10T08:29:34.049083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.057630+0000","last_change":"2024-09-10T08:29:33.024403+0000","last_active":"2024-09-10T08:29:34.057630+0000","last_peered":"2024-09-10T08:29:34.057630+0000","last_clean":"2024-09-10T08:29:34.057630+0000","last_became_active":"2024-09-10T08:29:33.023478+0000","last_became_peered":"2024-09-10T08:29:33.023478+0000","last_unstale":"2024-09-10T08:29:34.057630+0000","last_undegraded":"2024-09-10T08:29:34.057630+0000","last_fullsized":"2024-09-10T08:29:34.057630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.053926+0000","last_change":"2024-09-10T08:29:34.049858+0000","last_active":"2024-09-10T08:29:34.053926+0000","last_peered":"2024-09-10T08:29:34.053926+0000","last_clean":"2024-09-10T08:29:34.053926+0000","last_became_active":"2024-09-10T08:29:34.036503+0000","last_became_peered":"2024-09-10T08:29:34.036503+0000","last_unstale":"2024-09-10T08:29:34.053926+0000","last_undegraded":"2024-09-10T08:29:34.053926+0000","last_fullsized":"2024-09-10T08:29:34.053926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.056845+0000","last_change":"2024-09-10T08:29:33.028410+0000","last_active":"2024-09-10T08:29:34.056845+0000","last_peered":"2024-09-10T08:29:34.056845+0000","last_clean":"2024-09-10T08:29:34.056845+0000","last_became_active":"2024-09-10T08:29:33.026040+0000","last_became_peered":"2024-09-10T08:29:33.026040+0000","last_unstale":"2024-09-10T08:29:34.056845+0000","last_undegraded":"2024-09-10T08:29:34.056845+0000","last_fullsized":"2024-09-10T08:29:34.056845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049142+0000","last_change":"2024-09-10T08:29:34.044121+0000","last_active":"2024-09-10T08:29:34.049142+0000","last_peered":"2024-09-10T08:29:34.049142+0000","last_clean":"2024-09-10T08:29:34.049142+0000","last_became_active":"2024-09-10T08:29:34.043839+0000","last_became_peered":"2024-09-10T08:29:34.043839+0000","last_unstale":"2024-09-10T08:29:34.049142+0000","last_undegraded":"2024-09-10T08:29:34.049142+0000","last_fullsized":"2024-09-10T08:29:34.049142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:35.771620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022302+0000","last_change":"2024-09-10T08:29:33.024132+0000","last_active":"2024-09-10T08:29:34.022302+0000","last_peered":"2024-09-10T08:29:34.022302+0000","last_clean":"2024-09-10T08:29:34.022302+0000","last_became_active":"2024-09-10T08:29:33.023879+0000","last_became_peered":"2024-09-10T08:29:33.023879+0000","last_unstale":"2024-09-10T08:29:34.022302+0000","last_undegraded":"2024-09-10T08:29:34.022302+0000","last_fullsized":"2024-09-10T08:29:34.022302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:54.405184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031899+0000","last_change":"2024-09-10T08:29:34.027671+0000","last_active":"2024-09-10T08:29:34.031899+0000","last_peered":"2024-09-10T08:29:34.031899+0000","last_clean":"2024-09-10T08:29:34.031899+0000","last_became_active":"2024-09-10T08:29:34.027289+0000","last_became_peered":"2024-09-10T08:29:34.027289+0000","last_unstale":"2024-09-10T08:29:34.031899+0000","last_undegraded":"2024-09-10T08:29:34.031899+0000","last_fullsized":"2024-09-10T08:29:34.031899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014607+0000","last_change":"2024-09-10T08:29:33.020211+0000","last_active":"2024-09-10T08:29:34.014607+0000","last_peered":"2024-09-10T08:29:34.014607+0000","last_clean":"2024-09-10T08:29:34.014607+0000","last_became_active":"2024-09-10T08:29:33.019698+0000","last_became_peered":"2024-09-10T08:29:33.019698+0000","last_unstale":"2024-09-10T08:29:34.014607+0000","last_undegraded":"2024-09-10T08:29:34.014607+0000","last_fullsized":"2024-09-10T08:29:34.014607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.545431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039052+0000","last_change":"2024-09-10T08:29:34.031164+0000","last_active":"2024-09-10T08:29:34.039052+0000","last_peered":"2024-09-10T08:29:34.039052+0000","last_clean":"2024-09-10T08:29:34.039052+0000","last_became_active":"2024-09-10T08:29:34.030791+0000","last_became_peered":"2024-09-10T08:29:34.030791+0000","last_unstale":"2024-09-10T08:29:34.039052+0000","last_undegraded":"2024-09-10T08:29:34.039052+0000","last_fullsized":"2024-09-10T08:29:34.039052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:53.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.041097+0000","last_change":"2024-09-10T08:29:33.025504+0000","last_active":"2024-09-10T08:29:35.041097+0000","last_peered":"2024-09-10T08:29:35.041097+0000","last_clean":"2024-09-10T08:29:35.041097+0000","last_became_active":"2024-09-10T08:29:33.025250+0000","last_became_peered":"2024-09-10T08:29:33.025250+0000","last_unstale":"2024-09-10T08:29:35.041097+0000","last_undegraded":"2024-09-10T08:29:35.041097+0000","last_fullsized":"2024-09-10T08:29:35.041097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:03.539961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.039895+0000","last_change":"2024-09-10T08:29:34.035478+0000","last_active":"2024-09-10T08:29:34.039895+0000","last_peered":"2024-09-10T08:29:34.039895+0000","last_clean":"2024-09-10T08:29:34.039895+0000","last_became_active":"2024-09-10T08:29:34.035094+0000","last_became_peered":"2024-09-10T08:29:34.035094+0000","last_unstale":"2024-09-10T08:29:34.039895+0000","last_undegraded":"2024-09-10T08:29:34.039895+0000","last_fullsized":"2024-09-10T08:29:34.039895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040909+0000","last_change":"2024-09-10T08:29:33.022012+0000","last_active":"2024-09-10T08:29:35.040909+0000","last_peered":"2024-09-10T08:29:35.040909+0000","last_clean":"2024-09-10T08:29:35.040909+0000","last_became_active":"2024-09-10T08:29:33.021732+0000","last_became_peered":"2024-09-10T08:29:33.021732+0000","last_unstale":"2024-09-10T08:29:35.040909+0000","last_undegraded":"2024-09-10T08:29:35.040909+0000","last_fullsized":"2024-09-10T08:29:35.040909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:14.720438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031828+0000","last_change":"2024-09-10T08:29:34.027098+0000","last_active":"2024-09-10T08:29:34.031828+0000","last_peered":"2024-09-10T08:29:34.031828+0000","last_clean":"2024-09-10T08:29:34.031828+0000","last_became_active":"2024-09-10T08:29:34.026819+0000","last_became_peered":"2024-09-10T08:29:34.026819+0000","last_unstale":"2024-09-10T08:29:34.031828+0000","last_undegraded":"2024-09-10T08:29:34.031828+0000","last_fullsized":"2024-09-10T08:29:34.031828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052258+0000","last_change":"2024-09-10T08:29:33.024226+0000","last_active":"2024-09-10T08:29:34.052258+0000","last_peered":"2024-09-10T08:29:34.052258+0000","last_clean":"2024-09-10T08:29:34.052258+0000","last_became_active":"2024-09-10T08:29:33.023927+0000","last_became_peered":"2024-09-10T08:29:33.023927+0000","last_unstale":"2024-09-10T08:29:34.052258+0000","last_undegraded":"2024-09-10T08:29:34.052258+0000","last_fullsized":"2024-09-10T08:29:34.052258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.814661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.031055+0000","last_change":"2024-09-10T08:29:34.028666+0000","last_active":"2024-09-10T08:29:34.031055+0000","last_peered":"2024-09-10T08:29:34.031055+0000","last_clean":"2024-09-10T08:29:34.031055+0000","last_became_active":"2024-09-10T08:29:34.023390+0000","last_became_peered":"2024-09-10T08:29:34.023390+0000","last_unstale":"2024-09-10T08:29:34.031055+0000","last_undegraded":"2024-09-10T08:29:34.031055+0000","last_fullsized":"2024-09-10T08:29:34.031055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:07.098553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060807+0000","last_change":"2024-09-10T08:29:33.024849+0000","last_active":"2024-09-10T08:29:34.060807+0000","last_peered":"2024-09-10T08:29:34.060807+0000","last_clean":"2024-09-10T08:29:34.060807+0000","last_became_active":"2024-09-10T08:29:33.024498+0000","last_became_peered":"2024-09-10T08:29:33.024498+0000","last_unstale":"2024-09-10T08:29:34.060807+0000","last_undegraded":"2024-09-10T08:29:34.060807+0000","last_fullsized":"2024-09-10T08:29:34.060807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.046736+0000","last_change":"2024-09-10T08:29:34.043288+0000","last_active":"2024-09-10T08:29:34.046736+0000","last_peered":"2024-09-10T08:29:34.046736+0000","last_clean":"2024-09-10T08:29:34.046736+0000","last_became_active":"2024-09-10T08:29:34.042465+0000","last_became_peered":"2024-09-10T08:29:34.042465+0000","last_unstale":"2024-09-10T08:29:34.046736+0000","last_undegraded":"2024-09-10T08:29:34.046736+0000","last_fullsized":"2024-09-10T08:29:34.046736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:36.899814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058825+0000","last_change":"2024-09-10T08:29:33.028081+0000","last_active":"2024-09-10T08:29:34.058825+0000","last_peered":"2024-09-10T08:29:34.058825+0000","last_clean":"2024-09-10T08:29:34.058825+0000","last_became_active":"2024-09-10T08:29:33.027897+0000","last_became_peered":"2024-09-10T08:29:33.027897+0000","last_unstale":"2024-09-10T08:29:34.058825+0000","last_undegraded":"2024-09-10T08:29:34.058825+0000","last_fullsized":"2024-09-10T08:29:34.058825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:34.318695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051885+0000","last_change":"2024-09-10T08:29:34.045109+0000","last_active":"2024-09-10T08:29:34.051885+0000","last_peered":"2024-09-10T08:29:34.051885+0000","last_clean":"2024-09-10T08:29:34.051885+0000","last_became_active":"2024-09-10T08:29:34.043753+0000","last_became_peered":"2024-09-10T08:29:34.043753+0000","last_unstale":"2024-09-10T08:29:34.051885+0000","last_undegraded":"2024-09-10T08:29:34.051885+0000","last_fullsized":"2024-09-10T08:29:34.051885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015902+0000","last_change":"2024-09-10T08:29:33.024567+0000","last_active":"2024-09-10T08:29:34.015902+0000","last_peered":"2024-09-10T08:29:34.015902+0000","last_clean":"2024-09-10T08:29:34.015902+0000","last_became_active":"2024-09-10T08:29:33.024300+0000","last_became_peered":"2024-09-10T08:29:33.024300+0000","last_unstale":"2024-09-10T08:29:34.015902+0000","last_undegraded":"2024-09-10T08:29:34.015902+0000","last_fullsized":"2024-09-10T08:29:34.015902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:35.895300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.036800+0000","last_change":"2024-09-10T08:29:34.029898+0000","last_active":"2024-09-10T08:29:34.036800+0000","last_peered":"2024-09-10T08:29:34.036800+0000","last_clean":"2024-09-10T08:29:34.036800+0000","last_became_active":"2024-09-10T08:29:34.025811+0000","last_became_peered":"2024-09-10T08:29:34.025811+0000","last_unstale":"2024-09-10T08:29:34.036800+0000","last_undegraded":"2024-09-10T08:29:34.036800+0000","last_fullsized":"2024-09-10T08:29:34.036800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015430+0000","last_change":"2024-09-10T08:29:33.027465+0000","last_active":"2024-09-10T08:29:34.015430+0000","last_peered":"2024-09-10T08:29:34.015430+0000","last_clean":"2024-09-10T08:29:34.015430+0000","last_became_active":"2024-09-10T08:29:33.027180+0000","last_became_peered":"2024-09-10T08:29:33.027180+0000","last_unstale":"2024-09-10T08:29:34.015430+0000","last_undegraded":"2024-09-10T08:29:34.015430+0000","last_fullsized":"2024-09-10T08:29:34.015430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:21.360437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038526+0000","last_change":"2024-09-10T08:29:34.030798+0000","last_active":"2024-09-10T08:29:34.038526+0000","last_peered":"2024-09-10T08:29:34.038526+0000","last_clean":"2024-09-10T08:29:34.038526+0000","last_became_active":"2024-09-10T08:29:34.030429+0000","last_became_peered":"2024-09-10T08:29:34.030429+0000","last_unstale":"2024-09-10T08:29:34.038526+0000","last_undegraded":"2024-09-10T08:29:34.038526+0000","last_fullsized":"2024-09-10T08:29:34.038526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:27.365540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.063388+0000","last_change":"2024-09-10T08:29:33.026315+0000","last_active":"2024-09-10T08:29:34.063388+0000","last_peered":"2024-09-10T08:29:34.063388+0000","last_clean":"2024-09-10T08:29:34.063388+0000","last_became_active":"2024-09-10T08:29:33.025999+0000","last_became_peered":"2024-09-10T08:29:33.025999+0000","last_unstale":"2024-09-10T08:29:34.063388+0000","last_undegraded":"2024-09-10T08:29:34.063388+0000","last_fullsized":"2024-09-10T08:29:34.063388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:06.106789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.041040+0000","last_change":"2024-09-10T08:29:34.038925+0000","last_active":"2024-09-10T08:29:34.041040+0000","last_peered":"2024-09-10T08:29:34.041040+0000","last_clean":"2024-09-10T08:29:34.041040+0000","last_became_active":"2024-09-10T08:29:34.038615+0000","last_became_peered":"2024-09-10T08:29:34.038615+0000","last_unstale":"2024-09-10T08:29:34.041040+0000","last_undegraded":"2024-09-10T08:29:34.041040+0000","last_fullsized":"2024-09-10T08:29:34.041040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:14.933076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.060433+0000","last_change":"2024-09-10T08:29:33.021747+0000","last_active":"2024-09-10T08:29:34.060433+0000","last_peered":"2024-09-10T08:29:34.060433+0000","last_clean":"2024-09-10T08:29:34.060433+0000","last_became_active":"2024-09-10T08:29:33.021377+0000","last_became_peered":"2024-09-10T08:29:33.021377+0000","last_unstale":"2024-09-10T08:29:34.060433+0000","last_undegraded":"2024-09-10T08:29:34.060433+0000","last_fullsized":"2024-09-10T08:29:34.060433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:48.504875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049038+0000","last_change":"2024-09-10T08:29:34.044290+0000","last_active":"2024-09-10T08:29:34.049038+0000","last_peered":"2024-09-10T08:29:34.049038+0000","last_clean":"2024-09-10T08:29:34.049038+0000","last_became_active":"2024-09-10T08:29:34.043797+0000","last_became_peered":"2024-09-10T08:29:34.043797+0000","last_unstale":"2024-09-10T08:29:34.049038+0000","last_undegraded":"2024-09-10T08:29:34.049038+0000","last_fullsized":"2024-09-10T08:29:34.049038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:28.173898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.058819+0000","last_change":"2024-09-10T08:29:33.020918+0000","last_active":"2024-09-10T08:29:34.058819+0000","last_peered":"2024-09-10T08:29:34.058819+0000","last_clean":"2024-09-10T08:29:34.058819+0000","last_became_active":"2024-09-10T08:29:33.020658+0000","last_became_peered":"2024-09-10T08:29:33.020658+0000","last_unstale":"2024-09-10T08:29:34.058819+0000","last_undegraded":"2024-09-10T08:29:34.058819+0000","last_fullsized":"2024-09-10T08:29:34.058819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040749+0000","last_change":"2024-09-10T08:29:34.031282+0000","last_active":"2024-09-10T08:29:35.040749+0000","last_peered":"2024-09-10T08:29:35.040749+0000","last_clean":"2024-09-10T08:29:35.040749+0000","last_became_active":"2024-09-10T08:29:34.029114+0000","last_became_peered":"2024-09-10T08:29:34.029114+0000","last_unstale":"2024-09-10T08:29:35.040749+0000","last_undegraded":"2024-09-10T08:29:35.040749+0000","last_fullsized":"2024-09-10T08:29:35.040749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:54.579482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.051243+0000","last_change":"2024-09-10T08:29:33.026324+0000","last_active":"2024-09-10T08:29:34.051243+0000","last_peered":"2024-09-10T08:29:34.051243+0000","last_clean":"2024-09-10T08:29:34.051243+0000","last_became_active":"2024-09-10T08:29:33.025862+0000","last_became_peered":"2024-09-10T08:29:33.025862+0000","last_unstale":"2024-09-10T08:29:34.051243+0000","last_undegraded":"2024-09-10T08:29:34.051243+0000","last_fullsized":"2024-09-10T08:29:34.051243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:23.996817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048650+0000","last_change":"2024-09-10T08:29:34.043523+0000","last_active":"2024-09-10T08:29:34.048650+0000","last_peered":"2024-09-10T08:29:34.048650+0000","last_clean":"2024-09-10T08:29:34.048650+0000","last_became_active":"2024-09-10T08:29:34.043197+0000","last_became_peered":"2024-09-10T08:29:34.043197+0000","last_unstale":"2024-09-10T08:29:34.048650+0000","last_undegraded":"2024-09-10T08:29:34.048650+0000","last_fullsized":"2024-09-10T08:29:34.048650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:33.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025547+0000","last_change":"2024-09-10T08:29:33.023460+0000","last_active":"2024-09-10T08:29:34.025547+0000","last_peered":"2024-09-10T08:29:34.025547+0000","last_clean":"2024-09-10T08:29:34.025547+0000","last_became_active":"2024-09-10T08:29:33.023170+0000","last_became_peered":"2024-09-10T08:29:33.023170+0000","last_unstale":"2024-09-10T08:29:34.025547+0000","last_undegraded":"2024-09-10T08:29:34.025547+0000","last_fullsized":"2024-09-10T08:29:34.025547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.052270+0000","last_change":"2024-09-10T08:29:34.048200+0000","last_active":"2024-09-10T08:29:34.052270+0000","last_peered":"2024-09-10T08:29:34.052270+0000","last_clean":"2024-09-10T08:29:34.052270+0000","last_became_active":"2024-09-10T08:29:34.047927+0000","last_became_peered":"2024-09-10T08:29:34.047927+0000","last_unstale":"2024-09-10T08:29:34.052270+0000","last_undegraded":"2024-09-10T08:29:34.052270+0000","last_fullsized":"2024-09-10T08:29:34.052270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:53.789812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040834+0000","last_change":"2024-09-10T08:29:33.027059+0000","last_active":"2024-09-10T08:29:35.040834+0000","last_peered":"2024-09-10T08:29:35.040834+0000","last_clean":"2024-09-10T08:29:35.040834+0000","last_became_active":"2024-09-10T08:29:33.026748+0000","last_became_peered":"2024-09-10T08:29:33.026748+0000","last_unstale":"2024-09-10T08:29:35.040834+0000","last_undegraded":"2024-09-10T08:29:35.040834+0000","last_fullsized":"2024-09-10T08:29:35.040834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:11.419915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040703+0000","last_change":"2024-09-10T08:29:34.035156+0000","last_active":"2024-09-10T08:29:35.040703+0000","last_peered":"2024-09-10T08:29:35.040703+0000","last_clean":"2024-09-10T08:29:35.040703+0000","last_became_active":"2024-09-10T08:29:34.034309+0000","last_became_peered":"2024-09-10T08:29:34.034309+0000","last_unstale":"2024-09-10T08:29:35.040703+0000","last_undegraded":"2024-09-10T08:29:35.040703+0000","last_fullsized":"2024-09-10T08:29:35.040703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:13.516426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014220+0000","last_change":"2024-09-10T08:29:33.024913+0000","last_active":"2024-09-10T08:29:34.014220+0000","last_peered":"2024-09-10T08:29:34.014220+0000","last_clean":"2024-09-10T08:29:34.014220+0000","last_became_active":"2024-09-10T08:29:33.023124+0000","last_became_peered":"2024-09-10T08:29:33.023124+0000","last_unstale":"2024-09-10T08:29:34.014220+0000","last_undegraded":"2024-09-10T08:29:34.014220+0000","last_fullsized":"2024-09-10T08:29:34.014220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.044632+0000","last_change":"2024-09-10T08:29:34.039167+0000","last_active":"2024-09-10T08:29:34.044632+0000","last_peered":"2024-09-10T08:29:34.044632+0000","last_clean":"2024-09-10T08:29:34.044632+0000","last_became_active":"2024-09-10T08:29:34.037065+0000","last_became_peered":"2024-09-10T08:29:34.037065+0000","last_unstale":"2024-09-10T08:29:34.044632+0000","last_undegraded":"2024-09-10T08:29:34.044632+0000","last_fullsized":"2024-09-10T08:29:34.044632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.021311+0000","last_change":"2024-09-10T08:29:33.033458+0000","last_active":"2024-09-10T08:29:34.021311+0000","last_peered":"2024-09-10T08:29:34.021311+0000","last_clean":"2024-09-10T08:29:34.021311+0000","last_became_active":"2024-09-10T08:29:33.033161+0000","last_became_peered":"2024-09-10T08:29:33.033161+0000","last_unstale":"2024-09-10T08:29:34.021311+0000","last_undegraded":"2024-09-10T08:29:34.021311+0000","last_fullsized":"2024-09-10T08:29:34.021311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:40.792079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.049514+0000","last_change":"2024-09-10T08:29:34.047377+0000","last_active":"2024-09-10T08:29:34.049514+0000","last_peered":"2024-09-10T08:29:34.049514+0000","last_clean":"2024-09-10T08:29:34.049514+0000","last_became_active":"2024-09-10T08:29:34.047055+0000","last_became_peered":"2024-09-10T08:29:34.047055+0000","last_unstale":"2024-09-10T08:29:34.049514+0000","last_undegraded":"2024-09-10T08:29:34.049514+0000","last_fullsized":"2024-09-10T08:29:34.049514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:03.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.015675+0000","last_change":"2024-09-10T08:29:33.025805+0000","last_active":"2024-09-10T08:29:34.015675+0000","last_peered":"2024-09-10T08:29:34.015675+0000","last_clean":"2024-09-10T08:29:34.015675+0000","last_became_active":"2024-09-10T08:29:33.024658+0000","last_became_peered":"2024-09-10T08:29:33.024658+0000","last_unstale":"2024-09-10T08:29:34.015675+0000","last_undegraded":"2024-09-10T08:29:34.015675+0000","last_fullsized":"2024-09-10T08:29:34.015675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:23.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048661+0000","last_change":"2024-09-10T08:29:34.043724+0000","last_active":"2024-09-10T08:29:34.048661+0000","last_peered":"2024-09-10T08:29:34.048661+0000","last_clean":"2024-09-10T08:29:34.048661+0000","last_became_active":"2024-09-10T08:29:34.043471+0000","last_became_peered":"2024-09-10T08:29:34.043471+0000","last_unstale":"2024-09-10T08:29:34.048661+0000","last_undegraded":"2024-09-10T08:29:34.048661+0000","last_fullsized":"2024-09-10T08:29:34.048661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.786925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.055249+0000","last_change":"2024-09-10T08:29:33.028935+0000","last_active":"2024-09-10T08:29:34.055249+0000","last_peered":"2024-09-10T08:29:34.055249+0000","last_clean":"2024-09-10T08:29:34.055249+0000","last_became_active":"2024-09-10T08:29:33.028629+0000","last_became_peered":"2024-09-10T08:29:33.028629+0000","last_unstale":"2024-09-10T08:29:34.055249+0000","last_undegraded":"2024-09-10T08:29:34.055249+0000","last_fullsized":"2024-09-10T08:29:34.055249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.029997+0000","last_change":"2024-09-10T08:29:34.028422+0000","last_active":"2024-09-10T08:29:34.029997+0000","last_peered":"2024-09-10T08:29:34.029997+0000","last_clean":"2024-09-10T08:29:34.029997+0000","last_became_active":"2024-09-10T08:29:34.028152+0000","last_became_peered":"2024-09-10T08:29:34.028152+0000","last_unstale":"2024-09-10T08:29:34.029997+0000","last_undegraded":"2024-09-10T08:29:34.029997+0000","last_fullsized":"2024-09-10T08:29:34.029997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:55.420525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.041015+0000","last_change":"2024-09-10T08:29:33.024021+0000","last_active":"2024-09-10T08:29:35.041015+0000","last_peered":"2024-09-10T08:29:35.041015+0000","last_clean":"2024-09-10T08:29:35.041015+0000","last_became_active":"2024-09-10T08:29:33.023084+0000","last_became_peered":"2024-09-10T08:29:33.023084+0000","last_unstale":"2024-09-10T08:29:35.041015+0000","last_undegraded":"2024-09-10T08:29:35.041015+0000","last_fullsized":"2024-09-10T08:29:35.041015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:29.403561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038671+0000","last_change":"2024-09-10T08:29:34.037052+0000","last_active":"2024-09-10T08:29:34.038671+0000","last_peered":"2024-09-10T08:29:34.038671+0000","last_clean":"2024-09-10T08:29:34.038671+0000","last_became_active":"2024-09-10T08:29:34.036602+0000","last_became_peered":"2024-09-10T08:29:34.036602+0000","last_unstale":"2024-09-10T08:29:34.038671+0000","last_undegraded":"2024-09-10T08:29:34.038671+0000","last_fullsized":"2024-09-10T08:29:34.038671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:55.553479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.025729+0000","last_change":"2024-09-10T08:29:33.024043+0000","last_active":"2024-09-10T08:29:34.025729+0000","last_peered":"2024-09-10T08:29:34.025729+0000","last_clean":"2024-09-10T08:29:34.025729+0000","last_became_active":"2024-09-10T08:29:33.023735+0000","last_became_peered":"2024-09-10T08:29:33.023735+0000","last_unstale":"2024-09-10T08:29:34.025729+0000","last_undegraded":"2024-09-10T08:29:34.025729+0000","last_fullsized":"2024-09-10T08:29:34.025729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.047928+0000","last_change":"2024-09-10T08:29:34.044817+0000","last_active":"2024-09-10T08:29:34.047928+0000","last_peered":"2024-09-10T08:29:34.047928+0000","last_clean":"2024-09-10T08:29:34.047928+0000","last_became_active":"2024-09-10T08:29:34.044489+0000","last_became_peered":"2024-09-10T08:29:34.044489+0000","last_unstale":"2024-09-10T08:29:34.047928+0000","last_undegraded":"2024-09-10T08:29:34.047928+0000","last_fullsized":"2024-09-10T08:29:34.047928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.023957+0000","last_change":"2024-09-10T08:29:33.030176+0000","last_active":"2024-09-10T08:29:34.023957+0000","last_peered":"2024-09-10T08:29:34.023957+0000","last_clean":"2024-09-10T08:29:34.023957+0000","last_became_active":"2024-09-10T08:29:33.028687+0000","last_became_peered":"2024-09-10T08:29:33.028687+0000","last_unstale":"2024-09-10T08:29:34.023957+0000","last_undegraded":"2024-09-10T08:29:34.023957+0000","last_fullsized":"2024-09-10T08:29:34.023957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.032909+0000","last_change":"2024-09-10T08:29:34.031146+0000","last_active":"2024-09-10T08:29:34.032909+0000","last_peered":"2024-09-10T08:29:34.032909+0000","last_clean":"2024-09-10T08:29:34.032909+0000","last_became_active":"2024-09-10T08:29:34.030853+0000","last_became_peered":"2024-09-10T08:29:34.030853+0000","last_unstale":"2024-09-10T08:29:34.032909+0000","last_undegraded":"2024-09-10T08:29:34.032909+0000","last_fullsized":"2024-09-10T08:29:34.032909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022820+0000","last_change":"2024-09-10T08:29:33.028878+0000","last_active":"2024-09-10T08:29:34.022820+0000","last_peered":"2024-09-10T08:29:34.022820+0000","last_clean":"2024-09-10T08:29:34.022820+0000","last_became_active":"2024-09-10T08:29:33.028575+0000","last_became_peered":"2024-09-10T08:29:33.028575+0000","last_unstale":"2024-09-10T08:29:34.022820+0000","last_undegraded":"2024-09-10T08:29:34.022820+0000","last_fullsized":"2024-09-10T08:29:34.022820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.030519+0000","last_change":"2024-09-10T08:29:34.022980+0000","last_active":"2024-09-10T08:29:34.030519+0000","last_peered":"2024-09-10T08:29:34.030519+0000","last_clean":"2024-09-10T08:29:34.030519+0000","last_became_active":"2024-09-10T08:29:34.022678+0000","last_became_peered":"2024-09-10T08:29:34.022678+0000","last_unstale":"2024-09-10T08:29:34.030519+0000","last_undegraded":"2024-09-10T08:29:34.030519+0000","last_fullsized":"2024-09-10T08:29:34.030519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.014357+0000","last_change":"2024-09-10T08:29:33.027084+0000","last_active":"2024-09-10T08:29:34.014357+0000","last_peered":"2024-09-10T08:29:34.014357+0000","last_clean":"2024-09-10T08:29:34.014357+0000","last_became_active":"2024-09-10T08:29:33.026802+0000","last_became_peered":"2024-09-10T08:29:33.026802+0000","last_unstale":"2024-09-10T08:29:34.014357+0000","last_undegraded":"2024-09-10T08:29:34.014357+0000","last_fullsized":"2024-09-10T08:29:34.014357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.038540+0000","last_change":"2024-09-10T08:29:34.030886+0000","last_active":"2024-09-10T08:29:34.038540+0000","last_peered":"2024-09-10T08:29:34.038540+0000","last_clean":"2024-09-10T08:29:34.038540+0000","last_became_active":"2024-09-10T08:29:34.030659+0000","last_became_peered":"2024-09-10T08:29:34.030659+0000","last_unstale":"2024-09-10T08:29:34.038540+0000","last_undegraded":"2024-09-10T08:29:34.038540+0000","last_fullsized":"2024-09-10T08:29:34.038540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:46.321648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.016464+0000","last_change":"2024-09-10T08:29:33.029745+0000","last_active":"2024-09-10T08:29:34.016464+0000","last_peered":"2024-09-10T08:29:34.016464+0000","last_clean":"2024-09-10T08:29:34.016464+0000","last_became_active":"2024-09-10T08:29:33.029417+0000","last_became_peered":"2024-09-10T08:29:33.029417+0000","last_unstale":"2024-09-10T08:29:34.016464+0000","last_undegraded":"2024-09-10T08:29:34.016464+0000","last_fullsized":"2024-09-10T08:29:34.016464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:03.473771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.048514+0000","last_change":"2024-09-10T08:29:34.046471+0000","last_active":"2024-09-10T08:29:34.048514+0000","last_peered":"2024-09-10T08:29:34.048514+0000","last_clean":"2024-09-10T08:29:34.048514+0000","last_became_active":"2024-09-10T08:29:34.046117+0000","last_became_peered":"2024-09-10T08:29:34.046117+0000","last_unstale":"2024-09-10T08:29:34.048514+0000","last_undegraded":"2024-09-10T08:29:34.048514+0000","last_fullsized":"2024-09-10T08:29:34.048514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.022590+0000","last_change":"2024-09-10T08:29:33.026103+0000","last_active":"2024-09-10T08:29:34.022590+0000","last_peered":"2024-09-10T08:29:34.022590+0000","last_clean":"2024-09-10T08:29:34.022590+0000","last_became_active":"2024-09-10T08:29:33.025539+0000","last_became_peered":"2024-09-10T08:29:33.025539+0000","last_unstale":"2024-09-10T08:29:34.022590+0000","last_undegraded":"2024-09-10T08:29:34.022590+0000","last_fullsized":"2024-09-10T08:29:34.022590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:42.966093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-10T08:29:34.019288+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:29:34.019288+0000","last_peered":"2024-09-10T08:29:34.019288+0000","last_clean":"2024-09-10T08:29:34.019288+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:29:34.019288+0000","last_undegraded":"2024-09-10T08:29:34.019288+0000","last_fullsized":"2024-09-10T08:29:34.019288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":134879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":134901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":368640,"data_stored":134043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":950272,"data_stored":723705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":356352,"data_stored":133357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":730517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:42.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:29:43.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.113+0000 7f1f63400640 1 Processor -- start 2024-09-10T08:29:43.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.114+0000 7f1f63400640 1 -- start start 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f63400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1f5c073890 0x7f1f5c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f63400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f5c0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f63400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c0b4020 con 0x7f1f5c145ed0 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f63400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1f5c0b42c0 con 0x7f1f5c073890 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f63400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b45a0 con 0x7f1f5c0b5880 2024-09-10T08:29:43.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f60a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1f5c145ed0 0x7f1f5c073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39350/0 (socket says 172.21.15.52:39350) 2024-09-10T08:29:43.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f60a00640 1 -- 172.21.15.52:0/1140916414 learned_addr learned my addr 172.21.15.52:0/1140916414 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f53e00640 1 --2- 172.21.15.52:0/1140916414 >> v2:172.21.15.176:3300/0 conn(0x7f1f5c073890 0x7f1f5c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f61400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f5c0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.115+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180383767 0 0) 0x7f1f5c0b4020 con 0x7f1f5c145ed0 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f40003520 con 0x7f1f5c145ed0 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2135246237 0 0) 0x7f1f40003520 con 0x7f1f5c145ed0 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 msgr2=0x7f1f5c0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f5c0b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 >> v2:172.21.15.176:3300/0 conn(0x7f1f5c073890 msgr2=0x7f1f5c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 --2- 172.21.15.52:0/1140916414 >> v2:172.21.15.176:3300/0 conn(0x7f1f5c073890 0x7f1f5c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c0b4880 con 0x7f1f5c145ed0 2024-09-10T08:29:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f1f4c001690 con 0x7f1f5c145ed0 2024-09-10T08:29:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 >> v1:172.21.15.52:6789/0 conn(0x7f1f5c145ed0 legacy=0x7f1f5c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f40003f80 0x7f1f40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b42c0 con 0x7f1f40004d40 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b45a0 con 0x7f1f40003f80 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4000fdd0 con 0x7f1f5c0b5880 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f60a00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f53e00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f40003f80 0x7f1f40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.116+0000 7f1f61400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f61400640 1 -- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 msgr2=0x7f1f400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f61400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f61400640 1 -- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f40003f80 msgr2=0x7f1f40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f61400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f40003f80 0x7f1f40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f61400640 1 -- 172.21.15.52:0/1140916414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f40003520 con 0x7f1f40004d40 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f60a00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c0b5880 0x7f1f400039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.117+0000 7f1f53e00640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f40003f80 0x7f1f40004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:29:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.118+0000 7f1f61400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f400051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e170 tx=0x7f1f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96ed2068fbf2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.118+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54034020 con 0x7f1f40004d40 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.118+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f540305f0 con 0x7f1f40004d40 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.118+0000 7f1f5be00640 1 -- 172.21.15.52:0/1140916414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54009c10 con 0x7f1f40004d40 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 -- 172.21.15.52:0/1140916414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 msgr2=0x7f1f400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 --2- 172.21.15.52:0/1140916414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f400051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e170 tx=0x7f1f40005830 comp rx=0 tx=0).stop 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f61400640 1 -- 172.21.15.52:0/1140916414 reap_dead start 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 -- 172.21.15.52:0/1140916414 shutdown_connections 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 -- 172.21.15.52:0/1140916414 >> 172.21.15.52:0/1140916414 conn(0x7f1f5c0ccec0 msgr2=0x7f1f5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 -- 172.21.15.52:0/1140916414 shutdown_connections 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.119+0000 7f1f63400640 1 -- 172.21.15.52:0/1140916414 wait complete. 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.120+0000 7f1f63400640 1 Processor -- start 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 -- start start 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c1e3ef0 0x7f1f5c1e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 0x7f1f5c13b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c146430 con 0x7f1f40004d40 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c1462b0 con 0x7f1f5c1e3ef0 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.121+0000 7f1f63400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b5d30 con 0x7f1f5c13b000 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59558/0 (socket says 172.21.15.52:59558) 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 -- 172.21.15.52:0/2762551691 learned_addr learned my addr 172.21.15.52:0/2762551691 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f53e00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c1e3ef0 0x7f1f5c1e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f61400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 0x7f1f5c13b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 -- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 msgr2=0x7f1f5c13b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 0x7f1f5c13b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 -- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c1e3ef0 msgr2=0x7f1f5c1e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c1e3ef0 0x7f1f5c1e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 -- 172.21.15.52:0/2762551691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c159ec0 con 0x7f1f40004d40 2024-09-10T08:29:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f61400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 0x7f1f5c13b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.122+0000 7f1f60a00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c001800 tx=0x7f1f4c0076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.123+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00f960 con 0x7f1f40004d40 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.123+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c018070 con 0x7f1f40004d40 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.123+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00fd20 con 0x7f1f40004d40 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.123+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c1e2e70 con 0x7f1f40004d40 2024-09-10T08:29:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.123+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1e3430 con 0x7f1f40004d40 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.124+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5c0b5080 con 0x7f1f40004d40 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.125+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f4c01d460 con 0x7f1f40004d40 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.126+0000 7f1f59600640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 0x7f1f3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.126+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1f4c08afe0 con 0x7f1f40004d40 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.126+0000 7f1f53e00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 0x7f1f3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.127+0000 7f1f53e00640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 0x7f1f3806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009de0 tx=0x7f1f44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.130+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f4c059390 con 0x7f1f40004d40 2024-09-10T08:29:43.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.316+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f5c0686b0 con 0x7f1f3806be30 2024-09-10T08:29:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.322+0000 7f1f59600640 1 -- 172.21.15.52:0/2762551691 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f1f5c0686b0 con 0x7f1f3806be30 2024-09-10T08:29:43.325 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:43.327 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:29:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 msgr2=0x7f1f3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 0x7f1f3806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009de0 tx=0x7f1f44009190 comp rx=0 tx=0).stop 2024-09-10T08:29:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 msgr2=0x7f1f5c159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c001800 tx=0x7f1f4c0076e0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 shutdown_connections 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1f3806be30 0x7f1f3806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1f5c13b000 0x7f1f5c13b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f5c1e3ef0 0x7f1f5c1e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 --2- 172.21.15.52:0/2762551691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f40004d40 0x7f1f5c159980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 >> 172.21.15.52:0/2762551691 conn(0x7f1f5c0ccec0 msgr2=0x7f1f5c1448b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.326+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 shutdown_connections 2024-09-10T08:29:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.327+0000 7f1f63400640 1 -- 172.21.15.52:0/2762551691 wait complete. 2024-09-10T08:29:43.342 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-10T08:29:41.463728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241140,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733580,"statfs":{"total":773094113280,"available":772847185920,"internally_reserved":0,"allocated":4169728,"data_stored":2302092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002244"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026472+0000","last_change":"2024-09-10T08:29:34.050800+0000","last_active":"2024-09-10T08:29:35.026472+0000","last_peered":"2024-09-10T08:29:35.026472+0000","last_clean":"2024-09-10T08:29:35.026472+0000","last_became_active":"2024-09-10T08:29:34.050515+0000","last_became_peered":"2024-09-10T08:29:34.050515+0000","last_unstale":"2024-09-10T08:29:35.026472+0000","last_undegraded":"2024-09-10T08:29:35.026472+0000","last_fullsized":"2024-09-10T08:29:35.026472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:24.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040881+0000","last_change":"2024-09-10T08:29:34.038328+0000","last_active":"2024-09-10T08:29:35.040881+0000","last_peered":"2024-09-10T08:29:35.040881+0000","last_clean":"2024-09-10T08:29:35.040881+0000","last_became_active":"2024-09-10T08:29:34.036819+0000","last_became_peered":"2024-09-10T08:29:34.036819+0000","last_unstale":"2024-09-10T08:29:35.040881+0000","last_undegraded":"2024-09-10T08:29:35.040881+0000","last_fullsized":"2024-09-10T08:29:35.040881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:36.294753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351614+0000","last_change":"2024-09-10T08:29:34.032147+0000","last_active":"2024-09-10T08:29:35.351614+0000","last_peered":"2024-09-10T08:29:35.351614+0000","last_clean":"2024-09-10T08:29:35.351614+0000","last_became_active":"2024-09-10T08:29:34.031869+0000","last_became_peered":"2024-09-10T08:29:34.031869+0000","last_unstale":"2024-09-10T08:29:35.351614+0000","last_undegraded":"2024-09-10T08:29:35.351614+0000","last_fullsized":"2024-09-10T08:29:35.351614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027346+0000","last_change":"2024-09-10T08:29:34.043864+0000","last_active":"2024-09-10T08:29:35.027346+0000","last_peered":"2024-09-10T08:29:35.027346+0000","last_clean":"2024-09-10T08:29:35.027346+0000","last_became_active":"2024-09-10T08:29:34.041475+0000","last_became_peered":"2024-09-10T08:29:34.041475+0000","last_unstale":"2024-09-10T08:29:35.027346+0000","last_undegraded":"2024-09-10T08:29:35.027346+0000","last_fullsized":"2024-09-10T08:29:35.027346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:19.819175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040660+0000","last_change":"2024-09-10T08:29:34.033970+0000","last_active":"2024-09-10T08:29:35.040660+0000","last_peered":"2024-09-10T08:29:35.040660+0000","last_clean":"2024-09-10T08:29:35.040660+0000","last_became_active":"2024-09-10T08:29:34.030766+0000","last_became_peered":"2024-09-10T08:29:34.030766+0000","last_unstale":"2024-09-10T08:29:35.040660+0000","last_undegraded":"2024-09-10T08:29:35.040660+0000","last_fullsized":"2024-09-10T08:29:35.040660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:32.708847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043472+0000","last_change":"2024-09-10T08:29:34.039947+0000","last_active":"2024-09-10T08:29:35.043472+0000","last_peered":"2024-09-10T08:29:35.043472+0000","last_clean":"2024-09-10T08:29:35.043472+0000","last_became_active":"2024-09-10T08:29:34.039425+0000","last_became_peered":"2024-09-10T08:29:34.039425+0000","last_unstale":"2024-09-10T08:29:35.043472+0000","last_undegraded":"2024-09-10T08:29:35.043472+0000","last_fullsized":"2024-09-10T08:29:35.043472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:53.262529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.025975+0000","last_change":"2024-09-10T08:29:34.035820+0000","last_active":"2024-09-10T08:29:35.025975+0000","last_peered":"2024-09-10T08:29:35.025975+0000","last_clean":"2024-09-10T08:29:35.025975+0000","last_became_active":"2024-09-10T08:29:34.035530+0000","last_became_peered":"2024-09-10T08:29:34.035530+0000","last_unstale":"2024-09-10T08:29:35.025975+0000","last_undegraded":"2024-09-10T08:29:35.025975+0000","last_fullsized":"2024-09-10T08:29:35.025975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026472+0000","last_change":"2024-09-10T08:29:34.032026+0000","last_active":"2024-09-10T08:29:35.026472+0000","last_peered":"2024-09-10T08:29:35.026472+0000","last_clean":"2024-09-10T08:29:35.026472+0000","last_became_active":"2024-09-10T08:29:34.031828+0000","last_became_peered":"2024-09-10T08:29:34.031828+0000","last_unstale":"2024-09-10T08:29:35.026472+0000","last_undegraded":"2024-09-10T08:29:35.026472+0000","last_fullsized":"2024-09-10T08:29:35.026472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:21.412668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351836+0000","last_change":"2024-09-10T08:29:34.044053+0000","last_active":"2024-09-10T08:29:35.351836+0000","last_peered":"2024-09-10T08:29:35.351836+0000","last_clean":"2024-09-10T08:29:35.351836+0000","last_became_active":"2024-09-10T08:29:34.043402+0000","last_became_peered":"2024-09-10T08:29:34.043402+0000","last_unstale":"2024-09-10T08:29:35.351836+0000","last_undegraded":"2024-09-10T08:29:35.351836+0000","last_fullsized":"2024-09-10T08:29:35.351836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027924+0000","last_change":"2024-09-10T08:29:34.034386+0000","last_active":"2024-09-10T08:29:35.027924+0000","last_peered":"2024-09-10T08:29:35.027924+0000","last_clean":"2024-09-10T08:29:35.027924+0000","last_became_active":"2024-09-10T08:29:34.034034+0000","last_became_peered":"2024-09-10T08:29:34.034034+0000","last_unstale":"2024-09-10T08:29:35.027924+0000","last_undegraded":"2024-09-10T08:29:35.027924+0000","last_fullsized":"2024-09-10T08:29:35.027924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:40:53.766331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027776+0000","last_change":"2024-09-10T08:29:34.035547+0000","last_active":"2024-09-10T08:29:35.027776+0000","last_peered":"2024-09-10T08:29:35.027776+0000","last_clean":"2024-09-10T08:29:35.027776+0000","last_became_active":"2024-09-10T08:29:34.035248+0000","last_became_peered":"2024-09-10T08:29:34.035248+0000","last_unstale":"2024-09-10T08:29:35.027776+0000","last_undegraded":"2024-09-10T08:29:35.027776+0000","last_fullsized":"2024-09-10T08:29:35.027776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:51.547402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351540+0000","last_change":"2024-09-10T08:29:34.037847+0000","last_active":"2024-09-10T08:29:35.351540+0000","last_peered":"2024-09-10T08:29:35.351540+0000","last_clean":"2024-09-10T08:29:35.351540+0000","last_became_active":"2024-09-10T08:29:34.036896+0000","last_became_peered":"2024-09-10T08:29:34.036896+0000","last_unstale":"2024-09-10T08:29:35.351540+0000","last_undegraded":"2024-09-10T08:29:35.351540+0000","last_fullsized":"2024-09-10T08:29:35.351540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:53.262529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351686+0000","last_change":"2024-09-10T08:29:34.037905+0000","last_active":"2024-09-10T08:29:35.351686+0000","last_peered":"2024-09-10T08:29:35.351686+0000","last_clean":"2024-09-10T08:29:35.351686+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:35.351686+0000","last_undegraded":"2024-09-10T08:29:35.351686+0000","last_fullsized":"2024-09-10T08:29:35.351686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:30.222903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027618+0000","last_change":"2024-09-10T08:29:34.031148+0000","last_active":"2024-09-10T08:29:35.027618+0000","last_peered":"2024-09-10T08:29:35.027618+0000","last_clean":"2024-09-10T08:29:35.027618+0000","last_became_active":"2024-09-10T08:29:34.030897+0000","last_became_peered":"2024-09-10T08:29:34.030897+0000","last_unstale":"2024-09-10T08:29:35.027618+0000","last_undegraded":"2024-09-10T08:29:35.027618+0000","last_fullsized":"2024-09-10T08:29:35.027618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:51:07.098553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.350992+0000","last_change":"2024-09-10T08:29:34.037889+0000","last_active":"2024-09-10T08:29:35.350992+0000","last_peered":"2024-09-10T08:29:35.350992+0000","last_clean":"2024-09-10T08:29:35.350992+0000","last_became_active":"2024-09-10T08:29:34.037598+0000","last_became_peered":"2024-09-10T08:29:34.037598+0000","last_unstale":"2024-09-10T08:29:35.350992+0000","last_undegraded":"2024-09-10T08:29:35.350992+0000","last_fullsized":"2024-09-10T08:29:35.350992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.350871+0000","last_change":"2024-09-10T08:29:34.040898+0000","last_active":"2024-09-10T08:29:35.350871+0000","last_peered":"2024-09-10T08:29:35.350871+0000","last_clean":"2024-09-10T08:29:35.350871+0000","last_became_active":"2024-09-10T08:29:34.040166+0000","last_became_peered":"2024-09-10T08:29:34.040166+0000","last_unstale":"2024-09-10T08:29:35.350871+0000","last_undegraded":"2024-09-10T08:29:35.350871+0000","last_fullsized":"2024-09-10T08:29:35.350871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027649+0000","last_change":"2024-09-10T08:29:34.023343+0000","last_active":"2024-09-10T08:29:35.027649+0000","last_peered":"2024-09-10T08:29:35.027649+0000","last_clean":"2024-09-10T08:29:35.027649+0000","last_became_active":"2024-09-10T08:29:34.023036+0000","last_became_peered":"2024-09-10T08:29:34.023036+0000","last_unstale":"2024-09-10T08:29:35.027649+0000","last_undegraded":"2024-09-10T08:29:35.027649+0000","last_fullsized":"2024-09-10T08:29:35.027649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:06.635724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043746+0000","last_change":"2024-09-10T08:29:34.033658+0000","last_active":"2024-09-10T08:29:35.043746+0000","last_peered":"2024-09-10T08:29:35.043746+0000","last_clean":"2024-09-10T08:29:35.043746+0000","last_became_active":"2024-09-10T08:29:34.033379+0000","last_became_peered":"2024-09-10T08:29:34.033379+0000","last_unstale":"2024-09-10T08:29:35.043746+0000","last_undegraded":"2024-09-10T08:29:35.043746+0000","last_fullsized":"2024-09-10T08:29:35.043746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043580+0000","last_change":"2024-09-10T08:29:34.042026+0000","last_active":"2024-09-10T08:29:35.043580+0000","last_peered":"2024-09-10T08:29:35.043580+0000","last_clean":"2024-09-10T08:29:35.043580+0000","last_became_active":"2024-09-10T08:29:34.041674+0000","last_became_peered":"2024-09-10T08:29:34.041674+0000","last_unstale":"2024-09-10T08:29:35.043580+0000","last_undegraded":"2024-09-10T08:29:35.043580+0000","last_fullsized":"2024-09-10T08:29:35.043580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:35.323208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351873+0000","last_change":"2024-09-10T08:29:34.039736+0000","last_active":"2024-09-10T08:29:35.351873+0000","last_peered":"2024-09-10T08:29:35.351873+0000","last_clean":"2024-09-10T08:29:35.351873+0000","last_became_active":"2024-09-10T08:29:34.039447+0000","last_became_peered":"2024-09-10T08:29:34.039447+0000","last_unstale":"2024-09-10T08:29:35.351873+0000","last_undegraded":"2024-09-10T08:29:35.351873+0000","last_fullsized":"2024-09-10T08:29:35.351873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351258+0000","last_change":"2024-09-10T08:29:34.048898+0000","last_active":"2024-09-10T08:29:35.351258+0000","last_peered":"2024-09-10T08:29:35.351258+0000","last_clean":"2024-09-10T08:29:35.351258+0000","last_became_active":"2024-09-10T08:29:34.039978+0000","last_became_peered":"2024-09-10T08:29:34.039978+0000","last_unstale":"2024-09-10T08:29:35.351258+0000","last_undegraded":"2024-09-10T08:29:35.351258+0000","last_fullsized":"2024-09-10T08:29:35.351258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026087+0000","last_change":"2024-09-10T08:29:34.027611+0000","last_active":"2024-09-10T08:29:35.026087+0000","last_peered":"2024-09-10T08:29:35.026087+0000","last_clean":"2024-09-10T08:29:35.026087+0000","last_became_active":"2024-09-10T08:29:34.027316+0000","last_became_peered":"2024-09-10T08:29:34.027316+0000","last_unstale":"2024-09-10T08:29:35.026087+0000","last_undegraded":"2024-09-10T08:29:35.026087+0000","last_fullsized":"2024-09-10T08:29:35.026087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351348+0000","last_change":"2024-09-10T08:29:34.043504+0000","last_active":"2024-09-10T08:29:35.351348+0000","last_peered":"2024-09-10T08:29:35.351348+0000","last_clean":"2024-09-10T08:29:35.351348+0000","last_became_active":"2024-09-10T08:29:34.042661+0000","last_became_peered":"2024-09-10T08:29:34.042661+0000","last_unstale":"2024-09-10T08:29:35.351348+0000","last_undegraded":"2024-09-10T08:29:35.351348+0000","last_fullsized":"2024-09-10T08:29:35.351348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:02.694197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.025965+0000","last_change":"2024-09-10T08:29:34.036454+0000","last_active":"2024-09-10T08:29:35.025965+0000","last_peered":"2024-09-10T08:29:35.025965+0000","last_clean":"2024-09-10T08:29:35.025965+0000","last_became_active":"2024-09-10T08:29:34.036101+0000","last_became_peered":"2024-09-10T08:29:34.036101+0000","last_unstale":"2024-09-10T08:29:35.025965+0000","last_undegraded":"2024-09-10T08:29:35.025965+0000","last_fullsized":"2024-09-10T08:29:35.025965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:09.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027898+0000","last_change":"2024-09-10T08:29:34.030162+0000","last_active":"2024-09-10T08:29:35.027898+0000","last_peered":"2024-09-10T08:29:35.027898+0000","last_clean":"2024-09-10T08:29:35.027898+0000","last_became_active":"2024-09-10T08:29:34.029892+0000","last_became_peered":"2024-09-10T08:29:34.029892+0000","last_unstale":"2024-09-10T08:29:35.027898+0000","last_undegraded":"2024-09-10T08:29:35.027898+0000","last_fullsized":"2024-09-10T08:29:35.027898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:46.321648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027870+0000","last_change":"2024-09-10T08:29:34.024246+0000","last_active":"2024-09-10T08:29:35.027870+0000","last_peered":"2024-09-10T08:29:35.027870+0000","last_clean":"2024-09-10T08:29:35.027870+0000","last_became_active":"2024-09-10T08:29:34.023898+0000","last_became_peered":"2024-09-10T08:29:34.023898+0000","last_unstale":"2024-09-10T08:29:35.027870+0000","last_undegraded":"2024-09-10T08:29:35.027870+0000","last_fullsized":"2024-09-10T08:29:35.027870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:43.993961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040773+0000","last_change":"2024-09-10T08:29:34.041244+0000","last_active":"2024-09-10T08:29:35.040773+0000","last_peered":"2024-09-10T08:29:35.040773+0000","last_clean":"2024-09-10T08:29:35.040773+0000","last_became_active":"2024-09-10T08:29:34.040889+0000","last_became_peered":"2024-09-10T08:29:34.040889+0000","last_unstale":"2024-09-10T08:29:35.040773+0000","last_undegraded":"2024-09-10T08:29:35.040773+0000","last_fullsized":"2024-09-10T08:29:35.040773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:04.012827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026220+0000","last_change":"2024-09-10T08:29:34.033479+0000","last_active":"2024-09-10T08:29:35.026220+0000","last_peered":"2024-09-10T08:29:35.026220+0000","last_clean":"2024-09-10T08:29:35.026220+0000","last_became_active":"2024-09-10T08:29:34.033007+0000","last_became_peered":"2024-09-10T08:29:34.033007+0000","last_unstale":"2024-09-10T08:29:35.026220+0000","last_undegraded":"2024-09-10T08:29:35.026220+0000","last_fullsized":"2024-09-10T08:29:35.026220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:02.226643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351091+0000","last_change":"2024-09-10T08:29:34.038693+0000","last_active":"2024-09-10T08:29:35.351091+0000","last_peered":"2024-09-10T08:29:35.351091+0000","last_clean":"2024-09-10T08:29:35.351091+0000","last_became_active":"2024-09-10T08:29:34.038418+0000","last_became_peered":"2024-09-10T08:29:34.038418+0000","last_unstale":"2024-09-10T08:29:35.351091+0000","last_undegraded":"2024-09-10T08:29:35.351091+0000","last_fullsized":"2024-09-10T08:29:35.351091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351520+0000","last_change":"2024-09-10T08:29:34.043411+0000","last_active":"2024-09-10T08:29:35.351520+0000","last_peered":"2024-09-10T08:29:35.351520+0000","last_clean":"2024-09-10T08:29:35.351520+0000","last_became_active":"2024-09-10T08:29:34.042873+0000","last_became_peered":"2024-09-10T08:29:34.042873+0000","last_unstale":"2024-09-10T08:29:35.351520+0000","last_undegraded":"2024-09-10T08:29:35.351520+0000","last_fullsized":"2024-09-10T08:29:35.351520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:24.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026018+0000","last_change":"2024-09-10T08:29:34.036484+0000","last_active":"2024-09-10T08:29:35.026018+0000","last_peered":"2024-09-10T08:29:35.026018+0000","last_clean":"2024-09-10T08:29:35.026018+0000","last_became_active":"2024-09-10T08:29:34.036196+0000","last_became_peered":"2024-09-10T08:29:34.036196+0000","last_unstale":"2024-09-10T08:29:35.026018+0000","last_undegraded":"2024-09-10T08:29:35.026018+0000","last_fullsized":"2024-09-10T08:29:35.026018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:29.152829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027210+0000","last_change":"2024-09-10T08:29:34.023550+0000","last_active":"2024-09-10T08:29:35.027210+0000","last_peered":"2024-09-10T08:29:35.027210+0000","last_clean":"2024-09-10T08:29:35.027210+0000","last_became_active":"2024-09-10T08:29:34.023253+0000","last_became_peered":"2024-09-10T08:29:34.023253+0000","last_unstale":"2024-09-10T08:29:35.027210+0000","last_undegraded":"2024-09-10T08:29:35.027210+0000","last_fullsized":"2024-09-10T08:29:35.027210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:43.135760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351950+0000","last_change":"2024-09-10T08:29:34.030313+0000","last_active":"2024-09-10T08:29:35.351950+0000","last_peered":"2024-09-10T08:29:35.351950+0000","last_clean":"2024-09-10T08:29:35.351950+0000","last_became_active":"2024-09-10T08:29:34.029987+0000","last_became_peered":"2024-09-10T08:29:34.029987+0000","last_unstale":"2024-09-10T08:29:35.351950+0000","last_undegraded":"2024-09-10T08:29:35.351950+0000","last_fullsized":"2024-09-10T08:29:35.351950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:32.815693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027744+0000","last_change":"2024-09-10T08:29:33.022598+0000","last_active":"2024-09-10T08:29:35.027744+0000","last_peered":"2024-09-10T08:29:35.027744+0000","last_clean":"2024-09-10T08:29:35.027744+0000","last_became_active":"2024-09-10T08:29:33.022302+0000","last_became_peered":"2024-09-10T08:29:33.022302+0000","last_unstale":"2024-09-10T08:29:35.027744+0000","last_undegraded":"2024-09-10T08:29:35.027744+0000","last_fullsized":"2024-09-10T08:29:35.027744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:20.408155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026564+0000","last_change":"2024-09-10T08:29:34.038139+0000","last_active":"2024-09-10T08:29:35.026564+0000","last_peered":"2024-09-10T08:29:35.026564+0000","last_clean":"2024-09-10T08:29:35.026564+0000","last_became_active":"2024-09-10T08:29:34.037740+0000","last_became_peered":"2024-09-10T08:29:34.037740+0000","last_unstale":"2024-09-10T08:29:35.026564+0000","last_undegraded":"2024-09-10T08:29:35.026564+0000","last_fullsized":"2024-09-10T08:29:35.026564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:25.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027989+0000","last_change":"2024-09-10T08:29:33.022704+0000","last_active":"2024-09-10T08:29:35.027989+0000","last_peered":"2024-09-10T08:29:35.027989+0000","last_clean":"2024-09-10T08:29:35.027989+0000","last_became_active":"2024-09-10T08:29:33.021966+0000","last_became_peered":"2024-09-10T08:29:33.021966+0000","last_unstale":"2024-09-10T08:29:35.027989+0000","last_undegraded":"2024-09-10T08:29:35.027989+0000","last_fullsized":"2024-09-10T08:29:35.027989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026305+0000","last_change":"2024-09-10T08:29:34.026982+0000","last_active":"2024-09-10T08:29:35.026305+0000","last_peered":"2024-09-10T08:29:35.026305+0000","last_clean":"2024-09-10T08:29:35.026305+0000","last_became_active":"2024-09-10T08:29:34.026660+0000","last_became_peered":"2024-09-10T08:29:34.026660+0000","last_unstale":"2024-09-10T08:29:35.026305+0000","last_undegraded":"2024-09-10T08:29:35.026305+0000","last_fullsized":"2024-09-10T08:29:35.026305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:04.898802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043708+0000","last_change":"2024-09-10T08:29:33.021777+0000","last_active":"2024-09-10T08:29:35.043708+0000","last_peered":"2024-09-10T08:29:35.043708+0000","last_clean":"2024-09-10T08:29:35.043708+0000","last_became_active":"2024-09-10T08:29:33.021502+0000","last_became_peered":"2024-09-10T08:29:33.021502+0000","last_unstale":"2024-09-10T08:29:35.043708+0000","last_undegraded":"2024-09-10T08:29:35.043708+0000","last_fullsized":"2024-09-10T08:29:35.043708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:34.767107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027868+0000","last_change":"2024-09-10T08:29:34.034652+0000","last_active":"2024-09-10T08:29:35.027868+0000","last_peered":"2024-09-10T08:29:35.027868+0000","last_clean":"2024-09-10T08:29:35.027868+0000","last_became_active":"2024-09-10T08:29:34.034324+0000","last_became_peered":"2024-09-10T08:29:34.034324+0000","last_unstale":"2024-09-10T08:29:35.027868+0000","last_undegraded":"2024-09-10T08:29:35.027868+0000","last_fullsized":"2024-09-10T08:29:35.027868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:54.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027486+0000","last_change":"2024-09-10T08:29:33.022304+0000","last_active":"2024-09-10T08:29:35.027486+0000","last_peered":"2024-09-10T08:29:35.027486+0000","last_clean":"2024-09-10T08:29:35.027486+0000","last_became_active":"2024-09-10T08:29:33.022083+0000","last_became_peered":"2024-09-10T08:29:33.022083+0000","last_unstale":"2024-09-10T08:29:35.027486+0000","last_undegraded":"2024-09-10T08:29:35.027486+0000","last_fullsized":"2024-09-10T08:29:35.027486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:00.602457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351657+0000","last_change":"2024-09-10T08:29:34.045812+0000","last_active":"2024-09-10T08:29:35.351657+0000","last_peered":"2024-09-10T08:29:35.351657+0000","last_clean":"2024-09-10T08:29:35.351657+0000","last_became_active":"2024-09-10T08:29:34.045608+0000","last_became_peered":"2024-09-10T08:29:34.045608+0000","last_unstale":"2024-09-10T08:29:35.351657+0000","last_undegraded":"2024-09-10T08:29:35.351657+0000","last_fullsized":"2024-09-10T08:29:35.351657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026316+0000","last_change":"2024-09-10T08:29:33.024403+0000","last_active":"2024-09-10T08:29:35.026316+0000","last_peered":"2024-09-10T08:29:35.026316+0000","last_clean":"2024-09-10T08:29:35.026316+0000","last_became_active":"2024-09-10T08:29:33.023478+0000","last_became_peered":"2024-09-10T08:29:33.023478+0000","last_unstale":"2024-09-10T08:29:35.026316+0000","last_undegraded":"2024-09-10T08:29:35.026316+0000","last_fullsized":"2024-09-10T08:29:35.026316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026320+0000","last_change":"2024-09-10T08:29:34.049858+0000","last_active":"2024-09-10T08:29:35.026320+0000","last_peered":"2024-09-10T08:29:35.026320+0000","last_clean":"2024-09-10T08:29:35.026320+0000","last_became_active":"2024-09-10T08:29:34.036503+0000","last_became_peered":"2024-09-10T08:29:34.036503+0000","last_unstale":"2024-09-10T08:29:35.026320+0000","last_undegraded":"2024-09-10T08:29:35.026320+0000","last_fullsized":"2024-09-10T08:29:35.026320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:22.225232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026199+0000","last_change":"2024-09-10T08:29:33.028410+0000","last_active":"2024-09-10T08:29:35.026199+0000","last_peered":"2024-09-10T08:29:35.026199+0000","last_clean":"2024-09-10T08:29:35.026199+0000","last_became_active":"2024-09-10T08:29:33.026040+0000","last_became_peered":"2024-09-10T08:29:33.026040+0000","last_unstale":"2024-09-10T08:29:35.026199+0000","last_undegraded":"2024-09-10T08:29:35.026199+0000","last_fullsized":"2024-09-10T08:29:35.026199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351259+0000","last_change":"2024-09-10T08:29:34.044121+0000","last_active":"2024-09-10T08:29:35.351259+0000","last_peered":"2024-09-10T08:29:35.351259+0000","last_clean":"2024-09-10T08:29:35.351259+0000","last_became_active":"2024-09-10T08:29:34.043839+0000","last_became_peered":"2024-09-10T08:29:34.043839+0000","last_unstale":"2024-09-10T08:29:35.351259+0000","last_undegraded":"2024-09-10T08:29:35.351259+0000","last_fullsized":"2024-09-10T08:29:35.351259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:33.018856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043421+0000","last_change":"2024-09-10T08:29:33.024132+0000","last_active":"2024-09-10T08:29:35.043421+0000","last_peered":"2024-09-10T08:29:35.043421+0000","last_clean":"2024-09-10T08:29:35.043421+0000","last_became_active":"2024-09-10T08:29:33.023879+0000","last_became_peered":"2024-09-10T08:29:33.023879+0000","last_unstale":"2024-09-10T08:29:35.043421+0000","last_undegraded":"2024-09-10T08:29:35.043421+0000","last_fullsized":"2024-09-10T08:29:35.043421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:54.405184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026860+0000","last_change":"2024-09-10T08:29:34.027671+0000","last_active":"2024-09-10T08:29:35.026860+0000","last_peered":"2024-09-10T08:29:35.026860+0000","last_clean":"2024-09-10T08:29:35.026860+0000","last_became_active":"2024-09-10T08:29:34.027289+0000","last_became_peered":"2024-09-10T08:29:34.027289+0000","last_unstale":"2024-09-10T08:29:35.026860+0000","last_undegraded":"2024-09-10T08:29:35.026860+0000","last_fullsized":"2024-09-10T08:29:35.026860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:24.640818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026213+0000","last_change":"2024-09-10T08:29:33.020211+0000","last_active":"2024-09-10T08:29:35.026213+0000","last_peered":"2024-09-10T08:29:35.026213+0000","last_clean":"2024-09-10T08:29:35.026213+0000","last_became_active":"2024-09-10T08:29:33.019698+0000","last_became_peered":"2024-09-10T08:29:33.019698+0000","last_unstale":"2024-09-10T08:29:35.026213+0000","last_undegraded":"2024-09-10T08:29:35.026213+0000","last_fullsized":"2024-09-10T08:29:35.026213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:31.545431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.028035+0000","last_change":"2024-09-10T08:29:34.031164+0000","last_active":"2024-09-10T08:29:35.028035+0000","last_peered":"2024-09-10T08:29:35.028035+0000","last_clean":"2024-09-10T08:29:35.028035+0000","last_became_active":"2024-09-10T08:29:34.030791+0000","last_became_peered":"2024-09-10T08:29:34.030791+0000","last_unstale":"2024-09-10T08:29:35.028035+0000","last_undegraded":"2024-09-10T08:29:35.028035+0000","last_fullsized":"2024-09-10T08:29:35.028035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:51:59.690975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.041097+0000","last_change":"2024-09-10T08:29:33.025504+0000","last_active":"2024-09-10T08:29:35.041097+0000","last_peered":"2024-09-10T08:29:35.041097+0000","last_clean":"2024-09-10T08:29:35.041097+0000","last_became_active":"2024-09-10T08:29:33.025250+0000","last_became_peered":"2024-09-10T08:29:33.025250+0000","last_unstale":"2024-09-10T08:29:35.041097+0000","last_undegraded":"2024-09-10T08:29:35.041097+0000","last_fullsized":"2024-09-10T08:29:35.041097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:03.539961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027890+0000","last_change":"2024-09-10T08:29:34.035478+0000","last_active":"2024-09-10T08:29:35.027890+0000","last_peered":"2024-09-10T08:29:35.027890+0000","last_clean":"2024-09-10T08:29:35.027890+0000","last_became_active":"2024-09-10T08:29:34.035094+0000","last_became_peered":"2024-09-10T08:29:34.035094+0000","last_unstale":"2024-09-10T08:29:35.027890+0000","last_undegraded":"2024-09-10T08:29:35.027890+0000","last_fullsized":"2024-09-10T08:29:35.027890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:27.365540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040909+0000","last_change":"2024-09-10T08:29:33.022012+0000","last_active":"2024-09-10T08:29:35.040909+0000","last_peered":"2024-09-10T08:29:35.040909+0000","last_clean":"2024-09-10T08:29:35.040909+0000","last_became_active":"2024-09-10T08:29:33.021732+0000","last_became_peered":"2024-09-10T08:29:33.021732+0000","last_unstale":"2024-09-10T08:29:35.040909+0000","last_undegraded":"2024-09-10T08:29:35.040909+0000","last_fullsized":"2024-09-10T08:29:35.040909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:14.720438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027429+0000","last_change":"2024-09-10T08:29:34.027098+0000","last_active":"2024-09-10T08:29:35.027429+0000","last_peered":"2024-09-10T08:29:35.027429+0000","last_clean":"2024-09-10T08:29:35.027429+0000","last_became_active":"2024-09-10T08:29:34.026819+0000","last_became_peered":"2024-09-10T08:29:34.026819+0000","last_unstale":"2024-09-10T08:29:35.027429+0000","last_undegraded":"2024-09-10T08:29:35.027429+0000","last_fullsized":"2024-09-10T08:29:35.027429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:43.970606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027877+0000","last_change":"2024-09-10T08:29:33.024226+0000","last_active":"2024-09-10T08:29:35.027877+0000","last_peered":"2024-09-10T08:29:35.027877+0000","last_clean":"2024-09-10T08:29:35.027877+0000","last_became_active":"2024-09-10T08:29:33.023927+0000","last_became_peered":"2024-09-10T08:29:33.023927+0000","last_unstale":"2024-09-10T08:29:35.027877+0000","last_undegraded":"2024-09-10T08:29:35.027877+0000","last_fullsized":"2024-09-10T08:29:35.027877+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.814661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027647+0000","last_change":"2024-09-10T08:29:34.028666+0000","last_active":"2024-09-10T08:29:35.027647+0000","last_peered":"2024-09-10T08:29:35.027647+0000","last_clean":"2024-09-10T08:29:35.027647+0000","last_became_active":"2024-09-10T08:29:34.023390+0000","last_became_peered":"2024-09-10T08:29:34.023390+0000","last_unstale":"2024-09-10T08:29:35.027647+0000","last_undegraded":"2024-09-10T08:29:35.027647+0000","last_fullsized":"2024-09-10T08:29:35.027647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:14.618503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351871+0000","last_change":"2024-09-10T08:29:33.024849+0000","last_active":"2024-09-10T08:29:35.351871+0000","last_peered":"2024-09-10T08:29:35.351871+0000","last_clean":"2024-09-10T08:29:35.351871+0000","last_became_active":"2024-09-10T08:29:33.024498+0000","last_became_peered":"2024-09-10T08:29:33.024498+0000","last_unstale":"2024-09-10T08:29:35.351871+0000","last_undegraded":"2024-09-10T08:29:35.351871+0000","last_fullsized":"2024-09-10T08:29:35.351871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:30.782411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351394+0000","last_change":"2024-09-10T08:29:34.043288+0000","last_active":"2024-09-10T08:29:35.351394+0000","last_peered":"2024-09-10T08:29:35.351394+0000","last_clean":"2024-09-10T08:29:35.351394+0000","last_became_active":"2024-09-10T08:29:34.042465+0000","last_became_peered":"2024-09-10T08:29:34.042465+0000","last_unstale":"2024-09-10T08:29:35.351394+0000","last_undegraded":"2024-09-10T08:29:35.351394+0000","last_fullsized":"2024-09-10T08:29:35.351394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:05:26.050772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026420+0000","last_change":"2024-09-10T08:29:33.028081+0000","last_active":"2024-09-10T08:29:35.026420+0000","last_peered":"2024-09-10T08:29:35.026420+0000","last_clean":"2024-09-10T08:29:35.026420+0000","last_became_active":"2024-09-10T08:29:33.027897+0000","last_became_peered":"2024-09-10T08:29:33.027897+0000","last_unstale":"2024-09-10T08:29:35.026420+0000","last_undegraded":"2024-09-10T08:29:35.026420+0000","last_fullsized":"2024-09-10T08:29:35.026420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:34.318695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027329+0000","last_change":"2024-09-10T08:29:34.045109+0000","last_active":"2024-09-10T08:29:35.027329+0000","last_peered":"2024-09-10T08:29:35.027329+0000","last_clean":"2024-09-10T08:29:35.027329+0000","last_became_active":"2024-09-10T08:29:34.043753+0000","last_became_peered":"2024-09-10T08:29:34.043753+0000","last_unstale":"2024-09-10T08:29:35.027329+0000","last_undegraded":"2024-09-10T08:29:35.027329+0000","last_fullsized":"2024-09-10T08:29:35.027329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:25.001331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027262+0000","last_change":"2024-09-10T08:29:33.024567+0000","last_active":"2024-09-10T08:29:35.027262+0000","last_peered":"2024-09-10T08:29:35.027262+0000","last_clean":"2024-09-10T08:29:35.027262+0000","last_became_active":"2024-09-10T08:29:33.024300+0000","last_became_peered":"2024-09-10T08:29:33.024300+0000","last_unstale":"2024-09-10T08:29:35.027262+0000","last_undegraded":"2024-09-10T08:29:35.027262+0000","last_fullsized":"2024-09-10T08:29:35.027262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:35.895300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026130+0000","last_change":"2024-09-10T08:29:34.029898+0000","last_active":"2024-09-10T08:29:35.026130+0000","last_peered":"2024-09-10T08:29:35.026130+0000","last_clean":"2024-09-10T08:29:35.026130+0000","last_became_active":"2024-09-10T08:29:34.025811+0000","last_became_peered":"2024-09-10T08:29:34.025811+0000","last_unstale":"2024-09-10T08:29:35.026130+0000","last_undegraded":"2024-09-10T08:29:35.026130+0000","last_fullsized":"2024-09-10T08:29:35.026130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:48.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026796+0000","last_change":"2024-09-10T08:29:33.027465+0000","last_active":"2024-09-10T08:29:35.026796+0000","last_peered":"2024-09-10T08:29:35.026796+0000","last_clean":"2024-09-10T08:29:35.026796+0000","last_became_active":"2024-09-10T08:29:33.027180+0000","last_became_peered":"2024-09-10T08:29:33.027180+0000","last_unstale":"2024-09-10T08:29:35.026796+0000","last_undegraded":"2024-09-10T08:29:35.026796+0000","last_fullsized":"2024-09-10T08:29:35.026796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:21.360437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027217+0000","last_change":"2024-09-10T08:29:34.030798+0000","last_active":"2024-09-10T08:29:35.027217+0000","last_peered":"2024-09-10T08:29:35.027217+0000","last_clean":"2024-09-10T08:29:35.027217+0000","last_became_active":"2024-09-10T08:29:34.030429+0000","last_became_peered":"2024-09-10T08:29:34.030429+0000","last_unstale":"2024-09-10T08:29:35.027217+0000","last_undegraded":"2024-09-10T08:29:35.027217+0000","last_fullsized":"2024-09-10T08:29:35.027217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:36.937048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043283+0000","last_change":"2024-09-10T08:29:33.026315+0000","last_active":"2024-09-10T08:29:35.043283+0000","last_peered":"2024-09-10T08:29:35.043283+0000","last_clean":"2024-09-10T08:29:35.043283+0000","last_became_active":"2024-09-10T08:29:33.025999+0000","last_became_peered":"2024-09-10T08:29:33.025999+0000","last_unstale":"2024-09-10T08:29:35.043283+0000","last_undegraded":"2024-09-10T08:29:35.043283+0000","last_fullsized":"2024-09-10T08:29:35.043283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:32:06.106789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.028127+0000","last_change":"2024-09-10T08:29:34.038925+0000","last_active":"2024-09-10T08:29:35.028127+0000","last_peered":"2024-09-10T08:29:35.028127+0000","last_clean":"2024-09-10T08:29:35.028127+0000","last_became_active":"2024-09-10T08:29:34.038615+0000","last_became_peered":"2024-09-10T08:29:34.038615+0000","last_unstale":"2024-09-10T08:29:35.028127+0000","last_undegraded":"2024-09-10T08:29:35.028127+0000","last_fullsized":"2024-09-10T08:29:35.028127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:18.395183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043839+0000","last_change":"2024-09-10T08:29:33.021747+0000","last_active":"2024-09-10T08:29:35.043839+0000","last_peered":"2024-09-10T08:29:35.043839+0000","last_clean":"2024-09-10T08:29:35.043839+0000","last_became_active":"2024-09-10T08:29:33.021377+0000","last_became_peered":"2024-09-10T08:29:33.021377+0000","last_unstale":"2024-09-10T08:29:35.043839+0000","last_undegraded":"2024-09-10T08:29:35.043839+0000","last_fullsized":"2024-09-10T08:29:35.043839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:48.504875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351849+0000","last_change":"2024-09-10T08:29:34.044290+0000","last_active":"2024-09-10T08:29:35.351849+0000","last_peered":"2024-09-10T08:29:35.351849+0000","last_clean":"2024-09-10T08:29:35.351849+0000","last_became_active":"2024-09-10T08:29:34.043797+0000","last_became_peered":"2024-09-10T08:29:34.043797+0000","last_unstale":"2024-09-10T08:29:35.351849+0000","last_undegraded":"2024-09-10T08:29:35.351849+0000","last_fullsized":"2024-09-10T08:29:35.351849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.606970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026425+0000","last_change":"2024-09-10T08:29:33.020918+0000","last_active":"2024-09-10T08:29:35.026425+0000","last_peered":"2024-09-10T08:29:35.026425+0000","last_clean":"2024-09-10T08:29:35.026425+0000","last_became_active":"2024-09-10T08:29:33.020658+0000","last_became_peered":"2024-09-10T08:29:33.020658+0000","last_unstale":"2024-09-10T08:29:35.026425+0000","last_undegraded":"2024-09-10T08:29:35.026425+0000","last_fullsized":"2024-09-10T08:29:35.026425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040749+0000","last_change":"2024-09-10T08:29:34.031282+0000","last_active":"2024-09-10T08:29:35.040749+0000","last_peered":"2024-09-10T08:29:35.040749+0000","last_clean":"2024-09-10T08:29:35.040749+0000","last_became_active":"2024-09-10T08:29:34.029114+0000","last_became_peered":"2024-09-10T08:29:34.029114+0000","last_unstale":"2024-09-10T08:29:35.040749+0000","last_undegraded":"2024-09-10T08:29:35.040749+0000","last_fullsized":"2024-09-10T08:29:35.040749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:54.579482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027826+0000","last_change":"2024-09-10T08:29:33.026324+0000","last_active":"2024-09-10T08:29:35.027826+0000","last_peered":"2024-09-10T08:29:35.027826+0000","last_clean":"2024-09-10T08:29:35.027826+0000","last_became_active":"2024-09-10T08:29:33.025862+0000","last_became_peered":"2024-09-10T08:29:33.025862+0000","last_unstale":"2024-09-10T08:29:35.027826+0000","last_undegraded":"2024-09-10T08:29:35.027826+0000","last_fullsized":"2024-09-10T08:29:35.027826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:23.996817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043599+0000","last_change":"2024-09-10T08:29:34.043523+0000","last_active":"2024-09-10T08:29:35.043599+0000","last_peered":"2024-09-10T08:29:35.043599+0000","last_clean":"2024-09-10T08:29:35.043599+0000","last_became_active":"2024-09-10T08:29:34.043197+0000","last_became_peered":"2024-09-10T08:29:34.043197+0000","last_unstale":"2024-09-10T08:29:35.043599+0000","last_undegraded":"2024-09-10T08:29:35.043599+0000","last_fullsized":"2024-09-10T08:29:35.043599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:32.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351117+0000","last_change":"2024-09-10T08:29:33.023460+0000","last_active":"2024-09-10T08:29:35.351117+0000","last_peered":"2024-09-10T08:29:35.351117+0000","last_clean":"2024-09-10T08:29:35.351117+0000","last_became_active":"2024-09-10T08:29:33.023170+0000","last_became_peered":"2024-09-10T08:29:33.023170+0000","last_unstale":"2024-09-10T08:29:35.351117+0000","last_undegraded":"2024-09-10T08:29:35.351117+0000","last_fullsized":"2024-09-10T08:29:35.351117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:52.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351393+0000","last_change":"2024-09-10T08:29:34.048200+0000","last_active":"2024-09-10T08:29:35.351393+0000","last_peered":"2024-09-10T08:29:35.351393+0000","last_clean":"2024-09-10T08:29:35.351393+0000","last_became_active":"2024-09-10T08:29:34.047927+0000","last_became_peered":"2024-09-10T08:29:34.047927+0000","last_unstale":"2024-09-10T08:29:35.351393+0000","last_undegraded":"2024-09-10T08:29:35.351393+0000","last_fullsized":"2024-09-10T08:29:35.351393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:11:09.924440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040834+0000","last_change":"2024-09-10T08:29:33.027059+0000","last_active":"2024-09-10T08:29:35.040834+0000","last_peered":"2024-09-10T08:29:35.040834+0000","last_clean":"2024-09-10T08:29:35.040834+0000","last_became_active":"2024-09-10T08:29:33.026748+0000","last_became_peered":"2024-09-10T08:29:33.026748+0000","last_unstale":"2024-09-10T08:29:35.040834+0000","last_undegraded":"2024-09-10T08:29:35.040834+0000","last_fullsized":"2024-09-10T08:29:35.040834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:11.419915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.040703+0000","last_change":"2024-09-10T08:29:34.035156+0000","last_active":"2024-09-10T08:29:35.040703+0000","last_peered":"2024-09-10T08:29:35.040703+0000","last_clean":"2024-09-10T08:29:35.040703+0000","last_became_active":"2024-09-10T08:29:34.034309+0000","last_became_peered":"2024-09-10T08:29:34.034309+0000","last_unstale":"2024-09-10T08:29:35.040703+0000","last_undegraded":"2024-09-10T08:29:35.040703+0000","last_fullsized":"2024-09-10T08:29:35.040703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:13.516426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026310+0000","last_change":"2024-09-10T08:29:33.024913+0000","last_active":"2024-09-10T08:29:35.026310+0000","last_peered":"2024-09-10T08:29:35.026310+0000","last_clean":"2024-09-10T08:29:35.026310+0000","last_became_active":"2024-09-10T08:29:33.023124+0000","last_became_peered":"2024-09-10T08:29:33.023124+0000","last_unstale":"2024-09-10T08:29:35.026310+0000","last_undegraded":"2024-09-10T08:29:35.026310+0000","last_fullsized":"2024-09-10T08:29:35.026310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351373+0000","last_change":"2024-09-10T08:29:34.039167+0000","last_active":"2024-09-10T08:29:35.351373+0000","last_peered":"2024-09-10T08:29:35.351373+0000","last_clean":"2024-09-10T08:29:35.351373+0000","last_became_active":"2024-09-10T08:29:34.037065+0000","last_became_peered":"2024-09-10T08:29:34.037065+0000","last_unstale":"2024-09-10T08:29:35.351373+0000","last_undegraded":"2024-09-10T08:29:35.351373+0000","last_fullsized":"2024-09-10T08:29:35.351373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.435957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351446+0000","last_change":"2024-09-10T08:29:33.033458+0000","last_active":"2024-09-10T08:29:35.351446+0000","last_peered":"2024-09-10T08:29:35.351446+0000","last_clean":"2024-09-10T08:29:35.351446+0000","last_became_active":"2024-09-10T08:29:33.033161+0000","last_became_peered":"2024-09-10T08:29:33.033161+0000","last_unstale":"2024-09-10T08:29:35.351446+0000","last_undegraded":"2024-09-10T08:29:35.351446+0000","last_fullsized":"2024-09-10T08:29:35.351446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:40.792079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351445+0000","last_change":"2024-09-10T08:29:34.047377+0000","last_active":"2024-09-10T08:29:35.351445+0000","last_peered":"2024-09-10T08:29:35.351445+0000","last_clean":"2024-09-10T08:29:35.351445+0000","last_became_active":"2024-09-10T08:29:34.047055+0000","last_became_peered":"2024-09-10T08:29:34.047055+0000","last_unstale":"2024-09-10T08:29:35.351445+0000","last_undegraded":"2024-09-10T08:29:35.351445+0000","last_fullsized":"2024-09-10T08:29:35.351445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:31.786925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027174+0000","last_change":"2024-09-10T08:29:33.025805+0000","last_active":"2024-09-10T08:29:35.027174+0000","last_peered":"2024-09-10T08:29:35.027174+0000","last_clean":"2024-09-10T08:29:35.027174+0000","last_became_active":"2024-09-10T08:29:33.024658+0000","last_became_peered":"2024-09-10T08:29:33.024658+0000","last_unstale":"2024-09-10T08:29:35.027174+0000","last_undegraded":"2024-09-10T08:29:35.027174+0000","last_fullsized":"2024-09-10T08:29:35.027174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:23.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043803+0000","last_change":"2024-09-10T08:29:34.043724+0000","last_active":"2024-09-10T08:29:35.043803+0000","last_peered":"2024-09-10T08:29:35.043803+0000","last_clean":"2024-09-10T08:29:35.043803+0000","last_became_active":"2024-09-10T08:29:34.043471+0000","last_became_peered":"2024-09-10T08:29:34.043471+0000","last_unstale":"2024-09-10T08:29:35.043803+0000","last_undegraded":"2024-09-10T08:29:35.043803+0000","last_fullsized":"2024-09-10T08:29:35.043803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:22.364950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351821+0000","last_change":"2024-09-10T08:29:33.028935+0000","last_active":"2024-09-10T08:29:35.351821+0000","last_peered":"2024-09-10T08:29:35.351821+0000","last_clean":"2024-09-10T08:29:35.351821+0000","last_became_active":"2024-09-10T08:29:33.028629+0000","last_became_peered":"2024-09-10T08:29:33.028629+0000","last_unstale":"2024-09-10T08:29:35.351821+0000","last_undegraded":"2024-09-10T08:29:35.351821+0000","last_fullsized":"2024-09-10T08:29:35.351821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:32.014343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027694+0000","last_change":"2024-09-10T08:29:34.028422+0000","last_active":"2024-09-10T08:29:35.027694+0000","last_peered":"2024-09-10T08:29:35.027694+0000","last_clean":"2024-09-10T08:29:35.027694+0000","last_became_active":"2024-09-10T08:29:34.028152+0000","last_became_peered":"2024-09-10T08:29:34.028152+0000","last_unstale":"2024-09-10T08:29:35.027694+0000","last_undegraded":"2024-09-10T08:29:35.027694+0000","last_fullsized":"2024-09-10T08:29:35.027694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:21.167802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.041015+0000","last_change":"2024-09-10T08:29:33.024021+0000","last_active":"2024-09-10T08:29:35.041015+0000","last_peered":"2024-09-10T08:29:35.041015+0000","last_clean":"2024-09-10T08:29:35.041015+0000","last_became_active":"2024-09-10T08:29:33.023084+0000","last_became_peered":"2024-09-10T08:29:33.023084+0000","last_unstale":"2024-09-10T08:29:35.041015+0000","last_undegraded":"2024-09-10T08:29:35.041015+0000","last_fullsized":"2024-09-10T08:29:35.041015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:29.403561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.043746+0000","last_change":"2024-09-10T08:29:34.037052+0000","last_active":"2024-09-10T08:29:35.043746+0000","last_peered":"2024-09-10T08:29:35.043746+0000","last_clean":"2024-09-10T08:29:35.043746+0000","last_became_active":"2024-09-10T08:29:34.036602+0000","last_became_peered":"2024-09-10T08:29:34.036602+0000","last_unstale":"2024-09-10T08:29:35.043746+0000","last_undegraded":"2024-09-10T08:29:35.043746+0000","last_fullsized":"2024-09-10T08:29:35.043746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:38.662757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351949+0000","last_change":"2024-09-10T08:29:33.024043+0000","last_active":"2024-09-10T08:29:35.351949+0000","last_peered":"2024-09-10T08:29:35.351949+0000","last_clean":"2024-09-10T08:29:35.351949+0000","last_became_active":"2024-09-10T08:29:33.023735+0000","last_became_peered":"2024-09-10T08:29:33.023735+0000","last_unstale":"2024-09-10T08:29:35.351949+0000","last_undegraded":"2024-09-10T08:29:35.351949+0000","last_fullsized":"2024-09-10T08:29:35.351949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351340+0000","last_change":"2024-09-10T08:29:34.044817+0000","last_active":"2024-09-10T08:29:35.351340+0000","last_peered":"2024-09-10T08:29:35.351340+0000","last_clean":"2024-09-10T08:29:35.351340+0000","last_became_active":"2024-09-10T08:29:34.044489+0000","last_became_peered":"2024-09-10T08:29:34.044489+0000","last_unstale":"2024-09-10T08:29:35.351340+0000","last_undegraded":"2024-09-10T08:29:35.351340+0000","last_fullsized":"2024-09-10T08:29:35.351340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:22.225232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351702+0000","last_change":"2024-09-10T08:29:33.030176+0000","last_active":"2024-09-10T08:29:35.351702+0000","last_peered":"2024-09-10T08:29:35.351702+0000","last_clean":"2024-09-10T08:29:35.351702+0000","last_became_active":"2024-09-10T08:29:33.028687+0000","last_became_peered":"2024-09-10T08:29:33.028687+0000","last_unstale":"2024-09-10T08:29:35.351702+0000","last_undegraded":"2024-09-10T08:29:35.351702+0000","last_fullsized":"2024-09-10T08:29:35.351702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:19.270366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027481+0000","last_change":"2024-09-10T08:29:34.031146+0000","last_active":"2024-09-10T08:29:35.027481+0000","last_peered":"2024-09-10T08:29:35.027481+0000","last_clean":"2024-09-10T08:29:35.027481+0000","last_became_active":"2024-09-10T08:29:34.030853+0000","last_became_peered":"2024-09-10T08:29:34.030853+0000","last_unstale":"2024-09-10T08:29:35.027481+0000","last_undegraded":"2024-09-10T08:29:35.027481+0000","last_fullsized":"2024-09-10T08:29:35.027481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:55.420525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351529+0000","last_change":"2024-09-10T08:29:33.028878+0000","last_active":"2024-09-10T08:29:35.351529+0000","last_peered":"2024-09-10T08:29:35.351529+0000","last_clean":"2024-09-10T08:29:35.351529+0000","last_became_active":"2024-09-10T08:29:33.028575+0000","last_became_peered":"2024-09-10T08:29:33.028575+0000","last_unstale":"2024-09-10T08:29:35.351529+0000","last_undegraded":"2024-09-10T08:29:35.351529+0000","last_fullsized":"2024-09-10T08:29:35.351529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:02.410203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026966+0000","last_change":"2024-09-10T08:29:34.022980+0000","last_active":"2024-09-10T08:29:35.026966+0000","last_peered":"2024-09-10T08:29:35.026966+0000","last_clean":"2024-09-10T08:29:35.026966+0000","last_became_active":"2024-09-10T08:29:34.022678+0000","last_became_peered":"2024-09-10T08:29:34.022678+0000","last_unstale":"2024-09-10T08:29:35.026966+0000","last_undegraded":"2024-09-10T08:29:35.026966+0000","last_fullsized":"2024-09-10T08:29:35.026966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:21.412668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026087+0000","last_change":"2024-09-10T08:29:33.027084+0000","last_active":"2024-09-10T08:29:35.026087+0000","last_peered":"2024-09-10T08:29:35.026087+0000","last_clean":"2024-09-10T08:29:35.026087+0000","last_became_active":"2024-09-10T08:29:33.026802+0000","last_became_peered":"2024-09-10T08:29:33.026802+0000","last_unstale":"2024-09-10T08:29:35.026087+0000","last_undegraded":"2024-09-10T08:29:35.026087+0000","last_fullsized":"2024-09-10T08:29:35.026087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:52.258016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027271+0000","last_change":"2024-09-10T08:29:34.030886+0000","last_active":"2024-09-10T08:29:35.027271+0000","last_peered":"2024-09-10T08:29:35.027271+0000","last_clean":"2024-09-10T08:29:35.027271+0000","last_became_active":"2024-09-10T08:29:34.030659+0000","last_became_peered":"2024-09-10T08:29:34.030659+0000","last_unstale":"2024-09-10T08:29:35.027271+0000","last_undegraded":"2024-09-10T08:29:35.027271+0000","last_fullsized":"2024-09-10T08:29:35.027271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:35.727347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.026965+0000","last_change":"2024-09-10T08:29:33.029745+0000","last_active":"2024-09-10T08:29:35.026965+0000","last_peered":"2024-09-10T08:29:35.026965+0000","last_clean":"2024-09-10T08:29:35.026965+0000","last_became_active":"2024-09-10T08:29:33.029417+0000","last_became_peered":"2024-09-10T08:29:33.029417+0000","last_unstale":"2024-09-10T08:29:35.026965+0000","last_undegraded":"2024-09-10T08:29:35.026965+0000","last_fullsized":"2024-09-10T08:29:35.026965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:03.473771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351026+0000","last_change":"2024-09-10T08:29:34.046471+0000","last_active":"2024-09-10T08:29:35.351026+0000","last_peered":"2024-09-10T08:29:35.351026+0000","last_clean":"2024-09-10T08:29:35.351026+0000","last_became_active":"2024-09-10T08:29:34.046117+0000","last_became_peered":"2024-09-10T08:29:34.046117+0000","last_unstale":"2024-09-10T08:29:35.351026+0000","last_undegraded":"2024-09-10T08:29:35.351026+0000","last_fullsized":"2024-09-10T08:29:35.351026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:32.995521+0000","last_clean_scrub_stamp":"2024-09-10T08:29:32.995521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:56.097751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.027922+0000","last_change":"2024-09-10T08:29:33.026103+0000","last_active":"2024-09-10T08:29:35.027922+0000","last_peered":"2024-09-10T08:29:35.027922+0000","last_clean":"2024-09-10T08:29:35.027922+0000","last_became_active":"2024-09-10T08:29:33.025539+0000","last_became_peered":"2024-09-10T08:29:33.025539+0000","last_unstale":"2024-09-10T08:29:35.027922+0000","last_undegraded":"2024-09-10T08:29:35.027922+0000","last_fullsized":"2024-09-10T08:29:35.027922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:29:31.991008+0000","last_clean_scrub_stamp":"2024-09-10T08:29:31.991008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:42.966093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-10T08:29:35.351334+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:29:35.351334+0000","last_peered":"2024-09-10T08:29:35.351334+0000","last_clean":"2024-09-10T08:29:35.351334+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:29:35.351334+0000","last_undegraded":"2024-09-10T08:29:35.351334+0000","last_fullsized":"2024-09-10T08:29:35.351334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":376832,"data_stored":141179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":141201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":380928,"data_stored":140343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":368640,"data_stored":139601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":730005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":368640,"data_stored":139657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":730517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:29:43.347 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:29:43.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:29:43.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.548+0000 7fe918800640 1 Processor -- start 2024-09-10T08:29:43.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.548+0000 7fe918800640 1 -- start start 2024-09-10T08:29:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.549+0000 7fe918800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe91015e900 0x7fe9100d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.549+0000 7fe918800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe91006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.549+0000 7fe918800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100b7940 con 0x7fe91006dce0 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.549+0000 7fe918800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe91015ece0 con 0x7fe91015e900 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.549+0000 7fe918800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100b7f30 con 0x7fe9100cfca0 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe916800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe91006dce0 0x7fe91006bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39360/0 (socket says 172.21.15.52:39360) 2024-09-10T08:29:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe916800640 1 -- 172.21.15.52:0/978487021 learned_addr learned my addr 172.21.15.52:0/978487021 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe915e00640 1 --2- 172.21.15.52:0/978487021 >> v2:172.21.15.176:3300/0 conn(0x7fe91015e900 0x7fe9100d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe915400640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe91006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150261020 0 0) 0x7fe90c001490 con 0x7fe91006dce0 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f8003520 con 0x7fe91006dce0 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2449173353 0 0) 0x7fe8f8003520 con 0x7fe91006dce0 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 msgr2=0x7fe91006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe91006d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 >> v2:172.21.15.176:3300/0 conn(0x7fe91015e900 msgr2=0x7fe9100d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 --2- 172.21.15.52:0/978487021 >> v2:172.21.15.176:3300/0 conn(0x7fe91015e900 0x7fe9100d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100d3f90 con 0x7fe91006dce0 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fe90c001bc0 con 0x7fe91006dce0 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 >> v1:172.21.15.52:6789/0 conn(0x7fe91006dce0 legacy=0x7fe91006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe8f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8f8003f30 0x7fe8f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8f8004d40 0x7fe8f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100b7f30 con 0x7fe8f8003f30 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f800b9c0 con 0x7fe8f8004d40 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.550+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f800bb40 con 0x7fe9100cfca0 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8f8003f30 0x7fe8f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915e00640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe8f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe916800640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8f8004d40 0x7fe8f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 -- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 msgr2=0x7fe8f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe9100cfca0 0x7fe8f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 -- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8f8004d40 msgr2=0x7fe8f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8f8004d40 0x7fe8f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.551+0000 7fe915400640 1 -- 172.21.15.52:0/978487021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f8003520 con 0x7fe8f8003f30 2024-09-10T08:29:43.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.552+0000 7fe915400640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8f8003f30 0x7fe8f8004800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe900009a90 tx=0x7fe8f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c69a5d9a6699259 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.552+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900036070 con 0x7fe8f8003f30 2024-09-10T08:29:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.552+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe900031400 con 0x7fe8f8003f30 2024-09-10T08:29:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.552+0000 7fe914a00640 1 -- 172.21.15.52:0/978487021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900009690 con 0x7fe8f8003f30 2024-09-10T08:29:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 -- 172.21.15.52:0/978487021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8f8003f30 msgr2=0x7fe8f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 --2- 172.21.15.52:0/978487021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8f8003f30 0x7fe8f8004800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe900009a90 tx=0x7fe8f8005830 comp rx=0 tx=0).stop 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe916800640 1 -- 172.21.15.52:0/978487021 reap_dead start 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 -- 172.21.15.52:0/978487021 shutdown_connections 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 -- 172.21.15.52:0/978487021 >> 172.21.15.52:0/978487021 conn(0x7fe9100d47a0 msgr2=0x7fe9100d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 -- 172.21.15.52:0/978487021 shutdown_connections 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.553+0000 7fe918800640 1 -- 172.21.15.52:0/978487021 wait complete. 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.555+0000 7fe918800640 1 Processor -- start 2024-09-10T08:29:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.555+0000 7fe918800640 1 -- start start 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8f8003f30 0x7fe910161720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe910160ae0 0x7fe9100ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d3ba0 con 0x7fe910155850 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100b7bc0 con 0x7fe910160ae0 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe918800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100d3d20 con 0x7fe8f8003f30 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe915400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe915400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59584/0 (socket says 172.21.15.52:59584) 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe915400640 1 -- 172.21.15.52:0/4221771055 learned_addr learned my addr 172.21.15.52:0/4221771055 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe915e00640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8f8003f30 0x7fe910161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.556+0000 7fe916800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe910160ae0 0x7fe9100ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 -- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8f8003f30 msgr2=0x7fe910161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8f8003f30 0x7fe910161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 -- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe910160ae0 msgr2=0x7fe9100ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe910160ae0 0x7fe9100ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 -- 172.21.15.52:0/4221771055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9101f4150 con 0x7fe910155850 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe915400640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe90002ab50 tx=0x7fe900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900041030 con 0x7fe910155850 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90000f000 con 0x7fe910155850 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900036040 con 0x7fe910155850 2024-09-10T08:29:43.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9101f43f0 con 0x7fe910155850 2024-09-10T08:29:43.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.557+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9101f49b0 con 0x7fe910155850 2024-09-10T08:29:43.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.558+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100d3660 con 0x7fe910155850 2024-09-10T08:29:43.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.559+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe900044070 con 0x7fe910155850 2024-09-10T08:29:43.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.560+0000 7fe90a000640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 0x7fe8f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.560+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe9000aaa40 con 0x7fe910155850 2024-09-10T08:29:43.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.561+0000 7fe915e00640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 0x7fe8f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.561+0000 7fe915e00640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 0x7fe8f406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe904009c40 tx=0x7fe904009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.564+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe900078ee0 con 0x7fe910155850 2024-09-10T08:29:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.819+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe910069b20 con 0x7fe910155850 2024-09-10T08:29:43.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.821+0000 7fe90a000640 1 -- 172.21.15.52:0/4221771055 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fe90007d1e0 con 0x7fe910155850 2024-09-10T08:29:43.821 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:29:43.822 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:29:43.822 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:29:43.822 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:29:43.822 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:29:43.822 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:29:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 msgr2=0x7fe8f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 0x7fe8f406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe904009c40 tx=0x7fe904009190 comp rx=0 tx=0).stop 2024-09-10T08:29:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 msgr2=0x7fe910160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe90002ab50 tx=0x7fe900004730 comp rx=0 tx=0).stop 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 shutdown_connections 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8f406be30 0x7fe8f406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe910160ae0 0x7fe9100ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe910155850 0x7fe910160150 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 --2- 172.21.15.52:0/4221771055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8f8003f30 0x7fe910161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 >> 172.21.15.52:0/4221771055 conn(0x7fe9100d47a0 msgr2=0x7fe9100b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 shutdown_connections 2024-09-10T08:29:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.824+0000 7fe918800640 1 -- 172.21.15.52:0/4221771055 wait complete. 2024-09-10T08:29:43.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:29:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.995+0000 7f4951600640 1 Processor -- start 2024-09-10T08:29:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.995+0000 7f4951600640 1 -- start start 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4951600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f494c1522d0 0x7f494c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4951600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f494c0b60e0 0x7f494c15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4951600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c0b6660 con 0x7f494c15f400 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4951600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f494c15ca90 con 0x7f494c1522d0 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4951600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f494c15f830 con 0x7f494c0b60e0 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f494be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f494c1522d0 0x7f494c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4950c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f494c15f400 0x7f494c15b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39362/0 (socket says 172.21.15.52:39362) 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.996+0000 7f4950c00640 1 -- 172.21.15.52:0/347363248 learned_addr learned my addr 172.21.15.52:0/347363248 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f4943e00640 1 --2- 172.21.15.52:0/347363248 >> v2:172.21.15.176:3300/0 conn(0x7f494c0b60e0 0x7f494c15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f494be00640 1 -- 172.21.15.52:0/347363248 >> v2:172.21.15.176:3300/0 conn(0x7f494c0b60e0 msgr2=0x7f494c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f494be00640 1 --2- 172.21.15.52:0/347363248 >> v2:172.21.15.176:3300/0 conn(0x7f494c0b60e0 0x7f494c15eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f494be00640 1 -- 172.21.15.52:0/347363248 >> v1:172.21.15.52:6789/0 conn(0x7f494c15f400 legacy=0x7f494c15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f494be00640 1 -- 172.21.15.52:0/347363248 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c15cce0 con 0x7f494c1522d0 2024-09-10T08:29:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.997+0000 7f494b400640 1 -- 172.21.15.52:0/347363248 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504475086 0 0) 0x7f494c0b6660 con 0x7f494c15f400 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.998+0000 7f494be00640 1 --2- 172.21.15.52:0/347363248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c1522d0 0x7f494c0b5ba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f494c15ca00 tx=0x7f493c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af95aa8657ad8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.998+0000 7f494b400640 1 -- 172.21.15.52:0/347363248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c037070 con 0x7f494c1522d0 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.998+0000 7f494b400640 1 -- 172.21.15.52:0/347363248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c032440 con 0x7f494c1522d0 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.998+0000 7f494b400640 1 -- 172.21.15.52:0/347363248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c032810 con 0x7f494c1522d0 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 -- 172.21.15.52:0/347363248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c1522d0 msgr2=0x7f494c0b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 --2- 172.21.15.52:0/347363248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c1522d0 0x7f494c0b5ba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f494c15ca00 tx=0x7f493c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 -- 172.21.15.52:0/347363248 shutdown_connections 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 --2- 172.21.15.52:0/347363248 >> v2:172.21.15.176:3300/0 conn(0x7f494c0b60e0 0x7f494c15eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 --2- 172.21.15.52:0/347363248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c1522d0 0x7f494c0b5ba0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 -- 172.21.15.52:0/347363248 >> 172.21.15.52:0/347363248 conn(0x7f494c06c240 msgr2=0x7f494c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 -- 172.21.15.52:0/347363248 shutdown_connections 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:43.999+0000 7f4951600640 1 -- 172.21.15.52:0/347363248 wait complete. 2024-09-10T08:29:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.000+0000 7f4951600640 1 Processor -- start 2024-09-10T08:29:44.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 -- start start 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c1522d0 0x7f494c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c15f400 0x7f494c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f494c15fc80 con 0x7f494c0b60e0 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f494c15d2a0 con 0x7f494c1522d0 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.001+0000 7f4951600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f494c1526b0 con 0x7f494c15f400 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59606/0 (socket says 172.21.15.52:59606) 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 -- 172.21.15.52:0/2888964056 learned_addr learned my addr 172.21.15.52:0/2888964056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f4943e00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c1522d0 0x7f494c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f4950c00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c15f400 0x7f494c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 -- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c15f400 msgr2=0x7f494c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c15f400 0x7f494c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 -- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c1522d0 msgr2=0x7f494c1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c1522d0 0x7f494c1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 -- 172.21.15.52:0/2888964056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c141ef0 con 0x7f494c0b60e0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.002+0000 7f494be00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f493c000c00 tx=0x7f493c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.003+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c037050 con 0x7f494c0b60e0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.003+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c038040 con 0x7f494c0b60e0 2024-09-10T08:29:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.003+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c004470 con 0x7f494c0b60e0 2024-09-10T08:29:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.003+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c1421d0 con 0x7f494c0b60e0 2024-09-10T08:29:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.003+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c142790 con 0x7f494c0b60e0 2024-09-10T08:29:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.004+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c15eec0 con 0x7f494c0b60e0 2024-09-10T08:29:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.005+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f493c030900 con 0x7f494c0b60e0 2024-09-10T08:29:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.006+0000 7f4948c00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 0x7f492806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.006+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f493c0ab9a0 con 0x7f494c0b60e0 2024-09-10T08:29:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.006+0000 7f4943e00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 0x7f492806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.007+0000 7f4943e00640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 0x7f492806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4934006fd0 tx=0x7f4934008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.010+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f493c07a340 con 0x7f494c0b60e0 2024-09-10T08:29:44.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.229+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f494c1434c0 con 0x7f494c0b60e0 2024-09-10T08:29:44.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.230+0000 7f4948c00640 1 -- 172.21.15.52:0/2888964056 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7f493c079c40 con 0x7f494c0b60e0 2024-09-10T08:29:44.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:29:44.230 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"btime":"2024-09-10T08:29:37:030497+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:36.446188+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:29:44.231 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 17 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 msgr2=0x7f492806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 0x7f492806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4934006fd0 tx=0x7f4934008040 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 msgr2=0x7f494c13df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f493c000c00 tx=0x7f493c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 shutdown_connections 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f492806be30 0x7f492806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c15f400 0x7f494c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c1522d0 0x7f494c1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 --2- 172.21.15.52:0/2888964056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f494c0b60e0 0x7f494c13df00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 >> 172.21.15.52:0/2888964056 conn(0x7f494c06c240 msgr2=0x7f494c15d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 shutdown_connections 2024-09-10T08:29:44.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.232+0000 7f4951600640 1 -- 172.21.15.52:0/2888964056 wait complete. 2024-09-10T08:29:44.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:29:33.441490+0000', 'modified': '2024-09-10T08:29:36.446188+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4797}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4797': {'gid': 4797, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/2946930251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2946930251}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 2946930251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4797, 'qdb_cluster': [4797]} 2024-09-10T08:29:44.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:29:44.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T08:29:44.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.871+0000 7faf1d400640 1 Processor -- start 2024-09-10T08:29:44.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.871+0000 7faf1d400640 1 -- start start 2024-09-10T08:29:44.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.872+0000 7faf1d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.872+0000 7faf1d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf180cf450 0x7faf180b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.872+0000 7faf1d400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf180d3990 con 0x7faf180b6540 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.872+0000 7faf1d400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faf180b69b0 con 0x7faf180cf450 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.872+0000 7faf1d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf180d3c70 con 0x7faf1815e440 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf180cf450 0x7faf180b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf180cf450 0x7faf180b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34430/0 (socket says 172.21.15.52:34430) 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 -- 172.21.15.52:0/329030531 learned_addr learned my addr 172.21.15.52:0/329030531 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17e00640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 -- 172.21.15.52:0/329030531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 msgr2=0x7faf180d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 -- 172.21.15.52:0/329030531 >> v1:172.21.15.176:6789/0 conn(0x7faf180b6540 legacy=0x7faf1806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.873+0000 7faf17400640 1 -- 172.21.15.52:0/329030531 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf180d3f50 con 0x7faf180cf450 2024-09-10T08:29:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.874+0000 7faf17400640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b6000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500a0b08468de2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.874+0000 7faf16a00640 1 -- 172.21.15.52:0/329030531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04037070 con 0x7faf180cf450 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.874+0000 7faf16a00640 1 -- 172.21.15.52:0/329030531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0402ae50 con 0x7faf180cf450 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.874+0000 7faf16a00640 1 -- 172.21.15.52:0/329030531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04032860 con 0x7faf180cf450 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 -- 172.21.15.52:0/329030531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 msgr2=0x7faf180b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b6000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf04009870 tx=0x7faf0402a300 comp rx=0 tx=0).stop 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 -- 172.21.15.52:0/329030531 shutdown_connections 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b6000 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 --2- 172.21.15.52:0/329030531 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 -- 172.21.15.52:0/329030531 >> 172.21.15.52:0/329030531 conn(0x7faf18067f80 msgr2=0x7faf180d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 -- 172.21.15.52:0/329030531 shutdown_connections 2024-09-10T08:29:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.875+0000 7faf1d400640 1 -- 172.21.15.52:0/329030531 wait complete. 2024-09-10T08:29:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.877+0000 7faf1d400640 1 Processor -- start 2024-09-10T08:29:44.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.877+0000 7faf1d400640 1 -- start start 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 0x7faf1814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf180b7540 con 0x7faf180cf450 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf1815e820 con 0x7faf180b6540 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf180b76c0 con 0x7faf1815e440 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34442/0 (socket says 172.21.15.52:34442) 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 -- 172.21.15.52:0/212933782 learned_addr learned my addr 172.21.15.52:0/212933782 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1ca00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17e00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 0x7faf1814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 -- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 msgr2=0x7faf180b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 -- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 msgr2=0x7faf1814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 0x7faf1814e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17400640 1 -- 172.21.15.52:0/212933782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18158f20 con 0x7faf180cf450 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf1ca00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.878+0000 7faf17e00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 0x7faf1814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf17400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf0fe00640 1 -- 172.21.15.52:0/212933782 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04041020 con 0x7faf180cf450 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf0fe00640 1 -- 172.21.15.52:0/212933782 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0403c670 con 0x7faf180cf450 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf0fe00640 1 -- 172.21.15.52:0/212933782 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04037040 con 0x7faf180cf450 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf18159200 con 0x7faf180cf450 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.879+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf181597c0 con 0x7faf180cf450 2024-09-10T08:29:44.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.881+0000 7faf0fe00640 1 -- 172.21.15.52:0/212933782 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf04044020 con 0x7faf180cf450 2024-09-10T08:29:44.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.883+0000 7faf0fe00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 0x7faef806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.883+0000 7faf0fe00640 1 -- 172.21.15.52:0/212933782 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faf040ab520 con 0x7faf180cf450 2024-09-10T08:29:44.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.883+0000 7faf21811740 1 Processor -- start 2024-09-10T08:29:44.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.883+0000 7faf17e00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 0x7faef806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.883+0000 7faf21811740 1 -- start start 2024-09-10T08:29:44.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf17e00640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 0x7faef806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b9f0 tx=0x7faf08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 0x55d8db307280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8db2653b0 con 0x55d8db306ea0 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d8db26a410 con 0x55d8db308630 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.884+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d8db212620 con 0x55d8db304660 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34456/0 (socket says 172.21.15.52:34456) 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 -- 172.21.15.52:0/3638596369 learned_addr learned my addr 172.21.15.52:0/3638596369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17400640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 0x55d8db307280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf1ca00640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 -- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 msgr2=0x55d8db307280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 0x55d8db307280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 -- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 msgr2=0x55d8db301720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 -- 172.21.15.52:0/3638596369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8daf7d2d0 con 0x55d8db306ea0 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17400640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 0x55d8db307280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf1ca00640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.885+0000 7faf17e00640 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faf0800faf0 tx=0x7faf08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d784ba2f39df92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf03e00640 1 -- 172.21.15.52:0/3638596369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0801b050 con 0x55d8db306ea0 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf03e00640 1 -- 172.21.15.52:0/3638596369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08025070 con 0x55d8db306ea0 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf03e00640 1 -- 172.21.15.52:0/3638596369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08020440 con 0x55d8db306ea0 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 -- 172.21.15.52:0/3638596369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 msgr2=0x55d8db34c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faf0800faf0 tx=0x7faf08012000 comp rx=0 tx=0).stop 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 -- 172.21.15.52:0/3638596369 shutdown_connections 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db304660 0x55d8db307280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 --2- 172.21.15.52:0/3638596369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db34c640 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 -- 172.21.15.52:0/3638596369 >> 172.21.15.52:0/3638596369 conn(0x55d8db3038f0 msgr2=0x55d8db34bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.886+0000 7faf21811740 1 -- 172.21.15.52:0/3638596369 shutdown_connections 2024-09-10T08:29:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.887+0000 7faf21811740 1 -- 172.21.15.52:0/3638596369 wait complete. 2024-09-10T08:29:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.887+0000 7faf21811740 1 -- start start 2024-09-10T08:29:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.887+0000 7faf21811740 1 Processor -- start 2024-09-10T08:29:44.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db306ea0 0x55d8db325750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8db225780 con 0x55d8db302280 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d8db2663d0 con 0x55d8db308630 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d8db302d90 con 0x55d8db306ea0 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.888+0000 7faf21811740 10 client.0 _ll_register_callbacks cb 0x55d8db2635d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34472/0 (socket says 172.21.15.52:34472) 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 -- 172.21.15.52:0/3679716933 learned_addr learned my addr 172.21.15.52:0/3679716933 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf17400640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf17e00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db306ea0 0x55d8db325750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 -- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db306ea0 msgr2=0x55d8db325750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db306ea0 0x55d8db325750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 -- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 msgr2=0x55d8db301d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 -- 172.21.15.52:0/3679716933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8db0476b0 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf1ca00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faf10003eb0 tx=0x7faf10001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a750eda8caaef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.889+0000 7faf00c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf10012590 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faf10012730 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf08025070 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7faf10021050 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 10 client.4986 fetch_fsmap learned FSMap version 17 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d8db35c6c0 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf08025070 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7faf10024020 con 0x55d8db302280 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 10 client.4986 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 10 client.4986 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:29:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 20 client.4986 populate_metadata read hostname 'smithi052' 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3264f0 0x55d8db35fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 4 client.4986 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.890+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8db277b40 con 0x55d8db3264f0 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.891+0000 7faf17e00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3264f0 0x55d8db35fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.891+0000 7faf17e00640 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3264f0 0x55d8db35fa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb599b158250675 server_cookie=6df104651cecad36 in_seq=0 out_seq=0 2024-09-10T08:29:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.891+0000 7faf00c00640 10 client.4986 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:29:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf00c00640 1 -- 172.21.15.52:0/3679716933 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8db277b40 con 0x55d8db3264f0 2024-09-10T08:29:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf00c00640 10 client.4986 handle_command_reply: tid=0 2024-09-10T08:29:44.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 client.4986 shutdown 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 msgr2=0x55d8db305270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faf10003eb0 tx=0x7faf10001af0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 shutdown_connections 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3264f0 0x55d8db35fa70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db305270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db301d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 --2- 172.21.15.52:0/3679716933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db306ea0 0x55d8db325750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf00c00640 0 client.4986 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.892+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 >> 172.21.15.52:0/3679716933 conn(0x55d8db304660 msgr2=0x55d8db34b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.893+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 shutdown_connections 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.893+0000 7faf21811740 1 -- 172.21.15.52:0/3679716933 wait complete. 2024-09-10T08:29:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.893+0000 7faf21811740 20 client.4986 trim_cache size 0 max 16384 2024-09-10T08:29:44.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 Processor -- start 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 -- start start 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db302280 0x55d8db3256e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db35b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf181ffc10 con 0x55d8db306ea0 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf181f4980 con 0x55d8db308630 2024-09-10T08:29:44.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.912+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf181f4fd0 con 0x55d8db302280 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34482/0 (socket says 172.21.15.52:34482) 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 -- 172.21.15.52:0/980857237 learned_addr learned my addr 172.21.15.52:0/980857237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 -- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db302280 msgr2=0x55d8db3256e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db302280 0x55d8db3256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 -- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 msgr2=0x55d8db35b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf1ca00640 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db35b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db35b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 -- 172.21.15.52:0/980857237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8db302060 con 0x55d8db306ea0 2024-09-10T08:29:44.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf1ca00640 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db35b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.913+0000 7faf17400640 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf0402a340 tx=0x7faf04079350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6594fd9f9adb9f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf03400640 1 -- 172.21.15.52:0/980857237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0407dc90 con 0x55d8db306ea0 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf03400640 1 -- 172.21.15.52:0/980857237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0402ae50 con 0x55d8db306ea0 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf03400640 1 -- 172.21.15.52:0/980857237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040824c0 con 0x55d8db306ea0 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 -- 172.21.15.52:0/980857237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 msgr2=0x55d8db35b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf0402a340 tx=0x7faf04079350 comp rx=0 tx=0).stop 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 -- 172.21.15.52:0/980857237 shutdown_connections 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db308630 0x55d8db35b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db306ea0 0x55d8db35b080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 --2- 172.21.15.52:0/980857237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db302280 0x55d8db3256e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 -- 172.21.15.52:0/980857237 >> 172.21.15.52:0/980857237 conn(0x55d8db304660 msgr2=0x55d8db307e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 -- 172.21.15.52:0/980857237 shutdown_connections 2024-09-10T08:29:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.914+0000 7faf21811740 1 -- 172.21.15.52:0/980857237 wait complete. 2024-09-10T08:29:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.915+0000 7faf21811740 1 -- start start 2024-09-10T08:29:44.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.915+0000 7faf21811740 1 Processor -- start 2024-09-10T08:29:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 0x55d8db32ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 0x55d8db32b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8db326370 con 0x55d8db302280 2024-09-10T08:29:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d8db35ca60 con 0x55d8db306ea0 2024-09-10T08:29:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d8db3269c0 con 0x55d8db308630 2024-09-10T08:29:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf21811740 10 client.0 _ll_register_callbacks cb 0x7faf10003af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:29:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34484/0 (socket says 172.21.15.52:34484) 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.916+0000 7faf17e00640 1 -- 172.21.15.52:0/74435758 learned_addr learned my addr 172.21.15.52:0/74435758 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf1ca00640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 0x55d8db32b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17400640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 0x55d8db32ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 -- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 msgr2=0x55d8db32b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 0x55d8db32b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 -- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 msgr2=0x55d8db32ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 0x55d8db32ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 -- 172.21.15.52:0/74435758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8db3285e0 con 0x55d8db302280 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf1ca00640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 0x55d8db32b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17400640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 0x55d8db32ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:29:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf17e00640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf08022040 tx=0x7faf080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e437767a5c1420 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf00c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:29:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0803b070 con 0x55d8db302280 2024-09-10T08:29:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faf08014d20 con 0x55d8db302280 2024-09-10T08:29:44.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.917+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0402ae50 con 0x55d8db302280 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7faf08043050 con 0x55d8db302280 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 10 client.4992 fetch_fsmap learned FSMap version 17 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d8db35b940 con 0x55d8db302280 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0402ae50 con 0x55d8db302280 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7faf08046020 con 0x55d8db302280 2024-09-10T08:29:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 10 client.4992 fetch_fsmap finished waiting for FSMap version 17 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 10 client.4992 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 20 client.4992 populate_metadata read hostname 'smithi052' 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3ceb90 0x55d8db36ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 4 client.4992 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "status"}) -- 0x55d8db271e90 con 0x55d8db3ceb90 2024-09-10T08:29:44.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.918+0000 7faf17400640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3ceb90 0x55d8db36ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf17400640 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3ceb90 0x55d8db36ea70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514358b873df68c9 server_cookie=69514c110b6e6430 in_seq=0 out_seq=0 2024-09-10T08:29:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf00c00640 10 client.4992 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:29:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf00c00640 1 -- 172.21.15.52:0/74435758 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55d8db271e90 con 0x55d8db3ceb90 2024-09-10T08:29:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf00c00640 10 client.4992 handle_command_reply: tid=0 2024-09-10T08:29:44.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf21811740 1 client.4992 shutdown 2024-09-10T08:29:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 msgr2=0x55d8db35b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf08022040 tx=0x7faf080046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 shutdown_connections 2024-09-10T08:29:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.919+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55d8db3ceb90 0x55d8db36ea70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d8db308630 0x55d8db32b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d8db306ea0 0x55d8db32ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf00c00640 0 client.4992 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 --2- 172.21.15.52:0/74435758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8db302280 0x55d8db35b270 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 >> 172.21.15.52:0/74435758 conn(0x55d8db304660 msgr2=0x55d8db32dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 shutdown_connections 2024-09-10T08:29:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 1 -- 172.21.15.52:0/74435758 wait complete. 2024-09-10T08:29:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf21811740 20 client.4992 trim_cache size 0 max 16384 2024-09-10T08:29:44.936 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:29:44.936 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4797, 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:29:44.937 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.894042869, 2024-09-10T08:29:44.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 17, 2024-09-10T08:29:44.938 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 33, 2024-09-10T08:29:44.938 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 33, 2024-09-10T08:29:44.938 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 17.891760063 2024-09-10T08:29:44.938 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:29:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 msgr2=0x7faef806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 0x7faef806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf0800b9f0 tx=0x7faf08008040 comp rx=0 tx=0).stop 2024-09-10T08:29:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 msgr2=0x7faf180b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf040046c0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 shutdown_connections 2024-09-10T08:29:44.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faef806be30 0x7faef806e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf1815e440 0x7faf180b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf180cf450 0x7faf180b5700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 --2- 172.21.15.52:0/212933782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf180b6540 0x7faf1814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.920+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 >> 172.21.15.52:0/212933782 conn(0x7faf18067f80 msgr2=0x7faf180ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.921+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 shutdown_connections 2024-09-10T08:29:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:44.921+0000 7faf1d400640 1 -- 172.21.15.52:0/212933782 wait complete. 2024-09-10T08:29:44.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:29:45.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.100+0000 7f3468c00640 1 Processor -- start 2024-09-10T08:29:45.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.100+0000 7f3468c00640 1 -- start start 2024-09-10T08:29:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.101+0000 7f3468c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f346415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.101+0000 7f3468c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f346413eb20 0x7f346415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.101+0000 7f3468c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3464071180 con 0x7f34640b2d40 2024-09-10T08:29:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.101+0000 7f3468c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3464071ab0 con 0x7f346413eb20 2024-09-10T08:29:45.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.101+0000 7f3468c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3464071460 con 0x7f346406c320 2024-09-10T08:29:45.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3461e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f34640b2d40 0x7f346406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45080/0 (socket says 172.21.15.52:45080) 2024-09-10T08:29:45.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3461e00640 1 -- 172.21.15.52:0/2947966356 learned_addr learned my addr 172.21.15.52:0/2947966356 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:45.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3462800640 1 --2- 172.21.15.52:0/2947966356 >> v2:172.21.15.52:3300/0 conn(0x7f346413eb20 0x7f346415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f345be00640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f346415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3462800640 1 -- 172.21.15.52:0/2947966356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 msgr2=0x7f346415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3462800640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f346415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3461400640 1 -- 172.21.15.52:0/2947966356 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392334444 0 0) 0x7f3464071180 con 0x7f34640b2d40 2024-09-10T08:29:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3462800640 1 -- 172.21.15.52:0/2947966356 >> v1:172.21.15.52:6789/0 conn(0x7f34640b2d40 legacy=0x7f346406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.102+0000 7f3462800640 1 -- 172.21.15.52:0/2947966356 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3464071740 con 0x7f346413eb20 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.103+0000 7f3462800640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415c230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f345c009d90 tx=0x7f345c02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aef7ba1357e7300 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.103+0000 7f3461400640 1 -- 172.21.15.52:0/2947966356 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c032770 con 0x7f346413eb20 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.103+0000 7f3461400640 1 -- 172.21.15.52:0/2947966356 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c038070 con 0x7f346413eb20 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3461400640 1 -- 172.21.15.52:0/2947966356 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c032b30 con 0x7f346413eb20 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 -- 172.21.15.52:0/2947966356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 msgr2=0x7f346415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415c230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f345c009d90 tx=0x7f345c02c870 comp rx=0 tx=0).stop 2024-09-10T08:29:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 -- 172.21.15.52:0/2947966356 shutdown_connections 2024-09-10T08:29:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415c230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 --2- 172.21.15.52:0/2947966356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f346415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 -- 172.21.15.52:0/2947966356 >> 172.21.15.52:0/2947966356 conn(0x7f34640ccec0 msgr2=0x7f34640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 -- 172.21.15.52:0/2947966356 shutdown_connections 2024-09-10T08:29:45.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.104+0000 7f3468c00640 1 -- 172.21.15.52:0/2947966356 wait complete. 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.106+0000 7f3468c00640 1 Processor -- start 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.106+0000 7f3468c00640 1 -- start start 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f3464155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 0x7f34640cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34640720c0 con 0x7f346413eb20 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3464071f40 con 0x7f34640b2d40 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3468c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3464072240 con 0x7f346406c320 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3462800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3462800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34502/0 (socket says 172.21.15.52:34502) 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.107+0000 7f3462800640 1 -- 172.21.15.52:0/2734897621 learned_addr learned my addr 172.21.15.52:0/2734897621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3461e00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f3464155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 -- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 msgr2=0x7f3464155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f345be00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 0x7f34640cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f3464155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 -- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 msgr2=0x7f34640cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 0x7f34640cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 -- 172.21.15.52:0/2734897621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34640b3950 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3461e00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f3464155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f345be00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 0x7f34640cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3462800640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f345c035040 tx=0x7f345c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c003b90 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c003d30 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34640b3c30 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c004240 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.108+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34640b41f0 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.109+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346406bc10 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.110+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f345c032070 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.111+0000 7f345a000640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 0x7f344006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.111+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f345c0ab510 con 0x7f346413eb20 2024-09-10T08:29:45.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.112+0000 7f3461e00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 0x7f344006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:45.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.112+0000 7f3461e00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 0x7f344006e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f60 tx=0x7f3454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:45.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.115+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f345c0797e0 con 0x7f346413eb20 2024-09-10T08:29:45.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.338+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f346415fe20 con 0x7f346413eb20 2024-09-10T08:29:45.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.339+0000 7f345a000640 1 -- 172.21.15.52:0/2734897621 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f345c07dae0 con 0x7f346413eb20 2024-09-10T08:29:45.339 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:29:45.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 msgr2=0x7f344006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 0x7f344006e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3454000f60 tx=0x7f3454009040 comp rx=0 tx=0).stop 2024-09-10T08:29:45.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 msgr2=0x7f346415ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f345c035040 tx=0x7f345c004ab0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 shutdown_connections 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344006be30 0x7f344006e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346413eb20 0x7f346415ce50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34640b2d40 0x7f34640cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 --2- 172.21.15.52:0/2734897621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f346406c320 0x7f3464155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 >> 172.21.15.52:0/2734897621 conn(0x7f34640ccec0 msgr2=0x7f346413fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 shutdown_connections 2024-09-10T08:29:45.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45.341+0000 7f3468c00640 1 -- 172.21.15.52:0/2734897621 wait complete. 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:29:45.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:45.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.359 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:29:45.395 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:45.396 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42617sec preferred_lft 42617sec 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:29:45.397 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:29:45.398 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:29:45.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.399 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:29:45.489 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:29:45.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.492 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:29:45.530 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:29:45.530 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:29:45.530 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:29:45.530 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:29:45.531 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:29:45.531 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:29:45.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:29:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:45.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.730 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:29:45.765 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:29:45.765 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:29:45.766 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:45.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:29:45.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:45.862 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:45.898 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:29:45.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:29:45.898 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:45.973 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:29:45.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:45.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:46.101 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:46.101 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:46.129 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:29:46.129 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:29:46.129 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:29:46.130 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:29:46.130 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:29:46.132 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:29:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:29:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:29:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:29:46.133 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:29:46.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:29:46.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:46.135 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:29:46.192 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:29:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:29:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:29:46.289 INFO:teuthology.orchestra.run.smithi052.stdout:client5004 2024-09-10T08:29:46.289 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:46.290 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:46.326 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-10T08:29:46.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.526+0000 7f5156200640 1 Processor -- start 2024-09-10T08:29:46.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.527+0000 7f5156200640 1 -- start start 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5156200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f515006dfd0 0x7f51500d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5156200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51500d2690 0x7f51500d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5156200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150162040 con 0x7f5150161c60 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5156200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f51500d5040 con 0x7f515006dfd0 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5156200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51500d5320 con 0x7f51500d2690 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5154e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5150161c60 0x7f515006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45082/0 (socket says 172.21.15.52:45082) 2024-09-10T08:29:46.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5154e00640 1 -- 172.21.15.52:0/1744934288 learned_addr learned my addr 172.21.15.52:0/1744934288 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f514fe00640 1 --2- 172.21.15.52:0/1744934288 >> v2:172.21.15.176:3300/0 conn(0x7f515006dfd0 0x7f51500d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.528+0000 7f5155800640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51500d2690 0x7f51500d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514f400640 1 -- 172.21.15.52:0/1744934288 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952530822 0 0) 0x7f5150162040 con 0x7f5150161c60 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514f400640 1 -- 172.21.15.52:0/1744934288 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5138003520 con 0x7f5150161c60 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514fe00640 1 -- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51500d2690 msgr2=0x7f51500d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514fe00640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51500d2690 0x7f51500d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514fe00640 1 -- 172.21.15.52:0/1744934288 >> v1:172.21.15.52:6789/0 conn(0x7f5150161c60 legacy=0x7f515006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.529+0000 7f514fe00640 1 -- 172.21.15.52:0/1744934288 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500d3da0 con 0x7f515006dfd0 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.530+0000 7f514fe00640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515006dfd0 0x7f51500d2150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f513c0097a0 tx=0x7f513c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47934b2e100d9550 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.530+0000 7f514f400640 1 -- 172.21.15.52:0/1744934288 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c037070 con 0x7f515006dfd0 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.530+0000 7f514f400640 1 -- 172.21.15.52:0/1744934288 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c032440 con 0x7f515006dfd0 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.530+0000 7f514f400640 1 -- 172.21.15.52:0/1744934288 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c032810 con 0x7f515006dfd0 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 -- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515006dfd0 msgr2=0x7f51500d2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515006dfd0 0x7f51500d2150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f513c0097a0 tx=0x7f513c02a180 comp rx=0 tx=0).stop 2024-09-10T08:29:46.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 -- 172.21.15.52:0/1744934288 shutdown_connections 2024-09-10T08:29:46.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51500d2690 0x7f51500d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:46.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 --2- 172.21.15.52:0/1744934288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f515006dfd0 0x7f51500d2150 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:46.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 -- 172.21.15.52:0/1744934288 >> 172.21.15.52:0/1744934288 conn(0x7f51500d1630 msgr2=0x7f51500d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:46.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 -- 172.21.15.52:0/1744934288 shutdown_connections 2024-09-10T08:29:46.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.531+0000 7f5156200640 1 -- 172.21.15.52:0/1744934288 wait complete. 2024-09-10T08:29:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.533+0000 7f5156200640 1 Processor -- start 2024-09-10T08:29:46.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.533+0000 7f5156200640 1 -- start start 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f515006dfd0 0x7f5150158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51500d2690 0x7f51501f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51500b86c0 con 0x7f5150161c60 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51500d42c0 con 0x7f51500d2690 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5156200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51500b8840 con 0x7f515006dfd0 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34504/0 (socket says 172.21.15.52:34504) 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 -- 172.21.15.52:0/2626567610 learned_addr learned my addr 172.21.15.52:0/2626567610 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5154e00640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f515006dfd0 0x7f5150158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f514fe00640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51500d2690 0x7f51501f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 -- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f515006dfd0 msgr2=0x7f5150158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f515006dfd0 0x7f5150158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 -- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51500d2690 msgr2=0x7f51501f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51500d2690 0x7f51501f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.534+0000 7f5155800640 1 -- 172.21.15.52:0/2626567610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150155170 con 0x7f5150161c60 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f5155800640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f514800efc0 tx=0x7f514800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148018020 con 0x7f5150161c60 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148014480 con 0x7f5150161c60 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148014870 con 0x7f5150161c60 2024-09-10T08:29:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51501543b0 con 0x7f5150161c60 2024-09-10T08:29:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.535+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5150154970 con 0x7f5150161c60 2024-09-10T08:29:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.536+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51500b3920 con 0x7f5150161c60 2024-09-10T08:29:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.537+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5148005d10 con 0x7f5150161c60 2024-09-10T08:29:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.538+0000 7f514cc00640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:29:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.538+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f514808bb40 con 0x7f5150161c60 2024-09-10T08:29:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.538+0000 7f5154e00640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:29:46.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.539+0000 7f5154e00640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 0x7f513006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5144005880 tx=0x7f5144009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:29:46.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.543+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5148022030 con 0x7f5150161c60 2024-09-10T08:29:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:46.765+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f51500b3600 con 0x7f5150161c60 2024-09-10T08:29:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.532+0000 7f514cc00640 1 -- 172.21.15.52:0/2626567610 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) ==== 167+0+0 (secure 0 0 0) 0x7f5148010040 con 0x7f5150161c60 2024-09-10T08:29:47.533 INFO:teuthology.orchestra.run.smithi052.stderr:enabled new snapshots 2024-09-10T08:29:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.535+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 msgr2=0x7f513006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.535+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 0x7f513006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5144005880 tx=0x7f5144009040 comp rx=0 tx=0).stop 2024-09-10T08:29:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.535+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 msgr2=0x7f51501f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:29:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f514800efc0 tx=0x7f514800c490 comp rx=0 tx=0).stop 2024-09-10T08:29:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 shutdown_connections 2024-09-10T08:29:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f513006be30 0x7f513006e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5150161c60 0x7f51501f7ae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51500d2690 0x7f51501f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 --2- 172.21.15.52:0/2626567610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f515006dfd0 0x7f5150158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:29:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 >> 172.21.15.52:0/2626567610 conn(0x7f51500d1630 msgr2=0x7f51500cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:29:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 shutdown_connections 2024-09-10T08:29:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:29:47.536+0000 7f5156200640 1 -- 172.21.15.52:0/2626567610 wait complete. 2024-09-10T08:29:47.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:29:47.555 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-10T08:29:47.599 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:29:47.599 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> import uuid 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> n = 2000 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = False 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> if 3 > 0: 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = True 2024-09-10T08:29:47.676 DEBUG:teuthology.orchestra.run.smithi052:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> dpath = os.path.dirname(path) 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> fnameprefix = os.path.basename(path) 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> os.makedirs(dpath, exist_ok=True) 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> for i in range(n): 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> f.write(f"{i}") 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:29:47.677 DEBUG:teuthology.orchestra.run.smithi052:> f.flush() 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(f.fileno()) 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> os.unlink(fpath) 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> if create_hard_links: 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> for j in range(3): 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:29:47.678 DEBUG:teuthology.orchestra.run.smithi052:> finally: 2024-09-10T08:29:47.679 DEBUG:teuthology.orchestra.run.smithi052:> os.close(dirfd) 2024-09-10T08:29:47.679 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:30:05.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:05.649 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:20.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:30:20.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:30:20.610 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T08:30:20.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:30:20.722 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-10T08:30:35.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:35.755 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:30:49.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:30:49.524 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T08:30:49.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-10T08:30:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.769+0000 7f8e73800640 1 Processor -- start 2024-09-10T08:30:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.770+0000 7f8e73800640 1 -- start start 2024-09-10T08:30:49.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e73800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e6c0732e0 0x7f8e6c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e73800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6c0714b0 con 0x7f8e6c0cce30 2024-09-10T08:30:49.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e73800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6c073c00 con 0x7f8e6c0cd2a0 2024-09-10T08:30:49.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e73800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6c0cd880 con 0x7f8e6c0732e0 2024-09-10T08:30:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e70e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e6c0732e0 0x7f8e6c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e70e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8e6c0732e0 0x7f8e6c0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47226/0 (socket says 172.21.15.52:47226) 2024-09-10T08:30:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e70e00640 1 -- 172.21.15.52:0/326420941 learned_addr learned my addr 172.21.15.52:0/326420941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.771+0000 7f8e6be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8e6c0cce30 0x7f8e6c071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40782/0 (socket says 172.21.15.52:40782) 2024-09-10T08:30:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.772+0000 7f8e70e00640 1 -- 172.21.15.52:0/326420941 >> v1:172.21.15.176:6789/0 conn(0x7f8e6c0cd2a0 legacy=0x7f8e6c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.772+0000 7f8e70e00640 1 -- 172.21.15.52:0/326420941 >> v1:172.21.15.52:6789/0 conn(0x7f8e6c0cce30 legacy=0x7f8e6c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.772+0000 7f8e70e00640 1 -- 172.21.15.52:0/326420941 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c0cdb60 con 0x7f8e6c0732e0 2024-09-10T08:30:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e70e00640 1 --2- 172.21.15.52:0/326420941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c0736c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a81b342084d363 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e6b400640 1 -- 172.21.15.52:0/326420941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60037070 con 0x7f8e6c0732e0 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e6b400640 1 -- 172.21.15.52:0/326420941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60032440 con 0x7f8e6c0732e0 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e6b400640 1 -- 172.21.15.52:0/326420941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60032810 con 0x7f8e6c0732e0 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e73800640 1 -- 172.21.15.52:0/326420941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0732e0 msgr2=0x7f8e6c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.773+0000 7f8e73800640 1 --2- 172.21.15.52:0/326420941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c0736c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e6002a270 comp rx=0 tx=0).stop 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.774+0000 7f8e73800640 1 -- 172.21.15.52:0/326420941 shutdown_connections 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.774+0000 7f8e73800640 1 --2- 172.21.15.52:0/326420941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c0736c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.774+0000 7f8e73800640 1 -- 172.21.15.52:0/326420941 >> 172.21.15.52:0/326420941 conn(0x7f8e6c06d0f0 msgr2=0x7f8e6c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.774+0000 7f8e73800640 1 -- 172.21.15.52:0/326420941 shutdown_connections 2024-09-10T08:30:49.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.774+0000 7f8e73800640 1 -- 172.21.15.52:0/326420941 wait complete. 2024-09-10T08:30:49.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.775+0000 7f8e73800640 1 Processor -- start 2024-09-10T08:30:49.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 -- start start 2024-09-10T08:30:49.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c14e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c0cd2a0 0x7f8e6c1e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c06bf70 con 0x7f8e6c0cce30 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c06bdf0 con 0x7f8e6c0732e0 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.776+0000 7f8e73800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c072380 con 0x7f8e6c0cd2a0 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c14e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47228/0 (socket says 172.21.15.52:47228) 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 -- 172.21.15.52:0/3162474068 learned_addr learned my addr 172.21.15.52:0/3162474068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e71800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c0cd2a0 0x7f8e6c1e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 -- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c0cd2a0 msgr2=0x7f8e6c1e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c0cd2a0 0x7f8e6c1e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 -- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c0732e0 msgr2=0x7f8e6c14e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c14e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 -- 172.21.15.52:0/3162474068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c1ea0a0 con 0x7f8e6c0cce30 2024-09-10T08:30:49.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.777+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c3e0 tx=0x7f8e5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.778+0000 7f8e68c00640 1 -- 172.21.15.52:0/3162474068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580074e0 con 0x7f8e6c0cce30 2024-09-10T08:30:49.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.778+0000 7f8e68c00640 1 -- 172.21.15.52:0/3162474068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58007680 con 0x7f8e6c0cce30 2024-09-10T08:30:49.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.778+0000 7f8e68c00640 1 -- 172.21.15.52:0/3162474068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580049e0 con 0x7f8e6c0cce30 2024-09-10T08:30:49.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.778+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c1ea380 con 0x7f8e6c0cce30 2024-09-10T08:30:49.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.778+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c1e48d0 con 0x7f8e6c0cce30 2024-09-10T08:30:49.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.780+0000 7f8e68c00640 1 -- 172.21.15.52:0/3162474068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e5801a020 con 0x7f8e6c0cce30 2024-09-10T08:30:49.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.781+0000 7f8e68c00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 0x7f8e4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.781+0000 7f8e68c00640 1 -- 172.21.15.52:0/3162474068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f8e5808a560 con 0x7f8e6c0cce30 2024-09-10T08:30:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.781+0000 7f8e70e00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 0x7f8e4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.782+0000 7f8e76803740 1 Processor -- start 2024-09-10T08:30:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.782+0000 7f8e76803740 1 -- start start 2024-09-10T08:30:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.782+0000 7f8e70e00640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 0x7f8e4c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e60034000 tx=0x7f8e6002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30ef240 0x5602f30f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5602f30b8cf0 con 0x5602f30f3210 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5602f30547f0 con 0x5602f30ef240 2024-09-10T08:30:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5602f2ffc800 con 0x5602f30f1a80 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e71800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39742/0 (socket says 172.21.15.52:39742) 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e71800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47232/0 (socket says 172.21.15.52:47232) 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 -- 172.21.15.52:0/2665259659 learned_addr learned my addr 172.21.15.52:0/2665259659 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e6be00640 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30ef240 0x5602f30f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 -- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30ef240 msgr2=0x5602f30f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30ef240 0x5602f30f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 -- 172.21.15.52:0/2665259659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 msgr2=0x5602f30ec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e70e00640 1 -- 172.21.15.52:0/2665259659 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602f2e317d0 con 0x5602f30f1a80 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.783+0000 7f8e71800640 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.784+0000 7f8e70e00640 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009960 tx=0x7f8e6002c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb81eaf5aef6a90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.784+0000 7f8e5d600640 1 -- 172.21.15.52:0/2665259659 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6004e070 con 0x5602f30f1a80 2024-09-10T08:30:49.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.784+0000 7f8e5d600640 1 -- 172.21.15.52:0/2665259659 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60032d40 con 0x5602f30f1a80 2024-09-10T08:30:49.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.784+0000 7f8e5d600640 1 -- 172.21.15.52:0/2665259659 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60037040 con 0x5602f30f1a80 2024-09-10T08:30:49.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 -- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 msgr2=0x5602f3137220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009960 tx=0x7f8e6002c000 comp rx=0 tx=0).stop 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 -- 172.21.15.52:0/2665259659 shutdown_connections 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f30ec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30ef240 0x5602f30f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 --2- 172.21.15.52:0/2665259659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3137220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 -- 172.21.15.52:0/2665259659 >> 172.21.15.52:0/2665259659 conn(0x5602f30ee240 msgr2=0x5602f31366f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 -- 172.21.15.52:0/2665259659 shutdown_connections 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.785+0000 7f8e76803740 1 -- 172.21.15.52:0/2665259659 wait complete. 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.786+0000 7f8e76803740 1 -- start start 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.786+0000 7f8e76803740 1 Processor -- start 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f31123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f3112930 0x5602f30f0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5602f2fdd750 con 0x5602f30f1a80 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5602f30507b0 con 0x5602f30f3210 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5602f30ed6e0 con 0x5602f3112930 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e76803740 10 client.0 _ll_register_callbacks cb 0x5602f2d66be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47236/0 (socket says 172.21.15.52:47236) 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 -- 172.21.15.52:0/1116737928 learned_addr learned my addr 172.21.15.52:0/1116737928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e6be00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f31123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e71800640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f3112930 0x5602f30f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 -- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f3112930 msgr2=0x5602f30f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f3112930 0x5602f30f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 -- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 msgr2=0x5602f31123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.787+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f31123f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e70e00640 1 -- 172.21.15.52:0/1116737928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602f2d270f0 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e600090b0 tx=0x7f8e60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e73f048219e601 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e52000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6004e030 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f8e60032b40 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e60032d40 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e60037040 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e76803740 10 client.5025 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.788+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5602f2e91f60 con 0x5602f30f1a80 2024-09-10T08:30:49.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60032d40 con 0x5602f30f1a80 2024-09-10T08:30:49.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f8e6003caa0 con 0x5602f30f1a80 2024-09-10T08:30:49.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 10 client.5025 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:49.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 10 client.5025 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:49.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 20 client.5025 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f311ae40 0x5602f311b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 4 client.5025 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602f3061f20 con 0x5602f311ae40 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.789+0000 7f8e6be00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f311ae40 0x5602f311b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.790+0000 7f8e6be00640 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f311ae40 0x5602f311b250 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72163a6a5a531f8e server_cookie=43d076b0c6ffecad in_seq=0 out_seq=0 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.790+0000 7f8e52000640 10 client.5025 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.790+0000 7f8e52000640 1 -- 172.21.15.52:0/1116737928 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602f3061f20 con 0x5602f311ae40 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.790+0000 7f8e52000640 10 client.5025 handle_command_reply: tid=0 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.790+0000 7f8e76803740 1 client.5025 shutdown 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 msgr2=0x5602f3110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e600090b0 tx=0x7f8e60004730 comp rx=0 tx=0).stop 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 shutdown_connections 2024-09-10T08:30:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f311ae40 0x5602f311b250 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f3112930 0x5602f30f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f31123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 --2- 172.21.15.52:0/1116737928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f1a80 0x5602f3110650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 >> 172.21.15.52:0/1116737928 conn(0x5602f30ef240 msgr2=0x5602f3134770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e52000640 0 client.5025 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 shutdown_connections 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 1 -- 172.21.15.52:0/1116737928 wait complete. 2024-09-10T08:30:49.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.791+0000 7f8e76803740 20 client.5025 trim_cache size 0 max 16384 2024-09-10T08:30:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.808+0000 7f8e76803740 1 Processor -- start 2024-09-10T08:30:49.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.808+0000 7f8e76803740 1 -- start start 2024-09-10T08:30:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3138250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f3112930 0x5602f311a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c200ed0 con 0x5602f30f3210 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c1fffc0 con 0x5602f3112930 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c1e59e0 con 0x5602f30f1a80 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47238/0 (socket says 172.21.15.52:47238) 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 -- 172.21.15.52:0/3445887831 learned_addr learned my addr 172.21.15.52:0/3445887831 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 -- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 msgr2=0x5602f3138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 -- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f3112930 msgr2=0x5602f311a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f3112930 0x5602f311a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.809+0000 7f8e6be00640 1 -- 172.21.15.52:0/3445887831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602f2d001b0 con 0x5602f30f3210 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.810+0000 7f8e6be00640 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e580070a0 tx=0x7f8e5808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a76ff352b3c1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.810+0000 7f8e5cc00640 1 -- 172.21.15.52:0/3445887831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58056b30 con 0x5602f30f3210 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.810+0000 7f8e5cc00640 1 -- 172.21.15.52:0/3445887831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58054ea0 con 0x5602f30f3210 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.810+0000 7f8e5cc00640 1 -- 172.21.15.52:0/3445887831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58058c90 con 0x5602f30f3210 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- 172.21.15.52:0/3445887831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 msgr2=0x5602f311b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e580070a0 tx=0x7f8e5808a040 comp rx=0 tx=0).stop 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- 172.21.15.52:0/3445887831 shutdown_connections 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f3112930 0x5602f311a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f30f3210 0x5602f311b8f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 --2- 172.21.15.52:0/3445887831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- 172.21.15.52:0/3445887831 >> 172.21.15.52:0/3445887831 conn(0x5602f30ef240 msgr2=0x5602f30ef7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- 172.21.15.52:0/3445887831 shutdown_connections 2024-09-10T08:30:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- 172.21.15.52:0/3445887831 wait complete. 2024-09-10T08:30:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.811+0000 7f8e76803740 1 -- start start 2024-09-10T08:30:49.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.812+0000 7f8e76803740 1 Processor -- start 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.812+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3155f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f310df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5602f31112e0 con 0x5602f3112930 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c1e6030 con 0x5602f30f3210 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5602f30eda50 con 0x5602f30f1a80 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e76803740 10 client.0 _ll_register_callbacks cb 0x7f8e6004c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47252/0 (socket says 172.21.15.52:47252) 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 -- 172.21.15.52:0/1125030704 learned_addr learned my addr 172.21.15.52:0/1125030704 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e6be00640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f310df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 -- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 msgr2=0x5602f3155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 -- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 msgr2=0x5602f310df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f310df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.813+0000 7f8e71800640 1 -- 172.21.15.52:0/1125030704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602f3138530 con 0x5602f3112930 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e71800640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e64015950 tx=0x7f8e64015e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322b8f5acaf5c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e640020a0 con 0x5602f3112930 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f8e64006d60 con 0x5602f3112930 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e58054ea0 con 0x5602f3112930 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8e64003970 con 0x5602f3112930 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 10 client.5031 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:49.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5602f3156620 con 0x5602f3112930 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58054ea0 con 0x5602f3112930 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f8e6402a080 con 0x5602f3112930 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 10 client.5031 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 10 client.5031 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 20 client.5031 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f31387d0 0x5602f3147360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 4 client.5031 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.814+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5602f305c270 con 0x5602f31387d0 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.815+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f31387d0 0x5602f3147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.815+0000 7f8e70e00640 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f31387d0 0x5602f3147360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a278743d9a4fc61f server_cookie=bb017634cdec1755 in_seq=0 out_seq=0 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.815+0000 7f8e52000640 10 client.5031 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:49.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e52000640 1 -- 172.21.15.52:0/1125030704 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17990 (crc 0 0 0) 0x5602f305c270 con 0x5602f31387d0 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e52000640 10 client.5031 handle_command_reply: tid=0 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 client.5031 shutdown 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 msgr2=0x5602f3146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e64015950 tx=0x7f8e64015e10 comp rx=0 tx=0).stop 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 shutdown_connections 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5602f31387d0 0x5602f3147360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5602f3112930 0x5602f3146e20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5602f30f3210 0x5602f310df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 --2- 172.21.15.52:0/1125030704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5602f30f1a80 0x5602f3155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e52000640 0 client.5031 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 >> 172.21.15.52:0/1125030704 conn(0x5602f30ef240 msgr2=0x5602f3118970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 shutdown_connections 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 1 -- 172.21.15.52:0/1125030704 wait complete. 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.816+0000 7f8e76803740 20 client.5031 trim_cache size 0 max 16384 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 27181, 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 49157, 2024-09-10T08:30:49.821 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 9978229, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 42032497, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 10, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 4.706124195, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 2.715873237, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 2.557698316, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.026594845, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 49156, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.459006308, 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000029681 2024-09-10T08:30:49.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 71650, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.017727082, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000247 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 118064, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 20080 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2128, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2146, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 723251, 2024-09-10T08:30:49.823 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 40410414, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.343098096, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.184484904, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.065277386, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.075689916, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2145, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.597341973, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000278481 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.824 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 83104 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1811, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1811, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 457420, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 24618224, 2024-09-10T08:30:49.825 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.274201142, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.142999952, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.048840066, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.066208637, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1810, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.427797686, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000236352 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:30:49.826 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T08:30:49.827 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1221, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 16.061912593, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.013154719 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1876, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.685304901, 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000365301 2024-09-10T08:30:49.828 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25637, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25637, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25637, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 368.397745617, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.014369768 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T08:30:49.829 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 19905, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 19905, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 19904, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 54, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 54, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T08:30:49.830 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 46493, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46005, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 105, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T08:30:49.831 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:30:49.832 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 896, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4028, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2897, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2066, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 53, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14056 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T08:30:49.833 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 2000, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 169, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4156, 2024-09-10T08:30:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 1781, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2209, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T08:30:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 24611, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 24611, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 35, 2024-09-10T08:30:49.836 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 35, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 4, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 93710404, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2565, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 107.398283977, 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.041870676 2024-09-10T08:30:49.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 2014, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2014, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 19905, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19906, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 1, 2024-09-10T08:30:49.838 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 54, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 7159, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 7105, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 110628, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28487, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25637, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 4, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T08:30:49.839 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.047362351, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001023681 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.004030680, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000161227 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.840 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 7.413585393, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001235597 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7389, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.995362277, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000676053 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.841 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T08:30:49.842 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000075081, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000075081 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.843 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002902628, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002902628 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T08:30:49.844 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.046792192, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.046792192 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000125126, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000125126 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.092239259, 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.011529907 2024-09-10T08:30:49.845 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2209, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 333.945946004, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.151175167 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.846 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.004191734, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.004191734 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.847 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000278788, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000278788 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.848 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.849 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 19.844854104, 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002480606 2024-09-10T08:30:49.850 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-10T08:30:49.851 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 17921, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 17921, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 60, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:30:49.852 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:30:49.853 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T08:30:49.854 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 16988885, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 6277, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T08:30:49.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5696, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 83, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 21145838, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 877518, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T08:30:49.856 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 4599, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 89983963, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 27, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 4599, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4599, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 23.839683968, 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005183666 2024-09-10T08:30:49.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4599, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4710 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 4599, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 51, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 4548, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-10T08:30:49.858 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 51, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2616, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 32, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1781, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 33, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-09-10T08:30:49.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T08:30:49.860 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T08:30:49.861 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 35, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 3, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 132, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 32 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T08:30:49.862 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 1781, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 1781, 2024-09-10T08:30:49.863 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 31115, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 8353775, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 31115, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 31115, 2024-09-10T08:30:49.864 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8353775, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:30:49.865 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4599, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 90178092, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4599, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 90178092, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.866 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4599, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 4599, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4599, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 4599, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.867 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 1781, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 194129, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 1781, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:30:49.868 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 51, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 194129, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x564b42a5c500": { 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 84, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:30:49.869 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 24611, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 89516100, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 24611, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2565, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 89516016, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.870 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:49.871 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 msgr2=0x7f8e4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 0x7f8e4c06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8e60034000 tx=0x7f8e6002e000 comp rx=0 tx=0).stop 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 msgr2=0x7f8e6c1e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c3e0 tx=0x7f8e5800c8a0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 shutdown_connections 2024-09-10T08:30:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8e4c06be30 0x7f8e4c06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8e6c0cd2a0 0x7f8e6c1e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e6c0cce30 0x7f8e6c1e9600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 --2- 172.21.15.52:0/3162474068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e6c0732e0 0x7f8e6c14e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 >> 172.21.15.52:0/3162474068 conn(0x7f8e6c06d0f0 msgr2=0x7f8e6c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 shutdown_connections 2024-09-10T08:30:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:49.817+0000 7f8e73800640 1 -- 172.21.15.52:0/3162474068 wait complete. 2024-09-10T08:30:49.874 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-10T08:30:49.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:30:49.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-10T08:30:50.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.035+0000 7f8376a00640 1 Processor -- start 2024-09-10T08:30:50.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.035+0000 7f8376a00640 1 -- start start 2024-09-10T08:30:50.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8376a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8370158ef0 0x7f837006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8376a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f837006fbc0 0x7f83700b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8376a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837006fff0 con 0x7f837006c150 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8376a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f837006c5b0 con 0x7f8370158ef0 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8376a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f83701592d0 con 0x7f837006fbc0 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f836fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8370158ef0 0x7f837006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8367400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f837006c150 0x7f837006f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40784/0 (socket says 172.21.15.52:40784) 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8367400640 1 -- 172.21.15.52:0/1492353337 learned_addr learned my addr 172.21.15.52:0/1492353337 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.036+0000 7f8374a00640 1 --2- 172.21.15.52:0/1492353337 >> v2:172.21.15.176:3300/0 conn(0x7f837006fbc0 0x7f83700b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.037+0000 7f836fe00640 1 -- 172.21.15.52:0/1492353337 >> v2:172.21.15.176:3300/0 conn(0x7f837006fbc0 msgr2=0x7f83700b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.037+0000 7f836fe00640 1 --2- 172.21.15.52:0/1492353337 >> v2:172.21.15.176:3300/0 conn(0x7f837006fbc0 0x7f83700b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.037+0000 7f836fe00640 1 -- 172.21.15.52:0/1492353337 >> v1:172.21.15.52:6789/0 conn(0x7f837006c150 legacy=0x7f837006f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.037+0000 7f836fe00640 1 -- 172.21.15.52:0/1492353337 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83701624a0 con 0x7f8370158ef0 2024-09-10T08:30:50.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.037+0000 7f836f400640 1 -- 172.21.15.52:0/1492353337 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939349813 0 0) 0x7f8358001110 con 0x7f837006c150 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.038+0000 7f836fe00640 1 --2- 172.21.15.52:0/1492353337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f837006bc10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8370162670 tx=0x7f836002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c479fafb36b457a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.038+0000 7f836f400640 1 -- 172.21.15.52:0/1492353337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360037070 con 0x7f8370158ef0 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.038+0000 7f836f400640 1 -- 172.21.15.52:0/1492353337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360032440 con 0x7f8370158ef0 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.038+0000 7f836f400640 1 -- 172.21.15.52:0/1492353337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836002ae60 con 0x7f8370158ef0 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 -- 172.21.15.52:0/1492353337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 msgr2=0x7f837006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 --2- 172.21.15.52:0/1492353337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f837006bc10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8370162670 tx=0x7f836002a110 comp rx=0 tx=0).stop 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 -- 172.21.15.52:0/1492353337 shutdown_connections 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 --2- 172.21.15.52:0/1492353337 >> v2:172.21.15.176:3300/0 conn(0x7f837006fbc0 0x7f83700b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 --2- 172.21.15.52:0/1492353337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f837006bc10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 -- 172.21.15.52:0/1492353337 >> 172.21.15.52:0/1492353337 conn(0x7f8370067da0 msgr2=0x7f837006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 -- 172.21.15.52:0/1492353337 shutdown_connections 2024-09-10T08:30:50.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.039+0000 7f8376a00640 1 -- 172.21.15.52:0/1492353337 wait complete. 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.040+0000 7f8376a00640 1 Processor -- start 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.040+0000 7f8376a00640 1 -- start start 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 0x7f837015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f837006fbc0 0x7f83700af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8370162d00 con 0x7f8370158ef0 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8370162a20 con 0x7f837006c150 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.041+0000 7f8376a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8370162fe0 con 0x7f837006fbc0 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47264/0 (socket says 172.21.15.52:47264) 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 -- 172.21.15.52:0/3005872721 learned_addr learned my addr 172.21.15.52:0/3005872721 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8367400640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f837006fbc0 0x7f83700af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f836fe00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 0x7f837015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 -- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f837006fbc0 msgr2=0x7f83700af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f837006fbc0 0x7f83700af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 -- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 msgr2=0x7f837015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 0x7f837015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 -- 172.21.15.52:0/3005872721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370156940 con 0x7f8370158ef0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f836fe00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 0x7f837015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.042+0000 7f8374a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f836800efc0 tx=0x7f836800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.043+0000 7f836cc00640 1 -- 172.21.15.52:0/3005872721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368018020 con 0x7f8370158ef0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.043+0000 7f836cc00640 1 -- 172.21.15.52:0/3005872721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368014480 con 0x7f8370158ef0 2024-09-10T08:30:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.043+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837014f2c0 con 0x7f8370158ef0 2024-09-10T08:30:50.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.043+0000 7f836cc00640 1 -- 172.21.15.52:0/3005872721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368014870 con 0x7f8370158ef0 2024-09-10T08:30:50.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.043+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8370156be0 con 0x7f8370158ef0 2024-09-10T08:30:50.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.045+0000 7f836cc00640 1 -- 172.21.15.52:0/3005872721 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8368005d10 con 0x7f8370158ef0 2024-09-10T08:30:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.046+0000 7f836cc00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.046+0000 7f836cc00640 1 -- 172.21.15.52:0/3005872721 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f836808ba00 con 0x7f8370158ef0 2024-09-10T08:30:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.046+0000 7f836fe00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.046+0000 7f8379a15740 1 Processor -- start 2024-09-10T08:30:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.047+0000 7f8379a15740 1 -- start start 2024-09-10T08:30:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.047+0000 7f836fe00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8360034000 tx=0x7f836002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.047+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 0x562951da0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 0x562951d9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8379a15740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 0x562951d9b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8379a15740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562951d03770 con 0x562951d9dff0 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562951cab700 con 0x562951d9bf30 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562951cff730 con 0x562951da0830 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 0x562951d9b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f836fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 0x562951da0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8367400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 0x562951d9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f836fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 0x562951da0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39790/0 (socket says 172.21.15.52:39790) 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8367400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 0x562951d9ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36642/0 (socket says 172.21.15.52:36642) 2024-09-10T08:30:50.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f836fe00640 1 -- 172.21.15.52:0/3292617850 learned_addr learned my addr 172.21.15.52:0/3292617850 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 -- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 msgr2=0x562951da0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 0x562951da0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 -- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 msgr2=0x562951d9ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 0x562951d9ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.048+0000 7f8374a00640 1 -- 172.21.15.52:0/3292617850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562951c90110 con 0x562951d9dff0 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8374a00640 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 0x562951d9b360 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f836800c990 tx=0x7f8368059640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2998942d99eecb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f835fe00640 1 -- 172.21.15.52:0/3292617850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836805dfd0 con 0x562951d9dff0 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f835fe00640 1 -- 172.21.15.52:0/3292617850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368062800 con 0x562951d9dff0 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f835fe00640 1 -- 172.21.15.52:0/3292617850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368056290 con 0x562951d9dff0 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 -- 172.21.15.52:0/3292617850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 msgr2=0x562951d9b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 0x562951d9b360 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f836800c990 tx=0x7f8368059640 comp rx=0 tx=0).stop 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 -- 172.21.15.52:0/3292617850 shutdown_connections 2024-09-10T08:30:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951d9dff0 0x562951d9b360 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9bf30 0x562951d9ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 --2- 172.21.15.52:0/3292617850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951da0830 0x562951da0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.049+0000 7f8379a15740 1 -- 172.21.15.52:0/3292617850 >> 172.21.15.52:0/3292617850 conn(0x562951d9cff0 msgr2=0x562951de56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.050+0000 7f8379a15740 1 -- 172.21.15.52:0/3292617850 shutdown_connections 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.050+0000 7f8379a15740 1 -- 172.21.15.52:0/3292617850 wait complete. 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.050+0000 7f8379a15740 1 -- start start 2024-09-10T08:30:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.050+0000 7f8379a15740 1 Processor -- start 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951dca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951dbbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562951dcb0c0 con 0x562951da0830 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x562951cbe9c0 con 0x562951df5c20 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562951de5dc0 con 0x562951d9dff0 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.051+0000 7f8379a15740 10 client.0 _ll_register_callbacks cb 0x562951a15d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47288/0 (socket says 172.21.15.52:47288) 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 -- 172.21.15.52:0/2368049640 learned_addr learned my addr 172.21.15.52:0/2368049640 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8374a00640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951dbbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f836fe00640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951dca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 -- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 msgr2=0x562951dca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951dca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 -- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 msgr2=0x562951dbbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951dbbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 -- 172.21.15.52:0/2368049640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562951ae2940 con 0x562951da0830 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8374a00640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951dbbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f8367400640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8358007670 tx=0x7f8358001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f4ae2a83dad167 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.052+0000 7f835cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835801b060 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f8358016b60 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8368062800 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8358016d60 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 10 client.5046 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562951b430d0 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368062800 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f83580049f0 con 0x562951da0830 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 10 client.5046 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 10 client.5046 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 20 client.5046 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951df9590 0x562951df99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 4 client.5046 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:30:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.053+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562951d10ea0 con 0x562951df9590 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.054+0000 7f836fe00640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951df9590 0x562951df99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.054+0000 7f836fe00640 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951df9590 0x562951df99b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16c0f4c65108addf server_cookie=afb7f3956cd4ab26 in_seq=0 out_seq=0 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.054+0000 7f835cc00640 10 client.5046 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f835cc00640 1 -- 172.21.15.52:0/2368049640 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562951d10ea0 con 0x562951df9590 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f835cc00640 10 client.5046 handle_command_reply: tid=0 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 client.5046 shutdown 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 msgr2=0x562951db7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8358007670 tx=0x7f8358001850 comp rx=0 tx=0).stop 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 shutdown_connections 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951df9590 0x562951df99b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951dbbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951db7070 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 --2- 172.21.15.52:0/2368049640 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951dca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 >> 172.21.15.52:0/2368049640 conn(0x562951d9bf30 msgr2=0x562951de62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.055+0000 7f835cc00640 0 client.5046 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.056+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 shutdown_connections 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.056+0000 7f8379a15740 1 -- 172.21.15.52:0/2368049640 wait complete. 2024-09-10T08:30:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.056+0000 7f8379a15740 20 client.5046 trim_cache size 0 max 16384 2024-09-10T08:30:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.074+0000 7f8379a15740 1 Processor -- start 2024-09-10T08:30:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.074+0000 7f8379a15740 1 -- start start 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9dff0 0x562951de63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951df5c20 0x562951de36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8370200d90 con 0x562951da0830 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83701ffdb0 con 0x562951d9dff0 2024-09-10T08:30:50.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83701ff110 con 0x562951df5c20 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47294/0 (socket says 172.21.15.52:47294) 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8367400640 1 -- 172.21.15.52:0/4116286333 learned_addr learned my addr 172.21.15.52:0/4116286333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f836fe00640 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9dff0 0x562951de63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.075+0000 7f8374a00640 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951df5c20 0x562951de36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 -- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951df5c20 msgr2=0x562951de36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951df5c20 0x562951de36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 -- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9dff0 msgr2=0x562951de63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9dff0 0x562951de63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 -- 172.21.15.52:0/4116286333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562951dbbfc0 con 0x562951da0830 2024-09-10T08:30:50.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f8367400640 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8358007e80 tx=0x7f8358011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e16790e3272d0cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f835f400640 1 -- 172.21.15.52:0/4116286333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580049f0 con 0x562951da0830 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f835f400640 1 -- 172.21.15.52:0/4116286333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835800b070 con 0x562951da0830 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.076+0000 7f835f400640 1 -- 172.21.15.52:0/4116286333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358004f40 con 0x562951da0830 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 -- 172.21.15.52:0/4116286333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 msgr2=0x562951d9c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8358007e80 tx=0x7f8358011000 comp rx=0 tx=0).stop 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 -- 172.21.15.52:0/4116286333 shutdown_connections 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951df5c20 0x562951de36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951d9c5d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 --2- 172.21.15.52:0/4116286333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951d9dff0 0x562951de63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 -- 172.21.15.52:0/4116286333 >> 172.21.15.52:0/4116286333 conn(0x562951d9bf30 msgr2=0x562951db6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 -- 172.21.15.52:0/4116286333 shutdown_connections 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.077+0000 7f8379a15740 1 -- 172.21.15.52:0/4116286333 wait complete. 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.078+0000 7f8379a15740 1 -- start start 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.078+0000 7f8379a15740 1 Processor -- start 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951de3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951e64ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562951df8710 con 0x562951da0830 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83701ff760 con 0x562951df5c20 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562951e090b0 con 0x562951d9dff0 2024-09-10T08:30:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8379a15740 10 client.0 _ll_register_callbacks cb 0x7f8358007280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8367400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47300/0 (socket says 172.21.15.52:47300) 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8367400640 1 -- 172.21.15.52:0/3514725511 learned_addr learned my addr 172.21.15.52:0/3514725511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f836fe00640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951de3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.079+0000 7f8374a00640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951e64ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 -- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 msgr2=0x562951de3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951de3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 -- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 msgr2=0x562951e64ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951e64ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 -- 172.21.15.52:0/3514725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629519d6230 con 0x562951da0830 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8367400640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8358005d70 tx=0x7f8358001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da3963bc72b87fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f835cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580054e0 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f8358005680 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.080+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f835800b070 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8358015430 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 10 client.5052 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x562951ccb160 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835800b070 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f83580155d0 con 0x562951da0830 2024-09-10T08:30:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 10 client.5052 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 10 client.5052 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 20 client.5052 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951de2080 0x562951e65400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 4 client.5052 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x562951d0b1f0 con 0x562951de2080 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.081+0000 7f836fe00640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951de2080 0x562951e65400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.082+0000 7f836fe00640 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951de2080 0x562951e65400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ef30ff713aa866 server_cookie=c2193c12850c2c6f in_seq=0 out_seq=0 2024-09-10T08:30:50.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.082+0000 7f835cc00640 10 client.5052 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.086+0000 7f835cc00640 1 -- 172.21.15.52:0/3514725511 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562951d0b1f0 con 0x562951de2080 2024-09-10T08:30:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.086+0000 7f835cc00640 10 client.5052 handle_command_reply: tid=0 2024-09-10T08:30:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.086+0000 7f8379a15740 1 client.5052 shutdown 2024-09-10T08:30:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 msgr2=0x562951e640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8358005d70 tx=0x7f8358001080 comp rx=0 tx=0).stop 2024-09-10T08:30:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 shutdown_connections 2024-09-10T08:30:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x562951de2080 0x562951e65400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562951df5c20 0x562951e64ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562951da0830 0x562951e640c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 --2- 172.21.15.52:0/3514725511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x562951d9dff0 0x562951de3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 >> 172.21.15.52:0/3514725511 conn(0x562951d9bf30 msgr2=0x562951de6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f835cc00640 0 client.5052 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 shutdown_connections 2024-09-10T08:30:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 1 -- 172.21.15.52:0/3514725511 wait complete. 2024-09-10T08:30:50.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.087+0000 7f8379a15740 20 client.5052 trim_cache size 0 max 16384 2024-09-10T08:30:50.092 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:30:50.092 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:30:50.092 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "c82fa22f-f08e-4886-abd2-603b551ee42a", 2024-09-10T08:30:50.092 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:30:50.092 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 msgr2=0x7f834c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8360034000 tx=0x7f836002e000 comp rx=0 tx=0).stop 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 msgr2=0x7f83700af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f836800efc0 tx=0x7f836800c490 comp rx=0 tx=0).stop 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 shutdown_connections 2024-09-10T08:30:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8370158ef0 0x7f83700af5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f837006fbc0 0x7f83700af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 --2- 172.21.15.52:0/3005872721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f837006c150 0x7f837015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 >> 172.21.15.52:0/3005872721 conn(0x7f8370067da0 msgr2=0x7f837006e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 shutdown_connections 2024-09-10T08:30:50.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.088+0000 7f8376a00640 1 -- 172.21.15.52:0/3005872721 wait complete. 2024-09-10T08:30:50.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:30:50.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T08:30:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.326+0000 7f58c3e00640 1 Processor -- start 2024-09-10T08:30:50.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.326+0000 7f58c3e00640 1 -- start start 2024-09-10T08:30:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.327+0000 7f58c3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f58c40b7c10 0x7f58c40b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c3e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c40d36e0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c3e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f58c40d3950 con 0x7f58c40b7c10 2024-09-10T08:30:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40d3c30 con 0x7f58c40d32c0 2024-09-10T08:30:50.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c2a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f58c40b5fd0 0x7f58c40b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40786/0 (socket says 172.21.15.52:40786) 2024-09-10T08:30:50.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c2a00640 1 -- 172.21.15.52:0/384946961 learned_addr learned my addr 172.21.15.52:0/384946961 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c3400640 1 --2- 172.21.15.52:0/384946961 >> v2:172.21.15.52:3300/0 conn(0x7f58c40b7c10 0x7f58c40b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.328+0000 7f58c2000640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.329+0000 7f58c3400640 1 -- 172.21.15.52:0/384946961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 msgr2=0x7f58c40cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.329+0000 7f58c3400640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.329+0000 7f58c3400640 1 -- 172.21.15.52:0/384946961 >> v1:172.21.15.52:6789/0 conn(0x7f58c40b5fd0 legacy=0x7f58c40b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.329+0000 7f58c3400640 1 -- 172.21.15.52:0/384946961 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c40d3f10 con 0x7f58c40b7c10 2024-09-10T08:30:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.329+0000 7f58c1600640 1 -- 172.21.15.52:0/384946961 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138749031 0 0) 0x7f58c40d36e0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.330+0000 7f58c3400640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40b80c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009d90 tx=0x7f58bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee366514b1abd2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.331+0000 7f58c1600640 1 -- 172.21.15.52:0/384946961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007740 con 0x7f58c40b7c10 2024-09-10T08:30:50.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.331+0000 7f58c1600640 1 -- 172.21.15.52:0/384946961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc0078e0 con 0x7f58c40b7c10 2024-09-10T08:30:50.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.331+0000 7f58c1600640 1 -- 172.21.15.52:0/384946961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc007cb0 con 0x7f58c40b7c10 2024-09-10T08:30:50.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 -- 172.21.15.52:0/384946961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 msgr2=0x7f58c40b80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40b80c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009d90 tx=0x7f58bc02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 -- 172.21.15.52:0/384946961 shutdown_connections 2024-09-10T08:30:50.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40b80c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 --2- 172.21.15.52:0/384946961 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 -- 172.21.15.52:0/384946961 >> 172.21.15.52:0/384946961 conn(0x7f58c40d0fd0 msgr2=0x7f58c40d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.333+0000 7f58c3e00640 1 -- 172.21.15.52:0/384946961 shutdown_connections 2024-09-10T08:30:50.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.334+0000 7f58c3e00640 1 -- 172.21.15.52:0/384946961 wait complete. 2024-09-10T08:30:50.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.337+0000 7f58c3e00640 1 Processor -- start 2024-09-10T08:30:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.337+0000 7f58c3e00640 1 -- start start 2024-09-10T08:30:50.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40cfb90 con 0x7f58c40b7c10 2024-09-10T08:30:50.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40b7680 con 0x7f58c40b5fd0 2024-09-10T08:30:50.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40cfd10 con 0x7f58c40d32c0 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36686/0 (socket says 172.21.15.52:36686) 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c2a00640 1 -- 172.21.15.52:0/3228610085 learned_addr learned my addr 172.21.15.52:0/3228610085 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.339+0000 7f58c3400640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2000640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2a00640 1 -- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 msgr2=0x7f58c40c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2a00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2a00640 1 -- 172.21.15.52:0/3228610085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 msgr2=0x7f58c40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2a00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2a00640 1 -- 172.21.15.52:0/3228610085 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c40cd120 con 0x7f58c40b5fd0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.340+0000 7f58c2000640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58c2a00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c4d0 tx=0x7f58b400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58baa00640 1 -- 172.21.15.52:0/3228610085 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4018070 con 0x7f58c40b5fd0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58baa00640 1 -- 172.21.15.52:0/3228610085 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b40074e0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c4160c80 con 0x7f58c40b5fd0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58baa00640 1 -- 172.21.15.52:0/3228610085 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4004a20 con 0x7f58c40b5fd0 2024-09-10T08:30:50.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.341+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c40cd3c0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.345+0000 7f58baa00640 1 -- 172.21.15.52:0/3228610085 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58b4004bc0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.347+0000 7f58cc7d4740 1 Processor -- start 2024-09-10T08:30:50.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.347+0000 7f58cc7d4740 1 -- start start 2024-09-10T08:30:50.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.348+0000 7f58baa00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 0x7f58a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58baa00640 1 -- 172.21.15.52:0/3228610085 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f58b408a1a0 con 0x7f58c40b5fd0 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137323d40 0x55f1372e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372e96c0 0x55f13732c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f137243660 con 0x55f1372e96c0 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f1371eb680 con 0x55f1372fdd00 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f13723f620 con 0x55f137323d40 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58c3400640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 0x7f58a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36700/0 (socket says 172.21.15.52:36700) 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.349+0000 7f58c2a00640 1 -- 172.21.15.52:0/808756742 learned_addr learned my addr 172.21.15.52:0/808756742 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 -- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137323d40 msgr2=0x55f1372e2a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137323d40 0x55f1372e2a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 -- 172.21.15.52:0/808756742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372e96c0 msgr2=0x55f13732c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372e96c0 0x55f13732c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 -- 172.21.15.52:0/808756742 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1370207d0 con 0x55f1372fdd00 2024-09-10T08:30:50.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58c2a00640 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58b40609e0 tx=0x7f58b4057e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a306b03b8e5ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.350+0000 7f58af400640 1 -- 172.21.15.52:0/808756742 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40566e0 con 0x55f1372fdd00 2024-09-10T08:30:50.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.351+0000 7f58af400640 1 -- 172.21.15.52:0/808756742 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054a50 con 0x55f1372fdd00 2024-09-10T08:30:50.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.351+0000 7f58c3400640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 0x7f58a406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.351+0000 7f58af400640 1 -- 172.21.15.52:0/808756742 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4057a30 con 0x55f1372fdd00 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.351+0000 7f58cc7d4740 1 -- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 msgr2=0x55f1372fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.351+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f58b40609e0 tx=0x7f58b4057e70 comp rx=0 tx=0).stop 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 -- 172.21.15.52:0/808756742 shutdown_connections 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372e96c0 0x55f13732c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137323d40 0x55f1372e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/808756742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f1372fe0e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 -- 172.21.15.52:0/808756742 >> 172.21.15.52:0/808756742 conn(0x55f1372e4c20 msgr2=0x55f13732d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 -- 172.21.15.52:0/808756742 shutdown_connections 2024-09-10T08:30:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 -- 172.21.15.52:0/808756742 wait complete. 2024-09-10T08:30:50.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.352+0000 7f58cc7d4740 1 -- start start 2024-09-10T08:30:50.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.353+0000 7f58cc7d4740 1 Processor -- start 2024-09-10T08:30:50.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1373125d0 0x55f137328400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137328940 0x55f137324130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f13732c0c0 con 0x55f1373125d0 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f1371cc4c0 con 0x55f1372fdd00 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f13732b790 con 0x55f137328940 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.354+0000 7f58cc7d4740 10 client.0 _ll_register_callbacks cb 0x55f13723be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36712/0 (socket says 172.21.15.52:36712) 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 -- 172.21.15.52:0/1752062043 learned_addr learned my addr 172.21.15.52:0/1752062043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2000640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1373125d0 0x55f137328400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c3400640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137328940 0x55f137324130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 -- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137328940 msgr2=0x55f137324130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137328940 0x55f137324130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 -- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1373125d0 msgr2=0x55f137328400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1373125d0 0x55f137328400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.355+0000 7f58c2a00640 1 -- 172.21.15.52:0/1752062043 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f136f563f0 con 0x55f1372fdd00 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.356+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58b40580e0 tx=0x7f58b408a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6abecd0b7e15dd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.356+0000 7f58a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-10T08:30:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.356+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b405c180 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.356+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b4054a50 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f58b405c320 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f58b40880d0 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 10 client.4930 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f136f160f0 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054a50 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f58b4054130 con 0x55f1372fdd00 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 10 client.4930 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 10 client.4930 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:50.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 20 client.4930 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f137324670 0x55f1372e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 4 client.4930 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:30:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.357+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f137250d90 con 0x55f137324670 2024-09-10T08:30:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.358+0000 7f58c2000640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f137324670 0x55f1372e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.359+0000 7f58c2000640 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f137324670 0x55f1372e7ea0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238b0517e9cb270c server_cookie=c0ad9c4409294dc9 in_seq=0 out_seq=0 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.359+0000 7f58a3e00640 10 client.4930 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.360+0000 7f58a3e00640 1 -- 172.21.15.52:0/1752062043 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f137250d90 con 0x55f137324670 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.360+0000 7f58a3e00640 10 client.4930 handle_command_reply: tid=0 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.360+0000 7f58cc7d4740 1 client.4930 shutdown 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 msgr2=0x55f137325510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58b40580e0 tx=0x7f58b408a040 comp rx=0 tx=0).stop 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 shutdown_connections 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f137324670 0x55f1372e7ea0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f137328940 0x55f137324130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1373125d0 0x55f137328400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1752062043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f1372fdd00 0x55f137325510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 >> 172.21.15.52:0/1752062043 conn(0x55f1372e96c0 msgr2=0x55f1372fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58a3e00640 0 client.4930 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.361+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 shutdown_connections 2024-09-10T08:30:50.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.362+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1752062043 wait complete. 2024-09-10T08:30:50.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.362+0000 7f58cc7d4740 20 client.4930 trim_cache size 0 max 16384 2024-09-10T08:30:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.398+0000 7f58cc7d4740 1 Processor -- start 2024-09-10T08:30:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.398+0000 7f58cc7d4740 1 -- start start 2024-09-10T08:30:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1372fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f13732c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4071130 con 0x55f1372fdd00 2024-09-10T08:30:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4070190 con 0x55f137328940 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.399+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58c41f83f0 con 0x55f1373125d0 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47360/0 (socket says 172.21.15.52:47360) 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 -- 172.21.15.52:0/418855133 learned_addr learned my addr 172.21.15.52:0/418855133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2000640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1372fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c3400640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f13732c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 -- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 msgr2=0x55f1372fcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1372fcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 -- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 msgr2=0x55f13732c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f13732c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2a00640 1 -- 172.21.15.52:0/418855133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f137279b80 con 0x55f1372fdd00 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.400+0000 7f58c2000640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1372fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.401+0000 7f58c2a00640 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f58b4056910 tx=0x7f58b406e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61932fcc866b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.401+0000 7f58aea00640 1 -- 172.21.15.52:0/418855133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4077350 con 0x55f1372fdd00 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.401+0000 7f58aea00640 1 -- 172.21.15.52:0/418855133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4070020 con 0x55f1372fdd00 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.401+0000 7f58aea00640 1 -- 172.21.15.52:0/418855133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4054a50 con 0x55f1372fdd00 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 -- 172.21.15.52:0/418855133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 msgr2=0x55f13732d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f58b4056910 tx=0x7f58b406e070 comp rx=0 tx=0).stop 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 -- 172.21.15.52:0/418855133 shutdown_connections 2024-09-10T08:30:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f13732c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1372fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/418855133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f13732d3c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 -- 172.21.15.52:0/418855133 >> 172.21.15.52:0/418855133 conn(0x55f1372e96c0 msgr2=0x55f13732a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 -- 172.21.15.52:0/418855133 shutdown_connections 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.402+0000 7f58cc7d4740 1 -- 172.21.15.52:0/418855133 wait complete. 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.403+0000 7f58cc7d4740 1 -- start start 2024-09-10T08:30:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.403+0000 7f58cc7d4740 1 Processor -- start 2024-09-10T08:30:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1373ab850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f137325f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f13723f5b0 con 0x55f1372fdd00 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41606c0 con 0x55f137328940 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f1373404e0 con 0x55f1373125d0 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58cc7d4740 10 client.0 _ll_register_callbacks cb 0x7f58b4057d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58c2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47372/0 (socket says 172.21.15.52:47372) 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.405+0000 7f58c2a00640 1 -- 172.21.15.52:0/1982257547 learned_addr learned my addr 172.21.15.52:0/1982257547 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 -- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 msgr2=0x55f1373ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1373ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 -- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 msgr2=0x55f137325f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:30:50.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f137325f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 -- 172.21.15.52:0/1982257547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f13732c590 con 0x55f1372fdd00 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58c2a00640 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ce90 tx=0x7f58b4007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa35a841c8c1509 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4057b40 con 0x55f1372fdd00 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f58b4078e00 con 0x55f1372fdd00 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b4070020 con 0x55f1372fdd00 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.406+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f58b40701d0 con 0x55f1372fdd00 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58cc7d4740 10 client.5070 fetch_fsmap learned FSMap version 18 2024-09-10T08:30:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55f13732c590 con 0x55f1372fdd00 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4070020 con 0x55f1372fdd00 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f58b405c180 con 0x55f1372fdd00 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58cc7d4740 10 client.5070 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58cc7d4740 10 client.5070 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.407+0000 7f58cc7d4740 20 client.5070 populate_metadata read hostname 'smithi052' 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f1372fa2c0 0x55f1372fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58cc7d4740 4 client.5070 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f13724b0e0 con 0x55f1372fa2c0 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58c2000640 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f1372fa2c0 0x55f1372fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58c2000640 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f1372fa2c0 0x55f1372fa6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9286bb8d4ced7e0 server_cookie=21f0377d3bd5a73e in_seq=0 out_seq=0 2024-09-10T08:30:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.408+0000 7f58a3e00640 10 client.5070 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.453+0000 7f58a3e00640 1 -- 172.21.15.52:0/1982257547 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+274 (crc 0 0 0) 0x55f13724b0e0 con 0x55f1372fa2c0 2024-09-10T08:30:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.453+0000 7f58a3e00640 10 client.5070 handle_command_reply: tid=0 2024-09-10T08:30:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.453+0000 7f58cc7d4740 1 client.5070 shutdown 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 msgr2=0x55f137343960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ce90 tx=0x7f58b4007710 comp rx=0 tx=0).stop 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 shutdown_connections 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55f1372fa2c0 0x55f1372fa6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f137328940 0x55f137325f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f1373125d0 0x55f1373ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 --2- 172.21.15.52:0/1982257547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1372fdd00 0x55f137343960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 >> 172.21.15.52:0/1982257547 conn(0x55f1372e96c0 msgr2=0x55f1372fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.454+0000 7f58a3e00640 0 client.5070 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.455+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 shutdown_connections 2024-09-10T08:30:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.455+0000 7f58cc7d4740 1 -- 172.21.15.52:0/1982257547 wait complete. 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.455+0000 7f58cc7d4740 20 client.5070 trim_cache size 0 max 16384 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "scrub active (182 inodes in the stack)", 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stdout: "c82fa22f-f08e-4886-abd2-603b551ee42a": { 2024-09-10T08:30:50.456 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-10T08:30:50.457 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "c82fa22f-f08e-4886-abd2-603b551ee42a", 2024-09-10T08:30:50.457 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,scrub_mdsdir" 2024-09-10T08:30:50.457 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:50.457 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:30:50.457 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.456+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 msgr2=0x7f58a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.456+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 0x7f58a406e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.456+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 msgr2=0x7f58c4152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.456+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c4d0 tx=0x7f58b400c990 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 shutdown_connections 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f58a406be30 0x7f58a406e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58c40d32c0 0x7f58c40c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c40b7c10 0x7f58c40cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 --2- 172.21.15.52:0/3228610085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58c40b5fd0 0x7f58c4152d00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:30:50.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 >> 172.21.15.52:0/3228610085 conn(0x7f58c40d0fd0 msgr2=0x7f58c40b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:30:50.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.457+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 shutdown_connections 2024-09-10T08:30:50.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:30:50.458+0000 7f58c3e00640 1 -- 172.21.15.52:0/3228610085 wait complete. 2024-09-10T08:30:50.478 INFO:tasks.cephfs.filesystem:scrub status for tag:c82fa22f-f08e-4886-abd2-603b551ee42a - {'path': '/', 'tag': 'c82fa22f-f08e-4886-abd2-603b551ee42a', 'options': 'recursive,scrub_mdsdir'} 2024-09-10T08:31:05.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:05.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:20.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:20.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-10T08:31:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.649+0000 7f2afda00640 1 Processor -- start 2024-09-10T08:31:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.650+0000 7f2afda00640 1 -- start start 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2afda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2af8073a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2afda00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af815f650 con 0x7f2af8073fa0 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2afda00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af815f930 con 0x7f2af80cf3b0 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2afda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2af80735d0 con 0x7f2af815e650 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2aef400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2af8073fa0 0x7f2af80ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48708/0 (socket says 172.21.15.52:48708) 2024-09-10T08:31:20.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2aef400640 1 -- 172.21.15.52:0/2777541488 learned_addr learned my addr 172.21.15.52:0/2777541488 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:20.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2af8073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.651+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761447428 0 0) 0x7f2af815f650 con 0x7f2af8073fa0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2adc003520 con 0x7f2af8073fa0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 848137340 0 0) 0x7f2adc003520 con 0x7f2af8073fa0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 msgr2=0x7f2af8073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2af8073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 >> v1:172.21.15.176:6789/0 conn(0x7f2af80cf3b0 legacy=0x7f2af815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af8072f80 con 0x7f2af8073fa0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f2ae0001670 con 0x7f2af8073fa0 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 >> v1:172.21.15.52:6789/0 conn(0x7f2af8073fa0 legacy=0x7f2af80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc0039e0 0x7f2adc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2adc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc004d40 0x7f2adc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2af80735d0 con 0x7f2adc0039e0 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc00bb50 con 0x7f2adc004d40 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc00bd50 con 0x7f2af815e650 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc0039e0 0x7f2adc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.652+0000 7f2aef400640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2adc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2afd000640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc004d40 0x7f2adc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2af7e00640 1 -- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 msgr2=0x7f2adc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af815e650 0x7f2adc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2af7e00640 1 -- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc004d40 msgr2=0x7f2adc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc004d40 0x7f2adc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.653+0000 7f2af7e00640 1 -- 172.21.15.52:0/2777541488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc003520 con 0x7f2adc0039e0 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.654+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc0039e0 0x7f2adc003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2adc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b791aada1a8bba80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.654+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8036070 con 0x7f2adc0039e0 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.654+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae8031400 con 0x7f2adc0039e0 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.654+0000 7f2af7400640 1 -- 172.21.15.52:0/2777541488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8009690 con 0x7f2adc0039e0 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 -- 172.21.15.52:0/2777541488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc0039e0 msgr2=0x7f2adc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 --2- 172.21.15.52:0/2777541488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2adc0039e0 0x7f2adc003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2adc005830 comp rx=0 tx=0).stop 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afd000640 1 -- 172.21.15.52:0/2777541488 reap_dead start 2024-09-10T08:31:20.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 -- 172.21.15.52:0/2777541488 shutdown_connections 2024-09-10T08:31:20.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 -- 172.21.15.52:0/2777541488 >> 172.21.15.52:0/2777541488 conn(0x7f2af80b40d0 msgr2=0x7f2af80b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 -- 172.21.15.52:0/2777541488 shutdown_connections 2024-09-10T08:31:20.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.655+0000 7f2afda00640 1 -- 172.21.15.52:0/2777541488 wait complete. 2024-09-10T08:31:20.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.656+0000 7f2afda00640 1 Processor -- start 2024-09-10T08:31:20.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 -- start start 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc0039e0 0x7f2af8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af81f50a0 0x7f2af81457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2af815f140 con 0x7f2af80d26f0 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2af806f400 con 0x7f2adc0039e0 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.657+0000 7f2afda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2af815f2c0 con 0x7f2af81f50a0 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50020/0 (socket says 172.21.15.52:50020) 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 -- 172.21.15.52:0/1071607571 learned_addr learned my addr 172.21.15.52:0/1071607571 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2af7e00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc0039e0 0x7f2af8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2aef400640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af81f50a0 0x7f2af81457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 -- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af81f50a0 msgr2=0x7f2af81457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af81f50a0 0x7f2af81457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 -- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc0039e0 msgr2=0x7f2af8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc0039e0 0x7f2af8155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 -- 172.21.15.52:0/1071607571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af8156130 con 0x7f2af80d26f0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.658+0000 7f2afd000640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2af8069e30 tx=0x7f2af000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.659+0000 7f2af4c00640 1 -- 172.21.15.52:0/1071607571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af001a070 con 0x7f2af80d26f0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.659+0000 7f2af4c00640 1 -- 172.21.15.52:0/1071607571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af0006d60 con 0x7f2af80d26f0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.659+0000 7f2af4c00640 1 -- 172.21.15.52:0/1071607571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af000fea0 con 0x7f2af80d26f0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.659+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af81483f0 con 0x7f2af80d26f0 2024-09-10T08:31:20.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.659+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81489b0 con 0x7f2af80d26f0 2024-09-10T08:31:20.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.662+0000 7f2af4c00640 1 -- 172.21.15.52:0/1071607571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2af001d070 con 0x7f2af80d26f0 2024-09-10T08:31:20.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.663+0000 7f2af4c00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 0x7f2ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.663+0000 7f2af4c00640 1 -- 172.21.15.52:0/1071607571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f2af008a420 con 0x7f2af80d26f0 2024-09-10T08:31:20.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.663+0000 7f2b01eb6740 1 Processor -- start 2024-09-10T08:31:20.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.663+0000 7f2b01eb6740 1 -- start start 2024-09-10T08:31:20.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.663+0000 7f2af7e00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 0x7f2ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f1a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 0x5609c4eff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f4b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609c4e68660 con 0x5609c4f009e0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5609c4e10680 con 0x5609c4f1a4f0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5609c4e64620 con 0x5609c4f4aea0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2af7e00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 0x7f2ad406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8033000 tx=0x7f2ae8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2aef400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 0x5609c4eff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.664+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f1a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f1a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:49968/0 (socket says 172.21.15.52:49968) 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2af7e00640 1 -- 172.21.15.52:0/370839976 learned_addr learned my addr 172.21.15.52:0/370839976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2afd000640 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f4b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 -- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 msgr2=0x5609c4f4b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f4b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 -- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 msgr2=0x5609c4f1a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f1a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 -- 172.21.15.52:0/370839976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c4c457d0 con 0x5609c4f009e0 2024-09-10T08:31:20.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aef400640 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 0x5609c4eff240 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0007c50 tx=0x7f2ae0004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af8fa531412287e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aecc00640 1 -- 172.21.15.52:0/370839976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0004ce0 con 0x5609c4f009e0 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aecc00640 1 -- 172.21.15.52:0/370839976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae001a070 con 0x5609c4f009e0 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.665+0000 7f2aecc00640 1 -- 172.21.15.52:0/370839976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0015640 con 0x5609c4f009e0 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 -- 172.21.15.52:0/370839976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 msgr2=0x5609c4eff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 0x5609c4eff240 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0007c50 tx=0x7f2ae0004bb0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 -- 172.21.15.52:0/370839976 shutdown_connections 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f4b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f009e0 0x5609c4eff240 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/370839976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f1a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 -- 172.21.15.52:0/370839976 >> 172.21.15.52:0/370839976 conn(0x5609c4f01410 msgr2=0x5609c4f49a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 -- 172.21.15.52:0/370839976 shutdown_connections 2024-09-10T08:31:20.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.666+0000 7f2b01eb6740 1 -- 172.21.15.52:0/370839976 wait complete. 2024-09-10T08:31:20.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.667+0000 7f2b01eb6740 1 -- start start 2024-09-10T08:31:20.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.667+0000 7f2b01eb6740 1 Processor -- start 2024-09-10T08:31:20.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f5dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f3fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609c4eff940 con 0x5609c4f45670 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5609c4df14c0 con 0x5609c4f1a4f0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5609c4effc20 con 0x5609c4f4aea0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2b01eb6740 10 client.0 _ll_register_callbacks cb 0x5609c4e60e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2afd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2aef400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f3fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2afd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50042/0 (socket says 172.21.15.52:50042) 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2afd000640 1 -- 172.21.15.52:0/556286604 learned_addr learned my addr 172.21.15.52:0/556286604 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.668+0000 7f2af7e00640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f5dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 -- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 msgr2=0x5609c4f5dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f5dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 -- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 msgr2=0x5609c4f40a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 -- 172.21.15.52:0/556286604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5609c4b7b3f0 con 0x5609c4f4aea0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2afd000640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2aef400640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f3fa10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5609c4f4ab30 tx=0x7f2af815fb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c3ccd11e687c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2ae5600640 10 client.0 ms_handle_connect on v2:172.21.15.176:3301/0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.669+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0015850 con 0x5609c4f4aea0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae001a070 con 0x5609c4f4aea0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mon.2 v2:172.21.15.176:3301/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f2ae002ab50 con 0x5609c4f4aea0 2024-09-10T08:31:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2ae002ad50 con 0x5609c4f4aea0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 10 client.4763 fetch_fsmap learned FSMap version 18 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5609c4b3b0f0 con 0x5609c4f4aea0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mon.2 v2:172.21.15.176:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae001a070 con 0x5609c4f4aea0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mon.2 v2:172.21.15.176:3301/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f2ae00159f0 con 0x5609c4f4aea0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 10 client.4763 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 10 client.4763 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 20 client.4763 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f449f0 0x5609c4f59ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 4 client.4763 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.670+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609c4e75d90 con 0x5609c4f449f0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.671+0000 7f2af7e00640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f449f0 0x5609c4f59ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.671+0000 7f2af7e00640 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f449f0 0x5609c4f59ae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f64b0b6d988e24ec server_cookie=ee9e8ea91cd97ec0 in_seq=0 out_seq=0 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.671+0000 7f2ae5600640 10 client.4763 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2ae5600640 1 -- 172.21.15.52:0/556286604 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609c4e75d90 con 0x5609c4f449f0 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2ae5600640 10 client.4763 handle_command_reply: tid=0 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 client.4763 shutdown 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 msgr2=0x5609c4f3fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f3fa10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5609c4f4ab30 tx=0x7f2af815fb00 comp rx=0 tx=0).stop 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 shutdown_connections 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f449f0 0x5609c4f59ae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f45670 0x5609c4f40a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f3fa10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/556286604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f1a4f0 0x5609c4f5dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 >> 172.21.15.52:0/556286604 conn(0x5609c4f009e0 msgr2=0x5609c4f49a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2ae5600640 0 client.4763 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 shutdown_connections 2024-09-10T08:31:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.672+0000 7f2b01eb6740 1 -- 172.21.15.52:0/556286604 wait complete. 2024-09-10T08:31:20.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.673+0000 7f2b01eb6740 20 client.4763 trim_cache size 0 max 16384 2024-09-10T08:31:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.690+0000 7f2b01eb6740 1 Processor -- start 2024-09-10T08:31:20.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 -- start start 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f45670 0x5609c4f5c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f2e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2af8201440 con 0x5609c4f1a4f0 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2af8200460 con 0x5609c4f45670 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.691+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2af81f8560 con 0x5609c4f4aea0 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50058/0 (socket says 172.21.15.52:50058) 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 -- 172.21.15.52:0/4016168628 learned_addr learned my addr 172.21.15.52:0/4016168628 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2aef400640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f45670 0x5609c4f5c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2afd000640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f2e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 -- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 msgr2=0x5609c4f2e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f2e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 -- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f45670 msgr2=0x5609c4f5c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f45670 0x5609c4f5c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 -- 172.21.15.52:0/4016168628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c4f5dce0 con 0x5609c4f1a4f0 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2afd000640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f2e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.692+0000 7f2af7e00640 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2ae802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ee8842a4b0c951 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2ae7e00640 1 -- 172.21.15.52:0/4016168628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8041040 con 0x5609c4f1a4f0 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2ae7e00640 1 -- 172.21.15.52:0/4016168628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae8057070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2ae7e00640 1 -- 172.21.15.52:0/4016168628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8036040 con 0x5609c4f1a4f0 2024-09-10T08:31:20.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 -- 172.21.15.52:0/4016168628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 msgr2=0x5609c4f48290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2ae802f000 comp rx=0 tx=0).stop 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 -- 172.21.15.52:0/4016168628 shutdown_connections 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f4aea0 0x5609c4f2e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f45670 0x5609c4f5c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/4016168628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4f48290 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 -- 172.21.15.52:0/4016168628 >> 172.21.15.52:0/4016168628 conn(0x5609c4f009e0 msgr2=0x5609c4f44dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 -- 172.21.15.52:0/4016168628 shutdown_connections 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.693+0000 7f2b01eb6740 1 -- 172.21.15.52:0/4016168628 wait complete. 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.694+0000 7f2b01eb6740 1 -- start start 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.694+0000 7f2b01eb6740 1 Processor -- start 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f45670 0x5609c4fc6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f4aea0 0x5609c4f2e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609c4f5df60 con 0x5609c4f1a4f0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2af81fff60 con 0x5609c4f4aea0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5609c4f4a270 con 0x5609c4f45670 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2b01eb6740 10 client.0 _ll_register_callbacks cb 0x7f2adc0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50068/0 (socket says 172.21.15.52:50068) 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2af7e00640 1 -- 172.21.15.52:0/2324137123 learned_addr learned my addr 172.21.15.52:0/2324137123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2afd000640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f4aea0 0x5609c4f2e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.695+0000 7f2aef400640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f45670 0x5609c4fc6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 -- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f45670 msgr2=0x5609c4fc6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f45670 0x5609c4fc6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 -- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f4aea0 msgr2=0x5609c4f2e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f4aea0 0x5609c4f2e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 -- 172.21.15.52:0/2324137123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c4f41ff0 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2af7e00640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a134b4a491aed60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2ae5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8060070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae8057070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f2ae8003d20 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2ae8036070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2b01eb6740 10 client.5088 fetch_fsmap learned FSMap version 18 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.696+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5609c4f04d40 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae8057070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f2ae8052070 con 0x5609c4f1a4f0 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 10 client.5088 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 10 client.5088 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 20 client.5088 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f2eb60 0x5609c4f2d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 4 client.5088 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609c4e700e0 con 0x5609c4f2eb60 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.697+0000 7f2aef400640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f2eb60 0x5609c4f2d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2aef400640 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f2eb60 0x5609c4f2d270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06740b533f8050b server_cookie=af4f03d31bced501 in_seq=0 out_seq=0 2024-09-10T08:31:20.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2ae5600640 10 client.5088 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2ae5600640 1 -- 172.21.15.52:0/2324137123 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5609c4e700e0 con 0x5609c4f2eb60 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2ae5600640 10 client.5088 handle_command_reply: tid=0 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 client.5088 shutdown 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 msgr2=0x5609c4efeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae80046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 shutdown_connections 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x5609c4f2eb60 0x5609c4f2d270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5609c4f4aea0 0x5609c4f2e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5609c4f45670 0x5609c4fc6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2ae5600640 0 client.5088 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 --2- 172.21.15.52:0/2324137123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609c4f1a4f0 0x5609c4efeb50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 >> 172.21.15.52:0/2324137123 conn(0x5609c4f009e0 msgr2=0x5609c4f48290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 shutdown_connections 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 1 -- 172.21.15.52:0/2324137123 wait complete. 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.698+0000 7f2b01eb6740 20 client.5088 trim_cache size 0 max 16384 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:31:20.704 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 msgr2=0x7f2ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 0x7f2ad406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8033000 tx=0x7f2ae8008030 comp rx=0 tx=0).stop 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 msgr2=0x7f2af80d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2af8069e30 tx=0x7f2af000fc50 comp rx=0 tx=0).stop 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 shutdown_connections 2024-09-10T08:31:20.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ad406be30 0x7f2ad406e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2af80d26f0 0x7f2af80d2b70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2af81f50a0 0x7f2af81457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 --2- 172.21.15.52:0/1071607571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2adc0039e0 0x7f2af8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 >> 172.21.15.52:0/1071607571 conn(0x7f2af80b40d0 msgr2=0x7f2af80b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 shutdown_connections 2024-09-10T08:31:20.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.699+0000 7f2afda00640 1 -- 172.21.15.52:0/1071607571 wait complete. 2024-09-10T08:31:20.715 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:31:20.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-10T08:31:20.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.872+0000 7f4781c00640 1 Processor -- start 2024-09-10T08:31:20.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.872+0000 7f4781c00640 1 -- start start 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4781c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 0x7f477c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4781c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4781c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0714b0 con 0x7f477c0cce30 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4781c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f477c073c00 con 0x7f477c0cd270 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4781c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f477c0cd880 con 0x7f477c0732e0 2024-09-10T08:31:20.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4772000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f477c0cce30 0x7f477c071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48714/0 (socket says 172.21.15.52:48714) 2024-09-10T08:31:20.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f4772000640 1 -- 172.21.15.52:0/3011748285 learned_addr learned my addr 172.21.15.52:0/3011748285 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:20.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f477aa00640 1 --2- 172.21.15.52:0/3011748285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 0x7f477c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f477b400640 1 --2- 172.21.15.52:0/3011748285 >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.874+0000 7f477a000640 1 -- 172.21.15.52:0/3011748285 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198517371 0 0) 0x7f477c0714b0 con 0x7f477c0cce30 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477a000640 1 -- 172.21.15.52:0/3011748285 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4760003520 con 0x7f477c0cce30 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477aa00640 1 -- 172.21.15.52:0/3011748285 >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 msgr2=0x7f477c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477aa00640 1 --2- 172.21.15.52:0/3011748285 >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477aa00640 1 -- 172.21.15.52:0/3011748285 >> v1:172.21.15.52:6789/0 conn(0x7f477c0cce30 legacy=0x7f477c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477aa00640 1 -- 172.21.15.52:0/3011748285 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c0cdb60 con 0x7f477c0732e0 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.875+0000 7f477b400640 1 --2- 172.21.15.52:0/3011748285 >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:20.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f477aa00640 1 --2- 172.21.15.52:0/3011748285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 0x7f477c0736c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f476c0097a0 tx=0x7f476c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d7dafe8376da62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f477a000640 1 -- 172.21.15.52:0/3011748285 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c037070 con 0x7f477c0732e0 2024-09-10T08:31:20.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f477a000640 1 -- 172.21.15.52:0/3011748285 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c02ae50 con 0x7f477c0732e0 2024-09-10T08:31:20.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f477a000640 1 -- 172.21.15.52:0/3011748285 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c032660 con 0x7f477c0732e0 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f4781c00640 1 -- 172.21.15.52:0/3011748285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 msgr2=0x7f477c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.876+0000 7f4781c00640 1 --2- 172.21.15.52:0/3011748285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 0x7f477c0736c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f476c0097a0 tx=0x7f476c02a100 comp rx=0 tx=0).stop 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 -- 172.21.15.52:0/3011748285 shutdown_connections 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 --2- 172.21.15.52:0/3011748285 >> v2:172.21.15.176:3300/0 conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 --2- 172.21.15.52:0/3011748285 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0732e0 0x7f477c0736c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 -- 172.21.15.52:0/3011748285 >> 172.21.15.52:0/3011748285 conn(0x7f477c06d0f0 msgr2=0x7f477c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 -- 172.21.15.52:0/3011748285 shutdown_connections 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.877+0000 7f4781c00640 1 -- 172.21.15.52:0/3011748285 wait complete. 2024-09-10T08:31:20.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.878+0000 7f4781c00640 1 Processor -- start 2024-09-10T08:31:20.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.878+0000 7f4781c00640 1 -- start start 2024-09-10T08:31:20.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477c0732e0 0x7f477c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0cce30 0x7f477c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f477c06bf70 con 0x7f477c0cd270 2024-09-10T08:31:20.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f477c06bdf0 con 0x7f477c0732e0 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.879+0000 7f4781c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f477c072380 con 0x7f477c0cce30 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50082/0 (socket says 172.21.15.52:50082) 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 -- 172.21.15.52:0/4275527835 learned_addr learned my addr 172.21.15.52:0/4275527835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f4772000640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0cce30 0x7f477c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477aa00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477c0732e0 0x7f477c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 -- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0cce30 msgr2=0x7f477c0cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0cce30 0x7f477c0cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 -- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477c0732e0 msgr2=0x7f477c14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477c0732e0 0x7f477c14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 -- 172.21.15.52:0/4275527835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c14d6d0 con 0x7f477c0cd270 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.880+0000 7f477b400640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f477400efc0 tx=0x7f4774009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.881+0000 7f4773400640 1 -- 172.21.15.52:0/4275527835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774018030 con 0x7f477c0cd270 2024-09-10T08:31:20.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.881+0000 7f4773400640 1 -- 172.21.15.52:0/4275527835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477400cde0 con 0x7f477c0cd270 2024-09-10T08:31:20.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.881+0000 7f4773400640 1 -- 172.21.15.52:0/4275527835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774003bb0 con 0x7f477c0cd270 2024-09-10T08:31:20.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.881+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c14d9b0 con 0x7f477c0cd270 2024-09-10T08:31:20.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.881+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c14df70 con 0x7f477c0cd270 2024-09-10T08:31:20.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.883+0000 7f4773400640 1 -- 172.21.15.52:0/4275527835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4774005d10 con 0x7f477c0cd270 2024-09-10T08:31:20.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.883+0000 7f4773400640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.884+0000 7f4773400640 1 -- 172.21.15.52:0/4275527835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f477408bac0 con 0x7f477c0cd270 2024-09-10T08:31:20.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.884+0000 7f477aa00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.884+0000 7f4784c1c740 1 Processor -- start 2024-09-10T08:31:20.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.884+0000 7f4784c1c740 1 -- start start 2024-09-10T08:31:20.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f477aa00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 0x7f475806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f476c034000 tx=0x7f476c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986faa0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 0x55986fabca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55986fa3dcf0 con 0x55986fa74240 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55986f9d97f0 con 0x55986fabb2a0 2024-09-10T08:31:20.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.885+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55986f981800 con 0x55986faa08e0 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50098/0 (socket says 172.21.15.52:50098) 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 -- 172.21.15.52:0/200945908 learned_addr learned my addr 172.21.15.52:0/200945908 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477aa00640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986faa0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 -- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 msgr2=0x55986faa0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f4772000640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 0x55986fabca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986faa0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 -- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 msgr2=0x55986fabca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 0x55986fabca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 -- 172.21.15.52:0/200945908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986f7b67d0 con 0x55986fa74240 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477aa00640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986faa0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f4772000640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 0x55986fabca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:20.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.886+0000 7f477b400640 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f477400cae0 tx=0x7f477405a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39393d04d4fe5b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f476b400640 1 -- 172.21.15.52:0/200945908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774076070 con 0x55986fa74240 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f476b400640 1 -- 172.21.15.52:0/200945908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47740627a0 con 0x55986fa74240 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f476b400640 1 -- 172.21.15.52:0/200945908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774056230 con 0x55986fa74240 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 -- 172.21.15.52:0/200945908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 msgr2=0x55986fabcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f477400cae0 tx=0x7f477405a400 comp rx=0 tx=0).stop 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 -- 172.21.15.52:0/200945908 shutdown_connections 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa74240 0x55986fabcf90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fabb2a0 0x55986fabca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 --2- 172.21.15.52:0/200945908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986faa0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 -- 172.21.15.52:0/200945908 >> 172.21.15.52:0/200945908 conn(0x55986fa73240 msgr2=0x55986fabb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 -- 172.21.15.52:0/200945908 shutdown_connections 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.887+0000 7f4784c1c740 1 -- 172.21.15.52:0/200945908 wait complete. 2024-09-10T08:31:20.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.888+0000 7f4784c1c740 1 -- start start 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.888+0000 7f4784c1c740 1 Processor -- start 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986fa913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fa9d990 0x55986faa1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55986f962750 con 0x55986fabb2a0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55986f9d57b0 con 0x55986fa9d990 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55986faa16a0 con 0x55986faa08e0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4784c1c740 10 client.0 _ll_register_callbacks cb 0x55986f6ebbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4772000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4772000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50100/0 (socket says 172.21.15.52:50100) 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f4772000640 1 -- 172.21.15.52:0/52573788 learned_addr learned my addr 172.21.15.52:0/52573788 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.889+0000 7f477aa00640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986fa913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f477b400640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fa9d990 0x55986faa1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 -- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 msgr2=0x55986fa913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986fa913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 -- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fa9d990 msgr2=0x55986faa1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fa9d990 0x55986faa1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 -- 172.21.15.52:0/52573788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986f6ac0f0 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4772000640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4764000f60 tx=0x7f476400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a868eecc608a668d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f475fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47640058b0 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f4764005a50 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.890+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47740627a0 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4764020050 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 10 client.5100 fetch_fsmap learned FSMap version 18 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55986f816f60 con 0x55986fabb2a0 2024-09-10T08:31:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47740627a0 con 0x55986fabb2a0 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4764023020 con 0x55986fabb2a0 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 10 client.5100 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 10 client.5100 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 20 client.5100 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986faa3d80 0x55986faa4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 4 client.5100 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55986f9e6f20 con 0x55986faa3d80 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.891+0000 7f477aa00640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986faa3d80 0x55986faa4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.892+0000 7f477aa00640 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986faa3d80 0x55986faa4160 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d440e5be10560d21 server_cookie=d3b687cd9a44d38e in_seq=0 out_seq=0 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.892+0000 7f475fe00640 10 client.5100 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.892+0000 7f475fe00640 1 -- 172.21.15.52:0/52573788 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55986f9e6f20 con 0x55986faa3d80 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.892+0000 7f475fe00640 10 client.5100 handle_command_reply: tid=0 2024-09-10T08:31:20.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 client.5100 shutdown 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 msgr2=0x55986faa1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4764000f60 tx=0x7f476400f5a0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 shutdown_connections 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986faa3d80 0x55986faa4160 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986fa9d990 0x55986faa1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fabb2a0 0x55986faa1aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f475fe00640 0 client.5100 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 --2- 172.21.15.52:0/52573788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986faa08e0 0x55986fa913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 >> 172.21.15.52:0/52573788 conn(0x55986fa74240 msgr2=0x55986fabec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 shutdown_connections 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 1 -- 172.21.15.52:0/52573788 wait complete. 2024-09-10T08:31:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.893+0000 7f4784c1c740 20 client.5100 trim_cache size 0 max 16384 2024-09-10T08:31:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.910+0000 7f4784c1c740 1 Processor -- start 2024-09-10T08:31:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.910+0000 7f4784c1c740 1 -- start start 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb38c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa76930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0c83d0 con 0x55986fa9d990 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0d0140 con 0x55986faa08e0 2024-09-10T08:31:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f477c0cf4a0 con 0x55986fabb2a0 2024-09-10T08:31:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50110/0 (socket says 172.21.15.52:50110) 2024-09-10T08:31:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 -- 172.21.15.52:0/424953061 learned_addr learned my addr 172.21.15.52:0/424953061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4772000640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb38c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477b400640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa76930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 -- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 msgr2=0x55986fa76930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa76930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 -- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 msgr2=0x55986fb38c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb38c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f477aa00640 1 -- 172.21.15.52:0/424953061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55986f6851b0 con 0x55986fa9d990 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.911+0000 7f4772000640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb38c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.912+0000 7f477aa00640 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f476c0098c0 tx=0x7f476c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb671e6a706217b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.912+0000 7f476aa00640 1 -- 172.21.15.52:0/424953061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c04f070 con 0x55986fa9d990 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.912+0000 7f476aa00640 1 -- 172.21.15.52:0/424953061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c03e660 con 0x55986fa9d990 2024-09-10T08:31:20.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.912+0000 7f476aa00640 1 -- 172.21.15.52:0/424953061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c037040 con 0x55986fa9d990 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- 172.21.15.52:0/424953061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 msgr2=0x55986fa71fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f476c0098c0 tx=0x7f476c02c000 comp rx=0 tx=0).stop 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- 172.21.15.52:0/424953061 shutdown_connections 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa76930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb38c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 --2- 172.21.15.52:0/424953061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fa71fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- 172.21.15.52:0/424953061 >> 172.21.15.52:0/424953061 conn(0x55986fa74240 msgr2=0x55986fa9ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- 172.21.15.52:0/424953061 shutdown_connections 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- 172.21.15.52:0/424953061 wait complete. 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.913+0000 7f4784c1c740 1 -- start start 2024-09-10T08:31:20.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 Processor -- start 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fb3af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb23f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0cfaf0 con 0x55986fa9d990 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55986faa0540 con 0x55986faa08e0 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55986fb3b660 con 0x55986fabb2a0 2024-09-10T08:31:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.914+0000 7f4784c1c740 10 client.0 _ll_register_callbacks cb 0x7f4764007d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f4772000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb23f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f4772000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb23f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:50060/0 (socket says 172.21.15.52:50060) 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f4772000640 1 -- 172.21.15.52:0/2139314841 learned_addr learned my addr 172.21.15.52:0/2139314841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477b400640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa766d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57572/0 (socket says 172.21.15.52:57572) 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fb3af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 -- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 msgr2=0x55986fa766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa766d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 -- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 msgr2=0x55986fb23f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb23f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.915+0000 7f477aa00640 1 -- 172.21.15.52:0/2139314841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55986fb3b450 con 0x55986fa9d990 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f477aa00640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fb3af10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f476c009560 tx=0x7f476c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c109c4ddce2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c04f040 con 0x55986fa9d990 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f476c03ea10 con 0x55986fa9d990 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f476c03e660 con 0x55986fa9d990 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f476c054450 con 0x55986fa9d990 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 10 client.5106 fetch_fsmap learned FSMap version 18 2024-09-10T08:31:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55986fac3f80 con 0x55986fa9d990 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c03e660 con 0x55986fa9d990 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f476c0545f0 con 0x55986fa9d990 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 10 client.5106 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 10 client.5106 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 20 client.5106 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986fb378f0 0x55986fa76c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.916+0000 7f4784c1c740 4 client.5106 mds_command: new command op to 4797 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.917+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 --> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55986fabe9b0 con 0x55986fb378f0 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.917+0000 7f4772000640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986fb378f0 0x55986fa76c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.917+0000 7f4772000640 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986fb378f0 0x55986fa76c10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a658a0af6fdaf90d server_cookie=97de25ef13a2ab68 in_seq=0 out_seq=0 2024-09-10T08:31:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.917+0000 7f475fe00640 10 client.5106 ms_handle_connect on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f475fe00640 1 -- 172.21.15.52:0/2139314841 <== mds.0 v2:172.21.15.52:6832/2946930251 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18001 (crc 0 0 0) 0x55986fabe9b0 con 0x55986fb378f0 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f475fe00640 10 client.5106 handle_command_reply: tid=0 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 client.5106 shutdown 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 msgr2=0x55986fb3af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fb3af10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f476c009560 tx=0x7f476c004730 comp rx=0 tx=0).stop 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 shutdown_connections 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:6832/2946930251,v1:172.21.15.52:6834/2946930251] conn(0x55986fb378f0 0x55986fa76c10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55986fabb2a0 0x55986fa766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55986faa08e0 0x55986fb23f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f475fe00640 0 client.5106 ms_handle_reset on v2:172.21.15.52:6832/2946930251 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 --2- 172.21.15.52:0/2139314841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55986fa9d990 0x55986fb3af10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 >> 172.21.15.52:0/2139314841 conn(0x55986fa74240 msgr2=0x55986fac51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 shutdown_connections 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 1 -- 172.21.15.52:0/2139314841 wait complete. 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.918+0000 7f4784c1c740 20 client.5106 trim_cache size 0 max 16384 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 27766, 2024-09-10T08:31:20.924 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 49710, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 10132857, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 42329650, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 18, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 4.768455658, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 2.734871970, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 2.575199801, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.042448058, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 49709, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.536913061, 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000030918 2024-09-10T08:31:20.925 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 71694, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.017734063, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000247 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 122208, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 27056 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3667, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3691, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 1316289, 2024-09-10T08:31:20.926 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 42342513, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.509272488, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.256759870, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.101071397, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.121619924, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3690, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.871701066, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000236233 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:31:20.927 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 93952 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3790, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3790, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 961490, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 25270051, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:31:20.928 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.455218898, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.217303588, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.090739028, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.115509785, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3789, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.730016638, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000192667 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:31:20.929 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2693, 2024-09-10T08:31:20.930 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 16.531970999, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006138867 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3694, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.979675141, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000265207 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T08:31:20.931 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25637, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25637, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25637, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 368.397745617, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.014369768 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T08:31:20.932 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 17905, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 17905, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 17904, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 2, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 2, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 46494, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46006, 2024-09-10T08:31:20.933 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 105, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 2013, 2024-09-10T08:31:20.934 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 2013, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 13, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 2, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 11, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 2000, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 896, 2024-09-10T08:31:20.935 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4028, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2897, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2066, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 54, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14056 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T08:31:20.936 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4156, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 3781, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2209, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:31:20.937 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 1, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 26617, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 26617, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 36, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 36, 2024-09-10T08:31:20.939 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 4, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 94923520, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2569, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 107.438823041, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.041821262 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.940 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 14, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2016, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 2002, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 17905, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19906, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 2001, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 2, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 7159, 2024-09-10T08:31:20.941 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 7157, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 101332, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28487, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25637, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 6, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T08:31:20.942 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.047362351, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001023681 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.004030680, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000161227 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.943 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 7.413585393, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001235597 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7389, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.995362277, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000676053 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.944 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.945 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000075081, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000075081 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.946 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002902628, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002902628 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.947 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.046792192, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.046792192 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000125126, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000125126 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.092239259, 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.011529907 2024-09-10T08:31:20.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2209, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 333.945946004, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.151175167 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.949 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.004191734, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.004191734 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.950 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000278788, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000278788 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.951 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T08:31:20.952 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-09-10T08:31:20.953 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 19.844854104, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002480606 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.954 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 17921, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 17921, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 90, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:31:20.956 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:31:20.957 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 250670, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 92, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-09-10T08:31:20.958 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5800, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 85, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 13484661, 2024-09-10T08:31:20.959 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 661688, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 8646, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 91411991, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 27, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 8646, 2024-09-10T08:31:20.960 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8646, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 37.849498833, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.004377688 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8646, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 8760 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 8646, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 2077, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 6569, 2024-09-10T08:31:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 62, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2629, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 37, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1781, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 2033, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T08:31:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 2015, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:31:20.963 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T08:31:20.964 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 37, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 5, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 136, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 34 2024-09-10T08:31:20.965 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T08:31:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 3781, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 3781, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 35218, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 9235568, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 35218, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:31:20.967 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 35218, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 9235568, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:31:20.968 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8646, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 91808120, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8646, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 91808120, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8646, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 8646, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8646, 2024-09-10T08:31:20.970 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8646, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 3781, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 396129, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:31:20.971 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 3781, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 60, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 396129, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.972 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x564b42a5c500": { 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 26617, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 90729216, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 26617, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:31:20.973 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2569, 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 90729216, 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:20.974 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:20.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 msgr2=0x7f475806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 0x7f475806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f476c034000 tx=0x7f476c02e000 comp rx=0 tx=0).stop 2024-09-10T08:31:20.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 msgr2=0x7f477c15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f477400efc0 tx=0x7f4774009f90 comp rx=0 tx=0).stop 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 shutdown_connections 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f475806be30 0x7f475806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f477c0cd270 0x7f477c15c8d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f477c0cce30 0x7f477c0cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 --2- 172.21.15.52:0/4275527835 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f477c0732e0 0x7f477c14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 >> 172.21.15.52:0/4275527835 conn(0x7f477c06d0f0 msgr2=0x7f477c071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 shutdown_connections 2024-09-10T08:31:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:20.919+0000 7f4781c00640 1 -- 172.21.15.52:0/4275527835 wait complete. 2024-09-10T08:31:20.978 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:31:20.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:31:21.066 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:31:21.174 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:31:21.174 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:31:21.174 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:21.174 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:21.210 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:21.210 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:21.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:31:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.482+0000 7f91b3e00640 1 Processor -- start 2024-09-10T08:31:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.482+0000 7f91b3e00640 1 -- start start 2024-09-10T08:31:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b415e440 0x7f91b40d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91b40cf450 0x7f91b40b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b3e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b40d3990 con 0x7f91b40b6540 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b3e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f91b40b6990 con 0x7f91b415e440 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b3e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91b40d3c70 con 0x7f91b40cf450 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b415e440 0x7f91b40d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f91b415e440 0x7f91b40d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50116/0 (socket says 172.21.15.52:50116) 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b2a00640 1 -- 172.21.15.52:0/3439099125 learned_addr learned my addr 172.21.15.52:0/3439099125 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.483+0000 7f91b2000640 1 --2- 172.21.15.52:0/3439099125 >> v2:172.21.15.176:3300/0 conn(0x7f91b40cf450 0x7f91b40b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.484+0000 7f91b2a00640 1 -- 172.21.15.52:0/3439099125 >> v2:172.21.15.176:3300/0 conn(0x7f91b40cf450 msgr2=0x7f91b40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.484+0000 7f91b2a00640 1 --2- 172.21.15.52:0/3439099125 >> v2:172.21.15.176:3300/0 conn(0x7f91b40cf450 0x7f91b40b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.484+0000 7f91b2a00640 1 -- 172.21.15.52:0/3439099125 >> v1:172.21.15.176:6789/0 conn(0x7f91b40b6540 legacy=0x7f91b406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:21.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.484+0000 7f91b2a00640 1 -- 172.21.15.52:0/3439099125 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b40d3f50 con 0x7f91b415e440 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b2a00640 1 --2- 172.21.15.52:0/3439099125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b415e440 0x7f91b40d3240 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91b40b3f90 tx=0x7f91a402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32737087a829aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b1600640 1 -- 172.21.15.52:0/3439099125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4037070 con 0x7f91b415e440 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b1600640 1 -- 172.21.15.52:0/3439099125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a4032440 con 0x7f91b415e440 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b1600640 1 -- 172.21.15.52:0/3439099125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4032810 con 0x7f91b415e440 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b3e00640 1 -- 172.21.15.52:0/3439099125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b415e440 msgr2=0x7f91b40d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.485+0000 7f91b3e00640 1 --2- 172.21.15.52:0/3439099125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b415e440 0x7f91b40d3240 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f91b40b3f90 tx=0x7f91a402a2c0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 -- 172.21.15.52:0/3439099125 shutdown_connections 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 --2- 172.21.15.52:0/3439099125 >> v2:172.21.15.176:3300/0 conn(0x7f91b40cf450 0x7f91b40b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 --2- 172.21.15.52:0/3439099125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b415e440 0x7f91b40d3240 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 -- 172.21.15.52:0/3439099125 >> 172.21.15.52:0/3439099125 conn(0x7f91b4067f80 msgr2=0x7f91b40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 -- 172.21.15.52:0/3439099125 shutdown_connections 2024-09-10T08:31:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.486+0000 7f91b3e00640 1 -- 172.21.15.52:0/3439099125 wait complete. 2024-09-10T08:31:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.487+0000 7f91b3e00640 1 Processor -- start 2024-09-10T08:31:21.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.487+0000 7f91b3e00640 1 -- start start 2024-09-10T08:31:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b40cf450 0x7f91b4161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 0x7f91b41615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91b40b7540 con 0x7f91b40b6540 2024-09-10T08:31:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91b415e820 con 0x7f91b40cf450 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.488+0000 7f91b3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f91b40b76c0 con 0x7f91b415e440 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50132/0 (socket says 172.21.15.52:50132) 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 -- 172.21.15.52:0/203202006 learned_addr learned my addr 172.21.15.52:0/203202006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2000640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b40cf450 0x7f91b4161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b3400640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 0x7f91b41615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 -- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 msgr2=0x7f91b41615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:21.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 0x7f91b41615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 -- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b40cf450 msgr2=0x7f91b4161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b40cf450 0x7f91b4161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 -- 172.21.15.52:0/203202006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b40ce830 con 0x7f91b40b6540 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b3400640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 0x7f91b41615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.489+0000 7f91b2a00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.490+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4041020 con 0x7f91b40b6540 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.490+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a40306c0 con 0x7f91b40b6540 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.490+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4037040 con 0x7f91b40b6540 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.490+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b4161bf0 con 0x7f91b40b6540 2024-09-10T08:31:21.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.490+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b415ffb0 con 0x7f91b40b6540 2024-09-10T08:31:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.491+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b40b6000 con 0x7f91b40b6540 2024-09-10T08:31:21.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.492+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a4044020 con 0x7f91b40b6540 2024-09-10T08:31:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.493+0000 7f91aaa00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.493+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f91a40ab790 con 0x7f91b40b6540 2024-09-10T08:31:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.493+0000 7f91b2000640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:21.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.494+0000 7f91b2000640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 0x7f919406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91b4159980 tx=0x7f91a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.498+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91a404b030 con 0x7f91b40b6540 2024-09-10T08:31:21.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.694+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91b40d2da0 con 0x7f91b40b6540 2024-09-10T08:31:21.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.695+0000 7f91aaa00640 1 -- 172.21.15.52:0/203202006 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f91b40d2da0 con 0x7f91b40b6540 2024-09-10T08:31:21.695 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:31:21.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 msgr2=0x7f919406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 0x7f919406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91b4159980 tx=0x7f91a0008040 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 msgr2=0x7f91b4157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91a4000c00 tx=0x7f91a40046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 shutdown_connections 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91b415e440 0x7f91b41615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91b40cf450 0x7f91b4161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 --2- 172.21.15.52:0/203202006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91b40b6540 0x7f91b4157b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 >> 172.21.15.52:0/203202006 conn(0x7f91b4067f80 msgr2=0x7f91b40b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 shutdown_connections 2024-09-10T08:31:21.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:21.697+0000 7f91b3e00640 1 -- 172.21.15.52:0/203202006 wait complete. 2024-09-10T08:31:21.713 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:31:21.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:21.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:21.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:31:21.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:21.802 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:31:21.853 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:31:21.853 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:31:21.853 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:21.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:31:21.891 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:31:21.891 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:21.891 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:21.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:31:21.928 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:31:21.928 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:31:21.928 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:21.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:31:21.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.124+0000 7fe1bd000640 1 Processor -- start 2024-09-10T08:31:22.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.124+0000 7fe1bd000640 1 -- start start 2024-09-10T08:31:22.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1bd000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe1b80b63f0 0x7fe1b80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1bd000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe1b80b7a30 0x7fe1b80cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1bd000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b80cfb40 con 0x7fe1b80b67d0 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1bd000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b80d27f0 con 0x7fe1b80b63f0 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1bd000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b80cfe20 con 0x7fe1b80b7a30 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1b7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1b80b67d0 0x7fe1b815df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48716/0 (socket says 172.21.15.52:48716) 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1b7e00640 1 -- 172.21.15.52:0/1529317823 learned_addr learned my addr 172.21.15.52:0/1529317823 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1b7400640 1 --2- 172.21.15.52:0/1529317823 >> v2:172.21.15.52:3300/0 conn(0x7fe1b80b63f0 0x7fe1b80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.125+0000 7fe1b6a00640 1 --2- 172.21.15.52:0/1529317823 >> v2:172.21.15.176:3300/0 conn(0x7fe1b80b7a30 0x7fe1b80cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.126+0000 7fe1b7400640 1 -- 172.21.15.52:0/1529317823 >> v2:172.21.15.176:3300/0 conn(0x7fe1b80b7a30 msgr2=0x7fe1b80cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.126+0000 7fe1b7400640 1 --2- 172.21.15.52:0/1529317823 >> v2:172.21.15.176:3300/0 conn(0x7fe1b80b7a30 0x7fe1b80cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.126+0000 7fe1b7400640 1 -- 172.21.15.52:0/1529317823 >> v1:172.21.15.52:6789/0 conn(0x7fe1b80b67d0 legacy=0x7fe1b815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.126+0000 7fe1b7400640 1 -- 172.21.15.52:0/1529317823 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b80d2e00 con 0x7fe1b80b63f0 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.127+0000 7fe1b7400640 1 --2- 172.21.15.52:0/1529317823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b80cef60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80097a0 tx=0x7fe1a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd7498b9ee0b871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.127+0000 7fe1b6000640 1 -- 172.21.15.52:0/1529317823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8037070 con 0x7fe1b80b63f0 2024-09-10T08:31:22.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.127+0000 7fe1b6000640 1 -- 172.21.15.52:0/1529317823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8032440 con 0x7fe1b80b63f0 2024-09-10T08:31:22.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.127+0000 7fe1b6000640 1 -- 172.21.15.52:0/1529317823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8032810 con 0x7fe1b80b63f0 2024-09-10T08:31:22.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 -- 172.21.15.52:0/1529317823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 msgr2=0x7fe1b80cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 --2- 172.21.15.52:0/1529317823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b80cef60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80097a0 tx=0x7fe1a802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 -- 172.21.15.52:0/1529317823 shutdown_connections 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 --2- 172.21.15.52:0/1529317823 >> v2:172.21.15.176:3300/0 conn(0x7fe1b80b7a30 0x7fe1b80cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 --2- 172.21.15.52:0/1529317823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b80cef60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 -- 172.21.15.52:0/1529317823 >> 172.21.15.52:0/1529317823 conn(0x7fe1b80d1360 msgr2=0x7fe1b80d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 -- 172.21.15.52:0/1529317823 shutdown_connections 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.128+0000 7fe1bd000640 1 -- 172.21.15.52:0/1529317823 wait complete. 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.129+0000 7fe1bd000640 1 Processor -- start 2024-09-10T08:31:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.129+0000 7fe1bd000640 1 -- start start 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b80b67d0 0x7fe1b81f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b80b7a30 0x7fe1b80c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b815e810 con 0x7fe1b80b63f0 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b815e690 con 0x7fe1b80b67d0 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1bd000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b815e990 con 0x7fe1b80b7a30 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.130+0000 7fe1b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50146/0 (socket says 172.21.15.52:50146) 2024-09-10T08:31:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 -- 172.21.15.52:0/2404549969 learned_addr learned my addr 172.21.15.52:0/2404549969 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b6a00640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b80b67d0 0x7fe1b81f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 -- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b80b7a30 msgr2=0x7fe1b80c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b80b7a30 0x7fe1b80c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 -- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b80b67d0 msgr2=0x7fe1b81f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b80b67d0 0x7fe1b81f4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 -- 172.21.15.52:0/2404549969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b814a030 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1b7400640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8035040 tx=0x7fe1a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.131+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8037040 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.132+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a8030500 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.132+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8030910 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.132+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b81f4bc0 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.132+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81f5180 con 0x7fe1b80b63f0 2024-09-10T08:31:22.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.133+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b815df80 con 0x7fe1b80b63f0 2024-09-10T08:31:22.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.134+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1a8044020 con 0x7fe1b80b63f0 2024-09-10T08:31:22.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.134+0000 7fe1af400640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.135+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fe1a80ab220 con 0x7fe1b80b63f0 2024-09-10T08:31:22.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.135+0000 7fe1b6a00640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.136+0000 7fe1b6a00640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80d0490 tx=0x7fe1a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.139+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1b814a030 con 0x7fe1b80b63f0 2024-09-10T08:31:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.364+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1b80b92e0 con 0x7fe1b80b63f0 2024-09-10T08:31:22.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.365+0000 7fe1af400640 1 -- 172.21.15.52:0/2404549969 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7fe1a8079aa0 con 0x7fe1b80b63f0 2024-09-10T08:31:22.365 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:22.365 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"btime":"2024-09-10T08:29:47:527602+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:46.766528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:31:22.366 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 msgr2=0x7fe19806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 0x7fe19806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80d0490 tx=0x7fe1a4008040 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 msgr2=0x7fe1b8149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8035040 tx=0x7fe1a80046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 shutdown_connections 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe19806be30 0x7fe19806e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1b80b7a30 0x7fe1b80c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1b80b67d0 0x7fe1b81f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 --2- 172.21.15.52:0/2404549969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1b80b63f0 0x7fe1b8149af0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 >> 172.21.15.52:0/2404549969 conn(0x7fe1b80d1360 msgr2=0x7fe1b80b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:22.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 shutdown_connections 2024-09-10T08:31:22.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.367+0000 7fe1bd000640 1 -- 172.21.15.52:0/2404549969 wait complete. 2024-09-10T08:31:22.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.539+0000 7f37a3a00640 1 Processor -- start 2024-09-10T08:31:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.539+0000 7f37a3a00640 1 -- start start 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f37a3a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 0x7f379c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f37a3a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379c071b30 con 0x7f379c148260 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f37a3a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379c0b3510 con 0x7f379c06c320 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f37a3a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f379c074200 con 0x7f379c147e80 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f379c148260 0x7f379c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48726/0 (socket says 172.21.15.52:48726) 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379be00640 1 -- 172.21.15.52:0/1232726381 learned_addr learned my addr 172.21.15.52:0/1232726381 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f37a1000640 1 --2- 172.21.15.52:0/1232726381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 0x7f379c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536188904 0 0) 0x7f379c071b30 con 0x7f379c148260 2024-09-10T08:31:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3784003520 con 0x7f379c148260 2024-09-10T08:31:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49808836 0 0) 0x7f379c0b3510 con 0x7f379c06c320 2024-09-10T08:31:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.541+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f379c071b30 con 0x7f379c06c320 2024-09-10T08:31:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.542+0000 7f37a1000640 1 -- 172.21.15.52:0/1232726381 >> v1:172.21.15.176:6789/0 conn(0x7f379c06c320 legacy=0x7f379c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.542+0000 7f37a1000640 1 -- 172.21.15.52:0/1232726381 >> v1:172.21.15.52:6789/0 conn(0x7f379c148260 legacy=0x7f379c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.542+0000 7f37a1000640 1 -- 172.21.15.52:0/1232726381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c0b37f0 con 0x7f379c147e80 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.543+0000 7f37a1000640 1 --2- 172.21.15.52:0/1232726381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 0x7f379c070f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37900097d0 tx=0x7f379002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e31d32b817688c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.543+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790037070 con 0x7f379c147e80 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.543+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3790032440 con 0x7f379c147e80 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.543+0000 7f379b400640 1 -- 172.21.15.52:0/1232726381 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37900327f0 con 0x7f379c147e80 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 -- 172.21.15.52:0/1232726381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 msgr2=0x7f379c070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 --2- 172.21.15.52:0/1232726381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 0x7f379c070f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37900097d0 tx=0x7f379002a200 comp rx=0 tx=0).stop 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 -- 172.21.15.52:0/1232726381 shutdown_connections 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 --2- 172.21.15.52:0/1232726381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c147e80 0x7f379c070f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 -- 172.21.15.52:0/1232726381 >> 172.21.15.52:0/1232726381 conn(0x7f379c0ccec0 msgr2=0x7f379c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 -- 172.21.15.52:0/1232726381 shutdown_connections 2024-09-10T08:31:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.544+0000 7f37a3a00640 1 -- 172.21.15.52:0/1232726381 wait complete. 2024-09-10T08:31:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.545+0000 7f37a3a00640 1 Processor -- start 2024-09-10T08:31:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 -- start start 2024-09-10T08:31:22.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c06c320 0x7f379c13ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f379c148260 0x7f379c145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f379c0714b0 con 0x7f379c147e80 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f379c0b3e40 con 0x7f379c148260 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.546+0000 7f37a3a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f379c071630 con 0x7f379c06c320 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50152/0 (socket says 172.21.15.52:50152) 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 -- 172.21.15.52:0/2109180590 learned_addr learned my addr 172.21.15.52:0/2109180590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f37a1000640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c06c320 0x7f379c13ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f37a1a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f379c148260 0x7f379c145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 -- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c06c320 msgr2=0x7f379c13ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c06c320 0x7f379c13ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 -- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f379c148260 msgr2=0x7f379c145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f379c148260 0x7f379c145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 -- 172.21.15.52:0/2109180590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c0ac060 con 0x7f379c147e80 2024-09-10T08:31:22.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.547+0000 7f379be00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f378800c3e0 tx=0x7f378800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.548+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788017070 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.548+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3788005ce0 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.548+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c0ac340 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.548+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880072d0 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.548+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1404e0 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.549+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c070f70 con 0x7f379c147e80 2024-09-10T08:31:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.550+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f378801a070 con 0x7f379c147e80 2024-09-10T08:31:22.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.551+0000 7f3798c00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.551+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f378808a230 con 0x7f379c147e80 2024-09-10T08:31:22.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.551+0000 7f37a1000640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.552+0000 7f37a1000640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 0x7f377c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3790034000 tx=0x7f379002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.558+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37880584f0 con 0x7f379c147e80 2024-09-10T08:31:22.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.777+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f379c06c9c0 con 0x7f379c147e80 2024-09-10T08:31:22.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.778+0000 7f3798c00640 1 -- 172.21.15.52:0/2109180590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f378805c7f0 con 0x7f379c147e80 2024-09-10T08:31:22.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:22.779 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"btime":"2024-09-10T08:29:47:527602+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:46.766528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:31:22.779 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 msgr2=0x7f377c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 0x7f377c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3790034000 tx=0x7f379002e000 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 msgr2=0x7f379c0aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f378800c3e0 tx=0x7f378800c8a0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 shutdown_connections 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f377c06be30 0x7f377c06e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f379c148260 0x7f379c145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f379c147e80 0x7f379c0aae70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 --2- 172.21.15.52:0/2109180590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f379c06c320 0x7f379c13ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 >> 172.21.15.52:0/2109180590 conn(0x7f379c0ccec0 msgr2=0x7f379c0cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:22.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 shutdown_connections 2024-09-10T08:31:22.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.780+0000 7f37a3a00640 1 -- 172.21.15.52:0/2109180590 wait complete. 2024-09-10T08:31:22.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:22.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.951+0000 7fb067400640 1 Processor -- start 2024-09-10T08:31:22.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.951+0000 7fb067400640 1 -- start start 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.952+0000 7fb067400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 0x7fb0600b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.952+0000 7fb067400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 0x7fb0600b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb067400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0600b4020 con 0x7fb060145ed0 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb067400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb0600b42c0 con 0x7fb060073890 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb067400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0600b45a0 con 0x7fb0600b5880 2024-09-10T08:31:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb064a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb060145ed0 0x7fb060073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48730/0 (socket says 172.21.15.52:48730) 2024-09-10T08:31:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb064a00640 1 -- 172.21.15.52:0/2077156217 learned_addr learned my addr 172.21.15.52:0/2077156217 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb065400640 1 --2- 172.21.15.52:0/2077156217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 0x7fb0600b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb05fe00640 1 --2- 172.21.15.52:0/2077156217 >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 0x7fb0600b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220455384 0 0) 0x7fb0600b4020 con 0x7fb060145ed0 2024-09-10T08:31:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.953+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb048003520 con 0x7fb060145ed0 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb065400640 1 -- 172.21.15.52:0/2077156217 >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 msgr2=0x7fb0600b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb065400640 1 --2- 172.21.15.52:0/2077156217 >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 0x7fb0600b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614181004 0 0) 0x7fb048003520 con 0x7fb060145ed0 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb065400640 1 -- 172.21.15.52:0/2077156217 >> v1:172.21.15.52:6789/0 conn(0x7fb060145ed0 legacy=0x7fb060073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb065400640 1 -- 172.21.15.52:0/2077156217 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600b4880 con 0x7fb0600b5880 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.954+0000 7fb05fe00640 1 --2- 172.21.15.52:0/2077156217 >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 0x7fb0600b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:22.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb065400640 1 --2- 172.21.15.52:0/2077156217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 0x7fb0600b5d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb058009d90 tx=0x7fb05802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8e319a0c7c5e871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058007740 con 0x7fb0600b5880 2024-09-10T08:31:22.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0580078e0 con 0x7fb0600b5880 2024-09-10T08:31:22.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb05f400640 1 -- 172.21.15.52:0/2077156217 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058007c90 con 0x7fb0600b5880 2024-09-10T08:31:22.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 -- 172.21.15.52:0/2077156217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 msgr2=0x7fb0600b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 --2- 172.21.15.52:0/2077156217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 0x7fb0600b5d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb058009d90 tx=0x7fb05802a660 comp rx=0 tx=0).stop 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 -- 172.21.15.52:0/2077156217 shutdown_connections 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 --2- 172.21.15.52:0/2077156217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0600b5880 0x7fb0600b5d30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 --2- 172.21.15.52:0/2077156217 >> v2:172.21.15.176:3300/0 conn(0x7fb060073890 0x7fb0600b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 -- 172.21.15.52:0/2077156217 >> 172.21.15.52:0/2077156217 conn(0x7fb0600ccec0 msgr2=0x7fb0600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 -- 172.21.15.52:0/2077156217 shutdown_connections 2024-09-10T08:31:22.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.956+0000 7fb067400640 1 -- 172.21.15.52:0/2077156217 wait complete. 2024-09-10T08:31:22.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.957+0000 7fb067400640 1 Processor -- start 2024-09-10T08:31:22.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.957+0000 7fb067400640 1 -- start start 2024-09-10T08:31:22.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb060073890 0x7fb06013cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0600b5880 0x7fb0600c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0600b6270 con 0x7fb060145ed0 2024-09-10T08:31:22.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0601462b0 con 0x7fb0600b5880 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.958+0000 7fb067400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb06013d0f0 con 0x7fb060073890 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb064a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb060073890 0x7fb06013cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50158/0 (socket says 172.21.15.52:50158) 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 -- 172.21.15.52:0/2805610294 learned_addr learned my addr 172.21.15.52:0/2805610294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb05fe00640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0600b5880 0x7fb0600c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 -- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb060073890 msgr2=0x7fb06013cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb060073890 0x7fb06013cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 -- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0600b5880 msgr2=0x7fb0600c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0600b5880 0x7fb0600c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 -- 172.21.15.52:0/2805610294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600c7000 con 0x7fb060145ed0 2024-09-10T08:31:22.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.959+0000 7fb065400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb058009eb0 tx=0x7fb058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.960+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058009450 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.960+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb058004260 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.960+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb058004650 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.960+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0600c72e0 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.960+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0600c78a0 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.961+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0600b5080 con 0x7fb060145ed0 2024-09-10T08:31:22.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.962+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb058039040 con 0x7fb060145ed0 2024-09-10T08:31:22.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.963+0000 7fb05cc00640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 0x7fb04006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:22.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.963+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fb0580ac3e0 con 0x7fb060145ed0 2024-09-10T08:31:22.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.963+0000 7fb064a00640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 0x7fb04006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:22.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.964+0000 7fb064a00640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 0x7fb04006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0601f5470 tx=0x7fb054007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:22.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:22.967+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb058040030 con 0x7fb060145ed0 2024-09-10T08:31:23.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.153+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb060159ff0 con 0x7fb060145ed0 2024-09-10T08:31:23.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.155+0000 7fb05cc00640 1 -- 172.21.15.52:0/2805610294 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16996 (secure 0 0 0) 0x7fb05807a730 con 0x7fb060145ed0 2024-09-10T08:31:23.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:23.156 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:00.364710+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:29:31.784586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T08:29:32.424265+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:23.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 msgr2=0x7fb04006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 0x7fb04006e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0601f5470 tx=0x7fb054007c90 comp rx=0 tx=0).stop 2024-09-10T08:31:23.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 msgr2=0x7fb0600cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb058009eb0 tx=0x7fb058004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 shutdown_connections 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb04006be30 0x7fb04006e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb060145ed0 0x7fb0600cb010 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0600b5880 0x7fb0600c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 --2- 172.21.15.52:0/2805610294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb060073890 0x7fb06013cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 >> 172.21.15.52:0/2805610294 conn(0x7fb0600ccec0 msgr2=0x7fb0600ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:23.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 shutdown_connections 2024-09-10T08:31:23.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.157+0000 7fb067400640 1 -- 172.21.15.52:0/2805610294 wait complete. 2024-09-10T08:31:23.174 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:31:23.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 Processor -- start 2024-09-10T08:31:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 -- start start 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02e40b2d40 0x7f02e406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02e413eb20 0x7f02e406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4071180 con 0x7f02e415bcf0 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f02e415c890 con 0x7f02e413eb20 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.331+0000 7f02ec800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f02e4071ab0 con 0x7f02e40b2d40 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02e413eb20 0x7f02e406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f02e413eb20 0x7f02e406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50160/0 (socket says 172.21.15.52:50160) 2024-09-10T08:31:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 -- 172.21.15.52:0/3974623317 learned_addr learned my addr 172.21.15.52:0/3974623317 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9e00640 1 --2- 172.21.15.52:0/3974623317 >> v2:172.21.15.176:3300/0 conn(0x7f02e40b2d40 0x7f02e406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 -- 172.21.15.52:0/3974623317 >> v2:172.21.15.176:3300/0 conn(0x7f02e40b2d40 msgr2=0x7f02e406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 --2- 172.21.15.52:0/3974623317 >> v2:172.21.15.176:3300/0 conn(0x7f02e40b2d40 0x7f02e406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 -- 172.21.15.52:0/3974623317 >> v1:172.21.15.176:6789/0 conn(0x7f02e415bcf0 legacy=0x7f02e415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.332+0000 7f02e9400640 1 -- 172.21.15.52:0/3974623317 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4071460 con 0x7f02e413eb20 2024-09-10T08:31:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.333+0000 7f02e9400640 1 --2- 172.21.15.52:0/3974623317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e413eb20 0x7f02e406c150 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02e4069be0 tx=0x7f02d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b07a9b3dc0fe010 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02e8a00640 1 -- 172.21.15.52:0/3974623317 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4037070 con 0x7f02e413eb20 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02e8a00640 1 -- 172.21.15.52:0/3974623317 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d4032440 con 0x7f02e413eb20 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02e8a00640 1 -- 172.21.15.52:0/3974623317 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4032810 con 0x7f02e413eb20 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 -- 172.21.15.52:0/3974623317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e413eb20 msgr2=0x7f02e406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 --2- 172.21.15.52:0/3974623317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e413eb20 0x7f02e406c150 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02e4069be0 tx=0x7f02d402a230 comp rx=0 tx=0).stop 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 -- 172.21.15.52:0/3974623317 shutdown_connections 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 --2- 172.21.15.52:0/3974623317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e413eb20 0x7f02e406c150 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 --2- 172.21.15.52:0/3974623317 >> v2:172.21.15.176:3300/0 conn(0x7f02e40b2d40 0x7f02e406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 -- 172.21.15.52:0/3974623317 >> 172.21.15.52:0/3974623317 conn(0x7f02e40ccec0 msgr2=0x7f02e40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 -- 172.21.15.52:0/3974623317 shutdown_connections 2024-09-10T08:31:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.334+0000 7f02ec800640 1 -- 172.21.15.52:0/3974623317 wait complete. 2024-09-10T08:31:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 Processor -- start 2024-09-10T08:31:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 -- start start 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e40b2d40 0x7f02e40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e413eb20 0x7f02e4157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02e40720a0 con 0x7f02e415bcf0 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4071f20 con 0x7f02e413eb20 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ec800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02e4072220 con 0x7f02e40b2d40 2024-09-10T08:31:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50166/0 (socket says 172.21.15.52:50166) 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 -- 172.21.15.52:0/2101125538 learned_addr learned my addr 172.21.15.52:0/2101125538 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02e9e00640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e40b2d40 0x7f02e40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02e9400640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e413eb20 0x7f02e4157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 -- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e40b2d40 msgr2=0x7f02e40b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e40b2d40 0x7f02e40b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 -- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e413eb20 msgr2=0x7f02e4157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e413eb20 0x7f02e4157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.337+0000 7f02ea800640 1 -- 172.21.15.52:0/2101125538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4139050 con 0x7f02e415bcf0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02ea800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02e000b9a0 tx=0x7f02e000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0019070 con 0x7f02e415bcf0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e000cba0 con 0x7f02e415bcf0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0014440 con 0x7f02e415bcf0 2024-09-10T08:31:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e40b4510 con 0x7f02e415bcf0 2024-09-10T08:31:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.338+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e40b4ad0 con 0x7f02e415bcf0 2024-09-10T08:31:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.339+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e415c180 con 0x7f02e415bcf0 2024-09-10T08:31:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.340+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02e001c070 con 0x7f02e415bcf0 2024-09-10T08:31:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.341+0000 7f02de000640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 0x7f02c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.341+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f02e008ab40 con 0x7f02e415bcf0 2024-09-10T08:31:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.341+0000 7f02e9e00640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 0x7f02c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.342+0000 7f02e9e00640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 0x7f02c806e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f02d8006fd0 tx=0x7f02d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.346+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02e0058ce0 con 0x7f02e415bcf0 2024-09-10T08:31:23.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.566+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02e4155920 con 0x7f02e415bcf0 2024-09-10T08:31:23.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.566+0000 7f02de000640 1 -- 172.21.15.52:0/2101125538 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f02e005cfe0 con 0x7f02e415bcf0 2024-09-10T08:31:23.567 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:23.567 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"btime":"2024-09-10T08:29:47:527602+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:46.766528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:31:23.567 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.568+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 msgr2=0x7f02c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.568+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 0x7f02c806e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f02d8006fd0 tx=0x7f02d8008040 comp rx=0 tx=0).stop 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.568+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 msgr2=0x7f02e41f8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.568+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02e000b9a0 tx=0x7f02e000be60 comp rx=0 tx=0).stop 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 shutdown_connections 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02c806be60 0x7f02c806e320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02e415bcf0 0x7f02e41f8030 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02e413eb20 0x7f02e4157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 --2- 172.21.15.52:0/2101125538 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02e40b2d40 0x7f02e40b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 >> 172.21.15.52:0/2101125538 conn(0x7f02e40ccec0 msgr2=0x7f02e40cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:23.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 shutdown_connections 2024-09-10T08:31:23.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.569+0000 7f02ec800640 1 -- 172.21.15.52:0/2101125538 wait complete. 2024-09-10T08:31:23.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.742+0000 7facf2200640 1 Processor -- start 2024-09-10T08:31:23.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.742+0000 7facf2200640 1 -- start start 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facec15e6d0 0x7facec15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7facec0cb980 0x7facec162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec06cf30 0x7facec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7facec0cc990 con 0x7facec0cb980 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7facec15fcd0 con 0x7facec15e6d0 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7facf2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facec162440 con 0x7facec06cf30 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.743+0000 7faceaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7facec0cb980 0x7facec162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7facec0cb980 0x7facec162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50176/0 (socket says 172.21.15.52:50176) 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 -- 172.21.15.52:0/67369360 learned_addr learned my addr 172.21.15.52:0/67369360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceb400640 1 --2- 172.21.15.52:0/67369360 >> v2:172.21.15.176:3300/0 conn(0x7facec15e6d0 0x7facec15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7facebe00640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec06cf30 0x7facec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 -- 172.21.15.52:0/67369360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec06cf30 msgr2=0x7facec06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:23.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec06cf30 0x7facec06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 -- 172.21.15.52:0/67369360 >> v2:172.21.15.176:3300/0 conn(0x7facec15e6d0 msgr2=0x7facec15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 --2- 172.21.15.52:0/67369360 >> v2:172.21.15.176:3300/0 conn(0x7facec15e6d0 0x7facec15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.744+0000 7faceaa00640 1 -- 172.21.15.52:0/67369360 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec0cc3d0 con 0x7facec0cb980 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.745+0000 7faceaa00640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec0cb980 0x7facec162c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7facec073110 tx=0x7facd802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd332943df21ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.745+0000 7facea000640 1 -- 172.21.15.52:0/67369360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8037070 con 0x7facec0cb980 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.745+0000 7facea000640 1 -- 172.21.15.52:0/67369360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd802ae00 con 0x7facec0cb980 2024-09-10T08:31:23.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.745+0000 7facea000640 1 -- 172.21.15.52:0/67369360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8032660 con 0x7facec0cb980 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 -- 172.21.15.52:0/67369360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec0cb980 msgr2=0x7facec162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec0cb980 0x7facec162c00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7facec073110 tx=0x7facd802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 -- 172.21.15.52:0/67369360 shutdown_connections 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec06cf30 0x7facec06d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 --2- 172.21.15.52:0/67369360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec0cb980 0x7facec162c00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 --2- 172.21.15.52:0/67369360 >> v2:172.21.15.176:3300/0 conn(0x7facec15e6d0 0x7facec15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 -- 172.21.15.52:0/67369360 >> 172.21.15.52:0/67369360 conn(0x7facec0b4300 msgr2=0x7facec0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 -- 172.21.15.52:0/67369360 shutdown_connections 2024-09-10T08:31:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.746+0000 7facf2200640 1 -- 172.21.15.52:0/67369360 wait complete. 2024-09-10T08:31:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.748+0000 7facf2200640 1 Processor -- start 2024-09-10T08:31:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.748+0000 7facf2200640 1 -- start start 2024-09-10T08:31:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 0x7facec14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec0cb980 0x7facec147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7facec163140 con 0x7facec15e6d0 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7facec1626e0 con 0x7facec06cf30 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facf2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facec15eab0 con 0x7facec0cb980 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50190/0 (socket says 172.21.15.52:50190) 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7facebe00640 1 -- 172.21.15.52:0/2605472902 learned_addr learned my addr 172.21.15.52:0/2605472902 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7faceb400640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 0x7facec14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.749+0000 7faceaa00640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec0cb980 0x7facec147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 -- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec0cb980 msgr2=0x7facec147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec0cb980 0x7facec147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 -- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 msgr2=0x7facec14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 0x7facec14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 -- 172.21.15.52:0/2605472902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec148180 con 0x7facec15e6d0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7faceb400640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 0x7facec14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facebe00640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7face4009d30 tx=0x7face400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4018020 con 0x7facec15e6d0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4014480 con 0x7facec15e6d0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4014870 con 0x7facec15e6d0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.750+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec1618b0 con 0x7facec15e6d0 2024-09-10T08:31:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.751+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec14a760 con 0x7facec15e6d0 2024-09-10T08:31:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.752+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec162c00 con 0x7facec15e6d0 2024-09-10T08:31:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.752+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7face4005d10 con 0x7facec15e6d0 2024-09-10T08:31:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.753+0000 7face3400640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 0x7faccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.753+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7face408b900 con 0x7facec15e6d0 2024-09-10T08:31:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.754+0000 7faceb400640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 0x7faccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:23.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.754+0000 7faceb400640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 0x7faccc06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7facdc009a70 tx=0x7facdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.757+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7face4022070 con 0x7facec15e6d0 2024-09-10T08:31:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.977+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facec073e30 con 0x7facec15e6d0 2024-09-10T08:31:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.977+0000 7face3400640 1 -- 172.21.15.52:0/2605472902 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7face4010040 con 0x7facec15e6d0 2024-09-10T08:31:23.977 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:23.977 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"btime":"2024-09-10T08:29:47:527602+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:29:33.441490+0000","modified":"2024-09-10T08:29:46.766528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4797},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4797":{"gid":4797,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2946930251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2946930251},{"type":"v1","addr":"172.21.15.52:6834","nonce":2946930251}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4797,"qdb_cluster":[4797]},"id":2}]} 2024-09-10T08:31:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 18 2024-09-10T08:31:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 msgr2=0x7faccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 0x7faccc06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7facdc009a70 tx=0x7facdc008040 comp rx=0 tx=0).stop 2024-09-10T08:31:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 msgr2=0x7facec160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7face4009d30 tx=0x7face400c490 comp rx=0 tx=0).stop 2024-09-10T08:31:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 shutdown_connections 2024-09-10T08:31:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faccc06be30 0x7faccc06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec15e6d0 0x7facec160ed0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facec0cb980 0x7facec147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 --2- 172.21.15.52:0/2605472902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facec06cf30 0x7facec14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 >> 172.21.15.52:0/2605472902 conn(0x7facec0b4300 msgr2=0x7facec0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 shutdown_connections 2024-09-10T08:31:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:23.980+0000 7facf2200640 1 -- 172.21.15.52:0/2605472902 wait complete. 2024-09-10T08:31:23.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.152+0000 7fd632000640 1 Processor -- start 2024-09-10T08:31:24.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.152+0000 7fd632000640 1 -- start start 2024-09-10T08:31:24.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.153+0000 7fd632000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd62c0b2d40 0x7fd62c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.153+0000 7fd632000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd62c13eb20 0x7fd62c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.153+0000 7fd632000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c071180 con 0x7fd62c15bcf0 2024-09-10T08:31:24.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.153+0000 7fd632000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c15c890 con 0x7fd62c13eb20 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.153+0000 7fd632000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c071ab0 con 0x7fd62c0b2d40 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd62c13eb20 0x7fd62c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd62c13eb20 0x7fd62c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59604/0 (socket says 172.21.15.52:59604) 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 -- 172.21.15.52:0/3469180930 learned_addr learned my addr 172.21.15.52:0/3469180930 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd62b400640 1 --2- 172.21.15.52:0/3469180930 >> v2:172.21.15.176:3300/0 conn(0x7fd62c0b2d40 0x7fd62c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 -- 172.21.15.52:0/3469180930 >> v2:172.21.15.176:3300/0 conn(0x7fd62c0b2d40 msgr2=0x7fd62c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 --2- 172.21.15.52:0/3469180930 >> v2:172.21.15.176:3300/0 conn(0x7fd62c0b2d40 0x7fd62c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 -- 172.21.15.52:0/3469180930 >> v1:172.21.15.176:6789/0 conn(0x7fd62c15bcf0 legacy=0x7fd62c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:24.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.154+0000 7fd623e00640 1 -- 172.21.15.52:0/3469180930 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c071460 con 0x7fd62c13eb20 2024-09-10T08:31:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.155+0000 7fd623e00640 1 --2- 172.21.15.52:0/3469180930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c06c150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069be0 tx=0x7fd61402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c47101509c6ca52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.155+0000 7fd62aa00640 1 -- 172.21.15.52:0/3469180930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614037070 con 0x7fd62c13eb20 2024-09-10T08:31:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.155+0000 7fd62aa00640 1 -- 172.21.15.52:0/3469180930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614032440 con 0x7fd62c13eb20 2024-09-10T08:31:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.155+0000 7fd62aa00640 1 -- 172.21.15.52:0/3469180930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614032810 con 0x7fd62c13eb20 2024-09-10T08:31:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 -- 172.21.15.52:0/3469180930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 msgr2=0x7fd62c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 --2- 172.21.15.52:0/3469180930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c06c150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd62c069be0 tx=0x7fd61402a230 comp rx=0 tx=0).stop 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 -- 172.21.15.52:0/3469180930 shutdown_connections 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 --2- 172.21.15.52:0/3469180930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c06c150 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 --2- 172.21.15.52:0/3469180930 >> v2:172.21.15.176:3300/0 conn(0x7fd62c0b2d40 0x7fd62c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 -- 172.21.15.52:0/3469180930 >> 172.21.15.52:0/3469180930 conn(0x7fd62c0ccec0 msgr2=0x7fd62c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 -- 172.21.15.52:0/3469180930 shutdown_connections 2024-09-10T08:31:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.156+0000 7fd632000640 1 -- 172.21.15.52:0/3469180930 wait complete. 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.158+0000 7fd632000640 1 Processor -- start 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.158+0000 7fd632000640 1 -- start start 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62c0b2d40 0x7fd62c0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 0x7fd62c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0720c0 con 0x7fd62c13eb20 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c071f40 con 0x7fd62c15bcf0 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd632000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c072240 con 0x7fd62c0b2d40 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59618/0 (socket says 172.21.15.52:59618) 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 -- 172.21.15.52:0/3351745883 learned_addr learned my addr 172.21.15.52:0/3351745883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:24.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd62b400640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62c0b2d40 0x7fd62c0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd62be00640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 0x7fd62c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 -- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62c0b2d40 msgr2=0x7fd62c0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62c0b2d40 0x7fd62c0b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 -- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 msgr2=0x7fd62c0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 0x7fd62c0b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.159+0000 7fd623e00640 1 -- 172.21.15.52:0/3351745883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c156d70 con 0x7fd62c13eb20 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd62be00640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 0x7fd62c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:24.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd623e00640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd614000c00 tx=0x7fd6140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614041020 con 0x7fd62c13eb20 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6140306c0 con 0x7fd62c13eb20 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614037040 con 0x7fd62c13eb20 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c157050 con 0x7fd62c13eb20 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.160+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c157610 con 0x7fd62c13eb20 2024-09-10T08:31:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.161+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c15c180 con 0x7fd62c13eb20 2024-09-10T08:31:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.162+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd614044020 con 0x7fd62c13eb20 2024-09-10T08:31:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.163+0000 7fd623400640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 0x7fd60806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.163+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fd6140ab6f0 con 0x7fd62c13eb20 2024-09-10T08:31:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.163+0000 7fd62b400640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 0x7fd60806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.164+0000 7fd62b400640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 0x7fd60806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd61c006fd0 tx=0x7fd61c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.167+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd61404b030 con 0x7fd62c13eb20 2024-09-10T08:31:24.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.350+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd62c06c9c0 con 0x7fd62c13eb20 2024-09-10T08:31:24.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.352+0000 7fd623400640 1 -- 172.21.15.52:0/3351745883 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16996 (secure 0 0 0) 0x7fd61407a000 con 0x7fd62c13eb20 2024-09-10T08:31:24.351 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:24.351 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:00.364710+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:29:31.784586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-10T08:29:32.424265+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.2a","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 msgr2=0x7fd60806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 0x7fd60806e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd61c006fd0 tx=0x7fd61c008040 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 msgr2=0x7fd62c1562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd614000c00 tx=0x7fd6140046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 shutdown_connections 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd60806be30 0x7fd60806e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd62c15bcf0 0x7fd62c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd62c13eb20 0x7fd62c1562d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 --2- 172.21.15.52:0/3351745883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd62c0b2d40 0x7fd62c0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 >> 172.21.15.52:0/3351745883 conn(0x7fd62c0ccec0 msgr2=0x7fd62c0d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 shutdown_connections 2024-09-10T08:31:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.354+0000 7fd632000640 1 -- 172.21.15.52:0/3351745883 wait complete. 2024-09-10T08:31:24.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:31:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.526+0000 7fa055800640 1 Processor -- start 2024-09-10T08:31:24.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.526+0000 7fa055800640 1 -- start start 2024-09-10T08:31:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.527+0000 7fa055800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa050145ed0 0x7fa0500b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.527+0000 7fa055800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500b4020 con 0x7fa050073180 2024-09-10T08:31:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.527+0000 7fa055800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0500b42c0 con 0x7fa0500b5f90 2024-09-10T08:31:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.527+0000 7fa055800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa0500b63d0 con 0x7fa050145ed0 2024-09-10T08:31:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04e000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa050073180 0x7fa0500b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50856/0 (socket says 172.21.15.52:50856) 2024-09-10T08:31:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04e000640 1 -- 172.21.15.52:0/3183818521 learned_addr learned my addr 172.21.15.52:0/3183818521 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04ea00640 1 --2- 172.21.15.52:0/3183818521 >> v2:172.21.15.176:3300/0 conn(0x7fa050145ed0 0x7fa0500b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996192278 0 0) 0x7fa0500b4020 con 0x7fa050073180 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa034003520 con 0x7fa050073180 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2071599286 0 0) 0x7fa034003520 con 0x7fa050073180 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04ea00640 1 -- 172.21.15.52:0/3183818521 >> v1:172.21.15.176:6789/0 conn(0x7fa0500b5f90 legacy=0x7fa05015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04ea00640 1 -- 172.21.15.52:0/3183818521 >> v1:172.21.15.52:6789/0 conn(0x7fa050073180 legacy=0x7fa0500b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.528+0000 7fa04ea00640 1 -- 172.21.15.52:0/3183818521 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500b45a0 con 0x7fa050145ed0 2024-09-10T08:31:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.529+0000 7fa04ea00640 1 --2- 172.21.15.52:0/3183818521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050145ed0 0x7fa0500b5080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097a0 tx=0x7fa04002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d93a6f62b1e74aee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040037070 con 0x7fa050145ed0 2024-09-10T08:31:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04002ac50 con 0x7fa050145ed0 2024-09-10T08:31:24.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa04d600640 1 -- 172.21.15.52:0/3183818521 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c001690 con 0x7fa050145ed0 2024-09-10T08:31:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa055800640 1 -- 172.21.15.52:0/3183818521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050145ed0 msgr2=0x7fa0500b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa055800640 1 --2- 172.21.15.52:0/3183818521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050145ed0 0x7fa0500b5080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa0400097a0 tx=0x7fa04002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa055800640 1 -- 172.21.15.52:0/3183818521 shutdown_connections 2024-09-10T08:31:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa055800640 1 --2- 172.21.15.52:0/3183818521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa050145ed0 0x7fa0500b5080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.530+0000 7fa055800640 1 -- 172.21.15.52:0/3183818521 >> 172.21.15.52:0/3183818521 conn(0x7fa0500ccec0 msgr2=0x7fa0500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.531+0000 7fa055800640 1 -- 172.21.15.52:0/3183818521 shutdown_connections 2024-09-10T08:31:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.531+0000 7fa055800640 1 -- 172.21.15.52:0/3183818521 wait complete. 2024-09-10T08:31:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.532+0000 7fa055800640 1 Processor -- start 2024-09-10T08:31:24.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.532+0000 7fa055800640 1 -- start start 2024-09-10T08:31:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0500b5f90 0x7fa050159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa050145ed0 0x7fa050159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0501462b0 con 0x7fa050073180 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0500b4b60 con 0x7fa0500b5f90 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa055800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa050146430 con 0x7fa050145ed0 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.533+0000 7fa04ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59630/0 (socket says 172.21.15.52:59630) 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 -- 172.21.15.52:0/491428821 learned_addr learned my addr 172.21.15.52:0/491428821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04f400640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa050145ed0 0x7fa050159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04e000640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0500b5f90 0x7fa050159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 -- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa050145ed0 msgr2=0x7fa050159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa050145ed0 0x7fa050159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 -- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0500b5f90 msgr2=0x7fa050159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0500b5f90 0x7fa050159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 -- 172.21.15.52:0/491428821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0501f8e40 con 0x7fa050073180 2024-09-10T08:31:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.534+0000 7fa04ea00640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098c0 tx=0x7fa0400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.535+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040041070 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.535+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04003c460 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.535+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040037040 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.535+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05013ef20 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.535+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05013f4e0 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.536+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0500b5080 con 0x7fa050073180 2024-09-10T08:31:24.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.537+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa040044070 con 0x7fa050073180 2024-09-10T08:31:24.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.537+0000 7fa046a00640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 0x7fa03006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.538+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fa0400ab5e0 con 0x7fa050073180 2024-09-10T08:31:24.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.538+0000 7fa04e000640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 0x7fa03006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.539+0000 7fa04e000640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 0x7fa03006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa05013ec00 tx=0x7fa03c001bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.542+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa040079e60 con 0x7fa050073180 2024-09-10T08:31:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.763+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0500cd9b0 con 0x7fa050073180 2024-09-10T08:31:24.763 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:31:24.764+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:31:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.766+0000 7fa046a00640 1 -- 172.21.15.52:0/491428821 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fa040079760 con 0x7fa050073180 2024-09-10T08:31:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:31:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 msgr2=0x7fa03006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 0x7fa03006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa05013ec00 tx=0x7fa03c001bc0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 msgr2=0x7fa050158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa0400098c0 tx=0x7fa0400046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 shutdown_connections 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa03006be30 0x7fa03006e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa050145ed0 0x7fa050159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0500b5f90 0x7fa050159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 --2- 172.21.15.52:0/491428821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa050073180 0x7fa050158470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 >> 172.21.15.52:0/491428821 conn(0x7fa0500ccec0 msgr2=0x7fa0500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 shutdown_connections 2024-09-10T08:31:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.770+0000 7fa055800640 1 -- 172.21.15.52:0/491428821 wait complete. 2024-09-10T08:31:24.792 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:31:24.850 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:31:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.955+0000 7f6ce1200640 1 Processor -- start 2024-09-10T08:31:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.956+0000 7f6ce1200640 1 -- start start 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6ce1200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 0x7f6cdc0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6ce1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cdc0b8070 0x7f6cdc0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6ce1200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cdc0d3250 con 0x7f6cdc15e620 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6ce1200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6cdc0b7680 con 0x7f6cdc0b8070 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6ce1200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6cdc0d18e0 con 0x7f6cdc0d0f60 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cdc0b8070 0x7f6cdc0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6cdc0b8070 0x7f6cdc0b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59658/0 (socket says 172.21.15.52:59658) 2024-09-10T08:31:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 -- 172.21.15.52:0/1353725906 learned_addr learned my addr 172.21.15.52:0/1353725906 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/1353725906 >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 0x7f6cdc0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 -- 172.21.15.52:0/1353725906 >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 msgr2=0x7f6cdc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 --2- 172.21.15.52:0/1353725906 >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 0x7f6cdc0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 -- 172.21.15.52:0/1353725906 >> v1:172.21.15.176:6789/0 conn(0x7f6cdc15e620 legacy=0x7f6cdc0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cdbe00640 1 -- 172.21.15.52:0/1353725906 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc0b78b0 con 0x7f6cdc0b8070 2024-09-10T08:31:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.957+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/1353725906 >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 0x7f6cdc0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.958+0000 7f6cdbe00640 1 --2- 172.21.15.52:0/1353725906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc0b8500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0d08c0 tx=0x7f6cd402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afd5a3c726a6eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6cdaa00640 1 -- 172.21.15.52:0/1353725906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4036070 con 0x7f6cdc0b8070 2024-09-10T08:31:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6cdaa00640 1 -- 172.21.15.52:0/1353725906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd4031600 con 0x7f6cdc0b8070 2024-09-10T08:31:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6cdaa00640 1 -- 172.21.15.52:0/1353725906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40319d0 con 0x7f6cdc0b8070 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 -- 172.21.15.52:0/1353725906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 msgr2=0x7f6cdc0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 --2- 172.21.15.52:0/1353725906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc0b8500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0d08c0 tx=0x7f6cd402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 -- 172.21.15.52:0/1353725906 shutdown_connections 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 --2- 172.21.15.52:0/1353725906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc0b8500 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 --2- 172.21.15.52:0/1353725906 >> v2:172.21.15.176:3300/0 conn(0x7f6cdc0d0f60 0x7f6cdc0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.959+0000 7f6ce1200640 1 -- 172.21.15.52:0/1353725906 >> 172.21.15.52:0/1353725906 conn(0x7f6cdc067950 msgr2=0x7f6cdc067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.960+0000 7f6ce1200640 1 -- 172.21.15.52:0/1353725906 shutdown_connections 2024-09-10T08:31:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.960+0000 7f6ce1200640 1 -- 172.21.15.52:0/1353725906 wait complete. 2024-09-10T08:31:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.961+0000 7f6ce1200640 1 Processor -- start 2024-09-10T08:31:24.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.961+0000 7f6ce1200640 1 -- start start 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 0x7f6cdc0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 0x7f6cdc153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d2f70 con 0x7f6cdc0b8070 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d2c90 con 0x7f6cdc15e620 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6ce1200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc0d40a0 con 0x7f6cdc0d0f60 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6cdb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6cdb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59670/0 (socket says 172.21.15.52:59670) 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.962+0000 7f6cdb400640 1 -- 172.21.15.52:0/214914366 learned_addr learned my addr 172.21.15.52:0/214914366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 0x7f6cdc0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 -- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 msgr2=0x7f6cdc0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdbe00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 0x7f6cdc153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 0x7f6cdc0cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 -- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 msgr2=0x7f6cdc153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 0x7f6cdc153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 -- 172.21.15.52:0/214914366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc0ce400 con 0x7f6cdc0b8070 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 0x7f6cdc0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdbe00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 0x7f6cdc153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cdb400640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00b3f0 tx=0x7f6ccc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc015020 con 0x7f6cdc0b8070 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc011830 con 0x7f6cdc0b8070 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc011c20 con 0x7f6cdc0b8070 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.963+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc155af0 con 0x7f6cdc0b8070 2024-09-10T08:31:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.964+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc1560b0 con 0x7f6cdc0b8070 2024-09-10T08:31:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.964+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc0d13a0 con 0x7f6cdc0b8070 2024-09-10T08:31:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.965+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ccc018020 con 0x7f6cdc0b8070 2024-09-10T08:31:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.966+0000 7f6cd3400640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.966+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5911+0+0 (secure 0 0 0) 0x7f6ccc08ab20 con 0x7f6cdc0b8070 2024-09-10T08:31:24.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.967+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:24.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.968+0000 7f6cd3e00640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 0x7f6cb806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006fd0 tx=0x7f6cc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:24.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:24.971+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ccc01f030 con 0x7f6cdc0b8070 2024-09-10T08:31:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.191+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6cdc0cc670 con 0x7f6cdc0b8070 2024-09-10T08:31:25.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.773+0000 7f6cd3400640 1 -- 172.21.15.52:0/214914366 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f6ccc0172c0 con 0x7f6cdc0b8070 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 msgr2=0x7f6cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 0x7f6cb806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006fd0 tx=0x7f6cc4008040 comp rx=0 tx=0).stop 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 msgr2=0x7f6cdc1f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00b3f0 tx=0x7f6ccc00b8b0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 shutdown_connections 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cdc15e620 0x7f6cdc153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6cdc0d0f60 0x7f6cdc0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 --2- 172.21.15.52:0/214914366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cdc0b8070 0x7f6cdc1f8440 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.775+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 >> 172.21.15.52:0/214914366 conn(0x7f6cdc067950 msgr2=0x7f6cdc0d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:25.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.776+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 shutdown_connections 2024-09-10T08:31:25.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.776+0000 7f6ce1200640 1 -- 172.21.15.52:0/214914366 wait complete. 2024-09-10T08:31:25.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:31:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.956+0000 7f0a96e00640 1 Processor -- start 2024-09-10T08:31:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.956+0000 7f0a96e00640 1 -- start start 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a96e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a900b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a96e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a900b0680 con 0x7f0a900cfb30 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a96e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a900ccf70 con 0x7f0a900b21a0 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a96e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a900b2600 con 0x7f0a90155b20 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a94e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0a900cfb30 0x7f0a9015c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50884/0 (socket says 172.21.15.52:50884) 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a94e00640 1 -- 172.21.15.52:0/3250328893 learned_addr learned my addr 172.21.15.52:0/3250328893 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a900b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682268463 0 0) 0x7f0a900b0680 con 0x7f0a900cfb30 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.958+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a74003520 con 0x7f0a900cfb30 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1052515491 0 0) 0x7f0a74003520 con 0x7f0a900cfb30 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 msgr2=0x7f0a900b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a900b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 >> v1:172.21.15.176:6789/0 conn(0x7f0a900b21a0 legacy=0x7f0a900cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a900ce940 con 0x7f0a900cfb30 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f0a880019f0 con 0x7f0a900cfb30 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 >> v1:172.21.15.52:6789/0 conn(0x7f0a900cfb30 legacy=0x7f0a9015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a74004d40 0x7f0a740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7400ba70 con 0x7f0a740039e0 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7400bc20 con 0x7f0a74004d40 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7400be20 con 0x7f0a90155b20 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a87e00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.959+0000 7f0a94e00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a74004d40 0x7f0a740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.960+0000 7f0a8fe00640 1 -- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 msgr2=0x7f0a74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.960+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90155b20 0x7f0a74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.960+0000 7f0a8fe00640 1 -- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a74004d40 msgr2=0x7f0a740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.960+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a74004d40 0x7f0a740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.960+0000 7f0a8fe00640 1 -- 172.21.15.52:0/3250328893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74003520 con 0x7f0a740039e0 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a74003e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009a90 tx=0x7f0a74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75327a56b56e5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80036070 con 0x7f0a740039e0 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80031400 con 0x7f0a740039e0 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a8f400640 1 -- 172.21.15.52:0/3250328893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80009690 con 0x7f0a740039e0 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a96e00640 1 -- 172.21.15.52:0/3250328893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 msgr2=0x7f0a74003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a96e00640 1 --2- 172.21.15.52:0/3250328893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a74003e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009a90 tx=0x7f0a74005830 comp rx=0 tx=0).stop 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.961+0000 7f0a94e00640 1 -- 172.21.15.52:0/3250328893 reap_dead start 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.962+0000 7f0a96e00640 1 -- 172.21.15.52:0/3250328893 shutdown_connections 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.962+0000 7f0a96e00640 1 -- 172.21.15.52:0/3250328893 >> 172.21.15.52:0/3250328893 conn(0x7f0a9006c240 msgr2=0x7f0a9006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.962+0000 7f0a96e00640 1 -- 172.21.15.52:0/3250328893 shutdown_connections 2024-09-10T08:31:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.962+0000 7f0a96e00640 1 -- 172.21.15.52:0/3250328893 wait complete. 2024-09-10T08:31:25.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.963+0000 7f0a96e00640 1 Processor -- start 2024-09-10T08:31:25.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.963+0000 7f0a96e00640 1 -- start start 2024-09-10T08:31:25.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 0x7f0a9006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 0x7f0a9006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900cef00 con 0x7f0a740039e0 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900b01e0 con 0x7f0a90153c70 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a96e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a900ce610 con 0x7f0a90168c70 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a8fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.964+0000 7f0a8fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59684/0 (socket says 172.21.15.52:59684) 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 -- 172.21.15.52:0/2985535074 learned_addr learned my addr 172.21.15.52:0/2985535074 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a94e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 0x7f0a9006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a87e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 0x7f0a9006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 -- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 msgr2=0x7f0a9006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 0x7f0a9006d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 -- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 msgr2=0x7f0a9006d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 0x7f0a9006d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 -- 172.21.15.52:0/2985535074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a901691e0 con 0x7f0a740039e0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a87e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 0x7f0a9006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a94e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 0x7f0a9006d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8fe00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a80034040 tx=0x7f0a80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.965+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80040020 con 0x7f0a740039e0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.966+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80003940 con 0x7f0a740039e0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.966+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80036040 con 0x7f0a740039e0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.966+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9016a010 con 0x7f0a740039e0 2024-09-10T08:31:25.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.966+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9016a5d0 con 0x7f0a740039e0 2024-09-10T08:31:25.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.967+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a900b10f0 con 0x7f0a740039e0 2024-09-10T08:31:25.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.968+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a80043020 con 0x7f0a740039e0 2024-09-10T08:31:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.968+0000 7f0a8cc00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 0x7f0a6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.969+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5911+0+0 (secure 0 0 0) 0x7f0a800ab440 con 0x7f0a740039e0 2024-09-10T08:31:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.969+0000 7f0a87e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 0x7f0a6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.970+0000 7f0a87e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 0x7f0a6c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a78000c00 tx=0x7f0a78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:25.973+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a8004a030 con 0x7f0a740039e0 2024-09-10T08:31:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.159+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a9006de30 con 0x7f0a740039e0 2024-09-10T08:31:26.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.775+0000 7f0a8cc00640 1 -- 172.21.15.52:0/2985535074 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7f0a80079c80 con 0x7f0a740039e0 2024-09-10T08:31:26.774 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:31:26.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.779+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 msgr2=0x7f0a6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.779+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 0x7f0a6c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a78000c00 tx=0x7f0a78009040 comp rx=0 tx=0).stop 2024-09-10T08:31:26.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.779+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 msgr2=0x7f0a9015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.779+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a80034040 tx=0x7f0a80004730 comp rx=0 tx=0).stop 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 shutdown_connections 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a6c06be30 0x7f0a6c06e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a90153c70 0x7f0a9006d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a90168c70 0x7f0a9006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 --2- 172.21.15.52:0/2985535074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a740039e0 0x7f0a9015bb80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 >> 172.21.15.52:0/2985535074 conn(0x7f0a9006c240 msgr2=0x7f0a90071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:26.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 shutdown_connections 2024-09-10T08:31:26.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.780+0000 7f0a96e00640 1 -- 172.21.15.52:0/2985535074 wait complete. 2024-09-10T08:31:26.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:31:26.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.965+0000 7f92cd200640 1 Processor -- start 2024-09-10T08:31:26.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.965+0000 7f92cd200640 1 -- start start 2024-09-10T08:31:26.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92cd200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f92c80b6000 0x7f92c80afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92cd200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c8146220 con 0x7f92c81454b0 2024-09-10T08:31:26.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92cd200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c80cf640 con 0x7f92c80b2dc0 2024-09-10T08:31:26.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92cd200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f92c80b1920 con 0x7f92c80b6000 2024-09-10T08:31:26.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92c5e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f92c81454b0 0x7f92c80b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50892/0 (socket says 172.21.15.52:50892) 2024-09-10T08:31:26.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92c5e00640 1 -- 172.21.15.52:0/1626598854 learned_addr learned my addr 172.21.15.52:0/1626598854 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:26.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.966+0000 7f92bfe00640 1 --2- 172.21.15.52:0/1626598854 >> v2:172.21.15.52:3300/0 conn(0x7f92c80b6000 0x7f92c80afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.967+0000 7f92c5400640 1 -- 172.21.15.52:0/1626598854 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738221772 0 0) 0x7f92b8001110 con 0x7f92c81454b0 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.967+0000 7f92c5400640 1 -- 172.21.15.52:0/1626598854 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ac003520 con 0x7f92c81454b0 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.967+0000 7f92bfe00640 1 -- 172.21.15.52:0/1626598854 >> v1:172.21.15.176:6789/0 conn(0x7f92c80b2dc0 legacy=0x7f92c80b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.967+0000 7f92bfe00640 1 -- 172.21.15.52:0/1626598854 >> v1:172.21.15.52:6789/0 conn(0x7f92c81454b0 legacy=0x7f92c80b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.967+0000 7f92bfe00640 1 -- 172.21.15.52:0/1626598854 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c80cf8e0 con 0x7f92c80b6000 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92bfe00640 1 --2- 172.21.15.52:0/1626598854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b6000 0x7f92c80afe40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92b00097a0 tx=0x7f92b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80ea10650a3fb6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92c5400640 1 -- 172.21.15.52:0/1626598854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0037070 con 0x7f92c80b6000 2024-09-10T08:31:26.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92c5400640 1 -- 172.21.15.52:0/1626598854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b0032440 con 0x7f92c80b6000 2024-09-10T08:31:26.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92c5400640 1 -- 172.21.15.52:0/1626598854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0032810 con 0x7f92c80b6000 2024-09-10T08:31:26.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92cd200640 1 -- 172.21.15.52:0/1626598854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b6000 msgr2=0x7f92c80afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.968+0000 7f92cd200640 1 --2- 172.21.15.52:0/1626598854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b6000 0x7f92c80afe40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f92b00097a0 tx=0x7f92b002a270 comp rx=0 tx=0).stop 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.969+0000 7f92cd200640 1 -- 172.21.15.52:0/1626598854 shutdown_connections 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.969+0000 7f92cd200640 1 --2- 172.21.15.52:0/1626598854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b6000 0x7f92c80afe40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.969+0000 7f92cd200640 1 -- 172.21.15.52:0/1626598854 >> 172.21.15.52:0/1626598854 conn(0x7f92c806c240 msgr2=0x7f92c806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.969+0000 7f92cd200640 1 -- 172.21.15.52:0/1626598854 shutdown_connections 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.969+0000 7f92cd200640 1 -- 172.21.15.52:0/1626598854 wait complete. 2024-09-10T08:31:26.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.970+0000 7f92cd200640 1 Processor -- start 2024-09-10T08:31:26.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.970+0000 7f92cd200640 1 -- start start 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 0x7f92c80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92c81454b0 0x7f92c80aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f92c80d0180 con 0x7f92c80b2dc0 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92c80cfea0 con 0x7f92c81454b0 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92cd200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92c81459a0 con 0x7f92c80b6000 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.971+0000 7f92c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59710/0 (socket says 172.21.15.52:59710) 2024-09-10T08:31:26.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 -- 172.21.15.52:0/4062879825 learned_addr learned my addr 172.21.15.52:0/4062879825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c6800640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92c81454b0 0x7f92c80aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92bfe00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 0x7f92c80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 -- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 msgr2=0x7f92c80ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 0x7f92c80ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 -- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92c81454b0 msgr2=0x7f92c80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92c81454b0 0x7f92c80aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 -- 172.21.15.52:0/4062879825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c80b4900 con 0x7f92c80b2dc0 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92bfe00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 0x7f92c80ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92c5e00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c3a0 tx=0x7f92b800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.972+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8017070 con 0x7f92c80b2dc0 2024-09-10T08:31:26.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.973+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b8005ce0 con 0x7f92c80b2dc0 2024-09-10T08:31:26.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.973+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c81e7a10 con 0x7f92c80b2dc0 2024-09-10T08:31:26.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.973+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8007310 con 0x7f92c80b2dc0 2024-09-10T08:31:26.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.973+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c80b3b40 con 0x7f92c80b2dc0 2024-09-10T08:31:26.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.974+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c8142750 con 0x7f92c80b2dc0 2024-09-10T08:31:26.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.975+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92b801a070 con 0x7f92c80b2dc0 2024-09-10T08:31:26.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.975+0000 7f92be000640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:26.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.975+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5473+0+0 (secure 0 0 0) 0x7f92b808a230 con 0x7f92c80b2dc0 2024-09-10T08:31:26.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.976+0000 7f92bfe00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:26.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.977+0000 7f92bfe00640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 0x7f92a406e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:26.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:26.980+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92c8142750 con 0x7f92c80b2dc0 2024-09-10T08:31:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.165+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f92c80b15b0 con 0x7f92c80b2dc0 2024-09-10T08:31:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.780+0000 7f92be000640 1 -- 172.21.15.52:0/4062879825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7f92c80b15b0 con 0x7f92c80b2dc0 2024-09-10T08:31:27.780 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:31:27.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.784+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 msgr2=0x7f92a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.784+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 0x7f92a406e320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002e000 comp rx=0 tx=0).stop 2024-09-10T08:31:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.784+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 msgr2=0x7f92c81e74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.784+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f92b800c3a0 tx=0x7f92b800c860 comp rx=0 tx=0).stop 2024-09-10T08:31:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 shutdown_connections 2024-09-10T08:31:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92a406be60 0x7f92a406e320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92c81454b0 0x7f92c80aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92c80b6000 0x7f92c80ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 --2- 172.21.15.52:0/4062879825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c80b2dc0 0x7f92c81e74d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 >> 172.21.15.52:0/4062879825 conn(0x7f92c806c240 msgr2=0x7f92c80b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 shutdown_connections 2024-09-10T08:31:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.785+0000 7f92cd200640 1 -- 172.21.15.52:0/4062879825 wait complete. 2024-09-10T08:31:27.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:31:27.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.966+0000 7fd86e000640 1 Processor -- start 2024-09-10T08:31:27.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.967+0000 7fd86e000640 1 -- start start 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd86e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8680732e0 0x7fd8680736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd86e000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8680cd2a0 0x7fd86815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd86e000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8680714b0 con 0x7fd8680cce30 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd86e000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd868073c00 con 0x7fd8680732e0 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd86e000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd8680cd880 con 0x7fd8680cd2a0 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd867400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd8680732e0 0x7fd8680736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd85fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd8680cce30 0x7fd868071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50894/0 (socket says 172.21.15.52:50894) 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd85fe00640 1 -- 172.21.15.52:0/1985676875 learned_addr learned my addr 172.21.15.52:0/1985676875 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.968+0000 7fd867e00640 1 --2- 172.21.15.52:0/1985676875 >> v2:172.21.15.176:3300/0 conn(0x7fd8680cd2a0 0x7fd86815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.969+0000 7fd867400640 1 -- 172.21.15.52:0/1985676875 >> v2:172.21.15.176:3300/0 conn(0x7fd8680cd2a0 msgr2=0x7fd86815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:27.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.969+0000 7fd867400640 1 --2- 172.21.15.52:0/1985676875 >> v2:172.21.15.176:3300/0 conn(0x7fd8680cd2a0 0x7fd86815c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.969+0000 7fd867400640 1 -- 172.21.15.52:0/1985676875 >> v1:172.21.15.52:6789/0 conn(0x7fd8680cce30 legacy=0x7fd868071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.969+0000 7fd867400640 1 -- 172.21.15.52:0/1985676875 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8680cdb60 con 0x7fd8680732e0 2024-09-10T08:31:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.969+0000 7fd866a00640 1 -- 172.21.15.52:0/1985676875 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340652660 0 0) 0x7fd8680714b0 con 0x7fd8680cce30 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd867400640 1 --2- 172.21.15.52:0/1985676875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8680736c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8680c5550 tx=0x7fd85802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae52befcbbd5046 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd866a00640 1 -- 172.21.15.52:0/1985676875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858037070 con 0x7fd8680732e0 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd866a00640 1 -- 172.21.15.52:0/1985676875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd858032440 con 0x7fd8680732e0 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd866a00640 1 -- 172.21.15.52:0/1985676875 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85802ae60 con 0x7fd8680732e0 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd86e000640 1 -- 172.21.15.52:0/1985676875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 msgr2=0x7fd8680736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.970+0000 7fd86e000640 1 --2- 172.21.15.52:0/1985676875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8680736c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd8680c5550 tx=0x7fd85802a110 comp rx=0 tx=0).stop 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 -- 172.21.15.52:0/1985676875 shutdown_connections 2024-09-10T08:31:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 --2- 172.21.15.52:0/1985676875 >> v2:172.21.15.176:3300/0 conn(0x7fd8680cd2a0 0x7fd86815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 --2- 172.21.15.52:0/1985676875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8680736c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 -- 172.21.15.52:0/1985676875 >> 172.21.15.52:0/1985676875 conn(0x7fd86806d0f0 msgr2=0x7fd86806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 -- 172.21.15.52:0/1985676875 shutdown_connections 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.971+0000 7fd86e000640 1 -- 172.21.15.52:0/1985676875 wait complete. 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.972+0000 7fd86e000640 1 Processor -- start 2024-09-10T08:31:27.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.972+0000 7fd86e000640 1 -- start start 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8680cce30 0x7fd86813d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8680cd2a0 0x7fd86813d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd86806bf70 con 0x7fd8680732e0 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd86806bdf0 con 0x7fd8680cce30 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd86e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd868072380 con 0x7fd8680cd2a0 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd867400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd867400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59734/0 (socket says 172.21.15.52:59734) 2024-09-10T08:31:27.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.973+0000 7fd867400640 1 -- 172.21.15.52:0/3431556844 learned_addr learned my addr 172.21.15.52:0/3431556844 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd85fe00640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8680cce30 0x7fd86813d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867e00640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8680cd2a0 0x7fd86813d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 -- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8680cd2a0 msgr2=0x7fd86813d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8680cd2a0 0x7fd86813d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 -- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8680cce30 msgr2=0x7fd86813d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8680cce30 0x7fd86813d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 -- 172.21.15.52:0/3431556844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86814e790 con 0x7fd8680732e0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd867400640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd858009890 tx=0x7fd8580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858037040 con 0x7fd8680732e0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd858042070 con 0x7fd8680732e0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858030bd0 con 0x7fd8680732e0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.974+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8681e6f10 con 0x7fd8680732e0 2024-09-10T08:31:27.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.975+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8681e74d0 con 0x7fd8680732e0 2024-09-10T08:31:27.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.976+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8680736c0 con 0x7fd8680732e0 2024-09-10T08:31:27.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.976+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd858047460 con 0x7fd8680732e0 2024-09-10T08:31:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.977+0000 7fd85f400640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 0x7fd84406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.977+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fd8580ab6f0 con 0x7fd8680732e0 2024-09-10T08:31:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.978+0000 7fd85fe00640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 0x7fd84406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:27.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.978+0000 7fd85fe00640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 0x7fd84406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8680ced30 tx=0x7fd850007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:27.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:27.981+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd86814e790 con 0x7fd8680732e0 2024-09-10T08:31:28.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.167+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd8680711f0 con 0x7fd8680732e0 2024-09-10T08:31:28.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.180+0000 7fd85f400640 1 -- 172.21.15.52:0/3431556844 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fd858032e20 con 0x7fd8680732e0 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.185+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 msgr2=0x7fd84406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.185+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 0x7fd84406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd8680ced30 tx=0x7fd850007c00 comp rx=0 tx=0).stop 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.185+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 msgr2=0x7fd8681e7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.185+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd858009890 tx=0x7fd8580046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 shutdown_connections 2024-09-10T08:31:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd84406be60 0x7fd84406e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd8680cd2a0 0x7fd86813d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8680cce30 0x7fd86813d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 --2- 172.21.15.52:0/3431556844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8680732e0 0x7fd8681e7fb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.186+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 >> 172.21.15.52:0/3431556844 conn(0x7fd86806d0f0 msgr2=0x7fd86815efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.187+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 shutdown_connections 2024-09-10T08:31:28.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.187+0000 7fd86e000640 1 -- 172.21.15.52:0/3431556844 wait complete. 2024-09-10T08:31:28.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-10T08:31:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.367+0000 7f4a81400640 1 Processor -- start 2024-09-10T08:31:28.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.367+0000 7f4a81400640 1 -- start start 2024-09-10T08:31:28.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.368+0000 7f4a81400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a7c15e870 0x7f4a7c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.368+0000 7f4a81400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.368+0000 7f4a81400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7c15f6e0 con 0x7f4a7c0b2170 2024-09-10T08:31:28.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.368+0000 7f4a81400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7c071c00 con 0x7f4a7c15e870 2024-09-10T08:31:28.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.368+0000 7f4a81400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c15f9c0 con 0x7f4a7c0733e0 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a80a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a7c15e870 0x7f4a7c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a7c15e870 0x7f4a7c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41854/0 (socket says 172.21.15.52:41854) 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 -- 172.21.15.52:0/1742249873 learned_addr learned my addr 172.21.15.52:0/1742249873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a80a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57222/0 (socket says 172.21.15.52:57222) 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7b400640 1 --1- 172.21.15.52:0/1742249873 >> v1:172.21.15.176:6789/0 conn(0x7f4a7c0b2170 0x7f4a7c072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60454/0 (socket says 172.21.15.52:60454) 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 -- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 msgr2=0x7f4a7c072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 -- 172.21.15.52:0/1742249873 >> v1:172.21.15.176:6789/0 conn(0x7f4a7c0b2170 legacy=0x7f4a7c072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7be00640 1 -- 172.21.15.52:0/1742249873 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c071890 con 0x7f4a7c15e870 2024-09-10T08:31:28.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.370+0000 7f4a80a00640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:28.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.369+0000 7f4a7aa00640 1 -- 172.21.15.52:0/1742249873 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570755032 0 0) 0x7f4a7c15f6e0 con 0x7f4a7c0b2170 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a7be00640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c15e870 0x7f4a7c0ae870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009870 tx=0x7f4a6c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e713b127e0e693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a7aa00640 1 -- 172.21.15.52:0/1742249873 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c037070 con 0x7f4a7c15e870 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a7aa00640 1 -- 172.21.15.52:0/1742249873 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c032440 con 0x7f4a7c15e870 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a7aa00640 1 -- 172.21.15.52:0/1742249873 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c032810 con 0x7f4a7c15e870 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a81400640 1 -- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c15e870 msgr2=0x7f4a7c0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a81400640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c15e870 0x7f4a7c0ae870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009870 tx=0x7f4a6c02a130 comp rx=0 tx=0).stop 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.371+0000 7f4a81400640 1 -- 172.21.15.52:0/1742249873 shutdown_connections 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.372+0000 7f4a81400640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0733e0 0x7f4a7c072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.372+0000 7f4a81400640 1 --2- 172.21.15.52:0/1742249873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c15e870 0x7f4a7c0ae870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.372+0000 7f4a81400640 1 -- 172.21.15.52:0/1742249873 >> 172.21.15.52:0/1742249873 conn(0x7f4a7c0b0640 msgr2=0x7f4a7c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:28.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.372+0000 7f4a81400640 1 -- 172.21.15.52:0/1742249873 shutdown_connections 2024-09-10T08:31:28.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.372+0000 7f4a81400640 1 -- 172.21.15.52:0/1742249873 wait complete. 2024-09-10T08:31:28.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.373+0000 7f4a81400640 1 Processor -- start 2024-09-10T08:31:28.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.373+0000 7f4a81400640 1 -- start start 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0b2170 0x7f4a7c161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c1f3b50 0x7f4a7c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c0aedb0 con 0x7f4a7c0733e0 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c068030 con 0x7f4a7c1f3b50 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.374+0000 7f4a81400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7c0aef30 con 0x7f4a7c0b2170 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59748/0 (socket says 172.21.15.52:59748) 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 -- 172.21.15.52:0/2884464530 learned_addr learned my addr 172.21.15.52:0/2884464530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7b400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0b2170 0x7f4a7c161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a80a00640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c1f3b50 0x7f4a7c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 -- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0b2170 msgr2=0x7f4a7c161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0b2170 0x7f4a7c161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 -- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c1f3b50 msgr2=0x7f4a7c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c1f3b50 0x7f4a7c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 -- 172.21.15.52:0/2884464530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c162ff0 con 0x7f4a7c0733e0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.375+0000 7f4a7be00640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009870 tx=0x7f4a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.376+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c041020 con 0x7f4a7c0733e0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.376+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c030660 con 0x7f4a7c0733e0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.376+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c037040 con 0x7f4a7c0733e0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.376+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c15d410 con 0x7f4a7c0733e0 2024-09-10T08:31:28.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.376+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c15d9d0 con 0x7f4a7c0733e0 2024-09-10T08:31:28.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.377+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7c06f280 con 0x7f4a7c0733e0 2024-09-10T08:31:28.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.378+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a6c044020 con 0x7f4a7c0733e0 2024-09-10T08:31:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.379+0000 7f4a73e00640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 0x7f4a5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.379+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f4a6c0ab160 con 0x7f4a7c0733e0 2024-09-10T08:31:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.379+0000 7f4a7b400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 0x7f4a5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.380+0000 7f4a7b400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 0x7f4a5c06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0d0790 tx=0x7f4a68007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.383+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a6c04b030 con 0x7f4a7c0733e0 2024-09-10T08:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.638+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f4a7c159e60 con 0x7f4a7c0733e0 2024-09-10T08:31:28.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.781+0000 7f4a73e00640 1 -- 172.21.15.52:0/2884464530 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v136) ==== 148+0+0 (secure 0 0 0) 0x7f4a6c079e00 con 0x7f4a7c0733e0 2024-09-10T08:31:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.783+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 msgr2=0x7f4a5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.783+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 0x7f4a5c06e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0d0790 tx=0x7f4a68007d50 comp rx=0 tx=0).stop 2024-09-10T08:31:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 msgr2=0x7f4a7c15ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009870 tx=0x7f4a6c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 shutdown_connections 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a5c06be30 0x7f4a5c06e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a7c1f3b50 0x7f4a7c0b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a7c0b2170 0x7f4a7c161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 --2- 172.21.15.52:0/2884464530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a7c0733e0 0x7f4a7c15ab40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 >> 172.21.15.52:0/2884464530 conn(0x7f4a7c0b0640 msgr2=0x7f4a7c0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 shutdown_connections 2024-09-10T08:31:28.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.784+0000 7f4a81400640 1 -- 172.21.15.52:0/2884464530 wait complete. 2024-09-10T08:31:28.801 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-10T08:31:28.802 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:31:28.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:28.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.958+0000 7f1a38800640 1 Processor -- start 2024-09-10T08:31:28.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.958+0000 7f1a38800640 1 -- start start 2024-09-10T08:31:28.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a38800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1a30073890 0x7f1a300b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a38800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a300b5880 0x7f1a300b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a38800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a300b4020 con 0x7f1a30145ed0 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a38800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1a300b42c0 con 0x7f1a300b5880 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a38800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1a300b45a0 con 0x7f1a30073890 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a35e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a30145ed0 0x7f1a30073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50906/0 (socket says 172.21.15.52:50906) 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a35e00640 1 -- 172.21.15.52:0/4132352348 learned_addr learned my addr 172.21.15.52:0/4132352348 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.959+0000 7f1a36800640 1 --2- 172.21.15.52:0/4132352348 >> v2:172.21.15.52:3300/0 conn(0x7f1a300b5880 0x7f1a300b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a35400640 1 --2- 172.21.15.52:0/4132352348 >> v2:172.21.15.176:3300/0 conn(0x7f1a30073890 0x7f1a300b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a36800640 1 -- 172.21.15.52:0/4132352348 >> v2:172.21.15.176:3300/0 conn(0x7f1a30073890 msgr2=0x7f1a300b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a36800640 1 --2- 172.21.15.52:0/4132352348 >> v2:172.21.15.176:3300/0 conn(0x7f1a30073890 0x7f1a300b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a34a00640 1 -- 172.21.15.52:0/4132352348 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664031772 0 0) 0x7f1a300b4020 con 0x7f1a30145ed0 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a36800640 1 -- 172.21.15.52:0/4132352348 >> v1:172.21.15.52:6789/0 conn(0x7f1a30145ed0 legacy=0x7f1a30073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.960+0000 7f1a36800640 1 -- 172.21.15.52:0/4132352348 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a300b4880 con 0x7f1a300b5880 2024-09-10T08:31:28.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.961+0000 7f1a36800640 1 --2- 172.21.15.52:0/4132352348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a300b5880 0x7f1a300b5ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a300d1490 tx=0x7f1a2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9694f9a7c579d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.961+0000 7f1a34a00640 1 -- 172.21.15.52:0/4132352348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007740 con 0x7f1a300b5880 2024-09-10T08:31:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.961+0000 7f1a34a00640 1 -- 172.21.15.52:0/4132352348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0078e0 con 0x7f1a300b5880 2024-09-10T08:31:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.961+0000 7f1a34a00640 1 -- 172.21.15.52:0/4132352348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007cb0 con 0x7f1a300b5880 2024-09-10T08:31:28.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 -- 172.21.15.52:0/4132352348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a300b5880 msgr2=0x7f1a300b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 --2- 172.21.15.52:0/4132352348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a300b5880 0x7f1a300b5ce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a300d1490 tx=0x7f1a2c02a680 comp rx=0 tx=0).stop 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 -- 172.21.15.52:0/4132352348 shutdown_connections 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 --2- 172.21.15.52:0/4132352348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a300b5880 0x7f1a300b5ce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 --2- 172.21.15.52:0/4132352348 >> v2:172.21.15.176:3300/0 conn(0x7f1a30073890 0x7f1a300b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 -- 172.21.15.52:0/4132352348 >> 172.21.15.52:0/4132352348 conn(0x7f1a300ccec0 msgr2=0x7f1a300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 -- 172.21.15.52:0/4132352348 shutdown_connections 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.962+0000 7f1a38800640 1 -- 172.21.15.52:0/4132352348 wait complete. 2024-09-10T08:31:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.963+0000 7f1a38800640 1 Processor -- start 2024-09-10T08:31:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.964+0000 7f1a38800640 1 -- start start 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.964+0000 7f1a38800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a30073890 0x7f1a30142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.964+0000 7f1a38800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a300b5880 0x7f1a30072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a38800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a38800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a300b63a0 con 0x7f1a30145ed0 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a38800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a300b6220 con 0x7f1a30073890 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a38800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a301462b0 con 0x7f1a300b5880 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59774/0 (socket says 172.21.15.52:59774) 2024-09-10T08:31:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 -- 172.21.15.52:0/3429985182 learned_addr learned my addr 172.21.15.52:0/3429985182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a35e00640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a30073890 0x7f1a30142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a35400640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a300b5880 0x7f1a30072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 -- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a300b5880 msgr2=0x7f1a30072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a300b5880 0x7f1a30072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 -- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a30073890 msgr2=0x7f1a30142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a30073890 0x7f1a30142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.965+0000 7f1a36800640 1 -- 172.21.15.52:0/3429985182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30141aa0 con 0x7f1a30145ed0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a36800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009e80 tx=0x7f1a2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c040070 con 0x7f1a30145ed0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c031c40 con 0x7f1a30145ed0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a30141d80 con 0x7f1a30145ed0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c009450 con 0x7f1a30145ed0 2024-09-10T08:31:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.966+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a30142620 con 0x7f1a30145ed0 2024-09-10T08:31:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.967+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30141f50 con 0x7f1a30145ed0 2024-09-10T08:31:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.968+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a2c039040 con 0x7f1a30145ed0 2024-09-10T08:31:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.969+0000 7f1a2a000640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.970+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f1a2c0abcd0 con 0x7f1a30145ed0 2024-09-10T08:31:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.970+0000 7f1a35e00640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:28.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.971+0000 7f1a35e00640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 0x7f1a1406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000f60 tx=0x7f1a24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:28.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:28.974+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a2c07a320 con 0x7f1a30145ed0 2024-09-10T08:31:29.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.158+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a300b5080 con 0x7f1a30145ed0 2024-09-10T08:31:29.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.159+0000 7f1a2a000640 1 -- 172.21.15.52:0/3429985182 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+13044 (secure 0 0 0) 0x7f1a2c07e620 con 0x7f1a30145ed0 2024-09-10T08:31:29.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:27.775334+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6834/2946930251":"2024-09-11T08:31:24.763851+0000","172.21.15.52:6832/2946930251":"2024-09-11T08:31:24.763851+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 msgr2=0x7f1a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 0x7f1a1406e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000f60 tx=0x7f1a24009040 comp rx=0 tx=0).stop 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 msgr2=0x7f1a30140f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009e80 tx=0x7f1a2c004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 shutdown_connections 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a1406be30 0x7f1a1406e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a30145ed0 0x7f1a30140f50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a300b5880 0x7f1a30072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 --2- 172.21.15.52:0/3429985182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a30073890 0x7f1a30142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.161+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 >> 172.21.15.52:0/3429985182 conn(0x7f1a300ccec0 msgr2=0x7f1a300cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.162+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 shutdown_connections 2024-09-10T08:31:29.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.162+0000 7f1a38800640 1 -- 172.21.15.52:0/3429985182 wait complete. 2024-09-10T08:31:29.177 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:31:29.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:31:29.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.336+0000 7fa5f6800640 1 Processor -- start 2024-09-10T08:31:29.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.337+0000 7fa5f6800640 1 -- start start 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5f6800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa5f015c570 0x7fa5f00cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5f6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5f00d1e60 0x7fa5f015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5f6800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00cef10 con 0x7fa5f00d1a80 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5f6800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f00d01d0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5f6800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f015fc10 con 0x7fa5f015c570 2024-09-10T08:31:29.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5f00d1e60 0x7fa5f015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5f00d1e60 0x7fa5f015eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59782/0 (socket says 172.21.15.52:59782) 2024-09-10T08:31:29.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 -- 172.21.15.52:0/2457572095 learned_addr learned my addr 172.21.15.52:0/2457572095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:29.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5e7e00640 1 --2- 172.21.15.52:0/2457572095 >> v2:172.21.15.176:3300/0 conn(0x7fa5f015c570 0x7fa5f00cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 -- 172.21.15.52:0/2457572095 >> v2:172.21.15.176:3300/0 conn(0x7fa5f015c570 msgr2=0x7fa5f00cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 --2- 172.21.15.52:0/2457572095 >> v2:172.21.15.176:3300/0 conn(0x7fa5f015c570 0x7fa5f00cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 -- 172.21.15.52:0/2457572095 >> v1:172.21.15.176:6789/0 conn(0x7fa5f00d1a80 legacy=0x7fa5f015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.338+0000 7fa5efe00640 1 -- 172.21.15.52:0/2457572095 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00cf1d0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.339+0000 7fa5efe00640 1 --2- 172.21.15.52:0/2457572095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f015eee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009e50 tx=0x7fa5e802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5819a00b144f4525 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5eea00640 1 -- 172.21.15.52:0/2457572095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8036070 con 0x7fa5f00d1e60 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5eea00640 1 -- 172.21.15.52:0/2457572095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8031600 con 0x7fa5f00d1e60 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5eea00640 1 -- 172.21.15.52:0/2457572095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80319d0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 -- 172.21.15.52:0/2457572095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 msgr2=0x7fa5f015eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 --2- 172.21.15.52:0/2457572095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f015eee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009e50 tx=0x7fa5e802a6d0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 -- 172.21.15.52:0/2457572095 shutdown_connections 2024-09-10T08:31:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 --2- 172.21.15.52:0/2457572095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f015eee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 --2- 172.21.15.52:0/2457572095 >> v2:172.21.15.176:3300/0 conn(0x7fa5f015c570 0x7fa5f00cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 -- 172.21.15.52:0/2457572095 >> 172.21.15.52:0/2457572095 conn(0x7fa5f0067d70 msgr2=0x7fa5f0068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 -- 172.21.15.52:0/2457572095 shutdown_connections 2024-09-10T08:31:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.340+0000 7fa5f6800640 1 -- 172.21.15.52:0/2457572095 wait complete. 2024-09-10T08:31:29.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.342+0000 7fa5f6800640 1 Processor -- start 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.342+0000 7fa5f6800640 1 -- start start 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 0x7fa5f0150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f015c570 0x7fa5f00b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f015f420 con 0x7fa5f00d1e60 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00cf790 con 0x7fa5f015c570 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5f6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f015f5a0 con 0x7fa5f00d1a80 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59792/0 (socket says 172.21.15.52:59792) 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 -- 172.21.15.52:0/748052879 learned_addr learned my addr 172.21.15.52:0/748052879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:29.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5ef400640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 0x7fa5f0150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5efe00640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f015c570 0x7fa5f00b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 -- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 msgr2=0x7fa5f0150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 0x7fa5f0150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 -- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f015c570 msgr2=0x7fa5f00b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f015c570 0x7fa5f00b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5e7e00640 1 -- 172.21.15.52:0/748052879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00cd5e0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.343+0000 7fa5ef400640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 0x7fa5f0150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:29.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5e7e00640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800e870 tx=0x7fa5d800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8017070 con 0x7fa5f00d1e60 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d800c940 con 0x7fa5f00d1e60 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800cd30 con 0x7fa5f00d1e60 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f00cd8a0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.344+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f00cde60 con 0x7fa5f00d1e60 2024-09-10T08:31:29.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.345+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f015f930 con 0x7fa5f00d1e60 2024-09-10T08:31:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.346+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5d801a070 con 0x7fa5f00d1e60 2024-09-10T08:31:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.347+0000 7fa5e7400640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 0x7fa5cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.347+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fa5d808aa10 con 0x7fa5f00d1e60 2024-09-10T08:31:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.347+0000 7fa5ef400640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 0x7fa5cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.348+0000 7fa5ef400640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 0x7fa5cc06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5f015b810 tx=0x7fa5e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.351+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5d80596b0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.535+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5f00cecd0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.536+0000 7fa5e7400640 1 -- 172.21.15.52:0/748052879 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7fa5d8058fb0 con 0x7fa5f00d1e60 2024-09-10T08:31:29.536 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:31:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 msgr2=0x7fa5cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 0x7fa5cc06e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5f015b810 tx=0x7fa5e0009040 comp rx=0 tx=0).stop 2024-09-10T08:31:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 msgr2=0x7fa5f00cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800e870 tx=0x7fa5d800ed30 comp rx=0 tx=0).stop 2024-09-10T08:31:29.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 shutdown_connections 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa5cc06be30 0x7fa5cc06e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5f015c570 0x7fa5f00b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f00d1e60 0x7fa5f00cd0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 --2- 172.21.15.52:0/748052879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5f00d1a80 0x7fa5f0150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 >> 172.21.15.52:0/748052879 conn(0x7fa5f0067d70 msgr2=0x7fa5f0068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 shutdown_connections 2024-09-10T08:31:29.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.538+0000 7fa5f6800640 1 -- 172.21.15.52:0/748052879 wait complete. 2024-09-10T08:31:29.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-10T08:31:29.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.710+0000 7f6758600640 1 Processor -- start 2024-09-10T08:31:29.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.710+0000 7f6758600640 1 -- start start 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6758600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f67500b5080 0x7f67500b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6758600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500b4020 con 0x7f6750145ed0 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6758600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500b42c0 con 0x7f6750073890 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6758600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f67500b45a0 con 0x7f67500b5080 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6755c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6750145ed0 0x7f6750073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50916/0 (socket says 172.21.15.52:50916) 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6755c00640 1 -- 172.21.15.52:0/2348690808 learned_addr learned my addr 172.21.15.52:0/2348690808 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:29.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f6756600640 1 --2- 172.21.15.52:0/2348690808 >> v2:172.21.15.176:3300/0 conn(0x7f67500b5080 0x7f67500b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349713528 0 0) 0x7f67500b4020 con 0x7f6750145ed0 2024-09-10T08:31:29.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.712+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738003520 con 0x7f6750145ed0 2024-09-10T08:31:29.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.713+0000 7f6756600640 1 -- 172.21.15.52:0/2348690808 >> v1:172.21.15.176:6789/0 conn(0x7f6750073890 legacy=0x7f67500b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.713+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600619474 0 0) 0x7f67500b42c0 con 0x7f6750073890 2024-09-10T08:31:29.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.713+0000 7f6756600640 1 -- 172.21.15.52:0/2348690808 >> v1:172.21.15.52:6789/0 conn(0x7f6750145ed0 legacy=0x7f6750073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.713+0000 7f6756600640 1 -- 172.21.15.52:0/2348690808 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500b4880 con 0x7f67500b5080 2024-09-10T08:31:29.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.714+0000 7f6756600640 1 --2- 172.21.15.52:0/2348690808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f67500b5f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6748009d90 tx=0x7f674802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a552fc02c0f4d6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.714+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748037070 con 0x7f67500b5080 2024-09-10T08:31:29.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.714+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6748007740 con 0x7f67500b5080 2024-09-10T08:31:29.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.714+0000 7f674fe00640 1 -- 172.21.15.52:0/2348690808 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748007af0 con 0x7f67500b5080 2024-09-10T08:31:29.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 -- 172.21.15.52:0/2348690808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 msgr2=0x7f67500b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 --2- 172.21.15.52:0/2348690808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f67500b5f90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6748009d90 tx=0x7f674802a780 comp rx=0 tx=0).stop 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 -- 172.21.15.52:0/2348690808 shutdown_connections 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 --2- 172.21.15.52:0/2348690808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f67500b5f90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 -- 172.21.15.52:0/2348690808 >> 172.21.15.52:0/2348690808 conn(0x7f67500ccec0 msgr2=0x7f67500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 -- 172.21.15.52:0/2348690808 shutdown_connections 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.715+0000 7f6758600640 1 -- 172.21.15.52:0/2348690808 wait complete. 2024-09-10T08:31:29.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.716+0000 7f6758600640 1 Processor -- start 2024-09-10T08:31:29.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.717+0000 7f6758600640 1 -- start start 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.717+0000 7f6758600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.717+0000 7f6758600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f6750072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6758600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 0x7f675013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6758600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6750146430 con 0x7f6750073890 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6758600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67501462b0 con 0x7f67500b5080 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6758600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f675015cdc0 con 0x7f6750145ed0 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59798/0 (socket says 172.21.15.52:59798) 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 -- 172.21.15.52:0/4264565766 learned_addr learned my addr 172.21.15.52:0/4264565766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755200640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f6750072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6756600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 0x7f675013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 -- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 msgr2=0x7f675013c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 0x7f675013c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 -- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 msgr2=0x7f6750072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f6750072ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6755c00640 1 -- 172.21.15.52:0/4264565766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500714a0 con 0x7f6750073890 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.718+0000 7f6756600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 0x7f675013c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f6755c00640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f67440010e0 tx=0x7f674400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744017070 con 0x7f6750073890 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6744005d00 con 0x7f6750073890 2024-09-10T08:31:29.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6750071780 con 0x7f6750073890 2024-09-10T08:31:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744007310 con 0x7f6750073890 2024-09-10T08:31:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.719+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6750071d40 con 0x7f6750073890 2024-09-10T08:31:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.720+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6750073180 con 0x7f6750073890 2024-09-10T08:31:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.721+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f674401a070 con 0x7f6750073890 2024-09-10T08:31:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.722+0000 7f674d600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.722+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6744089fb0 con 0x7f6750073890 2024-09-10T08:31:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.722+0000 7f6755200640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:29.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.723+0000 7f6755200640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 0x7f673006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67501f75e0 tx=0x7f673c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.726+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6744058bd0 con 0x7f6750073890 2024-09-10T08:31:29.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:29.984+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f67500cfbe0 con 0x7f6750073890 2024-09-10T08:31:30.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.789+0000 7f674d600640 1 -- 172.21.15.52:0/4264565766 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v138) ==== 146+0+0 (secure 0 0 0) 0x7f67440584d0 con 0x7f6750073890 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 msgr2=0x7f673006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 0x7f673006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67501f75e0 tx=0x7f673c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 msgr2=0x7f67500ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f67440010e0 tx=0x7f674400c890 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 shutdown_connections 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f673006be30 0x7f673006e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6750145ed0 0x7f675013c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67500b5080 0x7f6750072ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 --2- 172.21.15.52:0/4264565766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6750073890 0x7f67500ca880 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 >> 172.21.15.52:0/4264565766 conn(0x7f67500ccec0 msgr2=0x7f67500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:30.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 shutdown_connections 2024-09-10T08:31:30.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.792+0000 7f6758600640 1 -- 172.21.15.52:0/4264565766 wait complete. 2024-09-10T08:31:30.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:31:30.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.976+0000 7fdebac00640 1 Processor -- start 2024-09-10T08:31:30.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.976+0000 7fdebac00640 1 -- start start 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdebac00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdeb40ccf30 0x7fdeb40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdebac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fdeb4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdebac00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb40cf2e0 con 0x7fdeb415b7c0 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdebac00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb4070fe0 con 0x7fdeb40ccf30 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdebac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40712c0 con 0x7fdeb40cead0 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdeb415b7c0 0x7fdeb40cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50928/0 (socket says 172.21.15.52:50928) 2024-09-10T08:31:30.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb3400640 1 -- 172.21.15.52:0/3987753963 learned_addr learned my addr 172.21.15.52:0/3987753963 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015458863 0 0) 0x7fdeb40cf2e0 con 0x7fdeb415b7c0 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde98005730 con 0x7fdeb415b7c0 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fdeb4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.978+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/3987753963 >> v2:172.21.15.176:3300/0 conn(0x7fdeb40ccf30 0x7fdeb40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 289061067 0 0) 0x7fde98005730 con 0x7fdeb415b7c0 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 msgr2=0x7fdeb4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fdeb4071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 >> v2:172.21.15.176:3300/0 conn(0x7fdeb40ccf30 msgr2=0x7fdeb40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 --2- 172.21.15.52:0/3987753963 >> v2:172.21.15.176:3300/0 conn(0x7fdeb40ccf30 0x7fdeb40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40715a0 con 0x7fdeb415b7c0 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fdea0001670 con 0x7fdeb415b7c0 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/3987753963 >> v2:172.21.15.176:3300/0 conn(0x7fdeb40ccf30 0x7fdeb40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fdeb4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 >> v1:172.21.15.52:6789/0 conn(0x7fdeb415b7c0 legacy=0x7fdeb40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fde98005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde980061b0 0x7fde98006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fde980073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4070fe0 con 0x7fde98006f50 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40712c0 con 0x7fde980061b0 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde9800dd30 con 0x7fdeb40cead0 2024-09-10T08:31:30.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fde980073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fde98005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.979+0000 7fdeb3400640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde980061b0 0x7fde98006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.980+0000 7fdeb8c00640 1 -- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 msgr2=0x7fde98005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.980+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cead0 0x7fde98005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.980+0000 7fdeb8c00640 1 -- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde980061b0 msgr2=0x7fde98006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.980+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde980061b0 0x7fde98006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.980+0000 7fdeb8c00640 1 -- 172.21.15.52:0/3987753963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde98005730 con 0x7fde98006f50 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fde980073d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0073e0 tx=0x7fde98007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ed6965758fbce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac009c80 con 0x7fde98006f50 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac02e660 con 0x7fde98006f50 2024-09-10T08:31:30.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdeb2a00640 1 -- 172.21.15.52:0/3987753963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac02ea10 con 0x7fde98006f50 2024-09-10T08:31:30.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdebac00640 1 -- 172.21.15.52:0/3987753963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 msgr2=0x7fde980073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdebac00640 1 --2- 172.21.15.52:0/3987753963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fde980073d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0073e0 tx=0x7fde98007a40 comp rx=0 tx=0).stop 2024-09-10T08:31:30.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.981+0000 7fdeb8c00640 1 -- 172.21.15.52:0/3987753963 reap_dead start 2024-09-10T08:31:30.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.982+0000 7fdebac00640 1 -- 172.21.15.52:0/3987753963 shutdown_connections 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.982+0000 7fdebac00640 1 -- 172.21.15.52:0/3987753963 >> 172.21.15.52:0/3987753963 conn(0x7fdeb406d0f0 msgr2=0x7fdeb406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.982+0000 7fdebac00640 1 -- 172.21.15.52:0/3987753963 shutdown_connections 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.982+0000 7fdebac00640 1 -- 172.21.15.52:0/3987753963 wait complete. 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.983+0000 7fdebac00640 1 Processor -- start 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.983+0000 7fdebac00640 1 -- start start 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 0x7fdeb40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cb830 0x7fdeb415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cf0c0 con 0x7fde98006f50 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cef40 con 0x7fdeb414d5d0 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.984+0000 7fdebac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb406bc10 con 0x7fdeb40cb830 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59816/0 (socket says 172.21.15.52:59816) 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 -- 172.21.15.52:0/2048125648 learned_addr learned my addr 172.21.15.52:0/2048125648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 -- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cb830 msgr2=0x7fdeb415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb8c00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cb830 0x7fdeb415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3400640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 0x7fdeb40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cb830 0x7fdeb415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 -- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 msgr2=0x7fdeb40cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 0x7fdeb40cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 -- 172.21.15.52:0/2048125648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40cbcd0 con 0x7fde98006f50 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3400640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 0x7fdeb40cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdea40116f0 tx=0x7fdea4011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.985+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4019070 con 0x7fde98006f50 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.986+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea4004220 con 0x7fde98006f50 2024-09-10T08:31:30.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.986+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb414c810 con 0x7fde98006f50 2024-09-10T08:31:30.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.986+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea400f040 con 0x7fde98006f50 2024-09-10T08:31:30.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.986+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb414cdd0 con 0x7fde98006f50 2024-09-10T08:31:30.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.987+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb40b2c50 con 0x7fde98006f50 2024-09-10T08:31:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.988+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdea400f760 con 0x7fde98006f50 2024-09-10T08:31:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.989+0000 7fdeabe00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 0x7fde9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.989+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fdea408adf0 con 0x7fde98006f50 2024-09-10T08:31:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.989+0000 7fdeb3400640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 0x7fde9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.990+0000 7fdeb3400640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 0x7fde9406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40b2750 tx=0x7fdea0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:30.994+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdea4059b30 con 0x7fde98006f50 2024-09-10T08:31:31.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.176+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdeb40cc960 con 0x7fde98006f50 2024-09-10T08:31:31.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.180+0000 7fdeabe00640 1 -- 172.21.15.52:0/2048125648 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fdea4059430 con 0x7fde98006f50 2024-09-10T08:31:31.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 msgr2=0x7fde9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 0x7fde9406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40b2750 tx=0x7fdea0009040 comp rx=0 tx=0).stop 2024-09-10T08:31:31.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 msgr2=0x7fdeb414be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdea40116f0 tx=0x7fdea4011bb0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 shutdown_connections 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9406be30 0x7fde9406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdeb40cb830 0x7fdeb415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdeb414d5d0 0x7fdeb40cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 --2- 172.21.15.52:0/2048125648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde98006f50 0x7fdeb414be50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.182+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 >> 172.21.15.52:0/2048125648 conn(0x7fdeb406d0f0 msgr2=0x7fdeb40cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.183+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 shutdown_connections 2024-09-10T08:31:31.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.183+0000 7fdebac00640 1 -- 172.21.15.52:0/2048125648 wait complete. 2024-09-10T08:31:31.199 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:31:31.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:31:31.274 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:31:31.369 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:31:31.370 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:31.370 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:31.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:31:31.405 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:31:31.405 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:31.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:31:31.444 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:31.444 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:31.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:31:31.480 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:31:31.480 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:31.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:31:31.521 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:31:31.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:31.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.677+0000 7f3f1b600640 1 Processor -- start 2024-09-10T08:31:31.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.677+0000 7f3f1b600640 1 -- start start 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.678+0000 7f3f1b600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3f1415eb60 0x7f3f1415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.678+0000 7f3f1b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 0x7f3f140b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f1b600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1415f590 con 0x7f3f141624b0 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f1b600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3f140b7070 con 0x7f3f1415eb60 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f1b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1415f870 con 0x7f3f140b66a0 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f13e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3f141624b0 0x7f3f140d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50936/0 (socket says 172.21.15.52:50936) 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f18c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3f1415eb60 0x7f3f1415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f13e00640 1 -- 172.21.15.52:0/3501696496 learned_addr learned my addr 172.21.15.52:0/3501696496 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:31.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f19600640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 0x7f3f140b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f18c00640 1 -- 172.21.15.52:0/3501696496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 msgr2=0x7f3f140b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f18c00640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 0x7f3f140b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f18c00640 1 -- 172.21.15.52:0/3501696496 >> v1:172.21.15.52:6789/0 conn(0x7f3f141624b0 legacy=0x7f3f140d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f18c00640 1 -- 172.21.15.52:0/3501696496 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1415fb50 con 0x7f3f1415eb60 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f19600640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 0x7f3f140b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:31.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.679+0000 7f3f13400640 1 -- 172.21.15.52:0/3501696496 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963853532 0 0) 0x7f3f1415f590 con 0x7f3f141624b0 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.680+0000 7f3f18c00640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f1415ef40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f080097a0 tx=0x7f3f0802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ac0b683793359f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f13400640 1 -- 172.21.15.52:0/3501696496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08037070 con 0x7f3f1415eb60 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f13400640 1 -- 172.21.15.52:0/3501696496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0802adb0 con 0x7f3f1415eb60 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f13400640 1 -- 172.21.15.52:0/3501696496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08032660 con 0x7f3f1415eb60 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 -- 172.21.15.52:0/3501696496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 msgr2=0x7f3f1415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f1415ef40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3f080097a0 tx=0x7f3f0802a060 comp rx=0 tx=0).stop 2024-09-10T08:31:31.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 -- 172.21.15.52:0/3501696496 shutdown_connections 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f140b66a0 0x7f3f140b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 --2- 172.21.15.52:0/3501696496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f1415ef40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 -- 172.21.15.52:0/3501696496 >> 172.21.15.52:0/3501696496 conn(0x7f3f140d16f0 msgr2=0x7f3f140d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 -- 172.21.15.52:0/3501696496 shutdown_connections 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.681+0000 7f3f1b600640 1 -- 172.21.15.52:0/3501696496 wait complete. 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.683+0000 7f3f1b600640 1 Processor -- start 2024-09-10T08:31:31.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.683+0000 7f3f1b600640 1 -- start start 2024-09-10T08:31:31.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f140b66a0 0x7f3f140c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f141624b0 0x7f3f1414a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f140d4480 con 0x7f3f1415eb60 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f140cef40 con 0x7f3f140b66a0 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f1b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f140d4600 con 0x7f3f141624b0 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59838/0 (socket says 172.21.15.52:59838) 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f13e00640 1 -- 172.21.15.52:0/641505164 learned_addr learned my addr 172.21.15.52:0/641505164 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.684+0000 7f3f19600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f141624b0 0x7f3f1414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f18c00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f140b66a0 0x7f3f140c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 -- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f141624b0 msgr2=0x7f3f1414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f141624b0 0x7f3f1414a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 -- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f140b66a0 msgr2=0x7f3f140c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f140b66a0 0x7f3f140c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 -- 172.21.15.52:0/641505164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f140c8cb0 con 0x7f3f1415eb60 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f13e00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000c4d0 tx=0x7f3f0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00018070 con 0x7f3f1415eb60 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00007500 con 0x7f3f1415eb60 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00004a20 con 0x7f3f1415eb60 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f140c8f90 con 0x7f3f1415eb60 2024-09-10T08:31:31.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.685+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f140c9550 con 0x7f3f1415eb60 2024-09-10T08:31:31.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.686+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1415f590 con 0x7f3f1415eb60 2024-09-10T08:31:31.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.687+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f00004bc0 con 0x7f3f1415eb60 2024-09-10T08:31:31.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.688+0000 7f3f10c00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:31.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.688+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f3f00089e70 con 0x7f3f1415eb60 2024-09-10T08:31:31.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.689+0000 7f3f18c00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:31.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.689+0000 7f3f18c00640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 0x7f3ef406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f08034000 tx=0x7f3f0802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:31.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.693+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f00058b10 con 0x7f3f1415eb60 2024-09-10T08:31:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.917+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f140d2520 con 0x7f3f1415eb60 2024-09-10T08:31:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.917+0000 7f3f10c00640 1 -- 172.21.15.52:0/641505164 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3911 (secure 0 0 0) 0x7f3f00058410 con 0x7f3f1415eb60 2024-09-10T08:31:31.917 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:31.918 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"btime":"2024-09-10T08:31:25:766654+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4580,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2170397822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2170397822},{"type":"v1","addr":"172.21.15.176:6836","nonce":2170397822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4583,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2888201537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2888201537},{"type":"v1","addr":"172.21.15.176:6837","nonce":2888201537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/30427297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":30427297},{"type":"v1","addr":"172.21.15.52:6835","nonce":30427297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5163,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2611977996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2611977996},{"type":"v1","addr":"172.21.15.52:6834","nonce":2611977996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-10T08:31:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 20 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 msgr2=0x7f3ef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 0x7f3ef406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f08034000 tx=0x7f3f0802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 msgr2=0x7f3f140b8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000c4d0 tx=0x7f3f0000c990 comp rx=0 tx=0).stop 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 shutdown_connections 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ef406be30 0x7f3ef406e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f141624b0 0x7f3f1414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1415eb60 0x7f3f140b8e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 --2- 172.21.15.52:0/641505164 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f140b66a0 0x7f3f140c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.919+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 >> 172.21.15.52:0/641505164 conn(0x7f3f140d16f0 msgr2=0x7f3f140cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.920+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 shutdown_connections 2024-09-10T08:31:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:31.920+0000 7f3f1b600640 1 -- 172.21.15.52:0/641505164 wait complete. 2024-09-10T08:31:31.935 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:31:31.936 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:31:31.936 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:31:31.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:31:31.936 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:31:31.936 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:31:31.936 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:31:31.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:31:31.937 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:31:31.937 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:31:31.937 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:31:31.937 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:31:31.937 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:31:31.937 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:31:31.937 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:31:31.938 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:31:31.950 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:31:31.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:31:31.951 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:31:31.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:31:31.954 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:31:31.955 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:31:31.955 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:31:31.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:31:31.994 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:31:31.994 DEBUG:teuthology.parallel:result is None 2024-09-10T08:31:31.996 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:31:31.996 DEBUG:teuthology.parallel:result is None 2024-09-10T08:31:31.999 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:31:31.999 DEBUG:teuthology.parallel:result is None 2024-09-10T08:31:32.001 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:31:32.001 DEBUG:teuthology.parallel:result is None 2024-09-10T08:31:32.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:31:32.127 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:31:32.128 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:31:32.135 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:31:32.135 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:31:32.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.171+0000 7f7c5ba00640 1 Processor -- start 2024-09-10T08:31:32.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.171+0000 7f7c5ba00640 1 -- start start 2024-09-10T08:31:32.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.172+0000 7f7c5ba00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c54147e80 0x7f7c54070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c5ba00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c54148260 0x7f7c540714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c5ba00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c54071b30 con 0x7f7c5406bc10 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c5ba00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7c54074200 con 0x7f7c54147e80 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c5ba00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7c540b3e40 con 0x7f7c54148260 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c54147e80 0x7f7c54070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c54147e80 0x7f7c54070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59884/0 (socket says 172.21.15.52:59884) 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 -- 172.21.15.52:0/567398929 learned_addr learned my addr 172.21.15.52:0/567398929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:32.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c4be00640 1 --2- 172.21.15.52:0/567398929 >> v2:172.21.15.176:3300/0 conn(0x7f7c54148260 0x7f7c540714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 -- 172.21.15.52:0/567398929 >> v2:172.21.15.176:3300/0 conn(0x7f7c54148260 msgr2=0x7f7c540714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:32.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 --2- 172.21.15.52:0/567398929 >> v2:172.21.15.176:3300/0 conn(0x7f7c54148260 0x7f7c540714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:32.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 -- 172.21.15.52:0/567398929 >> v1:172.21.15.52:6789/0 conn(0x7f7c5406bc10 legacy=0x7f7c541623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:32.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.173+0000 7f7c59000640 1 -- 172.21.15.52:0/567398929 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c540b3510 con 0x7f7c54147e80 2024-09-10T08:31:32.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.174+0000 7f7c59000640 1 --2- 172.21.15.52:0/567398929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c54070f70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7c540cce90 tx=0x7f7c4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c5579e92e3c206 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:32.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.174+0000 7f7c53e00640 1 -- 172.21.15.52:0/567398929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44037070 con 0x7f7c54147e80 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c53e00640 1 -- 172.21.15.52:0/567398929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c44032440 con 0x7f7c54147e80 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c53e00640 1 -- 172.21.15.52:0/567398929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44032810 con 0x7f7c54147e80 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 -- 172.21.15.52:0/567398929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 msgr2=0x7f7c54070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/567398929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c54070f70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7c540cce90 tx=0x7f7c4402a270 comp rx=0 tx=0).stop 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 -- 172.21.15.52:0/567398929 shutdown_connections 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/567398929 >> v2:172.21.15.176:3300/0 conn(0x7f7c54148260 0x7f7c540714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/567398929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c54070f70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:32.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 -- 172.21.15.52:0/567398929 >> 172.21.15.52:0/567398929 conn(0x7f7c540ccec0 msgr2=0x7f7c540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 -- 172.21.15.52:0/567398929 shutdown_connections 2024-09-10T08:31:32.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.175+0000 7f7c5ba00640 1 -- 172.21.15.52:0/567398929 wait complete. 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.177+0000 7f7c5ba00640 1 Processor -- start 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.177+0000 7f7c5ba00640 1 -- start start 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 0x7f7c54142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 0x7f7c541e6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c540b52e0 con 0x7f7c54147e80 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c540b3ad0 con 0x7f7c5406bc10 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c5ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c540b5460 con 0x7f7c54148260 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c4be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59900/0 (socket says 172.21.15.52:59900) 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c4be00640 1 -- 172.21.15.52:0/533656642 learned_addr learned my addr 172.21.15.52:0/533656642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c59000640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 0x7f7c54142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.178+0000 7f7c59a00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 0x7f7c541e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 -- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 msgr2=0x7f7c541e6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 0x7f7c541e6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 -- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 msgr2=0x7f7c54142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 0x7f7c54142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 -- 172.21.15.52:0/533656642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c541e8c10 con 0x7f7c54147e80 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c59000640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 0x7f7c54142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c59a00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 0x7f7c541e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c4be00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e9b0 tx=0x7f7c3c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:32.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c017070 con 0x7f7c54147e80 2024-09-10T08:31:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c00c9a0 con 0x7f7c54147e80 2024-09-10T08:31:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c541e8f50 con 0x7f7c54147e80 2024-09-10T08:31:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00cd90 con 0x7f7c54147e80 2024-09-10T08:31:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.179+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541e9790 con 0x7f7c54147e80 2024-09-10T08:31:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.180+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5406c080 con 0x7f7c54147e80 2024-09-10T08:31:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.184+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c3c01a070 con 0x7f7c54147e80 2024-09-10T08:31:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.185+0000 7f7c51600640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 0x7f7c3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:32.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.185+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f7c3c08b460 con 0x7f7c54147e80 2024-09-10T08:31:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.185+0000 7f7c59000640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 0x7f7c3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.186+0000 7f7c59000640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 0x7f7c3006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.188+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c541e8f50 con 0x7f7c54147e80 2024-09-10T08:31:32.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:32.390+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7c54145080 con 0x7f7c54147e80 2024-09-10T08:31:33.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.198+0000 7f7c51600640 1 -- 172.21.15.52:0/533656642 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7f7c3c05a0f0 con 0x7f7c54147e80 2024-09-10T08:31:33.199 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 msgr2=0x7f7c3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 0x7f7c3006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7c44034000 tx=0x7f7c4402e000 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 msgr2=0x7f7c5413fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e9b0 tx=0x7f7c3c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 shutdown_connections 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c3006be30 0x7f7c3006e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c54148260 0x7f7c541e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c54147e80 0x7f7c5413fac0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 --2- 172.21.15.52:0/533656642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c5406bc10 0x7f7c54142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.202+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 >> 172.21.15.52:0/533656642 conn(0x7f7c540ccec0 msgr2=0x7f7c540d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.203+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 shutdown_connections 2024-09-10T08:31:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.203+0000 7f7c5ba00640 1 -- 172.21.15.52:0/533656642 wait complete. 2024-09-10T08:31:33.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:31:33.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.382+0000 7fee6a400640 1 Processor -- start 2024-09-10T08:31:33.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.382+0000 7fee6a400640 1 -- start start 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.383+0000 7fee6a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee6a400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee6406c150 0x7fee6415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee6a400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee64071180 con 0x7fee6413eb20 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee6a400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fee64071ab0 con 0x7fee6406c150 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee6a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee64071460 con 0x7fee640b2d40 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fee6406c150 0x7fee6415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57382/0 (socket says 172.21.15.52:57382) 2024-09-10T08:31:33.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 -- 172.21.15.52:0/2945804314 learned_addr learned my addr 172.21.15.52:0/2945804314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:33.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee5be00640 1 --1- 172.21.15.52:0/2945804314 >> v1:172.21.15.176:6789/0 conn(0x7fee6413eb20 0x7fee6415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60494/0 (socket says 172.21.15.52:60494) 2024-09-10T08:31:33.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 -- 172.21.15.52:0/2945804314 >> v2:172.21.15.176:3300/0 conn(0x7fee6406c150 msgr2=0x7fee6415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:33.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 --2- 172.21.15.52:0/2945804314 >> v2:172.21.15.176:3300/0 conn(0x7fee6406c150 0x7fee6415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 -- 172.21.15.52:0/2945804314 >> v1:172.21.15.176:6789/0 conn(0x7fee6413eb20 legacy=0x7fee6415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.384+0000 7fee63400640 1 -- 172.21.15.52:0/2945804314 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee64071740 con 0x7fee640b2d40 2024-09-10T08:31:33.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.385+0000 7fee63400640 1 --2- 172.21.15.52:0/2945804314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee64071c30 tx=0x7fee5402c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f4fc49e1ed912c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee62a00640 1 -- 172.21.15.52:0/2945804314 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54036020 con 0x7fee640b2d40 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee62a00640 1 -- 172.21.15.52:0/2945804314 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54032800 con 0x7fee640b2d40 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee62a00640 1 -- 172.21.15.52:0/2945804314 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54032bd0 con 0x7fee640b2d40 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 -- 172.21.15.52:0/2945804314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 msgr2=0x7fee6406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 --2- 172.21.15.52:0/2945804314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee64071c30 tx=0x7fee5402c900 comp rx=0 tx=0).stop 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 -- 172.21.15.52:0/2945804314 shutdown_connections 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 --2- 172.21.15.52:0/2945804314 >> v2:172.21.15.176:3300/0 conn(0x7fee6406c150 0x7fee6415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 --2- 172.21.15.52:0/2945804314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee640b2d40 0x7fee6406bc10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 -- 172.21.15.52:0/2945804314 >> 172.21.15.52:0/2945804314 conn(0x7fee640ccec0 msgr2=0x7fee640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:33.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 -- 172.21.15.52:0/2945804314 shutdown_connections 2024-09-10T08:31:33.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.386+0000 7fee6a400640 1 -- 172.21.15.52:0/2945804314 wait complete. 2024-09-10T08:31:33.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.388+0000 7fee6a400640 1 Processor -- start 2024-09-10T08:31:33.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.388+0000 7fee6a400640 1 -- start start 2024-09-10T08:31:33.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee6406c150 0x7fee6415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 0x7fee6413d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee640722d0 con 0x7fee640b2d40 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee64072150 con 0x7fee6413eb20 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee6a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee64072450 con 0x7fee6406c150 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59902/0 (socket says 172.21.15.52:59902) 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee5be00640 1 -- 172.21.15.52:0/531363924 learned_addr learned my addr 172.21.15.52:0/531363924 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.389+0000 7fee63400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee6406c150 0x7fee6415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee63e00640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 0x7fee6413d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 -- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee6406c150 msgr2=0x7fee6415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee6406c150 0x7fee6415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 -- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 msgr2=0x7fee6413d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 0x7fee6413d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 -- 172.21.15.52:0/531363924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee640ca3a0 con 0x7fee640b2d40 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee63e00640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 0x7fee6413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5be00640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c470 tx=0x7fee4c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0074e0 con 0x7fee640b2d40 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4c007680 con 0x7fee640b2d40 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee640ca680 con 0x7fee640b2d40 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c004a00 con 0x7fee640b2d40 2024-09-10T08:31:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.390+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee640cac40 con 0x7fee640b2d40 2024-09-10T08:31:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.391+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6406bc10 con 0x7fee640b2d40 2024-09-10T08:31:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.392+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee4c01a020 con 0x7fee640b2d40 2024-09-10T08:31:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.393+0000 7fee5b400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 0x7fee4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.393+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7fee4c08a1b0 con 0x7fee640b2d40 2024-09-10T08:31:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.394+0000 7fee63400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 0x7fee4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.394+0000 7fee63400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 0x7fee4006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee54037000 tx=0x7fee54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.398+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee4c058ea0 con 0x7fee640b2d40 2024-09-10T08:31:33.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.649+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fee6406c9c0 con 0x7fee640b2d40 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.650+0000 7fee5b400640 1 -- 172.21.15.52:0/531363924 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fee4c0587a0 con 0x7fee640b2d40 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:31:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:31:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:31:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:31:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:31:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:31:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:31:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:31:33.664 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:33.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 msgr2=0x7fee4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 0x7fee4006e2f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee54037000 tx=0x7fee54008040 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 msgr2=0x7fee640cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c470 tx=0x7fee4c00c930 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 shutdown_connections 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee4006be30 0x7fee4006e2f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee6413eb20 0x7fee6413d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee640b2d40 0x7fee640cc300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 --2- 172.21.15.52:0/531363924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee6406c150 0x7fee6415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 >> 172.21.15.52:0/531363924 conn(0x7fee640ccec0 msgr2=0x7fee640b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 shutdown_connections 2024-09-10T08:31:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.652+0000 7fee6a400640 1 -- 172.21.15.52:0/531363924 wait complete. 2024-09-10T08:31:33.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:31:33.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.823+0000 7f53ef800640 1 Processor -- start 2024-09-10T08:31:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.823+0000 7f53ef800640 1 -- start start 2024-09-10T08:31:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.824+0000 7f53ef800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f53e8073890 0x7f53e80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.824+0000 7f53ef800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53e80b5880 0x7f53e80b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ef800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e80b4020 con 0x7f53e8145ed0 2024-09-10T08:31:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ef800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f53e80b42c0 con 0x7f53e80b5880 2024-09-10T08:31:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ef800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f53e80b45a0 con 0x7f53e8073890 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53e80b5880 0x7f53e80b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53e80b5880 0x7f53e80b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59912/0 (socket says 172.21.15.52:59912) 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 -- 172.21.15.52:0/2091279943 learned_addr learned my addr 172.21.15.52:0/2091279943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53e7e00640 1 --2- 172.21.15.52:0/2091279943 >> v2:172.21.15.176:3300/0 conn(0x7f53e8073890 0x7f53e80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 -- 172.21.15.52:0/2091279943 >> v2:172.21.15.176:3300/0 conn(0x7f53e8073890 msgr2=0x7f53e80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 --2- 172.21.15.52:0/2091279943 >> v2:172.21.15.176:3300/0 conn(0x7f53e8073890 0x7f53e80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 -- 172.21.15.52:0/2091279943 >> v1:172.21.15.52:6789/0 conn(0x7f53e8145ed0 legacy=0x7f53e8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.825+0000 7f53ed800640 1 -- 172.21.15.52:0/2091279943 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e80b4880 con 0x7f53e80b5880 2024-09-10T08:31:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.826+0000 7f53ed800640 1 --2- 172.21.15.52:0/2091279943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e80b5880 0x7f53e80b5ce0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f53e80d1490 tx=0x7f53e002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceed2a9cad5fcb7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.826+0000 7f53e7400640 1 -- 172.21.15.52:0/2091279943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0036070 con 0x7f53e80b5880 2024-09-10T08:31:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.826+0000 7f53e7400640 1 -- 172.21.15.52:0/2091279943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e0031600 con 0x7f53e80b5880 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.826+0000 7f53e7400640 1 -- 172.21.15.52:0/2091279943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00319d0 con 0x7f53e80b5880 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 -- 172.21.15.52:0/2091279943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e80b5880 msgr2=0x7f53e80b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 --2- 172.21.15.52:0/2091279943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e80b5880 0x7f53e80b5ce0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f53e80d1490 tx=0x7f53e002a740 comp rx=0 tx=0).stop 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 -- 172.21.15.52:0/2091279943 shutdown_connections 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 --2- 172.21.15.52:0/2091279943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e80b5880 0x7f53e80b5ce0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 --2- 172.21.15.52:0/2091279943 >> v2:172.21.15.176:3300/0 conn(0x7f53e8073890 0x7f53e80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 -- 172.21.15.52:0/2091279943 >> 172.21.15.52:0/2091279943 conn(0x7f53e80ccec0 msgr2=0x7f53e80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 -- 172.21.15.52:0/2091279943 shutdown_connections 2024-09-10T08:31:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.827+0000 7f53ef800640 1 -- 172.21.15.52:0/2091279943 wait complete. 2024-09-10T08:31:33.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.829+0000 7f53ef800640 1 Processor -- start 2024-09-10T08:31:33.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.829+0000 7f53ef800640 1 -- start start 2024-09-10T08:31:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53e8073890 0x7f53e813d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53e80b5880 0x7f53e813d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80b63a0 con 0x7f53e8145ed0 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80b6220 con 0x7f53e8073890 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ef800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53e81462b0 con 0x7f53e80b5880 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ed800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ed800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59914/0 (socket says 172.21.15.52:59914) 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ed800640 1 -- 172.21.15.52:0/4002286225 learned_addr learned my addr 172.21.15.52:0/4002286225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53ece00640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53e8073890 0x7f53e813d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.830+0000 7f53e7e00640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53e80b5880 0x7f53e813d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 -- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53e80b5880 msgr2=0x7f53e813d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53e80b5880 0x7f53e813d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 -- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53e8073890 msgr2=0x7f53e813d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:33.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53e8073890 0x7f53e813d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:33.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 -- 172.21.15.52:0/4002286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e81f48e0 con 0x7f53e8145ed0 2024-09-10T08:31:33.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ed800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009f40 tx=0x7f53e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0036050 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e0042070 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0009510 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e81f4bc0 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.831+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e81f5180 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.832+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e81f5380 con 0x7f53e8145ed0 2024-09-10T08:31:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.833+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53e0007bd0 con 0x7f53e8145ed0 2024-09-10T08:31:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.834+0000 7f53e4c00640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 0x7f53c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.834+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f53e00ab900 con 0x7f53e8145ed0 2024-09-10T08:31:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.835+0000 7f53ece00640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 0x7f53c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.836+0000 7f53ece00640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 0x7f53c806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f53dc000f60 tx=0x7f53dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:33.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:33.839+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53e81f5380 con 0x7f53e8145ed0 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.023+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f53e80b5080 con 0x7f53e8145ed0 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.024+0000 7f53e4c00640 1 -- 172.21.15.52:0/4002286225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) ==== 84+0+65 (secure 0 0 0) 0x7f53e007a5f0 con 0x7f53e8145ed0 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:31:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:34.025 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:31:34.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 msgr2=0x7f53c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 0x7f53c806e2f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f53dc000f60 tx=0x7f53dc009040 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 msgr2=0x7f53e8140830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009f40 tx=0x7f53e0004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 shutdown_connections 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f53c806be30 0x7f53c806e2f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53e8145ed0 0x7f53e8140830 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53e80b5880 0x7f53e813d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 --2- 172.21.15.52:0/4002286225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53e8073890 0x7f53e813d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 >> 172.21.15.52:0/4002286225 conn(0x7f53e80ccec0 msgr2=0x7f53e8145070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 shutdown_connections 2024-09-10T08:31:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.026+0000 7f53ef800640 1 -- 172.21.15.52:0/4002286225 wait complete. 2024-09-10T08:31:34.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:31:34.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:31:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.201+0000 7fcef2200640 1 Processor -- start 2024-09-10T08:31:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.201+0000 7fcef2200640 1 -- start start 2024-09-10T08:31:34.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.202+0000 7fcef2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fceec155b20 0x7fceec0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.202+0000 7fcef2200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fceec0cfb30 0x7fceec15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.202+0000 7fcef2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceec0b0680 con 0x7fceec0b21a0 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.202+0000 7fcef2200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fceec0b01e0 con 0x7fceec155b20 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.202+0000 7fcef2200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fceec0ccf70 con 0x7fceec0cfb30 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fceec155b20 0x7fceec0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fceec155b20 0x7fceec0b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40226/0 (socket says 172.21.15.52:40226) 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 -- 172.21.15.52:0/3385368176 learned_addr learned my addr 172.21.15.52:0/3385368176 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceebe00640 1 --2- 172.21.15.52:0/3385368176 >> v2:172.21.15.176:3300/0 conn(0x7fceec0cfb30 0x7fceec15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 -- 172.21.15.52:0/3385368176 >> v2:172.21.15.176:3300/0 conn(0x7fceec0cfb30 msgr2=0x7fceec15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 --2- 172.21.15.52:0/3385368176 >> v2:172.21.15.176:3300/0 conn(0x7fceec0cfb30 0x7fceec15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 -- 172.21.15.52:0/3385368176 >> v1:172.21.15.52:6789/0 conn(0x7fceec0b21a0 legacy=0x7fceec0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.203+0000 7fceeb400640 1 -- 172.21.15.52:0/3385368176 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec0ce940 con 0x7fceec155b20 2024-09-10T08:31:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.204+0000 7fceeb400640 1 --2- 172.21.15.52:0/3385368176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec0b1c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fceec159540 tx=0x7fcedc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d15139dd1233dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fceea000640 1 -- 172.21.15.52:0/3385368176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc037070 con 0x7fceec155b20 2024-09-10T08:31:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fceea000640 1 -- 172.21.15.52:0/3385368176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc032440 con 0x7fceec155b20 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fceea000640 1 -- 172.21.15.52:0/3385368176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc032810 con 0x7fceec155b20 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 -- 172.21.15.52:0/3385368176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 msgr2=0x7fceec0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 --2- 172.21.15.52:0/3385368176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec0b1c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fceec159540 tx=0x7fcedc02a270 comp rx=0 tx=0).stop 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 -- 172.21.15.52:0/3385368176 shutdown_connections 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 --2- 172.21.15.52:0/3385368176 >> v2:172.21.15.176:3300/0 conn(0x7fceec0cfb30 0x7fceec15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 --2- 172.21.15.52:0/3385368176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec0b1c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 -- 172.21.15.52:0/3385368176 >> 172.21.15.52:0/3385368176 conn(0x7fceec06c240 msgr2=0x7fceec06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 -- 172.21.15.52:0/3385368176 shutdown_connections 2024-09-10T08:31:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.205+0000 7fcef2200640 1 -- 172.21.15.52:0/3385368176 wait complete. 2024-09-10T08:31:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.207+0000 7fcef2200640 1 Processor -- start 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.207+0000 7fcef2200640 1 -- start start 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceec0b21a0 0x7fceec14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 0x7fceec152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0ce610 con 0x7fceec155b20 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0cef00 con 0x7fceec0cfb30 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fcef2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fceec0ccb20 con 0x7fceec0b21a0 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fceebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fceebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40242/0 (socket says 172.21.15.52:40242) 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fceebe00640 1 -- 172.21.15.52:0/661485280 learned_addr learned my addr 172.21.15.52:0/661485280 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fceeaa00640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 0x7fceec152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.208+0000 7fceeb400640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceec0b21a0 0x7fceec14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 -- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceec0b21a0 msgr2=0x7fceec14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceec0b21a0 0x7fceec14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 -- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 msgr2=0x7fceec152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 0x7fceec152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 -- 172.21.15.52:0/661485280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec153900 con 0x7fceec155b20 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceeaa00640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 0x7fceec152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fceebe00640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009d30 tx=0x7fcee400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4018020 con 0x7fceec155b20 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee4014480 con 0x7fceec155b20 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4014870 con 0x7fceec155b20 2024-09-10T08:31:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec153be0 con 0x7fceec155b20 2024-09-10T08:31:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.209+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec1541a0 con 0x7fceec155b20 2024-09-10T08:31:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.211+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec0cf420 con 0x7fceec155b20 2024-09-10T08:31:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.211+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcee4005d10 con 0x7fceec155b20 2024-09-10T08:31:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.212+0000 7fcee3400640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.212+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7fcee408b5b0 con 0x7fceec155b20 2024-09-10T08:31:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.213+0000 7fceeb400640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.214+0000 7fceeb400640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 0x7fcecc06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcedc034000 tx=0x7fcedc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.217+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcee4022070 con 0x7fceec155b20 2024-09-10T08:31:34.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:34.408+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fceec0b3c40 con 0x7fceec155b20 2024-09-10T08:31:35.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.203+0000 7fcee3400640 1 -- 172.21.15.52:0/661485280 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) ==== 138+0+0 (secure 0 0 0) 0x7fcee4010040 con 0x7fceec155b20 2024-09-10T08:31:35.203 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:31:35.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 msgr2=0x7fcecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 0x7fcecc06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcedc034000 tx=0x7fcedc02e000 comp rx=0 tx=0).stop 2024-09-10T08:31:35.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 msgr2=0x7fceec1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009d30 tx=0x7fcee400c490 comp rx=0 tx=0).stop 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 shutdown_connections 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcecc06be30 0x7fcecc06e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceec155b20 0x7fceec1532d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fceec0cfb30 0x7fceec152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 --2- 172.21.15.52:0/661485280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fceec0b21a0 0x7fceec14e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.206+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 >> 172.21.15.52:0/661485280 conn(0x7fceec06c240 msgr2=0x7fceec0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.207+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 shutdown_connections 2024-09-10T08:31:35.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.207+0000 7fcef2200640 1 -- 172.21.15.52:0/661485280 wait complete. 2024-09-10T08:31:35.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:31:35.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.397+0000 7fb614c00640 1 Processor -- start 2024-09-10T08:31:35.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.397+0000 7fb614c00640 1 -- start start 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.398+0000 7fb614c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 0x7fb6100d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.398+0000 7fb614c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6100d2660 0x7fb6100d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.398+0000 7fb614c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6100d3250 con 0x7fb6100d14a0 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.398+0000 7fb614c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb6100b7680 con 0x7fb6100d2660 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.398+0000 7fb614c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6100b78b0 con 0x7fb61015e620 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6100d2660 0x7fb6100d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb6100d2660 0x7fb6100d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40248/0 (socket says 172.21.15.52:40248) 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 -- 172.21.15.52:0/2706184409 learned_addr learned my addr 172.21.15.52:0/2706184409 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:35.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60f400640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 0x7fb6100d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 -- 172.21.15.52:0/2706184409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 msgr2=0x7fb6100d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:35.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 0x7fb6100d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 -- 172.21.15.52:0/2706184409 >> v1:172.21.15.52:6789/0 conn(0x7fb6100d14a0 legacy=0x7fb6100b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60ea00640 1 -- 172.21.15.52:0/2706184409 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61015ea00 con 0x7fb6100d2660 2024-09-10T08:31:35.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.399+0000 7fb60f400640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 0x7fb6100d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:35.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.400+0000 7fb60ea00640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6100d2660 0x7fb6100d0f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009870 tx=0x7fb5fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc75905ea3028a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:35.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.400+0000 7fb60e000640 1 -- 172.21.15.52:0/2706184409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc037070 con 0x7fb6100d2660 2024-09-10T08:31:35.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.400+0000 7fb60e000640 1 -- 172.21.15.52:0/2706184409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc032440 con 0x7fb6100d2660 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.400+0000 7fb60e000640 1 -- 172.21.15.52:0/2706184409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc032810 con 0x7fb6100d2660 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 -- 172.21.15.52:0/2706184409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6100d2660 msgr2=0x7fb6100d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6100d2660 0x7fb6100d0f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009870 tx=0x7fb5fc02a270 comp rx=0 tx=0).stop 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 -- 172.21.15.52:0/2706184409 shutdown_connections 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6100d2660 0x7fb6100d0f60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 --2- 172.21.15.52:0/2706184409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb61015e620 0x7fb6100d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 -- 172.21.15.52:0/2706184409 >> 172.21.15.52:0/2706184409 conn(0x7fb610067950 msgr2=0x7fb610067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 -- 172.21.15.52:0/2706184409 shutdown_connections 2024-09-10T08:31:35.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.401+0000 7fb614c00640 1 -- 172.21.15.52:0/2706184409 wait complete. 2024-09-10T08:31:35.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.403+0000 7fb614c00640 1 Processor -- start 2024-09-10T08:31:35.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.403+0000 7fb614c00640 1 -- start start 2024-09-10T08:31:35.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6100d14a0 0x7fb610153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6100d2660 0x7fb61015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb6100d40a0 con 0x7fb61015e620 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6100d2f70 con 0x7fb6100d2660 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb614c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6100b9080 con 0x7fb6100d14a0 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40254/0 (socket says 172.21.15.52:40254) 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 -- 172.21.15.52:0/2082977618 learned_addr learned my addr 172.21.15.52:0/2082977618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60f400640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6100d14a0 0x7fb610153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60ea00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6100d2660 0x7fb61015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 -- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6100d14a0 msgr2=0x7fb610153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6100d14a0 0x7fb610153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 -- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6100d2660 msgr2=0x7fb61015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.404+0000 7fb60fe00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6100d2660 0x7fb61015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb60fe00640 1 -- 172.21.15.52:0/2082977618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb610156b00 con 0x7fb61015e620 2024-09-10T08:31:35.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb60fe00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c7a0 tx=0x7fb60800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608003b70 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb608003d30 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60800aa90 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb610158320 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.405+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6101588e0 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.406+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb610158ae0 con 0x7fb61015e620 2024-09-10T08:31:35.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.407+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb60800ac30 con 0x7fb61015e620 2024-09-10T08:31:35.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.409+0000 7fb607400640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 0x7fb5f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:35.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.409+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5227+0+0 (secure 0 0 0) 0x7fb60808ac20 con 0x7fb61015e620 2024-09-10T08:31:35.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.409+0000 7fb60f400640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 0x7fb5f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:35.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.410+0000 7fb60f400640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 0x7fb5f006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb600006fd0 tx=0x7fb600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:35.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.414+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb610158ae0 con 0x7fb61015e620 2024-09-10T08:31:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:35.602+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6100d0f60 con 0x7fb61015e620 2024-09-10T08:31:35.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:35.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:31:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.208+0000 7fb607400640 1 -- 172.21.15.52:0/2082977618 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) ==== 170+0+0 (secure 0 0 0) 0x7fb6080597a0 con 0x7fb61015e620 2024-09-10T08:31:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:31:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 msgr2=0x7fb5f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 0x7fb5f006e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb600006fd0 tx=0x7fb600008040 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 msgr2=0x7fb61015af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c7a0 tx=0x7fb60800cc60 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 shutdown_connections 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5f006be30 0x7fb5f006e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb61015e620 0x7fb61015af70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6100d2660 0x7fb61015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 --2- 172.21.15.52:0/2082977618 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6100d14a0 0x7fb610153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 >> 172.21.15.52:0/2082977618 conn(0x7fb610067950 msgr2=0x7fb6100ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 shutdown_connections 2024-09-10T08:31:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.211+0000 7fb614c00640 1 -- 172.21.15.52:0/2082977618 wait complete. 2024-09-10T08:31:36.245 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:31:36.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.404+0000 7f31f7000640 1 Processor -- start 2024-09-10T08:31:36.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.404+0000 7f31f7000640 1 -- start start 2024-09-10T08:31:36.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.405+0000 7f31f7000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 0x7f31f0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.405+0000 7f31f7000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.405+0000 7f31f7000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f0072a10 con 0x7f31f015c310 2024-09-10T08:31:36.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.405+0000 7f31f7000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f31f00afa10 con 0x7f31f00d0880 2024-09-10T08:31:36.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.405+0000 7f31f7000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31f0071220 con 0x7f31f00725c0 2024-09-10T08:31:36.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:54626/0 (socket says 172.21.15.52:54626) 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 -- 172.21.15.52:0/2208085963 learned_addr learned my addr 172.21.15.52:0/2208085963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f5200640 1 --2- 172.21.15.52:0/2208085963 >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 0x7f31f0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 -- 172.21.15.52:0/2208085963 >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 msgr2=0x7f31f0071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 --2- 172.21.15.52:0/2208085963 >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 0x7f31f0071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 -- 172.21.15.52:0/2208085963 >> v1:172.21.15.176:6789/0 conn(0x7f31f015c310 legacy=0x7f31f00d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f6600640 1 -- 172.21.15.52:0/2208085963 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f0071500 con 0x7f31f00725c0 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31efe00640 1 -- 172.21.15.52:0/2208085963 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967937745 0 0) 0x7f31f0072a10 con 0x7f31f015c310 2024-09-10T08:31:36.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.406+0000 7f31f5200640 1 --2- 172.21.15.52:0/2208085963 >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 0x7f31f0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.407+0000 7f31f6600640 1 --2- 172.21.15.52:0/2208085963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009e50 tx=0x7f31e802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613f86d59e5de636 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.407+0000 7f31efe00640 1 -- 172.21.15.52:0/2208085963 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8036070 con 0x7f31f00725c0 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.407+0000 7f31efe00640 1 -- 172.21.15.52:0/2208085963 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e8031600 con 0x7f31f00725c0 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31efe00640 1 -- 172.21.15.52:0/2208085963 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e80319d0 con 0x7f31f00725c0 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 -- 172.21.15.52:0/2208085963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 msgr2=0x7f31f00cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 --2- 172.21.15.52:0/2208085963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009e50 tx=0x7f31e802a710 comp rx=0 tx=0).stop 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 -- 172.21.15.52:0/2208085963 shutdown_connections 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 --2- 172.21.15.52:0/2208085963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00725c0 0x7f31f00cdf80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 --2- 172.21.15.52:0/2208085963 >> v2:172.21.15.176:3300/0 conn(0x7f31f00d0880 0x7f31f0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 -- 172.21.15.52:0/2208085963 >> 172.21.15.52:0/2208085963 conn(0x7f31f006bc10 msgr2=0x7f31f006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:36.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 -- 172.21.15.52:0/2208085963 shutdown_connections 2024-09-10T08:31:36.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.408+0000 7f31f7000640 1 -- 172.21.15.52:0/2208085963 wait complete. 2024-09-10T08:31:36.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.410+0000 7f31f7000640 1 Processor -- start 2024-09-10T08:31:36.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.410+0000 7f31f7000640 1 -- start start 2024-09-10T08:31:36.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f00725c0 0x7f31f00b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00d0880 0x7f31f0149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31f0073e30 con 0x7f31f015c310 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31f00af6c0 con 0x7f31f00725c0 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f7000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31f0073fb0 con 0x7f31f00d0880 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40260/0 (socket says 172.21.15.52:40260) 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f6600640 1 -- 172.21.15.52:0/3029164908 learned_addr learned my addr 172.21.15.52:0/3029164908 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f5200640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00d0880 0x7f31f0149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.411+0000 7f31f5c00640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f00725c0 0x7f31f00b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 -- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00d0880 msgr2=0x7f31f0149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00d0880 0x7f31f0149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 -- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f00725c0 msgr2=0x7f31f00b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f00725c0 0x7f31f00b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 -- 172.21.15.52:0/3029164908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f014c2a0 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f6600640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f31e8034040 tx=0x7f31e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8041020 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e8037040 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f014c580 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8036050 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.412+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f00b1f20 con 0x7f31f015c310 2024-09-10T08:31:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.413+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f015c6f0 con 0x7f31f015c310 2024-09-10T08:31:36.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.415+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31e8007c50 con 0x7f31f015c310 2024-09-10T08:31:36.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.416+0000 7f31ed600640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 0x7f31d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:36.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.416+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5609+0+0 (secure 0 0 0) 0x7f31e80abcb0 con 0x7f31f015c310 2024-09-10T08:31:36.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.416+0000 7f31f5c00640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 0x7f31d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:36.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.417+0000 7f31f5c00640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 0x7f31d006e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000f60 tx=0x7f31e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:36.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.420+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31e804b060 con 0x7f31f015c310 2024-09-10T08:31:36.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:36.640+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f31f0072e10 con 0x7f31f015c310 2024-09-10T08:31:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.211+0000 7f31ed600640 1 -- 172.21.15.52:0/3029164908 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) ==== 172+0+0 (secure 0 0 0) 0x7f31e807a0e0 con 0x7f31f015c310 2024-09-10T08:31:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 6 and data pool 7 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.217+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 msgr2=0x7f31d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.217+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 0x7f31d006e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000f60 tx=0x7f31e4009040 comp rx=0 tx=0).stop 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.217+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 msgr2=0x7f31f014a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.217+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f31e8034040 tx=0x7f31e8004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 shutdown_connections 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d006be30 0x7f31d006e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f015c310 0x7f31f014a190 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f00d0880 0x7f31f0149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 --2- 172.21.15.52:0/3029164908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f00725c0 0x7f31f00b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 >> 172.21.15.52:0/3029164908 conn(0x7f31f006bc10 msgr2=0x7f31f00cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 shutdown_connections 2024-09-10T08:31:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.218+0000 7f31f7000640 1 -- 172.21.15.52:0/3029164908 wait complete. 2024-09-10T08:31:37.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:37.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.419+0000 7f9521e00640 1 Processor -- start 2024-09-10T08:31:37.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.419+0000 7f9521e00640 1 -- start start 2024-09-10T08:31:37.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f9521e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f951c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f9521e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f951c0b66b0 0x7f951c0b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f9521e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951c15f570 con 0x7f951c162490 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f9521e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f951c15f850 con 0x7f951c0b66b0 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f9521e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f951c15fb30 con 0x7f951c15eab0 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f951a000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f951c162490 0x7f951c0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58280/0 (socket says 172.21.15.52:58280) 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.420+0000 7f951a000640 1 -- 172.21.15.52:0/4021265504 learned_addr learned my addr 172.21.15.52:0/4021265504 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480449413 0 0) 0x7f951c15f570 con 0x7f951c162490 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f951aa00640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f951c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9500003520 con 0x7f951c162490 2024-09-10T08:31:37.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f951b400640 1 --2- 172.21.15.52:0/4021265504 >> v2:172.21.15.176:3300/0 conn(0x7f951c0b66b0 0x7f951c0b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1104338449 0 0) 0x7f9500003520 con 0x7f951c162490 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 msgr2=0x7f951c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f951c15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 >> v2:172.21.15.176:3300/0 conn(0x7f951c0b66b0 msgr2=0x7f951c0b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 --2- 172.21.15.52:0/4021265504 >> v2:172.21.15.176:3300/0 conn(0x7f951c0b66b0 0x7f951c0b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c15fe10 con 0x7f951c162490 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f9508001670 con 0x7f951c162490 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 >> v1:172.21.15.52:6789/0 conn(0x7f951c162490 legacy=0x7f951c0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f95000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9500003f30 0x7f9500004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500004d40 0x7f95000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f951c15f850 con 0x7f9500003f30 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f951c15fb30 con 0x7f9500004d40 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.421+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f950000b9c0 con 0x7f951c15eab0 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951aa00640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f95000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9500003f30 0x7f9500004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951b400640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500004d40 0x7f95000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 -- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 msgr2=0x7f95000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f95000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 -- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500004d40 msgr2=0x7f95000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500004d40 0x7f95000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951a000640 1 -- 172.21.15.52:0/4021265504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9500003520 con 0x7f9500003f30 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.422+0000 7f951aa00640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c15eab0 0x7f95000039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.423+0000 7f951a000640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9500003f30 0x7f9500004800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f950800c210 tx=0x7f9500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105143cbcd2f4f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.423+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508007d50 con 0x7f9500003f30 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.423+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508005af0 con 0x7f9500003f30 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.423+0000 7f9519600640 1 -- 172.21.15.52:0/4021265504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508007070 con 0x7f9500003f30 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 -- 172.21.15.52:0/4021265504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9500003f30 msgr2=0x7f9500004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 --2- 172.21.15.52:0/4021265504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9500003f30 0x7f9500004800 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f950800c210 tx=0x7f9500005830 comp rx=0 tx=0).stop 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f951b400640 1 -- 172.21.15.52:0/4021265504 reap_dead start 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 -- 172.21.15.52:0/4021265504 shutdown_connections 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 -- 172.21.15.52:0/4021265504 >> 172.21.15.52:0/4021265504 conn(0x7f951c0d16d0 msgr2=0x7f951c0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 -- 172.21.15.52:0/4021265504 shutdown_connections 2024-09-10T08:31:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.424+0000 7f9521e00640 1 -- 172.21.15.52:0/4021265504 wait complete. 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.426+0000 7f9521e00640 1 Processor -- start 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.426+0000 7f9521e00640 1 -- start start 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500003f30 0x7f951c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c0c96f0 0x7f951c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f951c0d45e0 con 0x7f951c0c9270 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f951c0d4460 con 0x7f9500003f30 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f9521e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f951c15ee90 con 0x7f951c0c96f0 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f951a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f951a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40292/0 (socket says 172.21.15.52:40292) 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f951a000640 1 -- 172.21.15.52:0/1534224192 learned_addr learned my addr 172.21.15.52:0/1534224192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f951b400640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c0c96f0 0x7f951c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.427+0000 7f951aa00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500003f30 0x7f951c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 -- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c0c96f0 msgr2=0x7f951c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c0c96f0 0x7f951c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 -- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500003f30 msgr2=0x7f951c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500003f30 0x7f951c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 -- 172.21.15.52:0/1534224192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c160b50 con 0x7f951c0c9270 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f951a000640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9508034040 tx=0x7f9508001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508042070 con 0x7f951c0c9270 2024-09-10T08:31:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508007480 con 0x7f951c0c9270 2024-09-10T08:31:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508007d50 con 0x7f951c0c9270 2024-09-10T08:31:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c0cb9a0 con 0x7f951c0c9270 2024-09-10T08:31:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.428+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c0cbf60 con 0x7f951c0c9270 2024-09-10T08:31:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.429+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951c15f570 con 0x7f951c0c9270 2024-09-10T08:31:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.430+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9508045070 con 0x7f951c0c9270 2024-09-10T08:31:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.431+0000 7f9513400640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 0x7f94fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.431+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f95080abbb0 con 0x7f951c0c9270 2024-09-10T08:31:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.432+0000 7f951aa00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 0x7f94fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.432+0000 7f951aa00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 0x7f94fc06e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f950c009c80 tx=0x7f950c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.435+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9508005ac0 con 0x7f951c0c9270 2024-09-10T08:31:37.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.624+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f951c0d2500 con 0x7f951c0c9270 2024-09-10T08:31:37.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.625+0000 7f9513400640 1 -- 172.21.15.52:0/1534224192 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16694 (secure 0 0 0) 0x7f9508079fa0 con 0x7f951c0c9270 2024-09-10T08:31:37.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:37.626 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:36.641706+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:31:34.450298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T08:31:35.644857+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.627+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 msgr2=0x7f94fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.627+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 0x7f94fc06e320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f950c009c80 tx=0x7f950c009190 comp rx=0 tx=0).stop 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.627+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 msgr2=0x7f951c15ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.627+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9508034040 tx=0x7f9508001a40 comp rx=0 tx=0).stop 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 shutdown_connections 2024-09-10T08:31:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94fc06be60 0x7f94fc06e320 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f951c0c96f0 0x7f951c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951c0c9270 0x7f951c15ffe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 --2- 172.21.15.52:0/1534224192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9500003f30 0x7f951c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 >> 172.21.15.52:0/1534224192 conn(0x7f951c0d16d0 msgr2=0x7f951c0b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 shutdown_connections 2024-09-10T08:31:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.628+0000 7f9521e00640 1 -- 172.21.15.52:0/1534224192 wait complete. 2024-09-10T08:31:37.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:37.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.799+0000 7f8375a00640 1 Processor -- start 2024-09-10T08:31:37.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.799+0000 7f8375a00640 1 -- start start 2024-09-10T08:31:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f8375a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370145ed0 0x7f83700b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f8375a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83700b5f90 0x7f83700735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f8375a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700b4020 con 0x7f8370073180 2024-09-10T08:31:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f8375a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8370073b00 con 0x7f83700b5f90 2024-09-10T08:31:37.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f8375a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83700b42c0 con 0x7f8370145ed0 2024-09-10T08:31:37.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83700b5f90 0x7f83700735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f83700b5f90 0x7f83700735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40302/0 (socket says 172.21.15.52:40302) 2024-09-10T08:31:37.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 -- 172.21.15.52:0/2650635347 learned_addr learned my addr 172.21.15.52:0/2650635347 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:37.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836ea00640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370145ed0 0x7f83700b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 -- 172.21.15.52:0/2650635347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370145ed0 msgr2=0x7f83700b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370145ed0 0x7f83700b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 -- 172.21.15.52:0/2650635347 >> v1:172.21.15.52:6789/0 conn(0x7f8370073180 legacy=0x7f83700b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.801+0000 7f836f400640 1 -- 172.21.15.52:0/2650635347 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700b45a0 con 0x7f83700b5f90 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.802+0000 7f836f400640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f83700735c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8368009e50 tx=0x7f836802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c56248625c9b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f836e000640 1 -- 172.21.15.52:0/2650635347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368036070 con 0x7f83700b5f90 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f836e000640 1 -- 172.21.15.52:0/2650635347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368031600 con 0x7f83700b5f90 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f836e000640 1 -- 172.21.15.52:0/2650635347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680319d0 con 0x7f83700b5f90 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 -- 172.21.15.52:0/2650635347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 msgr2=0x7f83700735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f83700735c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8368009e50 tx=0x7f836802a710 comp rx=0 tx=0).stop 2024-09-10T08:31:37.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 -- 172.21.15.52:0/2650635347 shutdown_connections 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f83700735c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 --2- 172.21.15.52:0/2650635347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370145ed0 0x7f83700b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 -- 172.21.15.52:0/2650635347 >> 172.21.15.52:0/2650635347 conn(0x7f83700ccec0 msgr2=0x7f83700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 -- 172.21.15.52:0/2650635347 shutdown_connections 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.803+0000 7f8375a00640 1 -- 172.21.15.52:0/2650635347 wait complete. 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.805+0000 7f8375a00640 1 Processor -- start 2024-09-10T08:31:37.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.805+0000 7f8375a00640 1 -- start start 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370073180 0x7f83701f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8370145ed0 0x7f8370143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83701462b0 con 0x7f83700b5f90 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83700b4b60 con 0x7f8370145ed0 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8375a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8370146430 con 0x7f8370073180 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8366000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.806+0000 7f8366000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40318/0 (socket says 172.21.15.52:40318) 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 -- 172.21.15.52:0/3941546210 learned_addr learned my addr 172.21.15.52:0/3941546210 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f836ea00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370073180 0x7f83701f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f836f400640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8370145ed0 0x7f8370143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 -- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370073180 msgr2=0x7f83701f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370073180 0x7f83701f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 -- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8370145ed0 msgr2=0x7f8370143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8370145ed0 0x7f8370143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 -- 172.21.15.52:0/3941546210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83701f53b0 con 0x7f83700b5f90 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8366000640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f835800c470 tx=0x7f8358001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580052d0 con 0x7f83700b5f90 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8358005470 con 0x7f83700b5f90 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837013b7d0 con 0x7f83700b5f90 2024-09-10T08:31:37.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.807+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358007260 con 0x7f83700b5f90 2024-09-10T08:31:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.808+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837013b210 con 0x7f83700b5f90 2024-09-10T08:31:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.809+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83700735c0 con 0x7f83700b5f90 2024-09-10T08:31:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.810+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8358007400 con 0x7f83700b5f90 2024-09-10T08:31:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.810+0000 7f8367400640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.810+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f835808a430 con 0x7f83700b5f90 2024-09-10T08:31:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.811+0000 7f836ea00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.812+0000 7f836ea00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f837013a210 tx=0x7f8360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:37.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:37.814+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8358058d40 con 0x7f83700b5f90 2024-09-10T08:31:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.001+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83700d1090 con 0x7f83700b5f90 2024-09-10T08:31:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.002+0000 7f8367400640 1 -- 172.21.15.52:0/3941546210 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16694 (secure 0 0 0) 0x7f8358058640 con 0x7f83700b5f90 2024-09-10T08:31:38.002 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:38.003 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":48,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:36.641706+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:31:34.450298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T08:31:35.644857+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 msgr2=0x7f834c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f837013a210 tx=0x7f8360008040 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 msgr2=0x7f837013a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f835800c470 tx=0x7f8358001e70 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 shutdown_connections 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834c06be30 0x7f834c06e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8370145ed0 0x7f8370143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83700b5f90 0x7f837013a420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 --2- 172.21.15.52:0/3941546210 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8370073180 0x7f83701f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 >> 172.21.15.52:0/3941546210 conn(0x7f83700ccec0 msgr2=0x7f83700cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 shutdown_connections 2024-09-10T08:31:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.004+0000 7f8375a00640 1 -- 172.21.15.52:0/3941546210 wait complete. 2024-09-10T08:31:38.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:31:38.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.180+0000 7fcf4fe00640 1 Processor -- start 2024-09-10T08:31:38.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.180+0000 7fcf4fe00640 1 -- start start 2024-09-10T08:31:38.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.181+0000 7fcf4fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf480ccf30 0x7fcf480b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.181+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4815b7c0 0x7fcf480cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.181+0000 7fcf4fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf480cd850 con 0x7fcf480cead0 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.181+0000 7fcf4fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcf480cf2e0 con 0x7fcf480ccf30 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.181+0000 7fcf4fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf48070fe0 con 0x7fcf4815b7c0 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcf480cead0 0x7fcf4815f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58290/0 (socket says 172.21.15.52:58290) 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4de00640 1 -- 172.21.15.52:0/633360709 learned_addr learned my addr 172.21.15.52:0/633360709 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4d400640 1 --2- 172.21.15.52:0/633360709 >> v2:172.21.15.176:3300/0 conn(0x7fcf480ccf30 0x7fcf480b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4ca00640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4815b7c0 0x7fcf480cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf47e00640 1 -- 172.21.15.52:0/633360709 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995987844 0 0) 0x7fcf480cd850 con 0x7fcf480cead0 2024-09-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf47e00640 1 -- 172.21.15.52:0/633360709 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30003520 con 0x7fcf480cead0 2024-09-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4d400640 1 -- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4815b7c0 msgr2=0x7fcf480cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4d400640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4815b7c0 0x7fcf480cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4d400640 1 -- 172.21.15.52:0/633360709 >> v1:172.21.15.52:6789/0 conn(0x7fcf480cead0 legacy=0x7fcf4815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.182+0000 7fcf4d400640 1 -- 172.21.15.52:0/633360709 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf480712c0 con 0x7fcf480ccf30 2024-09-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4d400640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480ccf30 0x7fcf480b2c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dd8a2d65bf5328c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf47e00640 1 -- 172.21.15.52:0/633360709 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c037070 con 0x7fcf480ccf30 2024-09-10T08:31:38.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf47e00640 1 -- 172.21.15.52:0/633360709 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c02ae50 con 0x7fcf480ccf30 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf47e00640 1 -- 172.21.15.52:0/633360709 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c032640 con 0x7fcf480ccf30 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 -- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480ccf30 msgr2=0x7fcf480b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480ccf30 0x7fcf480b2c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c02a100 comp rx=0 tx=0).stop 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 -- 172.21.15.52:0/633360709 shutdown_connections 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf4815b7c0 0x7fcf480cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/633360709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480ccf30 0x7fcf480b2c50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.184+0000 7fcf4fe00640 1 -- 172.21.15.52:0/633360709 >> 172.21.15.52:0/633360709 conn(0x7fcf4806d0f0 msgr2=0x7fcf4806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.185+0000 7fcf4fe00640 1 -- 172.21.15.52:0/633360709 shutdown_connections 2024-09-10T08:31:38.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.185+0000 7fcf4fe00640 1 -- 172.21.15.52:0/633360709 wait complete. 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.186+0000 7fcf4fe00640 1 Processor -- start 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.186+0000 7fcf4fe00640 1 -- start start 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf480ccf30 0x7fcf4813fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 0x7fcf481f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480cef20 con 0x7fcf4815b7c0 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf480cf5c0 con 0x7fcf480cead0 2024-09-10T08:31:38.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf480cf0a0 con 0x7fcf480ccf30 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40328/0 (socket says 172.21.15.52:40328) 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.187+0000 7fcf4de00640 1 -- 172.21.15.52:0/72083424 learned_addr learned my addr 172.21.15.52:0/72083424 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4ca00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 0x7fcf481f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4d400640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf480ccf30 0x7fcf4813fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 -- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf480ccf30 msgr2=0x7fcf4813fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf480ccf30 0x7fcf4813fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 -- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 msgr2=0x7fcf481f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:38.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 0x7fcf481f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 -- 172.21.15.52:0/72083424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf48140aa0 con 0x7fcf4815b7c0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4ca00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 0x7fcf481f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4de00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000cb40 tx=0x7fcf4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40017070 con 0x7fcf4815b7c0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4000aca0 con 0x7fcf4815b7c0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48140d80 con 0x7fcf4815b7c0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40012620 con 0x7fcf4815b7c0 2024-09-10T08:31:38.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.188+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf48141340 con 0x7fcf4815b7c0 2024-09-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.190+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf480b2c50 con 0x7fcf4815b7c0 2024-09-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.191+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf4001a070 con 0x7fcf4815b7c0 2024-09-10T08:31:38.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.191+0000 7fcf45600640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 0x7fcf2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.191+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fcf4008ad40 con 0x7fcf4815b7c0 2024-09-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.192+0000 7fcf4d400640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 0x7fcf2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.193+0000 7fcf4d400640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 0x7fcf2806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c034000 tx=0x7fcf3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:38.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.196+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf40059650 con 0x7fcf4815b7c0 2024-09-10T08:31:38.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:38.425+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcf480cc960 con 0x7fcf4815b7c0 2024-09-10T08:31:39.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.231+0000 7fcf45600640 1 -- 172.21.15.52:0/72083424 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fcf40058f50 con 0x7fcf4815b7c0 2024-09-10T08:31:39.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 msgr2=0x7fcf2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 0x7fcf2806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c034000 tx=0x7fcf3c02e000 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 msgr2=0x7fcf48141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000cb40 tx=0x7fcf4000a060 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 shutdown_connections 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf2806be30 0x7fcf2806e2f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf4815b7c0 0x7fcf48141aa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf480cead0 0x7fcf481f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 --2- 172.21.15.52:0/72083424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf480ccf30 0x7fcf4813fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 >> 172.21.15.52:0/72083424 conn(0x7fcf4806d0f0 msgr2=0x7fcf480ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 shutdown_connections 2024-09-10T08:31:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.234+0000 7fcf4fe00640 1 -- 172.21.15.52:0/72083424 wait complete. 2024-09-10T08:31:39.254 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:31:39.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:31:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.419+0000 7fc148e00640 1 Processor -- start 2024-09-10T08:31:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.419+0000 7fc148e00640 1 -- start start 2024-09-10T08:31:39.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.420+0000 7fc148e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1440ccf30 0x7fc1440b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.420+0000 7fc148e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14415b7c0 0x7fc1440cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.420+0000 7fc148e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1440cd850 con 0x7fc1440cead0 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc148e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc1440cf2e0 con 0x7fc1440ccf30 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc148e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc144070fe0 con 0x7fc14415b7c0 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1440ccf30 0x7fc1440b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1440ccf30 0x7fc1440b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40344/0 (socket says 172.21.15.52:40344) 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 -- 172.21.15.52:0/3992472427 learned_addr learned my addr 172.21.15.52:0/3992472427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc13be00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14415b7c0 0x7fc1440cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 -- 172.21.15.52:0/3992472427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14415b7c0 msgr2=0x7fc1440cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14415b7c0 0x7fc1440cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 -- 172.21.15.52:0/3992472427 >> v1:172.21.15.176:6789/0 conn(0x7fc1440cead0 legacy=0x7fc14415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.421+0000 7fc141e00640 1 -- 172.21.15.52:0/3992472427 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1440712c0 con 0x7fc1440ccf30 2024-09-10T08:31:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.422+0000 7fc141e00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1440ccf30 0x7fc1440b2c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc134009870 tx=0x7fc13402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3cc9bae2cdc538 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc141400640 1 -- 172.21.15.52:0/3992472427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134037070 con 0x7fc1440ccf30 2024-09-10T08:31:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc141400640 1 -- 172.21.15.52:0/3992472427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc134032440 con 0x7fc1440ccf30 2024-09-10T08:31:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc141400640 1 -- 172.21.15.52:0/3992472427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134032810 con 0x7fc1440ccf30 2024-09-10T08:31:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 -- 172.21.15.52:0/3992472427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1440ccf30 msgr2=0x7fc1440b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1440ccf30 0x7fc1440b2c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc134009870 tx=0x7fc13402a180 comp rx=0 tx=0).stop 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 -- 172.21.15.52:0/3992472427 shutdown_connections 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14415b7c0 0x7fc1440cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 --2- 172.21.15.52:0/3992472427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1440ccf30 0x7fc1440b2c50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 -- 172.21.15.52:0/3992472427 >> 172.21.15.52:0/3992472427 conn(0x7fc14406d0f0 msgr2=0x7fc14406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.423+0000 7fc148e00640 1 -- 172.21.15.52:0/3992472427 shutdown_connections 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.424+0000 7fc148e00640 1 -- 172.21.15.52:0/3992472427 wait complete. 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.425+0000 7fc148e00640 1 Processor -- start 2024-09-10T08:31:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.425+0000 7fc148e00640 1 -- start start 2024-09-10T08:31:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1440ccf30 0x7fc144145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1440cead0 0x7fc144167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1440cef20 con 0x7fc14415b7c0 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1440cf5c0 con 0x7fc1440ccf30 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc148e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1440cf0a0 con 0x7fc1440cead0 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc142800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc142800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40354/0 (socket says 172.21.15.52:40354) 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc142800640 1 -- 172.21.15.52:0/3153442566 learned_addr learned my addr 172.21.15.52:0/3153442566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.426+0000 7fc141e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1440ccf30 0x7fc144145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc13be00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1440cead0 0x7fc144167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 -- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1440cead0 msgr2=0x7fc144167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1440cead0 0x7fc144167970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 -- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1440ccf30 msgr2=0x7fc144145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1440ccf30 0x7fc144145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 -- 172.21.15.52:0/3153442566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc144148740 con 0x7fc14415b7c0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc142800640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c7b0 tx=0x7fc13c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004b60 con 0x7fc14415b7c0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13c004d00 con 0x7fc14415b7c0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00aa90 con 0x7fc14415b7c0 2024-09-10T08:31:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.427+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1441489e0 con 0x7fc14415b7c0 2024-09-10T08:31:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.428+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc144146490 con 0x7fc14415b7c0 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.429+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1440b2c50 con 0x7fc14415b7c0 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.430+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc13c00ac30 con 0x7fc14415b7c0 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.430+0000 7fc13a000640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 0x7fc12006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.431+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc13c08afe0 con 0x7fc14415b7c0 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.431+0000 7fc141e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 0x7fc12006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:39.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.432+0000 7fc141e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 0x7fc12006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc134034000 tx=0x7fc13402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:39.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.435+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc13c020070 con 0x7fc14415b7c0 2024-09-10T08:31:39.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:39.657+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc1440cd630 con 0x7fc14415b7c0 2024-09-10T08:31:40.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.236+0000 7fc13a000640 1 -- 172.21.15.52:0/3153442566 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fc13c059300 con 0x7fc14415b7c0 2024-09-10T08:31:40.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 msgr2=0x7fc12006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 0x7fc12006e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc134034000 tx=0x7fc13402e000 comp rx=0 tx=0).stop 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 msgr2=0x7fc144164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c7b0 tx=0x7fc13c00cc70 comp rx=0 tx=0).stop 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 shutdown_connections 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc12006be30 0x7fc12006e2f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc14415b7c0 0x7fc144164690 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1440cead0 0x7fc144167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 --2- 172.21.15.52:0/3153442566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1440ccf30 0x7fc144145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 >> 172.21.15.52:0/3153442566 conn(0x7fc14406d0f0 msgr2=0x7fc1441517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:40.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 shutdown_connections 2024-09-10T08:31:40.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.239+0000 7fc148e00640 1 -- 172.21.15.52:0/3153442566 wait complete. 2024-09-10T08:31:40.257 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:31:40.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:40.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.415+0000 7ff03ec00640 1 Processor -- start 2024-09-10T08:31:40.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.415+0000 7ff03ec00640 1 -- start start 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.416+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.416+0000 7ff03ec00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 0x7ff0380714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.416+0000 7ff03ec00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff038071b30 con 0x7ff038148260 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.416+0000 7ff03ec00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff038074200 con 0x7ff03806c320 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.416+0000 7ff03ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380b3e40 con 0x7ff038147e80 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:54698/0 (socket says 172.21.15.52:54698) 2024-09-10T08:31:40.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff03cc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 0x7ff0380714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 -- 172.21.15.52:0/4073878963 learned_addr learned my addr 172.21.15.52:0/4073878963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:40.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037400640 1 --1- 172.21.15.52:0/4073878963 >> v1:172.21.15.176:6789/0 conn(0x7ff038148260 0x7ff03806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52862/0 (socket says 172.21.15.52:52862) 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 -- 172.21.15.52:0/4073878963 >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 msgr2=0x7ff0380714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 --2- 172.21.15.52:0/4073878963 >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 0x7ff0380714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 -- 172.21.15.52:0/4073878963 >> v1:172.21.15.176:6789/0 conn(0x7ff038148260 legacy=0x7ff03806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff037e00640 1 -- 172.21.15.52:0/4073878963 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380b3510 con 0x7ff038147e80 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.417+0000 7ff03cc00640 1 --2- 172.21.15.52:0/4073878963 >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 0x7ff0380714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.418+0000 7ff037e00640 1 --2- 172.21.15.52:0/4073878963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff028009870 tx=0x7ff02802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7633b954a5b1b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff036a00640 1 -- 172.21.15.52:0/4073878963 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028037070 con 0x7ff038147e80 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff036a00640 1 -- 172.21.15.52:0/4073878963 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028032440 con 0x7ff038147e80 2024-09-10T08:31:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff036a00640 1 -- 172.21.15.52:0/4073878963 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028032810 con 0x7ff038147e80 2024-09-10T08:31:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 -- 172.21.15.52:0/4073878963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 msgr2=0x7ff038070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 --2- 172.21.15.52:0/4073878963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff028009870 tx=0x7ff02802a250 comp rx=0 tx=0).stop 2024-09-10T08:31:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 -- 172.21.15.52:0/4073878963 shutdown_connections 2024-09-10T08:31:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 --2- 172.21.15.52:0/4073878963 >> v2:172.21.15.176:3300/0 conn(0x7ff03806c320 0x7ff0380714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 --2- 172.21.15.52:0/4073878963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff038147e80 0x7ff038070f70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 -- 172.21.15.52:0/4073878963 >> 172.21.15.52:0/4073878963 conn(0x7ff0380ccec0 msgr2=0x7ff0380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 -- 172.21.15.52:0/4073878963 shutdown_connections 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.419+0000 7ff03ec00640 1 -- 172.21.15.52:0/4073878963 wait complete. 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.421+0000 7ff03ec00640 1 Processor -- start 2024-09-10T08:31:40.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.421+0000 7ff03ec00640 1 -- start start 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03806c320 0x7ff03813f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff038148260 0x7ff038141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0380b42d0 con 0x7ff038147e80 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0380b3ad0 con 0x7ff038148260 2024-09-10T08:31:40.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0380b4450 con 0x7ff03806c320 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff037400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff037400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40364/0 (socket says 172.21.15.52:40364) 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff037400640 1 -- 172.21.15.52:0/3602520190 learned_addr learned my addr 172.21.15.52:0/3602520190 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff037e00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03806c320 0x7ff03813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.422+0000 7ff03cc00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff038148260 0x7ff038141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 -- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03806c320 msgr2=0x7ff03813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03806c320 0x7ff03813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 -- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff038148260 msgr2=0x7ff038141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff038148260 0x7ff038141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 -- 172.21.15.52:0/3602520190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0381422f0 con 0x7ff038147e80 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff037400640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff02400c440 tx=0x7ff02400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240074e0 con 0x7ff038147e80 2024-09-10T08:31:40.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024007680 con 0x7ff038147e80 2024-09-10T08:31:40.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0381425d0 con 0x7ff038147e80 2024-09-10T08:31:40.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024004a20 con 0x7ff038147e80 2024-09-10T08:31:40.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.423+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381416b0 con 0x7ff038147e80 2024-09-10T08:31:40.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.424+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03806bc10 con 0x7ff038147e80 2024-09-10T08:31:40.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.425+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff02401a020 con 0x7ff038147e80 2024-09-10T08:31:40.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.426+0000 7ff02fe00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.426+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7ff02408a5d0 con 0x7ff038147e80 2024-09-10T08:31:40.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.427+0000 7ff037e00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.428+0000 7ff037e00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff028034000 tx=0x7ff02802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.431+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff024058f70 con 0x7ff038147e80 2024-09-10T08:31:40.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.649+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0380cadf0 con 0x7ff038147e80 2024-09-10T08:31:40.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.650+0000 7ff02fe00640 1 -- 172.21.15.52:0/3602520190 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7ff024058870 con 0x7ff038147e80 2024-09-10T08:31:40.651 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:40.651 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"btime":"2024-09-10T08:31:40:232695+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:39.658826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:31:40.651 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 msgr2=0x7ff01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff028034000 tx=0x7ff02802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 msgr2=0x7ff0381e3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff02400c440 tx=0x7ff02400c900 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 shutdown_connections 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff038148260 0x7ff038141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038147e80 0x7ff0381e3b20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 --2- 172.21.15.52:0/3602520190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff03806c320 0x7ff03813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 >> 172.21.15.52:0/3602520190 conn(0x7ff0380ccec0 msgr2=0x7ff0380b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 shutdown_connections 2024-09-10T08:31:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.652+0000 7ff03ec00640 1 -- 172.21.15.52:0/3602520190 wait complete. 2024-09-10T08:31:40.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:31:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.825+0000 7fdd2f600640 1 Processor -- start 2024-09-10T08:31:40.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.825+0000 7fdd2f600640 1 -- start start 2024-09-10T08:31:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.826+0000 7fdd2f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd280b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.826+0000 7fdd2f600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd280b4020 con 0x7fdd280b5880 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.826+0000 7fdd2f600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd280b42c0 con 0x7fdd28145ed0 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.826+0000 7fdd2f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd280b45a0 con 0x7fdd28073890 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd2d600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdd280b5880 0x7fdd280b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58304/0 (socket says 172.21.15.52:58304) 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd2d600640 1 -- 172.21.15.52:0/1681051468 learned_addr learned my addr 172.21.15.52:0/1681051468 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27e00640 1 --2- 172.21.15.52:0/1681051468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd280b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564516653 0 0) 0x7fdd280b4020 con 0x7fdd280b5880 2024-09-10T08:31:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd10003520 con 0x7fdd280b5880 2024-09-10T08:31:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814210425 0 0) 0x7fdd280b42c0 con 0x7fdd28145ed0 2024-09-10T08:31:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd280b4020 con 0x7fdd28145ed0 2024-09-10T08:31:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27e00640 1 -- 172.21.15.52:0/1681051468 >> v1:172.21.15.176:6789/0 conn(0x7fdd28145ed0 legacy=0x7fdd28073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27e00640 1 -- 172.21.15.52:0/1681051468 >> v1:172.21.15.52:6789/0 conn(0x7fdd280b5880 legacy=0x7fdd280b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.827+0000 7fdd27e00640 1 -- 172.21.15.52:0/1681051468 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd280b4880 con 0x7fdd28073890 2024-09-10T08:31:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.828+0000 7fdd27e00640 1 --2- 172.21.15.52:0/1681051468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd280b5080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097d0 tx=0x7fdd1402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b525f1a6ca3e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.829+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14037070 con 0x7fdd28073890 2024-09-10T08:31:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.829+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd14032440 con 0x7fdd28073890 2024-09-10T08:31:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.829+0000 7fdd27400640 1 -- 172.21.15.52:0/1681051468 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14032810 con 0x7fdd28073890 2024-09-10T08:31:40.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.829+0000 7fdd2f600640 1 -- 172.21.15.52:0/1681051468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 msgr2=0x7fdd280b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.829+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1681051468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd280b5080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdd140097d0 tx=0x7fdd1402a210 comp rx=0 tx=0).stop 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.830+0000 7fdd2f600640 1 -- 172.21.15.52:0/1681051468 shutdown_connections 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.830+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1681051468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd280b5080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.830+0000 7fdd2f600640 1 -- 172.21.15.52:0/1681051468 >> 172.21.15.52:0/1681051468 conn(0x7fdd280ccec0 msgr2=0x7fdd280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.830+0000 7fdd2f600640 1 -- 172.21.15.52:0/1681051468 shutdown_connections 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.830+0000 7fdd2f600640 1 -- 172.21.15.52:0/1681051468 wait complete. 2024-09-10T08:31:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.831+0000 7fdd2f600640 1 Processor -- start 2024-09-10T08:31:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 -- start start 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd28157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd280b5880 0x7fdd2813d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd28146430 con 0x7fdd28145ed0 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd281462b0 con 0x7fdd280b5880 2024-09-10T08:31:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.832+0000 7fdd2f600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2815cdc0 con 0x7fdd28073890 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40370/0 (socket says 172.21.15.52:40370) 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 -- 172.21.15.52:0/1226087880 learned_addr learned my addr 172.21.15.52:0/1226087880 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd27e00640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd280b5880 0x7fdd2813d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2cc00640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd28157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 -- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 msgr2=0x7fdd28157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd28157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 -- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd280b5880 msgr2=0x7fdd2813d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd280b5880 0x7fdd2813d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 -- 172.21.15.52:0/1226087880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd281f6710 con 0x7fdd28145ed0 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.833+0000 7fdd2d600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000cb70 tx=0x7fdd2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.834+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20017070 con 0x7fdd28145ed0 2024-09-10T08:31:40.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.834+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd2000ad60 con 0x7fdd28145ed0 2024-09-10T08:31:40.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.834+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20012640 con 0x7fdd28145ed0 2024-09-10T08:31:40.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.834+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd281f69f0 con 0x7fdd28145ed0 2024-09-10T08:31:40.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.834+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd281f6fb0 con 0x7fdd28145ed0 2024-09-10T08:31:40.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.835+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd280b5080 con 0x7fdd28145ed0 2024-09-10T08:31:40.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.836+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd2001a070 con 0x7fdd28145ed0 2024-09-10T08:31:40.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.837+0000 7fdd24c00640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 0x7fdd0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:40.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.837+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdd2008aca0 con 0x7fdd28145ed0 2024-09-10T08:31:40.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.837+0000 7fdd2cc00640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 0x7fdd0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:40.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.838+0000 7fdd2cc00640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 0x7fdd0806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0011e0 tx=0x7fdd1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:40.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:40.841+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd20058f60 con 0x7fdd28145ed0 2024-09-10T08:31:41.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.028+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd280caee0 con 0x7fdd28145ed0 2024-09-10T08:31:41.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.029+0000 7fdd24c00640 1 -- 172.21.15.52:0/1226087880 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16681 (secure 0 0 0) 0x7fdd2005d260 con 0x7fdd28145ed0 2024-09-10T08:31:41.029 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:41.030 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":49,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:38.220247+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:31:34.450298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T08:31:35.644857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:31:41.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 msgr2=0x7fdd0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 0x7fdd0806e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0011e0 tx=0x7fdd1c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 msgr2=0x7fdd2813df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000cb70 tx=0x7fdd2000a430 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 shutdown_connections 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd0806be30 0x7fdd0806e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd28145ed0 0x7fdd2813df10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd280b5880 0x7fdd2813d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 --2- 172.21.15.52:0/1226087880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd28073890 0x7fdd28157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 >> 172.21.15.52:0/1226087880 conn(0x7fdd280ccec0 msgr2=0x7fdd28144cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:41.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 shutdown_connections 2024-09-10T08:31:41.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.031+0000 7fdd2f600640 1 -- 172.21.15.52:0/1226087880 wait complete. 2024-09-10T08:31:41.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:31:41.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:31:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.203+0000 7f382be00640 1 Processor -- start 2024-09-10T08:31:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.203+0000 7f382be00640 1 -- start start 2024-09-10T08:31:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f382be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f38240b2d40 0x7f382406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f382be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f382415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f382be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3824071180 con 0x7f382413eb20 2024-09-10T08:31:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f382be00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3824071ab0 con 0x7f38240b2d40 2024-09-10T08:31:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f382be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3824071460 con 0x7f382406c150 2024-09-10T08:31:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f3828a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f382413eb20 0x7f382415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58310/0 (socket says 172.21.15.52:58310) 2024-09-10T08:31:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.204+0000 7f3828a00640 1 -- 172.21.15.52:0/3026060401 learned_addr learned my addr 172.21.15.52:0/3026060401 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3829e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f382415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3829400640 1 --2- 172.21.15.52:0/3026060401 >> v2:172.21.15.176:3300/0 conn(0x7f38240b2d40 0x7f382406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020177410 0 0) 0x7f3824071180 con 0x7f382413eb20 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f380c005730 con 0x7f382413eb20 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 716402061 0 0) 0x7f380c005730 con 0x7f382413eb20 2024-09-10T08:31:41.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 msgr2=0x7f382415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f382415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 >> v2:172.21.15.176:3300/0 conn(0x7f38240b2d40 msgr2=0x7f382406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 --2- 172.21.15.52:0/3026060401 >> v2:172.21.15.176:3300/0 conn(0x7f38240b2d40 0x7f382406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3824071740 con 0x7f382413eb20 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3810001670 con 0x7f382413eb20 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 >> v1:172.21.15.52:6789/0 conn(0x7f382413eb20 legacy=0x7f382415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f380c005bc0 0x7f380c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f380c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c006f50 0x7f380c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3824071ab0 con 0x7f380c005bc0 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3824071460 con 0x7f380c006f50 2024-09-10T08:31:41.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.205+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f380c00dbd0 con 0x7f382406c150 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f380c005bc0 0x7f380c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3828a00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f380c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c006f50 0x7f380c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 -- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 msgr2=0x7f380c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f380c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 -- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c006f50 msgr2=0x7f380c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c006f50 0x7f380c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829400640 1 -- 172.21.15.52:0/3026060401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380c005730 con 0x7f380c005bc0 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3829e00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c006f50 0x7f380c0073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.206+0000 7f3828a00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382406c150 0x7f380c006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.207+0000 7f3829400640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f380c005bc0 0x7f380c005fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3818009ac0 tx=0x7f380c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53788040caac85a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.207+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818036070 con 0x7f380c005bc0 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.207+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3818031400 con 0x7f380c005bc0 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.207+0000 7f3823e00640 1 -- 172.21.15.52:0/3026060401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818009690 con 0x7f380c005bc0 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 -- 172.21.15.52:0/3026060401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f380c005bc0 msgr2=0x7f380c005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 --2- 172.21.15.52:0/3026060401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f380c005bc0 0x7f380c005fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3818009ac0 tx=0x7f380c007a40 comp rx=0 tx=0).stop 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f3829e00640 1 -- 172.21.15.52:0/3026060401 reap_dead start 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 -- 172.21.15.52:0/3026060401 shutdown_connections 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 -- 172.21.15.52:0/3026060401 >> 172.21.15.52:0/3026060401 conn(0x7f38240ccec0 msgr2=0x7f38240cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 -- 172.21.15.52:0/3026060401 shutdown_connections 2024-09-10T08:31:41.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.208+0000 7f382be00640 1 -- 172.21.15.52:0/3026060401 wait complete. 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.210+0000 7f382be00640 1 Processor -- start 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.210+0000 7f382be00640 1 -- start start 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c005bc0 0x7f3824156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382413d990 0x7f38240cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f382415c7d0 con 0x7f382413ddf0 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f382415c650 con 0x7f380c005bc0 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f382be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3824071f40 con 0x7f382413d990 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40386/0 (socket says 172.21.15.52:40386) 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 -- 172.21.15.52:0/2698990016 learned_addr learned my addr 172.21.15.52:0/2698990016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3828a00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382413d990 0x7f38240cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829400640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c005bc0 0x7f3824156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 -- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382413d990 msgr2=0x7f38240cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382413d990 0x7f38240cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 -- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c005bc0 msgr2=0x7f3824156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c005bc0 0x7f3824156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.211+0000 7f3829e00640 1 -- 172.21.15.52:0/2698990016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382415f960 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f3829e00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f38240b3520 tx=0x7f381c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c010d80 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c003990 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c003d80 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382415fc40 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.212+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382415ec00 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.213+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38240ca540 con 0x7f382413ddf0 2024-09-10T08:31:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.214+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f381c005d10 con 0x7f382413ddf0 2024-09-10T08:31:41.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.215+0000 7f3821600640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.215+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f381c08b650 con 0x7f382413ddf0 2024-09-10T08:31:41.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.216+0000 7f3829400640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.216+0000 7f3829400640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 0x7f380406e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3818033000 tx=0x7f3818008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.220+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f381c025020 con 0x7f382413ddf0 2024-09-10T08:31:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.401+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f382415fe10 con 0x7f380406be30 2024-09-10T08:31:41.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.408+0000 7f3821600640 1 -- 172.21.15.52:0/2698990016 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239503 (secure 0 0 0) 0x7f382415fe10 con 0x7f380406be30 2024-09-10T08:31:41.409 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:41.413 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:31:41.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 msgr2=0x7f380406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 0x7f380406e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3818033000 tx=0x7f3818008030 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 msgr2=0x7f38240cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f38240b3520 tx=0x7f381c010590 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 shutdown_connections 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380406be30 0x7f380406e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382413ddf0 0x7f38240cc4f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382413d990 0x7f38240cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 --2- 172.21.15.52:0/2698990016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f380c005bc0 0x7f3824156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 >> 172.21.15.52:0/2698990016 conn(0x7f38240ccec0 msgr2=0x7f38240d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 shutdown_connections 2024-09-10T08:31:41.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.412+0000 7f382be00640 1 -- 172.21.15.52:0/2698990016 wait complete. 2024-09-10T08:31:41.429 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-10T08:31:39.494699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":300568,"kb_used_data":5252,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754674152,"statfs":{"total":773094113280,"available":772786331648,"internally_reserved":0,"allocated":5378048,"data_stored":2859495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.289926"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233009+0000","last_change":"2024-09-10T08:31:37.239576+0000","last_active":"2024-09-10T08:31:38.233009+0000","last_peered":"2024-09-10T08:31:38.233009+0000","last_clean":"2024-09-10T08:31:38.233009+0000","last_became_active":"2024-09-10T08:31:37.239219+0000","last_became_peered":"2024-09-10T08:31:37.239219+0000","last_unstale":"2024-09-10T08:31:38.233009+0000","last_undegraded":"2024-09-10T08:31:38.233009+0000","last_fullsized":"2024-09-10T08:31:38.233009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:06.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232409+0000","last_change":"2024-09-10T08:31:37.243086+0000","last_active":"2024-09-10T08:31:38.232409+0000","last_peered":"2024-09-10T08:31:38.232409+0000","last_clean":"2024-09-10T08:31:38.232409+0000","last_became_active":"2024-09-10T08:31:37.242734+0000","last_became_peered":"2024-09-10T08:31:37.242734+0000","last_unstale":"2024-09-10T08:31:38.232409+0000","last_undegraded":"2024-09-10T08:31:38.232409+0000","last_fullsized":"2024-09-10T08:31:38.232409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:17.148112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233101+0000","last_change":"2024-09-10T08:31:37.243898+0000","last_active":"2024-09-10T08:31:38.233101+0000","last_peered":"2024-09-10T08:31:38.233101+0000","last_clean":"2024-09-10T08:31:38.233101+0000","last_became_active":"2024-09-10T08:31:37.242628+0000","last_became_peered":"2024-09-10T08:31:37.242628+0000","last_unstale":"2024-09-10T08:31:38.233101+0000","last_undegraded":"2024-09-10T08:31:38.233101+0000","last_fullsized":"2024-09-10T08:31:38.233101+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:33.083323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232946+0000","last_change":"2024-09-10T08:31:37.236412+0000","last_active":"2024-09-10T08:31:38.232946+0000","last_peered":"2024-09-10T08:31:38.232946+0000","last_clean":"2024-09-10T08:31:38.232946+0000","last_became_active":"2024-09-10T08:31:37.236153+0000","last_became_peered":"2024-09-10T08:31:37.236153+0000","last_unstale":"2024-09-10T08:31:38.232946+0000","last_undegraded":"2024-09-10T08:31:38.232946+0000","last_fullsized":"2024-09-10T08:31:38.232946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:25.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232456+0000","last_change":"2024-09-10T08:31:37.235201+0000","last_active":"2024-09-10T08:31:38.232456+0000","last_peered":"2024-09-10T08:31:38.232456+0000","last_clean":"2024-09-10T08:31:38.232456+0000","last_became_active":"2024-09-10T08:31:37.234940+0000","last_became_peered":"2024-09-10T08:31:37.234940+0000","last_unstale":"2024-09-10T08:31:38.232456+0000","last_undegraded":"2024-09-10T08:31:38.232456+0000","last_fullsized":"2024-09-10T08:31:38.232456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:22.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233254+0000","last_change":"2024-09-10T08:31:37.239433+0000","last_active":"2024-09-10T08:31:38.233254+0000","last_peered":"2024-09-10T08:31:38.233254+0000","last_clean":"2024-09-10T08:31:38.233254+0000","last_became_active":"2024-09-10T08:31:37.238169+0000","last_became_peered":"2024-09-10T08:31:37.238169+0000","last_unstale":"2024-09-10T08:31:38.233254+0000","last_undegraded":"2024-09-10T08:31:38.233254+0000","last_fullsized":"2024-09-10T08:31:38.233254+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:38.882627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232904+0000","last_change":"2024-09-10T08:31:37.242790+0000","last_active":"2024-09-10T08:31:38.232904+0000","last_peered":"2024-09-10T08:31:38.232904+0000","last_clean":"2024-09-10T08:31:38.232904+0000","last_became_active":"2024-09-10T08:31:37.242467+0000","last_became_peered":"2024-09-10T08:31:37.242467+0000","last_unstale":"2024-09-10T08:31:38.232904+0000","last_undegraded":"2024-09-10T08:31:38.232904+0000","last_fullsized":"2024-09-10T08:31:38.232904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:39.564237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232399+0000","last_change":"2024-09-10T08:31:37.241998+0000","last_active":"2024-09-10T08:31:38.232399+0000","last_peered":"2024-09-10T08:31:38.232399+0000","last_clean":"2024-09-10T08:31:38.232399+0000","last_became_active":"2024-09-10T08:31:37.238994+0000","last_became_peered":"2024-09-10T08:31:37.238994+0000","last_unstale":"2024-09-10T08:31:38.232399+0000","last_undegraded":"2024-09-10T08:31:38.232399+0000","last_fullsized":"2024-09-10T08:31:38.232399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:47.018272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233257+0000","last_change":"2024-09-10T08:31:37.237232+0000","last_active":"2024-09-10T08:31:38.233257+0000","last_peered":"2024-09-10T08:31:38.233257+0000","last_clean":"2024-09-10T08:31:38.233257+0000","last_became_active":"2024-09-10T08:31:37.236955+0000","last_became_peered":"2024-09-10T08:31:37.236955+0000","last_unstale":"2024-09-10T08:31:38.233257+0000","last_undegraded":"2024-09-10T08:31:38.233257+0000","last_fullsized":"2024-09-10T08:31:38.233257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:00.788023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232726+0000","last_change":"2024-09-10T08:31:37.237507+0000","last_active":"2024-09-10T08:31:38.232726+0000","last_peered":"2024-09-10T08:31:38.232726+0000","last_clean":"2024-09-10T08:31:38.232726+0000","last_became_active":"2024-09-10T08:31:37.237121+0000","last_became_peered":"2024-09-10T08:31:37.237121+0000","last_unstale":"2024-09-10T08:31:38.232726+0000","last_undegraded":"2024-09-10T08:31:38.232726+0000","last_fullsized":"2024-09-10T08:31:38.232726+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:51.323353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232767+0000","last_change":"2024-09-10T08:31:36.235724+0000","last_active":"2024-09-10T08:31:38.232767+0000","last_peered":"2024-09-10T08:31:38.232767+0000","last_clean":"2024-09-10T08:31:38.232767+0000","last_became_active":"2024-09-10T08:31:36.235166+0000","last_became_peered":"2024-09-10T08:31:36.235166+0000","last_unstale":"2024-09-10T08:31:38.232767+0000","last_undegraded":"2024-09-10T08:31:38.232767+0000","last_fullsized":"2024-09-10T08:31:38.232767+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:39.992570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232598+0000","last_change":"2024-09-10T08:31:37.232468+0000","last_active":"2024-09-10T08:31:38.232598+0000","last_peered":"2024-09-10T08:31:38.232598+0000","last_clean":"2024-09-10T08:31:38.232598+0000","last_became_active":"2024-09-10T08:31:37.232168+0000","last_became_peered":"2024-09-10T08:31:37.232168+0000","last_unstale":"2024-09-10T08:31:38.232598+0000","last_undegraded":"2024-09-10T08:31:38.232598+0000","last_fullsized":"2024-09-10T08:31:38.232598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:58.569309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232360+0000","last_change":"2024-09-10T08:31:37.230995+0000","last_active":"2024-09-10T08:31:38.232360+0000","last_peered":"2024-09-10T08:31:38.232360+0000","last_clean":"2024-09-10T08:31:38.232360+0000","last_became_active":"2024-09-10T08:31:37.230551+0000","last_became_peered":"2024-09-10T08:31:37.230551+0000","last_unstale":"2024-09-10T08:31:38.232360+0000","last_undegraded":"2024-09-10T08:31:38.232360+0000","last_fullsized":"2024-09-10T08:31:38.232360+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:22.480198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.234703+0000","last_change":"2024-09-10T08:31:36.231242+0000","last_active":"2024-09-10T08:31:38.234703+0000","last_peered":"2024-09-10T08:31:38.234703+0000","last_clean":"2024-09-10T08:31:38.234703+0000","last_became_active":"2024-09-10T08:31:36.230932+0000","last_became_peered":"2024-09-10T08:31:36.230932+0000","last_unstale":"2024-09-10T08:31:38.234703+0000","last_undegraded":"2024-09-10T08:31:38.234703+0000","last_fullsized":"2024-09-10T08:31:38.234703+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:11.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232993+0000","last_change":"2024-09-10T08:31:37.235919+0000","last_active":"2024-09-10T08:31:38.232993+0000","last_peered":"2024-09-10T08:31:38.232993+0000","last_clean":"2024-09-10T08:31:38.232993+0000","last_became_active":"2024-09-10T08:31:37.235617+0000","last_became_peered":"2024-09-10T08:31:37.235617+0000","last_unstale":"2024-09-10T08:31:38.232993+0000","last_undegraded":"2024-09-10T08:31:38.232993+0000","last_fullsized":"2024-09-10T08:31:38.232993+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:13.783552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:36.204225+0000","last_change":"2024-09-10T08:31:36.204225+0000","last_active":"2024-09-10T08:31:36.204225+0000","last_peered":"2024-09-10T08:31:36.204225+0000","last_clean":"2024-09-10T08:31:36.204225+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:36.204225+0000","last_undegraded":"2024-09-10T08:31:36.204225+0000","last_fullsized":"2024-09-10T08:31:36.204225+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233121+0000","last_change":"2024-09-10T08:31:37.238244+0000","last_active":"2024-09-10T08:31:38.233121+0000","last_peered":"2024-09-10T08:31:38.233121+0000","last_clean":"2024-09-10T08:31:38.233121+0000","last_became_active":"2024-09-10T08:31:37.234812+0000","last_became_peered":"2024-09-10T08:31:37.234812+0000","last_unstale":"2024-09-10T08:31:38.233121+0000","last_undegraded":"2024-09-10T08:31:38.233121+0000","last_fullsized":"2024-09-10T08:31:38.233121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:36.044585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:31:35.201235+0000","last_change":"2024-09-10T08:31:35.201235+0000","last_active":"2024-09-10T08:31:35.201235+0000","last_peered":"2024-09-10T08:31:35.201235+0000","last_clean":"2024-09-10T08:31:35.201235+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:31:35.201235+0000","last_undegraded":"2024-09-10T08:31:35.201235+0000","last_fullsized":"2024-09-10T08:31:35.201235+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-10T08:31:34.314528+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:31:34.314528+0000","last_peered":"2024-09-10T08:31:34.314528+0000","last_clean":"2024-09-10T08:31:34.314528+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:31:34.314528+0000","last_undegraded":"2024-09-10T08:31:34.314528+0000","last_fullsized":"2024-09-10T08:31:34.314528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":1},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":4,"acting":4,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":520192,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35848,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":507904,"data_stored":202851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35868,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":520192,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40020,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331820,"statfs":{"total":96636764160,"available":96595783680,"internally_reserved":0,"allocated":520192,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40032,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331808,"statfs":{"total":96636764160,"available":96595771392,"internally_reserved":0,"allocated":520192,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40588,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331252,"statfs":{"total":96636764160,"available":96595202048,"internally_reserved":0,"allocated":1101824,"data_stored":793219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35856,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":520192,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1167360,"data_stored":823535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:31:41.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:31:41.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.626+0000 7f47c8800640 1 Processor -- start 2024-09-10T08:31:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.626+0000 7f47c8800640 1 -- start start 2024-09-10T08:31:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c8800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47c013eb20 0x7f47c015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c8800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c0071180 con 0x7f47c006c320 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c8800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c0071460 con 0x7f47c00b2d40 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c8800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f47c0071ab0 con 0x7f47c013eb20 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c5400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f47c006c320 0x7f47c015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58324/0 (socket says 172.21.15.52:58324) 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c5400640 1 -- 172.21.15.52:0/1189311109 learned_addr learned my addr 172.21.15.52:0/1189311109 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.627+0000 7f47c6800640 1 --2- 172.21.15.52:0/1189311109 >> v2:172.21.15.52:3300/0 conn(0x7f47c013eb20 0x7f47c015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.628+0000 7f47c6800640 1 -- 172.21.15.52:0/1189311109 >> v1:172.21.15.176:6789/0 conn(0x7f47c00b2d40 legacy=0x7f47c006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.628+0000 7f47c6800640 1 -- 172.21.15.52:0/1189311109 >> v1:172.21.15.52:6789/0 conn(0x7f47c006c320 legacy=0x7f47c015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.628+0000 7f47c6800640 1 -- 172.21.15.52:0/1189311109 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0071740 con 0x7f47c013eb20 2024-09-10T08:31:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.629+0000 7f47c6800640 1 --2- 172.21.15.52:0/1189311109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013eb20 0x7f47c015c400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5a2b03ea13dbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.629+0000 7f47c4a00640 1 -- 172.21.15.52:0/1189311109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc007740 con 0x7f47c013eb20 2024-09-10T08:31:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.629+0000 7f47c4a00640 1 -- 172.21.15.52:0/1189311109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0078e0 con 0x7f47c013eb20 2024-09-10T08:31:41.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.629+0000 7f47c4a00640 1 -- 172.21.15.52:0/1189311109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc007cb0 con 0x7f47c013eb20 2024-09-10T08:31:41.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 -- 172.21.15.52:0/1189311109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013eb20 msgr2=0x7f47c015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 --2- 172.21.15.52:0/1189311109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013eb20 0x7f47c015c400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 -- 172.21.15.52:0/1189311109 shutdown_connections 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 --2- 172.21.15.52:0/1189311109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013eb20 0x7f47c015c400 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 -- 172.21.15.52:0/1189311109 >> 172.21.15.52:0/1189311109 conn(0x7f47c00ccec0 msgr2=0x7f47c00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 -- 172.21.15.52:0/1189311109 shutdown_connections 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.630+0000 7f47c8800640 1 -- 172.21.15.52:0/1189311109 wait complete. 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.631+0000 7f47c8800640 1 Processor -- start 2024-09-10T08:31:41.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 -- start start 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 0x7f47c013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 0x7f47c015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47c00b3980 con 0x7f47c00b2d40 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f47c00b3800 con 0x7f47c013eb20 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.632+0000 7f47c8800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f47c00b3b00 con 0x7f47c006c320 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40400/0 (socket says 172.21.15.52:40400) 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 -- 172.21.15.52:0/2565956580 learned_addr learned my addr 172.21.15.52:0/2565956580 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5e00640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 0x7f47c013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c6800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 0x7f47c015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 -- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 msgr2=0x7f47c013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 0x7f47c013c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 -- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 msgr2=0x7f47c015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 0x7f47c015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 -- 172.21.15.52:0/2565956580 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0144840 con 0x7f47c00b2d40 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5e00640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 0x7f47c013c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c6800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 0x7f47c015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.633+0000 7f47c5400640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c4a0 tx=0x7f47b000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.634+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0017070 con 0x7f47c00b2d40 2024-09-10T08:31:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.634+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0005ce0 con 0x7f47c00b2d40 2024-09-10T08:31:41.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.634+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0007270 con 0x7f47c00b2d40 2024-09-10T08:31:41.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.634+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c0144b20 con 0x7f47c00b2d40 2024-09-10T08:31:41.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.634+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c013bc20 con 0x7f47c00b2d40 2024-09-10T08:31:41.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.635+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c013be20 con 0x7f47c00b2d40 2024-09-10T08:31:41.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.636+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47b001a070 con 0x7f47c00b2d40 2024-09-10T08:31:41.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.637+0000 7f47ba000640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:41.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.637+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f47b008a090 con 0x7f47c00b2d40 2024-09-10T08:31:41.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.637+0000 7f47c5e00640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:41.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.638+0000 7f47c5e00640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 0x7f47a406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47c00b2aa0 tx=0x7f47b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:41.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.641+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47c013be20 con 0x7f47c00b2d40 2024-09-10T08:31:41.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.827+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47c006bc10 con 0x7f47a406be30 2024-09-10T08:31:41.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.834+0000 7f47ba000640 1 -- 172.21.15.52:0/2565956580 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f47c006bc10 con 0x7f47a406be30 2024-09-10T08:31:41.837 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:41.839 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:31:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 msgr2=0x7f47a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 0x7f47a406e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47c00b2aa0 tx=0x7f47b4009040 comp rx=0 tx=0).stop 2024-09-10T08:31:41.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 msgr2=0x7f47c015f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c4a0 tx=0x7f47b000c960 comp rx=0 tx=0).stop 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 shutdown_connections 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f47a406be30 0x7f47a406e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c013eb20 0x7f47c015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c00b2d40 0x7f47c015f470 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 --2- 172.21.15.52:0/2565956580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47c006c320 0x7f47c013c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 >> 172.21.15.52:0/2565956580 conn(0x7f47c00ccec0 msgr2=0x7f47c0140540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.838+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 shutdown_connections 2024-09-10T08:31:41.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:41.839+0000 7f47c8800640 1 -- 172.21.15.52:0/2565956580 wait complete. 2024-09-10T08:31:41.854 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-10T08:31:41.495279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300928,"kb_used_data":5636,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754673792,"statfs":{"total":773094113280,"available":772785963008,"internally_reserved":0,"allocated":5771264,"data_stored":3031816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":302173744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001575"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.252889+0000","last_change":"2024-09-10T08:31:37.249551+0000","last_active":"2024-09-10T08:31:37.252889+0000","last_peered":"2024-09-10T08:31:37.252889+0000","last_clean":"2024-09-10T08:31:37.252889+0000","last_became_active":"2024-09-10T08:31:37.249245+0000","last_became_peered":"2024-09-10T08:31:37.249245+0000","last_unstale":"2024-09-10T08:31:37.252889+0000","last_undegraded":"2024-09-10T08:31:37.252889+0000","last_fullsized":"2024-09-10T08:31:37.252889+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:27.693877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228589+0000","last_change":"2024-09-10T08:31:37.239651+0000","last_active":"2024-09-10T08:31:38.228589+0000","last_peered":"2024-09-10T08:31:38.228589+0000","last_clean":"2024-09-10T08:31:38.228589+0000","last_became_active":"2024-09-10T08:31:37.239360+0000","last_became_peered":"2024-09-10T08:31:37.239360+0000","last_unstale":"2024-09-10T08:31:38.228589+0000","last_undegraded":"2024-09-10T08:31:38.228589+0000","last_fullsized":"2024-09-10T08:31:38.228589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:46.712474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230215+0000","last_change":"2024-09-10T08:31:37.239341+0000","last_active":"2024-09-10T08:31:38.230215+0000","last_peered":"2024-09-10T08:31:38.230215+0000","last_clean":"2024-09-10T08:31:38.230215+0000","last_became_active":"2024-09-10T08:31:37.239021+0000","last_became_peered":"2024-09-10T08:31:37.239021+0000","last_unstale":"2024-09-10T08:31:38.230215+0000","last_undegraded":"2024-09-10T08:31:38.230215+0000","last_fullsized":"2024-09-10T08:31:38.230215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:03.481442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233009+0000","last_change":"2024-09-10T08:31:37.239576+0000","last_active":"2024-09-10T08:31:38.233009+0000","last_peered":"2024-09-10T08:31:38.233009+0000","last_clean":"2024-09-10T08:31:38.233009+0000","last_became_active":"2024-09-10T08:31:37.239219+0000","last_became_peered":"2024-09-10T08:31:37.239219+0000","last_unstale":"2024-09-10T08:31:38.233009+0000","last_undegraded":"2024-09-10T08:31:38.233009+0000","last_fullsized":"2024-09-10T08:31:38.233009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:06.246797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.233564+0000","last_change":"2024-09-10T08:31:37.231028+0000","last_active":"2024-09-10T08:31:37.233564+0000","last_peered":"2024-09-10T08:31:37.233564+0000","last_clean":"2024-09-10T08:31:37.233564+0000","last_became_active":"2024-09-10T08:31:37.230531+0000","last_became_peered":"2024-09-10T08:31:37.230531+0000","last_unstale":"2024-09-10T08:31:37.233564+0000","last_undegraded":"2024-09-10T08:31:37.233564+0000","last_fullsized":"2024-09-10T08:31:37.233564+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:22:58.248714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.250827+0000","last_change":"2024-09-10T08:31:37.246877+0000","last_active":"2024-09-10T08:31:37.250827+0000","last_peered":"2024-09-10T08:31:37.250827+0000","last_clean":"2024-09-10T08:31:37.250827+0000","last_became_active":"2024-09-10T08:31:37.246605+0000","last_became_peered":"2024-09-10T08:31:37.246605+0000","last_unstale":"2024-09-10T08:31:37.250827+0000","last_undegraded":"2024-09-10T08:31:37.250827+0000","last_fullsized":"2024-09-10T08:31:37.250827+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:13.796522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235317+0000","last_change":"2024-09-10T08:31:37.245996+0000","last_active":"2024-09-10T08:31:38.235317+0000","last_peered":"2024-09-10T08:31:38.235317+0000","last_clean":"2024-09-10T08:31:38.235317+0000","last_became_active":"2024-09-10T08:31:37.245221+0000","last_became_peered":"2024-09-10T08:31:37.245221+0000","last_unstale":"2024-09-10T08:31:38.235317+0000","last_undegraded":"2024-09-10T08:31:38.235317+0000","last_fullsized":"2024-09-10T08:31:38.235317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:17.721403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232409+0000","last_change":"2024-09-10T08:31:37.243086+0000","last_active":"2024-09-10T08:31:38.232409+0000","last_peered":"2024-09-10T08:31:38.232409+0000","last_clean":"2024-09-10T08:31:38.232409+0000","last_became_active":"2024-09-10T08:31:37.242734+0000","last_became_peered":"2024-09-10T08:31:37.242734+0000","last_unstale":"2024-09-10T08:31:38.232409+0000","last_undegraded":"2024-09-10T08:31:38.232409+0000","last_fullsized":"2024-09-10T08:31:38.232409+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:17.148112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.247424+0000","last_change":"2024-09-10T08:31:37.241133+0000","last_active":"2024-09-10T08:31:37.247424+0000","last_peered":"2024-09-10T08:31:37.247424+0000","last_clean":"2024-09-10T08:31:37.247424+0000","last_became_active":"2024-09-10T08:31:37.240695+0000","last_became_peered":"2024-09-10T08:31:37.240695+0000","last_unstale":"2024-09-10T08:31:37.247424+0000","last_undegraded":"2024-09-10T08:31:37.247424+0000","last_fullsized":"2024-09-10T08:31:37.247424+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:55.244642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230607+0000","last_change":"2024-09-10T08:31:37.231345+0000","last_active":"2024-09-10T08:31:38.230607+0000","last_peered":"2024-09-10T08:31:38.230607+0000","last_clean":"2024-09-10T08:31:38.230607+0000","last_became_active":"2024-09-10T08:31:37.231089+0000","last_became_peered":"2024-09-10T08:31:37.231089+0000","last_unstale":"2024-09-10T08:31:38.230607+0000","last_undegraded":"2024-09-10T08:31:38.230607+0000","last_fullsized":"2024-09-10T08:31:38.230607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:15.649614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233101+0000","last_change":"2024-09-10T08:31:37.243898+0000","last_active":"2024-09-10T08:31:38.233101+0000","last_peered":"2024-09-10T08:31:38.233101+0000","last_clean":"2024-09-10T08:31:38.233101+0000","last_became_active":"2024-09-10T08:31:37.242628+0000","last_became_peered":"2024-09-10T08:31:37.242628+0000","last_unstale":"2024-09-10T08:31:38.233101+0000","last_undegraded":"2024-09-10T08:31:38.233101+0000","last_fullsized":"2024-09-10T08:31:38.233101+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:33.083323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228510+0000","last_change":"2024-09-10T08:31:37.243087+0000","last_active":"2024-09-10T08:31:38.228510+0000","last_peered":"2024-09-10T08:31:38.228510+0000","last_clean":"2024-09-10T08:31:38.228510+0000","last_became_active":"2024-09-10T08:31:37.242819+0000","last_became_peered":"2024-09-10T08:31:37.242819+0000","last_unstale":"2024-09-10T08:31:38.228510+0000","last_undegraded":"2024-09-10T08:31:38.228510+0000","last_fullsized":"2024-09-10T08:31:38.228510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:52.600806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.250825+0000","last_change":"2024-09-10T08:31:37.248450+0000","last_active":"2024-09-10T08:31:37.250825+0000","last_peered":"2024-09-10T08:31:37.250825+0000","last_clean":"2024-09-10T08:31:37.250825+0000","last_became_active":"2024-09-10T08:31:37.248177+0000","last_became_peered":"2024-09-10T08:31:37.248177+0000","last_unstale":"2024-09-10T08:31:37.250825+0000","last_undegraded":"2024-09-10T08:31:37.250825+0000","last_fullsized":"2024-09-10T08:31:37.250825+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:23.165736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232946+0000","last_change":"2024-09-10T08:31:37.236412+0000","last_active":"2024-09-10T08:31:38.232946+0000","last_peered":"2024-09-10T08:31:38.232946+0000","last_clean":"2024-09-10T08:31:38.232946+0000","last_became_active":"2024-09-10T08:31:37.236153+0000","last_became_peered":"2024-09-10T08:31:37.236153+0000","last_unstale":"2024-09-10T08:31:38.232946+0000","last_undegraded":"2024-09-10T08:31:38.232946+0000","last_fullsized":"2024-09-10T08:31:38.232946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:25.486701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232456+0000","last_change":"2024-09-10T08:31:37.235201+0000","last_active":"2024-09-10T08:31:38.232456+0000","last_peered":"2024-09-10T08:31:38.232456+0000","last_clean":"2024-09-10T08:31:38.232456+0000","last_became_active":"2024-09-10T08:31:37.234940+0000","last_became_peered":"2024-09-10T08:31:37.234940+0000","last_unstale":"2024-09-10T08:31:38.232456+0000","last_undegraded":"2024-09-10T08:31:38.232456+0000","last_fullsized":"2024-09-10T08:31:38.232456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:22.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.248418+0000","last_change":"2024-09-10T08:31:37.243055+0000","last_active":"2024-09-10T08:31:37.248418+0000","last_peered":"2024-09-10T08:31:37.248418+0000","last_clean":"2024-09-10T08:31:37.248418+0000","last_became_active":"2024-09-10T08:31:37.242764+0000","last_became_peered":"2024-09-10T08:31:37.242764+0000","last_unstale":"2024-09-10T08:31:37.248418+0000","last_undegraded":"2024-09-10T08:31:37.248418+0000","last_fullsized":"2024-09-10T08:31:37.248418+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:24.764340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228749+0000","last_change":"2024-09-10T08:31:37.237370+0000","last_active":"2024-09-10T08:31:38.228749+0000","last_peered":"2024-09-10T08:31:38.228749+0000","last_clean":"2024-09-10T08:31:38.228749+0000","last_became_active":"2024-09-10T08:31:37.236253+0000","last_became_peered":"2024-09-10T08:31:37.236253+0000","last_unstale":"2024-09-10T08:31:38.228749+0000","last_undegraded":"2024-09-10T08:31:38.228749+0000","last_fullsized":"2024-09-10T08:31:38.228749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:15.960818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230192+0000","last_change":"2024-09-10T08:31:37.247679+0000","last_active":"2024-09-10T08:31:38.230192+0000","last_peered":"2024-09-10T08:31:38.230192+0000","last_clean":"2024-09-10T08:31:38.230192+0000","last_became_active":"2024-09-10T08:31:37.247362+0000","last_became_peered":"2024-09-10T08:31:37.247362+0000","last_unstale":"2024-09-10T08:31:38.230192+0000","last_undegraded":"2024-09-10T08:31:38.230192+0000","last_fullsized":"2024-09-10T08:31:38.230192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:53.934276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.246675+0000","last_change":"2024-09-10T08:31:37.242127+0000","last_active":"2024-09-10T08:31:37.246675+0000","last_peered":"2024-09-10T08:31:37.246675+0000","last_clean":"2024-09-10T08:31:37.246675+0000","last_became_active":"2024-09-10T08:31:37.241851+0000","last_became_peered":"2024-09-10T08:31:37.241851+0000","last_unstale":"2024-09-10T08:31:37.246675+0000","last_undegraded":"2024-09-10T08:31:37.246675+0000","last_fullsized":"2024-09-10T08:31:37.246675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:09.194084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230915+0000","last_change":"2024-09-10T08:31:37.241827+0000","last_active":"2024-09-10T08:31:38.230915+0000","last_peered":"2024-09-10T08:31:38.230915+0000","last_clean":"2024-09-10T08:31:38.230915+0000","last_became_active":"2024-09-10T08:31:37.241027+0000","last_became_peered":"2024-09-10T08:31:37.241027+0000","last_unstale":"2024-09-10T08:31:38.230915+0000","last_undegraded":"2024-09-10T08:31:38.230915+0000","last_fullsized":"2024-09-10T08:31:38.230915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:08.516023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233254+0000","last_change":"2024-09-10T08:31:37.239433+0000","last_active":"2024-09-10T08:31:38.233254+0000","last_peered":"2024-09-10T08:31:38.233254+0000","last_clean":"2024-09-10T08:31:38.233254+0000","last_became_active":"2024-09-10T08:31:37.238169+0000","last_became_peered":"2024-09-10T08:31:37.238169+0000","last_unstale":"2024-09-10T08:31:38.233254+0000","last_undegraded":"2024-09-10T08:31:38.233254+0000","last_fullsized":"2024-09-10T08:31:38.233254+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:38.882627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.238004+0000","last_change":"2024-09-10T08:31:37.230490+0000","last_active":"2024-09-10T08:31:37.238004+0000","last_peered":"2024-09-10T08:31:37.238004+0000","last_clean":"2024-09-10T08:31:37.238004+0000","last_became_active":"2024-09-10T08:31:37.230214+0000","last_became_peered":"2024-09-10T08:31:37.230214+0000","last_unstale":"2024-09-10T08:31:37.238004+0000","last_undegraded":"2024-09-10T08:31:37.238004+0000","last_fullsized":"2024-09-10T08:31:37.238004+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:25.999529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235433+0000","last_change":"2024-09-10T08:31:37.234906+0000","last_active":"2024-09-10T08:31:38.235433+0000","last_peered":"2024-09-10T08:31:38.235433+0000","last_clean":"2024-09-10T08:31:38.235433+0000","last_became_active":"2024-09-10T08:31:37.234586+0000","last_became_peered":"2024-09-10T08:31:37.234586+0000","last_unstale":"2024-09-10T08:31:38.235433+0000","last_undegraded":"2024-09-10T08:31:38.235433+0000","last_fullsized":"2024-09-10T08:31:38.235433+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:59.614127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228157+0000","last_change":"2024-09-10T08:31:37.246018+0000","last_active":"2024-09-10T08:31:38.228157+0000","last_peered":"2024-09-10T08:31:38.228157+0000","last_clean":"2024-09-10T08:31:38.228157+0000","last_became_active":"2024-09-10T08:31:37.245738+0000","last_became_peered":"2024-09-10T08:31:37.245738+0000","last_unstale":"2024-09-10T08:31:38.228157+0000","last_undegraded":"2024-09-10T08:31:38.228157+0000","last_fullsized":"2024-09-10T08:31:38.228157+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:56.917169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.252910+0000","last_change":"2024-09-10T08:31:37.249538+0000","last_active":"2024-09-10T08:31:37.252910+0000","last_peered":"2024-09-10T08:31:37.252910+0000","last_clean":"2024-09-10T08:31:37.252910+0000","last_became_active":"2024-09-10T08:31:37.248915+0000","last_became_peered":"2024-09-10T08:31:37.248915+0000","last_unstale":"2024-09-10T08:31:37.252910+0000","last_undegraded":"2024-09-10T08:31:37.252910+0000","last_fullsized":"2024-09-10T08:31:37.252910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:06.393855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232904+0000","last_change":"2024-09-10T08:31:37.242790+0000","last_active":"2024-09-10T08:31:38.232904+0000","last_peered":"2024-09-10T08:31:38.232904+0000","last_clean":"2024-09-10T08:31:38.232904+0000","last_became_active":"2024-09-10T08:31:37.242467+0000","last_became_peered":"2024-09-10T08:31:37.242467+0000","last_unstale":"2024-09-10T08:31:38.232904+0000","last_undegraded":"2024-09-10T08:31:38.232904+0000","last_fullsized":"2024-09-10T08:31:38.232904+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:39.564237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235827+0000","last_change":"2024-09-10T08:31:37.231219+0000","last_active":"2024-09-10T08:31:38.235827+0000","last_peered":"2024-09-10T08:31:38.235827+0000","last_clean":"2024-09-10T08:31:38.235827+0000","last_became_active":"2024-09-10T08:31:37.230938+0000","last_became_peered":"2024-09-10T08:31:37.230938+0000","last_unstale":"2024-09-10T08:31:38.235827+0000","last_undegraded":"2024-09-10T08:31:38.235827+0000","last_fullsized":"2024-09-10T08:31:38.235827+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:21.559243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235717+0000","last_change":"2024-09-10T08:31:37.229937+0000","last_active":"2024-09-10T08:31:38.235717+0000","last_peered":"2024-09-10T08:31:38.235717+0000","last_clean":"2024-09-10T08:31:38.235717+0000","last_became_active":"2024-09-10T08:31:37.229581+0000","last_became_peered":"2024-09-10T08:31:37.229581+0000","last_unstale":"2024-09-10T08:31:38.235717+0000","last_undegraded":"2024-09-10T08:31:38.235717+0000","last_fullsized":"2024-09-10T08:31:38.235717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:17:50.359094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.235767+0000","last_change":"2024-09-10T08:31:37.234725+0000","last_active":"2024-09-10T08:31:37.235767+0000","last_peered":"2024-09-10T08:31:37.235767+0000","last_clean":"2024-09-10T08:31:37.235767+0000","last_became_active":"2024-09-10T08:31:37.234539+0000","last_became_peered":"2024-09-10T08:31:37.234539+0000","last_unstale":"2024-09-10T08:31:37.235767+0000","last_undegraded":"2024-09-10T08:31:37.235767+0000","last_fullsized":"2024-09-10T08:31:37.235767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:08.565398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228262+0000","last_change":"2024-09-10T08:31:37.234561+0000","last_active":"2024-09-10T08:31:38.228262+0000","last_peered":"2024-09-10T08:31:38.228262+0000","last_clean":"2024-09-10T08:31:38.228262+0000","last_became_active":"2024-09-10T08:31:37.234271+0000","last_became_peered":"2024-09-10T08:31:37.234271+0000","last_unstale":"2024-09-10T08:31:38.228262+0000","last_undegraded":"2024-09-10T08:31:38.228262+0000","last_fullsized":"2024-09-10T08:31:38.228262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:00.118098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.247950+0000","last_change":"2024-09-10T08:31:37.243107+0000","last_active":"2024-09-10T08:31:37.247950+0000","last_peered":"2024-09-10T08:31:37.247950+0000","last_clean":"2024-09-10T08:31:37.247950+0000","last_became_active":"2024-09-10T08:31:37.242816+0000","last_became_peered":"2024-09-10T08:31:37.242816+0000","last_unstale":"2024-09-10T08:31:37.247950+0000","last_undegraded":"2024-09-10T08:31:37.247950+0000","last_fullsized":"2024-09-10T08:31:37.247950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:31.553260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232399+0000","last_change":"2024-09-10T08:31:37.241998+0000","last_active":"2024-09-10T08:31:38.232399+0000","last_peered":"2024-09-10T08:31:38.232399+0000","last_clean":"2024-09-10T08:31:38.232399+0000","last_became_active":"2024-09-10T08:31:37.238994+0000","last_became_peered":"2024-09-10T08:31:37.238994+0000","last_unstale":"2024-09-10T08:31:38.232399+0000","last_undegraded":"2024-09-10T08:31:38.232399+0000","last_fullsized":"2024-09-10T08:31:38.232399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:47.018272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.238211+0000","last_change":"2024-09-10T08:31:37.231744+0000","last_active":"2024-09-10T08:31:37.238211+0000","last_peered":"2024-09-10T08:31:37.238211+0000","last_clean":"2024-09-10T08:31:37.238211+0000","last_became_active":"2024-09-10T08:31:37.231479+0000","last_became_peered":"2024-09-10T08:31:37.231479+0000","last_unstale":"2024-09-10T08:31:37.238211+0000","last_undegraded":"2024-09-10T08:31:37.238211+0000","last_fullsized":"2024-09-10T08:31:37.238211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:36.997969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.250515+0000","last_change":"2024-09-10T08:31:36.235665+0000","last_active":"2024-09-10T08:31:37.250515+0000","last_peered":"2024-09-10T08:31:37.250515+0000","last_clean":"2024-09-10T08:31:37.250515+0000","last_became_active":"2024-09-10T08:31:36.235369+0000","last_became_peered":"2024-09-10T08:31:36.235369+0000","last_unstale":"2024-09-10T08:31:37.250515+0000","last_undegraded":"2024-09-10T08:31:37.250515+0000","last_fullsized":"2024-09-10T08:31:37.250515+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:13:56.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.246808+0000","last_change":"2024-09-10T08:31:37.245076+0000","last_active":"2024-09-10T08:31:37.246808+0000","last_peered":"2024-09-10T08:31:37.246808+0000","last_clean":"2024-09-10T08:31:37.246808+0000","last_became_active":"2024-09-10T08:31:37.244770+0000","last_became_peered":"2024-09-10T08:31:37.244770+0000","last_unstale":"2024-09-10T08:31:37.246808+0000","last_undegraded":"2024-09-10T08:31:37.246808+0000","last_fullsized":"2024-09-10T08:31:37.246808+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:02:50.122347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235722+0000","last_change":"2024-09-10T08:31:36.228481+0000","last_active":"2024-09-10T08:31:38.235722+0000","last_peered":"2024-09-10T08:31:38.235722+0000","last_clean":"2024-09-10T08:31:38.235722+0000","last_became_active":"2024-09-10T08:31:36.228233+0000","last_became_peered":"2024-09-10T08:31:36.228233+0000","last_unstale":"2024-09-10T08:31:38.235722+0000","last_undegraded":"2024-09-10T08:31:38.235722+0000","last_fullsized":"2024-09-10T08:31:38.235722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:18.188771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228643+0000","last_change":"2024-09-10T08:31:37.250887+0000","last_active":"2024-09-10T08:31:38.228643+0000","last_peered":"2024-09-10T08:31:38.228643+0000","last_clean":"2024-09-10T08:31:38.228643+0000","last_became_active":"2024-09-10T08:31:37.250556+0000","last_became_peered":"2024-09-10T08:31:37.250556+0000","last_unstale":"2024-09-10T08:31:38.228643+0000","last_undegraded":"2024-09-10T08:31:38.228643+0000","last_fullsized":"2024-09-10T08:31:38.228643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:24:45.408137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.250716+0000","last_change":"2024-09-10T08:31:36.234090+0000","last_active":"2024-09-10T08:31:37.250716+0000","last_peered":"2024-09-10T08:31:37.250716+0000","last_clean":"2024-09-10T08:31:37.250716+0000","last_became_active":"2024-09-10T08:31:36.233822+0000","last_became_peered":"2024-09-10T08:31:36.233822+0000","last_unstale":"2024-09-10T08:31:37.250716+0000","last_undegraded":"2024-09-10T08:31:37.250716+0000","last_fullsized":"2024-09-10T08:31:37.250716+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:12.618670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233257+0000","last_change":"2024-09-10T08:31:37.237232+0000","last_active":"2024-09-10T08:31:38.233257+0000","last_peered":"2024-09-10T08:31:38.233257+0000","last_clean":"2024-09-10T08:31:38.233257+0000","last_became_active":"2024-09-10T08:31:37.236955+0000","last_became_peered":"2024-09-10T08:31:37.236955+0000","last_unstale":"2024-09-10T08:31:38.233257+0000","last_undegraded":"2024-09-10T08:31:38.233257+0000","last_fullsized":"2024-09-10T08:31:38.233257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:00.788023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235674+0000","last_change":"2024-09-10T08:31:36.228288+0000","last_active":"2024-09-10T08:31:38.235674+0000","last_peered":"2024-09-10T08:31:38.235674+0000","last_clean":"2024-09-10T08:31:38.235674+0000","last_became_active":"2024-09-10T08:31:36.228030+0000","last_became_peered":"2024-09-10T08:31:36.228030+0000","last_unstale":"2024-09-10T08:31:38.235674+0000","last_undegraded":"2024-09-10T08:31:38.235674+0000","last_fullsized":"2024-09-10T08:31:38.235674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:50.455184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235412+0000","last_change":"2024-09-10T08:31:37.231007+0000","last_active":"2024-09-10T08:31:38.235412+0000","last_peered":"2024-09-10T08:31:38.235412+0000","last_clean":"2024-09-10T08:31:38.235412+0000","last_became_active":"2024-09-10T08:31:37.230465+0000","last_became_peered":"2024-09-10T08:31:37.230465+0000","last_unstale":"2024-09-10T08:31:38.235412+0000","last_undegraded":"2024-09-10T08:31:38.235412+0000","last_fullsized":"2024-09-10T08:31:38.235412+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:54.419662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.251013+0000","last_change":"2024-09-10T08:31:36.232628+0000","last_active":"2024-09-10T08:31:37.251013+0000","last_peered":"2024-09-10T08:31:37.251013+0000","last_clean":"2024-09-10T08:31:37.251013+0000","last_became_active":"2024-09-10T08:31:36.232318+0000","last_became_peered":"2024-09-10T08:31:36.232318+0000","last_unstale":"2024-09-10T08:31:37.251013+0000","last_undegraded":"2024-09-10T08:31:37.251013+0000","last_fullsized":"2024-09-10T08:31:37.251013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:31.258620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230039+0000","last_change":"2024-09-10T08:31:37.245043+0000","last_active":"2024-09-10T08:31:38.230039+0000","last_peered":"2024-09-10T08:31:38.230039+0000","last_clean":"2024-09-10T08:31:38.230039+0000","last_became_active":"2024-09-10T08:31:37.244741+0000","last_became_peered":"2024-09-10T08:31:37.244741+0000","last_unstale":"2024-09-10T08:31:38.230039+0000","last_undegraded":"2024-09-10T08:31:38.230039+0000","last_fullsized":"2024-09-10T08:31:38.230039+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:56.609197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235541+0000","last_change":"2024-09-10T08:31:36.226807+0000","last_active":"2024-09-10T08:31:38.235541+0000","last_peered":"2024-09-10T08:31:38.235541+0000","last_clean":"2024-09-10T08:31:38.235541+0000","last_became_active":"2024-09-10T08:31:36.226527+0000","last_became_peered":"2024-09-10T08:31:36.226527+0000","last_unstale":"2024-09-10T08:31:38.235541+0000","last_undegraded":"2024-09-10T08:31:38.235541+0000","last_fullsized":"2024-09-10T08:31:38.235541+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:55.606207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229705+0000","last_change":"2024-09-10T08:31:37.232865+0000","last_active":"2024-09-10T08:31:38.229705+0000","last_peered":"2024-09-10T08:31:38.229705+0000","last_clean":"2024-09-10T08:31:38.229705+0000","last_became_active":"2024-09-10T08:31:37.232412+0000","last_became_peered":"2024-09-10T08:31:37.232412+0000","last_unstale":"2024-09-10T08:31:38.229705+0000","last_undegraded":"2024-09-10T08:31:38.229705+0000","last_fullsized":"2024-09-10T08:31:38.229705+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:51.458174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.215405+0000","last_change":"2024-09-10T08:31:36.228664+0000","last_active":"2024-09-10T08:31:37.215405+0000","last_peered":"2024-09-10T08:31:37.215405+0000","last_clean":"2024-09-10T08:31:37.215405+0000","last_became_active":"2024-09-10T08:31:36.228408+0000","last_became_peered":"2024-09-10T08:31:36.228408+0000","last_unstale":"2024-09-10T08:31:37.215405+0000","last_undegraded":"2024-09-10T08:31:37.215405+0000","last_fullsized":"2024-09-10T08:31:37.215405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:33.990465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235411+0000","last_change":"2024-09-10T08:31:37.244208+0000","last_active":"2024-09-10T08:31:38.235411+0000","last_peered":"2024-09-10T08:31:38.235411+0000","last_clean":"2024-09-10T08:31:38.235411+0000","last_became_active":"2024-09-10T08:31:37.243523+0000","last_became_peered":"2024-09-10T08:31:37.243523+0000","last_unstale":"2024-09-10T08:31:38.235411+0000","last_undegraded":"2024-09-10T08:31:38.235411+0000","last_fullsized":"2024-09-10T08:31:38.235411+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:49.310237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229788+0000","last_change":"2024-09-10T08:31:36.231255+0000","last_active":"2024-09-10T08:31:38.229788+0000","last_peered":"2024-09-10T08:31:38.229788+0000","last_clean":"2024-09-10T08:31:38.229788+0000","last_became_active":"2024-09-10T08:31:36.230879+0000","last_became_peered":"2024-09-10T08:31:36.230879+0000","last_unstale":"2024-09-10T08:31:38.229788+0000","last_undegraded":"2024-09-10T08:31:38.229788+0000","last_fullsized":"2024-09-10T08:31:38.229788+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:36.250092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230236+0000","last_change":"2024-09-10T08:31:37.236959+0000","last_active":"2024-09-10T08:31:38.230236+0000","last_peered":"2024-09-10T08:31:38.230236+0000","last_clean":"2024-09-10T08:31:38.230236+0000","last_became_active":"2024-09-10T08:31:37.236701+0000","last_became_peered":"2024-09-10T08:31:37.236701+0000","last_unstale":"2024-09-10T08:31:38.230236+0000","last_undegraded":"2024-09-10T08:31:38.230236+0000","last_fullsized":"2024-09-10T08:31:38.230236+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:32.261610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230276+0000","last_change":"2024-09-10T08:31:36.225899+0000","last_active":"2024-09-10T08:31:38.230276+0000","last_peered":"2024-09-10T08:31:38.230276+0000","last_clean":"2024-09-10T08:31:38.230276+0000","last_became_active":"2024-09-10T08:31:36.225609+0000","last_became_peered":"2024-09-10T08:31:36.225609+0000","last_unstale":"2024-09-10T08:31:38.230276+0000","last_undegraded":"2024-09-10T08:31:38.230276+0000","last_fullsized":"2024-09-10T08:31:38.230276+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:25.604328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230223+0000","last_change":"2024-09-10T08:31:37.233294+0000","last_active":"2024-09-10T08:31:38.230223+0000","last_peered":"2024-09-10T08:31:38.230223+0000","last_clean":"2024-09-10T08:31:38.230223+0000","last_became_active":"2024-09-10T08:31:37.232954+0000","last_became_peered":"2024-09-10T08:31:37.232954+0000","last_unstale":"2024-09-10T08:31:38.230223+0000","last_undegraded":"2024-09-10T08:31:38.230223+0000","last_fullsized":"2024-09-10T08:31:38.230223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:53.971530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230788+0000","last_change":"2024-09-10T08:31:36.233054+0000","last_active":"2024-09-10T08:31:38.230788+0000","last_peered":"2024-09-10T08:31:38.230788+0000","last_clean":"2024-09-10T08:31:38.230788+0000","last_became_active":"2024-09-10T08:31:36.232557+0000","last_became_peered":"2024-09-10T08:31:36.232557+0000","last_unstale":"2024-09-10T08:31:38.230788+0000","last_undegraded":"2024-09-10T08:31:38.230788+0000","last_fullsized":"2024-09-10T08:31:38.230788+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:45.709484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232726+0000","last_change":"2024-09-10T08:31:37.237507+0000","last_active":"2024-09-10T08:31:38.232726+0000","last_peered":"2024-09-10T08:31:38.232726+0000","last_clean":"2024-09-10T08:31:38.232726+0000","last_became_active":"2024-09-10T08:31:37.237121+0000","last_became_peered":"2024-09-10T08:31:37.237121+0000","last_unstale":"2024-09-10T08:31:38.232726+0000","last_undegraded":"2024-09-10T08:31:38.232726+0000","last_fullsized":"2024-09-10T08:31:38.232726+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:51.323353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228348+0000","last_change":"2024-09-10T08:31:36.222572+0000","last_active":"2024-09-10T08:31:38.228348+0000","last_peered":"2024-09-10T08:31:38.228348+0000","last_clean":"2024-09-10T08:31:38.228348+0000","last_became_active":"2024-09-10T08:31:36.222276+0000","last_became_peered":"2024-09-10T08:31:36.222276+0000","last_unstale":"2024-09-10T08:31:38.228348+0000","last_undegraded":"2024-09-10T08:31:38.228348+0000","last_fullsized":"2024-09-10T08:31:38.228348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:07.562408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235852+0000","last_change":"2024-09-10T08:31:37.245543+0000","last_active":"2024-09-10T08:31:38.235852+0000","last_peered":"2024-09-10T08:31:38.235852+0000","last_clean":"2024-09-10T08:31:38.235852+0000","last_became_active":"2024-09-10T08:31:37.245184+0000","last_became_peered":"2024-09-10T08:31:37.245184+0000","last_unstale":"2024-09-10T08:31:38.235852+0000","last_undegraded":"2024-09-10T08:31:38.235852+0000","last_fullsized":"2024-09-10T08:31:38.235852+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:14.272967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230394+0000","last_change":"2024-09-10T08:31:36.233333+0000","last_active":"2024-09-10T08:31:38.230394+0000","last_peered":"2024-09-10T08:31:38.230394+0000","last_clean":"2024-09-10T08:31:38.230394+0000","last_became_active":"2024-09-10T08:31:36.233029+0000","last_became_peered":"2024-09-10T08:31:36.233029+0000","last_unstale":"2024-09-10T08:31:38.230394+0000","last_undegraded":"2024-09-10T08:31:38.230394+0000","last_fullsized":"2024-09-10T08:31:38.230394+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:59.115108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229984+0000","last_change":"2024-09-10T08:31:37.247648+0000","last_active":"2024-09-10T08:31:38.229984+0000","last_peered":"2024-09-10T08:31:38.229984+0000","last_clean":"2024-09-10T08:31:38.229984+0000","last_became_active":"2024-09-10T08:31:37.247336+0000","last_became_peered":"2024-09-10T08:31:37.247336+0000","last_unstale":"2024-09-10T08:31:38.229984+0000","last_undegraded":"2024-09-10T08:31:38.229984+0000","last_fullsized":"2024-09-10T08:31:38.229984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:42.710632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.248691+0000","last_change":"2024-09-10T08:31:36.233932+0000","last_active":"2024-09-10T08:31:37.248691+0000","last_peered":"2024-09-10T08:31:37.248691+0000","last_clean":"2024-09-10T08:31:37.248691+0000","last_became_active":"2024-09-10T08:31:36.233642+0000","last_became_peered":"2024-09-10T08:31:36.233642+0000","last_unstale":"2024-09-10T08:31:37.248691+0000","last_undegraded":"2024-09-10T08:31:37.248691+0000","last_fullsized":"2024-09-10T08:31:37.248691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:14.021454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.236749+0000","last_change":"2024-09-10T08:31:37.229149+0000","last_active":"2024-09-10T08:31:37.236749+0000","last_peered":"2024-09-10T08:31:37.236749+0000","last_clean":"2024-09-10T08:31:37.236749+0000","last_became_active":"2024-09-10T08:31:37.228877+0000","last_became_peered":"2024-09-10T08:31:37.228877+0000","last_unstale":"2024-09-10T08:31:37.236749+0000","last_undegraded":"2024-09-10T08:31:37.236749+0000","last_fullsized":"2024-09-10T08:31:37.236749+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:25.461246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.215585+0000","last_change":"2024-09-10T08:31:36.223797+0000","last_active":"2024-09-10T08:31:37.215585+0000","last_peered":"2024-09-10T08:31:37.215585+0000","last_clean":"2024-09-10T08:31:37.215585+0000","last_became_active":"2024-09-10T08:31:36.223139+0000","last_became_peered":"2024-09-10T08:31:36.223139+0000","last_unstale":"2024-09-10T08:31:37.215585+0000","last_undegraded":"2024-09-10T08:31:37.215585+0000","last_fullsized":"2024-09-10T08:31:37.215585+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:54.241652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.238142+0000","last_change":"2024-09-10T08:31:37.231736+0000","last_active":"2024-09-10T08:31:37.238142+0000","last_peered":"2024-09-10T08:31:37.238142+0000","last_clean":"2024-09-10T08:31:37.238142+0000","last_became_active":"2024-09-10T08:31:37.231435+0000","last_became_peered":"2024-09-10T08:31:37.231435+0000","last_unstale":"2024-09-10T08:31:37.238142+0000","last_undegraded":"2024-09-10T08:31:37.238142+0000","last_fullsized":"2024-09-10T08:31:37.238142+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:59.564257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.226642+0000","last_change":"2024-09-10T08:31:36.236286+0000","last_active":"2024-09-10T08:31:37.226642+0000","last_peered":"2024-09-10T08:31:37.226642+0000","last_clean":"2024-09-10T08:31:37.226642+0000","last_became_active":"2024-09-10T08:31:36.235115+0000","last_became_peered":"2024-09-10T08:31:36.235115+0000","last_unstale":"2024-09-10T08:31:37.226642+0000","last_undegraded":"2024-09-10T08:31:37.226642+0000","last_fullsized":"2024-09-10T08:31:37.226642+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:49.321085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228138+0000","last_change":"2024-09-10T08:31:37.236028+0000","last_active":"2024-09-10T08:31:38.228138+0000","last_peered":"2024-09-10T08:31:38.228138+0000","last_clean":"2024-09-10T08:31:38.228138+0000","last_became_active":"2024-09-10T08:31:37.235768+0000","last_became_peered":"2024-09-10T08:31:37.235768+0000","last_unstale":"2024-09-10T08:31:38.228138+0000","last_undegraded":"2024-09-10T08:31:38.228138+0000","last_fullsized":"2024-09-10T08:31:38.228138+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:37.253082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229820+0000","last_change":"2024-09-10T08:31:36.235968+0000","last_active":"2024-09-10T08:31:38.229820+0000","last_peered":"2024-09-10T08:31:38.229820+0000","last_clean":"2024-09-10T08:31:38.229820+0000","last_became_active":"2024-09-10T08:31:36.235680+0000","last_became_peered":"2024-09-10T08:31:36.235680+0000","last_unstale":"2024-09-10T08:31:38.229820+0000","last_undegraded":"2024-09-10T08:31:38.229820+0000","last_fullsized":"2024-09-10T08:31:38.229820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:02.340795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.238189+0000","last_change":"2024-09-10T08:31:37.230578+0000","last_active":"2024-09-10T08:31:37.238189+0000","last_peered":"2024-09-10T08:31:37.238189+0000","last_clean":"2024-09-10T08:31:37.238189+0000","last_became_active":"2024-09-10T08:31:37.230227+0000","last_became_peered":"2024-09-10T08:31:37.230227+0000","last_unstale":"2024-09-10T08:31:37.238189+0000","last_undegraded":"2024-09-10T08:31:37.238189+0000","last_fullsized":"2024-09-10T08:31:37.238189+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:21.494265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232767+0000","last_change":"2024-09-10T08:31:36.235724+0000","last_active":"2024-09-10T08:31:38.232767+0000","last_peered":"2024-09-10T08:31:38.232767+0000","last_clean":"2024-09-10T08:31:38.232767+0000","last_became_active":"2024-09-10T08:31:36.235166+0000","last_became_peered":"2024-09-10T08:31:36.235166+0000","last_unstale":"2024-09-10T08:31:38.232767+0000","last_undegraded":"2024-09-10T08:31:38.232767+0000","last_fullsized":"2024-09-10T08:31:38.232767+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:39.992570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.239158+0000","last_change":"2024-09-10T08:31:37.235291+0000","last_active":"2024-09-10T08:31:37.239158+0000","last_peered":"2024-09-10T08:31:37.239158+0000","last_clean":"2024-09-10T08:31:37.239158+0000","last_became_active":"2024-09-10T08:31:37.234908+0000","last_became_peered":"2024-09-10T08:31:37.234908+0000","last_unstale":"2024-09-10T08:31:37.239158+0000","last_undegraded":"2024-09-10T08:31:37.239158+0000","last_fullsized":"2024-09-10T08:31:37.239158+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:57:42.710632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230295+0000","last_change":"2024-09-10T08:31:36.232351+0000","last_active":"2024-09-10T08:31:38.230295+0000","last_peered":"2024-09-10T08:31:38.230295+0000","last_clean":"2024-09-10T08:31:38.230295+0000","last_became_active":"2024-09-10T08:31:36.232090+0000","last_became_peered":"2024-09-10T08:31:36.232090+0000","last_unstale":"2024-09-10T08:31:38.230295+0000","last_undegraded":"2024-09-10T08:31:38.230295+0000","last_fullsized":"2024-09-10T08:31:38.230295+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:45.989305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228805+0000","last_change":"2024-09-10T08:31:37.244780+0000","last_active":"2024-09-10T08:31:38.228805+0000","last_peered":"2024-09-10T08:31:38.228805+0000","last_clean":"2024-09-10T08:31:38.228805+0000","last_became_active":"2024-09-10T08:31:37.243816+0000","last_became_peered":"2024-09-10T08:31:37.243816+0000","last_unstale":"2024-09-10T08:31:38.228805+0000","last_undegraded":"2024-09-10T08:31:38.228805+0000","last_fullsized":"2024-09-10T08:31:38.228805+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:47.506218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230309+0000","last_change":"2024-09-10T08:31:36.236490+0000","last_active":"2024-09-10T08:31:38.230309+0000","last_peered":"2024-09-10T08:31:38.230309+0000","last_clean":"2024-09-10T08:31:38.230309+0000","last_became_active":"2024-09-10T08:31:36.236220+0000","last_became_peered":"2024-09-10T08:31:36.236220+0000","last_unstale":"2024-09-10T08:31:38.230309+0000","last_undegraded":"2024-09-10T08:31:38.230309+0000","last_fullsized":"2024-09-10T08:31:38.230309+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:16.830771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230208+0000","last_change":"2024-09-10T08:31:37.240144+0000","last_active":"2024-09-10T08:31:38.230208+0000","last_peered":"2024-09-10T08:31:38.230208+0000","last_clean":"2024-09-10T08:31:38.230208+0000","last_became_active":"2024-09-10T08:31:37.239826+0000","last_became_peered":"2024-09-10T08:31:37.239826+0000","last_unstale":"2024-09-10T08:31:38.230208+0000","last_undegraded":"2024-09-10T08:31:38.230208+0000","last_fullsized":"2024-09-10T08:31:38.230208+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:50.324075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.226979+0000","last_change":"2024-09-10T08:31:36.235077+0000","last_active":"2024-09-10T08:31:37.226979+0000","last_peered":"2024-09-10T08:31:37.226979+0000","last_clean":"2024-09-10T08:31:37.226979+0000","last_became_active":"2024-09-10T08:31:36.234196+0000","last_became_peered":"2024-09-10T08:31:36.234196+0000","last_unstale":"2024-09-10T08:31:37.226979+0000","last_undegraded":"2024-09-10T08:31:37.226979+0000","last_fullsized":"2024-09-10T08:31:37.226979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:52.968541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229858+0000","last_change":"2024-09-10T08:31:37.245339+0000","last_active":"2024-09-10T08:31:38.229858+0000","last_peered":"2024-09-10T08:31:38.229858+0000","last_clean":"2024-09-10T08:31:38.229858+0000","last_became_active":"2024-09-10T08:31:37.245006+0000","last_became_peered":"2024-09-10T08:31:37.245006+0000","last_unstale":"2024-09-10T08:31:38.229858+0000","last_undegraded":"2024-09-10T08:31:38.229858+0000","last_fullsized":"2024-09-10T08:31:38.229858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:57.683473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230197+0000","last_change":"2024-09-10T08:31:36.234798+0000","last_active":"2024-09-10T08:31:38.230197+0000","last_peered":"2024-09-10T08:31:38.230197+0000","last_clean":"2024-09-10T08:31:38.230197+0000","last_became_active":"2024-09-10T08:31:36.234514+0000","last_became_peered":"2024-09-10T08:31:36.234514+0000","last_unstale":"2024-09-10T08:31:38.230197+0000","last_undegraded":"2024-09-10T08:31:38.230197+0000","last_fullsized":"2024-09-10T08:31:38.230197+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:51.597816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.243659+0000","last_change":"2024-09-10T08:31:37.232828+0000","last_active":"2024-09-10T08:31:37.243659+0000","last_peered":"2024-09-10T08:31:37.243659+0000","last_clean":"2024-09-10T08:31:37.243659+0000","last_became_active":"2024-09-10T08:31:37.232431+0000","last_became_peered":"2024-09-10T08:31:37.232431+0000","last_unstale":"2024-09-10T08:31:37.243659+0000","last_undegraded":"2024-09-10T08:31:37.243659+0000","last_fullsized":"2024-09-10T08:31:37.243659+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:34.993455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.215737+0000","last_change":"2024-09-10T08:31:36.235221+0000","last_active":"2024-09-10T08:31:37.215737+0000","last_peered":"2024-09-10T08:31:37.215737+0000","last_clean":"2024-09-10T08:31:37.215737+0000","last_became_active":"2024-09-10T08:31:36.232277+0000","last_became_peered":"2024-09-10T08:31:36.232277+0000","last_unstale":"2024-09-10T08:31:37.215737+0000","last_undegraded":"2024-09-10T08:31:37.215737+0000","last_fullsized":"2024-09-10T08:31:37.215737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:30.550270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232598+0000","last_change":"2024-09-10T08:31:37.232468+0000","last_active":"2024-09-10T08:31:38.232598+0000","last_peered":"2024-09-10T08:31:38.232598+0000","last_clean":"2024-09-10T08:31:38.232598+0000","last_became_active":"2024-09-10T08:31:37.232168+0000","last_became_peered":"2024-09-10T08:31:37.232168+0000","last_unstale":"2024-09-10T08:31:38.232598+0000","last_undegraded":"2024-09-10T08:31:38.232598+0000","last_fullsized":"2024-09-10T08:31:38.232598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:58.569309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230144+0000","last_change":"2024-09-10T08:31:36.233263+0000","last_active":"2024-09-10T08:31:38.230144+0000","last_peered":"2024-09-10T08:31:38.230144+0000","last_clean":"2024-09-10T08:31:38.230144+0000","last_became_active":"2024-09-10T08:31:36.232509+0000","last_became_peered":"2024-09-10T08:31:36.232509+0000","last_unstale":"2024-09-10T08:31:38.230144+0000","last_undegraded":"2024-09-10T08:31:38.230144+0000","last_fullsized":"2024-09-10T08:31:38.230144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:55.914179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232360+0000","last_change":"2024-09-10T08:31:37.230995+0000","last_active":"2024-09-10T08:31:38.232360+0000","last_peered":"2024-09-10T08:31:38.232360+0000","last_clean":"2024-09-10T08:31:38.232360+0000","last_became_active":"2024-09-10T08:31:37.230551+0000","last_became_peered":"2024-09-10T08:31:37.230551+0000","last_unstale":"2024-09-10T08:31:38.232360+0000","last_undegraded":"2024-09-10T08:31:38.232360+0000","last_fullsized":"2024-09-10T08:31:38.232360+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:22.480198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235261+0000","last_change":"2024-09-10T08:31:36.231976+0000","last_active":"2024-09-10T08:31:38.235261+0000","last_peered":"2024-09-10T08:31:38.235261+0000","last_clean":"2024-09-10T08:31:38.235261+0000","last_became_active":"2024-09-10T08:31:36.231611+0000","last_became_peered":"2024-09-10T08:31:36.231611+0000","last_unstale":"2024-09-10T08:31:38.235261+0000","last_undegraded":"2024-09-10T08:31:38.235261+0000","last_fullsized":"2024-09-10T08:31:38.235261+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:25:56.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235832+0000","last_change":"2024-09-10T08:31:37.243844+0000","last_active":"2024-09-10T08:31:38.235832+0000","last_peered":"2024-09-10T08:31:38.235832+0000","last_clean":"2024-09-10T08:31:38.235832+0000","last_became_active":"2024-09-10T08:31:37.243463+0000","last_became_peered":"2024-09-10T08:31:37.243463+0000","last_unstale":"2024-09-10T08:31:38.235832+0000","last_undegraded":"2024-09-10T08:31:38.235832+0000","last_fullsized":"2024-09-10T08:31:38.235832+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:20.327072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.234703+0000","last_change":"2024-09-10T08:31:36.231242+0000","last_active":"2024-09-10T08:31:38.234703+0000","last_peered":"2024-09-10T08:31:38.234703+0000","last_clean":"2024-09-10T08:31:38.234703+0000","last_became_active":"2024-09-10T08:31:36.230932+0000","last_became_peered":"2024-09-10T08:31:36.230932+0000","last_unstale":"2024-09-10T08:31:38.234703+0000","last_undegraded":"2024-09-10T08:31:38.234703+0000","last_fullsized":"2024-09-10T08:31:38.234703+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:11.202867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230273+0000","last_change":"2024-09-10T08:31:37.233672+0000","last_active":"2024-09-10T08:31:38.230273+0000","last_peered":"2024-09-10T08:31:38.230273+0000","last_clean":"2024-09-10T08:31:38.230273+0000","last_became_active":"2024-09-10T08:31:37.233355+0000","last_became_peered":"2024-09-10T08:31:37.233355+0000","last_unstale":"2024-09-10T08:31:38.230273+0000","last_undegraded":"2024-09-10T08:31:38.230273+0000","last_fullsized":"2024-09-10T08:31:38.230273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:56.472703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.217335+0000","last_change":"2024-09-10T08:31:36.227414+0000","last_active":"2024-09-10T08:31:37.217335+0000","last_peered":"2024-09-10T08:31:37.217335+0000","last_clean":"2024-09-10T08:31:37.217335+0000","last_became_active":"2024-09-10T08:31:36.227154+0000","last_became_peered":"2024-09-10T08:31:36.227154+0000","last_unstale":"2024-09-10T08:31:37.217335+0000","last_undegraded":"2024-09-10T08:31:37.217335+0000","last_fullsized":"2024-09-10T08:31:37.217335+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:34:12.793532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235943+0000","last_change":"2024-09-10T08:31:37.239709+0000","last_active":"2024-09-10T08:31:38.235943+0000","last_peered":"2024-09-10T08:31:38.235943+0000","last_clean":"2024-09-10T08:31:38.235943+0000","last_became_active":"2024-09-10T08:31:37.239421+0000","last_became_peered":"2024-09-10T08:31:37.239421+0000","last_unstale":"2024-09-10T08:31:38.235943+0000","last_undegraded":"2024-09-10T08:31:38.235943+0000","last_fullsized":"2024-09-10T08:31:38.235943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:37.955803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.217030+0000","last_change":"2024-09-10T08:31:36.227714+0000","last_active":"2024-09-10T08:31:37.217030+0000","last_peered":"2024-09-10T08:31:37.217030+0000","last_clean":"2024-09-10T08:31:37.217030+0000","last_became_active":"2024-09-10T08:31:36.227266+0000","last_became_peered":"2024-09-10T08:31:36.227266+0000","last_unstale":"2024-09-10T08:31:37.217030+0000","last_undegraded":"2024-09-10T08:31:37.217030+0000","last_fullsized":"2024-09-10T08:31:37.217030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:58.066271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.230163+0000","last_change":"2024-09-10T08:31:37.246154+0000","last_active":"2024-09-10T08:31:38.230163+0000","last_peered":"2024-09-10T08:31:38.230163+0000","last_clean":"2024-09-10T08:31:38.230163+0000","last_became_active":"2024-09-10T08:31:37.244671+0000","last_became_peered":"2024-09-10T08:31:37.244671+0000","last_unstale":"2024-09-10T08:31:38.230163+0000","last_undegraded":"2024-09-10T08:31:38.230163+0000","last_fullsized":"2024-09-10T08:31:38.230163+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:13.167007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.216535+0000","last_change":"2024-09-10T08:31:36.231792+0000","last_active":"2024-09-10T08:31:37.216535+0000","last_peered":"2024-09-10T08:31:37.216535+0000","last_clean":"2024-09-10T08:31:37.216535+0000","last_became_active":"2024-09-10T08:31:36.228160+0000","last_became_peered":"2024-09-10T08:31:36.228160+0000","last_unstale":"2024-09-10T08:31:37.216535+0000","last_undegraded":"2024-09-10T08:31:37.216535+0000","last_fullsized":"2024-09-10T08:31:37.216535+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:22.162746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.232993+0000","last_change":"2024-09-10T08:31:37.235919+0000","last_active":"2024-09-10T08:31:38.232993+0000","last_peered":"2024-09-10T08:31:38.232993+0000","last_clean":"2024-09-10T08:31:38.232993+0000","last_became_active":"2024-09-10T08:31:37.235617+0000","last_became_peered":"2024-09-10T08:31:37.235617+0000","last_unstale":"2024-09-10T08:31:38.232993+0000","last_undegraded":"2024-09-10T08:31:38.232993+0000","last_fullsized":"2024-09-10T08:31:38.232993+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:13.783552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235546+0000","last_change":"2024-09-10T08:31:36.234470+0000","last_active":"2024-09-10T08:31:38.235546+0000","last_peered":"2024-09-10T08:31:38.235546+0000","last_clean":"2024-09-10T08:31:38.235546+0000","last_became_active":"2024-09-10T08:31:36.233442+0000","last_became_peered":"2024-09-10T08:31:36.233442+0000","last_unstale":"2024-09-10T08:31:38.235546+0000","last_undegraded":"2024-09-10T08:31:38.235546+0000","last_fullsized":"2024-09-10T08:31:38.235546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:12.164017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229784+0000","last_change":"2024-09-10T08:31:37.244788+0000","last_active":"2024-09-10T08:31:38.229784+0000","last_peered":"2024-09-10T08:31:38.229784+0000","last_clean":"2024-09-10T08:31:38.229784+0000","last_became_active":"2024-09-10T08:31:37.244515+0000","last_became_peered":"2024-09-10T08:31:37.244515+0000","last_unstale":"2024-09-10T08:31:38.229784+0000","last_undegraded":"2024-09-10T08:31:38.229784+0000","last_fullsized":"2024-09-10T08:31:38.229784+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:36.997969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.226937+0000","last_change":"2024-09-10T08:31:36.232831+0000","last_active":"2024-09-10T08:31:37.226937+0000","last_peered":"2024-09-10T08:31:37.226937+0000","last_clean":"2024-09-10T08:31:37.226937+0000","last_became_active":"2024-09-10T08:31:36.232375+0000","last_became_peered":"2024-09-10T08:31:36.232375+0000","last_unstale":"2024-09-10T08:31:37.226937+0000","last_undegraded":"2024-09-10T08:31:37.226937+0000","last_fullsized":"2024-09-10T08:31:37.226937+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:02.478452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.228147+0000","last_change":"2024-09-10T08:31:37.233735+0000","last_active":"2024-09-10T08:31:38.228147+0000","last_peered":"2024-09-10T08:31:38.228147+0000","last_clean":"2024-09-10T08:31:38.228147+0000","last_became_active":"2024-09-10T08:31:37.232494+0000","last_became_peered":"2024-09-10T08:31:37.232494+0000","last_unstale":"2024-09-10T08:31:38.228147+0000","last_undegraded":"2024-09-10T08:31:38.228147+0000","last_fullsized":"2024-09-10T08:31:38.228147+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:03.343785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T08:31:37.216324+0000","last_change":"2024-09-10T08:31:36.238260+0000","last_active":"2024-09-10T08:31:37.216324+0000","last_peered":"2024-09-10T08:31:37.216324+0000","last_clean":"2024-09-10T08:31:37.216324+0000","last_became_active":"2024-09-10T08:31:36.237333+0000","last_became_peered":"2024-09-10T08:31:36.237333+0000","last_unstale":"2024-09-10T08:31:37.216324+0000","last_undegraded":"2024-09-10T08:31:37.216324+0000","last_fullsized":"2024-09-10T08:31:37.216324+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:37.634602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.233121+0000","last_change":"2024-09-10T08:31:37.238244+0000","last_active":"2024-09-10T08:31:38.233121+0000","last_peered":"2024-09-10T08:31:38.233121+0000","last_clean":"2024-09-10T08:31:38.233121+0000","last_became_active":"2024-09-10T08:31:37.234812+0000","last_became_peered":"2024-09-10T08:31:37.234812+0000","last_unstale":"2024-09-10T08:31:38.233121+0000","last_undegraded":"2024-09-10T08:31:38.233121+0000","last_fullsized":"2024-09-10T08:31:38.233121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:36.204225+0000","last_clean_scrub_stamp":"2024-09-10T08:31:36.204225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:36.044585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.235870+0000","last_change":"2024-09-10T08:31:36.228624+0000","last_active":"2024-09-10T08:31:38.235870+0000","last_peered":"2024-09-10T08:31:38.235870+0000","last_clean":"2024-09-10T08:31:38.235870+0000","last_became_active":"2024-09-10T08:31:36.228314+0000","last_became_peered":"2024-09-10T08:31:36.228314+0000","last_unstale":"2024-09-10T08:31:38.235870+0000","last_undegraded":"2024-09-10T08:31:38.235870+0000","last_fullsized":"2024-09-10T08:31:38.235870+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:31:35.201235+0000","last_clean_scrub_stamp":"2024-09-10T08:31:35.201235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:55.469713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":219,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T08:31:38.229842+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:31:38.229842+0000","last_peered":"2024-09-10T08:31:38.229842+0000","last_clean":"2024-09-10T08:31:38.229842+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:31:38.229842+0000","last_undegraded":"2024-09-10T08:31:38.229842+0000","last_fullsized":"2024-09-10T08:31:38.229842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35904,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335936,"statfs":{"total":96636764160,"available":96599998464,"internally_reserved":0,"allocated":561152,"data_stored":226879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35904,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335936,"statfs":{"total":96636764160,"available":96599998464,"internally_reserved":0,"allocated":565248,"data_stored":227461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35924,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335916,"statfs":{"total":96636764160,"available":96599977984,"internally_reserved":0,"allocated":589824,"data_stored":234849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":581632,"data_stored":234757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40068,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331772,"statfs":{"total":96636764160,"available":96595734528,"internally_reserved":0,"allocated":573440,"data_stored":233235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":823583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35904,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335936,"statfs":{"total":96636764160,"available":96599998464,"internally_reserved":0,"allocated":565248,"data_stored":227517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1167360,"data_stored":823535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:31:41.860 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:31:41.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:31:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.057+0000 7f18efc00640 1 Processor -- start 2024-09-10T08:31:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.057+0000 7f18efc00640 1 -- start start 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18efc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18e80cfcb0 0x7f18e8144340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18efc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f18e8071650 0x7f18e8144880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18efc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e815f120 con 0x7f18e80cf8d0 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18efc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f18e8141cd0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18efc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f18e815f400 con 0x7f18e8071650 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18e7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18e80cfcb0 0x7f18e8144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18e7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18e80cfcb0 0x7f18e8144340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40412/0 (socket says 172.21.15.52:40412) 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18e7e00640 1 -- 172.21.15.52:0/1101481353 learned_addr learned my addr 172.21.15.52:0/1101481353 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18edc00640 1 --2- 172.21.15.52:0/1101481353 >> v2:172.21.15.176:3300/0 conn(0x7f18e8071650 0x7f18e8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18e7e00640 1 -- 172.21.15.52:0/1101481353 >> v2:172.21.15.176:3300/0 conn(0x7f18e8071650 msgr2=0x7f18e8144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.059+0000 7f18e7e00640 1 --2- 172.21.15.52:0/1101481353 >> v2:172.21.15.176:3300/0 conn(0x7f18e8071650 0x7f18e8144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.060+0000 7f18e7e00640 1 -- 172.21.15.52:0/1101481353 >> v1:172.21.15.176:6789/0 conn(0x7f18e80cf8d0 legacy=0x7f18e8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.060+0000 7f18e7e00640 1 -- 172.21.15.52:0/1101481353 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e815f6e0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18e7e00640 1 --2- 172.21.15.52:0/1101481353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e8144340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f18e8072a60 tx=0x7f18d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60679458df0fa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18e7400640 1 -- 172.21.15.52:0/1101481353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4037070 con 0x7f18e80cfcb0 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18e7400640 1 -- 172.21.15.52:0/1101481353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d4032440 con 0x7f18e80cfcb0 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18e7400640 1 -- 172.21.15.52:0/1101481353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4032810 con 0x7f18e80cfcb0 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18efc00640 1 -- 172.21.15.52:0/1101481353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 msgr2=0x7f18e8144340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.061+0000 7f18efc00640 1 --2- 172.21.15.52:0/1101481353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e8144340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f18e8072a60 tx=0x7f18d402a270 comp rx=0 tx=0).stop 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 -- 172.21.15.52:0/1101481353 shutdown_connections 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 --2- 172.21.15.52:0/1101481353 >> v2:172.21.15.176:3300/0 conn(0x7f18e8071650 0x7f18e8144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 --2- 172.21.15.52:0/1101481353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e8144340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 -- 172.21.15.52:0/1101481353 >> 172.21.15.52:0/1101481353 conn(0x7f18e806d0f0 msgr2=0x7f18e806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:42.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 -- 172.21.15.52:0/1101481353 shutdown_connections 2024-09-10T08:31:42.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.062+0000 7f18efc00640 1 -- 172.21.15.52:0/1101481353 wait complete. 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.063+0000 7f18efc00640 1 Processor -- start 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.063+0000 7f18efc00640 1 -- start start 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18e8071650 0x7f18e813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18e80cf8d0 0x7f18e81e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18e815ee30 con 0x7f18e80cfcb0 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8144dc0 con 0x7f18e80cf8d0 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.064+0000 7f18efc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18e80ce0f0 con 0x7f18e8071650 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40420/0 (socket says 172.21.15.52:40420) 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 -- 172.21.15.52:0/625575518 learned_addr learned my addr 172.21.15.52:0/625575518 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18e7e00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18e80cf8d0 0x7f18e81e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18ed200640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18e8071650 0x7f18e813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 -- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18e8071650 msgr2=0x7f18e813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18e8071650 0x7f18e813fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 -- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18e80cf8d0 msgr2=0x7f18e81e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18e80cf8d0 0x7f18e81e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 -- 172.21.15.52:0/625575518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81e80e0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.065+0000 7f18edc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f18e0007e40 tx=0x7f18e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.066+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0014620 con 0x7f18e80cfcb0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.066+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e0019070 con 0x7f18e80cfcb0 2024-09-10T08:31:42.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.066+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0014a20 con 0x7f18e80cfcb0 2024-09-10T08:31:42.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.066+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e81e83c0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.066+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e81e8980 con 0x7f18e80cfcb0 2024-09-10T08:31:42.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.067+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e80cd0c0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.068+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18e0014bc0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.068+0000 7f18e4c00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 0x7f18c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.069+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f18e008b560 con 0x7f18e80cfcb0 2024-09-10T08:31:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.069+0000 7f18ed200640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 0x7f18c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.070+0000 7f18ed200640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 0x7f18c806e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18e80b2ea0 tx=0x7f18dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.073+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18e00598b0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.324+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f18e8144190 con 0x7f18e80cfcb0 2024-09-10T08:31:42.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.326+0000 7f18e4c00640 1 -- 172.21.15.52:0/625575518 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f18e005dbb0 con 0x7f18e80cfcb0 2024-09-10T08:31:42.326 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:31:42.327 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:31:42.327 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:31:42.327 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:31:42.327 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:31:42.327 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:31:42.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 msgr2=0x7f18c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 0x7f18c806e320 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f18e80b2ea0 tx=0x7f18dc009040 comp rx=0 tx=0).stop 2024-09-10T08:31:42.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 msgr2=0x7f18e80cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f18e0007e40 tx=0x7f18e000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 shutdown_connections 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18c806be60 0x7f18c806e320 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18e80cfcb0 0x7f18e80cb8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18e80cf8d0 0x7f18e81e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 --2- 172.21.15.52:0/625575518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18e8071650 0x7f18e813fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 >> 172.21.15.52:0/625575518 conn(0x7f18e806d0f0 msgr2=0x7f18e80b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.328+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 shutdown_connections 2024-09-10T08:31:42.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.329+0000 7f18efc00640 1 -- 172.21.15.52:0/625575518 wait complete. 2024-09-10T08:31:42.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.500+0000 7f52b4800640 1 Processor -- start 2024-09-10T08:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.500+0000 7f52b4800640 1 -- start start 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b4800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f52ac06fe40 0x7f52ac073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b4800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ac1631c0 con 0x7f52ac162c60 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b4800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ac0ae9a0 con 0x7f52ac15e790 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b4800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f52ac15eb70 con 0x7f52ac06fe40 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b1400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f52ac162c60 0x7f52ac06f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58326/0 (socket says 172.21.15.52:58326) 2024-09-10T08:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b1400640 1 -- 172.21.15.52:0/3344740984 learned_addr learned my addr 172.21.15.52:0/3344740984 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:42.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072511679 0 0) 0x7f52ac1631c0 con 0x7f52ac162c60 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b2800640 1 --2- 172.21.15.52:0/3344740984 >> v2:172.21.15.176:3300/0 conn(0x7f52ac06fe40 0x7f52ac073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.502+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5294003520 con 0x7f52ac162c60 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715038259 0 0) 0x7f5294003520 con 0x7f52ac162c60 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 >> v2:172.21.15.176:3300/0 conn(0x7f52ac06fe40 msgr2=0x7f52ac073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 --2- 172.21.15.52:0/3344740984 >> v2:172.21.15.176:3300/0 conn(0x7f52ac06fe40 0x7f52ac073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 >> v1:172.21.15.176:6789/0 conn(0x7f52ac15e790 legacy=0x7f52ac0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac0aec40 con 0x7f52ac162c60 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f529c001670 con 0x7f52ac162c60 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 >> v1:172.21.15.52:6789/0 conn(0x7f52ac162c60 legacy=0x7f52ac06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5294003a00 0x7f5294003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5294004800 0x7f5294004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f529400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f529400c130 con 0x7f5294005210 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f529400c2e0 con 0x7f5294003a00 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f529400c4e0 con 0x7f5294004800 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b2800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f529400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b1400640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5294004800 0x7f5294004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.503+0000 7f52b1e00640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5294003a00 0x7f5294003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.504+0000 7f52b2800640 1 -- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5294004800 msgr2=0x7f5294004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.504+0000 7f52b2800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5294004800 0x7f5294004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.504+0000 7f52b2800640 1 -- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5294003a00 msgr2=0x7f5294003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.504+0000 7f52b2800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5294003a00 0x7f5294003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.504+0000 7f52b2800640 1 -- 172.21.15.52:0/3344740984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5294003520 con 0x7f5294005210 2024-09-10T08:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b2800640 1 -- 172.21.15.52:0/3344740984 reap_dead start 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b2800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f529400b9c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009f90 tx=0x7f5294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38638fc4bf5a1b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8035020 con 0x7f5294005210 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a8003b90 con 0x7f5294005210 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b0a00640 1 -- 172.21.15.52:0/3344740984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8009c10 con 0x7f5294005210 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b4800640 1 -- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 msgr2=0x7f529400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b4800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f529400b9c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009f90 tx=0x7f5294005830 comp rx=0 tx=0).stop 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b4800640 1 -- 172.21.15.52:0/3344740984 shutdown_connections 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b4800640 1 --2- 172.21.15.52:0/3344740984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f529400b9c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.505+0000 7f52b4800640 1 -- 172.21.15.52:0/3344740984 >> 172.21.15.52:0/3344740984 conn(0x7f52ac0b0a80 msgr2=0x7f52ac0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.506+0000 7f52b4800640 1 -- 172.21.15.52:0/3344740984 shutdown_connections 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.506+0000 7f52b4800640 1 -- 172.21.15.52:0/3344740984 wait complete. 2024-09-10T08:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.507+0000 7f52b4800640 1 Processor -- start 2024-09-10T08:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.507+0000 7f52b4800640 1 -- start start 2024-09-10T08:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac155930 0x7f52ac15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac15cc30 0x7f52ac153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac06f430 con 0x7f5294005210 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac0af200 con 0x7f52ac155930 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b4800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f52ac073a40 con 0x7f52ac15cc30 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40434/0 (socket says 172.21.15.52:40434) 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.508+0000 7f52b1e00640 1 -- 172.21.15.52:0/1256310621 learned_addr learned my addr 172.21.15.52:0/1256310621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b2800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac15cc30 0x7f52ac153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1400640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac155930 0x7f52ac15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 -- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac15cc30 msgr2=0x7f52ac153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac15cc30 0x7f52ac153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 -- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac155930 msgr2=0x7f52ac15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac155930 0x7f52ac15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 -- 172.21.15.52:0/1256310621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac162680 con 0x7f5294005210 2024-09-10T08:31:42.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b1e00640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f52a000f620 tx=0x7f52a000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00052e0 con 0x7f5294005210 2024-09-10T08:31:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0018070 con 0x7f5294005210 2024-09-10T08:31:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0003810 con 0x7f5294005210 2024-09-10T08:31:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ac0cd540 con 0x7f5294005210 2024-09-10T08:31:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.509+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ac0cdb00 con 0x7f5294005210 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.510+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ac06f730 con 0x7f5294005210 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.511+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52a00039b0 con 0x7f5294005210 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.512+0000 7f52a6000640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 0x7f529006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.512+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f52a008ad30 con 0x7f5294005210 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.513+0000 7f52b1400640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 0x7f529006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:42.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.513+0000 7f52b1400640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 0x7f529006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f529c001050 tx=0x7f529c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:42.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.517+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52a0059640 con 0x7f5294005210 2024-09-10T08:31:42.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.737+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52ac15d010 con 0x7f5294005210 2024-09-10T08:31:42.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.738+0000 7f52a6000640 1 -- 172.21.15.52:0/1256310621 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7f52a0058f40 con 0x7f5294005210 2024-09-10T08:31:42.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:42.739 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"btime":"2024-09-10T08:31:40:232695+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:39.658826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:31:42.739 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 msgr2=0x7f529006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 0x7f529006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f529c001050 tx=0x7f529c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 msgr2=0x7f52ac152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f52a000f620 tx=0x7f52a000fae0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 shutdown_connections 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f529006be30 0x7f529006e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f52ac15cc30 0x7f52ac153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52ac155930 0x7f52ac15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 --2- 172.21.15.52:0/1256310621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5294005210 0x7f52ac152410 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:42.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 >> 172.21.15.52:0/1256310621 conn(0x7f52ac0b0a80 msgr2=0x7f52ac0b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:42.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 shutdown_connections 2024-09-10T08:31:42.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:42.740+0000 7f52b4800640 1 -- 172.21.15.52:0/1256310621 wait complete. 2024-09-10T08:31:42.801 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:31:42.801+0000 7f959d800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:31:43.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:31:36.642091+0000', 'modified': '2024-09-10T08:31:39.658826+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/3839158402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 3839158402}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3839158402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5256, 'qdb_cluster': [5256]} 2024-09-10T08:31:43.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:31:43.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T08:31:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.320+0000 7f4a06e00640 1 Processor -- start 2024-09-10T08:31:43.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.320+0000 7f4a06e00640 1 -- start start 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.321+0000 7f4a06e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a000b6830 0x7f4a0006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.321+0000 7f4a06e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a000b02b0 0x7f4a0006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.321+0000 7f4a06e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a00067b50 con 0x7f4a0015c4b0 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.321+0000 7f4a06e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4a000ce860 con 0x7f4a000b6830 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.321+0000 7f4a06e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a00070130 con 0x7f4a000b02b0 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a000b6830 0x7f4a0006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a000b6830 0x7f4a0006e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40436/0 (socket says 172.21.15.52:40436) 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 -- 172.21.15.52:0/53859748 learned_addr learned my addr 172.21.15.52:0/53859748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f4a04e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a000b02b0 0x7f4a0006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 -- 172.21.15.52:0/53859748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a000b02b0 msgr2=0x7f4a0006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a000b02b0 0x7f4a0006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 -- 172.21.15.52:0/53859748 >> v1:172.21.15.52:6789/0 conn(0x7f4a0015c4b0 legacy=0x7f4a000b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.322+0000 7f49f7e00640 1 -- 172.21.15.52:0/53859748 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0006fe50 con 0x7f4a000b6830 2024-09-10T08:31:43.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.323+0000 7f49f7e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b6830 0x7f4a0006e1e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009870 tx=0x7f49e802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2629a8b25961147 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.323+0000 7f49ff400640 1 -- 172.21.15.52:0/53859748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8037070 con 0x7f4a000b6830 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f49ff400640 1 -- 172.21.15.52:0/53859748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e8032440 con 0x7f4a000b6830 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f49ff400640 1 -- 172.21.15.52:0/53859748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8032810 con 0x7f4a000b6830 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 -- 172.21.15.52:0/53859748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b6830 msgr2=0x7f4a0006e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b6830 0x7f4a0006e1e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009870 tx=0x7f49e802a250 comp rx=0 tx=0).stop 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 -- 172.21.15.52:0/53859748 shutdown_connections 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a000b02b0 0x7f4a0006e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 --2- 172.21.15.52:0/53859748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b6830 0x7f4a0006e1e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 -- 172.21.15.52:0/53859748 >> 172.21.15.52:0/53859748 conn(0x7f4a000b0a80 msgr2=0x7f4a000b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 -- 172.21.15.52:0/53859748 shutdown_connections 2024-09-10T08:31:43.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.324+0000 7f4a06e00640 1 -- 172.21.15.52:0/53859748 wait complete. 2024-09-10T08:31:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.326+0000 7f4a06e00640 1 Processor -- start 2024-09-10T08:31:43.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.326+0000 7f4a06e00640 1 -- start start 2024-09-10T08:31:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a000b6830 0x7f4a0015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0015c4b0 0x7f4a00153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0006dcc0 con 0x7f4a000b02b0 2024-09-10T08:31:43.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a000ce580 con 0x7f4a000b6830 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a06e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0015c890 con 0x7f4a0015c4b0 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40448/0 (socket says 172.21.15.52:40448) 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 -- 172.21.15.52:0/1042126528 learned_addr learned my addr 172.21.15.52:0/1042126528 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f4a04e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0015c4b0 0x7f4a00153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a000b6830 0x7f4a0015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 -- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0015c4b0 msgr2=0x7f4a00153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0015c4b0 0x7f4a00153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 -- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a000b6830 msgr2=0x7f4a0015e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a000b6830 0x7f4a0015e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.327+0000 7f49ffe00640 1 -- 172.21.15.52:0/1042126528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0015f1b0 con 0x7f4a000b02b0 2024-09-10T08:31:43.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f49ffe00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c3c0 tx=0x7f49f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f49fcc00640 1 -- 172.21.15.52:0/1042126528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f00052d0 con 0x7f4a000b02b0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f49fcc00640 1 -- 172.21.15.52:0/1042126528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f0005490 con 0x7f4a000b02b0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f49fcc00640 1 -- 172.21.15.52:0/1042126528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0007260 con 0x7f4a000b02b0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a00152fa0 con 0x7f4a000b02b0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.328+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a00153560 con 0x7f4a000b02b0 2024-09-10T08:31:43.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.330+0000 7f49fcc00640 1 -- 172.21.15.52:0/1042126528 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49f0007400 con 0x7f4a000b02b0 2024-09-10T08:31:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.331+0000 7f49fcc00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 0x7f49dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.331+0000 7f49fcc00640 1 -- 172.21.15.52:0/1042126528 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f49f008a1e0 con 0x7f4a000b02b0 2024-09-10T08:31:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.331+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 0x7f49dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.332+0000 7f4a09c5a740 1 Processor -- start 2024-09-10T08:31:43.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.332+0000 7f4a09c5a740 1 -- start start 2024-09-10T08:31:43.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.332+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 0x7f49dc06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49e8034000 tx=0x7f49e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.332+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3ddc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3d91570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3cf53b0 con 0x55f0d3d944b0 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3cfa410 con 0x55f0d3d98480 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f0d3ca2620 con 0x55f0d3d96cf0 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40454/0 (socket says 172.21.15.52:40454) 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 -- 172.21.15.52:0/3477181908 learned_addr learned my addr 172.21.15.52:0/3477181908 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49ffe00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3ddc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f4a04e00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3d91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 -- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 msgr2=0x55f0d3ddc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3ddc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 -- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 msgr2=0x55f0d3d91570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3d91570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49f7e00640 1 -- 172.21.15.52:0/3477181908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d3a0d2d0 con 0x55f0d3d944b0 2024-09-10T08:31:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.333+0000 7f49ffe00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3ddc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009990 tx=0x7f49e802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6336ba5c2f30a09b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f49f4c00640 1 -- 172.21.15.52:0/3477181908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8037040 con 0x55f0d3d944b0 2024-09-10T08:31:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f49f4c00640 1 -- 172.21.15.52:0/3477181908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e804e070 con 0x55f0d3d944b0 2024-09-10T08:31:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f49f4c00640 1 -- 172.21.15.52:0/3477181908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8032d20 con 0x55f0d3d944b0 2024-09-10T08:31:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3477181908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 msgr2=0x55f0d3d970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009990 tx=0x7f49e802c000 comp rx=0 tx=0).stop 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.334+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3477181908 shutdown_connections 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3d91570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d944b0 0x55f0d3d970d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3477181908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3ddc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3477181908 >> 172.21.15.52:0/3477181908 conn(0x55f0d3d93740 msgr2=0x55f0d3ddb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3477181908 shutdown_connections 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3477181908 wait complete. 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 -- start start 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.335+0000 7f4a09c5a740 1 Processor -- start 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3d91cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3de39d0 0x55f0d3de0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3cb5780 con 0x55f0d3d98480 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3cf63d0 con 0x55f0d3de39d0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f0d3d92be0 con 0x55f0d3d96cf0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.336+0000 7f4a09c5a740 10 client.0 _ll_register_callbacks cb 0x55f0d3cf35d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40466/0 (socket says 172.21.15.52:40466) 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 -- 172.21.15.52:0/3394011483 learned_addr learned my addr 172.21.15.52:0/3394011483 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49ffe00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3d91cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f4a04e00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3de39d0 0x55f0d3de0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 -- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 msgr2=0x55f0d3d91cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3d91cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 -- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3de39d0 msgr2=0x55f0d3de0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3de39d0 0x55f0d3de0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 -- 172.21.15.52:0/3394011483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d3ad76b0 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49f7e00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009870 tx=0x7f49e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bd091c8451a378 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.337+0000 7f49ed600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8059070 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f49e8049890 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49e804e070 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f49e8064050 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 10 client.5370 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f0d3debc20 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e804e070 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f49e8067020 con 0x55f0d3d98480 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 10 client.5370 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 10 client.5370 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 20 client.5370 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3dbef00 0x55f0d3dbf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 4 client.5370 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.338+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0d3d07b40 con 0x55f0d3dbef00 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.339+0000 7f49ffe00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3dbef00 0x55f0d3dbf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.339+0000 7f49ffe00640 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3dbef00 0x55f0d3dbf2e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a410bdf1fe18c29 server_cookie=3cec6a1f96a5cf0b in_seq=0 out_seq=0 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.339+0000 7f49ed600640 10 client.5370 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f49ed600640 1 -- 172.21.15.52:0/3394011483 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0d3d07b40 con 0x55f0d3dbef00 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f49ed600640 10 client.5370 handle_command_reply: tid=0 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 client.5370 shutdown 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 msgr2=0x55f0d3d921f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009870 tx=0x7f49e8004730 comp rx=0 tx=0).stop 2024-09-10T08:31:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 shutdown_connections 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3dbef00 0x55f0d3dbf2e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3de39d0 0x55f0d3de0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3d921f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/3394011483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3d91cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 >> 172.21.15.52:0/3394011483 conn(0x55f0d3d944b0 msgr2=0x55f0d3dd99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f49ed600640 0 client.5370 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 shutdown_connections 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.340+0000 7f4a09c5a740 1 -- 172.21.15.52:0/3394011483 wait complete. 2024-09-10T08:31:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.341+0000 7f4a09c5a740 20 client.5370 trim_cache size 0 max 16384 2024-09-10T08:31:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.359+0000 7f4a09c5a740 1 Processor -- start 2024-09-10T08:31:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 -- start start 2024-09-10T08:31:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 0x55f0d3d91de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 0x55f0d3de1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0015d990 con 0x55f0d3d98480 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0015ccf0 con 0x55f0d3d96cf0 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.360+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0015d340 con 0x55f0d3de39d0 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40478/0 (socket says 172.21.15.52:40478) 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 -- 172.21.15.52:0/1314744486 learned_addr learned my addr 172.21.15.52:0/1314744486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49ffe00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 0x55f0d3d91de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f4a04e00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 0x55f0d3de1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 -- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 msgr2=0x55f0d3de1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 0x55f0d3de1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 -- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 msgr2=0x55f0d3d91de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 0x55f0d3d91de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 -- 172.21.15.52:0/1314744486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d3de0e90 con 0x55f0d3d98480 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49ffe00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 0x55f0d3d91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f4a04e00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 0x55f0d3de1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49f7e00640 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49e802a9f0 tx=0x7f49e8052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b755bd25e05c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.361+0000 7f49efe00640 1 -- 172.21.15.52:0/1314744486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8059070 con 0x55f0d3d98480 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f49efe00640 1 -- 172.21.15.52:0/1314744486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e804e040 con 0x55f0d3d98480 2024-09-10T08:31:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f49efe00640 1 -- 172.21.15.52:0/1314744486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8037040 con 0x55f0d3d98480 2024-09-10T08:31:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 -- 172.21.15.52:0/1314744486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 msgr2=0x55f0d3dbee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49e802a9f0 tx=0x7f49e8052000 comp rx=0 tx=0).stop 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 -- 172.21.15.52:0/1314744486 shutdown_connections 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3de39d0 0x55f0d3de1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3d98480 0x55f0d3dbee80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/1314744486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d96cf0 0x55f0d3d91de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 -- 172.21.15.52:0/1314744486 >> 172.21.15.52:0/1314744486 conn(0x55f0d3d944b0 msgr2=0x55f0d3dd99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 -- 172.21.15.52:0/1314744486 shutdown_connections 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.362+0000 7f4a09c5a740 1 -- 172.21.15.52:0/1314744486 wait complete. 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.363+0000 7f4a09c5a740 1 -- start start 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.363+0000 7f4a09c5a740 1 Processor -- start 2024-09-10T08:31:43.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3e5c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3dbbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3de1200 con 0x55f0d3de39d0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f0d3debea0 con 0x55f0d3d98480 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f0d3de0c10 con 0x55f0d3d96cf0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a09c5a740 10 client.0 _ll_register_callbacks cb 0x7f49f8009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a04e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a04e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40482/0 (socket says 172.21.15.52:40482) 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.364+0000 7f4a04e00640 1 -- 172.21.15.52:0/2989555225 learned_addr learned my addr 172.21.15.52:0/2989555225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49f7e00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3dbbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ffe00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3e5c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 -- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 msgr2=0x55f0d3e5c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3e5c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 -- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 msgr2=0x55f0d3dbbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3dbbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 -- 172.21.15.52:0/2989555225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d3dbc530 con 0x55f0d3de39d0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49f7e00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3dbbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ffe00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3e5c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a04e00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f49f8017dc0 tx=0x7f49f8015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180af1618caf04ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ed600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8025060 con 0x55f0d3de39d0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f49f8003990 con 0x55f0d3de39d0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49e804e040 con 0x55f0d3de39d0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f49f8015e30 con 0x55f0d3de39d0 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a09c5a740 10 client.5376 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.365+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f0d3de32b0 con 0x55f0d3de39d0 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e804e040 con 0x55f0d3de39d0 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f49f802e020 con 0x55f0d3de39d0 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 10 client.5376 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 10 client.5376 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 20 client.5376 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3def990 0x55f0d3dbcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 4 client.5376 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "status"}) -- 0x55f0d3d919e0 con 0x55f0d3def990 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.366+0000 7f49ffe00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3def990 0x55f0d3dbcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f49ffe00640 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3def990 0x55f0d3dbcb40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e9dc7db36e29003 server_cookie=e4b1bdf50f99048a in_seq=0 out_seq=0 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f49ed600640 10 client.5376 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:43.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f49ed600640 1 -- 172.21.15.52:0/2989555225 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f0d3d919e0 con 0x55f0d3def990 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f49ed600640 10 client.5376 handle_command_reply: tid=0 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 client.5376 shutdown 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 msgr2=0x55f0d3dbbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f49f8017dc0 tx=0x7f49f8015760 comp rx=0 tx=0).stop 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 shutdown_connections 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55f0d3def990 0x55f0d3dbcb40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f0d3de39d0 0x55f0d3dbbff0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f0d3d98480 0x55f0d3dbbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 --2- 172.21.15.52:0/2989555225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f0d3d96cf0 0x55f0d3e5c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f49ed600640 0 client.5376 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 >> 172.21.15.52:0/2989555225 conn(0x55f0d3d944b0 msgr2=0x55f0d3ddd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 shutdown_connections 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 1 -- 172.21.15.52:0/2989555225 wait complete. 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.367+0000 7f4a09c5a740 20 client.5376 trim_cache size 0 max 16384 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 5256, 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:31:43.373 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1550516149999996, 2024-09-10T08:31:43.374 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 26, 2024-09-10T08:31:43.374 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 49, 2024-09-10T08:31:43.374 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 49, 2024-09-10T08:31:43.374 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 11.234482581 2024-09-10T08:31:43.374 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 msgr2=0x7f49dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 0x7f49dc06e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49e8034000 tx=0x7f49e802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 msgr2=0x7f4a0014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f49f000c3c0 tx=0x7f49f000c880 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 shutdown_connections 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49dc06be30 0x7f49dc06e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a0015c4b0 0x7f4a00153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a000b6830 0x7f4a0015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 --2- 172.21.15.52:0/1042126528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a000b02b0 0x7f4a0014d710 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 >> 172.21.15.52:0/1042126528 conn(0x7f4a000b0a80 msgr2=0x7f4a000cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 shutdown_connections 2024-09-10T08:31:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.368+0000 7f4a06e00640 1 -- 172.21.15.52:0/1042126528 wait complete. 2024-09-10T08:31:43.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:31:43.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.540+0000 7f3693200640 1 Processor -- start 2024-09-10T08:31:43.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.540+0000 7f3693200640 1 -- start start 2024-09-10T08:31:43.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.541+0000 7f3693200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f368c15e440 0x7f368c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.541+0000 7f3693200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.541+0000 7f3693200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f368c0d3990 con 0x7f368c0cf450 2024-09-10T08:31:43.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.541+0000 7f3693200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f368c0d3c70 con 0x7f368c15e440 2024-09-10T08:31:43.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.541+0000 7f3693200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f368c0d3f50 con 0x7f368c0b6710 2024-09-10T08:31:43.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3692800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3691e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f368c15e440 0x7f368c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3691400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f368c0cf450 0x7f368c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52914/0 (socket says 172.21.15.52:52914) 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3691400640 1 -- 172.21.15.52:0/754964 learned_addr learned my addr 172.21.15.52:0/754964 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3692800640 1 -- 172.21.15.52:0/754964 >> v2:172.21.15.176:3300/0 conn(0x7f368c15e440 msgr2=0x7f368c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3692800640 1 --2- 172.21.15.52:0/754964 >> v2:172.21.15.176:3300/0 conn(0x7f368c15e440 0x7f368c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3692800640 1 -- 172.21.15.52:0/754964 >> v1:172.21.15.176:6789/0 conn(0x7f368c0cf450 legacy=0x7f368c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3690a00640 1 -- 172.21.15.52:0/754964 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237451953 0 0) 0x7f368c0d3990 con 0x7f368c0cf450 2024-09-10T08:31:43.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.542+0000 7f3692800640 1 -- 172.21.15.52:0/754964 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c0d4230 con 0x7f368c0b6710 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.543+0000 7f3692800640 1 --2- 172.21.15.52:0/754964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c0b7b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e77ad4d6c5da28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3690a00640 1 -- 172.21.15.52:0/754964 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688007740 con 0x7f368c0b6710 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3690a00640 1 -- 172.21.15.52:0/754964 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36880078e0 con 0x7f368c0b6710 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3690a00640 1 -- 172.21.15.52:0/754964 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688007cb0 con 0x7f368c0b6710 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 -- 172.21.15.52:0/754964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 msgr2=0x7f368c0b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 --2- 172.21.15.52:0/754964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c0b7b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368802a6f0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 -- 172.21.15.52:0/754964 shutdown_connections 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 --2- 172.21.15.52:0/754964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c0b7b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 --2- 172.21.15.52:0/754964 >> v2:172.21.15.176:3300/0 conn(0x7f368c15e440 0x7f368c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 -- 172.21.15.52:0/754964 >> 172.21.15.52:0/754964 conn(0x7f368c067f80 msgr2=0x7f368c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 -- 172.21.15.52:0/754964 shutdown_connections 2024-09-10T08:31:43.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.544+0000 7f3693200640 1 -- 172.21.15.52:0/754964 wait complete. 2024-09-10T08:31:43.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.546+0000 7f3693200640 1 Processor -- start 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.546+0000 7f3693200640 1 -- start start 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c15e440 0x7f368c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0b76c0 con 0x7f368c0cf450 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f368c0b7540 con 0x7f368c15e440 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3693200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f368c0b80a0 con 0x7f368c0b6710 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3691400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3691400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40486/0 (socket says 172.21.15.52:40486) 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3691400640 1 -- 172.21.15.52:0/2188481617 learned_addr learned my addr 172.21.15.52:0/2188481617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3692800640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c15e440 0x7f368c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.547+0000 7f3691e00640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 -- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 msgr2=0x7f368c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 -- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c15e440 msgr2=0x7f368c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c15e440 0x7f368c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 -- 172.21.15.52:0/2188481617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c0cb650 con 0x7f368c0cf450 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3691400640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f367c00c4d0 tx=0x7f367c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c018070 con 0x7f368c0cf450 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f367c007500 con 0x7f368c0cf450 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367c004a20 con 0x7f368c0cf450 2024-09-10T08:31:43.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.548+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c0cb930 con 0x7f368c0cf450 2024-09-10T08:31:43.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.549+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c0cbef0 con 0x7f368c0cf450 2024-09-10T08:31:43.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.550+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c0b50e0 con 0x7f368c0cf450 2024-09-10T08:31:43.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.550+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f367c004bc0 con 0x7f368c0cf450 2024-09-10T08:31:43.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.551+0000 7f3686000640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.551+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f367c08a0c0 con 0x7f368c0cf450 2024-09-10T08:31:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.552+0000 7f3691e00640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:43.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.552+0000 7f3691e00640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 0x7f367006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f368c15b410 tx=0x7f3680009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:43.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.556+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f367c058410 con 0x7f368c0cf450 2024-09-10T08:31:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.779+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f368c06ca40 con 0x7f368c0cf450 2024-09-10T08:31:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.780+0000 7f3686000640 1 -- 172.21.15.52:0/2188481617 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f367c05c710 con 0x7f368c0cf450 2024-09-10T08:31:43.780 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:31:43.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 msgr2=0x7f367006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 0x7f367006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f368c15b410 tx=0x7f3680009190 comp rx=0 tx=0).stop 2024-09-10T08:31:43.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 msgr2=0x7f368c1f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:43.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f367c00c4d0 tx=0x7f367c00c990 comp rx=0 tx=0).stop 2024-09-10T08:31:43.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 shutdown_connections 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f367006be30 0x7f367006e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f368c15e440 0x7f368c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f368c0cf450 0x7f368c1f4510 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 --2- 172.21.15.52:0/2188481617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f368c0b6710 0x7f368c15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 >> 172.21.15.52:0/2188481617 conn(0x7f368c067f80 msgr2=0x7f368c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 shutdown_connections 2024-09-10T08:31:43.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:43.782+0000 7f3693200640 1 -- 172.21.15.52:0/2188481617 wait complete. 2024-09-10T08:31:43.798 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:31:43.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:31:43.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:31:43.798 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:31:43.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:43.799 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:31:43.799 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:31:43.799 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:31:43.799 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:31:43.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:43.799 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:31:43.836 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42499sec preferred_lft 42499sec 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:31:43.837 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:31:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:31:43.839 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:31:43.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:43.839 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:31:43.929 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:31:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:43.932 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:31:43.969 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:31:43.970 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:31:43.970 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:31:43.970 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:31:43.970 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:31:43.970 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:31:43.970 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:31:43.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:31:43.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:31:43.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:31:43.971 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:31:44.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:31:44.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:31:44.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:44.168 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:31:44.204 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:31:44.204 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:31:44.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:31:44.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:44.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:31:44.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:31:44.303 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:44.338 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:31:44.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:31:44.338 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:44.413 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:31:44.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:44.414 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:31:44.542 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:31:44.542 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:31:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:31:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:31:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:31:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:31:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:31:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:31:44.571 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:31:44.571 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:31:44.572 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:31:44.572 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:31:44.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:31:44.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:44.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:44.631 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:31:44.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:31:44.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:31:44.727 INFO:teuthology.orchestra.run.smithi052.stdout:client5382 2024-09-10T08:31:44.728 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:44.728 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:44.763 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:44.763 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-10T08:31:44.763 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-10T08:31:44.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:44.764 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> import json 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> import sys 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> except OSError as e: 2024-09-10T08:31:44.846 DEBUG:teuthology.orchestra.run.smithi052:> sys.exit(e.errno) 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> print(json.dumps( 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> indent=2)) 2024-09-10T08:31:44.847 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:31:44.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:44 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-10T08:31:45.000 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T08:31:45.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:45.001 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-10T08:31:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-10T08:31:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-10T08:31:48.745 INFO:teuthology.orchestra.run.smithi052.stderr:Updating files: 45% (641/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 76% (1076/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-10T08:31:48.751 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-10T08:31:48.751 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-10T08:31:48.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-10T08:31:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.949+0000 7fc836a00640 1 Processor -- start 2024-09-10T08:31:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.950+0000 7fc836a00640 1 -- start start 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc836a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc830144300 0x7fc8300cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc836a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 0x7fc83015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc836a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8301446e0 con 0x7fc8300d0030 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc836a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc830071cf0 con 0x7fc830144300 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc836a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc830072180 con 0x7fc830073cd0 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc82fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc830144300 0x7fc8300cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc82fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc830144300 0x7fc8300cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46372/0 (socket says 172.21.15.52:46372) 2024-09-10T08:31:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.951+0000 7fc82fe00640 1 -- 172.21.15.52:0/1340462631 learned_addr learned my addr 172.21.15.52:0/1340462631 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc834a00640 1 --2- 172.21.15.52:0/1340462631 >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 0x7fc83015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc82fe00640 1 -- 172.21.15.52:0/1340462631 >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 msgr2=0x7fc83015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc82fe00640 1 --2- 172.21.15.52:0/1340462631 >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 0x7fc83015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc82fe00640 1 -- 172.21.15.52:0/1340462631 >> v1:172.21.15.52:6789/0 conn(0x7fc8300d0030 legacy=0x7fc8300735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc82fe00640 1 -- 172.21.15.52:0/1340462631 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8300710e0 con 0x7fc830144300 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc82f400640 1 -- 172.21.15.52:0/1340462631 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503021446 0 0) 0x7fc8301446e0 con 0x7fc8300d0030 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.952+0000 7fc834a00640 1 --2- 172.21.15.52:0/1340462631 >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 0x7fc83015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc82fe00640 1 --2- 172.21.15.52:0/1340462631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc830144300 0x7fc8300cf240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8300b2900 tx=0x7fc82002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2eeee729d2ea93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc82f400640 1 -- 172.21.15.52:0/1340462631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820037070 con 0x7fc830144300 2024-09-10T08:31:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc82f400640 1 -- 172.21.15.52:0/1340462631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc820032440 con 0x7fc830144300 2024-09-10T08:31:48.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc82f400640 1 -- 172.21.15.52:0/1340462631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820032810 con 0x7fc830144300 2024-09-10T08:31:48.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 -- 172.21.15.52:0/1340462631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc830144300 msgr2=0x7fc8300cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 --2- 172.21.15.52:0/1340462631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc830144300 0x7fc8300cf240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8300b2900 tx=0x7fc82002a270 comp rx=0 tx=0).stop 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 -- 172.21.15.52:0/1340462631 shutdown_connections 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 --2- 172.21.15.52:0/1340462631 >> v2:172.21.15.176:3300/0 conn(0x7fc830073cd0 0x7fc83015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 --2- 172.21.15.52:0/1340462631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc830144300 0x7fc8300cf240 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.953+0000 7fc836a00640 1 -- 172.21.15.52:0/1340462631 >> 172.21.15.52:0/1340462631 conn(0x7fc83006d0f0 msgr2=0x7fc83006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.954+0000 7fc836a00640 1 -- 172.21.15.52:0/1340462631 shutdown_connections 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.954+0000 7fc836a00640 1 -- 172.21.15.52:0/1340462631 wait complete. 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.955+0000 7fc836a00640 1 Processor -- start 2024-09-10T08:31:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.955+0000 7fc836a00640 1 -- start start 2024-09-10T08:31:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc830073cd0 0x7fc83015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300d0030 0x7fc83012d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144300 0x7fc830165620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc830071980 con 0x7fc8300d0030 2024-09-10T08:31:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300716a0 con 0x7fc830073cd0 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.956+0000 7fc836a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300cf780 con 0x7fc830144300 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300d0030 0x7fc83012d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300d0030 0x7fc83012d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46384/0 (socket says 172.21.15.52:46384) 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 -- 172.21.15.52:0/1451583620 learned_addr learned my addr 172.21.15.52:0/1451583620 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc82fe00640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc830073cd0 0x7fc83015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc834a00640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144300 0x7fc830165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 -- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144300 msgr2=0x7fc830165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144300 0x7fc830165620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 -- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc830073cd0 msgr2=0x7fc83015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc830073cd0 0x7fc83015e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 -- 172.21.15.52:0/1451583620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83015eca0 con 0x7fc8300d0030 2024-09-10T08:31:48.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.957+0000 7fc827400640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300d0030 0x7fc83012d360 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c4b0 tx=0x7fc81800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.958+0000 7fc82cc00640 1 -- 172.21.15.52:0/1451583620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818017070 con 0x7fc8300d0030 2024-09-10T08:31:48.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.958+0000 7fc82cc00640 1 -- 172.21.15.52:0/1451583620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818005480 con 0x7fc8300d0030 2024-09-10T08:31:48.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.958+0000 7fc82cc00640 1 -- 172.21.15.52:0/1451583620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818003830 con 0x7fc8300d0030 2024-09-10T08:31:48.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.958+0000 7fc836a00640 1 -- 172.21.15.52:0/1451583620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83015ef80 con 0x7fc8300d0030 2024-09-10T08:31:48.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.958+0000 7fc836a00640 1 -- 172.21.15.52:0/1451583620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83015f540 con 0x7fc8300d0030 2024-09-10T08:31:48.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.960+0000 7fc82cc00640 1 -- 172.21.15.52:0/1451583620 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc81801a070 con 0x7fc8300d0030 2024-09-10T08:31:48.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.961+0000 7fc82cc00640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.961+0000 7fc82cc00640 1 -- 172.21.15.52:0/1451583620 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc81808a1c0 con 0x7fc8300d0030 2024-09-10T08:31:48.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.961+0000 7fc82fe00640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.961+0000 7fc8399d5740 1 Processor -- start 2024-09-10T08:31:48.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.961+0000 7fc8399d5740 1 -- start start 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc82fe00640 1 --2- 172.21.15.52:0/1451583620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc820034000 tx=0x7fc82002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e93be150 0x5648e93bf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648e92dc840 con 0x5648e93770f0 2024-09-10T08:31:48.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5648e9284910 con 0x5648e93a3790 2024-09-10T08:31:48.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648e92d8800 con 0x5648e93be150 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46394/0 (socket says 172.21.15.52:46394) 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc834a00640 1 -- 172.21.15.52:0/2096035198 learned_addr learned my addr 172.21.15.52:0/2096035198 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc827400640 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e93be150 0x5648e93bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.962+0000 7fc82fe00640 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 -- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e93be150 msgr2=0x5648e93bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e93be150 0x5648e93bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 -- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 msgr2=0x5648e93a3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93a3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 -- 172.21.15.52:0/2096035198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e8fd3590 con 0x5648e93770f0 2024-09-10T08:31:48.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc834a00640 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e520 tx=0x7fc82800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb30e0b6bf564b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc81fe00640 1 -- 172.21.15.52:0/2096035198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82800c990 con 0x5648e93770f0 2024-09-10T08:31:48.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc81fe00640 1 -- 172.21.15.52:0/2096035198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82800cb30 con 0x5648e93770f0 2024-09-10T08:31:48.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.963+0000 7fc81fe00640 1 -- 172.21.15.52:0/2096035198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82800a410 con 0x5648e93770f0 2024-09-10T08:31:48.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 -- 172.21.15.52:0/2096035198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 msgr2=0x5648e93bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e520 tx=0x7fc82800e9e0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 -- 172.21.15.52:0/2096035198 shutdown_connections 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93770f0 0x5648e93bfe40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e93be150 0x5648e93bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 --2- 172.21.15.52:0/2096035198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93a3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 -- 172.21.15.52:0/2096035198 >> 172.21.15.52:0/2096035198 conn(0x5648e9376380 msgr2=0x5648e93be5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 -- 172.21.15.52:0/2096035198 shutdown_connections 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.964+0000 7fc8399d5740 1 -- 172.21.15.52:0/2096035198 wait complete. 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.965+0000 7fc8399d5740 1 -- start start 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.965+0000 7fc8399d5740 1 Processor -- start 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93be150 0x5648e9378d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9374220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648e93a4550 con 0x5648e93a3790 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5648e9297bd0 con 0x5648e93be150 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648e93bede0 con 0x5648e9379280 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc8399d5740 10 client.0 _ll_register_callbacks cb 0x5648e92d5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46410/0 (socket says 172.21.15.52:46410) 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc82fe00640 1 -- 172.21.15.52:0/4221138009 learned_addr learned my addr 172.21.15.52:0/4221138009 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc827400640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93be150 0x5648e9378d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.966+0000 7fc834a00640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9374220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 -- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 msgr2=0x5648e9374220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9374220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 -- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93be150 msgr2=0x5648e9378d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93be150 0x5648e9378d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 -- 172.21.15.52:0/4221138009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e8fef590 con 0x5648e93a3790 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc82fe00640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc820009630 tx=0x7fc820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3856d24236b18bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82004f020 con 0x5648e93a3790 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82800cb30 con 0x5648e93a3790 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.967+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc82004b660 con 0x5648e93a3790 2024-09-10T08:31:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc820037040 con 0x5648e93a3790 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 10 client.5397 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5648e90b9970 con 0x5648e93a3790 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82800cb30 con 0x5648e93a3790 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc82004b860 con 0x5648e93a3790 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 10 client.5397 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 10 client.5397 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 20 client.5397 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93a57b0 0x5648e93a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 4 client.5397 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e92e9f70 con 0x5648e93a57b0 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.968+0000 7fc827400640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93a57b0 0x5648e93a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.969+0000 7fc827400640 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93a57b0 0x5648e93a5bf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17090c2749d61333 server_cookie=b212d4d09c5af99e in_seq=0 out_seq=0 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.969+0000 7fc81cc00640 10 client.5397 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.969+0000 7fc81cc00640 1 -- 172.21.15.52:0/4221138009 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648e92e9f70 con 0x5648e93a57b0 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.969+0000 7fc81cc00640 10 client.5397 handle_command_reply: tid=0 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.969+0000 7fc8399d5740 1 client.5397 shutdown 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 msgr2=0x5648e939ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc820009630 tx=0x7fc820004730 comp rx=0 tx=0).stop 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 shutdown_connections 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93a57b0 0x5648e93a5bf0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9374220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93be150 0x5648e9378d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 --2- 172.21.15.52:0/4221138009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93a3790 0x5648e939ee70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 >> 172.21.15.52:0/4221138009 conn(0x5648e93770f0 msgr2=0x5648e93c1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:48.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc81cc00640 0 client.5397 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:48.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 shutdown_connections 2024-09-10T08:31:48.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 1 -- 172.21.15.52:0/4221138009 wait complete. 2024-09-10T08:31:48.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.970+0000 7fc8399d5740 20 client.5397 trim_cache size 0 max 16384 2024-09-10T08:31:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.985+0000 7fc8399d5740 1 Processor -- start 2024-09-10T08:31:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 -- start start 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9378bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301435e0 con 0x5648e93be150 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301426e0 con 0x5648e93a3790 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.986+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc830141a40 con 0x5648e9379280 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46418/0 (socket says 172.21.15.52:46418) 2024-09-10T08:31:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 -- 172.21.15.52:0/114525532 learned_addr learned my addr 172.21.15.52:0/114525532 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc82fe00640 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9378bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc827400640 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 -- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 msgr2=0x5648e9378bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9378bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 -- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 msgr2=0x5648e93bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93bf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 -- 172.21.15.52:0/114525532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e93c26b0 con 0x5648e93be150 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.987+0000 7fc834a00640 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc828016000 tx=0x7fc828011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314c1bbeb233366e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc81f400640 1 -- 172.21.15.52:0/114525532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828027070 con 0x5648e93be150 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc81f400640 1 -- 172.21.15.52:0/114525532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82800e230 con 0x5648e93be150 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc81f400640 1 -- 172.21.15.52:0/114525532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828003bd0 con 0x5648e93be150 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 -- 172.21.15.52:0/114525532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 msgr2=0x5648e9379b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc828016000 tx=0x7fc828011000 comp rx=0 tx=0).stop 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 -- 172.21.15.52:0/114525532 shutdown_connections 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e9379b50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e93bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 --2- 172.21.15.52:0/114525532 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e9378bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 -- 172.21.15.52:0/114525532 >> 172.21.15.52:0/114525532 conn(0x5648e93770f0 msgr2=0x5648e93a5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 -- 172.21.15.52:0/114525532 shutdown_connections 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.988+0000 7fc8399d5740 1 -- 172.21.15.52:0/114525532 wait complete. 2024-09-10T08:31:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.989+0000 7fc8399d5740 1 -- start start 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.989+0000 7fc8399d5740 1 Processor -- start 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e939ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e9373930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648e93a5b70 con 0x5648e93be150 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc830142090 con 0x5648e93a3790 2024-09-10T08:31:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648e939c470 con 0x5648e9379280 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc8399d5740 10 client.0 _ll_register_callbacks cb 0x7fc8200041c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.990+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e939ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46420/0 (socket says 172.21.15.52:46420) 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 -- 172.21.15.52:0/370092517 learned_addr learned my addr 172.21.15.52:0/370092517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc827400640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e9373930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 -- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 msgr2=0x5648e939ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e939ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 -- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 msgr2=0x5648e9373930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e9373930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 -- 172.21.15.52:0/370092517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e93c7e10 con 0x5648e93be150 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc834a00640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc82800ea20 tx=0x7fc828004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f421c23dd84fd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828027040 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.991+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc82800e030 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82800e230 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc82803b050 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 10 client.5403 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5648e93a5630 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82800e230 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc82803e020 con 0x5648e93be150 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 10 client.5403 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 10 client.5403 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 20 client.5403 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93c8360 0x5648e93a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 4 client.5403 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T08:31:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5648e92e42c0 con 0x5648e93c8360 2024-09-10T08:31:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.992+0000 7fc82fe00640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93c8360 0x5648e93a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.993+0000 7fc82fe00640 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93c8360 0x5648e93a0af0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d29a373bcb00849 server_cookie=f36a551cc64e3d34 in_seq=0 out_seq=0 2024-09-10T08:31:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.993+0000 7fc81cc00640 10 client.5403 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.993+0000 7fc81cc00640 1 -- 172.21.15.52:0/370092517 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x5648e92e42c0 con 0x5648e93c8360 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.993+0000 7fc81cc00640 10 client.5403 handle_command_reply: tid=0 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.993+0000 7fc8399d5740 1 client.5403 shutdown 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 msgr2=0x5648e93a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc82800ea20 tx=0x7fc828004ab0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 shutdown_connections 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648e93c8360 0x5648e93a0af0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648e93be150 0x5648e93a05b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648e93a3790 0x5648e9373930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 --2- 172.21.15.52:0/370092517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648e9379280 0x5648e939ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc81cc00640 0 client.5403 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 >> 172.21.15.52:0/370092517 conn(0x5648e93770f0 msgr2=0x5648e93a5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 shutdown_connections 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 1 -- 172.21.15.52:0/370092517 wait complete. 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:48.994+0000 7fc8399d5740 20 client.5403 trim_cache size 0 max 16384 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": -2 2024-09-10T08:31:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENOENT: 2024-09-10T08:31:49.001 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T08:31:49.001 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-10T08:31:49.001 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-10T08:31:49.002 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-10T08:31:49.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.161+0000 7fb24fe00640 1 Processor -- start 2024-09-10T08:31:49.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.161+0000 7fb24fe00640 1 -- start start 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24815b7c0 0x7fb2480b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb2480cead0 0x7fb248071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480cf2e0 con 0x7fb2480ccf30 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb248070fe0 con 0x7fb2480cead0 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480712c0 con 0x7fb24815b7c0 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2480ccf30 0x7fb2480cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51530/0 (socket says 172.21.15.52:51530) 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24d400640 1 -- 172.21.15.52:0/2120787195 learned_addr learned my addr 172.21.15.52:0/2120787195 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24de00640 1 --2- 172.21.15.52:0/2120787195 >> v2:172.21.15.52:3300/0 conn(0x7fb2480cead0 0x7fb248071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb24ca00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24815b7c0 0x7fb2480b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb247e00640 1 -- 172.21.15.52:0/2120787195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236986732 0 0) 0x7fb2480cf2e0 con 0x7fb2480ccf30 2024-09-10T08:31:49.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.163+0000 7fb247e00640 1 -- 172.21.15.52:0/2120787195 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb230003520 con 0x7fb2480ccf30 2024-09-10T08:31:49.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.164+0000 7fb24de00640 1 -- 172.21.15.52:0/2120787195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24815b7c0 msgr2=0x7fb2480b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.164+0000 7fb24de00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24815b7c0 0x7fb2480b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.164+0000 7fb24de00640 1 -- 172.21.15.52:0/2120787195 >> v1:172.21.15.52:6789/0 conn(0x7fb2480ccf30 legacy=0x7fb2480cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.164+0000 7fb24de00640 1 -- 172.21.15.52:0/2120787195 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480715a0 con 0x7fb2480cead0 2024-09-10T08:31:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb24de00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2480cead0 0x7fb248071ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb240009d90 tx=0x7fb24002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed67a8c4ab60575 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb247e00640 1 -- 172.21.15.52:0/2120787195 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240031600 con 0x7fb2480cead0 2024-09-10T08:31:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb247e00640 1 -- 172.21.15.52:0/2120787195 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2400317a0 con 0x7fb2480cead0 2024-09-10T08:31:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb247e00640 1 -- 172.21.15.52:0/2120787195 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240031b50 con 0x7fb2480cead0 2024-09-10T08:31:49.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb24fe00640 1 -- 172.21.15.52:0/2120787195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2480cead0 msgr2=0x7fb248071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.165+0000 7fb24fe00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2480cead0 0x7fb248071ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb240009d90 tx=0x7fb24002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 -- 172.21.15.52:0/2120787195 shutdown_connections 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2480cead0 0x7fb248071ac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 --2- 172.21.15.52:0/2120787195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24815b7c0 0x7fb2480b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 -- 172.21.15.52:0/2120787195 >> 172.21.15.52:0/2120787195 conn(0x7fb24806d0f0 msgr2=0x7fb24806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 -- 172.21.15.52:0/2120787195 shutdown_connections 2024-09-10T08:31:49.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.166+0000 7fb24fe00640 1 -- 172.21.15.52:0/2120787195 wait complete. 2024-09-10T08:31:49.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.167+0000 7fb24fe00640 1 Processor -- start 2024-09-10T08:31:49.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.167+0000 7fb24fe00640 1 -- start start 2024-09-10T08:31:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2480ccf30 0x7fb2481597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2480cead0 0x7fb24814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480cf0c0 con 0x7fb24815b7c0 2024-09-10T08:31:49.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480cef40 con 0x7fb2480cead0 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.168+0000 7fb24fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb248072000 con 0x7fb2480ccf30 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2480ccf30 0x7fb2481597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46428/0 (socket says 172.21.15.52:46428) 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 -- 172.21.15.52:0/588120873 learned_addr learned my addr 172.21.15.52:0/588120873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24ca00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2480cead0 0x7fb24814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 -- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2480ccf30 msgr2=0x7fb2481597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2480ccf30 0x7fb2481597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 -- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2480cead0 msgr2=0x7fb24814e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2480cead0 0x7fb24814e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.169+0000 7fb24de00640 1 -- 172.21.15.52:0/588120873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2480cb420 con 0x7fb24815b7c0 2024-09-10T08:31:49.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb24de00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb240009d90 tx=0x7fb240004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb245600640 1 -- 172.21.15.52:0/588120873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240040070 con 0x7fb24815b7c0 2024-09-10T08:31:49.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb245600640 1 -- 172.21.15.52:0/588120873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb240004260 con 0x7fb24815b7c0 2024-09-10T08:31:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2480cb700 con 0x7fb24815b7c0 2024-09-10T08:31:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb245600640 1 -- 172.21.15.52:0/588120873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240009450 con 0x7fb24815b7c0 2024-09-10T08:31:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.170+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2480cbcc0 con 0x7fb24815b7c0 2024-09-10T08:31:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.172+0000 7fb245600640 1 -- 172.21.15.52:0/588120873 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb240039040 con 0x7fb24815b7c0 2024-09-10T08:31:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.173+0000 7fb245600640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 0x7fb22806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.173+0000 7fb245600640 1 -- 172.21.15.52:0/588120873 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb2400abf90 con 0x7fb24815b7c0 2024-09-10T08:31:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.173+0000 7fb24d400640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 0x7fb22806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.174+0000 7fb252ca8740 1 Processor -- start 2024-09-10T08:31:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.174+0000 7fb24d400640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 0x7fb22806e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb23c005880 tx=0x7fb23c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.174+0000 7fb252ca8740 1 -- start start 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1983c0 0x55881f199f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 0x55881f17ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55881f1162d0 con 0x55881f19ac00 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55881f0b7930 con 0x55881f198820 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55881f05f8e0 con 0x55881f1983c0 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46432/0 (socket says 172.21.15.52:46432) 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 -- 172.21.15.52:0/2360584413 learned_addr learned my addr 172.21.15.52:0/2360584413 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24de00640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 0x55881f17ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24ca00640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1983c0 0x55881f199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 -- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1983c0 msgr2=0x55881f199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1983c0 0x55881f199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 -- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 msgr2=0x55881f17ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.175+0000 7fb24d400640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 0x55881f17ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb24d400640 1 -- 172.21.15.52:0/2360584413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881ee969f0 con 0x55881f19ac00 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb24de00640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 0x55881f17ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb24d400640 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00fab0 tx=0x7fb23c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad45989733361f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb239c00640 1 -- 172.21.15.52:0/2360584413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c025070 con 0x55881f19ac00 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb239c00640 1 -- 172.21.15.52:0/2360584413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c015cb0 con 0x55881f19ac00 2024-09-10T08:31:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.176+0000 7fb239c00640 1 -- 172.21.15.52:0/2360584413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c015e60 con 0x55881f19ac00 2024-09-10T08:31:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- 172.21.15.52:0/2360584413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 msgr2=0x55881f19afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb23c00fab0 tx=0x7fb23c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- 172.21.15.52:0/2360584413 shutdown_connections 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f198820 0x55881f17ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1983c0 0x55881f199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 --2- 172.21.15.52:0/2360584413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f19afe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- 172.21.15.52:0/2360584413 >> 172.21.15.52:0/2360584413 conn(0x55881f150860 msgr2=0x55881f198c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- 172.21.15.52:0/2360584413 shutdown_connections 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- 172.21.15.52:0/2360584413 wait complete. 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.177+0000 7fb252ca8740 1 -- start start 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.178+0000 7fb252ca8740 1 Processor -- start 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f191cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f154750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55881f072b60 con 0x55881f198820 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55881f0b38f0 con 0x55881f19ac00 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55881f197320 con 0x55881f1542d0 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb252ca8740 10 client.0 _ll_register_callbacks cb 0x55881f0b0640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46444/0 (socket says 172.21.15.52:46444) 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 -- 172.21.15.52:0/3573844721 learned_addr learned my addr 172.21.15.52:0/3573844721 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 -- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 msgr2=0x55881f154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 -- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 msgr2=0x55881f191cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f191cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.179+0000 7fb24d400640 1 -- 172.21.15.52:0/3573844721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881ed8a2e0 con 0x55881f198820 2024-09-10T08:31:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb24d400640 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb23c023040 tx=0x7fb23c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b2ab5567560704 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb22e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c025040 con 0x55881f198820 2024-09-10T08:31:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb23c020bd0 con 0x55881f198820 2024-09-10T08:31:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23c015cb0 con 0x55881f198820 2024-09-10T08:31:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb23c015e60 con 0x55881f198820 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb252ca8740 10 client.5418 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55881eef7180 con 0x55881f198820 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.180+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c015cb0 con 0x55881f198820 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fb23c0047e0 con 0x55881f198820 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 10 client.5418 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 10 client.5418 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 20 client.5418 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f17c120 0x55881f18fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 4 client.5418 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55881f0c5060 con 0x55881f17c120 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb24ca00640 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f17c120 0x55881f18fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb24ca00640 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f17c120 0x55881f18fb10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44139836348eee09 server_cookie=c9ebe2cc93419439 in_seq=0 out_seq=0 2024-09-10T08:31:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.181+0000 7fb22e000640 10 client.5418 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb22e000640 1 -- 172.21.15.52:0/3573844721 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55881f0c5060 con 0x55881f17c120 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb22e000640 10 client.5418 handle_command_reply: tid=0 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 client.5418 shutdown 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 msgr2=0x55881f178770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb23c023040 tx=0x7fb23c000bc0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 shutdown_connections 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f17c120 0x55881f18fb10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f191cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 --2- 172.21.15.52:0/3573844721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f198820 0x55881f178770 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb22e000640 0 client.5418 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.182+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 >> 172.21.15.52:0/3573844721 conn(0x55881f1983c0 msgr2=0x55881f198c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.183+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 shutdown_connections 2024-09-10T08:31:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.183+0000 7fb252ca8740 1 -- 172.21.15.52:0/3573844721 wait complete. 2024-09-10T08:31:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.183+0000 7fb252ca8740 20 client.5418 trim_cache size 0 max 16384 2024-09-10T08:31:49.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.201+0000 7fb252ca8740 1 Processor -- start 2024-09-10T08:31:49.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.201+0000 7fb252ca8740 1 -- start start 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f198df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f199330 0x55881f18ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb248200c70 con 0x55881f1542d0 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2481ffc90 con 0x55881f19ac00 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb24815dee0 con 0x55881f199330 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb24d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46446/0 (socket says 172.21.15.52:46446) 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.202+0000 7fb24d400640 1 -- 172.21.15.52:0/1195930187 learned_addr learned my addr 172.21.15.52:0/1195930187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24ca00640 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 -- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f199330 msgr2=0x55881f18ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f199330 0x55881f18ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 -- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 msgr2=0x55881f198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 -- 172.21.15.52:0/1195930187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55881ed633a0 con 0x55881f1542d0 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24ca00640 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:49.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb24d400640 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb23c015830 tx=0x7fb23c028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545edaf7ed7990d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb239200640 1 -- 172.21.15.52:0/1195930187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c025040 con 0x55881f1542d0 2024-09-10T08:31:49.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb239200640 1 -- 172.21.15.52:0/1195930187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c030070 con 0x55881f1542d0 2024-09-10T08:31:49.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.203+0000 7fb239200640 1 -- 172.21.15.52:0/1195930187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0047e0 con 0x55881f1542d0 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 -- 172.21.15.52:0/1195930187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 msgr2=0x55881f199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb23c015830 tx=0x7fb23c028000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 -- 172.21.15.52:0/1195930187 shutdown_connections 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f199330 0x55881f18ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f19ac00 0x55881f198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 --2- 172.21.15.52:0/1195930187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f1542d0 0x55881f199b10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 -- 172.21.15.52:0/1195930187 >> 172.21.15.52:0/1195930187 conn(0x55881f1983c0 msgr2=0x55881f17d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 -- 172.21.15.52:0/1195930187 shutdown_connections 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.204+0000 7fb252ca8740 1 -- 172.21.15.52:0/1195930187 wait complete. 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.205+0000 7fb252ca8740 1 -- start start 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.205+0000 7fb252ca8740 1 Processor -- start 2024-09-10T08:31:49.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f1906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f199330 0x55881f216ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2481ff640 con 0x55881f19ac00 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55881f154dc0 con 0x55881f199330 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55881f1b0b90 con 0x55881f1542d0 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb252ca8740 10 client.0 _ll_register_callbacks cb 0x7fb23c023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb24de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb24de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46450/0 (socket says 172.21.15.52:46450) 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb24de00640 1 -- 172.21.15.52:0/4207441868 learned_addr learned my addr 172.21.15.52:0/4207441868 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb24d400640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f1906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.206+0000 7fb24ca00640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f199330 0x55881f216ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 -- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 msgr2=0x55881f1906e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f1906e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 -- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f199330 msgr2=0x55881f216ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f199330 0x55881f216ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 -- 172.21.15.52:0/4207441868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55881f1af140 con 0x55881f19ac00 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb24de00640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb24003f040 tx=0x7fb24007a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353c247caa0efb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb22e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240092200 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb240004650 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23c030070 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.207+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb240004850 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 10 client.5424 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55881f178500 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c030070 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fb2400828f0 con 0x55881f19ac00 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 10 client.5424 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 10 client.5424 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 20 client.5424 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f1b0750 0x55881f18ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 4 client.5424 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55881f193750 con 0x55881f1b0750 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.208+0000 7fb24d400640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f1b0750 0x55881f18ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb24d400640 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f1b0750 0x55881f18ed30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce93bd8f50e26b1 server_cookie=71ad2f99fb6d4d5d in_seq=0 out_seq=0 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb22e000640 10 client.5424 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb22e000640 1 -- 172.21.15.52:0/4207441868 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x55881f193750 con 0x55881f1b0750 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb22e000640 10 client.5424 handle_command_reply: tid=0 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 client.5424 shutdown 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 msgr2=0x55881f1bbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb24003f040 tx=0x7fb24007a310 comp rx=0 tx=0).stop 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 shutdown_connections 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55881f1b0750 0x55881f18ed30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55881f19ac00 0x55881f1bbf90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55881f199330 0x55881f216ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 --2- 172.21.15.52:0/4207441868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55881f1542d0 0x55881f1906e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb22e000640 0 client.5424 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 >> 172.21.15.52:0/4207441868 conn(0x55881f1983c0 msgr2=0x55881f17d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.209+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 shutdown_connections 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb252ca8740 1 -- 172.21.15.52:0/4207441868 wait complete. 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb252ca8740 20 client.5424 trim_cache size 0 max 16384 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": -2 2024-09-10T08:31:49.214 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 msgr2=0x7fb22806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 0x7fb22806e320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb23c005880 tx=0x7fb23c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 msgr2=0x7fb2480b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb240009d90 tx=0x7fb240004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 shutdown_connections 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb22806be60 0x7fb22806e320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb24815b7c0 0x7fb2480b50a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2480cead0 0x7fb24814e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 --2- 172.21.15.52:0/588120873 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2480ccf30 0x7fb2481597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 >> 172.21.15.52:0/588120873 conn(0x7fb24806d0f0 msgr2=0x7fb24815f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 shutdown_connections 2024-09-10T08:31:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.210+0000 7fb24fe00640 1 -- 172.21.15.52:0/588120873 wait complete. 2024-09-10T08:31:49.225 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-10T08:31:49.225 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-10T08:31:49.225 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T08:31:49.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-10T08:31:49.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.383+0000 7fd496800640 1 Processor -- start 2024-09-10T08:31:49.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.383+0000 7fd496800640 1 -- start start 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.384+0000 7fd496800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4900705f0 0x7fd49006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd496800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4900b5e60 con 0x7fd49006bc10 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd496800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4900b6140 con 0x7fd4900b00f0 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd496800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd4900b6420 con 0x7fd4900705f0 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd495400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd4900705f0 0x7fd49006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd494a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd49006bc10 0x7fd49006c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51542/0 (socket says 172.21.15.52:51542) 2024-09-10T08:31:49.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd494a00640 1 -- 172.21.15.52:0/787863098 learned_addr learned my addr 172.21.15.52:0/787863098 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:49.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd48fe00640 1 -- 172.21.15.52:0/787863098 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010766496 0 0) 0x7fd4900b5e60 con 0x7fd49006bc10 2024-09-10T08:31:49.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd495400640 1 -- 172.21.15.52:0/787863098 >> v1:172.21.15.176:6789/0 conn(0x7fd4900b00f0 legacy=0x7fd4900b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd495400640 1 -- 172.21.15.52:0/787863098 >> v1:172.21.15.52:6789/0 conn(0x7fd49006bc10 legacy=0x7fd49006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.385+0000 7fd495400640 1 -- 172.21.15.52:0/787863098 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4900b5aa0 con 0x7fd4900705f0 2024-09-10T08:31:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.386+0000 7fd495400640 1 --2- 172.21.15.52:0/787863098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd49006f580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd48402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7184e865d3b219 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd48fe00640 1 -- 172.21.15.52:0/787863098 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484037070 con 0x7fd4900705f0 2024-09-10T08:31:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd48fe00640 1 -- 172.21.15.52:0/787863098 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd484032440 con 0x7fd4900705f0 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd48fe00640 1 -- 172.21.15.52:0/787863098 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484032810 con 0x7fd4900705f0 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 -- 172.21.15.52:0/787863098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 msgr2=0x7fd49006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 --2- 172.21.15.52:0/787863098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd49006f580 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd48402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 -- 172.21.15.52:0/787863098 shutdown_connections 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 --2- 172.21.15.52:0/787863098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd49006f580 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 -- 172.21.15.52:0/787863098 >> 172.21.15.52:0/787863098 conn(0x7fd4900d12e0 msgr2=0x7fd4900d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 -- 172.21.15.52:0/787863098 shutdown_connections 2024-09-10T08:31:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.387+0000 7fd496800640 1 -- 172.21.15.52:0/787863098 wait complete. 2024-09-10T08:31:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.389+0000 7fd496800640 1 Processor -- start 2024-09-10T08:31:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.389+0000 7fd496800640 1 -- start start 2024-09-10T08:31:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49006bc10 0x7fd49015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4900b00f0 0x7fd4900af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd49015f160 con 0x7fd4900705f0 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd49015efe0 con 0x7fd49006bc10 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd496800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd49015f2e0 con 0x7fd4900b00f0 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd494a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd494a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46464/0 (socket says 172.21.15.52:46464) 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.390+0000 7fd494a00640 1 -- 172.21.15.52:0/497873537 learned_addr learned my addr 172.21.15.52:0/497873537 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd495400640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49006bc10 0x7fd49015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd495e00640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4900b00f0 0x7fd4900af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 -- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4900b00f0 msgr2=0x7fd4900af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4900b00f0 0x7fd4900af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 -- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49006bc10 msgr2=0x7fd49015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49006bc10 0x7fd49015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 -- 172.21.15.52:0/497873537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd490152590 con 0x7fd4900705f0 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd494a00640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c4d0 tx=0x7fd47c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd48d600640 1 -- 172.21.15.52:0/497873537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c018070 con 0x7fd4900705f0 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.391+0000 7fd48d600640 1 -- 172.21.15.52:0/497873537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c0074e0 con 0x7fd4900705f0 2024-09-10T08:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.392+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd490156d40 con 0x7fd4900705f0 2024-09-10T08:31:49.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.392+0000 7fd48d600640 1 -- 172.21.15.52:0/497873537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c004a20 con 0x7fd4900705f0 2024-09-10T08:31:49.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.392+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4901575e0 con 0x7fd4900705f0 2024-09-10T08:31:49.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.395+0000 7fd48d600640 1 -- 172.21.15.52:0/497873537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd47c01b070 con 0x7fd4900705f0 2024-09-10T08:31:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.395+0000 7fd48d600640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 0x7fd47006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.395+0000 7fd48d600640 1 -- 172.21.15.52:0/497873537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd47c08a170 con 0x7fd4900705f0 2024-09-10T08:31:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.396+0000 7fd49ac4c740 1 Processor -- start 2024-09-10T08:31:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.396+0000 7fd49ac4c740 1 -- start start 2024-09-10T08:31:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.396+0000 7fd495400640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 0x7fd47006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca540b90 0x5616ca53fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca53ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5616ca4a85e0 con 0x5616ca545490 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5616ca4504d0 con 0x5616ca540b90 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5616ca4a45a0 con 0x5616ca542c50 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 0x7fd47006e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd484034000 tx=0x7fd48402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46472/0 (socket says 172.21.15.52:46472) 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 -- 172.21.15.52:0/1464112684 learned_addr learned my addr 172.21.15.52:0/1464112684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd494a00640 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca540b90 0x5616ca53fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495e00640 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca53ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 -- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 msgr2=0x5616ca53ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca53ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 -- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca540b90 msgr2=0x5616ca53fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca540b90 0x5616ca53fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.397+0000 7fd495400640 1 -- 172.21.15.52:0/1464112684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616ca1bb6b0 con 0x5616ca545490 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.398+0000 7fd495400640 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd484009890 tx=0x7fd48402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d9303382756e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.398+0000 7fd481c00640 1 -- 172.21.15.52:0/1464112684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484037040 con 0x5616ca545490 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.398+0000 7fd481c00640 1 -- 172.21.15.52:0/1464112684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48404c070 con 0x5616ca545490 2024-09-10T08:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.398+0000 7fd481c00640 1 -- 172.21.15.52:0/1464112684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48403c440 con 0x5616ca545490 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 -- 172.21.15.52:0/1464112684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 msgr2=0x5616ca545870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd484009890 tx=0x7fd48402c000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 -- 172.21.15.52:0/1464112684 shutdown_connections 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca53ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca540b90 0x5616ca53fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/1464112684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca545870 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 -- 172.21.15.52:0/1464112684 >> 172.21.15.52:0/1464112684 conn(0x5616ca541c50 msgr2=0x5616ca58a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 -- 172.21.15.52:0/1464112684 shutdown_connections 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.399+0000 7fd49ac4c740 1 -- 172.21.15.52:0/1464112684 wait complete. 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.400+0000 7fd49ac4c740 1 -- start start 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.400+0000 7fd49ac4c740 1 Processor -- start 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca545490 0x5616ca582ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5616ca56fd20 con 0x5616ca5831e0 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5616ca431600 con 0x5616ca542c50 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5616ca58aa20 con 0x5616ca545490 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd49ac4c740 10 client.0 _ll_register_callbacks cb 0x5616ca455520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46474/0 (socket says 172.21.15.52:46474) 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 -- 172.21.15.52:0/2173245563 learned_addr learned my addr 172.21.15.52:0/2173245563 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495400640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd494a00640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca545490 0x5616ca582ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 -- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca545490 msgr2=0x5616ca582ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca545490 0x5616ca582ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 -- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 msgr2=0x5616ca5804c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5804c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.401+0000 7fd495e00640 1 -- 172.21.15.52:0/2173245563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ca285a90 con 0x5616ca5831e0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd495e00640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd488012590 tx=0x7fd488012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebe14c00793a40e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd476000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488019020 con 0x5616ca5831e0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd488003b80 con 0x5616ca5831e0 2024-09-10T08:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd48404c070 con 0x5616ca5831e0 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd488023050 con 0x5616ca5831e0 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd49ac4c740 10 client.5439 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.402+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5616ca59bb30 con 0x5616ca5831e0 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48404c070 con 0x5616ca5831e0 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd488026020 con 0x5616ca5831e0 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 10 client.5439 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 10 client.5439 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 20 client.5439 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca585c00 0x5616ca586010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 4 client.5439 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616ca4b5d10 con 0x5616ca585c00 2024-09-10T08:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.403+0000 7fd495400640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca585c00 0x5616ca586010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.404+0000 7fd495400640 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca585c00 0x5616ca586010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe529e87cb054252 server_cookie=868f047594a1c008 in_seq=0 out_seq=0 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.404+0000 7fd476000640 10 client.5439 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.404+0000 7fd476000640 1 -- 172.21.15.52:0/2173245563 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616ca4b5d10 con 0x5616ca585c00 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.404+0000 7fd476000640 10 client.5439 handle_command_reply: tid=0 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.404+0000 7fd49ac4c740 1 client.5439 shutdown 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 msgr2=0x5616ca5870a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd488012590 tx=0x7fd488012a50 comp rx=0 tx=0).stop 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 shutdown_connections 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca585c00 0x5616ca586010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca5870a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca545490 0x5616ca582ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/2173245563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5804c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd476000640 0 client.5439 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 >> 172.21.15.52:0/2173245563 conn(0x5616ca540b90 msgr2=0x5616ca58af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 shutdown_connections 2024-09-10T08:31:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 1 -- 172.21.15.52:0/2173245563 wait complete. 2024-09-10T08:31:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.405+0000 7fd49ac4c740 20 client.5439 trim_cache size 0 max 16384 2024-09-10T08:31:49.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.420+0000 7fd49ac4c740 1 Processor -- start 2024-09-10T08:31:49.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 -- start start 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca580350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca545490 0x5616ca58b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd490200a40 con 0x5616ca5831e0 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd4901ffb30 con 0x5616ca545490 2024-09-10T08:31:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.421+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd4901f4710 con 0x5616ca542c50 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46490/0 (socket says 172.21.15.52:46490) 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 -- 172.21.15.52:0/3377402121 learned_addr learned my addr 172.21.15.52:0/3377402121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495400640 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca580350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd494a00640 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca545490 0x5616ca58b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 -- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 msgr2=0x5616ca580350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca580350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 -- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca545490 msgr2=0x5616ca58b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca545490 0x5616ca58b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.422+0000 7fd495e00640 1 -- 172.21.15.52:0/3377402121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616ca58bfb0 con 0x5616ca5831e0 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd495e00640 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd488000f80 tx=0x7fd48800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde62e996e6578f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd481200640 1 -- 172.21.15.52:0/3377402121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488019070 con 0x5616ca5831e0 2024-09-10T08:31:49.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd481200640 1 -- 172.21.15.52:0/3377402121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48802c070 con 0x5616ca5831e0 2024-09-10T08:31:49.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd481200640 1 -- 172.21.15.52:0/3377402121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488006d50 con 0x5616ca5831e0 2024-09-10T08:31:49.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3377402121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 msgr2=0x5616ca58b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd488000f80 tx=0x7fd48800c000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3377402121 shutdown_connections 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca5831e0 0x5616ca58b550 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca545490 0x5616ca58b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3377402121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca542c50 0x5616ca580350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3377402121 >> 172.21.15.52:0/3377402121 conn(0x5616ca540b90 msgr2=0x5616ca58a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3377402121 shutdown_connections 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.423+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3377402121 wait complete. 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.424+0000 7fd49ac4c740 1 -- start start 2024-09-10T08:31:49.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.424+0000 7fd49ac4c740 1 Processor -- start 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca5831e0 0x5616ca57fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4901f4d60 con 0x5616ca545490 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5616ca584600 con 0x5616ca542c50 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5616ca5ab380 con 0x5616ca5831e0 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd49ac4c740 10 client.0 _ll_register_callbacks cb 0x7fd488001990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd494a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd494a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46496/0 (socket says 172.21.15.52:46496) 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.425+0000 7fd494a00640 1 -- 172.21.15.52:0/3239983870 learned_addr learned my addr 172.21.15.52:0/3239983870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd495e00640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca5831e0 0x5616ca57fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd495400640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 -- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca5831e0 msgr2=0x5616ca57fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca5831e0 0x5616ca57fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 -- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 msgr2=0x5616ca5a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 -- 172.21.15.52:0/3239983870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ca5adde0 con 0x5616ca545490 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd494a00640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0885a0 tx=0x7fd47c0584f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2bdbc56029dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd476000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c088300 con 0x5616ca545490 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd48802c070 con 0x5616ca545490 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd47c004bc0 con 0x5616ca545490 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.426+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd47c076050 con 0x5616ca545490 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 10 client.5445 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5616ca5f2080 con 0x5616ca545490 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48802c070 con 0x5616ca545490 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd47c077240 con 0x5616ca545490 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 10 client.5445 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 10 client.5445 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 20 client.5445 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca580350 0x5616ca5aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 4 client.5445 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5616ca58d5d0 con 0x5616ca580350 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.427+0000 7fd495400640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca580350 0x5616ca5aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.428+0000 7fd495400640 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca580350 0x5616ca5aa390 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ceaacfdd26857d server_cookie=de67701238435178 in_seq=0 out_seq=0 2024-09-10T08:31:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.428+0000 7fd476000640 10 client.5445 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd476000640 1 -- 172.21.15.52:0/3239983870 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5616ca58d5d0 con 0x5616ca580350 2024-09-10T08:31:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd476000640 10 client.5445 handle_command_reply: tid=0 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 client.5445 shutdown 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 msgr2=0x5616ca5eb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0885a0 tx=0x7fd47c0584f0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 shutdown_connections 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5616ca580350 0x5616ca5aa390 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5616ca5831e0 0x5616ca57fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5616ca545490 0x5616ca5eb4b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd476000640 0 client.5445 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 --2- 172.21.15.52:0/3239983870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5616ca542c50 0x5616ca5a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 >> 172.21.15.52:0/3239983870 conn(0x5616ca540b90 msgr2=0x5616ca58d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 shutdown_connections 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 1 -- 172.21.15.52:0/3239983870 wait complete. 2024-09-10T08:31:49.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.431+0000 7fd49ac4c740 20 client.5445 trim_cache size 0 max 16384 2024-09-10T08:31:49.435 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:49.435 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:49.435 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:49.435 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 msgr2=0x7fd47006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 0x7fd47006e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd484034000 tx=0x7fd48402e000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 msgr2=0x7fd490147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00c4d0 tx=0x7fd47c00c990 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 shutdown_connections 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd47006be30 0x7fd47006e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd4900b00f0 0x7fd4900af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4900705f0 0x7fd490147c40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 --2- 172.21.15.52:0/497873537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd49006bc10 0x7fd49015fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 >> 172.21.15.52:0/497873537 conn(0x7fd4900d12e0 msgr2=0x7fd490072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 shutdown_connections 2024-09-10T08:31:49.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.432+0000 7fd496800640 1 -- 172.21.15.52:0/497873537 wait complete. 2024-09-10T08:31:49.447 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:49.447 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T08:31:49.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-10T08:31:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.607+0000 7fc839200640 1 Processor -- start 2024-09-10T08:31:49.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.608+0000 7fc839200640 1 -- start start 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc839200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 0x7fc8340b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc839200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83415f3e0 con 0x7fc8340b4560 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc839200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83415f6b0 con 0x7fc8340b4a70 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc839200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc83415fc70 con 0x7fc83415c270 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc82be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc8340b4560 0x7fc83415ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51554/0 (socket says 172.21.15.52:51554) 2024-09-10T08:31:49.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc82be00640 1 -- 172.21.15.52:0/270870908 learned_addr learned my addr 172.21.15.52:0/270870908 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:49.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.609+0000 7fc831e00640 1 --2- 172.21.15.52:0/270870908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 0x7fc8340b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674915315 0 0) 0x7fc83415f3e0 con 0x7fc8340b4560 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc818003520 con 0x7fc8340b4560 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237440193 0 0) 0x7fc83415f6b0 con 0x7fc8340b4a70 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc83415f3e0 con 0x7fc8340b4a70 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831e00640 1 -- 172.21.15.52:0/270870908 >> v1:172.21.15.176:6789/0 conn(0x7fc8340b4a70 legacy=0x7fc83406e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831e00640 1 -- 172.21.15.52:0/270870908 >> v1:172.21.15.52:6789/0 conn(0x7fc8340b4560 legacy=0x7fc83415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3424673649 0 0) 0x7fc818003520 con 0x7fc8340b4560 2024-09-10T08:31:49.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.610+0000 7fc831e00640 1 -- 172.21.15.52:0/270870908 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83415f990 con 0x7fc83415c270 2024-09-10T08:31:49.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.611+0000 7fc831e00640 1 --2- 172.21.15.52:0/270870908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 0x7fc8340b4020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef8eaf0bc2d58555 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824037070 con 0x7fc83415c270 2024-09-10T08:31:49.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82402ab90 con 0x7fc83415c270 2024-09-10T08:31:49.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc831400640 1 -- 172.21.15.52:0/270870908 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c001670 con 0x7fc83415c270 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 -- 172.21.15.52:0/270870908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 msgr2=0x7fc8340b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 --2- 172.21.15.52:0/270870908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 0x7fc8340b4020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402a100 comp rx=0 tx=0).stop 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 -- 172.21.15.52:0/270870908 shutdown_connections 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 --2- 172.21.15.52:0/270870908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc83415c270 0x7fc8340b4020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 -- 172.21.15.52:0/270870908 >> 172.21.15.52:0/270870908 conn(0x7fc834067fe0 msgr2=0x7fc83406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 -- 172.21.15.52:0/270870908 shutdown_connections 2024-09-10T08:31:49.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.612+0000 7fc839200640 1 -- 172.21.15.52:0/270870908 wait complete. 2024-09-10T08:31:49.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.614+0000 7fc839200640 1 Processor -- start 2024-09-10T08:31:49.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.614+0000 7fc839200640 1 -- start start 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8340b4a70 0x7fc8341f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc83415c270 0x7fc8341602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc83415c650 con 0x7fc83415d330 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8340b3b00 con 0x7fc83415c270 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc839200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc83406e810 con 0x7fc8340b4a70 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46506/0 (socket says 172.21.15.52:46506) 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc832800640 1 -- 172.21.15.52:0/4202616668 learned_addr learned my addr 172.21.15.52:0/4202616668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc831e00640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8340b4a70 0x7fc8341f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.615+0000 7fc82be00640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc83415c270 0x7fc8341602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 -- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8340b4a70 msgr2=0x7fc8341f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8340b4a70 0x7fc8341f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 -- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc83415c270 msgr2=0x7fc8341602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc83415c270 0x7fc8341602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 -- 172.21.15.52:0/4202616668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8340aa7d0 con 0x7fc83415d330 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc832800640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00c7a0 tx=0x7fc82c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc82a000640 1 -- 172.21.15.52:0/4202616668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c003b70 con 0x7fc83415d330 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8340aaab0 con 0x7fc83415d330 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.616+0000 7fc82a000640 1 -- 172.21.15.52:0/4202616668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c003d10 con 0x7fc83415d330 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.617+0000 7fc82a000640 1 -- 172.21.15.52:0/4202616668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00aa90 con 0x7fc83415d330 2024-09-10T08:31:49.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.617+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8340ab070 con 0x7fc83415d330 2024-09-10T08:31:49.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.619+0000 7fc82a000640 1 -- 172.21.15.52:0/4202616668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc82c00ac30 con 0x7fc83415d330 2024-09-10T08:31:49.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.620+0000 7fc82a000640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.620+0000 7fc82a000640 1 -- 172.21.15.52:0/4202616668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc82c08ae00 con 0x7fc83415d330 2024-09-10T08:31:49.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.621+0000 7fc831e00640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.621+0000 7fc83bfd2740 1 Processor -- start 2024-09-10T08:31:49.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.621+0000 7fc83bfd2740 1 -- start start 2024-09-10T08:31:49.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.621+0000 7fc831e00640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc824034000 tx=0x7fc82402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6da1baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 0x55ae6d9d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d99d1c0 con 0x55ae6d9d7a90 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d9398e0 con 0x55ae6d9d3ac0 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ae6d8e1720 con 0x55ae6d9d6300 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46522/0 (socket says 172.21.15.52:46522) 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc832800640 1 -- 172.21.15.52:0/3571215200 learned_addr learned my addr 172.21.15.52:0/3571215200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc831e00640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6da1baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.622+0000 7fc82be00640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 0x55ae6d9d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 -- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 msgr2=0x55ae6da1baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6da1baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 -- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 msgr2=0x55ae6d9d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 0x55ae6d9d66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 -- 172.21.15.52:0/3571215200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6d718b00 con 0x55ae6d9d7a90 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc82be00640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 0x55ae6d9d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc832800640 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0891d0 tx=0x7fc82c058c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3193735aca7016 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc822a00640 1 -- 172.21.15.52:0/3571215200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c061b70 con 0x55ae6d9d7a90 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc822a00640 1 -- 172.21.15.52:0/3571215200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0570e0 con 0x55ae6d9d7a90 2024-09-10T08:31:49.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.623+0000 7fc822a00640 1 -- 172.21.15.52:0/3571215200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0556b0 con 0x55ae6d9d7a90 2024-09-10T08:31:49.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 -- 172.21.15.52:0/3571215200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 msgr2=0x55ae6d9d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0891d0 tx=0x7fc82c058c80 comp rx=0 tx=0).stop 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 -- 172.21.15.52:0/3571215200 shutdown_connections 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d08f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d3ac0 0x55ae6d9d66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/3571215200 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6da1baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 -- 172.21.15.52:0/3571215200 >> 172.21.15.52:0/3571215200 conn(0x55ae6d9d2ac0 msgr2=0x55ae6da1af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 -- 172.21.15.52:0/3571215200 shutdown_connections 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.624+0000 7fc83bfd2740 1 -- 172.21.15.52:0/3571215200 wait complete. 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.625+0000 7fc83bfd2740 1 -- start start 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.625+0000 7fc83bfd2740 1 Processor -- start 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d8c27f0 con 0x55ae6d9d0b80 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d9358a0 con 0x55ae6d9d7a90 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ae6d9d1f60 con 0x55ae6d9d6300 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc83bfd2740 10 client.0 _ll_register_callbacks cb 0x55ae6d8e6660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46532/0 (socket says 172.21.15.52:46532) 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 -- 172.21.15.52:0/99234130 learned_addr learned my addr 172.21.15.52:0/99234130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 -- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 msgr2=0x55ae6d9f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc831e00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc82be00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 -- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 msgr2=0x55ae6d9f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc832800640 1 -- 172.21.15.52:0/99234130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6d60c3f0 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc82be00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.626+0000 7fc831e00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc832800640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc82c058fd0 tx=0x7fc82c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8a45f58dc89c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c088070 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc82c058490 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82c0570e0 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc82c058690 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc83bfd2740 10 client.5457 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ae6d779290 con 0x55ae6d9d0b80 2024-09-10T08:31:49.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c0570e0 con 0x55ae6d9d0b80 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc82c054d90 con 0x55ae6d9d0b80 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc83bfd2740 10 client.5457 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.627+0000 7fc83bfd2740 10 client.5457 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc83bfd2740 20 client.5457 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6d9fc7e0 0x55ae6d9ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc83bfd2740 4 client.5457 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae6d947010 con 0x55ae6d9fc7e0 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc831e00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6d9fc7e0 0x55ae6d9ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc831e00640 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6d9fc7e0 0x55ae6d9ff1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616ab71ac48d2954 server_cookie=5dd70631a854c74f in_seq=0 out_seq=0 2024-09-10T08:31:49.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.628+0000 7fc817400640 10 client.5457 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc817400640 1 -- 172.21.15.52:0/99234130 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae6d947010 con 0x55ae6d9fc7e0 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc817400640 10 client.5457 handle_command_reply: tid=0 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 client.5457 shutdown 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 msgr2=0x55ae6d9fc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc82c058fd0 tx=0x7fc82c001250 comp rx=0 tx=0).stop 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 shutdown_connections 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6d9fc7e0 0x55ae6d9ff1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6d9fc2a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/99234130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc817400640 0 client.5457 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.629+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 >> 172.21.15.52:0/99234130 conn(0x55ae6d9d3ac0 msgr2=0x55ae6da1a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.630+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 shutdown_connections 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.630+0000 7fc83bfd2740 1 -- 172.21.15.52:0/99234130 wait complete. 2024-09-10T08:31:49.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.630+0000 7fc83bfd2740 20 client.5457 trim_cache size 0 max 16384 2024-09-10T08:31:49.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.648+0000 7fc83bfd2740 1 Processor -- start 2024-09-10T08:31:49.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.648+0000 7fc83bfd2740 1 -- start start 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9fd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc834200d20 con 0x55ae6d9d0b80 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8341ffd00 con 0x55ae6d9d7a90 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8340ad400 con 0x55ae6d9d6300 2024-09-10T08:31:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46538/0 (socket says 172.21.15.52:46538) 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 -- 172.21.15.52:0/4085810544 learned_addr learned my addr 172.21.15.52:0/4085810544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc82be00640 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc832800640 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 -- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 msgr2=0x55ae6d9fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 -- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 msgr2=0x55ae6d9d5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.649+0000 7fc831e00640 1 -- 172.21.15.52:0/4085810544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae6d9fc610 con 0x55ae6d9d0b80 2024-09-10T08:31:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc831e00640 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f564b74cf8ed311b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc822000640 1 -- 172.21.15.52:0/4085810544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824037040 con 0x55ae6d9d0b80 2024-09-10T08:31:49.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc822000640 1 -- 172.21.15.52:0/4085810544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc824059070 con 0x55ae6d9d0b80 2024-09-10T08:31:49.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc822000640 1 -- 172.21.15.52:0/4085810544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824053590 con 0x55ae6d9d0b80 2024-09-10T08:31:49.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 -- 172.21.15.52:0/4085810544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 msgr2=0x55ae6da3f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc8240097d0 tx=0x7fc82402c000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 -- 172.21.15.52:0/4085810544 shutdown_connections 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6d9d5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d6300 0x55ae6d9fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/4085810544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d0b80 0x55ae6da3f130 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.650+0000 7fc83bfd2740 1 -- 172.21.15.52:0/4085810544 >> 172.21.15.52:0/4085810544 conn(0x55ae6d9d3ac0 msgr2=0x55ae6d9d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.651+0000 7fc83bfd2740 1 -- 172.21.15.52:0/4085810544 shutdown_connections 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.651+0000 7fc83bfd2740 1 -- 172.21.15.52:0/4085810544 wait complete. 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.651+0000 7fc83bfd2740 1 -- start start 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.651+0000 7fc83bfd2740 1 Processor -- start 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d0b80 0x55ae6da9e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6daa0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ae6d9d19b0 con 0x55ae6d9d6300 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8340ada50 con 0x55ae6d9d7a90 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ae6da1a210 con 0x55ae6d9d0b80 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc83bfd2740 10 client.0 _ll_register_callbacks cb 0x7fc82c061b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.652+0000 7fc82be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46554/0 (socket says 172.21.15.52:46554) 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 -- 172.21.15.52:0/2706190225 learned_addr learned my addr 172.21.15.52:0/2706190225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc832800640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6daa0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc831e00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d0b80 0x55ae6da9e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 -- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d0b80 msgr2=0x55ae6da9e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d0b80 0x55ae6da9e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 -- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 msgr2=0x55ae6daa0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6daa0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 -- 172.21.15.52:0/2706190225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6d5e54b0 con 0x55ae6d9d6300 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc82be00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0011e0 tx=0x7fc81c006f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85293587144fe228 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc817400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.653+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c01b070 con 0x55ae6d9d6300 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc81c014dc0 con 0x55ae6d9d6300 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc824059070 con 0x55ae6d9d6300 2024-09-10T08:31:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc81c017460 con 0x55ae6d9d6300 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 10 client.5463 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ae6da3e2e0 con 0x55ae6d9d6300 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc824059070 con 0x55ae6d9d6300 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc81c0047e0 con 0x55ae6d9d6300 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 10 client.5463 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 10 client.5463 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 20 client.5463 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6daa1050 0x55ae6d9fd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 4 client.5463 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55ae6d941360 con 0x55ae6daa1050 2024-09-10T08:31:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.654+0000 7fc831e00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6daa1050 0x55ae6d9fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.655+0000 7fc817400640 10 client.5463 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.655+0000 7fc831e00640 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6daa1050 0x55ae6d9fd210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8275a5b1e9ce0b2b server_cookie=39831edcb8b2c12d in_seq=0 out_seq=0 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc817400640 1 -- 172.21.15.52:0/2706190225 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ae6d941360 con 0x55ae6daa1050 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc817400640 10 client.5463 handle_command_reply: tid=0 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 client.5463 shutdown 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 msgr2=0x55ae6da3e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0011e0 tx=0x7fc81c006f30 comp rx=0 tx=0).stop 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 shutdown_connections 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ae6daa1050 0x55ae6d9fd210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ae6d9d7a90 0x55ae6daa0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ae6d9d6300 0x55ae6da3e800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 --2- 172.21.15.52:0/2706190225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ae6d9d0b80 0x55ae6da9e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc817400640 0 client.5463 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 >> 172.21.15.52:0/2706190225 conn(0x55ae6d9d3ac0 msgr2=0x55ae6da3f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 shutdown_connections 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 1 -- 172.21.15.52:0/2706190225 wait complete. 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.656+0000 7fc83bfd2740 20 client.5463 trim_cache size 0 max 16384 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:49.663 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "8c7d96a8-76ad-4edf-a335-5c4968936c15", 2024-09-10T08:31:49.664 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:49.664 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:49.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 msgr2=0x7fc81006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc824034000 tx=0x7fc82402e000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 msgr2=0x7fc83415d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00c7a0 tx=0x7fc82c00cc60 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 shutdown_connections 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc83415d330 0x7fc83415d7c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc83415c270 0x7fc8341602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 --2- 172.21.15.52:0/4202616668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8340b4a70 0x7fc8341f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 >> 172.21.15.52:0/4202616668 conn(0x7fc834067fe0 msgr2=0x7fc834072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 shutdown_connections 2024-09-10T08:31:49.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.657+0000 7fc839200640 1 -- 172.21.15.52:0/4202616668 wait complete. 2024-09-10T08:31:49.672 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '8c7d96a8-76ad-4edf-a335-5c4968936c15', 'mode': 'asynchronous'}' 2024-09-10T08:31:49.672 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T08:31:49.672 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T08:31:49.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T08:31:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.832+0000 7fc837600640 1 Processor -- start 2024-09-10T08:31:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.832+0000 7fc837600640 1 -- start start 2024-09-10T08:31:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.833+0000 7fc837600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc8300cf8d0 0x7fc830070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.833+0000 7fc837600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.833+0000 7fc837600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83015f120 con 0x7fc830144340 2024-09-10T08:31:49.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.833+0000 7fc837600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc830141cd0 con 0x7fc8300cf8d0 2024-09-10T08:31:49.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.833+0000 7fc837600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc83015f400 con 0x7fc8300cfcb0 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53340/0 (socket says 172.21.15.52:53340) 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 -- 172.21.15.52:0/1925086215 learned_addr learned my addr 172.21.15.52:0/1925086215 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc835600640 1 --1- 172.21.15.52:0/1925086215 >> v1:172.21.15.176:6789/0 conn(0x7fc830144340 0x7fc8301447d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41248/0 (socket says 172.21.15.52:41248) 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc834c00640 1 --2- 172.21.15.52:0/1925086215 >> v2:172.21.15.176:3300/0 conn(0x7fc8300cf8d0 0x7fc830070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 -- 172.21.15.52:0/1925086215 >> v2:172.21.15.176:3300/0 conn(0x7fc8300cf8d0 msgr2=0x7fc830070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 --2- 172.21.15.52:0/1925086215 >> v2:172.21.15.176:3300/0 conn(0x7fc8300cf8d0 0x7fc830070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 -- 172.21.15.52:0/1925086215 >> v1:172.21.15.176:6789/0 conn(0x7fc830144340 legacy=0x7fc8301447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.834+0000 7fc827e00640 1 -- 172.21.15.52:0/1925086215 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83015f6e0 con 0x7fc8300cfcb0 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.835+0000 7fc827e00640 1 --2- 172.21.15.52:0/1925086215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc818009870 tx=0x7fc81802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f03cbede8b1684 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.835+0000 7fc82fe00640 1 -- 172.21.15.52:0/1925086215 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818037070 con 0x7fc8300cfcb0 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc82fe00640 1 -- 172.21.15.52:0/1925086215 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818032440 con 0x7fc8300cfcb0 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc82fe00640 1 -- 172.21.15.52:0/1925086215 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818032810 con 0x7fc8300cfcb0 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 -- 172.21.15.52:0/1925086215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 msgr2=0x7fc830071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 --2- 172.21.15.52:0/1925086215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc818009870 tx=0x7fc81802a270 comp rx=0 tx=0).stop 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 -- 172.21.15.52:0/1925086215 shutdown_connections 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 --2- 172.21.15.52:0/1925086215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8300cfcb0 0x7fc830071480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 --2- 172.21.15.52:0/1925086215 >> v2:172.21.15.176:3300/0 conn(0x7fc8300cf8d0 0x7fc830070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 -- 172.21.15.52:0/1925086215 >> 172.21.15.52:0/1925086215 conn(0x7fc83006d0f0 msgr2=0x7fc83006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 -- 172.21.15.52:0/1925086215 shutdown_connections 2024-09-10T08:31:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.836+0000 7fc837600640 1 -- 172.21.15.52:0/1925086215 wait complete. 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.838+0000 7fc837600640 1 Processor -- start 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.838+0000 7fc837600640 1 -- start start 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8300cf8d0 0x7fc830158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144340 0x7fc8300ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300ce0f0 con 0x7fc8300cfcb0 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc83015ee30 con 0x7fc8300cf8d0 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc837600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300ce270 con 0x7fc830144340 2024-09-10T08:31:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc827e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc827e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46564/0 (socket says 172.21.15.52:46564) 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc827e00640 1 -- 172.21.15.52:0/487653527 learned_addr learned my addr 172.21.15.52:0/487653527 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc834c00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8300cf8d0 0x7fc830158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.839+0000 7fc835600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144340 0x7fc8300ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 -- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144340 msgr2=0x7fc8300ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144340 0x7fc8300ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 -- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8300cf8d0 msgr2=0x7fc830158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8300cf8d0 0x7fc830158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 -- 172.21.15.52:0/487653527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8300cc780 con 0x7fc8300cfcb0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc827e00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc818000c00 tx=0x7fc8180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc82d600640 1 -- 172.21.15.52:0/487653527 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818037040 con 0x7fc8300cfcb0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc82d600640 1 -- 172.21.15.52:0/487653527 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818042070 con 0x7fc8300cfcb0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc82d600640 1 -- 172.21.15.52:0/487653527 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818030940 con 0x7fc8300cfcb0 2024-09-10T08:31:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8300cca60 con 0x7fc8300cfcb0 2024-09-10T08:31:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.840+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8300cd020 con 0x7fc8300cfcb0 2024-09-10T08:31:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.842+0000 7fc82d600640 1 -- 172.21.15.52:0/487653527 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc818030ae0 con 0x7fc8300cfcb0 2024-09-10T08:31:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.844+0000 7fc82d600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.844+0000 7fc82d600640 1 -- 172.21.15.52:0/487653527 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc8180ab5b0 con 0x7fc8300cfcb0 2024-09-10T08:31:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.844+0000 7fc83a48e740 1 Processor -- start 2024-09-10T08:31:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.844+0000 7fc834c00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.845+0000 7fc83a48e740 1 -- start start 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.845+0000 7fc834c00640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8301f7f10 tx=0x7fc820009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56407234a960 0x5640723491c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072395370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5640722b1770 con 0x564072364470 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564072259840 con 0x564072394e20 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5640722ad730 con 0x56407234a960 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46578/0 (socket says 172.21.15.52:46578) 2024-09-10T08:31:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 -- 172.21.15.52:0/150856736 learned_addr learned my addr 172.21.15.52:0/150856736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc827e00640 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56407234a960 0x5640723491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc835600640 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072395370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 -- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56407234a960 msgr2=0x5640723491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56407234a960 0x5640723491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 -- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 msgr2=0x564072395370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072395370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.846+0000 7fc834c00640 1 -- 172.21.15.52:0/150856736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56407224a700 con 0x564072364470 2024-09-10T08:31:49.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.847+0000 7fc834c00640 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc820011de0 tx=0x7fc820014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299b62388a2dfbcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.847+0000 7fc825200640 1 -- 172.21.15.52:0/150856736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820025070 con 0x564072364470 2024-09-10T08:31:49.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.847+0000 7fc825200640 1 -- 172.21.15.52:0/150856736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82001b070 con 0x564072364470 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.847+0000 7fc825200640 1 -- 172.21.15.52:0/150856736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820014df0 con 0x564072364470 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 -- 172.21.15.52:0/150856736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 msgr2=0x564072364850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc820011de0 tx=0x7fc820014000 comp rx=0 tx=0).stop 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 -- 172.21.15.52:0/150856736 shutdown_connections 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072395370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56407234a960 0x5640723491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 --2- 172.21.15.52:0/150856736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072364470 0x564072364850 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 -- 172.21.15.52:0/150856736 >> 172.21.15.52:0/150856736 conn(0x56407234b390 msgr2=0x5640723939b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 -- 172.21.15.52:0/150856736 shutdown_connections 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.848+0000 7fc83a48e740 1 -- 172.21.15.52:0/150856736 wait complete. 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.849+0000 7fc83a48e740 1 -- start start 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.849+0000 7fc83a48e740 1 Processor -- start 2024-09-10T08:31:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x564072379d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072389d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5640723498c0 con 0x5640723a7610 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56407223a810 con 0x564072394e20 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564072349ba0 con 0x564072364470 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc83a48e740 10 client.0 _ll_register_callbacks cb 0x564071fc42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46590/0 (socket says 172.21.15.52:46590) 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 -- 172.21.15.52:0/2764098176 learned_addr learned my addr 172.21.15.52:0/2764098176 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc834c00640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x564072379d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc827e00640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072389d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 -- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 msgr2=0x564072379d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x564072379d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 -- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 msgr2=0x564072389d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072389d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.850+0000 7fc835600640 1 -- 172.21.15.52:0/2764098176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564071fa8ac0 con 0x5640723a7610 2024-09-10T08:31:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc835600640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc828007350 tx=0x7fc828007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1586efeac5c6f2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc81d600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828012820 con 0x5640723a7610 2024-09-10T08:31:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc8280129c0 con 0x5640723a7610 2024-09-10T08:31:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc82001b070 con 0x5640723a7610 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc828022050 con 0x5640723a7610 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc83a48e740 10 client.5472 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564071fc4ac0 con 0x5640723a7610 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.851+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82001b070 con 0x5640723a7610 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc828025020 con 0x5640723a7610 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 10 client.5472 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 10 client.5472 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 20 client.5472 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56407238e220 0x56407238e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 4 client.5472 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640722beea0 con 0x56407238e220 2024-09-10T08:31:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc834c00640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56407238e220 0x56407238e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc834c00640 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56407238e220 0x56407238e650 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b37eebc9555b0a0e server_cookie=55093071c873b4c7 in_seq=0 out_seq=0 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.852+0000 7fc81d600640 10 client.5472 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc81d600640 1 -- 172.21.15.52:0/2764098176 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640722beea0 con 0x56407238e220 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc81d600640 10 client.5472 handle_command_reply: tid=0 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 client.5472 shutdown 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 msgr2=0x5640723a7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc828007350 tx=0x7fc828007750 comp rx=0 tx=0).stop 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 shutdown_connections 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56407238e220 0x56407238e650 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x5640723a7a30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x564072389d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2764098176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x564072379d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc81d600640 0 client.5472 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.853+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 >> 172.21.15.52:0/2764098176 conn(0x56407234a960 msgr2=0x56407234c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.854+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 shutdown_connections 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.854+0000 7fc83a48e740 1 -- 172.21.15.52:0/2764098176 wait complete. 2024-09-10T08:31:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.854+0000 7fc83a48e740 20 client.5472 trim_cache size 0 max 16384 2024-09-10T08:31:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.869+0000 7fc83a48e740 1 Processor -- start 2024-09-10T08:31:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.869+0000 7fc83a48e740 1 -- start start 2024-09-10T08:31:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x56407237a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 0x5640723b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc830200c80 con 0x564072394e20 2024-09-10T08:31:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc83013cde0 con 0x5640723a7610 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc83013c140 con 0x564072364470 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc827e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc827e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46602/0 (socket says 172.21.15.52:46602) 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.870+0000 7fc827e00640 1 -- 172.21.15.52:0/2789861384 learned_addr learned my addr 172.21.15.52:0/2789861384 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc834c00640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x56407237a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 -- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 msgr2=0x56407237a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x56407237a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 -- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 msgr2=0x5640723b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc835600640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 0x5640723b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 0x5640723b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 -- 172.21.15.52:0/2789861384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564072090ed0 con 0x564072394e20 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc834c00640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x56407237a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc835600640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 0x5640723b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc827e00640 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc818079890 tx=0x7fc8180ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d11add69312bba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc81fe00640 1 -- 172.21.15.52:0/2789861384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818079900 con 0x564072394e20 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc81fe00640 1 -- 172.21.15.52:0/2789861384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81807dc00 con 0x564072394e20 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.871+0000 7fc81fe00640 1 -- 172.21.15.52:0/2789861384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818082430 con 0x564072394e20 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- 172.21.15.52:0/2789861384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 msgr2=0x56407237ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc818079890 tx=0x7fc8180ab040 comp rx=0 tx=0).stop 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- 172.21.15.52:0/2789861384 shutdown_connections 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640723a7610 0x5640723b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564072394e20 0x56407237ac60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 --2- 172.21.15.52:0/2789861384 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x56407237a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- 172.21.15.52:0/2789861384 >> 172.21.15.52:0/2789861384 conn(0x56407234a960 msgr2=0x5640723958c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- 172.21.15.52:0/2789861384 shutdown_connections 2024-09-10T08:31:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- 172.21.15.52:0/2789861384 wait complete. 2024-09-10T08:31:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.872+0000 7fc83a48e740 1 -- start start 2024-09-10T08:31:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.873+0000 7fc83a48e740 1 Processor -- start 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x5640723faf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x56407234eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc83013c790 con 0x5640723a7610 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5640723fb8e0 con 0x564072394e20 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5640723fb440 con 0x564072364470 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc83a48e740 10 client.0 _ll_register_callbacks cb 0x7fc828004d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46612/0 (socket says 172.21.15.52:46612) 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 -- 172.21.15.52:0/769500960 learned_addr learned my addr 172.21.15.52:0/769500960 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc834c00640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x5640723faf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc827e00640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x56407234eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 -- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 msgr2=0x5640723faf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x5640723faf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 -- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 msgr2=0x56407234eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x56407234eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc835600640 1 -- 172.21.15.52:0/769500960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564072392880 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.874+0000 7fc827e00640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x56407234eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc835600640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc828012b90 tx=0x7fc8280014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff5a68f71410a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc81d600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828007c80 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc82802fab0 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc81807dc00 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc82802fcf0 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc83a48e740 10 client.5478 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x56407234f130 con 0x5640723a7610 2024-09-10T08:31:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.875+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81807dc00 con 0x5640723a7610 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc828036050 con 0x5640723a7610 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 10 client.5478 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 10 client.5478 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 20 client.5478 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5640723a4200 0x5640723a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 4 client.5478 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x564072396940 con 0x5640723a4200 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc834c00640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5640723a4200 0x5640723a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc834c00640 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5640723a4200 0x5640723a4610 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe624e53d69e647 server_cookie=e484ec9c1383f5a2 in_seq=0 out_seq=0 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.876+0000 7fc81d600640 10 client.5478 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc81d600640 1 -- 172.21.15.52:0/769500960 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564072396940 con 0x5640723a4200 2024-09-10T08:31:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc81d600640 10 client.5478 handle_command_reply: tid=0 2024-09-10T08:31:49.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 client.5478 shutdown 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 msgr2=0x564072392bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc828012b90 tx=0x7fc8280014a0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 shutdown_connections 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5640723a4200 0x5640723a4610 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640723a7610 0x564072392bc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564072394e20 0x56407234eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc81d600640 0 client.5478 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 --2- 172.21.15.52:0/769500960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564072364470 0x5640723faf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 >> 172.21.15.52:0/769500960 conn(0x56407234a960 msgr2=0x56407237ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 shutdown_connections 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 1 -- 172.21.15.52:0/769500960 wait complete. 2024-09-10T08:31:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.880+0000 7fc83a48e740 20 client.5478 trim_cache size 0 max 16384 2024-09-10T08:31:49.886 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:49.886 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:49.886 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:49.886 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 msgr2=0x7fc80c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc8301f7f10 tx=0x7fc820009190 comp rx=0 tx=0).stop 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 msgr2=0x7fc8300c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc818000c00 tx=0x7fc8180046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 shutdown_connections 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc80c06be30 0x7fc80c06e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc830144340 0x7fc8300ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8300cfcb0 0x7fc8300c9b70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 --2- 172.21.15.52:0/487653527 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8300cf8d0 0x7fc830158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 >> 172.21.15.52:0/487653527 conn(0x7fc83006d0f0 msgr2=0x7fc830071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 shutdown_connections 2024-09-10T08:31:49.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:49.881+0000 7fc837600640 1 -- 172.21.15.52:0/487653527 wait complete. 2024-09-10T08:31:49.896 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:49.896 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T08:31:49.896 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T08:31:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.055+0000 7f20e6a00640 1 Processor -- start 2024-09-10T08:31:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.055+0000 7f20e6a00640 1 -- start start 2024-09-10T08:31:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.056+0000 7f20e6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20e00d32c0 0x7f20e00cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.056+0000 7f20e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00b7c10 0x7f20e00b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.056+0000 7f20e6a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e00d36e0 con 0x7f20e00b5fd0 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.056+0000 7f20e6a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f20e00d3950 con 0x7f20e00d32c0 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.056+0000 7f20e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00d3c30 con 0x7f20e00b7c10 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20e00d32c0 0x7f20e00cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20e00d32c0 0x7f20e00cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46622/0 (socket says 172.21.15.52:46622) 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 -- 172.21.15.52:0/1093811566 learned_addr learned my addr 172.21.15.52:0/1093811566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e6000640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00b7c10 0x7f20e00b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 -- 172.21.15.52:0/1093811566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00b7c10 msgr2=0x7f20e00b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00b7c10 0x7f20e00b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 -- 172.21.15.52:0/1093811566 >> v1:172.21.15.176:6789/0 conn(0x7f20e00b5fd0 legacy=0x7f20e00b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.057+0000 7f20e4c00640 1 -- 172.21.15.52:0/1093811566 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00d3f10 con 0x7f20e00d32c0 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.058+0000 7f20e4c00640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00d32c0 0x7f20e00cf650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009870 tx=0x7f20cc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96fe508bc8e48f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.058+0000 7f20dfe00640 1 -- 172.21.15.52:0/1093811566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc037070 con 0x7f20e00d32c0 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20dfe00640 1 -- 172.21.15.52:0/1093811566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc02ae50 con 0x7f20e00d32c0 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20dfe00640 1 -- 172.21.15.52:0/1093811566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc032860 con 0x7f20e00d32c0 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 -- 172.21.15.52:0/1093811566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00d32c0 msgr2=0x7f20e00cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00d32c0 0x7f20e00cf650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009870 tx=0x7f20cc02a300 comp rx=0 tx=0).stop 2024-09-10T08:31:50.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 -- 172.21.15.52:0/1093811566 shutdown_connections 2024-09-10T08:31:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00b7c10 0x7f20e00b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 --2- 172.21.15.52:0/1093811566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00d32c0 0x7f20e00cf650 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 -- 172.21.15.52:0/1093811566 >> 172.21.15.52:0/1093811566 conn(0x7f20e00d0fd0 msgr2=0x7f20e00d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 -- 172.21.15.52:0/1093811566 shutdown_connections 2024-09-10T08:31:50.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.059+0000 7f20e6a00640 1 -- 172.21.15.52:0/1093811566 wait complete. 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.061+0000 7f20e6a00640 1 Processor -- start 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.061+0000 7f20e6a00640 1 -- start start 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00b5fd0 0x7f20e0157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00d32c0 0x7f20e00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00cfb90 con 0x7f20e00b7c10 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00b7680 con 0x7f20e00b5fd0 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00cfd10 con 0x7f20e00d32c0 2024-09-10T08:31:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46626/0 (socket says 172.21.15.52:46626) 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 -- 172.21.15.52:0/873723036 learned_addr learned my addr 172.21.15.52:0/873723036 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e5600640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00b5fd0 0x7f20e0157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e6000640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00d32c0 0x7f20e00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 -- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00d32c0 msgr2=0x7f20e00cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00d32c0 0x7f20e00cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 -- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00b5fd0 msgr2=0x7f20e0157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00b5fd0 0x7f20e0157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.062+0000 7f20e4c00640 1 -- 172.21.15.52:0/873723036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00cd2e0 con 0x7f20e00b7c10 2024-09-10T08:31:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20e4c00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f20cc000c00 tx=0x7f20cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20dd600640 1 -- 172.21.15.52:0/873723036 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc041070 con 0x7f20e00b7c10 2024-09-10T08:31:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20dd600640 1 -- 172.21.15.52:0/873723036 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc03c670 con 0x7f20e00b7c10 2024-09-10T08:31:50.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20dd600640 1 -- 172.21.15.52:0/873723036 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc037040 con 0x7f20e00b7c10 2024-09-10T08:31:50.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e00cd5c0 con 0x7f20e00b7c10 2024-09-10T08:31:50.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.063+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e015ef60 con 0x7f20e00b7c10 2024-09-10T08:31:50.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.065+0000 7f20dd600640 1 -- 172.21.15.52:0/873723036 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20cc044070 con 0x7f20e00b7c10 2024-09-10T08:31:50.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.066+0000 7f20dd600640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.066+0000 7f20dd600640 1 -- 172.21.15.52:0/873723036 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f20cc0ab5d0 con 0x7f20e00b7c10 2024-09-10T08:31:50.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.067+0000 7f20e5600640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.067+0000 7f20eb02c740 1 Processor -- start 2024-09-10T08:31:50.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.067+0000 7f20eb02c740 1 -- start start 2024-09-10T08:31:50.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.067+0000 7f20e5600640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 0x7f20c006e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f60 tx=0x7f20d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ee5a0 0x5631265ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 0x5631265ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56312648ddc0 con 0x5631265ebd60 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56312650ab20 con 0x5631265ee5a0 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5631264b2b00 con 0x5631265ec1c0 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46636/0 (socket says 172.21.15.52:46636) 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20e4c00640 1 -- 172.21.15.52:0/3978067990 learned_addr learned my addr 172.21.15.52:0/3978067990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20e6000640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 0x5631265ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.068+0000 7f20e5600640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ee5a0 0x5631265ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 -- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 msgr2=0x5631265ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 0x5631265ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 -- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ee5a0 msgr2=0x5631265ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ee5a0 0x5631265ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 -- 172.21.15.52:0/3978067990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631262e9f00 con 0x5631265ebd60 2024-09-10T08:31:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e6000640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 0x5631265ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20e4c00640 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20cc035040 tx=0x7f20cc079440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744cd4a3ef0722f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20d1c00640 1 -- 172.21.15.52:0/3978067990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc04b030 con 0x5631265ebd60 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20d1c00640 1 -- 172.21.15.52:0/3978067990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc02ae50 con 0x5631265ebd60 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.069+0000 7f20d1c00640 1 -- 172.21.15.52:0/3978067990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc082610 con 0x5631265ebd60 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 -- 172.21.15.52:0/3978067990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 msgr2=0x5631265ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20cc035040 tx=0x7f20cc079440 comp rx=0 tx=0).stop 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 -- 172.21.15.52:0/3978067990 shutdown_connections 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ec1c0 0x5631265ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ebd60 0x5631265ed8f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 --2- 172.21.15.52:0/3978067990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ee5a0 0x5631265ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 -- 172.21.15.52:0/3978067990 >> 172.21.15.52:0/3978067990 conn(0x5631265a4200 msgr2=0x5631265ec610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 -- 172.21.15.52:0/3978067990 shutdown_connections 2024-09-10T08:31:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.070+0000 7f20eb02c740 1 -- 172.21.15.52:0/3978067990 wait complete. 2024-09-10T08:31:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.071+0000 7f20eb02c740 1 -- start start 2024-09-10T08:31:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.071+0000 7f20eb02c740 1 Processor -- start 2024-09-10T08:31:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ee5a0 0x5631265cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 0x5631265cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5631264c5d20 con 0x5631265ec1c0 2024-09-10T08:31:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563126506ae0 con 0x5631265cd600 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56312648ddc0 con 0x5631265ee5a0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20eb02c740 10 client.0 _ll_register_callbacks cb 0x5631264b8180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46640/0 (socket says 172.21.15.52:46640) 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e5600640 1 -- 172.21.15.52:0/591152710 learned_addr learned my addr 172.21.15.52:0/591152710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e4c00640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ee5a0 0x5631265cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e6000640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 0x5631265cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e5600640 1 -- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ee5a0 msgr2=0x5631265cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.072+0000 7f20e5600640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ee5a0 0x5631265cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20e5600640 1 -- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 msgr2=0x5631265cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20e5600640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 0x5631265cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20e5600640 1 -- 172.21.15.52:0/591152710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631261dd7f0 con 0x5631265ec1c0 2024-09-10T08:31:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20e6000640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 0x5631265cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20e5600640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20d4014760 tx=0x7f20d4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee22f5dcba18bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20c6000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d4013680 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f20d4013820 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20cc02ae50 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f20d402e050 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20eb02c740 10 client.5490 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.073+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x56312634a690 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc02ae50 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f20d4031020 con 0x5631265ec1c0 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 10 client.5490 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 10 client.5490 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 20 client.5490 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265e7970 0x5631265e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 4 client.5490 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563126518250 con 0x5631265e7970 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20e4c00640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265e7970 0x5631265e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20e4c00640 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265e7970 0x5631265e7d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d479f3f4531a0c9d server_cookie=27c732feeeade6d0 in_seq=0 out_seq=0 2024-09-10T08:31:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.074+0000 7f20c6000640 10 client.5490 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20c6000640 1 -- 172.21.15.52:0/591152710 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563126518250 con 0x5631265e7970 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20c6000640 10 client.5490 handle_command_reply: tid=0 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 client.5490 shutdown 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 msgr2=0x5631265cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20d4014760 tx=0x7f20d4001080 comp rx=0 tx=0).stop 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 shutdown_connections 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265e7970 0x5631265e7d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265cd600 0x5631265cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265ee5a0 0x5631265cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20c6000640 0 client.5490 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 --2- 172.21.15.52:0/591152710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ec1c0 0x5631265cc2b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.075+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 >> 172.21.15.52:0/591152710 conn(0x5631265ebd60 msgr2=0x5631265ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.076+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 shutdown_connections 2024-09-10T08:31:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.076+0000 7f20eb02c740 1 -- 172.21.15.52:0/591152710 wait complete. 2024-09-10T08:31:50.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.076+0000 7f20eb02c740 20 client.5490 trim_cache size 0 max 16384 2024-09-10T08:31:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.094+0000 7f20eb02c740 1 Processor -- start 2024-09-10T08:31:50.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.094+0000 7f20eb02c740 1 -- start start 2024-09-10T08:31:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631265cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265ed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0200cd0 con 0x5631265ee5a0 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00cc3f0 con 0x5631265ec1c0 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00cb750 con 0x5631265cd600 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46648/0 (socket says 172.21.15.52:46648) 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20e6000640 1 -- 172.21.15.52:0/2947174579 learned_addr learned my addr 172.21.15.52:0/2947174579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20e4c00640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.095+0000 7f20e5600640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631265cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 -- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 msgr2=0x5631265cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631265cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 -- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 msgr2=0x5631265ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 -- 172.21.15.52:0/2947174579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631261b68b0 con 0x5631265ee5a0 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e4c00640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20e6000640 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009f70 tx=0x7f20d8003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbb3e949f29c8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20d1200640 1 -- 172.21.15.52:0/2947174579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d801a020 con 0x5631265ee5a0 2024-09-10T08:31:50.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20d1200640 1 -- 172.21.15.52:0/2947174579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d8004600 con 0x5631265ee5a0 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.096+0000 7f20d1200640 1 -- 172.21.15.52:0/2947174579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8016400 con 0x5631265ee5a0 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- 172.21.15.52:0/2947174579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 msgr2=0x5631265efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009f70 tx=0x7f20d8003e20 comp rx=0 tx=0).stop 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- 172.21.15.52:0/2947174579 shutdown_connections 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265efb80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 --2- 172.21.15.52:0/2947174579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631265cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- 172.21.15.52:0/2947174579 >> 172.21.15.52:0/2947174579 conn(0x5631265ebd60 msgr2=0x5631265eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- 172.21.15.52:0/2947174579 shutdown_connections 2024-09-10T08:31:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- 172.21.15.52:0/2947174579 wait complete. 2024-09-10T08:31:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.097+0000 7f20eb02c740 1 -- start start 2024-09-10T08:31:50.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 Processor -- start 2024-09-10T08:31:50.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631266621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265efb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00cbda0 con 0x5631265ee5a0 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5631265cda60 con 0x5631265ec1c0 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.098+0000 7f20eb02c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563126602e40 con 0x5631265cd600 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20eb02c740 10 client.0 _ll_register_callbacks cb 0x7f20d4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46662/0 (socket says 172.21.15.52:46662) 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 -- 172.21.15.52:0/136344697 learned_addr learned my addr 172.21.15.52:0/136344697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e5600640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631266621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e4c00640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 -- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 msgr2=0x5631266621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631266621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 -- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 msgr2=0x5631265efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 -- 172.21.15.52:0/136344697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56312666eb50 con 0x5631265ee5a0 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e4c00640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.099+0000 7f20e6000640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f20d8018000 tx=0x7f20d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2588d40fde11e4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8029630 con 0x5631265ee5a0 2024-09-10T08:31:50.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f20d80297d0 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d8004600 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f20d80299d0 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 10 client.5496 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x563126602c40 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d8004600 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f20d8016400 con 0x5631265ee5a0 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 10 client.5496 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 10 client.5496 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 20 client.5496 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265cc4e0 0x5631265a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 4 client.5496 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.100+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x5631265125a0 con 0x5631265cc4e0 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.101+0000 7f20e5600640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265cc4e0 0x5631265a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.101+0000 7f20e5600640 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265cc4e0 0x5631265a1250 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ebc7a8e5570458 server_cookie=cf3c1889a7f0d94e in_seq=0 out_seq=0 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.101+0000 7f20c6000640 10 client.5496 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20c6000640 1 -- 172.21.15.52:0/136344697 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631265125a0 con 0x5631265cc4e0 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20c6000640 10 client.5496 handle_command_reply: tid=0 2024-09-10T08:31:50.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 client.5496 shutdown 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 msgr2=0x5631265f00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f20d8018000 tx=0x7f20d8004ab0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 shutdown_connections 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5631265cc4e0 0x5631265a1250 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5631265ee5a0 0x5631265f00c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5631265ec1c0 0x5631265efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 --2- 172.21.15.52:0/136344697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5631265cd600 0x5631266621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 >> 172.21.15.52:0/136344697 conn(0x5631265ebd60 msgr2=0x5631265eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20c6000640 0 client.5496 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 shutdown_connections 2024-09-10T08:31:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 1 -- 172.21.15.52:0/136344697 wait complete. 2024-09-10T08:31:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.102+0000 7f20eb02c740 20 client.5496 trim_cache size 0 max 16384 2024-09-10T08:31:50.114 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:50.114 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:50.114 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "84dc06c4-babf-4a45-8e55-c7f01574b414", 2024-09-10T08:31:50.114 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:50.114 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 msgr2=0x7f20c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 0x7f20c006e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f60 tx=0x7f20d4009040 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 msgr2=0x7f20e015f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f20cc000c00 tx=0x7f20cc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 shutdown_connections 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f20c006be60 0x7f20c006e320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20e00d32c0 0x7f20e00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e00b7c10 0x7f20e015f760 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 --2- 172.21.15.52:0/873723036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20e00b5fd0 0x7f20e0157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 >> 172.21.15.52:0/873723036 conn(0x7f20e00d0fd0 msgr2=0x7f20e00b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 shutdown_connections 2024-09-10T08:31:50.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.103+0000 7f20e6a00640 1 -- 172.21.15.52:0/873723036 wait complete. 2024-09-10T08:31:50.119 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '84dc06c4-babf-4a45-8e55-c7f01574b414', 'mode': 'asynchronous'}' 2024-09-10T08:31:50.119 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-10T08:31:50.119 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T08:31:50.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T08:31:50.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.277+0000 7f4b67400640 1 Processor -- start 2024-09-10T08:31:50.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.278+0000 7f4b67400640 1 -- start start 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b67400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b60072ad0 0x7f4b600b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b67400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600cf2e0 con 0x7f4b6015b7c0 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b67400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b60070fe0 con 0x7f4b600ccf30 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b67400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4b600712c0 con 0x7f4b60072ad0 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b65400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b60072ad0 0x7f4b600b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b57e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4b6015b7c0 0x7f4b600cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51566/0 (socket says 172.21.15.52:51566) 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b57e00640 1 -- 172.21.15.52:0/568469390 learned_addr learned my addr 172.21.15.52:0/568469390 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b65400640 1 -- 172.21.15.52:0/568469390 >> v1:172.21.15.176:6789/0 conn(0x7f4b600ccf30 legacy=0x7f4b600cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b65400640 1 -- 172.21.15.52:0/568469390 >> v1:172.21.15.52:6789/0 conn(0x7f4b6015b7c0 legacy=0x7f4b600cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.279+0000 7f4b65400640 1 -- 172.21.15.52:0/568469390 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600715a0 con 0x7f4b60072ad0 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.280+0000 7f4b65400640 1 --2- 172.21.15.52:0/568469390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b600b2c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009d90 tx=0x7f4b5802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a2dfb64d903d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b5fe00640 1 -- 172.21.15.52:0/568469390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58007740 con 0x7f4b60072ad0 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b5fe00640 1 -- 172.21.15.52:0/568469390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b580078e0 con 0x7f4b60072ad0 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b5fe00640 1 -- 172.21.15.52:0/568469390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58007cb0 con 0x7f4b60072ad0 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 -- 172.21.15.52:0/568469390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 msgr2=0x7f4b600b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 --2- 172.21.15.52:0/568469390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b600b2c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009d90 tx=0x7f4b5802a660 comp rx=0 tx=0).stop 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 -- 172.21.15.52:0/568469390 shutdown_connections 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 --2- 172.21.15.52:0/568469390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b600b2c50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 -- 172.21.15.52:0/568469390 >> 172.21.15.52:0/568469390 conn(0x7f4b6006d0f0 msgr2=0x7f4b6006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 -- 172.21.15.52:0/568469390 shutdown_connections 2024-09-10T08:31:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.281+0000 7f4b67400640 1 -- 172.21.15.52:0/568469390 wait complete. 2024-09-10T08:31:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.283+0000 7f4b67400640 1 Processor -- start 2024-09-10T08:31:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.283+0000 7f4b67400640 1 -- start start 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 0x7f4b601582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6015b7c0 0x7f4b6015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6006bd90 con 0x7f4b60072ad0 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6006bc10 con 0x7f4b6015b7c0 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b67400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6006bf10 con 0x7f4b600ccf30 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46674/0 (socket says 172.21.15.52:46674) 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b64a00640 1 -- 172.21.15.52:0/1693325436 learned_addr learned my addr 172.21.15.52:0/1693325436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 0x7f4b601582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.284+0000 7f4b65400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6015b7c0 0x7f4b6015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 -- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 msgr2=0x7f4b601582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 0x7f4b601582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 -- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6015b7c0 msgr2=0x7f4b6015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6015b7c0 0x7f4b6015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 -- 172.21.15.52:0/1693325436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6015c240 con 0x7f4b60072ad0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 0x7f4b601582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c400 tx=0x7f4b5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b5d600640 1 -- 172.21.15.52:0/1693325436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b500052d0 con 0x7f4b60072ad0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b5d600640 1 -- 172.21.15.52:0/1693325436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b50005490 con 0x7f4b60072ad0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b5d600640 1 -- 172.21.15.52:0/1693325436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50007260 con 0x7f4b60072ad0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b600c9a00 con 0x7f4b60072ad0 2024-09-10T08:31:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.285+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b600c9fc0 con 0x7f4b60072ad0 2024-09-10T08:31:50.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.288+0000 7f4b5d600640 1 -- 172.21.15.52:0/1693325436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b50007400 con 0x7f4b60072ad0 2024-09-10T08:31:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.289+0000 7f4b5d600640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 0x7f4b3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.289+0000 7f4b5d600640 1 -- 172.21.15.52:0/1693325436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4b5008a310 con 0x7f4b60072ad0 2024-09-10T08:31:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.290+0000 7f4b6a1fb740 1 Processor -- start 2024-09-10T08:31:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.290+0000 7f4b6a1fb740 1 -- start start 2024-09-10T08:31:50.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.290+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 0x7f4b3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.290+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 0x7f4b3c06e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b60157ca0 tx=0x7f4b48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e0c90 0x562930726430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x5629306db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562930644500 con 0x5629306de450 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5629305ec520 con 0x5629306e0c90 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5629306404c0 con 0x5629306e2420 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46680/0 (socket says 172.21.15.52:46680) 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 -- 172.21.15.52:0/573287584 learned_addr learned my addr 172.21.15.52:0/573287584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b64a00640 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e0c90 0x562930726430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b65400640 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x5629306db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 -- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 msgr2=0x5629306db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x5629306db510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 -- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e0c90 msgr2=0x562930726430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e0c90 0x562930726430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.291+0000 7f4b57e00640 1 -- 172.21.15.52:0/573287584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562930357240 con 0x5629306de450 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b57e00640 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b480058e0 tx=0x7f4b48011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ca7c622a322a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b55200640 1 -- 172.21.15.52:0/573287584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800e7b0 con 0x5629306de450 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b55200640 1 -- 172.21.15.52:0/573287584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4800e950 con 0x5629306de450 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b55200640 1 -- 172.21.15.52:0/573287584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800ed00 con 0x5629306de450 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/573287584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 msgr2=0x5629306e1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.292+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b480058e0 tx=0x7f4b48011000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/573287584 shutdown_connections 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x5629306db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306de450 0x5629306e1070 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/573287584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e0c90 0x562930726430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/573287584 >> 172.21.15.52:0/573287584 conn(0x5629306dd6e0 msgr2=0x562930725900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/573287584 shutdown_connections 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/573287584 wait complete. 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.293+0000 7f4b6a1fb740 1 -- start start 2024-09-10T08:31:50.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 Processor -- start 2024-09-10T08:31:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x562930703d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x56293071f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5629306dcb80 con 0x5629306e2420 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5629305ff680 con 0x562930729ae0 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.294+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x562930726c60 con 0x5629306e0c90 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b6a1fb740 10 client.0 _ll_register_callbacks cb 0x562930604570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46692/0 (socket says 172.21.15.52:46692) 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 -- 172.21.15.52:0/1853550813 learned_addr learned my addr 172.21.15.52:0/1853550813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x562930703d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b65400640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x56293071f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 -- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 msgr2=0x562930703d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x562930703d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 -- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 msgr2=0x56293071f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x56293071f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 -- 172.21.15.52:0/1853550813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562930421620 con 0x5629306e2420 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b57e00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007ec0 tx=0x7f4b48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346336106958cb4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.295+0000 7f4b4d600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48010ed0 con 0x5629306e2420 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4b480100d0 con 0x5629306e2420 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b4800e950 con 0x5629306e2420 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b48032050 con 0x5629306e2420 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 10 client.5511 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x56293070b520 con 0x5629306e2420 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4800e950 con 0x5629306e2420 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f4b48035020 con 0x5629306e2420 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 10 client.5511 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 10 client.5511 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 20 client.5511 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5629306db680 0x5629306dba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 4 client.5511 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.296+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562930651c30 con 0x5629306db680 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.297+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5629306db680 0x5629306dba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.297+0000 7f4b64a00640 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5629306db680 0x5629306dba60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef1726d3f5cf3cc server_cookie=6dc141021e228967 in_seq=0 out_seq=0 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.297+0000 7f4b4d600640 10 client.5511 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b4d600640 1 -- 172.21.15.52:0/1853550813 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562930651c30 con 0x5629306db680 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b4d600640 10 client.5511 handle_command_reply: tid=0 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 client.5511 shutdown 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 msgr2=0x5629307295a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b48007ec0 tx=0x7f4b48000ed0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 shutdown_connections 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5629306db680 0x5629306dba60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x56293071f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e2420 0x5629307295a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/1853550813 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x562930703d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 >> 172.21.15.52:0/1853550813 conn(0x5629306de450 msgr2=0x562930723980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b4d600640 0 client.5511 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 shutdown_connections 2024-09-10T08:31:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.298+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/1853550813 wait complete. 2024-09-10T08:31:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.299+0000 7f4b6a1fb740 20 client.5511 trim_cache size 0 max 16384 2024-09-10T08:31:50.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.314+0000 7f4b6a1fb740 1 Processor -- start 2024-09-10T08:31:50.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.314+0000 7f4b6a1fb740 1 -- start start 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x56293071f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e2420 0x562930723980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60200d40 con 0x562930729ae0 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600cb3f0 con 0x5629306e2420 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b601f8cf0 con 0x5629306e0c90 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46694/0 (socket says 172.21.15.52:46694) 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 -- 172.21.15.52:0/3662914671 learned_addr learned my addr 172.21.15.52:0/3662914671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b57e00640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e2420 0x562930723980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b64a00640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x56293071f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 -- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 msgr2=0x56293071f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x56293071f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 -- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e2420 msgr2=0x562930723980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e2420 0x562930723980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b65400640 1 -- 172.21.15.52:0/3662914671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629306dbdd0 con 0x562930729ae0 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.315+0000 7f4b64a00640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x56293071f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b65400640 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009eb0 tx=0x7f4b5802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecc384c27db431c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b4fe00640 1 -- 172.21.15.52:0/3662914671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580078d0 con 0x562930729ae0 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b4fe00640 1 -- 172.21.15.52:0/3662914671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58007a70 con 0x562930729ae0 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b4fe00640 1 -- 172.21.15.52:0/3662914671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58007e40 con 0x562930729ae0 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/3662914671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 msgr2=0x562930723ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.316+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009eb0 tx=0x7f4b5802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/3662914671 shutdown_connections 2024-09-10T08:31:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562930729ae0 0x562930723ec0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5629306e2420 0x562930723980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/3662914671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e0c90 0x56293071f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/3662914671 >> 172.21.15.52:0/3662914671 conn(0x5629306de450 msgr2=0x562930727460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/3662914671 shutdown_connections 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/3662914671 wait complete. 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 -- start start 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.317+0000 7f4b6a1fb740 1 Processor -- start 2024-09-10T08:31:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x56293070ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x5629307a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562930640640 con 0x5629306e0c90 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600cada0 con 0x562930729ae0 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56293071ee50 con 0x5629306e2420 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.318+0000 7f4b6a1fb740 10 client.0 _ll_register_callbacks cb 0x7f4b500548f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46704/0 (socket says 172.21.15.52:46704) 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 -- 172.21.15.52:0/171026113 learned_addr learned my addr 172.21.15.52:0/171026113 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b57e00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x56293070ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b65400640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x5629307a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 -- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 msgr2=0x56293070ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x56293070ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 -- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 msgr2=0x5629307a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x5629307a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 -- 172.21.15.52:0/171026113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629307a6810 con 0x5629306e0c90 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b64a00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001eb0 tx=0x7f4b50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bcff3fc743cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b4d600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.319+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50056950 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4b50054cc0 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b58007a70 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4b5005db90 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 10 client.5517 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x56293070a660 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58007a70 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f4b50057aa0 con 0x5629306e0c90 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 10 client.5517 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 10 client.5517 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 20 client.5517 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x562930722040 0x562930722440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 4 client.5517 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T08:31:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5629306e1f90 con 0x562930722040 2024-09-10T08:31:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.320+0000 7f4b57e00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x562930722040 0x562930722440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.321+0000 7f4b57e00640 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x562930722040 0x562930722440 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44170d167a5d9872 server_cookie=1da5121409f8177d in_seq=0 out_seq=0 2024-09-10T08:31:50.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.321+0000 7f4b4d600640 10 client.5517 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b4d600640 1 -- 172.21.15.52:0/171026113 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629306e1f90 con 0x562930722040 2024-09-10T08:31:50.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b4d600640 10 client.5517 handle_command_reply: tid=0 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 client.5517 shutdown 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 msgr2=0x5629307293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001eb0 tx=0x7f4b50000ed0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 shutdown_connections 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x562930722040 0x562930722440 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562930729ae0 0x5629307a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5629306e2420 0x56293070ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 --2- 172.21.15.52:0/171026113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629306e0c90 0x5629307293f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b4d600640 0 client.5517 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.323+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 >> 172.21.15.52:0/171026113 conn(0x5629306de450 msgr2=0x562930724ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 shutdown_connections 2024-09-10T08:31:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b6a1fb740 1 -- 172.21.15.52:0/171026113 wait complete. 2024-09-10T08:31:50.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b6a1fb740 20 client.5517 trim_cache size 0 max 16384 2024-09-10T08:31:50.330 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:50.330 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:50.330 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:50.330 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 msgr2=0x7f4b3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 0x7f4b3c06e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b60157ca0 tx=0x7f4b48009040 comp rx=0 tx=0).stop 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 msgr2=0x7f4b6015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c400 tx=0x7f4b5000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 shutdown_connections 2024-09-10T08:31:50.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b3c06be30 0x7f4b3c06e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b6015b7c0 0x7f4b6015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b600ccf30 0x7f4b601582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.324+0000 7f4b67400640 1 --2- 172.21.15.52:0/1693325436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b60072ad0 0x7f4b6015bbd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.325+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 >> 172.21.15.52:0/1693325436 conn(0x7f4b6006d0f0 msgr2=0x7f4b60151580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.325+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 shutdown_connections 2024-09-10T08:31:50.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.325+0000 7f4b67400640 1 -- 172.21.15.52:0/1693325436 wait complete. 2024-09-10T08:31:50.340 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:50.340 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-10T08:31:50.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-10T08:31:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.500+0000 7fb0bda00640 1 Processor -- start 2024-09-10T08:31:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.500+0000 7fb0bda00640 1 -- start start 2024-09-10T08:31:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.501+0000 7fb0bda00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb0b8155950 0x7fb0b8073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.501+0000 7fb0bda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.501+0000 7fb0bda00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b8073cc0 con 0x7fb0b8162c80 2024-09-10T08:31:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.501+0000 7fb0bda00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b80b04d0 con 0x7fb0b8155950 2024-09-10T08:31:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.501+0000 7fb0bda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b8070370 con 0x7fb0b80afb20 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb0b8155950 0x7fb0b8073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb0b8155950 0x7fb0b8073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46714/0 (socket says 172.21.15.52:46714) 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 -- 172.21.15.52:0/666654557 learned_addr learned my addr 172.21.15.52:0/666654557 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b7400640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 -- 172.21.15.52:0/666654557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 msgr2=0x7fb0b80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 -- 172.21.15.52:0/666654557 >> v1:172.21.15.176:6789/0 conn(0x7fb0b8162c80 legacy=0x7fb0b806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b6a00640 1 -- 172.21.15.52:0/666654557 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b8071aa0 con 0x7fb0b8155950 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.502+0000 7fb0b7400640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.503+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8155950 0x7fb0b8073600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80098a0 tx=0x7fb0a802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c519eb8f3d0eb2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.503+0000 7fb0b6000640 1 -- 172.21.15.52:0/666654557 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8037070 con 0x7fb0b8155950 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.503+0000 7fb0b6000640 1 -- 172.21.15.52:0/666654557 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a8032440 con 0x7fb0b8155950 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.503+0000 7fb0b6000640 1 -- 172.21.15.52:0/666654557 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8032810 con 0x7fb0b8155950 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 -- 172.21.15.52:0/666654557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8155950 msgr2=0x7fb0b8073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8155950 0x7fb0b8073600 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80098a0 tx=0x7fb0a802a290 comp rx=0 tx=0).stop 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 -- 172.21.15.52:0/666654557 shutdown_connections 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 --2- 172.21.15.52:0/666654557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8155950 0x7fb0b8073600 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 -- 172.21.15.52:0/666654557 >> 172.21.15.52:0/666654557 conn(0x7fb0b806db30 msgr2=0x7fb0b806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 -- 172.21.15.52:0/666654557 shutdown_connections 2024-09-10T08:31:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.504+0000 7fb0bda00640 1 -- 172.21.15.52:0/666654557 wait complete. 2024-09-10T08:31:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.506+0000 7fb0bda00640 1 Processor -- start 2024-09-10T08:31:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.506+0000 7fb0bda00640 1 -- start start 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 0x7fb0b80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b81630e0 con 0x7fb0b8162c80 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b806c320 con 0x7fb0b80b2110 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0bda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b8072060 con 0x7fb0b80afb20 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46730/0 (socket says 172.21.15.52:46730) 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 -- 172.21.15.52:0/1720435503 learned_addr learned my addr 172.21.15.52:0/1720435503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0b7400640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 0x7fb0b80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 -- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 msgr2=0x7fb0b80cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 -- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 msgr2=0x7fb0b80b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 0x7fb0b80b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0afe00640 1 -- 172.21.15.52:0/1720435503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b8143de0 con 0x7fb0b8162c80 2024-09-10T08:31:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.507+0000 7fb0b7400640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 0x7fb0b80b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0afe00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c3f0 tx=0x7fb0a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0aea00640 1 -- 172.21.15.52:0/1720435503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00052d0 con 0x7fb0b8162c80 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0aea00640 1 -- 172.21.15.52:0/1720435503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a0005490 con 0x7fb0b8162c80 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0aea00640 1 -- 172.21.15.52:0/1720435503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007260 con 0x7fb0b8162c80 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b80cdc40 con 0x7fb0b8162c80 2024-09-10T08:31:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.508+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b80ce200 con 0x7fb0b8162c80 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.510+0000 7fb0aea00640 1 -- 172.21.15.52:0/1720435503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0a0007400 con 0x7fb0b8162c80 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.511+0000 7fb0aea00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 0x7fb09406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.511+0000 7fb0aea00640 1 -- 172.21.15.52:0/1720435503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb0a008a300 con 0x7fb0b8162c80 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.511+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 0x7fb09406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.512+0000 7fb0c09f4740 1 Processor -- start 2024-09-10T08:31:50.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.512+0000 7fb0c09f4740 1 -- start start 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.512+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 0x7fb09406e320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8034000 tx=0x7fb0a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd6b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd671250 0x5558dd673e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558dd5d78c0 con 0x5558dd675220 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558dd57f820 con 0x5558dd673a90 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558dd5d3880 con 0x5558dd671250 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46744/0 (socket says 172.21.15.52:46744) 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 -- 172.21.15.52:0/2768745646 learned_addr learned my addr 172.21.15.52:0/2768745646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd6b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0afe00640 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd671250 0x5558dd673e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 -- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd671250 msgr2=0x5558dd673e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd671250 0x5558dd673e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 -- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 msgr2=0x5558dd6b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd6b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.513+0000 7fb0b7400640 1 -- 172.21.15.52:0/2768745646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558dd2ce280 con 0x5558dd675220 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.514+0000 7fb0b7400640 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009c60 tx=0x7fb0b0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff41f02f86fbd5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.514+0000 7fb0a7400640 1 -- 172.21.15.52:0/2768745646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0013780 con 0x5558dd675220 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.514+0000 7fb0a7400640 1 -- 172.21.15.52:0/2768745646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0019070 con 0x5558dd675220 2024-09-10T08:31:50.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.514+0000 7fb0a7400640 1 -- 172.21.15.52:0/2768745646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0013b40 con 0x5558dd675220 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 -- 172.21.15.52:0/2768745646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 msgr2=0x5558dd66e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009c60 tx=0x7fb0b0004410 comp rx=0 tx=0).stop 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 -- 172.21.15.52:0/2768745646 shutdown_connections 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd675220 0x5558dd66e080 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd671250 0x5558dd673e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/2768745646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd6b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 -- 172.21.15.52:0/2768745646 >> 172.21.15.52:0/2768745646 conn(0x5558dd670250 msgr2=0x5558dd6b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 -- 172.21.15.52:0/2768745646 shutdown_connections 2024-09-10T08:31:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.515+0000 7fb0c09f4740 1 -- 172.21.15.52:0/2768745646 wait complete. 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.516+0000 7fb0c09f4740 1 -- start start 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.516+0000 7fb0c09f4740 1 Processor -- start 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd69d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd69deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558dd66f6f0 con 0x5558dd692340 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558dd592a40 con 0x5558dd675220 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558dd6b9a60 con 0x5558dd673a90 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0c09f4740 10 client.0 _ll_register_callbacks cb 0x5558dd584520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46752/0 (socket says 172.21.15.52:46752) 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0b7400640 1 -- 172.21.15.52:0/882003250 learned_addr learned my addr 172.21.15.52:0/882003250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd69d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.517+0000 7fb0afe00640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd69deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 -- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 msgr2=0x5558dd69d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd69d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 -- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 msgr2=0x5558dd69deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd69deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 -- 172.21.15.52:0/882003250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558dd3b6690 con 0x5558dd692340 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0b7400640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0003990 tx=0x7fb0b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db02c3d83907d739 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb09be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0014610 con 0x5558dd692340 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb0b00147b0 con 0x5558dd692340 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b0019070 con 0x5558dd692340 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb0b0032050 con 0x5558dd692340 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.518+0000 7fb0c09f4740 10 client.5529 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5558dd416e20 con 0x5558dd692340 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0019070 con 0x5558dd692340 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fb0b0035020 con 0x5558dd692340 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 10 client.5529 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 10 client.5529 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 20 client.5529 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6927c0 0x5558dd671fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 4 client.5529 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558dd5e4ff0 con 0x5558dd6927c0 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.519+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6927c0 0x5558dd671fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.520+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6927c0 0x5558dd671fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d1bd15ce64a968 server_cookie=e79066ef546dcdbf in_seq=0 out_seq=0 2024-09-10T08:31:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.520+0000 7fb09be00640 10 client.5529 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.520+0000 7fb09be00640 1 -- 172.21.15.52:0/882003250 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558dd5e4ff0 con 0x5558dd6927c0 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb09be00640 10 client.5529 handle_command_reply: tid=0 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 client.5529 shutdown 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 msgr2=0x5558dd692e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0003990 tx=0x7fb0b0004ab0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 shutdown_connections 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6927c0 0x5558dd671fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd692e00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd69deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/882003250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd69d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 >> 172.21.15.52:0/882003250 conn(0x5558dd671250 msgr2=0x5558dd6b7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb09be00640 0 client.5529 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 shutdown_connections 2024-09-10T08:31:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 1 -- 172.21.15.52:0/882003250 wait complete. 2024-09-10T08:31:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.521+0000 7fb0c09f4740 20 client.5529 trim_cache size 0 max 16384 2024-09-10T08:31:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 Processor -- start 2024-09-10T08:31:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 -- start start 2024-09-10T08:31:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd693ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd675220 0x5558dd699900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558dd6931c0 con 0x5558dd692340 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.540+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8200df0 con 0x5558dd673a90 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b81574f0 con 0x5558dd675220 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46756/0 (socket says 172.21.15.52:46756) 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 -- 172.21.15.52:0/772416606 learned_addr learned my addr 172.21.15.52:0/772416606 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0afe00640 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd675220 0x5558dd699900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd693ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 -- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd675220 msgr2=0x5558dd699900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd675220 0x5558dd699900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 -- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 msgr2=0x5558dd693ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd693ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 -- 172.21.15.52:0/772416606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558dd2a9f80 con 0x5558dd692340 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.541+0000 7fb0b7400640 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009560 tx=0x7fb0b0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98725ee597a146c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0a6a00640 1 -- 172.21.15.52:0/772416606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00285f0 con 0x5558dd692340 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0a6a00640 1 -- 172.21.15.52:0/772416606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0019040 con 0x5558dd692340 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0a6a00640 1 -- 172.21.15.52:0/772416606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0028990 con 0x5558dd692340 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 -- 172.21.15.52:0/772416606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 msgr2=0x5558dd699e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009560 tx=0x7fb0b0020040 comp rx=0 tx=0).stop 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 -- 172.21.15.52:0/772416606 shutdown_connections 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd699e40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd675220 0x5558dd699900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/772416606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd673a90 0x5558dd693ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 -- 172.21.15.52:0/772416606 >> 172.21.15.52:0/772416606 conn(0x5558dd671250 msgr2=0x5558dd66ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 -- 172.21.15.52:0/772416606 shutdown_connections 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.542+0000 7fb0c09f4740 1 -- 172.21.15.52:0/772416606 wait complete. 2024-09-10T08:31:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.543+0000 7fb0c09f4740 1 -- start start 2024-09-10T08:31:50.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.543+0000 7fb0c09f4740 1 Processor -- start 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd6dab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd6db0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b8156ea0 con 0x5558dd692340 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b80b14b0 con 0x5558dd675220 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558dd699550 con 0x5558dd673a90 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0c09f4740 10 client.0 _ll_register_callbacks cb 0x7fb0b0013980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46766/0 (socket says 172.21.15.52:46766) 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.544+0000 7fb0b7400640 1 -- 172.21.15.52:0/3253435240 learned_addr learned my addr 172.21.15.52:0/3253435240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0afe00640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd6db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd6dab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 -- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 msgr2=0x5558dd6dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd6dab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 -- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 msgr2=0x5558dd6db0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd6db0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 -- 172.21.15.52:0/3253435240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558dd71bfc0 con 0x5558dd692340 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0b7400640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0002230 tx=0x7fb0b0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1503beb7fdada065 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb09be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b00283f0 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb0b0028590 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.545+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0b0019040 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb0b0028790 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 10 client.5535 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5558dd6b87a0 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b0019040 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fb0b0035070 con 0x5558dd692340 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 10 client.5535 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 10 client.5535 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 20 client.5535 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6bac70 0x5558dd6c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 4 client.5535 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5558dd5df340 con 0x5558dd6bac70 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.546+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6bac70 0x5558dd6c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.547+0000 7fb0b6a00640 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6bac70 0x5558dd6c7360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=301372bad9558fab server_cookie=c653a1989fe11b81 in_seq=0 out_seq=0 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.547+0000 7fb09be00640 10 client.5535 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.547+0000 7fb09be00640 1 -- 172.21.15.52:0/3253435240 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5558dd5df340 con 0x5558dd6bac70 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.547+0000 7fb09be00640 10 client.5535 handle_command_reply: tid=0 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.547+0000 7fb0c09f4740 1 client.5535 shutdown 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 msgr2=0x5558dd6c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0002230 tx=0x7fb0b0003d80 comp rx=0 tx=0).stop 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 shutdown_connections 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5558dd6bac70 0x5558dd6c7360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558dd692340 0x5558dd6c6e20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558dd675220 0x5558dd6db0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 --2- 172.21.15.52:0/3253435240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558dd673a90 0x5558dd6dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 >> 172.21.15.52:0/3253435240 conn(0x5558dd671250 msgr2=0x5558dd66ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb09be00640 0 client.5535 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 shutdown_connections 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 1 -- 172.21.15.52:0/3253435240 wait complete. 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.548+0000 7fb0c09f4740 20 client.5535 trim_cache size 0 max 16384 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:50.554 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b37eff18-1264-4a4c-8fcc-cd84d50ba043", 2024-09-10T08:31:50.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:50.555 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 msgr2=0x7fb09406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 0x7fb09406e320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8034000 tx=0x7fb0a802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 msgr2=0x7fb0b81438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c3f0 tx=0x7fb0a000c8b0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 shutdown_connections 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb09406be60 0x7fb09406e320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0b80b2110 0x7fb0b80b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0b8162c80 0x7fb0b81438a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 --2- 172.21.15.52:0/1720435503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0b80afb20 0x7fb0b80cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 >> 172.21.15.52:0/1720435503 conn(0x7fb0b806db30 msgr2=0x7fb0b80ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 shutdown_connections 2024-09-10T08:31:50.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.549+0000 7fb0bda00640 1 -- 172.21.15.52:0/1720435503 wait complete. 2024-09-10T08:31:50.567 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'b37eff18-1264-4a4c-8fcc-cd84d50ba043', 'mode': 'asynchronous'}' 2024-09-10T08:31:50.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:50.568 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-10T08:31:50.606 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-10T08:31:50.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-10T08:31:50.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.804+0000 7fe231e00640 1 Processor -- start 2024-09-10T08:31:50.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.804+0000 7fe231e00640 1 -- start start 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe231e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe22c0cce30 0x7fe22c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe231e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe231e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe22c0714b0 con 0x7fe22c0732e0 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe231e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe22c0cd880 con 0x7fe22c0cce30 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe231e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c0cdb60 con 0x7fe22c071c70 2024-09-10T08:31:50.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe223e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe22c0cce30 0x7fe22c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe223e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe22c0cce30 0x7fe22c0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46778/0 (socket says 172.21.15.52:46778) 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe223e00640 1 -- 172.21.15.52:0/3704744001 learned_addr learned my addr 172.21.15.52:0/3704744001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.805+0000 7fe22aa00640 1 --1- 172.21.15.52:0/3704744001 >> v1:172.21.15.52:6789/0 conn(0x7fe22c0732e0 0x7fe22c0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51582/0 (socket says 172.21.15.52:51582) 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.806+0000 7fe22b400640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.806+0000 7fe223e00640 1 -- 172.21.15.52:0/3704744001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 msgr2=0x7fe22c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.806+0000 7fe223e00640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.806+0000 7fe223e00640 1 -- 172.21.15.52:0/3704744001 >> v1:172.21.15.52:6789/0 conn(0x7fe22c0732e0 legacy=0x7fe22c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.806+0000 7fe223e00640 1 -- 172.21.15.52:0/3704744001 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c0cde40 con 0x7fe22c0cce30 2024-09-10T08:31:50.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.807+0000 7fe223e00640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0cce30 0x7fe22c0cd2a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe214009870 tx=0x7fe21402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feac53f9cccd0ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.807+0000 7fe22a000640 1 -- 172.21.15.52:0/3704744001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214037070 con 0x7fe22c0cce30 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.807+0000 7fe22a000640 1 -- 172.21.15.52:0/3704744001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe214032440 con 0x7fe22c0cce30 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.807+0000 7fe22a000640 1 -- 172.21.15.52:0/3704744001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214032810 con 0x7fe22c0cce30 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 -- 172.21.15.52:0/3704744001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0cce30 msgr2=0x7fe22c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0cce30 0x7fe22c0cd2a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe214009870 tx=0x7fe21402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 -- 172.21.15.52:0/3704744001 shutdown_connections 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 --2- 172.21.15.52:0/3704744001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0cce30 0x7fe22c0cd2a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 -- 172.21.15.52:0/3704744001 >> 172.21.15.52:0/3704744001 conn(0x7fe22c06d0f0 msgr2=0x7fe22c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 -- 172.21.15.52:0/3704744001 shutdown_connections 2024-09-10T08:31:50.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.808+0000 7fe231e00640 1 -- 172.21.15.52:0/3704744001 wait complete. 2024-09-10T08:31:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.809+0000 7fe231e00640 1 Processor -- start 2024-09-10T08:31:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.810+0000 7fe231e00640 1 -- start start 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.810+0000 7fe231e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe231e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe231e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 0x7fe22c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe231e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c15ca50 con 0x7fe22c0732e0 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe231e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c15c8d0 con 0x7fe22c0cce30 2024-09-10T08:31:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe231e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c15cbd0 con 0x7fe22c071c70 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46782/0 (socket says 172.21.15.52:46782) 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 -- 172.21.15.52:0/3180163286 learned_addr learned my addr 172.21.15.52:0/3180163286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 -- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 msgr2=0x7fe22c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 -- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 msgr2=0x7fe22c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe22b400640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 0x7fe22c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 0x7fe22c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe223e00640 1 -- 172.21.15.52:0/3180163286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c1e86d0 con 0x7fe22c0732e0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.811+0000 7fe22b400640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 0x7fe22c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe223e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe214000c00 tx=0x7fe2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe223400640 1 -- 172.21.15.52:0/3180163286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214041020 con 0x7fe22c0732e0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe223400640 1 -- 172.21.15.52:0/3180163286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2140306e0 con 0x7fe22c0732e0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c1e89b0 con 0x7fe22c0732e0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe223400640 1 -- 172.21.15.52:0/3180163286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214037040 con 0x7fe22c0732e0 2024-09-10T08:31:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.812+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c1e8f70 con 0x7fe22c0732e0 2024-09-10T08:31:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.814+0000 7fe223400640 1 -- 172.21.15.52:0/3180163286 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe214044020 con 0x7fe22c0732e0 2024-09-10T08:31:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.815+0000 7fe223400640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.815+0000 7fe223400640 1 -- 172.21.15.52:0/3180163286 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe2140ab630 con 0x7fe22c0732e0 2024-09-10T08:31:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.815+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.816+0000 7fe234c84740 1 Processor -- start 2024-09-10T08:31:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.816+0000 7fe234c84740 1 -- start start 2024-09-10T08:31:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.816+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe21c000f60 tx=0x7fe21c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 0x558f924f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924fa030 0x558f924f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558f9245b5a0 con 0x558f924f88a0 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558f924036b0 con 0x558f924fa030 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558f92457560 con 0x558f924f6060 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46790/0 (socket says 172.21.15.52:46790) 2024-09-10T08:31:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 -- 172.21.15.52:0/816424939 learned_addr learned my addr 172.21.15.52:0/816424939 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe223e00640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 0x558f924f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22b400640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924fa030 0x558f924f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 -- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 msgr2=0x558f924f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 0x558f924f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 -- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924fa030 msgr2=0x558f924f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924fa030 0x558f924f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe22aa00640 1 -- 172.21.15.52:0/816424939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f92425270 con 0x558f924f88a0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.817+0000 7fe223e00640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 0x558f924f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe22aa00640 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0073f0 tx=0x7fe21c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a0a6ad6dd3342 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe21b400640 1 -- 172.21.15.52:0/816424939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00d9d0 con 0x558f924f88a0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe21b400640 1 -- 172.21.15.52:0/816424939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c00db70 con 0x558f924f88a0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe21b400640 1 -- 172.21.15.52:0/816424939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c020450 con 0x558f924f88a0 2024-09-10T08:31:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe234c84740 1 -- 172.21.15.52:0/816424939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 msgr2=0x558f9253e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.818+0000 7fe234c84740 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0073f0 tx=0x7fe21c010000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 -- 172.21.15.52:0/816424939 shutdown_connections 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924fa030 0x558f924f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924f6060 0x558f924f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 --2- 172.21.15.52:0/816424939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253e040 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 -- 172.21.15.52:0/816424939 >> 172.21.15.52:0/816424939 conn(0x558f924f5060 msgr2=0x558f9253d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 -- 172.21.15.52:0/816424939 shutdown_connections 2024-09-10T08:31:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 -- 172.21.15.52:0/816424939 wait complete. 2024-09-10T08:31:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.819+0000 7fe234c84740 1 -- start start 2024-09-10T08:31:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.820+0000 7fe234c84740 1 Processor -- start 2024-09-10T08:31:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.820+0000 7fe234c84740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.820+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f924f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe234c84740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558f924f4500 con 0x558f924f88a0 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558f923e46b0 con 0x558f924f7200 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558f9253e870 con 0x558f924fa030 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe234c84740 10 client.0 _ll_register_callbacks cb 0x558f9240ebb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46802/0 (socket says 172.21.15.52:46802) 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 -- 172.21.15.52:0/2702148959 learned_addr learned my addr 172.21.15.52:0/2702148959 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22b400640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f924f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe223e00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 -- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 msgr2=0x558f9254e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 -- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 msgr2=0x558f924f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f924f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.821+0000 7fe22aa00640 1 -- 172.21.15.52:0/2702148959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f923faf60 con 0x558f924f88a0 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009010 tx=0x7fe21c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2222126f4d74e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe20fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c020660 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe21c020800 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c00db70 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe21c033050 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe234c84740 10 client.5550 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x558f9216e7b0 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.822+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c00db70 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe21c020a00 con 0x558f924f88a0 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 10 client.5550 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 20 client.5550 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f92551750 0x558f92551c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 4 client.5550 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f924392d0 con 0x558f92551750 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe223e00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f92551750 0x558f92551c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe223e00640 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f92551750 0x558f92551c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3604f9c8296cd83 server_cookie=faeba1129b8d1c03 in_seq=0 out_seq=0 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.823+0000 7fe20fe00640 10 client.5550 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe20fe00640 1 -- 172.21.15.52:0/2702148959 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f924392d0 con 0x558f92551750 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe20fe00640 10 client.5550 handle_command_reply: tid=0 2024-09-10T08:31:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 client.5550 shutdown 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 msgr2=0x558f9254d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009010 tx=0x7fe21c012000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 shutdown_connections 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f92551750 0x558f92551c00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f924f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe20fe00640 0 client.5550 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 --2- 172.21.15.52:0/2702148959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9254d620 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.824+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 >> 172.21.15.52:0/2702148959 conn(0x558f924f6060 msgr2=0x558f9253cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.825+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 shutdown_connections 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.825+0000 7fe234c84740 1 -- 172.21.15.52:0/2702148959 wait complete. 2024-09-10T08:31:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.825+0000 7fe234c84740 20 client.5550 trim_cache size 0 max 16384 2024-09-10T08:31:50.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.840+0000 7fe234c84740 1 Processor -- start 2024-09-10T08:31:50.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.840+0000 7fe234c84740 1 -- start start 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f88a0 0x558f924f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558f9253c960 con 0x558f924f7200 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c200b90 con 0x558f924f88a0 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe22c1f5950 con 0x558f924fa030 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46812/0 (socket says 172.21.15.52:46812) 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 -- 172.21.15.52:0/3210340691 learned_addr learned my addr 172.21.15.52:0/3210340691 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 -- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 msgr2=0x558f9254cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 -- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f88a0 msgr2=0x558f924f6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f88a0 0x558f924f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.841+0000 7fe22aa00640 1 -- 172.21.15.52:0/3210340691 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f924f79f0 con 0x558f924f7200 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe22aa00640 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d9e0 tx=0x7fe21c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76c18e475ff7c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe21aa00640 1 -- 172.21.15.52:0/3210340691 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007240 con 0x558f924f7200 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe21aa00640 1 -- 172.21.15.52:0/3210340691 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c020660 con 0x558f924f7200 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe21aa00640 1 -- 172.21.15.52:0/3210340691 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c020a10 con 0x558f924f7200 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe234c84740 1 -- 172.21.15.52:0/3210340691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 msgr2=0x558f924f6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.842+0000 7fe234c84740 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00d9e0 tx=0x7fe21c01c000 comp rx=0 tx=0).stop 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 -- 172.21.15.52:0/3210340691 shutdown_connections 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f9254cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f88a0 0x558f924f6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 --2- 172.21.15.52:0/3210340691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f7200 0x558f924f6680 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 -- 172.21.15.52:0/3210340691 >> 172.21.15.52:0/3210340691 conn(0x558f924f6060 msgr2=0x558f92540a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 -- 172.21.15.52:0/3210340691 shutdown_connections 2024-09-10T08:31:50.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 -- 172.21.15.52:0/3210340691 wait complete. 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.843+0000 7fe234c84740 1 -- start start 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 Processor -- start 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f925bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f925b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1f5300 con 0x558f924f88a0 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.844+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c1e6af0 con 0x558f924f7200 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe234c84740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558f924f7710 con 0x558f924fa030 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe234c84740 10 client.0 _ll_register_callbacks cb 0x7fe21c001cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46826/0 (socket says 172.21.15.52:46826) 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 -- 172.21.15.52:0/2594917062 learned_addr learned my addr 172.21.15.52:0/2594917062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f925bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe22b400640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f925b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 -- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 msgr2=0x558f925b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f925b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 -- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 msgr2=0x558f925bb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f925bb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 -- 172.21.15.52:0/2594917062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f92238b90 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe22b400640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f925b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe223e00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe2140795d0 tx=0x7fe214031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3695b390e229d634 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.845+0000 7fe20fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2140824b0 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe214080040 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c020660 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe214098050 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 10 client.5556 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x558f925bbb40 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c020660 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fe21c00dd20 con 0x558f924f88a0 2024-09-10T08:31:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 10 client.5556 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 10 client.5556 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 20 client.5556 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f924f6680 0x558f924f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 4 client.5556 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x558f92468cd0 con 0x558f924f6680 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.846+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f924f6680 0x558f924f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.847+0000 7fe22aa00640 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f924f6680 0x558f924f6ab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa3f390cb0b7346 server_cookie=d8144c47d8ea52f2 in_seq=0 out_seq=0 2024-09-10T08:31:50.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.847+0000 7fe20fe00640 10 client.5556 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe20fe00640 1 -- 172.21.15.52:0/2594917062 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f92468cd0 con 0x558f924f6680 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe20fe00640 10 client.5556 handle_command_reply: tid=0 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 client.5556 shutdown 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 msgr2=0x558f9253f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe2140795d0 tx=0x7fe214031f40 comp rx=0 tx=0).stop 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 shutdown_connections 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558f924f6680 0x558f924f6ab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558f924fa030 0x558f925b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f924f88a0 0x558f9253f190 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe20fe00640 0 client.5556 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 --2- 172.21.15.52:0/2594917062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558f924f7200 0x558f925bb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 >> 172.21.15.52:0/2594917062 conn(0x558f924f6060 msgr2=0x558f9253b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 shutdown_connections 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 1 -- 172.21.15.52:0/2594917062 wait complete. 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.850+0000 7fe234c84740 20 client.5556 trim_cache size 0 max 16384 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:50.854 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 msgr2=0x7fe20806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 0x7fe20806e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe21c000f60 tx=0x7fe21c009040 comp rx=0 tx=0).stop 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 msgr2=0x7fe22c0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe214000c00 tx=0x7fe2140046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 shutdown_connections 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe20806be30 0x7fe20806e2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c0cce30 0x7fe22c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe22c0732e0 0x7fe22c0b52c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 --2- 172.21.15.52:0/3180163286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe22c071c70 0x7fe22c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:50.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 >> 172.21.15.52:0/3180163286 conn(0x7fe22c06d0f0 msgr2=0x7fe22c15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:50.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 shutdown_connections 2024-09-10T08:31:50.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:50.851+0000 7fe231e00640 1 -- 172.21.15.52:0/3180163286 wait complete. 2024-09-10T08:31:50.866 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:50.866 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:31:50.866 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:31:50.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:50.902 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-10T08:31:50.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:31:50.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:31:50.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176782 s, 59.3 MB/s 2024-09-10T08:31:50.996 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-10T08:31:50.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-10T08:31:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.155+0000 7f0e3e400640 1 Processor -- start 2024-09-10T08:31:51.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.155+0000 7f0e3e400640 1 -- start start 2024-09-10T08:31:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e3e400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e3815c7f0 0x7f0e380b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e3e400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3815cbd0 con 0x7f0e38073800 2024-09-10T08:31:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e3e400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e380ce0e0 con 0x7f0e380b1c30 2024-09-10T08:31:51.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e3e400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0e380cecf0 con 0x7f0e3815c7f0 2024-09-10T08:31:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e37400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e3815c7f0 0x7f0e380b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e37e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0e38073800 0x7f0e3806f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51594/0 (socket says 172.21.15.52:51594) 2024-09-10T08:31:51.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.156+0000 7f0e37e00640 1 -- 172.21.15.52:0/839220558 learned_addr learned my addr 172.21.15.52:0/839220558 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.157+0000 7f0e37400640 1 -- 172.21.15.52:0/839220558 >> v1:172.21.15.176:6789/0 conn(0x7f0e380b1c30 legacy=0x7f0e380730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.157+0000 7f0e37400640 1 -- 172.21.15.52:0/839220558 >> v1:172.21.15.52:6789/0 conn(0x7f0e38073800 legacy=0x7f0e3806f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.157+0000 7f0e36a00640 1 -- 172.21.15.52:0/839220558 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434977234 0 0) 0x7f0e3815cbd0 con 0x7f0e38073800 2024-09-10T08:31:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.157+0000 7f0e37400640 1 -- 172.21.15.52:0/839220558 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e380ce3c0 con 0x7f0e3815c7f0 2024-09-10T08:31:51.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.158+0000 7f0e37400640 1 --2- 172.21.15.52:0/839220558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e3815c7f0 0x7f0e380b16f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097a0 tx=0x7f0e2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b72b64762710e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.158+0000 7f0e36a00640 1 -- 172.21.15.52:0/839220558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28037070 con 0x7f0e3815c7f0 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.158+0000 7f0e36a00640 1 -- 172.21.15.52:0/839220558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28032440 con 0x7f0e3815c7f0 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.158+0000 7f0e36a00640 1 -- 172.21.15.52:0/839220558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28032810 con 0x7f0e3815c7f0 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 -- 172.21.15.52:0/839220558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e3815c7f0 msgr2=0x7f0e380b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 --2- 172.21.15.52:0/839220558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e3815c7f0 0x7f0e380b16f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0e280097a0 tx=0x7f0e2802a230 comp rx=0 tx=0).stop 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 -- 172.21.15.52:0/839220558 shutdown_connections 2024-09-10T08:31:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 --2- 172.21.15.52:0/839220558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e3815c7f0 0x7f0e380b16f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 -- 172.21.15.52:0/839220558 >> 172.21.15.52:0/839220558 conn(0x7f0e380d2570 msgr2=0x7f0e380d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 -- 172.21.15.52:0/839220558 shutdown_connections 2024-09-10T08:31:51.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.159+0000 7f0e3e400640 1 -- 172.21.15.52:0/839220558 wait complete. 2024-09-10T08:31:51.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.160+0000 7f0e3e400640 1 Processor -- start 2024-09-10T08:31:51.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.160+0000 7f0e3e400640 1 -- start start 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e380b1c30 0x7f0e38156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 0x7f0e380b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380b5440 con 0x7f0e38073800 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380ce980 con 0x7f0e380b1c30 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.161+0000 7f0e3e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e380b1a50 con 0x7f0e3815c7f0 2024-09-10T08:31:51.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46848/0 (socket says 172.21.15.52:46848) 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 -- 172.21.15.52:0/1259829105 learned_addr learned my addr 172.21.15.52:0/1259829105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e380b1c30 0x7f0e38156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37e00640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 0x7f0e380b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 -- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 msgr2=0x7f0e380b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 0x7f0e380b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 -- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e380b1c30 msgr2=0x7f0e38156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e380b1c30 0x7f0e38156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 -- 172.21.15.52:0/1259829105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e380cbbd0 con 0x7f0e38073800 2024-09-10T08:31:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37e00640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 0x7f0e380b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.162+0000 7f0e37400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0e280098c0 tx=0x7f0e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.163+0000 7f0e2f400640 1 -- 172.21.15.52:0/1259829105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28041070 con 0x7f0e38073800 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.163+0000 7f0e2f400640 1 -- 172.21.15.52:0/1259829105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2803c930 con 0x7f0e38073800 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.163+0000 7f0e2f400640 1 -- 172.21.15.52:0/1259829105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28037040 con 0x7f0e38073800 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.163+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e380cbeb0 con 0x7f0e38073800 2024-09-10T08:31:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.163+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e380cc470 con 0x7f0e38073800 2024-09-10T08:31:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.165+0000 7f0e2f400640 1 -- 172.21.15.52:0/1259829105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e28044070 con 0x7f0e38073800 2024-09-10T08:31:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.166+0000 7f0e2f400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 0x7f0e1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.166+0000 7f0e2f400640 1 -- 172.21.15.52:0/1259829105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e280abb00 con 0x7f0e38073800 2024-09-10T08:31:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.166+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 0x7f0e1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.166+0000 7f0e4124e740 1 Processor -- start 2024-09-10T08:31:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.166+0000 7f0e4124e740 1 -- start start 2024-09-10T08:31:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 0x7f0e1406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e3806f9b0 tx=0x7f0e20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcaa060 0x5606dfcacc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfca6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606dfc0f5a0 con 0x5606dfcac8a0 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dfbb76b0 con 0x5606dfcaa060 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.167+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606dfc0b560 con 0x5606dfcae030 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46862/0 (socket says 172.21.15.52:46862) 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 -- 172.21.15.52:0/2692504534 learned_addr learned my addr 172.21.15.52:0/2692504534 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcaa060 0x5606dfcacc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37e00640 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfca6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 -- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 msgr2=0x5606dfca6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfca6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 -- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcaa060 msgr2=0x5606dfcacc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcaa060 0x5606dfcacc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 -- 172.21.15.52:0/2692504534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dfbd9270 con 0x5606dfcac8a0 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.168+0000 7f0e37400640 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0e28079e70 tx=0x7f0e28079900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0be097cf5e295d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e27e00640 1 -- 172.21.15.52:0/2692504534 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a8070 con 0x5606dfcac8a0 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e27e00640 1 -- 172.21.15.52:0/2692504534 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28082a10 con 0x5606dfcac8a0 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e27e00640 1 -- 172.21.15.52:0/2692504534 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2803cd20 con 0x5606dfcac8a0 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 -- 172.21.15.52:0/2692504534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 msgr2=0x5606dfcf2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0e28079e70 tx=0x7f0e28079900 comp rx=0 tx=0).stop 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 -- 172.21.15.52:0/2692504534 shutdown_connections 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfca6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcaa060 0x5606dfcacc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 --2- 172.21.15.52:0/2692504534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf2040 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 -- 172.21.15.52:0/2692504534 >> 172.21.15.52:0/2692504534 conn(0x5606dfca9060 msgr2=0x5606dfcf1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 -- 172.21.15.52:0/2692504534 shutdown_connections 2024-09-10T08:31:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.169+0000 7f0e4124e740 1 -- 172.21.15.52:0/2692504534 wait complete. 2024-09-10T08:31:51.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.170+0000 7f0e4124e740 1 -- start start 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.170+0000 7f0e4124e740 1 Processor -- start 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfd057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfca7d50 0x5606dfccb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606dfca8500 con 0x5606dfcac8a0 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606dfb986b0 con 0x5606dfca7d50 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606dfcf2870 con 0x5606dfcae030 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e4124e740 10 client.0 _ll_register_callbacks cb 0x5606dfbc2bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46878/0 (socket says 172.21.15.52:46878) 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfd057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.171+0000 7f0e37400640 1 -- 172.21.15.52:0/1268256525 learned_addr learned my addr 172.21.15.52:0/1268256525 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37e00640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfca7d50 0x5606dfccb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 -- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 msgr2=0x5606dfd057a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfd057a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 -- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfca7d50 msgr2=0x5606dfccb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfca7d50 0x5606dfccb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 -- 172.21.15.52:0/1268256525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dfbaef60 con 0x5606dfcac8a0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e37400640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0e2807a0a0 tx=0x7f0e28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc99362a2b051c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e24c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a8040 con 0x5606dfcac8a0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e28082580 con 0x5606dfcac8a0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.172+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e28082a10 con 0x5606dfcac8a0 2024-09-10T08:31:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e28095030 con 0x5606dfcac8a0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 10 client.5571 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606df9227b0 con 0x5606dfcac8a0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28082a10 con 0x5606dfcac8a0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0e28079330 con 0x5606dfcac8a0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 10 client.5571 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 10 client.5571 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 20 client.5571 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcab3e0 0x5606dfca5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 4 client.5571 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606dfbed2d0 con 0x5606dfcab3e0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.173+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcab3e0 0x5606dfca5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.174+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcab3e0 0x5606dfca5d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9b97ea81bb0342 server_cookie=feb5802a0110618b in_seq=0 out_seq=0 2024-09-10T08:31:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.174+0000 7f0e24c00640 10 client.5571 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e24c00640 1 -- 172.21.15.52:0/1268256525 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606dfbed2d0 con 0x5606dfcab3e0 2024-09-10T08:31:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e24c00640 10 client.5571 handle_command_reply: tid=0 2024-09-10T08:31:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 client.5571 shutdown 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 msgr2=0x5606dfccd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0e2807a0a0 tx=0x7f0e28008040 comp rx=0 tx=0).stop 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 shutdown_connections 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcab3e0 0x5606dfca5d90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfca7d50 0x5606dfccb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcae030 0x5606dfd057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e24c00640 0 client.5571 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1268256525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfccd2b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 >> 172.21.15.52:0/1268256525 conn(0x5606dfcaa060 msgr2=0x5606dfcf0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 shutdown_connections 2024-09-10T08:31:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 1 -- 172.21.15.52:0/1268256525 wait complete. 2024-09-10T08:31:51.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.175+0000 7f0e4124e740 20 client.5571 trim_cache size 0 max 16384 2024-09-10T08:31:51.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.191+0000 7f0e4124e740 1 Processor -- start 2024-09-10T08:31:51.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.191+0000 7f0e4124e740 1 -- start start 2024-09-10T08:31:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcac8a0 0x5606dfcd2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd15210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38200c00 con 0x5606dfca7d50 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380b03c0 con 0x5606dfcae030 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3815f160 con 0x5606dfcac8a0 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46882/0 (socket says 172.21.15.52:46882) 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 -- 172.21.15.52:0/1427961277 learned_addr learned my addr 172.21.15.52:0/1427961277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcac8a0 0x5606dfcd2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37e00640 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd15210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 -- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcac8a0 msgr2=0x5606dfcd2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcac8a0 0x5606dfcd2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 -- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 msgr2=0x5606dfd15210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd15210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 -- 172.21.15.52:0/1427961277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dfd01ea0 con 0x5606dfca7d50 2024-09-10T08:31:51.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.192+0000 7f0e37400640 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0e28079e70 tx=0x7f0e2807d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8544893e983810c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e27400640 1 -- 172.21.15.52:0/1427961277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2809e070 con 0x5606dfca7d50 2024-09-10T08:31:51.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e27400640 1 -- 172.21.15.52:0/1427961277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2808e030 con 0x5606dfca7d50 2024-09-10T08:31:51.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e27400640 1 -- 172.21.15.52:0/1427961277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a8070 con 0x5606dfca7d50 2024-09-10T08:31:51.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 -- 172.21.15.52:0/1427961277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 msgr2=0x5606dfcd2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0e28079e70 tx=0x7f0e2807d000 comp rx=0 tx=0).stop 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 -- 172.21.15.52:0/1427961277 shutdown_connections 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd15210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfcac8a0 0x5606dfcd2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 --2- 172.21.15.52:0/1427961277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfca7d50 0x5606dfcd2840 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 -- 172.21.15.52:0/1427961277 >> 172.21.15.52:0/1427961277 conn(0x5606dfcaa060 msgr2=0x5606dfccd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 -- 172.21.15.52:0/1427961277 shutdown_connections 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.193+0000 7f0e4124e740 1 -- 172.21.15.52:0/1427961277 wait complete. 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.194+0000 7f0e4124e740 1 -- start start 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.194+0000 7f0e4124e740 1 Processor -- start 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfca7d50 0x5606dfd00560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd68b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606dfb986b0 con 0x5606dfcac8a0 2024-09-10T08:31:51.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e380afd70 con 0x5606dfcae030 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606dfd00aa0 con 0x5606dfca7d50 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e4124e740 10 client.0 _ll_register_callbacks cb 0x7f0e280a6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46886/0 (socket says 172.21.15.52:46886) 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e2fe00640 1 -- 172.21.15.52:0/3125740325 learned_addr learned my addr 172.21.15.52:0/3125740325 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e37400640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfca7d50 0x5606dfd00560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.195+0000 7f0e37e00640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd68b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 -- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfca7d50 msgr2=0x5606dfd00560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfca7d50 0x5606dfd00560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 -- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 msgr2=0x5606dfd68b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd68b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 -- 172.21.15.52:0/3125740325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606df9ecb90 con 0x5606dfcac8a0 2024-09-10T08:31:51.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e37e00640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd68b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e2fe00640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5606dfccd9e0 tx=0x7f0e20000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c3a502660137e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e24c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20014450 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e200145f0 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.196+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e2808e030 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e20039050 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 10 client.5577 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606dfd690a0 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2808e030 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0e20020040 con 0x5606dfcac8a0 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 10 client.5577 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 10 client.5577 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 20 client.5577 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcef590 0x5606dfcef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 4 client.5577 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5606dfc1ccd0 con 0x5606dfcef590 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.197+0000 7f0e37400640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcef590 0x5606dfcef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.198+0000 7f0e37400640 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcef590 0x5606dfcef9a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39675a407b132bd server_cookie=cc63b1d318d3c222 in_seq=0 out_seq=0 2024-09-10T08:31:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.198+0000 7f0e24c00640 10 client.5577 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e24c00640 1 -- 172.21.15.52:0/3125740325 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5606dfc1ccd0 con 0x5606dfcef590 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e24c00640 10 client.5577 handle_command_reply: tid=0 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 client.5577 shutdown 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 msgr2=0x5606dfcf1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x5606dfccd9e0 tx=0x7f0e20000ed0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 shutdown_connections 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dfcef590 0x5606dfcef9a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dfcae030 0x5606dfd68b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606dfcac8a0 0x5606dfcf1640 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 --2- 172.21.15.52:0/3125740325 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606dfca7d50 0x5606dfd00560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e24c00640 0 client.5577 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 >> 172.21.15.52:0/3125740325 conn(0x5606dfcaa060 msgr2=0x5606dfccc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 shutdown_connections 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.203+0000 7f0e4124e740 1 -- 172.21.15.52:0/3125740325 wait complete. 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e4124e740 20 client.5577 trim_cache size 0 max 16384 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:51.205 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 msgr2=0x7f0e1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 0x7f0e1406e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0e3806f9b0 tx=0x7f0e20009040 comp rx=0 tx=0).stop 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 msgr2=0x7f0e380c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0e280098c0 tx=0x7f0e280046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 shutdown_connections 2024-09-10T08:31:51.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0e1406be30 0x7f0e1406e2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e3815c7f0 0x7f0e380b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e380b1c30 0x7f0e38156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 --2- 172.21.15.52:0/1259829105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e38073800 0x7f0e380c9640 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 >> 172.21.15.52:0/1259829105 conn(0x7f0e380d2570 msgr2=0x7f0e380b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 shutdown_connections 2024-09-10T08:31:51.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.204+0000 7f0e3e400640 1 -- 172.21.15.52:0/1259829105 wait complete. 2024-09-10T08:31:51.219 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-10T08:31:51.220 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:31:51.321 INFO:teuthology.orchestra.run.smithi052.stdout:1099511630412 2024-09-10T08:31:51.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:31:51.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T08:31:51.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.530+0000 7fcfc2200640 1 Processor -- start 2024-09-10T08:31:51.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.530+0000 7fcfc2200640 1 -- start start 2024-09-10T08:31:51.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfc2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfbc072ad0 0x7fcfbc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfc2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0cf2e0 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfc2200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc070fe0 con 0x7fcfbc15b7c0 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfc2200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc0712c0 con 0x7fcfbc072ad0 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfbc0ccf30 0x7fcfbc0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51602/0 (socket says 172.21.15.52:51602) 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbb400640 1 -- 172.21.15.52:0/3048713766 learned_addr learned my addr 172.21.15.52:0/3048713766 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/3048713766 >> v2:172.21.15.52:3300/0 conn(0x7fcfbc072ad0 0x7fcfbc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbbe00640 1 -- 172.21.15.52:0/3048713766 >> v1:172.21.15.176:6789/0 conn(0x7fcfbc15b7c0 legacy=0x7fcfbc0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbbe00640 1 -- 172.21.15.52:0/3048713766 >> v1:172.21.15.52:6789/0 conn(0x7fcfbc0ccf30 legacy=0x7fcfbc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.532+0000 7fcfbbe00640 1 -- 172.21.15.52:0/3048713766 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0715a0 con 0x7fcfbc072ad0 2024-09-10T08:31:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.533+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/3048713766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc0b2c50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b38e1bd3a0206d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfbaa00640 1 -- 172.21.15.52:0/3048713766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007740 con 0x7fcfbc072ad0 2024-09-10T08:31:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfbaa00640 1 -- 172.21.15.52:0/3048713766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40078e0 con 0x7fcfbc072ad0 2024-09-10T08:31:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfbaa00640 1 -- 172.21.15.52:0/3048713766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007cb0 con 0x7fcfbc072ad0 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 -- 172.21.15.52:0/3048713766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc072ad0 msgr2=0x7fcfbc0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 --2- 172.21.15.52:0/3048713766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc0b2c50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402c820 comp rx=0 tx=0).stop 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 -- 172.21.15.52:0/3048713766 shutdown_connections 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 --2- 172.21.15.52:0/3048713766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc0b2c50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 -- 172.21.15.52:0/3048713766 >> 172.21.15.52:0/3048713766 conn(0x7fcfbc06d0f0 msgr2=0x7fcfbc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 -- 172.21.15.52:0/3048713766 shutdown_connections 2024-09-10T08:31:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.534+0000 7fcfc2200640 1 -- 172.21.15.52:0/3048713766 wait complete. 2024-09-10T08:31:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.536+0000 7fcfc2200640 1 Processor -- start 2024-09-10T08:31:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.536+0000 7fcfc2200640 1 -- start start 2024-09-10T08:31:51.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 0x7fcfbc1f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc06bd90 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc06bc10 con 0x7fcfbc072ad0 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfc2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc06bf10 con 0x7fcfbc15b7c0 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46904/0 (socket says 172.21.15.52:46904) 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfb3e00640 1 -- 172.21.15.52:0/2468802783 learned_addr learned my addr 172.21.15.52:0/2468802783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 0x7fcfbc1f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.537+0000 7fcfbb400640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 -- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 msgr2=0x7fcfbc1f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 0x7fcfbc1f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 -- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 msgr2=0x7fcfbc15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 -- 172.21.15.52:0/2468802783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc15c420 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 0x7fcfbc1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfbb400640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400b3f0 tx=0x7fcfa400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3400640 1 -- 172.21.15.52:0/2468802783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4015020 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3400640 1 -- 172.21.15.52:0/2468802783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4011830 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc15ddd0 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfb3400640 1 -- 172.21.15.52:0/2468802783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4011c20 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.538+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc15c110 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.541+0000 7fcfb3400640 1 -- 172.21.15.52:0/2468802783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfa4018020 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.541+0000 7fcfb3400640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 0x7fcf9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.542+0000 7fcfb3400640 1 -- 172.21.15.52:0/2468802783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fcfa408aa70 con 0x7fcfbc0ccf30 2024-09-10T08:31:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.542+0000 7fcfc5089740 1 Processor -- start 2024-09-10T08:31:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.542+0000 7fcfbb400640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 0x7fcf9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.542+0000 7fcfc5089740 1 -- start start 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfbb400640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 0x7fcf9806e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000f60 tx=0x7fcfac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe112c0 0x5648cfe2ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe30d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648cfd4d490 con 0x5648cfe116a0 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5648cfcf5690 con 0x5648cfe112c0 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648cfd49450 con 0x5648cfe308b0 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46908/0 (socket says 172.21.15.52:46908) 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 -- 172.21.15.52:0/1511909238 learned_addr learned my addr 172.21.15.52:0/1511909238 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 -- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 msgr2=0x5648cfe30d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 -- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe112c0 msgr2=0x5648cfe2ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe112c0 0x5648cfe2ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.543+0000 7fcfb3e00640 1 -- 172.21.15.52:0/1511909238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648cfcfce00 con 0x5648cfe116a0 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4088f70 tx=0x7fcfa40595e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c340130a3a684e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfab400640 1 -- 172.21.15.52:0/1511909238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4011dc0 con 0x5648cfe116a0 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfab400640 1 -- 172.21.15.52:0/1511909238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4087070 con 0x5648cfe116a0 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfab400640 1 -- 172.21.15.52:0/1511909238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4055420 con 0x5648cfe116a0 2024-09-10T08:31:51.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 -- 172.21.15.52:0/1511909238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 msgr2=0x5648cfe2e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4088f70 tx=0x7fcfa40595e0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 -- 172.21.15.52:0/1511909238 shutdown_connections 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe30d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe2e360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 --2- 172.21.15.52:0/1511909238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe112c0 0x5648cfe2ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.544+0000 7fcfc5089740 1 -- 172.21.15.52:0/1511909238 >> 172.21.15.52:0/1511909238 conn(0x5648cfde6d20 msgr2=0x5648cfe2f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.545+0000 7fcfc5089740 1 -- 172.21.15.52:0/1511909238 shutdown_connections 2024-09-10T08:31:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.545+0000 7fcfc5089740 1 -- 172.21.15.52:0/1511909238 wait complete. 2024-09-10T08:31:51.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.545+0000 7fcfc5089740 1 -- start start 2024-09-10T08:31:51.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.545+0000 7fcfc5089740 1 Processor -- start 2024-09-10T08:31:51.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 0x5648cfde96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfe288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648cfe30280 con 0x5648cfe116a0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5648cfd08950 con 0x5648cfe308b0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648cfe30560 con 0x5648cfde9c30 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.546+0000 7fcfc5089740 10 client.0 _ll_register_callbacks cb 0x5648cfcd44d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46922/0 (socket says 172.21.15.52:46922) 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 -- 172.21.15.52:0/3429485503 learned_addr learned my addr 172.21.15.52:0/3429485503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfe288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 0x5648cfde96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 -- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 msgr2=0x5648cfe288b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfe288b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 -- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 msgr2=0x5648cfde96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 0x5648cfde96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 -- 172.21.15.52:0/3429485503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648cfd01f40 con 0x5648cfe116a0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 0x5648cfde96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfe288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005e10 tx=0x7fcfac0074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf68221addc25f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.547+0000 7fcf9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00ece0 con 0x5648cfe116a0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fcfac023ad0 con 0x5648cfe116a0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa4087070 con 0x5648cfe116a0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcfac00ee80 con 0x5648cfe116a0 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 10 client.5592 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5648cfa603f0 con 0x5648cfe116a0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4087070 con 0x5648cfe116a0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fcfac02a050 con 0x5648cfe116a0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 10 client.5592 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 10 client.5592 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 20 client.5592 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe143c0 0x5648cfe147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 4 client.5592 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.548+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648cfd5abc0 con 0x5648cfe143c0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.549+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe143c0 0x5648cfe147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.549+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe143c0 0x5648cfe147a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f0025a669506d43 server_cookie=37d6f00220f364cd in_seq=0 out_seq=0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.549+0000 7fcf9fe00640 10 client.5592 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3429485503 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648cfd5abc0 con 0x5648cfe143c0 2024-09-10T08:31:51.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcf9fe00640 10 client.5592 handle_command_reply: tid=0 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 client.5592 shutdown 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 msgr2=0x5648cfe0a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005e10 tx=0x7fcfac0074a0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 shutdown_connections 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe143c0 0x5648cfe147a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfe288b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe308b0 0x5648cfde96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcf9fe00640 0 client.5592 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3429485503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe116a0 0x5648cfe0a710 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 >> 172.21.15.52:0/3429485503 conn(0x5648cfe112c0 msgr2=0x5648cfe0f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 shutdown_connections 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.550+0000 7fcfc5089740 1 -- 172.21.15.52:0/3429485503 wait complete. 2024-09-10T08:31:51.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.551+0000 7fcfc5089740 20 client.5592 trim_cache size 0 max 16384 2024-09-10T08:31:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.565+0000 7fcfc5089740 1 Processor -- start 2024-09-10T08:31:51.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.565+0000 7fcfc5089740 1 -- start start 2024-09-10T08:31:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfde60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe2b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc1fca20 con 0x5648cfe308b0 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc156280 con 0x5648cfe116a0 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc1f4cd0 con 0x5648cfde9c30 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.566+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46930/0 (socket says 172.21.15.52:46930) 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 -- 172.21.15.52:0/2460698545 learned_addr learned my addr 172.21.15.52:0/2460698545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbb400640 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfde60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe2b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 -- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 msgr2=0x5648cfde60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfde60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 -- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 msgr2=0x5648cfe2b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe2b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 -- 172.21.15.52:0/2460698545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648cfb2a7d0 con 0x5648cfe308b0 2024-09-10T08:31:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.567+0000 7fcfbbe00640 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd302c8016b61205 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfaaa00640 1 -- 172.21.15.52:0/2460698545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007930 con 0x5648cfe308b0 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfaaa00640 1 -- 172.21.15.52:0/2460698545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4007ad0 con 0x5648cfe308b0 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfaaa00640 1 -- 172.21.15.52:0/2460698545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4047430 con 0x5648cfe308b0 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 -- 172.21.15.52:0/2460698545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 msgr2=0x5648cfe2bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009d90 tx=0x7fcfb402e000 comp rx=0 tx=0).stop 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 -- 172.21.15.52:0/2460698545 shutdown_connections 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfe308b0 0x5648cfe2bcb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe2b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 --2- 172.21.15.52:0/2460698545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfde9c30 0x5648cfde60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.568+0000 7fcfc5089740 1 -- 172.21.15.52:0/2460698545 >> 172.21.15.52:0/2460698545 conn(0x5648cfe112c0 msgr2=0x5648cfe45ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.569+0000 7fcfc5089740 1 -- 172.21.15.52:0/2460698545 shutdown_connections 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.569+0000 7fcfc5089740 1 -- 172.21.15.52:0/2460698545 wait complete. 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.569+0000 7fcfc5089740 1 -- start start 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.569+0000 7fcfc5089740 1 Processor -- start 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe2c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648cfde7220 con 0x5648cfde9c30 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc155c30 con 0x5648cfe116a0 2024-09-10T08:31:51.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5648cfe57860 con 0x5648cfe308b0 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.570+0000 7fcfc5089740 10 client.0 _ll_register_callbacks cb 0x7fcfac001d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46934/0 (socket says 172.21.15.52:46934) 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 -- 172.21.15.52:0/3977806733 learned_addr learned my addr 172.21.15.52:0/3977806733 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 -- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 msgr2=0x5648cfe2c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe2c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 -- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 msgr2=0x5648cfe570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 -- 172.21.15.52:0/3977806733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648cfe10630 con 0x5648cfde9c30 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcfbb400640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005e10 tx=0x7fcfac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedd8f066c3f7288 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.571+0000 7fcf9fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac013420 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fcfac0135c0 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb4007ad0 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcfac0137c0 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 10 client.5598 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5648cfe97970 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4007ad0 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fcfac040080 con 0x5648cfde9c30 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 10 client.5598 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 10 client.5598 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 20 client.5598 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe0cfa0 0x5648cfe0d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 4 client.5598 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648cfd54f10 con 0x5648cfe0cfa0 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.572+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe0cfa0 0x5648cfe0d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfb3e00640 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe0cfa0 0x5648cfe0d3e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3d43f6377cdf918 server_cookie=8b25a1a87a9c4e7b in_seq=0 out_seq=0 2024-09-10T08:31:51.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcf9fe00640 10 client.5598 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcf9fe00640 1 -- 172.21.15.52:0/3977806733 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648cfd54f10 con 0x5648cfe0cfa0 2024-09-10T08:31:51.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcf9fe00640 10 client.5598 handle_command_reply: tid=0 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 client.5598 shutdown 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 msgr2=0x5648cfde6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005e10 tx=0x7fcfac012000 comp rx=0 tx=0).stop 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 shutdown_connections 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5648cfe0cfa0 0x5648cfe0d3e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5648cfe308b0 0x5648cfe2c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5648cfe116a0 0x5648cfe570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 --2- 172.21.15.52:0/3977806733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648cfde9c30 0x5648cfde6650 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcf9fe00640 0 client.5598 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.573+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 >> 172.21.15.52:0/3977806733 conn(0x5648cfe112c0 msgr2=0x5648cfe461e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 shutdown_connections 2024-09-10T08:31:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc5089740 1 -- 172.21.15.52:0/3977806733 wait complete. 2024-09-10T08:31:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc5089740 20 client.5598 trim_cache size 0 max 16384 2024-09-10T08:31:51.580 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 msgr2=0x7fcf9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 0x7fcf9806e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcfac000f60 tx=0x7fcfac009040 comp rx=0 tx=0).stop 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 msgr2=0x7fcfbc0ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400b3f0 tx=0x7fcfa400b8b0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 shutdown_connections 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf9806be30 0x7fcf9806e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfbc15b7c0 0x7fcfbc1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfbc0ccf30 0x7fcfbc0ce320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 --2- 172.21.15.52:0/2468802783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfbc072ad0 0x7fcfbc15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.574+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 >> 172.21.15.52:0/2468802783 conn(0x7fcfbc06d0f0 msgr2=0x7fcfbc0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.575+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 shutdown_connections 2024-09-10T08:31:51.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.575+0000 7fcfc2200640 1 -- 172.21.15.52:0/2468802783 wait complete. 2024-09-10T08:31:51.590 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4c.00000000 parent 2024-09-10T08:31:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.667+0000 7f27e52acf40 1 Processor -- start 2024-09-10T08:31:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.667+0000 7f27e52acf40 1 -- start start 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.667+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb9476c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94753990 0x55cb94889930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e52acf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb946c7b30 con 0x55cb94768a40 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e52acf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cb94753f80 con 0x55cb94753990 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e52acf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55cb947f0620 con 0x55cb9471f880 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46948/0 (socket says 172.21.15.52:46948) 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 -- 172.21.15.52:0/3141717955 learned_addr learned my addr 172.21.15.52:0/3141717955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2400640 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb9476c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e1a00640 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94753990 0x55cb94889930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 -- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 msgr2=0x55cb9476c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb9476c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 -- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94753990 msgr2=0x55cb94889930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94753990 0x55cb94889930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.668+0000 7f27e2e00640 1 -- 172.21.15.52:0/3141717955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb947f0aa0 con 0x55cb94768a40 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e2e00640 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001b10 tx=0x7f27dc0069f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdc1523ec72564b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27dbe00640 1 -- 172.21.15.52:0/3141717955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc016070 con 0x55cb94768a40 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27dbe00640 1 -- 172.21.15.52:0/3141717955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc004540 con 0x55cb94768a40 2024-09-10T08:31:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27dbe00640 1 -- 172.21.15.52:0/3141717955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc004970 con 0x55cb94768a40 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 -- 172.21.15.52:0/3141717955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 msgr2=0x55cb94889e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001b10 tx=0x7f27dc0069f0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 -- 172.21.15.52:0/3141717955 shutdown_connections 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94768a40 0x55cb94889e70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94753990 0x55cb94889930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 --2- 172.21.15.52:0/3141717955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb9476c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 -- 172.21.15.52:0/3141717955 >> 172.21.15.52:0/3141717955 conn(0x55cb947504f0 msgr2=0x55cb9476d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.669+0000 7f27e52acf40 1 -- 172.21.15.52:0/3141717955 shutdown_connections 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.670+0000 7f27e52acf40 1 -- 172.21.15.52:0/3141717955 wait complete. 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.670+0000 7f27e52acf40 1 Processor -- start 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.670+0000 7f27e52acf40 1 -- start start 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb947e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 0x55cb94752ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94768a40 0x55cb947e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb947f1d60 con 0x55cb94753990 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cb947f0fd0 con 0x55cb94768a40 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e52acf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55cb947f14f0 con 0x55cb9471f880 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.671+0000 7f27e1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 0x55cb94752ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 0x55cb94752ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46956/0 (socket says 172.21.15.52:46956) 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 -- 172.21.15.52:0/2410518740 learned_addr learned my addr 172.21.15.52:0/2410518740 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e2400640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb947e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e2e00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94768a40 0x55cb947e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 -- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 msgr2=0x55cb947e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cb9471f880 0x55cb947e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 -- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94768a40 msgr2=0x55cb947e5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cb94768a40 0x55cb947e5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 -- 172.21.15.52:0/2410518740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb947ec800 con 0x55cb94753990 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.672+0000 7f27e1a00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 0x55cb94752ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009f70 tx=0x7f27d00084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.673+0000 7f27daa00640 1 -- 172.21.15.52:0/2410518740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0015660 con 0x55cb94753990 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.673+0000 7f27daa00640 1 -- 172.21.15.52:0/2410518740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d001a070 con 0x55cb94753990 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.673+0000 7f27daa00640 1 -- 172.21.15.52:0/2410518740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0015a20 con 0x55cb94753990 2024-09-10T08:31:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.673+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb947ecae0 con 0x55cb94753990 2024-09-10T08:31:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.673+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb947e6730 con 0x55cb94753990 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.674+0000 7f27daa00640 1 -- 172.21.15.52:0/2410518740 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27d0013030 con 0x55cb94753990 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.675+0000 7f27daa00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27c406a840 0x7f27c406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.675+0000 7f27daa00640 1 -- 172.21.15.52:0/2410518740 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f27d0089a30 con 0x55cb94753990 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.676+0000 7f27e52acf40 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x55cb94753220 0x55cb947f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.676+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 --> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] -- osd_op(unknown.0.0:1 7.3a 7:5fa3b718:::10000000a4c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x55cb947e96f0 con 0x55cb94753220 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.676+0000 7f27e2400640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27c406a840 0x7f27c406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.676+0000 7f27e2e00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x55cb94753220 0x55cb947f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.677+0000 7f27e2400640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27c406a840 0x7f27c406cd00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f27d4056000 tx=0x7f27d4050000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.677+0000 7f27e2e00640 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x55cb94753220 0x55cb947f41b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.678+0000 7f27e2e00640 1 -- 172.21.15.52:0/2410518740 <== osd.6 v2:172.21.15.176:6818/2589759932 1 ==== osd_op_reply(1 10000000a4c.00000000 [rmxattr] v49'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f27dc00f070 con 0x55cb94753220 2024-09-10T08:31:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.678+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x55cb94753220 msgr2=0x55cb947f41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.678+0000 7f27e52acf40 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x55cb94753220 0x55cb947f41b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27c406a840 msgr2=0x7f27c406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27c406a840 0x7f27c406cd00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f27d4056000 tx=0x7f27d4050000 comp rx=0 tx=0).stop 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 msgr2=0x55cb94752ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 --2- 172.21.15.52:0/2410518740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb94753990 0x55cb94752ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009f70 tx=0x7f27d00084c0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e2e00640 1 -- 172.21.15.52:0/2410518740 reap_dead start 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 shutdown_connections 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 >> 172.21.15.52:0/2410518740 conn(0x55cb947504f0 msgr2=0x55cb9476cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 shutdown_connections 2024-09-10T08:31:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.679+0000 7f27e52acf40 1 -- 172.21.15.52:0/2410518740 wait complete. 2024-09-10T08:31:51.683 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-10T08:31:51.683 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-10T08:31:51.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.842+0000 7f4bcac00640 1 Processor -- start 2024-09-10T08:31:51.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.842+0000 7f4bcac00640 1 -- start start 2024-09-10T08:31:51.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4bc40ccf30 0x7f4bc40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bc415b7c0 0x7f4bc40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc40cead0 0x7f4bc415f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc40cd850 con 0x7f4bc415b7c0 2024-09-10T08:31:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc40cf2e0 con 0x7f4bc40ccf30 2024-09-10T08:31:51.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.843+0000 7f4bcac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc4070fe0 con 0x7f4bc40cead0 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bc415b7c0 0x7f4bc40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4bc415b7c0 0x7f4bc40cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46958/0 (socket says 172.21.15.52:46958) 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 -- 172.21.15.52:0/2284316835 learned_addr learned my addr 172.21.15.52:0/2284316835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2284316835 >> v2:172.21.15.176:3300/0 conn(0x7f4bc40ccf30 0x7f4bc40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc40cead0 0x7f4bc415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 -- 172.21.15.52:0/2284316835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc40cead0 msgr2=0x7f4bc415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc40cead0 0x7f4bc415f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 -- 172.21.15.52:0/2284316835 >> v2:172.21.15.176:3300/0 conn(0x7f4bc40ccf30 msgr2=0x7f4bc40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2284316835 >> v2:172.21.15.176:3300/0 conn(0x7f4bc40ccf30 0x7f4bc40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.844+0000 7f4bc3400640 1 -- 172.21.15.52:0/2284316835 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc40712c0 con 0x7f4bc415b7c0 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.845+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc415b7c0 0x7f4bc40cd310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4bc406f1c0 tx=0x7f4bb002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b960dbb6a670f33e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.845+0000 7f4bc2a00640 1 -- 172.21.15.52:0/2284316835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0037070 con 0x7f4bc415b7c0 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bc2a00640 1 -- 172.21.15.52:0/2284316835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0032440 con 0x7f4bc415b7c0 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bc2a00640 1 -- 172.21.15.52:0/2284316835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0032810 con 0x7f4bc415b7c0 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 -- 172.21.15.52:0/2284316835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc415b7c0 msgr2=0x7f4bc40cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc415b7c0 0x7f4bc40cd310 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4bc406f1c0 tx=0x7f4bb002a140 comp rx=0 tx=0).stop 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 -- 172.21.15.52:0/2284316835 shutdown_connections 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc40cead0 0x7f4bc415f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2284316835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc415b7c0 0x7f4bc40cd310 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2284316835 >> v2:172.21.15.176:3300/0 conn(0x7f4bc40ccf30 0x7f4bc40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 -- 172.21.15.52:0/2284316835 >> 172.21.15.52:0/2284316835 conn(0x7f4bc406d0f0 msgr2=0x7f4bc406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 -- 172.21.15.52:0/2284316835 shutdown_connections 2024-09-10T08:31:51.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.846+0000 7f4bcac00640 1 -- 172.21.15.52:0/2284316835 wait complete. 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.848+0000 7f4bcac00640 1 Processor -- start 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.848+0000 7f4bcac00640 1 -- start start 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bc40ccf30 0x7f4bc414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc415b7c0 0x7f4bc415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc40cef20 con 0x7f4bc40cead0 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc40cf5c0 con 0x7f4bc40ccf30 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bcac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc40cf0a0 con 0x7f4bc415b7c0 2024-09-10T08:31:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46964/0 (socket says 172.21.15.52:46964) 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 -- 172.21.15.52:0/2358621366 learned_addr learned my addr 172.21.15.52:0/2358621366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc415b7c0 0x7f4bc415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bc40ccf30 0x7f4bc414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 -- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc415b7c0 msgr2=0x7f4bc415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc415b7c0 0x7f4bc415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.849+0000 7f4bc3400640 1 -- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bc40ccf30 msgr2=0x7f4bc414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bc40ccf30 0x7f4bc414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bc3400640 1 -- 172.21.15.52:0/2358621366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc414ed30 con 0x7f4bc40cead0 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bbbe00640 1 -- 172.21.15.52:0/2358621366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0041020 con 0x7f4bc40cead0 2024-09-10T08:31:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bbbe00640 1 -- 172.21.15.52:0/2358621366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb003d620 con 0x7f4bc40cead0 2024-09-10T08:31:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc414f010 con 0x7f4bc40cead0 2024-09-10T08:31:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bbbe00640 1 -- 172.21.15.52:0/2358621366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0037040 con 0x7f4bc40cead0 2024-09-10T08:31:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.850+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc414f5d0 con 0x7f4bc40cead0 2024-09-10T08:31:51.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.852+0000 7f4bbbe00640 1 -- 172.21.15.52:0/2358621366 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bb0044020 con 0x7f4bc40cead0 2024-09-10T08:31:51.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.853+0000 7f4bbbe00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 0x7f4ba406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.853+0000 7f4bbbe00640 1 -- 172.21.15.52:0/2358621366 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4bb00ab3b0 con 0x7f4bc40cead0 2024-09-10T08:31:51.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.854+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 0x7f4ba406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.854+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 0x7f4ba406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009a20 tx=0x7f4bb4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.854+0000 7f4bcda74740 1 Processor -- start 2024-09-10T08:31:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.854+0000 7f4bcda74740 1 -- start start 2024-09-10T08:31:51.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf47248d90 0x55bf47249170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf472206c0 0x55bf47270de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf47182ac0 con 0x55bf4721a950 2024-09-10T08:31:51.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf4712aa20 con 0x55bf472206c0 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bf4717ea80 con 0x55bf47248d90 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.855+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46974/0 (socket says 172.21.15.52:46974) 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 -- 172.21.15.52:0/1095115672 learned_addr learned my addr 172.21.15.52:0/1095115672 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf472206c0 0x55bf47270de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf47248d90 0x55bf47249170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 -- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf47248d90 msgr2=0x55bf47249170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf47248d90 0x55bf47249170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 -- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf472206c0 msgr2=0x55bf47270de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf472206c0 0x55bf47270de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 -- 172.21.15.52:0/1095115672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf46f61c00 con 0x55bf4721a950 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009280 tx=0x7f4bb0079060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88234cc66a801c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bafe00640 1 -- 172.21.15.52:0/1095115672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0082230 con 0x55bf4721a950 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bafe00640 1 -- 172.21.15.52:0/1095115672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0077a00 con 0x55bf4721a950 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.856+0000 7f4bafe00640 1 -- 172.21.15.52:0/1095115672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0075d70 con 0x55bf4721a950 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 -- 172.21.15.52:0/1095115672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 msgr2=0x55bf472708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009280 tx=0x7f4bb0079060 comp rx=0 tx=0).stop 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 -- 172.21.15.52:0/1095115672 shutdown_connections 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf472206c0 0x55bf47270de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4721a950 0x55bf472708a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1095115672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf47248d90 0x55bf47249170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 -- 172.21.15.52:0/1095115672 >> 172.21.15.52:0/1095115672 conn(0x55bf4721b650 msgr2=0x55bf47263ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 -- 172.21.15.52:0/1095115672 shutdown_connections 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.857+0000 7f4bcda74740 1 -- 172.21.15.52:0/1095115672 wait complete. 2024-09-10T08:31:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.858+0000 7f4bcda74740 1 -- start start 2024-09-10T08:31:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.858+0000 7f4bcda74740 1 Processor -- start 2024-09-10T08:31:51.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4724ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf47244d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf4721f9c0 con 0x55bf4726e680 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55bf4713dc40 con 0x55bf47248d90 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bf47182ac0 con 0x55bf4724a680 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bcda74740 10 client.0 _ll_register_callbacks cb 0x55bf4712f720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46988/0 (socket says 172.21.15.52:46988) 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.859+0000 7f4bc3400640 1 -- 172.21.15.52:0/2919549428 learned_addr learned my addr 172.21.15.52:0/2919549428 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4724ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf47244d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 -- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 msgr2=0x55bf47244d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf47244d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 -- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 msgr2=0x55bf4724ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4724ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 -- 172.21.15.52:0/2919549428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf46e554f0 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4724ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bc3400640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00791d0 tx=0x7f4bb00ab070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8304f3b368bade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bacc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0081fa0 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4bb007eb90 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb0077a00 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4bb007ed90 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bcda74740 10 client.5619 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.860+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55bf46fc2390 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0077a00 con 0x55bf4726e680 2024-09-10T08:31:51.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f4bb003a030 con 0x55bf4726e680 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 10 client.5619 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 20 client.5619 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4724c3f0 0x55bf4724c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 4 client.5619 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf47157250 con 0x55bf4724c3f0 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.861+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4724c3f0 0x55bf4724c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.862+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4724c3f0 0x55bf4724c840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c87705a0dcffbe server_cookie=bbbc171b84348e35 in_seq=0 out_seq=0 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.862+0000 7f4bacc00640 10 client.5619 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.862+0000 7f4bacc00640 1 -- 172.21.15.52:0/2919549428 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf47157250 con 0x55bf4724c3f0 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.862+0000 7f4bacc00640 10 client.5619 handle_command_reply: tid=0 2024-09-10T08:31:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 client.5619 shutdown 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 msgr2=0x55bf4724a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00791d0 tx=0x7f4bb00ab070 comp rx=0 tx=0).stop 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 shutdown_connections 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4724c3f0 0x55bf4724c840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf47244d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4726e680 0x55bf4724a140 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bacc00640 0 client.5619 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 --2- 172.21.15.52:0/2919549428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4724ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 >> 172.21.15.52:0/2919549428 conn(0x55bf472206c0 msgr2=0x55bf47261bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 shutdown_connections 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 1 -- 172.21.15.52:0/2919549428 wait complete. 2024-09-10T08:31:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.863+0000 7f4bcda74740 20 client.5619 trim_cache size 0 max 16384 2024-09-10T08:31:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.881+0000 7f4bcda74740 1 Processor -- start 2024-09-10T08:31:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.881+0000 7f4bcda74740 1 -- start start 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4726c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4726e680 0x55bf4726d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41fc860 con 0x55bf4724a680 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41fb860 con 0x55bf47248d90 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc41fac90 con 0x55bf4726e680 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.882+0000 7f4bc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46998/0 (socket says 172.21.15.52:46998) 2024-09-10T08:31:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 -- 172.21.15.52:0/1352464699 learned_addr learned my addr 172.21.15.52:0/1352464699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 -- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4726e680 msgr2=0x55bf4726d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4726e680 0x55bf4726d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 -- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 msgr2=0x55bf4726c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4726c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 -- 172.21.15.52:0/1352464699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf46e2e5b0 con 0x55bf4724a680 2024-09-10T08:31:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4bc3400640 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4bb002a180 tx=0x7f4bb008f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c77a588b487346 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4baf400640 1 -- 172.21.15.52:0/1352464699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0077a00 con 0x55bf4724a680 2024-09-10T08:31:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4baf400640 1 -- 172.21.15.52:0/1352464699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0081da0 con 0x55bf4724a680 2024-09-10T08:31:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.883+0000 7f4baf400640 1 -- 172.21.15.52:0/1352464699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0078b50 con 0x55bf4724a680 2024-09-10T08:31:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 -- 172.21.15.52:0/1352464699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 msgr2=0x55bf472441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4bb002a180 tx=0x7f4bb008f070 comp rx=0 tx=0).stop 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 -- 172.21.15.52:0/1352464699 shutdown_connections 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4726e680 0x55bf4726d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf4724a680 0x55bf472441e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 --2- 172.21.15.52:0/1352464699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf47248d90 0x55bf4726c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 -- 172.21.15.52:0/1352464699 >> 172.21.15.52:0/1352464699 conn(0x55bf472206c0 msgr2=0x55bf4724c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 -- 172.21.15.52:0/1352464699 shutdown_connections 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.884+0000 7f4bcda74740 1 -- 172.21.15.52:0/1352464699 wait complete. 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.885+0000 7f4bcda74740 1 -- start start 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.885+0000 7f4bcda74740 1 Processor -- start 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf472817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 0x55bf472dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf4712aa20 con 0x55bf47248d90 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41fb210 con 0x55bf4726e680 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55bf472464b0 con 0x55bf4724a680 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bcda74740 10 client.0 _ll_register_callbacks cb 0x7f4bb0079560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47012/0 (socket says 172.21.15.52:47012) 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 -- 172.21.15.52:0/683278853 learned_addr learned my addr 172.21.15.52:0/683278853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 -- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 msgr2=0x55bf472817e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3400640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf472817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 0x55bf472dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf472817e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 -- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 msgr2=0x55bf472dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 0x55bf472dc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.886+0000 7f4bc3e00640 1 -- 172.21.15.52:0/683278853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf4721d7b0 con 0x55bf47248d90 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bc3400640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf472817e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bc8c00640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 0x55bf472dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bc3e00640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55bf47264000 tx=0x7f4bb4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fce7b753b14867 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bacc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4030060 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bb0081da0 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4bb4003a90 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4bb4036050 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bcda74740 10 client.5625 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.887+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55bf4728c740 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0081da0 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f4bb4039020 con 0x55bf47248d90 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 10 client.5625 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:51.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 10 client.5625 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:51.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 20 client.5625 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:51.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4726d040 0x55bf472dcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:51.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 4 client.5625 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-10T08:31:51.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55bf471901f0 con 0x55bf4726d040 2024-09-10T08:31:51.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bc3400640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4726d040 0x55bf472dcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bc3400640 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4726d040 0x55bf472dcab0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49a3fe9834b0b212 server_cookie=f91799e79497c50f in_seq=0 out_seq=0 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.888+0000 7f4bacc00640 10 client.5625 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bacc00640 1 -- 172.21.15.52:0/683278853 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bf471901f0 con 0x55bf4726d040 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bacc00640 10 client.5625 handle_command_reply: tid=0 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 client.5625 shutdown 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 msgr2=0x55bf472e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x55bf47264000 tx=0x7f4bb4011b70 comp rx=0 tx=0).stop 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 shutdown_connections 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55bf4726d040 0x55bf472dcab0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55bf4726e680 0x55bf472dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55bf4724a680 0x55bf472817e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 --2- 172.21.15.52:0/683278853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf47248d90 0x55bf472e6b20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bacc00640 0 client.5625 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 >> 172.21.15.52:0/683278853 conn(0x55bf472206c0 msgr2=0x55bf4726c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 shutdown_connections 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 1 -- 172.21.15.52:0/683278853 wait complete. 2024-09-10T08:31:51.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.889+0000 7f4bcda74740 20 client.5625 trim_cache size 0 max 16384 2024-09-10T08:31:51.896 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f9598800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v434 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5382=0-4194304@1} caps={5382=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5382 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55c67e388b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4c:[<0x10000000001/new_file_0 v434>,<0x10000000000/ceph-qa-suite v42>,<0x1/scrub_test_path v14>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-10T08:31:51.897 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:51.897 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:51.897 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "1fe16de5-c85d-4674-ae1f-6b171b9820c8", 2024-09-10T08:31:51.897 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:51.897 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 msgr2=0x7f4ba406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 0x7f4ba406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009a20 tx=0x7f4bb4009190 comp rx=0 tx=0).stop 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 msgr2=0x7f4bc4159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0000c00 tx=0x7f4bb00046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 shutdown_connections 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ba406be60 0x7f4ba406e320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bc415b7c0 0x7f4bc415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc40cead0 0x7f4bc4159e00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 --2- 172.21.15.52:0/2358621366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bc40ccf30 0x7f4bc414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:51.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 >> 172.21.15.52:0/2358621366 conn(0x7f4bc406d0f0 msgr2=0x7f4bc4072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:51.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 shutdown_connections 2024-09-10T08:31:51.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:51.890+0000 7f4bcac00640 1 -- 172.21.15.52:0/2358621366 wait complete. 2024-09-10T08:31:51.905 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '1fe16de5-c85d-4674-ae1f-6b171b9820c8', 'mode': 'asynchronous'}' 2024-09-10T08:31:51.905 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:31:51.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T08:31:52.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.063+0000 7f38b3400640 1 Processor -- start 2024-09-10T08:31:52.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.063+0000 7f38b3400640 1 -- start start 2024-09-10T08:31:52.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38ac0732e0 0x7f38ac0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b3400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac0714b0 con 0x7f38ac0cd2a0 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b3400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ac073c00 con 0x7f38ac0cce30 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b3400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f38ac0cd880 con 0x7f38ac0732e0 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38ac0732e0 0x7f38ac0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38ac0732e0 0x7f38ac0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47014/0 (socket says 172.21.15.52:47014) 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 -- 172.21.15.52:0/3743467081 learned_addr learned my addr 172.21.15.52:0/3743467081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 -- 172.21.15.52:0/3743467081 >> v1:172.21.15.176:6789/0 conn(0x7f38ac0cce30 legacy=0x7f38ac071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 -- 172.21.15.52:0/3743467081 >> v1:172.21.15.52:6789/0 conn(0x7f38ac0cd2a0 legacy=0x7f38ac15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.065+0000 7f38b0a00640 1 -- 172.21.15.52:0/3743467081 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac0cdb60 con 0x7f38ac0732e0 2024-09-10T08:31:52.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.066+0000 7f38b0a00640 1 --2- 172.21.15.52:0/3743467081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0732e0 0x7f38ac0736c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28be939acc9f6740 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38abe00640 1 -- 172.21.15.52:0/3743467081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c037070 con 0x7f38ac0732e0 2024-09-10T08:31:52.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38abe00640 1 -- 172.21.15.52:0/3743467081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c032440 con 0x7f38ac0732e0 2024-09-10T08:31:52.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38abe00640 1 -- 172.21.15.52:0/3743467081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c032810 con 0x7f38ac0732e0 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 -- 172.21.15.52:0/3743467081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0732e0 msgr2=0x7f38ac0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 --2- 172.21.15.52:0/3743467081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0732e0 0x7f38ac0736c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c02a210 comp rx=0 tx=0).stop 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 -- 172.21.15.52:0/3743467081 shutdown_connections 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 --2- 172.21.15.52:0/3743467081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0732e0 0x7f38ac0736c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 -- 172.21.15.52:0/3743467081 >> 172.21.15.52:0/3743467081 conn(0x7f38ac06d0f0 msgr2=0x7f38ac06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 -- 172.21.15.52:0/3743467081 shutdown_connections 2024-09-10T08:31:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.067+0000 7f38b3400640 1 -- 172.21.15.52:0/3743467081 wait complete. 2024-09-10T08:31:52.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.069+0000 7f38b3400640 1 Processor -- start 2024-09-10T08:31:52.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.069+0000 7f38b3400640 1 -- start start 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ac0732e0 0x7f38ac156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ac0cd2a0 0x7f38ac1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac06bf70 con 0x7f38ac0cce30 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac06bdf0 con 0x7f38ac0cd2a0 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38ac072380 con 0x7f38ac0732e0 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47020/0 (socket says 172.21.15.52:47020) 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38a3e00640 1 -- 172.21.15.52:0/2908326169 learned_addr learned my addr 172.21.15.52:0/2908326169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b1400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ac0cd2a0 0x7f38ac1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.070+0000 7f38b0a00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ac0732e0 0x7f38ac156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 -- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ac0732e0 msgr2=0x7f38ac156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ac0732e0 0x7f38ac156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 -- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ac0cd2a0 msgr2=0x7f38ac1593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ac0cd2a0 0x7f38ac1593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 -- 172.21.15.52:0/2908326169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac159bd0 con 0x7f38ac0cce30 2024-09-10T08:31:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f389400b3f0 tx=0x7f389400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a9600640 1 -- 172.21.15.52:0/2908326169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894015020 con 0x7f38ac0cce30 2024-09-10T08:31:52.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a9600640 1 -- 172.21.15.52:0/2908326169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894011830 con 0x7f38ac0cce30 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38a9600640 1 -- 172.21.15.52:0/2908326169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894011c20 con 0x7f38ac0cce30 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.071+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac159eb0 con 0x7f38ac0cce30 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.072+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac0ce620 con 0x7f38ac0cce30 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.073+0000 7f38a9600640 1 -- 172.21.15.52:0/2908326169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3894018020 con 0x7f38ac0cce30 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.074+0000 7f38a9600640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 0x7f388806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.074+0000 7f38a9600640 1 -- 172.21.15.52:0/2908326169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f389408aa80 con 0x7f38ac0cce30 2024-09-10T08:31:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.075+0000 7f38b6253740 1 Processor -- start 2024-09-10T08:31:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.075+0000 7f38b0a00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 0x7f388806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.075+0000 7f38b6253740 1 -- start start 2024-09-10T08:31:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b0a00640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 0x7f388806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f389c034000 tx=0x7f389c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606dba1ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 0x5606dba1f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606db93c660 con 0x5606db9d4480 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606db8e4680 con 0x5606db9ee420 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606db938620 con 0x5606db9ee800 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47026/0 (socket says 172.21.15.52:47026) 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 0x5606dba1f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b1400640 1 -- 172.21.15.52:0/461583753 learned_addr learned my addr 172.21.15.52:0/461583753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.076+0000 7f38b0a00640 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606dba1ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 -- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 msgr2=0x5606dba1ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606dba1ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 -- 172.21.15.52:0/461583753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 msgr2=0x5606dba1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 -- 172.21.15.52:0/461583753 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606db7197d0 con 0x5606db9ee800 2024-09-10T08:31:52.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38b1400640 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:52.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a3e00640 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 0x5606dba1f200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3894088ee0 tx=0x7f3894061870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f171542948d75a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a1200640 1 -- 172.21.15.52:0/461583753 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894011dc0 con 0x5606db9ee800 2024-09-10T08:31:52.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a1200640 1 -- 172.21.15.52:0/461583753 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894057040 con 0x5606db9ee800 2024-09-10T08:31:52.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.077+0000 7f38a1200640 1 -- 172.21.15.52:0/461583753 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894058190 con 0x5606db9ee800 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 -- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 msgr2=0x5606dba1f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 0x5606dba1f200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3894088ee0 tx=0x7f3894061870 comp rx=0 tx=0).stop 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 -- 172.21.15.52:0/461583753 shutdown_connections 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9d4480 0x5606dba1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee800 0x5606dba1f200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 --2- 172.21.15.52:0/461583753 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606dba1ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 -- 172.21.15.52:0/461583753 >> 172.21.15.52:0/461583753 conn(0x5606db9d5220 msgr2=0x5606dba1d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 -- 172.21.15.52:0/461583753 shutdown_connections 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.078+0000 7f38b6253740 1 -- 172.21.15.52:0/461583753 wait complete. 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.079+0000 7f38b6253740 1 -- start start 2024-09-10T08:31:52.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.079+0000 7f38b6253740 1 Processor -- start 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606db9d8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 0x5606dba03bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606db9d33e0 con 0x5606db9ee800 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606db8c54c0 con 0x5606db9ee420 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606db9d36c0 con 0x5606db9ed330 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b6253740 10 client.0 _ll_register_callbacks cb 0x5606db934e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47038/0 (socket says 172.21.15.52:47038) 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 -- 172.21.15.52:0/3495096266 learned_addr learned my addr 172.21.15.52:0/3495096266 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b1400640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 0x5606dba03bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b0a00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606db9d8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 -- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 msgr2=0x5606dba03bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 0x5606dba03bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 -- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 msgr2=0x5606db9d8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606db9d8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38a3e00640 1 -- 172.21.15.52:0/3495096266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606db64f3f0 con 0x5606db9ee800 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b1400640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 0x5606dba03bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.080+0000 7f38b0a00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606db9d8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f38a3e00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3894088ee0 tx=0x7f389401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865a59c81211a12b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894058190 con 0x5606db9ee800 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3894058330 con 0x5606db9ee800 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3894057040 con 0x5606db9ee800 2024-09-10T08:31:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3894054a90 con 0x5606db9ee800 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f38b6253740 10 client.5640 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606db60f0f0 con 0x5606db9ee800 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894057040 con 0x5606db9ee800 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.081+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f3894054c30 con 0x5606db9ee800 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 10 client.5640 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 20 client.5640 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba31dd0 0x5606dba321b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 4 client.5640 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606db949d90 con 0x5606dba31dd0 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b0a00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba31dd0 0x5606dba321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f3899600640 10 client.5640 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.082+0000 7f38b0a00640 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba31dd0 0x5606dba321b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c422236029fe43f server_cookie=cc16df4032ddaa55 in_seq=0 out_seq=0 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f3899600640 1 -- 172.21.15.52:0/3495096266 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606db949d90 con 0x5606dba31dd0 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f3899600640 10 client.5640 handle_command_reply: tid=0 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 client.5640 shutdown 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 msgr2=0x5606db9ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3894088ee0 tx=0x7f389401c040 comp rx=0 tx=0).stop 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 shutdown_connections 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba31dd0 0x5606dba321b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ed330 0x5606dba03bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606db9ecdf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f3899600640 0 client.5640 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 --2- 172.21.15.52:0/3495096266 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606db9ee420 0x5606db9d8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.083+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 >> 172.21.15.52:0/3495096266 conn(0x5606db9d4480 msgr2=0x5606db9d1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.084+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 shutdown_connections 2024-09-10T08:31:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.084+0000 7f38b6253740 1 -- 172.21.15.52:0/3495096266 wait complete. 2024-09-10T08:31:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.084+0000 7f38b6253740 20 client.5640 trim_cache size 0 max 16384 2024-09-10T08:31:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.102+0000 7f38b6253740 1 Processor -- start 2024-09-10T08:31:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.102+0000 7f38b6253740 1 -- start start 2024-09-10T08:31:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.102+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b6253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606db9d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b6253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac200d30 con 0x5606db9ee800 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac0cfd60 con 0x5606dba17170 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38ac0cb630 con 0x5606db9ee420 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47052/0 (socket says 172.21.15.52:47052) 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 -- 172.21.15.52:0/2442421636 learned_addr learned my addr 172.21.15.52:0/2442421636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b0a00640 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38b1400640 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606db9d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 -- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 msgr2=0x5606dba1e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 -- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 msgr2=0x5606db9d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606db9d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.103+0000 7f38a3e00640 1 -- 172.21.15.52:0/2442421636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dba1f380 con 0x5606db9ee800 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38a3e00640 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3894079040 tx=0x7f3894072070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613d677d87b6cec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f389be00640 1 -- 172.21.15.52:0/2442421636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894068070 con 0x5606db9ee800 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f389be00640 1 -- 172.21.15.52:0/2442421636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894074030 con 0x5606db9ee800 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f389be00640 1 -- 172.21.15.52:0/2442421636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894054c30 con 0x5606db9ee800 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 -- 172.21.15.52:0/2442421636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 msgr2=0x5606dba1e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3894079040 tx=0x7f3894072070 comp rx=0 tx=0).stop 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 -- 172.21.15.52:0/2442421636 shutdown_connections 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606db9d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba1e690 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 --2- 172.21.15.52:0/2442421636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 -- 172.21.15.52:0/2442421636 >> 172.21.15.52:0/2442421636 conn(0x5606db9d4480 msgr2=0x5606db9ed720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 -- 172.21.15.52:0/2442421636 shutdown_connections 2024-09-10T08:31:52.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.104+0000 7f38b6253740 1 -- 172.21.15.52:0/2442421636 wait complete. 2024-09-10T08:31:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.105+0000 7f38b6253740 1 -- start start 2024-09-10T08:31:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.105+0000 7f38b6253740 1 Processor -- start 2024-09-10T08:31:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606dba20d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac0cf710 con 0x5606db9ee800 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5606db949d90 con 0x5606dba17170 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5606dba1c6f0 con 0x5606db9ee420 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38b6253740 10 client.0 _ll_register_callbacks cb 0x7f38a4001980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.106+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47066/0 (socket says 172.21.15.52:47066) 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 -- 172.21.15.52:0/4116002272 learned_addr learned my addr 172.21.15.52:0/4116002272 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38b0a00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38b1400640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606dba20d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 -- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 msgr2=0x5606dba1c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 -- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 msgr2=0x5606dba20d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606dba20d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 -- 172.21.15.52:0/4116002272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dba176c0 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38a3e00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3894057290 tx=0x7f3894058bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4667fb938fcdca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f3899600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894068060 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3894061cd0 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.107+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3894074030 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3894057040 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 10 client.5646 fetch_fsmap learned FSMap version 26 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5606dba176c0 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894074030 con 0x5606db9ee800 2024-09-10T08:31:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f3894057c00 con 0x5606db9ee800 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 10 client.5646 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 10 client.5646 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 20 client.5646 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba1df30 0x5606dba1e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 4 client.5646 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5606db9440e0 con 0x5606dba1df30 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.108+0000 7f38b0a00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba1df30 0x5606dba1e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b0a00640 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba1df30 0x5606dba1e310 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a340d5dd5e309d87 server_cookie=b1eea1388b7d4789 in_seq=0 out_seq=0 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f3899600640 10 client.5646 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f3899600640 1 -- 172.21.15.52:0/4116002272 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x5606db9440e0 con 0x5606dba1df30 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f3899600640 10 client.5646 handle_command_reply: tid=0 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 client.5646 shutdown 2024-09-10T08:31:52.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 msgr2=0x5606dba9ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3894057290 tx=0x7f3894058bc0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 shutdown_connections 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5606dba1df30 0x5606dba1e310 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5606dba17170 0x5606dba20d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606db9ee800 0x5606dba9ba00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 --2- 172.21.15.52:0/4116002272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5606db9ee420 0x5606dba1c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f3899600640 0 client.5646 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 >> 172.21.15.52:0/4116002272 conn(0x5606db9d4480 msgr2=0x5606db9d8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 shutdown_connections 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.109+0000 7f38b6253740 1 -- 172.21.15.52:0/4116002272 wait complete. 2024-09-10T08:31:52.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b6253740 20 client.5646 trim_cache size 0 max 16384 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "1fe16de5-c85d-4674-ae1f-6b171b9820c8": { 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "1fe16de5-c85d-4674-ae1f-6b171b9820c8", 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "84dc06c4-babf-4a45-8e55-c7f01574b414": { 2024-09-10T08:31:52.116 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "84dc06c4-babf-4a45-8e55-c7f01574b414", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "8c7d96a8-76ad-4edf-a335-5c4968936c15": { 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "8c7d96a8-76ad-4edf-a335-5c4968936c15", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "b37eff18-1264-4a4c-8fcc-cd84d50ba043": { 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "b37eff18-1264-4a4c-8fcc-cd84d50ba043", 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:52.117 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:52.118 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:52.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 msgr2=0x7f388806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 0x7f388806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f389c034000 tx=0x7f389c02e000 comp rx=0 tx=0).stop 2024-09-10T08:31:52.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 msgr2=0x7f38ac1521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f389400b3f0 tx=0x7f389400b8b0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 shutdown_connections 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f388806be30 0x7f388806e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38ac0cd2a0 0x7f38ac1593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ac0cce30 0x7f38ac1521c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 --2- 172.21.15.52:0/2908326169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f38ac0732e0 0x7f38ac156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 >> 172.21.15.52:0/2908326169 conn(0x7f38ac06d0f0 msgr2=0x7f38ac06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 shutdown_connections 2024-09-10T08:31:52.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:52.110+0000 7f38b3400640 1 -- 172.21.15.52:0/2908326169 wait complete. 2024-09-10T08:31:53.564 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:31:53.564+0000 7f82ad800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-10T08:31:57.126 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:31:57.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T08:31:57.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.316+0000 7fef5a600640 1 Processor -- start 2024-09-10T08:31:57.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.316+0000 7fef5a600640 1 -- start start 2024-09-10T08:31:57.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fef540b5fd0 0x7fef540d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef540b63b0 0x7fef540cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef54067950 0x7fef54067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fef540d3950 con 0x7fef54067950 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fef540d3c30 con 0x7fef540b5fd0 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef5a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef540d3f10 con 0x7fef540b63b0 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef59c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef54067950 0x7fef54067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef59c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fef54067950 0x7fef54067e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40130/0 (socket says 172.21.15.52:40130) 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.317+0000 7fef59c00640 1 -- 172.21.15.52:0/1336946363 learned_addr learned my addr 172.21.15.52:0/1336946363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef53e00640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef540b63b0 0x7fef540cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59200640 1 --2- 172.21.15.52:0/1336946363 >> v2:172.21.15.176:3300/0 conn(0x7fef540b5fd0 0x7fef540d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59c00640 1 -- 172.21.15.52:0/1336946363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef540b63b0 msgr2=0x7fef540cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59c00640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef540b63b0 0x7fef540cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59c00640 1 -- 172.21.15.52:0/1336946363 >> v2:172.21.15.176:3300/0 conn(0x7fef540b5fd0 msgr2=0x7fef540d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59c00640 1 --2- 172.21.15.52:0/1336946363 >> v2:172.21.15.176:3300/0 conn(0x7fef540b5fd0 0x7fef540d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.318+0000 7fef59c00640 1 -- 172.21.15.52:0/1336946363 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef540d41f0 con 0x7fef54067950 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef59c00640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef54067950 0x7fef54067e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fef540d5620 tx=0x7fef4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4a46e41bbfc82c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef53400640 1 -- 172.21.15.52:0/1336946363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c036070 con 0x7fef54067950 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef53400640 1 -- 172.21.15.52:0/1336946363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c031600 con 0x7fef54067950 2024-09-10T08:31:57.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef53400640 1 -- 172.21.15.52:0/1336946363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0319d0 con 0x7fef54067950 2024-09-10T08:31:57.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef5a600640 1 -- 172.21.15.52:0/1336946363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef54067950 msgr2=0x7fef54067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.319+0000 7fef5a600640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef54067950 0x7fef54067e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fef540d5620 tx=0x7fef4c02a730 comp rx=0 tx=0).stop 2024-09-10T08:31:57.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 -- 172.21.15.52:0/1336946363 shutdown_connections 2024-09-10T08:31:57.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef54067950 0x7fef54067e00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 --2- 172.21.15.52:0/1336946363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef540b63b0 0x7fef540cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 --2- 172.21.15.52:0/1336946363 >> v2:172.21.15.176:3300/0 conn(0x7fef540b5fd0 0x7fef540d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 -- 172.21.15.52:0/1336946363 >> 172.21.15.52:0/1336946363 conn(0x7fef540d0fd0 msgr2=0x7fef540d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 -- 172.21.15.52:0/1336946363 shutdown_connections 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.320+0000 7fef5a600640 1 -- 172.21.15.52:0/1336946363 wait complete. 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.321+0000 7fef5a600640 1 Processor -- start 2024-09-10T08:31:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.321+0000 7fef5a600640 1 -- start start 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef54067950 0x7fef541540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef540b63b0 0x7fef540cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef540cfd10 con 0x7fef540b5fd0 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef540cfb90 con 0x7fef540b63b0 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef5a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef540b67d0 con 0x7fef54067950 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.322+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40146/0 (socket says 172.21.15.52:40146) 2024-09-10T08:31:57.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 -- 172.21.15.52:0/3423231187 learned_addr learned my addr 172.21.15.52:0/3423231187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef59200640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef54067950 0x7fef541540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef59c00640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef540b63b0 0x7fef540cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 -- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef54067950 msgr2=0x7fef541540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef54067950 0x7fef541540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 -- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef540b63b0 msgr2=0x7fef540cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef540b63b0 0x7fef540cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 -- 172.21.15.52:0/3423231187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef540c8e00 con 0x7fef540b5fd0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef53e00640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d7d0 tx=0x7fef4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.323+0000 7fef50c00640 1 -- 172.21.15.52:0/3423231187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40004020 con 0x7fef540b5fd0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.324+0000 7fef50c00640 1 -- 172.21.15.52:0/3423231187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef400041e0 con 0x7fef540b5fd0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.324+0000 7fef50c00640 1 -- 172.21.15.52:0/3423231187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400043d0 con 0x7fef540b5fd0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.324+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef540c90e0 con 0x7fef540b5fd0 2024-09-10T08:31:57.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.324+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef540c96a0 con 0x7fef540b5fd0 2024-09-10T08:31:57.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.326+0000 7fef50c00640 1 -- 172.21.15.52:0/3423231187 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef4001b020 con 0x7fef540b5fd0 2024-09-10T08:31:57.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.326+0000 7fef50c00640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 0x7fef3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.327+0000 7fef50c00640 1 -- 172.21.15.52:0/3423231187 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fef4008abe0 con 0x7fef540b5fd0 2024-09-10T08:31:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.327+0000 7fef59200640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 0x7fef3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.327+0000 7fef5e9cf740 1 Processor -- start 2024-09-10T08:31:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.327+0000 7fef5e9cf740 1 -- start start 2024-09-10T08:31:57.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef59200640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 0x7fef3406e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef48006fd0 tx=0x7fef48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63dfd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ec63d1a660 con 0x55ec63db29e0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ec63cc2680 con 0x55ec63dfcea0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ec63d16620 con 0x55ec63dcc4f0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef59c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63dfd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40148/0 (socket says 172.21.15.52:40148) 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef53e00640 1 -- 172.21.15.52:0/2719304773 learned_addr learned my addr 172.21.15.52:0/2719304773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.328+0000 7fef59200640 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 -- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 msgr2=0x55ec63dcc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 -- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 msgr2=0x55ec63dfd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63dfd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 -- 172.21.15.52:0/2719304773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec63af77d0 con 0x55ec63db29e0 2024-09-10T08:31:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef59c00640 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63dfd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef53e00640 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fef40088fe0 tx=0x7fef40058b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7decbcdb0b14b35d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef45600640 1 -- 172.21.15.52:0/2719304773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40087070 con 0x55ec63db29e0 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef45600640 1 -- 172.21.15.52:0/2719304773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef400571a0 con 0x55ec63db29e0 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.329+0000 7fef45600640 1 -- 172.21.15.52:0/2719304773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400582f0 con 0x55ec63db29e0 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2719304773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 msgr2=0x55ec63db1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fef40088fe0 tx=0x7fef40058b10 comp rx=0 tx=0).stop 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2719304773 shutdown_connections 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63dfd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63db29e0 0x55ec63db1240 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2719304773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2719304773 >> 172.21.15.52:0/2719304773 conn(0x55ec63db3410 msgr2=0x55ec63dfba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2719304773 shutdown_connections 2024-09-10T08:31:57.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.330+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2719304773 wait complete. 2024-09-10T08:31:57.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.331+0000 7fef5e9cf740 1 -- start start 2024-09-10T08:31:57.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.331+0000 7fef5e9cf740 1 Processor -- start 2024-09-10T08:31:57.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63df1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63df2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ec63db1940 con 0x55ec63df8140 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ec63ca34c0 con 0x55ec63dfcea0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ec63db1c20 con 0x55ec63dcc4f0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef5e9cf740 10 client.0 _ll_register_callbacks cb 0x55ec63d12e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef59c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef59c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40162/0 (socket says 172.21.15.52:40162) 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef59c00640 1 -- 172.21.15.52:0/3517462353 learned_addr learned my addr 172.21.15.52:0/3517462353 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef59200640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63df1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.332+0000 7fef53e00640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63df2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 -- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 msgr2=0x55ec63df1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63df1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 -- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 msgr2=0x55ec63df2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63df2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 -- 172.21.15.52:0/3517462353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec63a2d3f0 con 0x55ec63df8140 2024-09-10T08:31:57.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef59c00640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fef4c02ad20 tx=0x7fef4c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1db06e93ddce3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef3a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c044070 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fef4c03e670 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef400571a0 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef4c04f050 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef5e9cf740 10 client.5658 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.333+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ec639ed0f0 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef400571a0 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fef4c052020 con 0x55ec63df8140 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 10 client.5658 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 10 client.5658 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 20 client.5658 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63e0c230 0x55ec63e0c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 4 client.5658 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec63d27d90 con 0x55ec63e0c230 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.334+0000 7fef59200640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63e0c230 0x55ec63e0c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.335+0000 7fef59200640 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63e0c230 0x55ec63e0c640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd03e78c42d1ae8 server_cookie=fdd0824b90f66475 in_seq=0 out_seq=0 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.335+0000 7fef3a000640 10 client.5658 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.335+0000 7fef3a000640 1 -- 172.21.15.52:0/3517462353 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec63d27d90 con 0x55ec63e0c230 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.335+0000 7fef3a000640 10 client.5658 handle_command_reply: tid=0 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.335+0000 7fef5e9cf740 1 client.5658 shutdown 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 msgr2=0x55ec63df85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fef4c02ad20 tx=0x7fef4c004ab0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 shutdown_connections 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63e0c230 0x55ec63e0c640 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63df85c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63df2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/3517462353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63df1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef3a000640 0 client.5658 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 >> 172.21.15.52:0/3517462353 conn(0x55ec63db29e0 msgr2=0x55ec63db0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 shutdown_connections 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 1 -- 172.21.15.52:0/3517462353 wait complete. 2024-09-10T08:31:57.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.336+0000 7fef5e9cf740 20 client.5658 trim_cache size 0 max 16384 2024-09-10T08:31:57.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.354+0000 7fef5e9cf740 1 Processor -- start 2024-09-10T08:31:57.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.354+0000 7fef5e9cf740 1 -- start start 2024-09-10T08:31:57.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63db0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef54200b40 con 0x55ec63df8140 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef541ffdc0 con 0x55ec63dfcea0 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef54158f20 con 0x55ec63dcc4f0 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40178/0 (socket says 172.21.15.52:40178) 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 -- 172.21.15.52:0/2225338650 learned_addr learned my addr 172.21.15.52:0/2225338650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 -- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 msgr2=0x55ec63dcc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 -- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 msgr2=0x55ec63db0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63db0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.355+0000 7fef53e00640 1 -- 172.21.15.52:0/2225338650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec63df5ec0 con 0x55ec63df8140 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef53e00640 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef4000dfd0 tx=0x7fef4008a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be67ce8828d802a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef44c00640 1 -- 172.21.15.52:0/2225338650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40087070 con 0x55ec63df8140 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef44c00640 1 -- 172.21.15.52:0/2225338650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40088040 con 0x55ec63df8140 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef44c00640 1 -- 172.21.15.52:0/2225338650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40055510 con 0x55ec63df8140 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2225338650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 msgr2=0x55ec63e1fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.356+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef4000dfd0 tx=0x7fef4008a000 comp rx=0 tx=0).stop 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2225338650 shutdown_connections 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dfcea0 0x55ec63db0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63df8140 0x55ec63e1fea0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2225338650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63dcc4f0 0x55ec63dcc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2225338650 >> 172.21.15.52:0/2225338650 conn(0x55ec63db29e0 msgr2=0x55ec63df4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2225338650 shutdown_connections 2024-09-10T08:31:57.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2225338650 wait complete. 2024-09-10T08:31:57.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.357+0000 7fef5e9cf740 1 -- start start 2024-09-10T08:31:57.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.358+0000 7fef5e9cf740 1 Processor -- start 2024-09-10T08:31:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.358+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 0x55ec63dcb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.358+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63df8140 0x55ec63e717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef5e9cf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ec63df8520 con 0x55ec63dfcea0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef5415f5b0 con 0x55ec63dcc4f0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef5e9cf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ec63df1690 con 0x55ec63df8140 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef5e9cf740 10 client.0 _ll_register_callbacks cb 0x7fef4c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40192/0 (socket says 172.21.15.52:40192) 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59200640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 0x55ec63dcb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 -- 172.21.15.52:0/2161628126 learned_addr learned my addr 172.21.15.52:0/2161628126 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef53e00640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63df8140 0x55ec63e717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 -- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63df8140 msgr2=0x55ec63e717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63df8140 0x55ec63e717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 -- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 msgr2=0x55ec63dcb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 0x55ec63dcb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59c00640 1 -- 172.21.15.52:0/2161628126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec63db71f0 con 0x55ec63dfcea0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.359+0000 7fef59200640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 0x55ec63dcb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef59c00640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef4c03d6b0 tx=0x7fef4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5e6e061b9a33a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c044070 con 0x55ec63dfcea0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fef4c03dca0 con 0x55ec63dfcea0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef40088040 con 0x55ec63dfcea0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef4c036040 con 0x55ec63dfcea0 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 10 client.5664 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:57.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ec63e0aaa0 con 0x55ec63dfcea0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40088040 con 0x55ec63dfcea0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fef4c052070 con 0x55ec63dfcea0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 10 client.5664 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 10 client.5664 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 20 client.5664 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63dfe0a0 0x55ec63db0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 4 client.5664 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.360+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec63d220e0 con 0x55ec63dfe0a0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef59200640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63dfe0a0 0x55ec63db0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef59200640 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63dfe0a0 0x55ec63db0140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b13689b42422dc server_cookie=755851a99d53181b in_seq=0 out_seq=0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef3a000640 10 client.5664 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef3a000640 1 -- 172.21.15.52:0/2161628126 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ec63d220e0 con 0x55ec63dfe0a0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef3a000640 10 client.5664 handle_command_reply: tid=0 2024-09-10T08:31:57.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.361+0000 7fef5e9cf740 1 client.5664 shutdown 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 msgr2=0x55ec63e0a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef4c03d6b0 tx=0x7fef4c004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 shutdown_connections 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ec63dfe0a0 0x55ec63db0140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ec63dfcea0 0x55ec63e0a0c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ec63df8140 0x55ec63e717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 --2- 172.21.15.52:0/2161628126 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ec63dcc4f0 0x55ec63dcb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef3a000640 0 client.5664 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 >> 172.21.15.52:0/2161628126 conn(0x55ec63db29e0 msgr2=0x55ec63e1fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 shutdown_connections 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 1 -- 172.21.15.52:0/2161628126 wait complete. 2024-09-10T08:31:57.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5e9cf740 20 client.5664 trim_cache size 0 max 16384 2024-09-10T08:31:57.367 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:57.367 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:31:57.367 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:31:57.367 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 msgr2=0x7fef3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 0x7fef3406e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fef48006fd0 tx=0x7fef48008040 comp rx=0 tx=0).stop 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 msgr2=0x7fef54159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.362+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d7d0 tx=0x7fef4000dc90 comp rx=0 tx=0).stop 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 shutdown_connections 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef3406be30 0x7fef3406e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef540b63b0 0x7fef540cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef540b5fd0 0x7fef54159e90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 --2- 172.21.15.52:0/3423231187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef54067950 0x7fef541540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 >> 172.21.15.52:0/3423231187 conn(0x7fef540d0fd0 msgr2=0x7fef540d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 shutdown_connections 2024-09-10T08:31:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.363+0000 7fef5a600640 1 -- 172.21.15.52:0/3423231187 wait complete. 2024-09-10T08:31:57.377 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:31:57.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T08:31:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.536+0000 7f46f2000640 1 Processor -- start 2024-09-10T08:31:57.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.536+0000 7f46f2000640 1 -- start start 2024-09-10T08:31:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.537+0000 7f46f2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0732e0 0x7f46ec0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.537+0000 7f46f2000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec0cce30 0x7f46ec0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.537+0000 7f46f2000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec0714b0 con 0x7f46ec071c70 2024-09-10T08:31:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.537+0000 7f46f2000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec073c00 con 0x7f46ec0cce30 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.537+0000 7f46f2000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec0cd880 con 0x7f46ec0732e0 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec0cce30 0x7f46ec0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f46ec0cce30 0x7f46ec0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40202/0 (socket says 172.21.15.52:40202) 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 -- 172.21.15.52:0/2973356877 learned_addr learned my addr 172.21.15.52:0/2973356877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46eb400640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0732e0 0x7f46ec0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 -- 172.21.15.52:0/2973356877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0732e0 msgr2=0x7f46ec0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0732e0 0x7f46ec0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 -- 172.21.15.52:0/2973356877 >> v1:172.21.15.176:6789/0 conn(0x7f46ec071c70 legacy=0x7f46ec15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.538+0000 7f46e3e00640 1 -- 172.21.15.52:0/2973356877 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec0cdb60 con 0x7f46ec0cce30 2024-09-10T08:31:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.539+0000 7f46e3e00640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0cce30 0x7f46ec0cd270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdfd8a264933986 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.539+0000 7f46eaa00640 1 -- 172.21.15.52:0/2973356877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4037070 con 0x7f46ec0cce30 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.539+0000 7f46eaa00640 1 -- 172.21.15.52:0/2973356877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4032440 con 0x7f46ec0cce30 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.539+0000 7f46eaa00640 1 -- 172.21.15.52:0/2973356877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4032810 con 0x7f46ec0cce30 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 -- 172.21.15.52:0/2973356877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0cce30 msgr2=0x7f46ec0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0cce30 0x7f46ec0cd270 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 -- 172.21.15.52:0/2973356877 shutdown_connections 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0cce30 0x7f46ec0cd270 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 --2- 172.21.15.52:0/2973356877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0732e0 0x7f46ec0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 -- 172.21.15.52:0/2973356877 >> 172.21.15.52:0/2973356877 conn(0x7f46ec06d0f0 msgr2=0x7f46ec06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 -- 172.21.15.52:0/2973356877 shutdown_connections 2024-09-10T08:31:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.540+0000 7f46f2000640 1 -- 172.21.15.52:0/2973356877 wait complete. 2024-09-10T08:31:57.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.542+0000 7f46f2000640 1 Processor -- start 2024-09-10T08:31:57.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.542+0000 7f46f2000640 1 -- start start 2024-09-10T08:31:57.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 0x7f46ec151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 0x7f46ec15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06bf70 con 0x7f46ec0732e0 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec06bdf0 con 0x7f46ec071c70 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46f2000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec072120 con 0x7f46ec0cce30 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40214/0 (socket says 172.21.15.52:40214) 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46e3e00640 1 -- 172.21.15.52:0/3200501314 learned_addr learned my addr 172.21.15.52:0/3200501314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46ebe00640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 0x7f46ec15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46eb400640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 0x7f46ec151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46e3e00640 1 -- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 msgr2=0x7f46ec15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.543+0000 7f46e3e00640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 0x7f46ec15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3e00640 1 -- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 msgr2=0x7f46ec151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3e00640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 0x7f46ec151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3e00640 1 -- 172.21.15.52:0/3200501314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec156370 con 0x7f46ec0732e0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46eb400640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 0x7f46ec151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46ebe00640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 0x7f46ec15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3e00640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f46d4000c00 tx=0x7f46d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3400640 1 -- 172.21.15.52:0/3200501314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4037040 con 0x7f46ec0732e0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3400640 1 -- 172.21.15.52:0/3200501314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4042070 con 0x7f46ec0732e0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec153fd0 con 0x7f46ec0732e0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46e3400640 1 -- 172.21.15.52:0/3200501314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4030880 con 0x7f46ec0732e0 2024-09-10T08:31:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.544+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec154590 con 0x7f46ec0732e0 2024-09-10T08:31:57.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.547+0000 7f46e3400640 1 -- 172.21.15.52:0/3200501314 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46d402ad10 con 0x7f46ec0732e0 2024-09-10T08:31:57.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.548+0000 7f46e3400640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.548+0000 7f46e3400640 1 -- 172.21.15.52:0/3200501314 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f46d40ab3d0 con 0x7f46ec0732e0 2024-09-10T08:31:57.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.548+0000 7f46f4e14740 1 Processor -- start 2024-09-10T08:31:57.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.548+0000 7f46eb400640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.548+0000 7f46f4e14740 1 -- start start 2024-09-10T08:31:57.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d250c0 0x555b46d254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 0x555b46d24410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 0x555b46d05040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555b46c41490 con 0x555b46d22ce0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555b46be9690 con 0x555b46d22880 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555b46c3d450 con 0x555b46d250c0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.549+0000 7f46eb400640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 0x7f46c806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009b90 tx=0x7f46dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 0x555b46d05040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 0x555b46d05040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40218/0 (socket says 172.21.15.52:40218) 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46ebe00640 1 -- 172.21.15.52:0/1932630904 learned_addr learned my addr 172.21.15.52:0/1932630904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 0x555b46d24410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46eb400640 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d250c0 0x555b46d254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 -- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d250c0 msgr2=0x555b46d254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d250c0 0x555b46d254a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 -- 172.21.15.52:0/1932630904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 msgr2=0x555b46d05040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 0x555b46d05040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 -- 172.21.15.52:0/1932630904 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b46bf0e00 con 0x555b46d22880 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46e3e00640 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 0x555b46d24410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f46d4079600 tx=0x7f46d4079270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e964fc64245be272 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46db400640 1 -- 172.21.15.52:0/1932630904 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d407da20 con 0x555b46d22880 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.550+0000 7f46db400640 1 -- 172.21.15.52:0/1932630904 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4082250 con 0x555b46d22880 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46db400640 1 -- 172.21.15.52:0/1932630904 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d40ab0b0 con 0x555b46d22880 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 -- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 msgr2=0x555b46d24410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 0x555b46d24410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f46d4079600 tx=0x7f46d4079270 comp rx=0 tx=0).stop 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 -- 172.21.15.52:0/1932630904 shutdown_connections 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d22ce0 0x555b46d05040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22880 0x555b46d24410 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 --2- 172.21.15.52:0/1932630904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d250c0 0x555b46d254a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 -- 172.21.15.52:0/1932630904 >> 172.21.15.52:0/1932630904 conn(0x555b46cdad20 msgr2=0x555b46d23130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 -- 172.21.15.52:0/1932630904 shutdown_connections 2024-09-10T08:31:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.551+0000 7f46f4e14740 1 -- 172.21.15.52:0/1932630904 wait complete. 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.552+0000 7f46f4e14740 1 -- start start 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.552+0000 7f46f4e14740 1 Processor -- start 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 0x555b46d1ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d1c330 0x555b46d1c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555b46be9690 con 0x555b46d250c0 2024-09-10T08:31:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555b46bfc950 con 0x555b46d22ce0 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555b46d217e0 con 0x555b46d1c330 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46f4e14740 10 client.0 _ll_register_callbacks cb 0x555b46bc84d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40220/0 (socket says 172.21.15.52:40220) 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46e3e00640 1 -- 172.21.15.52:0/740763986 learned_addr learned my addr 172.21.15.52:0/740763986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.553+0000 7f46ebe00640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d1c330 0x555b46d1c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46eb400640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 0x555b46d1ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 -- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d1c330 msgr2=0x555b46d1c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d1c330 0x555b46d1c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 -- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 msgr2=0x555b46d1ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 0x555b46d1ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 -- 172.21.15.52:0/740763986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b46bf5f40 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46eb400640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 0x555b46d1ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46e3e00640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46d4079370 tx=0x7f46d4032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6aa04a50d93755 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d407da20 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f46d4081dc0 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46d4082250 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46d4096050 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46f4e14740 10 client.5676 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.554+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555b469543f0 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4082250 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f46d403a070 con 0x555b46d250c0 2024-09-10T08:31:57.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 10 client.5676 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 10 client.5676 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 20 client.5676 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d078d0 0x555b46d07d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 4 client.5676 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b46c4ebc0 con 0x555b46d078d0 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.555+0000 7f46eb400640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d078d0 0x555b46d07d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.556+0000 7f46eb400640 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d078d0 0x555b46d07d00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e6c41e231154de server_cookie=495b6ac57c113f6f in_seq=0 out_seq=0 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.556+0000 7f46cfe00640 10 client.5676 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.556+0000 7f46cfe00640 1 -- 172.21.15.52:0/740763986 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b46c4ebc0 con 0x555b46d078d0 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.556+0000 7f46cfe00640 10 client.5676 handle_command_reply: tid=0 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.556+0000 7f46f4e14740 1 client.5676 shutdown 2024-09-10T08:31:57.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 msgr2=0x555b46d03cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46d4079370 tx=0x7f46d4032f90 comp rx=0 tx=0).stop 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 shutdown_connections 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d078d0 0x555b46d07d00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d1c330 0x555b46d1c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d03cb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 --2- 172.21.15.52:0/740763986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d22ce0 0x555b46d1ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46cfe00640 0 client.5676 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 >> 172.21.15.52:0/740763986 conn(0x555b46d22880 msgr2=0x555b46d04e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 shutdown_connections 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 1 -- 172.21.15.52:0/740763986 wait complete. 2024-09-10T08:31:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.557+0000 7f46f4e14740 20 client.5676 trim_cache size 0 max 16384 2024-09-10T08:31:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 Processor -- start 2024-09-10T08:31:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 -- start start 2024-09-10T08:31:57.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d26790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d250c0 0x555b46d05fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec200bd0 con 0x555b46d1c330 2024-09-10T08:31:57.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1e79a0 con 0x555b46d250c0 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.571+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec1e59c0 con 0x555b46d22ce0 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40236/0 (socket says 172.21.15.52:40236) 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 -- 172.21.15.52:0/48897841 learned_addr learned my addr 172.21.15.52:0/48897841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46ebe00640 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d250c0 0x555b46d05fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46e3e00640 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d26790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 -- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 msgr2=0x555b46d26790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d26790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 -- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d250c0 msgr2=0x555b46d05fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d250c0 0x555b46d05fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 -- 172.21.15.52:0/48897841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b46a1e7d0 con 0x555b46d1c330 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.572+0000 7f46eb400640 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0116f0 tx=0x7f46dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67a7b574c87e41a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46daa00640 1 -- 172.21.15.52:0/48897841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc030070 con 0x555b46d1c330 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46daa00640 1 -- 172.21.15.52:0/48897841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc01a040 con 0x555b46d1c330 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46daa00640 1 -- 172.21.15.52:0/48897841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0234c0 con 0x555b46d1c330 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 -- 172.21.15.52:0/48897841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 msgr2=0x555b46d080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0116f0 tx=0x7f46dc014000 comp rx=0 tx=0).stop 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 -- 172.21.15.52:0/48897841 shutdown_connections 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d250c0 0x555b46d05fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d26790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 --2- 172.21.15.52:0/48897841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d1c330 0x555b46d080a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 -- 172.21.15.52:0/48897841 >> 172.21.15.52:0/48897841 conn(0x555b46d22880 msgr2=0x555b46d47200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 -- 172.21.15.52:0/48897841 shutdown_connections 2024-09-10T08:31:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.573+0000 7f46f4e14740 1 -- 172.21.15.52:0/48897841 wait complete. 2024-09-10T08:31:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.574+0000 7f46f4e14740 1 -- start start 2024-09-10T08:31:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.574+0000 7f46f4e14740 1 Processor -- start 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d1c330 0x555b46d23320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec1e7350 con 0x555b46d250c0 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555b46c43930 con 0x555b46d1c330 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555b46d44580 con 0x555b46d22ce0 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46f4e14740 10 client.0 _ll_register_callbacks cb 0x7f46e40017b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40250/0 (socket says 172.21.15.52:40250) 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.575+0000 7f46ebe00640 1 -- 172.21.15.52:0/221187827 learned_addr learned my addr 172.21.15.52:0/221187827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46e3e00640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46eb400640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d1c330 0x555b46d23320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 -- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 msgr2=0x555b46d41e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d41e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 -- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d1c330 msgr2=0x555b46d23320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d1c330 0x555b46d23320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 -- 172.21.15.52:0/221187827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b46d47200 con 0x555b46d250c0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46ebe00640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46e4002070 tx=0x7f46e4005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4039e231af7bff49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4006e20 con 0x555b46d250c0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f46e401c890 con 0x555b46d250c0 2024-09-10T08:31:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.576+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46dc01a040 con 0x555b46d250c0 2024-09-10T08:31:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.577+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46e4027050 con 0x555b46d250c0 2024-09-10T08:31:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.577+0000 7f46f4e14740 10 client.5682 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.577+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555b46d25c00 con 0x555b46d250c0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46dc01a040 con 0x555b46d250c0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f46e402a020 con 0x555b46d250c0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 10 client.5682 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 10 client.5682 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 20 client.5682 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d428a0 0x555b46d97e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 4 client.5682 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b46c48f10 con 0x555b46d428a0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.579+0000 7f46eb400640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d428a0 0x555b46d97e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46eb400640 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d428a0 0x555b46d97e60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b48b748e0cf7216e server_cookie=3645e0f1f24f96ec in_seq=0 out_seq=0 2024-09-10T08:31:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46cfe00640 10 client.5682 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46cfe00640 1 -- 172.21.15.52:0/221187827 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x555b46c48f10 con 0x555b46d428a0 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46cfe00640 10 client.5682 handle_command_reply: tid=0 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 client.5682 shutdown 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 msgr2=0x555b46d42360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f46e4002070 tx=0x7f46e4005420 comp rx=0 tx=0).stop 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 shutdown_connections 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x555b46d428a0 0x555b46d97e60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b46d250c0 0x555b46d42360 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555b46d22ce0 0x555b46d41e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46cfe00640 0 client.5682 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 --2- 172.21.15.52:0/221187827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555b46d1c330 0x555b46d23320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 >> 172.21.15.52:0/221187827 conn(0x555b46d22880 msgr2=0x555b46d080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 shutdown_connections 2024-09-10T08:31:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.580+0000 7f46f4e14740 1 -- 172.21.15.52:0/221187827 wait complete. 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f4e14740 20 client.5682 trim_cache size 0 max 16384 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: "damage_type": "backtrace", 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 3724774956, 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 1099511630412, 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:31:57.584 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:31:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 msgr2=0x7f46c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 0x7f46c806e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009b90 tx=0x7f46dc008040 comp rx=0 tx=0).stop 2024-09-10T08:31:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 msgr2=0x7f46ec155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f46d4000c00 tx=0x7f46d40046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 shutdown_connections 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46ec0cce30 0x7f46ec15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ec0732e0 0x7f46ec155e30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 --2- 172.21.15.52:0/3200501314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46ec071c70 0x7f46ec151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.581+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 >> 172.21.15.52:0/3200501314 conn(0x7f46ec06d0f0 msgr2=0x7f46ec15df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.582+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 shutdown_connections 2024-09-10T08:31:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.582+0000 7f46f2000640 1 -- 172.21.15.52:0/3200501314 wait complete. 2024-09-10T08:31:57.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:31:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.753+0000 7fddb4600640 1 Processor -- start 2024-09-10T08:31:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.753+0000 7fddb4600640 1 -- start start 2024-09-10T08:31:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb4600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 0x7fddac15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb4600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddac13eb20 0x7fddac15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb4600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac071180 con 0x7fddac0b2d40 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb4600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fddac071ab0 con 0x7fddac13eb20 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb4600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fddac071460 con 0x7fddac06c320 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddac13eb20 0x7fddac15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fddac13eb20 0x7fddac15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40266/0 (socket says 172.21.15.52:40266) 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 -- 172.21.15.52:0/3854249475 learned_addr learned my addr 172.21.15.52:0/3854249475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb1200640 1 --2- 172.21.15.52:0/3854249475 >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 0x7fddac15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 -- 172.21.15.52:0/3854249475 >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 msgr2=0x7fddac15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 --2- 172.21.15.52:0/3854249475 >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 0x7fddac15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 -- 172.21.15.52:0/3854249475 >> v1:172.21.15.176:6789/0 conn(0x7fddac0b2d40 legacy=0x7fddac06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb2600640 1 -- 172.21.15.52:0/3854249475 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac071740 con 0x7fddac13eb20 2024-09-10T08:31:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.755+0000 7fddb1200640 1 --2- 172.21.15.52:0/3854249475 >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 0x7fddac15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.756+0000 7fddb2600640 1 --2- 172.21.15.52:0/3854249475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15c230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddac0d1500 tx=0x7fdda402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4874a81e23c14397 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddabe00640 1 -- 172.21.15.52:0/3854249475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4036070 con 0x7fddac13eb20 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddabe00640 1 -- 172.21.15.52:0/3854249475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda4031600 con 0x7fddac13eb20 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddabe00640 1 -- 172.21.15.52:0/3854249475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40319d0 con 0x7fddac13eb20 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 -- 172.21.15.52:0/3854249475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 msgr2=0x7fddac15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 --2- 172.21.15.52:0/3854249475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15c230 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddac0d1500 tx=0x7fdda402a730 comp rx=0 tx=0).stop 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 -- 172.21.15.52:0/3854249475 shutdown_connections 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 --2- 172.21.15.52:0/3854249475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15c230 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 --2- 172.21.15.52:0/3854249475 >> v2:172.21.15.176:3300/0 conn(0x7fddac06c320 0x7fddac15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 -- 172.21.15.52:0/3854249475 >> 172.21.15.52:0/3854249475 conn(0x7fddac0ccec0 msgr2=0x7fddac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 -- 172.21.15.52:0/3854249475 shutdown_connections 2024-09-10T08:31:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.757+0000 7fddb4600640 1 -- 172.21.15.52:0/3854249475 wait complete. 2024-09-10T08:31:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.759+0000 7fddb4600640 1 Processor -- start 2024-09-10T08:31:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.759+0000 7fddb4600640 1 -- start start 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac06c320 0x7fddac15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0b2d40 0x7fddac15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fddac0720c0 con 0x7fddac13eb20 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fddac071f40 con 0x7fddac06c320 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb4600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fddac072240 con 0x7fddac0b2d40 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40270/0 (socket says 172.21.15.52:40270) 2024-09-10T08:31:57.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb2600640 1 -- 172.21.15.52:0/2240540199 learned_addr learned my addr 172.21.15.52:0/2240540199 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb1c00640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac06c320 0x7fddac15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.760+0000 7fddb1200640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0b2d40 0x7fddac15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 -- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0b2d40 msgr2=0x7fddac15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0b2d40 0x7fddac15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 -- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac06c320 msgr2=0x7fddac15a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac06c320 0x7fddac15a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 -- 172.21.15.52:0/2240540199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac167950 con 0x7fddac13eb20 2024-09-10T08:31:57.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb2600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009f40 tx=0x7fdda4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4036050 con 0x7fddac13eb20 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda4042070 con 0x7fddac13eb20 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac154a60 con 0x7fddac13eb20 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.761+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4009510 con 0x7fddac13eb20 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.762+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac167390 con 0x7fddac13eb20 2024-09-10T08:31:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.762+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddac06bc10 con 0x7fddac13eb20 2024-09-10T08:31:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.763+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdda4007bf0 con 0x7fddac13eb20 2024-09-10T08:31:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.764+0000 7fdda9600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.764+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdda40abb60 con 0x7fddac13eb20 2024-09-10T08:31:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.765+0000 7fddb1c00640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.765+0000 7fddb1c00640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001780 tx=0x7fdda0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.769+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdda4079eb0 con 0x7fddac13eb20 2024-09-10T08:31:57.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.991+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddac06c9c0 con 0x7fddac13eb20 2024-09-10T08:31:57.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.992+0000 7fdda9600640 1 -- 172.21.15.52:0/2240540199 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fdda407e1b0 con 0x7fddac13eb20 2024-09-10T08:31:57.993 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:31:57.993 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:31:57.993 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:31:57.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 msgr2=0x7fdd8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001780 tx=0x7fdda0009040 comp rx=0 tx=0).stop 2024-09-10T08:31:57.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 msgr2=0x7fddac15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009f40 tx=0x7fdda4004a40 comp rx=0 tx=0).stop 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 shutdown_connections 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd8c06be30 0x7fdd8c06e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fddac13eb20 0x7fddac15b600 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fddac0b2d40 0x7fddac15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 --2- 172.21.15.52:0/2240540199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fddac06c320 0x7fddac15a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 >> 172.21.15.52:0/2240540199 conn(0x7fddac0ccec0 msgr2=0x7fddac140ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:57.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 shutdown_connections 2024-09-10T08:31:57.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:57.994+0000 7fddb4600640 1 -- 172.21.15.52:0/2240540199 wait complete. 2024-09-10T08:31:58.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 3724774956 2024-09-10T08:31:58.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.170+0000 7fe6fd600640 1 Processor -- start 2024-09-10T08:31:58.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.170+0000 7fe6fd600640 1 -- start start 2024-09-10T08:31:58.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.171+0000 7fe6fd600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6f80ccf30 0x7fe6f80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.171+0000 7fe6fd600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f80cf2e0 con 0x7fe6f80cead0 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.171+0000 7fe6fd600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f8070fe0 con 0x7fe6f815b7c0 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.171+0000 7fe6fd600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f80712c0 con 0x7fe6f80ccf30 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6f80ccf30 0x7fe6f80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6f80ccf30 0x7fe6f80b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40282/0 (socket says 172.21.15.52:40282) 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 -- 172.21.15.52:0/858804046 learned_addr learned my addr 172.21.15.52:0/858804046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f7400640 1 --1- 172.21.15.52:0/858804046 >> v1:172.21.15.52:6789/0 conn(0x7fe6f80cead0 0x7fe6f8071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33428/0 (socket says 172.21.15.52:33428) 2024-09-10T08:31:58.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 -- 172.21.15.52:0/858804046 >> v1:172.21.15.176:6789/0 conn(0x7fe6f815b7c0 legacy=0x7fe6f80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 -- 172.21.15.52:0/858804046 >> v1:172.21.15.52:6789/0 conn(0x7fe6f80cead0 legacy=0x7fe6f8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f6a00640 1 -- 172.21.15.52:0/858804046 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f80715a0 con 0x7fe6f80ccf30 2024-09-10T08:31:58.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.172+0000 7fe6f5600640 1 -- 172.21.15.52:0/858804046 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911858760 0 0) 0x7fe6f80cf2e0 con 0x7fe6f80cead0 2024-09-10T08:31:58.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.173+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/858804046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80ccf30 0x7fe6f80b2c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009870 tx=0x7fe6e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4b55edbac10611 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.173+0000 7fe6f5600640 1 -- 172.21.15.52:0/858804046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8037070 con 0x7fe6f80ccf30 2024-09-10T08:31:58.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.173+0000 7fe6f5600640 1 -- 172.21.15.52:0/858804046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8032440 con 0x7fe6f80ccf30 2024-09-10T08:31:58.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.173+0000 7fe6f5600640 1 -- 172.21.15.52:0/858804046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8032810 con 0x7fe6f80ccf30 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 -- 172.21.15.52:0/858804046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80ccf30 msgr2=0x7fe6f80b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 --2- 172.21.15.52:0/858804046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80ccf30 0x7fe6f80b2c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009870 tx=0x7fe6e802a270 comp rx=0 tx=0).stop 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 -- 172.21.15.52:0/858804046 shutdown_connections 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 --2- 172.21.15.52:0/858804046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80ccf30 0x7fe6f80b2c50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 -- 172.21.15.52:0/858804046 >> 172.21.15.52:0/858804046 conn(0x7fe6f806d0f0 msgr2=0x7fe6f806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 -- 172.21.15.52:0/858804046 shutdown_connections 2024-09-10T08:31:58.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.174+0000 7fe6fd600640 1 -- 172.21.15.52:0/858804046 wait complete. 2024-09-10T08:31:58.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.176+0000 7fe6fd600640 1 Processor -- start 2024-09-10T08:31:58.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.176+0000 7fe6fd600640 1 -- start start 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 0x7fe6f8168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 0x7fe6f814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f80cf060 con 0x7fe6f80cead0 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f80ceee0 con 0x7fe6f80ccf30 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6fd600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f80721d0 con 0x7fe6f815b7c0 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40298/0 (socket says 172.21.15.52:40298) 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 -- 172.21.15.52:0/2148082843 learned_addr learned my addr 172.21.15.52:0/2148082843 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f7400640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 0x7fe6f814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 0x7fe6f8168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 -- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 msgr2=0x7fe6f814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 0x7fe6f814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 -- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 msgr2=0x7fe6f8168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 0x7fe6f8168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6000640 1 -- 172.21.15.52:0/2148082843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f8165790 con 0x7fe6f80cead0 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f7400640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 0x7fe6f814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.177+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 0x7fe6f8168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6f6000640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c400 tx=0x7fe6e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6eea00640 1 -- 172.21.15.52:0/2148082843 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4017070 con 0x7fe6f80cead0 2024-09-10T08:31:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6eea00640 1 -- 172.21.15.52:0/2148082843 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40052d0 con 0x7fe6f80cead0 2024-09-10T08:31:58.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6eea00640 1 -- 172.21.15.52:0/2148082843 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4003830 con 0x7fe6f80cead0 2024-09-10T08:31:58.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f81f84b0 con 0x7fe6f80cead0 2024-09-10T08:31:58.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.178+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f81f8a70 con 0x7fe6f80cead0 2024-09-10T08:31:58.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.180+0000 7fe6eea00640 1 -- 172.21.15.52:0/2148082843 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6e401a070 con 0x7fe6f80cead0 2024-09-10T08:31:58.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.181+0000 7fe6eea00640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 0x7fe6d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.181+0000 7fe6eea00640 1 -- 172.21.15.52:0/2148082843 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6e408a1a0 con 0x7fe6f80cead0 2024-09-10T08:31:58.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.181+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 0x7fe6d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.182+0000 7fe700475740 1 Processor -- start 2024-09-10T08:31:58.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.182+0000 7fe700475740 1 -- start start 2024-09-10T08:31:58.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.182+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 0x7fe6d806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8034000 tx=0x7fe6e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c2a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25bff0 0x55c53c25ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c53c1c2700 con 0x55c53c25ffc0 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c53c16a660 con 0x55c53c25bff0 2024-09-10T08:31:58.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c53c1be6c0 con 0x55c53c25e830 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe6f7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe6f7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40306/0 (socket says 172.21.15.52:40306) 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe6f6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c2a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe6f7400640 1 -- 172.21.15.52:0/4144741888 learned_addr learned my addr 172.21.15.52:0/4144741888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.183+0000 7fe6f6000640 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25bff0 0x55c53c25ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 -- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 msgr2=0x55c53c2a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c2a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 -- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25bff0 msgr2=0x55c53c25ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25bff0 0x55c53c25ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 -- 172.21.15.52:0/4144741888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53bfa1710 con 0x55c53c25ffc0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6f7400640 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0001ef0 tx=0x7fe6f000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915e9c696f6593a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6e3000640 1 -- 172.21.15.52:0/4144741888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0004b60 con 0x55c53c25ffc0 2024-09-10T08:31:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6e3000640 1 -- 172.21.15.52:0/4144741888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f0004d00 con 0x55c53c25ffc0 2024-09-10T08:31:58.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.184+0000 7fe6e3000640 1 -- 172.21.15.52:0/4144741888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00072d0 con 0x55c53c25ffc0 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 -- 172.21.15.52:0/4144741888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 msgr2=0x55c53c258e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0001ef0 tx=0x7fe6f000d520 comp rx=0 tx=0).stop 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 -- 172.21.15.52:0/4144741888 shutdown_connections 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25ffc0 0x55c53c258e20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25bff0 0x55c53c25ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 --2- 172.21.15.52:0/4144741888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c2a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 -- 172.21.15.52:0/4144741888 >> 172.21.15.52:0/4144741888 conn(0x55c53c25aff0 msgr2=0x55c53c2a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 -- 172.21.15.52:0/4144741888 shutdown_connections 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.185+0000 7fe700475740 1 -- 172.21.15.52:0/4144741888 wait complete. 2024-09-10T08:31:58.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.186+0000 7fe700475740 1 -- start start 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.186+0000 7fe700475740 1 Processor -- start 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c259b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c27f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c53c25a490 con 0x55c53c25d030 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c53c17d880 con 0x55c53c25ffc0 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c53c2a4800 con 0x55c53c25e830 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe700475740 10 client.0 _ll_register_callbacks cb 0x55c53c16f360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe6f7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe6f7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40320/0 (socket says 172.21.15.52:40320) 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe6f7400640 1 -- 172.21.15.52:0/3500884662 learned_addr learned my addr 172.21.15.52:0/3500884662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c259b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.187+0000 7fe6f6000640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c27f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 -- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 msgr2=0x55c53c259b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c259b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 -- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 msgr2=0x55c53c27f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c27f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 -- 172.21.15.52:0/3500884662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53c001ea0 con 0x55c53c25d030 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6f7400640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00012e0 tx=0x7fe6f0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99818242a51a595f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6d7400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0024020 con 0x55c53c25d030 2024-09-10T08:31:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6f00075f0 con 0x55c53c25d030 2024-09-10T08:31:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f0004d00 con 0x55c53c25d030 2024-09-10T08:31:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6f0004b60 con 0x55c53c25d030 2024-09-10T08:31:58.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe700475740 10 client.5703 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.188+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c53be95000 con 0x55c53c25d030 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f0004d00 con 0x55c53c25d030 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fe6f00077f0 con 0x55c53c25d030 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 10 client.5703 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 10 client.5703 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 20 client.5703 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c287a60 0x55c53c287e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 4 client.5703 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c53c1cfe30 con 0x55c53c287a60 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.189+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c287a60 0x55c53c287e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.190+0000 7fe6d7400640 10 client.5703 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.190+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c287a60 0x55c53c287e40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc6a85a8395c983 server_cookie=cb163bdc9512840b in_seq=0 out_seq=0 2024-09-10T08:31:58.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.190+0000 7fe6d7400640 1 -- 172.21.15.52:0/3500884662 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c53c1cfe30 con 0x55c53c287a60 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.190+0000 7fe6d7400640 10 client.5703 handle_command_reply: tid=0 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.190+0000 7fe700475740 1 client.5703 shutdown 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 msgr2=0x55c53c25d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00012e0 tx=0x7fe6f0001630 comp rx=0 tx=0).stop 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 shutdown_connections 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c287a60 0x55c53c287e40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25d030 0x55c53c25d4b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c27f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe6d7400640 0 client.5703 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 --2- 172.21.15.52:0/3500884662 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25e830 0x55c53c259b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 >> 172.21.15.52:0/3500884662 conn(0x55c53c25bff0 msgr2=0x55c53c2a2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 shutdown_connections 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 1 -- 172.21.15.52:0/3500884662 wait complete. 2024-09-10T08:31:58.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.191+0000 7fe700475740 20 client.5703 trim_cache size 0 max 16384 2024-09-10T08:31:58.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.205+0000 7fe700475740 1 Processor -- start 2024-09-10T08:31:58.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.205+0000 7fe700475740 1 -- start start 2024-09-10T08:31:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25d030 0x55c53c2b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25ffc0 0x55c53c29f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f8167a80 con 0x55c53c25e830 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f81471e0 con 0x55c53c25d030 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f8167430 con 0x55c53c25ffc0 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40334/0 (socket says 172.21.15.52:40334) 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe6f6000640 1 -- 172.21.15.52:0/3669883650 learned_addr learned my addr 172.21.15.52:0/3669883650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25d030 0x55c53c2b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.206+0000 7fe6f7400640 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25ffc0 0x55c53c29f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 -- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25ffc0 msgr2=0x55c53c29f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25ffc0 0x55c53c29f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 -- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25d030 msgr2=0x55c53c2b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25d030 0x55c53c2b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 -- 172.21.15.52:0/3669883650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c53c25fdc0 con 0x55c53c25e830 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6f6000640 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400cdc0 tx=0x7fe6e401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99d7d5e3eb06467 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6e2600640 1 -- 172.21.15.52:0/3669883650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4070070 con 0x55c53c25e830 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6e2600640 1 -- 172.21.15.52:0/3669883650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4054ab0 con 0x55c53c25e830 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.207+0000 7fe6e2600640 1 -- 172.21.15.52:0/3669883650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4070430 con 0x55c53c25e830 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 -- 172.21.15.52:0/3669883650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 msgr2=0x55c53c2b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400cdc0 tx=0x7fe6e401e040 comp rx=0 tx=0).stop 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 -- 172.21.15.52:0/3669883650 shutdown_connections 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25ffc0 0x55c53c29f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b6100 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 --2- 172.21.15.52:0/3669883650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25d030 0x55c53c2b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 -- 172.21.15.52:0/3669883650 >> 172.21.15.52:0/3669883650 conn(0x55c53c25bff0 msgr2=0x55c53c2a0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 -- 172.21.15.52:0/3669883650 shutdown_connections 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.208+0000 7fe700475740 1 -- 172.21.15.52:0/3669883650 wait complete. 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.209+0000 7fe700475740 1 -- start start 2024-09-10T08:31:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.209+0000 7fe700475740 1 Processor -- start 2024-09-10T08:31:58.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25d030 0x55c53c3228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c2a7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c53c27fc20 con 0x55c53c25e830 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c53c2585e0 con 0x55c53c25ffc0 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c53c27f250 con 0x55c53c25d030 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe700475740 10 client.0 _ll_register_callbacks cb 0x7fe6f0001ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40346/0 (socket says 172.21.15.52:40346) 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 -- 172.21.15.52:0/1046462984 learned_addr learned my addr 172.21.15.52:0/1046462984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25d030 0x55c53c3228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f7400640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c2a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 -- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25d030 msgr2=0x55c53c3228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25d030 0x55c53c3228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 -- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 msgr2=0x55c53c2a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.210+0000 7fe6f6000640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c2a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6f6000640 1 -- 172.21.15.52:0/1046462984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c53c259b80 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6f7400640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c2a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6f6000640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c950b868807533 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6d7400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4087020 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6e4071d50 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6e4054ab0 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6e4070040 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe700475740 10 client.5709 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c53c259400 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.211+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4054ab0 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fe6e4088220 con 0x55c53c25e830 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 10 client.5709 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 10 client.5709 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 20 client.5709 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c2a1ec0 0x55c53c278770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 4 client.5709 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3724774956}] 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3724774956}) -- 0x55c53c1ca180 con 0x55c53c2a1ec0 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c2a1ec0 0x55c53c278770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe6f6a00640 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c2a1ec0 0x55c53c278770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b584f08c7f88357f server_cookie=ce74cc77f267e6f3 in_seq=0 out_seq=0 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.212+0000 7fe6d7400640 10 client.5709 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe6d7400640 1 -- 172.21.15.52:0/1046462984 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55c53c1ca180 con 0x55c53c2a1ec0 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe6d7400640 10 client.5709 handle_command_reply: tid=0 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 client.5709 shutdown 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 msgr2=0x55c53c2b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4007fd0 tx=0x7fe6e4005040 comp rx=0 tx=0).stop 2024-09-10T08:31:58.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 shutdown_connections 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55c53c2a1ec0 0x55c53c278770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c53c25ffc0 0x55c53c2a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c53c25e830 0x55c53c2b5bc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 --2- 172.21.15.52:0/1046462984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c53c25d030 0x55c53c3228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe6d7400640 0 client.5709 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 >> 172.21.15.52:0/1046462984 conn(0x55c53c25bff0 msgr2=0x55c53c287e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 shutdown_connections 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 1 -- 172.21.15.52:0/1046462984 wait complete. 2024-09-10T08:31:58.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.213+0000 7fe700475740 20 client.5709 trim_cache size 0 max 16384 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 msgr2=0x7fe6d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 0x7fe6d806e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8034000 tx=0x7fe6e802e000 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 msgr2=0x7fe6f814c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c400 tx=0x7fe6e400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 shutdown_connections 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6d806be30 0x7fe6d806e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6f815b7c0 0x7fe6f814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6f80cead0 0x7fe6f814c4d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 --2- 172.21.15.52:0/2148082843 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6f80ccf30 0x7fe6f8168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 >> 172.21.15.52:0/2148082843 conn(0x7fe6f806d0f0 msgr2=0x7fe6f80cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 shutdown_connections 2024-09-10T08:31:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.214+0000 7fe6fd600640 1 -- 172.21.15.52:0/2148082843 wait complete. 2024-09-10T08:31:58.230 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T08:31:58.230 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T08:31:58.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.387+0000 7f1eb6600640 1 Processor -- start 2024-09-10T08:31:58.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.387+0000 7f1eb6600640 1 -- start start 2024-09-10T08:31:58.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eb6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eb0155950 0x7f1eb0073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eb6600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1eb00afb20 0x7f1eb00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eb6600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb0073cc0 con 0x7f1eb0162c80 2024-09-10T08:31:58.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eb6600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb0070370 con 0x7f1eb00afb20 2024-09-10T08:31:58.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eb6600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb0071aa0 con 0x7f1eb0155950 2024-09-10T08:31:58.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1ea7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1eb0162c80 0x7f1eb006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33438/0 (socket says 172.21.15.52:33438) 2024-09-10T08:31:58.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1ea7e00640 1 -- 172.21.15.52:0/2477839570 learned_addr learned my addr 172.21.15.52:0/2477839570 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:58.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eb0155950 0x7f1eb0073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2477839570 >> v2:172.21.15.176:3300/0 conn(0x7f1eb00afb20 0x7f1eb00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.389+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054889704 0 0) 0x7f1eb0073cc0 con 0x7f1eb0162c80 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e94003520 con 0x7f1eb0162c80 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 61865501 0 0) 0x7f1e94003520 con 0x7f1eb0162c80 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eb0155950 msgr2=0x7f1eb0073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1eb0155950 0x7f1eb0073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 >> v2:172.21.15.176:3300/0 conn(0x7f1eb00afb20 msgr2=0x7f1eb00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 --2- 172.21.15.52:0/2477839570 >> v2:172.21.15.176:3300/0 conn(0x7f1eb00afb20 0x7f1eb00affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb0071d80 con 0x7f1eb0162c80 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f1e98001670 con 0x7f1eb0162c80 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2477839570 >> v2:172.21.15.176:3300/0 conn(0x7f1eb00afb20 0x7f1eb00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 >> v1:172.21.15.52:6789/0 conn(0x7f1eb0162c80 legacy=0x7f1eb006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e940039b0 0x7f1e94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e94004310 0x7f1e94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e94004e50 0x7f1e940052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0070370 con 0x7f1e94004310 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0071aa0 con 0x7f1e94004e50 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9400bd40 con 0x7f1e940039b0 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e94004310 0x7f1e94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e940039b0 0x7f1e94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.390+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e94004e50 0x7f1e940052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.391+0000 7f1ea7e00640 1 -- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e940039b0 msgr2=0x7f1e94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.391+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e940039b0 0x7f1e94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.391+0000 7f1ea7e00640 1 -- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e94004e50 msgr2=0x7f1e940052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.391+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e94004e50 0x7f1e940052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.391+0000 7f1ea7e00640 1 -- 172.21.15.52:0/2477839570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e94003520 con 0x7f1e94004310 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e94004310 0x7f1e94004800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c210 tx=0x7f1e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eab12acc829fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007d30 con 0x7f1e94004310 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98005ad0 con 0x7f1e94004310 2024-09-10T08:31:58.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eaea00640 1 -- 172.21.15.52:0/2477839570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007070 con 0x7f1e94004310 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eb6600640 1 -- 172.21.15.52:0/2477839570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e94004310 msgr2=0x7f1e94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eb6600640 1 --2- 172.21.15.52:0/2477839570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e94004310 0x7f1e94004800 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c210 tx=0x7f1e94005830 comp rx=0 tx=0).stop 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eafe00640 1 -- 172.21.15.52:0/2477839570 reap_dead start 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eb6600640 1 -- 172.21.15.52:0/2477839570 shutdown_connections 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.392+0000 7f1eb6600640 1 -- 172.21.15.52:0/2477839570 >> 172.21.15.52:0/2477839570 conn(0x7f1eb006db30 msgr2=0x7f1eb006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.393+0000 7f1eb6600640 1 -- 172.21.15.52:0/2477839570 shutdown_connections 2024-09-10T08:31:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.393+0000 7f1eb6600640 1 -- 172.21.15.52:0/2477839570 wait complete. 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.394+0000 7f1eb6600640 1 Processor -- start 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.394+0000 7f1eb6600640 1 -- start start 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e94004310 0x7f1eb0147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eb01f45f0 0x7f1eb01f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0072060 con 0x7f1eb00b1e10 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01630e0 con 0x7f1eb01f45f0 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1eb6600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb00721e0 con 0x7f1e94004310 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1ea7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1ea7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40360/0 (socket says 172.21.15.52:40360) 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.395+0000 7f1ea7e00640 1 -- 172.21.15.52:0/222953171 learned_addr learned my addr 172.21.15.52:0/222953171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1eafe00640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eb01f45f0 0x7f1eb01f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1eaf400640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e94004310 0x7f1eb0147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 -- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e94004310 msgr2=0x7f1eb0147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e94004310 0x7f1eb0147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 -- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eb01f45f0 msgr2=0x7f1eb01f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eb01f45f0 0x7f1eb01f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 -- 172.21.15.52:0/222953171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb01f51d0 con 0x7f1eb00b1e10 2024-09-10T08:31:58.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000f60 tx=0x7f1eb015edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7400640 1 -- 172.21.15.52:0/222953171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98038040 con 0x7f1eb00b1e10 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1ea7400640 1 -- 172.21.15.52:0/222953171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98042070 con 0x7f1eb00b1e10 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.396+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb01f54b0 con 0x7f1eb00b1e10 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.397+0000 7f1ea7400640 1 -- 172.21.15.52:0/222953171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e980047e0 con 0x7f1eb00b1e10 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.397+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb00cdb40 con 0x7f1eb00b1e10 2024-09-10T08:31:58.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.399+0000 7f1ea7400640 1 -- 172.21.15.52:0/222953171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e98004980 con 0x7f1eb00b1e10 2024-09-10T08:31:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.399+0000 7f1ea7400640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 0x7f1e8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.399+0000 7f1ea7400640 1 -- 172.21.15.52:0/222953171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1e980aa740 con 0x7f1eb00b1e10 2024-09-10T08:31:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.400+0000 7f1eaf400640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 0x7f1e8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.400+0000 7f1eb93cd740 1 Processor -- start 2024-09-10T08:31:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.400+0000 7f1eb93cd740 1 -- start start 2024-09-10T08:31:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.400+0000 7f1eaf400640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 0x7f1e8c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00099c0 tx=0x7f1ea0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fe3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5f98510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560be5f01500 con 0x560be5f9b450 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560be5ea9520 con 0x560be5f9dc90 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560be5efd4c0 con 0x560be5f9f420 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.401+0000 7f1ea7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40368/0 (socket says 172.21.15.52:40368) 2024-09-10T08:31:58.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 -- 172.21.15.52:0/279736484 learned_addr learned my addr 172.21.15.52:0/279736484 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 -- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 msgr2=0x560be5f98510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1eafe00640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5f98510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1eaf400640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fe3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5f98510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 -- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 msgr2=0x560be5fe3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fe3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 -- 172.21.15.52:0/279736484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be5c14240 con 0x560be5f9b450 2024-09-10T08:31:58.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1eafe00640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5f98510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1eaf400640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fe3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e980a8c40 tx=0x7f1e980785c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb0a60f4e0bba34 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1e9fe00640 1 -- 172.21.15.52:0/279736484 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98078ba0 con 0x560be5f9b450 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1e9fe00640 1 -- 172.21.15.52:0/279736484 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9807cf50 con 0x560be5f9b450 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.402+0000 7f1e9fe00640 1 -- 172.21.15.52:0/279736484 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98081780 con 0x560be5f9b450 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 -- 172.21.15.52:0/279736484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 msgr2=0x560be5f9e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e980a8c40 tx=0x7f1e980785c0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 -- 172.21.15.52:0/279736484 shutdown_connections 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5f98510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9b450 0x560be5f9e070 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/279736484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fe3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 -- 172.21.15.52:0/279736484 >> 172.21.15.52:0/279736484 conn(0x560be5f9a6e0 msgr2=0x560be5fe2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 -- 172.21.15.52:0/279736484 shutdown_connections 2024-09-10T08:31:58.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.403+0000 7f1eb93cd740 1 -- 172.21.15.52:0/279736484 wait complete. 2024-09-10T08:31:58.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.404+0000 7f1eb93cd740 1 -- start start 2024-09-10T08:31:58.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.404+0000 7f1eb93cd740 1 Processor -- start 2024-09-10T08:31:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5fc4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5fc4870 0x560be5fdc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560be5ea9520 con 0x560be5f9dc90 2024-09-10T08:31:58.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560be5ebc680 con 0x560be5fc4870 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560be5f01500 con 0x560be5f9f420 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eb93cd740 10 client.0 _ll_register_callbacks cb 0x560be5ec1570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40374/0 (socket says 172.21.15.52:40374) 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eaf400640 1 -- 172.21.15.52:0/643507584 learned_addr learned my addr 172.21.15.52:0/643507584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5fc4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.405+0000 7f1eafe00640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5fc4870 0x560be5fdc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 -- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 msgr2=0x560be5fc4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5fc4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 -- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5fc4870 msgr2=0x560be5fdc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5fc4870 0x560be5fdc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 -- 172.21.15.52:0/643507584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be5cde620 con 0x560be5f9dc90 2024-09-10T08:31:58.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eaf400640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0016a10 tx=0x7f1ea0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9b4e96941e7838 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1e9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0014e20 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1ea0015ad0 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.406+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9807cf50 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ea0033050 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 10 client.5721 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560be5fc8140 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9807cf50 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1ea0015cd0 con 0x560be5f9dc90 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 10 client.5721 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 10 client.5721 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 20 client.5721 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be5fde1b0 0x560be5fde5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 4 client.5721 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:58.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be5f0ec30 con 0x560be5fde1b0 2024-09-10T08:31:58.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.407+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be5fde1b0 0x560be5fde5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.408+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be5fde1b0 0x560be5fde5f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a39c1469a9929802 server_cookie=e3c02d142ca1ff88 in_seq=0 out_seq=0 2024-09-10T08:31:58.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.408+0000 7f1e9cc00640 10 client.5721 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1e9cc00640 1 -- 172.21.15.52:0/643507584 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560be5f0ec30 con 0x560be5fde1b0 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1e9cc00640 10 client.5721 handle_command_reply: tid=0 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 client.5721 shutdown 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 msgr2=0x560be5fc7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0016a10 tx=0x7f1ea0004730 comp rx=0 tx=0).stop 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 shutdown_connections 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be5fde1b0 0x560be5fde5f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5fc4870 0x560be5fdc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be5fc4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1e9cc00640 0 client.5721 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/643507584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be5fc7c00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 >> 172.21.15.52:0/643507584 conn(0x560be5f9b450 msgr2=0x560be5fe1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 shutdown_connections 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 1 -- 172.21.15.52:0/643507584 wait complete. 2024-09-10T08:31:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.409+0000 7f1eb93cd740 20 client.5721 trim_cache size 0 max 16384 2024-09-10T08:31:58.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.425+0000 7f1eb93cd740 1 Processor -- start 2024-09-10T08:31:58.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.425+0000 7f1eb93cd740 1 -- start start 2024-09-10T08:31:58.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.425+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fdc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be60069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0201130 con 0x560be5fc4870 2024-09-10T08:31:58.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb02001a0 con 0x560be5f9dc90 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb00b0fa0 con 0x560be5f9f420 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40384/0 (socket says 172.21.15.52:40384) 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 -- 172.21.15.52:0/2311661880 learned_addr learned my addr 172.21.15.52:0/2311661880 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fdc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be60069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 -- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 msgr2=0x560be60069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be60069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 -- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 msgr2=0x560be5fdc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fdc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.426+0000 7f1eafe00640 1 -- 172.21.15.52:0/2311661880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be5fe25e0 con 0x560be5fc4870 2024-09-10T08:31:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1eb006ffb0 tx=0x7f1ea8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a59199bd5dca82f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1e9f400640 1 -- 172.21.15.52:0/2311661880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8021670 con 0x560be5fc4870 2024-09-10T08:31:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1e9f400640 1 -- 172.21.15.52:0/2311661880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea801c070 con 0x560be5fc4870 2024-09-10T08:31:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1e9f400640 1 -- 172.21.15.52:0/2311661880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8021a50 con 0x560be5fc4870 2024-09-10T08:31:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2311661880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 msgr2=0x560be5fd8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1eb006ffb0 tx=0x7f1ea8009750 comp rx=0 tx=0).stop 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2311661880 shutdown_connections 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5fc4870 0x560be5fd8940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5f9f420 0x560be60069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2311661880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9dc90 0x560be5fdc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.427+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2311661880 >> 172.21.15.52:0/2311661880 conn(0x560be5f9b450 msgr2=0x560be5fc35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.428+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2311661880 shutdown_connections 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.428+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2311661880 wait complete. 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.428+0000 7f1eb93cd740 1 -- start start 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.428+0000 7f1eb93cd740 1 Processor -- start 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9f420 0x560be5fe19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5fc4870 0x560be5fe1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560be5ff6b50 con 0x560be5f9dc90 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb00b15f0 con 0x560be5f9f420 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560be5fd9c20 con 0x560be5fc4870 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.429+0000 7f1eb93cd740 10 client.0 _ll_register_callbacks cb 0x7f1ea001a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40394/0 (socket says 172.21.15.52:40394) 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 -- 172.21.15.52:0/2859841982 learned_addr learned my addr 172.21.15.52:0/2859841982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eafe00640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5fc4870 0x560be5fe1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9f420 0x560be5fe19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 -- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5fc4870 msgr2=0x560be5fe1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5fc4870 0x560be5fe1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 -- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9f420 msgr2=0x560be5fe19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9f420 0x560be5fe19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 -- 172.21.15.52:0/2859841982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be5fe67d0 con 0x560be5f9dc90 2024-09-10T08:31:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1eaf400640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0014720 tx=0x7f1ea0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5772378eb99f34e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.430+0000 7f1e9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0015ad0 con 0x560be5f9dc90 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1ea0015c70 con 0x560be5f9dc90 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea801c070 con 0x560be5f9dc90 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ea0004020 con 0x560be5f9dc90 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 10 client.5727 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x560be6005a50 con 0x560be5f9dc90 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea801c070 con 0x560be5f9dc90 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1ea00041c0 con 0x560be5f9dc90 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 10 client.5727 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 10 client.5727 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 20 client.5727 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be6049ab0 0x560be6064320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 4 client.5727 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.431+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x560be5f08f80 con 0x560be6049ab0 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.432+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be6049ab0 0x560be6064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.432+0000 7f1ea7e00640 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be6049ab0 0x560be6064320 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f993ddcecf657b9 server_cookie=a584ceb9ce2f6517 in_seq=0 out_seq=0 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.432+0000 7f1e9cc00640 10 client.5727 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.434+0000 7f1e9cc00640 1 -- 172.21.15.52:0/2859841982 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560be5f08f80 con 0x560be6049ab0 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.434+0000 7f1e9cc00640 10 client.5727 handle_command_reply: tid=0 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.434+0000 7f1eb93cd740 1 client.5727 shutdown 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.434+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 msgr2=0x560be60493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.434+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0014720 tx=0x7f1ea0019000 comp rx=0 tx=0).stop 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 shutdown_connections 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x560be6049ab0 0x560be6064320 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560be5fc4870 0x560be5fe1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560be5f9f420 0x560be5fe19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 --2- 172.21.15.52:0/2859841982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560be5f9dc90 0x560be60493f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1e9cc00640 0 client.5727 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 >> 172.21.15.52:0/2859841982 conn(0x560be5f9b450 msgr2=0x560be5fe4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 shutdown_connections 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 1 -- 172.21.15.52:0/2859841982 wait complete. 2024-09-10T08:31:58.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.435+0000 7f1eb93cd740 20 client.5727 trim_cache size 0 max 16384 2024-09-10T08:31:58.438 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:58.438 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:58.438 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:31:58.438 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 msgr2=0x7f1e8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 0x7f1e8c06e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00099c0 tx=0x7f1ea0008040 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 msgr2=0x7f1eb00b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1e98000f60 tx=0x7f1eb015edc0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 shutdown_connections 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e8c06be30 0x7f1e8c06e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1eb01f45f0 0x7f1eb01f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb00b1e10 0x7f1eb00b2290 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 --2- 172.21.15.52:0/222953171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e94004310 0x7f1eb0147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 >> 172.21.15.52:0/222953171 conn(0x7f1eb006db30 msgr2=0x7f1eb00b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 shutdown_connections 2024-09-10T08:31:58.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.436+0000 7f1eb6600640 1 -- 172.21.15.52:0/222953171 wait complete. 2024-09-10T08:31:58.452 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:31:58.452 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T08:31:58.452 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-10T08:31:58.452 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-10T08:31:58.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:58.452 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-10T08:31:58.489 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> import json 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> import sys 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> except OSError as e: 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> sys.exit(e.errno) 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> print(json.dumps( 2024-09-10T08:31:58.490 DEBUG:teuthology.orchestra.run.smithi052:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T08:31:58.491 DEBUG:teuthology.orchestra.run.smithi052:> indent=2)) 2024-09-10T08:31:58.491 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:31:58.632 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mode": 16877, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ino": 1099511627777, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_dev": 43, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_nlink": 16, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_uid": 1000, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_gid": 1333, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_size": 18, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_atime": 1725957105.078781, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mtime": 1725957110.976702, 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ctime": 1725957110.976702 2024-09-10T08:31:58.633 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:58.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:31:58.644 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-10T08:31:58.644 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-10T08:31:58.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-10T08:31:58.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.841+0000 7f4d9e800640 1 Processor -- start 2024-09-10T08:31:58.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.841+0000 7f4d9e800640 1 -- start start 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.842+0000 7f4d9e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d980cf8d0 0x7f4d98070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.842+0000 7f4d9e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4d980cfcb0 0x7f4d98071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d9e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 0x7f4d98144760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d9e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4d98141cd0 con 0x7f4d980cf8d0 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d9e800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9815f120 con 0x7f4d980cfcb0 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d9e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9815f400 con 0x7f4d98144340 2024-09-10T08:31:58.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d97400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d980cf8d0 0x7f4d98070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d97400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4d980cf8d0 0x7f4d98070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40402/0 (socket says 172.21.15.52:40402) 2024-09-10T08:31:58.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d97400640 1 -- 172.21.15.52:0/705307654 learned_addr learned my addr 172.21.15.52:0/705307654 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/705307654 >> v2:172.21.15.176:3300/0 conn(0x7f4d980cfcb0 0x7f4d98071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.843+0000 7f4d97e00640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 0x7f4d98144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97400640 1 -- 172.21.15.52:0/705307654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 msgr2=0x7f4d98144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97400640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 0x7f4d98144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97400640 1 -- 172.21.15.52:0/705307654 >> v2:172.21.15.176:3300/0 conn(0x7f4d980cfcb0 msgr2=0x7f4d98071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97400640 1 --2- 172.21.15.52:0/705307654 >> v2:172.21.15.176:3300/0 conn(0x7f4d980cfcb0 0x7f4d98071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97400640 1 -- 172.21.15.52:0/705307654 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9815f6e0 con 0x7f4d980cf8d0 2024-09-10T08:31:58.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.844+0000 7f4d97e00640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 0x7f4d98144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:58.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d97400640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d980cf8d0 0x7f4d98070f40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806e070 tx=0x7f4d8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e860fee8d0dca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d96a00640 1 -- 172.21.15.52:0/705307654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88037070 con 0x7f4d980cf8d0 2024-09-10T08:31:58.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d96a00640 1 -- 172.21.15.52:0/705307654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88032440 con 0x7f4d980cf8d0 2024-09-10T08:31:58.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d96a00640 1 -- 172.21.15.52:0/705307654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88032810 con 0x7f4d980cf8d0 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d9e800640 1 -- 172.21.15.52:0/705307654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d980cf8d0 msgr2=0x7f4d98070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.845+0000 7f4d9e800640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d980cf8d0 0x7f4d98070f40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806e070 tx=0x7f4d8802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 -- 172.21.15.52:0/705307654 shutdown_connections 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 --2- 172.21.15.52:0/705307654 >> v2:172.21.15.176:3300/0 conn(0x7f4d980cfcb0 0x7f4d98071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d98144340 0x7f4d98144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 --2- 172.21.15.52:0/705307654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d980cf8d0 0x7f4d98070f40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 -- 172.21.15.52:0/705307654 >> 172.21.15.52:0/705307654 conn(0x7f4d9806d0f0 msgr2=0x7f4d9806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 -- 172.21.15.52:0/705307654 shutdown_connections 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.846+0000 7f4d9e800640 1 -- 172.21.15.52:0/705307654 wait complete. 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.847+0000 7f4d9e800640 1 Processor -- start 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.848+0000 7f4d9e800640 1 -- start start 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.848+0000 7f4d9e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d980cf8d0 0x7f4d981410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.848+0000 7f4d9e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d980cfcb0 0x7f4d980cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d9e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d98144340 0x7f4d980cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d9e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d980ce0f0 con 0x7f4d98144340 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d9e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9815ee30 con 0x7f4d980cf8d0 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d9e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d980ce270 con 0x7f4d980cfcb0 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d98144340 0x7f4d980cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d98144340 0x7f4d980cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40406/0 (socket says 172.21.15.52:40406) 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 -- 172.21.15.52:0/1269677792 learned_addr learned my addr 172.21.15.52:0/1269677792 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97400640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d980cf8d0 0x7f4d981410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d980cfcb0 0x7f4d980cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 -- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d980cfcb0 msgr2=0x7f4d980cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4d980cfcb0 0x7f4d980cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 -- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d980cf8d0 msgr2=0x7f4d981410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d980cf8d0 0x7f4d981410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.849+0000 7f4d97e00640 1 -- 172.21.15.52:0/1269677792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d981e7480 con 0x7f4d98144340 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d97e00640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d98144340 0x7f4d980cce70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4d90007e20 tx=0x7f4d9000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d8fe00640 1 -- 172.21.15.52:0/1269677792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9001a070 con 0x7f4d98144340 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d8fe00640 1 -- 172.21.15.52:0/1269677792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d90003b90 con 0x7f4d98144340 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d9e800640 1 -- 172.21.15.52:0/1269677792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d981e63e0 con 0x7f4d98144340 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d8fe00640 1 -- 172.21.15.52:0/1269677792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000de80 con 0x7f4d98144340 2024-09-10T08:31:58.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.850+0000 7f4d9e800640 1 -- 172.21.15.52:0/1269677792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d981e69a0 con 0x7f4d98144340 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.852+0000 7f4d8fe00640 1 -- 172.21.15.52:0/1269677792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d9001d070 con 0x7f4d98144340 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.853+0000 7f4d8fe00640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4d7406be30 0x7f4d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.853+0000 7f4d8fe00640 1 -- 172.21.15.52:0/1269677792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4d9008b110 con 0x7f4d98144340 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.853+0000 7f4d97400640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4d7406be30 0x7f4d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.853+0000 7f4da15e7740 1 Processor -- start 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 -- start start 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4d97400640 1 --2- 172.21.15.52:0/1269677792 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4d7406be30 0x7f4d7406e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d88034000 tx=0x7f4d8802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f10f0 0x558dcb7f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558dcb756840 con 0x558dcb7f50c0 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558dcb6fe910 con 0x558dcb7f10f0 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.854+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558dcb752800 con 0x558dcb7f3930 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40418/0 (socket says 172.21.15.52:40418) 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 -- 172.21.15.52:0/2916929558 learned_addr learned my addr 172.21.15.52:0/2916929558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97400640 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f10f0 0x558dcb7f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 -- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 msgr2=0x558dcb8390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 -- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f10f0 msgr2=0x558dcb7f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f10f0 0x558dcb7f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 -- 172.21.15.52:0/2916929558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dcb44d590 con 0x558dcb7f50c0 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.855+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4d90055830 tx=0x7f4d9005d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48069b12334459ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4d87e00640 1 -- 172.21.15.52:0/2916929558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90055a40 con 0x558dcb7f50c0 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4d87e00640 1 -- 172.21.15.52:0/2916929558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d90071180 con 0x558dcb7f50c0 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4d87e00640 1 -- 172.21.15.52:0/2916929558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90055be0 con 0x558dcb7f50c0 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 -- 172.21.15.52:0/2916929558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 msgr2=0x558dcb7ee1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4d90055830 tx=0x7f4d9005d6d0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 -- 172.21.15.52:0/2916929558 shutdown_connections 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb7ee1b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f10f0 0x558dcb7f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2916929558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 -- 172.21.15.52:0/2916929558 >> 172.21.15.52:0/2916929558 conn(0x558dcb7f0380 msgr2=0x558dcb8385a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 -- 172.21.15.52:0/2916929558 shutdown_connections 2024-09-10T08:31:58.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.856+0000 7f4da15e7740 1 -- 172.21.15.52:0/2916929558 wait complete. 2024-09-10T08:31:58.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.857+0000 7f4da15e7740 1 -- start start 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.857+0000 7f4da15e7740 1 Processor -- start 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f50c0 0x558dcb84cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558dcb7ef820 con 0x558dcb836d00 2024-09-10T08:31:58.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558dcb711bd0 con 0x558dcb7f50c0 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558dcb839900 con 0x558dcb7f3930 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4da15e7740 10 client.0 _ll_register_callbacks cb 0x558dcb74fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.858+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40428/0 (socket says 172.21.15.52:40428) 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 -- 172.21.15.52:0/2632793257 learned_addr learned my addr 172.21.15.52:0/2632793257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f50c0 0x558dcb84cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 -- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 msgr2=0x558dcb8499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 -- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f50c0 msgr2=0x558dcb84cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f50c0 0x558dcb84cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 -- 172.21.15.52:0/2632793257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dcb469590 con 0x558dcb836d00 2024-09-10T08:31:58.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d97e00640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d9a0 tx=0x7f4d90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cae3740b0d8544 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d84c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90076060 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4d90059840 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.859+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d90071180 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d9007d050 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 10 client.5739 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558dcb533970 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d90071180 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4d90089070 con 0x558dcb836d00 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 10 client.5739 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 10 client.5739 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 20 client.5739 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb81d7d0 0x558dcb81b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 4 client.5739 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dcb763f70 con 0x558dcb81d7d0 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.860+0000 7f4d97400640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb81d7d0 0x558dcb81b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.861+0000 7f4d97400640 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb81d7d0 0x558dcb81b310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ea4310ec0c80cd server_cookie=df022f0c14b8745b in_seq=0 out_seq=0 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.861+0000 7f4d84c00640 10 client.5739 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4d84c00640 1 -- 172.21.15.52:0/2632793257 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558dcb763f70 con 0x558dcb81d7d0 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4d84c00640 10 client.5739 handle_command_reply: tid=0 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 client.5739 shutdown 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 msgr2=0x558dcb835ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d9a0 tx=0x7f4d90016000 comp rx=0 tx=0).stop 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 shutdown_connections 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb81d7d0 0x558dcb81b310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb836d00 0x558dcb835ac0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f50c0 0x558dcb84cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 --2- 172.21.15.52:0/2632793257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f3930 0x558dcb8499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4d84c00640 0 client.5739 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 >> 172.21.15.52:0/2632793257 conn(0x558dcb7f10f0 msgr2=0x558dcb83bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 shutdown_connections 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 1 -- 172.21.15.52:0/2632793257 wait complete. 2024-09-10T08:31:58.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.862+0000 7f4da15e7740 20 client.5739 trim_cache size 0 max 16384 2024-09-10T08:31:58.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.878+0000 7f4da15e7740 1 Processor -- start 2024-09-10T08:31:58.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.878+0000 7f4da15e7740 1 -- start start 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 0x558dcb838a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb836d00 0x558dcb81b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d98200c90 con 0x558dcb7f50c0 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981ffcd0 con 0x558dcb7f3930 2024-09-10T08:31:58.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4d981e89f0 con 0x558dcb836d00 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40432/0 (socket says 172.21.15.52:40432) 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 -- 172.21.15.52:0/3178075208 learned_addr learned my addr 172.21.15.52:0/3178075208 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d97400640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 0x558dcb838a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d97e00640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb836d00 0x558dcb81b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 -- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb836d00 msgr2=0x558dcb81b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb836d00 0x558dcb81b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 -- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 msgr2=0x558dcb838a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 0x558dcb838a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d8ea00640 1 -- 172.21.15.52:0/3178075208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dcb710c10 con 0x558dcb7f50c0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.879+0000 7f4d97400640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 0x558dcb838a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.880+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009a30 tx=0x7f4d80009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399090181d86eeee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.880+0000 7f4d87400640 1 -- 172.21.15.52:0/3178075208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80017e10 con 0x558dcb7f50c0 2024-09-10T08:31:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.880+0000 7f4d87400640 1 -- 172.21.15.52:0/3178075208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80004030 con 0x558dcb7f50c0 2024-09-10T08:31:58.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.880+0000 7f4d87400640 1 -- 172.21.15.52:0/3178075208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80004420 con 0x558dcb7f50c0 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- 172.21.15.52:0/3178075208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 msgr2=0x558dcb814050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009a30 tx=0x7f4d80009190 comp rx=0 tx=0).stop 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- 172.21.15.52:0/3178075208 shutdown_connections 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb836d00 0x558dcb81b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f50c0 0x558dcb814050 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 --2- 172.21.15.52:0/3178075208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb7f3930 0x558dcb838a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- 172.21.15.52:0/3178075208 >> 172.21.15.52:0/3178075208 conn(0x558dcb7f10f0 msgr2=0x558dcb837e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- 172.21.15.52:0/3178075208 shutdown_connections 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- 172.21.15.52:0/3178075208 wait complete. 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 -- start start 2024-09-10T08:31:58.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.881+0000 7f4da15e7740 1 Processor -- start 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f50c0 0x558dcb7f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb836d00 0x558dcb8ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558dcb83c660 con 0x558dcb7f3930 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d981ff680 con 0x558dcb836d00 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558dcb83a5a0 con 0x558dcb7f50c0 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.882+0000 7f4da15e7740 10 client.0 _ll_register_callbacks cb 0x7f4d90058fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40438/0 (socket says 172.21.15.52:40438) 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 -- 172.21.15.52:0/549677150 learned_addr learned my addr 172.21.15.52:0/549677150 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97e00640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb836d00 0x558dcb8ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f50c0 0x558dcb7f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 -- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f50c0 msgr2=0x558dcb7f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f50c0 0x558dcb7f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 -- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb836d00 msgr2=0x558dcb8ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb836d00 0x558dcb8ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 -- 172.21.15.52:0/549677150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dcb818b30 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d97400640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4d8803e040 tx=0x7f4d8802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9d2345e27bc489 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.883+0000 7f4d84c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88056070 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4d8804f520 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d80004030 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d88061050 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 10 client.5745 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558dcb8bac00 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80004030 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4d88064020 con 0x558dcb7f3930 2024-09-10T08:31:58.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 10 client.5745 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 10 client.5745 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 20 client.5745 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb8ba130 0x558dcb8ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 4 client.5745 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.884+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x558dcb81ce70 con 0x558dcb8ba130 2024-09-10T08:31:58.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.885+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb8ba130 0x558dcb8ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:58.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.885+0000 7f4d8ea00640 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb8ba130 0x558dcb8ba510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a14ce19cf7b4e55 server_cookie=6deab0ef5e636cb9 in_seq=0 out_seq=0 2024-09-10T08:31:58.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.885+0000 7f4d84c00640 10 client.5745 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4d84c00640 1 -- 172.21.15.52:0/549677150 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x558dcb81ce70 con 0x558dcb8ba130 2024-09-10T08:31:58.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4d84c00640 10 client.5745 handle_command_reply: tid=0 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 client.5745 shutdown 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 msgr2=0x558dcb8b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4d8803e040 tx=0x7f4d8802c070 comp rx=0 tx=0).stop 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 shutdown_connections 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x558dcb8ba130 0x558dcb8ba510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558dcb836d00 0x558dcb8ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558dcb7f50c0 0x558dcb7f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 --2- 172.21.15.52:0/549677150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558dcb7f3930 0x558dcb8b7650 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4d84c00640 0 client.5745 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 >> 172.21.15.52:0/549677150 conn(0x558dcb7f10f0 msgr2=0x558dcb83bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 shutdown_connections 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 1 -- 172.21.15.52:0/549677150 wait complete. 2024-09-10T08:31:58.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:58.886+0000 7f4da15e7740 20 client.5745 trim_cache size 0 max 16384 2024-09-10T08:31:58.891 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:58.891 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:31:58.891 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": -2 2024-09-10T08:31:58.891 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:58.891 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENOENT: 2024-09-10T08:31:58.894 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-10T08:31:58.895 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-10T08:31:58.895 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-10T08:31:58.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-10T08:31:59.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.053+0000 7f445a200640 1 Processor -- start 2024-09-10T08:31:59.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.053+0000 7f445a200640 1 -- start start 2024-09-10T08:31:59.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f445a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 0x7f445406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f445a200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445414c8f0 con 0x7f445406c150 2024-09-10T08:31:59.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f445a200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454073a80 con 0x7f445414c510 2024-09-10T08:31:59.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f445a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44540ce0f0 con 0x7f4454163190 2024-09-10T08:31:59.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f4453e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f445406c150 0x7f44540ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33442/0 (socket says 172.21.15.52:33442) 2024-09-10T08:31:59.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f4453e00640 1 -- 172.21.15.52:0/1943069098 learned_addr learned my addr 172.21.15.52:0/1943069098 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:59.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.055+0000 7f444be00640 1 --2- 172.21.15.52:0/1943069098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 0x7f445406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847363788 0 0) 0x7f445414c8f0 con 0x7f445406c150 2024-09-10T08:31:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4438003520 con 0x7f445406c150 2024-09-10T08:31:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634605536 0 0) 0x7f4454073a80 con 0x7f445414c510 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f445414c8f0 con 0x7f445414c510 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f444be00640 1 -- 172.21.15.52:0/1943069098 >> v1:172.21.15.176:6789/0 conn(0x7f445414c510 legacy=0x7f4454070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f444be00640 1 -- 172.21.15.52:0/1943069098 >> v1:172.21.15.52:6789/0 conn(0x7f445406c150 legacy=0x7f44540ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.056+0000 7f444be00640 1 -- 172.21.15.52:0/1943069098 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4454073d60 con 0x7f4454163190 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.057+0000 7f444be00640 1 --2- 172.21.15.52:0/1943069098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 0x7f445406bc10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097d0 tx=0x7f443c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88a8af91d29c8c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.057+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c037070 con 0x7f4454163190 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.057+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c032440 con 0x7f4454163190 2024-09-10T08:31:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.057+0000 7f4452a00640 1 -- 172.21.15.52:0/1943069098 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c0327f0 con 0x7f4454163190 2024-09-10T08:31:59.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 -- 172.21.15.52:0/1943069098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 msgr2=0x7f445406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 --2- 172.21.15.52:0/1943069098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 0x7f445406bc10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f443c0097d0 tx=0x7f443c02a210 comp rx=0 tx=0).stop 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 -- 172.21.15.52:0/1943069098 shutdown_connections 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 --2- 172.21.15.52:0/1943069098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4454163190 0x7f445406bc10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 -- 172.21.15.52:0/1943069098 >> 172.21.15.52:0/1943069098 conn(0x7f445406d0f0 msgr2=0x7f445406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 -- 172.21.15.52:0/1943069098 shutdown_connections 2024-09-10T08:31:59.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.058+0000 7f445a200640 1 -- 172.21.15.52:0/1943069098 wait complete. 2024-09-10T08:31:59.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.060+0000 7f445a200640 1 Processor -- start 2024-09-10T08:31:59.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.060+0000 7f445a200640 1 -- start start 2024-09-10T08:31:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.060+0000 7f445a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 0x7f44541f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f445a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f445a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4454163190 0x7f4454145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f445a200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4454071650 con 0x7f445414c510 2024-09-10T08:31:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f445a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44540ce340 con 0x7f4454163190 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f445a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4454073610 con 0x7f445406c150 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40440/0 (socket says 172.21.15.52:40440) 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 -- 172.21.15.52:0/2856780212 learned_addr learned my addr 172.21.15.52:0/2856780212 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f4453e00640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4454163190 0x7f4454145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f4453400640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 0x7f44541f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 -- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 msgr2=0x7f44541f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 0x7f44541f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 -- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4454163190 msgr2=0x7f4454145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4454163190 0x7f4454145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f444be00640 1 -- 172.21.15.52:0/2856780212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44541ed660 con 0x7f445414c510 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.061+0000 7f4453400640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 0x7f44541f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f444be00640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f443c02a250 tx=0x7f443c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f444b400640 1 -- 172.21.15.52:0/2856780212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c037040 con 0x7f445414c510 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f444b400640 1 -- 172.21.15.52:0/2856780212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c042070 con 0x7f445414c510 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f444b400640 1 -- 172.21.15.52:0/2856780212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c032810 con 0x7f445414c510 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44541fa000 con 0x7f445414c510 2024-09-10T08:31:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.062+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4454143de0 con 0x7f445414c510 2024-09-10T08:31:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.065+0000 7f444b400640 1 -- 172.21.15.52:0/2856780212 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f443c0329b0 con 0x7f445414c510 2024-09-10T08:31:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.066+0000 7f444b400640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.066+0000 7f444b400640 1 -- 172.21.15.52:0/2856780212 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f443c0ab780 con 0x7f445414c510 2024-09-10T08:31:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.066+0000 7f445d1e1740 1 Processor -- start 2024-09-10T08:31:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.066+0000 7f4453400640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.066+0000 7f445d1e1740 1 -- start start 2024-09-10T08:31:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f4453400640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 0x7f443006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44440016b0 tx=0x7f4444009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f3c0 0x557216d30f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d11b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557216cad2d0 con 0x557216d31c00 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557216c4e930 con 0x557216d2f3c0 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557216bf68e0 con 0x557216d2f820 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f4453400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f4453400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40450/0 (socket says 172.21.15.52:40450) 2024-09-10T08:31:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f4453400640 1 -- 172.21.15.52:0/3801735658 learned_addr learned my addr 172.21.15.52:0/3801735658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f444be00640 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f3c0 0x557216d30f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.067+0000 7f4453e00640 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d11b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 -- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 msgr2=0x557216d11b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d11b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 -- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f3c0 msgr2=0x557216d30f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f3c0 0x557216d30f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 -- 172.21.15.52:0/3801735658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557216a2d9f0 con 0x557216d31c00 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4453400640 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f444400da90 tx=0x7f4444010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7312e1d5ed078824 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4443400640 1 -- 172.21.15.52:0/3801735658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444024070 con 0x557216d31c00 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4443400640 1 -- 172.21.15.52:0/3801735658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4444014db0 con 0x557216d31c00 2024-09-10T08:31:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.068+0000 7f4443400640 1 -- 172.21.15.52:0/3801735658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444401f600 con 0x557216d31c00 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 -- 172.21.15.52:0/3801735658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 msgr2=0x557216d31fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f444400da90 tx=0x7f4444010000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 -- 172.21.15.52:0/3801735658 shutdown_connections 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d11b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f3c0 0x557216d30f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3801735658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d31fe0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 -- 172.21.15.52:0/3801735658 >> 172.21.15.52:0/3801735658 conn(0x557216ce7860 msgr2=0x557216d2fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 -- 172.21.15.52:0/3801735658 shutdown_connections 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.069+0000 7f445d1e1740 1 -- 172.21.15.52:0/3801735658 wait complete. 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.070+0000 7f445d1e1740 1 -- start start 2024-09-10T08:31:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.070+0000 7f445d1e1740 1 Processor -- start 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216ce9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 0x557216d11940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557216c09b60 con 0x557216d11e80 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x557216c4a8f0 con 0x557216d31c00 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557216d2e320 con 0x557216d2f820 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f445d1e1740 10 client.0 _ll_register_callbacks cb 0x557216c47640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40456/0 (socket says 172.21.15.52:40456) 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f4453e00640 1 -- 172.21.15.52:0/1018335449 learned_addr learned my addr 172.21.15.52:0/1018335449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f444be00640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 0x557216d11940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.071+0000 7f4453400640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216ce9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 -- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 msgr2=0x557216ce9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216ce9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 -- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 msgr2=0x557216d11940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 0x557216d11940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 -- 172.21.15.52:0/1018335449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572169212e0 con 0x557216d11e80 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453400640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216ce9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f444be00640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 0x557216d11940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4453e00640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f444c011970 tx=0x7f444c011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02bf0a068d97863 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4437e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c005de0 con 0x557216d11e80 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f444c00f7b0 con 0x557216d11e80 2024-09-10T08:31:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4444014db0 con 0x557216d11e80 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f444c022050 con 0x557216d11e80 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f445d1e1740 10 client.5757 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.072+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557216a8e180 con 0x557216d11e80 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4444014db0 con 0x557216d11e80 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f444c025020 con 0x557216d11e80 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 10 client.5757 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 20 client.5757 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d0bed0 0x557216d13e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 4 client.5757 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557216c5c060 con 0x557216d0bed0 2024-09-10T08:31:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.073+0000 7f4453400640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d0bed0 0x557216d13e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f4453400640 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d0bed0 0x557216d13e20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d727dbd5987631 server_cookie=f68c384a855a3411 in_seq=0 out_seq=0 2024-09-10T08:31:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f4437e00640 10 client.5757 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f4437e00640 1 -- 172.21.15.52:0/1018335449 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557216c5c060 con 0x557216d0bed0 2024-09-10T08:31:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f4437e00640 10 client.5757 handle_command_reply: tid=0 2024-09-10T08:31:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f445d1e1740 1 client.5757 shutdown 2024-09-10T08:31:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 msgr2=0x557216d0b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.074+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f444c011970 tx=0x7f444c011d70 comp rx=0 tx=0).stop 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 shutdown_connections 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d0bed0 0x557216d13e20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d11e80 0x557216d0b990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d31c00 0x557216d11940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1018335449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216ce9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f4437e00640 0 client.5757 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 >> 172.21.15.52:0/1018335449 conn(0x557216d2f3c0 msgr2=0x557216d331d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 shutdown_connections 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 1 -- 172.21.15.52:0/1018335449 wait complete. 2024-09-10T08:31:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.075+0000 7f445d1e1740 20 client.5757 trim_cache size 0 max 16384 2024-09-10T08:31:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.093+0000 7f445d1e1740 1 Processor -- start 2024-09-10T08:31:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.093+0000 7f445d1e1740 1 -- start start 2024-09-10T08:31:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d11e80 0x557216d30090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f820 0x557216d33140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4454205050 con 0x557216d31c00 2024-09-10T08:31:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44542040b0 con 0x557216d2f820 2024-09-10T08:31:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44541fd2c0 con 0x557216d11e80 2024-09-10T08:31:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40470/0 (socket says 172.21.15.52:40470) 2024-09-10T08:31:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.094+0000 7f4453e00640 1 -- 172.21.15.52:0/3817050962 learned_addr learned my addr 172.21.15.52:0/3817050962 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f444be00640 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f820 0x557216d33140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453400640 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d11e80 0x557216d30090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 -- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d11e80 msgr2=0x557216d30090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d11e80 0x557216d30090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 -- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f820 msgr2=0x557216d33140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f820 0x557216d33140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 -- 172.21.15.52:0/3817050962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572168fa3a0 con 0x557216d31c00 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4453e00640 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f444c009010 tx=0x7f444c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c297e1ba786d0781 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4442a00640 1 -- 172.21.15.52:0/3817050962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f5a0 con 0x557216d31c00 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4442a00640 1 -- 172.21.15.52:0/3817050962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444c01a070 con 0x557216d31c00 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.095+0000 7f4442a00640 1 -- 172.21.15.52:0/3817050962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f7b0 con 0x557216d31c00 2024-09-10T08:31:59.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- 172.21.15.52:0/3817050962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 msgr2=0x557216d30f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f444c009010 tx=0x7f444c00c000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- 172.21.15.52:0/3817050962 shutdown_connections 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d30f60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d2f820 0x557216d33140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 --2- 172.21.15.52:0/3817050962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d11e80 0x557216d30090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- 172.21.15.52:0/3817050962 >> 172.21.15.52:0/3817050962 conn(0x557216d2f3c0 msgr2=0x557216ce92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- 172.21.15.52:0/3817050962 shutdown_connections 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- 172.21.15.52:0/3817050962 wait complete. 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.096+0000 7f445d1e1740 1 -- start start 2024-09-10T08:31:59.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.097+0000 7f445d1e1740 1 Processor -- start 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.097+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 0x557216d0af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.097+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f445d1e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f445d1e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557216c0ab30 con 0x557216d31c00 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4454203a90 con 0x557216d11e80 2024-09-10T08:31:59.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f445d1e1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x557216d13860 con 0x557216d2f820 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f445d1e1740 10 client.0 _ll_register_callbacks cb 0x7f444c001d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40480/0 (socket says 172.21.15.52:40480) 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 -- 172.21.15.52:0/1428534027 learned_addr learned my addr 172.21.15.52:0/1428534027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f444be00640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453400640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 0x557216d0af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 -- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 msgr2=0x557216d0b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d0b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 -- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 msgr2=0x557216d0af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 0x557216d0af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453e00640 1 -- 172.21.15.52:0/1428534027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557216d151e0 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.098+0000 7f4453400640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 0x557216d0af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4453e00640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f444c028040 tx=0x7f444c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fe15b32c8f31ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c036070 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f444c015680 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f444c01a070 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f444c00f5a0 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 10 client.5763 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x557216d0e1a0 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444c01a070 con 0x557216d31c00 2024-09-10T08:31:59.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f444c044080 con 0x557216d31c00 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 10 client.5763 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 10 client.5763 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 20 client.5763 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d11a90 0x557216d10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 4 client.5763 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.099+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x557216c563b0 con 0x557216d11a90 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f4453400640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d11a90 0x557216d10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f4453400640 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d11a90 0x557216d10930 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df359fe076538dd7 server_cookie=6e2c6f7115e0c2eb in_seq=0 out_seq=0 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f4437e00640 10 client.5763 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f4437e00640 1 -- 172.21.15.52:0/1428534027 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x557216c563b0 con 0x557216d11a90 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f4437e00640 10 client.5763 handle_command_reply: tid=0 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.100+0000 7f445d1e1740 1 client.5763 shutdown 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 msgr2=0x557216d103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f444c028040 tx=0x7f444c0014d0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 shutdown_connections 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x557216d11a90 0x557216d10930 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557216d31c00 0x557216d103f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x557216d2f820 0x557216d0b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 --2- 172.21.15.52:0/1428534027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x557216d11e80 0x557216d0af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f4437e00640 0 client.5763 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 >> 172.21.15.52:0/1428534027 conn(0x557216d2f3c0 msgr2=0x557216d33140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 shutdown_connections 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 1 -- 172.21.15.52:0/1428534027 wait complete. 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.101+0000 7f445d1e1740 20 client.5763 trim_cache size 0 max 16384 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": -2 2024-09-10T08:31:59.107 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:59.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 msgr2=0x7f443006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 0x7f443006e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44440016b0 tx=0x7f4444009040 comp rx=0 tx=0).stop 2024-09-10T08:31:59.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 msgr2=0x7f44541454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f443c02a250 tx=0x7f443c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 shutdown_connections 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f443006be30 0x7f443006e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4454163190 0x7f4454145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f445414c510 0x7f44541454c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 --2- 172.21.15.52:0/2856780212 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f445406c150 0x7f44541f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 >> 172.21.15.52:0/2856780212 conn(0x7f445406d0f0 msgr2=0x7f44540b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 shutdown_connections 2024-09-10T08:31:59.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.102+0000 7f445a200640 1 -- 172.21.15.52:0/2856780212 wait complete. 2024-09-10T08:31:59.117 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-10T08:31:59.117 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-10T08:31:59.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-10T08:31:59.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.277+0000 7f4614400640 1 Processor -- start 2024-09-10T08:31:59.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.278+0000 7f4614400640 1 -- start start 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4614400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f460c15be30 0x7f460c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4614400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460c15c210 0x7f460c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4614400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460c15f620 con 0x7f460c13f0a0 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4614400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f460c15f900 con 0x7f460c15c210 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4614400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f460c15fbe0 con 0x7f460c15be30 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4611000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f460c15c210 0x7f460c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4612400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f460c13f0a0 0x7f460c1411b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33456/0 (socket says 172.21.15.52:33456) 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4612400640 1 -- 172.21.15.52:0/449699644 learned_addr learned my addr 172.21.15.52:0/449699644 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4611a00640 1 --2- 172.21.15.52:0/449699644 >> v2:172.21.15.176:3300/0 conn(0x7f460c15be30 0x7f460c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4611000640 1 -- 172.21.15.52:0/449699644 >> v2:172.21.15.176:3300/0 conn(0x7f460c15be30 msgr2=0x7f460c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4611000640 1 --2- 172.21.15.52:0/449699644 >> v2:172.21.15.176:3300/0 conn(0x7f460c15be30 0x7f460c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.279+0000 7f4611000640 1 -- 172.21.15.52:0/449699644 >> v1:172.21.15.52:6789/0 conn(0x7f460c13f0a0 legacy=0x7f460c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.280+0000 7f4611000640 1 -- 172.21.15.52:0/449699644 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c15fec0 con 0x7f460c15c210 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.280+0000 7f4611000640 1 --2- 172.21.15.52:0/449699644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c13eb60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f460c06ecc0 tx=0x7f45f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12abc4b84b519ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f460be00640 1 -- 172.21.15.52:0/449699644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8037070 con 0x7f460c15c210 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f460be00640 1 -- 172.21.15.52:0/449699644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8032440 con 0x7f460c15c210 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f460be00640 1 -- 172.21.15.52:0/449699644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8032810 con 0x7f460c15c210 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 -- 172.21.15.52:0/449699644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 msgr2=0x7f460c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 --2- 172.21.15.52:0/449699644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c13eb60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f460c06ecc0 tx=0x7f45f802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 -- 172.21.15.52:0/449699644 shutdown_connections 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 --2- 172.21.15.52:0/449699644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c13eb60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 --2- 172.21.15.52:0/449699644 >> v2:172.21.15.176:3300/0 conn(0x7f460c15be30 0x7f460c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.281+0000 7f4614400640 1 -- 172.21.15.52:0/449699644 >> 172.21.15.52:0/449699644 conn(0x7f460c067fe0 msgr2=0x7f460c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.282+0000 7f4614400640 1 -- 172.21.15.52:0/449699644 shutdown_connections 2024-09-10T08:31:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.282+0000 7f4614400640 1 -- 172.21.15.52:0/449699644 wait complete. 2024-09-10T08:31:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.283+0000 7f4614400640 1 Processor -- start 2024-09-10T08:31:59.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.283+0000 7f4614400640 1 -- start start 2024-09-10T08:31:59.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 0x7f460c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f460c15be30 0x7f460c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f460c141a40 con 0x7f460c15c210 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1418c0 con 0x7f460c13f0a0 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4614400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f460c15c660 con 0x7f460c15be30 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4612400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4612400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40500/0 (socket says 172.21.15.52:40500) 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.284+0000 7f4612400640 1 -- 172.21.15.52:0/1754788853 learned_addr learned my addr 172.21.15.52:0/1754788853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4611000640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f460c15be30 0x7f460c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4611a00640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 0x7f460c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 -- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f460c15be30 msgr2=0x7f460c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f460c15be30 0x7f460c0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 -- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 msgr2=0x7f460c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 0x7f460c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 -- 172.21.15.52:0/1754788853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c1f5510 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4611a00640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 0x7f460c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4612400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f460400cbc0 tx=0x7f460400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4609600640 1 -- 172.21.15.52:0/1754788853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604017070 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4609600640 1 -- 172.21.15.52:0/1754788853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460400ad40 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4609600640 1 -- 172.21.15.52:0/1754788853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604012600 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.285+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c1429a0 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.286+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c1f4750 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.288+0000 7f4609600640 1 -- 172.21.15.52:0/1754788853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f460401a070 con 0x7f460c15c210 2024-09-10T08:31:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.288+0000 7f4609600640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 0x7f45ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.289+0000 7f4609600640 1 -- 172.21.15.52:0/1754788853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f460408aa60 con 0x7f460c15c210 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.289+0000 7f461744b740 1 Processor -- start 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.289+0000 7f4611a00640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 0x7f45ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.289+0000 7f461744b740 1 -- start start 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f4611a00640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 0x7f45ec06e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b9204aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 0x5562b91b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5562b91861c0 con 0x5562b91bcac0 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5562b91228e0 con 0x5562b91bf300 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5562b90ca720 con 0x5562b91c0a90 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f4611000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f4611000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40508/0 (socket says 172.21.15.52:40508) 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f4611000640 1 -- 172.21.15.52:0/4156903938 learned_addr learned my addr 172.21.15.52:0/4156903938 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.290+0000 7f4611a00640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b9204aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4612400640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 0x5562b91b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 -- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 msgr2=0x5562b91b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 0x5562b91b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 -- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 msgr2=0x5562b9204aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b9204aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 -- 172.21.15.52:0/4156903938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562b8f01b00 con 0x5562b91bcac0 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4612400640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 0x5562b91b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f4611000640 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f45f802a790 tx=0x7f45f802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad9b2e9c97df06f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f45fe000640 1 -- 172.21.15.52:0/4156903938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8043070 con 0x5562b91bcac0 2024-09-10T08:31:59.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f45fe000640 1 -- 172.21.15.52:0/4156903938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8032880 con 0x5562b91bcac0 2024-09-10T08:31:59.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.291+0000 7f45fe000640 1 -- 172.21.15.52:0/4156903938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8037040 con 0x5562b91bcac0 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 -- 172.21.15.52:0/4156903938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 msgr2=0x5562b91bf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f45f802a790 tx=0x7f45f802c000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 -- 172.21.15.52:0/4156903938 shutdown_connections 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91c0a90 0x5562b91b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bcac0 0x5562b91bf6e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 --2- 172.21.15.52:0/4156903938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b9204aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 -- 172.21.15.52:0/4156903938 >> 172.21.15.52:0/4156903938 conn(0x5562b91bbac0 msgr2=0x5562b9203f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 -- 172.21.15.52:0/4156903938 shutdown_connections 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.292+0000 7f461744b740 1 -- 172.21.15.52:0/4156903938 wait complete. 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.293+0000 7f461744b740 1 -- start start 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.293+0000 7f461744b740 1 Processor -- start 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b91de830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b9218110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5562b90ab7f0 con 0x5562b91c0a90 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5562b911e8a0 con 0x5562b91bf300 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5562b91baf60 con 0x5562b9214080 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f461744b740 10 client.0 _ll_register_callbacks cb 0x5562b90cf660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f4611000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f4611000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40520/0 (socket says 172.21.15.52:40520) 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f4611000640 1 -- 172.21.15.52:0/2827392590 learned_addr learned my addr 172.21.15.52:0/2827392590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f4612400640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b9218110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.294+0000 7f4611a00640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b91de830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 -- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 msgr2=0x5562b9218110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b9218110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 -- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 msgr2=0x5562b91de830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b91de830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 -- 172.21.15.52:0/2827392590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562b8df53f0 con 0x5562b91c0a90 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611a00640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b91de830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f4611000640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f45f80092a0 tx=0x7f45f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6bcde6cb887242 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f45f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8037040 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f8032880 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f45f8004240 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f45f8054050 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f461744b740 10 client.5778 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.295+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5562b8f62290 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f8032880 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f45f8057020 con 0x5562b91c0a90 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 10 client.5778 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 20 client.5778 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e5330 0x5562b91e5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 4 client.5778 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562b9130010 con 0x5562b91e5330 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.296+0000 7f4611a00640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e5330 0x5562b91e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.297+0000 7f4611a00640 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e5330 0x5562b91e5770 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddeb4ab68d42b206 server_cookie=740a0f4f30bfdac1 in_seq=0 out_seq=0 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.297+0000 7f45f2a00640 10 client.5778 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.297+0000 7f45f2a00640 1 -- 172.21.15.52:0/2827392590 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562b9130010 con 0x5562b91e5330 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.297+0000 7f45f2a00640 10 client.5778 handle_command_reply: tid=0 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 client.5778 shutdown 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 msgr2=0x5562b91e6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f45f80092a0 tx=0x7f45f8004730 comp rx=0 tx=0).stop 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 shutdown_connections 2024-09-10T08:31:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e5330 0x5562b91e5770 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b9218110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91c0a90 0x5562b91e6dc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 --2- 172.21.15.52:0/2827392590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91bf300 0x5562b91de830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 >> 172.21.15.52:0/2827392590 conn(0x5562b91bcac0 msgr2=0x5562b9201ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f45f2a00640 0 client.5778 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 shutdown_connections 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 1 -- 172.21.15.52:0/2827392590 wait complete. 2024-09-10T08:31:59.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.298+0000 7f461744b740 20 client.5778 trim_cache size 0 max 16384 2024-09-10T08:31:59.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.316+0000 7f461744b740 1 Processor -- start 2024-09-10T08:31:59.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.316+0000 7f461744b740 1 -- start start 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b91e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f460c200bc0 con 0x5562b91bf300 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1ffbc0 con 0x5562b91c0a90 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f460c1fef20 con 0x5562b9214080 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f4611a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f4611a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40532/0 (socket says 172.21.15.52:40532) 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.317+0000 7f4611a00640 1 -- 172.21.15.52:0/3017574338 learned_addr learned my addr 172.21.15.52:0/3017574338 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611000640 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4612400640 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b91e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 -- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 msgr2=0x5562b91e6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b91e6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 -- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 msgr2=0x5562b91de7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91de7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 -- 172.21.15.52:0/3017574338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562b91e8510 con 0x5562b91bf300 2024-09-10T08:31:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f4611a00640 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f460c1589d0 tx=0x7f4600015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e75d58cda58abb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f45fd600640 1 -- 172.21.15.52:0/3017574338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460001b040 con 0x5562b91bf300 2024-09-10T08:31:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f45fd600640 1 -- 172.21.15.52:0/3017574338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460001c040 con 0x5562b91bf300 2024-09-10T08:31:59.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.318+0000 7f45fd600640 1 -- 172.21.15.52:0/3017574338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600023840 con 0x5562b91bf300 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 -- 172.21.15.52:0/3017574338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 msgr2=0x5562b9206020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f460c1589d0 tx=0x7f4600015000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 -- 172.21.15.52:0/3017574338 shutdown_connections 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b9214080 0x5562b91e6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 --2- 172.21.15.52:0/3017574338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b91bf300 0x5562b9206020 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 -- 172.21.15.52:0/3017574338 >> 172.21.15.52:0/3017574338 conn(0x5562b91bcac0 msgr2=0x5562b91bb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 -- 172.21.15.52:0/3017574338 shutdown_connections 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.319+0000 7f461744b740 1 -- 172.21.15.52:0/3017574338 wait complete. 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.320+0000 7f461744b740 1 -- start start 2024-09-10T08:31:59.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.320+0000 7f461744b740 1 Processor -- start 2024-09-10T08:31:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 0x5562b9202450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1ff570 con 0x5562b9214080 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5562b91b8800 con 0x5562b91c0a90 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5562b91be5e0 con 0x5562b91bf300 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f461744b740 10 client.0 _ll_register_callbacks cb 0x7f45f8006c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40534/0 (socket says 172.21.15.52:40534) 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 -- 172.21.15.52:0/1337274237 learned_addr learned my addr 172.21.15.52:0/1337274237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4611a00640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 0x5562b9202450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4611000640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 -- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 msgr2=0x5562b9202450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 0x5562b9202450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 -- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 msgr2=0x5562b91bdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91bdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4612400640 1 -- 172.21.15.52:0/1337274237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562b8dce4b0 con 0x5562b9214080 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4611000640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91bdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.321+0000 7f4611a00640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 0x5562b9202450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f4612400640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f460400a930 tx=0x7f460405d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d561610082df6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604086030 con 0x5562b9214080 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f46040614f0 con 0x5562b9214080 2024-09-10T08:31:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460001c040 con 0x5562b9214080 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4604057210 con 0x5562b9214080 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 10 client.5784 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5562b91b9420 con 0x5562b9214080 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460001c040 con 0x5562b9214080 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4604004b60 con 0x5562b9214080 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 10 client.5784 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 10 client.5784 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 20 client.5784 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e30f0 0x5562b91e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 4 client.5784 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.322+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5562b912a360 con 0x5562b91e30f0 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.323+0000 7f4611a00640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e30f0 0x5562b91e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.323+0000 7f4611a00640 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e30f0 0x5562b91e3500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7680c8082797edc2 server_cookie=2a1e231318a98afe in_seq=0 out_seq=0 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.323+0000 7f45f2a00640 10 client.5784 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f45f2a00640 1 -- 172.21.15.52:0/1337274237 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5562b912a360 con 0x5562b91e30f0 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f45f2a00640 10 client.5784 handle_command_reply: tid=0 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 client.5784 shutdown 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 msgr2=0x5562b9281670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f460400a930 tx=0x7f460405d150 comp rx=0 tx=0).stop 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 shutdown_connections 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5562b91e30f0 0x5562b91e3500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5562b9214080 0x5562b9281670 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5562b91c0a90 0x5562b91bdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 --2- 172.21.15.52:0/1337274237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5562b91bf300 0x5562b9202450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f45f2a00640 0 client.5784 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 >> 172.21.15.52:0/1337274237 conn(0x5562b91bcac0 msgr2=0x5562b91dfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 shutdown_connections 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 1 -- 172.21.15.52:0/1337274237 wait complete. 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.324+0000 7f461744b740 20 client.5784 trim_cache size 0 max 16384 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "6a80eda2-60d0-45b1-8c86-e5dbfa45fb13", 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:59.330 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 msgr2=0x7f45ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 0x7f45ec06e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4600006fd0 tx=0x7f4600008040 comp rx=0 tx=0).stop 2024-09-10T08:31:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 msgr2=0x7f460c0b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f460400cbc0 tx=0x7f460400a430 comp rx=0 tx=0).stop 2024-09-10T08:31:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 shutdown_connections 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f45ec06be30 0x7f45ec06e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f460c15c210 0x7f460c0b5650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f460c15be30 0x7f460c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 --2- 172.21.15.52:0/1754788853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f460c13f0a0 0x7f460c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 >> 172.21.15.52:0/1754788853 conn(0x7f460c067fe0 msgr2=0x7f460c0727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 shutdown_connections 2024-09-10T08:31:59.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.325+0000 7f4614400640 1 -- 172.21.15.52:0/1754788853 wait complete. 2024-09-10T08:31:59.340 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '6a80eda2-60d0-45b1-8c86-e5dbfa45fb13', 'mode': 'asynchronous'}' 2024-09-10T08:31:59.341 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-10T08:31:59.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-10T08:31:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.499+0000 7f500b200640 1 Processor -- start 2024-09-10T08:31:59.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.500+0000 7f500b200640 1 -- start start 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f500b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50040cce30 0x7f50040cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f500b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50040714b0 con 0x7f50040732e0 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f500b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50040cd880 con 0x7f5004071c70 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f500b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f50040cdb60 con 0x7f50040cce30 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f5003e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50040732e0 0x7f50040736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33472/0 (socket says 172.21.15.52:33472) 2024-09-10T08:31:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f5003e00640 1 -- 172.21.15.52:0/4096127492 learned_addr learned my addr 172.21.15.52:0/4096127492 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:31:59.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/4096127492 >> v2:172.21.15.176:3300/0 conn(0x7f50040cce30 0x7f50040cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.501+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621738448 0 0) 0x7f50040714b0 con 0x7f50040732e0 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.502+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8003520 con 0x7f50040732e0 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.502+0000 7f4ffbe00640 1 -- 172.21.15.52:0/4096127492 >> v1:172.21.15.176:6789/0 conn(0x7f5004071c70 legacy=0x7f500415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.502+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4214504241 0 0) 0x7f4fe8003520 con 0x7f50040732e0 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.502+0000 7f4ffbe00640 1 -- 172.21.15.52:0/4096127492 >> v1:172.21.15.52:6789/0 conn(0x7f50040732e0 legacy=0x7f50040736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.502+0000 7f4ffbe00640 1 -- 172.21.15.52:0/4096127492 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040cde40 con 0x7f50040cce30 2024-09-10T08:31:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.503+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/4096127492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50040cce30 0x7f50040cd2a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9bb5d7ed104738a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.503+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f50040cce30 2024-09-10T08:31:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.503+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec02abc0 con 0x7f50040cce30 2024-09-10T08:31:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.503+0000 7f5003400640 1 -- 172.21.15.52:0/4096127492 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4001670 con 0x7f50040cce30 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 -- 172.21.15.52:0/4096127492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50040cce30 msgr2=0x7f50040cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 --2- 172.21.15.52:0/4096127492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50040cce30 0x7f50040cd2a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0097a0 tx=0x7f4fec02a130 comp rx=0 tx=0).stop 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 -- 172.21.15.52:0/4096127492 shutdown_connections 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 --2- 172.21.15.52:0/4096127492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50040cce30 0x7f50040cd2a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 -- 172.21.15.52:0/4096127492 >> 172.21.15.52:0/4096127492 conn(0x7f500406d0f0 msgr2=0x7f500406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 -- 172.21.15.52:0/4096127492 shutdown_connections 2024-09-10T08:31:59.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.504+0000 7f500b200640 1 -- 172.21.15.52:0/4096127492 wait complete. 2024-09-10T08:31:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.506+0000 7f500b200640 1 Processor -- start 2024-09-10T08:31:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.506+0000 7f500b200640 1 -- start start 2024-09-10T08:31:59.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5004071c70 0x7f50040b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50040732e0 0x7f50040cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f500415d160 con 0x7f50040cce30 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f500415cfe0 con 0x7f5004071c70 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f500b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f500415d2e0 con 0x7f50040732e0 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40542/0 (socket says 172.21.15.52:40542) 2024-09-10T08:31:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 -- 172.21.15.52:0/3170977537 learned_addr learned my addr 172.21.15.52:0/3170977537 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5003e00640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5004071c70 0x7f50040b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50040732e0 0x7f50040cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 -- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50040732e0 msgr2=0x7f50040cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50040732e0 0x7f50040cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 -- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5004071c70 msgr2=0x7f50040b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.507+0000 7f5009200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5004071c70 0x7f50040b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f5009200640 1 -- 172.21.15.52:0/3170977537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50041567f0 con 0x7f50040cce30 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f5009200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c6e0 tx=0x7f4ffc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f5000c00640 1 -- 172.21.15.52:0/3170977537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc003b70 con 0x7f50040cce30 2024-09-10T08:31:59.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f5000c00640 1 -- 172.21.15.52:0/3170977537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc003d30 con 0x7f50040cce30 2024-09-10T08:31:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f5000c00640 1 -- 172.21.15.52:0/3170977537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc005310 con 0x7f50040cce30 2024-09-10T08:31:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50040cef30 con 0x7f50040cce30 2024-09-10T08:31:59.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.508+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040cf4f0 con 0x7f50040cce30 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.510+0000 7f5000c00640 1 -- 172.21.15.52:0/3170977537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ffc0054b0 con 0x7f50040cce30 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.511+0000 7f5000c00640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.511+0000 7f5000c00640 1 -- 172.21.15.52:0/3170977537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4ffc08acb0 con 0x7f50040cce30 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.511+0000 7f5003e00640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.512+0000 7f500e0b5740 1 Processor -- start 2024-09-10T08:31:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.512+0000 7f500e0b5740 1 -- start start 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.512+0000 7f5003e00640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 0x7f4fe006e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4005880 tx=0x7f4ff4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.512+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfd27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfb2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f500e0b5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56408de71dc0 con 0x56408dfcfb80 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56408deeeb20 con 0x56408dfcffe0 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56408de96b00 con 0x56408dfd23c0 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40554/0 (socket says 172.21.15.52:40554) 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f5003e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfd27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 -- 172.21.15.52:0/3894289124 learned_addr learned my addr 172.21.15.52:0/3894289124 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f5009200640 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 -- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 msgr2=0x56408dfd27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfd27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 -- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 msgr2=0x56408dfb2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfb2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.513+0000 7f4ffbe00640 1 -- 172.21.15.52:0/3894289124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56408dccdf00 con 0x56408dfcfb80 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fec035040 tx=0x7f4fec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b113e9fce080dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f4ff8c00640 1 -- 172.21.15.52:0/3894289124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec041070 con 0x56408dfcfb80 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f4ff8c00640 1 -- 172.21.15.52:0/3894289124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec004040 con 0x56408dfcfb80 2024-09-10T08:31:59.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f4ff8c00640 1 -- 172.21.15.52:0/3894289124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037040 con 0x56408dfcfb80 2024-09-10T08:31:59.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f500e0b5740 1 -- 172.21.15.52:0/3894289124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 msgr2=0x56408dfd1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.514+0000 7f500e0b5740 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4fec035040 tx=0x7f4fec02c000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 -- 172.21.15.52:0/3894289124 shutdown_connections 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfb2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfcfb80 0x56408dfd1710 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 --2- 172.21.15.52:0/3894289124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfd27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 -- 172.21.15.52:0/3894289124 >> 172.21.15.52:0/3894289124 conn(0x56408df88020 msgr2=0x56408dfd0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 -- 172.21.15.52:0/3894289124 shutdown_connections 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 -- 172.21.15.52:0/3894289124 wait complete. 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.515+0000 7f500e0b5740 1 -- start start 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.516+0000 7f500e0b5740 1 Processor -- start 2024-09-10T08:31:59.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.516+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfc9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfa2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56408dea9d20 con 0x56408dfca4b0 2024-09-10T08:31:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56408deeaae0 con 0x56408dfcffe0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56408dfceae0 con 0x56408dfd23c0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f500e0b5740 10 client.0 _ll_register_callbacks cb 0x56408de9c180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40556/0 (socket says 172.21.15.52:40556) 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 -- 172.21.15.52:0/2037908639 learned_addr learned my addr 172.21.15.52:0/2037908639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfa2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5003e00640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfc9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 -- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 msgr2=0x56408dfa2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfa2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 -- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 msgr2=0x56408dfc9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfc9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 -- 172.21.15.52:0/2037908639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56408dbc17f0 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f5009200640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc01a000 tx=0x7f4ffc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4c2d32a9278f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.517+0000 7f4ff1600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0555c0 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4ffc082b30 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fec004040 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ffc055760 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 10 client.5796 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56408dd2e690 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc078020 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4ffc079050 con 0x56408dfca4b0 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 10 client.5796 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 20 client.5796 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfcd960 0x56408dfe0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 4 client.5796 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.518+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56408defc250 con 0x56408dfcd960 2024-09-10T08:31:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.519+0000 7f5003e00640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfcd960 0x56408dfe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.519+0000 7f5003e00640 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfcd960 0x56408dfe0080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f52a4acd82a8ffa server_cookie=663c36365d26feb8 in_seq=0 out_seq=0 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.519+0000 7f4ff1600640 10 client.5796 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f4ff1600640 1 -- 172.21.15.52:0/2037908639 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56408defc250 con 0x56408dfcd960 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f4ff1600640 10 client.5796 handle_command_reply: tid=0 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 client.5796 shutdown 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 msgr2=0x56408dfa3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc01a000 tx=0x7f4ffc011000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 shutdown_connections 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfcd960 0x56408dfe0080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfa3040 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfd23c0 0x56408dfa2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 --2- 172.21.15.52:0/2037908639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfcffe0 0x56408dfc9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 >> 172.21.15.52:0/2037908639 conn(0x56408dfcfb80 msgr2=0x56408dfd2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f4ff1600640 0 client.5796 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 shutdown_connections 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.520+0000 7f500e0b5740 1 -- 172.21.15.52:0/2037908639 wait complete. 2024-09-10T08:31:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.521+0000 7f500e0b5740 20 client.5796 trim_cache size 0 max 16384 2024-09-10T08:31:59.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.539+0000 7f500e0b5740 1 Processor -- start 2024-09-10T08:31:59.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.539+0000 7f500e0b5740 1 -- start start 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408e045ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfd23c0 0x56408dfc9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5004200c60 con 0x56408dfca4b0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50040ab2a0 con 0x56408dfd23c0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50040aa600 con 0x56408dfcffe0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40568/0 (socket says 172.21.15.52:40568) 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 -- 172.21.15.52:0/215010243 learned_addr learned my addr 172.21.15.52:0/215010243 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5009200640 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfd23c0 0x56408dfc9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408e045ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 -- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 msgr2=0x56408e045ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408e045ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 -- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfd23c0 msgr2=0x56408dfc9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfd23c0 0x56408dfc9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.540+0000 7f5003e00640 1 -- 172.21.15.52:0/215010243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56408dfa1a50 con 0x56408dfca4b0 2024-09-10T08:31:59.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f5003e00640 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x56408dfcdfe0 tx=0x7f4ff4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7eb476a4f919241 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f4ff3e00640 1 -- 172.21.15.52:0/215010243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4005db0 con 0x56408dfca4b0 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f4ff3e00640 1 -- 172.21.15.52:0/215010243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4007560 con 0x56408dfca4b0 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f4ff3e00640 1 -- 172.21.15.52:0/215010243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007710 con 0x56408dfca4b0 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f500e0b5740 1 -- 172.21.15.52:0/215010243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 msgr2=0x56408dfd03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.541+0000 7f500e0b5740 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x56408dfcdfe0 tx=0x7f4ff4012000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 -- 172.21.15.52:0/215010243 shutdown_connections 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfd23c0 0x56408dfc9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408e045ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 --2- 172.21.15.52:0/215010243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfca4b0 0x56408dfd03c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 -- 172.21.15.52:0/215010243 >> 172.21.15.52:0/215010243 conn(0x56408dfcfb80 msgr2=0x56408dfb3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 -- 172.21.15.52:0/215010243 shutdown_connections 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 -- 172.21.15.52:0/215010243 wait complete. 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 -- start start 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.542+0000 7f500e0b5740 1 Processor -- start 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfca4b0 0x56408e044b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408dfa2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50040aac50 con 0x56408dfd23c0 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56408dff4c20 con 0x56408dfca4b0 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56408e04f0f0 con 0x56408dfcffe0 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.543+0000 7f500e0b5740 10 client.0 _ll_register_callbacks cb 0x7f4ffc058b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40584/0 (socket says 172.21.15.52:40584) 2024-09-10T08:31:59.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 -- 172.21.15.52:0/390073375 learned_addr learned my addr 172.21.15.52:0/390073375 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5003e00640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfca4b0 0x56408e044b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f4ffbe00640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408dfa2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 -- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 msgr2=0x56408dfa2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408dfa2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 -- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfca4b0 msgr2=0x56408e044b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfca4b0 0x56408e044b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 -- 172.21.15.52:0/390073375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56408db9a8b0 con 0x56408dfd23c0 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f5009200640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc058ee0 tx=0x7f4ffc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3d0d71bb87fc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f4ff1600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.544+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc078030 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4ffc054eb0 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff4007560 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ffc0555c0 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 10 client.5802 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56408e04eef0 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4007560 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4ffc079070 con 0x56408dfd23c0 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 10 client.5802 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 10 client.5802 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 20 client.5802 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfb13e0 0x56408dff2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 4 client.5802 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-10T08:31:59.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x56408def65a0 con 0x56408dfb13e0 2024-09-10T08:31:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.545+0000 7f5003e00640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfb13e0 0x56408dff2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.546+0000 7f5003e00640 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfb13e0 0x56408dff2dd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5888c9cf96d0e5e4 server_cookie=1d1b48b26016ba9b in_seq=0 out_seq=0 2024-09-10T08:31:59.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.546+0000 7f4ff1600640 10 client.5802 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f4ff1600640 1 -- 172.21.15.52:0/390073375 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56408def65a0 con 0x56408dfb13e0 2024-09-10T08:31:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f4ff1600640 10 client.5802 handle_command_reply: tid=0 2024-09-10T08:31:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 client.5802 shutdown 2024-09-10T08:31:59.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 msgr2=0x56408dfa30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc058ee0 tx=0x7f4ffc001250 comp rx=0 tx=0).stop 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 shutdown_connections 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x56408dfb13e0 0x56408dff2dd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56408dfd23c0 0x56408dfa30d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56408dfcffe0 0x56408dfa2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 --2- 172.21.15.52:0/390073375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56408dfca4b0 0x56408e044b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f4ff1600640 0 client.5802 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 >> 172.21.15.52:0/390073375 conn(0x56408dfcfb80 msgr2=0x56408e045330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 shutdown_connections 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 1 -- 172.21.15.52:0/390073375 wait complete. 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.547+0000 7f500e0b5740 20 client.5802 trim_cache size 0 max 16384 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "51dd1128-dfa3-45da-bad7-6984cd13baf6", 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:59.554 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 msgr2=0x7f4fe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 0x7f4fe006e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4005880 tx=0x7f4ff4009040 comp rx=0 tx=0).stop 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 msgr2=0x7f5004155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c6e0 tx=0x7f4ffc00cba0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 shutdown_connections 2024-09-10T08:31:59.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50040cce30 0x7f5004155350 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50040732e0 0x7f50040cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 --2- 172.21.15.52:0/3170977537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5004071c70 0x7f50040b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 >> 172.21.15.52:0/3170977537 conn(0x7f500406d0f0 msgr2=0x7f50040cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 shutdown_connections 2024-09-10T08:31:59.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.548+0000 7f500b200640 1 -- 172.21.15.52:0/3170977537 wait complete. 2024-09-10T08:31:59.564 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '51dd1128-dfa3-45da-bad7-6984cd13baf6', 'mode': 'asynchronous'}' 2024-09-10T08:31:59.564 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-10T08:31:59.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-10T08:31:59.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.722+0000 7f5f09c00640 1 Processor -- start 2024-09-10T08:31:59.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.723+0000 7f5f09c00640 1 -- start start 2024-09-10T08:31:59.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f09c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040cce30 0x7f5f040cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f09c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f04071c70 0x7f5f04072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f09c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f040714b0 con 0x7f5f040732e0 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f09c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5f040cd880 con 0x7f5f04071c70 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f09c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040cdb60 con 0x7f5f040cce30 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f04071c70 0x7f5f04072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5f04071c70 0x7f5f04072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40588/0 (socket says 172.21.15.52:40588) 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 -- 172.21.15.52:0/3206537171 learned_addr learned my addr 172.21.15.52:0/3206537171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5efbe00640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040cce30 0x7f5f040cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 -- 172.21.15.52:0/3206537171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040cce30 msgr2=0x7f5f040cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040cce30 0x7f5f040cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 -- 172.21.15.52:0/3206537171 >> v1:172.21.15.176:6789/0 conn(0x7f5f040732e0 legacy=0x7f5f040736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.724+0000 7f5f03400640 1 -- 172.21.15.52:0/3206537171 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040cde40 con 0x7f5f04071c70 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.725+0000 7f5f03400640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f04072120 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc0e401ce705558 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f02000640 1 -- 172.21.15.52:0/3206537171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc036070 con 0x7f5f04071c70 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f02000640 1 -- 172.21.15.52:0/3206537171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc031600 con 0x7f5f04071c70 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f02000640 1 -- 172.21.15.52:0/3206537171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0319d0 con 0x7f5f04071c70 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 -- 172.21.15.52:0/3206537171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 msgr2=0x7f5f04072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f04072120 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02a630 comp rx=0 tx=0).stop 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 -- 172.21.15.52:0/3206537171 shutdown_connections 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f04072120 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 --2- 172.21.15.52:0/3206537171 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040cce30 0x7f5f040cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 -- 172.21.15.52:0/3206537171 >> 172.21.15.52:0/3206537171 conn(0x7f5f0406d0f0 msgr2=0x7f5f0406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.726+0000 7f5f09c00640 1 -- 172.21.15.52:0/3206537171 shutdown_connections 2024-09-10T08:31:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.727+0000 7f5f09c00640 1 -- 172.21.15.52:0/3206537171 wait complete. 2024-09-10T08:31:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.728+0000 7f5f09c00640 1 Processor -- start 2024-09-10T08:31:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.728+0000 7f5f09c00640 1 -- start start 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040732e0 0x7f5f040ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 0x7f5f040ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0415ca50 con 0x7f5f04071c70 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0415c8d0 con 0x7f5f040cce30 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.729+0000 7f5f09c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0415cbd0 con 0x7f5f040732e0 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40602/0 (socket says 172.21.15.52:40602) 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 -- 172.21.15.52:0/1433986786 learned_addr learned my addr 172.21.15.52:0/1433986786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5efbe00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040732e0 0x7f5f040ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f03400640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 0x7f5f040ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 -- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040732e0 msgr2=0x7f5f040ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040732e0 0x7f5f040ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 -- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 msgr2=0x7f5f040ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 0x7f5f040ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 -- 172.21.15.52:0/1433986786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f040ced40 con 0x7f5f04071c70 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f03400640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 0x7f5f040ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.730+0000 7f5f02a00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c410 tx=0x7f5ef400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.731+0000 7f5efaa00640 1 -- 172.21.15.52:0/1433986786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4017070 con 0x7f5f04071c70 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.731+0000 7f5efaa00640 1 -- 172.21.15.52:0/1433986786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef40035f0 con 0x7f5f04071c70 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.731+0000 7f5efaa00640 1 -- 172.21.15.52:0/1433986786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4003a20 con 0x7f5f04071c70 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.731+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f040cf020 con 0x7f5f04071c70 2024-09-10T08:31:59.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.731+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f040cf5e0 con 0x7f5f04071c70 2024-09-10T08:31:59.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.733+0000 7f5efaa00640 1 -- 172.21.15.52:0/1433986786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ef4003bc0 con 0x7f5f04071c70 2024-09-10T08:31:59.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.733+0000 7f5efaa00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 0x7f5ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.734+0000 7f5efaa00640 1 -- 172.21.15.52:0/1433986786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef408a120 con 0x7f5f04071c70 2024-09-10T08:31:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.734+0000 7f5efbe00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 0x7f5ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.734+0000 7f5f0ca5f740 1 Processor -- start 2024-09-10T08:31:59.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.734+0000 7f5f0ca5f740 1 -- start start 2024-09-10T08:31:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5efbe00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 0x7f5ee006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f0414f430 tx=0x7f5eec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a44230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611279628c0 con 0x5611279fc250 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56112790a820 con 0x5611279fea90 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56112795e880 con 0x561127a00220 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40618/0 (socket says 172.21.15.52:40618) 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5efbe00640 1 -- 172.21.15.52:0/2195873897 learned_addr learned my addr 172.21.15.52:0/2195873897 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.735+0000 7f5f03400640 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5f02a00640 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a44230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 -- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 msgr2=0x5611279f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 -- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 msgr2=0x561127a44230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a44230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 -- 172.21.15.52:0/2195873897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561127659280 con 0x5611279fc250 2024-09-10T08:31:59.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5efbe00640 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5eec011d60 tx=0x7f5eec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2bead27bdf0dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.736+0000 7f5ef3400640 1 -- 172.21.15.52:0/2195873897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec025070 con 0x5611279fc250 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5ef3400640 1 -- 172.21.15.52:0/2195873897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec01b070 con 0x5611279fc250 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5ef3400640 1 -- 172.21.15.52:0/2195873897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec014dd0 con 0x5611279fc250 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2195873897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 msgr2=0x5611279fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5eec011d60 tx=0x7f5eec014000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2195873897 shutdown_connections 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fc250 0x5611279fee70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2195873897 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a44230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2195873897 >> 172.21.15.52:0/2195873897 conn(0x5611279fb250 msgr2=0x561127a43700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2195873897 shutdown_connections 2024-09-10T08:31:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.737+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2195873897 wait complete. 2024-09-10T08:31:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.738+0000 7f5f0ca5f740 1 -- start start 2024-09-10T08:31:59.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.738+0000 7f5f0ca5f740 1 Processor -- start 2024-09-10T08:31:59.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a00220 0x561127a1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 0x561127a1fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611279fa6f0 con 0x5611279fea90 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56112791da40 con 0x561127a00220 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561127a44a60 con 0x561127a1f8a0 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f0ca5f740 10 client.0 _ll_register_callbacks cb 0x56112790f520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40630/0 (socket says 172.21.15.52:40630) 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.739+0000 7f5f02a00640 1 -- 172.21.15.52:0/280653926 learned_addr learned my addr 172.21.15.52:0/280653926 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f03400640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 0x561127a1fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5efbe00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a00220 0x561127a1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 -- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 msgr2=0x561127a1fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 0x561127a1fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 -- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a00220 msgr2=0x561127a1d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a00220 0x561127a1d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 -- 172.21.15.52:0/280653926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561127741690 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f03400640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 0x561127a1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f02a00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c3e0 tx=0x7f5ef4057ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7eff67c56b8d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4070020 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef40703c0 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eec01b070 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.740+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5ef40880d0 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 10 client.5814 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5611277a1e20 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec01b070 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5ef40578c0 con 0x5611279fea90 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 10 client.5814 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 20 client.5814 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5611279f87d0 0x5611279f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 4 client.5814 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56112796fff0 con 0x5611279f87d0 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.741+0000 7f5efbe00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5611279f87d0 0x5611279f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.742+0000 7f5efbe00640 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5611279f87d0 0x5611279f8bb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84358a399d37b447 server_cookie=6eec1e8de3e53912 in_seq=0 out_seq=0 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.742+0000 7f5ee7e00640 10 client.5814 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.742+0000 7f5ee7e00640 1 -- 172.21.15.52:0/280653926 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56112796fff0 con 0x5611279f87d0 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.742+0000 7f5ee7e00640 10 client.5814 handle_command_reply: tid=0 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.742+0000 7f5f0ca5f740 1 client.5814 shutdown 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 msgr2=0x5611279f9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c3e0 tx=0x7f5ef4057ec0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 shutdown_connections 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5611279f87d0 0x5611279f8bb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a1f8a0 0x561127a1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a00220 0x561127a1d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/280653926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x5611279f9bc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5ee7e00640 0 client.5814 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 >> 172.21.15.52:0/280653926 conn(0x5611279fc250 msgr2=0x561127a42ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 shutdown_connections 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/280653926 wait complete. 2024-09-10T08:31:59.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.743+0000 7f5f0ca5f740 20 client.5814 trim_cache size 0 max 16384 2024-09-10T08:31:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.761+0000 7f5f0ca5f740 1 Processor -- start 2024-09-10T08:31:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.761+0000 7f5f0ca5f740 1 -- start start 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a43df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f042050e0 con 0x561127a1f8a0 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04204100 con 0x5611279fea90 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.762+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5f04203500 con 0x561127a00220 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40638/0 (socket says 172.21.15.52:40638) 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 -- 172.21.15.52:0/2915556568 learned_addr learned my addr 172.21.15.52:0/2915556568 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5efbe00640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f02a00640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a43df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 -- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 msgr2=0x5611279f95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 -- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 msgr2=0x561127a43df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a43df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 -- 172.21.15.52:0/2915556568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611279faff0 con 0x561127a1f8a0 2024-09-10T08:31:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f02a00640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a43df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.763+0000 7f5f03400640 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad421088e3bb2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5ef2a00640 1 -- 172.21.15.52:0/2915556568 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc04a070 con 0x561127a1f8a0 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5ef2a00640 1 -- 172.21.15.52:0/2915556568 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc03c5e0 con 0x561127a1f8a0 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5ef2a00640 1 -- 172.21.15.52:0/2915556568 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc036040 con 0x561127a1f8a0 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2915556568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 msgr2=0x5611279f9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02e000 comp rx=0 tx=0).stop 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2915556568 shutdown_connections 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561127a1f8a0 0x5611279f9b10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x5611279f95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/2915556568 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5611279fea90 0x561127a43df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2915556568 >> 172.21.15.52:0/2915556568 conn(0x5611279fc250 msgr2=0x561127a24ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2915556568 shutdown_connections 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.764+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/2915556568 wait complete. 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.765+0000 7f5f0ca5f740 1 -- start start 2024-09-10T08:31:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.765+0000 7f5f0ca5f740 1 Processor -- start 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x561127ac1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a1f8a0 0x561127a24740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5611279fe8a0 con 0x5611279fea90 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f04203ab0 con 0x561127a1f8a0 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561127970720 con 0x561127a00220 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f0ca5f740 10 client.0 _ll_register_callbacks cb 0x7f5ef4058020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40642/0 (socket says 172.21.15.52:40642) 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5f02a00640 1 -- 172.21.15.52:0/924007795 learned_addr learned my addr 172.21.15.52:0/924007795 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:31:59.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.766+0000 7f5efbe00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x561127ac1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f03400640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a1f8a0 0x561127a24740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 -- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 msgr2=0x561127ac1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x561127ac1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 -- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a1f8a0 msgr2=0x561127a24740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a1f8a0 0x561127a24740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 -- 172.21.15.52:0/924007795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561127634f80 con 0x5611279fea90 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5efbe00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x561127ac1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f02a00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4058400 tx=0x7f5ef4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aae3042d90ea693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4070050 con 0x5611279fea90 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef40541c0 con 0x5611279fea90 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5efc03c5e0 con 0x5611279fea90 2024-09-10T08:31:59.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5ef407d050 con 0x5611279fea90 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f0ca5f740 10 client.5820 fetch_fsmap learned FSMap version 27 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.767+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561127a1d600 con 0x5611279fea90 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc03c5e0 con 0x5611279fea90 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5ef4080020 con 0x5611279fea90 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 10 client.5820 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 20 client.5820 populate_metadata read hostname 'smithi052' 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561127a68020 0x561127a24c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 4 client.5820 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x56112796a340 con 0x561127a68020 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5efbe00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561127a68020 0x561127a24c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5efbe00640 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561127a68020 0x561127a24c80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ecbc5eaed481a9 server_cookie=47cac0c4014154e5 in_seq=0 out_seq=0 2024-09-10T08:31:59.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.768+0000 7f5ee7e00640 10 client.5820 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5ee7e00640 1 -- 172.21.15.52:0/924007795 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56112796a340 con 0x561127a68020 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5ee7e00640 10 client.5820 handle_command_reply: tid=0 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 client.5820 shutdown 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 msgr2=0x561127a51e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4058400 tx=0x7f5ef4003eb0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 shutdown_connections 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561127a68020 0x561127a24c80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561127a1f8a0 0x561127a24740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561127a00220 0x561127ac1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5ee7e00640 0 client.5820 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 --2- 172.21.15.52:0/924007795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5611279fea90 0x561127a51e20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 >> 172.21.15.52:0/924007795 conn(0x5611279fc250 msgr2=0x561127a238b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 shutdown_connections 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 1 -- 172.21.15.52:0/924007795 wait complete. 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.769+0000 7f5f0ca5f740 20 client.5820 trim_cache size 0 max 16384 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b5fe3b64-d3f2-4ce2-bf90-b6bcb9997c12", 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:31:59.775 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 msgr2=0x7f5ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 0x7f5ee006e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f0414f430 tx=0x7f5eec009190 comp rx=0 tx=0).stop 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 msgr2=0x7f5f041528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c410 tx=0x7f5ef400c8d0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 shutdown_connections 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ee006be30 0x7f5ee006e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f040cce30 0x7f5f040ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5f040732e0 0x7f5f040ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 --2- 172.21.15.52:0/1433986786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f04071c70 0x7f5f041528d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:31:59.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 >> 172.21.15.52:0/1433986786 conn(0x7f5f0406d0f0 msgr2=0x7f5f0415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:31:59.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 shutdown_connections 2024-09-10T08:31:59.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:31:59.770+0000 7f5f09c00640 1 -- 172.21.15.52:0/1433986786 wait complete. 2024-09-10T08:31:59.785 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'b5fe3b64-d3f2-4ce2-bf90-b6bcb9997c12', 'mode': 'asynchronous'}' 2024-09-10T08:31:59.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:31:59.786 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-10T08:31:59.823 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-10T08:31:59.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-10T08:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.020+0000 7fea2ea00640 1 Processor -- start 2024-09-10T08:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.020+0000 7fea2ea00640 1 -- start start 2024-09-10T08:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fea280b5fd0 0x7fea280d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea280b7c10 0x7fea280b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2ea00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea280d3950 con 0x7fea280b63b0 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2ea00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fea280d3c30 con 0x7fea280b7c10 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2ea00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fea280d3f10 con 0x7fea280b5fd0 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.021+0000 7fea2e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea280b7c10 0x7fea280b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea280b7c10 0x7fea280b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40658/0 (socket says 172.21.15.52:40658) 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 -- 172.21.15.52:0/2028971835 learned_addr learned my addr 172.21.15.52:0/2028971835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2d600640 1 --2- 172.21.15.52:0/2028971835 >> v2:172.21.15.176:3300/0 conn(0x7fea280b5fd0 0x7fea280d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 -- 172.21.15.52:0/2028971835 >> v2:172.21.15.176:3300/0 conn(0x7fea280b5fd0 msgr2=0x7fea280d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 --2- 172.21.15.52:0/2028971835 >> v2:172.21.15.176:3300/0 conn(0x7fea280b5fd0 0x7fea280d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 -- 172.21.15.52:0/2028971835 >> v1:172.21.15.52:6789/0 conn(0x7fea280b63b0 legacy=0x7fea280cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea2e000640 1 -- 172.21.15.52:0/2028971835 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280d41f0 con 0x7fea280b7c10 2024-09-10T08:32:00.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.022+0000 7fea27e00640 1 -- 172.21.15.52:0/2028971835 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438574602 0 0) 0x7fea280d3950 con 0x7fea280b63b0 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.023+0000 7fea2e000640 1 --2- 172.21.15.52:0/2028971835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b7c10 0x7fea280b80a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fea280d5620 tx=0x7fea2002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ea5c09badb311d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.023+0000 7fea27e00640 1 -- 172.21.15.52:0/2028971835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20036070 con 0x7fea280b7c10 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.023+0000 7fea27e00640 1 -- 172.21.15.52:0/2028971835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20031600 con 0x7fea280b7c10 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.023+0000 7fea27e00640 1 -- 172.21.15.52:0/2028971835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea200319f0 con 0x7fea280b7c10 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 -- 172.21.15.52:0/2028971835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b7c10 msgr2=0x7fea280b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 --2- 172.21.15.52:0/2028971835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b7c10 0x7fea280b80a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fea280d5620 tx=0x7fea2002a7c0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 -- 172.21.15.52:0/2028971835 shutdown_connections 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 --2- 172.21.15.52:0/2028971835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b7c10 0x7fea280b80a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 --2- 172.21.15.52:0/2028971835 >> v2:172.21.15.176:3300/0 conn(0x7fea280b5fd0 0x7fea280d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 -- 172.21.15.52:0/2028971835 >> 172.21.15.52:0/2028971835 conn(0x7fea280d0fd0 msgr2=0x7fea280d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 -- 172.21.15.52:0/2028971835 shutdown_connections 2024-09-10T08:32:00.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.024+0000 7fea2ea00640 1 -- 172.21.15.52:0/2028971835 wait complete. 2024-09-10T08:32:00.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.025+0000 7fea2ea00640 1 Processor -- start 2024-09-10T08:32:00.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.026+0000 7fea2ea00640 1 -- start start 2024-09-10T08:32:00.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.026+0000 7fea2ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.026+0000 7fea2ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea280b63b0 0x7fea28160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 0x7fea28161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea280b6950 con 0x7fea280b5fd0 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea280b67d0 con 0x7fea280b7c10 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea2815e7f0 con 0x7fea280b63b0 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40666/0 (socket says 172.21.15.52:40666) 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 -- 172.21.15.52:0/1249636681 learned_addr learned my addr 172.21.15.52:0/1249636681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2cc00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea280b63b0 0x7fea28160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2e000640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 0x7fea28161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 -- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea280b63b0 msgr2=0x7fea28160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea280b63b0 0x7fea28160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 -- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 msgr2=0x7fea28161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 0x7fea28161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2d600640 1 -- 172.21.15.52:0/1249636681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280cd920 con 0x7fea280b5fd0 2024-09-10T08:32:00.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.027+0000 7fea2e000640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 0x7fea28161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea2d600640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00d5f0 tx=0x7fea1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea25600640 1 -- 172.21.15.52:0/1249636681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0125f0 con 0x7fea280b5fd0 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea25600640 1 -- 172.21.15.52:0/1249636681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1c019070 con 0x7fea280b5fd0 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea25600640 1 -- 172.21.15.52:0/1249636681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0129d0 con 0x7fea280b5fd0 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea280c8f30 con 0x7fea280b5fd0 2024-09-10T08:32:00.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.028+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea280c94f0 con 0x7fea280b5fd0 2024-09-10T08:32:00.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.030+0000 7fea25600640 1 -- 172.21.15.52:0/1249636681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea1c012b70 con 0x7fea280b5fd0 2024-09-10T08:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.032+0000 7fea25600640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 0x7fea0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.032+0000 7fea25600640 1 -- 172.21.15.52:0/1249636681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fea1c08b1c0 con 0x7fea280b5fd0 2024-09-10T08:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.032+0000 7fea32e89740 1 Processor -- start 2024-09-10T08:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.032+0000 7fea2cc00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 0x7fea0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.032+0000 7fea32e89740 1 -- start start 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea2cc00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 0x7fea0806e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada13aa0 0x5598ada59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada11260 0x5598ada13e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5598ad9765a0 con 0x5598ada15230 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5598ad91e6b0 con 0x5598ada13aa0 2024-09-10T08:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5598ad972560 con 0x5598ada11260 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40678/0 (socket says 172.21.15.52:40678) 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea2e000640 1 -- 172.21.15.52:0/4176376463 learned_addr learned my addr 172.21.15.52:0/4176376463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.033+0000 7fea2cc00640 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada11260 0x5598ada13e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2d600640 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada13aa0 0x5598ada59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 -- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada11260 msgr2=0x5598ada13e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada11260 0x5598ada13e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 -- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada13aa0 msgr2=0x5598ada59240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada13aa0 0x5598ada59240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 -- 172.21.15.52:0/4176376463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad940270 con 0x5598ada15230 2024-09-10T08:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea2e000640 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea2002adb0 tx=0x7fea2002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4e0ef95e3b5891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea19c00640 1 -- 172.21.15.52:0/4176376463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20036040 con 0x5598ada15230 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.034+0000 7fea19c00640 1 -- 172.21.15.52:0/4176376463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20031740 con 0x5598ada15230 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea19c00640 1 -- 172.21.15.52:0/4176376463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20031b10 con 0x5598ada15230 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 -- 172.21.15.52:0/4176376463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 msgr2=0x5598ada0e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fea2002adb0 tx=0x7fea2002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 -- 172.21.15.52:0/4176376463 shutdown_connections 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598ada0e090 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada11260 0x5598ada13e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 --2- 172.21.15.52:0/4176376463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada13aa0 0x5598ada59240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 -- 172.21.15.52:0/4176376463 >> 172.21.15.52:0/4176376463 conn(0x5598ada10260 msgr2=0x5598ada58710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 -- 172.21.15.52:0/4176376463 shutdown_connections 2024-09-10T08:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.035+0000 7fea32e89740 1 -- 172.21.15.52:0/4176376463 wait complete. 2024-09-10T08:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.036+0000 7fea32e89740 1 -- start start 2024-09-10T08:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.036+0000 7fea32e89740 1 Processor -- start 2024-09-10T08:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada34740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5598ada0f700 con 0x5598ada39b40 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5598ad8ff6b0 con 0x5598ada15230 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5598ada59a70 con 0x5598ada13aa0 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea32e89740 10 client.0 _ll_register_callbacks cb 0x5598ad929bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.037+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40688/0 (socket says 172.21.15.52:40688) 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 -- 172.21.15.52:0/3986472472 learned_addr learned my addr 172.21.15.52:0/3986472472 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2cc00640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2d600640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada34740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 -- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 msgr2=0x5598ada34740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada34740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 -- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 msgr2=0x5598ada6c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada6c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 -- 172.21.15.52:0/3986472472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ad915f60 con 0x5598ada39b40 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea2e000640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fea20003d00 tx=0x7fea20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0031f1e7a0b715 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea0e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20036070 con 0x5598ada39b40 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea20031740 con 0x5598ada39b40 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.038+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fea20031b00 con 0x5598ada39b40 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea20055050 con 0x5598ada39b40 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 10 client.5835 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5598ad6897b0 con 0x5598ada39b40 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20031740 con 0x5598ada39b40 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fea20058020 con 0x5598ada39b40 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 10 client.5835 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 10 client.5835 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 20 client.5835 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada33510 0x5598ada33920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 4 client.5835 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598ad9542d0 con 0x5598ada33510 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.039+0000 7fea2d600640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada33510 0x5598ada33920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.040+0000 7fea2d600640 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada33510 0x5598ada33920 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50035d9ad9e0b87a server_cookie=582b8539c1c291ce in_seq=0 out_seq=0 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.040+0000 7fea0e000640 10 client.5835 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea0e000640 1 -- 172.21.15.52:0/3986472472 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598ad9542d0 con 0x5598ada33510 2024-09-10T08:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea0e000640 10 client.5835 handle_command_reply: tid=0 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 client.5835 shutdown 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 msgr2=0x5598ada39fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fea20003d00 tx=0x7fea20004ab0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 shutdown_connections 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada33510 0x5598ada33920 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada39fc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada6c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 --2- 172.21.15.52:0/3986472472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada34740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea0e000640 0 client.5835 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 >> 172.21.15.52:0/3986472472 conn(0x5598ada11260 msgr2=0x5598ada566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 shutdown_connections 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 1 -- 172.21.15.52:0/3986472472 wait complete. 2024-09-10T08:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.041+0000 7fea32e89740 20 client.5835 trim_cache size 0 max 16384 2024-09-10T08:32:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.057+0000 7fea32e89740 1 Processor -- start 2024-09-10T08:32:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.057+0000 7fea32e89740 1 -- start start 2024-09-10T08:32:00.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.057+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada3a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea32e89740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea32e89740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea28200860 con 0x5598ada39b40 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea281f5410 con 0x5598ada15230 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea280cc230 con 0x5598ada13aa0 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40704/0 (socket says 172.21.15.52:40704) 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 -- 172.21.15.52:0/725749241 learned_addr learned my addr 172.21.15.52:0/725749241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2cc00640 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada3a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2d600640 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 -- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 msgr2=0x5598ada3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada3ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 -- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 msgr2=0x5598ada3a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada3a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.058+0000 7fea2e000640 1 -- 172.21.15.52:0/725749241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ad753b90 con 0x5598ada39b40 2024-09-10T08:32:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea2e000640 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea20009c00 tx=0x7fea20046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9243107a9c3699 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea19200640 1 -- 172.21.15.52:0/725749241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20031740 con 0x5598ada39b40 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea19200640 1 -- 172.21.15.52:0/725749241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20031b00 con 0x5598ada39b40 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea19200640 1 -- 172.21.15.52:0/725749241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20004040 con 0x5598ada39b40 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 -- 172.21.15.52:0/725749241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 msgr2=0x5598ada0ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea20009c00 tx=0x7fea20046000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 -- 172.21.15.52:0/725749241 shutdown_connections 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada39b40 0x5598ada0ecb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada15230 0x5598ada3a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 --2- 172.21.15.52:0/725749241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 -- 172.21.15.52:0/725749241 >> 172.21.15.52:0/725749241 conn(0x5598ada11260 msgr2=0x5598ada12d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 -- 172.21.15.52:0/725749241 shutdown_connections 2024-09-10T08:32:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.059+0000 7fea32e89740 1 -- 172.21.15.52:0/725749241 wait complete. 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.060+0000 7fea32e89740 1 -- start start 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.060+0000 7fea32e89740 1 Processor -- start 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada55940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada39b40 0x5598ada39130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5598ada35f60 con 0x5598ada15230 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea281f4dc0 con 0x5598ada39b40 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5598ad9ff6b0 con 0x5598ada13aa0 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea32e89740 10 client.0 _ll_register_callbacks cb 0x7fea1c055700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea2cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40712/0 (socket says 172.21.15.52:40712) 2024-09-10T08:32:00.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea2cc00640 1 -- 172.21.15.52:0/2696325780 learned_addr learned my addr 172.21.15.52:0/2696325780 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.061+0000 7fea2d600640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada55940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2e000640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada39b40 0x5598ada39130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 -- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 msgr2=0x5598ada55940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada55940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 -- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada39b40 msgr2=0x5598ada39130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada39b40 0x5598ada39130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 -- 172.21.15.52:0/2696325780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598ada3adb0 con 0x5598ada15230 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea2cc00640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fea14014a60 tx=0x7fea14001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c146c28c14053736 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea0e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14014e60 con 0x5598ada15230 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fea14021b00 con 0x5598ada15230 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.062+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea20031b00 con 0x5598ada15230 2024-09-10T08:32:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fea14033050 con 0x5598ada15230 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 10 client.5841 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5598ada7b960 con 0x5598ada15230 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20031b00 con 0x5598ada15230 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fea14036020 con 0x5598ada15230 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 10 client.5841 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 10 client.5841 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 20 client.5841 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada684a0 0x5598ada3b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 4 client.5841 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x5598ad983cd0 con 0x5598ada684a0 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.063+0000 7fea2d600640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada684a0 0x5598ada3b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.064+0000 7fea2d600640 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada684a0 0x5598ada3b480 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8bda0b0f02005f server_cookie=3aeb69107ed09001 in_seq=0 out_seq=0 2024-09-10T08:32:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.064+0000 7fea0e000640 10 client.5841 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea0e000640 1 -- 172.21.15.52:0/2696325780 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598ad983cd0 con 0x5598ada684a0 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea0e000640 10 client.5841 handle_command_reply: tid=0 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 client.5841 shutdown 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 msgr2=0x5598adad5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fea14014a60 tx=0x7fea14001080 comp rx=0 tx=0).stop 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 shutdown_connections 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5598ada684a0 0x5598ada3b480 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5598ada39b40 0x5598ada39130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5598ada15230 0x5598adad5ca0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea0e000640 0 client.5841 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 --2- 172.21.15.52:0/2696325780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5598ada13aa0 0x5598ada55940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.069+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 >> 172.21.15.52:0/2696325780 conn(0x5598ada11260 msgr2=0x5598ada7c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 shutdown_connections 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea32e89740 1 -- 172.21.15.52:0/2696325780 wait complete. 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea32e89740 20 client.5841 trim_cache size 0 max 16384 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:32:00.074 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:32:00.075 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 msgr2=0x7fea0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 0x7fea0806e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea14009040 comp rx=0 tx=0).stop 2024-09-10T08:32:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 msgr2=0x7fea280cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00d5f0 tx=0x7fea1c00dab0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.070+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 shutdown_connections 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea0806be60 0x7fea0806e320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea280b7c10 0x7fea28161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea280b63b0 0x7fea28160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 --2- 172.21.15.52:0/1249636681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea280b5fd0 0x7fea280cd3e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 >> 172.21.15.52:0/1249636681 conn(0x7fea280d0fd0 msgr2=0x7fea280b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 shutdown_connections 2024-09-10T08:32:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.071+0000 7fea2ea00640 1 -- 172.21.15.52:0/1249636681 wait complete. 2024-09-10T08:32:00.086 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:32:00.086 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:00.086 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:00.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:00.122 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-10T08:32:00.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:32:00.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:32:00.213 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153187 s, 68.5 MB/s 2024-09-10T08:32:00.215 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-10T08:32:00.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-10T08:32:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.375+0000 7fdca3200640 1 Processor -- start 2024-09-10T08:32:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.375+0000 7fdca3200640 1 -- start start 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.376+0000 7fdca3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 0x7fdc9c073a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.376+0000 7fdca3200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc9c0cf3b0 0x7fdc9c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.376+0000 7fdca3200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c15f650 con 0x7fdc9c073fa0 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.376+0000 7fdca3200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c0735d0 con 0x7fdc9c0cf3b0 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.376+0000 7fdca3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c15f930 con 0x7fdc9c15e650 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdc9c073fa0 0x7fdc9c0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33484/0 (socket says 172.21.15.52:33484) 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1400640 1 -- 172.21.15.52:0/3227983938 learned_addr learned my addr 172.21.15.52:0/3227983938 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3227983938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 0x7fdc9c073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca2800640 1 --2- 172.21.15.52:0/3227983938 >> v2:172.21.15.176:3300/0 conn(0x7fdc9c0cf3b0 0x7fdc9c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca0a00640 1 -- 172.21.15.52:0/3227983938 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267584813 0 0) 0x7fdc9c15f650 con 0x7fdc9c073fa0 2024-09-10T08:32:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca0a00640 1 -- 172.21.15.52:0/3227983938 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc84003520 con 0x7fdc9c073fa0 2024-09-10T08:32:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1e00640 1 -- 172.21.15.52:0/3227983938 >> v2:172.21.15.176:3300/0 conn(0x7fdc9c0cf3b0 msgr2=0x7fdc9c15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3227983938 >> v2:172.21.15.176:3300/0 conn(0x7fdc9c0cf3b0 0x7fdc9c15ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1e00640 1 -- 172.21.15.52:0/3227983938 >> v1:172.21.15.52:6789/0 conn(0x7fdc9c073fa0 legacy=0x7fdc9c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.377+0000 7fdca1e00640 1 -- 172.21.15.52:0/3227983938 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c072f80 con 0x7fdc9c15e650 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3227983938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 0x7fdc9c073a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc900097a0 tx=0x7fdc9002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84544cab639bfdb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca0a00640 1 -- 172.21.15.52:0/3227983938 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037070 con 0x7fdc9c15e650 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca0a00640 1 -- 172.21.15.52:0/3227983938 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9002ae40 con 0x7fdc9c15e650 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca0a00640 1 -- 172.21.15.52:0/3227983938 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90032660 con 0x7fdc9c15e650 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca3200640 1 -- 172.21.15.52:0/3227983938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 msgr2=0x7fdc9c073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.379+0000 7fdca3200640 1 --2- 172.21.15.52:0/3227983938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 0x7fdc9c073a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc900097a0 tx=0x7fdc9002a0f0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 -- 172.21.15.52:0/3227983938 shutdown_connections 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 --2- 172.21.15.52:0/3227983938 >> v2:172.21.15.176:3300/0 conn(0x7fdc9c0cf3b0 0x7fdc9c15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 --2- 172.21.15.52:0/3227983938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c15e650 0x7fdc9c073a60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 -- 172.21.15.52:0/3227983938 >> 172.21.15.52:0/3227983938 conn(0x7fdc9c0b40d0 msgr2=0x7fdc9c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 -- 172.21.15.52:0/3227983938 shutdown_connections 2024-09-10T08:32:00.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.380+0000 7fdca3200640 1 -- 172.21.15.52:0/3227983938 wait complete. 2024-09-10T08:32:00.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.381+0000 7fdca3200640 1 Processor -- start 2024-09-10T08:32:00.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.381+0000 7fdca3200640 1 -- start start 2024-09-10T08:32:00.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 0x7fdc9c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c15e650 0x7fdc9c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c15ef70 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c06f400 con 0x7fdc9c15e650 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.382+0000 7fdca3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c15f0f0 con 0x7fdc9c0cf3b0 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40718/0 (socket says 172.21.15.52:40718) 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 -- 172.21.15.52:0/908808656 learned_addr learned my addr 172.21.15.52:0/908808656 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca1e00640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 0x7fdc9c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca1400640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c15e650 0x7fdc9c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 -- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 msgr2=0x7fdc9c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 0x7fdc9c15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 -- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c15e650 msgr2=0x7fdc9c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c15e650 0x7fdc9c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca2800640 1 -- 172.21.15.52:0/908808656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c15c5b0 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.383+0000 7fdca1e00640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 0x7fdc9c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:00.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdca2800640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800efc0 tx=0x7fdc9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdc96000640 1 -- 172.21.15.52:0/908808656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98018020 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdc96000640 1 -- 172.21.15.52:0/908808656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc98014480 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdc96000640 1 -- 172.21.15.52:0/908808656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98014870 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c15c890 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.384+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c15ce50 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.386+0000 7fdc96000640 1 -- 172.21.15.52:0/908808656 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc98005d10 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.388+0000 7fdc96000640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.388+0000 7fdc96000640 1 -- 172.21.15.52:0/908808656 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdc9808bb40 con 0x7fdc9c0b5d50 2024-09-10T08:32:00.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.388+0000 7fdca1e00640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.388+0000 7fdca7839740 1 Processor -- start 2024-09-10T08:32:00.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 -- start start 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca1e00640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc90034000 tx=0x7fdc9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f09260 0x55ca79f0be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca79e6e5a0 con 0x55ca79f0baa0 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca79e166b0 con 0x55ca79f09260 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.389+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca79e6a560 con 0x55ca79f0d230 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40732/0 (socket says 172.21.15.52:40732) 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 -- 172.21.15.52:0/463057167 learned_addr learned my addr 172.21.15.52:0/463057167 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca2800640 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1400640 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f09260 0x55ca79f0be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 -- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 msgr2=0x55ca79f06090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f06090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 -- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f09260 msgr2=0x55ca79f0be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f09260 0x55ca79f0be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 -- 172.21.15.52:0/463057167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca79e38270 con 0x55ca79f0baa0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.390+0000 7fdca1e00640 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc9002a6e0 tx=0x7fdc9002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaba7943460d622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdc8a600640 1 -- 172.21.15.52:0/463057167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9004e070 con 0x55ca79f0baa0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdc8a600640 1 -- 172.21.15.52:0/463057167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9003c440 con 0x55ca79f0baa0 2024-09-10T08:32:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdc8a600640 1 -- 172.21.15.52:0/463057167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90037040 con 0x55ca79f0baa0 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 -- 172.21.15.52:0/463057167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 msgr2=0x55ca79f51240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc9002a6e0 tx=0x7fdc9002c000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 -- 172.21.15.52:0/463057167 shutdown_connections 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f06090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f09260 0x55ca79f0be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 --2- 172.21.15.52:0/463057167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f51240 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 -- 172.21.15.52:0/463057167 >> 172.21.15.52:0/463057167 conn(0x55ca79f08260 msgr2=0x55ca79f50710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.391+0000 7fdca7839740 1 -- 172.21.15.52:0/463057167 shutdown_connections 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.392+0000 7fdca7839740 1 -- 172.21.15.52:0/463057167 wait complete. 2024-09-10T08:32:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.392+0000 7fdca7839740 1 -- start start 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.392+0000 7fdca7839740 1 Processor -- start 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f4a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 0x55ca79f4d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca79f07700 con 0x55ca79f0baa0 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca79df76b0 con 0x55ca79f4d3c0 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca79f51a70 con 0x55ca79f0d230 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.393+0000 7fdca7839740 10 client.0 _ll_register_callbacks cb 0x55ca79e21bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40742/0 (socket says 172.21.15.52:40742) 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 -- 172.21.15.52:0/2335877451 learned_addr learned my addr 172.21.15.52:0/2335877451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1400640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f4a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca2800640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 0x55ca79f4d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 -- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 msgr2=0x55ca79f4a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f4a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 -- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 msgr2=0x55ca79f4d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 0x55ca79f4d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 -- 172.21.15.52:0/2335877451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca79e0df60 con 0x55ca79f0baa0 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca2800640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 0x55ca79f4d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdca1e00640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc90000c00 tx=0x7fdc90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b12b51866144001 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.394+0000 7fdc7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90059060 con 0x55ca79f0baa0 2024-09-10T08:32:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdc9003cc30 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc9003c440 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc9005f050 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 10 client.5853 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ca79b817b0 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9003c440 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdc90062020 con 0x55ca79f0baa0 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 10 client.5853 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 20 client.5853 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79f2e0d0 0x55ca79f4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 4 client.5853 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.395+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca79e4c2d0 con 0x55ca79f2e0d0 2024-09-10T08:32:00.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.396+0000 7fdca1400640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79f2e0d0 0x55ca79f4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.396+0000 7fdca1400640 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79f2e0d0 0x55ca79f4be50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c85cbf0b60cfb1 server_cookie=342b6cc1cd356ee4 in_seq=0 out_seq=0 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.396+0000 7fdc7ea00640 10 client.5853 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdc7ea00640 1 -- 172.21.15.52:0/2335877451 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca79e4c2d0 con 0x55ca79f2e0d0 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdc7ea00640 10 client.5853 handle_command_reply: tid=0 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 client.5853 shutdown 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 msgr2=0x55ca79f33fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdc90000c00 tx=0x7fdc90004730 comp rx=0 tx=0).stop 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 shutdown_connections 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79f2e0d0 0x55ca79f4be50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f4d3c0 0x55ca79f4d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0d230 0x55ca79f4a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 --2- 172.21.15.52:0/2335877451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f33fb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdc7ea00640 0 client.5853 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 >> 172.21.15.52:0/2335877451 conn(0x55ca79f09260 msgr2=0x55ca79f4f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 shutdown_connections 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 1 -- 172.21.15.52:0/2335877451 wait complete. 2024-09-10T08:32:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.397+0000 7fdca7839740 20 client.5853 trim_cache size 0 max 16384 2024-09-10T08:32:00.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.413+0000 7fdca7839740 1 Processor -- start 2024-09-10T08:32:00.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.413+0000 7fdca7839740 1 -- start start 2024-09-10T08:32:00.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f0a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f4d3c0 0x55ca79f4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c2007c0 con 0x55ca79f0baa0 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c1ff7c0 con 0x55ca79f0d230 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c1fed30 con 0x55ca79f4d3c0 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40754/0 (socket says 172.21.15.52:40754) 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 -- 172.21.15.52:0/891022585 learned_addr learned my addr 172.21.15.52:0/891022585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 -- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f4d3c0 msgr2=0x55ca79f4be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f4d3c0 0x55ca79f4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 -- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 msgr2=0x55ca79f0a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f0a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.414+0000 7fdca1e00640 1 -- 172.21.15.52:0/891022585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca79c4bb90 con 0x55ca79f0baa0 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdca1e00640 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003cf70 tx=0x7fdc90040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab930c55d9af3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdc89c00640 1 -- 172.21.15.52:0/891022585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9004e030 con 0x55ca79f0baa0 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdc89c00640 1 -- 172.21.15.52:0/891022585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90050050 con 0x55ca79f0baa0 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdc89c00640 1 -- 172.21.15.52:0/891022585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90054680 con 0x55ca79f0baa0 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdca7839740 1 -- 172.21.15.52:0/891022585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 msgr2=0x55ca79f0a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.415+0000 7fdca7839740 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdc9003cf70 tx=0x7fdc90040000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 -- 172.21.15.52:0/891022585 shutdown_connections 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f4d3c0 0x55ca79f4be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f0a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 --2- 172.21.15.52:0/891022585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f0baa0 0x55ca79f0a130 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 -- 172.21.15.52:0/891022585 >> 172.21.15.52:0/891022585 conn(0x55ca79f09260 msgr2=0x55ca79f4f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 -- 172.21.15.52:0/891022585 shutdown_connections 2024-09-10T08:32:00.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 -- 172.21.15.52:0/891022585 wait complete. 2024-09-10T08:32:00.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 -- start start 2024-09-10T08:32:00.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.416+0000 7fdca7839740 1 Processor -- start 2024-09-10T08:32:00.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0baa0 0x55ca79f5fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f62f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c1ff1d0 con 0x55ca79f4d3c0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca79f4fee0 con 0x55ca79f0d230 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.417+0000 7fdca7839740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca79f63ac0 con 0x55ca79f0baa0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca7839740 10 client.0 _ll_register_callbacks cb 0x7fdc9004c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40764/0 (socket says 172.21.15.52:40764) 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 -- 172.21.15.52:0/3958890121 learned_addr learned my addr 172.21.15.52:0/3958890121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0baa0 0x55ca79f5fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca1400640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f62f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 -- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0baa0 msgr2=0x55ca79f5fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0baa0 0x55ca79f5fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 -- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 msgr2=0x55ca79f62f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f62f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 -- 172.21.15.52:0/3958890121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca79f75420 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca1400640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f62f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdca2800640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c990 tx=0x7fdc9805e250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6949048cce2fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.418+0000 7fdc7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98087070 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdc980592e0 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc90050050 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc98059500 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 10 client.5859 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ca79f60100 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90050050 con 0x55ca79f4d3c0 2024-09-10T08:32:00.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdc98060390 con 0x55ca79f4d3c0 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 10 client.5859 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 20 client.5859 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79fce840 0x55ca79f4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 4 client.5859 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55ca79e7bcd0 con 0x55ca79fce840 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.419+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79fce840 0x55ca79f4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.420+0000 7fdca1e00640 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79fce840 0x55ca79f4be50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72ebdf01eb4e3ab4 server_cookie=6cb2a362554059b7 in_seq=0 out_seq=0 2024-09-10T08:32:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.420+0000 7fdc7ea00640 10 client.5859 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdc7ea00640 1 -- 172.21.15.52:0/3958890121 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca79e7bcd0 con 0x55ca79fce840 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdc7ea00640 10 client.5859 handle_command_reply: tid=0 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 client.5859 shutdown 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 msgr2=0x55ca79fce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c990 tx=0x7fdc9805e250 comp rx=0 tx=0).stop 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 shutdown_connections 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55ca79fce840 0x55ca79f4be50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca79f4d3c0 0x55ca79fce300 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca79f0d230 0x55ca79f62f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 --2- 172.21.15.52:0/3958890121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca79f0baa0 0x55ca79f5fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdc7ea00640 0 client.5859 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.425+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 >> 172.21.15.52:0/3958890121 conn(0x55ca79f09260 msgr2=0x55ca79f4e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 shutdown_connections 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca7839740 1 -- 172.21.15.52:0/3958890121 wait complete. 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca7839740 20 client.5859 trim_cache size 0 max 16384 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:32:00.427 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:00.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 msgr2=0x7fdc8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 0x7fdc8006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc90034000 tx=0x7fdc9002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 msgr2=0x7fdc9c0aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800efc0 tx=0x7fdc9800c490 comp rx=0 tx=0).stop 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 shutdown_connections 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc8006be30 0x7fdc8006e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc9c0b5d50 0x7fdc9c0aa460 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc9c15e650 0x7fdc9c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 --2- 172.21.15.52:0/908808656 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc9c0cf3b0 0x7fdc9c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.426+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 >> 172.21.15.52:0/908808656 conn(0x7fdc9c0b40d0 msgr2=0x7fdc9c160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.427+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 shutdown_connections 2024-09-10T08:32:00.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.427+0000 7fdca3200640 1 -- 172.21.15.52:0/908808656 wait complete. 2024-09-10T08:32:00.441 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-10T08:32:00.442 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:32:00.542 INFO:teuthology.orchestra.run.smithi052.stdout:1099511630414 2024-09-10T08:32:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:32:00.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T08:32:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.752+0000 7fdb1ac00640 1 Processor -- start 2024-09-10T08:32:00.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.753+0000 7fdb1ac00640 1 -- start start 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb1ac00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb140cce30 0x7fdb140cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb1ac00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 0x7fdb140720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb1ac00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb140714b0 con 0x7fdb140732e0 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb1ac00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb140cd880 con 0x7fdb140cce30 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb1ac00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdb140cdb60 con 0x7fdb14071c70 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb13e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdb140732e0 0x7fdb140736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33488/0 (socket says 172.21.15.52:33488) 2024-09-10T08:32:00.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb13e00640 1 -- 172.21.15.52:0/1212974404 learned_addr learned my addr 172.21.15.52:0/1212974404 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:00.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb0b400640 1 --2- 172.21.15.52:0/1212974404 >> v2:172.21.15.52:3300/0 conn(0x7fdb140cce30 0x7fdb140cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.754+0000 7fdb13400640 1 -- 172.21.15.52:0/1212974404 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349441016 0 0) 0x7fdb140714b0 con 0x7fdb140732e0 2024-09-10T08:32:00.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb0b400640 1 -- 172.21.15.52:0/1212974404 >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 msgr2=0x7fdb140720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb18c00640 1 --2- 172.21.15.52:0/1212974404 >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 0x7fdb140720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb0b400640 1 --2- 172.21.15.52:0/1212974404 >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 0x7fdb140720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb0b400640 1 -- 172.21.15.52:0/1212974404 >> v1:172.21.15.52:6789/0 conn(0x7fdb140732e0 legacy=0x7fdb140736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb0b400640 1 -- 172.21.15.52:0/1212974404 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb140cde40 con 0x7fdb140cce30 2024-09-10T08:32:00.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.755+0000 7fdb18c00640 1 --2- 172.21.15.52:0/1212974404 >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 0x7fdb140720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb0b400640 1 --2- 172.21.15.52:0/1212974404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb140cd2a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb14074330 tx=0x7fdafc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102b1651b8e07a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb13400640 1 -- 172.21.15.52:0/1212974404 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037070 con 0x7fdb140cce30 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb13400640 1 -- 172.21.15.52:0/1212974404 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc032440 con 0x7fdb140cce30 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb13400640 1 -- 172.21.15.52:0/1212974404 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc02ae60 con 0x7fdb140cce30 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1212974404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 msgr2=0x7fdb140cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.756+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1212974404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb140cd2a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb14074330 tx=0x7fdafc02a110 comp rx=0 tx=0).stop 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1212974404 shutdown_connections 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1212974404 >> v2:172.21.15.176:3300/0 conn(0x7fdb14071c70 0x7fdb140720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1212974404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb140cd2a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1212974404 >> 172.21.15.52:0/1212974404 conn(0x7fdb1406d0f0 msgr2=0x7fdb1406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1212974404 shutdown_connections 2024-09-10T08:32:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.757+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1212974404 wait complete. 2024-09-10T08:32:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.758+0000 7fdb1ac00640 1 Processor -- start 2024-09-10T08:32:00.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.758+0000 7fdb1ac00640 1 -- start start 2024-09-10T08:32:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb14071c70 0x7fdb141e9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140732e0 0x7fdb141e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1415ca50 con 0x7fdb140cce30 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1415c8d0 con 0x7fdb14071c70 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.759+0000 7fdb1ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1415cbd0 con 0x7fdb140732e0 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40776/0 (socket says 172.21.15.52:40776) 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 -- 172.21.15.52:0/1177466372 learned_addr learned my addr 172.21.15.52:0/1177466372 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb13e00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb14071c70 0x7fdb141e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb0b400640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140732e0 0x7fdb141e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 -- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140732e0 msgr2=0x7fdb141e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140732e0 0x7fdb141e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 -- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb14071c70 msgr2=0x7fdb141e9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb14071c70 0x7fdb141e9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 -- 172.21.15.52:0/1177466372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb141e8680 con 0x7fdb140cce30 2024-09-10T08:32:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.760+0000 7fdb18c00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00cf20 tx=0x7fdb0c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.761+0000 7fdb10c00640 1 -- 172.21.15.52:0/1177466372 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c01a070 con 0x7fdb140cce30 2024-09-10T08:32:00.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.761+0000 7fdb10c00640 1 -- 172.21.15.52:0/1177466372 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00d840 con 0x7fdb140cce30 2024-09-10T08:32:00.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.761+0000 7fdb10c00640 1 -- 172.21.15.52:0/1177466372 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00dc30 con 0x7fdb140cce30 2024-09-10T08:32:00.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.761+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb141e8960 con 0x7fdb140cce30 2024-09-10T08:32:00.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.761+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141e8f20 con 0x7fdb140cce30 2024-09-10T08:32:00.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.763+0000 7fdb10c00640 1 -- 172.21.15.52:0/1177466372 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb0c01d070 con 0x7fdb140cce30 2024-09-10T08:32:00.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.764+0000 7fdb10c00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.764+0000 7fdb10c00640 1 -- 172.21.15.52:0/1177466372 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdb0c08b700 con 0x7fdb140cce30 2024-09-10T08:32:00.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.764+0000 7fdb13e00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.764+0000 7fdb1dbc6740 1 Processor -- start 2024-09-10T08:32:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.765+0000 7fdb1dbc6740 1 -- start start 2024-09-10T08:32:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.765+0000 7fdb13e00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 0x7fdaf006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb04000f60 tx=0x7fdb04007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.765+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed36040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e0aec72490 con 0x55e0aed53880 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e0aec1a690 con 0x55e0aed53ce0 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e0aec6e450 con 0x55e0aed560c0 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40780/0 (socket says 172.21.15.52:40780) 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 -- 172.21.15.52:0/581828353 learned_addr learned my addr 172.21.15.52:0/581828353 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb13e00640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb18c00640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed36040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 -- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 msgr2=0x55e0aed564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 -- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 msgr2=0x55e0aed36040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed36040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb0b400640 1 -- 172.21.15.52:0/581828353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aec21e00 con 0x55e0aed53880 2024-09-10T08:32:00.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.766+0000 7fdb18c00640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed36040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:00.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb0b400640 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009890 tx=0x7fdafc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab31903459214978 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb03e00640 1 -- 172.21.15.52:0/581828353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037040 con 0x55e0aed53880 2024-09-10T08:32:00.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb03e00640 1 -- 172.21.15.52:0/581828353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc032900 con 0x55e0aed53880 2024-09-10T08:32:00.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb03e00640 1 -- 172.21.15.52:0/581828353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc032cd0 con 0x55e0aed53880 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/581828353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 msgr2=0x55e0aed55410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.767+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009890 tx=0x7fdafc02c000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/581828353 shutdown_connections 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed36040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed53880 0x55e0aed55410 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/581828353 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/581828353 >> 172.21.15.52:0/581828353 conn(0x55e0aed0bd20 msgr2=0x55e0aed54130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/581828353 shutdown_connections 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/581828353 wait complete. 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.768+0000 7fdb1dbc6740 1 -- start start 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.769+0000 7fdb1dbc6740 1 Processor -- start 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.769+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed4dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.769+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed4b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.769+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e0aed527e0 con 0x55e0aed68320 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e0aec2d950 con 0x55e0aed53ce0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e0aed52ac0 con 0x55e0aed560c0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb1dbc6740 10 client.0 _ll_register_callbacks cb 0x55e0aebf94d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40788/0 (socket says 172.21.15.52:40788) 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 -- 172.21.15.52:0/3477978380 learned_addr learned my addr 172.21.15.52:0/3477978380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb0b400640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed4b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed4dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 -- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 msgr2=0x55e0aed4b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed4b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 -- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 msgr2=0x55e0aed4dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed4dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb18c00640 1 -- 172.21.15.52:0/3477978380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aec26f40 con 0x55e0aed68320 2024-09-10T08:32:00.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.770+0000 7fdb0b400640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed4b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:00.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb18c00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c089b00 tx=0x7fdb0c059b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642e56d22bd43db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c062060 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdb0c062200 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdafc032900 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdb0c058e10 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb1dbc6740 10 client.5874 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55e0ae9853f0 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc032900 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.771+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdb0c058fb0 con 0x55e0aed68320 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 10 client.5874 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 20 client.5874 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed39d70 0x55e0aed67780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 4 client.5874 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0aec7fbc0 con 0x55e0aed39d70 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed39d70 0x55e0aed67780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed39d70 0x55e0aed67780 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a663dd33354777 server_cookie=28895155fc5131bd in_seq=0 out_seq=0 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.772+0000 7fdb00c00640 10 client.5874 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb00c00640 1 -- 172.21.15.52:0/3477978380 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0aec7fbc0 con 0x55e0aed39d70 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb00c00640 10 client.5874 handle_command_reply: tid=0 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 client.5874 shutdown 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 msgr2=0x55e0aed34a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c089b00 tx=0x7fdb0c059b00 comp rx=0 tx=0).stop 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 shutdown_connections 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed39d70 0x55e0aed67780 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed34a20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed560c0 0x55e0aed4b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3477978380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed4dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 >> 172.21.15.52:0/3477978380 conn(0x55e0aed53880 msgr2=0x55e0aed56a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.773+0000 7fdb00c00640 0 client.5874 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.774+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 shutdown_connections 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.774+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3477978380 wait complete. 2024-09-10T08:32:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.774+0000 7fdb1dbc6740 20 client.5874 trim_cache size 0 max 16384 2024-09-10T08:32:00.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.787+0000 7fdb1dbc6740 1 Processor -- start 2024-09-10T08:32:00.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 -- start start 2024-09-10T08:32:00.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed53ce0 0x55e0aed64f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed54620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb142009d0 con 0x55e0aed68320 2024-09-10T08:32:00.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb141ffa30 con 0x55e0aed560c0 2024-09-10T08:32:00.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.788+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb141fed90 con 0x55e0aed53ce0 2024-09-10T08:32:00.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed54620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:54102/0 (socket says 172.21.15.52:54102) 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb13e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed53ce0 0x55e0aed64f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb0b400640 1 -- 172.21.15.52:0/2829469815 learned_addr learned my addr 172.21.15.52:0/2829469815 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 -- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed53ce0 msgr2=0x55e0aed64f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed53ce0 0x55e0aed64f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 -- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 msgr2=0x55e0aed540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 -- 172.21.15.52:0/2829469815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aea4f7d0 con 0x55e0aed68320 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb0b400640 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.789+0000 7fdb18c00640 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed54620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00acd0 tx=0x7fdb0c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da208460b1275746 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb03400640 1 -- 172.21.15.52:0/2829469815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c058fb0 con 0x55e0aed68320 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb03400640 1 -- 172.21.15.52:0/2829469815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c076070 con 0x55e0aed68320 2024-09-10T08:32:00.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb03400640 1 -- 172.21.15.52:0/2829469815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c062060 con 0x55e0aed68320 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/2829469815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 msgr2=0x55e0aed54620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed54620 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00acd0 tx=0x7fdb0c021000 comp rx=0 tx=0).stop 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/2829469815 shutdown_connections 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed68320 0x55e0aed54620 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed560c0 0x55e0aed540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/2829469815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed53ce0 0x55e0aed64f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/2829469815 >> 172.21.15.52:0/2829469815 conn(0x55e0aed53880 msgr2=0x55e0aed04d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/2829469815 shutdown_connections 2024-09-10T08:32:00.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.790+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/2829469815 wait complete. 2024-09-10T08:32:00.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.791+0000 7fdb1dbc6740 1 -- start start 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.791+0000 7fdb1dbc6740 1 Processor -- start 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed542d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed68320 0x55e0aedbb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e0aed0e5a0 con 0x55e0aed560c0 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb141ff3e0 con 0x55e0aed53ce0 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e0aed0ced0 con 0x55e0aed68320 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb1dbc6740 10 client.0 _ll_register_callbacks cb 0x7fdafc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40796/0 (socket says 172.21.15.52:40796) 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.792+0000 7fdb0b400640 1 -- 172.21.15.52:0/3539359802 learned_addr learned my addr 172.21.15.52:0/3539359802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb18c00640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed68320 0x55e0aedbb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 -- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed68320 msgr2=0x55e0aedbb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed68320 0x55e0aedbb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 -- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 msgr2=0x55e0aed542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 -- 172.21.15.52:0/3539359802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aed51b00 con 0x55e0aed560c0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb0b400640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009860 tx=0x7fdafc02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8bd7d37bde5cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb00c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037040 con 0x55e0aed560c0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdafc003810 con 0x55e0aed560c0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb0c076070 con 0x55e0aed560c0 2024-09-10T08:32:00.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdafc054050 con 0x55e0aed560c0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb1dbc6740 10 client.5880 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.793+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55e0aed4d9a0 con 0x55e0aed560c0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0c076070 con 0x55e0aed560c0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdafc057020 con 0x55e0aed560c0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 10 client.5880 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 10 client.5880 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 20 client.5880 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed54810 0x55e0aedd2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 4 client.5880 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0aed38870 con 0x55e0aed54810 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.794+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed54810 0x55e0aedd2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb13e00640 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed54810 0x55e0aedd2130 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94cbda4b53a4207f server_cookie=8220310e966aeab6 in_seq=0 out_seq=0 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb00c00640 10 client.5880 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb00c00640 1 -- 172.21.15.52:0/3539359802 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0aed38870 con 0x55e0aed54810 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb00c00640 10 client.5880 handle_command_reply: tid=0 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 client.5880 shutdown 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 msgr2=0x55e0aedbb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009860 tx=0x7fdafc02c070 comp rx=0 tx=0).stop 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 shutdown_connections 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55e0aed54810 0x55e0aedd2130 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e0aed68320 0x55e0aedbb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e0aed560c0 0x55e0aedbb110 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 --2- 172.21.15.52:0/3539359802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e0aed53ce0 0x55e0aed542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 >> 172.21.15.52:0/3539359802 conn(0x55e0aed53880 msgr2=0x55e0aed0f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb00c00640 0 client.5880 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 shutdown_connections 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 1 -- 172.21.15.52:0/3539359802 wait complete. 2024-09-10T08:32:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.795+0000 7fdb1dbc6740 20 client.5880 trim_cache size 0 max 16384 2024-09-10T08:32:00.800 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 msgr2=0x7fdaf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 0x7fdaf006e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb04000f60 tx=0x7fdb04007d50 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 msgr2=0x7fdb1414ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00cf20 tx=0x7fdb0c00a7d0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 shutdown_connections 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdaf006be30 0x7fdaf006e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb140cce30 0x7fdb1414ba20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb140732e0 0x7fdb141e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 --2- 172.21.15.52:0/1177466372 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb14071c70 0x7fdb141e9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 >> 172.21.15.52:0/1177466372 conn(0x7fdb1406d0f0 msgr2=0x7fdb1415efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 shutdown_connections 2024-09-10T08:32:00.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.796+0000 7fdb1ac00640 1 -- 172.21.15.52:0/1177466372 wait complete. 2024-09-10T08:32:00.811 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4e.00000000 parent 2024-09-10T08:32:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 Processor -- start 2024-09-10T08:32:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 -- start start 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a240c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a2cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56289a10db30 con 0x56289a199990 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56289a111b70 con 0x56289a165a50 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.888+0000 7f657c9eef40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56289a198b60 con 0x56289a1aea40 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40812/0 (socket says 172.21.15.52:40812) 2024-09-10T08:32:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 -- 172.21.15.52:0/4203509530 learned_addr learned my addr 172.21.15.52:0/4203509530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579c00640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a240c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f657a600640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a2cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 -- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 msgr2=0x56289a2cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a2cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 -- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 msgr2=0x56289a240c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a240c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 -- 172.21.15.52:0/4203509530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289a2cc9d0 con 0x56289a199990 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f657a600640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a2cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.889+0000 7f6579200640 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f656800b320 tx=0x7f656800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955134cdb7811241 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f6573400640 1 -- 172.21.15.52:0/4203509530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568012020 con 0x56289a199990 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f6573400640 1 -- 172.21.15.52:0/4203509530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656800d690 con 0x56289a199990 2024-09-10T08:32:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f6573400640 1 -- 172.21.15.52:0/4203509530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656800da60 con 0x56289a199990 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 -- 172.21.15.52:0/4203509530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 msgr2=0x56289a1981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f656800b320 tx=0x7f656800b7e0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 -- 172.21.15.52:0/4203509530 shutdown_connections 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a2cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1981a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 --2- 172.21.15.52:0/4203509530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a240c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 -- 172.21.15.52:0/4203509530 >> 172.21.15.52:0/4203509530 conn(0x56289a1964f0 msgr2=0x56289a1b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 -- 172.21.15.52:0/4203509530 shutdown_connections 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.890+0000 7f657c9eef40 1 -- 172.21.15.52:0/4203509530 wait complete. 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.891+0000 7f657c9eef40 1 Processor -- start 2024-09-10T08:32:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.891+0000 7f657c9eef40 1 -- start start 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a195170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a1aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56289a237f40 con 0x56289a199990 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56289a237c60 con 0x56289a165a50 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f657c9eef40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56289a198db0 con 0x56289a1aea40 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f6579200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f6579200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40824/0 (socket says 172.21.15.52:40824) 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.892+0000 7f6579200640 1 -- 172.21.15.52:0/3218491135 learned_addr learned my addr 172.21.15.52:0/3218491135 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 -- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 msgr2=0x56289a1aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56289a1aea40 0x56289a1aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 -- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 msgr2=0x56289a195170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56289a165a50 0x56289a195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 -- 172.21.15.52:0/3218491135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289a1ac150 con 0x56289a199990 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6579200640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1aa200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6568011040 tx=0x7f6568000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6572000640 1 -- 172.21.15.52:0/3218491135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568012030 con 0x56289a199990 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6572000640 1 -- 172.21.15.52:0/3218491135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65680014b0 con 0x56289a199990 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56289a1ac430 con 0x56289a199990 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f6572000640 1 -- 172.21.15.52:0/3218491135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568001af0 con 0x56289a199990 2024-09-10T08:32:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.893+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289a23ba20 con 0x56289a199990 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.895+0000 7f6572000640 1 -- 172.21.15.52:0/3218491135 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6568015020 con 0x56289a199990 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.896+0000 7f6572000640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f655c06a810 0x7f655c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.896+0000 7f6572000640 1 -- 172.21.15.52:0/3218491135 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f656808b4d0 con 0x56289a199990 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.896+0000 7f657c9eef40 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x56289a1956b0 0x56289a2ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.896+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 --> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] -- osd_op(unknown.0.0:1 7.2 7:43adcc81:::10000000a4e.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x56289a2366b0 con 0x56289a1956b0 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.896+0000 7f6579c00640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f655c06a810 0x7f655c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.897+0000 7f657a600640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x56289a1956b0 0x56289a2ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.897+0000 7f6579c00640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f655c06a810 0x7f655c06ccd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56289a16de90 tx=0x7f656c056040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.897+0000 7f657a600640 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x56289a1956b0 0x56289a2ceaa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657a600640 1 -- 172.21.15.52:0/3218491135 <== osd.4 v2:172.21.15.176:6802/3190346421 1 ==== osd_op_reply(1 10000000a4e.00000000 [rmxattr] v49'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6574003730 con 0x56289a1956b0 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x56289a1956b0 msgr2=0x56289a2ceaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x56289a1956b0 0x56289a2ceaa0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f655c06a810 msgr2=0x7f655c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f655c06a810 0x7f655c06ccd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56289a16de90 tx=0x7f656c056040 comp rx=0 tx=0).stop 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 msgr2=0x56289a1aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 --2- 172.21.15.52:0/3218491135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56289a199990 0x56289a1aa200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6568011040 tx=0x7f6568000ed0 comp rx=0 tx=0).stop 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657a600640 1 -- 172.21.15.52:0/3218491135 reap_dead start 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 shutdown_connections 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 >> 172.21.15.52:0/3218491135 conn(0x56289a1964f0 msgr2=0x56289a164fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 shutdown_connections 2024-09-10T08:32:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:00.899+0000 7f657c9eef40 1 -- 172.21.15.52:0/3218491135 wait complete. 2024-09-10T08:32:00.903 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-10T08:32:00.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-10T08:32:01.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.063+0000 7fd19da00640 1 Processor -- start 2024-09-10T08:32:01.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.063+0000 7fd19da00640 1 -- start start 2024-09-10T08:32:01.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd19da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd19da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1980afb20 0x7fd1980affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd19da00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd198073cc0 con 0x7fd198155950 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd19da00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd1981631c0 con 0x7fd1980afb20 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd19da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd198070370 con 0x7fd198073600 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1980afb20 0x7fd1980affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1980afb20 0x7fd1980affd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40826/0 (socket says 172.21.15.52:40826) 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 -- 172.21.15.52:0/3321908682 learned_addr learned my addr 172.21.15.52:0/3321908682 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd18fe00640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 -- 172.21.15.52:0/3321908682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 msgr2=0x7fd198162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 -- 172.21.15.52:0/3321908682 >> v1:172.21.15.176:6789/0 conn(0x7fd198155950 legacy=0x7fd19806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.065+0000 7fd197400640 1 -- 172.21.15.52:0/3321908682 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd198071aa0 con 0x7fd1980afb20 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.066+0000 7fd197400640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980affd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd190009e50 tx=0x7fd19002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd54ed3e700fe30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd196000640 1 -- 172.21.15.52:0/3321908682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190036070 con 0x7fd1980afb20 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd196000640 1 -- 172.21.15.52:0/3321908682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd190031600 con 0x7fd1980afb20 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd196000640 1 -- 172.21.15.52:0/3321908682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1900319d0 con 0x7fd1980afb20 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 -- 172.21.15.52:0/3321908682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 msgr2=0x7fd1980affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980affd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd190009e50 tx=0x7fd19002a6c0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 -- 172.21.15.52:0/3321908682 shutdown_connections 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980affd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 --2- 172.21.15.52:0/3321908682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 -- 172.21.15.52:0/3321908682 >> 172.21.15.52:0/3321908682 conn(0x7fd19806db30 msgr2=0x7fd19806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 -- 172.21.15.52:0/3321908682 shutdown_connections 2024-09-10T08:32:01.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.067+0000 7fd19da00640 1 -- 172.21.15.52:0/3321908682 wait complete. 2024-09-10T08:32:01.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.069+0000 7fd19da00640 1 Processor -- start 2024-09-10T08:32:01.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.069+0000 7fd19da00640 1 -- start start 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd198153990 0x7fd1980b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd19806c320 con 0x7fd1980afb20 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd198073a60 con 0x7fd198153990 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd19da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd198072060 con 0x7fd198073600 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd18fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd18fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40828/0 (socket says 172.21.15.52:40828) 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd18fe00640 1 -- 172.21.15.52:0/4027397327 learned_addr learned my addr 172.21.15.52:0/4027397327 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd197400640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd198153990 0x7fd1980b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.070+0000 7fd196a00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 -- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 msgr2=0x7fd198153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 -- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd198153990 msgr2=0x7fd1980b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd198153990 0x7fd1980b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 -- 172.21.15.52:0/4027397327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1980d0940 con 0x7fd1980afb20 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd196a00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18fe00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd18000d800 tx=0x7fd18000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18ea00640 1 -- 172.21.15.52:0/4027397327 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180004020 con 0x7fd1980afb20 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18ea00640 1 -- 172.21.15.52:0/4027397327 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800041c0 con 0x7fd1980afb20 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd18ea00640 1 -- 172.21.15.52:0/4027397327 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180004390 con 0x7fd1980afb20 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.071+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1980cea50 con 0x7fd1980afb20 2024-09-10T08:32:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.072+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1980cf010 con 0x7fd1980afb20 2024-09-10T08:32:01.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.075+0000 7fd18ea00640 1 -- 172.21.15.52:0/4027397327 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd18001b020 con 0x7fd1980afb20 2024-09-10T08:32:01.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.075+0000 7fd18ea00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 0x7fd17406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.076+0000 7fd18ea00640 1 -- 172.21.15.52:0/4027397327 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd18008abd0 con 0x7fd1980afb20 2024-09-10T08:32:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.076+0000 7fd1a0886740 1 Processor -- start 2024-09-10T08:32:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.076+0000 7fd196a00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 0x7fd17406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.076+0000 7fd1a0886740 1 -- start start 2024-09-10T08:32:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd196a00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 0x7fd17406e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac1cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55856ab32ac0 con 0x55856abf8d90 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55856aadaa20 con 0x55856ac135b0 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55856ab2ea80 con 0x55856ac14cf0 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd196a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd196a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40830/0 (socket says 172.21.15.52:40830) 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd196a00640 1 -- 172.21.15.52:0/3112766444 learned_addr learned my addr 172.21.15.52:0/3112766444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd18fe00640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd196a00640 1 -- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 msgr2=0x55856ac1c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.077+0000 7fd197400640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac1cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd196a00640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac1c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd196a00640 1 -- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 msgr2=0x55856ac1cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd196a00640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac1cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd196a00640 1 -- 172.21.15.52:0/3112766444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856a911c00 con 0x55856abf8d90 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd197400640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac1cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd18fe00640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd196a00640 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd18800d8e0 tx=0x7fd188010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bae3cabc96b02c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd187400640 1 -- 172.21.15.52:0/3112766444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188024070 con 0x55856abf8d90 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd187400640 1 -- 172.21.15.52:0/3112766444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1880149b0 con 0x55856abf8d90 2024-09-10T08:32:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.078+0000 7fd187400640 1 -- 172.21.15.52:0/3112766444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188014d80 con 0x55856abf8d90 2024-09-10T08:32:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 -- 172.21.15.52:0/3112766444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 msgr2=0x55856abf9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd18800d8e0 tx=0x7fd188010000 comp rx=0 tx=0).stop 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 -- 172.21.15.52:0/3112766444 shutdown_connections 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac1cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac1c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 --2- 172.21.15.52:0/3112766444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf8d90 0x55856abf9170 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 -- 172.21.15.52:0/3112766444 >> 172.21.15.52:0/3112766444 conn(0x55856abcb650 msgr2=0x55856ac13ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 -- 172.21.15.52:0/3112766444 shutdown_connections 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.079+0000 7fd1a0886740 1 -- 172.21.15.52:0/3112766444 wait complete. 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.080+0000 7fd1a0886740 1 -- start start 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.080+0000 7fd1a0886740 1 Processor -- start 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 0x55856ac0db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856abf7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55856abced40 con 0x55856abf7bb0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55856aaedc40 con 0x55856ac14cf0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55856abcf020 con 0x55856ac135b0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd1a0886740 10 client.0 _ll_register_callbacks cb 0x55856aadf720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd197400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd196a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 0x55856ac0db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd197400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40838/0 (socket says 172.21.15.52:40838) 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.081+0000 7fd197400640 1 -- 172.21.15.52:0/2084340900 learned_addr learned my addr 172.21.15.52:0/2084340900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856abf7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 -- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 msgr2=0x55856ac0db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 0x55856ac0db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 -- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 msgr2=0x55856abf7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856abf7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 -- 172.21.15.52:0/2084340900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856a8054f0 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd196a00640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 0x55856ac0db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd197400640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd19002acb0 tx=0x7fd190004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5784801b19dc392c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd17be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190043070 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1880149b0 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.082+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd190031b40 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd19004e050 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 10 client.5901 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55856a972390 con 0x55856abf7bb0 2024-09-10T08:32:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1880149b0 con 0x55856abf7bb0 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd190051020 con 0x55856abf7bb0 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 10 client.5901 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 10 client.5901 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 20 client.5901 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac0b360 0x55856ac0e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 4 client.5901 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55856ab07250 con 0x55856ac0b360 2024-09-10T08:32:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.083+0000 7fd196a00640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac0b360 0x55856ac0e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.084+0000 7fd196a00640 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac0b360 0x55856ac0e1a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73756d6477478d server_cookie=24728ecd2830d6f1 in_seq=0 out_seq=0 2024-09-10T08:32:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.084+0000 7fd17be00640 10 client.5901 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.084+0000 7fd17be00640 1 -- 172.21.15.52:0/2084340900 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55856ab07250 con 0x55856ac0b360 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.084+0000 7fd17be00640 10 client.5901 handle_command_reply: tid=0 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 client.5901 shutdown 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 msgr2=0x55856abe7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd19002acb0 tx=0x7fd190004ab0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 shutdown_connections 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac0b360 0x55856ac0e1a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abe7650 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856abf7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2084340900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac135b0 0x55856ac0db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 >> 172.21.15.52:0/2084340900 conn(0x55856abf8d90 msgr2=0x55856ac11f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd17be00640 0 client.5901 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 shutdown_connections 2024-09-10T08:32:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 1 -- 172.21.15.52:0/2084340900 wait complete. 2024-09-10T08:32:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.085+0000 7fd1a0886740 20 client.5901 trim_cache size 0 max 16384 2024-09-10T08:32:01.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.103+0000 7fd1a0886740 1 Processor -- start 2024-09-10T08:32:01.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.103+0000 7fd1a0886740 1 -- start start 2024-09-10T08:32:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856abf7bb0 0x55856ac37c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856ac0a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd198200d00 con 0x55856ac135b0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ffd00 con 0x55856ac14cf0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.104+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1981ff060 con 0x55856abf7bb0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40840/0 (socket says 172.21.15.52:40840) 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 -- 172.21.15.52:0/2093164564 learned_addr learned my addr 172.21.15.52:0/2093164564 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd196a00640 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856abf7bb0 0x55856ac37c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd197400640 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856ac0a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 -- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856abf7bb0 msgr2=0x55856ac37c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856abf7bb0 0x55856ac37c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 -- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 msgr2=0x55856ac0a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856ac0a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 -- 172.21.15.52:0/2093164564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856a7de5b0 con 0x55856ac135b0 2024-09-10T08:32:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd180058d70 tx=0x7fd180058a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5245a74d6cf805a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd186a00640 1 -- 172.21.15.52:0/2093164564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180086020 con 0x55856ac135b0 2024-09-10T08:32:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.105+0000 7fd186a00640 1 -- 172.21.15.52:0/2093164564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18005c030 con 0x55856ac135b0 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd186a00640 1 -- 172.21.15.52:0/2093164564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18005d190 con 0x55856ac135b0 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 -- 172.21.15.52:0/2093164564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 msgr2=0x55856ac09b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd180058d70 tx=0x7fd180058a50 comp rx=0 tx=0).stop 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 -- 172.21.15.52:0/2093164564 shutdown_connections 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac14cf0 0x55856ac0a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856ac135b0 0x55856ac09b30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2093164564 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856abf7bb0 0x55856ac37c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 -- 172.21.15.52:0/2093164564 >> 172.21.15.52:0/2093164564 conn(0x55856abf8d90 msgr2=0x55856abd0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 -- 172.21.15.52:0/2093164564 shutdown_connections 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.106+0000 7fd1a0886740 1 -- 172.21.15.52:0/2093164564 wait complete. 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.107+0000 7fd1a0886740 1 -- start start 2024-09-10T08:32:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.107+0000 7fd1a0886740 1 Processor -- start 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac8b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac09b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55856ac133c0 con 0x55856abf7bb0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ff6b0 con 0x55856ac135b0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55856aaf7320 con 0x55856ac14cf0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd1a0886740 10 client.0 _ll_register_callbacks cb 0x7fd190009510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd196a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd196a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40856/0 (socket says 172.21.15.52:40856) 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd196a00640 1 -- 172.21.15.52:0/2598394526 learned_addr learned my addr 172.21.15.52:0/2598394526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac8b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.108+0000 7fd197400640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac09b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 -- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 msgr2=0x55856ac09b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac09b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 -- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 msgr2=0x55856ac8b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac8b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 -- 172.21.15.52:0/2598394526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856abce570 con 0x55856abf7bb0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd196a00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd18800d530 tx=0x7fd188004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41f41bcafafcfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd17be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188030070 con 0x55856abf7bb0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd188005b10 con 0x55856abf7bb0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd18005c030 con 0x55856abf7bb0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd188038050 con 0x55856abf7bb0 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd1a0886740 10 client.5907 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.109+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55856ac921a0 con 0x55856abf7bb0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18005c030 con 0x55856abf7bb0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd18803b020 con 0x55856abf7bb0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 10 client.5907 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 10 client.5907 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 20 client.5907 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac10bc0 0x55856ac0a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 4 client.5907 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55856ab401f0 con 0x55856ac10bc0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.110+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac10bc0 0x55856ac0a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd18fe00640 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac10bc0 0x55856ac0a070 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f4bcab174b55b5 server_cookie=dd9acb7e44e650c in_seq=0 out_seq=0 2024-09-10T08:32:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd17be00640 10 client.5907 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd17be00640 1 -- 172.21.15.52:0/2598394526 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55856ab401f0 con 0x55856ac10bc0 2024-09-10T08:32:01.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd17be00640 10 client.5907 handle_command_reply: tid=0 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 client.5907 shutdown 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 msgr2=0x55856abf91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd18800d530 tx=0x7fd188004680 comp rx=0 tx=0).stop 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 shutdown_connections 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55856ac10bc0 0x55856ac0a070 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55856ac14cf0 0x55856ac09b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55856ac135b0 0x55856ac8b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 --2- 172.21.15.52:0/2598394526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55856abf7bb0 0x55856abf91b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd17be00640 0 client.5907 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.111+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 >> 172.21.15.52:0/2598394526 conn(0x55856abf8d90 msgr2=0x55856ac0c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 shutdown_connections 2024-09-10T08:32:01.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd1a0886740 1 -- 172.21.15.52:0/2598394526 wait complete. 2024-09-10T08:32:01.117 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:32:01.112+0000 7f9598800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v465 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5382=0-4194304@1} caps={5382=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5382 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55c67e389080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4e:[<0x10000000001/new_file_1 v465>,<0x10000000000/ceph-qa-suite v59>,<0x1/scrub_test_path v23>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-10T08:32:01.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd1a0886740 20 client.5907 trim_cache size 0 max 16384 2024-09-10T08:32:01.117 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:01.117 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:32:01.118 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "4623108a-3c77-4677-8974-4d664621cb68", 2024-09-10T08:32:01.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:32:01.118 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 msgr2=0x7fd17406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 0x7fd17406e320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd188006fd0 tx=0x7fd188008040 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 msgr2=0x7fd1980d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd18000d800 tx=0x7fd18000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 shutdown_connections 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd17406be60 0x7fd17406e320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd198153990 0x7fd1980b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1980afb20 0x7fd1980d0400 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 --2- 172.21.15.52:0/4027397327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd198073600 0x7fd198153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.112+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 >> 172.21.15.52:0/4027397327 conn(0x7fd19806db30 msgr2=0x7fd1981624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.113+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 shutdown_connections 2024-09-10T08:32:01.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.113+0000 7fd19da00640 1 -- 172.21.15.52:0/4027397327 wait complete. 2024-09-10T08:32:01.129 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '4623108a-3c77-4677-8974-4d664621cb68', 'mode': 'asynchronous'}' 2024-09-10T08:32:01.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:32:01.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T08:32:01.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.291+0000 7f9c25000640 1 Processor -- start 2024-09-10T08:32:01.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.291+0000 7f9c25000640 1 -- start start 2024-09-10T08:32:01.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.292+0000 7f9c25000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c200d32c0 0x7f9c200cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.292+0000 7f9c25000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 0x7f9c200b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.292+0000 7f9c25000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c200d36e0 con 0x7f9c200b5fd0 2024-09-10T08:32:01.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.292+0000 7f9c25000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200d3950 con 0x7f9c200d32c0 2024-09-10T08:32:01.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.292+0000 7f9c25000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200d3c30 con 0x7f9c200b7c10 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c200d32c0 0x7f9c200cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 0x7f9c200b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1f400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f9c200b5fd0 0x7f9c200b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:48020/0 (socket says 172.21.15.52:48020) 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1f400640 1 -- 172.21.15.52:0/544425815 learned_addr learned my addr 172.21.15.52:0/544425815 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c200d32c0 0x7f9c200cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:54206/0 (socket says 172.21.15.52:54206) 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1ea00640 1 -- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 msgr2=0x7f9c200b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 0x7f9c200b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1ea00640 1 -- 172.21.15.52:0/544425815 >> v1:172.21.15.176:6789/0 conn(0x7f9c200b5fd0 legacy=0x7f9c200b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.294+0000 7f9c1ea00640 1 -- 172.21.15.52:0/544425815 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200d3f10 con 0x7f9c200d32c0 2024-09-10T08:32:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.294+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 0x7f9c200b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:01.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.293+0000 7f9c1e000640 1 -- 172.21.15.52:0/544425815 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747288430 0 0) 0x7f9c200d36e0 con 0x7f9c200b5fd0 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c200cf650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9475adf92236e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c1e000640 1 -- 172.21.15.52:0/544425815 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037070 con 0x7f9c200d32c0 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c1e000640 1 -- 172.21.15.52:0/544425815 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c032440 con 0x7f9c200d32c0 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c1e000640 1 -- 172.21.15.52:0/544425815 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c032810 con 0x7f9c200d32c0 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c25000640 1 -- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 msgr2=0x7f9c200cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.295+0000 7f9c25000640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c200cf650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a230 comp rx=0 tx=0).stop 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 -- 172.21.15.52:0/544425815 shutdown_connections 2024-09-10T08:32:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b7c10 0x7f9c200b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 --2- 172.21.15.52:0/544425815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c200cf650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 -- 172.21.15.52:0/544425815 >> 172.21.15.52:0/544425815 conn(0x7f9c200d0fd0 msgr2=0x7f9c200d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 -- 172.21.15.52:0/544425815 shutdown_connections 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.296+0000 7f9c25000640 1 -- 172.21.15.52:0/544425815 wait complete. 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.297+0000 7f9c25000640 1 Processor -- start 2024-09-10T08:32:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.297+0000 7f9c25000640 1 -- start start 2024-09-10T08:32:01.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b5fd0 0x7f9c200cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c201f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200cfb90 con 0x7f9c200b7c10 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200b7680 con 0x7f9c200d32c0 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.298+0000 7f9c25000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200cfd10 con 0x7f9c200b5fd0 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40862/0 (socket says 172.21.15.52:40862) 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 -- 172.21.15.52:0/1189535548 learned_addr learned my addr 172.21.15.52:0/1189535548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c201f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b5fd0 0x7f9c200cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 -- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b5fd0 msgr2=0x7f9c200cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b5fd0 0x7f9c200cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 -- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 msgr2=0x7f9c201f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c201f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 -- 172.21.15.52:0/1189535548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200cbb60 con 0x7f9c200b7c10 2024-09-10T08:32:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.299+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c035040 tx=0x7f9c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.300+0000 7f9c17400640 1 -- 172.21.15.52:0/1189535548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037050 con 0x7f9c200b7c10 2024-09-10T08:32:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.300+0000 7f9c17400640 1 -- 172.21.15.52:0/1189535548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c038040 con 0x7f9c200b7c10 2024-09-10T08:32:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.300+0000 7f9c17400640 1 -- 172.21.15.52:0/1189535548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c004490 con 0x7f9c200b7c10 2024-09-10T08:32:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.300+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c200cc6a0 con 0x7f9c200b7c10 2024-09-10T08:32:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.300+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200cc0e0 con 0x7f9c200b7c10 2024-09-10T08:32:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.302+0000 7f9c17400640 1 -- 172.21.15.52:0/1189535548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c003610 con 0x7f9c200b7c10 2024-09-10T08:32:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.303+0000 7f9c17400640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 0x7f9c0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.304+0000 7f9c17400640 1 -- 172.21.15.52:0/1189535548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f9c0c0ab810 con 0x7f9c200b7c10 2024-09-10T08:32:01.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.304+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 0x7f9c0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.304+0000 7f9c2942e740 1 Processor -- start 2024-09-10T08:32:01.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.304+0000 7f9c2942e740 1 -- start start 2024-09-10T08:32:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 0x7f9c0006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c10007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a0801ff9e0 0x55a0801fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08024a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a080167660 con 0x55a0802194f0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a08010f680 con 0x55a0801ff9e0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a080163620 con 0x55a080249ea0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40872/0 (socket says 172.21.15.52:40872) 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.305+0000 7f9c1f400640 1 -- 172.21.15.52:0/2545464006 learned_addr learned my addr 172.21.15.52:0/2545464006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08024a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a0801ff9e0 0x55a0801fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 -- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 msgr2=0x55a08024a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08024a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 -- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a0801ff9e0 msgr2=0x55a0801fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a0801ff9e0 0x55a0801fe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 -- 172.21.15.52:0/2545464006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07ff447d0 con 0x55a0802194f0 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c1f400640 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c10001920 tx=0x7f9c10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc660e31aec7857d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c0be00640 1 -- 172.21.15.52:0/2545464006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10026070 con 0x55a0802194f0 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c0be00640 1 -- 172.21.15.52:0/2545464006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10013b80 con 0x55a0802194f0 2024-09-10T08:32:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.306+0000 7f9c0be00640 1 -- 172.21.15.52:0/2545464006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10012350 con 0x55a0802194f0 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 -- 172.21.15.52:0/2545464006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 msgr2=0x55a0802198d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c10001920 tx=0x7f9c10013000 comp rx=0 tx=0).stop 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 -- 172.21.15.52:0/2545464006 shutdown_connections 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08024a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a0801ff9e0 0x55a0801fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 --2- 172.21.15.52:0/2545464006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802198d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 -- 172.21.15.52:0/2545464006 >> 172.21.15.52:0/2545464006 conn(0x55a080200410 msgr2=0x55a080248a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 -- 172.21.15.52:0/2545464006 shutdown_connections 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.307+0000 7f9c2942e740 1 -- 172.21.15.52:0/2545464006 wait complete. 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.308+0000 7f9c2942e740 1 -- start start 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.308+0000 7f9c2942e740 1 Processor -- start 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a0802598f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080249ea0 0x55a08023f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a0801fe940 con 0x55a080243870 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a0800f04c0 con 0x55a080249ea0 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a0801fec20 con 0x55a0802194f0 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c2942e740 10 client.0 _ll_register_callbacks cb 0x55a08015fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40876/0 (socket says 172.21.15.52:40876) 2024-09-10T08:32:01.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.309+0000 7f9c1fe00640 1 -- 172.21.15.52:0/1177451817 learned_addr learned my addr 172.21.15.52:0/1177451817 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080249ea0 0x55a08023f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a0802598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 -- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 msgr2=0x55a0802598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a0802598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 -- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080249ea0 msgr2=0x55a08023f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080249ea0 0x55a08023f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 -- 172.21.15.52:0/1177451817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07fe7a3f0 con 0x55a080243870 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a0802598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c18014e40 tx=0x7f9c18012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a54baf7586806a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c08c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003b90 con 0x55a080243870 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c10013b80 con 0x55a080243870 2024-09-10T08:32:01.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.310+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f9c18003d30 con 0x55a080243870 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c18004020 con 0x55a080243870 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 10 client.5916 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a07fe3a0f0 con 0x55a080243870 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10013b80 con 0x55a080243870 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f9c180041c0 con 0x55a080243870 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 10 client.5916 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 20 client.5916 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a08022d9f0 0x55a08022ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 4 client.5916 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a080174d90 con 0x55a08022d9f0 2024-09-10T08:32:01.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.311+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a08022d9f0 0x55a08022ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.312+0000 7f9c1f400640 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a08022d9f0 0x55a08022ddd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d14a528787bd6b0 server_cookie=2fe9ffd6978f6bf3 in_seq=0 out_seq=0 2024-09-10T08:32:01.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.312+0000 7f9c08c00640 10 client.5916 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c08c00640 1 -- 172.21.15.52:0/1177451817 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a080174d90 con 0x55a08022d9f0 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c08c00640 10 client.5916 handle_command_reply: tid=0 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 client.5916 shutdown 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 msgr2=0x55a080245b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c18014e40 tx=0x7f9c18012670 comp rx=0 tx=0).stop 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 shutdown_connections 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a08022d9f0 0x55a08022ddd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080243870 0x55a080245b40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080249ea0 0x55a08023f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 --2- 172.21.15.52:0/1177451817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a0802598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c08c00640 0 client.5916 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 >> 172.21.15.52:0/1177451817 conn(0x55a0801ff9e0 msgr2=0x55a0801fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 shutdown_connections 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 1 -- 172.21.15.52:0/1177451817 wait complete. 2024-09-10T08:32:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.313+0000 7f9c2942e740 20 client.5916 trim_cache size 0 max 16384 2024-09-10T08:32:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.331+0000 7f9c2942e740 1 Processor -- start 2024-09-10T08:32:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.331+0000 7f9c2942e740 1 -- start start 2024-09-10T08:32:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a080218f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08024ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c202009b0 con 0x55a080249ea0 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201f8690 con 0x55a080243870 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200b5410 con 0x55a0802194f0 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40892/0 (socket says 172.21.15.52:40892) 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.332+0000 7f9c1fe00640 1 -- 172.21.15.52:0/567311597 learned_addr learned my addr 172.21.15.52:0/567311597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1f400640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a080218f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08024ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 -- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 msgr2=0x55a080218f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a080218f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 -- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 msgr2=0x55a08024ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08024ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 -- 172.21.15.52:0/567311597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0802050c0 con 0x55a080249ea0 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1f400640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a080218f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08024ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c18007080 tx=0x7f9c18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ac0b54e38a194 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c0b400640 1 -- 172.21.15.52:0/567311597 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18036070 con 0x55a080249ea0 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c0b400640 1 -- 172.21.15.52:0/567311597 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18004710 con 0x55a080249ea0 2024-09-10T08:32:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.333+0000 7f9c0b400640 1 -- 172.21.15.52:0/567311597 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1802d040 con 0x55a080249ea0 2024-09-10T08:32:01.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 -- 172.21.15.52:0/567311597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 msgr2=0x55a08023f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c18007080 tx=0x7f9c18018000 comp rx=0 tx=0).stop 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 -- 172.21.15.52:0/567311597 shutdown_connections 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a080249ea0 0x55a08023f9a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08024ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 --2- 172.21.15.52:0/567311597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a0802194f0 0x55a080218f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 -- 172.21.15.52:0/567311597 >> 172.21.15.52:0/567311597 conn(0x55a0801ff9e0 msgr2=0x55a0802011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 -- 172.21.15.52:0/567311597 shutdown_connections 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.334+0000 7f9c2942e740 1 -- 172.21.15.52:0/567311597 wait complete. 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.335+0000 7f9c2942e740 1 -- start start 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.335+0000 7f9c2942e740 1 Processor -- start 2024-09-10T08:32:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08022c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08022cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a080243050 con 0x55a0802194f0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c201f8040 con 0x55a080243870 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a0801ff520 con 0x55a080249ea0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c2942e740 10 client.0 _ll_register_callbacks cb 0x7f9c18009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40898/0 (socket says 172.21.15.52:40898) 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 -- 172.21.15.52:0/554345496 learned_addr learned my addr 172.21.15.52:0/554345496 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08022c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08022cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 -- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 msgr2=0x55a08022cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08022cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 -- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 msgr2=0x55a08022c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08022c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1f400640 1 -- 172.21.15.52:0/554345496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08024caf0 con 0x55a0802194f0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08022c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.336+0000 7f9c1fe00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08022cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c1f400640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9c10004fb0 tx=0x7f9c10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1a04d223fe93e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10026040 con 0x55a0802194f0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f9c10038460 con 0x55a0802194f0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18004710 con 0x55a0802194f0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9c10013b80 con 0x55a0802194f0 2024-09-10T08:32:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c2942e740 10 client.5922 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a08026c820 con 0x55a0802194f0 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18004710 con 0x55a0802194f0 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.337+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f9c10043020 con 0x55a0802194f0 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 10 client.5922 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 20 client.5922 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a080242bc0 0x55a0802039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 4 client.5922 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0802304d0 con 0x55a080242bc0 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a080242bc0 0x55a0802039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c1ea00640 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a080242bc0 0x55a0802039c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=482b00f9ddef453e server_cookie=aa7d6419727ab7f1 in_seq=0 out_seq=0 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c08c00640 10 client.5922 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c08c00640 1 -- 172.21.15.52:0/554345496 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x55a0802304d0 con 0x55a080242bc0 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c08c00640 10 client.5922 handle_command_reply: tid=0 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.338+0000 7f9c2942e740 1 client.5922 shutdown 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 msgr2=0x55a0802c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9c10004fb0 tx=0x7f9c10000ed0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 shutdown_connections 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55a080242bc0 0x55a0802039c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a080249ea0 0x55a08022cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a080243870 0x55a08022c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 --2- 172.21.15.52:0/554345496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a0802194f0 0x55a0802c72f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c08c00640 0 client.5922 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:01.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 >> 172.21.15.52:0/554345496 conn(0x55a0801ff9e0 msgr2=0x55a0801f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 shutdown_connections 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 1 -- 172.21.15.52:0/554345496 wait complete. 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.339+0000 7f9c2942e740 20 client.5922 trim_cache size 0 max 16384 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "4623108a-3c77-4677-8974-4d664621cb68": { 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "4623108a-3c77-4677-8974-4d664621cb68", 2024-09-10T08:32:01.345 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "51dd1128-dfa3-45da-bad7-6984cd13baf6": { 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "51dd1128-dfa3-45da-bad7-6984cd13baf6", 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "6a80eda2-60d0-45b1-8c86-e5dbfa45fb13": { 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "6a80eda2-60d0-45b1-8c86-e5dbfa45fb13", 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:01.346 INFO:teuthology.orchestra.run.smithi052.stdout: "b5fe3b64-d3f2-4ce2-bf90-b6bcb9997c12": { 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "b5fe3b64-d3f2-4ce2-bf90-b6bcb9997c12", 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "" 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:01.347 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 msgr2=0x7f9c0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 0x7f9c0006e2f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c10007d50 comp rx=0 tx=0).stop 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 msgr2=0x7f9c2015ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c035040 tx=0x7f9c0c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 shutdown_connections 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c0006be30 0x7f9c0006e2f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c200d32c0 0x7f9c201f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c200b7c10 0x7f9c2015ea00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 --2- 172.21.15.52:0/1189535548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c200b5fd0 0x7f9c200cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:01.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 >> 172.21.15.52:0/1189535548 conn(0x7f9c200d0fd0 msgr2=0x7f9c200b9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:01.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 shutdown_connections 2024-09-10T08:32:01.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:01.340+0000 7f9c25000640 1 -- 172.21.15.52:0/1189535548 wait complete. 2024-09-10T08:32:06.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:06.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:06.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:32:06.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-10T08:32:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.521+0000 7efe9e800640 1 Processor -- start 2024-09-10T08:32:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.521+0000 7efe9e800640 1 -- start start 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efe980b5fd0 0x7efe980d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b63b0 0x7efe980cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe98067950 0x7efe98067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efe980d3950 con 0x7efe98067950 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efe980d3c30 con 0x7efe980b5fd0 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe980d3f10 con 0x7efe980b63b0 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe98067950 0x7efe98067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe98067950 0x7efe98067e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51096/0 (socket says 172.21.15.52:51096) 2024-09-10T08:32:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.522+0000 7efe9de00640 1 -- 172.21.15.52:0/4034576505 learned_addr learned my addr 172.21.15.52:0/4034576505 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9d400640 1 --2- 172.21.15.52:0/4034576505 >> v2:172.21.15.176:3300/0 conn(0x7efe980b5fd0 0x7efe980d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9ca00640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b63b0 0x7efe980cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9de00640 1 -- 172.21.15.52:0/4034576505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b63b0 msgr2=0x7efe980cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9de00640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b63b0 0x7efe980cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9de00640 1 -- 172.21.15.52:0/4034576505 >> v2:172.21.15.176:3300/0 conn(0x7efe980b5fd0 msgr2=0x7efe980d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9de00640 1 --2- 172.21.15.52:0/4034576505 >> v2:172.21.15.176:3300/0 conn(0x7efe980b5fd0 0x7efe980d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.523+0000 7efe9de00640 1 -- 172.21.15.52:0/4034576505 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe980d41f0 con 0x7efe98067950 2024-09-10T08:32:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.524+0000 7efe9de00640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98067e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efe980d5620 tx=0x7efe9002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e3c1486bc172b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.524+0000 7efe97e00640 1 -- 172.21.15.52:0/4034576505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90036070 con 0x7efe98067950 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.524+0000 7efe97e00640 1 -- 172.21.15.52:0/4034576505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe90031600 con 0x7efe98067950 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.524+0000 7efe97e00640 1 -- 172.21.15.52:0/4034576505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900319d0 con 0x7efe98067950 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 -- 172.21.15.52:0/4034576505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 msgr2=0x7efe98067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98067e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efe980d5620 tx=0x7efe9002a730 comp rx=0 tx=0).stop 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 -- 172.21.15.52:0/4034576505 shutdown_connections 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98067e00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 --2- 172.21.15.52:0/4034576505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b63b0 0x7efe980cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 --2- 172.21.15.52:0/4034576505 >> v2:172.21.15.176:3300/0 conn(0x7efe980b5fd0 0x7efe980d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 -- 172.21.15.52:0/4034576505 >> 172.21.15.52:0/4034576505 conn(0x7efe980d0fd0 msgr2=0x7efe980d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 -- 172.21.15.52:0/4034576505 shutdown_connections 2024-09-10T08:32:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.525+0000 7efe9e800640 1 -- 172.21.15.52:0/4034576505 wait complete. 2024-09-10T08:32:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.527+0000 7efe9e800640 1 Processor -- start 2024-09-10T08:32:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.527+0000 7efe9e800640 1 -- start start 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 0x7efe980b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 0x7efe980b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe980cfd10 con 0x7efe98067950 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe980cfb90 con 0x7efe980b63b0 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.528+0000 7efe9e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe980b67d0 con 0x7efe980b5fd0 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51104/0 (socket says 172.21.15.52:51104) 2024-09-10T08:32:06.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 -- 172.21.15.52:0/1389327977 learned_addr learned my addr 172.21.15.52:0/1389327977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 0x7efe980b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9de00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 0x7efe980b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 -- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 msgr2=0x7efe980b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 0x7efe980b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 -- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 msgr2=0x7efe980b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 0x7efe980b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 -- 172.21.15.52:0/1389327977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe980b9620 con 0x7efe98067950 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 0x7efe980b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9de00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 0x7efe980b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.529+0000 7efe9d400640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00e890 tx=0x7efe8c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.530+0000 7efe95600640 1 -- 172.21.15.52:0/1389327977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c017070 con 0x7efe98067950 2024-09-10T08:32:06.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.530+0000 7efe95600640 1 -- 172.21.15.52:0/1389327977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8c00c940 con 0x7efe98067950 2024-09-10T08:32:06.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.530+0000 7efe95600640 1 -- 172.21.15.52:0/1389327977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00cd10 con 0x7efe98067950 2024-09-10T08:32:06.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.530+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe980b9900 con 0x7efe98067950 2024-09-10T08:32:06.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.530+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe980b9ec0 con 0x7efe98067950 2024-09-10T08:32:06.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.532+0000 7efe95600640 1 -- 172.21.15.52:0/1389327977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe8c01a070 con 0x7efe98067950 2024-09-10T08:32:06.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.533+0000 7efe95600640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 0x7efe7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.533+0000 7efe95600640 1 -- 172.21.15.52:0/1389327977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7efe8c08ae60 con 0x7efe98067950 2024-09-10T08:32:06.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.534+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 0x7efe7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.534+0000 7efea2c0d740 1 Processor -- start 2024-09-10T08:32:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.534+0000 7efea2c0d740 1 -- start start 2024-09-10T08:32:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 0x7efe7806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe980cb3e0 tx=0x7efe84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b4d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b339e0 0x561547b32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561547a9b660 con 0x561547b7dea0 2024-09-10T08:32:06.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561547a43680 con 0x561547b4d4f0 2024-09-10T08:32:06.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561547a97620 con 0x561547b339e0 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efe9de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efe9de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51108/0 (socket says 172.21.15.52:51108) 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.535+0000 7efe9de00640 1 -- 172.21.15.52:0/1108023508 learned_addr learned my addr 172.21.15.52:0/1108023508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b339e0 0x561547b32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9d400640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b4d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 -- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b339e0 msgr2=0x561547b32240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b339e0 0x561547b32240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 -- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 msgr2=0x561547b4d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b4d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 -- 172.21.15.52:0/1108023508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615478787d0 con 0x561547b7dea0 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9d400640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b4d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe9de00640 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9002ad20 tx=0x7efe9002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70420a033e382942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe89c00640 1 -- 172.21.15.52:0/1108023508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90036040 con 0x561547b7dea0 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe89c00640 1 -- 172.21.15.52:0/1108023508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe90042070 con 0x561547b7dea0 2024-09-10T08:32:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.536+0000 7efe89c00640 1 -- 172.21.15.52:0/1108023508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9003c870 con 0x561547b7dea0 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 -- 172.21.15.52:0/1108023508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 msgr2=0x561547b7e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efe9002ad20 tx=0x7efe9002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 -- 172.21.15.52:0/1108023508 shutdown_connections 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b7e3f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b339e0 0x561547b32240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1108023508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b4d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 -- 172.21.15.52:0/1108023508 >> 172.21.15.52:0/1108023508 conn(0x561547b34410 msgr2=0x561547b7ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 -- 172.21.15.52:0/1108023508 shutdown_connections 2024-09-10T08:32:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.537+0000 7efea2c0d740 1 -- 172.21.15.52:0/1108023508 wait complete. 2024-09-10T08:32:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.538+0000 7efea2c0d740 1 -- start start 2024-09-10T08:32:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.538+0000 7efea2c0d740 1 Processor -- start 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b79bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b7dea0 0x561547b61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561547b32940 con 0x561547b8cf40 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561547a244c0 con 0x561547b4d4f0 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561547b32c20 con 0x561547b7dea0 2024-09-10T08:32:06.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efea2c0d740 10 client.0 _ll_register_callbacks cb 0x561547a93e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efe9de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efe9de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51120/0 (socket says 172.21.15.52:51120) 2024-09-10T08:32:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efe9de00640 1 -- 172.21.15.52:0/1462574652 learned_addr learned my addr 172.21.15.52:0/1462574652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.539+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b7dea0 0x561547b61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9d400640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b79bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 -- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b7dea0 msgr2=0x561547b61d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b7dea0 0x561547b61d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 -- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 msgr2=0x561547b79bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b79bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 -- 172.21.15.52:0/1462574652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615477ae3f0 con 0x561547b8cf40 2024-09-10T08:32:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe9de00640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe90009f10 tx=0x7efe90004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed5f872e7fe121e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe7e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90036050 con 0x561547b8cf40 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe90042070 con 0x561547b8cf40 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.540+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7efe900042c0 con 0x561547b8cf40 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efe90056050 con 0x561547b8cf40 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 10 client.5934 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x56154776e0f0 con 0x561547b8cf40 2024-09-10T08:32:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe90042070 con 0x561547b8cf40 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7efe90059020 con 0x561547b8cf40 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 10 client.5934 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 10 client.5934 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 20 client.5934 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547b76f40 0x561547b74d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 4 client.5934 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561547aa8d90 con 0x561547b76f40 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.541+0000 7efe9d400640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547b76f40 0x561547b74d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.542+0000 7efe9d400640 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547b76f40 0x561547b74d20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b243c3063469503 server_cookie=2576df9628c70d16 in_seq=0 out_seq=0 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.542+0000 7efe7e000640 10 client.5934 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.542+0000 7efe7e000640 1 -- 172.21.15.52:0/1462574652 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561547aa8d90 con 0x561547b76f40 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.542+0000 7efe7e000640 10 client.5934 handle_command_reply: tid=0 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 client.5934 shutdown 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 msgr2=0x561547b8d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efe90009f10 tx=0x7efe90004ab0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 shutdown_connections 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547b76f40 0x561547b74d20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b8cf40 0x561547b8d3c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b7dea0 0x561547b61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efe7e000640 0 client.5934 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1462574652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b79bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 >> 172.21.15.52:0/1462574652 conn(0x561547b339e0 msgr2=0x561547b7acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 shutdown_connections 2024-09-10T08:32:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 1 -- 172.21.15.52:0/1462574652 wait complete. 2024-09-10T08:32:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.543+0000 7efea2c0d740 20 client.5934 trim_cache size 0 max 16384 2024-09-10T08:32:06.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.561+0000 7efea2c0d740 1 Processor -- start 2024-09-10T08:32:06.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.561+0000 7efea2c0d740 1 -- start start 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b4d4f0 0x561547b808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b8cf40 0x561547b78990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe98200b90 con 0x561547b7dea0 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe9815a040 con 0x561547b8cf40 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe9815f6c0 con 0x561547b4d4f0 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51128/0 (socket says 172.21.15.52:51128) 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.562+0000 7efe9ca00640 1 -- 172.21.15.52:0/1695589317 learned_addr learned my addr 172.21.15.52:0/1695589317 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9de00640 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b8cf40 0x561547b78990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9d400640 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b4d4f0 0x561547b808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 -- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b4d4f0 msgr2=0x561547b808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b4d4f0 0x561547b808b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 -- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b8cf40 msgr2=0x561547b78990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b8cf40 0x561547b78990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 -- 172.21.15.52:0/1695589317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561547b79dd0 con 0x561547b7dea0 2024-09-10T08:32:06.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe9ca00640 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe8400e8f0 tx=0x7efe84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578c766f2f36ab22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe89200640 1 -- 172.21.15.52:0/1695589317 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8400f040 con 0x561547b7dea0 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe89200640 1 -- 172.21.15.52:0/1695589317 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe84028070 con 0x561547b7dea0 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.563+0000 7efe89200640 1 -- 172.21.15.52:0/1695589317 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84023670 con 0x561547b7dea0 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 -- 172.21.15.52:0/1695589317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 msgr2=0x561547b78450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe8400e8f0 tx=0x7efe84014000 comp rx=0 tx=0).stop 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 -- 172.21.15.52:0/1695589317 shutdown_connections 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b8cf40 0x561547b78990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547b78450 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 --2- 172.21.15.52:0/1695589317 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b4d4f0 0x561547b808b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 -- 172.21.15.52:0/1695589317 >> 172.21.15.52:0/1695589317 conn(0x561547b339e0 msgr2=0x561547b76360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 -- 172.21.15.52:0/1695589317 shutdown_connections 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.564+0000 7efea2c0d740 1 -- 172.21.15.52:0/1695589317 wait complete. 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.565+0000 7efea2c0d740 1 -- start start 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.565+0000 7efea2c0d740 1 Processor -- start 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b7e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b8cf40 0x561547b4bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe981599b0 con 0x561547b7dea0 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x561547b78ff0 con 0x561547b4d4f0 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x561547b7eb80 con 0x561547b8cf40 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efea2c0d740 10 client.0 _ll_register_callbacks cb 0x7efe9002af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51134/0 (socket says 172.21.15.52:51134) 2024-09-10T08:32:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 -- 172.21.15.52:0/296658506 learned_addr learned my addr 172.21.15.52:0/296658506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9de00640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b8cf40 0x561547b4bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9d400640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b7e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 -- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b8cf40 msgr2=0x561547b4bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b8cf40 0x561547b4bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 -- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 msgr2=0x561547b7e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b7e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.566+0000 7efe9ca00640 1 -- 172.21.15.52:0/296658506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561547b80290 con 0x561547b7dea0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe9ca00640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efe84024000 tx=0x7efe84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866d99c9f16327d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe7e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84030070 con 0x561547b7dea0 2024-09-10T08:32:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7efe84015440 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe84028070 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efe8403b050 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efea2c0d740 10 client.5940 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561547b7e8c0 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.567+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe84028070 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7efe8403e020 con 0x561547b7dea0 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 10 client.5940 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 20 client.5940 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547bfb540 0x561547bfb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 4 client.5940 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561547b7bbc0 con 0x561547bfb540 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efe9d400640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547bfb540 0x561547bfb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efe9d400640 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547bfb540 0x561547bfb950 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b1111be0f3b1c7 server_cookie=713ce537e4e7a696 in_seq=0 out_seq=0 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.568+0000 7efe7e000640 10 client.5940 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efe7e000640 1 -- 172.21.15.52:0/296658506 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561547b7bbc0 con 0x561547bfb540 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efe7e000640 10 client.5940 handle_command_reply: tid=0 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 client.5940 shutdown 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 msgr2=0x561547ba0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efe84024000 tx=0x7efe84004730 comp rx=0 tx=0).stop 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 shutdown_connections 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x561547bfb540 0x561547bfb950 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x561547b8cf40 0x561547b4bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561547b7dea0 0x561547ba0ee0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 --2- 172.21.15.52:0/296658506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x561547b4d4f0 0x561547b7e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efe7e000640 0 client.5940 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 >> 172.21.15.52:0/296658506 conn(0x561547b339e0 msgr2=0x561547b2dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 shutdown_connections 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 1 -- 172.21.15.52:0/296658506 wait complete. 2024-09-10T08:32:06.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.569+0000 7efea2c0d740 20 client.5940 trim_cache size 0 max 16384 2024-09-10T08:32:06.576 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:06.576 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:32:06.576 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:32:06.576 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 msgr2=0x7efe7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 0x7efe7806e2f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efe980cb3e0 tx=0x7efe84008040 comp rx=0 tx=0).stop 2024-09-10T08:32:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 msgr2=0x7efe98157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00e890 tx=0x7efe8c00ed50 comp rx=0 tx=0).stop 2024-09-10T08:32:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 shutdown_connections 2024-09-10T08:32:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe7806be30 0x7efe7806e2f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe980b63b0 0x7efe980b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe980b5fd0 0x7efe980b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 --2- 172.21.15.52:0/1389327977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe98067950 0x7efe98157a20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 >> 172.21.15.52:0/1389327977 conn(0x7efe980d0fd0 msgr2=0x7efe980b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 shutdown_connections 2024-09-10T08:32:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.570+0000 7efe9e800640 1 -- 172.21.15.52:0/1389327977 wait complete. 2024-09-10T08:32:06.586 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:32:06.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-10T08:32:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.746+0000 7f7dc2200640 1 Processor -- start 2024-09-10T08:32:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.746+0000 7f7dc2200640 1 -- start start 2024-09-10T08:32:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.747+0000 7f7dc2200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7dbc0d32c0 0x7f7dbc0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.747+0000 7f7dc2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc0d36e0 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.747+0000 7f7dc2200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc0d3950 con 0x7f7dbc0b7c10 2024-09-10T08:32:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.747+0000 7f7dc2200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc0d3c30 con 0x7f7dbc0d32c0 2024-09-10T08:32:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dc0e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7dbc0b5fd0 0x7f7dbc0b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48936/0 (socket says 172.21.15.52:48936) 2024-09-10T08:32:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dc0e00640 1 -- 172.21.15.52:0/242128288 learned_addr learned my addr 172.21.15.52:0/242128288 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675770105 0 0) 0x7f7dbc0d36e0 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da4003520 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/242128288 >> v2:172.21.15.176:3300/0 conn(0x7f7dbc0d32c0 0x7f7dbc0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4250896428 0 0) 0x7f7da4003520 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 >> v2:172.21.15.176:3300/0 conn(0x7f7dbc0d32c0 msgr2=0x7f7dbc0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 --2- 172.21.15.52:0/242128288 >> v2:172.21.15.176:3300/0 conn(0x7f7dbc0d32c0 0x7f7dbc0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 >> v1:172.21.15.176:6789/0 conn(0x7f7dbc0b7c10 legacy=0x7f7dbc0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0d3f10 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f7db0001670 con 0x7f7dbc0b5fd0 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.748+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 >> v1:172.21.15.52:6789/0 conn(0x7f7dbc0b5fd0 legacy=0x7f7dbc0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7da4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7da4004800 0x7f7da4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7da40051c0 0x7f7da400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0d3c30 con 0x7f7da4003a00 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400c0a0 con 0x7f7da4004800 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7da400c2a0 con 0x7f7da40051c0 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7da4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7da4004800 0x7f7da4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc1800640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7da40051c0 0x7f7da400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 -- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7da40051c0 msgr2=0x7f7da400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7da40051c0 0x7f7da400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 -- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7da4004800 msgr2=0x7f7da4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7da4004800 0x7f7da4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc0e00640 1 -- 172.21.15.52:0/242128288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da4003520 con 0x7f7da4003a00 2024-09-10T08:32:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.749+0000 7f7dc1800640 1 -- 172.21.15.52:0/242128288 reap_dead start 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.750+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7da4003e20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c110 tx=0x7f7da4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1656ac114f1b0a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0007c40 con 0x7f7da4003a00 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0005af0 con 0x7f7da4003a00 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dbb400640 1 -- 172.21.15.52:0/242128288 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0007070 con 0x7f7da4003a00 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dc2200640 1 -- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 msgr2=0x7f7da4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dc2200640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7da4003e20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c110 tx=0x7f7da4005830 comp rx=0 tx=0).stop 2024-09-10T08:32:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dc2200640 1 -- 172.21.15.52:0/242128288 shutdown_connections 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dc2200640 1 --2- 172.21.15.52:0/242128288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7da4003e20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.751+0000 7f7dc2200640 1 -- 172.21.15.52:0/242128288 >> 172.21.15.52:0/242128288 conn(0x7f7dbc0d0fd0 msgr2=0x7f7dbc0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.752+0000 7f7dc2200640 1 -- 172.21.15.52:0/242128288 shutdown_connections 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.752+0000 7f7dc2200640 1 -- 172.21.15.52:0/242128288 wait complete. 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.754+0000 7f7dc2200640 1 Processor -- start 2024-09-10T08:32:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.754+0000 7f7dc2200640 1 -- start start 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 0x7f7dbc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 0x7f7dbc15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc15e7f0 con 0x7f7da4003a00 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0b7680 con 0x7f7dbc1537d0 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc15e970 con 0x7f7dbc0c8850 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.755+0000 7f7dc0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51152/0 (socket says 172.21.15.52:51152) 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 -- 172.21.15.52:0/2671260525 learned_addr learned my addr 172.21.15.52:0/2671260525 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 0x7f7dbc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc1800640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 0x7f7dbc15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 -- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 msgr2=0x7f7dbc15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 0x7f7dbc15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 -- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 msgr2=0x7f7dbc1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 0x7f7dbc1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 -- 172.21.15.52:0/2671260525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0c93f0 con 0x7f7da4003a00 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc1800640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 0x7f7dbc15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 0x7f7dbc1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c230 tx=0x7f7dbc0b75d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.756+0000 7f7db8c00640 1 -- 172.21.15.52:0/2671260525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0037040 con 0x7f7da4003a00 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.757+0000 7f7db8c00640 1 -- 172.21.15.52:0/2671260525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0041070 con 0x7f7da4003a00 2024-09-10T08:32:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.757+0000 7f7db8c00640 1 -- 172.21.15.52:0/2671260525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0001670 con 0x7f7da4003a00 2024-09-10T08:32:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.757+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc158080 con 0x7f7da4003a00 2024-09-10T08:32:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.757+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc1525f0 con 0x7f7da4003a00 2024-09-10T08:32:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.759+0000 7f7db8c00640 1 -- 172.21.15.52:0/2671260525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7db0004a20 con 0x7f7da4003a00 2024-09-10T08:32:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.759+0000 7f7db8c00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.760+0000 7f7db8c00640 1 -- 172.21.15.52:0/2671260525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7db00aaba0 con 0x7f7da4003a00 2024-09-10T08:32:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.760+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.760+0000 7f7dc660b740 1 Processor -- start 2024-09-10T08:32:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.760+0000 7f7dc660b740 1 -- start start 2024-09-10T08:32:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc15f2f0 tx=0x7f7da8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15f2a0 0x55976e15f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15ca60 0x55976e15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55976e07b490 con 0x55976e15cec0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55976e023690 con 0x55976e15f2a0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.761+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55976e077450 con 0x55976e15ca60 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51162/0 (socket says 172.21.15.52:51162) 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 -- 172.21.15.52:0/2657448530 learned_addr learned my addr 172.21.15.52:0/2657448530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15ca60 0x55976e15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15f2a0 0x55976e15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 -- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15ca60 msgr2=0x55976e15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15ca60 0x55976e15e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 -- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15f2a0 msgr2=0x55976e15f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15f2a0 0x55976e15f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 -- 172.21.15.52:0/2657448530 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976e02ae00 con 0x55976e15cec0 2024-09-10T08:32:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.762+0000 7f7dc1800640 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d20b0 tx=0x7f7db4001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ff4a49c0d1ca21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dad600640 1 -- 172.21.15.52:0/2657448530 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40054e0 con 0x55976e15cec0 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dad600640 1 -- 172.21.15.52:0/2657448530 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db401a070 con 0x55976e15cec0 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dad600640 1 -- 172.21.15.52:0/2657448530 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4015470 con 0x55976e15cec0 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 -- 172.21.15.52:0/2657448530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 msgr2=0x55976e13f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d20b0 tx=0x7f7db4001610 comp rx=0 tx=0).stop 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 -- 172.21.15.52:0/2657448530 shutdown_connections 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e13f220 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15ca60 0x55976e15e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 --2- 172.21.15.52:0/2657448530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15f2a0 0x55976e15f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 -- 172.21.15.52:0/2657448530 >> 172.21.15.52:0/2657448530 conn(0x55976e114f00 msgr2=0x55976e15d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.763+0000 7f7dc660b740 1 -- 172.21.15.52:0/2657448530 shutdown_connections 2024-09-10T08:32:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.764+0000 7f7dc660b740 1 -- 172.21.15.52:0/2657448530 wait complete. 2024-09-10T08:32:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.764+0000 7f7dc660b740 1 -- start start 2024-09-10T08:32:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.764+0000 7f7dc660b740 1 Processor -- start 2024-09-10T08:32:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15cec0 0x55976e156080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55976e15b9c0 con 0x55976e15f2a0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55976e036950 con 0x55976e118cc0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.765+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55976e15bca0 con 0x55976e15cec0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dc660b740 10 client.0 _ll_register_callbacks cb 0x55976e0024d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51166/0 (socket says 172.21.15.52:51166) 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 -- 172.21.15.52:0/319745100 learned_addr learned my addr 172.21.15.52:0/319745100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15cec0 0x55976e156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dc1800640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 -- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15cec0 msgr2=0x55976e156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15cec0 0x55976e156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 -- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 msgr2=0x55976e157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 -- 172.21.15.52:0/319745100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976e02ff40 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7da8016a40 tx=0x7f7da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04dc504624f54e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.766+0000 7f7da2000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8023b50 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7da8023cf0 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7db401a070 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7da8035050 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 10 client.5952 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55976dd8e3f0 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db401a070 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f7da802d470 con 0x55976e15f2a0 2024-09-10T08:32:06.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 10 client.5952 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 10 client.5952 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 20 client.5952 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e154580 0x55976e13cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 4 client.5952 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.767+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55976e088bc0 con 0x55976e154580 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.768+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e154580 0x55976e13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.768+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e154580 0x55976e13cbc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dbdfa140fe38a0f server_cookie=f10021d33b5c8955 in_seq=0 out_seq=0 2024-09-10T08:32:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.768+0000 7f7da2000640 10 client.5952 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7da2000640 1 -- 172.21.15.52:0/319745100 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55976e088bc0 con 0x55976e154580 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7da2000640 10 client.5952 handle_command_reply: tid=0 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 client.5952 shutdown 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 msgr2=0x55976e118780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7da8016a40 tx=0x7f7da8004730 comp rx=0 tx=0).stop 2024-09-10T08:32:06.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 shutdown_connections 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e154580 0x55976e13cbc0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15f2a0 0x55976e118780 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 --2- 172.21.15.52:0/319745100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15cec0 0x55976e156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 >> 172.21.15.52:0/319745100 conn(0x55976e15ca60 msgr2=0x55976e13f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7da2000640 0 client.5952 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.769+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 shutdown_connections 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.770+0000 7f7dc660b740 1 -- 172.21.15.52:0/319745100 wait complete. 2024-09-10T08:32:06.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.770+0000 7f7dc660b740 20 client.5952 trim_cache size 0 max 16384 2024-09-10T08:32:06.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.783+0000 7f7dc660b740 1 Processor -- start 2024-09-10T08:32:06.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 -- start start 2024-09-10T08:32:06.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e180d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc2012f0 con 0x55976e15cec0 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc1f7f40 con 0x55976e118cc0 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc160f10 con 0x55976e15f2a0 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.784+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51176/0 (socket says 172.21.15.52:51176) 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 -- 172.21.15.52:0/3020380700 learned_addr learned my addr 172.21.15.52:0/3020380700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 -- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 msgr2=0x55976e152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 -- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 msgr2=0x55976e180d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e180d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 -- 172.21.15.52:0/3020380700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976de587d0 con 0x55976e15cec0 2024-09-10T08:32:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7da8015010 tx=0x7f7da8026070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adce8770ed0d713 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dacc00640 1 -- 172.21.15.52:0/3020380700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8023790 con 0x55976e15cec0 2024-09-10T08:32:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dacc00640 1 -- 172.21.15.52:0/3020380700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da803e070 con 0x55976e15cec0 2024-09-10T08:32:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.785+0000 7f7dacc00640 1 -- 172.21.15.52:0/3020380700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da802db70 con 0x55976e15cec0 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 -- 172.21.15.52:0/3020380700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 msgr2=0x55976e15e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7da8015010 tx=0x7f7da8026070 comp rx=0 tx=0).stop 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 -- 172.21.15.52:0/3020380700 shutdown_connections 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e15cec0 0x55976e15e600 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 --2- 172.21.15.52:0/3020380700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e118cc0 0x55976e180d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 -- 172.21.15.52:0/3020380700 >> 172.21.15.52:0/3020380700 conn(0x55976e15ca60 msgr2=0x55976e112ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 -- 172.21.15.52:0/3020380700 shutdown_connections 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.786+0000 7f7dc660b740 1 -- 172.21.15.52:0/3020380700 wait complete. 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.787+0000 7f7dc660b740 1 -- start start 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.787+0000 7f7dc660b740 1 Processor -- start 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15cec0 0x55976e152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc161560 con 0x55976e118cc0 2024-09-10T08:32:06.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55976e114490 con 0x55976e15cec0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55976e1db9e0 con 0x55976e15f2a0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc660b740 10 client.0 _ll_register_callbacks cb 0x7f7da8014a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51180/0 (socket says 172.21.15.52:51180) 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc0e00640 1 -- 172.21.15.52:0/1521157225 learned_addr learned my addr 172.21.15.52:0/1521157225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15cec0 0x55976e152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.788+0000 7f7dc1800640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 -- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 msgr2=0x55976e152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 -- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15cec0 msgr2=0x55976e152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15cec0 0x55976e152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 -- 172.21.15.52:0/1521157225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976e15e7c0 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc0e00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7db0078b60 tx=0x7f7db0005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87678cec210dd6a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0004d10 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7db00754d0 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da803e070 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7db00815b0 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc660b740 10 client.5958 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55976e1db720 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da803e070 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.789+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f7db008e040 con 0x55976e118cc0 2024-09-10T08:32:06.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 10 client.5958 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 10 client.5958 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 20 client.5958 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e141360 0x55976e1da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 4 client.5958 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55976e082f10 con 0x55976e141360 2024-09-10T08:32:06.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e141360 0x55976e1da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7da2000640 10 client.5958 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.790+0000 7f7dbbe00640 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e141360 0x55976e1da9e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb3d3602726f078 server_cookie=b7b793840b8ff9cb in_seq=0 out_seq=0 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7da2000640 1 -- 172.21.15.52:0/1521157225 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55976e082f10 con 0x55976e141360 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7da2000640 10 client.5958 handle_command_reply: tid=0 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 client.5958 shutdown 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 msgr2=0x55976e1d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7db0078b60 tx=0x7f7db0005ed0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 shutdown_connections 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x55976e141360 0x55976e1da9e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55976e15f2a0 0x55976e152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55976e15cec0 0x55976e152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 --2- 172.21.15.52:0/1521157225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55976e118cc0 0x55976e1d1530 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 >> 172.21.15.52:0/1521157225 conn(0x55976e15ca60 msgr2=0x55976e111c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7da2000640 0 client.5958 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 shutdown_connections 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 1 -- 172.21.15.52:0/1521157225 wait complete. 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.791+0000 7f7dc660b740 20 client.5958 trim_cache size 0 max 16384 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:06.797 INFO:teuthology.orchestra.run.smithi052.stdout: "damage_type": "backtrace", 2024-09-10T08:32:06.798 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 2805418814, 2024-09-10T08:32:06.798 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 1099511630414, 2024-09-10T08:32:06.798 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-10T08:32:06.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:06.798 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 msgr2=0x7f7d9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc15f2f0 tx=0x7f7da8008040 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 msgr2=0x7f7dbc157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c230 tx=0x7f7dbc0b75d0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 shutdown_connections 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d9c06be30 0x7f7d9c06e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7dbc0c8850 0x7f7dbc15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7dbc1537d0 0x7f7dbc1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 --2- 172.21.15.52:0/2671260525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da4003a00 0x7f7dbc157a10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 >> 172.21.15.52:0/2671260525 conn(0x7f7dbc0d0fd0 msgr2=0x7f7dbc154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 shutdown_connections 2024-09-10T08:32:06.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.792+0000 7f7dc2200640 1 -- 172.21.15.52:0/2671260525 wait complete. 2024-09-10T08:32:06.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.967+0000 7f8bab200640 1 Processor -- start 2024-09-10T08:32:06.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.968+0000 7f8bab200640 1 -- start start 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8bab200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8bac0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8bab200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac0d3990 con 0x7f8bac15e440 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8bab200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac0d3c70 con 0x7f8bac0cf450 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8bab200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0d3f50 con 0x7f8bac0b6710 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8ba9e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8bac15e440 0x7f8bac0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48942/0 (socket says 172.21.15.52:48942) 2024-09-10T08:32:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8ba9e00640 1 -- 172.21.15.52:0/417887381 learned_addr learned my addr 172.21.15.52:0/417887381 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8ba1400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8bac0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.969+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481613611 0 0) 0x7f8bac0d3990 con 0x7f8bac15e440 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b90003520 con 0x7f8bac15e440 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1844047160 0 0) 0x7f8b90003520 con 0x7f8bac15e440 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 msgr2=0x7f8bac0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8bac0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 >> v1:172.21.15.176:6789/0 conn(0x7f8bac0cf450 legacy=0x7f8bac0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac0d4230 con 0x7f8bac15e440 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f8b9c001670 con 0x7f8bac15e440 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 >> v1:172.21.15.52:6789/0 conn(0x7f8bac15e440 legacy=0x7f8bac0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b900039e0 0x7f8b90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b90004800 0x7f8b90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8b900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0d3f50 con 0x7f8b900039e0 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9000ba70 con 0x7f8b90004800 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9000bc40 con 0x7f8bac0b6710 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b900039e0 0x7f8b90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8baa800640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8b900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.970+0000 7f8ba1400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b90004800 0x7f8b90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba9e00640 1 -- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 msgr2=0x7f8b900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8b900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba9e00640 1 -- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b90004800 msgr2=0x7f8b90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b90004800 0x7f8b90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba9e00640 1 -- 172.21.15.52:0/417887381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b90003520 con 0x7f8b900039e0 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8baa800640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bac0b6710 0x7f8b900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.971+0000 7f8ba1400640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b90004800 0x7f8b90004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b900039e0 0x7f8b90003dc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c0e0 tx=0x7f8b90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d48eb72a7b39b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c007c40 con 0x7f8b900039e0 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c005af0 con 0x7f8b900039e0 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8ba9400640 1 -- 172.21.15.52:0/417887381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c007070 con 0x7f8b900039e0 2024-09-10T08:32:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8bab200640 1 -- 172.21.15.52:0/417887381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b900039e0 msgr2=0x7f8b90003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8bab200640 1 --2- 172.21.15.52:0/417887381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b900039e0 0x7f8b90003dc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c0e0 tx=0x7f8b90005830 comp rx=0 tx=0).stop 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8baa800640 1 -- 172.21.15.52:0/417887381 reap_dead start 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8bab200640 1 -- 172.21.15.52:0/417887381 shutdown_connections 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.972+0000 7f8bab200640 1 -- 172.21.15.52:0/417887381 >> 172.21.15.52:0/417887381 conn(0x7f8bac067f80 msgr2=0x7f8bac0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.973+0000 7f8bab200640 1 -- 172.21.15.52:0/417887381 shutdown_connections 2024-09-10T08:32:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.973+0000 7f8bab200640 1 -- 172.21.15.52:0/417887381 wait complete. 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.974+0000 7f8bab200640 1 Processor -- start 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.974+0000 7f8bab200640 1 -- start start 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b900039e0 0x7f8bac0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 0x7f8bac0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0b76c0 con 0x7f8bac0cb810 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0b7540 con 0x7f8bac0c8f50 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8bab200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0d3240 con 0x7f8b900039e0 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8ba1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8ba1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51202/0 (socket says 172.21.15.52:51202) 2024-09-10T08:32:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.975+0000 7f8ba1400640 1 -- 172.21.15.52:0/1252560859 learned_addr learned my addr 172.21.15.52:0/1252560859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b900039e0 0x7f8bac0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8baa800640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 0x7f8bac0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 -- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b900039e0 msgr2=0x7f8bac0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b900039e0 0x7f8bac0ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 -- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 msgr2=0x7f8bac0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 0x7f8bac0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 -- 172.21.15.52:0/1252560859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac15fc00 con 0x7f8bac0cb810 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8baa800640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 0x7f8bac0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba1400640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b94011700 tx=0x7f8b94011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400f960 con 0x7f8bac0cb810 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9400fb00 con 0x7f8bac0cb810 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94015460 con 0x7f8bac0cb810 2024-09-10T08:32:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac0ce780 con 0x7f8bac0cb810 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.976+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac15fe70 con 0x7f8bac0cb810 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.978+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac0d3630 con 0x7f8bac0cb810 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.979+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b94015600 con 0x7f8bac0cb810 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.979+0000 7f8ba2a00640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.980+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8b9408b6b0 con 0x7f8bac0cb810 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.980+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.981+0000 7f8ba9e00640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 0x7f8b8806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c032000 tx=0x7f8b9c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:06.985+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b94019030 con 0x7f8bac0cb810 2024-09-10T08:32:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.209+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bac0b37e0 con 0x7f8bac0cb810 2024-09-10T08:32:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.210+0000 7f8ba2a00640 1 -- 172.21.15.52:0/1252560859 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7f8b9405a060 con 0x7f8bac0cb810 2024-09-10T08:32:07.210 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:07.210 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:32:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:32:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 msgr2=0x7f8b8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 0x7f8b8806e2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c032000 tx=0x7f8b9c009030 comp rx=0 tx=0).stop 2024-09-10T08:32:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 msgr2=0x7f8bac1582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b94011700 tx=0x7f8b94011bc0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 shutdown_connections 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b8806be30 0x7f8b8806e2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bac0c8f50 0x7f8bac0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bac0cb810 0x7f8bac1582c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 --2- 172.21.15.52:0/1252560859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b900039e0 0x7f8bac0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 >> 172.21.15.52:0/1252560859 conn(0x7f8bac067f80 msgr2=0x7f8bac0b8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 shutdown_connections 2024-09-10T08:32:07.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.212+0000 7f8bab200640 1 -- 172.21.15.52:0/1252560859 wait complete. 2024-09-10T08:32:07.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 2805418814 2024-09-10T08:32:07.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.387+0000 7fd9b3a00640 1 Processor -- start 2024-09-10T08:32:07.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.387+0000 7fd9b3a00640 1 -- start start 2024-09-10T08:32:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.388+0000 7fd9b3a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9ac15b7c0 0x7fd9ac0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.388+0000 7fd9b3a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 0x7fd9ac071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b3a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ac0cf2e0 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b3a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac070fe0 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b3a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac0712c0 con 0x7fd9ac0cead0 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9abe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd9ac15b7c0 0x7fd9ac0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b1000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd9ac0ccf30 0x7fd9ac0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48952/0 (socket says 172.21.15.52:48952) 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b1000640 1 -- 172.21.15.52:0/1785819411 learned_addr learned my addr 172.21.15.52:0/1785819411 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/1785819411 >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 0x7fd9ac071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9abe00640 1 -- 172.21.15.52:0/1785819411 >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 msgr2=0x7fd9ac071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9abe00640 1 --2- 172.21.15.52:0/1785819411 >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 0x7fd9ac071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9abe00640 1 -- 172.21.15.52:0/1785819411 >> v1:172.21.15.52:6789/0 conn(0x7fd9ac0ccf30 legacy=0x7fd9ac0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9abe00640 1 -- 172.21.15.52:0/1785819411 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0715a0 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9ab400640 1 -- 172.21.15.52:0/1785819411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461193743 0 0) 0x7fd9ac0cf2e0 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.389+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/1785819411 >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 0x7fd9ac071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.390+0000 7fd9abe00640 1 --2- 172.21.15.52:0/1785819411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac15b7c0 0x7fd9ac0b2c50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac06f170 tx=0x7fd99802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9c5ca1929c1a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9ab400640 1 -- 172.21.15.52:0/1785819411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998037070 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9ab400640 1 -- 172.21.15.52:0/1785819411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd998032440 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9ab400640 1 -- 172.21.15.52:0/1785819411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99802ae60 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 -- 172.21.15.52:0/1785819411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac15b7c0 msgr2=0x7fd9ac0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/1785819411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac15b7c0 0x7fd9ac0b2c50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac06f170 tx=0x7fd99802a110 comp rx=0 tx=0).stop 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 -- 172.21.15.52:0/1785819411 shutdown_connections 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/1785819411 >> v2:172.21.15.176:3300/0 conn(0x7fd9ac0cead0 0x7fd9ac071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/1785819411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac15b7c0 0x7fd9ac0b2c50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 -- 172.21.15.52:0/1785819411 >> 172.21.15.52:0/1785819411 conn(0x7fd9ac06d0f0 msgr2=0x7fd9ac06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 -- 172.21.15.52:0/1785819411 shutdown_connections 2024-09-10T08:32:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.391+0000 7fd9b3a00640 1 -- 172.21.15.52:0/1785819411 wait complete. 2024-09-10T08:32:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.393+0000 7fd9b3a00640 1 Processor -- start 2024-09-10T08:32:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.393+0000 7fd9b3a00640 1 -- start start 2024-09-10T08:32:07.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ac0cead0 0x7fd9ac15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ac15b7c0 0x7fd9ac1f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cf080 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac0cef00 con 0x7fd9ac0cead0 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b3a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac072000 con 0x7fd9ac15b7c0 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51212/0 (socket says 172.21.15.52:51212) 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b1000640 1 -- 172.21.15.52:0/4025986909 learned_addr learned my addr 172.21.15.52:0/4025986909 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9abe00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ac0cead0 0x7fd9ac15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.394+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ac15b7c0 0x7fd9ac1f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 -- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ac15b7c0 msgr2=0x7fd9ac1f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ac15b7c0 0x7fd9ac1f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 -- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ac0cead0 msgr2=0x7fd9ac15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ac0cead0 0x7fd9ac15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 -- 172.21.15.52:0/4025986909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac14b240 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b1000640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000c4d0 tx=0x7fd9a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9a8c00640 1 -- 172.21.15.52:0/4025986909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0018070 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9a8c00640 1 -- 172.21.15.52:0/4025986909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a0007500 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9a8c00640 1 -- 172.21.15.52:0/4025986909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0004a20 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.395+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac14b520 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.396+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac15dc50 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.397+0000 7fd9a8c00640 1 -- 172.21.15.52:0/4025986909 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9a0004bc0 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.398+0000 7fd9a8c00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 0x7fd98c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.398+0000 7fd9a8c00640 1 -- 172.21.15.52:0/4025986909 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a008a0f0 con 0x7fd9ac0ccf30 2024-09-10T08:32:07.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.399+0000 7fd9abe00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 0x7fd98c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.399+0000 7fd9b6a2d740 1 Processor -- start 2024-09-10T08:32:07.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.399+0000 7fd9b6a2d740 1 -- start start 2024-09-10T08:32:07.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.399+0000 7fd9abe00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 0x7fd98c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd998034000 tx=0x7fd99802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 0x5644721cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x564472182e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644720ec700 con 0x564472185ff0 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564472094660 con 0x564472188830 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5644720e86c0 con 0x564472189fc0 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51224/0 (socket says 172.21.15.52:51224) 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9abe00640 1 -- 172.21.15.52:0/2670879237 learned_addr learned my addr 172.21.15.52:0/2670879237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b1000640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 0x5644721cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.400+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x564472182e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 -- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 msgr2=0x564472182e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x564472182e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 -- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 msgr2=0x5644721cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 0x5644721cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 -- 172.21.15.52:0/2670879237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564471ecb710 con 0x564472185ff0 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9b1000640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 0x5644721cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd99802a700 tx=0x7fd99802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a17a11942450ab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd99d600640 1 -- 172.21.15.52:0/2670879237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99804b070 con 0x564472185ff0 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd99d600640 1 -- 172.21.15.52:0/2670879237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd998038040 con 0x564472185ff0 2024-09-10T08:32:07.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.401+0000 7fd99d600640 1 -- 172.21.15.52:0/2670879237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998041040 con 0x564472185ff0 2024-09-10T08:32:07.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2670879237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 msgr2=0x564472188c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd99802a700 tx=0x7fd99802c000 comp rx=0 tx=0).stop 2024-09-10T08:32:07.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2670879237 shutdown_connections 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x564472182e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472185ff0 0x564472188c10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2670879237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564472188830 0x5644721cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2670879237 >> 172.21.15.52:0/2670879237 conn(0x564472184ff0 msgr2=0x5644721cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2670879237 shutdown_connections 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.402+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2670879237 wait complete. 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.403+0000 7fd9b6a2d740 1 -- start start 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.403+0000 7fd9b6a2d740 1 Processor -- start 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x5644721d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x564472182650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564472184490 con 0x564472188830 2024-09-10T08:32:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5644720a7880 con 0x5644721d1500 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5644721ce800 con 0x564472189fc0 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b6a2d740 10 client.0 _ll_register_callbacks cb 0x564472099360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51232/0 (socket says 172.21.15.52:51232) 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 -- 172.21.15.52:0/323397185 learned_addr learned my addr 172.21.15.52:0/323397185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x564472182650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9abe00640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x5644721d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 -- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 msgr2=0x5644721d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x5644721d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 -- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 msgr2=0x564472182650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x564472182650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.404+0000 7fd9b1000640 1 -- 172.21.15.52:0/323397185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564471f2bea0 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b1000640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0088580 tx=0x7fd9a0057e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b995e3125888e667 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0060ee0 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a0057800 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd998038040 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd9a0057a00 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b6a2d740 10 client.5979 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x564471dbf000 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd998038040 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd9a005c150 con 0x564472188830 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b6a2d740 10 client.5979 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.405+0000 7fd9b6a2d740 10 client.5979 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:32:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9b6a2d740 20 client.5979 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x564472182b90 0x564472186e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9b6a2d740 4 client.5979 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644720f9e30 con 0x564472182b90 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9abe00640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x564472182b90 0x564472186e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd9abe00640 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x564472182b90 0x564472186e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69796c981face05f server_cookie=c49805141e8e0ded in_seq=0 out_seq=0 2024-09-10T08:32:07.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.406+0000 7fd992000640 10 client.5979 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd992000640 1 -- 172.21.15.52:0/323397185 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644720f9e30 con 0x564472182b90 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd992000640 10 client.5979 handle_command_reply: tid=0 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 client.5979 shutdown 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 msgr2=0x5644721b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0088580 tx=0x7fd9a0057e40 comp rx=0 tx=0).stop 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 shutdown_connections 2024-09-10T08:32:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x564472182b90 0x564472186e80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x564472182650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x5644721d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd992000640 0 client.5979 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/323397185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721b10d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 >> 172.21.15.52:0/323397185 conn(0x564472185ff0 msgr2=0x5644721ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 shutdown_connections 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.407+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/323397185 wait complete. 2024-09-10T08:32:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.408+0000 7fd9b6a2d740 20 client.5979 trim_cache size 0 max 16384 2024-09-10T08:32:07.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 Processor -- start 2024-09-10T08:32:07.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 -- start start 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447217e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac151f80 con 0x564472188830 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac14de00 con 0x5644721d1500 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.422+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac151930 con 0x564472189fc0 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51238/0 (socket says 172.21.15.52:51238) 2024-09-10T08:32:07.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 -- 172.21.15.52:0/1840894328 learned_addr learned my addr 172.21.15.52:0/1840894328 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9abe00640 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447217e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 -- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 msgr2=0x56447217e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447217e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 -- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 msgr2=0x5644721cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 -- 172.21.15.52:0/1840894328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644721ae170 con 0x564472188830 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.423+0000 7fd9b1000640 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000ce90 tx=0x7fd9a0009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c702cf2576d36df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd99cc00640 1 -- 172.21.15.52:0/1840894328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00881f0 con 0x564472188830 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd99cc00640 1 -- 172.21.15.52:0/1840894328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a005c150 con 0x564472188830 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd99cc00640 1 -- 172.21.15.52:0/1840894328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0054100 con 0x564472188830 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/1840894328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 msgr2=0x5644721d0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000ce90 tx=0x7fd9a0009070 comp rx=0 tx=0).stop 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/1840894328 shutdown_connections 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447217e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/1840894328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721d0850 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/1840894328 >> 172.21.15.52:0/1840894328 conn(0x564472185ff0 msgr2=0x5644721b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/1840894328 shutdown_connections 2024-09-10T08:32:07.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.424+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/1840894328 wait complete. 2024-09-10T08:32:07.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.425+0000 7fd9b6a2d740 1 -- start start 2024-09-10T08:32:07.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.425+0000 7fd9b6a2d740 1 Processor -- start 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447224b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644721b1840 con 0x564472188830 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5644721b1a30 con 0x5644721d1500 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5644721a6ca0 con 0x564472189fc0 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b6a2d740 10 client.0 _ll_register_callbacks cb 0x7fd9a0057f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51246/0 (socket says 172.21.15.52:51246) 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.426+0000 7fd9b1000640 1 -- 172.21.15.52:0/2318947032 learned_addr learned my addr 172.21.15.52:0/2318947032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447224b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1a00640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 -- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 msgr2=0x56447224b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447224b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 -- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 msgr2=0x5644721cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 -- 172.21.15.52:0/2318947032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644721ca1f0 con 0x564472188830 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b1000640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00580b0 tx=0x7fd9a005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2e4fc86e3a0a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd992000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0060ee0 con 0x564472188830 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a0054310 con 0x564472188830 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.427+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9a005c150 con 0x564472188830 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd9a0077300 con 0x564472188830 2024-09-10T08:32:07.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 10 client.5985 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5644721ca1f0 con 0x564472188830 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a005c150 con 0x564472188830 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd9a0057270 con 0x564472188830 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 10 client.5985 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 10 client.5985 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 20 client.5985 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5644721f0c60 0x5644721f1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 4 client.5985 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 2805418814}] 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2805418814}) -- 0x5644720f4180 con 0x5644721f0c60 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.428+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5644721f0c60 0x5644721f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9abe00640 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5644721f0c60 0x5644721f1040 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b05425ca07b33aa server_cookie=e1b43cce793af8d8 in_seq=0 out_seq=0 2024-09-10T08:32:07.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd992000640 10 client.5985 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd992000640 1 -- 172.21.15.52:0/2318947032 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x5644720f4180 con 0x5644721f0c60 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd992000640 10 client.5985 handle_command_reply: tid=0 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 client.5985 shutdown 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 msgr2=0x5644721cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00580b0 tx=0x7fd9a005b040 comp rx=0 tx=0).stop 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 shutdown_connections 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5644721f0c60 0x5644721f1040 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5644721d1500 0x5644721cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564472189fc0 0x56447224b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 --2- 172.21.15.52:0/2318947032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564472188830 0x5644721cca80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd992000640 0 client.5985 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 >> 172.21.15.52:0/2318947032 conn(0x564472185ff0 msgr2=0x5644721af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 shutdown_connections 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 1 -- 172.21.15.52:0/2318947032 wait complete. 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.429+0000 7fd9b6a2d740 20 client.5985 trim_cache size 0 max 16384 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 msgr2=0x7fd98c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 0x7fd98c06e2f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd998034000 tx=0x7fd99802e000 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 msgr2=0x7fd9ac140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000c4d0 tx=0x7fd9a000c990 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 shutdown_connections 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd98c06be30 0x7fd98c06e2f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9ac15b7c0 0x7fd9ac1f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9ac0cead0 0x7fd9ac15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 --2- 172.21.15.52:0/4025986909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9ac0ccf30 0x7fd9ac140150 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 >> 172.21.15.52:0/4025986909 conn(0x7fd9ac06d0f0 msgr2=0x7fd9ac15f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 shutdown_connections 2024-09-10T08:32:07.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.430+0000 7fd9b3a00640 1 -- 172.21.15.52:0/4025986909 wait complete. 2024-09-10T08:32:07.445 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-10T08:32:07.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-10T08:32:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.603+0000 7f81c5600640 1 Processor -- start 2024-09-10T08:32:07.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.603+0000 7f81c5600640 1 -- start start 2024-09-10T08:32:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.604+0000 7f81c5600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81c00b3350 0x7f81c00d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.604+0000 7f81c5600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c00cf710 con 0x7f81c006bfd0 2024-09-10T08:32:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.604+0000 7f81c5600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c00cf9f0 con 0x7f81c00b38a0 2024-09-10T08:32:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.604+0000 7f81c5600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f81c00b78a0 con 0x7f81c00b3350 2024-09-10T08:32:07.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81be000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81c00b3350 0x7f81c00d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81bea00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f81c006bfd0 0x7f81c006c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48966/0 (socket says 172.21.15.52:48966) 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81be000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81c00b3350 0x7f81c00d2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51262/0 (socket says 172.21.15.52:51262) 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81bea00640 1 -- 172.21.15.52:0/1284749064 learned_addr learned my addr 172.21.15.52:0/1284749064 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81bf400640 1 --1- 172.21.15.52:0/1284749064 >> v1:172.21.15.176:6789/0 conn(0x7f81c00b38a0 0x7f81c00d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39150/0 (socket says 172.21.15.52:39150) 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81be000640 1 -- 172.21.15.52:0/1284749064 >> v1:172.21.15.176:6789/0 conn(0x7f81c00b38a0 legacy=0x7f81c00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81be000640 1 -- 172.21.15.52:0/1284749064 >> v1:172.21.15.52:6789/0 conn(0x7f81c006bfd0 legacy=0x7f81c006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.605+0000 7f81be000640 1 -- 172.21.15.52:0/1284749064 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c00cfcd0 con 0x7f81c00b3350 2024-09-10T08:32:07.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.606+0000 7f81be000640 1 --2- 172.21.15.52:0/1284749064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c00d2920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0097a0 tx=0x7f81ac02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e4a971eed00e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.606+0000 7f81bd600640 1 -- 172.21.15.52:0/1284749064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac037070 con 0x7f81c00b3350 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81bd600640 1 -- 172.21.15.52:0/1284749064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac032640 con 0x7f81c00b3350 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81bd600640 1 -- 172.21.15.52:0/1284749064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac032a10 con 0x7f81c00b3350 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 -- 172.21.15.52:0/1284749064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 msgr2=0x7f81c00d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 --2- 172.21.15.52:0/1284749064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c00d2920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0097a0 tx=0x7f81ac02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 -- 172.21.15.52:0/1284749064 shutdown_connections 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 --2- 172.21.15.52:0/1284749064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c00d2920 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 -- 172.21.15.52:0/1284749064 >> 172.21.15.52:0/1284749064 conn(0x7f81c00d11c0 msgr2=0x7f81c00d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 -- 172.21.15.52:0/1284749064 shutdown_connections 2024-09-10T08:32:07.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.607+0000 7f81c5600640 1 -- 172.21.15.52:0/1284749064 wait complete. 2024-09-10T08:32:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.609+0000 7f81c5600640 1 Processor -- start 2024-09-10T08:32:07.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.609+0000 7f81c5600640 1 -- start start 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 0x7f81c00cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81c00b38a0 0x7f81c01f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81c006cd50 con 0x7f81c00b3350 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81c00cffb0 con 0x7f81c00b38a0 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81c5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81c015eae0 con 0x7f81c006bfd0 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51274/0 (socket says 172.21.15.52:51274) 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.610+0000 7f81be000640 1 -- 172.21.15.52:0/1857600962 learned_addr learned my addr 172.21.15.52:0/1857600962 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81bea00640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 0x7f81c00cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81bf400640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81c00b38a0 0x7f81c01f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 -- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 msgr2=0x7f81c00cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 0x7f81c00cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 -- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81c00b38a0 msgr2=0x7f81c01f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81c00b38a0 0x7f81c01f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 -- 172.21.15.52:0/1857600962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c00cb160 con 0x7f81c00b3350 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81bea00640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 0x7f81c00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81be000640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0098c0 tx=0x7f81ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81b6a00640 1 -- 172.21.15.52:0/1857600962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac041070 con 0x7f81c00b3350 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81b6a00640 1 -- 172.21.15.52:0/1857600962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac032e10 con 0x7f81c00b3350 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.611+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c0160d20 con 0x7f81c00b3350 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.612+0000 7f81b6a00640 1 -- 172.21.15.52:0/1857600962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac037040 con 0x7f81c00b3350 2024-09-10T08:32:07.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.612+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c00c8950 con 0x7f81c00b3350 2024-09-10T08:32:07.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.614+0000 7f81b6a00640 1 -- 172.21.15.52:0/1857600962 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81ac044070 con 0x7f81c00b3350 2024-09-10T08:32:07.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.615+0000 7f81b6a00640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 0x7f81a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.615+0000 7f81b6a00640 1 -- 172.21.15.52:0/1857600962 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f81ac0abc10 con 0x7f81c00b3350 2024-09-10T08:32:07.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.615+0000 7f81bea00640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 0x7f81a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.615+0000 7f81c841f740 1 Processor -- start 2024-09-10T08:32:07.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.615+0000 7f81c841f740 1 -- start start 2024-09-10T08:32:07.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81bea00640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 0x7f81a006e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81b0000f60 tx=0x7f81b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa601450 0x5593fa604070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa5fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5593fa567500 con 0x5593fa603c90 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5593fa50f520 con 0x5593fa605420 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.616+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5593fa5634c0 con 0x5593fa601450 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51284/0 (socket says 172.21.15.52:51284) 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 -- 172.21.15.52:0/2144728781 learned_addr learned my addr 172.21.15.52:0/2144728781 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bf400640 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa5fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81be000640 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa601450 0x5593fa604070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 -- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa601450 msgr2=0x5593fa604070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa601450 0x5593fa604070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 -- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 msgr2=0x5593fa5fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa5fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 -- 172.21.15.52:0/2144728781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fa27a240 con 0x5593fa603c90 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.617+0000 7f81bea00640 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005910 tx=0x7f81b0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b71f0887d0f9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81ab000640 1 -- 172.21.15.52:0/2144728781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000e7e0 con 0x5593fa603c90 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81ab000640 1 -- 172.21.15.52:0/2144728781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b000e980 con 0x5593fa603c90 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81ab000640 1 -- 172.21.15.52:0/2144728781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ed30 con 0x5593fa603c90 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 -- 172.21.15.52:0/2144728781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 msgr2=0x5593fa649430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005910 tx=0x7f81b0011000 comp rx=0 tx=0).stop 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 -- 172.21.15.52:0/2144728781 shutdown_connections 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa5fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa601450 0x5593fa604070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 --2- 172.21.15.52:0/2144728781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa649430 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.618+0000 7f81c841f740 1 -- 172.21.15.52:0/2144728781 >> 172.21.15.52:0/2144728781 conn(0x5593fa6006e0 msgr2=0x5593fa648900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.619+0000 7f81c841f740 1 -- 172.21.15.52:0/2144728781 shutdown_connections 2024-09-10T08:32:07.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.619+0000 7f81c841f740 1 -- 172.21.15.52:0/2144728781 wait complete. 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.619+0000 7f81c841f740 1 -- start start 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.619+0000 7f81c841f740 1 Processor -- start 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa603c90 0x5593fa62e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa62c160 0x5593fa6272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5593fa5ffb80 con 0x5593fa605420 2024-09-10T08:32:07.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5593fa522680 con 0x5593fa62c160 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5593fa649c60 con 0x5593fa603c90 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.620+0000 7f81c841f740 10 client.0 _ll_register_callbacks cb 0x5593fa527570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51294/0 (socket says 172.21.15.52:51294) 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 -- 172.21.15.52:0/690737884 learned_addr learned my addr 172.21.15.52:0/690737884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81bea00640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa603c90 0x5593fa62e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81bf400640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa62c160 0x5593fa6272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 -- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa603c90 msgr2=0x5593fa62e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa603c90 0x5593fa62e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 -- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa62c160 msgr2=0x5593fa6272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa62c160 0x5593fa6272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 -- 172.21.15.52:0/690737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fa344620 con 0x5593fa605420 2024-09-10T08:32:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f81be000640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0097a0 tx=0x7f81ac07a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e840fd1a659ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.621+0000 7f819f400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac082b20 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f81ac082690 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b000e980 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81ac082890 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 10 client.5997 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5593fa62cf40 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b000e980 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f81ac030bc0 con 0x5593fa605420 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 10 client.5997 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 10 client.5997 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:07.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 20 client.5997 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa65c6f0 0x5593fa65cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 4 client.5997 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593fa574c30 con 0x5593fa65c6f0 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.622+0000 7f81bea00640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa65c6f0 0x5593fa65cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.623+0000 7f81bea00640 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa65c6f0 0x5593fa65cb00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63894ed40908f3a0 server_cookie=10bd0dcb94b57225 in_seq=0 out_seq=0 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.623+0000 7f819f400640 10 client.5997 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f819f400640 1 -- 172.21.15.52:0/690737884 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593fa574c30 con 0x5593fa65c6f0 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f819f400640 10 client.5997 handle_command_reply: tid=0 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 client.5997 shutdown 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 msgr2=0x5593fa625f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0097a0 tx=0x7f81ac07a5b0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 shutdown_connections 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa65c6f0 0x5593fa65cb00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa62c160 0x5593fa6272f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa625f00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 --2- 172.21.15.52:0/690737884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa603c90 0x5593fa62e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 >> 172.21.15.52:0/690737884 conn(0x5593fa601450 msgr2=0x5593fa646980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f819f400640 0 client.5997 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 shutdown_connections 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 1 -- 172.21.15.52:0/690737884 wait complete. 2024-09-10T08:32:07.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.624+0000 7f81c841f740 20 client.5997 trim_cache size 0 max 16384 2024-09-10T08:32:07.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.640+0000 7f81c841f740 1 Processor -- start 2024-09-10T08:32:07.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.640+0000 7f81c841f740 1 -- start start 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa603c90 0x5593fa627bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5593fa62edd0 con 0x5593fa605420 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0200ee0 con 0x5593fa603c90 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81c01fff20 con 0x5593fa62c160 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51298/0 (socket says 172.21.15.52:51298) 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 -- 172.21.15.52:0/2416605269 learned_addr learned my addr 172.21.15.52:0/2416605269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 -- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 msgr2=0x5593fa646980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 -- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa603c90 msgr2=0x5593fa627bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa603c90 0x5593fa627bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 -- 172.21.15.52:0/2416605269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593fa62e840 con 0x5593fa605420 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.641+0000 7f81be000640 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f81ac079bb0 tx=0x7f81ac03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1caa3b9965e03ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81aa600640 1 -- 172.21.15.52:0/2416605269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac082b20 con 0x5593fa605420 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81aa600640 1 -- 172.21.15.52:0/2416605269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac0781b0 con 0x5593fa605420 2024-09-10T08:32:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81aa600640 1 -- 172.21.15.52:0/2416605269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0793f0 con 0x5593fa605420 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 -- 172.21.15.52:0/2416605269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 msgr2=0x5593fa66cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f81ac079bb0 tx=0x7f81ac03e000 comp rx=0 tx=0).stop 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 -- 172.21.15.52:0/2416605269 shutdown_connections 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa605420 0x5593fa66cdb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 --2- 172.21.15.52:0/2416605269 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa603c90 0x5593fa627bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 -- 172.21.15.52:0/2416605269 >> 172.21.15.52:0/2416605269 conn(0x5593fa601450 msgr2=0x5593fa625c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 -- 172.21.15.52:0/2416605269 shutdown_connections 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.642+0000 7f81c841f740 1 -- 172.21.15.52:0/2416605269 wait complete. 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.643+0000 7f81c841f740 1 -- start start 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.643+0000 7f81c841f740 1 Processor -- start 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa62ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ff8d0 con 0x5593fa603c90 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81c00ce3d0 con 0x5593fa605420 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5593fa626970 con 0x5593fa62c160 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81c841f740 10 client.0 _ll_register_callbacks cb 0x7f81ac006c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81bea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81bea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51304/0 (socket says 172.21.15.52:51304) 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81bea00640 1 -- 172.21.15.52:0/2180313504 learned_addr learned my addr 172.21.15.52:0/2180313504 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81bf400640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.644+0000 7f81be000640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa62ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 -- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 msgr2=0x5593fa646980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 -- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 msgr2=0x5593fa62ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa62ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 -- 172.21.15.52:0/2180313504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593fa66c380 con 0x5593fa603c90 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81be000640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa62ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81bea00640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f81b0001550 tx=0x7f81b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97b430e90f58f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f819f400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ecf0 con 0x5593fa603c90 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f81b0021450 con 0x5593fa603c90 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81ac0781b0 con 0x5593fa603c90 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81b0039050 con 0x5593fa603c90 2024-09-10T08:32:07.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81c841f740 10 client.6003 fetch_fsmap learned FSMap version 27 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.645+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5593fa66b6b0 con 0x5593fa603c90 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ac0781b0 con 0x5593fa603c90 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f81b003c020 con 0x5593fa603c90 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 10 client.6003 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 10 client.6003 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 20 client.6003 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa646ec0 0x5593fa64be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 4 client.6003 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 --> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5593fa62f300 con 0x5593fa646ec0 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81be000640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa646ec0 0x5593fa64be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f81be000640 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa646ec0 0x5593fa64be10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d95b838ea8e348a server_cookie=9eff91243d2810b0 in_seq=0 out_seq=0 2024-09-10T08:32:07.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.646+0000 7f819f400640 10 client.6003 ms_handle_connect on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f819f400640 1 -- 172.21.15.52:0/2180313504 <== mds.0 v2:172.21.15.52:6833/3839158402 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593fa62f300 con 0x5593fa646ec0 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f819f400640 10 client.6003 handle_command_reply: tid=0 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 client.6003 shutdown 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 msgr2=0x5593fa65b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f81b0001550 tx=0x7f81b0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 shutdown_connections 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:6833/3839158402,v1:172.21.15.52:6835/3839158402] conn(0x5593fa646ec0 0x5593fa64be10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5593fa62c160 0x5593fa646980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5593fa605420 0x5593fa62ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 --2- 172.21.15.52:0/2180313504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5593fa603c90 0x5593fa65b260 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 >> 172.21.15.52:0/2180313504 conn(0x5593fa601450 msgr2=0x5593fa625a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f819f400640 0 client.6003 ms_handle_reset on v2:172.21.15.52:6833/3839158402 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 shutdown_connections 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 1 -- 172.21.15.52:0/2180313504 wait complete. 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.649+0000 7f81c841f740 20 client.6003 trim_cache size 0 max 16384 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:32:07.654 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:07.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 msgr2=0x7f81a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 0x7f81a006e2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81b0000f60 tx=0x7f81b0009040 comp rx=0 tx=0).stop 2024-09-10T08:32:07.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 msgr2=0x7f81c0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:07.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0098c0 tx=0x7f81ac0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 shutdown_connections 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81a006be30 0x7f81a006e2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81c00b38a0 0x7f81c01f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c00b3350 0x7f81c0160260 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 --2- 172.21.15.52:0/1857600962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81c006bfd0 0x7f81c00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 >> 172.21.15.52:0/1857600962 conn(0x7f81c00d11c0 msgr2=0x7f81c00cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 shutdown_connections 2024-09-10T08:32:07.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:07.650+0000 7f81c5600640 1 -- 172.21.15.52:0/1857600962 wait complete. 2024-09-10T08:32:07.666 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-10T08:32:07.666 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:32:07.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:07.764 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:07.854 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:32:07.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:07.854 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:07.854 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:07.890 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:07.890 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:07.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:32:08.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.162+0000 7fdbbd800640 1 Processor -- start 2024-09-10T08:32:08.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.162+0000 7fdbbd800640 1 -- start start 2024-09-10T08:32:08.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbbd800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdbb8145ed0 0x7fdbb80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbbd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 0x7fdbb80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbbd800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb80b4020 con 0x7fdbb8073180 2024-09-10T08:32:08.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbbd800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdbb8073b00 con 0x7fdbb8145ed0 2024-09-10T08:32:08.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbbd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb80b42c0 con 0x7fdbb80b5f90 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbb7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 0x7fdbb80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbae000640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdbb8073180 0x7fdbb80b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39162/0 (socket says 172.21.15.52:39162) 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbae000640 1 -- 172.21.15.52:0/513764913 learned_addr learned my addr 172.21.15.52:0/513764913 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.164+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/513764913 >> v2:172.21.15.176:3300/0 conn(0x7fdbb8145ed0 0x7fdbb80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb6000640 1 -- 172.21.15.52:0/513764913 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977546524 0 0) 0x7fdbb80b4020 con 0x7fdbb8073180 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb6a00640 1 -- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 msgr2=0x7fdbb80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 0x7fdbb80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb6a00640 1 -- 172.21.15.52:0/513764913 >> v1:172.21.15.176:6789/0 conn(0x7fdbb8073180 legacy=0x7fdbb80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb6a00640 1 -- 172.21.15.52:0/513764913 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb80b45a0 con 0x7fdbb8145ed0 2024-09-10T08:32:08.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.165+0000 7fdbb7400640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 0x7fdbb80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.166+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb8145ed0 0x7fdbb80b5080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8073c80 tx=0x7fdba802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b92163239d0d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.166+0000 7fdbb6000640 1 -- 172.21.15.52:0/513764913 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8037070 con 0x7fdbb8145ed0 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.166+0000 7fdbb6000640 1 -- 172.21.15.52:0/513764913 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba8032440 con 0x7fdbb8145ed0 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.166+0000 7fdbb6000640 1 -- 172.21.15.52:0/513764913 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8032810 con 0x7fdbb8145ed0 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 -- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb8145ed0 msgr2=0x7fdbb80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb8145ed0 0x7fdbb80b5080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8073c80 tx=0x7fdba802a180 comp rx=0 tx=0).stop 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 -- 172.21.15.52:0/513764913 shutdown_connections 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb80b5f90 0x7fdbb80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 --2- 172.21.15.52:0/513764913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb8145ed0 0x7fdbb80b5080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 -- 172.21.15.52:0/513764913 >> 172.21.15.52:0/513764913 conn(0x7fdbb80ccec0 msgr2=0x7fdbb80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 -- 172.21.15.52:0/513764913 shutdown_connections 2024-09-10T08:32:08.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.167+0000 7fdbbd800640 1 -- 172.21.15.52:0/513764913 wait complete. 2024-09-10T08:32:08.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.168+0000 7fdbbd800640 1 Processor -- start 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.169+0000 7fdbbd800640 1 -- start start 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.169+0000 7fdbbd800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.169+0000 7fdbbd800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 0x7fdbb8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbbd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb8145ed0 0x7fdbb81576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbbd800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb81462b0 con 0x7fdbb8073180 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbbd800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb80b4b60 con 0x7fdbb80b5f90 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbbd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb8146430 con 0x7fdbb8145ed0 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51310/0 (socket says 172.21.15.52:51310) 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 -- 172.21.15.52:0/2284525303 learned_addr learned my addr 172.21.15.52:0/2284525303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbae000640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 0x7fdbb8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb7400640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb8145ed0 0x7fdbb81576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 -- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb8145ed0 msgr2=0x7fdbb81576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb8145ed0 0x7fdbb81576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 -- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 msgr2=0x7fdbb8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 0x7fdbb8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbb6a00640 1 -- 172.21.15.52:0/2284525303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb81563a0 con 0x7fdbb8073180 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.170+0000 7fdbae000640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 0x7fdbb8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbb6a00640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009890 tx=0x7fdba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8037040 con 0x7fdbb8073180 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba8042070 con 0x7fdbb8073180 2024-09-10T08:32:08.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba80308a0 con 0x7fdbb8073180 2024-09-10T08:32:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb8156680 con 0x7fdbb8073180 2024-09-10T08:32:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.171+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb813d350 con 0x7fdbb8073180 2024-09-10T08:32:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.172+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb80735c0 con 0x7fdbb8073180 2024-09-10T08:32:08.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.173+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdba8030a40 con 0x7fdbb8073180 2024-09-10T08:32:08.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.174+0000 7fdbaf400640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 0x7fdb9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:08.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.174+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fdba80ab6d0 con 0x7fdbb8073180 2024-09-10T08:32:08.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.174+0000 7fdbae000640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 0x7fdb9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:08.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.175+0000 7fdbae000640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 0x7fdb9406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8072f90 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:08.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.178+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdba807a070 con 0x7fdbb8073180 2024-09-10T08:32:08.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.381+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdbb80cd720 con 0x7fdbb8073180 2024-09-10T08:32:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.382+0000 7fdbaf400640 1 -- 172.21.15.52:0/2284525303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) ==== 80+0+0 (secure 0 0 0) 0x7fdba8079970 con 0x7fdbb8073180 2024-09-10T08:32:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 msgr2=0x7fdb9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 0x7fdb9406e2f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8072f90 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 msgr2=0x7fdbb81553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009890 tx=0x7fdba80046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 shutdown_connections 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb9406be30 0x7fdb9406e2f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdbb8145ed0 0x7fdbb81576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbb80b5f90 0x7fdbb8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 --2- 172.21.15.52:0/2284525303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbb8073180 0x7fdbb81553c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 >> 172.21.15.52:0/2284525303 conn(0x7fdbb80ccec0 msgr2=0x7fdbb80b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 shutdown_connections 2024-09-10T08:32:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:08.384+0000 7fdbbd800640 1 -- 172.21.15.52:0/2284525303 wait complete. 2024-09-10T08:32:08.400 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:32:08.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:08.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:09.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:32:09.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:09.741 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:32:09.778 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:09.778 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:09.778 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:09.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:09.816 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:09.816 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:09.816 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:09.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:32:09.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:09.854 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:09.854 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:09.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:09.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.050+0000 7fc13fe00640 1 Processor -- start 2024-09-10T08:32:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.050+0000 7fc13fe00640 1 -- start start 2024-09-10T08:32:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc14015e440 0x7fc1400d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 0x7fc1400b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1400d3990 con 0x7fc1400cf450 2024-09-10T08:32:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc1400d3c70 con 0x7fc14015e440 2024-09-10T08:32:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400d3f50 con 0x7fc1400b6710 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc136000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc1400cf450 0x7fc1400b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48980/0 (socket says 172.21.15.52:48980) 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc136000640 1 -- 172.21.15.52:0/2788826102 learned_addr learned my addr 172.21.15.52:0/2788826102 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13ea00640 1 --2- 172.21.15.52:0/2788826102 >> v2:172.21.15.176:3300/0 conn(0x7fc14015e440 0x7fc1400d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.051+0000 7fc13f400640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 0x7fc1400b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13e000640 1 -- 172.21.15.52:0/2788826102 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882014353 0 0) 0x7fc1400d3990 con 0x7fc1400cf450 2024-09-10T08:32:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13e000640 1 -- 172.21.15.52:0/2788826102 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc124003520 con 0x7fc1400cf450 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13ea00640 1 -- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 msgr2=0x7fc1400b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13ea00640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 0x7fc1400b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13ea00640 1 -- 172.21.15.52:0/2788826102 >> v1:172.21.15.52:6789/0 conn(0x7fc1400cf450 legacy=0x7fc1400b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13ea00640 1 -- 172.21.15.52:0/2788826102 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1400d4230 con 0x7fc14015e440 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.052+0000 7fc13f400640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 0x7fc1400b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.053+0000 7fc13ea00640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc14015e440 0x7fc1400d3240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1300097a0 tx=0x7fc13002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=854b68319e1fc714 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.053+0000 7fc13e000640 1 -- 172.21.15.52:0/2788826102 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130037070 con 0x7fc14015e440 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.053+0000 7fc13e000640 1 -- 172.21.15.52:0/2788826102 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130032440 con 0x7fc14015e440 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.053+0000 7fc13e000640 1 -- 172.21.15.52:0/2788826102 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130032810 con 0x7fc14015e440 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 -- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc14015e440 msgr2=0x7fc1400d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc14015e440 0x7fc1400d3240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc1300097a0 tx=0x7fc13002a210 comp rx=0 tx=0).stop 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 -- 172.21.15.52:0/2788826102 shutdown_connections 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1400b6710 0x7fc1400b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 --2- 172.21.15.52:0/2788826102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc14015e440 0x7fc1400d3240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 -- 172.21.15.52:0/2788826102 >> 172.21.15.52:0/2788826102 conn(0x7fc140067f80 msgr2=0x7fc1400d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 -- 172.21.15.52:0/2788826102 shutdown_connections 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.054+0000 7fc13fe00640 1 -- 172.21.15.52:0/2788826102 wait complete. 2024-09-10T08:32:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.056+0000 7fc13fe00640 1 Processor -- start 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.056+0000 7fc13fe00640 1 -- start start 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 0x7fc14015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14015e440 0x7fc1400caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1400b76c0 con 0x7fc1400cf450 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1400b7540 con 0x7fc1400b6710 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400b80a0 con 0x7fc14015e440 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51324/0 (socket says 172.21.15.52:51324) 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 -- 172.21.15.52:0/4191591935 learned_addr learned my addr 172.21.15.52:0/4191591935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13f400640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14015e440 0x7fc1400caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc13ea00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 0x7fc14015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 -- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14015e440 msgr2=0x7fc1400caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14015e440 0x7fc1400caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 -- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 msgr2=0x7fc14015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.057+0000 7fc136000640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 0x7fc14015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc136000640 1 -- 172.21.15.52:0/4191591935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14015ab70 con 0x7fc1400cf450 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc13ea00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 0x7fc14015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc136000640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc12800c430 tx=0x7fc12800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128017070 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128005ce0 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1280072f0 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1401601d0 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.058+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc140160790 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.059+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1400b7b60 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.060+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc12801a070 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.061+0000 7fc137400640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 0x7fc11c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.061+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc12808a400 con 0x7fc1400cf450 2024-09-10T08:32:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.061+0000 7fc13ea00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 0x7fc11c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.062+0000 7fc13ea00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 0x7fc11c06e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc130034000 tx=0x7fc13002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.065+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc128058d10 con 0x7fc1400cf450 2024-09-10T08:32:10.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.288+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1400761d0 con 0x7fc1400cf450 2024-09-10T08:32:10.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.289+0000 7fc137400640 1 -- 172.21.15.52:0/4191591935 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fc128058610 con 0x7fc1400cf450 2024-09-10T08:32:10.289 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:10.289 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:32:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 msgr2=0x7fc11c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 0x7fc11c06e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc130034000 tx=0x7fc13002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 msgr2=0x7fc1401f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc12800c430 tx=0x7fc12800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 shutdown_connections 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc11c06be30 0x7fc11c06e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc14015e440 0x7fc1400caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1400cf450 0x7fc1401f40f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 --2- 172.21.15.52:0/4191591935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1400b6710 0x7fc14015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 >> 172.21.15.52:0/4191591935 conn(0x7fc140067f80 msgr2=0x7fc1400b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:10.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 shutdown_connections 2024-09-10T08:32:10.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.291+0000 7fc13fe00640 1 -- 172.21.15.52:0/4191591935 wait complete. 2024-09-10T08:32:10.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.463+0000 7fa801000640 1 Processor -- start 2024-09-10T08:32:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.463+0000 7fa801000640 1 -- start start 2024-09-10T08:32:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa801000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7fc15eec0 0x7fa7fc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa801000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7fc15d7c0 0x7fa7fc15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa801000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7fc0b6660 con 0x7fa7fc1522d0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa801000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa7fc15f860 con 0x7fa7fc15d7c0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa801000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc15ca90 con 0x7fa7fc15eec0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa7fb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa7fc1522d0 0x7fa7fc0b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48988/0 (socket says 172.21.15.52:48988) 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.464+0000 7fa7fb400640 1 -- 172.21.15.52:0/3589755517 learned_addr learned my addr 172.21.15.52:0/3589755517 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7f3e00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7fc15eec0 0x7fa7fc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/3589755517 >> v2:172.21.15.176:3300/0 conn(0x7fa7fc15d7c0 0x7fa7fc15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438074734 0 0) 0x7fa7fc0b6660 con 0x7fa7fc1522d0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7e0003520 con 0x7fa7fc1522d0 2024-09-10T08:32:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428109309 0 0) 0x7fa7e0003520 con 0x7fa7fc1522d0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7fc15eec0 msgr2=0x7fa7fc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7fc15eec0 0x7fa7fc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 >> v2:172.21.15.176:3300/0 conn(0x7fa7fc15d7c0 msgr2=0x7fa7fc15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 --2- 172.21.15.52:0/3589755517 >> v2:172.21.15.176:3300/0 conn(0x7fa7fc15d7c0 0x7fa7fc15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc15cce0 con 0x7fa7fc1522d0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fa7ec001670 con 0x7fa7fc1522d0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 >> v1:172.21.15.52:6789/0 conn(0x7fa7fc1522d0 legacy=0x7fa7fc0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00043a0 0x7fa7e0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e0004ef0 0x7fa7e000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc15ca90 con 0x7fa7e0004ef0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e000e110 con 0x7fa7e00043a0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.465+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e000e290 con 0x7fa7e00039b0 2024-09-10T08:32:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e0004ef0 0x7fa7e000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7f3e00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00043a0 0x7fa7e0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 -- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00043a0 msgr2=0x7fa7e0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00043a0 0x7fa7e0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 -- 172.21.15.52:0/3589755517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e0004ef0 msgr2=0x7fa7e000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e0004ef0 0x7fa7e000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fb400640 1 -- 172.21.15.52:0/3589755517 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e0003520 con 0x7fa7e00039b0 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e0004ef0 0x7fa7e000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.466+0000 7fa7f3e00640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7e00043a0 0x7fa7e0004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.467+0000 7fa7fb400640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c290 tx=0x7fa7e0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c62d7c029155c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007d50 con 0x7fa7e00039b0 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec005af0 con 0x7fa7e00039b0 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa7faa00640 1 -- 172.21.15.52:0/3589755517 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007070 con 0x7fa7e00039b0 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 -- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 msgr2=0x7fa7e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 --2- 172.21.15.52:0/3589755517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7e0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00c290 tx=0x7fa7e0005830 comp rx=0 tx=0).stop 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa7fbe00640 1 -- 172.21.15.52:0/3589755517 reap_dead start 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 -- 172.21.15.52:0/3589755517 shutdown_connections 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 -- 172.21.15.52:0/3589755517 >> 172.21.15.52:0/3589755517 conn(0x7fa7fc06c240 msgr2=0x7fa7fc06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 -- 172.21.15.52:0/3589755517 shutdown_connections 2024-09-10T08:32:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.468+0000 7fa801000640 1 -- 172.21.15.52:0/3589755517 wait complete. 2024-09-10T08:32:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.470+0000 7fa801000640 1 Processor -- start 2024-09-10T08:32:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.470+0000 7fa801000640 1 -- start start 2024-09-10T08:32:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7fc149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7fc1566f0 0x7fa7fc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc15fc80 con 0x7fa7fc159c20 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc15d2a0 con 0x7fa7fc1566f0 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa801000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc0b62b0 con 0x7fa7e00039b0 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.471+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51336/0 (socket says 172.21.15.52:51336) 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 -- 172.21.15.52:0/1530134797 learned_addr learned my addr 172.21.15.52:0/1530134797 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fb400640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7fc149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7f3e00640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7fc1566f0 0x7fa7fc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 -- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 msgr2=0x7fa7fc149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7fc149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 -- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7fc1566f0 msgr2=0x7fa7fc156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7fc1566f0 0x7fa7fc156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 -- 172.21.15.52:0/1530134797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc1571b0 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fb400640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7fc149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7fbe00640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc15dba0 tx=0x7fa7f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.472+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4009650 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.473+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4003990 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.473+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4009c10 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.473+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc153c60 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.473+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc1511d0 con 0x7fa7fc159c20 2024-09-10T08:32:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.474+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc0b6070 con 0x7fa7fc159c20 2024-09-10T08:32:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.475+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7f4015430 con 0x7fa7fc159c20 2024-09-10T08:32:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.476+0000 7fa7f3400640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.476+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fa7f408b8a0 con 0x7fa7fc159c20 2024-09-10T08:32:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.476+0000 7fa7fb400640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.477+0000 7fa7fb400640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 0x7fa7d806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec033000 tx=0x7fa7ec009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.480+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7f4019030 con 0x7fa7fc159c20 2024-09-10T08:32:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.700+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7fc15e230 con 0x7fa7fc159c20 2024-09-10T08:32:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.701+0000 7fa7f3400640 1 -- 172.21.15.52:0/1530134797 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fa7f4010040 con 0x7fa7fc159c20 2024-09-10T08:32:10.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:10.702 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:32:10.702 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:32:10.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 msgr2=0x7fa7d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 0x7fa7d806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec033000 tx=0x7fa7ec009030 comp rx=0 tx=0).stop 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 msgr2=0x7fa7fc15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc15dba0 tx=0x7fa7f400f580 comp rx=0 tx=0).stop 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 shutdown_connections 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc159c20 0x7fa7fc15a080 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7fc1566f0 0x7fa7fc156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 --2- 172.21.15.52:0/1530134797 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7e00039b0 0x7fa7fc149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 >> 172.21.15.52:0/1530134797 conn(0x7fa7fc06c240 msgr2=0x7fa7fc0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:10.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 shutdown_connections 2024-09-10T08:32:10.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.703+0000 7fa801000640 1 -- 172.21.15.52:0/1530134797 wait complete. 2024-09-10T08:32:10.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:10.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.875+0000 7fbc5ee00640 1 Processor -- start 2024-09-10T08:32:10.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.875+0000 7fbc5ee00640 1 -- start start 2024-09-10T08:32:10.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc580d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5ee00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580d3990 con 0x7fbc5815e440 2024-09-10T08:32:10.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5ee00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580d3c70 con 0x7fbc580cf450 2024-09-10T08:32:10.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc580d3f50 con 0x7fbc580b6710 2024-09-10T08:32:10.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5da00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc5815e440 0x7fbc580b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49002/0 (socket says 172.21.15.52:49002) 2024-09-10T08:32:10.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.876+0000 7fbc5da00640 1 -- 172.21.15.52:0/849437798 learned_addr learned my addr 172.21.15.52:0/849437798 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:10.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc5d000640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc580d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70343856 0 0) 0x7fbc580d3990 con 0x7fbc5815e440 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc40003520 con 0x7fbc5815e440 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1311638418 0 0) 0x7fbc40003520 con 0x7fbc5815e440 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 msgr2=0x7fbc580d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc580d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 >> v1:172.21.15.176:6789/0 conn(0x7fbc580cf450 legacy=0x7fbc580b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc580d4230 con 0x7fbc5815e440 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fbc4c001670 con 0x7fbc5815e440 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 >> v1:172.21.15.52:6789/0 conn(0x7fbc5815e440 legacy=0x7fbc580b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc40003fb0 0x7fbc40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc580d3f50 con 0x7fbc40003fb0 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4000bb90 con 0x7fbc40004d40 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.877+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4000bd90 con 0x7fbc580b6710 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc40003fb0 0x7fbc40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5da00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5e400640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 -- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 msgr2=0x7fbc400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc580b6710 0x7fbc400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 -- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc40004d40 msgr2=0x7fbc400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:10.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc40004d40 0x7fbc400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.878+0000 7fbc5d000640 1 -- 172.21.15.52:0/849437798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc40003520 con 0x7fbc40003fb0 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.879+0000 7fbc5d000640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc40003fb0 0x7fbc40004800 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009ac0 tx=0x7fbc40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72363b72c41c0df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.879+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44036070 con 0x7fbc40003fb0 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.879+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44031400 con 0x7fbc40003fb0 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.879+0000 7fbc57e00640 1 -- 172.21.15.52:0/849437798 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44009690 con 0x7fbc40003fb0 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 -- 172.21.15.52:0/849437798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc40003fb0 msgr2=0x7fbc40004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/849437798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc40003fb0 0x7fbc40004800 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009ac0 tx=0x7fbc40005830 comp rx=0 tx=0).stop 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5e400640 1 -- 172.21.15.52:0/849437798 reap_dead start 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 -- 172.21.15.52:0/849437798 shutdown_connections 2024-09-10T08:32:10.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 -- 172.21.15.52:0/849437798 >> 172.21.15.52:0/849437798 conn(0x7fbc58067f80 msgr2=0x7fbc580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:10.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 -- 172.21.15.52:0/849437798 shutdown_connections 2024-09-10T08:32:10.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.880+0000 7fbc5ee00640 1 -- 172.21.15.52:0/849437798 wait complete. 2024-09-10T08:32:10.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.882+0000 7fbc5ee00640 1 Processor -- start 2024-09-10T08:32:10.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.882+0000 7fbc5ee00640 1 -- start start 2024-09-10T08:32:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc40003fb0 0x7fbc581571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 0x7fbc581e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc580b76c0 con 0x7fbc5815abc0 2024-09-10T08:32:10.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbc580b7540 con 0x7fbc581e8310 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbc580d3240 con 0x7fbc40003fb0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51354/0 (socket says 172.21.15.52:51354) 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5d000640 1 -- 172.21.15.52:0/3764951801 learned_addr learned my addr 172.21.15.52:0/3764951801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.883+0000 7fbc5da00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc40003fb0 0x7fbc581571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5e400640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 0x7fbc581e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 -- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc40003fb0 msgr2=0x7fbc581571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc40003fb0 0x7fbc581571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 -- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 msgr2=0x7fbc581e8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 0x7fbc581e8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 -- 172.21.15.52:0/3764951801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5815b660 con 0x7fbc5815abc0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5e400640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 0x7fbc581e8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5d000640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbc44034040 tx=0x7fbc44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44040020 con 0x7fbc5815abc0 2024-09-10T08:32:10.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44003c60 con 0x7fbc5815abc0 2024-09-10T08:32:10.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44036040 con 0x7fbc5815abc0 2024-09-10T08:32:10.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.884+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc581e50c0 con 0x7fbc5815abc0 2024-09-10T08:32:10.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.885+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc581e5680 con 0x7fbc5815abc0 2024-09-10T08:32:10.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.886+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc580d3650 con 0x7fbc5815abc0 2024-09-10T08:32:10.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.886+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc44043020 con 0x7fbc5815abc0 2024-09-10T08:32:10.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.887+0000 7fbc55600640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 0x7fbc3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:10.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.887+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fbc440ab310 con 0x7fbc5815abc0 2024-09-10T08:32:10.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.888+0000 7fbc5da00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 0x7fbc3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:10.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.889+0000 7fbc5da00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 0x7fbc3806e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007c60 tx=0x7fbc4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:10.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:10.891+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc4404a030 con 0x7fbc5815abc0 2024-09-10T08:32:11.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.075+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc580ba350 con 0x7fbc5815abc0 2024-09-10T08:32:11.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.076+0000 7fbc55600640 1 -- 172.21.15.52:0/3764951801 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16681 (secure 0 0 0) 0x7fbc4404c300 con 0x7fbc5815abc0 2024-09-10T08:32:11.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:11.077 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":49,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:38.220247+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:31:34.450298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T08:31:35.644857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 msgr2=0x7fbc3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 0x7fbc3806e320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c007c60 tx=0x7fbc4c009040 comp rx=0 tx=0).stop 2024-09-10T08:32:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 msgr2=0x7fbc5815b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbc44034040 tx=0x7fbc44004730 comp rx=0 tx=0).stop 2024-09-10T08:32:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 shutdown_connections 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.078+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbc3806be60 0x7fbc3806e320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc581e8310 0x7fbc581e8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc5815abc0 0x7fbc5815b040 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 --2- 172.21.15.52:0/3764951801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc40003fb0 0x7fbc581571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 >> 172.21.15.52:0/3764951801 conn(0x7fbc58067f80 msgr2=0x7fbc5806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 shutdown_connections 2024-09-10T08:32:11.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.079+0000 7fbc5ee00640 1 -- 172.21.15.52:0/3764951801 wait complete. 2024-09-10T08:32:11.094 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:32:11.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.251+0000 7ff1d3e00640 1 Processor -- start 2024-09-10T08:32:11.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.251+0000 7ff1d3e00640 1 -- start start 2024-09-10T08:32:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1d40cf9a0 0x7ff1d415c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d40b4370 con 0x7ff1d40cf5c0 2024-09-10T08:32:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d40b4650 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d40b4dc0 con 0x7ff1d40b3e00 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1cbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:32988/0 (socket says 172.21.15.52:32988) 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d3400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1d40cf9a0 0x7ff1d415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1d2a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff1d40cf5c0 0x7ff1d40b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39182/0 (socket says 172.21.15.52:39182) 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.252+0000 7ff1cbe00640 1 -- 172.21.15.52:0/80433220 learned_addr learned my addr 172.21.15.52:0/80433220 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.253+0000 7ff1cbe00640 1 -- 172.21.15.52:0/80433220 >> v2:172.21.15.176:3300/0 conn(0x7ff1d40cf9a0 msgr2=0x7ff1d415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.253+0000 7ff1cbe00640 1 --2- 172.21.15.52:0/80433220 >> v2:172.21.15.176:3300/0 conn(0x7ff1d40cf9a0 0x7ff1d415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.253+0000 7ff1cbe00640 1 -- 172.21.15.52:0/80433220 >> v1:172.21.15.176:6789/0 conn(0x7ff1d40cf5c0 legacy=0x7ff1d40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.253+0000 7ff1cbe00640 1 -- 172.21.15.52:0/80433220 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d40b50a0 con 0x7ff1d40b3e00 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.254+0000 7ff1cbe00640 1 --2- 172.21.15.52:0/80433220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66bbe0b9d64f93be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.254+0000 7ff1d2000640 1 -- 172.21.15.52:0/80433220 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc037070 con 0x7ff1d40b3e00 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.254+0000 7ff1d2000640 1 -- 172.21.15.52:0/80433220 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc032440 con 0x7ff1d40b3e00 2024-09-10T08:32:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.254+0000 7ff1d2000640 1 -- 172.21.15.52:0/80433220 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc032810 con 0x7ff1d40b3e00 2024-09-10T08:32:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 -- 172.21.15.52:0/80433220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 msgr2=0x7ff1d415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/80433220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009870 tx=0x7ff1bc02a130 comp rx=0 tx=0).stop 2024-09-10T08:32:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 -- 172.21.15.52:0/80433220 shutdown_connections 2024-09-10T08:32:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/80433220 >> v2:172.21.15.176:3300/0 conn(0x7ff1d40cf9a0 0x7ff1d415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/80433220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d415bfe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 -- 172.21.15.52:0/80433220 >> 172.21.15.52:0/80433220 conn(0x7ff1d406c240 msgr2=0x7ff1d406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 -- 172.21.15.52:0/80433220 shutdown_connections 2024-09-10T08:32:11.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.255+0000 7ff1d3e00640 1 -- 172.21.15.52:0/80433220 wait complete. 2024-09-10T08:32:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.257+0000 7ff1d3e00640 1 Processor -- start 2024-09-10T08:32:11.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.257+0000 7ff1d3e00640 1 -- start start 2024-09-10T08:32:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d40cf5c0 0x7ff1d41562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 0x7ff1d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d415cbe0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d415ca60 con 0x7ff1d40cf5c0 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d415cd60 con 0x7ff1d40b3e00 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 0x7ff1d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:33000/0 (socket says 172.21.15.52:33000) 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1d2a00640 1 -- 172.21.15.52:0/3295978261 learned_addr learned my addr 172.21.15.52:0/3295978261 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.258+0000 7ff1cbe00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d40cf5c0 0x7ff1d41562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 -- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 msgr2=0x7ff1d414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 -- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d40cf5c0 msgr2=0x7ff1d41562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d40cf5c0 0x7ff1d41562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 -- 172.21.15.52:0/3295978261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4155200 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3400640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 0x7ff1d406d0f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00ebd0 tx=0x7ff1cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc018020 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00cd20 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41554e0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0146c0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.259+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d4155aa0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.261+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40b36f0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.262+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1cc005d10 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.262+0000 7ff1caa00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 0x7ff1b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.262+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7ff1cc08ba40 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.263+0000 7ff1d2a00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 0x7ff1b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.263+0000 7ff1d2a00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 0x7ff1b006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4004de0 tx=0x7ff1c4007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.267+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1cc022030 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.489+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1d40cdad0 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.489+0000 7ff1caa00640 1 -- 172.21.15.52:0/3295978261 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7ff1cc08be20 con 0x7ff1d40cf9a0 2024-09-10T08:32:11.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:11.490 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:32:11.490 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:32:11.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 msgr2=0x7ff1b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 0x7ff1b006e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4004de0 tx=0x7ff1c4007f10 comp rx=0 tx=0).stop 2024-09-10T08:32:11.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 msgr2=0x7ff1d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 0x7ff1d406d0f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00ebd0 tx=0x7ff1cc00c490 comp rx=0 tx=0).stop 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 shutdown_connections 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff1b006be30 0x7ff1b006e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d40cf9a0 0x7ff1d406d0f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d40cf5c0 0x7ff1d41562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 --2- 172.21.15.52:0/3295978261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1d40b3e00 0x7ff1d414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 >> 172.21.15.52:0/3295978261 conn(0x7ff1d406c240 msgr2=0x7ff1d4072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 shutdown_connections 2024-09-10T08:32:11.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.492+0000 7ff1d3e00640 1 -- 172.21.15.52:0/3295978261 wait complete. 2024-09-10T08:32:11.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.663+0000 7fe03bc00640 1 Processor -- start 2024-09-10T08:32:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.663+0000 7fe03bc00640 1 -- start start 2024-09-10T08:32:11.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe03bc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe034162490 0x7fe03415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe03bc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0340b66b0 0x7fe0340b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe03bc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0340b7000 con 0x7fe03415eab0 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe03bc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe03415f570 con 0x7fe034162490 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe03bc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe03415f850 con 0x7fe0340b66b0 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe033e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe034162490 0x7fe03415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe033e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe034162490 0x7fe03415ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51372/0 (socket says 172.21.15.52:51372) 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.664+0000 7fe033e00640 1 -- 172.21.15.52:0/1232490323 learned_addr learned my addr 172.21.15.52:0/1232490323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.665+0000 7fe039c00640 1 --2- 172.21.15.52:0/1232490323 >> v2:172.21.15.176:3300/0 conn(0x7fe0340b66b0 0x7fe0340b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.665+0000 7fe033e00640 1 -- 172.21.15.52:0/1232490323 >> v2:172.21.15.176:3300/0 conn(0x7fe0340b66b0 msgr2=0x7fe0340b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:11.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.665+0000 7fe033e00640 1 --2- 172.21.15.52:0/1232490323 >> v2:172.21.15.176:3300/0 conn(0x7fe0340b66b0 0x7fe0340b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.665+0000 7fe033e00640 1 -- 172.21.15.52:0/1232490323 >> v1:172.21.15.52:6789/0 conn(0x7fe03415eab0 legacy=0x7fe0340d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.665+0000 7fe033e00640 1 -- 172.21.15.52:0/1232490323 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03415fb30 con 0x7fe034162490 2024-09-10T08:32:11.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.666+0000 7fe033e00640 1 --2- 172.21.15.52:0/1232490323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe034162490 0x7fe03415ee90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe03408d8c0 tx=0x7fe02002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985ef004a0465849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.666+0000 7fe033400640 1 -- 172.21.15.52:0/1232490323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020037070 con 0x7fe034162490 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.666+0000 7fe033400640 1 -- 172.21.15.52:0/1232490323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020032440 con 0x7fe034162490 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.666+0000 7fe033400640 1 -- 172.21.15.52:0/1232490323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020032810 con 0x7fe034162490 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 -- 172.21.15.52:0/1232490323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe034162490 msgr2=0x7fe03415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 --2- 172.21.15.52:0/1232490323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe034162490 0x7fe03415ee90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe03408d8c0 tx=0x7fe02002a270 comp rx=0 tx=0).stop 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 -- 172.21.15.52:0/1232490323 shutdown_connections 2024-09-10T08:32:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 --2- 172.21.15.52:0/1232490323 >> v2:172.21.15.176:3300/0 conn(0x7fe0340b66b0 0x7fe0340b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 --2- 172.21.15.52:0/1232490323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe034162490 0x7fe03415ee90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 -- 172.21.15.52:0/1232490323 >> 172.21.15.52:0/1232490323 conn(0x7fe0340d16d0 msgr2=0x7fe0340d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 -- 172.21.15.52:0/1232490323 shutdown_connections 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.667+0000 7fe03bc00640 1 -- 172.21.15.52:0/1232490323 wait complete. 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.668+0000 7fe03bc00640 1 Processor -- start 2024-09-10T08:32:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 -- start start 2024-09-10T08:32:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 0x7fe03415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe034162490 0x7fe03414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340d4460 con 0x7fe03415eab0 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340cef20 con 0x7fe034162490 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.669+0000 7fe03bc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe0340d45e0 con 0x7fe0340b66b0 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51386/0 (socket says 172.21.15.52:51386) 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 -- 172.21.15.52:0/2283206345 learned_addr learned my addr 172.21.15.52:0/2283206345 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe039c00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe034162490 0x7fe03414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe039200640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 0x7fe03415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 -- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 msgr2=0x7fe03415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 0x7fe03415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 -- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe034162490 msgr2=0x7fe03414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe034162490 0x7fe03414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe033e00640 1 -- 172.21.15.52:0/2283206345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03414aa70 con 0x7fe03415eab0 2024-09-10T08:32:11.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.670+0000 7fe039200640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 0x7fe03415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:11.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe033e00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe020000c00 tx=0x7fe0200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020037040 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020042070 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020030880 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03414ad50 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.671+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0340cc020 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.672+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0340b6ac0 con 0x7fe03415eab0 2024-09-10T08:32:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.673+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe020030a20 con 0x7fe03415eab0 2024-09-10T08:32:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.674+0000 7fe030c00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 0x7fe01406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.674+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe0200ab6f0 con 0x7fe03415eab0 2024-09-10T08:32:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.674+0000 7fe039200640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 0x7fe01406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.675+0000 7fe039200640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 0x7fe01406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0340b8e60 tx=0x7fe028009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.678+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe02007a000 con 0x7fe03415eab0 2024-09-10T08:32:11.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.896+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0340d2500 con 0x7fe03415eab0 2024-09-10T08:32:11.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.897+0000 7fe030c00640 1 -- 172.21.15.52:0/2283206345 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5229 (secure 0 0 0) 0x7fe020079900 con 0x7fe03415eab0 2024-09-10T08:32:11.897 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:11.897 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-10T08:31:53:565669+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:31:36.642091+0000","modified":"2024-09-10T08:31:53.254691+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.52:6835/3839158402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3839158402},{"type":"v1","addr":"172.21.15.52:6835","nonce":3839158402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-10T08:32:11.898 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 msgr2=0x7fe01406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 0x7fe01406e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0340b8e60 tx=0x7fe028009040 comp rx=0 tx=0).stop 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 msgr2=0x7fe03414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe020000c00 tx=0x7fe0200046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 shutdown_connections 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe01406be30 0x7fe01406e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe034162490 0x7fe03414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe03415eab0 0x7fe03414c8b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 --2- 172.21.15.52:0/2283206345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0340b66b0 0x7fe03415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:11.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 >> 172.21.15.52:0/2283206345 conn(0x7fe0340d16d0 msgr2=0x7fe0340cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:11.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 shutdown_connections 2024-09-10T08:32:11.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:11.899+0000 7fe03bc00640 1 -- 172.21.15.52:0/2283206345 wait complete. 2024-09-10T08:32:11.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.072+0000 7fe662600640 1 Processor -- start 2024-09-10T08:32:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.072+0000 7fe662600640 1 -- start start 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 0x7fe65c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 0x7fe65c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe65c0b66a0 0x7fe65c0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c15f590 con 0x7fe65c0b66a0 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe65c15f870 con 0x7fe65c1624b0 2024-09-10T08:32:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.073+0000 7fe662600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c15fb50 con 0x7fe65c15eb60 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe65c0b66a0 0x7fe65c0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe65c0b66a0 0x7fe65c0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51396/0 (socket says 172.21.15.52:51396) 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 -- 172.21.15.52:0/2960908589 learned_addr learned my addr 172.21.15.52:0/2960908589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65aa00640 1 --2- 172.21.15.52:0/2960908589 >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 0x7fe65c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65b400640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 0x7fe65c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 -- 172.21.15.52:0/2960908589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 msgr2=0x7fe65c15ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 0x7fe65c15ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 -- 172.21.15.52:0/2960908589 >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 msgr2=0x7fe65c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 --2- 172.21.15.52:0/2960908589 >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 0x7fe65c0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65be00640 1 -- 172.21.15.52:0/2960908589 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c15fe30 con 0x7fe65c0b66a0 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65aa00640 1 --2- 172.21.15.52:0/2960908589 >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 0x7fe65c0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.074+0000 7fe65b400640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 0x7fe65c15ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.075+0000 7fe65be00640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c0b6b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0d5950 tx=0x7fe65402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47451870f5a5be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.075+0000 7fe65a000640 1 -- 172.21.15.52:0/2960908589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654036070 con 0x7fe65c0b66a0 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.075+0000 7fe65a000640 1 -- 172.21.15.52:0/2960908589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe654031600 con 0x7fe65c0b66a0 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.075+0000 7fe65a000640 1 -- 172.21.15.52:0/2960908589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540319d0 con 0x7fe65c0b66a0 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 -- 172.21.15.52:0/2960908589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 msgr2=0x7fe65c0b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c0b6b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0d5950 tx=0x7fe65402a570 comp rx=0 tx=0).stop 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 -- 172.21.15.52:0/2960908589 shutdown_connections 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 --2- 172.21.15.52:0/2960908589 >> v2:172.21.15.176:3300/0 conn(0x7fe65c1624b0 0x7fe65c0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c0b6b50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 --2- 172.21.15.52:0/2960908589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c15eb60 0x7fe65c15ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 -- 172.21.15.52:0/2960908589 >> 172.21.15.52:0/2960908589 conn(0x7fe65c0d16f0 msgr2=0x7fe65c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 -- 172.21.15.52:0/2960908589 shutdown_connections 2024-09-10T08:32:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.076+0000 7fe662600640 1 -- 172.21.15.52:0/2960908589 wait complete. 2024-09-10T08:32:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.078+0000 7fe662600640 1 Processor -- start 2024-09-10T08:32:12.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.078+0000 7fe662600640 1 -- start start 2024-09-10T08:32:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe65c15eb60 0x7fe65c0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c1624b0 0x7fe65c1f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0d4480 con 0x7fe65c0b66a0 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c0d3190 con 0x7fe65c15eb60 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe662600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c0d4600 con 0x7fe65c1624b0 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51398/0 (socket says 172.21.15.52:51398) 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 -- 172.21.15.52:0/101589685 learned_addr learned my addr 172.21.15.52:0/101589685 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 -- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c1624b0 msgr2=0x7fe65c1f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c1624b0 0x7fe65c1f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 -- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe65c15eb60 msgr2=0x7fe65c0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe65c15eb60 0x7fe65c0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.079+0000 7fe65b400640 1 -- 172.21.15.52:0/101589685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c0c8cf0 con 0x7fe65c0b66a0 2024-09-10T08:32:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe65b400640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c7f0 tx=0x7fe64c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c015070 con 0x7fe65c0b66a0 2024-09-10T08:32:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64c007a30 con 0x7fe65c0b66a0 2024-09-10T08:32:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64c007e00 con 0x7fe65c0b66a0 2024-09-10T08:32:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65c0c8fd0 con 0x7fe65c0b66a0 2024-09-10T08:32:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.080+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65c15a280 con 0x7fe65c0b66a0 2024-09-10T08:32:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.081+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65c0d2520 con 0x7fe65c0b66a0 2024-09-10T08:32:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.082+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe64c018070 con 0x7fe65c0b66a0 2024-09-10T08:32:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.083+0000 7fe653400640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.083+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe64c08ad90 con 0x7fe65c0b66a0 2024-09-10T08:32:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.083+0000 7fe65aa00640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.084+0000 7fe65aa00640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 0x7fe63c06e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe648006fd0 tx=0x7fe648008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.087+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe64c059730 con 0x7fe65c0b66a0 2024-09-10T08:32:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.274+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe65c0ba7d0 con 0x7fe65c0b66a0 2024-09-10T08:32:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.275+0000 7fe653400640 1 -- 172.21.15.52:0/101589685 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16681 (secure 0 0 0) 0x7fe64c059030 con 0x7fe65c0b66a0 2024-09-10T08:32:12.275 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:12.276 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":49,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:31:38.220247+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:31:34.450298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-10T08:31:35.644857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 msgr2=0x7fe63c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 0x7fe63c06e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe648006fd0 tx=0x7fe648008040 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 msgr2=0x7fe65c159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00c7f0 tx=0x7fe64c00ccb0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 shutdown_connections 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe63c06be60 0x7fe63c06e320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe65c1624b0 0x7fe65c1f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe65c15eb60 0x7fe65c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 --2- 172.21.15.52:0/101589685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe65c0b66a0 0x7fe65c159d40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 >> 172.21.15.52:0/101589685 conn(0x7fe65c0d16f0 msgr2=0x7fe65c0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 shutdown_connections 2024-09-10T08:32:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.277+0000 7fe662600640 1 -- 172.21.15.52:0/101589685 wait complete. 2024-09-10T08:32:12.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:32:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.451+0000 7f8545400640 1 Processor -- start 2024-09-10T08:32:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.451+0000 7f8545400640 1 -- start start 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f8545400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8540145ed0 0x7f85400b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f8545400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 0x7f85400735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f8545400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85400b4020 con 0x7f8540073180 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f8545400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f85400b63d0 con 0x7f8540145ed0 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f8545400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8540073b00 con 0x7f85400b5f90 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f853e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8540145ed0 0x7f85400b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f853e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8540145ed0 0x7f85400b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51400/0 (socket says 172.21.15.52:51400) 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f853e800640 1 -- 172.21.15.52:0/4258608332 learned_addr learned my addr 172.21.15.52:0/4258608332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.452+0000 7f853f200640 1 --2- 172.21.15.52:0/4258608332 >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 0x7f85400735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.453+0000 7f853e800640 1 -- 172.21.15.52:0/4258608332 >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 msgr2=0x7f85400735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.453+0000 7f853e800640 1 --2- 172.21.15.52:0/4258608332 >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 0x7f85400735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.453+0000 7f853e800640 1 -- 172.21.15.52:0/4258608332 >> v1:172.21.15.176:6789/0 conn(0x7f8540073180 legacy=0x7f85400b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.453+0000 7f853e800640 1 -- 172.21.15.52:0/4258608332 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85400b42c0 con 0x7f8540145ed0 2024-09-10T08:32:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.453+0000 7f853f200640 1 --2- 172.21.15.52:0/4258608332 >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 0x7f85400735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f853e800640 1 --2- 172.21.15.52:0/4258608332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540145ed0 0x7f85400b5080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8540070080 tx=0x7f853002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfde15eabbbf0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f853d400640 1 -- 172.21.15.52:0/4258608332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530037070 con 0x7f8540145ed0 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f853d400640 1 -- 172.21.15.52:0/4258608332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8530032440 con 0x7f8540145ed0 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f853d400640 1 -- 172.21.15.52:0/4258608332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530032810 con 0x7f8540145ed0 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f8545400640 1 -- 172.21.15.52:0/4258608332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540145ed0 msgr2=0x7f85400b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.454+0000 7f8545400640 1 --2- 172.21.15.52:0/4258608332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540145ed0 0x7f85400b5080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8540070080 tx=0x7f853002a270 comp rx=0 tx=0).stop 2024-09-10T08:32:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 -- 172.21.15.52:0/4258608332 shutdown_connections 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 --2- 172.21.15.52:0/4258608332 >> v2:172.21.15.176:3300/0 conn(0x7f85400b5f90 0x7f85400735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 --2- 172.21.15.52:0/4258608332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540145ed0 0x7f85400b5080 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 -- 172.21.15.52:0/4258608332 >> 172.21.15.52:0/4258608332 conn(0x7f85400ccec0 msgr2=0x7f85400cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 -- 172.21.15.52:0/4258608332 shutdown_connections 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.455+0000 7f8545400640 1 -- 172.21.15.52:0/4258608332 wait complete. 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.456+0000 7f8545400640 1 Processor -- start 2024-09-10T08:32:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.456+0000 7f8545400640 1 -- start start 2024-09-10T08:32:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 0x7f85400727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 0x7f8540159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85400b4b60 con 0x7f8540073180 2024-09-10T08:32:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85400b4880 con 0x7f8540145ed0 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f8545400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85401462b0 con 0x7f85400b5f90 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.457+0000 7f853e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51416/0 (socket says 172.21.15.52:51416) 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 -- 172.21.15.52:0/3776286553 learned_addr learned my addr 172.21.15.52:0/3776286553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853de00640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 0x7f85400727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853f200640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 0x7f8540159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 -- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 msgr2=0x7f85400727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 0x7f85400727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 -- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 msgr2=0x7f8540159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 0x7f8540159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 -- 172.21.15.52:0/3776286553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8540157300 con 0x7f8540073180 2024-09-10T08:32:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853de00640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 0x7f85400727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853f200640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 0x7f8540159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f853e800640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f853002a2b0 tx=0x7f85300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.458+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530041020 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.459+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85300306c0 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.459+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530037040 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.459+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8540154ee0 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.459+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401554a0 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.460+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85400735c0 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.460+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8530044020 con 0x7f8540073180 2024-09-10T08:32:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.461+0000 7f8536a00640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 0x7f852006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.461+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f85300ab6a0 con 0x7f8540073180 2024-09-10T08:32:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.462+0000 7f853de00640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 0x7f852006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.463+0000 7f853de00640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 0x7f852006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85401427a0 tx=0x7f852c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.466+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f853004b030 con 0x7f8540073180 2024-09-10T08:32:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.688+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85400686b0 con 0x7f8540073180 2024-09-10T08:32:12.688 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:32:12.688+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:32:12.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.691+0000 7f8536a00640 1 -- 172.21.15.52:0/3776286553 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f8540157300 con 0x7f8540073180 2024-09-10T08:32:12.691 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:32:12.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.694+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 msgr2=0x7f852006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.694+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 0x7f852006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85401427a0 tx=0x7f852c009040 comp rx=0 tx=0).stop 2024-09-10T08:32:12.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.694+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 msgr2=0x7f8540156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.694+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f853002a2b0 tx=0x7f85300046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 shutdown_connections 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f852006be30 0x7f852006e2f0 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f85401427a0 tx=0x7f852c009040 comp rx=0 tx=0).stop 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8540145ed0 0x7f8540159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85400b5f90 0x7f85400727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 --2- 172.21.15.52:0/3776286553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8540073180 0x7f8540156dc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 >> 172.21.15.52:0/3776286553 conn(0x7f85400ccec0 msgr2=0x7f85400b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.695+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 shutdown_connections 2024-09-10T08:32:12.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.696+0000 7f8545400640 1 -- 172.21.15.52:0/3776286553 wait complete. 2024-09-10T08:32:12.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:32:12.777 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:32:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.881+0000 7f9ca9c00640 1 Processor -- start 2024-09-10T08:32:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.882+0000 7f9ca9c00640 1 -- start start 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca9c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ca40cce30 0x7f9ca40cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca9c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ca4071c70 0x7f9ca40720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca9c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca40714b0 con 0x7f9ca40732e0 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca9c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca40cd880 con 0x7f9ca4071c70 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca9c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca40cdb60 con 0x7f9ca40cce30 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca2a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ca40732e0 0x7f9ca40736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49018/0 (socket says 172.21.15.52:49018) 2024-09-10T08:32:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca2a00640 1 -- 172.21.15.52:0/629719898 learned_addr learned my addr 172.21.15.52:0/629719898 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca3400640 1 --2- 172.21.15.52:0/629719898 >> v2:172.21.15.52:3300/0 conn(0x7f9ca4071c70 0x7f9ca40720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9c9be00640 1 --2- 172.21.15.52:0/629719898 >> v2:172.21.15.176:3300/0 conn(0x7f9ca40cce30 0x7f9ca40cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.883+0000 7f9ca2000640 1 -- 172.21.15.52:0/629719898 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487174951 0 0) 0x7f9ca40714b0 con 0x7f9ca40732e0 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.884+0000 7f9ca2000640 1 -- 172.21.15.52:0/629719898 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c88003520 con 0x7f9ca40732e0 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.884+0000 7f9ca3400640 1 -- 172.21.15.52:0/629719898 >> v2:172.21.15.176:3300/0 conn(0x7f9ca40cce30 msgr2=0x7f9ca40cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.884+0000 7f9ca3400640 1 --2- 172.21.15.52:0/629719898 >> v2:172.21.15.176:3300/0 conn(0x7f9ca40cce30 0x7f9ca40cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.884+0000 7f9ca3400640 1 -- 172.21.15.52:0/629719898 >> v1:172.21.15.52:6789/0 conn(0x7f9ca40732e0 legacy=0x7f9ca40736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.884+0000 7f9ca3400640 1 -- 172.21.15.52:0/629719898 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca40cde40 con 0x7f9ca4071c70 2024-09-10T08:32:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.885+0000 7f9ca3400640 1 --2- 172.21.15.52:0/629719898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca40720c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40c57f0 tx=0x7f9c9c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901f86c8cb18307b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.885+0000 7f9ca2000640 1 -- 172.21.15.52:0/629719898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c007740 con 0x7f9ca4071c70 2024-09-10T08:32:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.885+0000 7f9ca2000640 1 -- 172.21.15.52:0/629719898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c0078e0 con 0x7f9ca4071c70 2024-09-10T08:32:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.885+0000 7f9ca2000640 1 -- 172.21.15.52:0/629719898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c007cb0 con 0x7f9ca4071c70 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 -- 172.21.15.52:0/629719898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 msgr2=0x7f9ca40720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/629719898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca40720c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40c57f0 tx=0x7f9c9c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 -- 172.21.15.52:0/629719898 shutdown_connections 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/629719898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca40720c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/629719898 >> v2:172.21.15.176:3300/0 conn(0x7f9ca40cce30 0x7f9ca40cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 -- 172.21.15.52:0/629719898 >> 172.21.15.52:0/629719898 conn(0x7f9ca406d0f0 msgr2=0x7f9ca406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 -- 172.21.15.52:0/629719898 shutdown_connections 2024-09-10T08:32:12.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.886+0000 7f9ca9c00640 1 -- 172.21.15.52:0/629719898 wait complete. 2024-09-10T08:32:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.887+0000 7f9ca9c00640 1 Processor -- start 2024-09-10T08:32:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.887+0000 7f9ca9c00640 1 -- start start 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ca40732e0 0x7f9ca414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca40cce30 0x7f9ca4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca415ca50 con 0x7f9ca4071c70 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca415c8d0 con 0x7f9ca40cce30 2024-09-10T08:32:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.888+0000 7f9ca9c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca415cbd0 con 0x7f9ca40732e0 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51456/0 (socket says 172.21.15.52:51456) 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 -- 172.21.15.52:0/2586278044 learned_addr learned my addr 172.21.15.52:0/2586278044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca3400640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca40cce30 0x7f9ca4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9c9be00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ca40732e0 0x7f9ca414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 -- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ca40732e0 msgr2=0x7f9ca414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ca40732e0 0x7f9ca414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 -- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca40cce30 msgr2=0x7f9ca4153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca40cce30 0x7f9ca4153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 -- 172.21.15.52:0/2586278044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca414d8f0 con 0x7f9ca4071c70 2024-09-10T08:32:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.889+0000 7f9ca2a00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c430 tx=0x7f9c9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.890+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94017070 con 0x7f9ca4071c70 2024-09-10T08:32:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.890+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c94005ce0 con 0x7f9ca4071c70 2024-09-10T08:32:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.890+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c940072f0 con 0x7f9ca4071c70 2024-09-10T08:32:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.890+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41547b0 con 0x7f9ca4071c70 2024-09-10T08:32:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.890+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca4154d70 con 0x7f9ca4071c70 2024-09-10T08:32:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.891+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca40cd2a0 con 0x7f9ca4071c70 2024-09-10T08:32:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.892+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c9401a070 con 0x7f9ca4071c70 2024-09-10T08:32:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.893+0000 7f9c9aa00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 0x7f9c8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.893+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5795+0+0 (secure 0 0 0) 0x7f9c9408a320 con 0x7f9ca4071c70 2024-09-10T08:32:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.894+0000 7f9c9be00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 0x7f9c8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:12.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.894+0000 7f9c9be00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 0x7f9c8006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ca41e76f0 tx=0x7f9c8c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:12.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:12.898+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ca414d8f0 con 0x7f9ca4071c70 2024-09-10T08:32:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.118+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9ca415f560 con 0x7f9ca4071c70 2024-09-10T08:32:13.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.696+0000 7f9c9aa00640 1 -- 172.21.15.52:0/2586278044 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f9c94058610 con 0x7f9ca4071c70 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 msgr2=0x7f9c8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 0x7f9c8006e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9ca41e76f0 tx=0x7f9c8c009190 comp rx=0 tx=0).stop 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 msgr2=0x7f9ca41e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c430 tx=0x7f9c9400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 shutdown_connections 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8006be30 0x7f9c8006e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ca40cce30 0x7f9ca4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ca40732e0 0x7f9ca414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 --2- 172.21.15.52:0/2586278044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4071c70 0x7f9ca41e7860 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 >> 172.21.15.52:0/2586278044 conn(0x7f9ca406d0f0 msgr2=0x7f9ca40736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 shutdown_connections 2024-09-10T08:32:13.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.700+0000 7f9ca9c00640 1 -- 172.21.15.52:0/2586278044 wait complete. 2024-09-10T08:32:13.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:32:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.899+0000 7fac40600640 1 Processor -- start 2024-09-10T08:32:13.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.899+0000 7fac40600640 1 -- start start 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac40600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac381454b0 0x7fac380b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac40600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 0x7fac380b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac40600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac38146220 con 0x7fac380b1db0 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac40600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fac380b1920 con 0x7fac381454b0 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac40600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fac380cf640 con 0x7fac381459a0 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac3dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac381454b0 0x7fac380b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac3dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fac381454b0 0x7fac380b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51470/0 (socket says 172.21.15.52:51470) 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.900+0000 7fac3dc00640 1 -- 172.21.15.52:0/293539422 learned_addr learned my addr 172.21.15.52:0/293539422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3d200640 1 --2- 172.21.15.52:0/293539422 >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 0x7fac380b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3dc00640 1 -- 172.21.15.52:0/293539422 >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 msgr2=0x7fac380b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3dc00640 1 --2- 172.21.15.52:0/293539422 >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 0x7fac380b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3dc00640 1 -- 172.21.15.52:0/293539422 >> v1:172.21.15.176:6789/0 conn(0x7fac380b1db0 legacy=0x7fac380b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3dc00640 1 -- 172.21.15.52:0/293539422 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac380cf8e0 con 0x7fac381454b0 2024-09-10T08:32:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.901+0000 7fac3d200640 1 --2- 172.21.15.52:0/293539422 >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 0x7fac380b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac3dc00640 1 --2- 172.21.15.52:0/293539422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac381454b0 0x7fac380b58f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac380b6490 tx=0x7fac2c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0328c7d4c8e5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac37e00640 1 -- 172.21.15.52:0/293539422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c037070 con 0x7fac381454b0 2024-09-10T08:32:13.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac37e00640 1 -- 172.21.15.52:0/293539422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c032440 con 0x7fac381454b0 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac37e00640 1 -- 172.21.15.52:0/293539422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c032810 con 0x7fac381454b0 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac40600640 1 -- 172.21.15.52:0/293539422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac381454b0 msgr2=0x7fac380b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.902+0000 7fac40600640 1 --2- 172.21.15.52:0/293539422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac381454b0 0x7fac380b58f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac380b6490 tx=0x7fac2c02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 -- 172.21.15.52:0/293539422 shutdown_connections 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 --2- 172.21.15.52:0/293539422 >> v2:172.21.15.176:3300/0 conn(0x7fac381459a0 0x7fac380b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 --2- 172.21.15.52:0/293539422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac381454b0 0x7fac380b58f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 -- 172.21.15.52:0/293539422 >> 172.21.15.52:0/293539422 conn(0x7fac3806c240 msgr2=0x7fac3806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 -- 172.21.15.52:0/293539422 shutdown_connections 2024-09-10T08:32:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.903+0000 7fac40600640 1 -- 172.21.15.52:0/293539422 wait complete. 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.904+0000 7fac40600640 1 Processor -- start 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.904+0000 7fac40600640 1 -- start start 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac381454b0 0x7fac3813f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac381459a0 0x7fac380b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac380d0180 con 0x7fac380b1db0 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac380cfea0 con 0x7fac381454b0 2024-09-10T08:32:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac40600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fac380b0e50 con 0x7fac381459a0 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac3dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac3dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51482/0 (socket says 172.21.15.52:51482) 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.905+0000 7fac3dc00640 1 -- 172.21.15.52:0/2155261603 learned_addr learned my addr 172.21.15.52:0/2155261603 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3d200640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac381454b0 0x7fac3813f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3e600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac381459a0 0x7fac380b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 -- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac381459a0 msgr2=0x7fac380b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac381459a0 0x7fac380b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 -- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac381454b0 msgr2=0x7fac3813f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac381454b0 0x7fac3813f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 -- 172.21.15.52:0/2155261603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3813fab0 con 0x7fac380b1db0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac3dc00640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fac2c02a300 tx=0x7fac2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c037040 con 0x7fac380b1db0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c042070 con 0x7fac380b1db0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2c030bb0 con 0x7fac380b1db0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.906+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3813bdb0 con 0x7fac380b1db0 2024-09-10T08:32:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.907+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3813c370 con 0x7fac380b1db0 2024-09-10T08:32:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.908+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac380b58f0 con 0x7fac380b1db0 2024-09-10T08:32:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.909+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac2c047460 con 0x7fac380b1db0 2024-09-10T08:32:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.910+0000 7fac35600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 0x7fac1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.910+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5795+0+0 (secure 0 0 0) 0x7fac2c0aba60 con 0x7fac380b1db0 2024-09-10T08:32:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.910+0000 7fac3d200640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 0x7fac1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.911+0000 7fac3d200640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 0x7fac1806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fac380af3c0 tx=0x7fac24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:13.914+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac3813fab0 con 0x7fac380b1db0 2024-09-10T08:32:14.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.097+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac381444d0 con 0x7fac380b1db0 2024-09-10T08:32:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.698+0000 7fac35600640 1 -- 172.21.15.52:0/2155261603 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) ==== 181+0+0 (secure 0 0 0) 0x7fac38146220 con 0x7fac380b1db0 2024-09-10T08:32:14.698 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:32:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 msgr2=0x7fac1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 0x7fac1806e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fac380af3c0 tx=0x7fac24008040 comp rx=0 tx=0).stop 2024-09-10T08:32:14.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 msgr2=0x7fac3813b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fac2c02a300 tx=0x7fac2c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 shutdown_connections 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fac1806be30 0x7fac1806e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fac381459a0 0x7fac380b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac381454b0 0x7fac3813f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 --2- 172.21.15.52:0/2155261603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac380b1db0 0x7fac3813b6f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.702+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 >> 172.21.15.52:0/2155261603 conn(0x7fac3806c240 msgr2=0x7fac380b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.703+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 shutdown_connections 2024-09-10T08:32:14.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.703+0000 7fac40600640 1 -- 172.21.15.52:0/2155261603 wait complete. 2024-09-10T08:32:14.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:32:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.888+0000 7fb880200640 1 Processor -- start 2024-09-10T08:32:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.889+0000 7fb880200640 1 -- start start 2024-09-10T08:32:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb880200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb87815e890 0x7fb8780d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb880200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87806ea60 con 0x7fb87815e4b0 2024-09-10T08:32:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb880200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87806ed40 con 0x7fb8780d30c0 2024-09-10T08:32:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb880200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb87806e810 con 0x7fb87815e890 2024-09-10T08:32:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb87d800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb87815e4b0 0x7fb878073490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46612/0 (socket says 172.21.15.52:46612) 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.890+0000 7fb87d800640 1 -- 172.21.15.52:0/4117224043 learned_addr learned my addr 172.21.15.52:0/4117224043 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb87ce00640 1 --2- 172.21.15.52:0/4117224043 >> v2:172.21.15.176:3300/0 conn(0x7fb87815e890 0x7fb8780d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687292486 0 0) 0x7fb87806ea60 con 0x7fb87815e4b0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb860003520 con 0x7fb87815e4b0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1805776792 0 0) 0x7fb860003520 con 0x7fb87815e4b0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 >> v2:172.21.15.176:3300/0 conn(0x7fb87815e890 msgr2=0x7fb8780d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 --2- 172.21.15.52:0/4117224043 >> v2:172.21.15.176:3300/0 conn(0x7fb87815e890 0x7fb8780d2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 >> v1:172.21.15.176:6789/0 conn(0x7fb8780d30c0 legacy=0x7fb87806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8780d2380 con 0x7fb87815e4b0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fb86c001670 con 0x7fb87815e4b0 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 >> v1:172.21.15.52:6789/0 conn(0x7fb87815e4b0 legacy=0x7fb878073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8600039b0 0x7fb860003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 0x7fb860004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8600051c0 0x7fb86000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb87806e810 con 0x7fb860004800 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb86000c0f0 con 0x7fb8600039b0 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb86000c2f0 con 0x7fb8600051c0 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb87ce00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 0x7fb860004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.891+0000 7fb87d800640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8600039b0 0x7fb860003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87e200640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8600051c0 0x7fb86000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87ce00640 1 -- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8600051c0 msgr2=0x7fb86000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87ce00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8600051c0 0x7fb86000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87ce00640 1 -- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8600039b0 msgr2=0x7fb860003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87ce00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8600039b0 0x7fb860003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87ce00640 1 -- 172.21.15.52:0/4117224043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8780d2380 con 0x7fb860004800 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87e200640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8600051c0 0x7fb86000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.892+0000 7fb87e200640 1 -- 172.21.15.52:0/4117224043 reap_dead start 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.893+0000 7fb87ce00640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 0x7fb860004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb864009ac0 tx=0x7fb860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c561f982315594 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.893+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864036070 con 0x7fb860004800 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.893+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb864031400 con 0x7fb860004800 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.893+0000 7fb877e00640 1 -- 172.21.15.52:0/4117224043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864009690 con 0x7fb860004800 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 -- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 msgr2=0x7fb860004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 0x7fb860004c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb864009ac0 tx=0x7fb860005830 comp rx=0 tx=0).stop 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 -- 172.21.15.52:0/4117224043 shutdown_connections 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 --2- 172.21.15.52:0/4117224043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb860004800 0x7fb860004c80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 -- 172.21.15.52:0/4117224043 >> 172.21.15.52:0/4117224043 conn(0x7fb878067950 msgr2=0x7fb878067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 -- 172.21.15.52:0/4117224043 shutdown_connections 2024-09-10T08:32:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.894+0000 7fb880200640 1 -- 172.21.15.52:0/4117224043 wait complete. 2024-09-10T08:32:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.895+0000 7fb880200640 1 Processor -- start 2024-09-10T08:32:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 -- start start 2024-09-10T08:32:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb860004800 0x7fb8780d1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8780cb8d0 0x7fb8780cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8780d2130 con 0x7fb8780cde00 2024-09-10T08:32:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb878074150 con 0x7fb8780cb8d0 2024-09-10T08:32:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.896+0000 7fb880200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8780d26f0 con 0x7fb860004800 2024-09-10T08:32:14.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53090/0 (socket says 172.21.15.52:53090) 2024-09-10T08:32:14.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 -- 172.21.15.52:0/2729269371 learned_addr learned my addr 172.21.15.52:0/2729269371 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:14.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87d800640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb860004800 0x7fb8780d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87ce00640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8780cb8d0 0x7fb8780cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 -- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb860004800 msgr2=0x7fb8780d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb860004800 0x7fb8780d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 -- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8780cb8d0 msgr2=0x7fb8780cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8780cb8d0 0x7fb8780cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.897+0000 7fb87e200640 1 -- 172.21.15.52:0/2729269371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8780cc390 con 0x7fb8780cde00 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb87e200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb8781632a0 tx=0x7fb87000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870003970 con 0x7fb8780cde00 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb870018070 con 0x7fb8780cde00 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8780cc670 con 0x7fb8780cde00 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870003d50 con 0x7fb8780cde00 2024-09-10T08:32:14.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.898+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8780ccc30 con 0x7fb8780cde00 2024-09-10T08:32:14.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.899+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8780d2c10 con 0x7fb8780cde00 2024-09-10T08:32:14.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.900+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8700050d0 con 0x7fb8780cde00 2024-09-10T08:32:14.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.901+0000 7fb875600640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 0x7fb85806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:14.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.901+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5357+0+0 (secure 0 0 0) 0x7fb87008a5a0 con 0x7fb8780cde00 2024-09-10T08:32:14.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.901+0000 7fb87d800640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 0x7fb85806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.902+0000 7fb87d800640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 0x7fb85806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb86c007fd0 tx=0x7fb86c001110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:14.905+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb870022020 con 0x7fb8780cde00 2024-09-10T08:32:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.089+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb8780b1f20 con 0x7fb8780cde00 2024-09-10T08:32:15.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.704+0000 7fb875600640 1 -- 172.21.15.52:0/2729269371 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) ==== 169+0+0 (secure 0 0 0) 0x7fb870058a50 con 0x7fb8780cde00 2024-09-10T08:32:15.704 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 msgr2=0x7fb85806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 0x7fb85806e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb86c007fd0 tx=0x7fb86c001110 comp rx=0 tx=0).stop 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 msgr2=0x7fb8780ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb8781632a0 tx=0x7fb87000eb90 comp rx=0 tx=0).stop 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 shutdown_connections 2024-09-10T08:32:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb85806be30 0x7fb85806e2f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8780cde00 0x7fb8780ce2b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8780cb8d0 0x7fb8780cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 --2- 172.21.15.52:0/2729269371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb860004800 0x7fb8780d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 >> 172.21.15.52:0/2729269371 conn(0x7fb878067950 msgr2=0x7fb87806d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 shutdown_connections 2024-09-10T08:32:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.708+0000 7fb880200640 1 -- 172.21.15.52:0/2729269371 wait complete. 2024-09-10T08:32:15.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:32:15.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.893+0000 7f9858600640 1 Processor -- start 2024-09-10T08:32:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.893+0000 7f9858600640 1 -- start start 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.894+0000 7f9858600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98500736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9858600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98500714b0 con 0x7f98500cd270 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9858600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9850073c00 con 0x7f98500cce30 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9858600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98500cd880 con 0x7f98500732e0 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9856600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f98500cd270 0x7f985015c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46626/0 (socket says 172.21.15.52:46626) 2024-09-10T08:32:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9856600640 1 -- 172.21.15.52:0/459661113 learned_addr learned my addr 172.21.15.52:0/459661113 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608526637 0 0) 0x7f98500714b0 con 0x7f98500cd270 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f9855c00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98500736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.895+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9838003520 con 0x7f98500cd270 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 97063381 0 0) 0x7f9838003520 con 0x7f98500cd270 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 msgr2=0x7f98500736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98500736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 >> v1:172.21.15.176:6789/0 conn(0x7f98500cce30 legacy=0x7f9850071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98500cdb60 con 0x7f98500cd270 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f98480019f0 con 0x7f98500cd270 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 >> v1:172.21.15.52:6789/0 conn(0x7f98500cd270 legacy=0x7f985015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9838003f60 0x7f9838004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9838004d40 0x7f98380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f98500cd880 con 0x7f9838004d40 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f983800bb50 con 0x7f9838003f60 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9838010160 con 0x7f98500732e0 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f9856600640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9838004d40 0x7f98380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f9855c00640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.896+0000 7f9855200640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9838003f60 0x7f9838004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.897+0000 7f9856600640 1 -- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 msgr2=0x7f98380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:15.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.897+0000 7f9856600640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98500732e0 0x7f98380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.897+0000 7f9856600640 1 -- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9838003f60 msgr2=0x7f9838004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:15.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.897+0000 7f9856600640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9838003f60 0x7f9838004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.897+0000 7f9856600640 1 -- 172.21.15.52:0/459661113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838003520 con 0x7f9838004d40 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9856600640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9838004d40 0x7f98380051c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f984800a850 tx=0x7f9838005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453bde99a638327c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984800a4a0 con 0x7f9838004d40 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984802f070 con 0x7f9838004d40 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f984fe00640 1 -- 172.21.15.52:0/459661113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984802bce0 con 0x7f9838004d40 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 -- 172.21.15.52:0/459661113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9838004d40 msgr2=0x7f98380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 --2- 172.21.15.52:0/459661113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9838004d40 0x7f98380051c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f984800a850 tx=0x7f9838005830 comp rx=0 tx=0).stop 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9856600640 1 -- 172.21.15.52:0/459661113 reap_dead start 2024-09-10T08:32:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 -- 172.21.15.52:0/459661113 shutdown_connections 2024-09-10T08:32:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 -- 172.21.15.52:0/459661113 >> 172.21.15.52:0/459661113 conn(0x7f985006d0f0 msgr2=0x7f985006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 -- 172.21.15.52:0/459661113 shutdown_connections 2024-09-10T08:32:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.898+0000 7f9858600640 1 -- 172.21.15.52:0/459661113 wait complete. 2024-09-10T08:32:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.900+0000 7f9858600640 1 Processor -- start 2024-09-10T08:32:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.900+0000 7f9858600640 1 -- start start 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9838004d40 0x7f985013eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 0x7f985015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f985006bf70 con 0x7f98501542d0 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f985006bdf0 con 0x7f985015d8a0 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9858600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9850072380 con 0x7f9838004d40 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9855200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9855200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53112/0 (socket says 172.21.15.52:53112) 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.901+0000 7f9855200640 1 -- 172.21.15.52:0/3984141907 learned_addr learned my addr 172.21.15.52:0/3984141907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:15.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855c00640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9838004d40 0x7f985013eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9856600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 0x7f985015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 -- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9838004d40 msgr2=0x7f985013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9838004d40 0x7f985013eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 -- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 msgr2=0x7f985015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 0x7f985015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 -- 172.21.15.52:0/3984141907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9850150610 con 0x7f98501542d0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9856600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 0x7f985015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9855200640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f983c00f850 tx=0x7f983c00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c00fe40 con 0x7f98501542d0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c018070 con 0x7f98501542d0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c00d6d0 con 0x7f98501542d0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.902+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9850156fe0 con 0x7f98501542d0 2024-09-10T08:32:15.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.903+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98501575a0 con 0x7f98501542d0 2024-09-10T08:32:15.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.904+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98500736c0 con 0x7f98501542d0 2024-09-10T08:32:15.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.905+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f983c00d870 con 0x7f98501542d0 2024-09-10T08:32:15.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.905+0000 7f984d600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 0x7f983006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:15.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.906+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f983c08a9c0 con 0x7f98501542d0 2024-09-10T08:32:15.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.906+0000 7f9855c00640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 0x7f983006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:15.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.907+0000 7f9855c00640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 0x7f983006e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9844009b00 tx=0x7f9844008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:15.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:15.910+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f983c0595d0 con 0x7f98501542d0 2024-09-10T08:32:16.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.096+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f98500711f0 con 0x7f98501542d0 2024-09-10T08:32:16.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.100+0000 7f984d600640 1 -- 172.21.15.52:0/3984141907 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f983c058ed0 con 0x7f98501542d0 2024-09-10T08:32:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 msgr2=0x7f983006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 0x7f983006e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9844009b00 tx=0x7f9844008040 comp rx=0 tx=0).stop 2024-09-10T08:32:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 msgr2=0x7f985013f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f983c00f850 tx=0x7f983c00fd10 comp rx=0 tx=0).stop 2024-09-10T08:32:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 shutdown_connections 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f983006be60 0x7f983006e320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f985015d8a0 0x7f985015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98501542d0 0x7f985013f280 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 --2- 172.21.15.52:0/3984141907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9838004d40 0x7f985013eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 >> 172.21.15.52:0/3984141907 conn(0x7f985006d0f0 msgr2=0x7f98500ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 shutdown_connections 2024-09-10T08:32:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.103+0000 7f9858600640 1 -- 172.21.15.52:0/3984141907 wait complete. 2024-09-10T08:32:16.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-10T08:32:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.274+0000 7fd7ae000640 1 Processor -- start 2024-09-10T08:32:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.274+0000 7fd7ae000640 1 -- start start 2024-09-10T08:32:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7ae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a815f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7ae000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a806bc10 0x7fd7a806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7ae000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7a8072a70 con 0x7fd7a8158cf0 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7ae000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd7a815f690 con 0x7fd7a806bc10 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7ae000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a80cdfa0 con 0x7fd7a815ece0 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7a806bc10 0x7fd7a806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd7a8158cf0 0x7fd7a80cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46642/0 (socket says 172.21.15.52:46642) 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7400640 1 -- 172.21.15.52:0/2427638680 learned_addr learned my addr 172.21.15.52:0/2427638680 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd79fe00640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7e00640 1 -- 172.21.15.52:0/2427638680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 msgr2=0x7fd7a815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7e00640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.276+0000 7fd7a7e00640 1 -- 172.21.15.52:0/2427638680 >> v1:172.21.15.52:6789/0 conn(0x7fd7a8158cf0 legacy=0x7fd7a80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.277+0000 7fd7a7e00640 1 -- 172.21.15.52:0/2427638680 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a815f8b0 con 0x7fd7a806bc10 2024-09-10T08:32:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.277+0000 7fd7a6a00640 1 -- 172.21.15.52:0/2427638680 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941380463 0 0) 0x7fd7a8072a70 con 0x7fd7a8158cf0 2024-09-10T08:32:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.277+0000 7fd79fe00640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7a7e00640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a806c0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d90 tx=0x7fd7a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e327d9170db175e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7a6a00640 1 -- 172.21.15.52:0/2427638680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0007740 con 0x7fd7a806bc10 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7a6a00640 1 -- 172.21.15.52:0/2427638680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a00078e0 con 0x7fd7a806bc10 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7a6a00640 1 -- 172.21.15.52:0/2427638680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0007cb0 con 0x7fd7a806bc10 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 -- 172.21.15.52:0/2427638680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 msgr2=0x7fd7a806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a806c0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d90 tx=0x7fd7a002a660 comp rx=0 tx=0).stop 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 -- 172.21.15.52:0/2427638680 shutdown_connections 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a806c0a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 --2- 172.21.15.52:0/2427638680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.278+0000 7fd7ae000640 1 -- 172.21.15.52:0/2427638680 >> 172.21.15.52:0/2427638680 conn(0x7fd7a806cd20 msgr2=0x7fd7a806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.279+0000 7fd7ae000640 1 -- 172.21.15.52:0/2427638680 shutdown_connections 2024-09-10T08:32:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.279+0000 7fd7ae000640 1 -- 172.21.15.52:0/2427638680 wait complete. 2024-09-10T08:32:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.280+0000 7fd7ae000640 1 Processor -- start 2024-09-10T08:32:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.280+0000 7fd7ae000640 1 -- start start 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 0x7fd7a80b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a80b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80ce520 con 0x7fd7a806bc10 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80ce240 con 0x7fd7a8158cf0 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.281+0000 7fd7ae000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a81590d0 con 0x7fd7a815ece0 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53118/0 (socket says 172.21.15.52:53118) 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 -- 172.21.15.52:0/3667277590 learned_addr learned my addr 172.21.15.52:0/3667277590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd79fe00640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 0x7fd7a80b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7e00640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a80b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 -- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 msgr2=0x7fd7a80b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a80b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 -- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 msgr2=0x7fd7a80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 0x7fd7a80b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 -- 172.21.15.52:0/3667277590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a815a240 con 0x7fd7a806bc10 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd79fe00640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 0x7fd7a80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.282+0000 7fd7a7400640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c4d0 tx=0x7fd79800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.283+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798018070 con 0x7fd7a806bc10 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.283+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd798007500 con 0x7fd7a806bc10 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.283+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798004a20 con 0x7fd7a806bc10 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.283+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a815a4b0 con 0x7fd7a806bc10 2024-09-10T08:32:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.283+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a815aa70 con 0x7fd7a806bc10 2024-09-10T08:32:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.284+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a815f150 con 0x7fd7a806bc10 2024-09-10T08:32:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.285+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd798004bc0 con 0x7fd7a806bc10 2024-09-10T08:32:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.285+0000 7fd79f400640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 0x7fd78406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.286+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fd798089e40 con 0x7fd7a806bc10 2024-09-10T08:32:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.286+0000 7fd79fe00640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 0x7fd78406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.287+0000 7fd79fe00640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 0x7fd78406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80b7330 tx=0x7fd790008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.290+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd798058ae0 con 0x7fd7a806bc10 2024-09-10T08:32:16.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.542+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7fd7a815acb0 con 0x7fd7a806bc10 2024-09-10T08:32:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.705+0000 7fd79f400640 1 -- 172.21.15.52:0/3667277590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v175) ==== 143+0+0 (secure 0 0 0) 0x7fd7980583e0 con 0x7fd7a806bc10 2024-09-10T08:32:16.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 msgr2=0x7fd78406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 0x7fd78406e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80b7330 tx=0x7fd790008040 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 msgr2=0x7fd7a81f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c4d0 tx=0x7fd79800c990 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 shutdown_connections 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd78406be30 0x7fd78406e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7a815ece0 0x7fd7a80b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7a8158cf0 0x7fd7a80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 --2- 172.21.15.52:0/3667277590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a806bc10 0x7fd7a81f3dc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 >> 172.21.15.52:0/3667277590 conn(0x7fd7a806cd20 msgr2=0x7fd7a8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 shutdown_connections 2024-09-10T08:32:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.708+0000 7fd7ae000640 1 -- 172.21.15.52:0/3667277590 wait complete. 2024-09-10T08:32:16.724 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-10T08:32:16.724 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-10T08:32:16.724 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:32:16.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.891+0000 7f7d3ca00640 1 Processor -- start 2024-09-10T08:32:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.891+0000 7f7d3ca00640 1 -- start start 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.892+0000 7f7d3ca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7d380b5080 0x7f7d380b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.892+0000 7f7d3ca00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d380b4020 con 0x7f7d38073890 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.892+0000 7f7d3ca00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d380b42c0 con 0x7f7d38145ed0 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.892+0000 7f7d3ca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7d380b45a0 con 0x7f7d380b5080 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d2d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7d38073890 0x7f7d380b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46652/0 (socket says 172.21.15.52:46652) 2024-09-10T08:32:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d2d400640 1 -- 172.21.15.52:0/4048659907 learned_addr learned my addr 172.21.15.52:0/4048659907 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d36800640 1 --2- 172.21.15.52:0/4048659907 >> v2:172.21.15.176:3300/0 conn(0x7f7d380b5080 0x7f7d380b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031645966 0 0) 0x7f7d380b4020 con 0x7f7d38073890 2024-09-10T08:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d1c003520 con 0x7f7d38073890 2024-09-10T08:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.893+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2403658657 0 0) 0x7f7d1c003520 con 0x7f7d38073890 2024-09-10T08:32:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 >> v2:172.21.15.176:3300/0 conn(0x7f7d380b5080 msgr2=0x7f7d380b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 --2- 172.21.15.52:0/4048659907 >> v2:172.21.15.176:3300/0 conn(0x7f7d380b5080 0x7f7d380b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 >> v1:172.21.15.176:6789/0 conn(0x7f7d38145ed0 legacy=0x7f7d38073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d380b4880 con 0x7f7d38073890 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f7d20001690 con 0x7f7d38073890 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 >> v1:172.21.15.52:6789/0 conn(0x7f7d38073890 legacy=0x7f7d380b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 0x7f7d1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c004800 0x7f7d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0051c0 0x7f7d1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d380b45a0 con 0x7f7d1c0039b0 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c00bf80 con 0x7f7d1c004800 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c00c180 con 0x7f7d1c0051c0 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 0x7f7d1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d2d400640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c004800 0x7f7d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d36800640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0051c0 0x7f7d1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 -- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0051c0 msgr2=0x7f7d1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d1c0051c0 0x7f7d1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 -- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c004800 msgr2=0x7f7d1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c004800 0x7f7d1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d35e00640 1 -- 172.21.15.52:0/4048659907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c003520 con 0x7f7d1c0039b0 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.894+0000 7f7d36800640 1 -- 172.21.15.52:0/4048659907 reap_dead start 2024-09-10T08:32:16.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.895+0000 7f7d35e00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 0x7f7d1c003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d28001860 tx=0x7f7d1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5f4f5c0f30c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28037070 con 0x7f7d1c0039b0 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2802ab60 con 0x7f7d1c0039b0 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d35400640 1 -- 172.21.15.52:0/4048659907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28001430 con 0x7f7d1c0039b0 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 -- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 msgr2=0x7f7d1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 0x7f7d1c003d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7d28001860 tx=0x7f7d1c005830 comp rx=0 tx=0).stop 2024-09-10T08:32:16.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 -- 172.21.15.52:0/4048659907 shutdown_connections 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/4048659907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d1c0039b0 0x7f7d1c003d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 -- 172.21.15.52:0/4048659907 >> 172.21.15.52:0/4048659907 conn(0x7f7d380ccec0 msgr2=0x7f7d380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 -- 172.21.15.52:0/4048659907 shutdown_connections 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.896+0000 7f7d3ca00640 1 -- 172.21.15.52:0/4048659907 wait complete. 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.898+0000 7f7d3ca00640 1 Processor -- start 2024-09-10T08:32:16.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.898+0000 7f7d3ca00640 1 -- start start 2024-09-10T08:32:16.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0039b0 0x7f7d380cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380c6470 0x7f7d380c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38146430 con 0x7f7d38143330 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d381462b0 con 0x7f7d1c0039b0 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d3ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d38073180 con 0x7f7d380c6470 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53134/0 (socket says 172.21.15.52:53134) 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 -- 172.21.15.52:0/376217063 learned_addr learned my addr 172.21.15.52:0/376217063 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 -- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380c6470 msgr2=0x7f7d380c68f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380c6470 0x7f7d380c68f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 -- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0039b0 msgr2=0x7f7d380cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.899+0000 7f7d36800640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0039b0 0x7f7d380cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:16.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d36800640 1 -- 172.21.15.52:0/376217063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d380cb390 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d36800640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d38073dd0 tx=0x7f7d300115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011db0 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3001b070 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30003990 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d380c6f30 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.900+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381504c0 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.902+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38073480 con 0x7f7d38143330 2024-09-10T08:32:16.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.902+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d30005d10 con 0x7f7d38143330 2024-09-10T08:32:16.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.903+0000 7f7d2ea00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 0x7f7d1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:16.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.904+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f7d3008af10 con 0x7f7d38143330 2024-09-10T08:32:16.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.904+0000 7f7d35e00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 0x7f7d1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:16.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.905+0000 7f7d35e00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 0x7f7d1406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d28034000 tx=0x7f7d2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:16.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:16.908+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d3001d310 con 0x7f7d38143330 2024-09-10T08:32:17.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.095+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d38145370 con 0x7f7d38143330 2024-09-10T08:32:17.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.096+0000 7f7d2ea00640 1 -- 172.21.15.52:0/376217063 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13044 (secure 0 0 0) 0x7f7d30059bb0 con 0x7f7d38143330 2024-09-10T08:32:17.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:17.097 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":52,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:15.699706+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3839158402":"2024-09-11T08:32:12.689631+0000","172.21.15.52:6833/3839158402":"2024-09-11T08:32:12.689631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 msgr2=0x7f7d1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 0x7f7d1406e320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d28034000 tx=0x7f7d2802e000 comp rx=0 tx=0).stop 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 msgr2=0x7f7d381437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d38073dd0 tx=0x7f7d300115a0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 shutdown_connections 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1406be60 0x7f7d1406e320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d38143330 0x7f7d381437e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d380c6470 0x7f7d380c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 --2- 172.21.15.52:0/376217063 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d1c0039b0 0x7f7d380cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.098+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 >> 172.21.15.52:0/376217063 conn(0x7f7d380ccec0 msgr2=0x7f7d380d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:17.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.099+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 shutdown_connections 2024-09-10T08:32:17.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.099+0000 7f7d3ca00640 1 -- 172.21.15.52:0/376217063 wait complete. 2024-09-10T08:32:17.115 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:32:17.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:32:17.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.275+0000 7f4cdba00640 1 Processor -- start 2024-09-10T08:32:17.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.275+0000 7f4cdba00640 1 -- start start 2024-09-10T08:32:17.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cdba00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4cd40cd2a0 0x7f4cd415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cdba00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd40714b0 con 0x7f4cd40732e0 2024-09-10T08:32:17.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cdba00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd40cd880 con 0x7f4cd40cce30 2024-09-10T08:32:17.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cdba00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd40cdb60 con 0x7f4cd40cd2a0 2024-09-10T08:32:17.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cd9000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4cd40732e0 0x7f4cd40736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46668/0 (socket says 172.21.15.52:46668) 2024-09-10T08:32:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cd9000640 1 -- 172.21.15.52:0/1430228755 learned_addr learned my addr 172.21.15.52:0/1430228755 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cd9a00640 1 --2- 172.21.15.52:0/1430228755 >> v2:172.21.15.176:3300/0 conn(0x7f4cd40cd2a0 0x7f4cd415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250837745 0 0) 0x7f4cd40714b0 con 0x7f4cd40732e0 2024-09-10T08:32:17.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.277+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb8003520 con 0x7f4cd40732e0 2024-09-10T08:32:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240158208 0 0) 0x7f4cd40cd880 con 0x7f4cd40cce30 2024-09-10T08:32:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd40714b0 con 0x7f4cd40cce30 2024-09-10T08:32:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1911857641 0 0) 0x7f4cb8003520 con 0x7f4cd40732e0 2024-09-10T08:32:17.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 >> v2:172.21.15.176:3300/0 conn(0x7f4cd40cd2a0 msgr2=0x7f4cd415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/1430228755 >> v2:172.21.15.176:3300/0 conn(0x7f4cd40cd2a0 0x7f4cd415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 >> v1:172.21.15.176:6789/0 conn(0x7f4cd40cce30 legacy=0x7f4cd4071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd40cde40 con 0x7f4cd40732e0 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f4cc4001670 con 0x7f4cd40732e0 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 >> v1:172.21.15.52:6789/0 conn(0x7f4cd40732e0 legacy=0x7f4cd40736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 0x7f4cb8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40cdb60 con 0x7f4cb8003b40 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb800c090 con 0x7f4cb80051c0 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb800c290 con 0x7f4cb8004800 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd9000640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 0x7f4cb8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4ccbe00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.278+0000 7f4cd9a00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9000640 1 -- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8004800 msgr2=0x7f4cb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9000640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9000640 1 -- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cb80051c0 msgr2=0x7f4cb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9000640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9000640 1 -- 172.21.15.52:0/1430228755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd40cde40 con 0x7f4cb8003b40 2024-09-10T08:32:17.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.279+0000 7f4cd9a00640 1 -- 172.21.15.52:0/1430228755 reap_dead start 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cd9000640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 0x7f4cb8003f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c370 tx=0x7f4cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc93efd2b6802136 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4036070 con 0x7f4cb8003b40 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc402d070 con 0x7f4cb8003b40 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cd3e00640 1 -- 172.21.15.52:0/1430228755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4007dd0 con 0x7f4cb8003b40 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cdba00640 1 -- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 msgr2=0x7f4cb8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.280+0000 7f4cdba00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 0x7f4cb8003f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400c370 tx=0x7f4cb8005830 comp rx=0 tx=0).stop 2024-09-10T08:32:17.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.281+0000 7f4cdba00640 1 -- 172.21.15.52:0/1430228755 shutdown_connections 2024-09-10T08:32:17.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.281+0000 7f4cdba00640 1 --2- 172.21.15.52:0/1430228755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cb8003b40 0x7f4cb8003f40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.281+0000 7f4cdba00640 1 -- 172.21.15.52:0/1430228755 >> 172.21.15.52:0/1430228755 conn(0x7f4cd406d0f0 msgr2=0x7f4cd406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:17.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.281+0000 7f4cdba00640 1 -- 172.21.15.52:0/1430228755 shutdown_connections 2024-09-10T08:32:17.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.281+0000 7f4cdba00640 1 -- 172.21.15.52:0/1430228755 wait complete. 2024-09-10T08:32:17.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.282+0000 7f4cdba00640 1 Processor -- start 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.283+0000 7f4cdba00640 1 -- start start 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.283+0000 7f4cdba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 0x7f4cd41511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.283+0000 7f4cdba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cdba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd41f3b50 0x7f4cd413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cdba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4073840 con 0x7f4cd41f36f0 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cdba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40736c0 con 0x7f4cd41f3b50 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cdba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd40739c0 con 0x7f4cb8003b40 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53148/0 (socket says 172.21.15.52:53148) 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 -- 172.21.15.52:0/3175636367 learned_addr learned my addr 172.21.15.52:0/3175636367 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cd9a00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd41f3b50 0x7f4cd413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cd9000640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 0x7f4cd41511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 -- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 msgr2=0x7f4cd41511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 0x7f4cd41511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 -- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd41f3b50 msgr2=0x7f4cd413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd41f3b50 0x7f4cd413ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4ccbe00640 1 -- 172.21.15.52:0/3175636367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd41539b0 con 0x7f4cd41f36f0 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.284+0000 7f4cd9000640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 0x7f4cd41511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4ccbe00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00f7a0 tx=0x7f4cbc00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc01a070 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00fe50 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc007050 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd4153c90 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.285+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd4153f70 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.286+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd4071c70 con 0x7f4cd41f36f0 2024-09-10T08:32:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.287+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cbc01d070 con 0x7f4cd41f36f0 2024-09-10T08:32:17.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.288+0000 7f4cd1600640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 0x7f4cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.288+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f4cbc08a2b0 con 0x7f4cd41f36f0 2024-09-10T08:32:17.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.289+0000 7f4cd9000640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 0x7f4cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.289+0000 7f4cd9000640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 0x7f4cb006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4033000 tx=0x7f4cc4009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.293+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cbc058900 con 0x7f4cd41f36f0 2024-09-10T08:32:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.478+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cd40711f0 con 0x7f4cd41f36f0 2024-09-10T08:32:17.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.479+0000 7f4cd1600640 1 -- 172.21.15.52:0/3175636367 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) ==== 93+0+10 (secure 0 0 0) 0x7f4cbc05cc00 con 0x7f4cd41f36f0 2024-09-10T08:32:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:32:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 msgr2=0x7f4cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 0x7f4cb006e2f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4033000 tx=0x7f4cc4009030 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 msgr2=0x7f4cd413e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00f7a0 tx=0x7f4cbc00fc60 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 shutdown_connections 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb006be30 0x7f4cb006e2f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cd41f3b50 0x7f4cd413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cd41f36f0 0x7f4cd413e850 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 --2- 172.21.15.52:0/3175636367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cb8003b40 0x7f4cd41511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 >> 172.21.15.52:0/3175636367 conn(0x7f4cd406d0f0 msgr2=0x7f4cd406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 shutdown_connections 2024-09-10T08:32:17.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.481+0000 7f4cdba00640 1 -- 172.21.15.52:0/3175636367 wait complete. 2024-09-10T08:32:17.497 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-10T08:32:17.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.652+0000 7fc919400640 1 Processor -- start 2024-09-10T08:32:17.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.653+0000 7fc919400640 1 -- start start 2024-09-10T08:32:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc919400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc91415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc919400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc914071180 con 0x7fc91413eb20 2024-09-10T08:32:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc919400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc914071460 con 0x7fc9140b2d40 2024-09-10T08:32:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc919400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc914071ab0 con 0x7fc91406c320 2024-09-10T08:32:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc913200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc91413eb20 0x7fc91415c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46680/0 (socket says 172.21.15.52:46680) 2024-09-10T08:32:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc913200640 1 -- 172.21.15.52:0/442319355 learned_addr learned my addr 172.21.15.52:0/442319355 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.654+0000 7fc90be00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc91415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837824806 0 0) 0x7fc914071180 con 0x7fc91413eb20 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f8003520 con 0x7fc91413eb20 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2601210066 0 0) 0x7fc8f8003520 con 0x7fc91413eb20 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 msgr2=0x7fc91415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc91415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 >> v1:172.21.15.176:6789/0 conn(0x7fc9140b2d40 legacy=0x7fc91406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914071740 con 0x7fc91413eb20 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc90c0019f0 con 0x7fc91413eb20 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 >> v1:172.21.15.52:6789/0 conn(0x7fc91413eb20 legacy=0x7fc91415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc8f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc914071ab0 con 0x7fc8f80039e0 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f800b9f0 con 0x7fc8f8004d40 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f800bbf0 con 0x7fc91406c320 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc912800640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.655+0000 7fc90be00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc8f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc913200640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc90be00640 1 -- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8f8004d40 msgr2=0x7fc8f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc90be00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc90be00640 1 -- 172.21.15.52:0/442319355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8f80039e0 msgr2=0x7fc8f8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc90be00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc90be00640 1 -- 172.21.15.52:0/442319355 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f8003520 con 0x7fc91406c320 2024-09-10T08:32:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.656+0000 7fc912800640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.657+0000 7fc90be00640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc8f8004800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009a90 tx=0x7fc8f8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43769629af1ff04b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.657+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc036070 con 0x7fc91406c320 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8fc031400 con 0x7fc91406c320 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc911e00640 1 -- 172.21.15.52:0/442319355 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc009690 con 0x7fc91406c320 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 -- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 msgr2=0x7fc8f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 --2- 172.21.15.52:0/442319355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc91406c320 0x7fc8f8004800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009a90 tx=0x7fc8f8005830 comp rx=0 tx=0).stop 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc913200640 1 -- 172.21.15.52:0/442319355 reap_dead start 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 -- 172.21.15.52:0/442319355 shutdown_connections 2024-09-10T08:32:17.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 -- 172.21.15.52:0/442319355 >> 172.21.15.52:0/442319355 conn(0x7fc9140ccec0 msgr2=0x7fc9140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:17.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 -- 172.21.15.52:0/442319355 shutdown_connections 2024-09-10T08:32:17.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.658+0000 7fc919400640 1 -- 172.21.15.52:0/442319355 wait complete. 2024-09-10T08:32:17.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.660+0000 7fc919400640 1 Processor -- start 2024-09-10T08:32:17.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.660+0000 7fc919400640 1 -- start start 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91406c320 0x7fc914144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc914158090 0x7fc914158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc91415c080 con 0x7fc91413d800 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc91415bf00 con 0x7fc91406c320 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc919400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9140b3570 con 0x7fc914158090 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53154/0 (socket says 172.21.15.52:53154) 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 -- 172.21.15.52:0/2082732023 learned_addr learned my addr 172.21.15.52:0/2082732023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc912800640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91406c320 0x7fc914144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc90be00640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc914158090 0x7fc914158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 -- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc914158090 msgr2=0x7fc914158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc914158090 0x7fc914158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 -- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91406c320 msgr2=0x7fc914144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91406c320 0x7fc914144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.661+0000 7fc913200640 1 -- 172.21.15.52:0/2082732023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91413e1f0 con 0x7fc91413d800 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc913200640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc90c002230 tx=0x7fc90c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904001580 con 0x7fc91413d800 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90c018070 con 0x7fc91413d800 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9141425e0 con 0x7fc91413d800 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00ad70 con 0x7fc91413d800 2024-09-10T08:32:17.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.662+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc914142b60 con 0x7fc91413d800 2024-09-10T08:32:17.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.663+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91406bc10 con 0x7fc91413d800 2024-09-10T08:32:17.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.664+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc90c01d460 con 0x7fc91413d800 2024-09-10T08:32:17.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.665+0000 7fc90aa00640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:17.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.665+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fc90c08af20 con 0x7fc91413d800 2024-09-10T08:32:17.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.665+0000 7fc912800640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:17.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.666+0000 7fc912800640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 0x7fc8f006e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc904000c00 tx=0x7fc904007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:17.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.669+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc90c059bc0 con 0x7fc91413d800 2024-09-10T08:32:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:17.922+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fc91406c9c0 con 0x7fc91413d800 2024-09-10T08:32:18.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.712+0000 7fc90aa00640 1 -- 172.21.15.52:0/2082732023 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v177) ==== 154+0+0 (secure 0 0 0) 0x7fc90c0594c0 con 0x7fc91413d800 2024-09-10T08:32:18.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 msgr2=0x7fc8f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:18.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 0x7fc8f006e320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc904000c00 tx=0x7fc904007cc0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 msgr2=0x7fc91413dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:18.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc90c002230 tx=0x7fc90c007b00 comp rx=0 tx=0).stop 2024-09-10T08:32:18.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 shutdown_connections 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc91413d800 0x7fc91413dcb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc914158090 0x7fc914158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 --2- 172.21.15.52:0/2082732023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc91406c320 0x7fc914144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 >> 172.21.15.52:0/2082732023 conn(0x7fc9140ccec0 msgr2=0x7fc91415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 shutdown_connections 2024-09-10T08:32:18.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.717+0000 7fc919400640 1 -- 172.21.15.52:0/2082732023 wait complete. 2024-09-10T08:32:18.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:32:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.899+0000 7f60dfe00640 1 Processor -- start 2024-09-10T08:32:18.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.899+0000 7f60dfe00640 1 -- start start 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f60e00b5fd0 0x7f60e00d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dfe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f60e00b7c10 0x7f60e00b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dfe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e00d3950 con 0x7f60e00b63b0 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f60e00d3c30 con 0x7f60e00b5fd0 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dfe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f60e00d3f10 con 0x7f60e00b7c10 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f60e00b5fd0 0x7f60e00d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f60e00b5fd0 0x7f60e00d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53156/0 (socket says 172.21.15.52:53156) 2024-09-10T08:32:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.900+0000 7f60dea00640 1 -- 172.21.15.52:0/2302196517 learned_addr learned my addr 172.21.15.52:0/2302196517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.901+0000 7f60df400640 1 --2- 172.21.15.52:0/2302196517 >> v2:172.21.15.176:3300/0 conn(0x7f60e00b7c10 0x7f60e00b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.901+0000 7f60dea00640 1 -- 172.21.15.52:0/2302196517 >> v2:172.21.15.176:3300/0 conn(0x7f60e00b7c10 msgr2=0x7f60e00b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.901+0000 7f60dea00640 1 --2- 172.21.15.52:0/2302196517 >> v2:172.21.15.176:3300/0 conn(0x7f60e00b7c10 0x7f60e00b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.901+0000 7f60dea00640 1 -- 172.21.15.52:0/2302196517 >> v1:172.21.15.176:6789/0 conn(0x7f60e00b63b0 legacy=0x7f60e00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.901+0000 7f60dea00640 1 -- 172.21.15.52:0/2302196517 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e00d41f0 con 0x7f60e00b5fd0 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.902+0000 7f60dea00640 1 --2- 172.21.15.52:0/2302196517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00d32c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ceb30 tx=0x7f60d002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca0e7351cd49b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.902+0000 7f60dd600640 1 -- 172.21.15.52:0/2302196517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0037070 con 0x7f60e00b5fd0 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.902+0000 7f60dd600640 1 -- 172.21.15.52:0/2302196517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d002ae50 con 0x7f60e00b5fd0 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.902+0000 7f60dd600640 1 -- 172.21.15.52:0/2302196517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0032860 con 0x7f60e00b5fd0 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 -- 172.21.15.52:0/2302196517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 msgr2=0x7f60e00d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 --2- 172.21.15.52:0/2302196517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00d32c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ceb30 tx=0x7f60d002a300 comp rx=0 tx=0).stop 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 -- 172.21.15.52:0/2302196517 shutdown_connections 2024-09-10T08:32:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 --2- 172.21.15.52:0/2302196517 >> v2:172.21.15.176:3300/0 conn(0x7f60e00b7c10 0x7f60e00b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 --2- 172.21.15.52:0/2302196517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00d32c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 -- 172.21.15.52:0/2302196517 >> 172.21.15.52:0/2302196517 conn(0x7f60e00d0fd0 msgr2=0x7f60e00d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 -- 172.21.15.52:0/2302196517 shutdown_connections 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.903+0000 7f60dfe00640 1 -- 172.21.15.52:0/2302196517 wait complete. 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.904+0000 7f60dfe00640 1 Processor -- start 2024-09-10T08:32:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.904+0000 7f60dfe00640 1 -- start start 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00b63b0 0x7f60e00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e00b7c10 0x7f60e0160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00b6950 con 0x7f60e00b5fd0 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00b67d0 con 0x7f60e00b7c10 2024-09-10T08:32:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.905+0000 7f60dfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60e015e7f0 con 0x7f60e00b63b0 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60df400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e00b7c10 0x7f60e0160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53160/0 (socket says 172.21.15.52:53160) 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 -- 172.21.15.52:0/3018489667 learned_addr learned my addr 172.21.15.52:0/3018489667 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60de000640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00b63b0 0x7f60e00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 -- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00b63b0 msgr2=0x7f60e00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00b63b0 0x7f60e00caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 -- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e00b7c10 msgr2=0x7f60e0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e00b7c10 0x7f60e0160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 -- 172.21.15.52:0/3018489667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e00c9b00 con 0x7f60e00b5fd0 2024-09-10T08:32:18.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.906+0000 7f60dea00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f60d002a340 tx=0x7f60d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:18.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.907+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0041020 con 0x7f60e00b5fd0 2024-09-10T08:32:18.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.907+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d003c670 con 0x7f60e00b5fd0 2024-09-10T08:32:18.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.907+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0037040 con 0x7f60e00b5fd0 2024-09-10T08:32:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.907+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e00c9de0 con 0x7f60e00b5fd0 2024-09-10T08:32:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.907+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e00ca3a0 con 0x7f60e00b5fd0 2024-09-10T08:32:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.908+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e00d32c0 con 0x7f60e00b5fd0 2024-09-10T08:32:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.909+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60d0044020 con 0x7f60e00b5fd0 2024-09-10T08:32:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.910+0000 7f60d6a00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.910+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f60d00ab030 con 0x7f60e00b5fd0 2024-09-10T08:32:18.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.910+0000 7f60de000640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:18.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.911+0000 7f60de000640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 0x7f60c006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60e01614b0 tx=0x7f60cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:18.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:18.914+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60d004b030 con 0x7f60e00b5fd0 2024-09-10T08:32:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.098+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f60e015baf0 con 0x7f60e00b5fd0 2024-09-10T08:32:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.101+0000 7f60d6a00640 1 -- 172.21.15.52:0/3018489667 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f60d0079720 con 0x7f60e00b5fd0 2024-09-10T08:32:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 msgr2=0x7f60c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 0x7f60c006e2f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60e01614b0 tx=0x7f60cc009040 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 msgr2=0x7f60e00ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f60d002a340 tx=0x7f60d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 shutdown_connections 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f60c006be30 0x7f60c006e2f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60e00b7c10 0x7f60e0160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60e00b63b0 0x7f60e00caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 --2- 172.21.15.52:0/3018489667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60e00b5fd0 0x7f60e00ccae0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 >> 172.21.15.52:0/3018489667 conn(0x7f60e00d0fd0 msgr2=0x7f60e00b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 shutdown_connections 2024-09-10T08:32:19.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.104+0000 7f60dfe00640 1 -- 172.21.15.52:0/3018489667 wait complete. 2024-09-10T08:32:19.119 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:32:19.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:19.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:19.304 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:32:19.304 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:19.304 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:19.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:32:19.340 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:19.340 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:19.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:19.379 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:19.379 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:19.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:32:19.415 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:19.415 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:19.456 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:19.456 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:32:19.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:19.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.611+0000 7fb901a00640 1 Processor -- start 2024-09-10T08:32:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.611+0000 7fb901a00640 1 -- start start 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.612+0000 7fb901a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc145ed0 0x7fb8fc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.612+0000 7fb901a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb8fc0b5f90 0x7fb8fc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.612+0000 7fb901a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8fc0b4020 con 0x7fb8fc073180 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.612+0000 7fb901a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc073b00 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.612+0000 7fb901a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b42c0 con 0x7fb8fc145ed0 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8f3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb8fc073180 0x7fb8fc0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46684/0 (socket says 172.21.15.52:46684) 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8f3e00640 1 -- 172.21.15.52:0/2288478413 learned_addr learned my addr 172.21.15.52:0/2288478413 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fb400640 1 --2- 172.21.15.52:0/2288478413 >> v2:172.21.15.176:3300/0 conn(0x7fb8fc0b5f90 0x7fb8fc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8faa00640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc145ed0 0x7fb8fc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fa000640 1 -- 172.21.15.52:0/2288478413 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504587781 0 0) 0x7fb8fc0b4020 con 0x7fb8fc073180 2024-09-10T08:32:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fa000640 1 -- 172.21.15.52:0/2288478413 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003520 con 0x7fb8fc073180 2024-09-10T08:32:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fb400640 1 -- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc145ed0 msgr2=0x7fb8fc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fb400640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc145ed0 0x7fb8fc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fb400640 1 -- 172.21.15.52:0/2288478413 >> v1:172.21.15.52:6789/0 conn(0x7fb8fc073180 legacy=0x7fb8fc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.613+0000 7fb8fb400640 1 -- 172.21.15.52:0/2288478413 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0b45a0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.614+0000 7fb8fb400640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc0735c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009d90 tx=0x7fb8f402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1653edc7e6f06c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb8fa000640 1 -- 172.21.15.52:0/2288478413 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007740 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb8fa000640 1 -- 172.21.15.52:0/2288478413 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f40078e0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb8fa000640 1 -- 172.21.15.52:0/2288478413 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007c90 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 -- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc0b5f90 msgr2=0x7fb8fc0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc0735c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009d90 tx=0x7fb8f402a660 comp rx=0 tx=0).stop 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 -- 172.21.15.52:0/2288478413 shutdown_connections 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc0735c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 --2- 172.21.15.52:0/2288478413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc145ed0 0x7fb8fc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.615+0000 7fb901a00640 1 -- 172.21.15.52:0/2288478413 >> 172.21.15.52:0/2288478413 conn(0x7fb8fc0ccec0 msgr2=0x7fb8fc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:19.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.616+0000 7fb901a00640 1 -- 172.21.15.52:0/2288478413 shutdown_connections 2024-09-10T08:32:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.616+0000 7fb901a00640 1 -- 172.21.15.52:0/2288478413 wait complete. 2024-09-10T08:32:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.617+0000 7fb901a00640 1 Processor -- start 2024-09-10T08:32:19.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.617+0000 7fb901a00640 1 -- start start 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc073180 0x7fb8fc1e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 0x7fb8fc1e2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc1462b0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b4b60 con 0x7fb8fc145ed0 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.618+0000 7fb901a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc146430 con 0x7fb8fc073180 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53172/0 (socket says 172.21.15.52:53172) 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 -- 172.21.15.52:0/75570154 learned_addr learned my addr 172.21.15.52:0/75570154 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:19.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8faa00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc073180 0x7fb8fc1e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8fb400640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 0x7fb8fc1e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 -- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc073180 msgr2=0x7fb8fc1e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc073180 0x7fb8fc1e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 -- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 msgr2=0x7fb8fc1e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 0x7fb8fc1e2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 -- 172.21.15.52:0/75570154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0cae40 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8fb400640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 0x7fb8fc1e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.619+0000 7fb8f3e00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c400 tx=0x7fb8e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.620+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4017070 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.620+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4005d00 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.620+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4007310 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.620+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc0cb120 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.620+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc0cb6e0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.621+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc0735c0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.622+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8e401a070 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.623+0000 7fb8f2a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:19.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.623+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fb8e4089ef0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.624+0000 7fb8faa00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:19.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.624+0000 7fb8faa00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009aa0 tx=0x7fb8ec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:19.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.628+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8e4058540 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.849+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8fc0d11d0 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.849+0000 7fb8f2a00640 1 -- 172.21.15.52:0/75570154 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3914 (secure 0 0 0) 0x7fb8e405c840 con 0x7fb8fc0b5f90 2024-09-10T08:32:19.850 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:19.850 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":29,"btime":"2024-09-10T08:32:13:692638+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2097732126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2097732126},{"type":"v1","addr":"172.21.15.176:6836","nonce":2097732126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":4862,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2695957014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2695957014},{"type":"v1","addr":"172.21.15.176:6837","nonce":2695957014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1188993010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1188993010},{"type":"v1","addr":"172.21.15.52:6834","nonce":1188993010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/109762702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":109762702},{"type":"v1","addr":"172.21.15.52:6835","nonce":109762702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-10T08:32:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 29 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 msgr2=0x7fb8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 0x7fb8d806e2f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009aa0 tx=0x7fb8ec009190 comp rx=0 tx=0).stop 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 msgr2=0x7fb8fc132a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c400 tx=0x7fb8e400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 shutdown_connections 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb8d806be30 0x7fb8d806e2f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb8fc145ed0 0x7fb8fc1e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8fc0b5f90 0x7fb8fc132a30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 --2- 172.21.15.52:0/75570154 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb8fc073180 0x7fb8fc1e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 >> 172.21.15.52:0/75570154 conn(0x7fb8fc0ccec0 msgr2=0x7fb8fc0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.851+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 shutdown_connections 2024-09-10T08:32:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:19.852+0000 7fb901a00640 1 -- 172.21.15.52:0/75570154 wait complete. 2024-09-10T08:32:19.868 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:32:19.868 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:32:19.868 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:32:19.868 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:19.869 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:32:19.869 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:32:19.869 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:32:19.869 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:19.869 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:32:19.869 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:32:19.869 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:32:19.870 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:19.870 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:32:19.870 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:32:19.870 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:32:19.870 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:19.883 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:32:19.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:32:19.885 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:32:19.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:32:19.886 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:32:19.887 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:32:19.887 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:32:19.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:32:19.928 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:32:19.929 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:19.931 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:32:19.931 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:19.932 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:32:19.932 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:19.933 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:32:19.934 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:19.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:32:20.061 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:32:20.061 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:32:20.064 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:32:20.064 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:32:20.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.096+0000 7f192d600640 1 Processor -- start 2024-09-10T08:32:20.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.097+0000 7f192d600640 1 -- start start 2024-09-10T08:32:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192d600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f19280cf080 0x7f192806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 0x7f192815c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192d600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19280cf5f0 con 0x7f19281452e0 2024-09-10T08:32:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192d600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f192806c580 con 0x7f19280cf080 2024-09-10T08:32:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19280cf8d0 con 0x7f192806c150 2024-09-10T08:32:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f1927e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f19281452e0 0x7f1928145a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:55126/0 (socket says 172.21.15.52:55126) 2024-09-10T08:32:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f1927e00640 1 -- 172.21.15.52:0/2150807689 learned_addr learned my addr 172.21.15.52:0/2150807689 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f1927400640 1 --2- 172.21.15.52:0/2150807689 >> v2:172.21.15.176:3300/0 conn(0x7f19280cf080 0x7f192806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.098+0000 7f192cc00640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 0x7f192815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f1926a00640 1 -- 172.21.15.52:0/2150807689 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940550850 0 0) 0x7f19280cf5f0 con 0x7f19281452e0 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f1927400640 1 -- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 msgr2=0x7f192815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f1927400640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 0x7f192815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f1927400640 1 -- 172.21.15.52:0/2150807689 >> v1:172.21.15.176:6789/0 conn(0x7f19281452e0 legacy=0x7f1928145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f1927400640 1 -- 172.21.15.52:0/2150807689 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280cfbb0 con 0x7f19280cf080 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.099+0000 7f192cc00640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 0x7f192815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.100+0000 7f1927400640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19280cf080 0x7f192806bc10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5468ffac23c6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.100+0000 7f1926a00640 1 -- 172.21.15.52:0/2150807689 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914037070 con 0x7f19280cf080 2024-09-10T08:32:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.100+0000 7f1926a00640 1 -- 172.21.15.52:0/2150807689 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914032440 con 0x7f19280cf080 2024-09-10T08:32:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.100+0000 7f1926a00640 1 -- 172.21.15.52:0/2150807689 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914032810 con 0x7f19280cf080 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 -- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19280cf080 msgr2=0x7f192806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19280cf080 0x7f192806bc10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f191402a180 comp rx=0 tx=0).stop 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 -- 172.21.15.52:0/2150807689 shutdown_connections 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f192806c150 0x7f192815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 --2- 172.21.15.52:0/2150807689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19280cf080 0x7f192806bc10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.101+0000 7f192d600640 1 -- 172.21.15.52:0/2150807689 >> 172.21.15.52:0/2150807689 conn(0x7f192806e2d0 msgr2=0x7f192806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.102+0000 7f192d600640 1 -- 172.21.15.52:0/2150807689 shutdown_connections 2024-09-10T08:32:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.102+0000 7f192d600640 1 -- 172.21.15.52:0/2150807689 wait complete. 2024-09-10T08:32:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.104+0000 7f192d600640 1 Processor -- start 2024-09-10T08:32:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.104+0000 7f192d600640 1 -- start start 2024-09-10T08:32:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192806c150 0x7f19281f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19281452e0 0x7f19280aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d0670 con 0x7f19280cf080 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d0170 con 0x7f192806c150 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f192815cdd0 con 0x7f19281452e0 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f1927400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f1927e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192806c150 0x7f19281f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f1927400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53202/0 (socket says 172.21.15.52:53202) 2024-09-10T08:32:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f1927400640 1 -- 172.21.15.52:0/1745780542 learned_addr learned my addr 172.21.15.52:0/1745780542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.105+0000 7f192cc00640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19281452e0 0x7f19280aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 -- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19281452e0 msgr2=0x7f19280aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19281452e0 0x7f19280aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 -- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192806c150 msgr2=0x7f19281f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192806c150 0x7f19281f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 -- 172.21.15.52:0/1745780542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280b4620 con 0x7f19280cf080 2024-09-10T08:32:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f1927400640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f19140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914037050 con 0x7f19280cf080 2024-09-10T08:32:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1914038040 con 0x7f19280cf080 2024-09-10T08:32:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19280b4900 con 0x7f19280cf080 2024-09-10T08:32:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1914004490 con 0x7f19280cf080 2024-09-10T08:32:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.106+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19280b4ec0 con 0x7f19280cf080 2024-09-10T08:32:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.107+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f192815c890 con 0x7f19280cf080 2024-09-10T08:32:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.109+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1914003610 con 0x7f19280cf080 2024-09-10T08:32:20.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.110+0000 7f191fe00640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:20.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.110+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4943+0+0 (secure 0 0 0) 0x7f19140ab4e0 con 0x7f19280cf080 2024-09-10T08:32:20.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.110+0000 7f1927e00640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.111+0000 7f1927e00640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1918007fd0 tx=0x7f1918007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.114+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f191407a070 con 0x7f19280cf080 2024-09-10T08:32:20.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:20.313+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f19280732a0 con 0x7f19280cf080 2024-09-10T08:32:21.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.127+0000 7f191fe00640 1 -- 172.21.15.52:0/1745780542 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) ==== 97+0+0 (secure 0 0 0) 0x7f1914079970 con 0x7f19280cf080 2024-09-10T08:32:21.127 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:32:21.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 msgr2=0x7f190806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 0x7f190806e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1918007fd0 tx=0x7f1918007de0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 msgr2=0x7f19281415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f19140097a0 tx=0x7f19140046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 shutdown_connections 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f190806be30 0x7f190806e2f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19281452e0 0x7f19280aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19280cf080 0x7f19281415d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 --2- 172.21.15.52:0/1745780542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f192806c150 0x7f19281f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 >> 172.21.15.52:0/1745780542 conn(0x7f192806e2d0 msgr2=0x7f19281427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 shutdown_connections 2024-09-10T08:32:21.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.130+0000 7f192d600640 1 -- 172.21.15.52:0/1745780542 wait complete. 2024-09-10T08:32:21.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:32:21.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.310+0000 7faa67e00640 1 Processor -- start 2024-09-10T08:32:21.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.311+0000 7faa67e00640 1 -- start start 2024-09-10T08:32:21.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa67e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faa6015e6d0 0x7faa60071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa67e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6015eab0 con 0x7faa6006cd20 2024-09-10T08:32:21.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa67e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6015ed70 con 0x7faa60070b80 2024-09-10T08:32:21.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa67e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faa6015f050 con 0x7faa6015e6d0 2024-09-10T08:32:21.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa64a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faa6006cd20 0x7faa600b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46720/0 (socket says 172.21.15.52:46720) 2024-09-10T08:32:21.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa64a00640 1 -- 172.21.15.52:0/1905267051 learned_addr learned my addr 172.21.15.52:0/1905267051 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.312+0000 7faa65400640 1 --2- 172.21.15.52:0/1905267051 >> v2:172.21.15.176:3300/0 conn(0x7faa6015e6d0 0x7faa60071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728922049 0 0) 0x7faa6015eab0 con 0x7faa6006cd20 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa48003520 con 0x7faa6006cd20 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026587311 0 0) 0x7faa6015ed70 con 0x7faa60070b80 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa6015eab0 con 0x7faa60070b80 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2455408242 0 0) 0x7faa48003520 con 0x7faa6006cd20 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 >> v2:172.21.15.176:3300/0 conn(0x7faa6015e6d0 msgr2=0x7faa60071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 --2- 172.21.15.52:0/1905267051 >> v2:172.21.15.176:3300/0 conn(0x7faa6015e6d0 0x7faa60071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 >> v1:172.21.15.176:6789/0 conn(0x7faa60070b80 legacy=0x7faa601622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6015f330 con 0x7faa6006cd20 2024-09-10T08:32:21.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7faa4c001670 con 0x7faa6006cd20 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 >> v1:172.21.15.52:6789/0 conn(0x7faa6006cd20 legacy=0x7faa600b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa48003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa48004800 0x7faa48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa480051c0 0x7faa4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa6015f050 con 0x7faa48003b40 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa4800c040 con 0x7faa48004800 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa4800c240 con 0x7faa480051c0 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa65400640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa48003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.313+0000 7faa64a00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa48004800 0x7faa48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65e00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa480051c0 0x7faa4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65400640 1 -- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa480051c0 msgr2=0x7faa4800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:21.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65400640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa480051c0 0x7faa4800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65400640 1 -- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa48004800 msgr2=0x7faa48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65400640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa48004800 0x7faa48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65400640 1 -- 172.21.15.52:0/1905267051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa48003520 con 0x7faa48003b40 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.314+0000 7faa65e00640 1 -- 172.21.15.52:0/1905267051 reap_dead start 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa65400640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa48003f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faa54009ac0 tx=0x7faa48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d686efa10fbbabc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54036070 con 0x7faa48003b40 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa54031400 con 0x7faa48003b40 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa5fe00640 1 -- 172.21.15.52:0/1905267051 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54009690 con 0x7faa48003b40 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa67e00640 1 -- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 msgr2=0x7faa48003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa67e00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa48003f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faa54009ac0 tx=0x7faa48005830 comp rx=0 tx=0).stop 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa67e00640 1 -- 172.21.15.52:0/1905267051 shutdown_connections 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa67e00640 1 --2- 172.21.15.52:0/1905267051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa48003f40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.315+0000 7faa67e00640 1 -- 172.21.15.52:0/1905267051 >> 172.21.15.52:0/1905267051 conn(0x7faa60067fb0 msgr2=0x7faa6006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:21.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.316+0000 7faa67e00640 1 -- 172.21.15.52:0/1905267051 shutdown_connections 2024-09-10T08:32:21.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.316+0000 7faa67e00640 1 -- 172.21.15.52:0/1905267051 wait complete. 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.317+0000 7faa67e00640 1 Processor -- start 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.317+0000 7faa67e00640 1 -- start start 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600b29a0 0x7faa6014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa600b4cb0 0x7faa6014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa60071390 con 0x7faa48003b40 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faa6015f8f0 con 0x7faa600b4cb0 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.318+0000 7faa67e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faa60071510 con 0x7faa600b29a0 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53228/0 (socket says 172.21.15.52:53228) 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 -- 172.21.15.52:0/3493477570 learned_addr learned my addr 172.21.15.52:0/3493477570 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 -- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600b29a0 msgr2=0x7faa6014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600b29a0 0x7faa6014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 -- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa600b4cb0 msgr2=0x7faa6014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa600b4cb0 0x7faa6014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 -- 172.21.15.52:0/3493477570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa600b2e30 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa65400640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7faa54034040 tx=0x7faa54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5403f020 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa54037040 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.319+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54036070 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.320+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa600b3110 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.320+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa600b36d0 con 0x7faa48003b40 2024-09-10T08:32:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.321+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa600718a0 con 0x7faa48003b40 2024-09-10T08:32:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.322+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faa54042020 con 0x7faa48003b40 2024-09-10T08:32:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.322+0000 7faa5d600640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 0x7faa4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.323+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7faa540aa9a0 con 0x7faa48003b40 2024-09-10T08:32:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.323+0000 7faa64a00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 0x7faa4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.324+0000 7faa64a00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 0x7faa4006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa601539f0 tx=0x7faa4c000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.327+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa54049070 con 0x7faa48003b40 2024-09-10T08:32:21.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.579+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faa600b57e0 con 0x7faa48003b40 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.580+0000 7faa5d600640 1 -- 172.21.15.52:0/3493477570 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7faa540796c0 con 0x7faa48003b40 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:32:21.580 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:32:21.582 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.583 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.584 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.586 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:32:21.587 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.588 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:32:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:32:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.593 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:32:21.594 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:32:21.595 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:32:21.595 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.595 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.595 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:32:21.595 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 msgr2=0x7faa4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 0x7faa4006e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa601539f0 tx=0x7faa4c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 msgr2=0x7faa6014d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7faa54034040 tx=0x7faa54004730 comp rx=0 tx=0).stop 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 shutdown_connections 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faa4006be30 0x7faa4006e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faa600b4cb0 0x7faa6014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faa600b29a0 0x7faa6014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 --2- 172.21.15.52:0/3493477570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa48003b40 0x7faa6014d500 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 >> 172.21.15.52:0/3493477570 conn(0x7faa60067fb0 msgr2=0x7faa60161310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 shutdown_connections 2024-09-10T08:32:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.582+0000 7faa67e00640 1 -- 172.21.15.52:0/3493477570 wait complete. 2024-09-10T08:32:21.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:32:21.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.755+0000 7ff302a00640 1 Processor -- start 2024-09-10T08:32:21.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.755+0000 7ff302a00640 1 -- start start 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff302a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2fc1624b0 0x7ff2fc15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff302a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 0x7ff2fc0b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff302a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc0b7030 con 0x7ff2fc15eb60 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff302a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff2fc15f590 con 0x7ff2fc1624b0 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff302a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff2fc15f870 con 0x7ff2fc0b66a0 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2f3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2fc1624b0 0x7ff2fc15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2fbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff2fc15eb60 0x7ff2fc0d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46722/0 (socket says 172.21.15.52:46722) 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2fbe00640 1 -- 172.21.15.52:0/1592553465 learned_addr learned my addr 172.21.15.52:0/1592553465 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:21.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff300a00640 1 --2- 172.21.15.52:0/1592553465 >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 0x7ff2fc0b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2f3400640 1 -- 172.21.15.52:0/1592553465 >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 msgr2=0x7ff2fc0b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2f3400640 1 --2- 172.21.15.52:0/1592553465 >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 0x7ff2fc0b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2f3400640 1 -- 172.21.15.52:0/1592553465 >> v1:172.21.15.52:6789/0 conn(0x7ff2fc15eb60 legacy=0x7ff2fc0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2f3400640 1 -- 172.21.15.52:0/1592553465 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc15fb50 con 0x7ff2fc1624b0 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff2fb400640 1 -- 172.21.15.52:0/1592553465 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304739694 0 0) 0x7ff2fc0b7030 con 0x7ff2fc15eb60 2024-09-10T08:32:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.757+0000 7ff300a00640 1 --2- 172.21.15.52:0/1592553465 >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 0x7ff2fc0b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.758+0000 7ff2f3400640 1 --2- 172.21.15.52:0/1592553465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc15ef40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0d5860 tx=0x7ff2e402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a29f362e7b4013 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff2fb400640 1 -- 172.21.15.52:0/1592553465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4037070 con 0x7ff2fc1624b0 2024-09-10T08:32:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff2fb400640 1 -- 172.21.15.52:0/1592553465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e402add0 con 0x7ff2fc1624b0 2024-09-10T08:32:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff2fb400640 1 -- 172.21.15.52:0/1592553465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4032660 con 0x7ff2fc1624b0 2024-09-10T08:32:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 -- 172.21.15.52:0/1592553465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc1624b0 msgr2=0x7ff2fc15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 --2- 172.21.15.52:0/1592553465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc15ef40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0d5860 tx=0x7ff2e402a080 comp rx=0 tx=0).stop 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 -- 172.21.15.52:0/1592553465 shutdown_connections 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 --2- 172.21.15.52:0/1592553465 >> v2:172.21.15.176:3300/0 conn(0x7ff2fc0b66a0 0x7ff2fc0b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 --2- 172.21.15.52:0/1592553465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc15ef40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 -- 172.21.15.52:0/1592553465 >> 172.21.15.52:0/1592553465 conn(0x7ff2fc0d16f0 msgr2=0x7ff2fc0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 -- 172.21.15.52:0/1592553465 shutdown_connections 2024-09-10T08:32:21.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.759+0000 7ff302a00640 1 -- 172.21.15.52:0/1592553465 wait complete. 2024-09-10T08:32:21.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.761+0000 7ff302a00640 1 Processor -- start 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.761+0000 7ff302a00640 1 -- start start 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 0x7ff2fc0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc0d4480 con 0x7ff2fc15eb60 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc0cef40 con 0x7ff2fc1624b0 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff302a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2fc0d4600 con 0x7ff2fc0b66a0 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff2f3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff2f3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53240/0 (socket says 172.21.15.52:53240) 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.762+0000 7ff2f3400640 1 -- 172.21.15.52:0/3174170562 learned_addr learned my addr 172.21.15.52:0/3174170562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff300a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 -- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 msgr2=0x7ff2fc0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2fbe00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 0x7ff2fc0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 0x7ff2fc0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 -- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 msgr2=0x7ff2fc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 -- 172.21.15.52:0/3174170562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc0cb6d0 con 0x7ff2fc15eb60 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff300a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2fbe00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 0x7ff2fc0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f3400640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40096f0 tx=0x7ff2e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4037050 con 0x7ff2fc15eb60 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e4038040 con 0x7ff2fc15eb60 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc0cc1a0 con 0x7ff2fc15eb60 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004430 con 0x7ff2fc15eb60 2024-09-10T08:32:21.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.763+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc0cc760 con 0x7ff2fc15eb60 2024-09-10T08:32:21.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.764+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc15ef40 con 0x7ff2fc15eb60 2024-09-10T08:32:21.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.765+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2e402ac90 con 0x7ff2fc15eb60 2024-09-10T08:32:21.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.766+0000 7ff2f8c00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 0x7ff2d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:21.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.766+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7ff2e40ab2b0 con 0x7ff2fc15eb60 2024-09-10T08:32:21.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.767+0000 7ff2fbe00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 0x7ff2d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:21.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.767+0000 7ff2fbe00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 0x7ff2d806e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007fd0 tx=0x7ff2ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:21.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.770+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2e407a0c0 con 0x7ff2fc15eb60 2024-09-10T08:32:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.955+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff2fc0d2520 con 0x7ff2fc15eb60 2024-09-10T08:32:21.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.956+0000 7ff2f8c00640 1 -- 172.21.15.52:0/3174170562 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) ==== 84+0+65 (secure 0 0 0) 0x7ff2e40799c0 con 0x7ff2fc15eb60 2024-09-10T08:32:21.956 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:21.956 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:32:21.956 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:32:21.957 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:32:21.957 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:32:21.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:32:21.957 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:32:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 msgr2=0x7ff2d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 0x7ff2d806e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007fd0 tx=0x7ff2ec009040 comp rx=0 tx=0).stop 2024-09-10T08:32:21.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 msgr2=0x7ff2fc0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40096f0 tx=0x7ff2e40046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 shutdown_connections 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d806be30 0x7ff2d806e2f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2fc1624b0 0x7ff2fc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2fc15eb60 0x7ff2fc0cb190 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 --2- 172.21.15.52:0/3174170562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2fc0b66a0 0x7ff2fc0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 >> 172.21.15.52:0/3174170562 conn(0x7ff2fc0d16f0 msgr2=0x7ff2fc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 shutdown_connections 2024-09-10T08:32:21.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:21.958+0000 7ff302a00640 1 -- 172.21.15.52:0/3174170562 wait complete. 2024-09-10T08:32:21.973 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:32:21.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:32:22.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.134+0000 7fd23a000640 1 Processor -- start 2024-09-10T08:32:22.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.134+0000 7fd23a000640 1 -- start start 2024-09-10T08:32:22.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd23a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406dfd0 0x7fd2340d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd23a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2340d2690 0x7fd2340d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd23a000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd234162040 con 0x7fd234161c60 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd23a000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd2340d5040 con 0x7fd2340d2690 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd23a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340d5320 con 0x7fd23406dfd0 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd238c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd234161c60 0x7fd23406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46730/0 (socket says 172.21.15.52:46730) 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.135+0000 7fd238c00640 1 -- 172.21.15.52:0/427701284 learned_addr learned my addr 172.21.15.52:0/427701284 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd239600640 1 --2- 172.21.15.52:0/427701284 >> v2:172.21.15.52:3300/0 conn(0x7fd2340d2690 0x7fd2340d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd233e00640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406dfd0 0x7fd2340d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd233400640 1 -- 172.21.15.52:0/427701284 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472056839 0 0) 0x7fd234162040 con 0x7fd234161c60 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd233400640 1 -- 172.21.15.52:0/427701284 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd21c003520 con 0x7fd234161c60 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd239600640 1 -- 172.21.15.52:0/427701284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406dfd0 msgr2=0x7fd2340d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd239600640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406dfd0 0x7fd2340d2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd239600640 1 -- 172.21.15.52:0/427701284 >> v1:172.21.15.52:6789/0 conn(0x7fd234161c60 legacy=0x7fd23406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.136+0000 7fd239600640 1 -- 172.21.15.52:0/427701284 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340d3da0 con 0x7fd2340d2690 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.137+0000 7fd239600640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2340d2690 0x7fd2340d2ae0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efd37e428cc8767 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.137+0000 7fd233400640 1 -- 172.21.15.52:0/427701284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c007740 con 0x7fd2340d2690 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.137+0000 7fd233400640 1 -- 172.21.15.52:0/427701284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c0078e0 con 0x7fd2340d2690 2024-09-10T08:32:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.137+0000 7fd233400640 1 -- 172.21.15.52:0/427701284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c007cb0 con 0x7fd2340d2690 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 -- 172.21.15.52:0/427701284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2340d2690 msgr2=0x7fd2340d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2340d2690 0x7fd2340d2ae0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c02a660 comp rx=0 tx=0).stop 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 -- 172.21.15.52:0/427701284 shutdown_connections 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2340d2690 0x7fd2340d2ae0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 --2- 172.21.15.52:0/427701284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd23406dfd0 0x7fd2340d2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 -- 172.21.15.52:0/427701284 >> 172.21.15.52:0/427701284 conn(0x7fd2340d1630 msgr2=0x7fd2340d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 -- 172.21.15.52:0/427701284 shutdown_connections 2024-09-10T08:32:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.138+0000 7fd23a000640 1 -- 172.21.15.52:0/427701284 wait complete. 2024-09-10T08:32:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.140+0000 7fd23a000640 1 Processor -- start 2024-09-10T08:32:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.140+0000 7fd23a000640 1 -- start start 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2340d2690 0x7fd2341f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234161c60 0x7fd2341f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340b86c0 con 0x7fd23406dfd0 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340d42c0 con 0x7fd234161c60 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd23a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340b8840 con 0x7fd2340d2690 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53258/0 (socket says 172.21.15.52:53258) 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 -- 172.21.15.52:0/1979067039 learned_addr learned my addr 172.21.15.52:0/1979067039 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 -- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2340d2690 msgr2=0x7fd2341f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2340d2690 0x7fd2341f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 -- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234161c60 msgr2=0x7fd2341f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234161c60 0x7fd2341f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.141+0000 7fd238c00640 1 -- 172.21.15.52:0/1979067039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340c86f0 con 0x7fd23406dfd0 2024-09-10T08:32:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd238c00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c390 tx=0x7fd22800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228017070 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228005ce0 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280072f0 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2340c89d0 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.142+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2340c8f90 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.143+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2340ccff0 con 0x7fd23406dfd0 2024-09-10T08:32:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.144+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd22801a070 con 0x7fd23406dfd0 2024-09-10T08:32:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.145+0000 7fd230c00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.145+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4857+0+0 (secure 0 0 0) 0x7fd228089ef0 con 0x7fd23406dfd0 2024-09-10T08:32:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.146+0000 7fd233e00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:22.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.146+0000 7fd233e00640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 0x7fd21406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2340b8e80 tx=0x7fd2200095a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.149+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2340ccff0 con 0x7fd23406dfd0 2024-09-10T08:32:22.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:22.333+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd2340b8300 con 0x7fd23406dfd0 2024-09-10T08:32:23.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.131+0000 7fd230c00640 1 -- 172.21.15.52:0/1979067039 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) ==== 138+0+0 (secure 0 0 0) 0x7fd228058ca0 con 0x7fd23406dfd0 2024-09-10T08:32:23.131 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:32:23.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.135+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 msgr2=0x7fd21406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.135+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 0x7fd21406e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd2340b8e80 tx=0x7fd2200095a0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.135+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 msgr2=0x7fd2340c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.135+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c390 tx=0x7fd22800c850 comp rx=0 tx=0).stop 2024-09-10T08:32:23.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 shutdown_connections 2024-09-10T08:32:23.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd21406be30 0x7fd21406e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd234161c60 0x7fd2341f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2340d2690 0x7fd2341f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 --2- 172.21.15.52:0/1979067039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd23406dfd0 0x7fd2340c7d80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 >> 172.21.15.52:0/1979067039 conn(0x7fd2340d1630 msgr2=0x7fd2340cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:23.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 shutdown_connections 2024-09-10T08:32:23.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.136+0000 7fd23a000640 1 -- 172.21.15.52:0/1979067039 wait complete. 2024-09-10T08:32:23.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:32:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.327+0000 7f2408200640 1 Processor -- start 2024-09-10T08:32:23.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.327+0000 7f2408200640 1 -- start start 2024-09-10T08:32:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2408200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f240015c690 0x7f24000ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2408200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000b5a80 con 0x7f24000b7320 2024-09-10T08:32:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2408200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000b6ab0 con 0x7f240006c320 2024-09-10T08:32:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2408200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f24000b6620 con 0x7f240015c690 2024-09-10T08:32:23.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2404e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f24000b7320 0x7f240006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46740/0 (socket says 172.21.15.52:46740) 2024-09-10T08:32:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2404e00640 1 -- 172.21.15.52:0/3922216591 learned_addr learned my addr 172.21.15.52:0/3922216591 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:23.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.328+0000 7f2405800640 1 --2- 172.21.15.52:0/3922216591 >> v2:172.21.15.176:3300/0 conn(0x7f240015c690 0x7f24000ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.329+0000 7f23ffe00640 1 -- 172.21.15.52:0/3922216591 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789003132 0 0) 0x7f24000b5a80 con 0x7f24000b7320 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.329+0000 7f23ffe00640 1 -- 172.21.15.52:0/3922216591 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23e8003520 con 0x7f24000b7320 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.329+0000 7f2405800640 1 -- 172.21.15.52:0/3922216591 >> v1:172.21.15.176:6789/0 conn(0x7f240006c320 legacy=0x7f240015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.329+0000 7f2405800640 1 -- 172.21.15.52:0/3922216591 >> v1:172.21.15.52:6789/0 conn(0x7f24000b7320 legacy=0x7f240006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.329+0000 7f2405800640 1 -- 172.21.15.52:0/3922216591 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24000b5cf0 con 0x7f240015c690 2024-09-10T08:32:23.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.330+0000 7f2405800640 1 --2- 172.21.15.52:0/3922216591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240015c690 0x7f24000ceaa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2077790e057bcca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f23ffe00640 1 -- 172.21.15.52:0/3922216591 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4037070 con 0x7f240015c690 2024-09-10T08:32:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f23ffe00640 1 -- 172.21.15.52:0/3922216591 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f4032440 con 0x7f240015c690 2024-09-10T08:32:23.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f23ffe00640 1 -- 172.21.15.52:0/3922216591 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4032810 con 0x7f240015c690 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 -- 172.21.15.52:0/3922216591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240015c690 msgr2=0x7f24000ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 --2- 172.21.15.52:0/3922216591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240015c690 0x7f24000ceaa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402a230 comp rx=0 tx=0).stop 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 -- 172.21.15.52:0/3922216591 shutdown_connections 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 --2- 172.21.15.52:0/3922216591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f240015c690 0x7f24000ceaa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 -- 172.21.15.52:0/3922216591 >> 172.21.15.52:0/3922216591 conn(0x7f240006cd20 msgr2=0x7f240006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 -- 172.21.15.52:0/3922216591 shutdown_connections 2024-09-10T08:32:23.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.331+0000 7f2408200640 1 -- 172.21.15.52:0/3922216591 wait complete. 2024-09-10T08:32:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.333+0000 7f2408200640 1 Processor -- start 2024-09-10T08:32:23.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.333+0000 7f2408200640 1 -- start start 2024-09-10T08:32:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24000b7320 0x7f24001f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240015c690 0x7f2400152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24000cefe0 con 0x7f240006c320 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24000b62b0 con 0x7f24000b7320 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2408200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24000cf160 con 0x7f240015c690 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2405800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2405800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53274/0 (socket says 172.21.15.52:53274) 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2405800640 1 -- 172.21.15.52:0/4163624145 learned_addr learned my addr 172.21.15.52:0/4163624145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.334+0000 7f2404e00640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24000b7320 0x7f24001f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2406200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240015c690 0x7f2400152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 -- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240015c690 msgr2=0x7f2400152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240015c690 0x7f2400152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 -- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24000b7320 msgr2=0x7f24001f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24000b7320 0x7f24001f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 -- 172.21.15.52:0/4163624145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400072800 con 0x7f240006c320 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2405800640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f23f4035040 tx=0x7f23f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4037040 con 0x7f240006c320 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f4030500 con 0x7f240006c320 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4030910 con 0x7f240006c320 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.335+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2400072ae0 con 0x7f240006c320 2024-09-10T08:32:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.336+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24000730a0 con 0x7f240006c320 2024-09-10T08:32:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.336+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2400076320 con 0x7f240006c320 2024-09-10T08:32:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.338+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23f4044020 con 0x7f240006c320 2024-09-10T08:32:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.339+0000 7f23fd600640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 0x7f23e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.339+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5227+0+0 (secure 0 0 0) 0x7f23f40ab9e0 con 0x7f240006c320 2024-09-10T08:32:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.339+0000 7f2404e00640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 0x7f23e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.340+0000 7f2404e00640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 0x7f23e006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2400159500 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.342+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2400076320 con 0x7f240006c320 2024-09-10T08:32:23.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:23.527+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f24000ceaa0 con 0x7f240006c320 2024-09-10T08:32:24.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.137+0000 7f23fd600640 1 -- 172.21.15.52:0/4163624145 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) ==== 170+0+0 (secure 0 0 0) 0x7f23f407a5e0 con 0x7f240006c320 2024-09-10T08:32:24.138 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:32:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 msgr2=0x7f23e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 0x7f23e006e2f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2400159500 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2024-09-10T08:32:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 msgr2=0x7f2400152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f23f4035040 tx=0x7f23f40046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 shutdown_connections 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f23e006be30 0x7f23e006e2f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f240015c690 0x7f2400152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24000b7320 0x7f24001f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 --2- 172.21.15.52:0/4163624145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f240006c320 0x7f2400152130 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.141+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 >> 172.21.15.52:0/4163624145 conn(0x7f240006cd20 msgr2=0x7f24000c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.142+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 shutdown_connections 2024-09-10T08:32:24.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.142+0000 7f2408200640 1 -- 172.21.15.52:0/4163624145 wait complete. 2024-09-10T08:32:24.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:32:24.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.344+0000 7f6a31400640 1 Processor -- start 2024-09-10T08:32:24.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.344+0000 7f6a31400640 1 -- start start 2024-09-10T08:32:24.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a31400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a31400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a2c0cce30 0x7f6a2c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a31400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2c0714b0 con 0x7f6a2c071c70 2024-09-10T08:32:24.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a31400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6a2c073c00 con 0x7f6a2c0cce30 2024-09-10T08:32:24.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a31400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c0cd880 con 0x7f6a2c0732e0 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a2b200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6a2c071c70 0x7f6a2c15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49560/0 (socket says 172.21.15.52:49560) 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a2b200640 1 -- 172.21.15.52:0/3338883108 learned_addr learned my addr 172.21.15.52:0/3338883108 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a23e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6a2c0cce30 0x7f6a2c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a2a800640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a23e00640 1 -- 172.21.15.52:0/3338883108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 msgr2=0x7f6a2c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.346+0000 7f6a23e00640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.347+0000 7f6a23e00640 1 -- 172.21.15.52:0/3338883108 >> v1:172.21.15.52:6789/0 conn(0x7f6a2c071c70 legacy=0x7f6a2c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.347+0000 7f6a23e00640 1 -- 172.21.15.52:0/3338883108 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0cdb60 con 0x7f6a2c0cce30 2024-09-10T08:32:24.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.347+0000 7f6a29e00640 1 -- 172.21.15.52:0/3338883108 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557979728 0 0) 0x7f6a2c0714b0 con 0x7f6a2c071c70 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a23e00640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c0cd270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097a0 tx=0x7f6a1402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f116cbe75af230da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a29e00640 1 -- 172.21.15.52:0/3338883108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14037070 con 0x7f6a2c0cce30 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a29e00640 1 -- 172.21.15.52:0/3338883108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1402ae50 con 0x7f6a2c0cce30 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a29e00640 1 -- 172.21.15.52:0/3338883108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14032660 con 0x7f6a2c0cce30 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 -- 172.21.15.52:0/3338883108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 msgr2=0x7f6a2c0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c0cd270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097a0 tx=0x7f6a1402a100 comp rx=0 tx=0).stop 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 -- 172.21.15.52:0/3338883108 shutdown_connections 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c0cd270 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 --2- 172.21.15.52:0/3338883108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.348+0000 7f6a31400640 1 -- 172.21.15.52:0/3338883108 >> 172.21.15.52:0/3338883108 conn(0x7f6a2c06d0f0 msgr2=0x7f6a2c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:24.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.349+0000 7f6a31400640 1 -- 172.21.15.52:0/3338883108 shutdown_connections 2024-09-10T08:32:24.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.349+0000 7f6a31400640 1 -- 172.21.15.52:0/3338883108 wait complete. 2024-09-10T08:32:24.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.350+0000 7f6a31400640 1 Processor -- start 2024-09-10T08:32:24.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.350+0000 7f6a31400640 1 -- start start 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c071c70 0x7f6a2c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c06bf70 con 0x7f6a2c0cce30 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c06bdf0 con 0x7f6a2c071c70 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a31400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c072120 con 0x7f6a2c0732e0 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a2b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a2b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44528/0 (socket says 172.21.15.52:44528) 2024-09-10T08:32:24.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.351+0000 7f6a2b200640 1 -- 172.21.15.52:0/2224450974 learned_addr learned my addr 172.21.15.52:0/2224450974 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:24.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2a800640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c071c70 0x7f6a2c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a23e00640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 -- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 msgr2=0x7f6a2c155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 -- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c071c70 msgr2=0x7f6a2c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c071c70 0x7f6a2c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:24.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 -- 172.21.15.52:0/2224450974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0c7320 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a2b200640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c7a0 tx=0x7f6a2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.352+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24018070 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.353+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2400a640 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.353+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400aab0 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.353+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c0c7600 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.353+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c155030 con 0x7f6a2c0cce30 2024-09-10T08:32:24.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.354+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c0724b0 con 0x7f6a2c0cce30 2024-09-10T08:32:24.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.355+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a2400ac50 con 0x7f6a2c0cce30 2024-09-10T08:32:24.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.356+0000 7f6a22a00640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 0x7f6a0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:24.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.356+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5609+0+0 (secure 0 0 0) 0x7f6a2408a470 con 0x7f6a2c0cce30 2024-09-10T08:32:24.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.356+0000 7f6a2a800640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 0x7f6a0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:24.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.357+0000 7f6a2a800640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 0x7f6a0806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:24.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.361+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a24058790 con 0x7f6a2c0cce30 2024-09-10T08:32:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:24.579+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6a2c0b4f30 con 0x7f6a2c0cce30 2024-09-10T08:32:25.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.139+0000 7f6a22a00640 1 -- 172.21.15.52:0/2224450974 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) ==== 172+0+0 (secure 0 0 0) 0x7f6a2405ca90 con 0x7f6a2c0cce30 2024-09-10T08:32:25.140 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 8 and data pool 9 2024-09-10T08:32:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.146+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 msgr2=0x7f6a0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.146+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 0x7f6a0806e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006fd0 tx=0x7f6a1c008040 comp rx=0 tx=0).stop 2024-09-10T08:32:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.146+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 msgr2=0x7f6a2c151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.146+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c7a0 tx=0x7f6a2400cc60 comp rx=0 tx=0).stop 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 shutdown_connections 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a0806be30 0x7f6a0806e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c0cce30 0x7f6a2c151c90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6a2c0732e0 0x7f6a2c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 --2- 172.21.15.52:0/2224450974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a2c071c70 0x7f6a2c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.147+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 >> 172.21.15.52:0/2224450974 conn(0x7f6a2c06d0f0 msgr2=0x7f6a2c15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:25.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.148+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 shutdown_connections 2024-09-10T08:32:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.151+0000 7f6a31400640 1 -- 172.21.15.52:0/2224450974 wait complete. 2024-09-10T08:32:25.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.340+0000 7fdd4dc00640 1 Processor -- start 2024-09-10T08:32:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.340+0000 7fdd4dc00640 1 -- start start 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd4815e440 0x7fdd480d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd480cf450 0x7fdd480b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4dc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd480d3990 con 0x7fdd480b6540 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4dc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdd480b69b0 con 0x7fdd480cf450 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd480d3c70 con 0x7fdd4815e440 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd47400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdd480cf450 0x7fdd480b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4d200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdd480b6540 0x7fdd4806bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49568/0 (socket says 172.21.15.52:49568) 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.341+0000 7fdd4d200640 1 -- 172.21.15.52:0/1709061593 learned_addr learned my addr 172.21.15.52:0/1709061593 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.342+0000 7fdd47e00640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd4815e440 0x7fdd480d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.342+0000 7fdd47400640 1 -- 172.21.15.52:0/1709061593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd4815e440 msgr2=0x7fdd480d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:25.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.342+0000 7fdd47400640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd4815e440 0x7fdd480d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.342+0000 7fdd47400640 1 -- 172.21.15.52:0/1709061593 >> v1:172.21.15.52:6789/0 conn(0x7fdd480b6540 legacy=0x7fdd4806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.342+0000 7fdd47400640 1 -- 172.21.15.52:0/1709061593 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd480d3f50 con 0x7fdd480cf450 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.343+0000 7fdd47400640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd480cf450 0x7fdd480b6000 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097a0 tx=0x7fdd3402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2a2c960304121d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.343+0000 7fdd46a00640 1 -- 172.21.15.52:0/1709061593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34037070 con 0x7fdd480cf450 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.343+0000 7fdd46a00640 1 -- 172.21.15.52:0/1709061593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34032440 con 0x7fdd480cf450 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.343+0000 7fdd46a00640 1 -- 172.21.15.52:0/1709061593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34032810 con 0x7fdd480cf450 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 -- 172.21.15.52:0/1709061593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd480cf450 msgr2=0x7fdd480b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd480cf450 0x7fdd480b6000 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdd340097a0 tx=0x7fdd3402a230 comp rx=0 tx=0).stop 2024-09-10T08:32:25.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 -- 172.21.15.52:0/1709061593 shutdown_connections 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd480cf450 0x7fdd480b6000 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/1709061593 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd4815e440 0x7fdd480d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 -- 172.21.15.52:0/1709061593 >> 172.21.15.52:0/1709061593 conn(0x7fdd48067f80 msgr2=0x7fdd480d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 -- 172.21.15.52:0/1709061593 shutdown_connections 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.344+0000 7fdd4dc00640 1 -- 172.21.15.52:0/1709061593 wait complete. 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.345+0000 7fdd4dc00640 1 Processor -- start 2024-09-10T08:32:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 -- start start 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd480b6540 0x7fdd481f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd480cf450 0x7fdd48160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd480b7540 con 0x7fdd4815e440 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4815e820 con 0x7fdd480b6540 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.346+0000 7fdd4dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdd480b76c0 con 0x7fdd480cf450 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44550/0 (socket says 172.21.15.52:44550) 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 -- 172.21.15.52:0/779763726 learned_addr learned my addr 172.21.15.52:0/779763726 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:25.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd47e00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd480b6540 0x7fdd481f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd47400640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd480cf450 0x7fdd48160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 -- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd480cf450 msgr2=0x7fdd48160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd480cf450 0x7fdd48160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 -- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd480b6540 msgr2=0x7fdd481f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd480b6540 0x7fdd481f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 -- 172.21.15.52:0/779763726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4815f6b0 con 0x7fdd4815e440 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.347+0000 7fdd4d200640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000cbc0 tx=0x7fdd4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.348+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40017070 con 0x7fdd4815e440 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.348+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4000ad40 con 0x7fdd4815e440 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.348+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40012600 con 0x7fdd4815e440 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.348+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4815f990 con 0x7fdd4815e440 2024-09-10T08:32:25.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.348+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4815ff50 con 0x7fdd4815e440 2024-09-10T08:32:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.349+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd480b6000 con 0x7fdd4815e440 2024-09-10T08:32:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.350+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd4001a070 con 0x7fdd4815e440 2024-09-10T08:32:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.351+0000 7fdd3fe00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.351+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fdd4008ab60 con 0x7fdd4815e440 2024-09-10T08:32:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.351+0000 7fdd47e00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.352+0000 7fdd47e00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 0x7fdd2806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd380079a0 tx=0x7fdd38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.355+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd40058eb0 con 0x7fdd4815e440 2024-09-10T08:32:25.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.542+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd480b4320 con 0x7fdd4815e440 2024-09-10T08:32:25.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.543+0000 7fdd3fe00640 1 -- 172.21.15.52:0/779763726 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16750 (secure 0 0 0) 0x7fdd4005d1b0 con 0x7fdd4815e440 2024-09-10T08:32:25.543 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:25.543 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":60,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:24.581333+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:32:22.375699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T08:32:23.570054+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 msgr2=0x7fdd2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 0x7fdd2806e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd380079a0 tx=0x7fdd38008040 comp rx=0 tx=0).stop 2024-09-10T08:32:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 msgr2=0x7fdd48161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000cbc0 tx=0x7fdd4000a430 comp rx=0 tx=0).stop 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 shutdown_connections 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdd2806be30 0x7fdd2806e2f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd4815e440 0x7fdd48161210 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdd480cf450 0x7fdd48160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 --2- 172.21.15.52:0/779763726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd480b6540 0x7fdd481f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 >> 172.21.15.52:0/779763726 conn(0x7fdd48067f80 msgr2=0x7fdd4806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 shutdown_connections 2024-09-10T08:32:25.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.545+0000 7fdd4dc00640 1 -- 172.21.15.52:0/779763726 wait complete. 2024-09-10T08:32:25.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:25.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.717+0000 7f1fee000640 1 Processor -- start 2024-09-10T08:32:25.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.717+0000 7f1fee000640 1 -- start start 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.718+0000 7f1fee000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1fe8071680 0x7f1fe8169750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fee000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8071b30 con 0x7f1fe8148260 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fee000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe80b3510 con 0x7f1fe8147e80 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fee000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe8074200 con 0x7f1fe8071680 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fdfe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1fe8148260 0x7f1fe806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49574/0 (socket says 172.21.15.52:49574) 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fdfe00640 1 -- 172.21.15.52:0/709892882 learned_addr learned my addr 172.21.15.52:0/709892882 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fe7e00640 1 --2- 172.21.15.52:0/709892882 >> v2:172.21.15.176:3300/0 conn(0x7f1fe8071680 0x7f1fe8169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127071228 0 0) 0x7f1fe8071b30 con 0x7f1fe8148260 2024-09-10T08:32:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.719+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fcc003520 con 0x7f1fe8148260 2024-09-10T08:32:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.720+0000 7f1fe7e00640 1 -- 172.21.15.52:0/709892882 >> v1:172.21.15.176:6789/0 conn(0x7f1fe8147e80 legacy=0x7f1fe8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.720+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423608569 0 0) 0x7f1fe80b3510 con 0x7f1fe8147e80 2024-09-10T08:32:25.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.720+0000 7f1fe7e00640 1 -- 172.21.15.52:0/709892882 >> v1:172.21.15.52:6789/0 conn(0x7f1fe8148260 legacy=0x7f1fe806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.720+0000 7f1fe7e00640 1 -- 172.21.15.52:0/709892882 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe80b37f0 con 0x7f1fe8071680 2024-09-10T08:32:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fe7e00640 1 --2- 172.21.15.52:0/709892882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8071680 0x7f1fe8169750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c748983a40e50bab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0007740 con 0x7f1fe8071680 2024-09-10T08:32:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe00078e0 con 0x7f1fe8071680 2024-09-10T08:32:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fe6a00640 1 -- 172.21.15.52:0/709892882 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0007cb0 con 0x7f1fe8071680 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fee000640 1 -- 172.21.15.52:0/709892882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8071680 msgr2=0x7f1fe8169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fee000640 1 --2- 172.21.15.52:0/709892882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8071680 0x7f1fe8169750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009d90 tx=0x7f1fe002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fee000640 1 -- 172.21.15.52:0/709892882 shutdown_connections 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.721+0000 7f1fee000640 1 --2- 172.21.15.52:0/709892882 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8071680 0x7f1fe8169750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.722+0000 7f1fee000640 1 -- 172.21.15.52:0/709892882 >> 172.21.15.52:0/709892882 conn(0x7f1fe80ccec0 msgr2=0x7f1fe80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.722+0000 7f1fee000640 1 -- 172.21.15.52:0/709892882 shutdown_connections 2024-09-10T08:32:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.722+0000 7f1fee000640 1 -- 172.21.15.52:0/709892882 wait complete. 2024-09-10T08:32:25.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.723+0000 7f1fee000640 1 Processor -- start 2024-09-10T08:32:25.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.723+0000 7f1fee000640 1 -- start start 2024-09-10T08:32:25.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.725 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f20f0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:32:25.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 0x7f1fe8139150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8148260 0x7f1fe815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe806c320 con 0x7f1fe8071680 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80b3e40 con 0x7f1fe8148260 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.724+0000 7f1fee000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe806c4a0 con 0x7f1fe8147e80 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44558/0 (socket says 172.21.15.52:44558) 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 -- 172.21.15.52:0/679378061 learned_addr learned my addr 172.21.15.52:0/679378061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fdfe00640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 0x7f1fe8139150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7e00640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8148260 0x7f1fe815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 -- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 msgr2=0x7f1fe8139150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 0x7f1fe8139150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 -- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8148260 msgr2=0x7f1fe815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8148260 0x7f1fe815e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 -- 172.21.15.52:0/679378061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe8139690 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fdfe00640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 0x7f1fe8139150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.725+0000 7f1fe7400640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c4e0 tx=0x7f1fd800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.726+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017070 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.726+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd80035f0 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.726+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe80b0680 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.726+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80039e0 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.726+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe80b0f20 con 0x7f1fe8071680 2024-09-10T08:32:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.727+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe80b0a70 con 0x7f1fe8071680 2024-09-10T08:32:25.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.728+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fd801a070 con 0x7f1fe8071680 2024-09-10T08:32:25.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.729+0000 7f1fdf400640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 0x7f1fc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:25.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.729+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1fd808a100 con 0x7f1fe8071680 2024-09-10T08:32:25.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.729+0000 7f1fdfe00640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 0x7f1fc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:25.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.730+0000 7f1fdfe00640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 0x7f1fc406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80adf80 tx=0x7f1fd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:25.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.734+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fe8139690 con 0x7f1fe8071680 2024-09-10T08:32:25.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.918+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fe8070f70 con 0x7f1fe8071680 2024-09-10T08:32:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.919+0000 7f1fdf400640 1 -- 172.21.15.52:0/679378061 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16750 (secure 0 0 0) 0x7f1fd8058450 con 0x7f1fe8071680 2024-09-10T08:32:25.920 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:25.920 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":60,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:24.581333+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:32:22.375699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T08:32:23.570054+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:25.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 msgr2=0x7f1fc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 0x7f1fc406e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80adf80 tx=0x7f1fd0009040 comp rx=0 tx=0).stop 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 msgr2=0x7f1fe80affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c4e0 tx=0x7f1fd800c9a0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 shutdown_connections 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc406be30 0x7f1fc406e2f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe8148260 0x7f1fe815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe8147e80 0x7f1fe8139150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 --2- 172.21.15.52:0/679378061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8071680 0x7f1fe80affa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 >> 172.21.15.52:0/679378061 conn(0x7f1fe80ccec0 msgr2=0x7f1fe806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 shutdown_connections 2024-09-10T08:32:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:25.922+0000 7f1fee000640 1 -- 172.21.15.52:0/679378061 wait complete. 2024-09-10T08:32:25.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:32:26.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.096+0000 7fc348e00640 1 Processor -- start 2024-09-10T08:32:26.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.097+0000 7fc348e00640 1 -- start start 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc348e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc34415c570 0x7fc3440cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc348e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc34415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc348e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440cef10 con 0x7fc3440d1a80 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc348e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440d01d0 con 0x7fc34415c570 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc348e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc34415fc10 con 0x7fc3440d1e60 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc341e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc3440d1a80 0x7fc34415be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49586/0 (socket says 172.21.15.52:49586) 2024-09-10T08:32:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc341e00640 1 -- 172.21.15.52:0/1734589646 learned_addr learned my addr 172.21.15.52:0/1734589646 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc33be00640 1 --2- 172.21.15.52:0/1734589646 >> v2:172.21.15.176:3300/0 conn(0x7fc34415c570 0x7fc3440cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.098+0000 7fc342800640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc34415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc341400640 1 -- 172.21.15.52:0/1734589646 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287711780 0 0) 0x7fc3440cef10 con 0x7fc3440d1a80 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc341400640 1 -- 172.21.15.52:0/1734589646 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc328003520 con 0x7fc3440d1a80 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc33be00640 1 -- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 msgr2=0x7fc34415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc33be00640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc34415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc33be00640 1 -- 172.21.15.52:0/1734589646 >> v1:172.21.15.52:6789/0 conn(0x7fc3440d1a80 legacy=0x7fc34415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc33be00640 1 -- 172.21.15.52:0/1734589646 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440cf1d0 con 0x7fc34415c570 2024-09-10T08:32:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.099+0000 7fc342800640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc34415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.100+0000 7fc33be00640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34415c570 0x7fc3440cfc90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097d0 tx=0x7fc32c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd1b47cd9fc8e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.100+0000 7fc341400640 1 -- 172.21.15.52:0/1734589646 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c037070 con 0x7fc34415c570 2024-09-10T08:32:26.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.100+0000 7fc341400640 1 -- 172.21.15.52:0/1734589646 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c032440 con 0x7fc34415c570 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.100+0000 7fc341400640 1 -- 172.21.15.52:0/1734589646 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c032810 con 0x7fc34415c570 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 -- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34415c570 msgr2=0x7fc3440cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34415c570 0x7fc3440cfc90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097d0 tx=0x7fc32c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 -- 172.21.15.52:0/1734589646 shutdown_connections 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc34415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 --2- 172.21.15.52:0/1734589646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc34415c570 0x7fc3440cfc90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 -- 172.21.15.52:0/1734589646 >> 172.21.15.52:0/1734589646 conn(0x7fc344067d70 msgr2=0x7fc344068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 -- 172.21.15.52:0/1734589646 shutdown_connections 2024-09-10T08:32:26.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.101+0000 7fc348e00640 1 -- 172.21.15.52:0/1734589646 wait complete. 2024-09-10T08:32:26.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.103+0000 7fc348e00640 1 Processor -- start 2024-09-10T08:32:26.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.103+0000 7fc348e00640 1 -- start start 2024-09-10T08:32:26.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3440d1a80 0x7fc3440ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc3440c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc34415f420 con 0x7fc34415c570 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440cf790 con 0x7fc3440d1a80 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc348e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc34415f5a0 con 0x7fc3440d1e60 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44570/0 (socket says 172.21.15.52:44570) 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 -- 172.21.15.52:0/3310454991 learned_addr learned my addr 172.21.15.52:0/3310454991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc341e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3440d1a80 0x7fc3440ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc33be00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc3440c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 -- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 msgr2=0x7fc3440c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc3440c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 -- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3440d1a80 msgr2=0x7fc3440ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.104+0000 7fc342800640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3440d1a80 0x7fc3440ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc342800640 1 -- 172.21.15.52:0/3310454991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440cd390 con 0x7fc34415c570 2024-09-10T08:32:26.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc342800640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ef90 tx=0x7fc33c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c018020 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c014480 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c014870 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3440cd670 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.105+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3440cdc30 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.106+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34415eee0 con 0x7fc34415c570 2024-09-10T08:32:26.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.107+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc33c005d10 con 0x7fc34415c570 2024-09-10T08:32:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.108+0000 7fc33a000640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 0x7fc32006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.108+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fc33c08bc50 con 0x7fc34415c570 2024-09-10T08:32:26.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.108+0000 7fc341e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 0x7fc32006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:26.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.109+0000 7fc341e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 0x7fc32006e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc334005880 tx=0x7fc334009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:26.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.112+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc33c022030 con 0x7fc34415c570 2024-09-10T08:32:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:26.336+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc3440cecd0 con 0x7fc34415c570 2024-09-10T08:32:27.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.159+0000 7fc33a000640 1 -- 172.21.15.52:0/3310454991 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7fc33c010040 con 0x7fc34415c570 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 msgr2=0x7fc32006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 0x7fc32006e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc334005880 tx=0x7fc334009040 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 msgr2=0x7fc34414ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00ef90 tx=0x7fc33c009f90 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 shutdown_connections 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc32006be30 0x7fc32006e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34415c570 0x7fc34414ec00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc3440d1e60 0x7fc3440c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 --2- 172.21.15.52:0/3310454991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3440d1a80 0x7fc3440ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.162+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 >> 172.21.15.52:0/3310454991 conn(0x7fc344067d70 msgr2=0x7fc34415ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.163+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 shutdown_connections 2024-09-10T08:32:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.163+0000 7fc348e00640 1 -- 172.21.15.52:0/3310454991 wait complete. 2024-09-10T08:32:27.182 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:32:27.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:32:27.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.345+0000 7f1da7000640 1 Processor -- start 2024-09-10T08:32:27.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.346+0000 7f1da7000640 1 -- start start 2024-09-10T08:32:27.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da7000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1da015b7c0 0x7f1da00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da7000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1da00cead0 0x7f1da0071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da7000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da00cf2e0 con 0x7f1da00ccf30 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da7000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1da0070fe0 con 0x7f1da015b7c0 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da7000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1da00712c0 con 0x7f1da00cead0 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1d9fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1da00ccf30 0x7f1da00cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49592/0 (socket says 172.21.15.52:49592) 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1d9fe00640 1 -- 172.21.15.52:0/2143915973 learned_addr learned my addr 172.21.15.52:0/2143915973 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1d97e00640 1 --2- 172.21.15.52:0/2143915973 >> v2:172.21.15.52:3300/0 conn(0x7f1da015b7c0 0x7f1da00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.347+0000 7f1da5000640 1 --2- 172.21.15.52:0/2143915973 >> v2:172.21.15.176:3300/0 conn(0x7f1da00cead0 0x7f1da0071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d9f400640 1 -- 172.21.15.52:0/2143915973 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137227335 0 0) 0x7f1da00cf2e0 con 0x7f1da00ccf30 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d9f400640 1 -- 172.21.15.52:0/2143915973 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d84003520 con 0x7f1da00ccf30 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d97e00640 1 -- 172.21.15.52:0/2143915973 >> v2:172.21.15.176:3300/0 conn(0x7f1da00cead0 msgr2=0x7f1da0071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d97e00640 1 --2- 172.21.15.52:0/2143915973 >> v2:172.21.15.176:3300/0 conn(0x7f1da00cead0 0x7f1da0071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d97e00640 1 -- 172.21.15.52:0/2143915973 >> v1:172.21.15.52:6789/0 conn(0x7f1da00ccf30 legacy=0x7f1da00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.348+0000 7f1d97e00640 1 -- 172.21.15.52:0/2143915973 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da00715a0 con 0x7f1da015b7c0 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.349+0000 7f1d97e00640 1 --2- 172.21.15.52:0/2143915973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da015b7c0 0x7f1da00b2c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1da006f170 tx=0x7f1d8802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09529679f5154dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.349+0000 7f1d9f400640 1 -- 172.21.15.52:0/2143915973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88037070 con 0x7f1da015b7c0 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.349+0000 7f1d9f400640 1 -- 172.21.15.52:0/2143915973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d88032440 con 0x7f1da015b7c0 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.349+0000 7f1d9f400640 1 -- 172.21.15.52:0/2143915973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8802ae60 con 0x7f1da015b7c0 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.349+0000 7f1da7000640 1 -- 172.21.15.52:0/2143915973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da015b7c0 msgr2=0x7f1da00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 --2- 172.21.15.52:0/2143915973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da015b7c0 0x7f1da00b2c50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1da006f170 tx=0x7f1d8802a110 comp rx=0 tx=0).stop 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 -- 172.21.15.52:0/2143915973 shutdown_connections 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 --2- 172.21.15.52:0/2143915973 >> v2:172.21.15.176:3300/0 conn(0x7f1da00cead0 0x7f1da0071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 --2- 172.21.15.52:0/2143915973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da015b7c0 0x7f1da00b2c50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 -- 172.21.15.52:0/2143915973 >> 172.21.15.52:0/2143915973 conn(0x7f1da006d0f0 msgr2=0x7f1da006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 -- 172.21.15.52:0/2143915973 shutdown_connections 2024-09-10T08:32:27.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.350+0000 7f1da7000640 1 -- 172.21.15.52:0/2143915973 wait complete. 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.351+0000 7f1da7000640 1 Processor -- start 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 -- start start 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 0x7f1da0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 0x7f1da0154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1da00cf080 con 0x7f1da00cead0 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1da00cef00 con 0x7f1da015b7c0 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.352+0000 7f1da7000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1da0072000 con 0x7f1da00ccf30 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44578/0 (socket says 172.21.15.52:44578) 2024-09-10T08:32:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 -- 172.21.15.52:0/581811726 learned_addr learned my addr 172.21.15.52:0/581811726 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d9fe00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 0x7f1da0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1da5000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 0x7f1da0154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 -- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 msgr2=0x7f1da0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 0x7f1da0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 -- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 msgr2=0x7f1da0154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 0x7f1da0154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 -- 172.21.15.52:0/581811726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da015e5f0 con 0x7f1da00cead0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d9fe00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 0x7f1da0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1da5000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 0x7f1da0154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.353+0000 7f1d97e00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1d88000c00 tx=0x7f1d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.354+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88041020 con 0x7f1da00cead0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.354+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8803d700 con 0x7f1da00cead0 2024-09-10T08:32:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.354+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88037040 con 0x7f1da00cead0 2024-09-10T08:32:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.354+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da015e8d0 con 0x7f1da00cead0 2024-09-10T08:32:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.354+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da0154240 con 0x7f1da00cead0 2024-09-10T08:32:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.355+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da0071ac0 con 0x7f1da00cead0 2024-09-10T08:32:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.356+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d88044020 con 0x7f1da00cead0 2024-09-10T08:32:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.357+0000 7f1d9cc00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 0x7f1d7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.357+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f1d880ab690 con 0x7f1da00cead0 2024-09-10T08:32:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.357+0000 7f1d9fe00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 0x7f1d7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.358+0000 7f1d9fe00640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 0x7f1d7c06e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d90007fd0 tx=0x7f1d90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.361+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d8804b030 con 0x7f1da00cead0 2024-09-10T08:32:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:27.579+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1da00cc960 con 0x7f1da00cead0 2024-09-10T08:32:28.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.169+0000 7f1d9cc00640 1 -- 172.21.15.52:0/581811726 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f1d88079fb0 con 0x7f1da00cead0 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 msgr2=0x7f1d7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 0x7f1d7c06e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d90007fd0 tx=0x7f1d90009040 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 msgr2=0x7f1da01482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1d88000c00 tx=0x7f1d880046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 shutdown_connections 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d7c06be30 0x7f1d7c06e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1da015b7c0 0x7f1da0154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1da00cead0 0x7f1da01482d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 --2- 172.21.15.52:0/581811726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1da00ccf30 0x7f1da0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 >> 172.21.15.52:0/581811726 conn(0x7f1da006d0f0 msgr2=0x7f1da006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:28.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.172+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 shutdown_connections 2024-09-10T08:32:28.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.173+0000 7f1da7000640 1 -- 172.21.15.52:0/581811726 wait complete. 2024-09-10T08:32:28.192 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:32:28.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:28.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.352+0000 7efca9e00640 1 Processor -- start 2024-09-10T08:32:28.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.352+0000 7efca9e00640 1 -- start start 2024-09-10T08:32:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.353+0000 7efca9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efca415e6d0 0x7efca4071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.353+0000 7efca9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca4070b80 0x7efca41622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.353+0000 7efca9e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca415eab0 con 0x7efca406cd20 2024-09-10T08:32:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.353+0000 7efca9e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efca415ed70 con 0x7efca415e6d0 2024-09-10T08:32:28.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.353+0000 7efca9e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efca415f050 con 0x7efca4070b80 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efca415e6d0 0x7efca4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efca406cd20 0x7efca40b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49602/0 (socket says 172.21.15.52:49602) 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2000640 1 -- 172.21.15.52:0/2765096414 learned_addr learned my addr 172.21.15.52:0/2765096414 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca3400640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca4070b80 0x7efca41622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2a00640 1 -- 172.21.15.52:0/2765096414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca4070b80 msgr2=0x7efca41622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2a00640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca4070b80 0x7efca41622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2a00640 1 -- 172.21.15.52:0/2765096414 >> v1:172.21.15.52:6789/0 conn(0x7efca406cd20 legacy=0x7efca40b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca1600640 1 -- 172.21.15.52:0/2765096414 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178572896 0 0) 0x7efca415eab0 con 0x7efca406cd20 2024-09-10T08:32:28.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.354+0000 7efca2a00640 1 -- 172.21.15.52:0/2765096414 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca415f330 con 0x7efca415e6d0 2024-09-10T08:32:28.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.355+0000 7efca2a00640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca415e6d0 0x7efca4071390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efc940097a0 tx=0x7efc9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924e1950418bf1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.355+0000 7efca1600640 1 -- 172.21.15.52:0/2765096414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94037070 con 0x7efca415e6d0 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.355+0000 7efca1600640 1 -- 172.21.15.52:0/2765096414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94032440 con 0x7efca415e6d0 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.355+0000 7efca1600640 1 -- 172.21.15.52:0/2765096414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94032810 con 0x7efca415e6d0 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 -- 172.21.15.52:0/2765096414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca415e6d0 msgr2=0x7efca4071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca415e6d0 0x7efca4071390 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7efc940097a0 tx=0x7efc9402a180 comp rx=0 tx=0).stop 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 -- 172.21.15.52:0/2765096414 shutdown_connections 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca4070b80 0x7efca41622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 --2- 172.21.15.52:0/2765096414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca415e6d0 0x7efca4071390 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 -- 172.21.15.52:0/2765096414 >> 172.21.15.52:0/2765096414 conn(0x7efca4067fb0 msgr2=0x7efca406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:28.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 -- 172.21.15.52:0/2765096414 shutdown_connections 2024-09-10T08:32:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.356+0000 7efca9e00640 1 -- 172.21.15.52:0/2765096414 wait complete. 2024-09-10T08:32:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.358+0000 7efca9e00640 1 Processor -- start 2024-09-10T08:32:28.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.358+0000 7efca9e00640 1 -- start start 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca4070b80 0x7efca4149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca415e6d0 0x7efca40b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efca40718d0 con 0x7efca406cd20 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efca415f8f0 con 0x7efca4070b80 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca9e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efca4071a50 con 0x7efca415e6d0 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44592/0 (socket says 172.21.15.52:44592) 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 -- 172.21.15.52:0/3246058402 learned_addr learned my addr 172.21.15.52:0/3246058402 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:28.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 -- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca415e6d0 msgr2=0x7efca40b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca415e6d0 0x7efca40b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 -- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca4070b80 msgr2=0x7efca4149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca4070b80 0x7efca4149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.359+0000 7efca2a00640 1 -- 172.21.15.52:0/3246058402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40b4d50 con 0x7efca406cd20 2024-09-10T08:32:28.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efca2a00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94037040 con 0x7efca406cd20 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc94042070 con 0x7efca406cd20 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc94030bb0 con 0x7efca406cd20 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40b37b0 con 0x7efca406cd20 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.360+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca40b3cb0 con 0x7efca406cd20 2024-09-10T08:32:28.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.361+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca4071390 con 0x7efca406cd20 2024-09-10T08:32:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.362+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc94047460 con 0x7efca406cd20 2024-09-10T08:32:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.363+0000 7efc9b400640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 0x7efc8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.363+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7efc940abb30 con 0x7efca406cd20 2024-09-10T08:32:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.364+0000 7efca2000640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 0x7efc8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.364+0000 7efca2000640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 0x7efc8406e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efc900011e0 tx=0x7efc90007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.367+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc94032e20 con 0x7efca406cd20 2024-09-10T08:32:28.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.586+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efca40b5190 con 0x7efca406cd20 2024-09-10T08:32:28.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.586+0000 7efc9b400640 1 -- 172.21.15.52:0/3246058402 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5226 (secure 0 0 0) 0x7efc9407a3b0 con 0x7efca406cd20 2024-09-10T08:32:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:28.587 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"btime":"2024-09-10T08:32:28:165289+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/346517988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":346517988},{"type":"v1","addr":"172.21.15.52:6834","nonce":346517988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5845,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3539522339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3539522339},{"type":"v1","addr":"172.21.15.176:6836","nonce":3539522339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1157302538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1157302538},{"type":"v1","addr":"172.21.15.176:6837","nonce":1157302538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:27.581371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2886852302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2886852302},{"type":"v1","addr":"172.21.15.52:6835","nonce":2886852302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6135,"qdb_cluster":[6135]},"id":4}]} 2024-09-10T08:32:28.587 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 34 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 msgr2=0x7efc8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 0x7efc8406e320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efc900011e0 tx=0x7efc90007920 comp rx=0 tx=0).stop 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 msgr2=0x7efca414d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7efc94000c00 tx=0x7efc940046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 shutdown_connections 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc8406be60 0x7efc8406e320 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efca415e6d0 0x7efca40b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efca4070b80 0x7efca4149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 --2- 172.21.15.52:0/3246058402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efca406cd20 0x7efca414d970 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.588+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 >> 172.21.15.52:0/3246058402 conn(0x7efca4067fb0 msgr2=0x7efca415fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:28.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.589+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 shutdown_connections 2024-09-10T08:32:28.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.589+0000 7efca9e00640 1 -- 172.21.15.52:0/3246058402 wait complete. 2024-09-10T08:32:28.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.760+0000 7ff22b600640 1 Processor -- start 2024-09-10T08:32:28.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.760+0000 7ff22b600640 1 -- start start 2024-09-10T08:32:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.761+0000 7ff22b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2240b2d40 0x7ff22406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.761+0000 7ff22b600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff22413eb20 0x7ff22406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.761+0000 7ff22b600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff224071180 con 0x7ff22415bcf0 2024-09-10T08:32:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.761+0000 7ff22b600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff224071ab0 con 0x7ff22413eb20 2024-09-10T08:32:28.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.761+0000 7ff22b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff224071460 con 0x7ff2240b2d40 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff22413eb20 0x7ff22406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff22413eb20 0x7ff22406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44600/0 (socket says 172.21.15.52:44600) 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 -- 172.21.15.52:0/1723906094 learned_addr learned my addr 172.21.15.52:0/1723906094 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff228c00640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2240b2d40 0x7ff22406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 -- 172.21.15.52:0/1723906094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2240b2d40 msgr2=0x7ff22406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2240b2d40 0x7ff22406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 -- 172.21.15.52:0/1723906094 >> v1:172.21.15.176:6789/0 conn(0x7ff22415bcf0 legacy=0x7ff22415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:28.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.762+0000 7ff223e00640 1 -- 172.21.15.52:0/1723906094 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff224071740 con 0x7ff22413eb20 2024-09-10T08:32:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.763+0000 7ff223e00640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22413eb20 0x7ff22406c150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff224071c30 tx=0x7ff21002c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503952c905f021fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.763+0000 7ff223400640 1 -- 172.21.15.52:0/1723906094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210038070 con 0x7ff22413eb20 2024-09-10T08:32:28.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff223400640 1 -- 172.21.15.52:0/1723906094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff210031710 con 0x7ff22413eb20 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff223400640 1 -- 172.21.15.52:0/1723906094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210031ae0 con 0x7ff22413eb20 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 -- 172.21.15.52:0/1723906094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22413eb20 msgr2=0x7ff22406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22413eb20 0x7ff22406c150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff224071c30 tx=0x7ff21002c410 comp rx=0 tx=0).stop 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 -- 172.21.15.52:0/1723906094 shutdown_connections 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22413eb20 0x7ff22406c150 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 --2- 172.21.15.52:0/1723906094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2240b2d40 0x7ff22406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 -- 172.21.15.52:0/1723906094 >> 172.21.15.52:0/1723906094 conn(0x7ff2240ccec0 msgr2=0x7ff2240cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 -- 172.21.15.52:0/1723906094 shutdown_connections 2024-09-10T08:32:28.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.764+0000 7ff22b600640 1 -- 172.21.15.52:0/1723906094 wait complete. 2024-09-10T08:32:28.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.766+0000 7ff22b600640 1 Processor -- start 2024-09-10T08:32:28.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.766+0000 7ff22b600640 1 -- start start 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff22413eb20 0x7ff22413e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 0x7ff2240b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2240722d0 con 0x7ff22415bcf0 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff224072150 con 0x7ff2240b2d40 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff22b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff224072450 con 0x7ff22413eb20 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff228c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff229600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 0x7ff2240b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff228c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:39714/0 (socket says 172.21.15.52:39714) 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff228c00640 1 -- 172.21.15.52:0/2222211822 learned_addr learned my addr 172.21.15.52:0/2222211822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:28.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.767+0000 7ff223e00640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff22413eb20 0x7ff22413e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 -- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff22413eb20 msgr2=0x7ff22413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff22413eb20 0x7ff22413e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 -- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 msgr2=0x7ff224155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 -- 172.21.15.52:0/2222211822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2240ca750 con 0x7ff22415bcf0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff228c00640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff229600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 0x7ff2240b5cf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00be30 tx=0x7ff21c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c019070 con 0x7ff22415bcf0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.768+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c014440 con 0x7ff22415bcf0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.769+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2240caa30 con 0x7ff22415bcf0 2024-09-10T08:32:28.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.769+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c014830 con 0x7ff22415bcf0 2024-09-10T08:32:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.769+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2240caff0 con 0x7ff22415bcf0 2024-09-10T08:32:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.770+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2240728e0 con 0x7ff22415bcf0 2024-09-10T08:32:28.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.770+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff21c01c070 con 0x7ff22415bcf0 2024-09-10T08:32:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.771+0000 7ff220c00640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 0x7ff20406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.771+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff21c08ac90 con 0x7ff22415bcf0 2024-09-10T08:32:28.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.772+0000 7ff228c00640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 0x7ff20406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:28.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.773+0000 7ff228c00640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 0x7ff20406e320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff218006fd0 tx=0x7ff218008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:28.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.776+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff21c058f50 con 0x7ff22415bcf0 2024-09-10T08:32:28.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.958+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff224140800 con 0x7ff22415bcf0 2024-09-10T08:32:28.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.960+0000 7ff220c00640 1 -- 172.21.15.52:0/2222211822 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16737 (secure 0 0 0) 0x7ff21c05d250 con 0x7ff22415bcf0 2024-09-10T08:32:28.960 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:28.961 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":61,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:26.150583+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:32:22.375699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T08:32:23.570054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 msgr2=0x7ff20406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 0x7ff20406e320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff218006fd0 tx=0x7ff218008040 comp rx=0 tx=0).stop 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 msgr2=0x7ff2240b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 0x7ff2240b5cf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00be30 tx=0x7ff21c00bf20 comp rx=0 tx=0).stop 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 shutdown_connections 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff20406be60 0x7ff20406e320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff22415bcf0 0x7ff2240b5cf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff22413eb20 0x7ff22413e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 --2- 172.21.15.52:0/2222211822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2240b2d40 0x7ff224155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 >> 172.21.15.52:0/2222211822 conn(0x7ff2240ccec0 msgr2=0x7ff2240cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 shutdown_connections 2024-09-10T08:32:28.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:28.962+0000 7ff22b600640 1 -- 172.21.15.52:0/2222211822 wait complete. 2024-09-10T08:32:28.978 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:32:28.979 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:32:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.135+0000 7f3b6f400640 1 Processor -- start 2024-09-10T08:32:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.136+0000 7f3b6f400640 1 -- start start 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b6815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6f400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6815f590 con 0x7f3b680b66a0 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6f400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6815f870 con 0x7f3b681624b0 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6f400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6815fb50 con 0x7f3b6815eb60 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b680b66a0 0x7f3b680d3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49618/0 (socket says 172.21.15.52:49618) 2024-09-10T08:32:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6d400640 1 -- 172.21.15.52:0/4188871529 learned_addr learned my addr 172.21.15.52:0/4188871529 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b6815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425835158 0 0) 0x7f3b6815f590 con 0x7f3b680b66a0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.137+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b4c003520 con 0x7f3b680b66a0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820228516 0 0) 0x7f3b6815f870 con 0x7f3b681624b0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b6815f590 con 0x7f3b681624b0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2650179575 0 0) 0x7f3b4c003520 con 0x7f3b680b66a0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 msgr2=0x7f3b6815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b6815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 >> v1:172.21.15.176:6789/0 conn(0x7f3b681624b0 legacy=0x7f3b680d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6815fe30 con 0x7f3b680b66a0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3b600019f0 con 0x7f3b680b66a0 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 >> v1:172.21.15.52:6789/0 conn(0x7f3b680b66a0 legacy=0x7f3b680d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b4c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4c004120 0x7f3b4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b4c004d40 0x7f3b4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6815fb50 con 0x7f3b4c004120 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c00bc20 con 0x7f3b4c004d40 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c00be20 con 0x7f3b6815eb60 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b5fe00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4c004120 0x7f3b4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b4c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.138+0000 7f3b6d400640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b4c004d40 0x7f3b4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b5fe00640 1 -- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 msgr2=0x7f3b4c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b5fe00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b4c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b5fe00640 1 -- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b4c004d40 msgr2=0x7f3b4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b5fe00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b4c004d40 0x7f3b4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b5fe00640 1 -- 172.21.15.52:0/4188871529 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c003520 con 0x7f3b4c004120 2024-09-10T08:32:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.139+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b6815eb60 0x7f3b4c003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.140+0000 7f3b5fe00640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4c004120 0x7f3b4c004800 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3b500018a0 tx=0x7f3b4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09eff2e4a8cff3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.140+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b500014f0 con 0x7f3b4c004120 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.140+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b500052d0 con 0x7f3b4c004120 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.140+0000 7f3b67e00640 1 -- 172.21.15.52:0/4188871529 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5002ac60 con 0x7f3b4c004120 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 -- 172.21.15.52:0/4188871529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4c004120 msgr2=0x7f3b4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4188871529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b4c004120 0x7f3b4c004800 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3b500018a0 tx=0x7f3b4c005830 comp rx=0 tx=0).stop 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6d400640 1 -- 172.21.15.52:0/4188871529 reap_dead start 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 -- 172.21.15.52:0/4188871529 shutdown_connections 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 -- 172.21.15.52:0/4188871529 >> 172.21.15.52:0/4188871529 conn(0x7f3b680d16f0 msgr2=0x7f3b680d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:29.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 -- 172.21.15.52:0/4188871529 shutdown_connections 2024-09-10T08:32:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.141+0000 7f3b6f400640 1 -- 172.21.15.52:0/4188871529 wait complete. 2024-09-10T08:32:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.143+0000 7f3b6f400640 1 Processor -- start 2024-09-10T08:32:29.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.143+0000 7f3b6f400640 1 -- start start 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b4c004120 0x7f3b680cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b680cc300 0x7f3b680ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b680d4600 con 0x7f3b68151c30 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b680d4480 con 0x7f3b680cc300 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6f400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b680d3d10 con 0x7f3b4c004120 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44620/0 (socket says 172.21.15.52:44620) 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 -- 172.21.15.52:0/4277761508 learned_addr learned my addr 172.21.15.52:0/4277761508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:29.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b4c004120 0x7f3b680cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b5fe00640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b680cc300 0x7f3b680ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 -- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b4c004120 msgr2=0x7f3b680cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b4c004120 0x7f3b680cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 -- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b680cc300 msgr2=0x7f3b680ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b680cc300 0x7f3b680ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.144+0000 7f3b6d400640 1 -- 172.21.15.52:0/4277761508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b680cea50 con 0x7f3b68151c30 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b6d400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3b60002230 tx=0x7f3b60007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58009690 con 0x7f3b68151c30 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b60018070 con 0x7f3b68151c30 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b680cc780 con 0x7f3b68151c30 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000abd0 con 0x7f3b68151c30 2024-09-10T08:32:29.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.145+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b680cd750 con 0x7f3b68151c30 2024-09-10T08:32:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.146+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6815f870 con 0x7f3b68151c30 2024-09-10T08:32:29.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.147+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b6001d460 con 0x7f3b68151c30 2024-09-10T08:32:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.148+0000 7f3b65600640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 0x7f3b4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.149+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f3b6008b140 con 0x7f3b68151c30 2024-09-10T08:32:29.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.149+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 0x7f3b4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.150+0000 7f3b6ca00640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 0x7f3b4406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009c80 tx=0x7f3b58009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.153+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b60059a50 con 0x7f3b68151c30 2024-09-10T08:32:29.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.335+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b680d2520 con 0x7f3b4406be30 2024-09-10T08:32:29.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.342+0000 7f3b65600640 1 -- 172.21.15.52:0/4277761508 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245555 (secure 0 0 0) 0x7f3b680d2520 con 0x7f3b4406be30 2024-09-10T08:32:29.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:32:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.345+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 msgr2=0x7f3b4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.345+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 0x7f3b4406e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009c80 tx=0x7f3b58009190 comp rx=0 tx=0).stop 2024-09-10T08:32:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 msgr2=0x7f3b680b8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3b60002230 tx=0x7f3b60007b10 comp rx=0 tx=0).stop 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 shutdown_connections 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4406be30 0x7f3b4406e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b68151c30 0x7f3b680b8bd0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b680cc300 0x7f3b680ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 --2- 172.21.15.52:0/4277761508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b4c004120 0x7f3b680cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 >> 172.21.15.52:0/4277761508 conn(0x7f3b680d16f0 msgr2=0x7f3b680b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 shutdown_connections 2024-09-10T08:32:29.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.346+0000 7f3b6f400640 1 -- 172.21.15.52:0/4277761508 wait complete. 2024-09-10T08:32:29.361 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-10T08:32:27.508029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310232,"kb_used_data":6620,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754664488,"statfs":{"total":773094113280,"available":772776435712,"internally_reserved":0,"allocated":6778880,"data_stored":3483141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.375283"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146826+0000","last_change":"2024-09-10T08:32:24.146826+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146826+0000","last_undegraded":"2024-09-10T08:32:24.146826+0000","last_fullsized":"2024-09-10T08:32:24.146826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147327+0000","last_change":"2024-09-10T08:32:24.147327+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147327+0000","last_undegraded":"2024-09-10T08:32:24.147327+0000","last_fullsized":"2024-09-10T08:32:24.147327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148389+0000","last_change":"2024-09-10T08:32:24.148389+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148389+0000","last_undegraded":"2024-09-10T08:32:24.148389+0000","last_fullsized":"2024-09-10T08:32:24.148389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147174+0000","last_change":"2024-09-10T08:32:24.147174+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147174+0000","last_undegraded":"2024-09-10T08:32:24.147174+0000","last_fullsized":"2024-09-10T08:32:24.147174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145509+0000","last_change":"2024-09-10T08:32:24.145509+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145509+0000","last_undegraded":"2024-09-10T08:32:24.145509+0000","last_fullsized":"2024-09-10T08:32:24.145509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143813+0000","last_change":"2024-09-10T08:32:24.143813+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143813+0000","last_undegraded":"2024-09-10T08:32:24.143813+0000","last_fullsized":"2024-09-10T08:32:24.143813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147570+0000","last_change":"2024-09-10T08:32:24.147570+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147570+0000","last_undegraded":"2024-09-10T08:32:24.147570+0000","last_fullsized":"2024-09-10T08:32:24.147570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152102+0000","last_change":"2024-09-10T08:32:24.152102+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152102+0000","last_undegraded":"2024-09-10T08:32:24.152102+0000","last_fullsized":"2024-09-10T08:32:24.152102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146849+0000","last_change":"2024-09-10T08:32:24.146849+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146849+0000","last_undegraded":"2024-09-10T08:32:24.146849+0000","last_fullsized":"2024-09-10T08:32:24.146849+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151172+0000","last_change":"2024-09-10T08:32:24.151172+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151172+0000","last_undegraded":"2024-09-10T08:32:24.151172+0000","last_fullsized":"2024-09-10T08:32:24.151172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150648+0000","last_change":"2024-09-10T08:32:24.150648+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150648+0000","last_undegraded":"2024-09-10T08:32:24.150648+0000","last_fullsized":"2024-09-10T08:32:24.150648+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149466+0000","last_change":"2024-09-10T08:32:24.149466+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149466+0000","last_undegraded":"2024-09-10T08:32:24.149466+0000","last_fullsized":"2024-09-10T08:32:24.149466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150210+0000","last_change":"2024-09-10T08:32:24.150210+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150210+0000","last_undegraded":"2024-09-10T08:32:24.150210+0000","last_fullsized":"2024-09-10T08:32:24.150210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.153251+0000","last_change":"2024-09-10T08:32:24.153251+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.153251+0000","last_undegraded":"2024-09-10T08:32:24.153251+0000","last_fullsized":"2024-09-10T08:32:24.153251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142415+0000","last_change":"2024-09-10T08:32:24.142415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142415+0000","last_undegraded":"2024-09-10T08:32:24.142415+0000","last_fullsized":"2024-09-10T08:32:24.142415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146382+0000","last_change":"2024-09-10T08:32:24.146382+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146382+0000","last_undegraded":"2024-09-10T08:32:24.146382+0000","last_fullsized":"2024-09-10T08:32:24.146382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148176+0000","last_change":"2024-09-10T08:32:24.148176+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148176+0000","last_undegraded":"2024-09-10T08:32:24.148176+0000","last_fullsized":"2024-09-10T08:32:24.148176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145415+0000","last_change":"2024-09-10T08:32:24.145415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145415+0000","last_undegraded":"2024-09-10T08:32:24.145415+0000","last_fullsized":"2024-09-10T08:32:24.145415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150734+0000","last_change":"2024-09-10T08:32:24.150734+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150734+0000","last_undegraded":"2024-09-10T08:32:24.150734+0000","last_fullsized":"2024-09-10T08:32:24.150734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149043+0000","last_change":"2024-09-10T08:32:24.149043+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149043+0000","last_undegraded":"2024-09-10T08:32:24.149043+0000","last_fullsized":"2024-09-10T08:32:24.149043+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150302+0000","last_change":"2024-09-10T08:32:24.150302+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150302+0000","last_undegraded":"2024-09-10T08:32:24.150302+0000","last_fullsized":"2024-09-10T08:32:24.150302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146846+0000","last_change":"2024-09-10T08:32:24.146846+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146846+0000","last_undegraded":"2024-09-10T08:32:24.146846+0000","last_fullsized":"2024-09-10T08:32:24.146846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150089+0000","last_change":"2024-09-10T08:32:24.150089+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150089+0000","last_undegraded":"2024-09-10T08:32:24.150089+0000","last_fullsized":"2024-09-10T08:32:24.150089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148618+0000","last_change":"2024-09-10T08:32:24.148618+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148618+0000","last_undegraded":"2024-09-10T08:32:24.148618+0000","last_fullsized":"2024-09-10T08:32:24.148618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151779+0000","last_change":"2024-09-10T08:32:24.151779+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151779+0000","last_undegraded":"2024-09-10T08:32:24.151779+0000","last_fullsized":"2024-09-10T08:32:24.151779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144995+0000","last_change":"2024-09-10T08:32:24.144995+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144995+0000","last_undegraded":"2024-09-10T08:32:24.144995+0000","last_fullsized":"2024-09-10T08:32:24.144995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146828+0000","last_change":"2024-09-10T08:32:24.146828+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146828+0000","last_undegraded":"2024-09-10T08:32:24.146828+0000","last_fullsized":"2024-09-10T08:32:24.146828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143407+0000","last_change":"2024-09-10T08:32:24.143407+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143407+0000","last_undegraded":"2024-09-10T08:32:24.143407+0000","last_fullsized":"2024-09-10T08:32:24.143407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147539+0000","last_change":"2024-09-10T08:32:24.147539+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147539+0000","last_undegraded":"2024-09-10T08:32:24.147539+0000","last_fullsized":"2024-09-10T08:32:24.147539+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146388+0000","last_change":"2024-09-10T08:32:24.146388+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146388+0000","last_undegraded":"2024-09-10T08:32:24.146388+0000","last_fullsized":"2024-09-10T08:32:24.146388+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163798+0000","last_change":"2024-09-10T08:32:24.162104+0000","last_active":"2024-09-10T08:32:24.163798+0000","last_peered":"2024-09-10T08:32:24.163798+0000","last_clean":"2024-09-10T08:32:24.163798+0000","last_became_active":"2024-09-10T08:32:24.160974+0000","last_became_peered":"2024-09-10T08:32:24.160974+0000","last_unstale":"2024-09-10T08:32:24.163798+0000","last_undegraded":"2024-09-10T08:32:24.163798+0000","last_fullsized":"2024-09-10T08:32:24.163798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:24.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145961+0000","last_change":"2024-09-10T08:32:24.145961+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145961+0000","last_undegraded":"2024-09-10T08:32:24.145961+0000","last_fullsized":"2024-09-10T08:32:24.145961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166236+0000","last_change":"2024-09-10T08:32:24.165316+0000","last_active":"2024-09-10T08:32:24.166236+0000","last_peered":"2024-09-10T08:32:24.166236+0000","last_clean":"2024-09-10T08:32:24.166236+0000","last_became_active":"2024-09-10T08:32:24.165042+0000","last_became_peered":"2024-09-10T08:32:24.165042+0000","last_unstale":"2024-09-10T08:32:24.166236+0000","last_undegraded":"2024-09-10T08:32:24.166236+0000","last_fullsized":"2024-09-10T08:32:24.166236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:05.022458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163350+0000","last_change":"2024-09-10T08:32:24.159693+0000","last_active":"2024-09-10T08:32:24.163350+0000","last_peered":"2024-09-10T08:32:24.163350+0000","last_clean":"2024-09-10T08:32:24.163350+0000","last_became_active":"2024-09-10T08:32:24.159350+0000","last_became_peered":"2024-09-10T08:32:24.159350+0000","last_unstale":"2024-09-10T08:32:24.163350+0000","last_undegraded":"2024-09-10T08:32:24.163350+0000","last_fullsized":"2024-09-10T08:32:24.163350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:38.383683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145252+0000","last_change":"2024-09-10T08:32:24.145252+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145252+0000","last_undegraded":"2024-09-10T08:32:24.145252+0000","last_fullsized":"2024-09-10T08:32:24.145252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158485+0000","last_change":"2024-09-10T08:32:24.154313+0000","last_active":"2024-09-10T08:32:24.158485+0000","last_peered":"2024-09-10T08:32:24.158485+0000","last_clean":"2024-09-10T08:32:24.158485+0000","last_became_active":"2024-09-10T08:32:24.153991+0000","last_became_peered":"2024-09-10T08:32:24.153991+0000","last_unstale":"2024-09-10T08:32:24.158485+0000","last_undegraded":"2024-09-10T08:32:24.158485+0000","last_fullsized":"2024-09-10T08:32:24.158485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:29.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163986+0000","last_change":"2024-09-10T08:32:24.159316+0000","last_active":"2024-09-10T08:32:24.163986+0000","last_peered":"2024-09-10T08:32:24.163986+0000","last_clean":"2024-09-10T08:32:24.163986+0000","last_became_active":"2024-09-10T08:32:24.159005+0000","last_became_peered":"2024-09-10T08:32:24.159005+0000","last_unstale":"2024-09-10T08:32:24.163986+0000","last_undegraded":"2024-09-10T08:32:24.163986+0000","last_fullsized":"2024-09-10T08:32:24.163986+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.167399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152285+0000","last_change":"2024-09-10T08:32:24.152285+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152285+0000","last_undegraded":"2024-09-10T08:32:24.152285+0000","last_fullsized":"2024-09-10T08:32:24.152285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.157267+0000","last_change":"2024-09-10T08:32:24.154485+0000","last_active":"2024-09-10T08:32:24.157267+0000","last_peered":"2024-09-10T08:32:24.157267+0000","last_clean":"2024-09-10T08:32:24.157267+0000","last_became_active":"2024-09-10T08:32:24.154218+0000","last_became_peered":"2024-09-10T08:32:24.154218+0000","last_unstale":"2024-09-10T08:32:24.157267+0000","last_undegraded":"2024-09-10T08:32:24.157267+0000","last_fullsized":"2024-09-10T08:32:24.157267+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:48.551576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147721+0000","last_change":"2024-09-10T08:32:24.147721+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147721+0000","last_undegraded":"2024-09-10T08:32:24.147721+0000","last_fullsized":"2024-09-10T08:32:24.147721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167113+0000","last_change":"2024-09-10T08:32:24.165574+0000","last_active":"2024-09-10T08:32:24.167113+0000","last_peered":"2024-09-10T08:32:24.167113+0000","last_clean":"2024-09-10T08:32:24.167113+0000","last_became_active":"2024-09-10T08:32:24.165300+0000","last_became_peered":"2024-09-10T08:32:24.165300+0000","last_unstale":"2024-09-10T08:32:24.167113+0000","last_undegraded":"2024-09-10T08:32:24.167113+0000","last_fullsized":"2024-09-10T08:32:24.167113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142512+0000","last_change":"2024-09-10T08:32:24.142512+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142512+0000","last_undegraded":"2024-09-10T08:32:24.142512+0000","last_fullsized":"2024-09-10T08:32:24.142512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166052+0000","last_change":"2024-09-10T08:32:24.163403+0000","last_active":"2024-09-10T08:32:24.166052+0000","last_peered":"2024-09-10T08:32:24.166052+0000","last_clean":"2024-09-10T08:32:24.166052+0000","last_became_active":"2024-09-10T08:32:24.162449+0000","last_became_peered":"2024-09-10T08:32:24.162449+0000","last_unstale":"2024-09-10T08:32:24.166052+0000","last_undegraded":"2024-09-10T08:32:24.166052+0000","last_fullsized":"2024-09-10T08:32:24.166052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:02.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151339+0000","last_change":"2024-09-10T08:32:24.151339+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151339+0000","last_undegraded":"2024-09-10T08:32:24.151339+0000","last_fullsized":"2024-09-10T08:32:24.151339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163796+0000","last_change":"2024-09-10T08:32:24.163145+0000","last_active":"2024-09-10T08:32:24.163796+0000","last_peered":"2024-09-10T08:32:24.163796+0000","last_clean":"2024-09-10T08:32:24.163796+0000","last_became_active":"2024-09-10T08:32:24.162835+0000","last_became_peered":"2024-09-10T08:32:24.162835+0000","last_unstale":"2024-09-10T08:32:24.163796+0000","last_undegraded":"2024-09-10T08:32:24.163796+0000","last_fullsized":"2024-09-10T08:32:24.163796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150987+0000","last_change":"2024-09-10T08:32:24.150987+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150987+0000","last_undegraded":"2024-09-10T08:32:24.150987+0000","last_fullsized":"2024-09-10T08:32:24.150987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.143515+0000","last_change":"2024-09-10T08:32:23.143515+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.143515+0000","last_undegraded":"2024-09-10T08:32:23.143515+0000","last_fullsized":"2024-09-10T08:32:23.143515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161981+0000","last_change":"2024-09-10T08:32:24.156801+0000","last_active":"2024-09-10T08:32:24.161981+0000","last_peered":"2024-09-10T08:32:24.161981+0000","last_clean":"2024-09-10T08:32:24.161981+0000","last_became_active":"2024-09-10T08:32:24.156520+0000","last_became_peered":"2024-09-10T08:32:24.156520+0000","last_unstale":"2024-09-10T08:32:24.161981+0000","last_undegraded":"2024-09-10T08:32:24.161981+0000","last_fullsized":"2024-09-10T08:32:24.161981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:36.232352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148838+0000","last_change":"2024-09-10T08:32:24.148838+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148838+0000","last_undegraded":"2024-09-10T08:32:24.148838+0000","last_fullsized":"2024-09-10T08:32:24.148838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167980+0000","last_change":"2024-09-10T08:32:24.166153+0000","last_active":"2024-09-10T08:32:24.167980+0000","last_peered":"2024-09-10T08:32:24.167980+0000","last_clean":"2024-09-10T08:32:24.167980+0000","last_became_active":"2024-09-10T08:32:24.165858+0000","last_became_peered":"2024-09-10T08:32:24.165858+0000","last_unstale":"2024-09-10T08:32:24.167980+0000","last_undegraded":"2024-09-10T08:32:24.167980+0000","last_fullsized":"2024-09-10T08:32:24.167980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:55.441531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151031+0000","last_change":"2024-09-10T08:32:24.151031+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151031+0000","last_undegraded":"2024-09-10T08:32:24.151031+0000","last_fullsized":"2024-09-10T08:32:24.151031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.143234+0000","last_change":"2024-09-10T08:32:23.143234+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.143234+0000","last_undegraded":"2024-09-10T08:32:23.143234+0000","last_fullsized":"2024-09-10T08:32:23.143234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151395+0000","last_change":"2024-09-10T08:32:24.151395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151395+0000","last_undegraded":"2024-09-10T08:32:24.151395+0000","last_fullsized":"2024-09-10T08:32:24.151395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160522+0000","last_change":"2024-09-10T08:32:24.159347+0000","last_active":"2024-09-10T08:32:24.160522+0000","last_peered":"2024-09-10T08:32:24.160522+0000","last_clean":"2024-09-10T08:32:24.160522+0000","last_became_active":"2024-09-10T08:32:24.158536+0000","last_became_peered":"2024-09-10T08:32:24.158536+0000","last_unstale":"2024-09-10T08:32:24.160522+0000","last_undegraded":"2024-09-10T08:32:24.160522+0000","last_fullsized":"2024-09-10T08:32:24.160522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:08.950585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149626+0000","last_change":"2024-09-10T08:32:24.149626+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149626+0000","last_undegraded":"2024-09-10T08:32:24.149626+0000","last_fullsized":"2024-09-10T08:32:24.149626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.159168+0000","last_change":"2024-09-10T08:32:24.155976+0000","last_active":"2024-09-10T08:32:24.159168+0000","last_peered":"2024-09-10T08:32:24.159168+0000","last_clean":"2024-09-10T08:32:24.159168+0000","last_became_active":"2024-09-10T08:32:24.155662+0000","last_became_peered":"2024-09-10T08:32:24.155662+0000","last_unstale":"2024-09-10T08:32:24.159168+0000","last_undegraded":"2024-09-10T08:32:24.159168+0000","last_fullsized":"2024-09-10T08:32:24.159168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:54.341281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146404+0000","last_change":"2024-09-10T08:32:24.146404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146404+0000","last_undegraded":"2024-09-10T08:32:24.146404+0000","last_fullsized":"2024-09-10T08:32:24.146404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163615+0000","last_change":"2024-09-10T08:32:24.161542+0000","last_active":"2024-09-10T08:32:24.163615+0000","last_peered":"2024-09-10T08:32:24.163615+0000","last_clean":"2024-09-10T08:32:24.163615+0000","last_became_active":"2024-09-10T08:32:24.161209+0000","last_became_peered":"2024-09-10T08:32:24.161209+0000","last_unstale":"2024-09-10T08:32:24.163615+0000","last_undegraded":"2024-09-10T08:32:24.163615+0000","last_fullsized":"2024-09-10T08:32:24.163615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:26.653099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147702+0000","last_change":"2024-09-10T08:32:24.147702+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147702+0000","last_undegraded":"2024-09-10T08:32:24.147702+0000","last_fullsized":"2024-09-10T08:32:24.147702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163888+0000","last_change":"2024-09-10T08:32:24.160497+0000","last_active":"2024-09-10T08:32:24.163888+0000","last_peered":"2024-09-10T08:32:24.163888+0000","last_clean":"2024-09-10T08:32:24.163888+0000","last_became_active":"2024-09-10T08:32:24.160209+0000","last_became_peered":"2024-09-10T08:32:24.160209+0000","last_unstale":"2024-09-10T08:32:24.163888+0000","last_undegraded":"2024-09-10T08:32:24.163888+0000","last_fullsized":"2024-09-10T08:32:24.163888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150523+0000","last_change":"2024-09-10T08:32:24.150523+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150523+0000","last_undegraded":"2024-09-10T08:32:24.150523+0000","last_fullsized":"2024-09-10T08:32:24.150523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.143036+0000","last_change":"2024-09-10T08:32:23.143036+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.143036+0000","last_undegraded":"2024-09-10T08:32:23.143036+0000","last_fullsized":"2024-09-10T08:32:23.143036+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144404+0000","last_change":"2024-09-10T08:32:24.144404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144404+0000","last_undegraded":"2024-09-10T08:32:24.144404+0000","last_fullsized":"2024-09-10T08:32:24.144404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163655+0000","last_change":"2024-09-10T08:32:24.161818+0000","last_active":"2024-09-10T08:32:24.163655+0000","last_peered":"2024-09-10T08:32:24.163655+0000","last_clean":"2024-09-10T08:32:24.163655+0000","last_became_active":"2024-09-10T08:32:24.161093+0000","last_became_peered":"2024-09-10T08:32:24.161093+0000","last_unstale":"2024-09-10T08:32:24.163655+0000","last_undegraded":"2024-09-10T08:32:24.163655+0000","last_fullsized":"2024-09-10T08:32:24.163655+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:17.486040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148438+0000","last_change":"2024-09-10T08:32:24.148438+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148438+0000","last_undegraded":"2024-09-10T08:32:24.148438+0000","last_fullsized":"2024-09-10T08:32:24.148438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.142722+0000","last_change":"2024-09-10T08:32:23.142722+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.142722+0000","last_undegraded":"2024-09-10T08:32:23.142722+0000","last_fullsized":"2024-09-10T08:32:23.142722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150610+0000","last_change":"2024-09-10T08:32:24.150610+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150610+0000","last_undegraded":"2024-09-10T08:32:24.150610+0000","last_fullsized":"2024-09-10T08:32:24.150610+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166462+0000","last_change":"2024-09-10T08:32:24.165473+0000","last_active":"2024-09-10T08:32:24.166462+0000","last_peered":"2024-09-10T08:32:24.166462+0000","last_clean":"2024-09-10T08:32:24.166462+0000","last_became_active":"2024-09-10T08:32:24.165182+0000","last_became_peered":"2024-09-10T08:32:24.165182+0000","last_unstale":"2024-09-10T08:32:24.166462+0000","last_undegraded":"2024-09-10T08:32:24.166462+0000","last_fullsized":"2024-09-10T08:32:24.166462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:17.760809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.143926+0000","last_change":"2024-09-10T08:32:23.143926+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.143926+0000","last_undegraded":"2024-09-10T08:32:23.143926+0000","last_fullsized":"2024-09-10T08:32:23.143926+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160966+0000","last_change":"2024-09-10T08:32:24.159571+0000","last_active":"2024-09-10T08:32:24.160966+0000","last_peered":"2024-09-10T08:32:24.160966+0000","last_clean":"2024-09-10T08:32:24.160966+0000","last_became_active":"2024-09-10T08:32:24.159007+0000","last_became_peered":"2024-09-10T08:32:24.159007+0000","last_unstale":"2024-09-10T08:32:24.160966+0000","last_undegraded":"2024-09-10T08:32:24.160966+0000","last_fullsized":"2024-09-10T08:32:24.160966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.047855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145138+0000","last_change":"2024-09-10T08:32:24.145138+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145138+0000","last_undegraded":"2024-09-10T08:32:24.145138+0000","last_fullsized":"2024-09-10T08:32:24.145138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163295+0000","last_change":"2024-09-10T08:32:24.160317+0000","last_active":"2024-09-10T08:32:24.163295+0000","last_peered":"2024-09-10T08:32:24.163295+0000","last_clean":"2024-09-10T08:32:24.163295+0000","last_became_active":"2024-09-10T08:32:24.158842+0000","last_became_peered":"2024-09-10T08:32:24.158842+0000","last_unstale":"2024-09-10T08:32:24.163295+0000","last_undegraded":"2024-09-10T08:32:24.163295+0000","last_fullsized":"2024-09-10T08:32:24.163295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145158+0000","last_change":"2024-09-10T08:32:24.145158+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145158+0000","last_undegraded":"2024-09-10T08:32:24.145158+0000","last_fullsized":"2024-09-10T08:32:24.145158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166992+0000","last_change":"2024-09-10T08:32:24.166154+0000","last_active":"2024-09-10T08:32:24.166992+0000","last_peered":"2024-09-10T08:32:24.166992+0000","last_clean":"2024-09-10T08:32:24.166992+0000","last_became_active":"2024-09-10T08:32:24.165827+0000","last_became_peered":"2024-09-10T08:32:24.165827+0000","last_unstale":"2024-09-10T08:32:24.166992+0000","last_undegraded":"2024-09-10T08:32:24.166992+0000","last_fullsized":"2024-09-10T08:32:24.166992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:44.608981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143970+0000","last_change":"2024-09-10T08:32:24.143970+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143970+0000","last_undegraded":"2024-09-10T08:32:24.143970+0000","last_fullsized":"2024-09-10T08:32:24.143970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.168179+0000","last_change":"2024-09-10T08:32:24.167261+0000","last_active":"2024-09-10T08:32:24.168179+0000","last_peered":"2024-09-10T08:32:24.168179+0000","last_clean":"2024-09-10T08:32:24.168179+0000","last_became_active":"2024-09-10T08:32:24.166919+0000","last_became_peered":"2024-09-10T08:32:24.166919+0000","last_unstale":"2024-09-10T08:32:24.168179+0000","last_undegraded":"2024-09-10T08:32:24.168179+0000","last_fullsized":"2024-09-10T08:32:24.168179+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161736+0000","last_change":"2024-09-10T08:32:24.155506+0000","last_active":"2024-09-10T08:32:24.161736+0000","last_peered":"2024-09-10T08:32:24.161736+0000","last_clean":"2024-09-10T08:32:24.161736+0000","last_became_active":"2024-09-10T08:32:24.154291+0000","last_became_peered":"2024-09-10T08:32:24.154291+0000","last_unstale":"2024-09-10T08:32:24.161736+0000","last_undegraded":"2024-09-10T08:32:24.161736+0000","last_fullsized":"2024-09-10T08:32:24.161736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:30.359702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143395+0000","last_change":"2024-09-10T08:32:24.143395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143395+0000","last_undegraded":"2024-09-10T08:32:24.143395+0000","last_fullsized":"2024-09-10T08:32:24.143395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158973+0000","last_change":"2024-09-10T08:32:24.154949+0000","last_active":"2024-09-10T08:32:24.158973+0000","last_peered":"2024-09-10T08:32:24.158973+0000","last_clean":"2024-09-10T08:32:24.158973+0000","last_became_active":"2024-09-10T08:32:24.153289+0000","last_became_peered":"2024-09-10T08:32:24.153289+0000","last_unstale":"2024-09-10T08:32:24.158973+0000","last_undegraded":"2024-09-10T08:32:24.158973+0000","last_fullsized":"2024-09-10T08:32:24.158973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148622+0000","last_change":"2024-09-10T08:32:24.148622+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148622+0000","last_undegraded":"2024-09-10T08:32:24.148622+0000","last_fullsized":"2024-09-10T08:32:24.148622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163882+0000","last_change":"2024-09-10T08:32:24.162218+0000","last_active":"2024-09-10T08:32:24.163882+0000","last_peered":"2024-09-10T08:32:24.163882+0000","last_clean":"2024-09-10T08:32:24.163882+0000","last_became_active":"2024-09-10T08:32:24.159383+0000","last_became_peered":"2024-09-10T08:32:24.159383+0000","last_unstale":"2024-09-10T08:32:24.163882+0000","last_undegraded":"2024-09-10T08:32:24.163882+0000","last_fullsized":"2024-09-10T08:32:24.163882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:02.720855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158308+0000","last_change":"2024-09-10T08:32:24.157040+0000","last_active":"2024-09-10T08:32:24.158308+0000","last_peered":"2024-09-10T08:32:24.158308+0000","last_clean":"2024-09-10T08:32:24.158308+0000","last_became_active":"2024-09-10T08:32:24.156709+0000","last_became_peered":"2024-09-10T08:32:24.156709+0000","last_unstale":"2024-09-10T08:32:24.158308+0000","last_undegraded":"2024-09-10T08:32:24.158308+0000","last_fullsized":"2024-09-10T08:32:24.158308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:06.117270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142949+0000","last_change":"2024-09-10T08:32:24.142949+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142949+0000","last_undegraded":"2024-09-10T08:32:24.142949+0000","last_fullsized":"2024-09-10T08:32:24.142949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2024-09-10T08:32:23.142644+0000","last_change":"2024-09-10T08:32:23.142644+0000","last_active":"2024-09-10T08:32:23.129733+0000","last_peered":"2024-09-10T08:32:23.129733+0000","last_clean":"2024-09-10T08:32:23.129733+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:23.142644+0000","last_undegraded":"2024-09-10T08:32:23.142644+0000","last_fullsized":"2024-09-10T08:32:23.142644+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:32:24.132542+0000","last_change":"2024-09-10T08:32:24.132542+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.132542+0000","last_undegraded":"2024-09-10T08:32:24.132542+0000","last_fullsized":"2024-09-10T08:32:24.132542+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.164787+0000","last_change":"2024-09-10T08:32:24.159632+0000","last_active":"2024-09-10T08:32:24.164787+0000","last_peered":"2024-09-10T08:32:24.164787+0000","last_clean":"2024-09-10T08:32:24.164787+0000","last_became_active":"2024-09-10T08:32:24.158831+0000","last_became_peered":"2024-09-10T08:32:24.158831+0000","last_unstale":"2024-09-10T08:32:24.164787+0000","last_undegraded":"2024-09-10T08:32:24.164787+0000","last_fullsized":"2024-09-10T08:32:24.164787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.150316+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:32:24.150316+0000","last_peered":"2024-09-10T08:32:24.150316+0000","last_clean":"2024-09-10T08:32:24.150316+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:32:24.150316+0000","last_undegraded":"2024-09-10T08:32:24.150316+0000","last_fullsized":"2024-09-10T08:32:24.150316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1294336,"data_stored":878953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1282048,"data_stored":872678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:32:29.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:32:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.600+0000 7fe452a00640 1 Processor -- start 2024-09-10T08:32:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.601+0000 7fe452a00640 1 -- start start 2024-09-10T08:32:29.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe452a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe452a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c0b4020 con 0x7fe44c0b5880 2024-09-10T08:32:29.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe452a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c0b42c0 con 0x7fe44c145ed0 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe452a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c0b45a0 con 0x7fe44c073890 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe450a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe44c0b5880 0x7fe44c0b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49626/0 (socket says 172.21.15.52:49626) 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe450a00640 1 -- 172.21.15.52:0/1739570066 learned_addr learned my addr 172.21.15.52:0/1739570066 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.602+0000 7fe443400640 1 --2- 172.21.15.52:0/1739570066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859250688 0 0) 0x7fe44c0b4020 con 0x7fe44c0b5880 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe430003520 con 0x7fe44c0b5880 2024-09-10T08:32:29.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493450372 0 0) 0x7fe44c0b42c0 con 0x7fe44c145ed0 2024-09-10T08:32:29.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe443400640 1 -- 172.21.15.52:0/1739570066 >> v1:172.21.15.176:6789/0 conn(0x7fe44c145ed0 legacy=0x7fe44c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe443400640 1 -- 172.21.15.52:0/1739570066 >> v1:172.21.15.52:6789/0 conn(0x7fe44c0b5880 legacy=0x7fe44c0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.603+0000 7fe443400640 1 -- 172.21.15.52:0/1739570066 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c0b4880 con 0x7fe44c073890 2024-09-10T08:32:29.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.604+0000 7fe443400640 1 --2- 172.21.15.52:0/1739570066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c0b5080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4340097d0 tx=0x7fe43402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cc4e9b154832a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.604+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434037070 con 0x7fe44c073890 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.604+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe434032440 con 0x7fe44c073890 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.604+0000 7fe44b400640 1 -- 172.21.15.52:0/1739570066 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340327f0 con 0x7fe44c073890 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 -- 172.21.15.52:0/1739570066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 msgr2=0x7fe44c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 --2- 172.21.15.52:0/1739570066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c0b5080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4340097d0 tx=0x7fe43402a210 comp rx=0 tx=0).stop 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 -- 172.21.15.52:0/1739570066 shutdown_connections 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 --2- 172.21.15.52:0/1739570066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c0b5080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 -- 172.21.15.52:0/1739570066 >> 172.21.15.52:0/1739570066 conn(0x7fe44c0ccec0 msgr2=0x7fe44c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 -- 172.21.15.52:0/1739570066 shutdown_connections 2024-09-10T08:32:29.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.605+0000 7fe452a00640 1 -- 172.21.15.52:0/1739570066 wait complete. 2024-09-10T08:32:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.607+0000 7fe452a00640 1 Processor -- start 2024-09-10T08:32:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.607+0000 7fe452a00640 1 -- start start 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c1f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe44c0b5880 0x7fe44c072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c146430 con 0x7fe44c145ed0 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c1462b0 con 0x7fe44c0b5880 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe452a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c15cdc0 con 0x7fe44c073890 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44628/0 (socket says 172.21.15.52:44628) 2024-09-10T08:32:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 -- 172.21.15.52:0/1336359124 learned_addr learned my addr 172.21.15.52:0/1336359124 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe443400640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe44c0b5880 0x7fe44c072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe44be00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c1f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 -- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 msgr2=0x7fe44c1f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c1f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 -- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe44c0b5880 msgr2=0x7fe44c072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe44c0b5880 0x7fe44c072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.608+0000 7fe450a00640 1 -- 172.21.15.52:0/1336359124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c0718b0 con 0x7fe44c145ed0 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe450a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe44400cb40 tx=0x7fe44400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444017070 con 0x7fe44c145ed0 2024-09-10T08:32:29.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44400aca0 con 0x7fe44c145ed0 2024-09-10T08:32:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444012620 con 0x7fe44c145ed0 2024-09-10T08:32:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c071b90 con 0x7fe44c145ed0 2024-09-10T08:32:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.609+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c072150 con 0x7fe44c145ed0 2024-09-10T08:32:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.610+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44c0d1550 con 0x7fe44c145ed0 2024-09-10T08:32:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.611+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe44401a070 con 0x7fe44c145ed0 2024-09-10T08:32:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.612+0000 7fe448c00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 0x7fe42806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.612+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fe44408ad70 con 0x7fe44c145ed0 2024-09-10T08:32:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.612+0000 7fe44be00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 0x7fe42806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.613+0000 7fe44be00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 0x7fe42806e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe43c007fd0 tx=0x7fe43c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:29.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.616+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe44c0d1550 con 0x7fe44c145ed0 2024-09-10T08:32:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.797+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe44c0b5080 con 0x7fe42806be60 2024-09-10T08:32:29.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.804+0000 7fe448c00640 1 -- 172.21.15.52:0/1336359124 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247551 (secure 0 0 0) 0x7fe44c0b5080 con 0x7fe42806be60 2024-09-10T08:32:29.808 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:29.809 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 msgr2=0x7fe42806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 0x7fe42806e320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe43c007fd0 tx=0x7fe43c009040 comp rx=0 tx=0).stop 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 msgr2=0x7fe44c072e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe44400cb40 tx=0x7fe44400a060 comp rx=0 tx=0).stop 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 shutdown_connections 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe42806be60 0x7fe42806e320 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe44c145ed0 0x7fe44c072e90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe44c0b5880 0x7fe44c072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 --2- 172.21.15.52:0/1336359124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe44c073890 0x7fe44c1f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 >> 172.21.15.52:0/1336359124 conn(0x7fe44c0ccec0 msgr2=0x7fe44c0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 shutdown_connections 2024-09-10T08:32:29.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:29.808+0000 7fe452a00640 1 -- 172.21.15.52:0/1336359124 wait complete. 2024-09-10T08:32:29.824 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-10T08:32:29.508577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310268,"kb_used_data":6660,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754664452,"statfs":{"total":773094113280,"available":772776398848,"internally_reserved":0,"allocated":6819840,"data_stored":3502525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001710"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146826+0000","last_change":"2024-09-10T08:32:24.146826+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146826+0000","last_undegraded":"2024-09-10T08:32:24.146826+0000","last_fullsized":"2024-09-10T08:32:24.146826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147327+0000","last_change":"2024-09-10T08:32:24.147327+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147327+0000","last_undegraded":"2024-09-10T08:32:24.147327+0000","last_fullsized":"2024-09-10T08:32:24.147327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148389+0000","last_change":"2024-09-10T08:32:24.148389+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148389+0000","last_undegraded":"2024-09-10T08:32:24.148389+0000","last_fullsized":"2024-09-10T08:32:24.148389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147174+0000","last_change":"2024-09-10T08:32:24.147174+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147174+0000","last_undegraded":"2024-09-10T08:32:24.147174+0000","last_fullsized":"2024-09-10T08:32:24.147174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145509+0000","last_change":"2024-09-10T08:32:24.145509+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145509+0000","last_undegraded":"2024-09-10T08:32:24.145509+0000","last_fullsized":"2024-09-10T08:32:24.145509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143813+0000","last_change":"2024-09-10T08:32:24.143813+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143813+0000","last_undegraded":"2024-09-10T08:32:24.143813+0000","last_fullsized":"2024-09-10T08:32:24.143813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147570+0000","last_change":"2024-09-10T08:32:24.147570+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147570+0000","last_undegraded":"2024-09-10T08:32:24.147570+0000","last_fullsized":"2024-09-10T08:32:24.147570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279852+0000","last_change":"2024-09-10T08:32:25.163263+0000","last_active":"2024-09-10T08:32:26.279852+0000","last_peered":"2024-09-10T08:32:26.279852+0000","last_clean":"2024-09-10T08:32:26.279852+0000","last_became_active":"2024-09-10T08:32:25.162949+0000","last_became_peered":"2024-09-10T08:32:25.162949+0000","last_unstale":"2024-09-10T08:32:26.279852+0000","last_undegraded":"2024-09-10T08:32:26.279852+0000","last_fullsized":"2024-09-10T08:32:26.279852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:01.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152102+0000","last_change":"2024-09-10T08:32:24.152102+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152102+0000","last_undegraded":"2024-09-10T08:32:24.152102+0000","last_fullsized":"2024-09-10T08:32:24.152102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146849+0000","last_change":"2024-09-10T08:32:24.146849+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146849+0000","last_undegraded":"2024-09-10T08:32:24.146849+0000","last_fullsized":"2024-09-10T08:32:24.146849+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151172+0000","last_change":"2024-09-10T08:32:24.151172+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151172+0000","last_undegraded":"2024-09-10T08:32:24.151172+0000","last_fullsized":"2024-09-10T08:32:24.151172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150648+0000","last_change":"2024-09-10T08:32:24.150648+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150648+0000","last_undegraded":"2024-09-10T08:32:24.150648+0000","last_fullsized":"2024-09-10T08:32:24.150648+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149466+0000","last_change":"2024-09-10T08:32:24.149466+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149466+0000","last_undegraded":"2024-09-10T08:32:24.149466+0000","last_fullsized":"2024-09-10T08:32:24.149466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150210+0000","last_change":"2024-09-10T08:32:24.150210+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150210+0000","last_undegraded":"2024-09-10T08:32:24.150210+0000","last_fullsized":"2024-09-10T08:32:24.150210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.153251+0000","last_change":"2024-09-10T08:32:24.153251+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.153251+0000","last_undegraded":"2024-09-10T08:32:24.153251+0000","last_fullsized":"2024-09-10T08:32:24.153251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142415+0000","last_change":"2024-09-10T08:32:24.142415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142415+0000","last_undegraded":"2024-09-10T08:32:24.142415+0000","last_fullsized":"2024-09-10T08:32:24.142415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146382+0000","last_change":"2024-09-10T08:32:24.146382+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146382+0000","last_undegraded":"2024-09-10T08:32:24.146382+0000","last_fullsized":"2024-09-10T08:32:24.146382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148176+0000","last_change":"2024-09-10T08:32:24.148176+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148176+0000","last_undegraded":"2024-09-10T08:32:24.148176+0000","last_fullsized":"2024-09-10T08:32:24.148176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145415+0000","last_change":"2024-09-10T08:32:24.145415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145415+0000","last_undegraded":"2024-09-10T08:32:24.145415+0000","last_fullsized":"2024-09-10T08:32:24.145415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150734+0000","last_change":"2024-09-10T08:32:24.150734+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150734+0000","last_undegraded":"2024-09-10T08:32:24.150734+0000","last_fullsized":"2024-09-10T08:32:24.150734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149043+0000","last_change":"2024-09-10T08:32:24.149043+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149043+0000","last_undegraded":"2024-09-10T08:32:24.149043+0000","last_fullsized":"2024-09-10T08:32:24.149043+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150302+0000","last_change":"2024-09-10T08:32:24.150302+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150302+0000","last_undegraded":"2024-09-10T08:32:24.150302+0000","last_fullsized":"2024-09-10T08:32:24.150302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146846+0000","last_change":"2024-09-10T08:32:24.146846+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146846+0000","last_undegraded":"2024-09-10T08:32:24.146846+0000","last_fullsized":"2024-09-10T08:32:24.146846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150089+0000","last_change":"2024-09-10T08:32:24.150089+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150089+0000","last_undegraded":"2024-09-10T08:32:24.150089+0000","last_fullsized":"2024-09-10T08:32:24.150089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148618+0000","last_change":"2024-09-10T08:32:24.148618+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148618+0000","last_undegraded":"2024-09-10T08:32:24.148618+0000","last_fullsized":"2024-09-10T08:32:24.148618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151779+0000","last_change":"2024-09-10T08:32:24.151779+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151779+0000","last_undegraded":"2024-09-10T08:32:24.151779+0000","last_fullsized":"2024-09-10T08:32:24.151779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144995+0000","last_change":"2024-09-10T08:32:24.144995+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144995+0000","last_undegraded":"2024-09-10T08:32:24.144995+0000","last_fullsized":"2024-09-10T08:32:24.144995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280476+0000","last_change":"2024-09-10T08:32:25.165304+0000","last_active":"2024-09-10T08:32:26.280476+0000","last_peered":"2024-09-10T08:32:26.280476+0000","last_clean":"2024-09-10T08:32:26.280476+0000","last_became_active":"2024-09-10T08:32:25.164955+0000","last_became_peered":"2024-09-10T08:32:25.164955+0000","last_unstale":"2024-09-10T08:32:26.280476+0000","last_undegraded":"2024-09-10T08:32:26.280476+0000","last_fullsized":"2024-09-10T08:32:26.280476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:06.512577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280552+0000","last_change":"2024-09-10T08:32:25.171501+0000","last_active":"2024-09-10T08:32:26.280552+0000","last_peered":"2024-09-10T08:32:26.280552+0000","last_clean":"2024-09-10T08:32:26.280552+0000","last_became_active":"2024-09-10T08:32:25.170830+0000","last_became_peered":"2024-09-10T08:32:25.170830+0000","last_unstale":"2024-09-10T08:32:26.280552+0000","last_undegraded":"2024-09-10T08:32:26.280552+0000","last_fullsized":"2024-09-10T08:32:26.280552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:30.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146828+0000","last_change":"2024-09-10T08:32:24.146828+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146828+0000","last_undegraded":"2024-09-10T08:32:24.146828+0000","last_fullsized":"2024-09-10T08:32:24.146828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143407+0000","last_change":"2024-09-10T08:32:24.143407+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143407+0000","last_undegraded":"2024-09-10T08:32:24.143407+0000","last_fullsized":"2024-09-10T08:32:24.143407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147539+0000","last_change":"2024-09-10T08:32:24.147539+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147539+0000","last_undegraded":"2024-09-10T08:32:24.147539+0000","last_fullsized":"2024-09-10T08:32:24.147539+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146388+0000","last_change":"2024-09-10T08:32:24.146388+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146388+0000","last_undegraded":"2024-09-10T08:32:24.146388+0000","last_fullsized":"2024-09-10T08:32:24.146388+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163798+0000","last_change":"2024-09-10T08:32:24.162104+0000","last_active":"2024-09-10T08:32:24.163798+0000","last_peered":"2024-09-10T08:32:24.163798+0000","last_clean":"2024-09-10T08:32:24.163798+0000","last_became_active":"2024-09-10T08:32:24.160974+0000","last_became_peered":"2024-09-10T08:32:24.160974+0000","last_unstale":"2024-09-10T08:32:24.163798+0000","last_undegraded":"2024-09-10T08:32:24.163798+0000","last_fullsized":"2024-09-10T08:32:24.163798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:24.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145961+0000","last_change":"2024-09-10T08:32:24.145961+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145961+0000","last_undegraded":"2024-09-10T08:32:24.145961+0000","last_fullsized":"2024-09-10T08:32:24.145961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166236+0000","last_change":"2024-09-10T08:32:24.165316+0000","last_active":"2024-09-10T08:32:24.166236+0000","last_peered":"2024-09-10T08:32:24.166236+0000","last_clean":"2024-09-10T08:32:24.166236+0000","last_became_active":"2024-09-10T08:32:24.165042+0000","last_became_peered":"2024-09-10T08:32:24.165042+0000","last_unstale":"2024-09-10T08:32:24.166236+0000","last_undegraded":"2024-09-10T08:32:24.166236+0000","last_fullsized":"2024-09-10T08:32:24.166236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:05.022458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280575+0000","last_change":"2024-09-10T08:32:25.178616+0000","last_active":"2024-09-10T08:32:26.280575+0000","last_peered":"2024-09-10T08:32:26.280575+0000","last_clean":"2024-09-10T08:32:26.280575+0000","last_became_active":"2024-09-10T08:32:25.178160+0000","last_became_peered":"2024-09-10T08:32:25.178160+0000","last_unstale":"2024-09-10T08:32:26.280575+0000","last_undegraded":"2024-09-10T08:32:26.280575+0000","last_fullsized":"2024-09-10T08:32:26.280575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:34.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163350+0000","last_change":"2024-09-10T08:32:24.159693+0000","last_active":"2024-09-10T08:32:24.163350+0000","last_peered":"2024-09-10T08:32:24.163350+0000","last_clean":"2024-09-10T08:32:24.163350+0000","last_became_active":"2024-09-10T08:32:24.159350+0000","last_became_peered":"2024-09-10T08:32:24.159350+0000","last_unstale":"2024-09-10T08:32:24.163350+0000","last_undegraded":"2024-09-10T08:32:24.163350+0000","last_fullsized":"2024-09-10T08:32:24.163350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:38.383683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145252+0000","last_change":"2024-09-10T08:32:24.145252+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145252+0000","last_undegraded":"2024-09-10T08:32:24.145252+0000","last_fullsized":"2024-09-10T08:32:24.145252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158485+0000","last_change":"2024-09-10T08:32:24.154313+0000","last_active":"2024-09-10T08:32:24.158485+0000","last_peered":"2024-09-10T08:32:24.158485+0000","last_clean":"2024-09-10T08:32:24.158485+0000","last_became_active":"2024-09-10T08:32:24.153991+0000","last_became_peered":"2024-09-10T08:32:24.153991+0000","last_unstale":"2024-09-10T08:32:24.158485+0000","last_undegraded":"2024-09-10T08:32:24.158485+0000","last_fullsized":"2024-09-10T08:32:24.158485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:29.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280650+0000","last_change":"2024-09-10T08:32:25.169611+0000","last_active":"2024-09-10T08:32:26.280650+0000","last_peered":"2024-09-10T08:32:26.280650+0000","last_clean":"2024-09-10T08:32:26.280650+0000","last_became_active":"2024-09-10T08:32:25.160291+0000","last_became_peered":"2024-09-10T08:32:25.160291+0000","last_unstale":"2024-09-10T08:32:26.280650+0000","last_undegraded":"2024-09-10T08:32:26.280650+0000","last_fullsized":"2024-09-10T08:32:26.280650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:13.177652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163986+0000","last_change":"2024-09-10T08:32:24.159316+0000","last_active":"2024-09-10T08:32:24.163986+0000","last_peered":"2024-09-10T08:32:24.163986+0000","last_clean":"2024-09-10T08:32:24.163986+0000","last_became_active":"2024-09-10T08:32:24.159005+0000","last_became_peered":"2024-09-10T08:32:24.159005+0000","last_unstale":"2024-09-10T08:32:24.163986+0000","last_undegraded":"2024-09-10T08:32:24.163986+0000","last_fullsized":"2024-09-10T08:32:24.163986+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.167399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152285+0000","last_change":"2024-09-10T08:32:24.152285+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152285+0000","last_undegraded":"2024-09-10T08:32:24.152285+0000","last_fullsized":"2024-09-10T08:32:24.152285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.157267+0000","last_change":"2024-09-10T08:32:24.154485+0000","last_active":"2024-09-10T08:32:24.157267+0000","last_peered":"2024-09-10T08:32:24.157267+0000","last_clean":"2024-09-10T08:32:24.157267+0000","last_became_active":"2024-09-10T08:32:24.154218+0000","last_became_peered":"2024-09-10T08:32:24.154218+0000","last_unstale":"2024-09-10T08:32:24.157267+0000","last_undegraded":"2024-09-10T08:32:24.157267+0000","last_fullsized":"2024-09-10T08:32:24.157267+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:48.551576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147721+0000","last_change":"2024-09-10T08:32:24.147721+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147721+0000","last_undegraded":"2024-09-10T08:32:24.147721+0000","last_fullsized":"2024-09-10T08:32:24.147721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167113+0000","last_change":"2024-09-10T08:32:24.165574+0000","last_active":"2024-09-10T08:32:24.167113+0000","last_peered":"2024-09-10T08:32:24.167113+0000","last_clean":"2024-09-10T08:32:24.167113+0000","last_became_active":"2024-09-10T08:32:24.165300+0000","last_became_peered":"2024-09-10T08:32:24.165300+0000","last_unstale":"2024-09-10T08:32:24.167113+0000","last_undegraded":"2024-09-10T08:32:24.167113+0000","last_fullsized":"2024-09-10T08:32:24.167113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142512+0000","last_change":"2024-09-10T08:32:24.142512+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142512+0000","last_undegraded":"2024-09-10T08:32:24.142512+0000","last_fullsized":"2024-09-10T08:32:24.142512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166052+0000","last_change":"2024-09-10T08:32:24.163403+0000","last_active":"2024-09-10T08:32:24.166052+0000","last_peered":"2024-09-10T08:32:24.166052+0000","last_clean":"2024-09-10T08:32:24.166052+0000","last_became_active":"2024-09-10T08:32:24.162449+0000","last_became_peered":"2024-09-10T08:32:24.162449+0000","last_unstale":"2024-09-10T08:32:24.166052+0000","last_undegraded":"2024-09-10T08:32:24.166052+0000","last_fullsized":"2024-09-10T08:32:24.166052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:02.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151339+0000","last_change":"2024-09-10T08:32:24.151339+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151339+0000","last_undegraded":"2024-09-10T08:32:24.151339+0000","last_fullsized":"2024-09-10T08:32:24.151339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163796+0000","last_change":"2024-09-10T08:32:24.163145+0000","last_active":"2024-09-10T08:32:24.163796+0000","last_peered":"2024-09-10T08:32:24.163796+0000","last_clean":"2024-09-10T08:32:24.163796+0000","last_became_active":"2024-09-10T08:32:24.162835+0000","last_became_peered":"2024-09-10T08:32:24.162835+0000","last_unstale":"2024-09-10T08:32:24.163796+0000","last_undegraded":"2024-09-10T08:32:24.163796+0000","last_fullsized":"2024-09-10T08:32:24.163796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150987+0000","last_change":"2024-09-10T08:32:24.150987+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150987+0000","last_undegraded":"2024-09-10T08:32:24.150987+0000","last_fullsized":"2024-09-10T08:32:24.150987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280688+0000","last_change":"2024-09-10T08:32:24.161471+0000","last_active":"2024-09-10T08:32:26.280688+0000","last_peered":"2024-09-10T08:32:26.280688+0000","last_clean":"2024-09-10T08:32:26.280688+0000","last_became_active":"2024-09-10T08:32:24.160009+0000","last_became_peered":"2024-09-10T08:32:24.160009+0000","last_unstale":"2024-09-10T08:32:26.280688+0000","last_undegraded":"2024-09-10T08:32:26.280688+0000","last_fullsized":"2024-09-10T08:32:26.280688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:02.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280817+0000","last_change":"2024-09-10T08:32:25.178400+0000","last_active":"2024-09-10T08:32:26.280817+0000","last_peered":"2024-09-10T08:32:26.280817+0000","last_clean":"2024-09-10T08:32:26.280817+0000","last_became_active":"2024-09-10T08:32:25.177837+0000","last_became_peered":"2024-09-10T08:32:25.177837+0000","last_unstale":"2024-09-10T08:32:26.280817+0000","last_undegraded":"2024-09-10T08:32:26.280817+0000","last_fullsized":"2024-09-10T08:32:26.280817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.029416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161981+0000","last_change":"2024-09-10T08:32:24.156801+0000","last_active":"2024-09-10T08:32:24.161981+0000","last_peered":"2024-09-10T08:32:24.161981+0000","last_clean":"2024-09-10T08:32:24.161981+0000","last_became_active":"2024-09-10T08:32:24.156520+0000","last_became_peered":"2024-09-10T08:32:24.156520+0000","last_unstale":"2024-09-10T08:32:24.161981+0000","last_undegraded":"2024-09-10T08:32:24.161981+0000","last_fullsized":"2024-09-10T08:32:24.161981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:36.232352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148838+0000","last_change":"2024-09-10T08:32:24.148838+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148838+0000","last_undegraded":"2024-09-10T08:32:24.148838+0000","last_fullsized":"2024-09-10T08:32:24.148838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167980+0000","last_change":"2024-09-10T08:32:24.166153+0000","last_active":"2024-09-10T08:32:24.167980+0000","last_peered":"2024-09-10T08:32:24.167980+0000","last_clean":"2024-09-10T08:32:24.167980+0000","last_became_active":"2024-09-10T08:32:24.165858+0000","last_became_peered":"2024-09-10T08:32:24.165858+0000","last_unstale":"2024-09-10T08:32:24.167980+0000","last_undegraded":"2024-09-10T08:32:24.167980+0000","last_fullsized":"2024-09-10T08:32:24.167980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:55.441531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151031+0000","last_change":"2024-09-10T08:32:24.151031+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151031+0000","last_undegraded":"2024-09-10T08:32:24.151031+0000","last_fullsized":"2024-09-10T08:32:24.151031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280775+0000","last_change":"2024-09-10T08:32:24.159349+0000","last_active":"2024-09-10T08:32:26.280775+0000","last_peered":"2024-09-10T08:32:26.280775+0000","last_clean":"2024-09-10T08:32:26.280775+0000","last_became_active":"2024-09-10T08:32:24.159072+0000","last_became_peered":"2024-09-10T08:32:24.159072+0000","last_unstale":"2024-09-10T08:32:26.280775+0000","last_undegraded":"2024-09-10T08:32:26.280775+0000","last_fullsized":"2024-09-10T08:32:26.280775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.680184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151395+0000","last_change":"2024-09-10T08:32:24.151395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151395+0000","last_undegraded":"2024-09-10T08:32:24.151395+0000","last_fullsized":"2024-09-10T08:32:24.151395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160522+0000","last_change":"2024-09-10T08:32:24.159347+0000","last_active":"2024-09-10T08:32:24.160522+0000","last_peered":"2024-09-10T08:32:24.160522+0000","last_clean":"2024-09-10T08:32:24.160522+0000","last_became_active":"2024-09-10T08:32:24.158536+0000","last_became_peered":"2024-09-10T08:32:24.158536+0000","last_unstale":"2024-09-10T08:32:24.160522+0000","last_undegraded":"2024-09-10T08:32:24.160522+0000","last_fullsized":"2024-09-10T08:32:24.160522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:08.950585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149626+0000","last_change":"2024-09-10T08:32:24.149626+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149626+0000","last_undegraded":"2024-09-10T08:32:24.149626+0000","last_fullsized":"2024-09-10T08:32:24.149626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.159168+0000","last_change":"2024-09-10T08:32:24.155976+0000","last_active":"2024-09-10T08:32:24.159168+0000","last_peered":"2024-09-10T08:32:24.159168+0000","last_clean":"2024-09-10T08:32:24.159168+0000","last_became_active":"2024-09-10T08:32:24.155662+0000","last_became_peered":"2024-09-10T08:32:24.155662+0000","last_unstale":"2024-09-10T08:32:24.159168+0000","last_undegraded":"2024-09-10T08:32:24.159168+0000","last_fullsized":"2024-09-10T08:32:24.159168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:54.341281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146404+0000","last_change":"2024-09-10T08:32:24.146404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146404+0000","last_undegraded":"2024-09-10T08:32:24.146404+0000","last_fullsized":"2024-09-10T08:32:24.146404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163615+0000","last_change":"2024-09-10T08:32:24.161542+0000","last_active":"2024-09-10T08:32:24.163615+0000","last_peered":"2024-09-10T08:32:24.163615+0000","last_clean":"2024-09-10T08:32:24.163615+0000","last_became_active":"2024-09-10T08:32:24.161209+0000","last_became_peered":"2024-09-10T08:32:24.161209+0000","last_unstale":"2024-09-10T08:32:24.163615+0000","last_undegraded":"2024-09-10T08:32:24.163615+0000","last_fullsized":"2024-09-10T08:32:24.163615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:26.653099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147702+0000","last_change":"2024-09-10T08:32:24.147702+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147702+0000","last_undegraded":"2024-09-10T08:32:24.147702+0000","last_fullsized":"2024-09-10T08:32:24.147702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163888+0000","last_change":"2024-09-10T08:32:24.160497+0000","last_active":"2024-09-10T08:32:24.163888+0000","last_peered":"2024-09-10T08:32:24.163888+0000","last_clean":"2024-09-10T08:32:24.163888+0000","last_became_active":"2024-09-10T08:32:24.160209+0000","last_became_peered":"2024-09-10T08:32:24.160209+0000","last_unstale":"2024-09-10T08:32:24.163888+0000","last_undegraded":"2024-09-10T08:32:24.163888+0000","last_fullsized":"2024-09-10T08:32:24.163888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150523+0000","last_change":"2024-09-10T08:32:24.150523+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150523+0000","last_undegraded":"2024-09-10T08:32:24.150523+0000","last_fullsized":"2024-09-10T08:32:24.150523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158627+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158081+0000","last_became_peered":"2024-09-10T08:32:24.158081+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:59.562165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144404+0000","last_change":"2024-09-10T08:32:24.144404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144404+0000","last_undegraded":"2024-09-10T08:32:24.144404+0000","last_fullsized":"2024-09-10T08:32:24.144404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163655+0000","last_change":"2024-09-10T08:32:24.161818+0000","last_active":"2024-09-10T08:32:24.163655+0000","last_peered":"2024-09-10T08:32:24.163655+0000","last_clean":"2024-09-10T08:32:24.163655+0000","last_became_active":"2024-09-10T08:32:24.161093+0000","last_became_peered":"2024-09-10T08:32:24.161093+0000","last_unstale":"2024-09-10T08:32:24.163655+0000","last_undegraded":"2024-09-10T08:32:24.163655+0000","last_fullsized":"2024-09-10T08:32:24.163655+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:17.486040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148438+0000","last_change":"2024-09-10T08:32:24.148438+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148438+0000","last_undegraded":"2024-09-10T08:32:24.148438+0000","last_fullsized":"2024-09-10T08:32:24.148438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158676+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158391+0000","last_became_peered":"2024-09-10T08:32:24.158391+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.081154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150610+0000","last_change":"2024-09-10T08:32:24.150610+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150610+0000","last_undegraded":"2024-09-10T08:32:24.150610+0000","last_fullsized":"2024-09-10T08:32:24.150610+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166462+0000","last_change":"2024-09-10T08:32:24.165473+0000","last_active":"2024-09-10T08:32:24.166462+0000","last_peered":"2024-09-10T08:32:24.166462+0000","last_clean":"2024-09-10T08:32:24.166462+0000","last_became_active":"2024-09-10T08:32:24.165182+0000","last_became_peered":"2024-09-10T08:32:24.165182+0000","last_unstale":"2024-09-10T08:32:24.166462+0000","last_undegraded":"2024-09-10T08:32:24.166462+0000","last_fullsized":"2024-09-10T08:32:24.166462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:17.760809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280601+0000","last_change":"2024-09-10T08:32:25.171746+0000","last_active":"2024-09-10T08:32:26.280601+0000","last_peered":"2024-09-10T08:32:26.280601+0000","last_clean":"2024-09-10T08:32:26.280601+0000","last_became_active":"2024-09-10T08:32:25.171207+0000","last_became_peered":"2024-09-10T08:32:25.171207+0000","last_unstale":"2024-09-10T08:32:26.280601+0000","last_undegraded":"2024-09-10T08:32:26.280601+0000","last_fullsized":"2024-09-10T08:32:26.280601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:36.297951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280394+0000","last_change":"2024-09-10T08:32:24.162270+0000","last_active":"2024-09-10T08:32:26.280394+0000","last_peered":"2024-09-10T08:32:26.280394+0000","last_clean":"2024-09-10T08:32:26.280394+0000","last_became_active":"2024-09-10T08:32:24.161849+0000","last_became_peered":"2024-09-10T08:32:24.161849+0000","last_unstale":"2024-09-10T08:32:26.280394+0000","last_undegraded":"2024-09-10T08:32:26.280394+0000","last_fullsized":"2024-09-10T08:32:26.280394+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:09.348585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280457+0000","last_change":"2024-09-10T08:32:25.176004+0000","last_active":"2024-09-10T08:32:26.280457+0000","last_peered":"2024-09-10T08:32:26.280457+0000","last_clean":"2024-09-10T08:32:26.280457+0000","last_became_active":"2024-09-10T08:32:25.175730+0000","last_became_peered":"2024-09-10T08:32:25.175730+0000","last_unstale":"2024-09-10T08:32:26.280457+0000","last_undegraded":"2024-09-10T08:32:26.280457+0000","last_fullsized":"2024-09-10T08:32:26.280457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160966+0000","last_change":"2024-09-10T08:32:24.159571+0000","last_active":"2024-09-10T08:32:24.160966+0000","last_peered":"2024-09-10T08:32:24.160966+0000","last_clean":"2024-09-10T08:32:24.160966+0000","last_became_active":"2024-09-10T08:32:24.159007+0000","last_became_peered":"2024-09-10T08:32:24.159007+0000","last_unstale":"2024-09-10T08:32:24.160966+0000","last_undegraded":"2024-09-10T08:32:24.160966+0000","last_fullsized":"2024-09-10T08:32:24.160966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.047855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145138+0000","last_change":"2024-09-10T08:32:24.145138+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145138+0000","last_undegraded":"2024-09-10T08:32:24.145138+0000","last_fullsized":"2024-09-10T08:32:24.145138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163295+0000","last_change":"2024-09-10T08:32:24.160317+0000","last_active":"2024-09-10T08:32:24.163295+0000","last_peered":"2024-09-10T08:32:24.163295+0000","last_clean":"2024-09-10T08:32:24.163295+0000","last_became_active":"2024-09-10T08:32:24.158842+0000","last_became_peered":"2024-09-10T08:32:24.158842+0000","last_unstale":"2024-09-10T08:32:24.163295+0000","last_undegraded":"2024-09-10T08:32:24.163295+0000","last_fullsized":"2024-09-10T08:32:24.163295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145158+0000","last_change":"2024-09-10T08:32:24.145158+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145158+0000","last_undegraded":"2024-09-10T08:32:24.145158+0000","last_fullsized":"2024-09-10T08:32:24.145158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166992+0000","last_change":"2024-09-10T08:32:24.166154+0000","last_active":"2024-09-10T08:32:24.166992+0000","last_peered":"2024-09-10T08:32:24.166992+0000","last_clean":"2024-09-10T08:32:24.166992+0000","last_became_active":"2024-09-10T08:32:24.165827+0000","last_became_peered":"2024-09-10T08:32:24.165827+0000","last_unstale":"2024-09-10T08:32:24.166992+0000","last_undegraded":"2024-09-10T08:32:24.166992+0000","last_fullsized":"2024-09-10T08:32:24.166992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:44.608981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143970+0000","last_change":"2024-09-10T08:32:24.143970+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143970+0000","last_undegraded":"2024-09-10T08:32:24.143970+0000","last_fullsized":"2024-09-10T08:32:24.143970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.168179+0000","last_change":"2024-09-10T08:32:24.167261+0000","last_active":"2024-09-10T08:32:24.168179+0000","last_peered":"2024-09-10T08:32:24.168179+0000","last_clean":"2024-09-10T08:32:24.168179+0000","last_became_active":"2024-09-10T08:32:24.166919+0000","last_became_peered":"2024-09-10T08:32:24.166919+0000","last_unstale":"2024-09-10T08:32:24.168179+0000","last_undegraded":"2024-09-10T08:32:24.168179+0000","last_fullsized":"2024-09-10T08:32:24.168179+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280868+0000","last_change":"2024-09-10T08:32:25.161153+0000","last_active":"2024-09-10T08:32:26.280868+0000","last_peered":"2024-09-10T08:32:26.280868+0000","last_clean":"2024-09-10T08:32:26.280868+0000","last_became_active":"2024-09-10T08:32:25.160777+0000","last_became_peered":"2024-09-10T08:32:25.160777+0000","last_unstale":"2024-09-10T08:32:26.280868+0000","last_undegraded":"2024-09-10T08:32:26.280868+0000","last_fullsized":"2024-09-10T08:32:26.280868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:28.805917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161736+0000","last_change":"2024-09-10T08:32:24.155506+0000","last_active":"2024-09-10T08:32:24.161736+0000","last_peered":"2024-09-10T08:32:24.161736+0000","last_clean":"2024-09-10T08:32:24.161736+0000","last_became_active":"2024-09-10T08:32:24.154291+0000","last_became_peered":"2024-09-10T08:32:24.154291+0000","last_unstale":"2024-09-10T08:32:24.161736+0000","last_undegraded":"2024-09-10T08:32:24.161736+0000","last_fullsized":"2024-09-10T08:32:24.161736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:30.359702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143395+0000","last_change":"2024-09-10T08:32:24.143395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143395+0000","last_undegraded":"2024-09-10T08:32:24.143395+0000","last_fullsized":"2024-09-10T08:32:24.143395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158973+0000","last_change":"2024-09-10T08:32:24.154949+0000","last_active":"2024-09-10T08:32:24.158973+0000","last_peered":"2024-09-10T08:32:24.158973+0000","last_clean":"2024-09-10T08:32:24.158973+0000","last_became_active":"2024-09-10T08:32:24.153289+0000","last_became_peered":"2024-09-10T08:32:24.153289+0000","last_unstale":"2024-09-10T08:32:24.158973+0000","last_undegraded":"2024-09-10T08:32:24.158973+0000","last_fullsized":"2024-09-10T08:32:24.158973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148622+0000","last_change":"2024-09-10T08:32:24.148622+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148622+0000","last_undegraded":"2024-09-10T08:32:24.148622+0000","last_fullsized":"2024-09-10T08:32:24.148622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163882+0000","last_change":"2024-09-10T08:32:24.162218+0000","last_active":"2024-09-10T08:32:24.163882+0000","last_peered":"2024-09-10T08:32:24.163882+0000","last_clean":"2024-09-10T08:32:24.163882+0000","last_became_active":"2024-09-10T08:32:24.159383+0000","last_became_peered":"2024-09-10T08:32:24.159383+0000","last_unstale":"2024-09-10T08:32:24.163882+0000","last_undegraded":"2024-09-10T08:32:24.163882+0000","last_fullsized":"2024-09-10T08:32:24.163882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:02.720855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280007+0000","last_change":"2024-09-10T08:32:25.177447+0000","last_active":"2024-09-10T08:32:26.280007+0000","last_peered":"2024-09-10T08:32:26.280007+0000","last_clean":"2024-09-10T08:32:26.280007+0000","last_became_active":"2024-09-10T08:32:25.177118+0000","last_became_peered":"2024-09-10T08:32:25.177118+0000","last_unstale":"2024-09-10T08:32:26.280007+0000","last_undegraded":"2024-09-10T08:32:26.280007+0000","last_fullsized":"2024-09-10T08:32:26.280007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:52.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158308+0000","last_change":"2024-09-10T08:32:24.157040+0000","last_active":"2024-09-10T08:32:24.158308+0000","last_peered":"2024-09-10T08:32:24.158308+0000","last_clean":"2024-09-10T08:32:24.158308+0000","last_became_active":"2024-09-10T08:32:24.156709+0000","last_became_peered":"2024-09-10T08:32:24.156709+0000","last_unstale":"2024-09-10T08:32:24.158308+0000","last_undegraded":"2024-09-10T08:32:24.158308+0000","last_fullsized":"2024-09-10T08:32:24.158308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:06.117270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142949+0000","last_change":"2024-09-10T08:32:24.142949+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142949+0000","last_undegraded":"2024-09-10T08:32:24.142949+0000","last_fullsized":"2024-09-10T08:32:24.142949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280122+0000","last_change":"2024-09-10T08:32:24.158256+0000","last_active":"2024-09-10T08:32:26.280122+0000","last_peered":"2024-09-10T08:32:26.280122+0000","last_clean":"2024-09-10T08:32:26.280122+0000","last_became_active":"2024-09-10T08:32:24.157987+0000","last_became_peered":"2024-09-10T08:32:24.157987+0000","last_unstale":"2024-09-10T08:32:26.280122+0000","last_undegraded":"2024-09-10T08:32:26.280122+0000","last_fullsized":"2024-09-10T08:32:26.280122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.320171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280286+0000","last_change":"2024-09-10T08:32:25.170475+0000","last_active":"2024-09-10T08:32:26.280286+0000","last_peered":"2024-09-10T08:32:26.280286+0000","last_clean":"2024-09-10T08:32:26.280286+0000","last_became_active":"2024-09-10T08:32:25.170160+0000","last_became_peered":"2024-09-10T08:32:25.170160+0000","last_unstale":"2024-09-10T08:32:26.280286+0000","last_undegraded":"2024-09-10T08:32:26.280286+0000","last_fullsized":"2024-09-10T08:32:26.280286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:38.003307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.164787+0000","last_change":"2024-09-10T08:32:24.159632+0000","last_active":"2024-09-10T08:32:24.164787+0000","last_peered":"2024-09-10T08:32:24.164787+0000","last_clean":"2024-09-10T08:32:24.164787+0000","last_became_active":"2024-09-10T08:32:24.158831+0000","last_became_peered":"2024-09-10T08:32:24.158831+0000","last_unstale":"2024-09-10T08:32:24.164787+0000","last_undegraded":"2024-09-10T08:32:24.164787+0000","last_fullsized":"2024-09-10T08:32:24.164787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.150316+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:32:24.150316+0000","last_peered":"2024-09-10T08:32:24.150316+0000","last_clean":"2024-09-10T08:32:24.150316+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:32:24.150316+0000","last_undegraded":"2024-09-10T08:32:24.150316+0000","last_fullsized":"2024-09-10T08:32:24.150316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1294336,"data_stored":878953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":892062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:32:29.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:32:30.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.022+0000 7f39dfe00640 1 Processor -- start 2024-09-10T08:32:30.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.022+0000 7f39dfe00640 1 -- start start 2024-09-10T08:32:30.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f39e00cf450 0x7f39e00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dfe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e00d3990 con 0x7f39e015e440 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dfe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e00d3c70 con 0x7f39e00b6710 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f39e00d3f50 con 0x7f39e00cf450 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dea00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f39e015e440 0x7f39e00b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49632/0 (socket says 172.21.15.52:49632) 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39dea00640 1 -- 172.21.15.52:0/3946941893 learned_addr learned my addr 172.21.15.52:0/3946941893 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.023+0000 7f39df400640 1 --2- 172.21.15.52:0/3946941893 >> v2:172.21.15.52:3300/0 conn(0x7f39e00cf450 0x7f39e00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933374529 0 0) 0x7f39e00d3990 con 0x7f39e015e440 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39c4003520 con 0x7f39e015e440 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39df400640 1 -- 172.21.15.52:0/3946941893 >> v1:172.21.15.176:6789/0 conn(0x7f39e00b6710 legacy=0x7f39e00b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745963555 0 0) 0x7f39e00d3c70 con 0x7f39e00b6710 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39df400640 1 -- 172.21.15.52:0/3946941893 >> v1:172.21.15.52:6789/0 conn(0x7f39e015e440 legacy=0x7f39e00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.024+0000 7f39df400640 1 -- 172.21.15.52:0/3946941893 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e00d4230 con 0x7f39e00cf450 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.025+0000 7f39df400640 1 --2- 172.21.15.52:0/3946941893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00cf450 0x7f39e00d3240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009d90 tx=0x7f39d802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0149e00b2d5a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.025+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8037070 con 0x7f39e00cf450 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.025+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8007740 con 0x7f39e00cf450 2024-09-10T08:32:30.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.025+0000 7f39dd600640 1 -- 172.21.15.52:0/3946941893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007af0 con 0x7f39e00cf450 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 -- 172.21.15.52:0/3946941893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00cf450 msgr2=0x7f39e00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 --2- 172.21.15.52:0/3946941893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00cf450 0x7f39e00d3240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009d90 tx=0x7f39d802a780 comp rx=0 tx=0).stop 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 -- 172.21.15.52:0/3946941893 shutdown_connections 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 --2- 172.21.15.52:0/3946941893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00cf450 0x7f39e00d3240 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 -- 172.21.15.52:0/3946941893 >> 172.21.15.52:0/3946941893 conn(0x7f39e0067f80 msgr2=0x7f39e00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:30.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 -- 172.21.15.52:0/3946941893 shutdown_connections 2024-09-10T08:32:30.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.026+0000 7f39dfe00640 1 -- 172.21.15.52:0/3946941893 wait complete. 2024-09-10T08:32:30.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.028+0000 7f39dfe00640 1 Processor -- start 2024-09-10T08:32:30.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.028+0000 7f39dfe00640 1 -- start start 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39e00cf450 0x7f39e0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39e015e440 0x7f39e0150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39e00b76c0 con 0x7f39e00b6710 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39e00b7540 con 0x7f39e015e440 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39e00b8270 con 0x7f39e00cf450 2024-09-10T08:32:30.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44646/0 (socket says 172.21.15.52:44646) 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 -- 172.21.15.52:0/780318642 learned_addr learned my addr 172.21.15.52:0/780318642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 -- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39e00cf450 msgr2=0x7f39e0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39e00cf450 0x7f39e0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 -- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39e015e440 msgr2=0x7f39e0150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39e015e440 0x7f39e0150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 -- 172.21.15.52:0/780318642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e00b1c20 con 0x7f39e00b6710 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.029+0000 7f39dea00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c390 tx=0x7f39d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.030+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0017070 con 0x7f39e00b6710 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.030+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d0005ce0 con 0x7f39e00b6710 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.030+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e00b1f00 con 0x7f39e00b6710 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.030+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d00072f0 con 0x7f39e00b6710 2024-09-10T08:32:30.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.030+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e00b24c0 con 0x7f39e00b6710 2024-09-10T08:32:30.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.031+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e00d3240 con 0x7f39e00b6710 2024-09-10T08:32:30.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.032+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39d001a070 con 0x7f39e00b6710 2024-09-10T08:32:30.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.033+0000 7f39d7400640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.033+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f39d008a260 con 0x7f39e00b6710 2024-09-10T08:32:30.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.033+0000 7f39de000640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.034+0000 7f39de000640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 0x7f39c006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39e01f7320 tx=0x7f39cc007910 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.037+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39d0058c10 con 0x7f39e00b6710 2024-09-10T08:32:30.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.219+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39e0069b20 con 0x7f39c006be30 2024-09-10T08:32:30.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.226+0000 7f39d7400640 1 -- 172.21.15.52:0/780318642 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247551 (secure 0 0 0) 0x7f39e0069b20 con 0x7f39c006be30 2024-09-10T08:32:30.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:30.230 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:32:30.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 msgr2=0x7f39c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 0x7f39c006e2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39e01f7320 tx=0x7f39cc007910 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 msgr2=0x7f39e00d47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c390 tx=0x7f39d000c850 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 shutdown_connections 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39c006be30 0x7f39c006e2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f39e015e440 0x7f39e0150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39e00cf450 0x7f39e0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 --2- 172.21.15.52:0/780318642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39e00b6710 0x7f39e00d47f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 >> 172.21.15.52:0/780318642 conn(0x7f39e0067f80 msgr2=0x7f39e015aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 shutdown_connections 2024-09-10T08:32:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.230+0000 7f39dfe00640 1 -- 172.21.15.52:0/780318642 wait complete. 2024-09-10T08:32:30.247 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-10T08:32:29.508577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310268,"kb_used_data":6660,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754664452,"statfs":{"total":773094113280,"available":772776398848,"internally_reserved":0,"allocated":6819840,"data_stored":3502525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001710"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146826+0000","last_change":"2024-09-10T08:32:24.146826+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146826+0000","last_undegraded":"2024-09-10T08:32:24.146826+0000","last_fullsized":"2024-09-10T08:32:24.146826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147327+0000","last_change":"2024-09-10T08:32:24.147327+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147327+0000","last_undegraded":"2024-09-10T08:32:24.147327+0000","last_fullsized":"2024-09-10T08:32:24.147327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148389+0000","last_change":"2024-09-10T08:32:24.148389+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148389+0000","last_undegraded":"2024-09-10T08:32:24.148389+0000","last_fullsized":"2024-09-10T08:32:24.148389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147174+0000","last_change":"2024-09-10T08:32:24.147174+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147174+0000","last_undegraded":"2024-09-10T08:32:24.147174+0000","last_fullsized":"2024-09-10T08:32:24.147174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145509+0000","last_change":"2024-09-10T08:32:24.145509+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145509+0000","last_undegraded":"2024-09-10T08:32:24.145509+0000","last_fullsized":"2024-09-10T08:32:24.145509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143813+0000","last_change":"2024-09-10T08:32:24.143813+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143813+0000","last_undegraded":"2024-09-10T08:32:24.143813+0000","last_fullsized":"2024-09-10T08:32:24.143813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147570+0000","last_change":"2024-09-10T08:32:24.147570+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147570+0000","last_undegraded":"2024-09-10T08:32:24.147570+0000","last_fullsized":"2024-09-10T08:32:24.147570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279852+0000","last_change":"2024-09-10T08:32:25.163263+0000","last_active":"2024-09-10T08:32:26.279852+0000","last_peered":"2024-09-10T08:32:26.279852+0000","last_clean":"2024-09-10T08:32:26.279852+0000","last_became_active":"2024-09-10T08:32:25.162949+0000","last_became_peered":"2024-09-10T08:32:25.162949+0000","last_unstale":"2024-09-10T08:32:26.279852+0000","last_undegraded":"2024-09-10T08:32:26.279852+0000","last_fullsized":"2024-09-10T08:32:26.279852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:01.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152102+0000","last_change":"2024-09-10T08:32:24.152102+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152102+0000","last_undegraded":"2024-09-10T08:32:24.152102+0000","last_fullsized":"2024-09-10T08:32:24.152102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146849+0000","last_change":"2024-09-10T08:32:24.146849+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146849+0000","last_undegraded":"2024-09-10T08:32:24.146849+0000","last_fullsized":"2024-09-10T08:32:24.146849+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151172+0000","last_change":"2024-09-10T08:32:24.151172+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151172+0000","last_undegraded":"2024-09-10T08:32:24.151172+0000","last_fullsized":"2024-09-10T08:32:24.151172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150648+0000","last_change":"2024-09-10T08:32:24.150648+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150648+0000","last_undegraded":"2024-09-10T08:32:24.150648+0000","last_fullsized":"2024-09-10T08:32:24.150648+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149466+0000","last_change":"2024-09-10T08:32:24.149466+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149466+0000","last_undegraded":"2024-09-10T08:32:24.149466+0000","last_fullsized":"2024-09-10T08:32:24.149466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150210+0000","last_change":"2024-09-10T08:32:24.150210+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150210+0000","last_undegraded":"2024-09-10T08:32:24.150210+0000","last_fullsized":"2024-09-10T08:32:24.150210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.153251+0000","last_change":"2024-09-10T08:32:24.153251+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.153251+0000","last_undegraded":"2024-09-10T08:32:24.153251+0000","last_fullsized":"2024-09-10T08:32:24.153251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142415+0000","last_change":"2024-09-10T08:32:24.142415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142415+0000","last_undegraded":"2024-09-10T08:32:24.142415+0000","last_fullsized":"2024-09-10T08:32:24.142415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146382+0000","last_change":"2024-09-10T08:32:24.146382+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146382+0000","last_undegraded":"2024-09-10T08:32:24.146382+0000","last_fullsized":"2024-09-10T08:32:24.146382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148176+0000","last_change":"2024-09-10T08:32:24.148176+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148176+0000","last_undegraded":"2024-09-10T08:32:24.148176+0000","last_fullsized":"2024-09-10T08:32:24.148176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145415+0000","last_change":"2024-09-10T08:32:24.145415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145415+0000","last_undegraded":"2024-09-10T08:32:24.145415+0000","last_fullsized":"2024-09-10T08:32:24.145415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150734+0000","last_change":"2024-09-10T08:32:24.150734+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150734+0000","last_undegraded":"2024-09-10T08:32:24.150734+0000","last_fullsized":"2024-09-10T08:32:24.150734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149043+0000","last_change":"2024-09-10T08:32:24.149043+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149043+0000","last_undegraded":"2024-09-10T08:32:24.149043+0000","last_fullsized":"2024-09-10T08:32:24.149043+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150302+0000","last_change":"2024-09-10T08:32:24.150302+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150302+0000","last_undegraded":"2024-09-10T08:32:24.150302+0000","last_fullsized":"2024-09-10T08:32:24.150302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146846+0000","last_change":"2024-09-10T08:32:24.146846+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146846+0000","last_undegraded":"2024-09-10T08:32:24.146846+0000","last_fullsized":"2024-09-10T08:32:24.146846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150089+0000","last_change":"2024-09-10T08:32:24.150089+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150089+0000","last_undegraded":"2024-09-10T08:32:24.150089+0000","last_fullsized":"2024-09-10T08:32:24.150089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148618+0000","last_change":"2024-09-10T08:32:24.148618+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148618+0000","last_undegraded":"2024-09-10T08:32:24.148618+0000","last_fullsized":"2024-09-10T08:32:24.148618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151779+0000","last_change":"2024-09-10T08:32:24.151779+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151779+0000","last_undegraded":"2024-09-10T08:32:24.151779+0000","last_fullsized":"2024-09-10T08:32:24.151779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144995+0000","last_change":"2024-09-10T08:32:24.144995+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144995+0000","last_undegraded":"2024-09-10T08:32:24.144995+0000","last_fullsized":"2024-09-10T08:32:24.144995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280476+0000","last_change":"2024-09-10T08:32:25.165304+0000","last_active":"2024-09-10T08:32:26.280476+0000","last_peered":"2024-09-10T08:32:26.280476+0000","last_clean":"2024-09-10T08:32:26.280476+0000","last_became_active":"2024-09-10T08:32:25.164955+0000","last_became_peered":"2024-09-10T08:32:25.164955+0000","last_unstale":"2024-09-10T08:32:26.280476+0000","last_undegraded":"2024-09-10T08:32:26.280476+0000","last_fullsized":"2024-09-10T08:32:26.280476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:06.512577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280552+0000","last_change":"2024-09-10T08:32:25.171501+0000","last_active":"2024-09-10T08:32:26.280552+0000","last_peered":"2024-09-10T08:32:26.280552+0000","last_clean":"2024-09-10T08:32:26.280552+0000","last_became_active":"2024-09-10T08:32:25.170830+0000","last_became_peered":"2024-09-10T08:32:25.170830+0000","last_unstale":"2024-09-10T08:32:26.280552+0000","last_undegraded":"2024-09-10T08:32:26.280552+0000","last_fullsized":"2024-09-10T08:32:26.280552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:30.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146828+0000","last_change":"2024-09-10T08:32:24.146828+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146828+0000","last_undegraded":"2024-09-10T08:32:24.146828+0000","last_fullsized":"2024-09-10T08:32:24.146828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143407+0000","last_change":"2024-09-10T08:32:24.143407+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143407+0000","last_undegraded":"2024-09-10T08:32:24.143407+0000","last_fullsized":"2024-09-10T08:32:24.143407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147539+0000","last_change":"2024-09-10T08:32:24.147539+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147539+0000","last_undegraded":"2024-09-10T08:32:24.147539+0000","last_fullsized":"2024-09-10T08:32:24.147539+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146388+0000","last_change":"2024-09-10T08:32:24.146388+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146388+0000","last_undegraded":"2024-09-10T08:32:24.146388+0000","last_fullsized":"2024-09-10T08:32:24.146388+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163798+0000","last_change":"2024-09-10T08:32:24.162104+0000","last_active":"2024-09-10T08:32:24.163798+0000","last_peered":"2024-09-10T08:32:24.163798+0000","last_clean":"2024-09-10T08:32:24.163798+0000","last_became_active":"2024-09-10T08:32:24.160974+0000","last_became_peered":"2024-09-10T08:32:24.160974+0000","last_unstale":"2024-09-10T08:32:24.163798+0000","last_undegraded":"2024-09-10T08:32:24.163798+0000","last_fullsized":"2024-09-10T08:32:24.163798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:24.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145961+0000","last_change":"2024-09-10T08:32:24.145961+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145961+0000","last_undegraded":"2024-09-10T08:32:24.145961+0000","last_fullsized":"2024-09-10T08:32:24.145961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166236+0000","last_change":"2024-09-10T08:32:24.165316+0000","last_active":"2024-09-10T08:32:24.166236+0000","last_peered":"2024-09-10T08:32:24.166236+0000","last_clean":"2024-09-10T08:32:24.166236+0000","last_became_active":"2024-09-10T08:32:24.165042+0000","last_became_peered":"2024-09-10T08:32:24.165042+0000","last_unstale":"2024-09-10T08:32:24.166236+0000","last_undegraded":"2024-09-10T08:32:24.166236+0000","last_fullsized":"2024-09-10T08:32:24.166236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:05.022458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280575+0000","last_change":"2024-09-10T08:32:25.178616+0000","last_active":"2024-09-10T08:32:26.280575+0000","last_peered":"2024-09-10T08:32:26.280575+0000","last_clean":"2024-09-10T08:32:26.280575+0000","last_became_active":"2024-09-10T08:32:25.178160+0000","last_became_peered":"2024-09-10T08:32:25.178160+0000","last_unstale":"2024-09-10T08:32:26.280575+0000","last_undegraded":"2024-09-10T08:32:26.280575+0000","last_fullsized":"2024-09-10T08:32:26.280575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:34.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163350+0000","last_change":"2024-09-10T08:32:24.159693+0000","last_active":"2024-09-10T08:32:24.163350+0000","last_peered":"2024-09-10T08:32:24.163350+0000","last_clean":"2024-09-10T08:32:24.163350+0000","last_became_active":"2024-09-10T08:32:24.159350+0000","last_became_peered":"2024-09-10T08:32:24.159350+0000","last_unstale":"2024-09-10T08:32:24.163350+0000","last_undegraded":"2024-09-10T08:32:24.163350+0000","last_fullsized":"2024-09-10T08:32:24.163350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:38.383683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145252+0000","last_change":"2024-09-10T08:32:24.145252+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145252+0000","last_undegraded":"2024-09-10T08:32:24.145252+0000","last_fullsized":"2024-09-10T08:32:24.145252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158485+0000","last_change":"2024-09-10T08:32:24.154313+0000","last_active":"2024-09-10T08:32:24.158485+0000","last_peered":"2024-09-10T08:32:24.158485+0000","last_clean":"2024-09-10T08:32:24.158485+0000","last_became_active":"2024-09-10T08:32:24.153991+0000","last_became_peered":"2024-09-10T08:32:24.153991+0000","last_unstale":"2024-09-10T08:32:24.158485+0000","last_undegraded":"2024-09-10T08:32:24.158485+0000","last_fullsized":"2024-09-10T08:32:24.158485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:29.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280650+0000","last_change":"2024-09-10T08:32:25.169611+0000","last_active":"2024-09-10T08:32:26.280650+0000","last_peered":"2024-09-10T08:32:26.280650+0000","last_clean":"2024-09-10T08:32:26.280650+0000","last_became_active":"2024-09-10T08:32:25.160291+0000","last_became_peered":"2024-09-10T08:32:25.160291+0000","last_unstale":"2024-09-10T08:32:26.280650+0000","last_undegraded":"2024-09-10T08:32:26.280650+0000","last_fullsized":"2024-09-10T08:32:26.280650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:13.177652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163986+0000","last_change":"2024-09-10T08:32:24.159316+0000","last_active":"2024-09-10T08:32:24.163986+0000","last_peered":"2024-09-10T08:32:24.163986+0000","last_clean":"2024-09-10T08:32:24.163986+0000","last_became_active":"2024-09-10T08:32:24.159005+0000","last_became_peered":"2024-09-10T08:32:24.159005+0000","last_unstale":"2024-09-10T08:32:24.163986+0000","last_undegraded":"2024-09-10T08:32:24.163986+0000","last_fullsized":"2024-09-10T08:32:24.163986+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.167399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152285+0000","last_change":"2024-09-10T08:32:24.152285+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152285+0000","last_undegraded":"2024-09-10T08:32:24.152285+0000","last_fullsized":"2024-09-10T08:32:24.152285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.157267+0000","last_change":"2024-09-10T08:32:24.154485+0000","last_active":"2024-09-10T08:32:24.157267+0000","last_peered":"2024-09-10T08:32:24.157267+0000","last_clean":"2024-09-10T08:32:24.157267+0000","last_became_active":"2024-09-10T08:32:24.154218+0000","last_became_peered":"2024-09-10T08:32:24.154218+0000","last_unstale":"2024-09-10T08:32:24.157267+0000","last_undegraded":"2024-09-10T08:32:24.157267+0000","last_fullsized":"2024-09-10T08:32:24.157267+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:48.551576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147721+0000","last_change":"2024-09-10T08:32:24.147721+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147721+0000","last_undegraded":"2024-09-10T08:32:24.147721+0000","last_fullsized":"2024-09-10T08:32:24.147721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167113+0000","last_change":"2024-09-10T08:32:24.165574+0000","last_active":"2024-09-10T08:32:24.167113+0000","last_peered":"2024-09-10T08:32:24.167113+0000","last_clean":"2024-09-10T08:32:24.167113+0000","last_became_active":"2024-09-10T08:32:24.165300+0000","last_became_peered":"2024-09-10T08:32:24.165300+0000","last_unstale":"2024-09-10T08:32:24.167113+0000","last_undegraded":"2024-09-10T08:32:24.167113+0000","last_fullsized":"2024-09-10T08:32:24.167113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142512+0000","last_change":"2024-09-10T08:32:24.142512+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142512+0000","last_undegraded":"2024-09-10T08:32:24.142512+0000","last_fullsized":"2024-09-10T08:32:24.142512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166052+0000","last_change":"2024-09-10T08:32:24.163403+0000","last_active":"2024-09-10T08:32:24.166052+0000","last_peered":"2024-09-10T08:32:24.166052+0000","last_clean":"2024-09-10T08:32:24.166052+0000","last_became_active":"2024-09-10T08:32:24.162449+0000","last_became_peered":"2024-09-10T08:32:24.162449+0000","last_unstale":"2024-09-10T08:32:24.166052+0000","last_undegraded":"2024-09-10T08:32:24.166052+0000","last_fullsized":"2024-09-10T08:32:24.166052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:02.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151339+0000","last_change":"2024-09-10T08:32:24.151339+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151339+0000","last_undegraded":"2024-09-10T08:32:24.151339+0000","last_fullsized":"2024-09-10T08:32:24.151339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163796+0000","last_change":"2024-09-10T08:32:24.163145+0000","last_active":"2024-09-10T08:32:24.163796+0000","last_peered":"2024-09-10T08:32:24.163796+0000","last_clean":"2024-09-10T08:32:24.163796+0000","last_became_active":"2024-09-10T08:32:24.162835+0000","last_became_peered":"2024-09-10T08:32:24.162835+0000","last_unstale":"2024-09-10T08:32:24.163796+0000","last_undegraded":"2024-09-10T08:32:24.163796+0000","last_fullsized":"2024-09-10T08:32:24.163796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150987+0000","last_change":"2024-09-10T08:32:24.150987+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150987+0000","last_undegraded":"2024-09-10T08:32:24.150987+0000","last_fullsized":"2024-09-10T08:32:24.150987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280688+0000","last_change":"2024-09-10T08:32:24.161471+0000","last_active":"2024-09-10T08:32:26.280688+0000","last_peered":"2024-09-10T08:32:26.280688+0000","last_clean":"2024-09-10T08:32:26.280688+0000","last_became_active":"2024-09-10T08:32:24.160009+0000","last_became_peered":"2024-09-10T08:32:24.160009+0000","last_unstale":"2024-09-10T08:32:26.280688+0000","last_undegraded":"2024-09-10T08:32:26.280688+0000","last_fullsized":"2024-09-10T08:32:26.280688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:02.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280817+0000","last_change":"2024-09-10T08:32:25.178400+0000","last_active":"2024-09-10T08:32:26.280817+0000","last_peered":"2024-09-10T08:32:26.280817+0000","last_clean":"2024-09-10T08:32:26.280817+0000","last_became_active":"2024-09-10T08:32:25.177837+0000","last_became_peered":"2024-09-10T08:32:25.177837+0000","last_unstale":"2024-09-10T08:32:26.280817+0000","last_undegraded":"2024-09-10T08:32:26.280817+0000","last_fullsized":"2024-09-10T08:32:26.280817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.029416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161981+0000","last_change":"2024-09-10T08:32:24.156801+0000","last_active":"2024-09-10T08:32:24.161981+0000","last_peered":"2024-09-10T08:32:24.161981+0000","last_clean":"2024-09-10T08:32:24.161981+0000","last_became_active":"2024-09-10T08:32:24.156520+0000","last_became_peered":"2024-09-10T08:32:24.156520+0000","last_unstale":"2024-09-10T08:32:24.161981+0000","last_undegraded":"2024-09-10T08:32:24.161981+0000","last_fullsized":"2024-09-10T08:32:24.161981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:36.232352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148838+0000","last_change":"2024-09-10T08:32:24.148838+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148838+0000","last_undegraded":"2024-09-10T08:32:24.148838+0000","last_fullsized":"2024-09-10T08:32:24.148838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167980+0000","last_change":"2024-09-10T08:32:24.166153+0000","last_active":"2024-09-10T08:32:24.167980+0000","last_peered":"2024-09-10T08:32:24.167980+0000","last_clean":"2024-09-10T08:32:24.167980+0000","last_became_active":"2024-09-10T08:32:24.165858+0000","last_became_peered":"2024-09-10T08:32:24.165858+0000","last_unstale":"2024-09-10T08:32:24.167980+0000","last_undegraded":"2024-09-10T08:32:24.167980+0000","last_fullsized":"2024-09-10T08:32:24.167980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:55.441531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151031+0000","last_change":"2024-09-10T08:32:24.151031+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151031+0000","last_undegraded":"2024-09-10T08:32:24.151031+0000","last_fullsized":"2024-09-10T08:32:24.151031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280775+0000","last_change":"2024-09-10T08:32:24.159349+0000","last_active":"2024-09-10T08:32:26.280775+0000","last_peered":"2024-09-10T08:32:26.280775+0000","last_clean":"2024-09-10T08:32:26.280775+0000","last_became_active":"2024-09-10T08:32:24.159072+0000","last_became_peered":"2024-09-10T08:32:24.159072+0000","last_unstale":"2024-09-10T08:32:26.280775+0000","last_undegraded":"2024-09-10T08:32:26.280775+0000","last_fullsized":"2024-09-10T08:32:26.280775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.680184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151395+0000","last_change":"2024-09-10T08:32:24.151395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151395+0000","last_undegraded":"2024-09-10T08:32:24.151395+0000","last_fullsized":"2024-09-10T08:32:24.151395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160522+0000","last_change":"2024-09-10T08:32:24.159347+0000","last_active":"2024-09-10T08:32:24.160522+0000","last_peered":"2024-09-10T08:32:24.160522+0000","last_clean":"2024-09-10T08:32:24.160522+0000","last_became_active":"2024-09-10T08:32:24.158536+0000","last_became_peered":"2024-09-10T08:32:24.158536+0000","last_unstale":"2024-09-10T08:32:24.160522+0000","last_undegraded":"2024-09-10T08:32:24.160522+0000","last_fullsized":"2024-09-10T08:32:24.160522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:08.950585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149626+0000","last_change":"2024-09-10T08:32:24.149626+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149626+0000","last_undegraded":"2024-09-10T08:32:24.149626+0000","last_fullsized":"2024-09-10T08:32:24.149626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.159168+0000","last_change":"2024-09-10T08:32:24.155976+0000","last_active":"2024-09-10T08:32:24.159168+0000","last_peered":"2024-09-10T08:32:24.159168+0000","last_clean":"2024-09-10T08:32:24.159168+0000","last_became_active":"2024-09-10T08:32:24.155662+0000","last_became_peered":"2024-09-10T08:32:24.155662+0000","last_unstale":"2024-09-10T08:32:24.159168+0000","last_undegraded":"2024-09-10T08:32:24.159168+0000","last_fullsized":"2024-09-10T08:32:24.159168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:54.341281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146404+0000","last_change":"2024-09-10T08:32:24.146404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146404+0000","last_undegraded":"2024-09-10T08:32:24.146404+0000","last_fullsized":"2024-09-10T08:32:24.146404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163615+0000","last_change":"2024-09-10T08:32:24.161542+0000","last_active":"2024-09-10T08:32:24.163615+0000","last_peered":"2024-09-10T08:32:24.163615+0000","last_clean":"2024-09-10T08:32:24.163615+0000","last_became_active":"2024-09-10T08:32:24.161209+0000","last_became_peered":"2024-09-10T08:32:24.161209+0000","last_unstale":"2024-09-10T08:32:24.163615+0000","last_undegraded":"2024-09-10T08:32:24.163615+0000","last_fullsized":"2024-09-10T08:32:24.163615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:26.653099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147702+0000","last_change":"2024-09-10T08:32:24.147702+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147702+0000","last_undegraded":"2024-09-10T08:32:24.147702+0000","last_fullsized":"2024-09-10T08:32:24.147702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163888+0000","last_change":"2024-09-10T08:32:24.160497+0000","last_active":"2024-09-10T08:32:24.163888+0000","last_peered":"2024-09-10T08:32:24.163888+0000","last_clean":"2024-09-10T08:32:24.163888+0000","last_became_active":"2024-09-10T08:32:24.160209+0000","last_became_peered":"2024-09-10T08:32:24.160209+0000","last_unstale":"2024-09-10T08:32:24.163888+0000","last_undegraded":"2024-09-10T08:32:24.163888+0000","last_fullsized":"2024-09-10T08:32:24.163888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150523+0000","last_change":"2024-09-10T08:32:24.150523+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150523+0000","last_undegraded":"2024-09-10T08:32:24.150523+0000","last_fullsized":"2024-09-10T08:32:24.150523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158627+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158081+0000","last_became_peered":"2024-09-10T08:32:24.158081+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:59.562165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144404+0000","last_change":"2024-09-10T08:32:24.144404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144404+0000","last_undegraded":"2024-09-10T08:32:24.144404+0000","last_fullsized":"2024-09-10T08:32:24.144404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163655+0000","last_change":"2024-09-10T08:32:24.161818+0000","last_active":"2024-09-10T08:32:24.163655+0000","last_peered":"2024-09-10T08:32:24.163655+0000","last_clean":"2024-09-10T08:32:24.163655+0000","last_became_active":"2024-09-10T08:32:24.161093+0000","last_became_peered":"2024-09-10T08:32:24.161093+0000","last_unstale":"2024-09-10T08:32:24.163655+0000","last_undegraded":"2024-09-10T08:32:24.163655+0000","last_fullsized":"2024-09-10T08:32:24.163655+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:17.486040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148438+0000","last_change":"2024-09-10T08:32:24.148438+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148438+0000","last_undegraded":"2024-09-10T08:32:24.148438+0000","last_fullsized":"2024-09-10T08:32:24.148438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158676+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158391+0000","last_became_peered":"2024-09-10T08:32:24.158391+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.081154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150610+0000","last_change":"2024-09-10T08:32:24.150610+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150610+0000","last_undegraded":"2024-09-10T08:32:24.150610+0000","last_fullsized":"2024-09-10T08:32:24.150610+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166462+0000","last_change":"2024-09-10T08:32:24.165473+0000","last_active":"2024-09-10T08:32:24.166462+0000","last_peered":"2024-09-10T08:32:24.166462+0000","last_clean":"2024-09-10T08:32:24.166462+0000","last_became_active":"2024-09-10T08:32:24.165182+0000","last_became_peered":"2024-09-10T08:32:24.165182+0000","last_unstale":"2024-09-10T08:32:24.166462+0000","last_undegraded":"2024-09-10T08:32:24.166462+0000","last_fullsized":"2024-09-10T08:32:24.166462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:17.760809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280601+0000","last_change":"2024-09-10T08:32:25.171746+0000","last_active":"2024-09-10T08:32:26.280601+0000","last_peered":"2024-09-10T08:32:26.280601+0000","last_clean":"2024-09-10T08:32:26.280601+0000","last_became_active":"2024-09-10T08:32:25.171207+0000","last_became_peered":"2024-09-10T08:32:25.171207+0000","last_unstale":"2024-09-10T08:32:26.280601+0000","last_undegraded":"2024-09-10T08:32:26.280601+0000","last_fullsized":"2024-09-10T08:32:26.280601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:36.297951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280394+0000","last_change":"2024-09-10T08:32:24.162270+0000","last_active":"2024-09-10T08:32:26.280394+0000","last_peered":"2024-09-10T08:32:26.280394+0000","last_clean":"2024-09-10T08:32:26.280394+0000","last_became_active":"2024-09-10T08:32:24.161849+0000","last_became_peered":"2024-09-10T08:32:24.161849+0000","last_unstale":"2024-09-10T08:32:26.280394+0000","last_undegraded":"2024-09-10T08:32:26.280394+0000","last_fullsized":"2024-09-10T08:32:26.280394+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:09.348585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280457+0000","last_change":"2024-09-10T08:32:25.176004+0000","last_active":"2024-09-10T08:32:26.280457+0000","last_peered":"2024-09-10T08:32:26.280457+0000","last_clean":"2024-09-10T08:32:26.280457+0000","last_became_active":"2024-09-10T08:32:25.175730+0000","last_became_peered":"2024-09-10T08:32:25.175730+0000","last_unstale":"2024-09-10T08:32:26.280457+0000","last_undegraded":"2024-09-10T08:32:26.280457+0000","last_fullsized":"2024-09-10T08:32:26.280457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160966+0000","last_change":"2024-09-10T08:32:24.159571+0000","last_active":"2024-09-10T08:32:24.160966+0000","last_peered":"2024-09-10T08:32:24.160966+0000","last_clean":"2024-09-10T08:32:24.160966+0000","last_became_active":"2024-09-10T08:32:24.159007+0000","last_became_peered":"2024-09-10T08:32:24.159007+0000","last_unstale":"2024-09-10T08:32:24.160966+0000","last_undegraded":"2024-09-10T08:32:24.160966+0000","last_fullsized":"2024-09-10T08:32:24.160966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.047855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145138+0000","last_change":"2024-09-10T08:32:24.145138+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145138+0000","last_undegraded":"2024-09-10T08:32:24.145138+0000","last_fullsized":"2024-09-10T08:32:24.145138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163295+0000","last_change":"2024-09-10T08:32:24.160317+0000","last_active":"2024-09-10T08:32:24.163295+0000","last_peered":"2024-09-10T08:32:24.163295+0000","last_clean":"2024-09-10T08:32:24.163295+0000","last_became_active":"2024-09-10T08:32:24.158842+0000","last_became_peered":"2024-09-10T08:32:24.158842+0000","last_unstale":"2024-09-10T08:32:24.163295+0000","last_undegraded":"2024-09-10T08:32:24.163295+0000","last_fullsized":"2024-09-10T08:32:24.163295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145158+0000","last_change":"2024-09-10T08:32:24.145158+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145158+0000","last_undegraded":"2024-09-10T08:32:24.145158+0000","last_fullsized":"2024-09-10T08:32:24.145158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166992+0000","last_change":"2024-09-10T08:32:24.166154+0000","last_active":"2024-09-10T08:32:24.166992+0000","last_peered":"2024-09-10T08:32:24.166992+0000","last_clean":"2024-09-10T08:32:24.166992+0000","last_became_active":"2024-09-10T08:32:24.165827+0000","last_became_peered":"2024-09-10T08:32:24.165827+0000","last_unstale":"2024-09-10T08:32:24.166992+0000","last_undegraded":"2024-09-10T08:32:24.166992+0000","last_fullsized":"2024-09-10T08:32:24.166992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:44.608981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143970+0000","last_change":"2024-09-10T08:32:24.143970+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143970+0000","last_undegraded":"2024-09-10T08:32:24.143970+0000","last_fullsized":"2024-09-10T08:32:24.143970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.168179+0000","last_change":"2024-09-10T08:32:24.167261+0000","last_active":"2024-09-10T08:32:24.168179+0000","last_peered":"2024-09-10T08:32:24.168179+0000","last_clean":"2024-09-10T08:32:24.168179+0000","last_became_active":"2024-09-10T08:32:24.166919+0000","last_became_peered":"2024-09-10T08:32:24.166919+0000","last_unstale":"2024-09-10T08:32:24.168179+0000","last_undegraded":"2024-09-10T08:32:24.168179+0000","last_fullsized":"2024-09-10T08:32:24.168179+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280868+0000","last_change":"2024-09-10T08:32:25.161153+0000","last_active":"2024-09-10T08:32:26.280868+0000","last_peered":"2024-09-10T08:32:26.280868+0000","last_clean":"2024-09-10T08:32:26.280868+0000","last_became_active":"2024-09-10T08:32:25.160777+0000","last_became_peered":"2024-09-10T08:32:25.160777+0000","last_unstale":"2024-09-10T08:32:26.280868+0000","last_undegraded":"2024-09-10T08:32:26.280868+0000","last_fullsized":"2024-09-10T08:32:26.280868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:28.805917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161736+0000","last_change":"2024-09-10T08:32:24.155506+0000","last_active":"2024-09-10T08:32:24.161736+0000","last_peered":"2024-09-10T08:32:24.161736+0000","last_clean":"2024-09-10T08:32:24.161736+0000","last_became_active":"2024-09-10T08:32:24.154291+0000","last_became_peered":"2024-09-10T08:32:24.154291+0000","last_unstale":"2024-09-10T08:32:24.161736+0000","last_undegraded":"2024-09-10T08:32:24.161736+0000","last_fullsized":"2024-09-10T08:32:24.161736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:30.359702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143395+0000","last_change":"2024-09-10T08:32:24.143395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143395+0000","last_undegraded":"2024-09-10T08:32:24.143395+0000","last_fullsized":"2024-09-10T08:32:24.143395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158973+0000","last_change":"2024-09-10T08:32:24.154949+0000","last_active":"2024-09-10T08:32:24.158973+0000","last_peered":"2024-09-10T08:32:24.158973+0000","last_clean":"2024-09-10T08:32:24.158973+0000","last_became_active":"2024-09-10T08:32:24.153289+0000","last_became_peered":"2024-09-10T08:32:24.153289+0000","last_unstale":"2024-09-10T08:32:24.158973+0000","last_undegraded":"2024-09-10T08:32:24.158973+0000","last_fullsized":"2024-09-10T08:32:24.158973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148622+0000","last_change":"2024-09-10T08:32:24.148622+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148622+0000","last_undegraded":"2024-09-10T08:32:24.148622+0000","last_fullsized":"2024-09-10T08:32:24.148622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163882+0000","last_change":"2024-09-10T08:32:24.162218+0000","last_active":"2024-09-10T08:32:24.163882+0000","last_peered":"2024-09-10T08:32:24.163882+0000","last_clean":"2024-09-10T08:32:24.163882+0000","last_became_active":"2024-09-10T08:32:24.159383+0000","last_became_peered":"2024-09-10T08:32:24.159383+0000","last_unstale":"2024-09-10T08:32:24.163882+0000","last_undegraded":"2024-09-10T08:32:24.163882+0000","last_fullsized":"2024-09-10T08:32:24.163882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:02.720855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280007+0000","last_change":"2024-09-10T08:32:25.177447+0000","last_active":"2024-09-10T08:32:26.280007+0000","last_peered":"2024-09-10T08:32:26.280007+0000","last_clean":"2024-09-10T08:32:26.280007+0000","last_became_active":"2024-09-10T08:32:25.177118+0000","last_became_peered":"2024-09-10T08:32:25.177118+0000","last_unstale":"2024-09-10T08:32:26.280007+0000","last_undegraded":"2024-09-10T08:32:26.280007+0000","last_fullsized":"2024-09-10T08:32:26.280007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:52.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158308+0000","last_change":"2024-09-10T08:32:24.157040+0000","last_active":"2024-09-10T08:32:24.158308+0000","last_peered":"2024-09-10T08:32:24.158308+0000","last_clean":"2024-09-10T08:32:24.158308+0000","last_became_active":"2024-09-10T08:32:24.156709+0000","last_became_peered":"2024-09-10T08:32:24.156709+0000","last_unstale":"2024-09-10T08:32:24.158308+0000","last_undegraded":"2024-09-10T08:32:24.158308+0000","last_fullsized":"2024-09-10T08:32:24.158308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:06.117270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142949+0000","last_change":"2024-09-10T08:32:24.142949+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142949+0000","last_undegraded":"2024-09-10T08:32:24.142949+0000","last_fullsized":"2024-09-10T08:32:24.142949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280122+0000","last_change":"2024-09-10T08:32:24.158256+0000","last_active":"2024-09-10T08:32:26.280122+0000","last_peered":"2024-09-10T08:32:26.280122+0000","last_clean":"2024-09-10T08:32:26.280122+0000","last_became_active":"2024-09-10T08:32:24.157987+0000","last_became_peered":"2024-09-10T08:32:24.157987+0000","last_unstale":"2024-09-10T08:32:26.280122+0000","last_undegraded":"2024-09-10T08:32:26.280122+0000","last_fullsized":"2024-09-10T08:32:26.280122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.320171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280286+0000","last_change":"2024-09-10T08:32:25.170475+0000","last_active":"2024-09-10T08:32:26.280286+0000","last_peered":"2024-09-10T08:32:26.280286+0000","last_clean":"2024-09-10T08:32:26.280286+0000","last_became_active":"2024-09-10T08:32:25.170160+0000","last_became_peered":"2024-09-10T08:32:25.170160+0000","last_unstale":"2024-09-10T08:32:26.280286+0000","last_undegraded":"2024-09-10T08:32:26.280286+0000","last_fullsized":"2024-09-10T08:32:26.280286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:38.003307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.164787+0000","last_change":"2024-09-10T08:32:24.159632+0000","last_active":"2024-09-10T08:32:24.164787+0000","last_peered":"2024-09-10T08:32:24.164787+0000","last_clean":"2024-09-10T08:32:24.164787+0000","last_became_active":"2024-09-10T08:32:24.158831+0000","last_became_peered":"2024-09-10T08:32:24.158831+0000","last_unstale":"2024-09-10T08:32:24.164787+0000","last_undegraded":"2024-09-10T08:32:24.164787+0000","last_fullsized":"2024-09-10T08:32:24.164787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.150316+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:32:24.150316+0000","last_peered":"2024-09-10T08:32:24.150316+0000","last_clean":"2024-09-10T08:32:24.150316+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:32:24.150316+0000","last_undegraded":"2024-09-10T08:32:24.150316+0000","last_fullsized":"2024-09-10T08:32:24.150316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1294336,"data_stored":878953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":892062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:32:30.251 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-10T08:32:30.251 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146826+0000', 'last_change': '2024-09-10T08:32:24.146826+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146826+0000', 'last_undegraded': '2024-09-10T08:32:24.146826+0000', 'last_fullsized': '2024-09-10T08:32:24.146826+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147327+0000', 'last_change': '2024-09-10T08:32:24.147327+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147327+0000', 'last_undegraded': '2024-09-10T08:32:24.147327+0000', 'last_fullsized': '2024-09-10T08:32:24.147327+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148389+0000', 'last_change': '2024-09-10T08:32:24.148389+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148389+0000', 'last_undegraded': '2024-09-10T08:32:24.148389+0000', 'last_fullsized': '2024-09-10T08:32:24.148389+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147174+0000', 'last_change': '2024-09-10T08:32:24.147174+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147174+0000', 'last_undegraded': '2024-09-10T08:32:24.147174+0000', 'last_fullsized': '2024-09-10T08:32:24.147174+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145509+0000', 'last_change': '2024-09-10T08:32:24.145509+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145509+0000', 'last_undegraded': '2024-09-10T08:32:24.145509+0000', 'last_fullsized': '2024-09-10T08:32:24.145509+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.143813+0000', 'last_change': '2024-09-10T08:32:24.143813+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.143813+0000', 'last_undegraded': '2024-09-10T08:32:24.143813+0000', 'last_fullsized': '2024-09-10T08:32:24.143813+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.252 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147570+0000', 'last_change': '2024-09-10T08:32:24.147570+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147570+0000', 'last_undegraded': '2024-09-10T08:32:24.147570+0000', 'last_fullsized': '2024-09-10T08:32:24.147570+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.152102+0000', 'last_change': '2024-09-10T08:32:24.152102+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.152102+0000', 'last_undegraded': '2024-09-10T08:32:24.152102+0000', 'last_fullsized': '2024-09-10T08:32:24.152102+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146849+0000', 'last_change': '2024-09-10T08:32:24.146849+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146849+0000', 'last_undegraded': '2024-09-10T08:32:24.146849+0000', 'last_fullsized': '2024-09-10T08:32:24.146849+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.151172+0000', 'last_change': '2024-09-10T08:32:24.151172+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.151172+0000', 'last_undegraded': '2024-09-10T08:32:24.151172+0000', 'last_fullsized': '2024-09-10T08:32:24.151172+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150648+0000', 'last_change': '2024-09-10T08:32:24.150648+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150648+0000', 'last_undegraded': '2024-09-10T08:32:24.150648+0000', 'last_fullsized': '2024-09-10T08:32:24.150648+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-10T08:32:30.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.149466+0000', 'last_change': '2024-09-10T08:32:24.149466+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.149466+0000', 'last_undegraded': '2024-09-10T08:32:24.149466+0000', 'last_fullsized': '2024-09-10T08:32:24.149466+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150210+0000', 'last_change': '2024-09-10T08:32:24.150210+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150210+0000', 'last_undegraded': '2024-09-10T08:32:24.150210+0000', 'last_fullsized': '2024-09-10T08:32:24.150210+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.153251+0000', 'last_change': '2024-09-10T08:32:24.153251+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.153251+0000', 'last_undegraded': '2024-09-10T08:32:24.153251+0000', 'last_fullsized': '2024-09-10T08:32:24.153251+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.142415+0000', 'last_change': '2024-09-10T08:32:24.142415+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.142415+0000', 'last_undegraded': '2024-09-10T08:32:24.142415+0000', 'last_fullsized': '2024-09-10T08:32:24.142415+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146382+0000', 'last_change': '2024-09-10T08:32:24.146382+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146382+0000', 'last_undegraded': '2024-09-10T08:32:24.146382+0000', 'last_fullsized': '2024-09-10T08:32:24.146382+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148176+0000', 'last_change': '2024-09-10T08:32:24.148176+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148176+0000', 'last_undegraded': '2024-09-10T08:32:24.148176+0000', 'last_fullsized': '2024-09-10T08:32:24.148176+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.254 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145415+0000', 'last_change': '2024-09-10T08:32:24.145415+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145415+0000', 'last_undegraded': '2024-09-10T08:32:24.145415+0000', 'last_fullsized': '2024-09-10T08:32:24.145415+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150734+0000', 'last_change': '2024-09-10T08:32:24.150734+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150734+0000', 'last_undegraded': '2024-09-10T08:32:24.150734+0000', 'last_fullsized': '2024-09-10T08:32:24.150734+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.149043+0000', 'last_change': '2024-09-10T08:32:24.149043+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.149043+0000', 'last_undegraded': '2024-09-10T08:32:24.149043+0000', 'last_fullsized': '2024-09-10T08:32:24.149043+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150302+0000', 'last_change': '2024-09-10T08:32:24.150302+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150302+0000', 'last_undegraded': '2024-09-10T08:32:24.150302+0000', 'last_fullsized': '2024-09-10T08:32:24.150302+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146846+0000', 'last_change': '2024-09-10T08:32:24.146846+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146846+0000', 'last_undegraded': '2024-09-10T08:32:24.146846+0000', 'last_fullsized': '2024-09-10T08:32:24.146846+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-10T08:32:30.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150089+0000', 'last_change': '2024-09-10T08:32:24.150089+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150089+0000', 'last_undegraded': '2024-09-10T08:32:24.150089+0000', 'last_fullsized': '2024-09-10T08:32:24.150089+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148618+0000', 'last_change': '2024-09-10T08:32:24.148618+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148618+0000', 'last_undegraded': '2024-09-10T08:32:24.148618+0000', 'last_fullsized': '2024-09-10T08:32:24.148618+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.151779+0000', 'last_change': '2024-09-10T08:32:24.151779+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.151779+0000', 'last_undegraded': '2024-09-10T08:32:24.151779+0000', 'last_fullsized': '2024-09-10T08:32:24.151779+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.144995+0000', 'last_change': '2024-09-10T08:32:24.144995+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.144995+0000', 'last_undegraded': '2024-09-10T08:32:24.144995+0000', 'last_fullsized': '2024-09-10T08:32:24.144995+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146828+0000', 'last_change': '2024-09-10T08:32:24.146828+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146828+0000', 'last_undegraded': '2024-09-10T08:32:24.146828+0000', 'last_fullsized': '2024-09-10T08:32:24.146828+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.143407+0000', 'last_change': '2024-09-10T08:32:24.143407+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.143407+0000', 'last_undegraded': '2024-09-10T08:32:24.143407+0000', 'last_fullsized': '2024-09-10T08:32:24.143407+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-10T08:32:30.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147539+0000', 'last_change': '2024-09-10T08:32:24.147539+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147539+0000', 'last_undegraded': '2024-09-10T08:32:24.147539+0000', 'last_fullsized': '2024-09-10T08:32:24.147539+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146388+0000', 'last_change': '2024-09-10T08:32:24.146388+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146388+0000', 'last_undegraded': '2024-09-10T08:32:24.146388+0000', 'last_fullsized': '2024-09-10T08:32:24.146388+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145961+0000', 'last_change': '2024-09-10T08:32:24.145961+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145961+0000', 'last_undegraded': '2024-09-10T08:32:24.145961+0000', 'last_fullsized': '2024-09-10T08:32:24.145961+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145252+0000', 'last_change': '2024-09-10T08:32:24.145252+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145252+0000', 'last_undegraded': '2024-09-10T08:32:24.145252+0000', 'last_fullsized': '2024-09-10T08:32:24.145252+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.152285+0000', 'last_change': '2024-09-10T08:32:24.152285+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.152285+0000', 'last_undegraded': '2024-09-10T08:32:24.152285+0000', 'last_fullsized': '2024-09-10T08:32:24.152285+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147721+0000', 'last_change': '2024-09-10T08:32:24.147721+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147721+0000', 'last_undegraded': '2024-09-10T08:32:24.147721+0000', 'last_fullsized': '2024-09-10T08:32:24.147721+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.257 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.142512+0000', 'last_change': '2024-09-10T08:32:24.142512+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.142512+0000', 'last_undegraded': '2024-09-10T08:32:24.142512+0000', 'last_fullsized': '2024-09-10T08:32:24.142512+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.151339+0000', 'last_change': '2024-09-10T08:32:24.151339+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.151339+0000', 'last_undegraded': '2024-09-10T08:32:24.151339+0000', 'last_fullsized': '2024-09-10T08:32:24.151339+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150987+0000', 'last_change': '2024-09-10T08:32:24.150987+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150987+0000', 'last_undegraded': '2024-09-10T08:32:24.150987+0000', 'last_fullsized': '2024-09-10T08:32:24.150987+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148838+0000', 'last_change': '2024-09-10T08:32:24.148838+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148838+0000', 'last_undegraded': '2024-09-10T08:32:24.148838+0000', 'last_fullsized': '2024-09-10T08:32:24.148838+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.151031+0000', 'last_change': '2024-09-10T08:32:24.151031+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.151031+0000', 'last_undegraded': '2024-09-10T08:32:24.151031+0000', 'last_fullsized': '2024-09-10T08:32:24.151031+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.151395+0000', 'last_change': '2024-09-10T08:32:24.151395+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.151395+0000', 'last_undegraded': '2024-09-10T08:32:24.151395+0000', 'last_fullsized': '2024-09-10T08:32:24.151395+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.258 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.149626+0000', 'last_change': '2024-09-10T08:32:24.149626+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.149626+0000', 'last_undegraded': '2024-09-10T08:32:24.149626+0000', 'last_fullsized': '2024-09-10T08:32:24.149626+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.146404+0000', 'last_change': '2024-09-10T08:32:24.146404+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.146404+0000', 'last_undegraded': '2024-09-10T08:32:24.146404+0000', 'last_fullsized': '2024-09-10T08:32:24.146404+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.147702+0000', 'last_change': '2024-09-10T08:32:24.147702+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.147702+0000', 'last_undegraded': '2024-09-10T08:32:24.147702+0000', 'last_fullsized': '2024-09-10T08:32:24.147702+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150523+0000', 'last_change': '2024-09-10T08:32:24.150523+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150523+0000', 'last_undegraded': '2024-09-10T08:32:24.150523+0000', 'last_fullsized': '2024-09-10T08:32:24.150523+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.144404+0000', 'last_change': '2024-09-10T08:32:24.144404+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.144404+0000', 'last_undegraded': '2024-09-10T08:32:24.144404+0000', 'last_fullsized': '2024-09-10T08:32:24.144404+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-10T08:32:30.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148438+0000', 'last_change': '2024-09-10T08:32:24.148438+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148438+0000', 'last_undegraded': '2024-09-10T08:32:24.148438+0000', 'last_fullsized': '2024-09-10T08:32:24.148438+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.150610+0000', 'last_change': '2024-09-10T08:32:24.150610+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.150610+0000', 'last_undegraded': '2024-09-10T08:32:24.150610+0000', 'last_fullsized': '2024-09-10T08:32:24.150610+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145138+0000', 'last_change': '2024-09-10T08:32:24.145138+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145138+0000', 'last_undegraded': '2024-09-10T08:32:24.145138+0000', 'last_fullsized': '2024-09-10T08:32:24.145138+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.145158+0000', 'last_change': '2024-09-10T08:32:24.145158+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.145158+0000', 'last_undegraded': '2024-09-10T08:32:24.145158+0000', 'last_fullsized': '2024-09-10T08:32:24.145158+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.143970+0000', 'last_change': '2024-09-10T08:32:24.143970+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.143970+0000', 'last_undegraded': '2024-09-10T08:32:24.143970+0000', 'last_fullsized': '2024-09-10T08:32:24.143970+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.143395+0000', 'last_change': '2024-09-10T08:32:24.143395+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.143395+0000', 'last_undegraded': '2024-09-10T08:32:24.143395+0000', 'last_fullsized': '2024-09-10T08:32:24.143395+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-10T08:32:30.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.148622+0000', 'last_change': '2024-09-10T08:32:24.148622+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.148622+0000', 'last_undegraded': '2024-09-10T08:32:24.148622+0000', 'last_fullsized': '2024-09-10T08:32:24.148622+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:32:30.261 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-10T08:32:30.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 59, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:32:24.142949+0000', 'last_change': '2024-09-10T08:32:24.142949+0000', 'last_active': '2024-09-10T08:32:24.132542+0000', 'last_peered': '2024-09-10T08:32:24.132542+0000', 'last_clean': '2024-09-10T08:32:24.132542+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:32:24.142949+0000', 'last_undegraded': '2024-09-10T08:32:24.142949+0000', 'last_fullsized': '2024-09-10T08:32:24.142949+0000', 'mapping_epoch': 59, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 59, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'last_clean_scrub_stamp': '2024-09-10T08:32:24.132542+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:32:30.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:32:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.443+0000 7f8273200640 1 Processor -- start 2024-09-10T08:32:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.443+0000 7f8273200640 1 -- start start 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.444+0000 7f8273200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f826c0b2d40 0x7f826c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.444+0000 7f8273200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f826c13eb20 0x7f826c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.444+0000 7f8273200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826c071180 con 0x7f826c15bcf0 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.444+0000 7f8273200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f826c15c890 con 0x7f826c13eb20 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.444+0000 7f8273200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f826c071ab0 con 0x7f826c0b2d40 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f826c13eb20 0x7f826c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f8271200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f826c15bcf0 0x7f826c15c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49634/0 (socket says 172.21.15.52:49634) 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f8271200640 1 -- 172.21.15.52:0/1056698354 learned_addr learned my addr 172.21.15.52:0/1056698354 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826be00640 1 --2- 172.21.15.52:0/1056698354 >> v2:172.21.15.176:3300/0 conn(0x7f826c0b2d40 0x7f826c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826aa00640 1 -- 172.21.15.52:0/1056698354 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004554386 0 0) 0x7f826c071180 con 0x7f826c15bcf0 2024-09-10T08:32:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826b400640 1 -- 172.21.15.52:0/1056698354 >> v2:172.21.15.176:3300/0 conn(0x7f826c0b2d40 msgr2=0x7f826c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826b400640 1 --2- 172.21.15.52:0/1056698354 >> v2:172.21.15.176:3300/0 conn(0x7f826c0b2d40 0x7f826c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826b400640 1 -- 172.21.15.52:0/1056698354 >> v1:172.21.15.52:6789/0 conn(0x7f826c15bcf0 legacy=0x7f826c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.445+0000 7f826b400640 1 -- 172.21.15.52:0/1056698354 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c071460 con 0x7f826c13eb20 2024-09-10T08:32:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.446+0000 7f826b400640 1 --2- 172.21.15.52:0/1056698354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c13eb20 0x7f826c06c150 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f826c069be0 tx=0x7f825802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade927e014cfe654 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f826aa00640 1 -- 172.21.15.52:0/1056698354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258032770 con 0x7f826c13eb20 2024-09-10T08:32:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f826aa00640 1 -- 172.21.15.52:0/1056698354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8258038070 con 0x7f826c13eb20 2024-09-10T08:32:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f826aa00640 1 -- 172.21.15.52:0/1056698354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258032b30 con 0x7f826c13eb20 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 -- 172.21.15.52:0/1056698354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c13eb20 msgr2=0x7f826c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 --2- 172.21.15.52:0/1056698354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c13eb20 0x7f826c06c150 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f826c069be0 tx=0x7f825802c870 comp rx=0 tx=0).stop 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 -- 172.21.15.52:0/1056698354 shutdown_connections 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 --2- 172.21.15.52:0/1056698354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c13eb20 0x7f826c06c150 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 --2- 172.21.15.52:0/1056698354 >> v2:172.21.15.176:3300/0 conn(0x7f826c0b2d40 0x7f826c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 -- 172.21.15.52:0/1056698354 >> 172.21.15.52:0/1056698354 conn(0x7f826c0ccec0 msgr2=0x7f826c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 -- 172.21.15.52:0/1056698354 shutdown_connections 2024-09-10T08:32:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.447+0000 7f8273200640 1 -- 172.21.15.52:0/1056698354 wait complete. 2024-09-10T08:32:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.449+0000 7f8273200640 1 Processor -- start 2024-09-10T08:32:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.449+0000 7f8273200640 1 -- start start 2024-09-10T08:32:30.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f826c13eb20 0x7f826c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 0x7f826c0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f826c0720c0 con 0x7f826c0b2d40 2024-09-10T08:32:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f826c071f40 con 0x7f826c13eb20 2024-09-10T08:32:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f8273200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f826c072240 con 0x7f826c15bcf0 2024-09-10T08:32:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f826be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f826be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44668/0 (socket says 172.21.15.52:44668) 2024-09-10T08:32:30.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f826be00640 1 -- 172.21.15.52:0/3085254076 learned_addr learned my addr 172.21.15.52:0/3085254076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.450+0000 7f826b400640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f826c13eb20 0x7f826c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8271200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 0x7f826c0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 -- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 msgr2=0x7f826c0c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 0x7f826c0c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 -- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f826c13eb20 msgr2=0x7f826c0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f826c13eb20 0x7f826c0c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 -- 172.21.15.52:0/3085254076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c156130 con 0x7f826c0b2d40 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8271200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 0x7f826c0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f826be00640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f825c00e9b0 tx=0x7f825c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c017070 con 0x7f826c0b2d40 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c00c9a0 con 0x7f826c0b2d40 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c00cd90 con 0x7f826c0b2d40 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c156410 con 0x7f826c0b2d40 2024-09-10T08:32:30.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.451+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c1569d0 con 0x7f826c0b2d40 2024-09-10T08:32:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.452+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c15c180 con 0x7f826c0b2d40 2024-09-10T08:32:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.453+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f825c01a070 con 0x7f826c0b2d40 2024-09-10T08:32:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.455+0000 7f8263e00640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.455+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f825c08b270 con 0x7f826c0b2d40 2024-09-10T08:32:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.455+0000 7f826b400640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.456+0000 7f826b400640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 0x7f824c06e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8258037000 tx=0x7f8258032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.459+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f825c059c10 con 0x7f826c0b2d40 2024-09-10T08:32:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.710+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f826c06c9c0 con 0x7f826c0b2d40 2024-09-10T08:32:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.710+0000 7f8263e00640 1 -- 172.21.15.52:0/3085254076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f825c059510 con 0x7f826c0b2d40 2024-09-10T08:32:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:30.711 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":250,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":53},{"state_name":"active+clean","count":44}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590402,"bytes_used":317714432,"bytes_avail":772776398848,"bytes_total":773094113280,"inactive_pgs_ratio":0.54639172554016113,"write_bytes_sec":1194,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":34,"btime":"2024-09-10T08:32:28:165289+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6135}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-10T08:32:13.504600+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 msgr2=0x7f824c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 0x7f824c06e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8258037000 tx=0x7f8258032000 comp rx=0 tx=0).stop 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 msgr2=0x7f826c155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f825c00e9b0 tx=0x7f825c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 shutdown_connections 2024-09-10T08:32:30.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824c06be30 0x7f824c06e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826c15bcf0 0x7f826c0c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f826c13eb20 0x7f826c0c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 --2- 172.21.15.52:0/3085254076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f826c0b2d40 0x7f826c155230 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 >> 172.21.15.52:0/3085254076 conn(0x7f826c0ccec0 msgr2=0x7f826c0d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 shutdown_connections 2024-09-10T08:32:30.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.712+0000 7f8273200640 1 -- 172.21.15.52:0/3085254076 wait complete. 2024-09-10T08:32:30.728 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:32:30.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:32:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.886+0000 7f99c7e00640 1 Processor -- start 2024-09-10T08:32:30.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.886+0000 7f99c7e00640 1 -- start start 2024-09-10T08:32:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 0x7f99c80b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99c815f400 0x7f99c815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f99c815ca90 con 0x7f99c815f400 2024-09-10T08:32:30.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f99c80b6660 con 0x7f99c81522d0 2024-09-10T08:32:30.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99c815cce0 con 0x7f99c80b60e0 2024-09-10T08:32:30.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99c815f400 0x7f99c815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99c815f400 0x7f99c815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44672/0 (socket says 172.21.15.52:44672) 2024-09-10T08:32:30.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.887+0000 7f99c7400640 1 -- 172.21.15.52:0/2901705520 learned_addr learned my addr 172.21.15.52:0/2901705520 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c7400640 1 -- 172.21.15.52:0/2901705520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 msgr2=0x7f99c815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99bfe00640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c6a00640 1 --2- 172.21.15.52:0/2901705520 >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 0x7f99c80b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c7400640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c815eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c7400640 1 -- 172.21.15.52:0/2901705520 >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 msgr2=0x7f99c80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c7400640 1 --2- 172.21.15.52:0/2901705520 >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 0x7f99c80b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c7400640 1 -- 172.21.15.52:0/2901705520 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c815cfc0 con 0x7f99c815f400 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99bfe00640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.888+0000 7f99c6a00640 1 --2- 172.21.15.52:0/2901705520 >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 0x7f99c80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c7400640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c815b8d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f99c806f210 tx=0x7f99c002a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdafa6f3b737ee4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c6000640 1 -- 172.21.15.52:0/2901705520 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0036070 con 0x7f99c815f400 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c6000640 1 -- 172.21.15.52:0/2901705520 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c0031600 con 0x7f99c815f400 2024-09-10T08:32:30.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c6000640 1 -- 172.21.15.52:0/2901705520 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00319d0 con 0x7f99c815f400 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c7e00640 1 -- 172.21.15.52:0/2901705520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 msgr2=0x7f99c815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.889+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c815b8d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f99c806f210 tx=0x7f99c002a690 comp rx=0 tx=0).stop 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 -- 172.21.15.52:0/2901705520 shutdown_connections 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c815b8d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2901705520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2901705520 >> v2:172.21.15.176:3300/0 conn(0x7f99c81522d0 0x7f99c80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 -- 172.21.15.52:0/2901705520 >> 172.21.15.52:0/2901705520 conn(0x7f99c806c240 msgr2=0x7f99c806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:30.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 -- 172.21.15.52:0/2901705520 shutdown_connections 2024-09-10T08:32:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.890+0000 7f99c7e00640 1 -- 172.21.15.52:0/2901705520 wait complete. 2024-09-10T08:32:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.891+0000 7f99c7e00640 1 Processor -- start 2024-09-10T08:32:30.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.891+0000 7f99c7e00640 1 -- start start 2024-09-10T08:32:30.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c8152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99c81522d0 0x7f99c814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99c81526b0 con 0x7f99c815f400 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815fc80 con 0x7f99c81522d0 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.892+0000 7f99c7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99c8152830 con 0x7f99c80b60e0 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44682/0 (socket says 172.21.15.52:44682) 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 -- 172.21.15.52:0/2716612507 learned_addr learned my addr 172.21.15.52:0/2716612507 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99bfe00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99c81522d0 0x7f99c814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c6a00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c8152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 -- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 msgr2=0x7f99c8152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c8152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 -- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99c81522d0 msgr2=0x7f99c814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:30.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99c81522d0 0x7f99c814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:30.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 -- 172.21.15.52:0/2716612507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c80af7e0 con 0x7f99c815f400 2024-09-10T08:32:30.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.893+0000 7f99c7400640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f99c002ac80 tx=0x7f99c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.894+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c003f020 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.894+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c0037040 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.894+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0036070 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.894+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c81534a0 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.894+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c8153a60 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.895+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c815eec0 con 0x7f99c815f400 2024-09-10T08:32:30.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.896+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99c0042020 con 0x7f99c815f400 2024-09-10T08:32:30.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.897+0000 7f99bea00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 0x7f99a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:30.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.897+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f99c00ab5e0 con 0x7f99c815f400 2024-09-10T08:32:30.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.897+0000 7f99c6a00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 0x7f99a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:30.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.898+0000 7f99c6a00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 0x7f99a406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99b800ab60 tx=0x7f99b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:30.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:30.901+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99c0049020 con 0x7f99c815f400 2024-09-10T08:32:31.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.084+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99c8068790 con 0x7f99a406be30 2024-09-10T08:32:31.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.091+0000 7f99bea00640 1 -- 172.21.15.52:0/2716612507 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247551 (secure 0 0 0) 0x7f99c8068790 con 0x7f99a406be30 2024-09-10T08:32:31.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:31.095 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 msgr2=0x7f99a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 0x7f99a406e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f99b800ab60 tx=0x7f99b8008040 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 msgr2=0x7f99c80af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f99c002ac80 tx=0x7f99c0004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 shutdown_connections 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f99a406be30 0x7f99a406e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99c815f400 0x7f99c80af2a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99c81522d0 0x7f99c814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 --2- 172.21.15.52:0/2716612507 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99c80b60e0 0x7f99c8152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 >> 172.21.15.52:0/2716612507 conn(0x7f99c806c240 msgr2=0x7f99c815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:31.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 shutdown_connections 2024-09-10T08:32:31.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:31.095+0000 7f99c7e00640 1 -- 172.21.15.52:0/2716612507 wait complete. 2024-09-10T08:32:31.111 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-10T08:32:29.508577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":165,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310268,"kb_used_data":6660,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754664452,"statfs":{"total":773094113280,"available":772776398848,"internally_reserved":0,"allocated":6819840,"data_stored":3502525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001710"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146826+0000","last_change":"2024-09-10T08:32:24.146826+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146826+0000","last_undegraded":"2024-09-10T08:32:24.146826+0000","last_fullsized":"2024-09-10T08:32:24.146826+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147327+0000","last_change":"2024-09-10T08:32:24.147327+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147327+0000","last_undegraded":"2024-09-10T08:32:24.147327+0000","last_fullsized":"2024-09-10T08:32:24.147327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148389+0000","last_change":"2024-09-10T08:32:24.148389+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148389+0000","last_undegraded":"2024-09-10T08:32:24.148389+0000","last_fullsized":"2024-09-10T08:32:24.148389+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147174+0000","last_change":"2024-09-10T08:32:24.147174+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147174+0000","last_undegraded":"2024-09-10T08:32:24.147174+0000","last_fullsized":"2024-09-10T08:32:24.147174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145509+0000","last_change":"2024-09-10T08:32:24.145509+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145509+0000","last_undegraded":"2024-09-10T08:32:24.145509+0000","last_fullsized":"2024-09-10T08:32:24.145509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143813+0000","last_change":"2024-09-10T08:32:24.143813+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143813+0000","last_undegraded":"2024-09-10T08:32:24.143813+0000","last_fullsized":"2024-09-10T08:32:24.143813+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147570+0000","last_change":"2024-09-10T08:32:24.147570+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147570+0000","last_undegraded":"2024-09-10T08:32:24.147570+0000","last_fullsized":"2024-09-10T08:32:24.147570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279852+0000","last_change":"2024-09-10T08:32:25.163263+0000","last_active":"2024-09-10T08:32:26.279852+0000","last_peered":"2024-09-10T08:32:26.279852+0000","last_clean":"2024-09-10T08:32:26.279852+0000","last_became_active":"2024-09-10T08:32:25.162949+0000","last_became_peered":"2024-09-10T08:32:25.162949+0000","last_unstale":"2024-09-10T08:32:26.279852+0000","last_undegraded":"2024-09-10T08:32:26.279852+0000","last_fullsized":"2024-09-10T08:32:26.279852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:01.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152102+0000","last_change":"2024-09-10T08:32:24.152102+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152102+0000","last_undegraded":"2024-09-10T08:32:24.152102+0000","last_fullsized":"2024-09-10T08:32:24.152102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146849+0000","last_change":"2024-09-10T08:32:24.146849+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146849+0000","last_undegraded":"2024-09-10T08:32:24.146849+0000","last_fullsized":"2024-09-10T08:32:24.146849+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151172+0000","last_change":"2024-09-10T08:32:24.151172+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151172+0000","last_undegraded":"2024-09-10T08:32:24.151172+0000","last_fullsized":"2024-09-10T08:32:24.151172+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150648+0000","last_change":"2024-09-10T08:32:24.150648+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150648+0000","last_undegraded":"2024-09-10T08:32:24.150648+0000","last_fullsized":"2024-09-10T08:32:24.150648+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149466+0000","last_change":"2024-09-10T08:32:24.149466+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149466+0000","last_undegraded":"2024-09-10T08:32:24.149466+0000","last_fullsized":"2024-09-10T08:32:24.149466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150210+0000","last_change":"2024-09-10T08:32:24.150210+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150210+0000","last_undegraded":"2024-09-10T08:32:24.150210+0000","last_fullsized":"2024-09-10T08:32:24.150210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.153251+0000","last_change":"2024-09-10T08:32:24.153251+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.153251+0000","last_undegraded":"2024-09-10T08:32:24.153251+0000","last_fullsized":"2024-09-10T08:32:24.153251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142415+0000","last_change":"2024-09-10T08:32:24.142415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142415+0000","last_undegraded":"2024-09-10T08:32:24.142415+0000","last_fullsized":"2024-09-10T08:32:24.142415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146382+0000","last_change":"2024-09-10T08:32:24.146382+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146382+0000","last_undegraded":"2024-09-10T08:32:24.146382+0000","last_fullsized":"2024-09-10T08:32:24.146382+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148176+0000","last_change":"2024-09-10T08:32:24.148176+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148176+0000","last_undegraded":"2024-09-10T08:32:24.148176+0000","last_fullsized":"2024-09-10T08:32:24.148176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145415+0000","last_change":"2024-09-10T08:32:24.145415+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145415+0000","last_undegraded":"2024-09-10T08:32:24.145415+0000","last_fullsized":"2024-09-10T08:32:24.145415+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150734+0000","last_change":"2024-09-10T08:32:24.150734+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150734+0000","last_undegraded":"2024-09-10T08:32:24.150734+0000","last_fullsized":"2024-09-10T08:32:24.150734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149043+0000","last_change":"2024-09-10T08:32:24.149043+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149043+0000","last_undegraded":"2024-09-10T08:32:24.149043+0000","last_fullsized":"2024-09-10T08:32:24.149043+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150302+0000","last_change":"2024-09-10T08:32:24.150302+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150302+0000","last_undegraded":"2024-09-10T08:32:24.150302+0000","last_fullsized":"2024-09-10T08:32:24.150302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146846+0000","last_change":"2024-09-10T08:32:24.146846+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146846+0000","last_undegraded":"2024-09-10T08:32:24.146846+0000","last_fullsized":"2024-09-10T08:32:24.146846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150089+0000","last_change":"2024-09-10T08:32:24.150089+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150089+0000","last_undegraded":"2024-09-10T08:32:24.150089+0000","last_fullsized":"2024-09-10T08:32:24.150089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148618+0000","last_change":"2024-09-10T08:32:24.148618+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148618+0000","last_undegraded":"2024-09-10T08:32:24.148618+0000","last_fullsized":"2024-09-10T08:32:24.148618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151779+0000","last_change":"2024-09-10T08:32:24.151779+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151779+0000","last_undegraded":"2024-09-10T08:32:24.151779+0000","last_fullsized":"2024-09-10T08:32:24.151779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144995+0000","last_change":"2024-09-10T08:32:24.144995+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144995+0000","last_undegraded":"2024-09-10T08:32:24.144995+0000","last_fullsized":"2024-09-10T08:32:24.144995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280476+0000","last_change":"2024-09-10T08:32:25.165304+0000","last_active":"2024-09-10T08:32:26.280476+0000","last_peered":"2024-09-10T08:32:26.280476+0000","last_clean":"2024-09-10T08:32:26.280476+0000","last_became_active":"2024-09-10T08:32:25.164955+0000","last_became_peered":"2024-09-10T08:32:25.164955+0000","last_unstale":"2024-09-10T08:32:26.280476+0000","last_undegraded":"2024-09-10T08:32:26.280476+0000","last_fullsized":"2024-09-10T08:32:26.280476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:06.512577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280552+0000","last_change":"2024-09-10T08:32:25.171501+0000","last_active":"2024-09-10T08:32:26.280552+0000","last_peered":"2024-09-10T08:32:26.280552+0000","last_clean":"2024-09-10T08:32:26.280552+0000","last_became_active":"2024-09-10T08:32:25.170830+0000","last_became_peered":"2024-09-10T08:32:25.170830+0000","last_unstale":"2024-09-10T08:32:26.280552+0000","last_undegraded":"2024-09-10T08:32:26.280552+0000","last_fullsized":"2024-09-10T08:32:26.280552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:30.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146828+0000","last_change":"2024-09-10T08:32:24.146828+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146828+0000","last_undegraded":"2024-09-10T08:32:24.146828+0000","last_fullsized":"2024-09-10T08:32:24.146828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143407+0000","last_change":"2024-09-10T08:32:24.143407+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143407+0000","last_undegraded":"2024-09-10T08:32:24.143407+0000","last_fullsized":"2024-09-10T08:32:24.143407+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147539+0000","last_change":"2024-09-10T08:32:24.147539+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147539+0000","last_undegraded":"2024-09-10T08:32:24.147539+0000","last_fullsized":"2024-09-10T08:32:24.147539+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146388+0000","last_change":"2024-09-10T08:32:24.146388+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146388+0000","last_undegraded":"2024-09-10T08:32:24.146388+0000","last_fullsized":"2024-09-10T08:32:24.146388+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163798+0000","last_change":"2024-09-10T08:32:24.162104+0000","last_active":"2024-09-10T08:32:24.163798+0000","last_peered":"2024-09-10T08:32:24.163798+0000","last_clean":"2024-09-10T08:32:24.163798+0000","last_became_active":"2024-09-10T08:32:24.160974+0000","last_became_peered":"2024-09-10T08:32:24.160974+0000","last_unstale":"2024-09-10T08:32:24.163798+0000","last_undegraded":"2024-09-10T08:32:24.163798+0000","last_fullsized":"2024-09-10T08:32:24.163798+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:24.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145961+0000","last_change":"2024-09-10T08:32:24.145961+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145961+0000","last_undegraded":"2024-09-10T08:32:24.145961+0000","last_fullsized":"2024-09-10T08:32:24.145961+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166236+0000","last_change":"2024-09-10T08:32:24.165316+0000","last_active":"2024-09-10T08:32:24.166236+0000","last_peered":"2024-09-10T08:32:24.166236+0000","last_clean":"2024-09-10T08:32:24.166236+0000","last_became_active":"2024-09-10T08:32:24.165042+0000","last_became_peered":"2024-09-10T08:32:24.165042+0000","last_unstale":"2024-09-10T08:32:24.166236+0000","last_undegraded":"2024-09-10T08:32:24.166236+0000","last_fullsized":"2024-09-10T08:32:24.166236+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:09:05.022458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280575+0000","last_change":"2024-09-10T08:32:25.178616+0000","last_active":"2024-09-10T08:32:26.280575+0000","last_peered":"2024-09-10T08:32:26.280575+0000","last_clean":"2024-09-10T08:32:26.280575+0000","last_became_active":"2024-09-10T08:32:25.178160+0000","last_became_peered":"2024-09-10T08:32:25.178160+0000","last_unstale":"2024-09-10T08:32:26.280575+0000","last_undegraded":"2024-09-10T08:32:26.280575+0000","last_fullsized":"2024-09-10T08:32:26.280575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:34.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163350+0000","last_change":"2024-09-10T08:32:24.159693+0000","last_active":"2024-09-10T08:32:24.163350+0000","last_peered":"2024-09-10T08:32:24.163350+0000","last_clean":"2024-09-10T08:32:24.163350+0000","last_became_active":"2024-09-10T08:32:24.159350+0000","last_became_peered":"2024-09-10T08:32:24.159350+0000","last_unstale":"2024-09-10T08:32:24.163350+0000","last_undegraded":"2024-09-10T08:32:24.163350+0000","last_fullsized":"2024-09-10T08:32:24.163350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:38.383683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145252+0000","last_change":"2024-09-10T08:32:24.145252+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145252+0000","last_undegraded":"2024-09-10T08:32:24.145252+0000","last_fullsized":"2024-09-10T08:32:24.145252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158485+0000","last_change":"2024-09-10T08:32:24.154313+0000","last_active":"2024-09-10T08:32:24.158485+0000","last_peered":"2024-09-10T08:32:24.158485+0000","last_clean":"2024-09-10T08:32:24.158485+0000","last_became_active":"2024-09-10T08:32:24.153991+0000","last_became_peered":"2024-09-10T08:32:24.153991+0000","last_unstale":"2024-09-10T08:32:24.158485+0000","last_undegraded":"2024-09-10T08:32:24.158485+0000","last_fullsized":"2024-09-10T08:32:24.158485+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:29.505197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280650+0000","last_change":"2024-09-10T08:32:25.169611+0000","last_active":"2024-09-10T08:32:26.280650+0000","last_peered":"2024-09-10T08:32:26.280650+0000","last_clean":"2024-09-10T08:32:26.280650+0000","last_became_active":"2024-09-10T08:32:25.160291+0000","last_became_peered":"2024-09-10T08:32:25.160291+0000","last_unstale":"2024-09-10T08:32:26.280650+0000","last_undegraded":"2024-09-10T08:32:26.280650+0000","last_fullsized":"2024-09-10T08:32:26.280650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:13.177652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163986+0000","last_change":"2024-09-10T08:32:24.159316+0000","last_active":"2024-09-10T08:32:24.163986+0000","last_peered":"2024-09-10T08:32:24.163986+0000","last_clean":"2024-09-10T08:32:24.163986+0000","last_became_active":"2024-09-10T08:32:24.159005+0000","last_became_peered":"2024-09-10T08:32:24.159005+0000","last_unstale":"2024-09-10T08:32:24.163986+0000","last_undegraded":"2024-09-10T08:32:24.163986+0000","last_fullsized":"2024-09-10T08:32:24.163986+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.167399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.152285+0000","last_change":"2024-09-10T08:32:24.152285+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.152285+0000","last_undegraded":"2024-09-10T08:32:24.152285+0000","last_fullsized":"2024-09-10T08:32:24.152285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.157267+0000","last_change":"2024-09-10T08:32:24.154485+0000","last_active":"2024-09-10T08:32:24.157267+0000","last_peered":"2024-09-10T08:32:24.157267+0000","last_clean":"2024-09-10T08:32:24.157267+0000","last_became_active":"2024-09-10T08:32:24.154218+0000","last_became_peered":"2024-09-10T08:32:24.154218+0000","last_unstale":"2024-09-10T08:32:24.157267+0000","last_undegraded":"2024-09-10T08:32:24.157267+0000","last_fullsized":"2024-09-10T08:32:24.157267+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:48.551576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147721+0000","last_change":"2024-09-10T08:32:24.147721+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147721+0000","last_undegraded":"2024-09-10T08:32:24.147721+0000","last_fullsized":"2024-09-10T08:32:24.147721+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167113+0000","last_change":"2024-09-10T08:32:24.165574+0000","last_active":"2024-09-10T08:32:24.167113+0000","last_peered":"2024-09-10T08:32:24.167113+0000","last_clean":"2024-09-10T08:32:24.167113+0000","last_became_active":"2024-09-10T08:32:24.165300+0000","last_became_peered":"2024-09-10T08:32:24.165300+0000","last_unstale":"2024-09-10T08:32:24.167113+0000","last_undegraded":"2024-09-10T08:32:24.167113+0000","last_fullsized":"2024-09-10T08:32:24.167113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142512+0000","last_change":"2024-09-10T08:32:24.142512+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142512+0000","last_undegraded":"2024-09-10T08:32:24.142512+0000","last_fullsized":"2024-09-10T08:32:24.142512+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166052+0000","last_change":"2024-09-10T08:32:24.163403+0000","last_active":"2024-09-10T08:32:24.166052+0000","last_peered":"2024-09-10T08:32:24.166052+0000","last_clean":"2024-09-10T08:32:24.166052+0000","last_became_active":"2024-09-10T08:32:24.162449+0000","last_became_peered":"2024-09-10T08:32:24.162449+0000","last_unstale":"2024-09-10T08:32:24.166052+0000","last_undegraded":"2024-09-10T08:32:24.166052+0000","last_fullsized":"2024-09-10T08:32:24.166052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:02.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151339+0000","last_change":"2024-09-10T08:32:24.151339+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151339+0000","last_undegraded":"2024-09-10T08:32:24.151339+0000","last_fullsized":"2024-09-10T08:32:24.151339+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163796+0000","last_change":"2024-09-10T08:32:24.163145+0000","last_active":"2024-09-10T08:32:24.163796+0000","last_peered":"2024-09-10T08:32:24.163796+0000","last_clean":"2024-09-10T08:32:24.163796+0000","last_became_active":"2024-09-10T08:32:24.162835+0000","last_became_peered":"2024-09-10T08:32:24.162835+0000","last_unstale":"2024-09-10T08:32:24.163796+0000","last_undegraded":"2024-09-10T08:32:24.163796+0000","last_fullsized":"2024-09-10T08:32:24.163796+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150987+0000","last_change":"2024-09-10T08:32:24.150987+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150987+0000","last_undegraded":"2024-09-10T08:32:24.150987+0000","last_fullsized":"2024-09-10T08:32:24.150987+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280688+0000","last_change":"2024-09-10T08:32:24.161471+0000","last_active":"2024-09-10T08:32:26.280688+0000","last_peered":"2024-09-10T08:32:26.280688+0000","last_clean":"2024-09-10T08:32:26.280688+0000","last_became_active":"2024-09-10T08:32:24.160009+0000","last_became_peered":"2024-09-10T08:32:24.160009+0000","last_unstale":"2024-09-10T08:32:26.280688+0000","last_undegraded":"2024-09-10T08:32:26.280688+0000","last_fullsized":"2024-09-10T08:32:26.280688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:02.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280817+0000","last_change":"2024-09-10T08:32:25.178400+0000","last_active":"2024-09-10T08:32:26.280817+0000","last_peered":"2024-09-10T08:32:26.280817+0000","last_clean":"2024-09-10T08:32:26.280817+0000","last_became_active":"2024-09-10T08:32:25.177837+0000","last_became_peered":"2024-09-10T08:32:25.177837+0000","last_unstale":"2024-09-10T08:32:26.280817+0000","last_undegraded":"2024-09-10T08:32:26.280817+0000","last_fullsized":"2024-09-10T08:32:26.280817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.029416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161981+0000","last_change":"2024-09-10T08:32:24.156801+0000","last_active":"2024-09-10T08:32:24.161981+0000","last_peered":"2024-09-10T08:32:24.161981+0000","last_clean":"2024-09-10T08:32:24.161981+0000","last_became_active":"2024-09-10T08:32:24.156520+0000","last_became_peered":"2024-09-10T08:32:24.156520+0000","last_unstale":"2024-09-10T08:32:24.161981+0000","last_undegraded":"2024-09-10T08:32:24.161981+0000","last_fullsized":"2024-09-10T08:32:24.161981+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:36.232352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148838+0000","last_change":"2024-09-10T08:32:24.148838+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148838+0000","last_undegraded":"2024-09-10T08:32:24.148838+0000","last_fullsized":"2024-09-10T08:32:24.148838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.167980+0000","last_change":"2024-09-10T08:32:24.166153+0000","last_active":"2024-09-10T08:32:24.167980+0000","last_peered":"2024-09-10T08:32:24.167980+0000","last_clean":"2024-09-10T08:32:24.167980+0000","last_became_active":"2024-09-10T08:32:24.165858+0000","last_became_peered":"2024-09-10T08:32:24.165858+0000","last_unstale":"2024-09-10T08:32:24.167980+0000","last_undegraded":"2024-09-10T08:32:24.167980+0000","last_fullsized":"2024-09-10T08:32:24.167980+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:55.441531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151031+0000","last_change":"2024-09-10T08:32:24.151031+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151031+0000","last_undegraded":"2024-09-10T08:32:24.151031+0000","last_fullsized":"2024-09-10T08:32:24.151031+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280775+0000","last_change":"2024-09-10T08:32:24.159349+0000","last_active":"2024-09-10T08:32:26.280775+0000","last_peered":"2024-09-10T08:32:26.280775+0000","last_clean":"2024-09-10T08:32:26.280775+0000","last_became_active":"2024-09-10T08:32:24.159072+0000","last_became_peered":"2024-09-10T08:32:24.159072+0000","last_unstale":"2024-09-10T08:32:26.280775+0000","last_undegraded":"2024-09-10T08:32:26.280775+0000","last_fullsized":"2024-09-10T08:32:26.280775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.680184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.151395+0000","last_change":"2024-09-10T08:32:24.151395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.151395+0000","last_undegraded":"2024-09-10T08:32:24.151395+0000","last_fullsized":"2024-09-10T08:32:24.151395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160522+0000","last_change":"2024-09-10T08:32:24.159347+0000","last_active":"2024-09-10T08:32:24.160522+0000","last_peered":"2024-09-10T08:32:24.160522+0000","last_clean":"2024-09-10T08:32:24.160522+0000","last_became_active":"2024-09-10T08:32:24.158536+0000","last_became_peered":"2024-09-10T08:32:24.158536+0000","last_unstale":"2024-09-10T08:32:24.160522+0000","last_undegraded":"2024-09-10T08:32:24.160522+0000","last_fullsized":"2024-09-10T08:32:24.160522+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:08.950585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.149626+0000","last_change":"2024-09-10T08:32:24.149626+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.149626+0000","last_undegraded":"2024-09-10T08:32:24.149626+0000","last_fullsized":"2024-09-10T08:32:24.149626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.159168+0000","last_change":"2024-09-10T08:32:24.155976+0000","last_active":"2024-09-10T08:32:24.159168+0000","last_peered":"2024-09-10T08:32:24.159168+0000","last_clean":"2024-09-10T08:32:24.159168+0000","last_became_active":"2024-09-10T08:32:24.155662+0000","last_became_peered":"2024-09-10T08:32:24.155662+0000","last_unstale":"2024-09-10T08:32:24.159168+0000","last_undegraded":"2024-09-10T08:32:24.159168+0000","last_fullsized":"2024-09-10T08:32:24.159168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:54.341281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.146404+0000","last_change":"2024-09-10T08:32:24.146404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.146404+0000","last_undegraded":"2024-09-10T08:32:24.146404+0000","last_fullsized":"2024-09-10T08:32:24.146404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163615+0000","last_change":"2024-09-10T08:32:24.161542+0000","last_active":"2024-09-10T08:32:24.163615+0000","last_peered":"2024-09-10T08:32:24.163615+0000","last_clean":"2024-09-10T08:32:24.163615+0000","last_became_active":"2024-09-10T08:32:24.161209+0000","last_became_peered":"2024-09-10T08:32:24.161209+0000","last_unstale":"2024-09-10T08:32:24.163615+0000","last_undegraded":"2024-09-10T08:32:24.163615+0000","last_fullsized":"2024-09-10T08:32:24.163615+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:26.653099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.147702+0000","last_change":"2024-09-10T08:32:24.147702+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.147702+0000","last_undegraded":"2024-09-10T08:32:24.147702+0000","last_fullsized":"2024-09-10T08:32:24.147702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163888+0000","last_change":"2024-09-10T08:32:24.160497+0000","last_active":"2024-09-10T08:32:24.163888+0000","last_peered":"2024-09-10T08:32:24.163888+0000","last_clean":"2024-09-10T08:32:24.163888+0000","last_became_active":"2024-09-10T08:32:24.160209+0000","last_became_peered":"2024-09-10T08:32:24.160209+0000","last_unstale":"2024-09-10T08:32:24.163888+0000","last_undegraded":"2024-09-10T08:32:24.163888+0000","last_fullsized":"2024-09-10T08:32:24.163888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150523+0000","last_change":"2024-09-10T08:32:24.150523+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150523+0000","last_undegraded":"2024-09-10T08:32:24.150523+0000","last_fullsized":"2024-09-10T08:32:24.150523+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158627+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158081+0000","last_became_peered":"2024-09-10T08:32:24.158081+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:59.562165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.144404+0000","last_change":"2024-09-10T08:32:24.144404+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.144404+0000","last_undegraded":"2024-09-10T08:32:24.144404+0000","last_fullsized":"2024-09-10T08:32:24.144404+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163655+0000","last_change":"2024-09-10T08:32:24.161818+0000","last_active":"2024-09-10T08:32:24.163655+0000","last_peered":"2024-09-10T08:32:24.163655+0000","last_clean":"2024-09-10T08:32:24.163655+0000","last_became_active":"2024-09-10T08:32:24.161093+0000","last_became_peered":"2024-09-10T08:32:24.161093+0000","last_unstale":"2024-09-10T08:32:24.163655+0000","last_undegraded":"2024-09-10T08:32:24.163655+0000","last_fullsized":"2024-09-10T08:32:24.163655+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:17.486040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148438+0000","last_change":"2024-09-10T08:32:24.148438+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148438+0000","last_undegraded":"2024-09-10T08:32:24.148438+0000","last_fullsized":"2024-09-10T08:32:24.148438+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158676+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158391+0000","last_became_peered":"2024-09-10T08:32:24.158391+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.081154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.150610+0000","last_change":"2024-09-10T08:32:24.150610+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.150610+0000","last_undegraded":"2024-09-10T08:32:24.150610+0000","last_fullsized":"2024-09-10T08:32:24.150610+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166462+0000","last_change":"2024-09-10T08:32:24.165473+0000","last_active":"2024-09-10T08:32:24.166462+0000","last_peered":"2024-09-10T08:32:24.166462+0000","last_clean":"2024-09-10T08:32:24.166462+0000","last_became_active":"2024-09-10T08:32:24.165182+0000","last_became_peered":"2024-09-10T08:32:24.165182+0000","last_unstale":"2024-09-10T08:32:24.166462+0000","last_undegraded":"2024-09-10T08:32:24.166462+0000","last_fullsized":"2024-09-10T08:32:24.166462+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:17.760809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280601+0000","last_change":"2024-09-10T08:32:25.171746+0000","last_active":"2024-09-10T08:32:26.280601+0000","last_peered":"2024-09-10T08:32:26.280601+0000","last_clean":"2024-09-10T08:32:26.280601+0000","last_became_active":"2024-09-10T08:32:25.171207+0000","last_became_peered":"2024-09-10T08:32:25.171207+0000","last_unstale":"2024-09-10T08:32:26.280601+0000","last_undegraded":"2024-09-10T08:32:26.280601+0000","last_fullsized":"2024-09-10T08:32:26.280601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:36.297951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280394+0000","last_change":"2024-09-10T08:32:24.162270+0000","last_active":"2024-09-10T08:32:26.280394+0000","last_peered":"2024-09-10T08:32:26.280394+0000","last_clean":"2024-09-10T08:32:26.280394+0000","last_became_active":"2024-09-10T08:32:24.161849+0000","last_became_peered":"2024-09-10T08:32:24.161849+0000","last_unstale":"2024-09-10T08:32:26.280394+0000","last_undegraded":"2024-09-10T08:32:26.280394+0000","last_fullsized":"2024-09-10T08:32:26.280394+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:09.348585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280457+0000","last_change":"2024-09-10T08:32:25.176004+0000","last_active":"2024-09-10T08:32:26.280457+0000","last_peered":"2024-09-10T08:32:26.280457+0000","last_clean":"2024-09-10T08:32:26.280457+0000","last_became_active":"2024-09-10T08:32:25.175730+0000","last_became_peered":"2024-09-10T08:32:25.175730+0000","last_unstale":"2024-09-10T08:32:26.280457+0000","last_undegraded":"2024-09-10T08:32:26.280457+0000","last_fullsized":"2024-09-10T08:32:26.280457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.160966+0000","last_change":"2024-09-10T08:32:24.159571+0000","last_active":"2024-09-10T08:32:24.160966+0000","last_peered":"2024-09-10T08:32:24.160966+0000","last_clean":"2024-09-10T08:32:24.160966+0000","last_became_active":"2024-09-10T08:32:24.159007+0000","last_became_peered":"2024-09-10T08:32:24.159007+0000","last_unstale":"2024-09-10T08:32:24.160966+0000","last_undegraded":"2024-09-10T08:32:24.160966+0000","last_fullsized":"2024-09-10T08:32:24.160966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:37.047855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145138+0000","last_change":"2024-09-10T08:32:24.145138+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145138+0000","last_undegraded":"2024-09-10T08:32:24.145138+0000","last_fullsized":"2024-09-10T08:32:24.145138+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163295+0000","last_change":"2024-09-10T08:32:24.160317+0000","last_active":"2024-09-10T08:32:24.163295+0000","last_peered":"2024-09-10T08:32:24.163295+0000","last_clean":"2024-09-10T08:32:24.163295+0000","last_became_active":"2024-09-10T08:32:24.158842+0000","last_became_peered":"2024-09-10T08:32:24.158842+0000","last_unstale":"2024-09-10T08:32:24.163295+0000","last_undegraded":"2024-09-10T08:32:24.163295+0000","last_fullsized":"2024-09-10T08:32:24.163295+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:53.319364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.145158+0000","last_change":"2024-09-10T08:32:24.145158+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.145158+0000","last_undegraded":"2024-09-10T08:32:24.145158+0000","last_fullsized":"2024-09-10T08:32:24.145158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.166992+0000","last_change":"2024-09-10T08:32:24.166154+0000","last_active":"2024-09-10T08:32:24.166992+0000","last_peered":"2024-09-10T08:32:24.166992+0000","last_clean":"2024-09-10T08:32:24.166992+0000","last_became_active":"2024-09-10T08:32:24.165827+0000","last_became_peered":"2024-09-10T08:32:24.165827+0000","last_unstale":"2024-09-10T08:32:24.166992+0000","last_undegraded":"2024-09-10T08:32:24.166992+0000","last_fullsized":"2024-09-10T08:32:24.166992+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:44.608981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143970+0000","last_change":"2024-09-10T08:32:24.143970+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143970+0000","last_undegraded":"2024-09-10T08:32:24.143970+0000","last_fullsized":"2024-09-10T08:32:24.143970+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.168179+0000","last_change":"2024-09-10T08:32:24.167261+0000","last_active":"2024-09-10T08:32:24.168179+0000","last_peered":"2024-09-10T08:32:24.168179+0000","last_clean":"2024-09-10T08:32:24.168179+0000","last_became_active":"2024-09-10T08:32:24.166919+0000","last_became_peered":"2024-09-10T08:32:24.166919+0000","last_unstale":"2024-09-10T08:32:24.168179+0000","last_undegraded":"2024-09-10T08:32:24.168179+0000","last_fullsized":"2024-09-10T08:32:24.168179+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:47.835946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280868+0000","last_change":"2024-09-10T08:32:25.161153+0000","last_active":"2024-09-10T08:32:26.280868+0000","last_peered":"2024-09-10T08:32:26.280868+0000","last_clean":"2024-09-10T08:32:26.280868+0000","last_became_active":"2024-09-10T08:32:25.160777+0000","last_became_peered":"2024-09-10T08:32:25.160777+0000","last_unstale":"2024-09-10T08:32:26.280868+0000","last_undegraded":"2024-09-10T08:32:26.280868+0000","last_fullsized":"2024-09-10T08:32:26.280868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:28.805917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.161736+0000","last_change":"2024-09-10T08:32:24.155506+0000","last_active":"2024-09-10T08:32:24.161736+0000","last_peered":"2024-09-10T08:32:24.161736+0000","last_clean":"2024-09-10T08:32:24.161736+0000","last_became_active":"2024-09-10T08:32:24.154291+0000","last_became_peered":"2024-09-10T08:32:24.154291+0000","last_unstale":"2024-09-10T08:32:24.161736+0000","last_undegraded":"2024-09-10T08:32:24.161736+0000","last_fullsized":"2024-09-10T08:32:24.161736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:30.359702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.143395+0000","last_change":"2024-09-10T08:32:24.143395+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.143395+0000","last_undegraded":"2024-09-10T08:32:24.143395+0000","last_fullsized":"2024-09-10T08:32:24.143395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158973+0000","last_change":"2024-09-10T08:32:24.154949+0000","last_active":"2024-09-10T08:32:24.158973+0000","last_peered":"2024-09-10T08:32:24.158973+0000","last_clean":"2024-09-10T08:32:24.158973+0000","last_became_active":"2024-09-10T08:32:24.153289+0000","last_became_peered":"2024-09-10T08:32:24.153289+0000","last_unstale":"2024-09-10T08:32:24.158973+0000","last_undegraded":"2024-09-10T08:32:24.158973+0000","last_fullsized":"2024-09-10T08:32:24.158973+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:14.619385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.148622+0000","last_change":"2024-09-10T08:32:24.148622+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.148622+0000","last_undegraded":"2024-09-10T08:32:24.148622+0000","last_fullsized":"2024-09-10T08:32:24.148622+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.163882+0000","last_change":"2024-09-10T08:32:24.162218+0000","last_active":"2024-09-10T08:32:24.163882+0000","last_peered":"2024-09-10T08:32:24.163882+0000","last_clean":"2024-09-10T08:32:24.163882+0000","last_became_active":"2024-09-10T08:32:24.159383+0000","last_became_peered":"2024-09-10T08:32:24.159383+0000","last_unstale":"2024-09-10T08:32:24.163882+0000","last_undegraded":"2024-09-10T08:32:24.163882+0000","last_fullsized":"2024-09-10T08:32:24.163882+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:02.720855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280007+0000","last_change":"2024-09-10T08:32:25.177447+0000","last_active":"2024-09-10T08:32:26.280007+0000","last_peered":"2024-09-10T08:32:26.280007+0000","last_clean":"2024-09-10T08:32:26.280007+0000","last_became_active":"2024-09-10T08:32:25.177118+0000","last_became_peered":"2024-09-10T08:32:25.177118+0000","last_unstale":"2024-09-10T08:32:26.280007+0000","last_undegraded":"2024-09-10T08:32:26.280007+0000","last_fullsized":"2024-09-10T08:32:26.280007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:52.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.158308+0000","last_change":"2024-09-10T08:32:24.157040+0000","last_active":"2024-09-10T08:32:24.158308+0000","last_peered":"2024-09-10T08:32:24.158308+0000","last_clean":"2024-09-10T08:32:24.158308+0000","last_became_active":"2024-09-10T08:32:24.156709+0000","last_became_peered":"2024-09-10T08:32:24.156709+0000","last_unstale":"2024-09-10T08:32:24.158308+0000","last_undegraded":"2024-09-10T08:32:24.158308+0000","last_fullsized":"2024-09-10T08:32:24.158308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:06.117270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2024-09-10T08:32:24.142949+0000","last_change":"2024-09-10T08:32:24.142949+0000","last_active":"2024-09-10T08:32:24.132542+0000","last_peered":"2024-09-10T08:32:24.132542+0000","last_clean":"2024-09-10T08:32:24.132542+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:32:24.142949+0000","last_undegraded":"2024-09-10T08:32:24.142949+0000","last_fullsized":"2024-09-10T08:32:24.142949+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280122+0000","last_change":"2024-09-10T08:32:24.158256+0000","last_active":"2024-09-10T08:32:26.280122+0000","last_peered":"2024-09-10T08:32:26.280122+0000","last_clean":"2024-09-10T08:32:26.280122+0000","last_became_active":"2024-09-10T08:32:24.157987+0000","last_became_peered":"2024-09-10T08:32:24.157987+0000","last_unstale":"2024-09-10T08:32:26.280122+0000","last_undegraded":"2024-09-10T08:32:26.280122+0000","last_fullsized":"2024-09-10T08:32:26.280122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.320171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280286+0000","last_change":"2024-09-10T08:32:25.170475+0000","last_active":"2024-09-10T08:32:26.280286+0000","last_peered":"2024-09-10T08:32:26.280286+0000","last_clean":"2024-09-10T08:32:26.280286+0000","last_became_active":"2024-09-10T08:32:25.170160+0000","last_became_peered":"2024-09-10T08:32:25.170160+0000","last_unstale":"2024-09-10T08:32:26.280286+0000","last_undegraded":"2024-09-10T08:32:26.280286+0000","last_fullsized":"2024-09-10T08:32:26.280286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:38.003307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.164787+0000","last_change":"2024-09-10T08:32:24.159632+0000","last_active":"2024-09-10T08:32:24.164787+0000","last_peered":"2024-09-10T08:32:24.164787+0000","last_clean":"2024-09-10T08:32:24.164787+0000","last_became_active":"2024-09-10T08:32:24.158831+0000","last_became_peered":"2024-09-10T08:32:24.158831+0000","last_unstale":"2024-09-10T08:32:24.164787+0000","last_undegraded":"2024-09-10T08:32:24.164787+0000","last_fullsized":"2024-09-10T08:32:24.164787+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":235,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-10T08:32:24.150316+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:32:24.150316+0000","last_peered":"2024-09-10T08:32:24.150316+0000","last_clean":"2024-09-10T08:32:24.150316+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:32:24.150316+0000","last_undegraded":"2024-09-10T08:32:24.150316+0000","last_fullsized":"2024-09-10T08:32:24.150316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36036,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335804,"statfs":{"total":96636764160,"available":96599863296,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1294336,"data_stored":878953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36032,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335808,"statfs":{"total":96636764160,"available":96599867392,"internally_reserved":0,"allocated":700416,"data_stored":288585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":892062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:32:34.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:32:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.282+0000 7fd3cde00640 1 Processor -- start 2024-09-10T08:32:34.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.282+0000 7fd3cde00640 1 -- start start 2024-09-10T08:32:34.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.283+0000 7fd3cde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3cde00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3c80cb980 0x7fd3c8162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3cde00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c80cc990 con 0x7fd3c806cf30 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3cde00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c815fcd0 con 0x7fd3c80cb980 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3cde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c8162440 con 0x7fd3c815e6d0 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3be000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3c80cb980 0x7fd3c8162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3c6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3be000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3c80cb980 0x7fd3c8162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:38826/0 (socket says 172.21.15.52:38826) 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3c7400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd3c806cf30 0x7fd3c80709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41238/0 (socket says 172.21.15.52:41238) 2024-09-10T08:32:34.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.284+0000 7fd3be000640 1 -- 172.21.15.52:0/196714090 learned_addr learned my addr 172.21.15.52:0/196714090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:34.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.285+0000 7fd3be000640 1 -- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 msgr2=0x7fd3c815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:34.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.285+0000 7fd3be000640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.285+0000 7fd3be000640 1 -- 172.21.15.52:0/196714090 >> v1:172.21.15.176:6789/0 conn(0x7fd3c806cf30 legacy=0x7fd3c80709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.285+0000 7fd3be000640 1 -- 172.21.15.52:0/196714090 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c80cc3d0 con 0x7fd3c80cb980 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.285+0000 7fd3c6a00640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.286+0000 7fd3be000640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c80cb980 0x7fd3c8162c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009870 tx=0x7fd3b002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594399be65384eba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.286+0000 7fd3c6000640 1 -- 172.21.15.52:0/196714090 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0037070 con 0x7fd3c80cb980 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.286+0000 7fd3c6000640 1 -- 172.21.15.52:0/196714090 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b0032440 con 0x7fd3c80cb980 2024-09-10T08:32:34.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.286+0000 7fd3c6000640 1 -- 172.21.15.52:0/196714090 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0032810 con 0x7fd3c80cb980 2024-09-10T08:32:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 -- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c80cb980 msgr2=0x7fd3c8162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c80cb980 0x7fd3c8162c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009870 tx=0x7fd3b002a130 comp rx=0 tx=0).stop 2024-09-10T08:32:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 -- 172.21.15.52:0/196714090 shutdown_connections 2024-09-10T08:32:34.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c80cb980 0x7fd3c8162c00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 --2- 172.21.15.52:0/196714090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 -- 172.21.15.52:0/196714090 >> 172.21.15.52:0/196714090 conn(0x7fd3c80b4300 msgr2=0x7fd3c80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 -- 172.21.15.52:0/196714090 shutdown_connections 2024-09-10T08:32:34.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.287+0000 7fd3cde00640 1 -- 172.21.15.52:0/196714090 wait complete. 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.289+0000 7fd3cde00640 1 Processor -- start 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.289+0000 7fd3cde00640 1 -- start start 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c806cf30 0x7fd3c815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c8163140 con 0x7fd3c80cb980 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c81626e0 con 0x7fd3c806cf30 2024-09-10T08:32:34.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3cde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c815eab0 con 0x7fd3c815e6d0 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44880/0 (socket says 172.21.15.52:44880) 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 -- 172.21.15.52:0/1715194216 learned_addr learned my addr 172.21.15.52:0/1715194216 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3c7400640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3c6a00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c806cf30 0x7fd3c815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 -- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 msgr2=0x7fd3c815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 -- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c806cf30 msgr2=0x7fd3c815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c806cf30 0x7fd3c815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.290+0000 7fd3be000640 1 -- 172.21.15.52:0/1715194216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c80ccde0 con 0x7fd3c80cb980 2024-09-10T08:32:34.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3be000640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0000c00 tx=0x7fd3b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0037040 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b0042070 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0030940 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c80cd0c0 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.291+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c80cd680 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.292+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c8162c00 con 0x7fd3c80cb980 2024-09-10T08:32:34.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.293+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3b0030ae0 con 0x7fd3c80cb980 2024-09-10T08:32:34.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.294+0000 7fd3bfe00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 0x7fd3a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.294+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fd3b00ab530 con 0x7fd3c80cb980 2024-09-10T08:32:34.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.295+0000 7fd3c6a00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 0x7fd3a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.295+0000 7fd3c6a00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 0x7fd3a406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009560 tx=0x7fd3b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.298+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3b0079880 con 0x7fd3c80cb980 2024-09-10T08:32:34.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.479+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3c806e1b0 con 0x7fd3a406be30 2024-09-10T08:32:34.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.486+0000 7fd3bfe00640 1 -- 172.21.15.52:0/1715194216 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fd3c806e1b0 con 0x7fd3a406be30 2024-09-10T08:32:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:34.491 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 msgr2=0x7fd3a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 0x7fd3a406e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009560 tx=0x7fd3b8009190 comp rx=0 tx=0).stop 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 msgr2=0x7fd3c815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0000c00 tx=0x7fd3b00046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 shutdown_connections 2024-09-10T08:32:34.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3a406be30 0x7fd3a406e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c815e6d0 0x7fd3c815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80cb980 0x7fd3c815b010 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 --2- 172.21.15.52:0/1715194216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c806cf30 0x7fd3c815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 >> 172.21.15.52:0/1715194216 conn(0x7fd3c80b4300 msgr2=0x7fd3c80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 shutdown_connections 2024-09-10T08:32:34.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.490+0000 7fd3cde00640 1 -- 172.21.15.52:0/1715194216 wait complete. 2024-09-10T08:32:34.509 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-10T08:32:33.509860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310492,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754664228,"statfs":{"total":773094113280,"available":772776169472,"internally_reserved":0,"allocated":7053312,"data_stored":3598836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.367973"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282273+0000","last_change":"2024-09-10T08:32:25.177998+0000","last_active":"2024-09-10T08:32:26.282273+0000","last_peered":"2024-09-10T08:32:26.282273+0000","last_clean":"2024-09-10T08:32:26.282273+0000","last_became_active":"2024-09-10T08:32:25.177236+0000","last_became_peered":"2024-09-10T08:32:25.177236+0000","last_unstale":"2024-09-10T08:32:26.282273+0000","last_undegraded":"2024-09-10T08:32:26.282273+0000","last_fullsized":"2024-09-10T08:32:26.282273+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:05.640734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281709+0000","last_change":"2024-09-10T08:32:25.178876+0000","last_active":"2024-09-10T08:32:26.281709+0000","last_peered":"2024-09-10T08:32:26.281709+0000","last_clean":"2024-09-10T08:32:26.281709+0000","last_became_active":"2024-09-10T08:32:25.178102+0000","last_became_peered":"2024-09-10T08:32:25.178102+0000","last_unstale":"2024-09-10T08:32:26.281709+0000","last_undegraded":"2024-09-10T08:32:26.281709+0000","last_fullsized":"2024-09-10T08:32:26.281709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:31.362512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160950+0000","last_change":"2024-09-10T08:32:25.158382+0000","last_active":"2024-09-10T08:32:26.160950+0000","last_peered":"2024-09-10T08:32:26.160950+0000","last_clean":"2024-09-10T08:32:26.160950+0000","last_became_active":"2024-09-10T08:32:25.158125+0000","last_became_peered":"2024-09-10T08:32:25.158125+0000","last_unstale":"2024-09-10T08:32:26.160950+0000","last_undegraded":"2024-09-10T08:32:26.160950+0000","last_fullsized":"2024-09-10T08:32:26.160950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:10.103034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163963+0000","last_change":"2024-09-10T08:32:25.175370+0000","last_active":"2024-09-10T08:32:26.163963+0000","last_peered":"2024-09-10T08:32:26.163963+0000","last_clean":"2024-09-10T08:32:26.163963+0000","last_became_active":"2024-09-10T08:32:25.175038+0000","last_became_peered":"2024-09-10T08:32:25.175038+0000","last_unstale":"2024-09-10T08:32:26.163963+0000","last_undegraded":"2024-09-10T08:32:26.163963+0000","last_fullsized":"2024-09-10T08:32:26.163963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:04.395664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279817+0000","last_change":"2024-09-10T08:32:25.175325+0000","last_active":"2024-09-10T08:32:26.279817+0000","last_peered":"2024-09-10T08:32:26.279817+0000","last_clean":"2024-09-10T08:32:26.279817+0000","last_became_active":"2024-09-10T08:32:25.175048+0000","last_became_peered":"2024-09-10T08:32:25.175048+0000","last_unstale":"2024-09-10T08:32:26.279817+0000","last_undegraded":"2024-09-10T08:32:26.279817+0000","last_fullsized":"2024-09-10T08:32:26.279817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:09.487560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279957+0000","last_change":"2024-09-10T08:32:25.163011+0000","last_active":"2024-09-10T08:32:26.279957+0000","last_peered":"2024-09-10T08:32:26.279957+0000","last_clean":"2024-09-10T08:32:26.279957+0000","last_became_active":"2024-09-10T08:32:25.162425+0000","last_became_peered":"2024-09-10T08:32:25.162425+0000","last_unstale":"2024-09-10T08:32:26.279957+0000","last_undegraded":"2024-09-10T08:32:26.279957+0000","last_fullsized":"2024-09-10T08:32:26.279957+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:08.255390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163559+0000","last_change":"2024-09-10T08:32:25.158634+0000","last_active":"2024-09-10T08:32:26.163559+0000","last_peered":"2024-09-10T08:32:26.163559+0000","last_clean":"2024-09-10T08:32:26.163559+0000","last_became_active":"2024-09-10T08:32:25.158370+0000","last_became_peered":"2024-09-10T08:32:25.158370+0000","last_unstale":"2024-09-10T08:32:26.163559+0000","last_undegraded":"2024-09-10T08:32:26.163559+0000","last_fullsized":"2024-09-10T08:32:26.163559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:21.135933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279852+0000","last_change":"2024-09-10T08:32:25.163263+0000","last_active":"2024-09-10T08:32:26.279852+0000","last_peered":"2024-09-10T08:32:26.279852+0000","last_clean":"2024-09-10T08:32:26.279852+0000","last_became_active":"2024-09-10T08:32:25.162949+0000","last_became_peered":"2024-09-10T08:32:25.162949+0000","last_unstale":"2024-09-10T08:32:26.279852+0000","last_undegraded":"2024-09-10T08:32:26.279852+0000","last_fullsized":"2024-09-10T08:32:26.279852+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:01.985094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280214+0000","last_change":"2024-09-10T08:32:25.174136+0000","last_active":"2024-09-10T08:32:26.280214+0000","last_peered":"2024-09-10T08:32:26.280214+0000","last_clean":"2024-09-10T08:32:26.280214+0000","last_became_active":"2024-09-10T08:32:25.173788+0000","last_became_peered":"2024-09-10T08:32:25.173788+0000","last_unstale":"2024-09-10T08:32:26.280214+0000","last_undegraded":"2024-09-10T08:32:26.280214+0000","last_fullsized":"2024-09-10T08:32:26.280214+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:01.095325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282074+0000","last_change":"2024-09-10T08:32:25.162089+0000","last_active":"2024-09-10T08:32:26.282074+0000","last_peered":"2024-09-10T08:32:26.282074+0000","last_clean":"2024-09-10T08:32:26.282074+0000","last_became_active":"2024-09-10T08:32:25.161549+0000","last_became_peered":"2024-09-10T08:32:25.161549+0000","last_unstale":"2024-09-10T08:32:26.282074+0000","last_undegraded":"2024-09-10T08:32:26.282074+0000","last_fullsized":"2024-09-10T08:32:26.282074+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:18.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164294+0000","last_change":"2024-09-10T08:32:25.156411+0000","last_active":"2024-09-10T08:32:26.164294+0000","last_peered":"2024-09-10T08:32:26.164294+0000","last_clean":"2024-09-10T08:32:26.164294+0000","last_became_active":"2024-09-10T08:32:25.156123+0000","last_became_peered":"2024-09-10T08:32:25.156123+0000","last_unstale":"2024-09-10T08:32:26.164294+0000","last_undegraded":"2024-09-10T08:32:26.164294+0000","last_fullsized":"2024-09-10T08:32:26.164294+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:18.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279889+0000","last_change":"2024-09-10T08:32:25.170205+0000","last_active":"2024-09-10T08:32:26.279889+0000","last_peered":"2024-09-10T08:32:26.279889+0000","last_clean":"2024-09-10T08:32:26.279889+0000","last_became_active":"2024-09-10T08:32:25.169889+0000","last_became_peered":"2024-09-10T08:32:25.169889+0000","last_unstale":"2024-09-10T08:32:26.279889+0000","last_undegraded":"2024-09-10T08:32:26.279889+0000","last_fullsized":"2024-09-10T08:32:26.279889+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:44.537514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280096+0000","last_change":"2024-09-10T08:32:25.166315+0000","last_active":"2024-09-10T08:32:26.280096+0000","last_peered":"2024-09-10T08:32:26.280096+0000","last_clean":"2024-09-10T08:32:26.280096+0000","last_became_active":"2024-09-10T08:32:25.166013+0000","last_became_peered":"2024-09-10T08:32:25.166013+0000","last_unstale":"2024-09-10T08:32:26.280096+0000","last_undegraded":"2024-09-10T08:32:26.280096+0000","last_fullsized":"2024-09-10T08:32:26.280096+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:47.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160520+0000","last_change":"2024-09-10T08:32:25.170249+0000","last_active":"2024-09-10T08:32:26.160520+0000","last_peered":"2024-09-10T08:32:26.160520+0000","last_clean":"2024-09-10T08:32:26.160520+0000","last_became_active":"2024-09-10T08:32:25.168477+0000","last_became_peered":"2024-09-10T08:32:25.168477+0000","last_unstale":"2024-09-10T08:32:26.160520+0000","last_undegraded":"2024-09-10T08:32:26.160520+0000","last_fullsized":"2024-09-10T08:32:26.160520+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:27.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279770+0000","last_change":"2024-09-10T08:32:25.168748+0000","last_active":"2024-09-10T08:32:26.279770+0000","last_peered":"2024-09-10T08:32:26.279770+0000","last_clean":"2024-09-10T08:32:26.279770+0000","last_became_active":"2024-09-10T08:32:25.168474+0000","last_became_peered":"2024-09-10T08:32:25.168474+0000","last_unstale":"2024-09-10T08:32:26.279770+0000","last_undegraded":"2024-09-10T08:32:26.279770+0000","last_fullsized":"2024-09-10T08:32:26.279770+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:42.347980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279735+0000","last_change":"2024-09-10T08:32:25.174689+0000","last_active":"2024-09-10T08:32:26.279735+0000","last_peered":"2024-09-10T08:32:26.279735+0000","last_clean":"2024-09-10T08:32:26.279735+0000","last_became_active":"2024-09-10T08:32:25.174400+0000","last_became_peered":"2024-09-10T08:32:25.174400+0000","last_unstale":"2024-09-10T08:32:26.279735+0000","last_undegraded":"2024-09-10T08:32:26.279735+0000","last_fullsized":"2024-09-10T08:32:26.279735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:47.542445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282279+0000","last_change":"2024-09-10T08:32:25.167439+0000","last_active":"2024-09-10T08:32:26.282279+0000","last_peered":"2024-09-10T08:32:26.282279+0000","last_clean":"2024-09-10T08:32:26.282279+0000","last_became_active":"2024-09-10T08:32:25.166580+0000","last_became_peered":"2024-09-10T08:32:25.166580+0000","last_unstale":"2024-09-10T08:32:26.282279+0000","last_undegraded":"2024-09-10T08:32:26.282279+0000","last_fullsized":"2024-09-10T08:32:26.282279+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:30.065612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160904+0000","last_change":"2024-09-10T08:32:25.171029+0000","last_active":"2024-09-10T08:32:26.160904+0000","last_peered":"2024-09-10T08:32:26.160904+0000","last_clean":"2024-09-10T08:32:26.160904+0000","last_became_active":"2024-09-10T08:32:25.170687+0000","last_became_peered":"2024-09-10T08:32:25.170687+0000","last_unstale":"2024-09-10T08:32:26.160904+0000","last_undegraded":"2024-09-10T08:32:26.160904+0000","last_fullsized":"2024-09-10T08:32:26.160904+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:55.487475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281521+0000","last_change":"2024-09-10T08:32:25.183078+0000","last_active":"2024-09-10T08:32:26.281521+0000","last_peered":"2024-09-10T08:32:26.281521+0000","last_clean":"2024-09-10T08:32:26.281521+0000","last_became_active":"2024-09-10T08:32:25.182656+0000","last_became_peered":"2024-09-10T08:32:25.182656+0000","last_unstale":"2024-09-10T08:32:26.281521+0000","last_undegraded":"2024-09-10T08:32:26.281521+0000","last_fullsized":"2024-09-10T08:32:26.281521+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:44.401021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164495+0000","last_change":"2024-09-10T08:32:25.156465+0000","last_active":"2024-09-10T08:32:26.164495+0000","last_peered":"2024-09-10T08:32:26.164495+0000","last_clean":"2024-09-10T08:32:26.164495+0000","last_became_active":"2024-09-10T08:32:25.156186+0000","last_became_peered":"2024-09-10T08:32:25.156186+0000","last_unstale":"2024-09-10T08:32:26.164495+0000","last_undegraded":"2024-09-10T08:32:26.164495+0000","last_fullsized":"2024-09-10T08:32:26.164495+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:55.344090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280233+0000","last_change":"2024-09-10T08:32:25.161045+0000","last_active":"2024-09-10T08:32:26.280233+0000","last_peered":"2024-09-10T08:32:26.280233+0000","last_clean":"2024-09-10T08:32:26.280233+0000","last_became_active":"2024-09-10T08:32:25.160752+0000","last_became_peered":"2024-09-10T08:32:25.160752+0000","last_unstale":"2024-09-10T08:32:26.280233+0000","last_undegraded":"2024-09-10T08:32:26.280233+0000","last_fullsized":"2024-09-10T08:32:26.280233+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:38.287412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164510+0000","last_change":"2024-09-10T08:32:25.160508+0000","last_active":"2024-09-10T08:32:26.164510+0000","last_peered":"2024-09-10T08:32:26.164510+0000","last_clean":"2024-09-10T08:32:26.164510+0000","last_became_active":"2024-09-10T08:32:25.160233+0000","last_became_peered":"2024-09-10T08:32:25.160233+0000","last_unstale":"2024-09-10T08:32:26.164510+0000","last_undegraded":"2024-09-10T08:32:26.164510+0000","last_fullsized":"2024-09-10T08:32:26.164510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:30.508006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163651+0000","last_change":"2024-09-10T08:32:25.165095+0000","last_active":"2024-09-10T08:32:26.163651+0000","last_peered":"2024-09-10T08:32:26.163651+0000","last_clean":"2024-09-10T08:32:26.163651+0000","last_became_active":"2024-09-10T08:32:25.161038+0000","last_became_peered":"2024-09-10T08:32:25.161038+0000","last_unstale":"2024-09-10T08:32:26.163651+0000","last_undegraded":"2024-09-10T08:32:26.163651+0000","last_fullsized":"2024-09-10T08:32:26.163651+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:10.258182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279468+0000","last_change":"2024-09-10T08:32:25.175357+0000","last_active":"2024-09-10T08:32:26.279468+0000","last_peered":"2024-09-10T08:32:26.279468+0000","last_clean":"2024-09-10T08:32:26.279468+0000","last_became_active":"2024-09-10T08:32:25.174890+0000","last_became_peered":"2024-09-10T08:32:25.174890+0000","last_unstale":"2024-09-10T08:32:26.279468+0000","last_undegraded":"2024-09-10T08:32:26.279468+0000","last_fullsized":"2024-09-10T08:32:26.279468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:49.554386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281649+0000","last_change":"2024-09-10T08:32:25.182012+0000","last_active":"2024-09-10T08:32:26.281649+0000","last_peered":"2024-09-10T08:32:26.281649+0000","last_clean":"2024-09-10T08:32:26.281649+0000","last_became_active":"2024-09-10T08:32:25.181625+0000","last_became_peered":"2024-09-10T08:32:25.181625+0000","last_unstale":"2024-09-10T08:32:26.281649+0000","last_undegraded":"2024-09-10T08:32:26.281649+0000","last_fullsized":"2024-09-10T08:32:26.281649+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:03.577931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280643+0000","last_change":"2024-09-10T08:32:25.164379+0000","last_active":"2024-09-10T08:32:26.280643+0000","last_peered":"2024-09-10T08:32:26.280643+0000","last_clean":"2024-09-10T08:32:26.280643+0000","last_became_active":"2024-09-10T08:32:25.164127+0000","last_became_peered":"2024-09-10T08:32:25.164127+0000","last_unstale":"2024-09-10T08:32:26.280643+0000","last_undegraded":"2024-09-10T08:32:26.280643+0000","last_fullsized":"2024-09-10T08:32:26.280643+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:08.255390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281687+0000","last_change":"2024-09-10T08:32:25.179584+0000","last_active":"2024-09-10T08:32:26.281687+0000","last_peered":"2024-09-10T08:32:26.281687+0000","last_clean":"2024-09-10T08:32:26.281687+0000","last_became_active":"2024-09-10T08:32:25.179311+0000","last_became_peered":"2024-09-10T08:32:25.179311+0000","last_unstale":"2024-09-10T08:32:26.281687+0000","last_undegraded":"2024-09-10T08:32:26.281687+0000","last_fullsized":"2024-09-10T08:32:26.281687+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:56.444340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280476+0000","last_change":"2024-09-10T08:32:25.165304+0000","last_active":"2024-09-10T08:32:26.280476+0000","last_peered":"2024-09-10T08:32:26.280476+0000","last_clean":"2024-09-10T08:32:26.280476+0000","last_became_active":"2024-09-10T08:32:25.164955+0000","last_became_peered":"2024-09-10T08:32:25.164955+0000","last_unstale":"2024-09-10T08:32:26.280476+0000","last_undegraded":"2024-09-10T08:32:26.280476+0000","last_fullsized":"2024-09-10T08:32:26.280476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:06.512577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280552+0000","last_change":"2024-09-10T08:32:25.171501+0000","last_active":"2024-09-10T08:32:26.280552+0000","last_peered":"2024-09-10T08:32:26.280552+0000","last_clean":"2024-09-10T08:32:26.280552+0000","last_became_active":"2024-09-10T08:32:25.170830+0000","last_became_peered":"2024-09-10T08:32:25.170830+0000","last_unstale":"2024-09-10T08:32:26.280552+0000","last_undegraded":"2024-09-10T08:32:26.280552+0000","last_fullsized":"2024-09-10T08:32:26.280552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:48:30.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163563+0000","last_change":"2024-09-10T08:32:25.155783+0000","last_active":"2024-09-10T08:32:26.163563+0000","last_peered":"2024-09-10T08:32:26.163563+0000","last_clean":"2024-09-10T08:32:26.163563+0000","last_became_active":"2024-09-10T08:32:25.155491+0000","last_became_peered":"2024-09-10T08:32:25.155491+0000","last_unstale":"2024-09-10T08:32:26.163563+0000","last_undegraded":"2024-09-10T08:32:26.163563+0000","last_fullsized":"2024-09-10T08:32:26.163563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:06.068454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280988+0000","last_change":"2024-09-10T08:32:25.166383+0000","last_active":"2024-09-10T08:32:26.280988+0000","last_peered":"2024-09-10T08:32:26.280988+0000","last_clean":"2024-09-10T08:32:26.280988+0000","last_became_active":"2024-09-10T08:32:25.166120+0000","last_became_peered":"2024-09-10T08:32:25.166120+0000","last_unstale":"2024-09-10T08:32:26.280988+0000","last_undegraded":"2024-09-10T08:32:26.280988+0000","last_fullsized":"2024-09-10T08:32:26.280988+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:39.386492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164379+0000","last_change":"2024-09-10T08:32:25.161512+0000","last_active":"2024-09-10T08:32:26.164379+0000","last_peered":"2024-09-10T08:32:26.164379+0000","last_clean":"2024-09-10T08:32:26.164379+0000","last_became_active":"2024-09-10T08:32:25.161249+0000","last_became_peered":"2024-09-10T08:32:25.161249+0000","last_unstale":"2024-09-10T08:32:26.164379+0000","last_undegraded":"2024-09-10T08:32:26.164379+0000","last_fullsized":"2024-09-10T08:32:26.164379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:16.966704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282160+0000","last_change":"2024-09-10T08:32:25.161848+0000","last_active":"2024-09-10T08:32:26.282160+0000","last_peered":"2024-09-10T08:32:26.282160+0000","last_clean":"2024-09-10T08:32:26.282160+0000","last_became_active":"2024-09-10T08:32:25.161174+0000","last_became_peered":"2024-09-10T08:32:25.161174+0000","last_unstale":"2024-09-10T08:32:26.282160+0000","last_undegraded":"2024-09-10T08:32:26.282160+0000","last_fullsized":"2024-09-10T08:32:26.282160+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:11.405198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"60'4","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164458+0000","last_change":"2024-09-10T08:32:24.162104+0000","last_active":"2024-09-10T08:32:26.164458+0000","last_peered":"2024-09-10T08:32:26.164458+0000","last_clean":"2024-09-10T08:32:26.164458+0000","last_became_active":"2024-09-10T08:32:24.160974+0000","last_became_peered":"2024-09-10T08:32:24.160974+0000","last_unstale":"2024-09-10T08:32:26.164458+0000","last_undegraded":"2024-09-10T08:32:26.164458+0000","last_fullsized":"2024-09-10T08:32:26.164458+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:10.402388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282388+0000","last_change":"2024-09-10T08:32:25.167667+0000","last_active":"2024-09-10T08:32:26.282388+0000","last_peered":"2024-09-10T08:32:26.282388+0000","last_clean":"2024-09-10T08:32:26.282388+0000","last_became_active":"2024-09-10T08:32:25.167129+0000","last_became_peered":"2024-09-10T08:32:25.167129+0000","last_unstale":"2024-09-10T08:32:26.282388+0000","last_undegraded":"2024-09-10T08:32:26.282388+0000","last_fullsized":"2024-09-10T08:32:26.282388+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:27.115517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281670+0000","last_change":"2024-09-10T08:32:24.165316+0000","last_active":"2024-09-10T08:32:26.281670+0000","last_peered":"2024-09-10T08:32:26.281670+0000","last_clean":"2024-09-10T08:32:26.281670+0000","last_became_active":"2024-09-10T08:32:24.165042+0000","last_became_peered":"2024-09-10T08:32:24.165042+0000","last_unstale":"2024-09-10T08:32:26.281670+0000","last_undegraded":"2024-09-10T08:32:26.281670+0000","last_fullsized":"2024-09-10T08:32:26.281670+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:44:39.526314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280575+0000","last_change":"2024-09-10T08:32:25.178616+0000","last_active":"2024-09-10T08:32:26.280575+0000","last_peered":"2024-09-10T08:32:26.280575+0000","last_clean":"2024-09-10T08:32:26.280575+0000","last_became_active":"2024-09-10T08:32:25.178160+0000","last_became_peered":"2024-09-10T08:32:25.178160+0000","last_unstale":"2024-09-10T08:32:26.280575+0000","last_undegraded":"2024-09-10T08:32:26.280575+0000","last_fullsized":"2024-09-10T08:32:26.280575+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:34.627236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282020+0000","last_change":"2024-09-10T08:32:24.159693+0000","last_active":"2024-09-10T08:32:26.282020+0000","last_peered":"2024-09-10T08:32:26.282020+0000","last_clean":"2024-09-10T08:32:26.282020+0000","last_became_active":"2024-09-10T08:32:24.159350+0000","last_became_peered":"2024-09-10T08:32:24.159350+0000","last_unstale":"2024-09-10T08:32:26.282020+0000","last_undegraded":"2024-09-10T08:32:26.282020+0000","last_fullsized":"2024-09-10T08:32:26.282020+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:00.092515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281929+0000","last_change":"2024-09-10T08:32:25.165342+0000","last_active":"2024-09-10T08:32:26.281929+0000","last_peered":"2024-09-10T08:32:26.281929+0000","last_clean":"2024-09-10T08:32:26.281929+0000","last_became_active":"2024-09-10T08:32:25.165098+0000","last_became_peered":"2024-09-10T08:32:25.165098+0000","last_unstale":"2024-09-10T08:32:26.281929+0000","last_undegraded":"2024-09-10T08:32:26.281929+0000","last_fullsized":"2024-09-10T08:32:26.281929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:25.884121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164010+0000","last_change":"2024-09-10T08:32:24.154313+0000","last_active":"2024-09-10T08:32:26.164010+0000","last_peered":"2024-09-10T08:32:26.164010+0000","last_clean":"2024-09-10T08:32:26.164010+0000","last_became_active":"2024-09-10T08:32:24.153991+0000","last_became_peered":"2024-09-10T08:32:24.153991+0000","last_unstale":"2024-09-10T08:32:26.164010+0000","last_undegraded":"2024-09-10T08:32:26.164010+0000","last_fullsized":"2024-09-10T08:32:26.164010+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:21.009386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280650+0000","last_change":"2024-09-10T08:32:25.169611+0000","last_active":"2024-09-10T08:32:26.280650+0000","last_peered":"2024-09-10T08:32:26.280650+0000","last_clean":"2024-09-10T08:32:26.280650+0000","last_became_active":"2024-09-10T08:32:25.160291+0000","last_became_peered":"2024-09-10T08:32:25.160291+0000","last_unstale":"2024-09-10T08:32:26.280650+0000","last_undegraded":"2024-09-10T08:32:26.280650+0000","last_fullsized":"2024-09-10T08:32:26.280650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:13.177652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160678+0000","last_change":"2024-09-10T08:32:24.159316+0000","last_active":"2024-09-10T08:32:26.160678+0000","last_peered":"2024-09-10T08:32:26.160678+0000","last_clean":"2024-09-10T08:32:26.160678+0000","last_became_active":"2024-09-10T08:32:24.159005+0000","last_became_peered":"2024-09-10T08:32:24.159005+0000","last_unstale":"2024-09-10T08:32:26.160678+0000","last_undegraded":"2024-09-10T08:32:26.160678+0000","last_fullsized":"2024-09-10T08:32:26.160678+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.646911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164550+0000","last_change":"2024-09-10T08:32:25.164582+0000","last_active":"2024-09-10T08:32:26.164550+0000","last_peered":"2024-09-10T08:32:26.164550+0000","last_clean":"2024-09-10T08:32:26.164550+0000","last_became_active":"2024-09-10T08:32:25.164255+0000","last_became_peered":"2024-09-10T08:32:25.164255+0000","last_unstale":"2024-09-10T08:32:26.164550+0000","last_undegraded":"2024-09-10T08:32:26.164550+0000","last_fullsized":"2024-09-10T08:32:26.164550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:37.235162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280047+0000","last_change":"2024-09-10T08:32:24.154485+0000","last_active":"2024-09-10T08:32:26.280047+0000","last_peered":"2024-09-10T08:32:26.280047+0000","last_clean":"2024-09-10T08:32:26.280047+0000","last_became_active":"2024-09-10T08:32:24.154218+0000","last_became_peered":"2024-09-10T08:32:24.154218+0000","last_unstale":"2024-09-10T08:32:26.280047+0000","last_undegraded":"2024-09-10T08:32:26.280047+0000","last_fullsized":"2024-09-10T08:32:26.280047+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:02.575122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160506+0000","last_change":"2024-09-10T08:32:25.154994+0000","last_active":"2024-09-10T08:32:26.160506+0000","last_peered":"2024-09-10T08:32:26.160506+0000","last_clean":"2024-09-10T08:32:26.160506+0000","last_became_active":"2024-09-10T08:32:25.154737+0000","last_became_peered":"2024-09-10T08:32:25.154737+0000","last_unstale":"2024-09-10T08:32:26.160506+0000","last_undegraded":"2024-09-10T08:32:26.160506+0000","last_fullsized":"2024-09-10T08:32:26.160506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:30.065612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279660+0000","last_change":"2024-09-10T08:32:24.165574+0000","last_active":"2024-09-10T08:32:26.279660+0000","last_peered":"2024-09-10T08:32:26.279660+0000","last_clean":"2024-09-10T08:32:26.279660+0000","last_became_active":"2024-09-10T08:32:24.165300+0000","last_became_peered":"2024-09-10T08:32:24.165300+0000","last_unstale":"2024-09-10T08:32:26.279660+0000","last_undegraded":"2024-09-10T08:32:26.279660+0000","last_fullsized":"2024-09-10T08:32:26.279660+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:43.842678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279790+0000","last_change":"2024-09-10T08:32:25.177949+0000","last_active":"2024-09-10T08:32:26.279790+0000","last_peered":"2024-09-10T08:32:26.279790+0000","last_clean":"2024-09-10T08:32:26.279790+0000","last_became_active":"2024-09-10T08:32:25.175920+0000","last_became_peered":"2024-09-10T08:32:25.175920+0000","last_unstale":"2024-09-10T08:32:26.279790+0000","last_undegraded":"2024-09-10T08:32:26.279790+0000","last_fullsized":"2024-09-10T08:32:26.279790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:38.287412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279521+0000","last_change":"2024-09-10T08:32:24.163403+0000","last_active":"2024-09-10T08:32:26.279521+0000","last_peered":"2024-09-10T08:32:26.279521+0000","last_clean":"2024-09-10T08:32:26.279521+0000","last_became_active":"2024-09-10T08:32:24.162449+0000","last_became_peered":"2024-09-10T08:32:24.162449+0000","last_unstale":"2024-09-10T08:32:26.279521+0000","last_undegraded":"2024-09-10T08:32:26.279521+0000","last_fullsized":"2024-09-10T08:32:26.279521+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:35:40.167399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280688+0000","last_change":"2024-09-10T08:32:25.157398+0000","last_active":"2024-09-10T08:32:26.280688+0000","last_peered":"2024-09-10T08:32:26.280688+0000","last_clean":"2024-09-10T08:32:26.280688+0000","last_became_active":"2024-09-10T08:32:25.157122+0000","last_became_peered":"2024-09-10T08:32:25.157122+0000","last_unstale":"2024-09-10T08:32:26.280688+0000","last_undegraded":"2024-09-10T08:32:26.280688+0000","last_fullsized":"2024-09-10T08:32:26.280688+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:02.201285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280191+0000","last_change":"2024-09-10T08:32:24.163145+0000","last_active":"2024-09-10T08:32:26.280191+0000","last_peered":"2024-09-10T08:32:26.280191+0000","last_clean":"2024-09-10T08:32:26.280191+0000","last_became_active":"2024-09-10T08:32:24.162835+0000","last_became_peered":"2024-09-10T08:32:24.162835+0000","last_unstale":"2024-09-10T08:32:26.280191+0000","last_undegraded":"2024-09-10T08:32:26.280191+0000","last_fullsized":"2024-09-10T08:32:26.280191+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:47.043606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.161199+0000","last_change":"2024-09-10T08:32:25.174367+0000","last_active":"2024-09-10T08:32:26.161199+0000","last_peered":"2024-09-10T08:32:26.161199+0000","last_clean":"2024-09-10T08:32:26.161199+0000","last_became_active":"2024-09-10T08:32:25.174101+0000","last_became_peered":"2024-09-10T08:32:25.174101+0000","last_unstale":"2024-09-10T08:32:26.161199+0000","last_undegraded":"2024-09-10T08:32:26.161199+0000","last_fullsized":"2024-09-10T08:32:26.161199+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:30.508006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280688+0000","last_change":"2024-09-10T08:32:24.161471+0000","last_active":"2024-09-10T08:32:26.280688+0000","last_peered":"2024-09-10T08:32:26.280688+0000","last_clean":"2024-09-10T08:32:26.280688+0000","last_became_active":"2024-09-10T08:32:24.160009+0000","last_became_peered":"2024-09-10T08:32:24.160009+0000","last_unstale":"2024-09-10T08:32:26.280688+0000","last_undegraded":"2024-09-10T08:32:26.280688+0000","last_fullsized":"2024-09-10T08:32:26.280688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:02.401139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280817+0000","last_change":"2024-09-10T08:32:25.178400+0000","last_active":"2024-09-10T08:32:26.280817+0000","last_peered":"2024-09-10T08:32:26.280817+0000","last_clean":"2024-09-10T08:32:26.280817+0000","last_became_active":"2024-09-10T08:32:25.177837+0000","last_became_peered":"2024-09-10T08:32:25.177837+0000","last_unstale":"2024-09-10T08:32:26.280817+0000","last_undegraded":"2024-09-10T08:32:26.280817+0000","last_fullsized":"2024-09-10T08:32:26.280817+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:28:05.029416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"60'3","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163753+0000","last_change":"2024-09-10T08:32:24.156801+0000","last_active":"2024-09-10T08:32:26.163753+0000","last_peered":"2024-09-10T08:32:26.163753+0000","last_clean":"2024-09-10T08:32:26.163753+0000","last_became_active":"2024-09-10T08:32:24.156520+0000","last_became_peered":"2024-09-10T08:32:24.156520+0000","last_unstale":"2024-09-10T08:32:26.163753+0000","last_undegraded":"2024-09-10T08:32:26.163753+0000","last_fullsized":"2024-09-10T08:32:26.163753+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:43.462302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163650+0000","last_change":"2024-09-10T08:32:25.163401+0000","last_active":"2024-09-10T08:32:26.163650+0000","last_peered":"2024-09-10T08:32:26.163650+0000","last_clean":"2024-09-10T08:32:26.163650+0000","last_became_active":"2024-09-10T08:32:25.163078+0000","last_became_peered":"2024-09-10T08:32:25.163078+0000","last_unstale":"2024-09-10T08:32:26.163650+0000","last_undegraded":"2024-09-10T08:32:26.163650+0000","last_fullsized":"2024-09-10T08:32:26.163650+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:22.887492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"60'6","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280557+0000","last_change":"2024-09-10T08:32:24.166153+0000","last_active":"2024-09-10T08:32:26.280557+0000","last_peered":"2024-09-10T08:32:26.280557+0000","last_clean":"2024-09-10T08:32:26.280557+0000","last_became_active":"2024-09-10T08:32:24.165858+0000","last_became_peered":"2024-09-10T08:32:24.165858+0000","last_unstale":"2024-09-10T08:32:26.280557+0000","last_undegraded":"2024-09-10T08:32:26.280557+0000","last_fullsized":"2024-09-10T08:32:26.280557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:17.486040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279714+0000","last_change":"2024-09-10T08:32:25.166730+0000","last_active":"2024-09-10T08:32:26.279714+0000","last_peered":"2024-09-10T08:32:26.279714+0000","last_clean":"2024-09-10T08:32:26.279714+0000","last_became_active":"2024-09-10T08:32:25.166123+0000","last_became_peered":"2024-09-10T08:32:25.166123+0000","last_unstale":"2024-09-10T08:32:26.279714+0000","last_undegraded":"2024-09-10T08:32:26.279714+0000","last_fullsized":"2024-09-10T08:32:26.279714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:39.386492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280775+0000","last_change":"2024-09-10T08:32:24.159349+0000","last_active":"2024-09-10T08:32:26.280775+0000","last_peered":"2024-09-10T08:32:26.280775+0000","last_clean":"2024-09-10T08:32:26.280775+0000","last_became_active":"2024-09-10T08:32:24.159072+0000","last_became_peered":"2024-09-10T08:32:24.159072+0000","last_unstale":"2024-09-10T08:32:26.280775+0000","last_undegraded":"2024-09-10T08:32:26.280775+0000","last_fullsized":"2024-09-10T08:32:26.280775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:56:29.680184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160626+0000","last_change":"2024-09-10T08:32:25.159900+0000","last_active":"2024-09-10T08:32:26.160626+0000","last_peered":"2024-09-10T08:32:26.160626+0000","last_clean":"2024-09-10T08:32:26.160626+0000","last_became_active":"2024-09-10T08:32:25.159526+0000","last_became_peered":"2024-09-10T08:32:25.159526+0000","last_unstale":"2024-09-10T08:32:26.160626+0000","last_undegraded":"2024-09-10T08:32:26.160626+0000","last_fullsized":"2024-09-10T08:32:26.160626+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:03.127378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163564+0000","last_change":"2024-09-10T08:32:24.159347+0000","last_active":"2024-09-10T08:32:26.163564+0000","last_peered":"2024-09-10T08:32:26.163564+0000","last_clean":"2024-09-10T08:32:26.163564+0000","last_became_active":"2024-09-10T08:32:24.158536+0000","last_became_peered":"2024-09-10T08:32:24.158536+0000","last_unstale":"2024-09-10T08:32:26.163564+0000","last_undegraded":"2024-09-10T08:32:26.163564+0000","last_fullsized":"2024-09-10T08:32:26.163564+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.988251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279547+0000","last_change":"2024-09-10T08:32:25.157391+0000","last_active":"2024-09-10T08:32:26.279547+0000","last_peered":"2024-09-10T08:32:26.279547+0000","last_clean":"2024-09-10T08:32:26.279547+0000","last_became_active":"2024-09-10T08:32:25.157027+0000","last_became_peered":"2024-09-10T08:32:25.157027+0000","last_unstale":"2024-09-10T08:32:26.279547+0000","last_undegraded":"2024-09-10T08:32:26.279547+0000","last_fullsized":"2024-09-10T08:32:26.279547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:07.120079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163753+0000","last_change":"2024-09-10T08:32:24.155976+0000","last_active":"2024-09-10T08:32:26.163753+0000","last_peered":"2024-09-10T08:32:26.163753+0000","last_clean":"2024-09-10T08:32:26.163753+0000","last_became_active":"2024-09-10T08:32:24.155662+0000","last_became_peered":"2024-09-10T08:32:24.155662+0000","last_unstale":"2024-09-10T08:32:26.163753+0000","last_undegraded":"2024-09-10T08:32:26.163753+0000","last_fullsized":"2024-09-10T08:32:26.163753+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:23.053424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163736+0000","last_change":"2024-09-10T08:32:25.162851+0000","last_active":"2024-09-10T08:32:26.163736+0000","last_peered":"2024-09-10T08:32:26.163736+0000","last_clean":"2024-09-10T08:32:26.163736+0000","last_became_active":"2024-09-10T08:32:25.160952+0000","last_became_peered":"2024-09-10T08:32:25.160952+0000","last_unstale":"2024-09-10T08:32:26.163736+0000","last_undegraded":"2024-09-10T08:32:26.163736+0000","last_fullsized":"2024-09-10T08:32:26.163736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:00.699531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"60'8","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163729+0000","last_change":"2024-09-10T08:32:24.161542+0000","last_active":"2024-09-10T08:32:26.163729+0000","last_peered":"2024-09-10T08:32:26.163729+0000","last_clean":"2024-09-10T08:32:26.163729+0000","last_became_active":"2024-09-10T08:32:24.161209+0000","last_became_peered":"2024-09-10T08:32:24.161209+0000","last_unstale":"2024-09-10T08:32:26.163729+0000","last_undegraded":"2024-09-10T08:32:26.163729+0000","last_fullsized":"2024-09-10T08:32:26.163729+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:16.015777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160982+0000","last_change":"2024-09-10T08:32:25.158055+0000","last_active":"2024-09-10T08:32:26.160982+0000","last_peered":"2024-09-10T08:32:26.160982+0000","last_clean":"2024-09-10T08:32:26.160982+0000","last_became_active":"2024-09-10T08:32:25.157777+0000","last_became_peered":"2024-09-10T08:32:25.157777+0000","last_unstale":"2024-09-10T08:32:26.160982+0000","last_undegraded":"2024-09-10T08:32:26.160982+0000","last_fullsized":"2024-09-10T08:32:26.160982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:15:18.381328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281716+0000","last_change":"2024-09-10T08:32:24.160497+0000","last_active":"2024-09-10T08:32:26.281716+0000","last_peered":"2024-09-10T08:32:26.281716+0000","last_clean":"2024-09-10T08:32:26.281716+0000","last_became_active":"2024-09-10T08:32:24.160209+0000","last_became_peered":"2024-09-10T08:32:24.160209+0000","last_unstale":"2024-09-10T08:32:26.281716+0000","last_undegraded":"2024-09-10T08:32:26.281716+0000","last_fullsized":"2024-09-10T08:32:26.281716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:33.637982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.161202+0000","last_change":"2024-09-10T08:32:25.174117+0000","last_active":"2024-09-10T08:32:26.161202+0000","last_peered":"2024-09-10T08:32:26.161202+0000","last_clean":"2024-09-10T08:32:26.161202+0000","last_became_active":"2024-09-10T08:32:25.173113+0000","last_became_peered":"2024-09-10T08:32:25.173113+0000","last_unstale":"2024-09-10T08:32:26.161202+0000","last_undegraded":"2024-09-10T08:32:26.161202+0000","last_fullsized":"2024-09-10T08:32:26.161202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:55.344090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158627+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158081+0000","last_became_peered":"2024-09-10T08:32:24.158081+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:59.562165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281178+0000","last_change":"2024-09-10T08:32:25.173124+0000","last_active":"2024-09-10T08:32:26.281178+0000","last_peered":"2024-09-10T08:32:26.281178+0000","last_clean":"2024-09-10T08:32:26.281178+0000","last_became_active":"2024-09-10T08:32:25.172705+0000","last_became_peered":"2024-09-10T08:32:25.172705+0000","last_unstale":"2024-09-10T08:32:26.281178+0000","last_undegraded":"2024-09-10T08:32:26.281178+0000","last_fullsized":"2024-09-10T08:32:26.281178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:44.537514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.161289+0000","last_change":"2024-09-10T08:32:24.161818+0000","last_active":"2024-09-10T08:32:26.161289+0000","last_peered":"2024-09-10T08:32:26.161289+0000","last_clean":"2024-09-10T08:32:26.161289+0000","last_became_active":"2024-09-10T08:32:24.161093+0000","last_became_peered":"2024-09-10T08:32:24.161093+0000","last_unstale":"2024-09-10T08:32:26.161289+0000","last_undegraded":"2024-09-10T08:32:26.161289+0000","last_fullsized":"2024-09-10T08:32:26.161289+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:44:16.638978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.163751+0000","last_change":"2024-09-10T08:32:25.157060+0000","last_active":"2024-09-10T08:32:26.163751+0000","last_peered":"2024-09-10T08:32:26.163751+0000","last_clean":"2024-09-10T08:32:26.163751+0000","last_became_active":"2024-09-10T08:32:25.156744+0000","last_became_peered":"2024-09-10T08:32:25.156744+0000","last_unstale":"2024-09-10T08:32:26.163751+0000","last_undegraded":"2024-09-10T08:32:26.163751+0000","last_fullsized":"2024-09-10T08:32:26.163751+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:57.530837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280800+0000","last_change":"2024-09-10T08:32:24.158676+0000","last_active":"2024-09-10T08:32:26.280800+0000","last_peered":"2024-09-10T08:32:26.280800+0000","last_clean":"2024-09-10T08:32:26.280800+0000","last_became_active":"2024-09-10T08:32:24.158391+0000","last_became_peered":"2024-09-10T08:32:24.158391+0000","last_unstale":"2024-09-10T08:32:26.280800+0000","last_undegraded":"2024-09-10T08:32:26.280800+0000","last_fullsized":"2024-09-10T08:32:26.280800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.081154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279855+0000","last_change":"2024-09-10T08:32:25.166935+0000","last_active":"2024-09-10T08:32:26.279855+0000","last_peered":"2024-09-10T08:32:26.279855+0000","last_clean":"2024-09-10T08:32:26.279855+0000","last_became_active":"2024-09-10T08:32:25.166478+0000","last_became_peered":"2024-09-10T08:32:25.166478+0000","last_unstale":"2024-09-10T08:32:26.279855+0000","last_undegraded":"2024-09-10T08:32:26.279855+0000","last_fullsized":"2024-09-10T08:32:26.279855+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:45.611791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.164666+0000","last_change":"2024-09-10T08:32:24.165473+0000","last_active":"2024-09-10T08:32:26.164666+0000","last_peered":"2024-09-10T08:32:26.164666+0000","last_clean":"2024-09-10T08:32:26.164666+0000","last_became_active":"2024-09-10T08:32:24.165182+0000","last_became_peered":"2024-09-10T08:32:24.165182+0000","last_unstale":"2024-09-10T08:32:26.164666+0000","last_undegraded":"2024-09-10T08:32:26.164666+0000","last_fullsized":"2024-09-10T08:32:26.164666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:04.637925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280601+0000","last_change":"2024-09-10T08:32:25.171746+0000","last_active":"2024-09-10T08:32:26.280601+0000","last_peered":"2024-09-10T08:32:26.280601+0000","last_clean":"2024-09-10T08:32:26.280601+0000","last_became_active":"2024-09-10T08:32:25.171207+0000","last_became_peered":"2024-09-10T08:32:25.171207+0000","last_unstale":"2024-09-10T08:32:26.280601+0000","last_undegraded":"2024-09-10T08:32:26.280601+0000","last_fullsized":"2024-09-10T08:32:26.280601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:36.297951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280394+0000","last_change":"2024-09-10T08:32:24.162270+0000","last_active":"2024-09-10T08:32:26.280394+0000","last_peered":"2024-09-10T08:32:26.280394+0000","last_clean":"2024-09-10T08:32:26.280394+0000","last_became_active":"2024-09-10T08:32:24.161849+0000","last_became_peered":"2024-09-10T08:32:24.161849+0000","last_unstale":"2024-09-10T08:32:26.280394+0000","last_undegraded":"2024-09-10T08:32:26.280394+0000","last_fullsized":"2024-09-10T08:32:26.280394+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:16:09.348585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280457+0000","last_change":"2024-09-10T08:32:25.176004+0000","last_active":"2024-09-10T08:32:26.280457+0000","last_peered":"2024-09-10T08:32:26.280457+0000","last_clean":"2024-09-10T08:32:26.280457+0000","last_became_active":"2024-09-10T08:32:25.175730+0000","last_became_peered":"2024-09-10T08:32:25.175730+0000","last_unstale":"2024-09-10T08:32:26.280457+0000","last_undegraded":"2024-09-10T08:32:26.280457+0000","last_fullsized":"2024-09-10T08:32:26.280457+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:06.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279567+0000","last_change":"2024-09-10T08:32:24.159571+0000","last_active":"2024-09-10T08:32:26.279567+0000","last_peered":"2024-09-10T08:32:26.279567+0000","last_clean":"2024-09-10T08:32:26.279567+0000","last_became_active":"2024-09-10T08:32:24.159007+0000","last_became_peered":"2024-09-10T08:32:24.159007+0000","last_unstale":"2024-09-10T08:32:26.279567+0000","last_undegraded":"2024-09-10T08:32:26.279567+0000","last_fullsized":"2024-09-10T08:32:26.279567+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:24.178590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.161109+0000","last_change":"2024-09-10T08:32:25.164873+0000","last_active":"2024-09-10T08:32:26.161109+0000","last_peered":"2024-09-10T08:32:26.161109+0000","last_clean":"2024-09-10T08:32:26.161109+0000","last_became_active":"2024-09-10T08:32:25.164321+0000","last_became_peered":"2024-09-10T08:32:25.164321+0000","last_unstale":"2024-09-10T08:32:26.161109+0000","last_undegraded":"2024-09-10T08:32:26.161109+0000","last_fullsized":"2024-09-10T08:32:26.161109+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:09:16.966704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"60'2","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281813+0000","last_change":"2024-09-10T08:32:24.160317+0000","last_active":"2024-09-10T08:32:26.281813+0000","last_peered":"2024-09-10T08:32:26.281813+0000","last_clean":"2024-09-10T08:32:26.281813+0000","last_became_active":"2024-09-10T08:32:24.158842+0000","last_became_peered":"2024-09-10T08:32:24.158842+0000","last_unstale":"2024-09-10T08:32:26.281813+0000","last_undegraded":"2024-09-10T08:32:26.281813+0000","last_fullsized":"2024-09-10T08:32:26.281813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:32.333646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.161342+0000","last_change":"2024-09-10T08:32:25.163777+0000","last_active":"2024-09-10T08:32:26.161342+0000","last_peered":"2024-09-10T08:32:26.161342+0000","last_clean":"2024-09-10T08:32:26.161342+0000","last_became_active":"2024-09-10T08:32:25.162979+0000","last_became_peered":"2024-09-10T08:32:25.162979+0000","last_unstale":"2024-09-10T08:32:26.161342+0000","last_undegraded":"2024-09-10T08:32:26.161342+0000","last_fullsized":"2024-09-10T08:32:26.161342+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:37.235162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.282185+0000","last_change":"2024-09-10T08:32:24.166154+0000","last_active":"2024-09-10T08:32:26.282185+0000","last_peered":"2024-09-10T08:32:26.282185+0000","last_clean":"2024-09-10T08:32:26.282185+0000","last_became_active":"2024-09-10T08:32:24.165827+0000","last_became_peered":"2024-09-10T08:32:24.165827+0000","last_unstale":"2024-09-10T08:32:26.282185+0000","last_undegraded":"2024-09-10T08:32:26.282185+0000","last_fullsized":"2024-09-10T08:32:26.282185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:43.398211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281411+0000","last_change":"2024-09-10T08:32:25.169080+0000","last_active":"2024-09-10T08:32:26.281411+0000","last_peered":"2024-09-10T08:32:26.281411+0000","last_clean":"2024-09-10T08:32:26.281411+0000","last_became_active":"2024-09-10T08:32:25.168717+0000","last_became_peered":"2024-09-10T08:32:25.168717+0000","last_unstale":"2024-09-10T08:32:26.281411+0000","last_undegraded":"2024-09-10T08:32:26.281411+0000","last_fullsized":"2024-09-10T08:32:26.281411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:01.095325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280101+0000","last_change":"2024-09-10T08:32:24.167261+0000","last_active":"2024-09-10T08:32:26.280101+0000","last_peered":"2024-09-10T08:32:26.280101+0000","last_clean":"2024-09-10T08:32:26.280101+0000","last_became_active":"2024-09-10T08:32:24.166919+0000","last_became_peered":"2024-09-10T08:32:24.166919+0000","last_unstale":"2024-09-10T08:32:26.280101+0000","last_undegraded":"2024-09-10T08:32:26.280101+0000","last_fullsized":"2024-09-10T08:32:26.280101+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:50.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280868+0000","last_change":"2024-09-10T08:32:25.161153+0000","last_active":"2024-09-10T08:32:26.280868+0000","last_peered":"2024-09-10T08:32:26.280868+0000","last_clean":"2024-09-10T08:32:26.280868+0000","last_became_active":"2024-09-10T08:32:25.160777+0000","last_became_peered":"2024-09-10T08:32:25.160777+0000","last_unstale":"2024-09-10T08:32:26.280868+0000","last_undegraded":"2024-09-10T08:32:26.280868+0000","last_fullsized":"2024-09-10T08:32:26.280868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:28.805917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160766+0000","last_change":"2024-09-10T08:32:24.155506+0000","last_active":"2024-09-10T08:32:26.160766+0000","last_peered":"2024-09-10T08:32:26.160766+0000","last_clean":"2024-09-10T08:32:26.160766+0000","last_became_active":"2024-09-10T08:32:24.154291+0000","last_became_peered":"2024-09-10T08:32:24.154291+0000","last_unstale":"2024-09-10T08:32:26.160766+0000","last_undegraded":"2024-09-10T08:32:26.160766+0000","last_fullsized":"2024-09-10T08:32:26.160766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:03:13.157259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280042+0000","last_change":"2024-09-10T08:32:25.162732+0000","last_active":"2024-09-10T08:32:26.280042+0000","last_peered":"2024-09-10T08:32:26.280042+0000","last_clean":"2024-09-10T08:32:26.280042+0000","last_became_active":"2024-09-10T08:32:25.162068+0000","last_became_peered":"2024-09-10T08:32:25.162068+0000","last_unstale":"2024-09-10T08:32:26.280042+0000","last_undegraded":"2024-09-10T08:32:26.280042+0000","last_fullsized":"2024-09-10T08:32:26.280042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:02.201285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281202+0000","last_change":"2024-09-10T08:32:24.154949+0000","last_active":"2024-09-10T08:32:26.281202+0000","last_peered":"2024-09-10T08:32:26.281202+0000","last_clean":"2024-09-10T08:32:26.281202+0000","last_became_active":"2024-09-10T08:32:24.153289+0000","last_became_peered":"2024-09-10T08:32:24.153289+0000","last_unstale":"2024-09-10T08:32:26.281202+0000","last_undegraded":"2024-09-10T08:32:26.281202+0000","last_fullsized":"2024-09-10T08:32:26.281202+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:50.269293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280372+0000","last_change":"2024-09-10T08:32:25.176014+0000","last_active":"2024-09-10T08:32:26.280372+0000","last_peered":"2024-09-10T08:32:26.280372+0000","last_clean":"2024-09-10T08:32:26.280372+0000","last_became_active":"2024-09-10T08:32:25.175731+0000","last_became_peered":"2024-09-10T08:32:25.175731+0000","last_unstale":"2024-09-10T08:32:26.280372+0000","last_undegraded":"2024-09-10T08:32:26.280372+0000","last_fullsized":"2024-09-10T08:32:26.280372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:09.487560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.160620+0000","last_change":"2024-09-10T08:32:24.162218+0000","last_active":"2024-09-10T08:32:26.160620+0000","last_peered":"2024-09-10T08:32:26.160620+0000","last_clean":"2024-09-10T08:32:26.160620+0000","last_became_active":"2024-09-10T08:32:24.159383+0000","last_became_peered":"2024-09-10T08:32:24.159383+0000","last_unstale":"2024-09-10T08:32:26.160620+0000","last_undegraded":"2024-09-10T08:32:26.160620+0000","last_fullsized":"2024-09-10T08:32:26.160620+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:06.046135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280007+0000","last_change":"2024-09-10T08:32:25.177447+0000","last_active":"2024-09-10T08:32:26.280007+0000","last_peered":"2024-09-10T08:32:26.280007+0000","last_clean":"2024-09-10T08:32:26.280007+0000","last_became_active":"2024-09-10T08:32:25.177118+0000","last_became_peered":"2024-09-10T08:32:25.177118+0000","last_unstale":"2024-09-10T08:32:26.280007+0000","last_undegraded":"2024-09-10T08:32:26.280007+0000","last_fullsized":"2024-09-10T08:32:26.280007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:52.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279904+0000","last_change":"2024-09-10T08:32:24.157040+0000","last_active":"2024-09-10T08:32:26.279904+0000","last_peered":"2024-09-10T08:32:26.279904+0000","last_clean":"2024-09-10T08:32:26.279904+0000","last_became_active":"2024-09-10T08:32:24.156709+0000","last_became_peered":"2024-09-10T08:32:24.156709+0000","last_unstale":"2024-09-10T08:32:26.279904+0000","last_undegraded":"2024-09-10T08:32:26.279904+0000","last_fullsized":"2024-09-10T08:32:26.279904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:43.534705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.281022+0000","last_change":"2024-09-10T08:32:25.174293+0000","last_active":"2024-09-10T08:32:26.281022+0000","last_peered":"2024-09-10T08:32:26.281022+0000","last_clean":"2024-09-10T08:32:26.281022+0000","last_became_active":"2024-09-10T08:32:25.174003+0000","last_became_peered":"2024-09-10T08:32:25.174003+0000","last_unstale":"2024-09-10T08:32:26.281022+0000","last_undegraded":"2024-09-10T08:32:26.281022+0000","last_fullsized":"2024-09-10T08:32:26.281022+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:45.611791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280122+0000","last_change":"2024-09-10T08:32:24.158256+0000","last_active":"2024-09-10T08:32:26.280122+0000","last_peered":"2024-09-10T08:32:26.280122+0000","last_clean":"2024-09-10T08:32:26.280122+0000","last_became_active":"2024-09-10T08:32:24.157987+0000","last_became_peered":"2024-09-10T08:32:24.157987+0000","last_unstale":"2024-09-10T08:32:26.280122+0000","last_undegraded":"2024-09-10T08:32:26.280122+0000","last_fullsized":"2024-09-10T08:32:26.280122+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:26.320171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.280286+0000","last_change":"2024-09-10T08:32:25.170475+0000","last_active":"2024-09-10T08:32:26.280286+0000","last_peered":"2024-09-10T08:32:26.280286+0000","last_clean":"2024-09-10T08:32:26.280286+0000","last_became_active":"2024-09-10T08:32:25.170160+0000","last_became_peered":"2024-09-10T08:32:25.170160+0000","last_unstale":"2024-09-10T08:32:26.280286+0000","last_undegraded":"2024-09-10T08:32:26.280286+0000","last_fullsized":"2024-09-10T08:32:26.280286+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:24.132542+0000","last_clean_scrub_stamp":"2024-09-10T08:32:24.132542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:04:38.003307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279697+0000","last_change":"2024-09-10T08:32:24.159632+0000","last_active":"2024-09-10T08:32:26.279697+0000","last_peered":"2024-09-10T08:32:26.279697+0000","last_clean":"2024-09-10T08:32:26.279697+0000","last_became_active":"2024-09-10T08:32:24.158831+0000","last_became_peered":"2024-09-10T08:32:24.158831+0000","last_unstale":"2024-09-10T08:32:26.279697+0000","last_undegraded":"2024-09-10T08:32:26.279697+0000","last_fullsized":"2024-09-10T08:32:26.279697+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:32:23.129733+0000","last_clean_scrub_stamp":"2024-09-10T08:32:23.129733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:30.359702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":239,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-10T08:32:26.279676+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:32:26.279676+0000","last_peered":"2024-09-10T08:32:26.279676+0000","last_clean":"2024-09-10T08:32:26.279676+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:32:26.279676+0000","last_undegraded":"2024-09-10T08:32:26.279676+0000","last_fullsized":"2024-09-10T08:32:26.279676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":301752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":729088,"data_stored":301682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":302276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":301750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44400,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327440,"statfs":{"total":96636764160,"available":96591298560,"internally_reserved":0,"allocated":745472,"data_stored":303432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509490,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1323008,"data_stored":892610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":737280,"data_stored":303272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":892062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:32:34.512 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:32:34.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:32:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.712+0000 7f31fd400640 1 Processor -- start 2024-09-10T08:32:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.712+0000 7f31fd400640 1 -- start start 2024-09-10T08:32:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.713+0000 7f31fd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31f80cce30 0x7f31f80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.713+0000 7f31fd400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f80714b0 con 0x7f31f80732e0 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.713+0000 7f31fd400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f80cd880 con 0x7f31f8071c70 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.713+0000 7f31fd400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f31f80cdb60 con 0x7f31f80cce30 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31ede00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f31f80cce30 0x7f31f80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31f6800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f31f80732e0 0x7f31f80736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40744/0 (socket says 172.21.15.52:40744) 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31f6800640 1 -- 172.21.15.52:0/298502678 learned_addr learned my addr 172.21.15.52:0/298502678 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31ede00640 1 -- 172.21.15.52:0/298502678 >> v1:172.21.15.176:6789/0 conn(0x7f31f8071c70 legacy=0x7f31f815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31ede00640 1 -- 172.21.15.52:0/298502678 >> v1:172.21.15.52:6789/0 conn(0x7f31f80732e0 legacy=0x7f31f80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31ede00640 1 -- 172.21.15.52:0/298502678 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f80cde40 con 0x7f31f80cce30 2024-09-10T08:32:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.714+0000 7f31f5e00640 1 -- 172.21.15.52:0/298502678 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158209626 0 0) 0x7f31f80714b0 con 0x7f31f80732e0 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.715+0000 7f31ede00640 1 --2- 172.21.15.52:0/298502678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f80cce30 0x7f31f80cd2a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f31e00097a0 tx=0x7f31e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07e3dcd5e216c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.715+0000 7f31f5e00640 1 -- 172.21.15.52:0/298502678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0037070 con 0x7f31f80cce30 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.715+0000 7f31f5e00640 1 -- 172.21.15.52:0/298502678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e002ae50 con 0x7f31f80cce30 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.715+0000 7f31f5e00640 1 -- 172.21.15.52:0/298502678 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0032660 con 0x7f31f80cce30 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 -- 172.21.15.52:0/298502678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f80cce30 msgr2=0x7f31f80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 --2- 172.21.15.52:0/298502678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f80cce30 0x7f31f80cd2a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f31e00097a0 tx=0x7f31e002a140 comp rx=0 tx=0).stop 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 -- 172.21.15.52:0/298502678 shutdown_connections 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 --2- 172.21.15.52:0/298502678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f80cce30 0x7f31f80cd2a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 -- 172.21.15.52:0/298502678 >> 172.21.15.52:0/298502678 conn(0x7f31f806d0f0 msgr2=0x7f31f806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 -- 172.21.15.52:0/298502678 shutdown_connections 2024-09-10T08:32:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.716+0000 7f31fd400640 1 -- 172.21.15.52:0/298502678 wait complete. 2024-09-10T08:32:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.718+0000 7f31fd400640 1 Processor -- start 2024-09-10T08:32:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.718+0000 7f31fd400640 1 -- start start 2024-09-10T08:32:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 0x7f31f80aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 0x7f31f80abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31f815d160 con 0x7f31f8071c70 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31f815cfe0 con 0x7f31f80cce30 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31fd400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31f815d2e0 con 0x7f31f80732e0 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31f6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31f6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44898/0 (socket says 172.21.15.52:44898) 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31f6800640 1 -- 172.21.15.52:0/3123210284 learned_addr learned my addr 172.21.15.52:0/3123210284 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31ede00640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 0x7f31f80aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.719+0000 7f31f7200640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 0x7f31f80abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 -- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 msgr2=0x7f31f80aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 0x7f31f80aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 -- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 msgr2=0x7f31f80abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 0x7f31f80abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 -- 172.21.15.52:0/3123210284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f80aa960 con 0x7f31f8071c70 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31ede00640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 0x7f31f80aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f7200640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 0x7f31f80abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31f6800640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c430 tx=0x7f31e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e80074e0 con 0x7f31f8071c70 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e80047e0 con 0x7f31f8071c70 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f80aac40 con 0x7f31f8071c70 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8004bd0 con 0x7f31f8071c70 2024-09-10T08:32:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.720+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f80ab200 con 0x7f31f8071c70 2024-09-10T08:32:34.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.721+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f80cd2a0 con 0x7f31f8071c70 2024-09-10T08:32:34.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.722+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31e8011070 con 0x7f31f8071c70 2024-09-10T08:32:34.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.723+0000 7f31ef400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:34.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.723+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f31e808ab70 con 0x7f31f8071c70 2024-09-10T08:32:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.724+0000 7f31ede00640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.724+0000 7f31ede00640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 0x7f31d406e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:34.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.728+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31e8059480 con 0x7f31f8071c70 2024-09-10T08:32:34.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.978+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f31f815b970 con 0x7f31f8071c70 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.980+0000 7f31ef400640 1 -- 172.21.15.52:0/3123210284 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f31e8058d80 con 0x7f31f8071c70 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:32:34.981 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:32:34.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.982+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 msgr2=0x7f31d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.982+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 0x7f31d406e2f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:34.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 msgr2=0x7f31f8158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:34.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c430 tx=0x7f31e800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 shutdown_connections 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f31f80cce30 0x7f31f80abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31f80732e0 0x7f31f80aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 --2- 172.21.15.52:0/3123210284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31f8071c70 0x7f31f8158c30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 >> 172.21.15.52:0/3123210284 conn(0x7f31f806d0f0 msgr2=0x7f31f8072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 shutdown_connections 2024-09-10T08:32:34.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:34.983+0000 7f31fd400640 1 -- 172.21.15.52:0/3123210284 wait complete. 2024-09-10T08:32:34.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:35.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.154+0000 7f8205400640 1 Processor -- start 2024-09-10T08:32:35.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.154+0000 7f8205400640 1 -- start start 2024-09-10T08:32:35.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f8205400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8200073750 0x7f8200073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f8205400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 0x7f8200164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f8205400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82000712a0 con 0x7f820014c480 2024-09-10T08:32:35.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f8205400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f82000732c0 con 0x7f8200073750 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f8205400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8200072c70 con 0x7f8200164650 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f81f5e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8200073750 0x7f8200073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f81fe800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f820014c480 0x7f8200163be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40760/0 (socket says 172.21.15.52:40760) 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f81fe800640 1 -- 172.21.15.52:0/3279701046 learned_addr learned my addr 172.21.15.52:0/3279701046 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.156+0000 7f81ff200640 1 --2- 172.21.15.52:0/3279701046 >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 0x7f8200164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81f5e00640 1 -- 172.21.15.52:0/3279701046 >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 msgr2=0x7f8200164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81f5e00640 1 --2- 172.21.15.52:0/3279701046 >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 0x7f8200164ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81f5e00640 1 -- 172.21.15.52:0/3279701046 >> v1:172.21.15.52:6789/0 conn(0x7f820014c480 legacy=0x7f8200163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81f5e00640 1 -- 172.21.15.52:0/3279701046 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8200072f50 con 0x7f8200073750 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81ff200640 1 --2- 172.21.15.52:0/3279701046 >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 0x7f8200164ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:35.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.157+0000 7f81fde00640 1 -- 172.21.15.52:0/3279701046 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204639862 0 0) 0x7f82000712a0 con 0x7f820014c480 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f81f5e00640 1 --2- 172.21.15.52:0/3279701046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200073750 0x7f8200073bc0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82000b6700 tx=0x7f81e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e078a9fca1eb52d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f81fde00640 1 -- 172.21.15.52:0/3279701046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8037070 con 0x7f8200073750 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f81fde00640 1 -- 172.21.15.52:0/3279701046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e8032440 con 0x7f8200073750 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f81fde00640 1 -- 172.21.15.52:0/3279701046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e802ae60 con 0x7f8200073750 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f8205400640 1 -- 172.21.15.52:0/3279701046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200073750 msgr2=0x7f8200073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f8205400640 1 --2- 172.21.15.52:0/3279701046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200073750 0x7f8200073bc0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82000b6700 tx=0x7f81e802a110 comp rx=0 tx=0).stop 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f8205400640 1 -- 172.21.15.52:0/3279701046 shutdown_connections 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.158+0000 7f8205400640 1 --2- 172.21.15.52:0/3279701046 >> v2:172.21.15.176:3300/0 conn(0x7f8200164650 0x7f8200164ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.159+0000 7f8205400640 1 --2- 172.21.15.52:0/3279701046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200073750 0x7f8200073bc0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.159+0000 7f8205400640 1 -- 172.21.15.52:0/3279701046 >> 172.21.15.52:0/3279701046 conn(0x7f82000ccec0 msgr2=0x7f82000cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:35.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.159+0000 7f8205400640 1 -- 172.21.15.52:0/3279701046 shutdown_connections 2024-09-10T08:32:35.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.159+0000 7f8205400640 1 -- 172.21.15.52:0/3279701046 wait complete. 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.160+0000 7f8205400640 1 Processor -- start 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.160+0000 7f8205400640 1 -- start start 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8200073750 0x7f8200145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 0x7f82001495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f82000b6350 con 0x7f8200164650 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8200071580 con 0x7f8200073750 2024-09-10T08:32:35.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.161+0000 7f8205400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82000b64d0 con 0x7f820014c480 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44922/0 (socket says 172.21.15.52:44922) 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 -- 172.21.15.52:0/21827612 learned_addr learned my addr 172.21.15.52:0/21827612 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81fe800640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8200073750 0x7f8200145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81f5e00640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 0x7f82001495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 -- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 msgr2=0x7f82001495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 0x7f82001495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 -- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8200073750 msgr2=0x7f8200145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8200073750 0x7f8200145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 -- 172.21.15.52:0/21827612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8200149eb0 con 0x7f8200164650 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81f5e00640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 0x7f82001495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81ff200640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007df0 tx=0x7f81f800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.162+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f801a070 con 0x7f8200164650 2024-09-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.163+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8003990 con 0x7f8200164650 2024-09-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.163+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820014a190 con 0x7f8200164650 2024-09-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.163+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8003d80 con 0x7f8200164650 2024-09-10T08:32:35.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.163+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8200146430 con 0x7f8200164650 2024-09-10T08:32:35.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.164+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8200073bc0 con 0x7f8200164650 2024-09-10T08:32:35.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.165+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81f801d070 con 0x7f8200164650 2024-09-10T08:32:35.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.165+0000 7f81f7400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 0x7f81dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.166+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f81f808b150 con 0x7f8200164650 2024-09-10T08:32:35.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.166+0000 7f81fe800640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 0x7f81dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.167+0000 7f81fe800640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 0x7f81dc06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000f60 tx=0x7f81f0007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.170+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81f8010070 con 0x7f8200164650 2024-09-10T08:32:35.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.389+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82000cdbf0 con 0x7f8200164650 2024-09-10T08:32:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.390+0000 7f81f7400640 1 -- 172.21.15.52:0/21827612 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5226 (secure 0 0 0) 0x7f81f8059a60 con 0x7f8200164650 2024-09-10T08:32:35.390 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:35.390 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"btime":"2024-09-10T08:32:28:165289+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/346517988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":346517988},{"type":"v1","addr":"172.21.15.52:6834","nonce":346517988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5845,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3539522339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3539522339},{"type":"v1","addr":"172.21.15.176:6836","nonce":3539522339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1157302538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1157302538},{"type":"v1","addr":"172.21.15.176:6837","nonce":1157302538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:27.581371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2886852302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2886852302},{"type":"v1","addr":"172.21.15.52:6835","nonce":2886852302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6135,"qdb_cluster":[6135]},"id":4}]} 2024-09-10T08:32:35.390 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 34 2024-09-10T08:32:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 msgr2=0x7f81dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 0x7f81dc06e2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000f60 tx=0x7f81f0007b70 comp rx=0 tx=0).stop 2024-09-10T08:32:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 msgr2=0x7f82000b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f81f8007df0 tx=0x7f81f800d4a0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 shutdown_connections 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f81dc06be30 0x7f81dc06e2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8200164650 0x7f82000b4b90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f820014c480 0x7f82001495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 --2- 172.21.15.52:0/21827612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8200073750 0x7f8200145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 >> 172.21.15.52:0/21827612 conn(0x7f82000ccec0 msgr2=0x7f82001669b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 shutdown_connections 2024-09-10T08:32:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.392+0000 7f8205400640 1 -- 172.21.15.52:0/21827612 wait complete. 2024-09-10T08:32:35.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:32:24.581671+0000', 'modified': '2024-09-10T08:32:27.581371+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6135}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6135': {'gid': 6135, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/2886852302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2886852302}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2886852302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6135, 'qdb_cluster': [6135]} 2024-09-10T08:32:35.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:32:35.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:32:35.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.972+0000 7f9cd1600640 1 Processor -- start 2024-09-10T08:32:35.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.972+0000 7f9cd1600640 1 -- start start 2024-09-10T08:32:35.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9cd1600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 0x7f9ccc0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9cd1600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ccc0cf450 0x7f9ccc0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9cd1600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0d3990 con 0x7f9ccc15e440 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9cd1600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9ccc0d3c70 con 0x7f9ccc0cf450 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9cd1600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc0d3f50 con 0x7f9ccc0b6710 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9ccbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ccc15e440 0x7f9ccc0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40768/0 (socket says 172.21.15.52:40768) 2024-09-10T08:32:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.973+0000 7f9ccbe00640 1 -- 172.21.15.52:0/2232992820 learned_addr learned my addr 172.21.15.52:0/2232992820 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccb400640 1 --2- 172.21.15.52:0/2232992820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 0x7f9ccc0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/2232992820 >> v2:172.21.15.176:3300/0 conn(0x7f9ccc0cf450 0x7f9ccc0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccaa00640 1 -- 172.21.15.52:0/2232992820 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546957951 0 0) 0x7f9ccc0d3990 con 0x7f9ccc15e440 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccaa00640 1 -- 172.21.15.52:0/2232992820 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb0003520 con 0x7f9ccc15e440 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccb400640 1 -- 172.21.15.52:0/2232992820 >> v2:172.21.15.176:3300/0 conn(0x7f9ccc0cf450 msgr2=0x7f9ccc0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccb400640 1 --2- 172.21.15.52:0/2232992820 >> v2:172.21.15.176:3300/0 conn(0x7f9ccc0cf450 0x7f9ccc0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccb400640 1 -- 172.21.15.52:0/2232992820 >> v1:172.21.15.52:6789/0 conn(0x7f9ccc15e440 legacy=0x7f9ccc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.974+0000 7f9ccb400640 1 -- 172.21.15.52:0/2232992820 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0d4230 con 0x7f9ccc0b6710 2024-09-10T08:32:35.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.975+0000 7f9ccb400640 1 --2- 172.21.15.52:0/2232992820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 0x7f9ccc0d3240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80097a0 tx=0x7f9cb802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edb972f49d76389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9ccaa00640 1 -- 172.21.15.52:0/2232992820 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8037070 con 0x7f9ccc0b6710 2024-09-10T08:32:35.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9ccaa00640 1 -- 172.21.15.52:0/2232992820 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb8032440 con 0x7f9ccc0b6710 2024-09-10T08:32:35.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9ccaa00640 1 -- 172.21.15.52:0/2232992820 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80327f0 con 0x7f9ccc0b6710 2024-09-10T08:32:35.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 -- 172.21.15.52:0/2232992820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 msgr2=0x7f9ccc0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 --2- 172.21.15.52:0/2232992820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 0x7f9ccc0d3240 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80097a0 tx=0x7f9cb802a210 comp rx=0 tx=0).stop 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 -- 172.21.15.52:0/2232992820 shutdown_connections 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 --2- 172.21.15.52:0/2232992820 >> v2:172.21.15.176:3300/0 conn(0x7f9ccc0cf450 0x7f9ccc0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 --2- 172.21.15.52:0/2232992820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0b6710 0x7f9ccc0d3240 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 -- 172.21.15.52:0/2232992820 >> 172.21.15.52:0/2232992820 conn(0x7f9ccc067f80 msgr2=0x7f9ccc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.976+0000 7f9cd1600640 1 -- 172.21.15.52:0/2232992820 shutdown_connections 2024-09-10T08:32:35.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.977+0000 7f9cd1600640 1 -- 172.21.15.52:0/2232992820 wait complete. 2024-09-10T08:32:35.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.978+0000 7f9cd1600640 1 Processor -- start 2024-09-10T08:32:35.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.978+0000 7f9cd1600640 1 -- start start 2024-09-10T08:32:35.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0cf450 0x7f9ccc0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ccc15e440 0x7f9ccc160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b76c0 con 0x7f9ccc0b6710 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b7540 con 0x7f9ccc15e440 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9cd1600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc0b80a0 con 0x7f9ccc0cf450 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44926/0 (socket says 172.21.15.52:44926) 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.979+0000 7f9ccbe00640 1 -- 172.21.15.52:0/1463862090 learned_addr learned my addr 172.21.15.52:0/1463862090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccb400640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0cf450 0x7f9ccc0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ccc15e440 0x7f9ccc160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 -- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0cf450 msgr2=0x7f9ccc0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0cf450 0x7f9ccc0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 -- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ccc15e440 msgr2=0x7f9ccc160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ccc15e440 0x7f9ccc160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 -- 172.21.15.52:0/1463862090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc0cdbb0 con 0x7f9ccc0b6710 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.980+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c390 tx=0x7f9cbc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.981+0000 7f9cc3e00640 1 -- 172.21.15.52:0/1463862090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc017070 con 0x7f9ccc0b6710 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.981+0000 7f9cc3e00640 1 -- 172.21.15.52:0/1463862090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc005ce0 con 0x7f9ccc0b6710 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.981+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc0cde90 con 0x7f9ccc0b6710 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.981+0000 7f9cc3e00640 1 -- 172.21.15.52:0/1463862090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0072f0 con 0x7f9ccc0b6710 2024-09-10T08:32:35.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.981+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc0ce450 con 0x7f9ccc0b6710 2024-09-10T08:32:35.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.984+0000 7f9cc3e00640 1 -- 172.21.15.52:0/1463862090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cbc01a070 con 0x7f9ccc0b6710 2024-09-10T08:32:35.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.984+0000 7f9cd5bc5740 1 Processor -- start 2024-09-10T08:32:35.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.985+0000 7f9cd5bc5740 1 -- start start 2024-09-10T08:32:35.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.985+0000 7f9cc3e00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.985+0000 7f9cc3e00640 1 -- 172.21.15.52:0/1463862090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f9cbc08a200 con 0x7f9ccc0b6710 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.985+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf08b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf085720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555caefe93b0 con 0x555caf08c630 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555caefee410 con 0x555caf08aea0 2024-09-10T08:32:35.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555caef96620 con 0x555caf088660 2024-09-10T08:32:35.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf085720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccb400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf08b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:38882/0 (socket says 172.21.15.52:38882) 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4130363026 learned_addr learned my addr 172.21.15.52:0/4130363026 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 0x7f9cac06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc15e1a0 tx=0x7f9cc400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 msgr2=0x555caf08b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf08b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.986+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4130363026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 msgr2=0x555caf085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf085720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4130363026 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caed012d0 con 0x555caf08aea0 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf085720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:35.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0070a0 tx=0x7f9cbc057f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380bdbba44deb033 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9cb7e00640 1 -- 172.21.15.52:0/4130363026 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc085070 con 0x555caf08aea0 2024-09-10T08:32:35.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9cb7e00640 1 -- 172.21.15.52:0/4130363026 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc061080 con 0x555caf08aea0 2024-09-10T08:32:35.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.987+0000 7f9cb7e00640 1 -- 172.21.15.52:0/4130363026 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc054bc0 con 0x555caf08aea0 2024-09-10T08:32:35.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 msgr2=0x555caf0d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0070a0 tx=0x7f9cbc057f70 comp rx=0 tx=0).stop 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4130363026 shutdown_connections 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf085720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf08b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4130363026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf0d0640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4130363026 >> 172.21.15.52:0/4130363026 conn(0x555caf0878f0 msgr2=0x555caf0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4130363026 shutdown_connections 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.988+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4130363026 wait complete. 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.989+0000 7f9cd5bc5740 1 -- start start 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.989+0000 7f9cd5bc5740 1 Processor -- start 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0df290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555caefa9780 con 0x555caf0df7d0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555caefea3d0 con 0x555caf08c630 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555caf086d90 con 0x555caf08aea0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd5bc5740 10 client.0 _ll_register_callbacks cb 0x555caefe75d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44938/0 (socket says 172.21.15.52:44938) 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.990+0000 7f9cd0c00640 1 -- 172.21.15.52:0/4195103397 learned_addr learned my addr 172.21.15.52:0/4195103397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9ccb400640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0df290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 -- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 msgr2=0x555caf0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 -- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 msgr2=0x555caf0df290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0df290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 -- 172.21.15.52:0/4195103397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caedcb6b0 con 0x555caf0df7d0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9ccb400640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0df290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4017e90 tx=0x7f9cc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb0845a3ec414ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4027030 con 0x555caf0df7d0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cbc061080 con 0x555caf0df7d0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.991+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc4023690 con 0x555caf0df7d0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9cc4023890 con 0x555caf0df7d0 2024-09-10T08:32:35.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 10 client.6297 fetch_fsmap learned FSMap version 34 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x555caf0ace50 con 0x555caf0df7d0 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc061080 con 0x555caf0df7d0 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f9cc4036080 con 0x555caf0df7d0 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 10 client.6297 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 10 client.6297 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 20 client.6297 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf084c30 0x555caf09b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 4 client.6297 mds_command: new command op to 6135 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 --> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555caeffbb40 con 0x555caf084c30 2024-09-10T08:32:35.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.992+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf084c30 0x555caf09b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:35.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.993+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf084c30 0x555caf09b9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70bede044301178 server_cookie=77355255be8d9162 in_seq=0 out_seq=0 2024-09-10T08:32:35.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.993+0000 7f9cb4c00640 10 client.6297 ms_handle_connect on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cb4c00640 1 -- 172.21.15.52:0/4195103397 <== mds.0 v2:172.21.15.52:6832/2886852302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555caeffbb40 con 0x555caf084c30 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cb4c00640 10 client.6297 handle_command_reply: tid=0 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 client.6297 shutdown 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 msgr2=0x555caf0dfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4017e90 tx=0x7f9cc4004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 shutdown_connections 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf084c30 0x555caf09b9f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf0df7d0 0x555caf0dfc30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0df290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4195103397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 >> 172.21.15.52:0/4195103397 conn(0x555caf088660 msgr2=0x555caf0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cb4c00640 0 client.6297 ms_handle_reset on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 shutdown_connections 2024-09-10T08:32:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4195103397 wait complete. 2024-09-10T08:32:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:35.994+0000 7f9cd5bc5740 20 client.6297 trim_cache size 0 max 16384 2024-09-10T08:32:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.013+0000 7f9cd5bc5740 1 Processor -- start 2024-09-10T08:32:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.013+0000 7f9cd5bc5740 1 -- start start 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc14f590 con 0x555caf088660 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc0cc330 con 0x555caf08c630 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc14ef40 con 0x555caf08aea0 2024-09-10T08:32:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44952/0 (socket says 172.21.15.52:44952) 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4100066193 learned_addr learned my addr 172.21.15.52:0/4100066193 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccb400640 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 msgr2=0x555caf0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 msgr2=0x555caf0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.014+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9ccbe00640 1 -- 172.21.15.52:0/4100066193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555caf0b2150 con 0x555caf088660 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0549b0 tx=0x7f9cbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827b6b295f85463c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9cb7400640 1 -- 172.21.15.52:0/4100066193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc085040 con 0x555caf088660 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9cb7400640 1 -- 172.21.15.52:0/4100066193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc056850 con 0x555caf088660 2024-09-10T08:32:36.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9cb7400640 1 -- 172.21.15.52:0/4100066193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc054bc0 con 0x555caf088660 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4100066193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 msgr2=0x555caf0f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.015+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0549b0 tx=0x7f9cbc013000 comp rx=0 tx=0).stop 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4100066193 shutdown_connections 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08c630 0x555caf0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf08aea0 0x555caf0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/4100066193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf088660 0x555caf0f4cf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4100066193 >> 172.21.15.52:0/4100066193 conn(0x555caf0df3f0 msgr2=0x555caf0aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4100066193 shutdown_connections 2024-09-10T08:32:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/4100066193 wait complete. 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 -- start start 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.016+0000 7f9cd5bc5740 1 Processor -- start 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf0f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555caf084ab0 con 0x555caf08c630 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555caf0855c0 con 0x555caf08aea0 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555caf0850a0 con 0x555caf088660 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.017+0000 7f9cd5bc5740 10 client.0 _ll_register_callbacks cb 0x7f9cc4009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44958/0 (socket says 172.21.15.52:44958) 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 -- 172.21.15.52:0/3207247584 learned_addr learned my addr 172.21.15.52:0/3207247584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf0f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9ccb400640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 -- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 msgr2=0x555caf0f02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf0f02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 -- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 msgr2=0x555caf1457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf1457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 -- 172.21.15.52:0/3207247584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555caf0e3440 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cd0c00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4017e90 tx=0x7f9cc4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab107628df55011 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.018+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4027040 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f9cc402c740 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cbc056850 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9cc4015c70 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 10 client.6303 fetch_fsmap learned FSMap version 34 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x555caf0ab4b0 con 0x555caf08c630 2024-09-10T08:32:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc056850 con 0x555caf08c630 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f9cc4020050 con 0x555caf08c630 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 10 client.6303 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 10 client.6303 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 20 client.6303 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf0df7d0 0x555caf0f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 4 client.6303 mds_command: new command op to 6135 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 --> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] -- command(tid 0: {"prefix": "status"}) -- 0x555caeff5e90 con 0x555caf0df7d0 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.019+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf0df7d0 0x555caf0f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9ccbe00640 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf0df7d0 0x555caf0f27d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec3de86df7f324c server_cookie=2b6435805258a6ce in_seq=0 out_seq=0 2024-09-10T08:32:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cb4c00640 10 client.6303 ms_handle_connect on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cb4c00640 1 -- 172.21.15.52:0/3207247584 <== mds.0 v2:172.21.15.52:6832/2886852302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555caeff5e90 con 0x555caf0df7d0 2024-09-10T08:32:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cb4c00640 10 client.6303 handle_command_reply: tid=0 2024-09-10T08:32:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 client.6303 shutdown 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 msgr2=0x555caf145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4017e90 tx=0x7f9cc4019000 comp rx=0 tx=0).stop 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 shutdown_connections 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x555caf0df7d0 0x555caf0f27d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555caf08c630 0x555caf145d30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555caf08aea0 0x555caf1457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 --2- 172.21.15.52:0/3207247584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555caf088660 0x555caf0f02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cb4c00640 0 client.6303 ms_handle_reset on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.020+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 >> 172.21.15.52:0/3207247584 conn(0x555caf0df3f0 msgr2=0x555caf0aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 shutdown_connections 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd5bc5740 1 -- 172.21.15.52:0/3207247584 wait complete. 2024-09-10T08:32:36.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd5bc5740 20 client.6303 trim_cache size 0 max 16384 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6135, 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.879812680000001, 2024-09-10T08:32:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 34, 2024-09-10T08:32:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 61, 2024-09-10T08:32:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 61, 2024-09-10T08:32:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.954126203 2024-09-10T08:32:36.027 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 msgr2=0x7f9cac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 0x7f9cac06e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc15e1a0 tx=0x7f9cc400b040 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 msgr2=0x7f9ccc1e7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c390 tx=0x7f9cbc00c850 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 shutdown_connections 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cac06be30 0x7f9cac06e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ccc15e440 0x7f9ccc160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ccc0cf450 0x7f9ccc0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 --2- 172.21.15.52:0/1463862090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ccc0b6710 0x7f9ccc1e7b90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.021+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 >> 172.21.15.52:0/1463862090 conn(0x7f9ccc067f80 msgr2=0x7f9ccc0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:36.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.022+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 shutdown_connections 2024-09-10T08:32:36.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.022+0000 7f9cd1600640 1 -- 172.21.15.52:0/1463862090 wait complete. 2024-09-10T08:32:36.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:32:36.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:36.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:32:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.193+0000 7fef89600640 1 Processor -- start 2024-09-10T08:32:36.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.193+0000 7fef89600640 1 -- start start 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef89600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 0x7fef840b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef89600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef840d0e70 con 0x7fef8415ed20 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef89600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef840d41c0 con 0x7fef840b6970 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef89600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef840d35b0 con 0x7fef840d23b0 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef82a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fef8415ed20 0x7fef840b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40776/0 (socket says 172.21.15.52:40776) 2024-09-10T08:32:36.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef82a00640 1 -- 172.21.15.52:0/143827804 learned_addr learned my addr 172.21.15.52:0/143827804 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:36.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef83400640 1 --2- 172.21.15.52:0/143827804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 0x7fef840b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029425467 0 0) 0x7fef74001110 con 0x7fef8415ed20 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.195+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef68003520 con 0x7fef8415ed20 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.196+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370348808 0 0) 0x7fef840d41c0 con 0x7fef840b6970 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.196+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef74001110 con 0x7fef840b6970 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.196+0000 7fef83400640 1 -- 172.21.15.52:0/143827804 >> v1:172.21.15.176:6789/0 conn(0x7fef840b6970 legacy=0x7fef840b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.196+0000 7fef83400640 1 -- 172.21.15.52:0/143827804 >> v1:172.21.15.52:6789/0 conn(0x7fef8415ed20 legacy=0x7fef840b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.196+0000 7fef83400640 1 -- 172.21.15.52:0/143827804 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840d3890 con 0x7fef840d23b0 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.197+0000 7fef83400640 1 --2- 172.21.15.52:0/143827804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 0x7fef840b87e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009dc0 tx=0x7fef7c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ffa0d6f735dcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.197+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c02ae60 con 0x7fef840d23b0 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.197+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c007740 con 0x7fef840d23b0 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.197+0000 7fef82000640 1 -- 172.21.15.52:0/143827804 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c007af0 con 0x7fef840d23b0 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 -- 172.21.15.52:0/143827804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 msgr2=0x7fef840b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 --2- 172.21.15.52:0/143827804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 0x7fef840b87e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009dc0 tx=0x7fef7c02a640 comp rx=0 tx=0).stop 2024-09-10T08:32:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 -- 172.21.15.52:0/143827804 shutdown_connections 2024-09-10T08:32:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 --2- 172.21.15.52:0/143827804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef840d23b0 0x7fef840b87e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 -- 172.21.15.52:0/143827804 >> 172.21.15.52:0/143827804 conn(0x7fef840d1260 msgr2=0x7fef840d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 -- 172.21.15.52:0/143827804 shutdown_connections 2024-09-10T08:32:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.198+0000 7fef89600640 1 -- 172.21.15.52:0/143827804 wait complete. 2024-09-10T08:32:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.200+0000 7fef89600640 1 Processor -- start 2024-09-10T08:32:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.200+0000 7fef89600640 1 -- start start 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.200+0000 7fef89600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef840b6970 0x7fef84155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef89600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef89600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef8415ed20 0x7fef84160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef89600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef840d32a0 con 0x7fef840d23b0 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef89600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef840d3e50 con 0x7fef840b6970 2024-09-10T08:32:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef89600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fef8415f100 con 0x7fef8415ed20 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44964/0 (socket says 172.21.15.52:44964) 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef82a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef840b6970 0x7fef84155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 -- 172.21.15.52:0/894965500 learned_addr learned my addr 172.21.15.52:0/894965500 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef83400640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef8415ed20 0x7fef84160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 -- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef8415ed20 msgr2=0x7fef84160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef8415ed20 0x7fef84160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 -- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef840b6970 msgr2=0x7fef84155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef840b6970 0x7fef84155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.201+0000 7fef7a000640 1 -- 172.21.15.52:0/894965500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840cc820 con 0x7fef840d23b0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef7a000640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c490 tx=0x7fef6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0052d0 con 0x7fef840d23b0 2024-09-10T08:32:36.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6c005470 con 0x7fef840d23b0 2024-09-10T08:32:36.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef84156160 con 0x7fef840d23b0 2024-09-10T08:32:36.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c012850 con 0x7fef840d23b0 2024-09-10T08:32:36.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.202+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef840ccd70 con 0x7fef840d23b0 2024-09-10T08:32:36.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.203+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef840ccf70 con 0x7fef840d23b0 2024-09-10T08:32:36.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.204+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef6c0129f0 con 0x7fef840d23b0 2024-09-10T08:32:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.205+0000 7fef7b400640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 0x7fef6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.206+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fef6c08aa90 con 0x7fef840d23b0 2024-09-10T08:32:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.206+0000 7fef82a00640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 0x7fef6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.207+0000 7fef82a00640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 0x7fef6006e320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef74000f60 tx=0x7fef74007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:36.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.210+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef6c058cd0 con 0x7fef840d23b0 2024-09-10T08:32:36.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.432+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fef840b7010 con 0x7fef840d23b0 2024-09-10T08:32:36.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.433+0000 7fef7b400640 1 -- 172.21.15.52:0/894965500 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fef6c05cfd0 con 0x7fef840d23b0 2024-09-10T08:32:36.433 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:32:36.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 msgr2=0x7fef6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 0x7fef6006e320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef74000f60 tx=0x7fef74007d30 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 msgr2=0x7fef840ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00c490 tx=0x7fef6c00c950 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 shutdown_connections 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fef6006be60 0x7fef6006e320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fef8415ed20 0x7fef84160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef840d23b0 0x7fef840ca670 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 --2- 172.21.15.52:0/894965500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef840b6970 0x7fef84155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 >> 172.21.15.52:0/894965500 conn(0x7fef840d1260 msgr2=0x7fef840b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 shutdown_connections 2024-09-10T08:32:36.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36.435+0000 7fef89600640 1 -- 172.21.15.52:0/894965500 wait complete. 2024-09-10T08:32:36.451 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:32:36.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:32:36.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:32:36.451 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:32:36.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:36.452 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:32:36.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:32:36.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:32:36.452 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:32:36.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:36.452 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:32:36.488 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42446sec preferred_lft 42446sec 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:32:36.489 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:32:36.490 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:32:36.491 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:32:36.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:36.491 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:32:36.582 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:32:36.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:36.585 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:32:36.621 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:32:36.621 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:32:36.622 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:32:36.622 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:32:36.622 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:32:36.622 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:32:36.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:32:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:32:36.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:36.819 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:32:36.854 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:32:36.855 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:32:36.855 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:32:36.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:36.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:32:36.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:32:36.951 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:36.986 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:32:36.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:32:36.986 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:37.060 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:32:37.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:37.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:32:37.189 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:32:37.189 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:32:37.217 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:32:37.217 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:32:37.217 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:32:37.217 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:32:37.217 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:32:37.220 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:32:37.220 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:32:37.220 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:32:37.220 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:32:37.220 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:32:37.223 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:32:37.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:37.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:37.279 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:32:37.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:32:37.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:32:37.374 INFO:teuthology.orchestra.run.smithi052.stdout:client5612 2024-09-10T08:32:37.375 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:37.375 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:37.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-10T08:32:37.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 Processor -- start 2024-09-10T08:32:37.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 -- start start 2024-09-10T08:32:37.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ff80705f0 0x7f2ff806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff80b5e60 con 0x7f2ff80b00f0 2024-09-10T08:32:37.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff80b6140 con 0x7f2ff806bc10 2024-09-10T08:32:37.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff80b6420 con 0x7f2ff80705f0 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ff80705f0 0x7f2ff806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2ff80b00f0 0x7f2ff80b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40786/0 (socket says 172.21.15.52:40786) 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.612+0000 7f2ff7400640 1 -- 172.21.15.52:0/3218514641 learned_addr learned my addr 172.21.15.52:0/3218514641 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.613+0000 7f2ff6a00640 1 -- 172.21.15.52:0/3218514641 >> v1:172.21.15.176:6789/0 conn(0x7f2ff806bc10 legacy=0x7f2ff806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.613+0000 7f2ff6a00640 1 -- 172.21.15.52:0/3218514641 >> v1:172.21.15.52:6789/0 conn(0x7f2ff80b00f0 legacy=0x7f2ff80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.613+0000 7f2ff6a00640 1 -- 172.21.15.52:0/3218514641 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff80b5aa0 con 0x7f2ff80705f0 2024-09-10T08:32:37.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.613+0000 7f2ff5600640 1 -- 172.21.15.52:0/3218514641 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730131365 0 0) 0x7f2ff80b5e60 con 0x7f2ff80b00f0 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff6a00640 1 --2- 172.21.15.52:0/3218514641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff806f580 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097a0 tx=0x7f2fe802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfd868cbd268f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff5600640 1 -- 172.21.15.52:0/3218514641 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8037070 con 0x7f2ff80705f0 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff5600640 1 -- 172.21.15.52:0/3218514641 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8032440 con 0x7f2ff80705f0 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff5600640 1 -- 172.21.15.52:0/3218514641 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8032810 con 0x7f2ff80705f0 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff7e00640 1 -- 172.21.15.52:0/3218514641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 msgr2=0x7f2ff806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.614+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/3218514641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff806f580 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80097a0 tx=0x7f2fe802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.615+0000 7f2ff7e00640 1 -- 172.21.15.52:0/3218514641 shutdown_connections 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.615+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/3218514641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff806f580 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.615+0000 7f2ff7e00640 1 -- 172.21.15.52:0/3218514641 >> 172.21.15.52:0/3218514641 conn(0x7f2ff80d12e0 msgr2=0x7f2ff80d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.615+0000 7f2ff7e00640 1 -- 172.21.15.52:0/3218514641 shutdown_connections 2024-09-10T08:32:37.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.615+0000 7f2ff7e00640 1 -- 172.21.15.52:0/3218514641 wait complete. 2024-09-10T08:32:37.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.616+0000 7f2ff7e00640 1 Processor -- start 2024-09-10T08:32:37.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.616+0000 7f2ff7e00640 1 -- start start 2024-09-10T08:32:37.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ff806bc10 0x7f2ff81f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff80b00f0 0x7f2ff81f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff815f160 con 0x7f2ff80705f0 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff815efe0 con 0x7f2ff80b00f0 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.617+0000 7f2ff7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff815f2e0 con 0x7f2ff806bc10 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44982/0 (socket says 172.21.15.52:44982) 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 -- 172.21.15.52:0/2700233321 learned_addr learned my addr 172.21.15.52:0/2700233321 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6a00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ff806bc10 0x7f2ff81f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff7400640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff80b00f0 0x7f2ff81f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 -- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ff806bc10 msgr2=0x7f2ff81f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ff806bc10 0x7f2ff81f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 -- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff80b00f0 msgr2=0x7f2ff81f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff80b00f0 0x7f2ff81f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.618+0000 7f2ff6000640 1 -- 172.21.15.52:0/2700233321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff81f4f70 con 0x7f2ff80705f0 2024-09-10T08:32:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2ff6000640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c480 tx=0x7f2fe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40052d0 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe4005470 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4012870 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff8158bd0 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.619+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff8159190 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.620+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff80b5e60 con 0x7f2ff80705f0 2024-09-10T08:32:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.621+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fe4012a10 con 0x7f2ff80705f0 2024-09-10T08:32:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.622+0000 7f2fef400640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 0x7f2fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.622+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f2fe408a9b0 con 0x7f2ff80705f0 2024-09-10T08:32:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.622+0000 7f2ff6a00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 0x7f2fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.624+0000 7f2ff6a00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 0x7f2fd806e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8034000 tx=0x7f2fe802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:37.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.626+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ff81f4f70 con 0x7f2ff80705f0 2024-09-10T08:32:37.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.811+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f2ff8073fa0 con 0x7f2ff80705f0 2024-09-10T08:32:37.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.814+0000 7f2fef400640 1 -- 172.21.15.52:0/2700233321 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f2fe4058d00 con 0x7f2ff80705f0 2024-09-10T08:32:37.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 msgr2=0x7f2fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 0x7f2fd806e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8034000 tx=0x7f2fe802e000 comp rx=0 tx=0).stop 2024-09-10T08:32:37.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 msgr2=0x7f2ff81f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c480 tx=0x7f2fe400c940 comp rx=0 tx=0).stop 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 shutdown_connections 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2fd806be30 0x7f2fd806e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ff80b00f0 0x7f2ff81f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff80705f0 0x7f2ff81f4a30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 --2- 172.21.15.52:0/2700233321 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ff806bc10 0x7f2ff81f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 >> 172.21.15.52:0/2700233321 conn(0x7f2ff80d12e0 msgr2=0x7f2ff8072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 shutdown_connections 2024-09-10T08:32:37.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.817+0000 7f2ff7e00640 1 -- 172.21.15.52:0/2700233321 wait complete. 2024-09-10T08:32:37.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-10T08:32:37.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 Processor -- start 2024-09-10T08:32:37.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 -- start start 2024-09-10T08:32:37.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d80cce30 0x7f21d80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21d8071c70 0x7f21d8072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d80714b0 con 0x7f21d80732e0 2024-09-10T08:32:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80cd880 con 0x7f21d8071c70 2024-09-10T08:32:37.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.993+0000 7f21dda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21d80cdb60 con 0x7f21d80cce30 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21d8071c70 0x7f21d8072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d6000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d80cce30 0x7f21d80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21d8071c70 0x7f21d8072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:38934/0 (socket says 172.21.15.52:38934) 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 -- 172.21.15.52:0/3792033140 learned_addr learned my addr 172.21.15.52:0/3792033140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d6a00640 1 --1- 172.21.15.52:0/3792033140 >> v1:172.21.15.176:6789/0 conn(0x7f21d80732e0 0x7f21d80736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41256/0 (socket says 172.21.15.52:41256) 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d5600640 1 -- 172.21.15.52:0/3792033140 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305665228 0 0) 0x7f21d80714b0 con 0x7f21d80732e0 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d5600640 1 -- 172.21.15.52:0/3792033140 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21bc003520 con 0x7f21d80732e0 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 -- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d80cce30 msgr2=0x7f21d80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 --2- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d80cce30 0x7f21d80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 -- 172.21.15.52:0/3792033140 >> v1:172.21.15.176:6789/0 conn(0x7f21d80732e0 legacy=0x7f21d80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.994+0000 7f21d7400640 1 -- 172.21.15.52:0/3792033140 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80cde40 con 0x7f21d8071c70 2024-09-10T08:32:37.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.995+0000 7f21d7400640 1 --2- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d8071c70 0x7f21d8072120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbbca0db0ada0230 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.995+0000 7f21d5600640 1 -- 172.21.15.52:0/3792033140 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0036070 con 0x7f21d8071c70 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21d5600640 1 -- 172.21.15.52:0/3792033140 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d0031600 con 0x7f21d8071c70 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21d5600640 1 -- 172.21.15.52:0/3792033140 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d00319d0 con 0x7f21d8071c70 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 -- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d8071c70 msgr2=0x7f21d8072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 --2- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d8071c70 0x7f21d8072120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d002a6a0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 -- 172.21.15.52:0/3792033140 shutdown_connections 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 --2- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d8071c70 0x7f21d8072120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 --2- 172.21.15.52:0/3792033140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d80cce30 0x7f21d80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 -- 172.21.15.52:0/3792033140 >> 172.21.15.52:0/3792033140 conn(0x7f21d806d0f0 msgr2=0x7f21d806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 -- 172.21.15.52:0/3792033140 shutdown_connections 2024-09-10T08:32:37.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.996+0000 7f21dda00640 1 -- 172.21.15.52:0/3792033140 wait complete. 2024-09-10T08:32:37.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.998+0000 7f21dda00640 1 Processor -- start 2024-09-10T08:32:37.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.998+0000 7f21dda00640 1 -- start start 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d8071c70 0x7f21d814a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d80cce30 0x7f21d8156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f21d815ca50 con 0x7f21d80732e0 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21d815c8d0 con 0x7f21d80cce30 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21dda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21d815cbd0 con 0x7f21d8071c70 2024-09-10T08:32:38.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44986/0 (socket says 172.21.15.52:44986) 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21d6000640 1 -- 172.21.15.52:0/3541023854 learned_addr learned my addr 172.21.15.52:0/3541023854 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21d7400640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d80cce30 0x7f21d8156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:37.999+0000 7f21d6a00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d8071c70 0x7f21d814a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 -- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d8071c70 msgr2=0x7f21d814a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d8071c70 0x7f21d814a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 -- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d80cce30 msgr2=0x7f21d8156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d80cce30 0x7f21d8156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 -- 172.21.15.52:0/3541023854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d814a730 con 0x7f21d80732e0 2024-09-10T08:32:38.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21d6000640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f21c4012ab0 tx=0x7f21c4012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4010a20 con 0x7f21d80732e0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c401d070 con 0x7f21d80732e0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d815eb10 con 0x7f21d80732e0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.000+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4010de0 con 0x7f21d80732e0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.001+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d80c6660 con 0x7f21d80732e0 2024-09-10T08:32:38.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.001+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d80cd270 con 0x7f21d80732e0 2024-09-10T08:32:38.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.003+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21c4016050 con 0x7f21d80732e0 2024-09-10T08:32:38.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.003+0000 7f21cea00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.004+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f21c408ebc0 con 0x7f21d80732e0 2024-09-10T08:32:38.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.004+0000 7f21d6a00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.005+0000 7f21d6a00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f60 tx=0x7f21c8007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.008+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21c4026020 con 0x7f21d80732e0 2024-09-10T08:32:38.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.193+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f21d80cfae0 con 0x7f21d80732e0 2024-09-10T08:32:38.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.197+0000 7f21cea00640 1 -- 172.21.15.52:0/3541023854 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f21d814a730 con 0x7f21d80732e0 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.199+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 msgr2=0x7f21b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.199+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000f60 tx=0x7f21c8007cf0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.199+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 msgr2=0x7f21d80c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.199+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f21c4012ab0 tx=0x7f21c4012f70 comp rx=0 tx=0).stop 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 shutdown_connections 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21d80cce30 0x7f21d8156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21d80732e0 0x7f21d80c7140 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 --2- 172.21.15.52:0/3541023854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21d8071c70 0x7f21d814a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 >> 172.21.15.52:0/3541023854 conn(0x7f21d806d0f0 msgr2=0x7f21d815b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:38.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 shutdown_connections 2024-09-10T08:32:38.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.200+0000 7f21dda00640 1 -- 172.21.15.52:0/3541023854 wait complete. 2024-09-10T08:32:38.216 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-10T08:32:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.374+0000 7f8bf2c00640 1 Processor -- start 2024-09-10T08:32:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.375+0000 7f8bf2c00640 1 -- start start 2024-09-10T08:32:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf2c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bec06bfd0 0x7f8bec06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf2c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec0b3350 0x7f8bec1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf2c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bec06c8f0 con 0x7f8bec0b38a0 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf2c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8bec0b78a0 con 0x7f8bec06bfd0 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf2c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bec0cffb0 con 0x7f8bec0b3350 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf0c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8bec0b38a0 0x7f8bec1628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40796/0 (socket says 172.21.15.52:40796) 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bf0c00640 1 -- 172.21.15.52:0/1052163122 learned_addr learned my addr 172.21.15.52:0/1052163122 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8bebe00640 1 --2- 172.21.15.52:0/1052163122 >> v2:172.21.15.52:3300/0 conn(0x7f8bec06bfd0 0x7f8bec06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.376+0000 7f8beb400640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec0b3350 0x7f8bec1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8beaa00640 1 -- 172.21.15.52:0/1052163122 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611866375 0 0) 0x7f8bec06c8f0 con 0x7f8bec0b38a0 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8beaa00640 1 -- 172.21.15.52:0/1052163122 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd0003520 con 0x7f8bec0b38a0 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8bebe00640 1 -- 172.21.15.52:0/1052163122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec0b3350 msgr2=0x7f8bec1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8bebe00640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec0b3350 0x7f8bec1623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8bebe00640 1 -- 172.21.15.52:0/1052163122 >> v1:172.21.15.52:6789/0 conn(0x7f8bec0b38a0 legacy=0x7f8bec1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.377+0000 7f8bebe00640 1 -- 172.21.15.52:0/1052163122 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec0cf710 con 0x7f8bec06bfd0 2024-09-10T08:32:38.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.378+0000 7f8bebe00640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec06bfd0 0x7f8bec06c3b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0097d0 tx=0x7f8bdc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd3a62881366bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.378+0000 7f8beaa00640 1 -- 172.21.15.52:0/1052163122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc037070 con 0x7f8bec06bfd0 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.378+0000 7f8beaa00640 1 -- 172.21.15.52:0/1052163122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc032440 con 0x7f8bec06bfd0 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.378+0000 7f8beaa00640 1 -- 172.21.15.52:0/1052163122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc032810 con 0x7f8bec06bfd0 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 -- 172.21.15.52:0/1052163122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec06bfd0 msgr2=0x7f8bec06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec06bfd0 0x7f8bec06c3b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0097d0 tx=0x7f8bdc02a250 comp rx=0 tx=0).stop 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 -- 172.21.15.52:0/1052163122 shutdown_connections 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec0b3350 0x7f8bec1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/1052163122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec06bfd0 0x7f8bec06c3b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 -- 172.21.15.52:0/1052163122 >> 172.21.15.52:0/1052163122 conn(0x7f8bec0d11c0 msgr2=0x7f8bec0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 -- 172.21.15.52:0/1052163122 shutdown_connections 2024-09-10T08:32:38.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.379+0000 7f8bf2c00640 1 -- 172.21.15.52:0/1052163122 wait complete. 2024-09-10T08:32:38.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.382+0000 7f8bf2c00640 1 Processor -- start 2024-09-10T08:32:38.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.382+0000 7f8bf2c00640 1 -- start start 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec06bfd0 0x7f8bec0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bec0b38a0 0x7f8bec1e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec0d2400 con 0x7f8bec0b3350 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8bec0cfcd0 con 0x7f8bec0b38a0 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bec06cd50 con 0x7f8bec06bfd0 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44998/0 (socket says 172.21.15.52:44998) 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 -- 172.21.15.52:0/3149203644 learned_addr learned my addr 172.21.15.52:0/3149203644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bebe00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec06bfd0 0x7f8bec0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf0c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bec0b38a0 0x7f8bec1e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 -- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec06bfd0 msgr2=0x7f8bec0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec06bfd0 0x7f8bec0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 -- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bec0b38a0 msgr2=0x7f8bec1e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bec0b38a0 0x7f8bec1e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 -- 172.21.15.52:0/3149203644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bec0cef00 con 0x7f8bec0b3350 2024-09-10T08:32:38.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8beb400640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e9b0 tx=0x7f8bd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8017070 con 0x7f8bec0b3350 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd800c9a0 con 0x7f8bec0b3350 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800cd90 con 0x7f8bec0b3350 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bec0cf480 con 0x7f8bec0b3350 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.383+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bec160790 con 0x7f8bec0b3350 2024-09-10T08:32:38.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.384+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec0d0cf0 con 0x7f8bec0b3350 2024-09-10T08:32:38.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.385+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bd801a070 con 0x7f8bec0b3350 2024-09-10T08:32:38.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.386+0000 7f8be3e00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 0x7f8bcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.386+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f8bd808adb0 con 0x7f8bec0b3350 2024-09-10T08:32:38.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.387+0000 7f8bebe00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 0x7f8bcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.387+0000 7f8bebe00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 0x7f8bcc06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc034000 tx=0x7f8bdc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.391+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bd808f070 con 0x7f8bec0b3350 2024-09-10T08:32:38.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.574+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f8bec0d1df0 con 0x7f8bec0b3350 2024-09-10T08:32:38.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.577+0000 7f8be3e00640 1 -- 172.21.15.52:0/3149203644 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f8bd8059100 con 0x7f8bec0b3350 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 msgr2=0x7f8bcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 0x7f8bcc06e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc034000 tx=0x7f8bdc02e000 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 msgr2=0x7f8bec153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e9b0 tx=0x7f8bd800ee70 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 shutdown_connections 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bcc06be30 0x7f8bcc06e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bec0b38a0 0x7f8bec1e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bec0b3350 0x7f8bec153430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 --2- 172.21.15.52:0/3149203644 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bec06bfd0 0x7f8bec0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 >> 172.21.15.52:0/3149203644 conn(0x7f8bec0d11c0 msgr2=0x7f8bec0b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:38.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 shutdown_connections 2024-09-10T08:32:38.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.579+0000 7f8bf2c00640 1 -- 172.21.15.52:0/3149203644 wait complete. 2024-09-10T08:32:38.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:38.595 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-10T08:32:38.637 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:32:38.776 INFO:teuthology.orchestra.run.smithi052.stdout:1099511627776 2024-09-10T08:32:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:32:38.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:38.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.987+0000 7f57c7e00640 1 Processor -- start 2024-09-10T08:32:38.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.987+0000 7f57c7e00640 1 -- start start 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c7e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57c8141360 0x7f57c8162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57c8141740 0x7f57c80cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c7e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c81628c0 con 0x7f57c80cf5c0 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f57c8162680 con 0x7f57c8141740 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c7e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f57c80cfa00 con 0x7f57c8141360 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57bfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57c8141740 0x7f57c80cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57bfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57c8141740 0x7f57c80cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45014/0 (socket says 172.21.15.52:45014) 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57bfe00640 1 -- 172.21.15.52:0/785764144 learned_addr learned my addr 172.21.15.52:0/785764144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.988+0000 7f57c6a00640 1 --2- 172.21.15.52:0/785764144 >> v2:172.21.15.176:3300/0 conn(0x7f57c8141360 0x7f57c8162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.989+0000 7f57bfe00640 1 -- 172.21.15.52:0/785764144 >> v2:172.21.15.176:3300/0 conn(0x7f57c8141360 msgr2=0x7f57c8162140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.989+0000 7f57bfe00640 1 --2- 172.21.15.52:0/785764144 >> v2:172.21.15.176:3300/0 conn(0x7f57c8141360 0x7f57c8162140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.989+0000 7f57bfe00640 1 -- 172.21.15.52:0/785764144 >> v1:172.21.15.176:6789/0 conn(0x7f57c80cf5c0 legacy=0x7f57c8143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.989+0000 7f57bfe00640 1 -- 172.21.15.52:0/785764144 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c8162ba0 con 0x7f57c8141740 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57bfe00640 1 --2- 172.21.15.52:0/785764144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c80cf080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f57c8068920 tx=0x7f57b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56944cd3ea3010b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57c6000640 1 -- 172.21.15.52:0/785764144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0037070 con 0x7f57c8141740 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57c6000640 1 -- 172.21.15.52:0/785764144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b0032440 con 0x7f57c8141740 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57c6000640 1 -- 172.21.15.52:0/785764144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0032810 con 0x7f57c8141740 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57c7e00640 1 -- 172.21.15.52:0/785764144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 msgr2=0x7f57c80cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.990+0000 7f57c7e00640 1 --2- 172.21.15.52:0/785764144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c80cf080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f57c8068920 tx=0x7f57b002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 -- 172.21.15.52:0/785764144 shutdown_connections 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 --2- 172.21.15.52:0/785764144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c80cf080 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 --2- 172.21.15.52:0/785764144 >> v2:172.21.15.176:3300/0 conn(0x7f57c8141360 0x7f57c8162140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 -- 172.21.15.52:0/785764144 >> 172.21.15.52:0/785764144 conn(0x7f57c806e2d0 msgr2=0x7f57c806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 -- 172.21.15.52:0/785764144 shutdown_connections 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.991+0000 7f57c7e00640 1 -- 172.21.15.52:0/785764144 wait complete. 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.992+0000 7f57c7e00640 1 Processor -- start 2024-09-10T08:32:38.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.992+0000 7f57c7e00640 1 -- start start 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57c80cf5c0 0x7f57c813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57c8141360 0x7f57c80ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57c81432d0 con 0x7f57c8141740 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57c8141da0 con 0x7f57c8141360 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57c8143450 con 0x7f57c80cf5c0 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.993+0000 7f57c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57bfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57c8141360 0x7f57c80ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45020/0 (socket says 172.21.15.52:45020) 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 -- 172.21.15.52:0/802203905 learned_addr learned my addr 172.21.15.52:0/802203905 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c6a00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57c80cf5c0 0x7f57c813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 -- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57c80cf5c0 msgr2=0x7f57c813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57c80cf5c0 0x7f57c813fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 -- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57c8141360 msgr2=0x7f57c80ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57c8141360 0x7f57c80ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 -- 172.21.15.52:0/802203905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c81402e0 con 0x7f57c8141740 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.994+0000 7f57c7400640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c710 tx=0x7f57c000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.995+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0016020 con 0x7f57c8141740 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.995+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c0006d50 con 0x7f57c8141740 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.995+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0003bb0 con 0x7f57c8141740 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.995+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c80ccd60 con 0x7f57c8141740 2024-09-10T08:32:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.995+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c80cd320 con 0x7f57c8141740 2024-09-10T08:32:38.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.996+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c8162140 con 0x7f57c8141740 2024-09-10T08:32:38.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.997+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57c000a850 con 0x7f57c8141740 2024-09-10T08:32:38.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.997+0000 7f57bf400640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 0x7f57a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:38.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.998+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f57c008a910 con 0x7f57c8141740 2024-09-10T08:32:38.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.998+0000 7f57c6a00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 0x7f57a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:38.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:38.999+0000 7f57c6a00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 0x7f57a406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57b8006fd0 tx=0x7f57b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:39.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.001+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57c0020020 con 0x7f57c8141740 2024-09-10T08:32:39.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.224+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57c806cb00 con 0x7f57c8141740 2024-09-10T08:32:39.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.225+0000 7f57bf400640 1 -- 172.21.15.52:0/802203905 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5226 (secure 0 0 0) 0x7f57c81402e0 con 0x7f57c8141740 2024-09-10T08:32:39.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:39.224 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"btime":"2024-09-10T08:32:28:165289+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/346517988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":346517988},{"type":"v1","addr":"172.21.15.52:6834","nonce":346517988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5845,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3539522339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3539522339},{"type":"v1","addr":"172.21.15.176:6836","nonce":3539522339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1157302538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1157302538},{"type":"v1","addr":"172.21.15.176:6837","nonce":1157302538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:27.581371+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6135},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6135":{"gid":6135,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/2886852302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2886852302},{"type":"v1","addr":"172.21.15.52:6835","nonce":2886852302}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6135,"qdb_cluster":[6135]},"id":4}]} 2024-09-10T08:32:39.225 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 34 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 msgr2=0x7f57a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 0x7f57a406e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57b8006fd0 tx=0x7f57b8008040 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 msgr2=0x7f57c8072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c710 tx=0x7f57c000cbd0 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 shutdown_connections 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57a406be30 0x7f57a406e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57c8141740 0x7f57c8072f70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57c8141360 0x7f57c80ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 --2- 172.21.15.52:0/802203905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57c80cf5c0 0x7f57c813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 >> 172.21.15.52:0/802203905 conn(0x7f57c806e2d0 msgr2=0x7f57c80b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 shutdown_connections 2024-09-10T08:32:39.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39.227+0000 7f57c7e00640 1 -- 172.21.15.52:0/802203905 wait complete. 2024-09-10T08:32:39.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T08:32:39.418 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:32:38.634067+0000","btime":"2024-09-10T08:32:38.634067+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:32:38.634067+0000","atime":"2024-09-10T08:32:38.634067+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5612,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":5612,"want_loner":5612,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:32:39.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:32:38.634067+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-10T08:32:38.634067+0000", "change_attr": 0, "client_caps": [ { "client_id": 5612, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-10T08:32:38.634067+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5612, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:32:38.634067+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5612, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:32:39.419 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:39.419 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> import uuid 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> n = 40 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = False 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> if 0 > 0: 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = True 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> dpath = os.path.dirname(path) 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> fnameprefix = os.path.basename(path) 2024-09-10T08:32:39.455 DEBUG:teuthology.orchestra.run.smithi052:> os.makedirs(dpath, exist_ok=True) 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> for i in range(n): 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> f.write(f"{i}") 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> f.flush() 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(f.fileno()) 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> os.unlink(fpath) 2024-09-10T08:32:39.456 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> if create_hard_links: 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> for j in range(0): 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> finally: 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> os.close(dirfd) 2024-09-10T08:32:39.457 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:32:39.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:32:39.850 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:39.850 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:39.926 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:39.926 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:40.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:32:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.202+0000 7f94eae00640 1 Processor -- start 2024-09-10T08:32:40.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.202+0000 7f94eae00640 1 -- start start 2024-09-10T08:32:40.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94eae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 0x7f94e40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94eae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f94e40b5f90 0x7f94e40735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94eae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e40b4020 con 0x7f94e4073180 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94eae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f94e4073b00 con 0x7f94e40b5f90 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94eae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94e40b42c0 con 0x7f94e4145ed0 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f94e40b5f90 0x7f94e40735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f94e40b5f90 0x7f94e40735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45034/0 (socket says 172.21.15.52:45034) 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 -- 172.21.15.52:0/2371969432 learned_addr learned my addr 172.21.15.52:0/2371969432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e3e00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 0x7f94e40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 -- 172.21.15.52:0/2371969432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 msgr2=0x7f94e40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 0x7f94e40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 -- 172.21.15.52:0/2371969432 >> v1:172.21.15.176:6789/0 conn(0x7f94e4073180 legacy=0x7f94e40b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.204+0000 7f94e8e00640 1 -- 172.21.15.52:0/2371969432 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e40b45a0 con 0x7f94e40b5f90 2024-09-10T08:32:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.205+0000 7f94e3e00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 0x7f94e40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.205+0000 7f94e8e00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e40b5f90 0x7f94e40735c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009e50 tx=0x7f94dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883eccdc84fe6489 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94e3400640 1 -- 172.21.15.52:0/2371969432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc036070 con 0x7f94e40b5f90 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94e3400640 1 -- 172.21.15.52:0/2371969432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc031600 con 0x7f94e40b5f90 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94e3400640 1 -- 172.21.15.52:0/2371969432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0319d0 con 0x7f94e40b5f90 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 -- 172.21.15.52:0/2371969432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e40b5f90 msgr2=0x7f94e40735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e40b5f90 0x7f94e40735c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009e50 tx=0x7f94dc02a710 comp rx=0 tx=0).stop 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 -- 172.21.15.52:0/2371969432 shutdown_connections 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e40b5f90 0x7f94e40735c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 --2- 172.21.15.52:0/2371969432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4145ed0 0x7f94e40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.206+0000 7f94eae00640 1 -- 172.21.15.52:0/2371969432 >> 172.21.15.52:0/2371969432 conn(0x7f94e40ccec0 msgr2=0x7f94e40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.207+0000 7f94eae00640 1 -- 172.21.15.52:0/2371969432 shutdown_connections 2024-09-10T08:32:40.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.207+0000 7f94eae00640 1 -- 172.21.15.52:0/2371969432 wait complete. 2024-09-10T08:32:40.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.208+0000 7f94eae00640 1 Processor -- start 2024-09-10T08:32:40.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.208+0000 7f94eae00640 1 -- start start 2024-09-10T08:32:40.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4073180 0x7f94e41f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e40b5f90 0x7f94e413a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41462b0 con 0x7f94e4145ed0 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94e40b4b60 con 0x7f94e40b5f90 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94eae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f94e4146430 con 0x7f94e4073180 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94e8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94e8e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45042/0 (socket says 172.21.15.52:45042) 2024-09-10T08:32:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.209+0000 7f94e8e00640 1 -- 172.21.15.52:0/4111251080 learned_addr learned my addr 172.21.15.52:0/4111251080 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e3e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4073180 0x7f94e41f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94db400640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e40b5f90 0x7f94e413a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 -- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4073180 msgr2=0x7f94e41f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4073180 0x7f94e41f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 -- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e40b5f90 msgr2=0x7f94e413a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e40b5f90 0x7f94e413a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 -- 172.21.15.52:0/4111251080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e41f53b0 con 0x7f94e4145ed0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e8e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009f70 tx=0x7f94dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc03f020 con 0x7f94e4145ed0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc037040 con 0x7f94e4145ed0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.210+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc036070 con 0x7f94e4145ed0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.211+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e413b7d0 con 0x7f94e4145ed0 2024-09-10T08:32:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.211+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e413b210 con 0x7f94e4145ed0 2024-09-10T08:32:40.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.212+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e40735c0 con 0x7f94e4145ed0 2024-09-10T08:32:40.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.213+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94dc042020 con 0x7f94e4145ed0 2024-09-10T08:32:40.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.214+0000 7f94e0c00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 0x7f94c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.214+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f94dc0ab400 con 0x7f94e4145ed0 2024-09-10T08:32:40.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.214+0000 7f94e3e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 0x7f94c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.215+0000 7f94e3e00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 0x7f94c006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94e413a210 tx=0x7f94d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.218+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94dc049030 con 0x7f94e4145ed0 2024-09-10T08:32:40.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.417+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f94e40d1090 con 0x7f94e4145ed0 2024-09-10T08:32:40.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.417+0000 7f94e0c00640 1 -- 172.21.15.52:0/4111251080 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) ==== 80+0+0 (secure 0 0 0) 0x7f94dc079d10 con 0x7f94e4145ed0 2024-09-10T08:32:40.416 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.419+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 msgr2=0x7f94c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.419+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 0x7f94c006e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f94e413a210 tx=0x7f94d4008040 comp rx=0 tx=0).stop 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.419+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 msgr2=0x7f94e4143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.419+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009f70 tx=0x7f94dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 shutdown_connections 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94c006be30 0x7f94c006e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94e4145ed0 0x7f94e4143120 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e40b5f90 0x7f94e413a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 --2- 172.21.15.52:0/4111251080 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94e4073180 0x7f94e41f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 >> 172.21.15.52:0/4111251080 conn(0x7f94e40ccec0 msgr2=0x7f94e40cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 shutdown_connections 2024-09-10T08:32:40.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.420+0000 7f94eae00640 1 -- 172.21.15.52:0/4111251080 wait complete. 2024-09-10T08:32:40.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:32:40.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:40.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:32:40.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:32:40.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:40.565 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:32:40.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-10T08:32:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.807+0000 7f644bc00640 1 Processor -- start 2024-09-10T08:32:40.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.807+0000 7f644bc00640 1 -- start start 2024-09-10T08:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f644bc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 0x7f64440cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f644bc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64440714b0 con 0x7f6444071c70 2024-09-10T08:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f644bc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64440cd880 con 0x7f64440732e0 2024-09-10T08:32:40.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f644bc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64440cdb60 con 0x7f64440cce30 2024-09-10T08:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f6449c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6444071c70 0x7f644415c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40798/0 (socket says 172.21.15.52:40798) 2024-09-10T08:32:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.808+0000 7f6449c00640 1 -- 172.21.15.52:0/4292101529 learned_addr learned my addr 172.21.15.52:0/4292101529 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443e00640 1 --2- 172.21.15.52:0/4292101529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 0x7f64440cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419165935 0 0) 0x7f64440714b0 con 0x7f6444071c70 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642c003520 con 0x7f6444071c70 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802164668 0 0) 0x7f64440cd880 con 0x7f64440732e0 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64440714b0 con 0x7f64440732e0 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443e00640 1 -- 172.21.15.52:0/4292101529 >> v1:172.21.15.176:6789/0 conn(0x7f64440732e0 legacy=0x7f64440736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443e00640 1 -- 172.21.15.52:0/4292101529 >> v1:172.21.15.52:6789/0 conn(0x7f6444071c70 legacy=0x7f644415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.809+0000 7f6443e00640 1 -- 172.21.15.52:0/4292101529 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64440cde40 con 0x7f64440cce30 2024-09-10T08:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.810+0000 7f6443e00640 1 --2- 172.21.15.52:0/4292101529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 0x7f64440cd270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64300097d0 tx=0x7f643002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a91c868a7b5cea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430037070 con 0x7f64440cce30 2024-09-10T08:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6430032440 con 0x7f64440cce30 2024-09-10T08:32:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f6443400640 1 -- 172.21.15.52:0/4292101529 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430032810 con 0x7f64440cce30 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 -- 172.21.15.52:0/4292101529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 msgr2=0x7f64440cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 --2- 172.21.15.52:0/4292101529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 0x7f64440cd270 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64300097d0 tx=0x7f643002a180 comp rx=0 tx=0).stop 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 -- 172.21.15.52:0/4292101529 shutdown_connections 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 --2- 172.21.15.52:0/4292101529 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440cce30 0x7f64440cd270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 -- 172.21.15.52:0/4292101529 >> 172.21.15.52:0/4292101529 conn(0x7f644406d0f0 msgr2=0x7f644406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 -- 172.21.15.52:0/4292101529 shutdown_connections 2024-09-10T08:32:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.811+0000 7f644bc00640 1 -- 172.21.15.52:0/4292101529 wait complete. 2024-09-10T08:32:40.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.813+0000 7f644bc00640 1 Processor -- start 2024-09-10T08:32:40.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.813+0000 7f644bc00640 1 -- start start 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440732e0 0x7f644414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64440cce30 0x7f6444158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f64440722a0 con 0x7f6444071c70 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6444072120 con 0x7f64440cce30 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f644bc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6444072420 con 0x7f64440732e0 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45054/0 (socket says 172.21.15.52:45054) 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.814+0000 7f6449200640 1 -- 172.21.15.52:0/1502327603 learned_addr learned my addr 172.21.15.52:0/1502327603 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6443e00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440732e0 0x7f644414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449c00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64440cce30 0x7f6444158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 -- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440732e0 msgr2=0x7f644414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440732e0 0x7f644414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 -- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64440cce30 msgr2=0x7f6444158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64440cce30 0x7f6444158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 -- 172.21.15.52:0/1502327603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644414b740 con 0x7f6444071c70 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6449200640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f643800c430 tx=0x7f643800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.815+0000 7f6440c00640 1 -- 172.21.15.52:0/1502327603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438017070 con 0x7f6444071c70 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.816+0000 7f6440c00640 1 -- 172.21.15.52:0/1502327603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64380052f0 con 0x7f6444071c70 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.816+0000 7f6440c00640 1 -- 172.21.15.52:0/1502327603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438003830 con 0x7f6444071c70 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.816+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6444158fb0 con 0x7f6444071c70 2024-09-10T08:32:40.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.816+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6444159550 con 0x7f6444071c70 2024-09-10T08:32:40.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.819+0000 7f6440c00640 1 -- 172.21.15.52:0/1502327603 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f643801a070 con 0x7f6444071c70 2024-09-10T08:32:40.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.819+0000 7f6440c00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 0x7f642406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.820+0000 7f6440c00640 1 -- 172.21.15.52:0/1502327603 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f643808a2f0 con 0x7f6444071c70 2024-09-10T08:32:40.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.820+0000 7f644ea8e740 1 Processor -- start 2024-09-10T08:32:40.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.820+0000 7f644ea8e740 1 -- start start 2024-09-10T08:32:40.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.820+0000 7f6443e00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 0x7f642406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1420 0x5640b36f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36f2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5640b360f660 con 0x5640b36a7480 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5640b35b7680 con 0x5640b36c1420 2024-09-10T08:32:40.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5640b360b620 con 0x5640b36c1800 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6443e00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 0x7f642406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6430034000 tx=0x7f643002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45068/0 (socket says 172.21.15.52:45068) 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 -- 172.21.15.52:0/1027118958 learned_addr learned my addr 172.21.15.52:0/1027118958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6443e00640 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449200640 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1420 0x5640b36f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 -- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 msgr2=0x5640b36f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 -- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1420 msgr2=0x5640b36f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1420 0x5640b36f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.821+0000 7f6449c00640 1 -- 172.21.15.52:0/1027118958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b33ec7d0 con 0x5640b36a7480 2024-09-10T08:32:40.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.822+0000 7f6449c00640 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f643c001fc0 tx=0x7f643c007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c99f8c64ef6740 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.822+0000 7f6435600640 1 -- 172.21.15.52:0/1027118958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c007ac0 con 0x5640b36a7480 2024-09-10T08:32:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.822+0000 7f6435600640 1 -- 172.21.15.52:0/1027118958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c018070 con 0x5640b36a7480 2024-09-10T08:32:40.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.822+0000 7f6435600640 1 -- 172.21.15.52:0/1027118958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c012760 con 0x5640b36a7480 2024-09-10T08:32:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- 172.21.15.52:0/1027118958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 msgr2=0x5640b36f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f643c001fc0 tx=0x7f643c007410 comp rx=0 tx=0).stop 2024-09-10T08:32:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- 172.21.15.52:0/1027118958 shutdown_connections 2024-09-10T08:32:40.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36a7480 0x5640b36f2740 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 --2- 172.21.15.52:0/1027118958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1420 0x5640b36f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- 172.21.15.52:0/1027118958 >> 172.21.15.52:0/1027118958 conn(0x5640b36a8220 msgr2=0x5640b36f0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- 172.21.15.52:0/1027118958 shutdown_connections 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- 172.21.15.52:0/1027118958 wait complete. 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.823+0000 7f644ea8e740 1 -- start start 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.824+0000 7f644ea8e740 1 Processor -- start 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 0x5640b36ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5640b36a63e0 con 0x5640b36c1420 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5640b35984c0 con 0x5640b36c1800 2024-09-10T08:32:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5640b36a66c0 con 0x5640b36eb6e0 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f644ea8e740 10 client.0 _ll_register_callbacks cb 0x5640b3607e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45072/0 (socket says 172.21.15.52:45072) 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 -- 172.21.15.52:0/3048682666 learned_addr learned my addr 172.21.15.52:0/3048682666 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449c00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 0x5640b36ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6443e00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 -- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 msgr2=0x5640b36ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 0x5640b36ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 -- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 msgr2=0x5640b36d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449200640 1 -- 172.21.15.52:0/3048682666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b33223f0 con 0x5640b36c1420 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6449c00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 0x5640b36ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:40.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.825+0000 7f6443e00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:40.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f6449200640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6438088780 tx=0x7f643805c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8c41a28422db23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64380568f0 con 0x5640b36c1420 2024-09-10T08:32:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f6438060bd0 con 0x5640b36c1420 2024-09-10T08:32:40.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f643c018070 con 0x5640b36c1420 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6438060dd0 con 0x5640b36c1420 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 10 client.6354 fetch_fsmap learned FSMap version 34 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5640b32e20f0 con 0x5640b36c1420 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c018070 con 0x5640b36c1420 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f6438057980 con 0x5640b36c1420 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 10 client.6354 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 10 client.6354 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.826+0000 7f644ea8e740 20 client.6354 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36e9870 0x5640b37043c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f644ea8e740 4 client.6354 mds_command: new command op to 6135 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 --> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b361cd90 con 0x5640b36e9870 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f6443e00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36e9870 0x5640b37043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f6443e00640 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36e9870 0x5640b37043c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c48653b80baeb543 server_cookie=225fe5580214f9ff in_seq=0 out_seq=0 2024-09-10T08:32:40.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.827+0000 7f642a000640 10 client.6354 ms_handle_connect on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f642a000640 1 -- 172.21.15.52:0/3048682666 <== mds.0 v2:172.21.15.52:6832/2886852302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640b361cd90 con 0x5640b36e9870 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f642a000640 10 client.6354 handle_command_reply: tid=0 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 client.6354 shutdown 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 msgr2=0x5640b36ec5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6438088780 tx=0x7f643805c8f0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 shutdown_connections 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36eb6e0 0x5640b36ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36e9870 0x5640b37043c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3048682666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ec5a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 >> 172.21.15.52:0/3048682666 conn(0x5640b36a7480 msgr2=0x5640b36eead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.828+0000 7f642a000640 0 client.6354 ms_handle_reset on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.829+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 shutdown_connections 2024-09-10T08:32:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.829+0000 7f644ea8e740 1 -- 172.21.15.52:0/3048682666 wait complete. 2024-09-10T08:32:40.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.829+0000 7f644ea8e740 20 client.6354 trim_cache size 0 max 16384 2024-09-10T08:32:40.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.844+0000 7f644ea8e740 1 Processor -- start 2024-09-10T08:32:40.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.844+0000 7f644ea8e740 1 -- start start 2024-09-10T08:32:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36eb6e0 0x5640b36a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6444200b30 con 0x5640b36c1420 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64441ffb60 con 0x5640b36eb6e0 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f64440cacd0 con 0x5640b36c1800 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f6449200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45086/0 (socket says 172.21.15.52:45086) 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.845+0000 7f6449200640 1 -- 172.21.15.52:0/3548532219 learned_addr learned my addr 172.21.15.52:0/3548532219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6443e00640 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449c00640 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36eb6e0 0x5640b36a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 -- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 msgr2=0x5640b36ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 -- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36eb6e0 msgr2=0x5640b36a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36eb6e0 0x5640b36a4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 -- 172.21.15.52:0/3548532219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b36e8ba0 con 0x5640b36c1420 2024-09-10T08:32:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6449200640 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64380883d0 tx=0x7f6438014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c472801d60de84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6434c00640 1 -- 172.21.15.52:0/3548532219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438061060 con 0x5640b36c1420 2024-09-10T08:32:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6434c00640 1 -- 172.21.15.52:0/3548532219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6438054ba0 con 0x5640b36c1420 2024-09-10T08:32:40.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.846+0000 7f6434c00640 1 -- 172.21.15.52:0/3548532219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438088450 con 0x5640b36c1420 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 -- 172.21.15.52:0/3548532219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 msgr2=0x5640b36ed130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64380883d0 tx=0x7f6438014000 comp rx=0 tx=0).stop 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 -- 172.21.15.52:0/3548532219 shutdown_connections 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36eb6e0 0x5640b36a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1800 0x5640b36ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 --2- 172.21.15.52:0/3548532219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36c1420 0x5640b36ed130 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 -- 172.21.15.52:0/3548532219 >> 172.21.15.52:0/3548532219 conn(0x5640b36a7480 msgr2=0x5640b36f0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 -- 172.21.15.52:0/3548532219 shutdown_connections 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.847+0000 7f644ea8e740 1 -- 172.21.15.52:0/3548532219 wait complete. 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.848+0000 7f644ea8e740 1 -- start start 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.848+0000 7f644ea8e740 1 Processor -- start 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1420 0x5640b3755090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5640b36f30c0 con 0x5640b36eb6e0 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64440cb320 con 0x5640b36c1800 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5640b3485940 con 0x5640b36c1420 2024-09-10T08:32:40.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f644ea8e740 10 client.0 _ll_register_callbacks cb 0x7f6438058160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f6449c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f6449c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45098/0 (socket says 172.21.15.52:45098) 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f6449c00640 1 -- 172.21.15.52:0/741510363 learned_addr learned my addr 172.21.15.52:0/741510363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f6449200640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1420 0x5640b3755090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.849+0000 7f6443e00640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 -- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1420 msgr2=0x5640b3755090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1420 0x5640b3755090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 -- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 msgr2=0x5640b36bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 -- 172.21.15.52:0/741510363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b376f4a0 con 0x5640b36eb6e0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f6449c00640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f643c007450 tx=0x7f643c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5214d75064389bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:40.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f642a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c007ac0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f643c029af0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.850+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6438054ba0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f643c029cf0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 10 client.6360 fetch_fsmap learned FSMap version 34 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x5640b37555d0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6438054ba0 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f643c026070 con 0x5640b36eb6e0 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 10 client.6360 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 10 client.6360 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 20 client.6360 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36ed2e0 0x5640b36f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 4 client.6360 mds_command: new command op to 6135 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T08:32:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 --> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640b36170e0 con 0x5640b36ed2e0 2024-09-10T08:32:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.851+0000 7f6449200640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36ed2e0 0x5640b36f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.852+0000 7f6449200640 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36ed2e0 0x5640b36f1760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d10e1066a34d09 server_cookie=bdf973f31073eef2 in_seq=0 out_seq=0 2024-09-10T08:32:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.852+0000 7f642a000640 10 client.6360 ms_handle_connect on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:40.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.867+0000 7f642a000640 1 -- 172.21.15.52:0/741510363 <== mds.0 v2:172.21.15.52:6832/2886852302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640b36170e0 con 0x5640b36ed2e0 2024-09-10T08:32:40.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.867+0000 7f642a000640 10 client.6360 handle_command_reply: tid=0 2024-09-10T08:32:40.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.867+0000 7f644ea8e740 1 client.6360 shutdown 2024-09-10T08:32:40.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 msgr2=0x5640b36c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f643c007450 tx=0x7f643c001250 comp rx=0 tx=0).stop 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 shutdown_connections 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:6832/2886852302,v1:172.21.15.52:6835/2886852302] conn(0x5640b36ed2e0 0x5640b36f1760 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5640b36eb6e0 0x5640b36c01a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5640b36c1800 0x5640b36bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f642a000640 0 client.6360 ms_handle_reset on v2:172.21.15.52:6832/2886852302 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 --2- 172.21.15.52:0/741510363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5640b36c1420 0x5640b3755090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 >> 172.21.15.52:0/741510363 conn(0x5640b36a7480 msgr2=0x5640b36e9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 shutdown_connections 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 1 -- 172.21.15.52:0/741510363 wait complete. 2024-09-10T08:32:40.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.868+0000 7f644ea8e740 20 client.6360 trim_cache size 0 max 16384 2024-09-10T08:32:40.869 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:40.869 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:32:40.869 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:32:40.869 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 msgr2=0x7f642406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 0x7f642406e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6430034000 tx=0x7f643002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 msgr2=0x7f6444152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f643800c430 tx=0x7f643800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 shutdown_connections 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f642406be30 0x7f642406e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64440cce30 0x7f6444158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64440732e0 0x7f644414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 --2- 172.21.15.52:0/1502327603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6444071c70 0x7f6444152210 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 >> 172.21.15.52:0/1502327603 conn(0x7f644406d0f0 msgr2=0x7f644406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:40.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 shutdown_connections 2024-09-10T08:32:40.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:40.869+0000 7f644bc00640 1 -- 172.21.15.52:0/1502327603 wait complete. 2024-09-10T08:32:40.884 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:32:40.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:40.884 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:32:40.884 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:40.885 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:32:40.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:40.885 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:32:40.885 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:32:40.898 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:32:40.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T08:32:40.901 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:32:40.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T08:32:40.903 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:32:40.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T08:32:40.903 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:32:40.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T08:32:41.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.108+0000 7f1e54a00640 1 Processor -- start 2024-09-10T08:32:41.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.108+0000 7f1e54a00640 1 -- start start 2024-09-10T08:32:41.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7ff0fa800640 1 Processor -- start 2024-09-10T08:32:41.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7ff0fa800640 1 -- start start 2024-09-10T08:32:41.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7f1e54a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1e5015e440 0x7f1e500d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7f1e54a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e500cf450 0x7f1e500b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7f1e54a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e500d3990 con 0x7f1e500b6540 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7f1e54a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1e500b6990 con 0x7f1e500cf450 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.109+0000 7f1e54a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1e500d3c70 con 0x7f1e5015e440 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e500cf450 0x7f1e500b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e500cf450 0x7f1e500b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45114/0 (socket says 172.21.15.52:45114) 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 -- 172.21.15.52:0/992861358 learned_addr learned my addr 172.21.15.52:0/992861358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4e800640 1 --2- 172.21.15.52:0/992861358 >> v2:172.21.15.176:3300/0 conn(0x7f1e5015e440 0x7f1e500d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7ff0fa800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0f415e4c0 0x7ff0f40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7ff0fa800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 0x7ff0f40d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7ff0fa800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f40cf5e0 con 0x7ff0f4162b70 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7ff0fa800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f40cf8c0 con 0x7ff0f40b6790 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7ff0fa800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f40d2980 con 0x7ff0f415e4c0 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 -- 172.21.15.52:0/992861358 >> v2:172.21.15.176:3300/0 conn(0x7f1e5015e440 msgr2=0x7f1e500d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 --2- 172.21.15.52:0/992861358 >> v2:172.21.15.176:3300/0 conn(0x7f1e5015e440 0x7f1e500d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 -- 172.21.15.52:0/992861358 >> v1:172.21.15.176:6789/0 conn(0x7f1e500b6540 legacy=0x7f1e5006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.110+0000 7f1e4de00640 1 -- 172.21.15.52:0/992861358 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e500d3f50 con 0x7f1e500cf450 2024-09-10T08:32:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 0x7ff0f40d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0f415e4c0 0x7ff0f40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0f415e4c0 0x7ff0f40cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:39048/0 (socket says 172.21.15.52:39048) 2024-09-10T08:32:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 -- 172.21.15.52:0/1898223098 learned_addr learned my addr 172.21.15.52:0/1898223098 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7f0b8ee00640 1 Processor -- start 2024-09-10T08:32:41.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7f0b8ee00640 1 -- start start 2024-09-10T08:32:41.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 -- 172.21.15.52:0/1898223098 >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 msgr2=0x7ff0f40d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 --2- 172.21.15.52:0/1898223098 >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 0x7ff0f40d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 -- 172.21.15.52:0/1898223098 >> v1:172.21.15.176:6789/0 conn(0x7ff0f4162b70 legacy=0x7ff0f40b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.111+0000 7ff0f9400640 1 -- 172.21.15.52:0/1898223098 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f40d2c60 con 0x7ff0f415e4c0 2024-09-10T08:32:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f1e4de00640 1 --2- 172.21.15.52:0/992861358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e500cf450 0x7f1e500b6000 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1e50068870 tx=0x7f1e3c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0689a30e5271bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7ff0f9e00640 1 --2- 172.21.15.52:0/1898223098 >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 0x7ff0f40d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:41.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f1e4d400640 1 -- 172.21.15.52:0/992861358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c037070 con 0x7f1e500cf450 2024-09-10T08:32:41.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f1e4d400640 1 -- 172.21.15.52:0/992861358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c02ae50 con 0x7f1e500cf450 2024-09-10T08:32:41.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f1e4d400640 1 -- 172.21.15.52:0/992861358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c032860 con 0x7f1e500cf450 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f0b8ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b880cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f0b8ee00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0b880b6790 0x7f0b880d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f0b8ee00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b880cf5e0 con 0x7f0b88162b70 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f0b8ee00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0b880cf8c0 con 0x7f0b880b6790 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.112+0000 7f0b8ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b880d2980 con 0x7f0b8815e4c0 2024-09-10T08:32:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f0b8d000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0b88162b70 0x7f0b880b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40800/0 (socket says 172.21.15.52:40800) 2024-09-10T08:32:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f0b8d000640 1 -- 172.21.15.52:0/1829852836 learned_addr learned my addr 172.21.15.52:0/1829852836 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7ff0f9400640 1 --2- 172.21.15.52:0/1898223098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f415e4c0 0x7ff0f40cef50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40687d0 tx=0x7ff0e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd065371e08b4aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f0b8e400640 1 --2- 172.21.15.52:0/1829852836 >> v2:172.21.15.176:3300/0 conn(0x7f0b880b6790 0x7f0b880d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f0b8da00640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b880cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 -- 172.21.15.52:0/992861358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e500cf450 msgr2=0x7f1e500b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 --2- 172.21.15.52:0/992861358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e500cf450 0x7f1e500b6000 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1e50068870 tx=0x7f1e3c02a300 comp rx=0 tx=0).stop 2024-09-10T08:32:41.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7fee47e00640 1 Processor -- start 2024-09-10T08:32:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7ff0f3e00640 1 -- 172.21.15.52:0/1898223098 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8037070 con 0x7ff0f415e4c0 2024-09-10T08:32:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 -- 172.21.15.52:0/992861358 shutdown_connections 2024-09-10T08:32:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 --2- 172.21.15.52:0/992861358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e500cf450 0x7f1e500b6000 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 --2- 172.21.15.52:0/992861358 >> v2:172.21.15.176:3300/0 conn(0x7f1e5015e440 0x7f1e500d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f1e54a00640 1 -- 172.21.15.52:0/992861358 >> 172.21.15.52:0/992861358 conn(0x7f1e50067f80 msgr2=0x7f1e500d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7ff0f3e00640 1 -- 172.21.15.52:0/1898223098 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e802ae10 con 0x7ff0f415e4c0 2024-09-10T08:32:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7ff0f3e00640 1 -- 172.21.15.52:0/1898223098 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8032660 con 0x7ff0f415e4c0 2024-09-10T08:32:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.113+0000 7f0b87e00640 1 -- 172.21.15.52:0/1829852836 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847201421 0 0) 0x7f0b880cf5e0 con 0x7f0b88162b70 2024-09-10T08:32:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7fee47e00640 1 -- start start 2024-09-10T08:32:41.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f1e54a00640 1 -- 172.21.15.52:0/992861358 shutdown_connections 2024-09-10T08:32:41.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f0b8e400640 1 -- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 msgr2=0x7f0b880cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:41.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f0b8e400640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b880cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f0b8e400640 1 -- 172.21.15.52:0/1829852836 >> v1:172.21.15.52:6789/0 conn(0x7f0b88162b70 legacy=0x7f0b880b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f0b8e400640 1 -- 172.21.15.52:0/1829852836 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b880d2c60 con 0x7f0b880b6790 2024-09-10T08:32:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7f1e54a00640 1 -- 172.21.15.52:0/992861358 wait complete. 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 -- 172.21.15.52:0/1898223098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f415e4c0 msgr2=0x7ff0f40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 --2- 172.21.15.52:0/1898223098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f415e4c0 0x7ff0f40cef50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40687d0 tx=0x7ff0e802a180 comp rx=0 tx=0).stop 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 -- 172.21.15.52:0/1898223098 shutdown_connections 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 --2- 172.21.15.52:0/1898223098 >> v2:172.21.15.52:3300/0 conn(0x7ff0f40b6790 0x7ff0f40d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 --2- 172.21.15.52:0/1898223098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f415e4c0 0x7ff0f40cef50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.114+0000 7ff0fa800640 1 -- 172.21.15.52:0/1898223098 >> 172.21.15.52:0/1898223098 conn(0x7ff0f40d1080 msgr2=0x7ff0f40d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.115+0000 7ff0fa800640 1 -- 172.21.15.52:0/1898223098 shutdown_connections 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.115+0000 7ff0fa800640 1 -- 172.21.15.52:0/1898223098 wait complete. 2024-09-10T08:32:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.115+0000 7f0b8e400640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b880d3180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009d90 tx=0x7f0b8002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb2cc262026c2a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.115+0000 7fee47e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 0x7fee480d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.115+0000 7fee47e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee480d3990 con 0x7fee480b6710 2024-09-10T08:32:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee480d3c70 con 0x7fee4815e440 2024-09-10T08:32:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee480d3f50 con 0x7fee480cf450 2024-09-10T08:32:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7f1e54a00640 1 Processor -- start 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7f0b87e00640 1 -- 172.21.15.52:0/1829852836 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80007740 con 0x7f0b880b6790 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7f0b87e00640 1 -- 172.21.15.52:0/1829852836 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b800078e0 con 0x7f0b880b6790 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7f0b87e00640 1 -- 172.21.15.52:0/1829852836 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80007cb0 con 0x7f0b880b6790 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee46a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fee4815e440 0x7fee480b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41302/0 (socket says 172.21.15.52:41302) 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee46a00640 1 -- 172.21.15.52:0/2866316061 learned_addr learned my addr 172.21.15.52:0/2866316061 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47400640 1 --2- 172.21.15.52:0/2866316061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 0x7fee480d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee45600640 1 -- 172.21.15.52:0/2866316061 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580040914 0 0) 0x7fee480d3c70 con 0x7fee4815e440 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47400640 1 -- 172.21.15.52:0/2866316061 >> v1:172.21.15.176:6789/0 conn(0x7fee4815e440 legacy=0x7fee480b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47400640 1 -- 172.21.15.52:0/2866316061 >> v1:172.21.15.52:6789/0 conn(0x7fee480b6710 legacy=0x7fee480b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7fee47400640 1 -- 172.21.15.52:0/2866316061 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480d4230 con 0x7fee480cf450 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.116+0000 7f1e54a00640 1 -- start start 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e500b6540 0x7f1e500c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 0x7f1e500cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7ff0fa800640 1 Processor -- start 2024-09-10T08:32:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 0x7f1e5015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e500b7540 con 0x7f1e5015e440 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5015e820 con 0x7f1e500cf450 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e54a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e500b76c0 con 0x7f1e500b6540 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 0x7f1e5015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e4f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 0x7f1e5015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45130/0 (socket says 172.21.15.52:45130) 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e4f200640 1 -- 172.21.15.52:0/3330710448 learned_addr learned my addr 172.21.15.52:0/3330710448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f0b8ee00640 1 -- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 msgr2=0x7f0b880d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b880d3180 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009d90 tx=0x7f0b8002a660 comp rx=0 tx=0).stop 2024-09-10T08:32:41.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7ff0fa800640 1 -- start start 2024-09-10T08:32:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e4de00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 0x7f1e500cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.117+0000 7f1e4e800640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e500b6540 0x7f1e500c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 -- 172.21.15.52:0/1829852836 shutdown_connections 2024-09-10T08:32:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b880d3180 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/1829852836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b880cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 -- 172.21.15.52:0/1829852836 >> 172.21.15.52:0/1829852836 conn(0x7f0b880d1080 msgr2=0x7f0b880d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 -- 172.21.15.52:0/1829852836 shutdown_connections 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 -- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e500b6540 msgr2=0x7f1e500c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e500b6540 0x7f1e500c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 -- 172.21.15.52:0/3330710448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 msgr2=0x7f1e5015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 0x7f1e5015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 -- 172.21.15.52:0/3330710448 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e500c9800 con 0x7f1e500cf450 2024-09-10T08:32:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7fee47400640 1 --2- 172.21.15.52:0/2866316061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 0x7fee480d3240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee40009dc0 tx=0x7fee4002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb93031b1319181c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f0b8ee00640 1 -- 172.21.15.52:0/1829852836 wait complete. 2024-09-10T08:32:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7f1e4de00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 0x7f1e500cdef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c031000 tx=0x7f1e3c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.118+0000 7ff0fa800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f40b6790 0x7ff0f40cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0fa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 0x7ff0f414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0fa800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0fa800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f415e8a0 con 0x7ff0f415e4c0 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0fa800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f40cfba0 con 0x7ff0f40b6790 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0fa800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f415ea20 con 0x7ff0f4162b70 2024-09-10T08:32:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7fee45600640 1 -- 172.21.15.52:0/2866316061 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40007740 con 0x7fee480cf450 2024-09-10T08:32:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7fee45600640 1 -- 172.21.15.52:0/2866316061 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee400078e0 con 0x7fee480cf450 2024-09-10T08:32:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7fee45600640 1 -- 172.21.15.52:0/2866316061 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40007cb0 con 0x7fee480cf450 2024-09-10T08:32:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0f9400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f40b6790 0x7ff0f40cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c041070 con 0x7f1e500cf450 2024-09-10T08:32:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c03c680 con 0x7f1e500cf450 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c037040 con 0x7f1e500cf450 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e500c9ae0 con 0x7f1e500cf450 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e50155300 con 0x7f1e500cf450 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0f9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0f9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:51724/0 (socket says 172.21.15.52:51724) 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0f9e00640 1 -- 172.21.15.52:0/61658984 learned_addr learned my addr 172.21.15.52:0/61658984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.119+0000 7ff0f8a00640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 0x7ff0f414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 -- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f40b6790 msgr2=0x7ff0f40cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f40b6790 0x7ff0f40cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 -- 172.21.15.52:0/61658984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 msgr2=0x7ff0f414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 0x7ff0f414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 -- 172.21.15.52:0/61658984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f4161550 con 0x7ff0f4162b70 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f8a00640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 0x7ff0f414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:41.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 -- 172.21.15.52:0/2866316061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 msgr2=0x7fee480d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 --2- 172.21.15.52:0/2866316061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 0x7fee480d3240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee40009dc0 tx=0x7fee4002a760 comp rx=0 tx=0).stop 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 -- 172.21.15.52:0/2866316061 shutdown_connections 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 --2- 172.21.15.52:0/2866316061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480cf450 0x7fee480d3240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 -- 172.21.15.52:0/2866316061 >> 172.21.15.52:0/2866316061 conn(0x7fee48067f80 msgr2=0x7fee480d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e500b6000 con 0x7f1e500cf450 2024-09-10T08:32:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7ff0f9e00640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00efc0 tx=0x7ff0ec009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 -- 172.21.15.52:0/2866316061 shutdown_connections 2024-09-10T08:32:41.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.120+0000 7fee47e00640 1 -- 172.21.15.52:0/2866316061 wait complete. 2024-09-10T08:32:41.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec018020 con 0x7ff0f4162b70 2024-09-10T08:32:41.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec014480 con 0x7ff0f4162b70 2024-09-10T08:32:41.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014830 con 0x7ff0f4162b70 2024-09-10T08:32:41.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7f0b8ee00640 1 Processor -- start 2024-09-10T08:32:41.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f4161270 con 0x7ff0f4162b70 2024-09-10T08:32:41.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f40cba50 con 0x7ff0f4162b70 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.121+0000 7f0b8ee00640 1 -- start start 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b88156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b88162b70 0x7f0b880cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8815e8a0 con 0x7f0b88162b70 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b880cfba0 con 0x7f0b880b6790 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8815ea20 con 0x7f0b8815e4c0 2024-09-10T08:32:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b88156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b88156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:39082/0 (socket says 172.21.15.52:39082) 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8da00640 1 -- 172.21.15.52:0/2966094686 learned_addr learned my addr 172.21.15.52:0/2966094686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f0b8d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:51734/0 (socket says 172.21.15.52:51734) 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8e400640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b88162b70 0x7f0b880cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f40cef50 con 0x7ff0f4162b70 2024-09-10T08:32:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7fee47e00640 1 Processor -- start 2024-09-10T08:32:41.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.122+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e3c044070 con 0x7f1e500cf450 2024-09-10T08:32:41.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f1e46a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 -- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 msgr2=0x7f0b88156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b88156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 -- 172.21.15.52:0/2966094686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b88162b70 msgr2=0x7f0b880cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b88162b70 0x7f0b880cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 -- 172.21.15.52:0/2966094686 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b880cd000 con 0x7f0b8815e4c0 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7fee47e00640 1 -- start start 2024-09-10T08:32:41.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3c0ab800 con 0x7f1e500cf450 2024-09-10T08:32:41.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.123+0000 7f0b8d000640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c3e0 tx=0x7f0b7400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b740074e0 con 0x7f0b8815e4c0 2024-09-10T08:32:41.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b740047e0 con 0x7f0b8815e4c0 2024-09-10T08:32:41.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74004bd0 con 0x7f0b8815e4c0 2024-09-10T08:32:41.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f1e4e800640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b88157120 con 0x7f0b8815e4c0 2024-09-10T08:32:41.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b880cc6d0 con 0x7f0b8815e4c0 2024-09-10T08:32:41.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.124+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0ec005d10 con 0x7ff0f4162b70 2024-09-10T08:32:41.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480b6710 0x7fee4815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7f1e4e800640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009b40 tx=0x7f1e40009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 0x7fee4806fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee480b76c0 con 0x7fee4815e440 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fee480b7540 con 0x7fee480cf450 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fee480b8270 con 0x7fee480b6710 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b880cef50 con 0x7f0b8815e4c0 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee46000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee46000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:39084/0 (socket says 172.21.15.52:39084) 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee46000640 1 -- 172.21.15.52:0/587321477 learned_addr learned my addr 172.21.15.52:0/587321477 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee47400640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 0x7fee4806fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.125+0000 7fee46a00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480b6710 0x7fee4815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7ff0f1600640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 0x7ff0d406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7ff0ec08bc90 con 0x7ff0f4162b70 2024-09-10T08:32:41.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7ff0f9400640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 0x7ff0d406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 -- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480b6710 msgr2=0x7fee4815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480b6710 0x7fee4815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 -- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 msgr2=0x7fee480cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 -- 172.21.15.52:0/587321477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480cc5f0 con 0x7fee4815e440 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee46000640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee47400640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 0x7fee4806fa70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fee40031000 tx=0x7fee40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.126+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40040070 con 0x7fee4815e440 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b74011070 con 0x7f0b8815e4c0 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee480cc030 con 0x7fee4815e440 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4806f270 con 0x7fee4815e440 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40031c10 con 0x7fee4815e440 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40045460 con 0x7fee4815e440 2024-09-10T08:32:41.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.127+0000 7ff0f9400640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 0x7ff0d406e340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8034000 tx=0x7ff0e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.128+0000 7f0b85600640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 0x7f0b6806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.128+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7408a850 con 0x7f0b8815e4c0 2024-09-10T08:32:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.128+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee20005290 con 0x7fee4815e440 2024-09-10T08:32:41.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.128+0000 7f0b8da00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 0x7f0b6806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.128+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e3c04b030 con 0x7f1e500cf450 2024-09-10T08:32:41.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.129+0000 7f0b8da00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 0x7f0b6806e340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009c00 tx=0x7f0b7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.129+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee40039040 con 0x7fee4815e440 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.130+0000 7fee3ea00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 0x7fee2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.130+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7fee400ac570 con 0x7fee4815e440 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.130+0000 7fee46a00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 0x7fee2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.131+0000 7fee46a00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 0x7fee2806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee38007fd0 tx=0x7fee38007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:41.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.132+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0ec022030 con 0x7ff0f4162b70 2024-09-10T08:32:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.135+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee4007a8c0 con 0x7fee4815e440 2024-09-10T08:32:41.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.136+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b74058b90 con 0x7f0b8815e4c0 2024-09-10T08:32:41.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.389+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f1e500c9cb0 con 0x7f1e500cf450 2024-09-10T08:32:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.402+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f0b880ba580 con 0x7f0b8815e4c0 2024-09-10T08:32:41.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.437+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7ff0f40ba580 con 0x7ff0f4162b70 2024-09-10T08:32:41.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.444+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fee20005580 con 0x7fee4815e440 2024-09-10T08:32:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.600+0000 7f1e46a00640 1 -- 172.21.15.52:0/3330710448 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5507 v35) ==== 95+0+0 (secure 0 0 0) 0x7f1e3c0a9e20 con 0x7f1e500cf450 2024-09-10T08:32:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 5507 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 msgr2=0x7f1e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 0x7f1e3006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009b40 tx=0x7f1e40009190 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 msgr2=0x7f1e500cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 0x7f1e500cdef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c031000 tx=0x7f1e3c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 shutdown_connections 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e3006be30 0x7f1e3006e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e5015e440 0x7f1e5015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e500cf450 0x7f1e500cdef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 --2- 172.21.15.52:0/3330710448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e500b6540 0x7f1e500c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 >> 172.21.15.52:0/3330710448 conn(0x7f1e50067f80 msgr2=0x7f1e500b8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.602+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 shutdown_connections 2024-09-10T08:32:41.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.603+0000 7f1e54a00640 1 -- 172.21.15.52:0/3330710448 wait complete. 2024-09-10T08:32:41.603 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:32:41.604+0000 7f82a7400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:32:41.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.614+0000 7f0b85600640 1 -- 172.21.15.52:0/2966094686 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5845 v36) ==== 95+0+0 (secure 0 0 0) 0x7f0b7405ce90 con 0x7f0b8815e4c0 2024-09-10T08:32:41.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.614+0000 7ff0f1600640 1 -- 172.21.15.52:0/61658984 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6135 v36) ==== 95+0+0 (secure 0 0 0) 0x7ff0ec010040 con 0x7ff0f4162b70 2024-09-10T08:32:41.614 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 5845 2024-09-10T08:32:41.614 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6135 2024-09-10T08:32:41.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.617+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 msgr2=0x7ff0d406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.617+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 0x7ff0d406e340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8034000 tx=0x7ff0e802e000 comp rx=0 tx=0).stop 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.617+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 msgr2=0x7ff0f40c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.617+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00efc0 tx=0x7ff0ec009f90 comp rx=0 tx=0).stop 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 shutdown_connections 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0d406be80 0x7ff0d406e340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0f4162b70 0x7ff0f40c80f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f415e4c0 0x7ff0f414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 --2- 172.21.15.52:0/61658984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f40b6790 0x7ff0f40cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 >> 172.21.15.52:0/61658984 conn(0x7ff0f40d1080 msgr2=0x7ff0f40d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 shutdown_connections 2024-09-10T08:32:41.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7ff0fa800640 1 -- 172.21.15.52:0/61658984 wait complete. 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 msgr2=0x7f0b6806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 0x7f0b6806e340 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009c00 tx=0x7f0b7c009190 comp rx=0 tx=0).stop 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 msgr2=0x7f0b8815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.618+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400c3e0 tx=0x7f0b7400c8a0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 shutdown_connections 2024-09-10T08:32:41.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0b6806be80 0x7f0b6806e340 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b88162b70 0x7f0b880cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0b8815e4c0 0x7f0b8815c9b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 --2- 172.21.15.52:0/2966094686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b880b6790 0x7f0b88156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 >> 172.21.15.52:0/2966094686 conn(0x7f0b880d1080 msgr2=0x7f0b880b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 shutdown_connections 2024-09-10T08:32:41.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:41.619+0000 7f0b8ee00640 1 -- 172.21.15.52:0/2966094686 wait complete. 2024-09-10T08:32:41.622 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:32:41.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:32:41.627 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:32:41.628 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:41.636 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:32:41.636 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:32:41.637 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:32:41.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:32:41.641 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:32:41.642 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:41.680 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:32:41.680 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:41.755 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:32:41.773 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:32:41.808 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:32:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.611+0000 7fee3ea00640 1 -- 172.21.15.52:0/587321477 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5848 v37) ==== 95+0+0 (secure 0 0 0) 0x7fee400aae20 con 0x7fee4815e440 2024-09-10T08:32:42.611 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 5848 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 msgr2=0x7fee2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 0x7fee2806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee38007fd0 tx=0x7fee38007de0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 msgr2=0x7fee4806fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 0x7fee4806fa70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fee40031000 tx=0x7fee40004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 shutdown_connections 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fee2806be30 0x7fee2806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee4815e440 0x7fee4806fa70 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee480cf450 0x7fee480cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 --2- 172.21.15.52:0/587321477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee480b6710 0x7fee4815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 >> 172.21.15.52:0/587321477 conn(0x7fee48067f80 msgr2=0x7fee480d4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.615+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 shutdown_connections 2024-09-10T08:32:42.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.616+0000 7fee47e00640 1 -- 172.21.15.52:0/587321477 wait complete. 2024-09-10T08:32:42.637 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:32:42.637 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:32:42.642 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:32:42.642 DEBUG:teuthology.parallel:result is None 2024-09-10T08:32:42.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:42.770 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:32:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.838+0000 7fd379000640 1 Processor -- start 2024-09-10T08:32:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.839+0000 7fd379000640 1 -- start start 2024-09-10T08:32:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd379000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd379000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374071180 con 0x7fd3740b2d40 2024-09-10T08:32:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd379000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd374071460 con 0x7fd37406c320 2024-09-10T08:32:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd379000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd374071ab0 con 0x7fd37413eb20 2024-09-10T08:32:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd371e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd3740b2d40 0x7fd37406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40842/0 (socket says 172.21.15.52:40842) 2024-09-10T08:32:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd371e00640 1 -- 172.21.15.52:0/2870840424 learned_addr learned my addr 172.21.15.52:0/2870840424 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd372800640 1 --2- 172.21.15.52:0/2870840424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.840+0000 7fd371400640 1 -- 172.21.15.52:0/2870840424 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469822139 0 0) 0x7fd374071180 con 0x7fd3740b2d40 2024-09-10T08:32:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.841+0000 7fd371400640 1 -- 172.21.15.52:0/2870840424 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd358003520 con 0x7fd3740b2d40 2024-09-10T08:32:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.841+0000 7fd372800640 1 -- 172.21.15.52:0/2870840424 >> v1:172.21.15.176:6789/0 conn(0x7fd37406c320 legacy=0x7fd37415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.841+0000 7fd372800640 1 -- 172.21.15.52:0/2870840424 >> v1:172.21.15.52:6789/0 conn(0x7fd3740b2d40 legacy=0x7fd37406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.841+0000 7fd372800640 1 -- 172.21.15.52:0/2870840424 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374071740 con 0x7fd37413eb20 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.842+0000 7fd372800640 1 --2- 172.21.15.52:0/2870840424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37415c400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009dc0 tx=0x7fd36c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7358616211630ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.842+0000 7fd371400640 1 -- 172.21.15.52:0/2870840424 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007740 con 0x7fd37413eb20 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.842+0000 7fd371400640 1 -- 172.21.15.52:0/2870840424 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c0078e0 con 0x7fd37413eb20 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.842+0000 7fd371400640 1 -- 172.21.15.52:0/2870840424 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c007cb0 con 0x7fd37413eb20 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 -- 172.21.15.52:0/2870840424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 msgr2=0x7fd37415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 --2- 172.21.15.52:0/2870840424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37415c400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009dc0 tx=0x7fd36c02a6d0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 -- 172.21.15.52:0/2870840424 shutdown_connections 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 --2- 172.21.15.52:0/2870840424 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37415c400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 -- 172.21.15.52:0/2870840424 >> 172.21.15.52:0/2870840424 conn(0x7fd3740ccec0 msgr2=0x7fd3740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 -- 172.21.15.52:0/2870840424 shutdown_connections 2024-09-10T08:32:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.843+0000 7fd379000640 1 -- 172.21.15.52:0/2870840424 wait complete. 2024-09-10T08:32:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.844+0000 7fd379000640 1 Processor -- start 2024-09-10T08:32:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.844+0000 7fd379000640 1 -- start start 2024-09-10T08:32:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 0x7fd3741583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37413d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740b3980 con 0x7fd3740b2d40 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740b3800 con 0x7fd37406c320 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.845+0000 7fd379000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3740b3b00 con 0x7fd37413eb20 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd371e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 0x7fd3741583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45214/0 (socket says 172.21.15.52:45214) 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 -- 172.21.15.52:0/457340935 learned_addr learned my addr 172.21.15.52:0/457340935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd372800640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37413d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 -- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 msgr2=0x7fd37413d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37413d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 -- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 msgr2=0x7fd3741583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 0x7fd3741583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 -- 172.21.15.52:0/457340935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3741f8230 con 0x7fd3740b2d40 2024-09-10T08:32:42.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd371e00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 0x7fd3741583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:42.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36be00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c400 tx=0x7fd35c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:42.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.846+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c0052d0 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.847+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c005490 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.847+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c007260 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.847+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3741f8510 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.847+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37413d5b0 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.848+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37406bc10 con 0x7fd3740b2d40 2024-09-10T08:32:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.849+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd35c007400 con 0x7fd3740b2d40 2024-09-10T08:32:42.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.849+0000 7fd36a000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:42.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.850+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7fd35c08a3f0 con 0x7fd3740b2d40 2024-09-10T08:32:42.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.850+0000 7fd371e00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:42.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.851+0000 7fd371e00640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 0x7fd35006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd3640011e0 tx=0x7fd364007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:42.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:42.854+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd35c058650 con 0x7fd3740b2d40 2024-09-10T08:32:43.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.077+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd37406c9c0 con 0x7fd3740b2d40 2024-09-10T08:32:43.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.077+0000 7fd36a000640 1 -- 172.21.15.52:0/457340935 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+4395 (secure 0 0 0) 0x7fd35c05c950 con 0x7fd3740b2d40 2024-09-10T08:32:43.077 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:43.077 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"btime":"2024-09-10T08:32:42:614682+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:42.614650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-10T08:32:43.077 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2024-09-10T08:32:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.079+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 msgr2=0x7fd35006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.079+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 0x7fd35006e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd3640011e0 tx=0x7fd364007d30 comp rx=0 tx=0).stop 2024-09-10T08:32:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 msgr2=0x7fd3741f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00c400 tx=0x7fd35c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:32:43.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 shutdown_connections 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd35006be30 0x7fd35006e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd37413eb20 0x7fd37413d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3740b2d40 0x7fd3741f7ac0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 --2- 172.21.15.52:0/457340935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd37406c320 0x7fd3741583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 >> 172.21.15.52:0/457340935 conn(0x7fd3740ccec0 msgr2=0x7fd37413db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 shutdown_connections 2024-09-10T08:32:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:43.080+0000 7fd379000640 1 -- 172.21.15.52:0/457340935 wait complete. 2024-09-10T08:32:43.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:32:24.581671+0000', 'modified': '2024-09-10T08:32:42.614650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 64, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6405}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6405': {'gid': 6405, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.52:6835/3318304686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3318304686}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3318304686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:32:43.498 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6405:up:replay 2024-09-10T08:32:44.499 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:44.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.668+0000 7f05e4c00640 1 Processor -- start 2024-09-10T08:32:44.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.668+0000 7f05e4c00640 1 -- start start 2024-09-10T08:32:44.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.669+0000 7f05e4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.669+0000 7f05e4c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 0x7f05e006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.669+0000 7f05e4c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e0071180 con 0x7f05e015bcf0 2024-09-10T08:32:44.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.669+0000 7f05e4c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f05e0071ab0 con 0x7f05e013eb20 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.669+0000 7f05e4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05e0071460 con 0x7f05e00b2d40 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05de800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f05e015bcf0 0x7f05e015c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34720/0 (socket says 172.21.15.52:34720) 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05de800640 1 -- 172.21.15.52:0/1676058891 learned_addr learned my addr 172.21.15.52:0/1676058891 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dde00640 1 --2- 172.21.15.52:0/1676058891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dd400640 1 --2- 172.21.15.52:0/1676058891 >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 0x7f05e006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543603403 0 0) 0x7f05e0071180 con 0x7f05e015bcf0 2024-09-10T08:32:44.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c4003520 con 0x7f05e015bcf0 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dde00640 1 -- 172.21.15.52:0/1676058891 >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 msgr2=0x7f05e006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dde00640 1 --2- 172.21.15.52:0/1676058891 >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 0x7f05e006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dde00640 1 -- 172.21.15.52:0/1676058891 >> v1:172.21.15.52:6789/0 conn(0x7f05e015bcf0 legacy=0x7f05e015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1028560836 0 0) 0x7f05c4003520 con 0x7f05e015bcf0 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dde00640 1 -- 172.21.15.52:0/1676058891 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e0071740 con 0x7f05e00b2d40 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.670+0000 7f05dd400640 1 --2- 172.21.15.52:0/1676058891 >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 0x7f05e006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.671+0000 7f05dde00640 1 --2- 172.21.15.52:0/1676058891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e006bc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071c30 tx=0x7f05d002c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76478cdc4dc54ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0034620 con 0x7f05e00b2d40 2024-09-10T08:32:44.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d00347c0 con 0x7f05e00b2d40 2024-09-10T08:32:44.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05dca00640 1 -- 172.21.15.52:0/1676058891 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0034b90 con 0x7f05e00b2d40 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 -- 172.21.15.52:0/1676058891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 msgr2=0x7f05e006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 --2- 172.21.15.52:0/1676058891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e006bc10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071c30 tx=0x7f05d002c830 comp rx=0 tx=0).stop 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 -- 172.21.15.52:0/1676058891 shutdown_connections 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 --2- 172.21.15.52:0/1676058891 >> v2:172.21.15.176:3300/0 conn(0x7f05e013eb20 0x7f05e006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 --2- 172.21.15.52:0/1676058891 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e006bc10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 -- 172.21.15.52:0/1676058891 >> 172.21.15.52:0/1676058891 conn(0x7f05e00ccec0 msgr2=0x7f05e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 -- 172.21.15.52:0/1676058891 shutdown_connections 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.672+0000 7f05e4c00640 1 -- 172.21.15.52:0/1676058891 wait complete. 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.674+0000 7f05e4c00640 1 Processor -- start 2024-09-10T08:32:44.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.674+0000 7f05e4c00640 1 -- start start 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e015bcf0 0x7f05e01f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00722d0 con 0x7f05e013eb20 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05e0072150 con 0x7f05e015bcf0 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05e4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05e0072450 con 0x7f05e00b2d40 2024-09-10T08:32:44.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.675+0000 7f05dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39204/0 (socket says 172.21.15.52:39204) 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36726/0 (socket says 172.21.15.52:36726) 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dd400640 1 -- 172.21.15.52:0/134578127 learned_addr learned my addr 172.21.15.52:0/134578127 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05de800640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e015bcf0 0x7f05e01f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 -- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e015bcf0 msgr2=0x7f05e01f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e015bcf0 0x7f05e01f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 -- 172.21.15.52:0/134578127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 msgr2=0x7f05e00b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 -- 172.21.15.52:0/134578127 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00b56f0 con 0x7f05e00b2d40 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dd400640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.676+0000 7f05dde00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05d0034000 tx=0x7f05d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.677+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0042070 con 0x7f05e00b2d40 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.677+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0033c00 con 0x7f05e00b2d40 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.677+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0034e10 con 0x7f05e00b2d40 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.677+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e00b59d0 con 0x7f05e00b2d40 2024-09-10T08:32:44.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.677+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e00b5cb0 con 0x7f05e00b2d40 2024-09-10T08:32:44.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.678+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e0072890 con 0x7f05e00b2d40 2024-09-10T08:32:44.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.679+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d0045070 con 0x7f05e00b2d40 2024-09-10T08:32:44.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.680+0000 7f05d6000640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:44.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.680+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f05d00ab7f0 con 0x7f05e00b2d40 2024-09-10T08:32:44.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.680+0000 7f05dd400640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:44.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.681+0000 7f05dd400640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05e0141670 tx=0x7f05cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:44.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.685+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05d0079c10 con 0x7f05e00b2d40 2024-09-10T08:32:44.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.905+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05e0155920 con 0x7f05e00b2d40 2024-09-10T08:32:44.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.906+0000 7f05d6000640 1 -- 172.21.15.52:0/134578127 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5223 (secure 0 0 0) 0x7f05d007df10 con 0x7f05e00b2d40 2024-09-10T08:32:44.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:44.907 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"btime":"2024-09-10T08:32:44:621722+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:43.623252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-10T08:32:44.907 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 40 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 msgr2=0x7f05c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 0x7f05c006e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05e0141670 tx=0x7f05cc009190 comp rx=0 tx=0).stop 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 msgr2=0x7f05e013d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f05d0034000 tx=0x7f05d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 shutdown_connections 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f05c006be30 0x7f05c006e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e015bcf0 0x7f05e01f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05e013eb20 0x7f05e00b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 --2- 172.21.15.52:0/134578127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05e00b2d40 0x7f05e013d420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:44.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 >> 172.21.15.52:0/134578127 conn(0x7f05e00ccec0 msgr2=0x7f05e013f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:44.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 shutdown_connections 2024-09-10T08:32:44.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:44.908+0000 7f05e4c00640 1 -- 172.21.15.52:0/134578127 wait complete. 2024-09-10T08:32:45.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:32:24.581671+0000', 'modified': '2024-09-10T08:32:43.623252+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 64, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6405}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6405': {'gid': 6405, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.52:6835/3318304686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3318304686}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3318304686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:32:45.327 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6405:up:rejoin 2024-09-10T08:32:46.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.495+0000 7f3af2e00640 1 Processor -- start 2024-09-10T08:32:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.495+0000 7f3af2e00640 1 -- start start 2024-09-10T08:32:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.496+0000 7f3af2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.496+0000 7f3af2e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3aec0cf450 0x7f3aec0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.496+0000 7f3af2e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aec0d3990 con 0x7f3aec15e440 2024-09-10T08:32:46.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.496+0000 7f3af2e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3aec0d3c70 con 0x7f3aec0cf450 2024-09-10T08:32:46.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.496+0000 7f3af2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec0d3f50 con 0x7f3aec0b6710 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af2400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3aec0cf450 0x7f3aec0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af1a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f3aec15e440 0x7f3aec0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:45194/0 (socket says 172.21.15.52:45194) 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af1a00640 1 -- 172.21.15.52:0/2108479636 learned_addr learned my addr 172.21.15.52:0/2108479636 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af2400640 1 -- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 msgr2=0x7f3aec0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af2400640 1 --2- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af2400640 1 -- 172.21.15.52:0/2108479636 >> v1:172.21.15.176:6789/0 conn(0x7f3aec15e440 legacy=0x7f3aec0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3af2400640 1 -- 172.21.15.52:0/2108479636 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec0d4230 con 0x7f3aec0cf450 2024-09-10T08:32:46.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.497+0000 7f3aebe00640 1 -- 172.21.15.52:0/2108479636 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526383238 0 0) 0x7f3aec0d3990 con 0x7f3aec15e440 2024-09-10T08:32:46.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.498+0000 7f3af2400640 1 --2- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec0b7b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009d90 tx=0x7f3ae402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e380a4cc9788041c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:46.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3aebe00640 1 -- 172.21.15.52:0/2108479636 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4007740 con 0x7f3aec0cf450 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3aebe00640 1 -- 172.21.15.52:0/2108479636 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae40078e0 con 0x7f3aec0cf450 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3aebe00640 1 -- 172.21.15.52:0/2108479636 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4007cb0 con 0x7f3aec0cf450 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 -- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 msgr2=0x7f3aec0b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec0b7b60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009d90 tx=0x7f3ae402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 -- 172.21.15.52:0/2108479636 shutdown_connections 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec0b7b60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2108479636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 -- 172.21.15.52:0/2108479636 >> 172.21.15.52:0/2108479636 conn(0x7f3aec067f80 msgr2=0x7f3aec0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 -- 172.21.15.52:0/2108479636 shutdown_connections 2024-09-10T08:32:46.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.499+0000 7f3af2e00640 1 -- 172.21.15.52:0/2108479636 wait complete. 2024-09-10T08:32:46.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.501+0000 7f3af2e00640 1 Processor -- start 2024-09-10T08:32:46.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.501+0000 7f3af2e00640 1 -- start start 2024-09-10T08:32:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec0b76c0 con 0x7f3aec15e440 2024-09-10T08:32:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec0b7540 con 0x7f3aec0cf450 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec0b80a0 con 0x7f3aec0b6710 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39216/0 (socket says 172.21.15.52:39216) 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af2400640 1 -- 172.21.15.52:0/2936397303 learned_addr learned my addr 172.21.15.52:0/2936397303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af1a00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.502+0000 7f3af1000640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 -- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 msgr2=0x7f3aec153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 -- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 msgr2=0x7f3aec153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 -- 172.21.15.52:0/2936397303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec151bf0 con 0x7f3aec15e440 2024-09-10T08:32:46.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3af2400640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ae402ace0 tx=0x7f3ae4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.503+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4040070 con 0x7f3aec15e440 2024-09-10T08:32:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.504+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4031bc0 con 0x7f3aec15e440 2024-09-10T08:32:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.504+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec151ed0 con 0x7f3aec15e440 2024-09-10T08:32:46.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.504+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4009450 con 0x7f3aec15e440 2024-09-10T08:32:46.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.504+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec152490 con 0x7f3aec15e440 2024-09-10T08:32:46.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.505+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aec0b7b60 con 0x7f3aec15e440 2024-09-10T08:32:46.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.505+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ae4039040 con 0x7f3aec15e440 2024-09-10T08:32:46.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.507+0000 7f3ae9600640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 0x7f3acc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:46.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.507+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f3ae40ac680 con 0x7f3aec15e440 2024-09-10T08:32:46.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.507+0000 7f3af1a00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 0x7f3acc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:46.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.508+0000 7f3af1a00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 0x7f3acc06e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0007fd0 tx=0x7f3ae0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:46.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.512+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ae407aa00 con 0x7f3aec15e440 2024-09-10T08:32:46.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.733+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aec0b37f0 con 0x7f3aec15e440 2024-09-10T08:32:46.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.734+0000 7f3ae9600640 1 -- 172.21.15.52:0/2936397303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f3ae407ed00 con 0x7f3aec15e440 2024-09-10T08:32:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:46.734 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 msgr2=0x7f3acc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 0x7f3acc06e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0007fd0 tx=0x7f3ae0007de0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 msgr2=0x7f3aec0ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ae402ace0 tx=0x7f3ae4004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 shutdown_connections 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3acc06be60 0x7f3acc06e320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aec15e440 0x7f3aec0ca0c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aec0cf450 0x7f3aec153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 --2- 172.21.15.52:0/2936397303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aec0b6710 0x7f3aec153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:46.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.736+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 >> 172.21.15.52:0/2936397303 conn(0x7f3aec067f80 msgr2=0x7f3aec0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:46.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.737+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 shutdown_connections 2024-09-10T08:32:46.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:46.737+0000 7f3af2e00640 1 -- 172.21.15.52:0/2936397303 wait complete. 2024-09-10T08:32:47.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:32:24.581671+0000', 'modified': '2024-09-10T08:32:45.628228+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 64, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6405}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6405': {'gid': 6405, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6835/3318304686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3318304686}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3318304686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6405, 'qdb_cluster': [6405]} 2024-09-10T08:32:47.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:32:47.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:32:47.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.317+0000 7f0a7d000640 1 Processor -- start 2024-09-10T08:32:47.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.317+0000 7f0a7d000640 1 -- start start 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 0x7f0a7806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a7806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a7815bcf0 0x7f0a7815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0a78071ab0 con 0x7f0a7815bcf0 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0a78071180 con 0x7f0a780b2d40 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a7d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a78071460 con 0x7f0a7813eb20 2024-09-10T08:32:47.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a76800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a7815bcf0 0x7f0a7815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a76800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a7815bcf0 0x7f0a7815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39226/0 (socket says 172.21.15.52:39226) 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a76800640 1 -- 172.21.15.52:0/1927543229 learned_addr learned my addr 172.21.15.52:0/1927543229 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a6d400640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a7806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.319+0000 7f0a75e00640 1 --2- 172.21.15.52:0/1927543229 >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 0x7f0a7806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a76800640 1 -- 172.21.15.52:0/1927543229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 msgr2=0x7f0a7806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a76800640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a7806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a76800640 1 -- 172.21.15.52:0/1927543229 >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 msgr2=0x7f0a7806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a76800640 1 --2- 172.21.15.52:0/1927543229 >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 0x7f0a7806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a76800640 1 -- 172.21.15.52:0/1927543229 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a78071740 con 0x7f0a7815bcf0 2024-09-10T08:32:47.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.320+0000 7f0a75e00640 1 --2- 172.21.15.52:0/1927543229 >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 0x7f0a7806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:47.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a76800640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a7815c1a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0a78069be0 tx=0x7f0a7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b471907e4a970 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a75400640 1 -- 172.21.15.52:0/1927543229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70036070 con 0x7f0a7815bcf0 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a75400640 1 -- 172.21.15.52:0/1927543229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70031600 con 0x7f0a7815bcf0 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a75400640 1 -- 172.21.15.52:0/1927543229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700319d0 con 0x7f0a7815bcf0 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 -- 172.21.15.52:0/1927543229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 msgr2=0x7f0a7815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a7815c1a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0a78069be0 tx=0x7f0a7002a6a0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 -- 172.21.15.52:0/1927543229 shutdown_connections 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a7815c1a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 --2- 172.21.15.52:0/1927543229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a7806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 --2- 172.21.15.52:0/1927543229 >> v2:172.21.15.176:3300/0 conn(0x7f0a780b2d40 0x7f0a7806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.321+0000 7f0a7d000640 1 -- 172.21.15.52:0/1927543229 >> 172.21.15.52:0/1927543229 conn(0x7f0a780ccec0 msgr2=0x7f0a780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.322+0000 7f0a7d000640 1 -- 172.21.15.52:0/1927543229 shutdown_connections 2024-09-10T08:32:47.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.322+0000 7f0a7d000640 1 -- 172.21.15.52:0/1927543229 wait complete. 2024-09-10T08:32:47.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.323+0000 7f0a7d000640 1 Processor -- start 2024-09-10T08:32:47.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.323+0000 7f0a7d000640 1 -- start start 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a780b2d40 0x7f0a781545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a780cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7815f140 con 0x7f0a7815bcf0 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7815efc0 con 0x7f0a780b2d40 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.324+0000 7f0a7d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7815f2c0 con 0x7f0a7813eb20 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39240/0 (socket says 172.21.15.52:39240) 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 -- 172.21.15.52:0/2275833990 learned_addr learned my addr 172.21.15.52:0/2275833990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a6d400640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a780cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a75e00640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a780b2d40 0x7f0a781545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 -- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 msgr2=0x7f0a780cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a780cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 -- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a780b2d40 msgr2=0x7f0a781545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a780b2d40 0x7f0a781545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 -- 172.21.15.52:0/2275833990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a780c9b90 con 0x7f0a7815bcf0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.325+0000 7f0a76800640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009f40 tx=0x7f0a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.326+0000 7f0a6ea00640 1 -- 172.21.15.52:0/2275833990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70036050 con 0x7f0a7815bcf0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.326+0000 7f0a6ea00640 1 -- 172.21.15.52:0/2275833990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70042070 con 0x7f0a7815bcf0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.326+0000 7f0a6ea00640 1 -- 172.21.15.52:0/2275833990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70009510 con 0x7f0a7815bcf0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.326+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a780c9e70 con 0x7f0a7815bcf0 2024-09-10T08:32:47.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.326+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a780ca430 con 0x7f0a7815bcf0 2024-09-10T08:32:47.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.328+0000 7f0a6ea00640 1 -- 172.21.15.52:0/2275833990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a70007bf0 con 0x7f0a7815bcf0 2024-09-10T08:32:47.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.329+0000 7f0a6ea00640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 0x7f0a5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.329+0000 7f0a6ea00640 1 -- 172.21.15.52:0/2275833990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f0a700abbc0 con 0x7f0a7815bcf0 2024-09-10T08:32:47.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.329+0000 7f0a7fe7b740 1 Processor -- start 2024-09-10T08:32:47.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.329+0000 7f0a75e00640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 0x7f0a5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.329+0000 7f0a7fe7b740 1 -- start start 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a75e00640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 0x7f0a5406e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0a78073240 tx=0x7f0a68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44cc6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7e4b0 0x55ba44c810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba44bdf3b0 con 0x55ba44c82480 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ba44be4410 con 0x55ba44c80cf0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.330+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ba44b8c620 con 0x55ba44c7e4b0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44cc6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a6d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7e4b0 0x55ba44c810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44cc6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:58712/0 (socket says 172.21.15.52:58712) 2024-09-10T08:32:47.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a75e00640 1 -- 172.21.15.52:0/3840548951 learned_addr learned my addr 172.21.15.52:0/3840548951 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 -- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7e4b0 msgr2=0x55ba44c810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7e4b0 0x55ba44c810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 -- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 msgr2=0x55ba44cc6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44cc6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 -- 172.21.15.52:0/3840548951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba448f72d0 con 0x55ba44c82480 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a76800640 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7b570 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0a700aa050 tx=0x7f0a70007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3afb458ba2aa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.331+0000 7f0a66a00640 1 -- 172.21.15.52:0/3840548951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a8070 con 0x55ba44c82480 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a66a00640 1 -- 172.21.15.52:0/3840548951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70037040 con 0x55ba44c82480 2024-09-10T08:32:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a66a00640 1 -- 172.21.15.52:0/3840548951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70079eb0 con 0x55ba44c82480 2024-09-10T08:32:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3840548951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 msgr2=0x55ba44c7b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7b570 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0a700aa050 tx=0x7f0a70007f90 comp rx=0 tx=0).stop 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3840548951 shutdown_connections 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7b570 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7e4b0 0x55ba44c810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3840548951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44cc6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3840548951 >> 172.21.15.52:0/3840548951 conn(0x55ba44c7d740 msgr2=0x55ba44cc5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3840548951 shutdown_connections 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.332+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3840548951 wait complete. 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.333+0000 7f0a7fe7b740 1 -- start start 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.333+0000 7f0a7fe7b740 1 Processor -- start 2024-09-10T08:32:47.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44c7bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c7c220 0x55ba44ca3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba44b9f780 con 0x55ba44c80cf0 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ba44be03d0 con 0x55ba44c7c220 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ba44be4410 con 0x55ba44c82480 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a7fe7b740 10 client.0 _ll_register_callbacks cb 0x55ba44bdd5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39248/0 (socket says 172.21.15.52:39248) 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.334+0000 7f0a75e00640 1 -- 172.21.15.52:0/3520596523 learned_addr learned my addr 172.21.15.52:0/3520596523 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a76800640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c7c220 0x55ba44ca3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a6d400640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44c7bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 -- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 msgr2=0x55ba44c7bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44c7bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 -- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c7c220 msgr2=0x55ba44ca3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c7c220 0x55ba44ca3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 -- 172.21.15.52:0/3520596523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba449c16b0 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a75e00640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0a680156c0 tx=0x7f0a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e79793cf83f7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a5b400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68026070 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f0a68004440 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.335+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a70037040 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0a68031050 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 10 client.6435 fetch_fsmap learned FSMap version 41 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55ba44caa970 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70037040 con 0x55ba44c80cf0 2024-09-10T08:32:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f0a68034020 con 0x55ba44c80cf0 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 10 client.6435 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 10 client.6435 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 20 client.6435 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44cd7be0 0x55ba44cd7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 4 client.6435 mds_command: new command op to 6405 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 --> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba44bf1b40 con 0x55ba44cd7be0 2024-09-10T08:32:47.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.336+0000 7f0a6d400640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44cd7be0 0x55ba44cd7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.337+0000 7f0a6d400640 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44cd7be0 0x55ba44cd7fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48854ef92df38ff6 server_cookie=5413c94e6dbc777 in_seq=0 out_seq=0 2024-09-10T08:32:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.337+0000 7f0a5b400640 10 client.6435 ms_handle_connect on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a5b400640 1 -- 172.21.15.52:0/3520596523 <== mds.0 v2:172.21.15.52:6834/3318304686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba44bf1b40 con 0x55ba44cd7be0 2024-09-10T08:32:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a5b400640 10 client.6435 handle_command_reply: tid=0 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 client.6435 shutdown 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 msgr2=0x55ba44cab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0a680156c0 tx=0x7f0a680046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 shutdown_connections 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c7c220 0x55ba44ca3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44cd7be0 0x55ba44cd7fc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44c7bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/3520596523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c80cf0 0x55ba44cab2b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 >> 172.21.15.52:0/3520596523 conn(0x55ba44c7e4b0 msgr2=0x55ba44cc39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a5b400640 0 client.6435 ms_handle_reset on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 shutdown_connections 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.338+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/3520596523 wait complete. 2024-09-10T08:32:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.339+0000 7f0a7fe7b740 20 client.6435 trim_cache size 0 max 16384 2024-09-10T08:32:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.357+0000 7f0a7fe7b740 1 Processor -- start 2024-09-10T08:32:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.357+0000 7f0a7fe7b740 1 -- start start 2024-09-10T08:32:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44ce9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44cc8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781ffe70 con 0x55ba44c7c220 2024-09-10T08:32:47.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a78157420 con 0x55ba44c80cf0 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0a78157a70 con 0x55ba44c82480 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39250/0 (socket says 172.21.15.52:39250) 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.358+0000 7f0a75e00640 1 -- 172.21.15.52:0/1125443542 learned_addr learned my addr 172.21.15.52:0/1125443542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a76800640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44cc8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a6d400640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44ce9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 -- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 msgr2=0x55ba44cc8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44cc8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 -- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 msgr2=0x55ba44ce9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44ce9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 -- 172.21.15.52:0/1125443542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba44ca82b0 con 0x55ba44c7c220 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a76800640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44cc8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a6d400640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44ce9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a75e00640 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a680116d0 tx=0x7f0a68024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef81087a42c29cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a66000640 1 -- 172.21.15.52:0/1125443542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68026070 con 0x55ba44c7c220 2024-09-10T08:32:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a66000640 1 -- 172.21.15.52:0/1125443542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6801a070 con 0x55ba44c7c220 2024-09-10T08:32:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.359+0000 7f0a66000640 1 -- 172.21.15.52:0/1125443542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800f040 con 0x55ba44c7c220 2024-09-10T08:32:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/1125443542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 msgr2=0x55ba44ccd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a680116d0 tx=0x7f0a68024000 comp rx=0 tx=0).stop 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/1125443542 shutdown_connections 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c82480 0x55ba44cc8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44ce9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/1125443542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c7c220 0x55ba44ccd540 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/1125443542 >> 172.21.15.52:0/1125443542 conn(0x55ba44c7e4b0 msgr2=0x55ba44caaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/1125443542 shutdown_connections 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/1125443542 wait complete. 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.360+0000 7f0a7fe7b740 1 -- start start 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 Processor -- start 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7c220 0x55ba44cc2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44c7a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba44cd8630 con 0x55ba44c82480 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ba44bdf3b0 con 0x55ba44c80cf0 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.361+0000 7f0a7fe7b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ba44ca9030 con 0x55ba44c7c220 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a7fe7b740 10 client.0 _ll_register_callbacks cb 0x7f0a680118e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a75e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7c220 0x55ba44cc2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39266/0 (socket says 172.21.15.52:39266) 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 -- 172.21.15.52:0/4028662485 learned_addr learned my addr 172.21.15.52:0/4028662485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a6d400640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44c7a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 -- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7c220 msgr2=0x55ba44cc2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7c220 0x55ba44cc2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 -- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 msgr2=0x55ba44c7a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44c7a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 -- 172.21.15.52:0/4028662485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba44cd8910 con 0x55ba44c82480 2024-09-10T08:32:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a76800640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a7002a6e0 tx=0x7f0a70009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08253313640e168 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.362+0000 7f0a5b400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a700a8070 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f0a70079500 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a6801a070 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0a7007e1b0 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 10 client.6441 fetch_fsmap learned FSMap version 41 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55ba44cd8910 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6801a070 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f0a70098030 con 0x55ba44c82480 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 10 client.6441 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 10 client.6441 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 20 client.6441 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44d48360 0x55ba44d48740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 4 client.6441 mds_command: new command op to 6405 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:32:47.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.363+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 --> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] -- command(tid 0: {"prefix": "status"}) -- 0x55ba44bebe90 con 0x55ba44d48360 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a75e00640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44d48360 0x55ba44d48740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a75e00640 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44d48360 0x55ba44d48740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14eeed775095222b server_cookie=fb7bee121caa1cf2 in_seq=0 out_seq=0 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a5b400640 10 client.6441 ms_handle_connect on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a5b400640 1 -- 172.21.15.52:0/4028662485 <== mds.0 v2:172.21.15.52:6834/3318304686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ba44bebe90 con 0x55ba44d48360 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a5b400640 10 client.6441 handle_command_reply: tid=0 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a7fe7b740 1 client.6441 shutdown 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 msgr2=0x55ba44c7ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.364+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a7002a6e0 tx=0x7f0a70009810 comp rx=0 tx=0).stop 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 shutdown_connections 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba44c82480 0x55ba44c7ad50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ba44c80cf0 0x55ba44c7a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55ba44d48360 0x55ba44d48740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 --2- 172.21.15.52:0/4028662485 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ba44c7c220 0x55ba44cc2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 >> 172.21.15.52:0/4028662485 conn(0x55ba44c7e4b0 msgr2=0x55ba44ce9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a5b400640 0 client.6441 ms_handle_reset on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 shutdown_connections 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 1 -- 172.21.15.52:0/4028662485 wait complete. 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7fe7b740 20 client.6441 trim_cache size 0 max 16384 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6405, 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:32:47.370 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 4.7436702420000003, 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 41, 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 65, 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 65, 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 5.5530568860000002 2024-09-10T08:32:47.371 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 msgr2=0x7f0a5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 0x7f0a5406e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0a78073240 tx=0x7f0a68008040 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 msgr2=0x7f0a78071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009f40 tx=0x7f0a70004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 shutdown_connections 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0a5406be30 0x7f0a5406e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a7815bcf0 0x7f0a78071f40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a7813eb20 0x7f0a780cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 --2- 172.21.15.52:0/2275833990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a780b2d40 0x7f0a781545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.365+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 >> 172.21.15.52:0/2275833990 conn(0x7f0a780ccec0 msgr2=0x7f0a7815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.366+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 shutdown_connections 2024-09-10T08:32:47.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.366+0000 7f0a7d000640 1 -- 172.21.15.52:0/2275833990 wait complete. 2024-09-10T08:32:47.382 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-10T08:32:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.540+0000 7f9af6800640 1 Processor -- start 2024-09-10T08:32:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.540+0000 7f9af6800640 1 -- start start 2024-09-10T08:32:47.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9af6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9af00b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9af6800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af00d4560 con 0x7f9af015ea80 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9af6800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af00d2c80 con 0x7f9af00b6620 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9af6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9af00d2f60 con 0x7f9af00b6a70 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9aef400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9af015ea80 0x7f9af00d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34722/0 (socket says 172.21.15.52:34722) 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9aef400640 1 -- 172.21.15.52:0/2433127089 learned_addr learned my addr 172.21.15.52:0/2433127089 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9aefe00640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9af00b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427699747 0 0) 0x7f9af00d4560 con 0x7f9af015ea80 2024-09-10T08:32:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.542+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad4003520 con 0x7f9af015ea80 2024-09-10T08:32:47.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 482363190 0 0) 0x7f9ad4003520 con 0x7f9af015ea80 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 msgr2=0x7f9af00b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9af00b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 >> v1:172.21.15.176:6789/0 conn(0x7f9af00b6620 legacy=0x7f9af00b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af00d3240 con 0x7f9af015ea80 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f9ae0001670 con 0x7f9af015ea80 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 >> v1:172.21.15.52:6789/0 conn(0x7f9af015ea80 legacy=0x7f9af00d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ad40039e0 0x7f9ad4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9ad4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ad4004d40 0x7f9ad40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00d2f60 con 0x7f9ad40039e0 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad400b9c0 con 0x7f9ad4004d40 2024-09-10T08:32:47.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad400bbc0 con 0x7f9af00b6a70 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ad40039e0 0x7f9ad4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aeea00640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9ad4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aefe00640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ad4004d40 0x7f9ad40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 -- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 msgr2=0x7f9ad4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9ad4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 -- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ad4004d40 msgr2=0x7f9ad40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ad4004d40 0x7f9ad40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aef400640 1 -- 172.21.15.52:0/2433127089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad4003520 con 0x7f9ad40039e0 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.543+0000 7f9aeea00640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af00b6a70 0x7f9ad4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:47.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.544+0000 7f9aef400640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ad40039e0 0x7f9ad4003dc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c290 tx=0x7f9ad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaf69d221dec342 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0007d50 con 0x7f9ad40039e0 2024-09-10T08:32:47.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae0005af0 con 0x7f9ad40039e0 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9aee000640 1 -- 172.21.15.52:0/2433127089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0007070 con 0x7f9ad40039e0 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9af6800640 1 -- 172.21.15.52:0/2433127089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ad40039e0 msgr2=0x7f9ad4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9af6800640 1 --2- 172.21.15.52:0/2433127089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ad40039e0 0x7f9ad4003dc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c290 tx=0x7f9ad4005830 comp rx=0 tx=0).stop 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9aefe00640 1 -- 172.21.15.52:0/2433127089 reap_dead start 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9af6800640 1 -- 172.21.15.52:0/2433127089 shutdown_connections 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9af6800640 1 -- 172.21.15.52:0/2433127089 >> 172.21.15.52:0/2433127089 conn(0x7f9af00d1620 msgr2=0x7f9af00d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.545+0000 7f9af6800640 1 -- 172.21.15.52:0/2433127089 shutdown_connections 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.546+0000 7f9af6800640 1 -- 172.21.15.52:0/2433127089 wait complete. 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.547+0000 7f9af6800640 1 Processor -- start 2024-09-10T08:32:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.547+0000 7f9af6800640 1 -- start start 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 0x7f9af00cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 0x7f9af00c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00b6f00 con 0x7f9af0160390 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00d3800 con 0x7f9af0160810 2024-09-10T08:32:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9af6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9af015ee60 con 0x7f9ad40039e0 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9aeea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9aeea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39288/0 (socket says 172.21.15.52:39288) 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9aeea00640 1 -- 172.21.15.52:0/1891807429 learned_addr learned my addr 172.21.15.52:0/1891807429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.548+0000 7f9aef400640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 0x7f9af00cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aefe00640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 0x7f9af00c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 -- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 msgr2=0x7f9af00cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 0x7f9af00cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 -- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 msgr2=0x7f9af00c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 0x7f9af00c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 -- 172.21.15.52:0/1891807429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af00cb8f0 con 0x7f9af0160390 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aefe00640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 0x7f9af00c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aef400640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 0x7f9af00cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9aeea00640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e830 tx=0x7f9adc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0052e0 con 0x7f9af0160390 2024-09-10T08:32:47.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc018070 con 0x7f9af0160390 2024-09-10T08:32:47.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00c8e0 con 0x7f9af0160390 2024-09-10T08:32:47.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.549+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af00c9830 con 0x7f9af0160390 2024-09-10T08:32:47.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.550+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af00c9b10 con 0x7f9af0160390 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.551+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af00d2810 con 0x7f9af0160390 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.551+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9adc00ca80 con 0x7f9af0160390 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.552+0000 7f9ae7400640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 0x7f9ad006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.552+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f9adc08add0 con 0x7f9af0160390 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.553+0000 7f9aef400640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 0x7f9ad006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.553+0000 7f9aef400640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 0x7f9ad006e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0032000 tx=0x7f9ae002d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.557+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9adc01a310 con 0x7f9af0160390 2024-09-10T08:32:47.623 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:32:47.623+0000 7fc6d2200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:32:47.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.743+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f9af00b9c90 con 0x7f9af0160390 2024-09-10T08:32:47.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.747+0000 7f9ae7400640 1 -- 172.21.15.52:0/1891807429 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f9adc005480 con 0x7f9af0160390 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 msgr2=0x7f9ad006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 0x7f9ad006e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0032000 tx=0x7f9ae002d000 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 msgr2=0x7f9af00c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e830 tx=0x7f9adc00ecf0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 shutdown_connections 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad006be30 0x7f9ad006e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af0160810 0x7f9af00c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af0160390 0x7f9af00c8c70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 --2- 172.21.15.52:0/1891807429 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ad40039e0 0x7f9af00cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 >> 172.21.15.52:0/1891807429 conn(0x7f9af00d1620 msgr2=0x7f9af00b8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 shutdown_connections 2024-09-10T08:32:47.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.749+0000 7f9af6800640 1 -- 172.21.15.52:0/1891807429 wait complete. 2024-09-10T08:32:47.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-10T08:32:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.925+0000 7f2e8b600640 1 Processor -- start 2024-09-10T08:32:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.925+0000 7f2e8b600640 1 -- start start 2024-09-10T08:32:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.926+0000 7f2e8b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e840b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.926+0000 7f2e8b600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e840cead0 0x7f2e84071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.926+0000 7f2e8b600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e840cf2e0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.926+0000 7f2e8b600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2e84070fe0 con 0x7f2e840cead0 2024-09-10T08:32:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.926+0000 7f2e8b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e840712c0 con 0x7f2e840ccf30 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.927+0000 7f2e88c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e840b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.927+0000 7f2e89600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e840cead0 0x7f2e84071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.927+0000 7f2e83e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2e8415b7c0 0x7f2e840cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:45206/0 (socket says 172.21.15.52:45206) 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.927+0000 7f2e83e00640 1 -- 172.21.15.52:0/3174811416 learned_addr learned my addr 172.21.15.52:0/3174811416 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e89600640 1 -- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 msgr2=0x7f2e840b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e89600640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e840b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e89600640 1 -- 172.21.15.52:0/3174811416 >> v1:172.21.15.176:6789/0 conn(0x7f2e8415b7c0 legacy=0x7f2e840cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e89600640 1 -- 172.21.15.52:0/3174811416 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840715a0 con 0x7f2e840cead0 2024-09-10T08:32:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e83400640 1 -- 172.21.15.52:0/3174811416 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783137769 0 0) 0x7f2e840cf2e0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.928+0000 7f2e88c00640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e840b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e89600640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e84071ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a62baf91637aaa8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e83400640 1 -- 172.21.15.52:0/3174811416 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c031600 con 0x7f2e840cead0 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e83400640 1 -- 172.21.15.52:0/3174811416 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0317a0 con 0x7f2e840cead0 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e83400640 1 -- 172.21.15.52:0/3174811416 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c031b70 con 0x7f2e840cead0 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e8b600640 1 -- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 msgr2=0x7f2e84071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.929+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e84071ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009d90 tx=0x7f2e7c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 -- 172.21.15.52:0/3174811416 shutdown_connections 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e84071ac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3174811416 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e840b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 -- 172.21.15.52:0/3174811416 >> 172.21.15.52:0/3174811416 conn(0x7f2e8406d0f0 msgr2=0x7f2e8406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 -- 172.21.15.52:0/3174811416 shutdown_connections 2024-09-10T08:32:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.930+0000 7f2e8b600640 1 -- 172.21.15.52:0/3174811416 wait complete. 2024-09-10T08:32:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.931+0000 7f2e8b600640 1 Processor -- start 2024-09-10T08:32:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.931+0000 7f2e8b600640 1 -- start start 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e84147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e8415e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84072000 con 0x7f2e8415b7c0 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840cef60 con 0x7f2e840cead0 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.932+0000 7f2e8b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e84072180 con 0x7f2e840ccf30 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39290/0 (socket says 172.21.15.52:39290) 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 -- 172.21.15.52:0/3448670648 learned_addr learned my addr 172.21.15.52:0/3448670648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e88c00640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e84147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e83e00640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e8415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 -- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 msgr2=0x7f2e84147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e84147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 -- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 msgr2=0x7f2e8415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e8415e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 -- 172.21.15.52:0/3448670648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8415e950 con 0x7f2e8415b7c0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.933+0000 7f2e89600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009eb0 tx=0x7f2e7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.934+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c040070 con 0x7f2e8415b7c0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.934+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c030ae0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.934+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8414a930 con 0x7f2e8415b7c0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.934+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c03c420 con 0x7f2e8415b7c0 2024-09-10T08:32:47.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.934+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8414aef0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.935+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e84071ac0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.936+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e7c039040 con 0x7f2e8415b7c0 2024-09-10T08:32:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.936+0000 7f2e80c00640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.937+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f2e7c0abff0 con 0x7f2e8415b7c0 2024-09-10T08:32:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.937+0000 7f2e88c00640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.938+0000 7f2e88c00640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009560 tx=0x7f2e78009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:47.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:47.941+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e7c07a290 con 0x7f2e8415b7c0 2024-09-10T08:32:48.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.128+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f2e840cc960 con 0x7f2e8415b7c0 2024-09-10T08:32:48.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.132+0000 7f2e80c00640 1 -- 172.21.15.52:0/3448670648 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f2e7c07e590 con 0x7f2e8415b7c0 2024-09-10T08:32:48.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 msgr2=0x7f2e6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009560 tx=0x7f2e78009190 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 msgr2=0x7f2e841f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009eb0 tx=0x7f2e7c004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 shutdown_connections 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8415b7c0 0x7f2e841f63c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e840cead0 0x7f2e8415e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 --2- 172.21.15.52:0/3448670648 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e840ccf30 0x7f2e84147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 >> 172.21.15.52:0/3448670648 conn(0x7f2e8406d0f0 msgr2=0x7f2e840725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 shutdown_connections 2024-09-10T08:32:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.134+0000 7f2e8b600640 1 -- 172.21.15.52:0/3448670648 wait complete. 2024-09-10T08:32:48.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:48.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.307+0000 7ff1ac800640 1 Processor -- start 2024-09-10T08:32:48.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.307+0000 7ff1ac800640 1 -- start start 2024-09-10T08:32:48.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.308+0000 7ff1ac800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1a40b2d40 0x7ff1a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.308+0000 7ff1ac800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a413eb20 0x7ff1a406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.308+0000 7ff1ac800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4071180 con 0x7ff1a415bcf0 2024-09-10T08:32:48.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.308+0000 7ff1ac800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a415c890 con 0x7ff1a413eb20 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.308+0000 7ff1ac800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a4071ab0 con 0x7ff1a40b2d40 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a413eb20 0x7ff1a406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1a413eb20 0x7ff1a406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39302/0 (socket says 172.21.15.52:39302) 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 -- 172.21.15.52:0/1938338321 learned_addr learned my addr 172.21.15.52:0/1938338321 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9e00640 1 --2- 172.21.15.52:0/1938338321 >> v2:172.21.15.176:3300/0 conn(0x7ff1a40b2d40 0x7ff1a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 -- 172.21.15.52:0/1938338321 >> v2:172.21.15.176:3300/0 conn(0x7ff1a40b2d40 msgr2=0x7ff1a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 --2- 172.21.15.52:0/1938338321 >> v2:172.21.15.176:3300/0 conn(0x7ff1a40b2d40 0x7ff1a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 -- 172.21.15.52:0/1938338321 >> v1:172.21.15.176:6789/0 conn(0x7ff1a415bcf0 legacy=0x7ff1a415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.309+0000 7ff1a9400640 1 -- 172.21.15.52:0/1938338321 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4071460 con 0x7ff1a413eb20 2024-09-10T08:32:48.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.310+0000 7ff1a9400640 1 --2- 172.21.15.52:0/1938338321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a413eb20 0x7ff1a406c150 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4069be0 tx=0x7ff19402c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a00c6a4c9e0eb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.310+0000 7ff1a8a00640 1 -- 172.21.15.52:0/1938338321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194038070 con 0x7ff1a413eb20 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.310+0000 7ff1a8a00640 1 -- 172.21.15.52:0/1938338321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff194031710 con 0x7ff1a413eb20 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.310+0000 7ff1a8a00640 1 -- 172.21.15.52:0/1938338321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194031ae0 con 0x7ff1a413eb20 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 -- 172.21.15.52:0/1938338321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a413eb20 msgr2=0x7ff1a406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 --2- 172.21.15.52:0/1938338321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a413eb20 0x7ff1a406c150 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4069be0 tx=0x7ff19402c480 comp rx=0 tx=0).stop 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 -- 172.21.15.52:0/1938338321 shutdown_connections 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 --2- 172.21.15.52:0/1938338321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a413eb20 0x7ff1a406c150 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 --2- 172.21.15.52:0/1938338321 >> v2:172.21.15.176:3300/0 conn(0x7ff1a40b2d40 0x7ff1a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 -- 172.21.15.52:0/1938338321 >> 172.21.15.52:0/1938338321 conn(0x7ff1a40ccec0 msgr2=0x7ff1a40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 -- 172.21.15.52:0/1938338321 shutdown_connections 2024-09-10T08:32:48.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.311+0000 7ff1ac800640 1 -- 172.21.15.52:0/1938338321 wait complete. 2024-09-10T08:32:48.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.313+0000 7ff1ac800640 1 Processor -- start 2024-09-10T08:32:48.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.313+0000 7ff1ac800640 1 -- start start 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a413eb20 0x7ff1a40ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 0x7ff1a413d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40720c0 con 0x7ff1a40b2d40 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4071f40 con 0x7ff1a415bcf0 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1ac800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a4072240 con 0x7ff1a413eb20 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1a9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1a9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39316/0 (socket says 172.21.15.52:39316) 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1a9e00640 1 -- 172.21.15.52:0/2690172209 learned_addr learned my addr 172.21.15.52:0/2690172209 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1aa800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 0x7ff1a413d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.314+0000 7ff1a9400640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a413eb20 0x7ff1a40ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 -- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a413eb20 msgr2=0x7ff1a40ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a413eb20 0x7ff1a40ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 -- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 msgr2=0x7ff1a413d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 0x7ff1a413d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 -- 172.21.15.52:0/2690172209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a415fe50 con 0x7ff1a40b2d40 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1aa800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 0x7ff1a413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1a9e00640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e9e0 tx=0x7ff19800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198017070 con 0x7ff1a40b2d40 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19800c9d0 con 0x7ff1a40b2d40 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19800cdc0 con 0x7ff1a40b2d40 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a40c9890 con 0x7ff1a40b2d40 2024-09-10T08:32:48.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.315+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a40ca130 con 0x7ff1a40b2d40 2024-09-10T08:32:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.316+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a40c9a60 con 0x7ff1a40b2d40 2024-09-10T08:32:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.317+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff19801a070 con 0x7ff1a40b2d40 2024-09-10T08:32:48.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.318+0000 7ff19e000640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 0x7ff18806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.318+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7ff19808af90 con 0x7ff1a40b2d40 2024-09-10T08:32:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.319+0000 7ff1a9400640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 0x7ff18806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.319+0000 7ff1a9400640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 0x7ff18806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff194035000 tx=0x7ff194008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.323+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff198059840 con 0x7ff1a40b2d40 2024-09-10T08:32:48.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.547+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1a415c180 con 0x7ff1a40b2d40 2024-09-10T08:32:48.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.548+0000 7ff19e000640 1 -- 172.21.15.52:0/2690172209 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7ff198059140 con 0x7ff1a40b2d40 2024-09-10T08:32:48.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:48.548 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:48.549 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 msgr2=0x7ff18806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 0x7ff18806e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff194035000 tx=0x7ff194008030 comp rx=0 tx=0).stop 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 msgr2=0x7ff1a415f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e9e0 tx=0x7ff19800eea0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 shutdown_connections 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff18806be30 0x7ff18806e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1a415bcf0 0x7ff1a413d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1a413eb20 0x7ff1a40ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 --2- 172.21.15.52:0/2690172209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1a40b2d40 0x7ff1a415f800 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.550+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 >> 172.21.15.52:0/2690172209 conn(0x7ff1a40ccec0 msgr2=0x7ff1a40cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.551+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 shutdown_connections 2024-09-10T08:32:48.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.551+0000 7ff1ac800640 1 -- 172.21.15.52:0/2690172209 wait complete. 2024-09-10T08:32:48.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T08:32:48.741 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:32:39.658053+0000","btime":"2024-09-10T08:32:38.634067+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:32:39.658053+0000","atime":"2024-09-10T08:32:38.634067+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:32:39.658053+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:32:48.742 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:32:38.634067+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:32:38.634067+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:32:39.658053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T08:32:39.658053+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:32:39.658053+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:32:48.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:32:48.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-10T08:32:48.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.902+0000 7f7527600640 1 Processor -- start 2024-09-10T08:32:48.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.902+0000 7f7527600640 1 -- start start 2024-09-10T08:32:48.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7527600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75200b6980 0x7f75200d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7527600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520162fe0 0x7f75200d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7527600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75200b7920 con 0x7f752015ec10 2024-09-10T08:32:48.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7527600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f75200b3c00 con 0x7f7520162fe0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7527600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75200cf7c0 con 0x7f75200b6980 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7525600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520162fe0 0x7f75200d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7525600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7520162fe0 0x7f75200d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39330/0 (socket says 172.21.15.52:39330) 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.903+0000 7f7525600640 1 -- 172.21.15.52:0/2257643550 learned_addr learned my addr 172.21.15.52:0/2257643550 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.904+0000 7f751fe00640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75200b6980 0x7f75200d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.904+0000 7f7525600640 1 -- 172.21.15.52:0/2257643550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75200b6980 msgr2=0x7f75200d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.904+0000 7f7525600640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75200b6980 0x7f75200d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.904+0000 7f7525600640 1 -- 172.21.15.52:0/2257643550 >> v1:172.21.15.176:6789/0 conn(0x7f752015ec10 legacy=0x7f75200b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.904+0000 7f7525600640 1 -- 172.21.15.52:0/2257643550 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75200cfaa0 con 0x7f7520162fe0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.905+0000 7f7525600640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520162fe0 0x7f75200d32f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7995643017754ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.905+0000 7f751f400640 1 -- 172.21.15.52:0/2257643550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518036070 con 0x7f7520162fe0 2024-09-10T08:32:48.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.905+0000 7f751f400640 1 -- 172.21.15.52:0/2257643550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518031600 con 0x7f7520162fe0 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.905+0000 7f751f400640 1 -- 172.21.15.52:0/2257643550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180319d0 con 0x7f7520162fe0 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 -- 172.21.15.52:0/2257643550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520162fe0 msgr2=0x7f75200d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520162fe0 0x7f75200d32f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802a680 comp rx=0 tx=0).stop 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 -- 172.21.15.52:0/2257643550 shutdown_connections 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7520162fe0 0x7f75200d32f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 --2- 172.21.15.52:0/2257643550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f75200b6980 0x7f75200d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 -- 172.21.15.52:0/2257643550 >> 172.21.15.52:0/2257643550 conn(0x7f75200d1450 msgr2=0x7f75200d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 -- 172.21.15.52:0/2257643550 shutdown_connections 2024-09-10T08:32:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.906+0000 7f7527600640 1 -- 172.21.15.52:0/2257643550 wait complete. 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.907+0000 7f7527600640 1 Processor -- start 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 -- start start 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f752015ec10 0x7f7520150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520162fe0 0x7f7520160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75200d39b0 con 0x7f75200b6980 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75200d3830 con 0x7f7520162fe0 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.908+0000 7f7527600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f75200d3b30 con 0x7f752015ec10 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39342/0 (socket says 172.21.15.52:39342) 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 -- 172.21.15.52:0/3624157970 learned_addr learned my addr 172.21.15.52:0/3624157970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f751fe00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f752015ec10 0x7f7520150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7525600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520162fe0 0x7f7520160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 -- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f752015ec10 msgr2=0x7f7520150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f752015ec10 0x7f7520150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 -- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520162fe0 msgr2=0x7f7520160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520162fe0 0x7f7520160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 -- 172.21.15.52:0/3624157970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7520158d50 con 0x7f75200b6980 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.909+0000 7f7524c00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f751400c400 tx=0x7f751400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.910+0000 7f751cc00640 1 -- 172.21.15.52:0/3624157970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75140052d0 con 0x7f75200b6980 2024-09-10T08:32:48.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.910+0000 7f751cc00640 1 -- 172.21.15.52:0/3624157970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7514005490 con 0x7f75200b6980 2024-09-10T08:32:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.910+0000 7f751cc00640 1 -- 172.21.15.52:0/3624157970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514007260 con 0x7f75200b6980 2024-09-10T08:32:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.910+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7520158ff0 con 0x7f75200b6980 2024-09-10T08:32:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.910+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7520160770 con 0x7f75200b6980 2024-09-10T08:32:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.912+0000 7f751cc00640 1 -- 172.21.15.52:0/3624157970 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7514007400 con 0x7f75200b6980 2024-09-10T08:32:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.913+0000 7f751cc00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 0x7f750006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.913+0000 7f751cc00640 1 -- 172.21.15.52:0/3624157970 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f751408a3f0 con 0x7f75200b6980 2024-09-10T08:32:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.913+0000 7f752a652740 1 Processor -- start 2024-09-10T08:32:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.913+0000 7f752a652740 1 -- start start 2024-09-10T08:32:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.913+0000 7f751fe00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 0x7f750006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f751fe00640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 0x7f750006e320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f75200b6090 tx=0x7f750c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 0x55d36be20450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be20990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d36bd36970 con 0x55d36bdfcc40 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d36bcde8d0 con 0x55d36be18ba0 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d36bd32930 con 0x55d36be17460 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.914+0000 7f7524c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39350/0 (socket says 172.21.15.52:39350) 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 -- 172.21.15.52:0/2287943512 learned_addr learned my addr 172.21.15.52:0/2287943512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f751fe00640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 0x55d36be20450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7525600640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be20990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 -- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 msgr2=0x55d36be20990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be20990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 -- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 msgr2=0x55d36be20450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 0x55d36be20450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 -- 172.21.15.52:0/2287943512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36bb15a20 con 0x55d36bdfcc40 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7525600640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be20990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:48.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f751fe00640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 0x55d36be20450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7524c00640 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7514007830 tx=0x7f7514011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8256ddb6209289d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7511200640 1 -- 172.21.15.52:0/2287943512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514056950 con 0x55d36bdfcc40 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7511200640 1 -- 172.21.15.52:0/2287943512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751408a0c0 con 0x55d36bdfcc40 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.915+0000 7f7511200640 1 -- 172.21.15.52:0/2287943512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514057aa0 con 0x55d36bdfcc40 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 -- 172.21.15.52:0/2287943512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 msgr2=0x55d36bdfd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7514007830 tx=0x7f7514011000 comp rx=0 tx=0).stop 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 -- 172.21.15.52:0/2287943512 shutdown_connections 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be20990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be18ba0 0x55d36be20450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 --2- 172.21.15.52:0/2287943512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36bdfcc40 0x55d36bdfd020 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 -- 172.21.15.52:0/2287943512 >> 172.21.15.52:0/2287943512 conn(0x55d36bdcf500 msgr2=0x55d36be17a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 -- 172.21.15.52:0/2287943512 shutdown_connections 2024-09-10T08:32:48.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.916+0000 7f752a652740 1 -- 172.21.15.52:0/2287943512 wait complete. 2024-09-10T08:32:48.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.917+0000 7f752a652740 1 -- start start 2024-09-10T08:32:48.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.917+0000 7f752a652740 1 Processor -- start 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be28f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be28460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d36bdd2bf0 con 0x55d36be18ba0 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d36bcf1af0 con 0x55d36be11b80 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d36bdd2ed0 con 0x55d36be17460 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f752a652740 10 client.0 _ll_register_callbacks cb 0x55d36bce35d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f751fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f751fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39358/0 (socket says 172.21.15.52:39358) 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.918+0000 7f751fe00640 1 -- 172.21.15.52:0/2180047957 learned_addr learned my addr 172.21.15.52:0/2180047957 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f7524c00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f7525600640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be28460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 -- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 msgr2=0x55d36be28f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be28f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 -- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 msgr2=0x55d36be28460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be28460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 -- 172.21.15.52:0/2180047957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36ba09310 con 0x55d36be18ba0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f751fe00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f75200b3360 tx=0x7f750c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2719893b5e9b8775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f7505600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c029060 con 0x55d36be18ba0 2024-09-10T08:32:48.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f750c00f040 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.919+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f751408a0c0 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f750c02f050 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 10 client.6468 fetch_fsmap learned FSMap version 41 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55d36bb761b0 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751408a0c0 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f750c032020 con 0x55d36be18ba0 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 10 client.6468 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 10 client.6468 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 20 client.6468 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be289a0 0x55d36bdfb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 4 client.6468 mds_command: new command op to 6405 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:32:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.920+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 --> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d36bd0b100 con 0x55d36be289a0 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.921+0000 7f7524c00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be289a0 0x55d36bdfb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.921+0000 7f7524c00640 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be289a0 0x55d36bdfb330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25902b45a1d1bc6b server_cookie=4b594a9478fba55 in_seq=0 out_seq=0 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.921+0000 7f7505600640 10 client.6468 ms_handle_connect on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f7505600640 1 -- 172.21.15.52:0/2180047957 <== mds.0 v2:172.21.15.52:6834/3318304686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d36bd0b100 con 0x55d36be289a0 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f7505600640 10 client.6468 handle_command_reply: tid=0 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 client.6468 shutdown 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 msgr2=0x55d36bdf9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f75200b3360 tx=0x7f750c004730 comp rx=0 tx=0).stop 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 shutdown_connections 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be28460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36bdf9810 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be289a0 0x55d36bdfb330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 --2- 172.21.15.52:0/2180047957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be28f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f7505600640 0 client.6468 ms_handle_reset on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 >> 172.21.15.52:0/2180047957 conn(0x55d36bdfcc40 msgr2=0x55d36be15df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 shutdown_connections 2024-09-10T08:32:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 1 -- 172.21.15.52:0/2180047957 wait complete. 2024-09-10T08:32:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.922+0000 7f752a652740 20 client.6468 trim_cache size 0 max 16384 2024-09-10T08:32:48.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.940+0000 7f752a652740 1 Processor -- start 2024-09-10T08:32:48.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 -- start start 2024-09-10T08:32:48.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36bdd1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7520200ef0 con 0x55d36be18ba0 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75201fff80 con 0x55d36be11b80 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.941+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f752015fa20 con 0x55d36be17460 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39368/0 (socket says 172.21.15.52:39368) 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 -- 172.21.15.52:0/941453190 learned_addr learned my addr 172.21.15.52:0/941453190 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7524c00640 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36bdd1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f751fe00640 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 -- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 msgr2=0x55d36be319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 -- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 msgr2=0x55d36bdd1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36bdd1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 -- 172.21.15.52:0/941453190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36b9e23d0 con 0x55d36be18ba0 2024-09-10T08:32:48.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.942+0000 7f7525600640 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb32471ab715db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f7507e00640 1 -- 172.21.15.52:0/941453190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518036040 con 0x55d36be18ba0 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f7507e00640 1 -- 172.21.15.52:0/941453190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518037040 con 0x55d36be18ba0 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f7507e00640 1 -- 172.21.15.52:0/941453190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180498a0 con 0x55d36be18ba0 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 -- 172.21.15.52:0/941453190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 msgr2=0x55d36be31f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802e000 comp rx=0 tx=0).stop 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 -- 172.21.15.52:0/941453190 shutdown_connections 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31f00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 --2- 172.21.15.52:0/941453190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36bdd1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 -- 172.21.15.52:0/941453190 >> 172.21.15.52:0/941453190 conn(0x55d36bdfcc40 msgr2=0x55d36be0d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 -- 172.21.15.52:0/941453190 shutdown_connections 2024-09-10T08:32:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.943+0000 7f752a652740 1 -- 172.21.15.52:0/941453190 wait complete. 2024-09-10T08:32:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.944+0000 7f752a652740 1 -- start start 2024-09-10T08:32:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.944+0000 7f752a652740 1 Processor -- start 2024-09-10T08:32:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be99f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be3bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d36be19c20 con 0x55d36be18ba0 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7520160070 con 0x55d36be11b80 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d36be9a800 con 0x55d36be17460 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.945+0000 7f752a652740 10 client.0 _ll_register_callbacks cb 0x7f750c010960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39372/0 (socket says 172.21.15.52:39372) 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 -- 172.21.15.52:0/2970007093 learned_addr learned my addr 172.21.15.52:0/2970007093 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7524c00640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be99f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f751fe00640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be3bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 -- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 msgr2=0x55d36be3bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be3bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 -- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 msgr2=0x55d36be99f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be99f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 -- 172.21.15.52:0/2970007093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36bdd0680 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7525600640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7518009f70 tx=0x7f7518004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebac4b614a6b1d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.946+0000 7f7505600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518036070 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f7518031890 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7518037040 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f751805a050 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 10 client.6474 fetch_fsmap learned FSMap version 41 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55d36be15d30 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518037040 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f751805d020 con 0x55d36be18ba0 2024-09-10T08:32:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 10 client.6474 fetch_fsmap finished waiting for FSMap version 41 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 10 client.6474 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 20 client.6474 populate_metadata read hostname 'smithi052' 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be320f0 0x55d36be903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 4 client.6474 mds_command: new command op to 6405 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.947+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 --> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55d36bd440a0 con 0x55d36be320f0 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.948+0000 7f7524c00640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be320f0 0x55d36be903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.948+0000 7f7524c00640 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be320f0 0x55d36be903e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec425ff5424de04c server_cookie=d686571c416c3047 in_seq=0 out_seq=0 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.948+0000 7f7505600640 10 client.6474 ms_handle_connect on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f7505600640 1 -- 172.21.15.52:0/2970007093 <== mds.0 v2:172.21.15.52:6834/3318304686 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d36bd440a0 con 0x55d36be320f0 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f7505600640 10 client.6474 handle_command_reply: tid=0 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 client.6474 shutdown 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 msgr2=0x55d36be31bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7518009f70 tx=0x7f7518004ab0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 shutdown_connections 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d36be18ba0 0x55d36be31bb0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.52:6834/3318304686,v1:172.21.15.52:6835/3318304686] conn(0x55d36be320f0 0x55d36be903e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d36be17460 0x55d36be3bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 --2- 172.21.15.52:0/2970007093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d36be11b80 0x55d36be99f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f7505600640 0 client.6474 ms_handle_reset on v2:172.21.15.52:6834/3318304686 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 >> 172.21.15.52:0/2970007093 conn(0x55d36bdfcc40 msgr2=0x55d36be190d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 shutdown_connections 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 1 -- 172.21.15.52:0/2970007093 wait complete. 2024-09-10T08:32:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.949+0000 7f752a652740 20 client.6474 trim_cache size 0 max 16384 2024-09-10T08:32:48.954 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:32:48.954 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:32:48.954 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "ad8825ab-3dae-4685-8822-bd39888252a1", 2024-09-10T08:32:48.954 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:32:48.954 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 msgr2=0x7f750006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 0x7f750006e320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f75200b6090 tx=0x7f750c008040 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 msgr2=0x7f7520161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f751400c400 tx=0x7f751400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 shutdown_connections 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f750006be60 0x7f750006e320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7520162fe0 0x7f7520160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f752015ec10 0x7f7520150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 --2- 172.21.15.52:0/3624157970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75200b6980 0x7f7520161ac0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.950+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 >> 172.21.15.52:0/3624157970 conn(0x7f75200d1450 msgr2=0x7f75200b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.951+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 shutdown_connections 2024-09-10T08:32:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:48.951+0000 7f7527600640 1 -- 172.21.15.52:0/3624157970 wait complete. 2024-09-10T08:32:48.968 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.124+0000 7ffa71a00640 1 Processor -- start 2024-09-10T08:32:49.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.124+0000 7ffa71a00640 1 -- start start 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa71a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 0x7ffa6c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa71a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 0x7ffa6c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa71a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c071180 con 0x7ffa6c15bcf0 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa71a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c071ab0 con 0x7ffa6c13eb20 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa71a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c071460 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa6b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffa6c15bcf0 0x7ffa6c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34724/0 (socket says 172.21.15.52:34724) 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa6b400640 1 -- 172.21.15.52:0/535694367 learned_addr learned my addr 172.21.15.52:0/535694367 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa63e00640 1 --2- 172.21.15.52:0/535694367 >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 0x7ffa6c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/535694367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 0x7ffa6c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.126+0000 7ffa6a000640 1 -- 172.21.15.52:0/535694367 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271818946 0 0) 0x7ffa6c071180 con 0x7ffa6c15bcf0 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa6a000640 1 -- 172.21.15.52:0/535694367 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa50003520 con 0x7ffa6c15bcf0 2024-09-10T08:32:49.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa6aa00640 1 -- 172.21.15.52:0/535694367 >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 msgr2=0x7ffa6c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/535694367 >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 0x7ffa6c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa6aa00640 1 -- 172.21.15.52:0/535694367 >> v1:172.21.15.52:6789/0 conn(0x7ffa6c15bcf0 legacy=0x7ffa6c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa6aa00640 1 -- 172.21.15.52:0/535694367 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c071740 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.127+0000 7ffa63e00640 1 --2- 172.21.15.52:0/535694367 >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 0x7ffa6c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.128+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/535694367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 0x7ffa6c06bc10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c071c30 tx=0x7ffa5c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0923a073e239e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.128+0000 7ffa6a000640 1 -- 172.21.15.52:0/535694367 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c037070 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.128+0000 7ffa6a000640 1 -- 172.21.15.52:0/535694367 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c032440 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.128+0000 7ffa6a000640 1 -- 172.21.15.52:0/535694367 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0327f0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 -- 172.21.15.52:0/535694367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 msgr2=0x7ffa6c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 --2- 172.21.15.52:0/535694367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 0x7ffa6c06bc10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c071c30 tx=0x7ffa5c02a180 comp rx=0 tx=0).stop 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 -- 172.21.15.52:0/535694367 shutdown_connections 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 --2- 172.21.15.52:0/535694367 >> v2:172.21.15.176:3300/0 conn(0x7ffa6c13eb20 0x7ffa6c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 --2- 172.21.15.52:0/535694367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c0b2d40 0x7ffa6c06bc10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 -- 172.21.15.52:0/535694367 >> 172.21.15.52:0/535694367 conn(0x7ffa6c0ccec0 msgr2=0x7ffa6c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 -- 172.21.15.52:0/535694367 shutdown_connections 2024-09-10T08:32:49.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.129+0000 7ffa71a00640 1 -- 172.21.15.52:0/535694367 wait complete. 2024-09-10T08:32:49.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.130+0000 7ffa71a00640 1 Processor -- start 2024-09-10T08:32:49.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 -- start start 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c13eb20 0x7ffa6c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa6c15bcf0 0x7ffa6c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0722d0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c072150 con 0x7ffa6c15bcf0 2024-09-10T08:32:49.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.131+0000 7ffa71a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c072450 con 0x7ffa6c13eb20 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39378/0 (socket says 172.21.15.52:39378) 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 -- 172.21.15.52:0/470398045 learned_addr learned my addr 172.21.15.52:0/470398045 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa63e00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c13eb20 0x7ffa6c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6b400640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa6c15bcf0 0x7ffa6c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 -- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c13eb20 msgr2=0x7ffa6c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c13eb20 0x7ffa6c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 -- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa6c15bcf0 msgr2=0x7ffa6c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa6c15bcf0 0x7ffa6c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.132+0000 7ffa6aa00640 1 -- 172.21.15.52:0/470398045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c15ee30 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa6aa00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c02a1c0 tx=0x7ffa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:49.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c037040 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c042070 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c032810 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c15f110 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.133+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c15f6d0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.134+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c072840 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.135+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa5c0329b0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.136+0000 7ffa62a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:49.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.136+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7ffa5c0ab6a0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.137+0000 7ffa63e00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:49.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.137+0000 7ffa63e00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 0x7ffa4806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009560 tx=0x7ffa54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:49.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.140+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa5c079900 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.362+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa6c06c9c0 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.363+0000 7ffa62a00640 1 -- 172.21.15.52:0/470398045 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7ffa5c07dc00 con 0x7ffa6c0b2d40 2024-09-10T08:32:49.364 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:49.364 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:49.364 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 msgr2=0x7ffa4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 0x7ffa4806e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffa54009560 tx=0x7ffa54009190 comp rx=0 tx=0).stop 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 msgr2=0x7ffa6c1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c02a1c0 tx=0x7ffa5c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 shutdown_connections 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa4806be30 0x7ffa4806e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa6c15bcf0 0x7ffa6c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa6c13eb20 0x7ffa6c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 --2- 172.21.15.52:0/470398045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa6c0b2d40 0x7ffa6c1548f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 >> 172.21.15.52:0/470398045 conn(0x7ffa6c0ccec0 msgr2=0x7ffa6c0b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 shutdown_connections 2024-09-10T08:32:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:49.365+0000 7ffa71a00640 1 -- 172.21.15.52:0/470398045 wait complete. 2024-09-10T08:32:49.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T08:32:49.556 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:32:39.658053+0000","btime":"2024-09-10T08:32:38.634067+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:32:39.658053+0000","atime":"2024-09-10T08:32:38.634067+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:32:39.658053+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:32:49.557 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:32:38.634067+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:32:38.634067+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:32:39.658053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T08:32:39.658053+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:32:39.658053+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:32:49.557 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-10T08:32:54.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.724+0000 7f7eb2800640 1 Processor -- start 2024-09-10T08:32:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.724+0000 7f7eb2800640 1 -- start start 2024-09-10T08:32:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eb2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7eac145ed0 0x7f7eac0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eb2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 0x7f7eac0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eb2800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac0b4020 con 0x7f7eac0b5880 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eb2800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac073b00 con 0x7f7eac145ed0 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eb2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac0b42c0 con 0x7f7eac073180 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eab400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7eac145ed0 0x7f7eac0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eab400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7eac145ed0 0x7f7eac0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37502/0 (socket says 172.21.15.52:37502) 2024-09-10T08:32:54.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.725+0000 7f7eab400640 1 -- 172.21.15.52:0/2321847492 learned_addr learned my addr 172.21.15.52:0/2321847492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eab400640 1 -- 172.21.15.52:0/2321847492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 msgr2=0x7f7eac0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eaaa00640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 0x7f7eac0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eab400640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 0x7f7eac0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eab400640 1 -- 172.21.15.52:0/2321847492 >> v1:172.21.15.52:6789/0 conn(0x7f7eac0b5880 legacy=0x7f7eac0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eab400640 1 -- 172.21.15.52:0/2321847492 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac0b45a0 con 0x7f7eac145ed0 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.726+0000 7f7eaaa00640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 0x7f7eac0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:54.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.727+0000 7f7eab400640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac145ed0 0x7f7eac0b5080 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009870 tx=0x7f7e9c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b45c74e5729884a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:54.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.727+0000 7f7eaa000640 1 -- 172.21.15.52:0/2321847492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c037070 con 0x7f7eac145ed0 2024-09-10T08:32:54.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.727+0000 7f7eaa000640 1 -- 172.21.15.52:0/2321847492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c032440 con 0x7f7eac145ed0 2024-09-10T08:32:54.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.727+0000 7f7eaa000640 1 -- 172.21.15.52:0/2321847492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c032810 con 0x7f7eac145ed0 2024-09-10T08:32:54.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 -- 172.21.15.52:0/2321847492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac145ed0 msgr2=0x7f7eac0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac145ed0 0x7f7eac0b5080 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009870 tx=0x7f7e9c02a250 comp rx=0 tx=0).stop 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 -- 172.21.15.52:0/2321847492 shutdown_connections 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac073180 0x7f7eac0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 --2- 172.21.15.52:0/2321847492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac145ed0 0x7f7eac0b5080 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 -- 172.21.15.52:0/2321847492 >> 172.21.15.52:0/2321847492 conn(0x7f7eac0ccec0 msgr2=0x7f7eac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 -- 172.21.15.52:0/2321847492 shutdown_connections 2024-09-10T08:32:54.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.728+0000 7f7eb2800640 1 -- 172.21.15.52:0/2321847492 wait complete. 2024-09-10T08:32:54.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.730+0000 7f7eb2800640 1 Processor -- start 2024-09-10T08:32:54.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.730+0000 7f7eb2800640 1 -- start start 2024-09-10T08:32:54.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.730+0000 7f7eb2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 0x7f7eac157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eb2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eb2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 0x7f7eac1f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eb2800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac1462b0 con 0x7f7eac0b5880 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eb2800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0b4b60 con 0x7f7eac073180 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eb2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac146430 con 0x7f7eac145ed0 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37512/0 (socket says 172.21.15.52:37512) 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 -- 172.21.15.52:0/4227818252 learned_addr learned my addr 172.21.15.52:0/4227818252 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eab400640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 0x7f7eac157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eabe00640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 0x7f7eac1f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 -- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 msgr2=0x7f7eac1f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 0x7f7eac1f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 -- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 msgr2=0x7f7eac157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 0x7f7eac157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eaaa00640 1 -- 172.21.15.52:0/4227818252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac1f7ba0 con 0x7f7eac0b5880 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eab400640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 0x7f7eac157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.731+0000 7f7eabe00640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 0x7f7eac1f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:54.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7eaaa00640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c7f0 tx=0x7f7e9800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98015070 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e98007a30 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac158120 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007e00 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.732+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1586e0 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.733+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eac0735c0 con 0x7f7eac0b5880 2024-09-10T08:32:54.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.734+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e98018070 con 0x7f7eac0b5880 2024-09-10T08:32:54.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.735+0000 7f7ea3400640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 0x7f7e8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:54.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.735+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f7e9808afe0 con 0x7f7eac0b5880 2024-09-10T08:32:54.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.736+0000 7f7eab400640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 0x7f7e8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:54.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.737+0000 7f7eab400640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 0x7f7e8c06e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c034000 tx=0x7f7e9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:54.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.740+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e98059800 con 0x7f7eac0b5880 2024-09-10T08:32:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.964+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eac0cf7b0 con 0x7f7eac0b5880 2024-09-10T08:32:54.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.965+0000 7f7ea3400640 1 -- 172.21.15.52:0/4227818252 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f7e98059100 con 0x7f7eac0b5880 2024-09-10T08:32:54.965 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:54.965 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:54.965 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:54.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 msgr2=0x7f7e8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 0x7f7e8c06e320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c034000 tx=0x7f7e9c02e000 comp rx=0 tx=0).stop 2024-09-10T08:32:54.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 msgr2=0x7f7eac072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:54.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c7f0 tx=0x7f7e9800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 shutdown_connections 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e8c06be60 0x7f7e8c06e320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7eac145ed0 0x7f7eac1f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7eac0b5880 0x7f7eac072ac0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 --2- 172.21.15.52:0/4227818252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7eac073180 0x7f7eac157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 >> 172.21.15.52:0/4227818252 conn(0x7f7eac0ccec0 msgr2=0x7f7eac0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 shutdown_connections 2024-09-10T08:32:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:54.967+0000 7f7eb2800640 1 -- 172.21.15.52:0/4227818252 wait complete. 2024-09-10T08:32:54.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-10T08:32:55.157 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:32:39.658053+0000","btime":"2024-09-10T08:32:38.634067+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:32:39.658053+0000","atime":"2024-09-10T08:32:38.634067+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:32:39.658053+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:32:39.659053+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-10T08:32:48.952211+0000","last_scrub_version":244,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:32:55.158 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:32:38.634067+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:32:38.634067+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:32:39.658053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-10T08:32:39.658053+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-10T08:32:48.952211+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:32:39.658053+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-10T08:32:39.659053+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:32:55.158 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T08:32:55.158 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:32:55.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:55.258 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:32:55.367 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:32:55.367 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:55.367 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:55.367 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:55.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:32:55.403 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:55.403 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:55.403 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:55.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:55.440 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:55.440 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:32:55.441 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:55.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:32:55.478 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:32:55.478 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:32:55.478 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:32:55.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:32:55.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:55.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.673+0000 7f6aef000640 1 Processor -- start 2024-09-10T08:32:55.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.674+0000 7f6aef000640 1 -- start start 2024-09-10T08:32:55.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aef000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ae80cf5c0 0x7f6ae80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aef000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aef000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae80b4370 con 0x7f6ae81600f0 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aef000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae80b4650 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aef000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae80b4dc0 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aed200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aed200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37528/0 (socket says 172.21.15.52:37528) 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aed200640 1 -- 172.21.15.52:0/2003807000 learned_addr learned my addr 172.21.15.52:0/2003807000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.675+0000 7f6aedc00640 1 --2- 172.21.15.52:0/2003807000 >> v2:172.21.15.176:3300/0 conn(0x7f6ae80cf5c0 0x7f6ae80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.676+0000 7f6aed200640 1 -- 172.21.15.52:0/2003807000 >> v2:172.21.15.176:3300/0 conn(0x7f6ae80cf5c0 msgr2=0x7f6ae80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.676+0000 7f6aed200640 1 --2- 172.21.15.52:0/2003807000 >> v2:172.21.15.176:3300/0 conn(0x7f6ae80cf5c0 0x7f6ae80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.676+0000 7f6aed200640 1 -- 172.21.15.52:0/2003807000 >> v1:172.21.15.176:6789/0 conn(0x7f6ae81600f0 legacy=0x7f6ae8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.676+0000 7f6aed200640 1 -- 172.21.15.52:0/2003807000 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae80b50a0 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6aed200640 1 --2- 172.21.15.52:0/2003807000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806f210 tx=0x7f6ad402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4fd08426c78980 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:55.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6ae7e00640 1 -- 172.21.15.52:0/2003807000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4037070 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6ae7e00640 1 -- 172.21.15.52:0/2003807000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4032440 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6ae7e00640 1 -- 172.21.15.52:0/2003807000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4032810 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6aef000640 1 -- 172.21.15.52:0/2003807000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf9a0 msgr2=0x7f6ae80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.677+0000 7f6aef000640 1 --2- 172.21.15.52:0/2003807000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806f210 tx=0x7f6ad402a160 comp rx=0 tx=0).stop 2024-09-10T08:32:55.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 -- 172.21.15.52:0/2003807000 shutdown_connections 2024-09-10T08:32:55.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 --2- 172.21.15.52:0/2003807000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae80b3c30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 --2- 172.21.15.52:0/2003807000 >> v2:172.21.15.176:3300/0 conn(0x7f6ae80cf5c0 0x7f6ae80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 -- 172.21.15.52:0/2003807000 >> 172.21.15.52:0/2003807000 conn(0x7f6ae806c240 msgr2=0x7f6ae806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:55.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 -- 172.21.15.52:0/2003807000 shutdown_connections 2024-09-10T08:32:55.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.678+0000 7f6aef000640 1 -- 172.21.15.52:0/2003807000 wait complete. 2024-09-10T08:32:55.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.679+0000 7f6aef000640 1 Processor -- start 2024-09-10T08:32:55.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.679+0000 7f6aef000640 1 -- start start 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae81600f0 0x7f6ae8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8160e10 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8160c90 con 0x7f6ae80cf9a0 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.680+0000 7f6aef000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae80b5880 con 0x7f6ae81600f0 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aed200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37532/0 (socket says 172.21.15.52:37532) 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 -- 172.21.15.52:0/731115752 learned_addr learned my addr 172.21.15.52:0/731115752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aee600640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae81600f0 0x7f6ae8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 -- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae81600f0 msgr2=0x7f6ae8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae81600f0 0x7f6ae8150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 -- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 msgr2=0x7f6ae81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae81590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 -- 172.21.15.52:0/731115752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81597b0 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aed200640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.681+0000 7f6aedc00640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00d830 tx=0x7f6adc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.682+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00b6c0 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.682+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc019070 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.682+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae8159a90 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.682+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00ba80 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.682+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae815a050 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.683+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8160580 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.684+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6adc01e460 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.685+0000 7f6ae5600640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 0x7f6ac806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.685+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f6adc08b420 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.685+0000 7f6aed200640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 0x7f6ac806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:55.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.686+0000 7f6aed200640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 0x7f6ac806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4034000 tx=0x7f6ad402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.690+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6adc059720 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.909+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae806d620 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.909+0000 7f6ae5600640 1 -- 172.21.15.52:0/731115752 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7f6adc05da20 con 0x7f6ae80cf5c0 2024-09-10T08:32:55.910 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:55.910 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:55.910 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 msgr2=0x7f6ac806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 0x7f6ac806e2f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4034000 tx=0x7f6ad402e000 comp rx=0 tx=0).stop 2024-09-10T08:32:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 msgr2=0x7f6ae8158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00d830 tx=0x7f6adc00dcf0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 shutdown_connections 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac806be30 0x7f6ac806e2f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae81600f0 0x7f6ae8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae80cf9a0 0x7f6ae81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 --2- 172.21.15.52:0/731115752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae80cf5c0 0x7f6ae8158ba0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 >> 172.21.15.52:0/731115752 conn(0x7f6ae806c240 msgr2=0x7f6ae815f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 shutdown_connections 2024-09-10T08:32:55.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:55.912+0000 7f6aef000640 1 -- 172.21.15.52:0/731115752 wait complete. 2024-09-10T08:32:55.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:56.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.087+0000 7fd3e8400640 1 Processor -- start 2024-09-10T08:32:56.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.087+0000 7fd3e8400640 1 -- start start 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.088+0000 7fd3e8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 0x7fd3e015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e8400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e0071180 con 0x7fd3e013eb20 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e8400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e0071460 con 0x7fd3e00b2d40 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e0071ab0 con 0x7fd3e006c320 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e6400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd3e013eb20 0x7fd3e015c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56318/0 (socket says 172.21.15.52:56318) 2024-09-10T08:32:56.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e6400640 1 -- 172.21.15.52:0/1739960093 learned_addr learned my addr 172.21.15.52:0/1739960093 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e5000640 1 --2- 172.21.15.52:0/1739960093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 0x7fd3e015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409522554 0 0) 0x7fd3e0071460 con 0x7fd3e00b2d40 2024-09-10T08:32:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c8003520 con 0x7fd3e00b2d40 2024-09-10T08:32:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783271714 0 0) 0x7fd3e0071180 con 0x7fd3e013eb20 2024-09-10T08:32:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e0071460 con 0x7fd3e013eb20 2024-09-10T08:32:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e5000640 1 -- 172.21.15.52:0/1739960093 >> v1:172.21.15.176:6789/0 conn(0x7fd3e00b2d40 legacy=0x7fd3e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e5000640 1 -- 172.21.15.52:0/1739960093 >> v1:172.21.15.52:6789/0 conn(0x7fd3e013eb20 legacy=0x7fd3e015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.089+0000 7fd3e5000640 1 -- 172.21.15.52:0/1739960093 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0071740 con 0x7fd3e006c320 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e5000640 1 --2- 172.21.15.52:0/1739960093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 0x7fd3e015bcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0097d0 tx=0x7fd3cc02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77fbf75f1e6ce1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc037070 con 0x7fd3e006c320 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc032440 con 0x7fd3e006c320 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1739960093 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc032810 con 0x7fd3e006c320 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 -- 172.21.15.52:0/1739960093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 msgr2=0x7fd3e015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 --2- 172.21.15.52:0/1739960093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 0x7fd3e015bcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0097d0 tx=0x7fd3cc02a200 comp rx=0 tx=0).stop 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 -- 172.21.15.52:0/1739960093 shutdown_connections 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 --2- 172.21.15.52:0/1739960093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e006c320 0x7fd3e015bcf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 -- 172.21.15.52:0/1739960093 >> 172.21.15.52:0/1739960093 conn(0x7fd3e00ccec0 msgr2=0x7fd3e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 -- 172.21.15.52:0/1739960093 shutdown_connections 2024-09-10T08:32:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.091+0000 7fd3e8400640 1 -- 172.21.15.52:0/1739960093 wait complete. 2024-09-10T08:32:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.093+0000 7fd3e8400640 1 Processor -- start 2024-09-10T08:32:56.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.093+0000 7fd3e8400640 1 -- start start 2024-09-10T08:32:56.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e00b2d40 0x7fd3e01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 0x7fd3e015b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00b3900 con 0x7fd3e006c320 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00b3780 con 0x7fd3e013eb20 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e00b3a80 con 0x7fd3e00b2d40 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37546/0 (socket says 172.21.15.52:37546) 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.094+0000 7fd3e5a00640 1 -- 172.21.15.52:0/834356945 learned_addr learned my addr 172.21.15.52:0/834356945 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e6400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 0x7fd3e015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5000640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e00b2d40 0x7fd3e01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 -- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e00b2d40 msgr2=0x7fd3e01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e00b2d40 0x7fd3e01595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 -- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 msgr2=0x7fd3e015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 0x7fd3e015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 -- 172.21.15.52:0/834356945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0156090 con 0x7fd3e006c320 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e6400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 0x7fd3e015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:32:56.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e5a00640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400c500 tx=0x7fd3d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40052d0 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d4005470 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4012870 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.095+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e015bb40 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.096+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e015c100 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.097+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e006bc10 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.098+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3d4012a10 con 0x7fd3e006c320 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.098+0000 7fd3dd600640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.098+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7fd3d408aa90 con 0x7fd3e006c320 2024-09-10T08:32:56.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.099+0000 7fd3e5000640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.099+0000 7fd3e5000640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 0x7fd3c006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc034000 tx=0x7fd3cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.103+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d40594b0 con 0x7fd3e006c320 2024-09-10T08:32:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.326+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3e006c9c0 con 0x7fd3e006c320 2024-09-10T08:32:56.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.327+0000 7fd3dd600640 1 -- 172.21.15.52:0/834356945 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7fd3d4058db0 con 0x7fd3e006c320 2024-09-10T08:32:56.327 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:56.328 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 msgr2=0x7fd3c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 0x7fd3c006e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc034000 tx=0x7fd3cc02e000 comp rx=0 tx=0).stop 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 msgr2=0x7fd3e01f4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400c500 tx=0x7fd3d400c9c0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 shutdown_connections 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be60 0x7fd3c006e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e013eb20 0x7fd3e015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3e00b2d40 0x7fd3e01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 --2- 172.21.15.52:0/834356945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e006c320 0x7fd3e01f4470 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 >> 172.21.15.52:0/834356945 conn(0x7fd3e00ccec0 msgr2=0x7fd3e013db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.329+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 shutdown_connections 2024-09-10T08:32:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.330+0000 7fd3e8400640 1 -- 172.21.15.52:0/834356945 wait complete. 2024-09-10T08:32:56.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.502+0000 7fa984000640 1 Processor -- start 2024-09-10T08:32:56.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.502+0000 7fa984000640 1 -- start start 2024-09-10T08:32:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa984000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa97c162c60 0x7fa97c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa984000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c1631c0 con 0x7fa97c15e790 2024-09-10T08:32:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa984000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97c0ae9a0 con 0x7fa97c06f730 2024-09-10T08:32:56.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa984000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa97c15eb70 con 0x7fa97c162c60 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa981600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa97c15e790 0x7fa97c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56334/0 (socket says 172.21.15.52:56334) 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa981600640 1 -- 172.21.15.52:0/2391297845 learned_addr learned my addr 172.21.15.52:0/2391297845 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa980c00640 1 --2- 172.21.15.52:0/2391297845 >> v2:172.21.15.176:3300/0 conn(0x7fa97c162c60 0x7fa97c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896026581 0 0) 0x7fa97c1631c0 con 0x7fa97c15e790 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.504+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa964003520 con 0x7fa97c15e790 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2960784078 0 0) 0x7fa964003520 con 0x7fa97c15e790 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 >> v2:172.21.15.176:3300/0 conn(0x7fa97c162c60 msgr2=0x7fa97c073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 --2- 172.21.15.52:0/2391297845 >> v2:172.21.15.176:3300/0 conn(0x7fa97c162c60 0x7fa97c073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 >> v1:172.21.15.176:6789/0 conn(0x7fa97c06f730 legacy=0x7fa97c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c0aec40 con 0x7fa97c15e790 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fa970001670 con 0x7fa97c15e790 2024-09-10T08:32:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 >> v1:172.21.15.52:6789/0 conn(0x7fa97c15e790 legacy=0x7fa97c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9640039b0 0x7fa964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa96400c130 con 0x7fa964004800 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa96400c2e0 con 0x7fa9640051c0 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa96400c4e0 con 0x7fa9640039b0 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa980c00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa981600640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9640039b0 0x7fa964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.505+0000 7fa982000640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa980c00640 1 -- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9640039b0 msgr2=0x7fa964003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:56.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa980c00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9640039b0 0x7fa964003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa980c00640 1 -- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9640051c0 msgr2=0x7fa96400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa980c00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9640051c0 0x7fa96400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa980c00640 1 -- 172.21.15.52:0/2391297845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa964003520 con 0x7fa964004800 2024-09-10T08:32:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.506+0000 7fa982000640 1 -- 172.21.15.52:0/2391297845 reap_dead start 2024-09-10T08:32:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa980c00640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 0x7fa964004c80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa968009ac0 tx=0x7fa964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b712054da3ef3b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968036070 con 0x7fa964004800 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa968031400 con 0x7fa964004800 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa97be00640 1 -- 172.21.15.52:0/2391297845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968009690 con 0x7fa964004800 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa984000640 1 -- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 msgr2=0x7fa964004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.507+0000 7fa984000640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 0x7fa964004c80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa968009ac0 tx=0x7fa964005830 comp rx=0 tx=0).stop 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.508+0000 7fa984000640 1 -- 172.21.15.52:0/2391297845 shutdown_connections 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.508+0000 7fa984000640 1 --2- 172.21.15.52:0/2391297845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa964004800 0x7fa964004c80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.508+0000 7fa984000640 1 -- 172.21.15.52:0/2391297845 >> 172.21.15.52:0/2391297845 conn(0x7fa97c0b0a80 msgr2=0x7fa97c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.508+0000 7fa984000640 1 -- 172.21.15.52:0/2391297845 shutdown_connections 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.508+0000 7fa984000640 1 -- 172.21.15.52:0/2391297845 wait complete. 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.509+0000 7fa984000640 1 Processor -- start 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.509+0000 7fa984000640 1 -- start start 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 0x7fa97c1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97c160ee0 0x7fa97c161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c06f430 con 0x7fa97c15cdd0 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c0af200 con 0x7fa97c160ee0 2024-09-10T08:32:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.510+0000 7fa984000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa97c073a40 con 0x7fa964004800 2024-09-10T08:32:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa981600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 0x7fa97c1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa980c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97c160ee0 0x7fa97c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37564/0 (socket says 172.21.15.52:37564) 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa981600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 0x7fa97c1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:38578/0 (socket says 172.21.15.52:38578) 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa981600640 1 -- 172.21.15.52:0/1384674185 learned_addr learned my addr 172.21.15.52:0/1384674185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 -- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 msgr2=0x7fa97c1f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 0x7fa97c1f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 -- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97c160ee0 msgr2=0x7fa97c161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97c160ee0 0x7fa97c161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 -- 172.21.15.52:0/1384674185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c1619c0 con 0x7fa97c15cdd0 2024-09-10T08:32:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.511+0000 7fa982000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa97c074360 tx=0x7fa97400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.512+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97401a070 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.512+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa974006d60 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.512+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974003bb0 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.512+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c161ca0 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.512+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c1f53e0 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.513+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c06fb80 con 0x7fa97c15cdd0 2024-09-10T08:32:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.514+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa974005070 con 0x7fa97c15cdd0 2024-09-10T08:32:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.514+0000 7fa979600640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 0x7fa95c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.515+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7fa97408a5e0 con 0x7fa97c15cdd0 2024-09-10T08:32:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.515+0000 7fa981600640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 0x7fa95c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.516+0000 7fa981600640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 0x7fa95c06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9700011e0 tx=0x7fa970001470 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.519+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa974058840 con 0x7fa97c15cdd0 2024-09-10T08:32:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.706+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa97c0b1480 con 0x7fa97c15cdd0 2024-09-10T08:32:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.707+0000 7fa979600640 1 -- 172.21.15.52:0/1384674185 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16866 (secure 0 0 0) 0x7fa97405cb40 con 0x7fa97c15cdd0 2024-09-10T08:32:56.708 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:56.708 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":65,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:41.612704+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:32:22.375699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T08:32:23.570054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/2886852302":"2024-09-11T08:32:41.603819+0000","172.21.15.52:6832/2886852302":"2024-09-11T08:32:41.603819+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.709+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 msgr2=0x7fa95c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.709+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 0x7fa95c06e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9700011e0 tx=0x7fa970001470 comp rx=0 tx=0).stop 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.709+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 msgr2=0x7fa97c15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.709+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa97c074360 tx=0x7fa97400fc90 comp rx=0 tx=0).stop 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 shutdown_connections 2024-09-10T08:32:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa95c06be60 0x7fa95c06e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa97c15cdd0 0x7fa97c15d250 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97c160ee0 0x7fa97c161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 --2- 172.21.15.52:0/1384674185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa964004800 0x7fa97c1f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 >> 172.21.15.52:0/1384674185 conn(0x7fa97c0b0a80 msgr2=0x7fa97c0b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 shutdown_connections 2024-09-10T08:32:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.710+0000 7fa984000640 1 -- 172.21.15.52:0/1384674185 wait complete. 2024-09-10T08:32:56.727 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:32:56.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.884+0000 7faf06e00640 1 Processor -- start 2024-09-10T08:32:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.884+0000 7faf06e00640 1 -- start start 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.885+0000 7faf06e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf00073890 0x7faf000b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.885+0000 7faf06e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf000b5880 0x7faf000b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.885+0000 7faf06e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000b4020 con 0x7faf00145ed0 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.885+0000 7faf06e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faf000b42c0 con 0x7faf000b5880 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.885+0000 7faf06e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf000b45a0 con 0x7faf00073890 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf000b5880 0x7faf000b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faf000b5880 0x7faf000b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37566/0 (socket says 172.21.15.52:37566) 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 -- 172.21.15.52:0/3523070824 learned_addr learned my addr 172.21.15.52:0/3523070824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faef7e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf00073890 0x7faf000b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 -- 172.21.15.52:0/3523070824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf00073890 msgr2=0x7faf000b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf00073890 0x7faf000b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 -- 172.21.15.52:0/3523070824 >> v1:172.21.15.176:6789/0 conn(0x7faf00145ed0 legacy=0x7faf00073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.886+0000 7faf04e00640 1 -- 172.21.15.52:0/3523070824 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000b4880 con 0x7faf000b5880 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.887+0000 7faf04e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf000b5880 0x7faf000b5d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e50 tx=0x7faef802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5d2b79fe30d0bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.887+0000 7faeff400640 1 -- 172.21.15.52:0/3523070824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8036070 con 0x7faf000b5880 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.887+0000 7faeff400640 1 -- 172.21.15.52:0/3523070824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8031600 con 0x7faf000b5880 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.887+0000 7faeff400640 1 -- 172.21.15.52:0/3523070824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80319d0 con 0x7faf000b5880 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 -- 172.21.15.52:0/3523070824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf000b5880 msgr2=0x7faf000b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf000b5880 0x7faf000b5d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e50 tx=0x7faef802a6c0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 -- 172.21.15.52:0/3523070824 shutdown_connections 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf000b5880 0x7faf000b5d30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 --2- 172.21.15.52:0/3523070824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf00073890 0x7faf000b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 -- 172.21.15.52:0/3523070824 >> 172.21.15.52:0/3523070824 conn(0x7faf000ccec0 msgr2=0x7faf000cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 -- 172.21.15.52:0/3523070824 shutdown_connections 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.888+0000 7faf06e00640 1 -- 172.21.15.52:0/3523070824 wait complete. 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.890+0000 7faf06e00640 1 Processor -- start 2024-09-10T08:32:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.890+0000 7faf06e00640 1 -- start start 2024-09-10T08:32:56.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf00073890 0x7faf000728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf000b5880 0x7faf000c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b6270 con 0x7faf00145ed0 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf001462b0 con 0x7faf00073890 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf06e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf00071820 con 0x7faf000b5880 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf04e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf04e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37580/0 (socket says 172.21.15.52:37580) 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faf04e00640 1 -- 172.21.15.52:0/1659538127 learned_addr learned my addr 172.21.15.52:0/1659538127 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faeffe00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf00073890 0x7faf000728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.891+0000 7faef7e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf000b5880 0x7faf000c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 -- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf000b5880 msgr2=0x7faf000c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf000b5880 0x7faf000c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 -- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf00073890 msgr2=0x7faf000728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf00073890 0x7faf000728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 -- 172.21.15.52:0/1659538127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf00071b00 con 0x7faf00145ed0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf04e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e50 tx=0x7faef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8036050 con 0x7faf00145ed0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8042070 con 0x7faf00145ed0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8009510 con 0x7faf00145ed0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf00071de0 con 0x7faf00145ed0 2024-09-10T08:32:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.892+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf00071440 con 0x7faf00145ed0 2024-09-10T08:32:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.893+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf00073500 con 0x7faf00145ed0 2024-09-10T08:32:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.894+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faef8007bd0 con 0x7faf00145ed0 2024-09-10T08:32:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.895+0000 7faefcc00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.895+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7faef80abcf0 con 0x7faf00145ed0 2024-09-10T08:32:56.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.896+0000 7faeffe00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:56.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.896+0000 7faeffe00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 0x7faedc06e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faef0006fd0 tx=0x7faef0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:56.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:56.900+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faef80b0070 con 0x7faf00145ed0 2024-09-10T08:32:57.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.121+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf00073220 con 0x7faf00145ed0 2024-09-10T08:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.122+0000 7faefcc00640 1 -- 172.21.15.52:0/1659538127 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7faef8079f60 con 0x7faf00145ed0 2024-09-10T08:32:57.122 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:57.122 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 msgr2=0x7faedc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 0x7faedc06e2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faef0006fd0 tx=0x7faef0009060 comp rx=0 tx=0).stop 2024-09-10T08:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 msgr2=0x7faf000cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e50 tx=0x7faef8004a40 comp rx=0 tx=0).stop 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 shutdown_connections 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf00145ed0 0x7faf000cc170 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf000b5880 0x7faf000c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 --2- 172.21.15.52:0/1659538127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf00073890 0x7faf000728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 >> 172.21.15.52:0/1659538127 conn(0x7faf000ccec0 msgr2=0x7faf00145130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 shutdown_connections 2024-09-10T08:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.124+0000 7faf06e00640 1 -- 172.21.15.52:0/1659538127 wait complete. 2024-09-10T08:32:57.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:32:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.299+0000 7fc23f200640 1 Processor -- start 2024-09-10T08:32:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.299+0000 7fc23f200640 1 -- start start 2024-09-10T08:32:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2400b6710 0x7fc2400d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2400cf450 0x7fc2400b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2400d3990 con 0x7fc24015e440 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400d3c70 con 0x7fc2400cf450 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400d3f50 con 0x7fc2400b6710 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2400cf450 0x7fc2400b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc2400cf450 0x7fc2400b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37592/0 (socket says 172.21.15.52:37592) 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc23e800640 1 -- 172.21.15.52:0/1685948574 learned_addr learned my addr 172.21.15.52:0/1685948574 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.300+0000 7fc237e00640 1 --2- 172.21.15.52:0/1685948574 >> v2:172.21.15.176:3300/0 conn(0x7fc2400b6710 0x7fc2400d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.301+0000 7fc23e800640 1 -- 172.21.15.52:0/1685948574 >> v2:172.21.15.176:3300/0 conn(0x7fc2400b6710 msgr2=0x7fc2400d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.301+0000 7fc23e800640 1 --2- 172.21.15.52:0/1685948574 >> v2:172.21.15.176:3300/0 conn(0x7fc2400b6710 0x7fc2400d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.301+0000 7fc23e800640 1 -- 172.21.15.52:0/1685948574 >> v1:172.21.15.176:6789/0 conn(0x7fc24015e440 legacy=0x7fc2400b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.301+0000 7fc23e800640 1 -- 172.21.15.52:0/1685948574 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400d4230 con 0x7fc2400cf450 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.302+0000 7fc23e800640 1 --2- 172.21.15.52:0/1685948574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400cf450 0x7fc2400b7b60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc2400d2480 tx=0x7fc23802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ed77f4930a2196 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.302+0000 7fc23d400640 1 -- 172.21.15.52:0/1685948574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238036070 con 0x7fc2400cf450 2024-09-10T08:32:57.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.302+0000 7fc23d400640 1 -- 172.21.15.52:0/1685948574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc238031600 con 0x7fc2400cf450 2024-09-10T08:32:57.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.302+0000 7fc23d400640 1 -- 172.21.15.52:0/1685948574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2380319f0 con 0x7fc2400cf450 2024-09-10T08:32:57.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 -- 172.21.15.52:0/1685948574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400cf450 msgr2=0x7fc2400b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 --2- 172.21.15.52:0/1685948574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400cf450 0x7fc2400b7b60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc2400d2480 tx=0x7fc23802a7c0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 -- 172.21.15.52:0/1685948574 shutdown_connections 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 --2- 172.21.15.52:0/1685948574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400cf450 0x7fc2400b7b60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 --2- 172.21.15.52:0/1685948574 >> v2:172.21.15.176:3300/0 conn(0x7fc2400b6710 0x7fc2400d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 -- 172.21.15.52:0/1685948574 >> 172.21.15.52:0/1685948574 conn(0x7fc240067f80 msgr2=0x7fc2400d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 -- 172.21.15.52:0/1685948574 shutdown_connections 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.303+0000 7fc23f200640 1 -- 172.21.15.52:0/1685948574 wait complete. 2024-09-10T08:32:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.304+0000 7fc23f200640 1 Processor -- start 2024-09-10T08:32:57.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.304+0000 7fc23f200640 1 -- start start 2024-09-10T08:32:57.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2400cf450 0x7fc2401f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 0x7fc2401e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400b76c0 con 0x7fc2400b6710 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400b7540 con 0x7fc24015e440 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.305+0000 7fc23f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400b80a0 con 0x7fc2400cf450 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37606/0 (socket says 172.21.15.52:37606) 2024-09-10T08:32:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 -- 172.21.15.52:0/1944489754 learned_addr learned my addr 172.21.15.52:0/1944489754 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23e800640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 0x7fc2401e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 -- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2400cf450 msgr2=0x7fc2401f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2400cf450 0x7fc2401f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 -- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 msgr2=0x7fc2401e5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 0x7fc2401e5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 -- 172.21.15.52:0/1944489754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2401e6500 con 0x7fc2400b6710 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23e800640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 0x7fc2401e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:57.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc23de00640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc23000c3c0 tx=0x7fc23000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.306+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2300052d0 con 0x7fc2400b6710 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.307+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc230005490 con 0x7fc2400b6710 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.307+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc230007260 con 0x7fc2400b6710 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.307+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2400cdd30 con 0x7fc2400b6710 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.307+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400ce2f0 con 0x7fc2400b6710 2024-09-10T08:32:57.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.308+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2400b3470 con 0x7fc2400b6710 2024-09-10T08:32:57.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.309+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc230007400 con 0x7fc2400b6710 2024-09-10T08:32:57.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.309+0000 7fc236000640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 0x7fc21c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.310+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7fc23008a420 con 0x7fc2400b6710 2024-09-10T08:32:57.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.310+0000 7fc237e00640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 0x7fc21c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.311+0000 7fc237e00640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 0x7fc21c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc228006a90 tx=0x7fc228006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.314+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2401e6500 con 0x7fc2400b6710 2024-09-10T08:32:57.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.537+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2400ce4f0 con 0x7fc2400b6710 2024-09-10T08:32:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.537+0000 7fc236000640 1 -- 172.21.15.52:0/1944489754 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5230 (secure 0 0 0) 0x7fc2400ce4f0 con 0x7fc2400b6710 2024-09-10T08:32:57.538 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:57.538 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":41,"btime":"2024-09-10T08:32:45:628233+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:32:24.581671+0000","modified":"2024-09-10T08:32:45.628228+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":64,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6405},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6405":{"gid":6405,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3318304686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3318304686},{"type":"v1","addr":"172.21.15.52:6835","nonce":3318304686}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6405,"qdb_cluster":[6405]},"id":4}]} 2024-09-10T08:32:57.538 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 41 2024-09-10T08:32:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 msgr2=0x7fc21c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 0x7fc21c06e2f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc228006a90 tx=0x7fc228006a20 comp rx=0 tx=0).stop 2024-09-10T08:32:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 msgr2=0x7fc2400cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc23000c3c0 tx=0x7fc23000c880 comp rx=0 tx=0).stop 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 shutdown_connections 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc21c06be30 0x7fc21c06e2f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc24015e440 0x7fc2401e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2400cf450 0x7fc2401f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 --2- 172.21.15.52:0/1944489754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2400b6710 0x7fc2400cd6a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 >> 172.21.15.52:0/1944489754 conn(0x7fc240067f80 msgr2=0x7fc2400b9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 shutdown_connections 2024-09-10T08:32:57.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.540+0000 7fc23f200640 1 -- 172.21.15.52:0/1944489754 wait complete. 2024-09-10T08:32:57.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:32:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.712+0000 7f4a6be00640 1 Processor -- start 2024-09-10T08:32:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.712+0000 7f4a6be00640 1 -- start start 2024-09-10T08:32:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a6c1522d0 0x7f4a6c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6c0b6660 con 0x7f4a6c15f5d0 2024-09-10T08:32:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6be00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6c15cce0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6be00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4a6c15ca90 con 0x7f4a6c1522d0 2024-09-10T08:32:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4a6c15f5d0 0x7f4a6c15d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56342/0 (socket says 172.21.15.52:56342) 2024-09-10T08:32:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6b400640 1 -- 172.21.15.52:0/4189205621 learned_addr learned my addr 172.21.15.52:0/4189205621 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.713+0000 7f4a6aa00640 1 --2- 172.21.15.52:0/4189205621 >> v2:172.21.15.176:3300/0 conn(0x7f4a6c1522d0 0x7f4a6c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409417684 0 0) 0x7f4a6c0b6660 con 0x7f4a6c15f5d0 2024-09-10T08:32:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a50003520 con 0x7f4a6c15f5d0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914435341 0 0) 0x7f4a6c15cce0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a6c0b6660 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6aa00640 1 -- 172.21.15.52:0/4189205621 >> v1:172.21.15.176:6789/0 conn(0x7f4a6c0b60e0 legacy=0x7f4a6c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6aa00640 1 -- 172.21.15.52:0/4189205621 >> v1:172.21.15.52:6789/0 conn(0x7f4a6c15f5d0 legacy=0x7f4a6c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.714+0000 7f4a6aa00640 1 -- 172.21.15.52:0/4189205621 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c15cfc0 con 0x7f4a6c1522d0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.715+0000 7f4a6aa00640 1 --2- 172.21.15.52:0/4189205621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c1522d0 0x7f4a6c0b5ba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0097a0 tx=0x7f4a5c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68549addf3b6116f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.715+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c037070 con 0x7f4a6c1522d0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.715+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c032440 con 0x7f4a6c1522d0 2024-09-10T08:32:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.715+0000 7f4a6a000640 1 -- 172.21.15.52:0/4189205621 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0327f0 con 0x7f4a6c1522d0 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 -- 172.21.15.52:0/4189205621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c1522d0 msgr2=0x7f4a6c0b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 --2- 172.21.15.52:0/4189205621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c1522d0 0x7f4a6c0b5ba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0097a0 tx=0x7f4a5c02a230 comp rx=0 tx=0).stop 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 -- 172.21.15.52:0/4189205621 shutdown_connections 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 --2- 172.21.15.52:0/4189205621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c1522d0 0x7f4a6c0b5ba0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 -- 172.21.15.52:0/4189205621 >> 172.21.15.52:0/4189205621 conn(0x7f4a6c06c240 msgr2=0x7f4a6c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 -- 172.21.15.52:0/4189205621 shutdown_connections 2024-09-10T08:32:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.716+0000 7f4a6be00640 1 -- 172.21.15.52:0/4189205621 wait complete. 2024-09-10T08:32:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.718+0000 7f4a6be00640 1 Processor -- start 2024-09-10T08:32:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.718+0000 7f4a6be00640 1 -- start start 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6c1522d0 0x7f4a6c1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c15f5d0 0x7f4a6c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1526b0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c15fc80 con 0x7f4a6c15f5d0 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6c152830 con 0x7f4a6c1522d0 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37620/0 (socket says 172.21.15.52:37620) 2024-09-10T08:32:57.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 -- 172.21.15.52:0/2092782870 learned_addr learned my addr 172.21.15.52:0/2092782870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:57.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 -- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6c1522d0 msgr2=0x7f4a6c1557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6c1522d0 0x7f4a6c1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 -- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c15f5d0 msgr2=0x7f4a6c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c15f5d0 0x7f4a6c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.719+0000 7f4a6aa00640 1 -- 172.21.15.52:0/2092782870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c071ad0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a6aa00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c037040 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c042070 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c032830 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c072850 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.720+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c072050 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.721+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6c0b5ba0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.722+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a5c0329d0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.723+0000 7f4a63400640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 0x7f4a4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:57.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.723+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7f4a5c0ab7b0 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.723+0000 7f4a62000640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 0x7f4a4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:57.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.724+0000 7f4a62000640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 0x7f4a4806e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a540011e0 tx=0x7f4a540078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:57.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.727+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a5c07a180 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.911+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a6c15e590 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.913+0000 7f4a63400640 1 -- 172.21.15.52:0/2092782870 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16866 (secure 0 0 0) 0x7f4a5c079a80 con 0x7f4a6c0b60e0 2024-09-10T08:32:57.913 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:32:57.913 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":65,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:32:41.612704+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:32:22.375699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-10T08:32:23.570054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/2886852302":"2024-09-11T08:32:41.603819+0000","172.21.15.52:6832/2886852302":"2024-09-11T08:32:41.603819+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 msgr2=0x7f4a4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 0x7f4a4806e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4a540011e0 tx=0x7f4a540078f0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 msgr2=0x7f4a6c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000c00 tx=0x7f4a5c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 shutdown_connections 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a4806be60 0x7f4a4806e320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a6c15f5d0 0x7f4a6c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a6c1522d0 0x7f4a6c1557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 --2- 172.21.15.52:0/2092782870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a6c0b60e0 0x7f4a6c155270 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:57.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 >> 172.21.15.52:0/2092782870 conn(0x7f4a6c06c240 msgr2=0x7f4a6c1594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:57.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 shutdown_connections 2024-09-10T08:32:57.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:57.915+0000 7f4a6be00640 1 -- 172.21.15.52:0/2092782870 wait complete. 2024-09-10T08:32:57.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:32:58.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.088+0000 7fdb6fe00640 1 Processor -- start 2024-09-10T08:32:58.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.088+0000 7fdb6fe00640 1 -- start start 2024-09-10T08:32:58.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb7015e440 0x7fdb700d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b6710 0x7fdb700b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb700d3990 con 0x7fdb700cf450 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb700d3c70 con 0x7fdb7015e440 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700d3f50 con 0x7fdb700b6710 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb7015e440 0x7fdb700d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb7015e440 0x7fdb700d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37636/0 (socket says 172.21.15.52:37636) 2024-09-10T08:32:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.089+0000 7fdb6ea00640 1 -- 172.21.15.52:0/1422514631 learned_addr learned my addr 172.21.15.52:0/1422514631 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.090+0000 7fdb6f400640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b6710 0x7fdb700b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.090+0000 7fdb6ea00640 1 -- 172.21.15.52:0/1422514631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b6710 msgr2=0x7fdb700b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.090+0000 7fdb6ea00640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b6710 0x7fdb700b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.090+0000 7fdb6ea00640 1 -- 172.21.15.52:0/1422514631 >> v1:172.21.15.52:6789/0 conn(0x7fdb700cf450 legacy=0x7fdb700b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.090+0000 7fdb6ea00640 1 -- 172.21.15.52:0/1422514631 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700d4230 con 0x7fdb7015e440 2024-09-10T08:32:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.091+0000 7fdb6ea00640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb700d3240 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb6002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3c2019a1d21a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.091+0000 7fdb6d600640 1 -- 172.21.15.52:0/1422514631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60037070 con 0x7fdb7015e440 2024-09-10T08:32:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.091+0000 7fdb6d600640 1 -- 172.21.15.52:0/1422514631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6002ae50 con 0x7fdb7015e440 2024-09-10T08:32:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.091+0000 7fdb6d600640 1 -- 172.21.15.52:0/1422514631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60032860 con 0x7fdb7015e440 2024-09-10T08:32:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 -- 172.21.15.52:0/1422514631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 msgr2=0x7fdb700d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb700d3240 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009870 tx=0x7fdb6002a300 comp rx=0 tx=0).stop 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 -- 172.21.15.52:0/1422514631 shutdown_connections 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700b6710 0x7fdb700b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/1422514631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb700d3240 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 -- 172.21.15.52:0/1422514631 >> 172.21.15.52:0/1422514631 conn(0x7fdb70067f80 msgr2=0x7fdb700d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 -- 172.21.15.52:0/1422514631 shutdown_connections 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.092+0000 7fdb6fe00640 1 -- 172.21.15.52:0/1422514631 wait complete. 2024-09-10T08:32:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.093+0000 7fdb6fe00640 1 Processor -- start 2024-09-10T08:32:58.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.094+0000 7fdb6fe00640 1 -- start start 2024-09-10T08:32:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb700b6710 0x7fdb7014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700cf450 0x7fdb70160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b76c0 con 0x7fdb7015e440 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b7540 con 0x7fdb700b6710 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700b80a0 con 0x7fdb700cf450 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37642/0 (socket says 172.21.15.52:37642) 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 -- 172.21.15.52:0/3377332840 learned_addr learned my addr 172.21.15.52:0/3377332840 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6ea00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb700b6710 0x7fdb7014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6e000640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700cf450 0x7fdb70160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 -- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700cf450 msgr2=0x7fdb70160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700cf450 0x7fdb70160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 -- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb700b6710 msgr2=0x7fdb7014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb700b6710 0x7fdb7014fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.095+0000 7fdb6f400640 1 -- 172.21.15.52:0/3377332840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700c9d60 con 0x7fdb7015e440 2024-09-10T08:32:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb6f400640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fdb68007e40 tx=0x7fdb6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68014620 con 0x7fdb7015e440 2024-09-10T08:32:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb68019070 con 0x7fdb7015e440 2024-09-10T08:32:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68014a20 con 0x7fdb7015e440 2024-09-10T08:32:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb700c8cc0 con 0x7fdb7015e440 2024-09-10T08:32:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.096+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb700c9280 con 0x7fdb7015e440 2024-09-10T08:32:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.097+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb700b7b60 con 0x7fdb7015e440 2024-09-10T08:32:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.098+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb68014bc0 con 0x7fdb7015e440 2024-09-10T08:32:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.099+0000 7fdb66a00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.100+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5795+0+0 (secure 0 0 0) 0x7fdb6808b640 con 0x7fdb7015e440 2024-09-10T08:32:58.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.100+0000 7fdb6ea00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.101+0000 7fdb6ea00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 0x7fdb5006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb60034000 tx=0x7fdb6002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.104+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb68059930 con 0x7fdb7015e440 2024-09-10T08:32:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.326+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdb700d33e0 con 0x7fdb7015e440 2024-09-10T08:32:58.326 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:32:58.326+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:32:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.328+0000 7fdb66a00640 1 -- 172.21.15.52:0/3377332840 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7fdb6805dc30 con 0x7fdb7015e440 2024-09-10T08:32:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:32:58.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 msgr2=0x7fdb5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 0x7fdb5006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb60034000 tx=0x7fdb6002e000 comp rx=0 tx=0).stop 2024-09-10T08:32:58.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 msgr2=0x7fdb70161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fdb68007e40 tx=0x7fdb6800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 shutdown_connections 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb5006be30 0x7fdb5006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb7015e440 0x7fdb70161380 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb700cf450 0x7fdb70160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 --2- 172.21.15.52:0/3377332840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb700b6710 0x7fdb7014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 >> 172.21.15.52:0/3377332840 conn(0x7fdb70067f80 msgr2=0x7fdb700d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 shutdown_connections 2024-09-10T08:32:58.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.332+0000 7fdb6fe00640 1 -- 172.21.15.52:0/3377332840 wait complete. 2024-09-10T08:32:58.338 INFO:tasks.ceph.mds.c.smithi052.stderr: -2160> 2024-09-10T08:32:47.623+0000 7fc6d2200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:32:58.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:32:58.385 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:32:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.509+0000 7fc1ec400640 1 Processor -- start 2024-09-10T08:32:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.509+0000 7fc1ec400640 1 -- start start 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ec400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e4144340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ec400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1e4071650 0x7fc1e4144880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ec400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e415f120 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ec400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e4141cd0 con 0x7fc1e4071650 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ec400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e415f400 con 0x7fc1e40cfcb0 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1e4071650 0x7fc1e4144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1e9a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc1e40cf8d0 0x7fc1e4070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56362/0 (socket says 172.21.15.52:56362) 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1e4071650 0x7fc1e4144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37660/0 (socket says 172.21.15.52:37660) 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1e9a00640 1 -- 172.21.15.52:0/3302865979 learned_addr learned my addr 172.21.15.52:0/3302865979 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:32:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1e9000640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e4144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 -- 172.21.15.52:0/3302865979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 msgr2=0x7fc1e4144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e4144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 -- 172.21.15.52:0/3302865979 >> v1:172.21.15.52:6789/0 conn(0x7fc1e40cf8d0 legacy=0x7fc1e4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1ea400640 1 -- 172.21.15.52:0/3302865979 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e415f6e0 con 0x7fc1e4071650 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.511+0000 7fc1e3e00640 1 -- 172.21.15.52:0/3302865979 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621009464 0 0) 0x7fc1e415f120 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.512+0000 7fc1ea400640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e4071650 0x7fc1e4144880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009d90 tx=0x7fc1dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d406d6e249f36ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1e3e00640 1 -- 172.21.15.52:0/3302865979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc007740 con 0x7fc1e4071650 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1e3e00640 1 -- 172.21.15.52:0/3302865979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0078e0 con 0x7fc1e4071650 2024-09-10T08:32:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1e3e00640 1 -- 172.21.15.52:0/3302865979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc007cb0 con 0x7fc1e4071650 2024-09-10T08:32:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 -- 172.21.15.52:0/3302865979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e4071650 msgr2=0x7fc1e4144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e4071650 0x7fc1e4144880 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009d90 tx=0x7fc1dc02a660 comp rx=0 tx=0).stop 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 -- 172.21.15.52:0/3302865979 shutdown_connections 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e4071650 0x7fc1e4144880 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 --2- 172.21.15.52:0/3302865979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e4144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 -- 172.21.15.52:0/3302865979 >> 172.21.15.52:0/3302865979 conn(0x7fc1e406d0f0 msgr2=0x7fc1e406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 -- 172.21.15.52:0/3302865979 shutdown_connections 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.513+0000 7fc1ec400640 1 -- 172.21.15.52:0/3302865979 wait complete. 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.515+0000 7fc1ec400640 1 Processor -- start 2024-09-10T08:32:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.515+0000 7fc1ec400640 1 -- start start 2024-09-10T08:32:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e4071650 0x7fc1e40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e40c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e415ee30 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4144dc0 con 0x7fc1e4071650 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ec400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e40ce0f0 con 0x7fc1e40cfcb0 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37676/0 (socket says 172.21.15.52:37676) 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 -- 172.21.15.52:0/4214421379 learned_addr learned my addr 172.21.15.52:0/4214421379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1ea400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e40c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9a00640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e4071650 0x7fc1e40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 -- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 msgr2=0x7fc1e40c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e40c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 -- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e4071650 msgr2=0x7fc1e40cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e4071650 0x7fc1e40cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.516+0000 7fc1e9000640 1 -- 172.21.15.52:0/4214421379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4159090 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1e9000640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000d800 tx=0x7fc1d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000b6c0 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0019070 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000ba80 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e40c9e10 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.517+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e40ca390 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.518+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4070f40 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.519+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1d000bc20 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.520+0000 7fc1e1600640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:58.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.520+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5881+0+0 (secure 0 0 0) 0x7fc1d008b410 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.521+0000 7fc1e9a00640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.521+0000 7fc1e9a00640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 0x7fc1c406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8000f60 tx=0x7fc1d8007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.525+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1e4159090 con 0x7fc1e40cf8d0 2024-09-10T08:32:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:58.745+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc1e406f260 con 0x7fc1e40cf8d0 2024-09-10T08:32:59.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.330+0000 7fc1e1600640 1 -- 172.21.15.52:0/4214421379 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fc1d001c360 con 0x7fc1e40cf8d0 2024-09-10T08:32:59.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 msgr2=0x7fc1c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:59.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 0x7fc1c406e2f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8000f60 tx=0x7fc1d8007b50 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 msgr2=0x7fc1e4158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000d800 tx=0x7fc1d000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 shutdown_connections 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1e40cfcb0 0x7fc1e40c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1e40cf8d0 0x7fc1e4158b50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 --2- 172.21.15.52:0/4214421379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1e4071650 0x7fc1e40cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 >> 172.21.15.52:0/4214421379 conn(0x7fc1e406d0f0 msgr2=0x7fc1e40b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 shutdown_connections 2024-09-10T08:32:59.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.333+0000 7fc1ec400640 1 -- 172.21.15.52:0/4214421379 wait complete. 2024-09-10T08:32:59.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:32:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.558+0000 7f0d6a000640 1 Processor -- start 2024-09-10T08:32:59.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.558+0000 7f0d6a000640 1 -- start start 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d64155b20 0x7f0d640b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 0x7f0d640cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0d640cf960 0x7f0d6415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0d640b2600 con 0x7f0d64155b20 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0d640b01e0 con 0x7f0d640cf960 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.559+0000 7f0d6a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d640b0680 con 0x7f0d640b21a0 2024-09-10T08:32:59.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d64155b20 0x7f0d640b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d64155b20 0x7f0d640b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37690/0 (socket says 172.21.15.52:37690) 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 -- 172.21.15.52:0/2009671794 learned_addr learned my addr 172.21.15.52:0/2009671794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63e00640 1 --2- 172.21.15.52:0/2009671794 >> v2:172.21.15.176:3300/0 conn(0x7f0d640cf960 0x7f0d6415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d62a00640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 0x7f0d640cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 -- 172.21.15.52:0/2009671794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 msgr2=0x7f0d640cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 0x7f0d640cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 -- 172.21.15.52:0/2009671794 >> v2:172.21.15.176:3300/0 conn(0x7f0d640cf960 msgr2=0x7f0d6415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 --2- 172.21.15.52:0/2009671794 >> v2:172.21.15.176:3300/0 conn(0x7f0d640cf960 0x7f0d6415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d63400640 1 -- 172.21.15.52:0/2009671794 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d640ccf70 con 0x7f0d64155b20 2024-09-10T08:32:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.560+0000 7f0d62a00640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 0x7f0d640cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:32:59.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.561+0000 7f0d63400640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d64155b20 0x7f0d640b1c60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0d6415eeb0 tx=0x7f0d5402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af38cbbcb6aed95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:59.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.561+0000 7f0d62000640 1 -- 172.21.15.52:0/2009671794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54037070 con 0x7f0d64155b20 2024-09-10T08:32:59.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d62000640 1 -- 172.21.15.52:0/2009671794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d54032440 con 0x7f0d64155b20 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d62000640 1 -- 172.21.15.52:0/2009671794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54032810 con 0x7f0d64155b20 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 -- 172.21.15.52:0/2009671794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d64155b20 msgr2=0x7f0d640b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d64155b20 0x7f0d640b1c60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0d6415eeb0 tx=0x7f0d5402a210 comp rx=0 tx=0).stop 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 -- 172.21.15.52:0/2009671794 shutdown_connections 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2009671794 >> v2:172.21.15.176:3300/0 conn(0x7f0d640cf960 0x7f0d6415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640b21a0 0x7f0d640cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2009671794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d64155b20 0x7f0d640b1c60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 -- 172.21.15.52:0/2009671794 >> 172.21.15.52:0/2009671794 conn(0x7f0d6406c240 msgr2=0x7f0d6406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 -- 172.21.15.52:0/2009671794 shutdown_connections 2024-09-10T08:32:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.562+0000 7f0d6a000640 1 -- 172.21.15.52:0/2009671794 wait complete. 2024-09-10T08:32:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.564+0000 7f0d6a000640 1 Processor -- start 2024-09-10T08:32:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.564+0000 7f0d6a000640 1 -- start start 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640cf960 0x7f0d64157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d64155b20 0x7f0d640ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d640cef00 con 0x7f0d640b21a0 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d640cec20 con 0x7f0d64155b20 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d6a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0d640cfdb0 con 0x7f0d640cf960 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d63400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d63400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37706/0 (socket says 172.21.15.52:37706) 2024-09-10T08:32:59.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d63400640 1 -- 172.21.15.52:0/2362193143 learned_addr learned my addr 172.21.15.52:0/2362193143 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d62a00640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640cf960 0x7f0d64157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.565+0000 7f0d63e00640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d64155b20 0x7f0d640ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 -- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640cf960 msgr2=0x7f0d64157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640cf960 0x7f0d64157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 -- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d64155b20 msgr2=0x7f0d640ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d64155b20 0x7f0d640ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 -- 172.21.15.52:0/2362193143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d64156390 con 0x7f0d640b21a0 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d63400640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54041020 con 0x7f0d640b21a0 2024-09-10T08:32:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d540306c0 con 0x7f0d640b21a0 2024-09-10T08:32:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54037040 con 0x7f0d640b21a0 2024-09-10T08:32:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.566+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d64156670 con 0x7f0d640b21a0 2024-09-10T08:32:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.567+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d64156c30 con 0x7f0d640b21a0 2024-09-10T08:32:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.568+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d640ce610 con 0x7f0d640b21a0 2024-09-10T08:32:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.568+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d54044020 con 0x7f0d640b21a0 2024-09-10T08:32:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.569+0000 7f0d5b400640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 0x7f0d4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:32:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.569+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5881+0+0 (secure 0 0 0) 0x7f0d540ab740 con 0x7f0d640b21a0 2024-09-10T08:32:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.570+0000 7f0d62a00640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 0x7f0d4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:32:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.570+0000 7f0d62a00640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 0x7f0d4406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d641f77b0 tx=0x7f0d50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:32:59.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.574+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d5404b030 con 0x7f0d640b21a0 2024-09-10T08:32:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:32:59.763+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d640b0930 con 0x7f0d640b21a0 2024-09-10T08:33:00.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.335+0000 7f0d5b400640 1 -- 172.21.15.52:0/2362193143 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) ==== 181+0+0 (secure 0 0 0) 0x7f0d540798c0 con 0x7f0d640b21a0 2024-09-10T08:33:00.335 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:33:00.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 msgr2=0x7f0d4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 0x7f0d4406e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0d641f77b0 tx=0x7f0d50008040 comp rx=0 tx=0).stop 2024-09-10T08:33:00.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 msgr2=0x7f0d64149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0d54000c00 tx=0x7f0d540046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 shutdown_connections 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.338+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0d4406be30 0x7f0d4406e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d64155b20 0x7f0d640ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d640cf960 0x7f0d64157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 --2- 172.21.15.52:0/2362193143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d640b21a0 0x7f0d64149d80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 >> 172.21.15.52:0/2362193143 conn(0x7f0d6406c240 msgr2=0x7f0d6415add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:00.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 shutdown_connections 2024-09-10T08:33:00.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.339+0000 7f0d6a000640 1 -- 172.21.15.52:0/2362193143 wait complete. 2024-09-10T08:33:00.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:33:00.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.523+0000 7f10cda00640 1 Processor -- start 2024-09-10T08:33:00.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.523+0000 7f10cda00640 1 -- start start 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.524+0000 7f10cda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80b3e60 0x7f10c80d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.524+0000 7f10cda00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10c80d1080 0x7f10c806e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.524+0000 7f10cda00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c80d09b0 con 0x7f10c815b510 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.524+0000 7f10cda00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f10c80d0c90 con 0x7f10c80d1080 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.524+0000 7f10cda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10c80b3520 con 0x7f10c80b3e60 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c6a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f10c815b510 0x7f10c80b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56376/0 (socket says 172.21.15.52:56376) 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c6a00640 1 -- 172.21.15.52:0/259010497 learned_addr learned my addr 172.21.15.52:0/259010497 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c7400640 1 --2- 172.21.15.52:0/259010497 >> v2:172.21.15.52:3300/0 conn(0x7f10c80d1080 0x7f10c806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10bfe00640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80b3e60 0x7f10c80d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c6000640 1 -- 172.21.15.52:0/259010497 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359085233 0 0) 0x7f10c80d09b0 con 0x7f10c815b510 2024-09-10T08:33:00.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c6000640 1 -- 172.21.15.52:0/259010497 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10ac003520 con 0x7f10c815b510 2024-09-10T08:33:00.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c7400640 1 -- 172.21.15.52:0/259010497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80b3e60 msgr2=0x7f10c80d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:00.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c7400640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80b3e60 0x7f10c80d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c7400640 1 -- 172.21.15.52:0/259010497 >> v1:172.21.15.52:6789/0 conn(0x7f10c815b510 legacy=0x7f10c80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.525+0000 7f10c7400640 1 -- 172.21.15.52:0/259010497 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c80b1820 con 0x7f10c80d1080 2024-09-10T08:33:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.526+0000 7f10c7400640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c80d1080 0x7f10c806e200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541d624259c7cb9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10c6000640 1 -- 172.21.15.52:0/259010497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031600 con 0x7f10c80d1080 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10c6000640 1 -- 172.21.15.52:0/259010497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c00317a0 con 0x7f10c80d1080 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10c6000640 1 -- 172.21.15.52:0/259010497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0031b70 con 0x7f10c80d1080 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 -- 172.21.15.52:0/259010497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c80d1080 msgr2=0x7f10c806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c80d1080 0x7f10c806e200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009d90 tx=0x7f10c002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 -- 172.21.15.52:0/259010497 shutdown_connections 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c80d1080 0x7f10c806e200 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 --2- 172.21.15.52:0/259010497 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80b3e60 0x7f10c80d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 -- 172.21.15.52:0/259010497 >> 172.21.15.52:0/259010497 conn(0x7f10c8067da0 msgr2=0x7f10c806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 -- 172.21.15.52:0/259010497 shutdown_connections 2024-09-10T08:33:00.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.527+0000 7f10cda00640 1 -- 172.21.15.52:0/259010497 wait complete. 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.529+0000 7f10cda00640 1 Processor -- start 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.529+0000 7f10cda00640 1 -- start start 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 0x7f10c80afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80d1080 0x7f10c8146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80b1de0 con 0x7f10c815b510 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80d1490 con 0x7f10c80b3e60 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10cda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10c815b8f0 con 0x7f10c80d1080 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37728/0 (socket says 172.21.15.52:37728) 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10c7400640 1 -- 172.21.15.52:0/557388148 learned_addr learned my addr 172.21.15.52:0/557388148 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.530+0000 7f10bfe00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80d1080 0x7f10c8146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c6a00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 0x7f10c80afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 -- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80d1080 msgr2=0x7f10c8146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80d1080 0x7f10c8146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 -- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 msgr2=0x7f10c80afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 0x7f10c80afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 -- 172.21.15.52:0/557388148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c815db30 con 0x7f10c815b510 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c6a00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 0x7f10c80afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:00.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10c7400640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009eb0 tx=0x7f10c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0040070 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c0030b60 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c815ddb0 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.531+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0009450 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.532+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c815e650 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.533+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c80d03b0 con 0x7f10c815b510 2024-09-10T08:33:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.533+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10c0039040 con 0x7f10c815b510 2024-09-10T08:33:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.535+0000 7f10bea00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 0x7f10a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.535+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5443+0+0 (secure 0 0 0) 0x7f10c00ac420 con 0x7f10c815b510 2024-09-10T08:33:00.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.535+0000 7f10c6a00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 0x7f10a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.536+0000 7f10c6a00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 0x7f10a406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007fd0 tx=0x7f10b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:00.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.540+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10c815db30 con 0x7f10c815b510 2024-09-10T08:33:00.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:00.731+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10c80b0780 con 0x7f10c815b510 2024-09-10T08:33:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.337+0000 7f10bea00640 1 -- 172.21.15.52:0/557388148 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) ==== 169+0+0 (secure 0 0 0) 0x7f10c007ae30 con 0x7f10c815b510 2024-09-10T08:33:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:33:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 msgr2=0x7f10a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 0x7f10a406e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007fd0 tx=0x7f10b8009040 comp rx=0 tx=0).stop 2024-09-10T08:33:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 msgr2=0x7f10c8156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009eb0 tx=0x7f10c0004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 shutdown_connections 2024-09-10T08:33:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f10a406be30 0x7f10a406e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10c815b510 0x7f10c8156360 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10c80d1080 0x7f10c8146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 --2- 172.21.15.52:0/557388148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10c80b3e60 0x7f10c80afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.340+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 >> 172.21.15.52:0/557388148 conn(0x7f10c8067da0 msgr2=0x7f10c806e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.341+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 shutdown_connections 2024-09-10T08:33:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.341+0000 7f10cda00640 1 -- 172.21.15.52:0/557388148 wait complete. 2024-09-10T08:33:01.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-10T08:33:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.525+0000 7fa6f2a00640 1 Processor -- start 2024-09-10T08:33:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.525+0000 7fa6f2a00640 1 -- start start 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.526+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6ec0d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.526+0000 7fa6f2a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa6ec0b63b0 0x7fa6ec0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.526+0000 7fa6f2a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ec0d3950 con 0x7fa6ec067950 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.526+0000 7fa6f2a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa6ec0d3c30 con 0x7fa6ec0b63b0 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.526+0000 7fa6f2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ec0d3f10 con 0x7fa6ec0b5fd0 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6f2000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa6ec067950 0x7fa6ec067e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56384/0 (socket says 172.21.15.52:56384) 2024-09-10T08:33:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6f2000640 1 -- 172.21.15.52:0/503508853 learned_addr learned my addr 172.21.15.52:0/503508853 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6f1600640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6ec0d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/503508853 >> v2:172.21.15.176:3300/0 conn(0x7fa6ec0b63b0 0x7fa6ec0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 553472958 0 0) 0x7fa6ec0d3950 con 0x7fa6ec067950 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6d4003520 con 0x7fa6ec067950 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.527+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3245973721 0 0) 0x7fa6d4003520 con 0x7fa6ec067950 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 msgr2=0x7fa6ec0d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6ec0d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 >> v2:172.21.15.176:3300/0 conn(0x7fa6ec0b63b0 msgr2=0x7fa6ec0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 --2- 172.21.15.52:0/503508853 >> v2:172.21.15.176:3300/0 conn(0x7fa6ec0b63b0 0x7fa6ec0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec0d41f0 con 0x7fa6ec067950 2024-09-10T08:33:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fa6e40019f0 con 0x7fa6ec067950 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/503508853 >> v2:172.21.15.176:3300/0 conn(0x7fa6ec0b63b0 0x7fa6ec0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 >> v1:172.21.15.52:6789/0 conn(0x7fa6ec067950 legacy=0x7fa6ec067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4003f30 0x7fa6d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d4004d40 0x7fa6d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0d3c30 con 0x7fa6d4004d40 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0d3f10 con 0x7fa6d4003f30 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d400b9f0 con 0x7fa6ec0b5fd0 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f1600640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d4004d40 0x7fa6d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4003f30 0x7fa6d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 -- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 msgr2=0x7fa6d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0b5fd0 0x7fa6d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 -- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4003f30 msgr2=0x7fa6d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4003f30 0x7fa6d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.528+0000 7fa6f2000640 1 -- 172.21.15.52:0/503508853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d4003520 con 0x7fa6d4004d40 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.529+0000 7fa6f2000640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d4004d40 0x7fa6d40051c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400a8a0 tx=0x7fa6d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5ee8aae481806e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400a4c0 con 0x7fa6d4004d40 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e402f070 con 0x7fa6d4004d40 2024-09-10T08:33:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6ebe00640 1 -- 172.21.15.52:0/503508853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e402bd70 con 0x7fa6d4004d40 2024-09-10T08:33:01.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 -- 172.21.15.52:0/503508853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d4004d40 msgr2=0x7fa6d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/503508853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d4004d40 0x7fa6d40051c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400a8a0 tx=0x7fa6d4005830 comp rx=0 tx=0).stop 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2000640 1 -- 172.21.15.52:0/503508853 reap_dead start 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 -- 172.21.15.52:0/503508853 shutdown_connections 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 -- 172.21.15.52:0/503508853 >> 172.21.15.52:0/503508853 conn(0x7fa6ec0d0fd0 msgr2=0x7fa6ec0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 -- 172.21.15.52:0/503508853 shutdown_connections 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.530+0000 7fa6f2a00640 1 -- 172.21.15.52:0/503508853 wait complete. 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.532+0000 7fa6f2a00640 1 Processor -- start 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.532+0000 7fa6f2a00640 1 -- start start 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4004d40 0x7fa6ec14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0ccbb0 0x7fa6ec0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0cfd10 con 0x7fa6ec14b070 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec0cfb90 con 0x7fa6d4004d40 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ec0b67d0 con 0x7fa6ec0ccbb0 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37744/0 (socket says 172.21.15.52:37744) 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.533+0000 7fa6f0c00640 1 -- 172.21.15.52:0/2885168554 learned_addr learned my addr 172.21.15.52:0/2885168554 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f1600640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4004d40 0x7fa6ec14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f2000640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0ccbb0 0x7fa6ec0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 -- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0ccbb0 msgr2=0x7fa6ec0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0ccbb0 0x7fa6ec0aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 -- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4004d40 msgr2=0x7fa6ec14d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4004d40 0x7fa6ec14d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 -- 172.21.15.52:0/2885168554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec0cd130 con 0x7fa6ec14b070 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6f0c00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8011cd0 tx=0x7fa6d800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d800fcc0 con 0x7fa6ec14b070 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d800fe60 con 0x7fa6ec14b070 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.534+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8014680 con 0x7fa6ec14b070 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.535+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec0cd410 con 0x7fa6ec14b070 2024-09-10T08:33:01.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.535+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec0cd9d0 con 0x7fa6ec14b070 2024-09-10T08:33:01.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.536+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec15e7f0 con 0x7fa6ec14b070 2024-09-10T08:33:01.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.537+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6d8012040 con 0x7fa6ec14b070 2024-09-10T08:33:01.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.537+0000 7fa6e9600640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 0x7fa6cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.538+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7fa6d808b2f0 con 0x7fa6ec14b070 2024-09-10T08:33:01.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.538+0000 7fa6f1600640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 0x7fa6cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.539+0000 7fa6f1600640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 0x7fa6cc06e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009bc0 tx=0x7fa6e0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.542+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6d8019030 con 0x7fa6ec14b070 2024-09-10T08:33:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.734+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7fa6ec0b7e90 con 0x7fa6ec14b070 2024-09-10T08:33:01.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.738+0000 7fa6e9600640 1 -- 172.21.15.52:0/2885168554 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7fa6d8059f30 con 0x7fa6ec14b070 2024-09-10T08:33:01.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 msgr2=0x7fa6cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 0x7fa6cc06e320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009bc0 tx=0x7fa6e0009190 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 msgr2=0x7fa6ec0cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8011cd0 tx=0x7fa6d800f610 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 shutdown_connections 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa6cc06be60 0x7fa6cc06e320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa6ec0ccbb0 0x7fa6ec0aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6ec14b070 0x7fa6ec0cc670 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 --2- 172.21.15.52:0/2885168554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa6d4004d40 0x7fa6ec14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 >> 172.21.15.52:0/2885168554 conn(0x7fa6ec0d0fd0 msgr2=0x7fa6ec0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 shutdown_connections 2024-09-10T08:33:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.740+0000 7fa6f2a00640 1 -- 172.21.15.52:0/2885168554 wait complete. 2024-09-10T08:33:01.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-10T08:33:01.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.913+0000 7f95e6400640 1 Processor -- start 2024-09-10T08:33:01.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.913+0000 7f95e6400640 1 -- start start 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 0x7f95e00736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95e00cce30 0x7f95e00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e00720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f95e00714b0 con 0x7f95e00cce30 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f95e0073c00 con 0x7f95e00732e0 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95e6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95e00cd880 con 0x7f95e0071c70 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95e00cce30 0x7f95e00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95e00cce30 0x7f95e00cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37754/0 (socket says 172.21.15.52:37754) 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 -- 172.21.15.52:0/73864847 learned_addr learned my addr 172.21.15.52:0/73864847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95dfe00640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e00720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95df400640 1 --2- 172.21.15.52:0/73864847 >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 0x7f95e00736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 -- 172.21.15.52:0/73864847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 msgr2=0x7f95e00720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e00720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 -- 172.21.15.52:0/73864847 >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 msgr2=0x7f95e00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 --2- 172.21.15.52:0/73864847 >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 0x7f95e00736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95d7e00640 1 -- 172.21.15.52:0/73864847 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e00cdb60 con 0x7f95e00cce30 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95dfe00640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e00720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.915+0000 7f95df400640 1 --2- 172.21.15.52:0/73864847 >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 0x7f95e00736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.916+0000 7f95d7e00640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e00cd2a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f95e00b6780 tx=0x7f95c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed953692881283af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95dea00640 1 -- 172.21.15.52:0/73864847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8037070 con 0x7f95e00cce30 2024-09-10T08:33:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95dea00640 1 -- 172.21.15.52:0/73864847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c8032440 con 0x7f95e00cce30 2024-09-10T08:33:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95dea00640 1 -- 172.21.15.52:0/73864847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8032810 con 0x7f95e00cce30 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 -- 172.21.15.52:0/73864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 msgr2=0x7f95e00cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e00cd2a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f95e00b6780 tx=0x7f95c802a140 comp rx=0 tx=0).stop 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 -- 172.21.15.52:0/73864847 shutdown_connections 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e00720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 --2- 172.21.15.52:0/73864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e00cd2a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 --2- 172.21.15.52:0/73864847 >> v2:172.21.15.176:3300/0 conn(0x7f95e00732e0 0x7f95e00736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 -- 172.21.15.52:0/73864847 >> 172.21.15.52:0/73864847 conn(0x7f95e006d0f0 msgr2=0x7f95e006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 -- 172.21.15.52:0/73864847 shutdown_connections 2024-09-10T08:33:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.917+0000 7f95e6400640 1 -- 172.21.15.52:0/73864847 wait complete. 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.919+0000 7f95e6400640 1 Processor -- start 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.919+0000 7f95e6400640 1 -- start start 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e0148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95e00732e0 0x7f95e01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95e006bf70 con 0x7f95e00cce30 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95e006bdf0 con 0x7f95e00732e0 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95e6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95e015c8d0 con 0x7f95e0071c70 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95dfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37764/0 (socket says 172.21.15.52:37764) 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95dfe00640 1 -- 172.21.15.52:0/3732960579 learned_addr learned my addr 172.21.15.52:0/3732960579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:01.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.920+0000 7f95d7e00640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95e00732e0 0x7f95e01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95df400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e0148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 -- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 msgr2=0x7f95e0148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e0148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 -- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95e00732e0 msgr2=0x7f95e01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95e00732e0 0x7f95e01594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 -- 172.21.15.52:0/3732960579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e0158470 con 0x7f95e00cce30 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95dfe00640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f95d8007e10 tx=0x7f95d800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d801a070 con 0x7f95e00cce30 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8003b90 con 0x7f95e00cce30 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.921+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8004030 con 0x7f95e00cce30 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.922+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e0158710 con 0x7f95e00cce30 2024-09-10T08:33:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.922+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e0158cd0 con 0x7f95e00cce30 2024-09-10T08:33:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.923+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e00736c0 con 0x7f95e00cce30 2024-09-10T08:33:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.923+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f95d801d070 con 0x7f95e00cce30 2024-09-10T08:33:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.924+0000 7f95d7400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 0x7f95bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.924+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f95d808ade0 con 0x7f95e00cce30 2024-09-10T08:33:01.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.925+0000 7f95df400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 0x7f95bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:01.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.926+0000 7f95df400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 0x7f95bc06e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006fd0 tx=0x7f95d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:01.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:01.929+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95d8010070 con 0x7f95e00cce30 2024-09-10T08:33:02.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.113+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f95e015d1c0 con 0x7f95e00cce30 2024-09-10T08:33:02.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.116+0000 7f95d7400640 1 -- 172.21.15.52:0/3732960579 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v21) ==== 101+0+0 (secure 0 0 0) 0x7f95d80593d0 con 0x7f95e00cce30 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 msgr2=0x7f95bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 0x7f95bc06e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006fd0 tx=0x7f95d0008040 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 msgr2=0x7f95e0144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f95d8007e10 tx=0x7f95d800d4a0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 shutdown_connections 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f95bc06be30 0x7f95bc06e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e00cce30 0x7f95e0144d50 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95e00732e0 0x7f95e01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 --2- 172.21.15.52:0/3732960579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95e0071c70 0x7f95e0148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 >> 172.21.15.52:0/3732960579 conn(0x7f95e006d0f0 msgr2=0x7f95e00cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 shutdown_connections 2024-09-10T08:33:02.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.119+0000 7f95e6400640 1 -- 172.21.15.52:0/3732960579 wait complete. 2024-09-10T08:33:02.135 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-10T08:33:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.292+0000 7fb515600640 1 Processor -- start 2024-09-10T08:33:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.292+0000 7fb515600640 1 -- start start 2024-09-10T08:33:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb515600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 0x7fb51015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb515600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5100cef10 con 0x7fb5100d1a80 2024-09-10T08:33:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb515600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51015fc10 con 0x7fb51015c570 2024-09-10T08:33:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb515600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5100cf1d0 con 0x7fb5100d1e60 2024-09-10T08:33:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb50ea00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb5100d1a80 0x7fb51015be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56392/0 (socket says 172.21.15.52:56392) 2024-09-10T08:33:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb50ea00640 1 -- 172.21.15.52:0/4127961546 learned_addr learned my addr 172.21.15.52:0/4127961546 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.293+0000 7fb50f400640 1 --2- 172.21.15.52:0/4127961546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 0x7fb51015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900041393 0 0) 0x7fb5100cef10 con 0x7fb5100d1a80 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f4003520 con 0x7fb5100d1a80 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697865935 0 0) 0x7fb51015fc10 con 0x7fb51015c570 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5100cef10 con 0x7fb51015c570 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50f400640 1 -- 172.21.15.52:0/4127961546 >> v1:172.21.15.176:6789/0 conn(0x7fb51015c570 legacy=0x7fb51015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50f400640 1 -- 172.21.15.52:0/4127961546 >> v1:172.21.15.52:6789/0 conn(0x7fb5100d1a80 legacy=0x7fb51015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.294+0000 7fb50f400640 1 -- 172.21.15.52:0/4127961546 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5100cf4b0 con 0x7fb5100d1e60 2024-09-10T08:33:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.295+0000 7fb50f400640 1 --2- 172.21.15.52:0/4127961546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 0x7fb51015f5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb508009df0 tx=0x7fb50802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf184f0feda90b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.295+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508007740 con 0x7fb5100d1e60 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.295+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5080078e0 con 0x7fb5100d1e60 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.295+0000 7fb50d600640 1 -- 172.21.15.52:0/4127961546 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508007cb0 con 0x7fb5100d1e60 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 -- 172.21.15.52:0/4127961546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 msgr2=0x7fb51015f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 --2- 172.21.15.52:0/4127961546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 0x7fb51015f5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb508009df0 tx=0x7fb50802a710 comp rx=0 tx=0).stop 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 -- 172.21.15.52:0/4127961546 shutdown_connections 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 --2- 172.21.15.52:0/4127961546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1e60 0x7fb51015f5f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 -- 172.21.15.52:0/4127961546 >> 172.21.15.52:0/4127961546 conn(0x7fb510067d70 msgr2=0x7fb510068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 -- 172.21.15.52:0/4127961546 shutdown_connections 2024-09-10T08:33:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.296+0000 7fb515600640 1 -- 172.21.15.52:0/4127961546 wait complete. 2024-09-10T08:33:02.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.298+0000 7fb515600640 1 Processor -- start 2024-09-10T08:33:02.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.298+0000 7fb515600640 1 -- start start 2024-09-10T08:33:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1a80 0x7fb5101f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb51015c570 0x7fb510150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100cfe10 con 0x7fb5100d1e60 2024-09-10T08:33:02.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100cfc90 con 0x7fb51015c570 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb515600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5100cff90 con 0x7fb5100d1a80 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37772/0 (socket says 172.21.15.52:37772) 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 -- 172.21.15.52:0/3521782224 learned_addr learned my addr 172.21.15.52:0/3521782224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50f400640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb51015c570 0x7fb510150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50ea00640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1a80 0x7fb5101f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 -- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1a80 msgr2=0x7fb5101f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1a80 0x7fb5101f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 -- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb51015c570 msgr2=0x7fb510150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb51015c570 0x7fb510150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.299+0000 7fb50e000640 1 -- 172.21.15.52:0/3521782224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51015b050 con 0x7fb5100d1e60 2024-09-10T08:33:02.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb50e000640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c430 tx=0x7fb4fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc017070 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc0052f0 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc003830 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51015b330 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.300+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101f84e0 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.301+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5100ba820 con 0x7fb5100d1e60 2024-09-10T08:33:02.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.302+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4fc01a070 con 0x7fb5100d1e60 2024-09-10T08:33:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.303+0000 7fb506a00640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 0x7fb4f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.303+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7fb4fc089fa0 con 0x7fb5100d1e60 2024-09-10T08:33:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.304+0000 7fb50ea00640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 0x7fb4f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.304+0000 7fb50ea00640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 0x7fb4f006e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5000011e0 tx=0x7fb500007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.307+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5100ba820 con 0x7fb5100d1e60 2024-09-10T08:33:02.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.494+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7fb51015be60 con 0x7fb5100d1e60 2024-09-10T08:33:02.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.498+0000 7fb506a00640 1 -- 172.21.15.52:0/3521782224 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v22) ==== 101+0+0 (secure 0 0 0) 0x7fb4fc058500 con 0x7fb5100d1e60 2024-09-10T08:33:02.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 msgr2=0x7fb4f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 0x7fb4f006e2f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5000011e0 tx=0x7fb500007d30 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 msgr2=0x7fb51015a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00c430 tx=0x7fb4fc00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 shutdown_connections 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4f006be30 0x7fb4f006e2f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb51015c570 0x7fb510150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5100d1e60 0x7fb51015a8f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 --2- 172.21.15.52:0/3521782224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5100d1a80 0x7fb5101f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 >> 172.21.15.52:0/3521782224 conn(0x7fb510067d70 msgr2=0x7fb5100d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 shutdown_connections 2024-09-10T08:33:02.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.500+0000 7fb515600640 1 -- 172.21.15.52:0/3521782224 wait complete. 2024-09-10T08:33:02.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:33:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.674+0000 7fe439200640 1 Processor -- start 2024-09-10T08:33:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.674+0000 7fe439200640 1 -- start start 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe439200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4340ccf30 0x7fe4340b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe439200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4340cf2e0 con 0x7fe4340cead0 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe439200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe434070fe0 con 0x7fe43415b7c0 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe439200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe4340712c0 con 0x7fe4340ccf30 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe431e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4340ccf30 0x7fe4340b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe432800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe4340cead0 0x7fe434071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56404/0 (socket says 172.21.15.52:56404) 2024-09-10T08:33:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe432800640 1 -- 172.21.15.52:0/3570419025 learned_addr learned my addr 172.21.15.52:0/3570419025 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe431e00640 1 -- 172.21.15.52:0/3570419025 >> v1:172.21.15.176:6789/0 conn(0x7fe43415b7c0 legacy=0x7fe4340cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe431e00640 1 -- 172.21.15.52:0/3570419025 >> v1:172.21.15.52:6789/0 conn(0x7fe4340cead0 legacy=0x7fe434071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe431e00640 1 -- 172.21.15.52:0/3570419025 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4340715a0 con 0x7fe4340ccf30 2024-09-10T08:33:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.676+0000 7fe431400640 1 -- 172.21.15.52:0/3570419025 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196911122 0 0) 0x7fe4340cf2e0 con 0x7fe4340cead0 2024-09-10T08:33:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.677+0000 7fe431e00640 1 --2- 172.21.15.52:0/3570419025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340b2c50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe42402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afe76f644704d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe431400640 1 -- 172.21.15.52:0/3570419025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424037070 con 0x7fe4340ccf30 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe431400640 1 -- 172.21.15.52:0/3570419025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe42402ae50 con 0x7fe4340ccf30 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe431400640 1 -- 172.21.15.52:0/3570419025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424032660 con 0x7fe4340ccf30 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 -- 172.21.15.52:0/3570419025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 msgr2=0x7fe4340b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 --2- 172.21.15.52:0/3570419025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340b2c50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe42402a140 comp rx=0 tx=0).stop 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 -- 172.21.15.52:0/3570419025 shutdown_connections 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 --2- 172.21.15.52:0/3570419025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340b2c50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 -- 172.21.15.52:0/3570419025 >> 172.21.15.52:0/3570419025 conn(0x7fe43406d0f0 msgr2=0x7fe43406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 -- 172.21.15.52:0/3570419025 shutdown_connections 2024-09-10T08:33:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.678+0000 7fe439200640 1 -- 172.21.15.52:0/3570419025 wait complete. 2024-09-10T08:33:02.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.680+0000 7fe439200640 1 Processor -- start 2024-09-10T08:33:02.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.680+0000 7fe439200640 1 -- start start 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4340cead0 0x7fe4340cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe43415b7c0 0x7fe4341e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4340cf080 con 0x7fe4340ccf30 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4340cef00 con 0x7fe43415b7c0 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe439200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4340721d0 con 0x7fe4340cead0 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe431e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe431e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37796/0 (socket says 172.21.15.52:37796) 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe431e00640 1 -- 172.21.15.52:0/3579245884 learned_addr learned my addr 172.21.15.52:0/3579245884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe432800640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe43415b7c0 0x7fe4341e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.681+0000 7fe42be00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4340cead0 0x7fe4340cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 -- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4340cead0 msgr2=0x7fe4340cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4340cead0 0x7fe4340cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 -- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe43415b7c0 msgr2=0x7fe4341e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe43415b7c0 0x7fe4341e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 -- 172.21.15.52:0/3579245884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4340c8cf0 con 0x7fe4340ccf30 2024-09-10T08:33:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe431e00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424037040 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424004030 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424006e10 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4340c54c0 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.682+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4340c5a80 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.683+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4340cc960 con 0x7fe4340ccf30 2024-09-10T08:33:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.684+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe42403d650 con 0x7fe4340ccf30 2024-09-10T08:33:02.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.686+0000 7fe42a000640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 0x7fe41006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:02.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.686+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7fe4240ab4d0 con 0x7fe4340ccf30 2024-09-10T08:33:02.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.686+0000 7fe42be00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 0x7fe41006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:02.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.687+0000 7fe42be00640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 0x7fe41006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe41c006fd0 tx=0x7fe41c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:02.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.690+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe424042020 con 0x7fe4340ccf30 2024-09-10T08:33:02.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.873+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe4340d0290 con 0x7fe4340ccf30 2024-09-10T08:33:02.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.877+0000 7fe42a000640 1 -- 172.21.15.52:0/3579245884 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fe42407a080 con 0x7fe4340ccf30 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 msgr2=0x7fe41006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 0x7fe41006e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe41c006fd0 tx=0x7fe41c008040 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 msgr2=0x7fe4340c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097a0 tx=0x7fe4240046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 shutdown_connections 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe41006be30 0x7fe41006e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe43415b7c0 0x7fe4341e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4340cead0 0x7fe4340cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 --2- 172.21.15.52:0/3579245884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4340ccf30 0x7fe4340c87b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 >> 172.21.15.52:0/3579245884 conn(0x7fe43406d0f0 msgr2=0x7fe4340cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:02.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.879+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 shutdown_connections 2024-09-10T08:33:02.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:02.880+0000 7fe439200640 1 -- 172.21.15.52:0/3579245884 wait complete. 2024-09-10T08:33:02.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-10T08:33:03.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.050+0000 7f5ff5000640 1 Processor -- start 2024-09-10T08:33:03.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.050+0000 7f5ff5000640 1 -- start start 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5ff5000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5ff0073890 0x7f5ff00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5ff00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5ff5000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff00b4020 con 0x7f5ff0145ed0 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5ff5000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5ff00b42c0 con 0x7f5ff0073890 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5ff5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00b45a0 con 0x7f5ff00b5880 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fede00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5ff0145ed0 0x7f5ff0073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56406/0 (socket says 172.21.15.52:56406) 2024-09-10T08:33:03.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fede00640 1 -- 172.21.15.52:0/2464500536 learned_addr learned my addr 172.21.15.52:0/2464500536 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fe7e00640 1 --2- 172.21.15.52:0/2464500536 >> v2:172.21.15.176:3300/0 conn(0x7f5ff0073890 0x7f5ff00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fee800640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5ff00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188969529 0 0) 0x7f5ff00b4020 con 0x7f5ff0145ed0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.052+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003520 con 0x7f5ff0145ed0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 919988849 0 0) 0x7f5fd4003520 con 0x7f5ff0145ed0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 msgr2=0x7f5ff00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5ff00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 >> v2:172.21.15.176:3300/0 conn(0x7f5ff0073890 msgr2=0x7f5ff00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 --2- 172.21.15.52:0/2464500536 >> v2:172.21.15.176:3300/0 conn(0x7f5ff0073890 0x7f5ff00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff00b4880 con 0x7f5ff0145ed0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f5fe0001690 con 0x7f5ff0145ed0 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 >> v1:172.21.15.52:6789/0 conn(0x7f5ff0145ed0 legacy=0x7f5ff0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5fd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5fd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00b42c0 con 0x7f5fd4004d40 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00b45a0 con 0x7f5fd40039b0 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd400fdd0 con 0x7f5ff00b5880 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fee800640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5fd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fede00640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.053+0000 7f5fe7e00640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5fd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.054+0000 7f5fee800640 1 -- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 msgr2=0x7f5fd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.054+0000 7f5fee800640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff00b5880 0x7f5fd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.054+0000 7f5fee800640 1 -- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd40039b0 msgr2=0x7f5fd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.054+0000 7f5fee800640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd40039b0 0x7f5fd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.054+0000 7f5fee800640 1 -- 172.21.15.52:0/2464500536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd4003520 con 0x7f5fd4004d40 2024-09-10T08:33:03.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5fee800640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5fd40051c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009fc0 tx=0x7f5fd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9102c2d7d4833aba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8009c10 con 0x7f5fd4004d40 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8036070 con 0x7f5fd4004d40 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5fed400640 1 -- 172.21.15.52:0/2464500536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8031860 con 0x7f5fd4004d40 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5ff5000640 1 -- 172.21.15.52:0/2464500536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 msgr2=0x7f5fd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2464500536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5fd40051c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009fc0 tx=0x7f5fd4005830 comp rx=0 tx=0).stop 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.055+0000 7f5fee800640 1 -- 172.21.15.52:0/2464500536 reap_dead start 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.056+0000 7f5ff5000640 1 -- 172.21.15.52:0/2464500536 shutdown_connections 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.056+0000 7f5ff5000640 1 -- 172.21.15.52:0/2464500536 >> 172.21.15.52:0/2464500536 conn(0x7f5ff00ccec0 msgr2=0x7f5ff00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.056+0000 7f5ff5000640 1 -- 172.21.15.52:0/2464500536 shutdown_connections 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.056+0000 7f5ff5000640 1 -- 172.21.15.52:0/2464500536 wait complete. 2024-09-10T08:33:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.057+0000 7f5ff5000640 1 Processor -- start 2024-09-10T08:33:03.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.057+0000 7f5ff5000640 1 -- start start 2024-09-10T08:33:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ff01f00f0 0x7f5ff01e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff01f0570 0x7f5ff01e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0146430 con 0x7f5fd4004d40 2024-09-10T08:33:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff01462b0 con 0x7f5ff01f00f0 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.058+0000 7f5ff5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00b5d30 con 0x7f5ff01f0570 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37820/0 (socket says 172.21.15.52:37820) 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 -- 172.21.15.52:0/2668148675 learned_addr learned my addr 172.21.15.52:0/2668148675 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fe7e00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ff01f00f0 0x7f5ff01e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fee800640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff01f0570 0x7f5ff01e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 -- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff01f0570 msgr2=0x7f5ff01e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff01f0570 0x7f5ff01e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 -- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ff01f00f0 msgr2=0x7f5ff01e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ff01f00f0 0x7f5ff01e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 -- 172.21.15.52:0/2668148675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff013fb10 con 0x7f5fd4004d40 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.059+0000 7f5fede00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007310 tx=0x7f5fe00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.060+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000f8e0 con 0x7f5fd4004d40 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.060+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0018070 con 0x7f5fd4004d40 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.060+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000fce0 con 0x7f5fd4004d40 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.060+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff013fdf0 con 0x7f5fd4004d40 2024-09-10T08:33:03.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.060+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01403b0 con 0x7f5fd4004d40 2024-09-10T08:33:03.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.061+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff00b6070 con 0x7f5fd4004d40 2024-09-10T08:33:03.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.062+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fe001d460 con 0x7f5fd4004d40 2024-09-10T08:33:03.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.062+0000 7f5fe6000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 0x7f5fcc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.063+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f5fe008ad30 con 0x7f5fd4004d40 2024-09-10T08:33:03.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.063+0000 7f5fe7e00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 0x7f5fcc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.064+0000 7f5fe7e00640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 0x7f5fcc06e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ff013aaa0 tx=0x7f5fd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.067+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fe00598e0 con 0x7f5fd4004d40 2024-09-10T08:33:03.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.318+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f5ff00cd620 con 0x7f5fd4004d40 2024-09-10T08:33:03.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.352+0000 7f5fe6000640 1 -- 172.21.15.52:0/2668148675 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v218) ==== 151+0+0 (secure 0 0 0) 0x7f5fe00591e0 con 0x7f5fd4004d40 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.354+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 msgr2=0x7f5fcc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.354+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 0x7f5fcc06e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ff013aaa0 tx=0x7f5fd8008040 comp rx=0 tx=0).stop 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.354+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 msgr2=0x7f5ff015bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.354+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0007310 tx=0x7f5fe00077d0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 shutdown_connections 2024-09-10T08:33:03.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fcc06be60 0x7f5fcc06e320 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ff01f0570 0x7f5ff01e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ff01f00f0 0x7f5ff01e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 --2- 172.21.15.52:0/2668148675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fd4004d40 0x7f5ff015bc30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 >> 172.21.15.52:0/2668148675 conn(0x7f5ff00ccec0 msgr2=0x7f5ff0142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 shutdown_connections 2024-09-10T08:33:03.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.355+0000 7f5ff5000640 1 -- 172.21.15.52:0/2668148675 wait complete. 2024-09-10T08:33:03.371 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-10T08:33:03.371 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:33:03.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:03.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.526+0000 7f09ede00640 1 Processor -- start 2024-09-10T08:33:03.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.526+0000 7f09ede00640 1 -- start start 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.527+0000 7f09ede00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09e8145ed0 0x7f09e80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.527+0000 7f09ede00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09e80b5f90 0x7f09e80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.527+0000 7f09ede00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e80b4020 con 0x7f09e8073180 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09ede00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f09e80b63d0 con 0x7f09e80b5f90 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09ede00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f09e8073b00 con 0x7f09e8145ed0 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f09e80b5f90 0x7f09e80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09dfe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f09e8073180 0x7f09e80b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56420/0 (socket says 172.21.15.52:56420) 2024-09-10T08:33:03.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09dfe00640 1 -- 172.21.15.52:0/1507975060 learned_addr learned my addr 172.21.15.52:0/1507975060 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:03.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e6a00640 1 --2- 172.21.15.52:0/1507975060 >> v2:172.21.15.176:3300/0 conn(0x7f09e8145ed0 0x7f09e80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e7400640 1 -- 172.21.15.52:0/1507975060 >> v2:172.21.15.176:3300/0 conn(0x7f09e8145ed0 msgr2=0x7f09e80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e7400640 1 --2- 172.21.15.52:0/1507975060 >> v2:172.21.15.176:3300/0 conn(0x7f09e8145ed0 0x7f09e80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e7400640 1 -- 172.21.15.52:0/1507975060 >> v1:172.21.15.52:6789/0 conn(0x7f09e8073180 legacy=0x7f09e80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e7400640 1 -- 172.21.15.52:0/1507975060 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e80b42c0 con 0x7f09e80b5f90 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.528+0000 7f09e6000640 1 -- 172.21.15.52:0/1507975060 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778109536 0 0) 0x7f09e80b4020 con 0x7f09e8073180 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.529+0000 7f09e7400640 1 --2- 172.21.15.52:0/1507975060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e80b5f90 0x7f09e80735c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f09e8069cd0 tx=0x7f09e002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11dfef1ac249ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09e6000640 1 -- 172.21.15.52:0/1507975060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0007740 con 0x7f09e80b5f90 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09e6000640 1 -- 172.21.15.52:0/1507975060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e00078e0 con 0x7f09e80b5f90 2024-09-10T08:33:03.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09e6000640 1 -- 172.21.15.52:0/1507975060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0007cb0 con 0x7f09e80b5f90 2024-09-10T08:33:03.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 -- 172.21.15.52:0/1507975060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e80b5f90 msgr2=0x7f09e80735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 --2- 172.21.15.52:0/1507975060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e80b5f90 0x7f09e80735c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f09e8069cd0 tx=0x7f09e002a680 comp rx=0 tx=0).stop 2024-09-10T08:33:03.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 -- 172.21.15.52:0/1507975060 shutdown_connections 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 --2- 172.21.15.52:0/1507975060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e80b5f90 0x7f09e80735c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 --2- 172.21.15.52:0/1507975060 >> v2:172.21.15.176:3300/0 conn(0x7f09e8145ed0 0x7f09e80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 -- 172.21.15.52:0/1507975060 >> 172.21.15.52:0/1507975060 conn(0x7f09e80ccec0 msgr2=0x7f09e80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 -- 172.21.15.52:0/1507975060 shutdown_connections 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.530+0000 7f09ede00640 1 -- 172.21.15.52:0/1507975060 wait complete. 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.532+0000 7f09ede00640 1 Processor -- start 2024-09-10T08:33:03.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.532+0000 7f09ede00640 1 -- start start 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e8073180 0x7f09e815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 0x7f09e80c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f09e80b4b60 con 0x7f09e8145ed0 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f09e80b4880 con 0x7f09e80b5f90 2024-09-10T08:33:03.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09ede00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f09e81462b0 con 0x7f09e8073180 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37832/0 (socket says 172.21.15.52:37832) 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.533+0000 7f09e7400640 1 -- 172.21.15.52:0/3831405706 learned_addr learned my addr 172.21.15.52:0/3831405706 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09dfe00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 0x7f09e80c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e6a00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e8073180 0x7f09e815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 -- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e8073180 msgr2=0x7f09e815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e8073180 0x7f09e815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 -- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 msgr2=0x7f09e80c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 0x7f09e80c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 -- 172.21.15.52:0/3831405706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e81f5580 con 0x7f09e8145ed0 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09dfe00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 0x7f09e80c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:03.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09e7400640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009e80 tx=0x7f09e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0040070 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e0031c40 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e81f5860 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.534+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0009450 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.535+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e81f5e20 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.536+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e81f6020 con 0x7f09e8145ed0 2024-09-10T08:33:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.537+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09e0039040 con 0x7f09e8145ed0 2024-09-10T08:33:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.537+0000 7f09df400640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 0x7f09c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.538+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f09e00abdf0 con 0x7f09e8145ed0 2024-09-10T08:33:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.538+0000 7f09e6a00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 0x7f09c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.539+0000 7f09e6a00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 0x7f09c406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ad0 tx=0x7f09d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.542+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09e007a9a0 con 0x7f09e8145ed0 2024-09-10T08:33:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.728+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09e81448c0 con 0x7f09e8145ed0 2024-09-10T08:33:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.729+0000 7f09df400640 1 -- 172.21.15.52:0/3831405706 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+13174 (secure 0 0 0) 0x7f09e007a2a0 con 0x7f09e8145ed0 2024-09-10T08:33:03.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:03.729 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":68,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:01.336315+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3318304686":"2024-09-11T08:32:58.327554+0000","172.21.15.52:6834/3318304686":"2024-09-11T08:32:58.327554+0000","172.21.15.52:6835/2886852302":"2024-09-11T08:32:41.603819+0000","172.21.15.52:6832/2886852302":"2024-09-11T08:32:41.603819+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 msgr2=0x7f09c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 0x7f09c406e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009ad0 tx=0x7f09d8008040 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 msgr2=0x7f09e80c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009e80 tx=0x7f09e0004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 shutdown_connections 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f09c406be30 0x7f09c406e2f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09e8145ed0 0x7f09e80c7300 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09e80b5f90 0x7f09e80c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 --2- 172.21.15.52:0/3831405706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09e8073180 0x7f09e815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 >> 172.21.15.52:0/3831405706 conn(0x7f09e80ccec0 msgr2=0x7f09e81450c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 shutdown_connections 2024-09-10T08:33:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.731+0000 7f09ede00640 1 -- 172.21.15.52:0/3831405706 wait complete. 2024-09-10T08:33:03.747 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:33:03.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:33:03.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.907+0000 7f8cc6600640 1 Processor -- start 2024-09-10T08:33:03.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.907+0000 7f8cc6600640 1 -- start start 2024-09-10T08:33:03.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.908+0000 7f8cc6600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8cc00b3350 0x7f8cc00d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.908+0000 7f8cc6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 0x7f8cc00d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.908+0000 7f8cc6600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc00cf710 con 0x7f8cc006bfd0 2024-09-10T08:33:03.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.908+0000 7f8cc6600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc00b78a0 con 0x7f8cc00b3350 2024-09-10T08:33:03.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.908+0000 7f8cc6600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc00cffb0 con 0x7f8cc00b38a0 2024-09-10T08:33:03.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8cc00b3350 0x7f8cc00d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 0x7f8cc00d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8cc00b3350 0x7f8cc00d2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:51708/0 (socket says 172.21.15.52:51708) 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 -- 172.21.15.52:0/909355005 learned_addr learned my addr 172.21.15.52:0/909355005 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 -- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 msgr2=0x7f8cc00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 0x7f8cc00d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 -- 172.21.15.52:0/909355005 >> v1:172.21.15.176:6789/0 conn(0x7f8cc006bfd0 legacy=0x7f8cc006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbea00640 1 -- 172.21.15.52:0/909355005 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc00cf9f0 con 0x7f8cc00b3350 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.909+0000 7f8cbfe00640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 0x7f8cc00d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:03.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.910+0000 7f8cbea00640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc00b3350 0x7f8cc00d2920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2172f8f280a0b335 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cbe000640 1 -- 172.21.15.52:0/909355005 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac037070 con 0x7f8cc00b3350 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cbe000640 1 -- 172.21.15.52:0/909355005 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac02ae50 con 0x7f8cc00b3350 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cbe000640 1 -- 172.21.15.52:0/909355005 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032860 con 0x7f8cc00b3350 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 -- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc00b3350 msgr2=0x7f8cc00d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc00b3350 0x7f8cc00d2920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009870 tx=0x7f8cac02a300 comp rx=0 tx=0).stop 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 -- 172.21.15.52:0/909355005 shutdown_connections 2024-09-10T08:33:03.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b38a0 0x7f8cc00d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 --2- 172.21.15.52:0/909355005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc00b3350 0x7f8cc00d2920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 -- 172.21.15.52:0/909355005 >> 172.21.15.52:0/909355005 conn(0x7f8cc00d11c0 msgr2=0x7f8cc00d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 -- 172.21.15.52:0/909355005 shutdown_connections 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.911+0000 7f8cc6600640 1 -- 172.21.15.52:0/909355005 wait complete. 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.913+0000 7f8cc6600640 1 Processor -- start 2024-09-10T08:33:03.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.913+0000 7f8cc6600640 1 -- start start 2024-09-10T08:33:03.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc006bfd0 0x7f8cc0149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 0x7f8cc0159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc006cd50 con 0x7f8cc00b38a0 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc00d2400 con 0x7f8cc006bfd0 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cc6600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc015eae0 con 0x7f8cc00b3350 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cbfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cbfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37834/0 (socket says 172.21.15.52:37834) 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cbfe00640 1 -- 172.21.15.52:0/2118788607 learned_addr learned my addr 172.21.15.52:0/2118788607 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cbea00640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 0x7f8cc0159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.914+0000 7f8cbf400640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc006bfd0 0x7f8cc0149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 -- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 msgr2=0x7f8cc0159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 0x7f8cc0159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 -- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc006bfd0 msgr2=0x7f8cc0149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc006bfd0 0x7f8cc0149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 -- 172.21.15.52:0/2118788607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0154120 con 0x7f8cc00b38a0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbea00640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 0x7f8cc0159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cbfe00640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800efc0 tx=0x7f8cb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8018030 con 0x7f8cc00b38a0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb800cdf0 con 0x7f8cc00b38a0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8003bb0 con 0x7f8cc00b38a0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.915+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc015a3f0 con 0x7f8cc00b38a0 2024-09-10T08:33:03.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.916+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc0147570 con 0x7f8cc00b38a0 2024-09-10T08:33:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.917+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc006c3b0 con 0x7f8cc00b38a0 2024-09-10T08:33:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.918+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cb801b070 con 0x7f8cc00b38a0 2024-09-10T08:33:03.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.918+0000 7f8cb7400640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 0x7f8ca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:03.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.919+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f8cb808b460 con 0x7f8cc00b38a0 2024-09-10T08:33:03.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.919+0000 7f8cbf400640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 0x7f8ca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:03.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.920+0000 7f8cbf400640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 0x7f8ca006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000f60 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:03.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:03.923+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cb8010040 con 0x7f8cc00b38a0 2024-09-10T08:33:04.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.107+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8cc00d0cf0 con 0x7f8cc00b38a0 2024-09-10T08:33:04.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.108+0000 7f8cb7400640 1 -- 172.21.15.52:0/2118788607 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7f8cb8059a50 con 0x7f8cc00b38a0 2024-09-10T08:33:04.108 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 msgr2=0x7f8ca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 0x7f8ca006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000f60 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 msgr2=0x7f8cc0161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800efc0 tx=0x7f8cb800c490 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 shutdown_connections 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ca006be30 0x7f8ca006e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cc00b38a0 0x7f8cc0161630 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cc00b3350 0x7f8cc0159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 --2- 172.21.15.52:0/2118788607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cc006bfd0 0x7f8cc0149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 >> 172.21.15.52:0/2118788607 conn(0x7f8cc00d11c0 msgr2=0x7f8cc015f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:04.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 shutdown_connections 2024-09-10T08:33:04.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.110+0000 7f8cc6600640 1 -- 172.21.15.52:0/2118788607 wait complete. 2024-09-10T08:33:04.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-10T08:33:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.283+0000 7f1919200640 1 Processor -- start 2024-09-10T08:33:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.284+0000 7f1919200640 1 -- start start 2024-09-10T08:33:04.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1919200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1914073890 0x7f19140b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1919200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19140b5880 0x7f19140b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1919200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19140b4020 con 0x7f1914145ed0 2024-09-10T08:33:04.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1919200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f19140b42c0 con 0x7f1914073890 2024-09-10T08:33:04.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1919200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19140b45a0 con 0x7f19140b5880 2024-09-10T08:33:04.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f190be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1914073890 0x7f19140b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f1912800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19140b5880 0x7f19140b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f190be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1914073890 0x7f19140b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:55506/0 (socket says 172.21.15.52:55506) 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.285+0000 7f190be00640 1 -- 172.21.15.52:0/406077596 learned_addr learned my addr 172.21.15.52:0/406077596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.286+0000 7f190be00640 1 -- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19140b5880 msgr2=0x7f19140b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.286+0000 7f190be00640 1 --2- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19140b5880 0x7f19140b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.286+0000 7f190be00640 1 -- 172.21.15.52:0/406077596 >> v1:172.21.15.176:6789/0 conn(0x7f1914145ed0 legacy=0x7f1914073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.286+0000 7f190be00640 1 -- 172.21.15.52:0/406077596 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19140b4880 con 0x7f1914073890 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.287+0000 7f190be00640 1 --2- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1914073890 0x7f19140b5080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca7f777fc30b234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.287+0000 7f1911400640 1 -- 172.21.15.52:0/406077596 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc037070 con 0x7f1914073890 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.287+0000 7f1911400640 1 -- 172.21.15.52:0/406077596 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc032440 con 0x7f1914073890 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.287+0000 7f1911400640 1 -- 172.21.15.52:0/406077596 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc032810 con 0x7f1914073890 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 -- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1914073890 msgr2=0x7f19140b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 --2- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1914073890 0x7f19140b5080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009870 tx=0x7f18fc02a250 comp rx=0 tx=0).stop 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 -- 172.21.15.52:0/406077596 shutdown_connections 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 --2- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f19140b5880 0x7f19140b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 --2- 172.21.15.52:0/406077596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1914073890 0x7f19140b5080 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 -- 172.21.15.52:0/406077596 >> 172.21.15.52:0/406077596 conn(0x7f19140ccec0 msgr2=0x7f19140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 -- 172.21.15.52:0/406077596 shutdown_connections 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.288+0000 7f1919200640 1 -- 172.21.15.52:0/406077596 wait complete. 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.289+0000 7f1919200640 1 Processor -- start 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 -- start start 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1914073890 0x7f19141554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 0x7f19141583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19140b6270 con 0x7f1914145ed0 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f19141462b0 con 0x7f19140b5880 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.290+0000 7f1919200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1914157380 con 0x7f1914073890 2024-09-10T08:33:04.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44136/0 (socket says 172.21.15.52:44136) 2024-09-10T08:33:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 -- 172.21.15.52:0/2064411771 learned_addr learned my addr 172.21.15.52:0/2064411771 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f190be00640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 0x7f19141583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1911e00640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1914073890 0x7f19141554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 -- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1914073890 msgr2=0x7f19141554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1914073890 0x7f19141554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 -- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 msgr2=0x7f19141583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 0x7f19141583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:04.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f1912800640 1 -- 172.21.15.52:0/2064411771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1914157620 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.291+0000 7f190be00640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 0x7f19141583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f1912800640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f190c00efc0 tx=0x7f190c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c018020 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c014480 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1914157960 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c014870 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.292+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1914155a10 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.293+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19140b5080 con 0x7f1914145ed0 2024-09-10T08:33:04.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.294+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f190c005d10 con 0x7f1914145ed0 2024-09-10T08:33:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.295+0000 7f190a000640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.295+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f190c08b7b0 con 0x7f1914145ed0 2024-09-10T08:33:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.295+0000 7f1911e00640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:04.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.296+0000 7f1911e00640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1904000f60 tx=0x7f1904009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:04.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.299+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f190c022070 con 0x7f1914145ed0 2024-09-10T08:33:04.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:04.556+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f19140d0860 con 0x7f1914145ed0 2024-09-10T08:33:05.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.360+0000 7f190a000640 1 -- 172.21.15.52:0/2064411771 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v220) ==== 146+0+0 (secure 0 0 0) 0x7f1914157960 con 0x7f1914145ed0 2024-09-10T08:33:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 msgr2=0x7f18f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 0x7f18f006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1904000f60 tx=0x7f1904009040 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 msgr2=0x7f191413e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f190c00efc0 tx=0x7f190c00c490 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 shutdown_connections 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18f006be30 0x7f18f006e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1914145ed0 0x7f191413e090 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f19140b5880 0x7f19141583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 --2- 172.21.15.52:0/2064411771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1914073890 0x7f19141554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 >> 172.21.15.52:0/2064411771 conn(0x7f19140ccec0 msgr2=0x7f19140b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 shutdown_connections 2024-09-10T08:33:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.365+0000 7f1919200640 1 -- 172.21.15.52:0/2064411771 wait complete. 2024-09-10T08:33:05.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:33:05.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.548+0000 7f56db600640 1 Processor -- start 2024-09-10T08:33:05.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.548+0000 7f56db600640 1 -- start start 2024-09-10T08:33:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.549+0000 7f56db600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f56d40ccf30 0x7f56d40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56db600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56db600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d40cf2e0 con 0x7f56d415b7c0 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56db600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f56d4070fe0 con 0x7f56d40ccf30 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56db600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56d40712c0 con 0x7f56d40cead0 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56d8c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f56d40ccf30 0x7f56d40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56d9600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56d8c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f56d40ccf30 0x7f56d40b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:55528/0 (socket says 172.21.15.52:55528) 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56d8c00640 1 -- 172.21.15.52:0/3262995044 learned_addr learned my addr 172.21.15.52:0/3262995044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:05.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.550+0000 7f56d9600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57398/0 (socket says 172.21.15.52:57398) 2024-09-10T08:33:05.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.551+0000 7f56d8c00640 1 -- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 msgr2=0x7f56d4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:05.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.551+0000 7f56d8c00640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.551+0000 7f56d8c00640 1 -- 172.21.15.52:0/3262995044 >> v1:172.21.15.176:6789/0 conn(0x7f56d415b7c0 legacy=0x7f56d40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.551+0000 7f56d8c00640 1 -- 172.21.15.52:0/3262995044 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d40715a0 con 0x7f56d40ccf30 2024-09-10T08:33:05.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.551+0000 7f56d9600640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56d8c00640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d40b2c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56c400bb10 tx=0x7f56c402c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1177c7e3d7e9c77a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56d3e00640 1 -- 172.21.15.52:0/3262995044 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4032790 con 0x7f56d40ccf30 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56d3e00640 1 -- 172.21.15.52:0/3262995044 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c4038070 con 0x7f56d40ccf30 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56d3e00640 1 -- 172.21.15.52:0/3262995044 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4032b50 con 0x7f56d40ccf30 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 -- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 msgr2=0x7f56d40b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d40b2c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56c400bb10 tx=0x7f56c402c890 comp rx=0 tx=0).stop 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 -- 172.21.15.52:0/3262995044 shutdown_connections 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 --2- 172.21.15.52:0/3262995044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d40b2c50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.552+0000 7f56db600640 1 -- 172.21.15.52:0/3262995044 >> 172.21.15.52:0/3262995044 conn(0x7f56d406d0f0 msgr2=0x7f56d406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.553+0000 7f56db600640 1 -- 172.21.15.52:0/3262995044 shutdown_connections 2024-09-10T08:33:05.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.553+0000 7f56db600640 1 -- 172.21.15.52:0/3262995044 wait complete. 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.554+0000 7f56db600640 1 Processor -- start 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.554+0000 7f56db600640 1 -- start start 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56d40cf0c0 con 0x7f56d415b7c0 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56d40cef40 con 0x7f56d40ccf30 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56db600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f56d4072000 con 0x7f56d40cead0 2024-09-10T08:33:05.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56d9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56d9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44142/0 (socket says 172.21.15.52:44142) 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.555+0000 7f56d9600640 1 -- 172.21.15.52:0/447399860 learned_addr learned my addr 172.21.15.52:0/447399860 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56cbe00640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d8c00640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 -- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 msgr2=0x7f56d414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 -- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 msgr2=0x7f56d4145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d4145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 -- 172.21.15.52:0/447399860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d414f6b0 con 0x7f56d415b7c0 2024-09-10T08:33:05.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d9600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00efc0 tx=0x7f56cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:05.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.556+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc018030 con 0x7f56d415b7c0 2024-09-10T08:33:05.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.557+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc00cde0 con 0x7f56d415b7c0 2024-09-10T08:33:05.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.557+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d414f990 con 0x7f56d415b7c0 2024-09-10T08:33:05.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.557+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc003bb0 con 0x7f56d415b7c0 2024-09-10T08:33:05.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.557+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d414ff50 con 0x7f56d415b7c0 2024-09-10T08:33:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.558+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d40cc960 con 0x7f56d415b7c0 2024-09-10T08:33:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.559+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56cc005d10 con 0x7f56d415b7c0 2024-09-10T08:33:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.559+0000 7f56d1600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 0x7f56b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.560+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f56cc08b580 con 0x7f56d415b7c0 2024-09-10T08:33:05.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.560+0000 7f56d8c00640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 0x7f56b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:05.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.561+0000 7f56d8c00640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 0x7f56b006e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56c4037000 tx=0x7f56c4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:05.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.564+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56cc022070 con 0x7f56d415b7c0 2024-09-10T08:33:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.751+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f56d40d0290 con 0x7f56d415b7c0 2024-09-10T08:33:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.755+0000 7f56d1600640 1 -- 172.21.15.52:0/447399860 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f56cc010040 con 0x7f56d415b7c0 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 msgr2=0x7f56b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 0x7f56b006e2f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f56c4037000 tx=0x7f56c4032000 comp rx=0 tx=0).stop 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 msgr2=0x7f56d414b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00efc0 tx=0x7f56cc009f90 comp rx=0 tx=0).stop 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 shutdown_connections 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f56b006be30 0x7f56b006e2f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56d415b7c0 0x7f56d414b7d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56d40cead0 0x7f56d414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 --2- 172.21.15.52:0/447399860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56d40ccf30 0x7f56d4145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:05.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 >> 172.21.15.52:0/447399860 conn(0x7f56d406d0f0 msgr2=0x7f56d4156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:05.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 shutdown_connections 2024-09-10T08:33:05.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:05.757+0000 7f56db600640 1 -- 172.21.15.52:0/447399860 wait complete. 2024-09-10T08:33:05.774 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:33:05.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:05.866 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:05.959 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:33:05.960 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:05.960 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:05.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:33:05.996 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:05.996 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:06.034 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:06.034 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:06.034 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:06.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:33:06.071 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:06.071 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:06.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:06.111 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:33:06.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:06.267 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.268+0000 7ffa5e800640 1 Processor -- start 2024-09-10T08:33:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.268+0000 7ffa5e800640 1 -- start start 2024-09-10T08:33:06.272 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:06.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa580b6710 0x7ffa580d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa580cf450 0x7ffa580b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5e800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa580d3990 con 0x7ffa5815e440 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffa580d3c70 con 0x7ffa580cf450 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5e800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ffa580d3f50 con 0x7ffa580b6710 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa580cf450 0x7ffa580b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa580cf450 0x7ffa580b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44144/0 (socket says 172.21.15.52:44144) 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5de00640 1 -- 172.21.15.52:0/1285238481 learned_addr learned my addr 172.21.15.52:0/1285238481 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.269+0000 7ffa5ca00640 1 --2- 172.21.15.52:0/1285238481 >> v2:172.21.15.176:3300/0 conn(0x7ffa580b6710 0x7ffa580d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.270+0000 7ffa5de00640 1 -- 172.21.15.52:0/1285238481 >> v2:172.21.15.176:3300/0 conn(0x7ffa580b6710 msgr2=0x7ffa580d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.270+0000 7ffa5de00640 1 --2- 172.21.15.52:0/1285238481 >> v2:172.21.15.176:3300/0 conn(0x7ffa580b6710 0x7ffa580d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.270+0000 7ffa5de00640 1 -- 172.21.15.52:0/1285238481 >> v1:172.21.15.176:6789/0 conn(0x7ffa5815e440 legacy=0x7ffa580b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.270+0000 7ffa5de00640 1 -- 172.21.15.52:0/1285238481 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa580d4230 con 0x7ffa580cf450 2024-09-10T08:33:06.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.271+0000 7ffa5de00640 1 --2- 172.21.15.52:0/1285238481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580cf450 0x7ffa580b7b60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffa580d2480 tx=0x7ffa5002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475f95fd0b6321f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.271+0000 7ffa57e00640 1 -- 172.21.15.52:0/1285238481 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50036070 con 0x7ffa580cf450 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.271+0000 7ffa57e00640 1 -- 172.21.15.52:0/1285238481 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50031600 con 0x7ffa580cf450 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.271+0000 7ffa57e00640 1 -- 172.21.15.52:0/1285238481 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500319f0 con 0x7ffa580cf450 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 -- 172.21.15.52:0/1285238481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580cf450 msgr2=0x7ffa580b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 --2- 172.21.15.52:0/1285238481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580cf450 0x7ffa580b7b60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffa580d2480 tx=0x7ffa5002a7c0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 -- 172.21.15.52:0/1285238481 shutdown_connections 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 --2- 172.21.15.52:0/1285238481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580cf450 0x7ffa580b7b60 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 --2- 172.21.15.52:0/1285238481 >> v2:172.21.15.176:3300/0 conn(0x7ffa580b6710 0x7ffa580d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 -- 172.21.15.52:0/1285238481 >> 172.21.15.52:0/1285238481 conn(0x7ffa58067f80 msgr2=0x7ffa580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 -- 172.21.15.52:0/1285238481 shutdown_connections 2024-09-10T08:33:06.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.272+0000 7ffa5e800640 1 -- 172.21.15.52:0/1285238481 wait complete. 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.274+0000 7ffa5e800640 1 Processor -- start 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.274+0000 7ffa5e800640 1 -- start start 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa580cf450 0x7ffa5815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa5815e440 0x7ffa5815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580b76c0 con 0x7ffa580b6710 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580b7540 con 0x7ffa580cf450 2024-09-10T08:33:06.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa580b80a0 con 0x7ffa5815e440 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44156/0 (socket says 172.21.15.52:44156) 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5d400640 1 -- 172.21.15.52:0/2147114624 learned_addr learned my addr 172.21.15.52:0/2147114624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.275+0000 7ffa5ca00640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa580cf450 0x7ffa5815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5de00640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa5815e440 0x7ffa5815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 -- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa5815e440 msgr2=0x7ffa5815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa5815e440 0x7ffa5815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 -- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa580cf450 msgr2=0x7ffa5815d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa580cf450 0x7ffa5815d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 -- 172.21.15.52:0/2147114624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581e47f0 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5d400640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c400 tx=0x7ffa4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c017070 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0052d0 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c003830 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.276+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa581e4ad0 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.277+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581e5090 con 0x7ffa580b6710 2024-09-10T08:33:06.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.278+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa580b7b60 con 0x7ffa580b6710 2024-09-10T08:33:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.279+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa4c01a070 con 0x7ffa580b6710 2024-09-10T08:33:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.280+0000 7ffa55600640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.280+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7ffa4c089ef0 con 0x7ffa580b6710 2024-09-10T08:33:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.280+0000 7ffa5ca00640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.281+0000 7ffa5ca00640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 0x7ffa3806e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa5815d430 tx=0x7ffa44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.285+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa4c058450 con 0x7ffa580b6710 2024-09-10T08:33:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.507+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa58150df0 con 0x7ffa580b6710 2024-09-10T08:33:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.508+0000 7ffa55600640 1 -- 172.21.15.52:0/2147114624 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3914 (secure 0 0 0) 0x7ffa4c05c750 con 0x7ffa580b6710 2024-09-10T08:33:06.508 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:06.508 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":43,"btime":"2024-09-10T08:32:59:329411+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5681,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/1095286656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1095286656},{"type":"v1","addr":"172.21.15.176:6835","nonce":1095286656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6070,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1669026718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":1669026718},{"type":"v1","addr":"172.21.15.176:6837","nonce":1669026718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/1556159590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1556159590},{"type":"v1","addr":"172.21.15.52:6833","nonce":1556159590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/471877512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":471877512},{"type":"v1","addr":"172.21.15.52:6835","nonce":471877512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-09-10T08:33:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 43 2024-09-10T08:33:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 msgr2=0x7ffa3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 0x7ffa3806e2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa5815d430 tx=0x7ffa44009190 comp rx=0 tx=0).stop 2024-09-10T08:33:06.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 msgr2=0x7ffa581508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c400 tx=0x7ffa4c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 shutdown_connections 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa5815e440 0x7ffa5815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa580cf450 0x7ffa5815d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 --2- 172.21.15.52:0/2147114624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa580b6710 0x7ffa581508b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 >> 172.21.15.52:0/2147114624 conn(0x7ffa58067f80 msgr2=0x7ffa580ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 shutdown_connections 2024-09-10T08:33:06.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.510+0000 7ffa5e800640 1 -- 172.21.15.52:0/2147114624 wait complete. 2024-09-10T08:33:06.527 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:33:06.527 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:33:06.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:33:06.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:06.528 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:33:06.528 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:33:06.528 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:33:06.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:06.528 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:33:06.528 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:33:06.529 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:33:06.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:06.529 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:33:06.529 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:33:06.529 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:33:06.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:06.544 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:33:06.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:33:06.545 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:33:06.545 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:33:06.546 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:33:06.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:33:06.547 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:33:06.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:33:06.588 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:33:06.588 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:06.590 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:33:06.590 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:06.590 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:33:06.591 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:06.592 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:33:06.592 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:06.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:33:06.717 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:33:06.717 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:33:06.721 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:33:06.721 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:33:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.756+0000 7f5d6fe00640 1 Processor -- start 2024-09-10T08:33:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.756+0000 7f5d6fe00640 1 -- start start 2024-09-10T08:33:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d700d3990 con 0x7f5d7015e440 2024-09-10T08:33:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d700d3c70 con 0x7f5d700b6710 2024-09-10T08:33:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700d3f50 con 0x7f5d700cf450 2024-09-10T08:33:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6ea00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d7015e440 0x7f5d700b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39404/0 (socket says 172.21.15.52:39404) 2024-09-10T08:33:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6ea00640 1 -- 172.21.15.52:0/4137055537 learned_addr learned my addr 172.21.15.52:0/4137055537 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.757+0000 7f5d6f400640 1 --2- 172.21.15.52:0/4137055537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176093216 0 0) 0x7f5d700d3990 con 0x7f5d7015e440 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d54003520 con 0x7f5d7015e440 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6f400640 1 -- 172.21.15.52:0/4137055537 >> v1:172.21.15.176:6789/0 conn(0x7f5d700b6710 legacy=0x7f5d700b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066609924 0 0) 0x7f5d700d3c70 con 0x7f5d700b6710 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6f400640 1 -- 172.21.15.52:0/4137055537 >> v1:172.21.15.52:6789/0 conn(0x7f5d7015e440 legacy=0x7f5d700b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.758+0000 7f5d6f400640 1 -- 172.21.15.52:0/4137055537 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700d4230 con 0x7f5d700cf450 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.759+0000 7f5d6f400640 1 --2- 172.21.15.52:0/4137055537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700d3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009dc0 tx=0x7f5d6802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42034eb5463ca9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.759+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007740 con 0x7f5d700cf450 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.759+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d680078e0 con 0x7f5d700cf450 2024-09-10T08:33:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.759+0000 7f5d6e000640 1 -- 172.21.15.52:0/4137055537 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007cb0 con 0x7f5d700cf450 2024-09-10T08:33:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 -- 172.21.15.52:0/4137055537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 msgr2=0x7f5d700d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/4137055537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700d3240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009dc0 tx=0x7f5d6802a760 comp rx=0 tx=0).stop 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 -- 172.21.15.52:0/4137055537 shutdown_connections 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/4137055537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700d3240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 -- 172.21.15.52:0/4137055537 >> 172.21.15.52:0/4137055537 conn(0x7f5d70067f80 msgr2=0x7f5d700d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 -- 172.21.15.52:0/4137055537 shutdown_connections 2024-09-10T08:33:06.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.760+0000 7f5d6fe00640 1 -- 172.21.15.52:0/4137055537 wait complete. 2024-09-10T08:33:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.761+0000 7f5d6fe00640 1 Processor -- start 2024-09-10T08:33:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 -- start start 2024-09-10T08:33:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d7015e440 0x7f5d701f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700b76c0 con 0x7f5d700b6710 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700b7540 con 0x7f5d7015e440 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.762+0000 7f5d6fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700b8270 con 0x7f5d700cf450 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44188/0 (socket says 172.21.15.52:44188) 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 -- 172.21.15.52:0/1421575481 learned_addr learned my addr 172.21.15.52:0/1421575481 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6f400640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d7015e440 0x7f5d701f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d67e00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 -- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 msgr2=0x7f5d700ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 -- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d7015e440 msgr2=0x7f5d701f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d7015e440 0x7f5d701f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.763+0000 7f5d6ea00640 1 -- 172.21.15.52:0/1421575481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700abaa0 con 0x7f5d700b6710 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d6ea00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c390 tx=0x7f5d6000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60017070 con 0x7f5d700b6710 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60005ce0 con 0x7f5d700b6710 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d600072f0 con 0x7f5d700b6710 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d700abde0 con 0x7f5d700b6710 2024-09-10T08:33:06.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.764+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d700ac620 con 0x7f5d700b6710 2024-09-10T08:33:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.765+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d700d3240 con 0x7f5d700b6710 2024-09-10T08:33:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.766+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d6001a070 con 0x7f5d700b6710 2024-09-10T08:33:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.767+0000 7f5d67400640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:06.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.767+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5029+0+0 (secure 0 0 0) 0x7f5d60089f60 con 0x7f5d700b6710 2024-09-10T08:33:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.767+0000 7f5d67e00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:06.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.768+0000 7f5d67e00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5d700cf3a0 tx=0x7f5d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.771+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d700abde0 con 0x7f5d700b6710 2024-09-10T08:33:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:06.965+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5d700ac820 con 0x7f5d700b6710 2024-09-10T08:33:07.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.380+0000 7f5d67400640 1 -- 172.21.15.52:0/1421575481 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v70) ==== 97+0+0 (secure 0 0 0) 0x7f5d60058550 con 0x7f5d700b6710 2024-09-10T08:33:07.380 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:33:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 msgr2=0x7f5d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5d700cf3a0 tx=0x7f5d58009040 comp rx=0 tx=0).stop 2024-09-10T08:33:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 msgr2=0x7f5d700ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000c390 tx=0x7f5d6000c850 comp rx=0 tx=0).stop 2024-09-10T08:33:07.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 shutdown_connections 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d7015e440 0x7f5d701f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d700cf450 0x7f5d700ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 --2- 172.21.15.52:0/1421575481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d700b6710 0x7f5d700ab410 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 >> 172.21.15.52:0/1421575481 conn(0x7f5d70067f80 msgr2=0x7f5d700b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 shutdown_connections 2024-09-10T08:33:07.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.383+0000 7f5d6fe00640 1 -- 172.21.15.52:0/1421575481 wait complete. 2024-09-10T08:33:07.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:33:07.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.559+0000 7fa999200640 1 Processor -- start 2024-09-10T08:33:07.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.559+0000 7fa999200640 1 -- start start 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa999200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 0x7fa9940cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa999200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa9940cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa999200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9940cfb40 con 0x7fa9940b7a30 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa999200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa9940d27f0 con 0x7fa9940b63f0 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa999200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9940cfe20 con 0x7fa9940b67d0 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa992a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa9940b7a30 0x7fa99415df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39418/0 (socket says 172.21.15.52:39418) 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.560+0000 7fa992a00640 1 -- 172.21.15.52:0/1947780834 learned_addr learned my addr 172.21.15.52:0/1947780834 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993e00640 1 --2- 172.21.15.52:0/1947780834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa9940cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993400640 1 --2- 172.21.15.52:0/1947780834 >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 0x7fa9940cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa992000640 1 -- 172.21.15.52:0/1947780834 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563130361 0 0) 0x7fa9940cfb40 con 0x7fa9940b7a30 2024-09-10T08:33:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa992000640 1 -- 172.21.15.52:0/1947780834 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa978003520 con 0x7fa9940b7a30 2024-09-10T08:33:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993e00640 1 -- 172.21.15.52:0/1947780834 >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 msgr2=0x7fa9940cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993e00640 1 --2- 172.21.15.52:0/1947780834 >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 0x7fa9940cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993e00640 1 -- 172.21.15.52:0/1947780834 >> v1:172.21.15.52:6789/0 conn(0x7fa9940b7a30 legacy=0x7fa99415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993e00640 1 -- 172.21.15.52:0/1947780834 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9940d2e00 con 0x7fa9940b67d0 2024-09-10T08:33:07.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.561+0000 7fa993400640 1 --2- 172.21.15.52:0/1947780834 >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 0x7fa9940cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:07.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.562+0000 7fa993e00640 1 --2- 172.21.15.52:0/1947780834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa9940cf4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009d90 tx=0x7fa98c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2981e59e780d2931 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa992000640 1 -- 172.21.15.52:0/1947780834 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c007740 con 0x7fa9940b67d0 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa992000640 1 -- 172.21.15.52:0/1947780834 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98c0078e0 con 0x7fa9940b67d0 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa992000640 1 -- 172.21.15.52:0/1947780834 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c007cb0 con 0x7fa9940b67d0 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 -- 172.21.15.52:0/1947780834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 msgr2=0x7fa9940cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 --2- 172.21.15.52:0/1947780834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa9940cf4a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009d90 tx=0x7fa98c02a660 comp rx=0 tx=0).stop 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 -- 172.21.15.52:0/1947780834 shutdown_connections 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 --2- 172.21.15.52:0/1947780834 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa9940cf4a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 --2- 172.21.15.52:0/1947780834 >> v2:172.21.15.176:3300/0 conn(0x7fa9940b63f0 0x7fa9940cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 -- 172.21.15.52:0/1947780834 >> 172.21.15.52:0/1947780834 conn(0x7fa9940d1360 msgr2=0x7fa9940d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:07.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 -- 172.21.15.52:0/1947780834 shutdown_connections 2024-09-10T08:33:07.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.563+0000 7fa999200640 1 -- 172.21.15.52:0/1947780834 wait complete. 2024-09-10T08:33:07.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.565+0000 7fa999200640 1 Processor -- start 2024-09-10T08:33:07.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.565+0000 7fa999200640 1 -- start start 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa994155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940b7a30 0x7fa994152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa99415e810 con 0x7fa9940b63f0 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa99415e690 con 0x7fa9940b7a30 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa999200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa99415e990 con 0x7fa9940b67d0 2024-09-10T08:33:07.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa993400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa993400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44204/0 (socket says 172.21.15.52:44204) 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa993400640 1 -- 172.21.15.52:0/2375650773 learned_addr learned my addr 172.21.15.52:0/2375650773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.566+0000 7fa992a00640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa994155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993e00640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940b7a30 0x7fa994152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 -- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 msgr2=0x7fa994155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa994155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 -- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940b7a30 msgr2=0x7fa994152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940b7a30 0x7fa994152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 -- 172.21.15.52:0/2375650773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9941561b0 con 0x7fa9940b63f0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa992a00640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa994155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa993400640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa98400ec10 tx=0x7fa98400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984017070 con 0x7fa9940b63f0 2024-09-10T08:33:07.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98400cc30 con 0x7fa9940b63f0 2024-09-10T08:33:07.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984013470 con 0x7fa9940b63f0 2024-09-10T08:33:07.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.567+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa994156490 con 0x7fa9940b63f0 2024-09-10T08:33:07.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.568+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa994156a50 con 0x7fa9940b63f0 2024-09-10T08:33:07.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.569+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99415df80 con 0x7fa9940b63f0 2024-09-10T08:33:07.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.569+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa98401a070 con 0x7fa9940b63f0 2024-09-10T08:33:07.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.571+0000 7fa98b400640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 0x7fa97406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:07.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.571+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4857+0+0 (secure 0 0 0) 0x7fa98408aeb0 con 0x7fa9940b63f0 2024-09-10T08:33:07.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.571+0000 7fa992a00640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 0x7fa97406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:07.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.572+0000 7fa992a00640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 0x7fa97406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa980009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:07.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.575+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa984059b10 con 0x7fa9940b63f0 2024-09-10T08:33:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.829+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa994158ac0 con 0x7fa9940b63f0 2024-09-10T08:33:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.830+0000 7fa98b400640 1 -- 172.21.15.52:0/2375650773 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fa984059410 con 0x7fa9940b63f0 2024-09-10T08:33:07.830 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.831 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:33:07.832 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.833 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.834 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.835 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.836 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:33:07.837 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.838 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.839 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.840 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.841 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:33:07.842 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:07.843 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.844 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:07.845 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:33:07.846 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:07.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 msgr2=0x7fa97406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 0x7fa97406e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa980007fd0 tx=0x7fa980009040 comp rx=0 tx=0).stop 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 msgr2=0x7fa99414ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa98400ec10 tx=0x7fa98400c520 comp rx=0 tx=0).stop 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 shutdown_connections 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa97406be30 0x7fa97406e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9940b7a30 0x7fa994152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9940b67d0 0x7fa994155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 --2- 172.21.15.52:0/2375650773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9940b63f0 0x7fa99414ef60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:07.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 >> 172.21.15.52:0/2375650773 conn(0x7fa9940d1360 msgr2=0x7fa9940d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:07.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.832+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 shutdown_connections 2024-09-10T08:33:07.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:07.833+0000 7fa999200640 1 -- 172.21.15.52:0/2375650773 wait complete. 2024-09-10T08:33:07.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:33:08.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.006+0000 7f09a0c00640 1 Processor -- start 2024-09-10T08:33:08.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.006+0000 7f09a0c00640 1 -- start start 2024-09-10T08:33:08.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f09a0c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f099c0b2d40 0x7f099c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f09a0c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f099c06c150 0x7f099c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f09a0c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c071180 con 0x7f099c13eb20 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f09a0c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f099c071ab0 con 0x7f099c06c150 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f09a0c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f099c071460 con 0x7f099c0b2d40 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f099c06c150 0x7f099c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f099c06c150 0x7f099c15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44212/0 (socket says 172.21.15.52:44212) 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 -- 172.21.15.52:0/1015792331 learned_addr learned my addr 172.21.15.52:0/1015792331 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f0999e00640 1 --2- 172.21.15.52:0/1015792331 >> v2:172.21.15.176:3300/0 conn(0x7f099c0b2d40 0x7f099c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 -- 172.21.15.52:0/1015792331 >> v2:172.21.15.176:3300/0 conn(0x7f099c0b2d40 msgr2=0x7f099c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 --2- 172.21.15.52:0/1015792331 >> v2:172.21.15.176:3300/0 conn(0x7f099c0b2d40 0x7f099c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 -- 172.21.15.52:0/1015792331 >> v1:172.21.15.176:6789/0 conn(0x7f099c13eb20 legacy=0x7f099c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:08.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.008+0000 7f099a800640 1 -- 172.21.15.52:0/1015792331 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c071740 con 0x7f099c06c150 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.009+0000 7f099a800640 1 --2- 172.21.15.52:0/1015792331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c15c400 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f099c069be0 tx=0x7f099402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd96b13eea7f3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.009+0000 7f0999400640 1 -- 172.21.15.52:0/1015792331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994036070 con 0x7f099c06c150 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f0999400640 1 -- 172.21.15.52:0/1015792331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994031600 con 0x7f099c06c150 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f0999400640 1 -- 172.21.15.52:0/1015792331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940319d0 con 0x7f099c06c150 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 -- 172.21.15.52:0/1015792331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 msgr2=0x7f099c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 --2- 172.21.15.52:0/1015792331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c15c400 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f099c069be0 tx=0x7f099402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 -- 172.21.15.52:0/1015792331 shutdown_connections 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 --2- 172.21.15.52:0/1015792331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c15c400 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 --2- 172.21.15.52:0/1015792331 >> v2:172.21.15.176:3300/0 conn(0x7f099c0b2d40 0x7f099c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 -- 172.21.15.52:0/1015792331 >> 172.21.15.52:0/1015792331 conn(0x7f099c0ccec0 msgr2=0x7f099c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 -- 172.21.15.52:0/1015792331 shutdown_connections 2024-09-10T08:33:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.010+0000 7f09a0c00640 1 -- 172.21.15.52:0/1015792331 wait complete. 2024-09-10T08:33:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.012+0000 7f09a0c00640 1 Processor -- start 2024-09-10T08:33:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.012+0000 7f09a0c00640 1 -- start start 2024-09-10T08:33:08.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 0x7f099c1f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 0x7f099c166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f099c0722d0 con 0x7f099c06c150 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f099c072150 con 0x7f099c13eb20 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f09a0c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f099c072450 con 0x7f099c0b2d40 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44226/0 (socket says 172.21.15.52:44226) 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 -- 172.21.15.52:0/31926441 learned_addr learned my addr 172.21.15.52:0/31926441 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f099a800640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 0x7f099c166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0993e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 0x7f099c1f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 -- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 msgr2=0x7f099c1f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 0x7f099c1f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 -- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 msgr2=0x7f099c166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 0x7f099c166b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0999e00640 1 -- 172.21.15.52:0/31926441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0b6550 con 0x7f099c06c150 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f099a800640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 0x7f099c166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.013+0000 7f0993e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 0x7f099c1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f0999e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f098c00d830 tx=0x7f098c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c00b6c0 con 0x7f099c06c150 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c019070 con 0x7f099c06c150 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c00ba80 con 0x7f099c06c150 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c168330 con 0x7f099c06c150 2024-09-10T08:33:08.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.014+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c167570 con 0x7f099c06c150 2024-09-10T08:33:08.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.015+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c06bc10 con 0x7f099c06c150 2024-09-10T08:33:08.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.016+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f098c01e460 con 0x7f099c06c150 2024-09-10T08:33:08.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.017+0000 7f0992000640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.017+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4857+0+0 (secure 0 0 0) 0x7f098c08b160 con 0x7f099c06c150 2024-09-10T08:33:08.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.018+0000 7f0993e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.018+0000 7f0993e00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f099c165ff0 tx=0x7f0984008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.021+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f099c0b6550 con 0x7f099c06c150 2024-09-10T08:33:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.206+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f099c06c9c0 con 0x7f099c06c150 2024-09-10T08:33:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.206+0000 7f0992000640 1 -- 172.21.15.52:0/31926441 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f098c059ef0 con 0x7f099c06c150 2024-09-10T08:33:08.206 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:08.207 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 msgr2=0x7f097806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 0x7f097806e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f099c165ff0 tx=0x7f0984008040 comp rx=0 tx=0).stop 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 msgr2=0x7f099c154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f098c00d830 tx=0x7f098c00dcf0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 shutdown_connections 2024-09-10T08:33:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f097806be30 0x7f097806e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.208+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f099c13eb20 0x7f099c166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.209+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f099c0b2d40 0x7f099c1f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.209+0000 7f09a0c00640 1 --2- 172.21.15.52:0/31926441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f099c06c150 0x7f099c154bb0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.209+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 >> 172.21.15.52:0/31926441 conn(0x7f099c0ccec0 msgr2=0x7f099c0ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.209+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 shutdown_connections 2024-09-10T08:33:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.209+0000 7f09a0c00640 1 -- 172.21.15.52:0/31926441 wait complete. 2024-09-10T08:33:08.226 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:33:08.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:33:08.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.390+0000 7fa09fe00640 1 Processor -- start 2024-09-10T08:33:08.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.390+0000 7fa09fe00640 1 -- start start 2024-09-10T08:33:08.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.391+0000 7fa09fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0a0161c60 0x7fa0a006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a00b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a0162040 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a006e240 con 0x7fa0a0161c60 2024-09-10T08:33:08.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a00d5040 con 0x7fa0a006de00 2024-09-10T08:33:08.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0a0161c60 0x7fa0a006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa096000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a00b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09f400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa0a00b7bf0 0x7fa0a00b8020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:54326/0 (socket says 172.21.15.52:54326) 2024-09-10T08:33:08.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09f400640 1 -- 172.21.15.52:0/2070705411 learned_addr learned my addr 172.21.15.52:0/2070705411 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09e000640 1 -- 172.21.15.52:0/2070705411 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427441890 0 0) 0x7fa0a0162040 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09e000640 1 -- 172.21.15.52:0/2070705411 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa084003520 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.392+0000 7fa09ea00640 1 -- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 msgr2=0x7fa0a00b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.393+0000 7fa09ea00640 1 --2- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a00b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.393+0000 7fa09ea00640 1 -- 172.21.15.52:0/2070705411 >> v1:172.21.15.176:6789/0 conn(0x7fa0a00b7bf0 legacy=0x7fa0a00b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.393+0000 7fa09ea00640 1 -- 172.21.15.52:0/2070705411 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a00d5320 con 0x7fa0a0161c60 2024-09-10T08:33:08.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09ea00640 1 --2- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a006d8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097a0 tx=0x7fa09002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ba3db6cb6ad2d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09e000640 1 -- 172.21.15.52:0/2070705411 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090037070 con 0x7fa0a0161c60 2024-09-10T08:33:08.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09e000640 1 -- 172.21.15.52:0/2070705411 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa090032440 con 0x7fa0a0161c60 2024-09-10T08:33:08.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09e000640 1 -- 172.21.15.52:0/2070705411 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090032810 con 0x7fa0a0161c60 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09fe00640 1 -- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 msgr2=0x7fa0a006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.394+0000 7fa09fe00640 1 --2- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a006d8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097a0 tx=0x7fa09002a180 comp rx=0 tx=0).stop 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 -- 172.21.15.52:0/2070705411 shutdown_connections 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 --2- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a00b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 --2- 172.21.15.52:0/2070705411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a006d8c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 -- 172.21.15.52:0/2070705411 >> 172.21.15.52:0/2070705411 conn(0x7fa0a00d1630 msgr2=0x7fa0a00d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:08.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 -- 172.21.15.52:0/2070705411 shutdown_connections 2024-09-10T08:33:08.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.395+0000 7fa09fe00640 1 -- 172.21.15.52:0/2070705411 wait complete. 2024-09-10T08:33:08.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.396+0000 7fa09fe00640 1 Processor -- start 2024-09-10T08:33:08.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.396+0000 7fa09fe00640 1 -- start start 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a00b8730 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a00cfc80 con 0x7fa0a0161c60 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.397+0000 7fa09fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a00d42c0 con 0x7fa0a006de00 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44232/0 (socket says 172.21.15.52:44232) 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 -- 172.21.15.52:0/1489495696 learned_addr learned my addr 172.21.15.52:0/1489495696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:08.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa09ea00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa09f400640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 -- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 msgr2=0x7fa0a015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 -- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 msgr2=0x7fa0a015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:08.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.398+0000 7fa096000640 1 -- 172.21.15.52:0/1489495696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a01e7b50 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa096000640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa08800e9b0 tx=0x7fa08800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088017070 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08800c9a0 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08800cd90 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a01e7e30 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.399+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a01e83f0 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.400+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a00c9380 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.401+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa08801a070 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.402+0000 7fa097400640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 0x7fa07c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:08.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.402+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4857+0+0 (secure 0 0 0) 0x7fa08808ae80 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.402+0000 7fa09ea00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 0x7fa07c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:08.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.403+0000 7fa09ea00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 0x7fa07c06e320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa090034000 tx=0x7fa09002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.406+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa088059490 con 0x7fa0a00b7bf0 2024-09-10T08:33:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:08.592+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa0a006e3f0 con 0x7fa0a00b7bf0 2024-09-10T08:33:09.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.399+0000 7fa097400640 1 -- 172.21.15.52:0/1489495696 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7fa08805d790 con 0x7fa0a00b7bf0 2024-09-10T08:33:09.400 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:33:09.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.403+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 msgr2=0x7fa07c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.403+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 0x7fa07c06e320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa090034000 tx=0x7fa09002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:09.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.403+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 msgr2=0x7fa0a00b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.403+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa08800e9b0 tx=0x7fa08800ee70 comp rx=0 tx=0).stop 2024-09-10T08:33:09.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 shutdown_connections 2024-09-10T08:33:09.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa07c06be60 0x7fa07c06e320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0a0161c60 0x7fa0a015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0a00b7bf0 0x7fa0a00b2b90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 --2- 172.21.15.52:0/1489495696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0a006de00 0x7fa0a015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 >> 172.21.15.52:0/1489495696 conn(0x7fa0a00d1630 msgr2=0x7fa0a00d1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:09.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 shutdown_connections 2024-09-10T08:33:09.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.404+0000 7fa09fe00640 1 -- 172.21.15.52:0/1489495696 wait complete. 2024-09-10T08:33:09.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:33:09.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.594+0000 7f8b8e600640 1 Processor -- start 2024-09-10T08:33:09.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.594+0000 7f8b8e600640 1 -- start start 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b8e600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 0x7f8b880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b8e600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b88071c70 0x7f8b880720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b8e600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b880714b0 con 0x7f8b880732e0 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b8e600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8b880cd880 con 0x7f8b88071c70 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b8e600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8b880cdb60 con 0x7f8b880cce30 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b87e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b88071c70 0x7f8b880720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b87400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8b880732e0 0x7f8b880736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39430/0 (socket says 172.21.15.52:39430) 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b87400640 1 -- 172.21.15.52:0/3894148060 learned_addr learned my addr 172.21.15.52:0/3894148060 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:09.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.595+0000 7f8b7fe00640 1 --2- 172.21.15.52:0/3894148060 >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 0x7f8b880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.596+0000 7f8b87e00640 1 -- 172.21.15.52:0/3894148060 >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 msgr2=0x7f8b880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.596+0000 7f8b87e00640 1 --2- 172.21.15.52:0/3894148060 >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 0x7f8b880cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.596+0000 7f8b87e00640 1 -- 172.21.15.52:0/3894148060 >> v1:172.21.15.52:6789/0 conn(0x7f8b880732e0 legacy=0x7f8b880736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.596+0000 7f8b87e00640 1 -- 172.21.15.52:0/3894148060 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b880cde40 con 0x7f8b88071c70 2024-09-10T08:33:09.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.596+0000 7f8b7fe00640 1 --2- 172.21.15.52:0/3894148060 >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 0x7f8b880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b87e00640 1 --2- 172.21.15.52:0/3894148060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b88071c70 0x7f8b880720c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c57f0 tx=0x7f8b8002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecc46d50f4c2bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b86a00640 1 -- 172.21.15.52:0/3894148060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80007740 con 0x7f8b88071c70 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b86a00640 1 -- 172.21.15.52:0/3894148060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b800078e0 con 0x7f8b88071c70 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b86a00640 1 -- 172.21.15.52:0/3894148060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80007cb0 con 0x7f8b88071c70 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b8e600640 1 -- 172.21.15.52:0/3894148060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b88071c70 msgr2=0x7f8b880720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.597+0000 7f8b8e600640 1 --2- 172.21.15.52:0/3894148060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b88071c70 0x7f8b880720c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8b880c57f0 tx=0x7f8b8002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 -- 172.21.15.52:0/3894148060 shutdown_connections 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 --2- 172.21.15.52:0/3894148060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b88071c70 0x7f8b880720c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 --2- 172.21.15.52:0/3894148060 >> v2:172.21.15.176:3300/0 conn(0x7f8b880cce30 0x7f8b880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 -- 172.21.15.52:0/3894148060 >> 172.21.15.52:0/3894148060 conn(0x7f8b8806d0f0 msgr2=0x7f8b8806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 -- 172.21.15.52:0/3894148060 shutdown_connections 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.598+0000 7f8b8e600640 1 -- 172.21.15.52:0/3894148060 wait complete. 2024-09-10T08:33:09.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.599+0000 7f8b8e600640 1 Processor -- start 2024-09-10T08:33:09.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.599+0000 7f8b8e600640 1 -- start start 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b88071c70 0x7f8b880afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b880cce30 0x7f8b880cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8815ca50 con 0x7f8b880732e0 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8815c8d0 con 0x7f8b880cce30 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b8e600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8815cbd0 con 0x7f8b88071c70 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.600+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44250/0 (socket says 172.21.15.52:44250) 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 -- 172.21.15.52:0/2662461062 learned_addr learned my addr 172.21.15.52:0/2662461062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b87e00640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b880cce30 0x7f8b880cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b87400640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b88071c70 0x7f8b880afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 -- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b88071c70 msgr2=0x7f8b880afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b88071c70 0x7f8b880afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 -- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b880cce30 msgr2=0x7f8b880cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b880cce30 0x7f8b880cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 -- 172.21.15.52:0/2662461062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b881506d0 con 0x7f8b880732e0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7fe00640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000d7d0 tx=0x7f8b7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70004030 con 0x7f8b880732e0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700041d0 con 0x7f8b880732e0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700096a0 con 0x7f8b880732e0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.601+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b881509b0 con 0x7f8b880732e0 2024-09-10T08:33:09.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.602+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b88150f70 con 0x7f8b880732e0 2024-09-10T08:33:09.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.603+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b880cd2a0 con 0x7f8b880732e0 2024-09-10T08:33:09.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.604+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b70009840 con 0x7f8b880732e0 2024-09-10T08:33:09.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.605+0000 7f8b7f400640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 0x7f8b6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:09.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.605+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5227+0+0 (secure 0 0 0) 0x7f8b7008afa0 con 0x7f8b880732e0 2024-09-10T08:33:09.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.605+0000 7f8b87400640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 0x7f8b6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:09.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.606+0000 7f8b87400640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 0x7f8b6406e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b78000f60 tx=0x7f8b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:09.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.610+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b70059b20 con 0x7f8b880732e0 2024-09-10T08:33:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:09.794+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8b8815b970 con 0x7f8b880732e0 2024-09-10T08:33:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.406+0000 7f8b7f400640 1 -- 172.21.15.52:0/2662461062 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7f8b70059420 con 0x7f8b880732e0 2024-09-10T08:33:10.406 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 msgr2=0x7f8b6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 0x7f8b6406e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b78000f60 tx=0x7f8b78009040 comp rx=0 tx=0).stop 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 msgr2=0x7f8b880b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000d7d0 tx=0x7f8b7000dc90 comp rx=0 tx=0).stop 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 shutdown_connections 2024-09-10T08:33:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b6406be30 0x7f8b6406e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b880cce30 0x7f8b880cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b880732e0 0x7f8b880b1c80 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 --2- 172.21.15.52:0/2662461062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b88071c70 0x7f8b880afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 >> 172.21.15.52:0/2662461062 conn(0x7f8b8806d0f0 msgr2=0x7f8b880b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 shutdown_connections 2024-09-10T08:33:10.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.410+0000 7f8b8e600640 1 -- 172.21.15.52:0/2662461062 wait complete. 2024-09-10T08:33:10.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:33:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.601+0000 7ff9ece00640 1 Processor -- start 2024-09-10T08:33:10.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.601+0000 7ff9ece00640 1 -- start start 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9ece00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9e80cce30 0x7ff9e80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9ece00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9e8071c70 0x7ff9e80720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9ece00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e80714b0 con 0x7ff9e80732e0 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9ece00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80cd880 con 0x7ff9e80cce30 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9ece00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e80cdb60 con 0x7ff9e8071c70 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9e5e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff9e80732e0 0x7ff9e80736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39438/0 (socket says 172.21.15.52:39438) 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9e5e00640 1 -- 172.21.15.52:0/638959803 learned_addr learned my addr 172.21.15.52:0/638959803 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9dd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9e80cce30 0x7ff9e80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9e6800640 1 --2- 172.21.15.52:0/638959803 >> v2:172.21.15.176:3300/0 conn(0x7ff9e8071c70 0x7ff9e80720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9dd400640 1 -- 172.21.15.52:0/638959803 >> v2:172.21.15.176:3300/0 conn(0x7ff9e8071c70 msgr2=0x7ff9e80720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9e5400640 1 -- 172.21.15.52:0/638959803 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847827870 0 0) 0x7ff9e80714b0 con 0x7ff9e80732e0 2024-09-10T08:33:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9dd400640 1 --2- 172.21.15.52:0/638959803 >> v2:172.21.15.176:3300/0 conn(0x7ff9e8071c70 0x7ff9e80720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9dd400640 1 -- 172.21.15.52:0/638959803 >> v1:172.21.15.52:6789/0 conn(0x7ff9e80732e0 legacy=0x7ff9e80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.603+0000 7ff9dd400640 1 -- 172.21.15.52:0/638959803 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80cde40 con 0x7ff9e80cce30 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.604+0000 7ff9dd400640 1 --2- 172.21.15.52:0/638959803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e80cce30 0x7ff9e80cd2a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8074330 tx=0x7ff9d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1118f64ab73fa439 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9e5400640 1 -- 172.21.15.52:0/638959803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0037070 con 0x7ff9e80cce30 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9e5400640 1 -- 172.21.15.52:0/638959803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d0032440 con 0x7ff9e80cce30 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9e5400640 1 -- 172.21.15.52:0/638959803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d002ae60 con 0x7ff9e80cce30 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 -- 172.21.15.52:0/638959803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e80cce30 msgr2=0x7ff9e80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 --2- 172.21.15.52:0/638959803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e80cce30 0x7ff9e80cd2a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8074330 tx=0x7ff9d002a110 comp rx=0 tx=0).stop 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 -- 172.21.15.52:0/638959803 shutdown_connections 2024-09-10T08:33:10.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 --2- 172.21.15.52:0/638959803 >> v2:172.21.15.176:3300/0 conn(0x7ff9e8071c70 0x7ff9e80720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 --2- 172.21.15.52:0/638959803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e80cce30 0x7ff9e80cd2a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 -- 172.21.15.52:0/638959803 >> 172.21.15.52:0/638959803 conn(0x7ff9e806d0f0 msgr2=0x7ff9e806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 -- 172.21.15.52:0/638959803 shutdown_connections 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.605+0000 7ff9ece00640 1 -- 172.21.15.52:0/638959803 wait complete. 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.607+0000 7ff9ece00640 1 Processor -- start 2024-09-10T08:33:10.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.607+0000 7ff9ece00640 1 -- start start 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 0x7ff9e81f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 0x7ff9e81e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e815ca50 con 0x7ff9e8071c70 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e815c8d0 con 0x7ff9e80732e0 2024-09-10T08:33:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9ece00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e815cbd0 con 0x7ff9e80cce30 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9e5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9e5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44274/0 (socket says 172.21.15.52:44274) 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.608+0000 7ff9e5e00640 1 -- 172.21.15.52:0/605285510 learned_addr learned my addr 172.21.15.52:0/605285510 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e6800640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 0x7ff9e81e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9dd400640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 0x7ff9e81f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 -- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 msgr2=0x7ff9e81e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 0x7ff9e81e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 -- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 msgr2=0x7ff9e81f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 0x7ff9e81f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 -- 172.21.15.52:0/605285510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e80cf180 con 0x7ff9e8071c70 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9dd400640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 0x7ff9e81f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e6800640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 0x7ff9e81e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:10.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9e5e00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c500 tx=0x7ff9d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8018070 con 0x7ff9e8071c70 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d8007580 con 0x7ff9e8071c70 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8004a20 con 0x7ff9e8071c70 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.609+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e80cf420 con 0x7ff9e8071c70 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.610+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e81e6570 con 0x7ff9e8071c70 2024-09-10T08:33:10.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.610+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e81e6360 con 0x7ff9e8071c70 2024-09-10T08:33:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.612+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9d801b070 con 0x7ff9e8071c70 2024-09-10T08:33:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.613+0000 7ff9dea00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.613+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5609+0+0 (secure 0 0 0) 0x7ff9d808a470 con 0x7ff9e8071c70 2024-09-10T08:33:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.613+0000 7ff9dd400640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:10.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.614+0000 7ff9dd400640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034000 tx=0x7ff9d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:10.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.617+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9d8058ef0 con 0x7ff9e8071c70 2024-09-10T08:33:10.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:10.839+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff9e80cd2a0 con 0x7ff9e8071c70 2024-09-10T08:33:11.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.408+0000 7ff9dea00640 1 -- 172.21.15.52:0/605285510 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v46) ==== 174+0+0 (secure 0 0 0) 0x7ff9d80587f0 con 0x7ff9e8071c70 2024-09-10T08:33:11.409 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 10 and data pool 11 2024-09-10T08:33:11.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.414+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 msgr2=0x7ff9c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.414+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 0x7ff9c406e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0034000 tx=0x7ff9d002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:11.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.414+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 msgr2=0x7ff9e80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.414+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c500 tx=0x7ff9d800c9c0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 shutdown_connections 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9c406be30 0x7ff9c406e2f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e80cce30 0x7ff9e81e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e80732e0 0x7ff9e81f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 --2- 172.21.15.52:0/605285510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8071c70 0x7ff9e80ca9d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.415+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 >> 172.21.15.52:0/605285510 conn(0x7ff9e806d0f0 msgr2=0x7ff9e815d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.418+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 shutdown_connections 2024-09-10T08:33:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.418+0000 7ff9ece00640 1 -- 172.21.15.52:0/605285510 wait complete. 2024-09-10T08:33:11.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:11.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.612+0000 7f2589e00640 1 Processor -- start 2024-09-10T08:33:11.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.612+0000 7f2589e00640 1 -- start start 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2589e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2584145ed0 0x7f25840b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2589e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f25840735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2589e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25840b4020 con 0x7f25840b5880 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2589e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2584073b00 con 0x7f2584145ed0 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2589e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f25840b42c0 con 0x7f2584073180 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.613+0000 7f2582a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2584145ed0 0x7f25840b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2584145ed0 0x7f25840b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44282/0 (socket says 172.21.15.52:44282) 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 -- 172.21.15.52:0/168158021 learned_addr learned my addr 172.21.15.52:0/168158021 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582000640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f25840735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 -- 172.21.15.52:0/168158021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 msgr2=0x7f25840735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f25840735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 -- 172.21.15.52:0/168158021 >> v1:172.21.15.176:6789/0 conn(0x7f25840b5880 legacy=0x7f25840b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.614+0000 7f2582a00640 1 -- 172.21.15.52:0/168158021 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25840b45a0 con 0x7f2584145ed0 2024-09-10T08:33:11.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.615+0000 7f2582a00640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2584145ed0 0x7f25840b5080 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2574009870 tx=0x7f257402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609fade4a425dce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:11.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.615+0000 7f2581600640 1 -- 172.21.15.52:0/168158021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574037070 con 0x7f2584145ed0 2024-09-10T08:33:11.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.615+0000 7f2581600640 1 -- 172.21.15.52:0/168158021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2574032440 con 0x7f2584145ed0 2024-09-10T08:33:11.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.615+0000 7f2581600640 1 -- 172.21.15.52:0/168158021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574032810 con 0x7f2584145ed0 2024-09-10T08:33:11.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 -- 172.21.15.52:0/168158021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2584145ed0 msgr2=0x7f25840b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2584145ed0 0x7f25840b5080 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2574009870 tx=0x7f257402a270 comp rx=0 tx=0).stop 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 -- 172.21.15.52:0/168158021 shutdown_connections 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f25840735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 --2- 172.21.15.52:0/168158021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2584145ed0 0x7f25840b5080 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 -- 172.21.15.52:0/168158021 >> 172.21.15.52:0/168158021 conn(0x7f25840ccec0 msgr2=0x7f25840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 -- 172.21.15.52:0/168158021 shutdown_connections 2024-09-10T08:33:11.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.616+0000 7f2589e00640 1 -- 172.21.15.52:0/168158021 wait complete. 2024-09-10T08:33:11.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.618+0000 7f2589e00640 1 Processor -- start 2024-09-10T08:33:11.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.618+0000 7f2589e00640 1 -- start start 2024-09-10T08:33:11.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f258413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2584145ed0 0x7f25841591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f25841462b0 con 0x7f25840b5880 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25840b4b60 con 0x7f2584145ed0 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2589e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2584146430 con 0x7f2584073180 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44284/0 (socket says 172.21.15.52:44284) 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 -- 172.21.15.52:0/2895123442 learned_addr learned my addr 172.21.15.52:0/2895123442 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2583400640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2584145ed0 0x7f25841591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582a00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f258413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 -- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 msgr2=0x7f258413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f258413c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 -- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2584145ed0 msgr2=0x7f25841591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2584145ed0 0x7f25841591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.619+0000 7f2582000640 1 -- 172.21.15.52:0/2895123442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2584141b50 con 0x7f25840b5880 2024-09-10T08:33:11.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f2582000640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f257000e9e0 tx=0x7f257000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570017070 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257000c9d0 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2584142930 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257000cdc0 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.620+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258413dcb0 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.621+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25840735c0 con 0x7f25840b5880 2024-09-10T08:33:11.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.622+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f257001a070 con 0x7f25840b5880 2024-09-10T08:33:11.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.623+0000 7f257b400640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 0x7f256406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.623+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f257008b240 con 0x7f25840b5880 2024-09-10T08:33:11.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.623+0000 7f2582a00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 0x7f256406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.624+0000 7f2582a00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 0x7f256406e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2574034000 tx=0x7f257402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:11.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.627+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2570059be0 con 0x7f25840b5880 2024-09-10T08:33:11.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.811+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2584141d20 con 0x7f25840b5880 2024-09-10T08:33:11.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.812+0000 7f257b400640 1 -- 172.21.15.52:0/2895123442 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16693 (secure 0 0 0) 0x7f25700594e0 con 0x7f25840b5880 2024-09-10T08:33:11.813 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:11.813 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:10.841040+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:08.635125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:09.836766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 msgr2=0x7f256406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 0x7f256406e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2574034000 tx=0x7f257402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 msgr2=0x7f2584141f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f257000e9e0 tx=0x7f257000eea0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 shutdown_connections 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f256406be30 0x7f256406e2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2584145ed0 0x7f25841591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f25840b5880 0x7f2584141f40 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 --2- 172.21.15.52:0/2895123442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2584073180 0x7f258413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 >> 172.21.15.52:0/2895123442 conn(0x7f25840ccec0 msgr2=0x7f2584143ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 shutdown_connections 2024-09-10T08:33:11.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.814+0000 7f2589e00640 1 -- 172.21.15.52:0/2895123442 wait complete. 2024-09-10T08:33:11.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.987+0000 7f006b400640 1 Processor -- start 2024-09-10T08:33:11.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.988+0000 7f006b400640 1 -- start start 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f006b400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0064147e80 0x7f0064070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f006b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0064148260 0x7f00640714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f006b400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0064071b30 con 0x7f006406bc10 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f006b400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0064074200 con 0x7f0064148260 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f006b400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f00640b3e40 con 0x7f0064147e80 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f005be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0064148260 0x7f00640714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f005be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0064148260 0x7f00640714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44292/0 (socket says 172.21.15.52:44292) 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f005be00640 1 -- 172.21.15.52:0/1220383128 learned_addr learned my addr 172.21.15.52:0/1220383128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:11.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.989+0000 7f0068a00640 1 --2- 172.21.15.52:0/1220383128 >> v2:172.21.15.176:3300/0 conn(0x7f0064147e80 0x7f0064070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.990+0000 7f005be00640 1 -- 172.21.15.52:0/1220383128 >> v2:172.21.15.176:3300/0 conn(0x7f0064147e80 msgr2=0x7f0064070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.990+0000 7f005be00640 1 --2- 172.21.15.52:0/1220383128 >> v2:172.21.15.176:3300/0 conn(0x7f0064147e80 0x7f0064070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.990+0000 7f005be00640 1 -- 172.21.15.52:0/1220383128 >> v1:172.21.15.176:6789/0 conn(0x7f006406bc10 legacy=0x7f00641623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:11.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.990+0000 7f005be00640 1 -- 172.21.15.52:0/1220383128 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00640b3510 con 0x7f0064148260 2024-09-10T08:33:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f005be00640 1 --2- 172.21.15.52:0/1220383128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064148260 0x7f00640714b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f00640d1500 tx=0x7f004c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2541e55f9a712 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f0063e00640 1 -- 172.21.15.52:0/1220383128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c037070 con 0x7f0064148260 2024-09-10T08:33:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f0063e00640 1 -- 172.21.15.52:0/1220383128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c032440 con 0x7f0064148260 2024-09-10T08:33:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f0063e00640 1 -- 172.21.15.52:0/1220383128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c032810 con 0x7f0064148260 2024-09-10T08:33:11.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f006b400640 1 -- 172.21.15.52:0/1220383128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064148260 msgr2=0x7f00640714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.991+0000 7f006b400640 1 --2- 172.21.15.52:0/1220383128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064148260 0x7f00640714b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f00640d1500 tx=0x7f004c02a270 comp rx=0 tx=0).stop 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 -- 172.21.15.52:0/1220383128 shutdown_connections 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 --2- 172.21.15.52:0/1220383128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064148260 0x7f00640714b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 --2- 172.21.15.52:0/1220383128 >> v2:172.21.15.176:3300/0 conn(0x7f0064147e80 0x7f0064070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 -- 172.21.15.52:0/1220383128 >> 172.21.15.52:0/1220383128 conn(0x7f00640ccec0 msgr2=0x7f00640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 -- 172.21.15.52:0/1220383128 shutdown_connections 2024-09-10T08:33:11.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.992+0000 7f006b400640 1 -- 172.21.15.52:0/1220383128 wait complete. 2024-09-10T08:33:11.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.993+0000 7f006b400640 1 Processor -- start 2024-09-10T08:33:11.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.993+0000 7f006b400640 1 -- start start 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0064147e80 0x7f0064141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0064148260 0x7f0064140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00640b52e0 con 0x7f006406bc10 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f00640b3ad0 con 0x7f0064147e80 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.994+0000 7f006b400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f00640b5460 con 0x7f0064148260 2024-09-10T08:33:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44302/0 (socket says 172.21.15.52:44302) 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 -- 172.21.15.52:0/263306904 learned_addr learned my addr 172.21.15.52:0/263306904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f005be00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0064147e80 0x7f0064141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0069400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0064148260 0x7f0064140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 -- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0064148260 msgr2=0x7f0064140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0064148260 0x7f0064140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 -- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0064147e80 msgr2=0x7f0064141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0064147e80 0x7f0064141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.995+0000 7f0068a00640 1 -- 172.21.15.52:0/263306904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0064142070 con 0x7f006406bc10 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f0068a00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f005400d800 tx=0x7f005400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005400b6c0 con 0x7f006406bc10 2024-09-10T08:33:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0054019070 con 0x7f006406bc10 2024-09-10T08:33:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0064142350 con 0x7f006406bc10 2024-09-10T08:33:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005400ba80 con 0x7f006406bc10 2024-09-10T08:33:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.996+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0064142910 con 0x7f006406bc10 2024-09-10T08:33:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.997+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064145570 con 0x7f006406bc10 2024-09-10T08:33:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.998+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f005400bc20 con 0x7f006406bc10 2024-09-10T08:33:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.999+0000 7f0061600640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 0x7f004006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.999+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f005408b270 con 0x7f006406bc10 2024-09-10T08:33:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:11.999+0000 7f005be00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 0x7f004006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.000+0000 7f005be00640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 0x7f004006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f004c034000 tx=0x7f004c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.003+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0054059530 con 0x7f006406bc10 2024-09-10T08:33:12.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.187+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0064145290 con 0x7f006406bc10 2024-09-10T08:33:12.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.188+0000 7f0061600640 1 -- 172.21.15.52:0/263306904 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16693 (secure 0 0 0) 0x7f005405d830 con 0x7f006406bc10 2024-09-10T08:33:12.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:12.189 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:10.841040+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:08.635125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:09.836766+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 msgr2=0x7f004006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 0x7f004006e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f004c034000 tx=0x7f004c02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 msgr2=0x7f00641e6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f005400d800 tx=0x7f005400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 shutdown_connections 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f004006be30 0x7f004006e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0064148260 0x7f0064140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0064147e80 0x7f0064141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 --2- 172.21.15.52:0/263306904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f006406bc10 0x7f00641e6590 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 >> 172.21.15.52:0/263306904 conn(0x7f00640ccec0 msgr2=0x7f00640b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 shutdown_connections 2024-09-10T08:33:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.191+0000 7f006b400640 1 -- 172.21.15.52:0/263306904 wait complete. 2024-09-10T08:33:12.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:33:12.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.365+0000 7f4456a00640 1 Processor -- start 2024-09-10T08:33:12.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.365+0000 7f4456a00640 1 -- start start 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4456a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44500ccf30 0x7f44500b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4456a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44500cf2e0 con 0x7f445015b7c0 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4456a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4450070fe0 con 0x7f44500cead0 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4456a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f44500712c0 con 0x7f44500ccf30 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4447e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f445015b7c0 0x7f44500cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39444/0 (socket says 172.21.15.52:39444) 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f444fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44500ccf30 0x7f44500b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f4447e00640 1 -- 172.21.15.52:0/2418449759 learned_addr learned my addr 172.21.15.52:0/2418449759 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.367+0000 7f444fe00640 1 -- 172.21.15.52:0/2418449759 >> v1:172.21.15.176:6789/0 conn(0x7f44500cead0 legacy=0x7f4450071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.368+0000 7f444fe00640 1 -- 172.21.15.52:0/2418449759 >> v1:172.21.15.52:6789/0 conn(0x7f445015b7c0 legacy=0x7f44500cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.368+0000 7f444fe00640 1 -- 172.21.15.52:0/2418449759 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44500715a0 con 0x7f44500ccf30 2024-09-10T08:33:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.368+0000 7f444f400640 1 -- 172.21.15.52:0/2418449759 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364228515 0 0) 0x7f44500cf2e0 con 0x7f445015b7c0 2024-09-10T08:33:12.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f444fe00640 1 --2- 172.21.15.52:0/2418449759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44500b2c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f44400097a0 tx=0x7f444002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33d3ce9a5e1dd0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:12.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f444f400640 1 -- 172.21.15.52:0/2418449759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440037070 con 0x7f44500ccf30 2024-09-10T08:33:12.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f444f400640 1 -- 172.21.15.52:0/2418449759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444002ae50 con 0x7f44500ccf30 2024-09-10T08:33:12.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f444f400640 1 -- 172.21.15.52:0/2418449759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440032660 con 0x7f44500ccf30 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f4456a00640 1 -- 172.21.15.52:0/2418449759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 msgr2=0x7f44500b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f4456a00640 1 --2- 172.21.15.52:0/2418449759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44500b2c50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f44400097a0 tx=0x7f444002a140 comp rx=0 tx=0).stop 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f4456a00640 1 -- 172.21.15.52:0/2418449759 shutdown_connections 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f4456a00640 1 --2- 172.21.15.52:0/2418449759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44500b2c50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.369+0000 7f4456a00640 1 -- 172.21.15.52:0/2418449759 >> 172.21.15.52:0/2418449759 conn(0x7f445006d0f0 msgr2=0x7f445006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:12.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.370+0000 7f4456a00640 1 -- 172.21.15.52:0/2418449759 shutdown_connections 2024-09-10T08:33:12.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.370+0000 7f4456a00640 1 -- 172.21.15.52:0/2418449759 wait complete. 2024-09-10T08:33:12.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.371+0000 7f4456a00640 1 Processor -- start 2024-09-10T08:33:12.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.371+0000 7f4456a00640 1 -- start start 2024-09-10T08:33:12.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:12.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44500cead0 0x7f445013de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:12.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 0x7f445013aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44500cf080 con 0x7f44500ccf30 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44500cef00 con 0x7f445015b7c0 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f4456a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44500721d0 con 0x7f44500cead0 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f444fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f444fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44322/0 (socket says 172.21.15.52:44322) 2024-09-10T08:33:12.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.372+0000 7f444fe00640 1 -- 172.21.15.52:0/390060489 learned_addr learned my addr 172.21.15.52:0/390060489 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 -- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44500cead0 msgr2=0x7f445013de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44500cead0 0x7f445013de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 -- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 msgr2=0x7f445013aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f4454a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 0x7f445013aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 0x7f445013aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 -- 172.21.15.52:0/390060489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445013b420 con 0x7f44500ccf30 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f4454a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 0x7f445013aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444fe00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f44400097a0 tx=0x7f44400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440042070 con 0x7f44500ccf30 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444003e670 con 0x7f44500ccf30 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440037040 con 0x7f44500ccf30 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.373+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445013e360 con 0x7f44500ccf30 2024-09-10T08:33:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.374+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44501f5550 con 0x7f44500ccf30 2024-09-10T08:33:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.375+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44500b2c50 con 0x7f44500ccf30 2024-09-10T08:33:12.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.375+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4440045070 con 0x7f44500ccf30 2024-09-10T08:33:12.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.376+0000 7f444cc00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 0x7f442c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:12.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.376+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5709+0+0 (secure 0 0 0) 0x7f44400ab930 con 0x7f44500ccf30 2024-09-10T08:33:12.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.377+0000 7f4447e00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 0x7f442c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:12.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.377+0000 7f4447e00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 0x7f442c06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4438007fd0 tx=0x7f4438007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:12.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.380+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f445013e360 con 0x7f44500ccf30 2024-09-10T08:33:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:12.602+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f44500cc960 con 0x7f44500ccf30 2024-09-10T08:33:13.387 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:33:13.387+0000 7f20e4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:33:13.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.434+0000 7f444cc00640 1 -- 172.21.15.52:0/390060489 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) ==== 118+0+0 (secure 0 0 0) 0x7f444007a360 con 0x7f44500ccf30 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 msgr2=0x7f442c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 0x7f442c06e2f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4438007fd0 tx=0x7f4438007960 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 msgr2=0x7f44501f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f44400097a0 tx=0x7f44400046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 shutdown_connections 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f442c06be30 0x7f442c06e2f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f445015b7c0 0x7f445013aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44500cead0 0x7f445013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 --2- 172.21.15.52:0/390060489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44500ccf30 0x7f44501f4940 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 >> 172.21.15.52:0/390060489 conn(0x7f445006d0f0 msgr2=0x7f44501566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.437+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 shutdown_connections 2024-09-10T08:33:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.438+0000 7f4456a00640 1 -- 172.21.15.52:0/390060489 wait complete. 2024-09-10T08:33:13.457 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:33:13.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:33:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.621+0000 7f411da00640 1 Processor -- start 2024-09-10T08:33:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.621+0000 7f411da00640 1 -- start start 2024-09-10T08:33:13.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.622+0000 7f411da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 0x7f41180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.622+0000 7f411da00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41180cf2e0 con 0x7f41180ccf30 2024-09-10T08:33:13.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.622+0000 7f411da00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4118070fe0 con 0x7f411815b7c0 2024-09-10T08:33:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.622+0000 7f411da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41180712c0 con 0x7f4118072ad0 2024-09-10T08:33:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4116a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f41180ccf30 0x7f41180cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39458/0 (socket says 172.21.15.52:39458) 2024-09-10T08:33:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4116a00640 1 -- 172.21.15.52:0/3746959716 learned_addr learned my addr 172.21.15.52:0/3746959716 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4117400640 1 --2- 172.21.15.52:0/3746959716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 0x7f41180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031981838 0 0) 0x7f41180cf2e0 con 0x7f41180ccf30 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc003520 con 0x7f41180ccf30 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4117400640 1 -- 172.21.15.52:0/3746959716 >> v1:172.21.15.176:6789/0 conn(0x7f411815b7c0 legacy=0x7f41180cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3047324896 0 0) 0x7f40fc003520 con 0x7f41180ccf30 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4117400640 1 -- 172.21.15.52:0/3746959716 >> v1:172.21.15.52:6789/0 conn(0x7f41180ccf30 legacy=0x7f41180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.623+0000 7f4117400640 1 -- 172.21.15.52:0/3746959716 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41180715a0 con 0x7f4118072ad0 2024-09-10T08:33:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.624+0000 7f4117400640 1 --2- 172.21.15.52:0/3746959716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 0x7f41180b2c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4110009dc0 tx=0x7f411002c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ad2ada64fc32544 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110037020 con 0x7f4118072ad0 2024-09-10T08:33:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4110007540 con 0x7f4118072ad0 2024-09-10T08:33:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f4116000640 1 -- 172.21.15.52:0/3746959716 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108001670 con 0x7f4118072ad0 2024-09-10T08:33:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f411da00640 1 -- 172.21.15.52:0/3746959716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 msgr2=0x7f41180b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f411da00640 1 --2- 172.21.15.52:0/3746959716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 0x7f41180b2c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4110009dc0 tx=0x7f411002c710 comp rx=0 tx=0).stop 2024-09-10T08:33:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f411da00640 1 -- 172.21.15.52:0/3746959716 shutdown_connections 2024-09-10T08:33:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f411da00640 1 --2- 172.21.15.52:0/3746959716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4118072ad0 0x7f41180b2c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.625+0000 7f411da00640 1 -- 172.21.15.52:0/3746959716 >> 172.21.15.52:0/3746959716 conn(0x7f411806d0f0 msgr2=0x7f411806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.626+0000 7f411da00640 1 -- 172.21.15.52:0/3746959716 shutdown_connections 2024-09-10T08:33:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.626+0000 7f411da00640 1 -- 172.21.15.52:0/3746959716 wait complete. 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.627+0000 7f411da00640 1 Processor -- start 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.627+0000 7f411da00640 1 -- start start 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118072ad0 0x7f411815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 0x7f411814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f411806bd90 con 0x7f41180ccf30 2024-09-10T08:33:13.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f411806bc10 con 0x7f4118072ad0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f411da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f411806bf10 con 0x7f411815b7c0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f410e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f410e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44324/0 (socket says 172.21.15.52:44324) 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.628+0000 7f410e000640 1 -- 172.21.15.52:0/795224030 learned_addr learned my addr 172.21.15.52:0/795224030 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f4116a00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118072ad0 0x7f411815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f4117400640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 0x7f411814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 -- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 msgr2=0x7f411814f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 0x7f411814f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 -- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118072ad0 msgr2=0x7f411815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118072ad0 0x7f411815a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 -- 172.21.15.52:0/795224030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411814fb80 con 0x7f41180ccf30 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f4117400640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 0x7f411814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:13.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410e000640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f410000c460 tx=0x7f410000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100017070 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41000035f0 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000039e0 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411814f8a0 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.629+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4118150150 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.630+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41180b2c50 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.631+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f410001a070 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.632+0000 7f410f400640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 0x7f40f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.632+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f410008a280 con 0x7f41180ccf30 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.633+0000 7f4116a00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 0x7f40f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.633+0000 7f4116a00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 0x7f40f406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4108001eb0 tx=0x7f4108001570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.637+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4100058b90 con 0x7f41180ccf30 2024-09-10T08:33:13.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:13.857+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f41180cc960 con 0x7f41180ccf30 2024-09-10T08:33:14.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.441+0000 7f410f400640 1 -- 172.21.15.52:0/795224030 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7f4100001110 con 0x7f41180ccf30 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 msgr2=0x7f40f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 0x7f40f406e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4108001eb0 tx=0x7f4108001570 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 msgr2=0x7f411814ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f410000c460 tx=0x7f410000c920 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 shutdown_connections 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40f406be30 0x7f40f406e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411815b7c0 0x7f411814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41180ccf30 0x7f411814ed30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 --2- 172.21.15.52:0/795224030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4118072ad0 0x7f411815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 >> 172.21.15.52:0/795224030 conn(0x7f411806d0f0 msgr2=0x7f411815f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.444+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 shutdown_connections 2024-09-10T08:33:14.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.445+0000 7f411da00640 1 -- 172.21.15.52:0/795224030 wait complete. 2024-09-10T08:33:14.463 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:33:14.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.623+0000 7f17fa600640 1 Processor -- start 2024-09-10T08:33:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.623+0000 7f17fa600640 1 -- start start 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.624+0000 7f17fa600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 0x7f17f40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.624+0000 7f17fa600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17f40b5f90 0x7f17f40735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.624+0000 7f17fa600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f40b4020 con 0x7f17f4073180 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.624+0000 7f17fa600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f17f4073b00 con 0x7f17f40b5f90 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.624+0000 7f17fa600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40b42c0 con 0x7f17f4145ed0 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17f40b5f90 0x7f17f40735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f2a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f17f4073180 0x7f17f40b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59614/0 (socket says 172.21.15.52:59614) 2024-09-10T08:33:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f2a00640 1 -- 172.21.15.52:0/2801624291 learned_addr learned my addr 172.21.15.52:0/2801624291 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3400640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 0x7f17f40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3e00640 1 -- 172.21.15.52:0/2801624291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 msgr2=0x7f17f40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3e00640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 0x7f17f40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3e00640 1 -- 172.21.15.52:0/2801624291 >> v1:172.21.15.52:6789/0 conn(0x7f17f4073180 legacy=0x7f17f40b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3e00640 1 -- 172.21.15.52:0/2801624291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40b45a0 con 0x7f17f40b5f90 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f2000640 1 -- 172.21.15.52:0/2801624291 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517599024 0 0) 0x7f17f40b4020 con 0x7f17f4073180 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.625+0000 7f17f3400640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 0x7f17f40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.626+0000 7f17f3e00640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f40b5f90 0x7f17f40735c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c8c154e8f81f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.626+0000 7f17f2000640 1 -- 172.21.15.52:0/2801624291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007740 con 0x7f17f40b5f90 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.626+0000 7f17f2000640 1 -- 172.21.15.52:0/2801624291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0078e0 con 0x7f17f40b5f90 2024-09-10T08:33:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.626+0000 7f17f2000640 1 -- 172.21.15.52:0/2801624291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007cb0 con 0x7f17f40b5f90 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 -- 172.21.15.52:0/2801624291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f40b5f90 msgr2=0x7f17f40735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f40b5f90 0x7f17f40735c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec02a660 comp rx=0 tx=0).stop 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 -- 172.21.15.52:0/2801624291 shutdown_connections 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f40b5f90 0x7f17f40735c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 --2- 172.21.15.52:0/2801624291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4145ed0 0x7f17f40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 -- 172.21.15.52:0/2801624291 >> 172.21.15.52:0/2801624291 conn(0x7f17f40ccec0 msgr2=0x7f17f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 -- 172.21.15.52:0/2801624291 shutdown_connections 2024-09-10T08:33:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.627+0000 7f17fa600640 1 -- 172.21.15.52:0/2801624291 wait complete. 2024-09-10T08:33:14.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.628+0000 7f17fa600640 1 Processor -- start 2024-09-10T08:33:14.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.629+0000 7f17fa600640 1 -- start start 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.629+0000 7f17fa600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4073180 0x7f17f413d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.629+0000 7f17fa600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 0x7f17f413f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17fa600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17fa600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41462b0 con 0x7f17f4145ed0 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17fa600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40b4b60 con 0x7f17f40b5f90 2024-09-10T08:33:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17fa600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17f4146430 con 0x7f17f4073180 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46704/0 (socket says 172.21.15.52:46704) 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 -- 172.21.15.52:0/1118322241 learned_addr learned my addr 172.21.15.52:0/1118322241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3400640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4073180 0x7f17f413d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f2a00640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 0x7f17f413f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 -- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4073180 msgr2=0x7f17f413d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4073180 0x7f17f413d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 -- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 msgr2=0x7f17f413f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 0x7f17f413f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f3e00640 1 -- 172.21.15.52:0/1118322241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f413d760 con 0x7f17f4145ed0 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.630+0000 7f17f2a00640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 0x7f17f413f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17f3e00640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec040070 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec031c90 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec03c640 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f40cbce0 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.631+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f40cc2a0 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.632+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40735c0 con 0x7f17f4145ed0 2024-09-10T08:33:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.633+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17ec039040 con 0x7f17f4145ed0 2024-09-10T08:33:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.634+0000 7f17eb400640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.634+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f17ec0ac1f0 con 0x7f17f4145ed0 2024-09-10T08:33:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.634+0000 7f17f3400640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:14.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.635+0000 7f17f3400640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 0x7f17d406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17e400a930 tx=0x7f17e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:14.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.638+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17ec039330 con 0x7f17f4145ed0 2024-09-10T08:33:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.861+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f40b29f0 con 0x7f17f4145ed0 2024-09-10T08:33:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.862+0000 7f17eb400640 1 -- 172.21.15.52:0/1118322241 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5228 (secure 0 0 0) 0x7f17ec07abc0 con 0x7f17f4145ed0 2024-09-10T08:33:14.862 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:14.862 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":50,"btime":"2024-09-10T08:33:14:436162+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1578598331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1578598331},{"type":"v1","addr":"172.21.15.176:6837","nonce":1578598331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1182188200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1182188200},{"type":"v1","addr":"172.21.15.52:6835","nonce":1182188200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6298,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1714870234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1714870234},{"type":"v1","addr":"172.21.15.176:6836","nonce":1714870234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:13.858530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/177160853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":177160853},{"type":"v1","addr":"172.21.15.52:6834","nonce":177160853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6642,"qdb_cluster":[6642]},"id":5}]} 2024-09-10T08:33:14.863 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 50 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 msgr2=0x7f17d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 0x7f17d406e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17e400a930 tx=0x7f17e4008040 comp rx=0 tx=0).stop 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 msgr2=0x7f17f413fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 shutdown_connections 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17d406be30 0x7f17d406e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17f4145ed0 0x7f17f413fdf0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17f40b5f90 0x7f17f413f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 --2- 172.21.15.52:0/1118322241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17f4073180 0x7f17f413d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.864+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 >> 172.21.15.52:0/1118322241 conn(0x7f17f40ccec0 msgr2=0x7f17f40cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.865+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 shutdown_connections 2024-09-10T08:33:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:14.865+0000 7f17fa600640 1 -- 172.21.15.52:0/1118322241 wait complete. 2024-09-10T08:33:14.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:15.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.037+0000 7f3c1e000640 1 Processor -- start 2024-09-10T08:33:15.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.037+0000 7f3c1e000640 1 -- start start 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.038+0000 7f3c1e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c1815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.038+0000 7f3c1e000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c1813eb20 0x7f3c1815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.038+0000 7f3c1e000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c18071180 con 0x7f3c180b2d40 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.038+0000 7f3c1e000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3c18071ab0 con 0x7f3c1813eb20 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.038+0000 7f3c1e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c18071460 con 0x7f3c1806c320 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3c180b2d40 0x7f3c1806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59626/0 (socket says 172.21.15.52:59626) 2024-09-10T08:33:15.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17400640 1 -- 172.21.15.52:0/2218414886 learned_addr learned my addr 172.21.15.52:0/2218414886 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:15.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17e00640 1 --2- 172.21.15.52:0/2218414886 >> v2:172.21.15.176:3300/0 conn(0x7f3c1813eb20 0x7f3c1815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c16a00640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c1815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c16000640 1 -- 172.21.15.52:0/2218414886 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106241638 0 0) 0x7f3c18071180 con 0x7f3c180b2d40 2024-09-10T08:33:15.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c16000640 1 -- 172.21.15.52:0/2218414886 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bfc003520 con 0x7f3c180b2d40 2024-09-10T08:33:15.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17e00640 1 -- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 msgr2=0x7f3c1815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:15.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17e00640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c1815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17e00640 1 -- 172.21.15.52:0/2218414886 >> v1:172.21.15.52:6789/0 conn(0x7f3c180b2d40 legacy=0x7f3c1806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.039+0000 7f3c17e00640 1 -- 172.21.15.52:0/2218414886 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c18071740 con 0x7f3c1813eb20 2024-09-10T08:33:15.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c17e00640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c1813eb20 0x7f3c1815c230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009d90 tx=0x7f3c1002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672c5aa40535d17b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c16000640 1 -- 172.21.15.52:0/2218414886 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007740 con 0x7f3c1813eb20 2024-09-10T08:33:15.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c16000640 1 -- 172.21.15.52:0/2218414886 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c100078e0 con 0x7f3c1813eb20 2024-09-10T08:33:15.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c16000640 1 -- 172.21.15.52:0/2218414886 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007c90 con 0x7f3c1813eb20 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 -- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c1813eb20 msgr2=0x7f3c1815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c1813eb20 0x7f3c1815c230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009d90 tx=0x7f3c1002a660 comp rx=0 tx=0).stop 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 -- 172.21.15.52:0/2218414886 shutdown_connections 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c1813eb20 0x7f3c1815c230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 --2- 172.21.15.52:0/2218414886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c1815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 -- 172.21.15.52:0/2218414886 >> 172.21.15.52:0/2218414886 conn(0x7f3c180ccec0 msgr2=0x7f3c180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.041+0000 7f3c1e000640 1 -- 172.21.15.52:0/2218414886 shutdown_connections 2024-09-10T08:33:15.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.042+0000 7f3c1e000640 1 -- 172.21.15.52:0/2218414886 wait complete. 2024-09-10T08:33:15.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.043+0000 7f3c1e000640 1 Processor -- start 2024-09-10T08:33:15.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.043+0000 7f3c1e000640 1 -- start start 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c181f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c180b2d40 0x7f3c180cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180720c0 con 0x7f3c1813eb20 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c18071f40 con 0x7f3c180b2d40 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c1e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c18072240 con 0x7f3c1806c320 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.044+0000 7f3c17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46710/0 (socket says 172.21.15.52:46710) 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 -- 172.21.15.52:0/3025913237 learned_addr learned my addr 172.21.15.52:0/3025913237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:15.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c16a00640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c180b2d40 0x7f3c180cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17400640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c181f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 -- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 msgr2=0x7f3c181f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c181f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 -- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c180b2d40 msgr2=0x7f3c180cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c180b2d40 0x7f3c180cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 -- 172.21.15.52:0/3025913237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c181eeb50 con 0x7f3c1813eb20 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c17e00640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002ac50 tx=0x7f3c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.045+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1003f070 con 0x7f3c1813eb20 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.046+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10031c60 con 0x7f3c1813eb20 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.046+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c180cc400 con 0x7f3c1813eb20 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.046+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10009450 con 0x7f3c1813eb20 2024-09-10T08:33:15.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.046+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c180cbb60 con 0x7f3c1813eb20 2024-09-10T08:33:15.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.047+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1806bc10 con 0x7f3c1813eb20 2024-09-10T08:33:15.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.048+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c1003b410 con 0x7f3c1813eb20 2024-09-10T08:33:15.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.049+0000 7f3c0f400640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 0x7f3bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.049+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f3c100ac0b0 con 0x7f3c1813eb20 2024-09-10T08:33:15.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.049+0000 7f3c17400640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 0x7f3bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.050+0000 7f3c17400640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 0x7f3bf806e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3c08005880 tx=0x7f3c08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.053+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c1007a370 con 0x7f3c1813eb20 2024-09-10T08:33:15.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.237+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c1806c9c0 con 0x7f3c1813eb20 2024-09-10T08:33:15.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.239+0000 7f3c0f400640 1 -- 172.21.15.52:0/3025913237 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16680 (secure 0 0 0) 0x7f3c1007e670 con 0x7f3c1813eb20 2024-09-10T08:33:15.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:15.240 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":76,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:12.419643+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:08.635125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:09.836766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 msgr2=0x7f3bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 0x7f3bf806e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3c08005880 tx=0x7f3c08009040 comp rx=0 tx=0).stop 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 msgr2=0x7f3c181ee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002ac50 tx=0x7f3c10004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 shutdown_connections 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bf806be30 0x7f3bf806e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c1813eb20 0x7f3c181ee610 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c180b2d40 0x7f3c180cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 --2- 172.21.15.52:0/3025913237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c1806c320 0x7f3c181f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 >> 172.21.15.52:0/3025913237 conn(0x7f3c180ccec0 msgr2=0x7f3c18156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:15.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 shutdown_connections 2024-09-10T08:33:15.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.241+0000 7f3c1e000640 1 -- 172.21.15.52:0/3025913237 wait complete. 2024-09-10T08:33:15.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:33:15.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:33:15.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.414+0000 7eff24a00640 1 Processor -- start 2024-09-10T08:33:15.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.414+0000 7eff24a00640 1 -- start start 2024-09-10T08:33:15.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.415+0000 7eff24a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff200b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.415+0000 7eff24a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7eff200b5f90 0x7eff200735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff24a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff200b4020 con 0x7eff20073180 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff24a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7eff20073b00 con 0x7eff200b5f90 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff24a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff200b42c0 con 0x7eff20145ed0 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff17e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7eff20073180 0x7eff200b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59634/0 (socket says 172.21.15.52:59634) 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff17e00640 1 -- 172.21.15.52:0/3991096858 learned_addr learned my addr 172.21.15.52:0/3991096858 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1e800640 1 --2- 172.21.15.52:0/3991096858 >> v2:172.21.15.176:3300/0 conn(0x7eff200b5f90 0x7eff200735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1de00640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff200b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1d400640 1 -- 172.21.15.52:0/3991096858 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389284951 0 0) 0x7eff200b4020 con 0x7eff20073180 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1d400640 1 -- 172.21.15.52:0/3991096858 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04003520 con 0x7eff20073180 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1e800640 1 -- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 msgr2=0x7eff200b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:15.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1e800640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff200b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1e800640 1 -- 172.21.15.52:0/3991096858 >> v1:172.21.15.52:6789/0 conn(0x7eff20073180 legacy=0x7eff200b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.416+0000 7eff1e800640 1 -- 172.21.15.52:0/3991096858 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff200b45a0 con 0x7eff200b5f90 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.418+0000 7eff1e800640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff200b5f90 0x7eff200735c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca3d9755fa6cb27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.418+0000 7eff1d400640 1 -- 172.21.15.52:0/3991096858 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18007740 con 0x7eff200b5f90 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.418+0000 7eff1d400640 1 -- 172.21.15.52:0/3991096858 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180078e0 con 0x7eff200b5f90 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.418+0000 7eff1d400640 1 -- 172.21.15.52:0/3991096858 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18007c90 con 0x7eff200b5f90 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 -- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff200b5f90 msgr2=0x7eff200735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff200b5f90 0x7eff200735c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1802a660 comp rx=0 tx=0).stop 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 -- 172.21.15.52:0/3991096858 shutdown_connections 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff200b5f90 0x7eff200735c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 --2- 172.21.15.52:0/3991096858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff200b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 -- 172.21.15.52:0/3991096858 >> 172.21.15.52:0/3991096858 conn(0x7eff200ccec0 msgr2=0x7eff200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:15.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 -- 172.21.15.52:0/3991096858 shutdown_connections 2024-09-10T08:33:15.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.419+0000 7eff24a00640 1 -- 172.21.15.52:0/3991096858 wait complete. 2024-09-10T08:33:15.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.420+0000 7eff24a00640 1 Processor -- start 2024-09-10T08:33:15.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.421+0000 7eff24a00640 1 -- start start 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.421+0000 7eff24a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff20073180 0x7eff20140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff24a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff24a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff2013e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff24a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff201462b0 con 0x7eff200b5f90 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff24a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff200b4b60 con 0x7eff20073180 2024-09-10T08:33:15.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff24a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff20146430 con 0x7eff20145ed0 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46718/0 (socket says 172.21.15.52:46718) 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 -- 172.21.15.52:0/2220194890 learned_addr learned my addr 172.21.15.52:0/2220194890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff1de00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff20073180 0x7eff20140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff1e800640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff2013e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 -- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 msgr2=0x7eff2013e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff2013e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 -- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff20073180 msgr2=0x7eff20140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff20073180 0x7eff20140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff17e00640 1 -- 172.21.15.52:0/2220194890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2015a360 con 0x7eff200b5f90 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.422+0000 7eff1e800640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff2013e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:15.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff17e00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c430 tx=0x7eff0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08017070 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08005d00 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08007310 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2015ac80 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.423+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2015b240 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.424+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff200735c0 con 0x7eff200b5f90 2024-09-10T08:33:15.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.425+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff0801a070 con 0x7eff200b5f90 2024-09-10T08:33:15.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.426+0000 7eff16000640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.426+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7eff0808a320 con 0x7eff200b5f90 2024-09-10T08:33:15.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.427+0000 7eff1de00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.427+0000 7eff1de00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff200b5250 tx=0x7eff10009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.431+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff080585e0 con 0x7eff200b5f90 2024-09-10T08:33:15.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.615+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff2015c900 con 0x7efefc06be30 2024-09-10T08:33:15.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.622+0000 7eff16000640 1 -- 172.21.15.52:0/2220194890 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7eff2015c900 con 0x7efefc06be30 2024-09-10T08:33:15.625 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:33:15.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 msgr2=0x7efefc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff200b5250 tx=0x7eff10009190 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 msgr2=0x7eff2015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c430 tx=0x7eff0800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 shutdown_connections 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff20145ed0 0x7eff2013e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff200b5f90 0x7eff2015a580 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 --2- 172.21.15.52:0/2220194890 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff20073180 0x7eff20140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 >> 172.21.15.52:0/2220194890 conn(0x7eff200ccec0 msgr2=0x7eff200cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 shutdown_connections 2024-09-10T08:33:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.626+0000 7eff24a00640 1 -- 172.21.15.52:0/2220194890 wait complete. 2024-09-10T08:33:15.643 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-09-10T08:33:15.520339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312016,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754662704,"statfs":{"total":773094113280,"available":772774608896,"internally_reserved":0,"allocated":8593408,"data_stored":4298836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001237"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700378+0000","last_change":"2024-09-10T08:33:11.435776+0000","last_active":"2024-09-10T08:33:12.700378+0000","last_peered":"2024-09-10T08:33:12.700378+0000","last_clean":"2024-09-10T08:33:12.700378+0000","last_became_active":"2024-09-10T08:33:11.435497+0000","last_became_peered":"2024-09-10T08:33:11.435497+0000","last_unstale":"2024-09-10T08:33:12.700378+0000","last_undegraded":"2024-09-10T08:33:12.700378+0000","last_fullsized":"2024-09-10T08:33:12.700378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:58.216449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427849+0000","last_change":"2024-09-10T08:33:11.447796+0000","last_active":"2024-09-10T08:33:12.427849+0000","last_peered":"2024-09-10T08:33:12.427849+0000","last_clean":"2024-09-10T08:33:12.427849+0000","last_became_active":"2024-09-10T08:33:11.447289+0000","last_became_peered":"2024-09-10T08:33:11.447289+0000","last_unstale":"2024-09-10T08:33:12.427849+0000","last_undegraded":"2024-09-10T08:33:12.427849+0000","last_fullsized":"2024-09-10T08:33:12.427849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:52.901497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432802+0000","last_change":"2024-09-10T08:33:11.441850+0000","last_active":"2024-09-10T08:33:12.432802+0000","last_peered":"2024-09-10T08:33:12.432802+0000","last_clean":"2024-09-10T08:33:12.432802+0000","last_became_active":"2024-09-10T08:33:11.441538+0000","last_became_peered":"2024-09-10T08:33:11.441538+0000","last_unstale":"2024-09-10T08:33:12.432802+0000","last_undegraded":"2024-09-10T08:33:12.432802+0000","last_fullsized":"2024-09-10T08:33:12.432802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:13.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432423+0000","last_change":"2024-09-10T08:33:11.441424+0000","last_active":"2024-09-10T08:33:12.432423+0000","last_peered":"2024-09-10T08:33:12.432423+0000","last_clean":"2024-09-10T08:33:12.432423+0000","last_became_active":"2024-09-10T08:33:11.441155+0000","last_became_peered":"2024-09-10T08:33:11.441155+0000","last_unstale":"2024-09-10T08:33:12.432423+0000","last_undegraded":"2024-09-10T08:33:12.432423+0000","last_fullsized":"2024-09-10T08:33:12.432423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:16.776882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432588+0000","last_change":"2024-09-10T08:33:11.431799+0000","last_active":"2024-09-10T08:33:12.432588+0000","last_peered":"2024-09-10T08:33:12.432588+0000","last_clean":"2024-09-10T08:33:12.432588+0000","last_became_active":"2024-09-10T08:33:11.430654+0000","last_became_peered":"2024-09-10T08:33:11.430654+0000","last_unstale":"2024-09-10T08:33:12.432588+0000","last_undegraded":"2024-09-10T08:33:12.432588+0000","last_fullsized":"2024-09-10T08:33:12.432588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:18.774893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699514+0000","last_change":"2024-09-10T08:33:11.439861+0000","last_active":"2024-09-10T08:33:12.699514+0000","last_peered":"2024-09-10T08:33:12.699514+0000","last_clean":"2024-09-10T08:33:12.699514+0000","last_became_active":"2024-09-10T08:33:11.439499+0000","last_became_peered":"2024-09-10T08:33:11.439499+0000","last_unstale":"2024-09-10T08:33:12.699514+0000","last_undegraded":"2024-09-10T08:33:12.699514+0000","last_fullsized":"2024-09-10T08:33:12.699514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:39.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699965+0000","last_change":"2024-09-10T08:33:11.433513+0000","last_active":"2024-09-10T08:33:12.699965+0000","last_peered":"2024-09-10T08:33:12.699965+0000","last_clean":"2024-09-10T08:33:12.699965+0000","last_became_active":"2024-09-10T08:33:11.433222+0000","last_became_peered":"2024-09-10T08:33:11.433222+0000","last_unstale":"2024-09-10T08:33:12.699965+0000","last_undegraded":"2024-09-10T08:33:12.699965+0000","last_fullsized":"2024-09-10T08:33:12.699965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:03.287463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700450+0000","last_change":"2024-09-10T08:33:11.433144+0000","last_active":"2024-09-10T08:33:12.700450+0000","last_peered":"2024-09-10T08:33:12.700450+0000","last_clean":"2024-09-10T08:33:12.700450+0000","last_became_active":"2024-09-10T08:33:11.432829+0000","last_became_peered":"2024-09-10T08:33:11.432829+0000","last_unstale":"2024-09-10T08:33:12.700450+0000","last_undegraded":"2024-09-10T08:33:12.700450+0000","last_fullsized":"2024-09-10T08:33:12.700450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:23.397877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433249+0000","last_change":"2024-09-10T08:33:11.433582+0000","last_active":"2024-09-10T08:33:12.433249+0000","last_peered":"2024-09-10T08:33:12.433249+0000","last_clean":"2024-09-10T08:33:12.433249+0000","last_became_active":"2024-09-10T08:33:11.432833+0000","last_became_peered":"2024-09-10T08:33:11.432833+0000","last_unstale":"2024-09-10T08:33:12.433249+0000","last_undegraded":"2024-09-10T08:33:12.433249+0000","last_fullsized":"2024-09-10T08:33:12.433249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:13.259937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699841+0000","last_change":"2024-09-10T08:33:11.439801+0000","last_active":"2024-09-10T08:33:12.699841+0000","last_peered":"2024-09-10T08:33:12.699841+0000","last_clean":"2024-09-10T08:33:12.699841+0000","last_became_active":"2024-09-10T08:33:11.439521+0000","last_became_peered":"2024-09-10T08:33:11.439521+0000","last_unstale":"2024-09-10T08:33:12.699841+0000","last_undegraded":"2024-09-10T08:33:12.699841+0000","last_fullsized":"2024-09-10T08:33:12.699841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:08.281072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700022+0000","last_change":"2024-09-10T08:33:11.433387+0000","last_active":"2024-09-10T08:33:12.700022+0000","last_peered":"2024-09-10T08:33:12.700022+0000","last_clean":"2024-09-10T08:33:12.700022+0000","last_became_active":"2024-09-10T08:33:11.433119+0000","last_became_peered":"2024-09-10T08:33:11.433119+0000","last_unstale":"2024-09-10T08:33:12.700022+0000","last_undegraded":"2024-09-10T08:33:12.700022+0000","last_fullsized":"2024-09-10T08:33:12.700022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:37.276648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699680+0000","last_change":"2024-09-10T08:33:11.432913+0000","last_active":"2024-09-10T08:33:12.699680+0000","last_peered":"2024-09-10T08:33:12.699680+0000","last_clean":"2024-09-10T08:33:12.699680+0000","last_became_active":"2024-09-10T08:33:11.430378+0000","last_became_peered":"2024-09-10T08:33:11.430378+0000","last_unstale":"2024-09-10T08:33:12.699680+0000","last_undegraded":"2024-09-10T08:33:12.699680+0000","last_fullsized":"2024-09-10T08:33:12.699680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:56.522668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432521+0000","last_change":"2024-09-10T08:33:11.439683+0000","last_active":"2024-09-10T08:33:12.432521+0000","last_peered":"2024-09-10T08:33:12.432521+0000","last_clean":"2024-09-10T08:33:12.432521+0000","last_became_active":"2024-09-10T08:33:11.439389+0000","last_became_peered":"2024-09-10T08:33:11.439389+0000","last_unstale":"2024-09-10T08:33:12.432521+0000","last_undegraded":"2024-09-10T08:33:12.432521+0000","last_fullsized":"2024-09-10T08:33:12.432521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:41.612967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699511+0000","last_change":"2024-09-10T08:33:11.442606+0000","last_active":"2024-09-10T08:33:12.699511+0000","last_peered":"2024-09-10T08:33:12.699511+0000","last_clean":"2024-09-10T08:33:12.699511+0000","last_became_active":"2024-09-10T08:33:11.441736+0000","last_became_peered":"2024-09-10T08:33:11.441736+0000","last_unstale":"2024-09-10T08:33:12.699511+0000","last_undegraded":"2024-09-10T08:33:12.699511+0000","last_fullsized":"2024-09-10T08:33:12.699511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:50.525719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699246+0000","last_change":"2024-09-10T08:33:11.425686+0000","last_active":"2024-09-10T08:33:12.699246+0000","last_peered":"2024-09-10T08:33:12.699246+0000","last_clean":"2024-09-10T08:33:12.699246+0000","last_became_active":"2024-09-10T08:33:11.425376+0000","last_became_peered":"2024-09-10T08:33:11.425376+0000","last_unstale":"2024-09-10T08:33:12.699246+0000","last_undegraded":"2024-09-10T08:33:12.699246+0000","last_fullsized":"2024-09-10T08:33:12.699246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:24.949496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700522+0000","last_change":"2024-09-10T08:33:11.443778+0000","last_active":"2024-09-10T08:33:12.700522+0000","last_peered":"2024-09-10T08:33:12.700522+0000","last_clean":"2024-09-10T08:33:12.700522+0000","last_became_active":"2024-09-10T08:33:11.443509+0000","last_became_peered":"2024-09-10T08:33:11.443509+0000","last_unstale":"2024-09-10T08:33:12.700522+0000","last_undegraded":"2024-09-10T08:33:12.700522+0000","last_fullsized":"2024-09-10T08:33:12.700522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:54.421311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433242+0000","last_change":"2024-09-10T08:33:11.428541+0000","last_active":"2024-09-10T08:33:12.433242+0000","last_peered":"2024-09-10T08:33:12.433242+0000","last_clean":"2024-09-10T08:33:12.433242+0000","last_became_active":"2024-09-10T08:33:11.428288+0000","last_became_peered":"2024-09-10T08:33:11.428288+0000","last_unstale":"2024-09-10T08:33:12.433242+0000","last_undegraded":"2024-09-10T08:33:12.433242+0000","last_fullsized":"2024-09-10T08:33:12.433242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:56.359037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433667+0000","last_change":"2024-09-10T08:33:11.435726+0000","last_active":"2024-09-10T08:33:12.433667+0000","last_peered":"2024-09-10T08:33:12.433667+0000","last_clean":"2024-09-10T08:33:12.433667+0000","last_became_active":"2024-09-10T08:33:11.434751+0000","last_became_peered":"2024-09-10T08:33:11.434751+0000","last_unstale":"2024-09-10T08:33:12.433667+0000","last_undegraded":"2024-09-10T08:33:12.433667+0000","last_fullsized":"2024-09-10T08:33:12.433667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:25.349600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699764+0000","last_change":"2024-09-10T08:33:11.436124+0000","last_active":"2024-09-10T08:33:12.699764+0000","last_peered":"2024-09-10T08:33:12.699764+0000","last_clean":"2024-09-10T08:33:12.699764+0000","last_became_active":"2024-09-10T08:33:11.435858+0000","last_became_peered":"2024-09-10T08:33:11.435858+0000","last_unstale":"2024-09-10T08:33:12.699764+0000","last_undegraded":"2024-09-10T08:33:12.699764+0000","last_fullsized":"2024-09-10T08:33:12.699764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:34.249059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433341+0000","last_change":"2024-09-10T08:33:11.425738+0000","last_active":"2024-09-10T08:33:12.433341+0000","last_peered":"2024-09-10T08:33:12.433341+0000","last_clean":"2024-09-10T08:33:12.433341+0000","last_became_active":"2024-09-10T08:33:11.425463+0000","last_became_peered":"2024-09-10T08:33:11.425463+0000","last_unstale":"2024-09-10T08:33:12.433341+0000","last_undegraded":"2024-09-10T08:33:12.433341+0000","last_fullsized":"2024-09-10T08:33:12.433341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:18.033684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428320+0000","last_change":"2024-09-10T08:33:11.426318+0000","last_active":"2024-09-10T08:33:12.428320+0000","last_peered":"2024-09-10T08:33:12.428320+0000","last_clean":"2024-09-10T08:33:12.428320+0000","last_became_active":"2024-09-10T08:33:11.425981+0000","last_became_peered":"2024-09-10T08:33:11.425981+0000","last_unstale":"2024-09-10T08:33:12.428320+0000","last_undegraded":"2024-09-10T08:33:12.428320+0000","last_fullsized":"2024-09-10T08:33:12.428320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:32.753180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699649+0000","last_change":"2024-09-10T08:33:11.421551+0000","last_active":"2024-09-10T08:33:12.699649+0000","last_peered":"2024-09-10T08:33:12.699649+0000","last_clean":"2024-09-10T08:33:12.699649+0000","last_became_active":"2024-09-10T08:33:11.421280+0000","last_became_peered":"2024-09-10T08:33:11.421280+0000","last_unstale":"2024-09-10T08:33:12.699649+0000","last_undegraded":"2024-09-10T08:33:12.699649+0000","last_fullsized":"2024-09-10T08:33:12.699649+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:55.119689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699336+0000","last_change":"2024-09-10T08:33:11.446566+0000","last_active":"2024-09-10T08:33:12.699336+0000","last_peered":"2024-09-10T08:33:12.699336+0000","last_clean":"2024-09-10T08:33:12.699336+0000","last_became_active":"2024-09-10T08:33:11.446198+0000","last_became_peered":"2024-09-10T08:33:11.446198+0000","last_unstale":"2024-09-10T08:33:12.699336+0000","last_undegraded":"2024-09-10T08:33:12.699336+0000","last_fullsized":"2024-09-10T08:33:12.699336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:13.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700590+0000","last_change":"2024-09-10T08:33:11.438109+0000","last_active":"2024-09-10T08:33:12.700590+0000","last_peered":"2024-09-10T08:33:12.700590+0000","last_clean":"2024-09-10T08:33:12.700590+0000","last_became_active":"2024-09-10T08:33:11.437841+0000","last_became_peered":"2024-09-10T08:33:11.437841+0000","last_unstale":"2024-09-10T08:33:12.700590+0000","last_undegraded":"2024-09-10T08:33:12.700590+0000","last_fullsized":"2024-09-10T08:33:12.700590+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:08.509070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700198+0000","last_change":"2024-09-10T08:33:11.443377+0000","last_active":"2024-09-10T08:33:12.700198+0000","last_peered":"2024-09-10T08:33:12.700198+0000","last_clean":"2024-09-10T08:33:12.700198+0000","last_became_active":"2024-09-10T08:33:11.443049+0000","last_became_peered":"2024-09-10T08:33:11.443049+0000","last_unstale":"2024-09-10T08:33:12.700198+0000","last_undegraded":"2024-09-10T08:33:12.700198+0000","last_fullsized":"2024-09-10T08:33:12.700198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:51.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700006+0000","last_change":"2024-09-10T08:33:11.446943+0000","last_active":"2024-09-10T08:33:12.700006+0000","last_peered":"2024-09-10T08:33:12.700006+0000","last_clean":"2024-09-10T08:33:12.700006+0000","last_became_active":"2024-09-10T08:33:11.446701+0000","last_became_peered":"2024-09-10T08:33:11.446701+0000","last_unstale":"2024-09-10T08:33:12.700006+0000","last_undegraded":"2024-09-10T08:33:12.700006+0000","last_fullsized":"2024-09-10T08:33:12.700006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:40.809873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433484+0000","last_change":"2024-09-10T08:33:11.436303+0000","last_active":"2024-09-10T08:33:12.433484+0000","last_peered":"2024-09-10T08:33:12.433484+0000","last_clean":"2024-09-10T08:33:12.433484+0000","last_became_active":"2024-09-10T08:33:11.435664+0000","last_became_peered":"2024-09-10T08:33:11.435664+0000","last_unstale":"2024-09-10T08:33:12.433484+0000","last_undegraded":"2024-09-10T08:33:12.433484+0000","last_fullsized":"2024-09-10T08:33:12.433484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:00.452710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427624+0000","last_change":"2024-09-10T08:33:11.431630+0000","last_active":"2024-09-10T08:33:12.427624+0000","last_peered":"2024-09-10T08:33:12.427624+0000","last_clean":"2024-09-10T08:33:12.427624+0000","last_became_active":"2024-09-10T08:33:11.431352+0000","last_became_peered":"2024-09-10T08:33:11.431352+0000","last_unstale":"2024-09-10T08:33:12.427624+0000","last_undegraded":"2024-09-10T08:33:12.427624+0000","last_fullsized":"2024-09-10T08:33:12.427624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432659+0000","last_change":"2024-09-10T08:33:11.438335+0000","last_active":"2024-09-10T08:33:12.432659+0000","last_peered":"2024-09-10T08:33:12.432659+0000","last_clean":"2024-09-10T08:33:12.432659+0000","last_became_active":"2024-09-10T08:33:11.438061+0000","last_became_peered":"2024-09-10T08:33:11.438061+0000","last_unstale":"2024-09-10T08:33:12.432659+0000","last_undegraded":"2024-09-10T08:33:12.432659+0000","last_fullsized":"2024-09-10T08:33:12.432659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:56.222271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699096+0000","last_change":"2024-09-10T08:33:11.435333+0000","last_active":"2024-09-10T08:33:12.699096+0000","last_peered":"2024-09-10T08:33:12.699096+0000","last_clean":"2024-09-10T08:33:12.699096+0000","last_became_active":"2024-09-10T08:33:11.435046+0000","last_became_peered":"2024-09-10T08:33:11.435046+0000","last_unstale":"2024-09-10T08:33:12.699096+0000","last_undegraded":"2024-09-10T08:33:12.699096+0000","last_fullsized":"2024-09-10T08:33:12.699096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:04.316781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427640+0000","last_change":"2024-09-10T08:33:11.431634+0000","last_active":"2024-09-10T08:33:12.427640+0000","last_peered":"2024-09-10T08:33:12.427640+0000","last_clean":"2024-09-10T08:33:12.427640+0000","last_became_active":"2024-09-10T08:33:11.431340+0000","last_became_peered":"2024-09-10T08:33:11.431340+0000","last_unstale":"2024-09-10T08:33:12.427640+0000","last_undegraded":"2024-09-10T08:33:12.427640+0000","last_fullsized":"2024-09-10T08:33:12.427640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:43.799713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427489+0000","last_change":"2024-09-10T08:33:11.432302+0000","last_active":"2024-09-10T08:33:12.427489+0000","last_peered":"2024-09-10T08:33:12.427489+0000","last_clean":"2024-09-10T08:33:12.427489+0000","last_became_active":"2024-09-10T08:33:11.432018+0000","last_became_peered":"2024-09-10T08:33:11.432018+0000","last_unstale":"2024-09-10T08:33:12.427489+0000","last_undegraded":"2024-09-10T08:33:12.427489+0000","last_fullsized":"2024-09-10T08:33:12.427489+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.156368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700165+0000","last_change":"2024-09-10T08:33:11.446348+0000","last_active":"2024-09-10T08:33:12.700165+0000","last_peered":"2024-09-10T08:33:12.700165+0000","last_clean":"2024-09-10T08:33:12.700165+0000","last_became_active":"2024-09-10T08:33:11.446044+0000","last_became_peered":"2024-09-10T08:33:11.446044+0000","last_unstale":"2024-09-10T08:33:12.700165+0000","last_undegraded":"2024-09-10T08:33:12.700165+0000","last_fullsized":"2024-09-10T08:33:12.700165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:14.373340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700203+0000","last_change":"2024-09-10T08:33:10.424360+0000","last_active":"2024-09-10T08:33:12.700203+0000","last_peered":"2024-09-10T08:33:12.700203+0000","last_clean":"2024-09-10T08:33:12.700203+0000","last_became_active":"2024-09-10T08:33:10.423469+0000","last_became_peered":"2024-09-10T08:33:10.423469+0000","last_unstale":"2024-09-10T08:33:12.700203+0000","last_undegraded":"2024-09-10T08:33:12.700203+0000","last_fullsized":"2024-09-10T08:33:12.700203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.898574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433463+0000","last_change":"2024-09-10T08:33:11.438753+0000","last_active":"2024-09-10T08:33:12.433463+0000","last_peered":"2024-09-10T08:33:12.433463+0000","last_clean":"2024-09-10T08:33:12.433463+0000","last_became_active":"2024-09-10T08:33:11.438263+0000","last_became_peered":"2024-09-10T08:33:11.438263+0000","last_unstale":"2024-09-10T08:33:12.433463+0000","last_undegraded":"2024-09-10T08:33:12.433463+0000","last_fullsized":"2024-09-10T08:33:12.433463+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:08.281072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433797+0000","last_change":"2024-09-10T08:33:10.429513+0000","last_active":"2024-09-10T08:33:12.433797+0000","last_peered":"2024-09-10T08:33:12.433797+0000","last_clean":"2024-09-10T08:33:12.433797+0000","last_became_active":"2024-09-10T08:33:10.429063+0000","last_became_peered":"2024-09-10T08:33:10.429063+0000","last_unstale":"2024-09-10T08:33:12.433797+0000","last_undegraded":"2024-09-10T08:33:12.433797+0000","last_fullsized":"2024-09-10T08:33:12.433797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699781+0000","last_change":"2024-09-10T08:33:11.438546+0000","last_active":"2024-09-10T08:33:12.699781+0000","last_peered":"2024-09-10T08:33:12.699781+0000","last_clean":"2024-09-10T08:33:12.699781+0000","last_became_active":"2024-09-10T08:33:11.436506+0000","last_became_peered":"2024-09-10T08:33:11.436506+0000","last_unstale":"2024-09-10T08:33:12.699781+0000","last_undegraded":"2024-09-10T08:33:12.699781+0000","last_fullsized":"2024-09-10T08:33:12.699781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:30.193150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700087+0000","last_change":"2024-09-10T08:33:10.429767+0000","last_active":"2024-09-10T08:33:12.700087+0000","last_peered":"2024-09-10T08:33:12.700087+0000","last_clean":"2024-09-10T08:33:12.700087+0000","last_became_active":"2024-09-10T08:33:10.429518+0000","last_became_peered":"2024-09-10T08:33:10.429518+0000","last_unstale":"2024-09-10T08:33:12.700087+0000","last_undegraded":"2024-09-10T08:33:12.700087+0000","last_fullsized":"2024-09-10T08:33:12.700087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:54.527776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699603+0000","last_change":"2024-09-10T08:33:11.434623+0000","last_active":"2024-09-10T08:33:12.699603+0000","last_peered":"2024-09-10T08:33:12.699603+0000","last_clean":"2024-09-10T08:33:12.699603+0000","last_became_active":"2024-09-10T08:33:11.434091+0000","last_became_peered":"2024-09-10T08:33:11.434091+0000","last_unstale":"2024-09-10T08:33:12.699603+0000","last_undegraded":"2024-09-10T08:33:12.699603+0000","last_fullsized":"2024-09-10T08:33:12.699603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:30.733987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699836+0000","last_change":"2024-09-10T08:33:10.423456+0000","last_active":"2024-09-10T08:33:12.699836+0000","last_peered":"2024-09-10T08:33:12.699836+0000","last_clean":"2024-09-10T08:33:12.699836+0000","last_became_active":"2024-09-10T08:33:10.423176+0000","last_became_peered":"2024-09-10T08:33:10.423176+0000","last_unstale":"2024-09-10T08:33:12.699836+0000","last_undegraded":"2024-09-10T08:33:12.699836+0000","last_fullsized":"2024-09-10T08:33:12.699836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.661617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699235+0000","last_change":"2024-09-10T08:33:11.434617+0000","last_active":"2024-09-10T08:33:12.699235+0000","last_peered":"2024-09-10T08:33:12.699235+0000","last_clean":"2024-09-10T08:33:12.699235+0000","last_became_active":"2024-09-10T08:33:11.432921+0000","last_became_peered":"2024-09-10T08:33:11.432921+0000","last_unstale":"2024-09-10T08:33:12.699235+0000","last_undegraded":"2024-09-10T08:33:12.699235+0000","last_fullsized":"2024-09-10T08:33:12.699235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:14.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699054+0000","last_change":"2024-09-10T08:33:10.431342+0000","last_active":"2024-09-10T08:33:12.699054+0000","last_peered":"2024-09-10T08:33:12.699054+0000","last_clean":"2024-09-10T08:33:12.699054+0000","last_became_active":"2024-09-10T08:33:10.428923+0000","last_became_peered":"2024-09-10T08:33:10.428923+0000","last_unstale":"2024-09-10T08:33:12.699054+0000","last_undegraded":"2024-09-10T08:33:12.699054+0000","last_fullsized":"2024-09-10T08:33:12.699054+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.898574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700719+0000","last_change":"2024-09-10T08:33:11.433638+0000","last_active":"2024-09-10T08:33:12.700719+0000","last_peered":"2024-09-10T08:33:12.700719+0000","last_clean":"2024-09-10T08:33:12.700719+0000","last_became_active":"2024-09-10T08:33:11.433371+0000","last_became_peered":"2024-09-10T08:33:11.433371+0000","last_unstale":"2024-09-10T08:33:12.700719+0000","last_undegraded":"2024-09-10T08:33:12.700719+0000","last_fullsized":"2024-09-10T08:33:12.700719+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:58.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699037+0000","last_change":"2024-09-10T08:33:10.437989+0000","last_active":"2024-09-10T08:33:12.699037+0000","last_peered":"2024-09-10T08:33:12.699037+0000","last_clean":"2024-09-10T08:33:12.699037+0000","last_became_active":"2024-09-10T08:33:10.437717+0000","last_became_peered":"2024-09-10T08:33:10.437717+0000","last_unstale":"2024-09-10T08:33:12.699037+0000","last_undegraded":"2024-09-10T08:33:12.699037+0000","last_fullsized":"2024-09-10T08:33:12.699037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:56.671151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698899+0000","last_change":"2024-09-10T08:33:11.441496+0000","last_active":"2024-09-10T08:33:12.698899+0000","last_peered":"2024-09-10T08:33:12.698899+0000","last_clean":"2024-09-10T08:33:12.698899+0000","last_became_active":"2024-09-10T08:33:11.440723+0000","last_became_peered":"2024-09-10T08:33:11.440723+0000","last_unstale":"2024-09-10T08:33:12.698899+0000","last_undegraded":"2024-09-10T08:33:12.698899+0000","last_fullsized":"2024-09-10T08:33:12.698899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:52.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699543+0000","last_change":"2024-09-10T08:33:10.433454+0000","last_active":"2024-09-10T08:33:12.699543+0000","last_peered":"2024-09-10T08:33:12.699543+0000","last_clean":"2024-09-10T08:33:12.699543+0000","last_became_active":"2024-09-10T08:33:10.433133+0000","last_became_peered":"2024-09-10T08:33:10.433133+0000","last_unstale":"2024-09-10T08:33:12.699543+0000","last_undegraded":"2024-09-10T08:33:12.699543+0000","last_fullsized":"2024-09-10T08:33:12.699543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:02.831431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699584+0000","last_change":"2024-09-10T08:33:11.440869+0000","last_active":"2024-09-10T08:33:12.699584+0000","last_peered":"2024-09-10T08:33:12.699584+0000","last_clean":"2024-09-10T08:33:12.699584+0000","last_became_active":"2024-09-10T08:33:11.440514+0000","last_became_peered":"2024-09-10T08:33:11.440514+0000","last_unstale":"2024-09-10T08:33:12.699584+0000","last_undegraded":"2024-09-10T08:33:12.699584+0000","last_fullsized":"2024-09-10T08:33:12.699584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:27.808015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698961+0000","last_change":"2024-09-10T08:33:10.427751+0000","last_active":"2024-09-10T08:33:12.698961+0000","last_peered":"2024-09-10T08:33:12.698961+0000","last_clean":"2024-09-10T08:33:12.698961+0000","last_became_active":"2024-09-10T08:33:10.427482+0000","last_became_peered":"2024-09-10T08:33:10.427482+0000","last_unstale":"2024-09-10T08:33:12.698961+0000","last_undegraded":"2024-09-10T08:33:12.698961+0000","last_fullsized":"2024-09-10T08:33:12.698961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.661617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699904+0000","last_change":"2024-09-10T08:33:11.452506+0000","last_active":"2024-09-10T08:33:12.699904+0000","last_peered":"2024-09-10T08:33:12.699904+0000","last_clean":"2024-09-10T08:33:12.699904+0000","last_became_active":"2024-09-10T08:33:11.452139+0000","last_became_peered":"2024-09-10T08:33:11.452139+0000","last_unstale":"2024-09-10T08:33:12.699904+0000","last_undegraded":"2024-09-10T08:33:12.699904+0000","last_fullsized":"2024-09-10T08:33:12.699904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:10.325110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700078+0000","last_change":"2024-09-10T08:33:10.435609+0000","last_active":"2024-09-10T08:33:12.700078+0000","last_peered":"2024-09-10T08:33:12.700078+0000","last_clean":"2024-09-10T08:33:12.700078+0000","last_became_active":"2024-09-10T08:33:10.435314+0000","last_became_peered":"2024-09-10T08:33:10.435314+0000","last_unstale":"2024-09-10T08:33:12.700078+0000","last_undegraded":"2024-09-10T08:33:12.700078+0000","last_fullsized":"2024-09-10T08:33:12.700078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:54.094298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428040+0000","last_change":"2024-09-10T08:33:11.446444+0000","last_active":"2024-09-10T08:33:12.428040+0000","last_peered":"2024-09-10T08:33:12.428040+0000","last_clean":"2024-09-10T08:33:12.428040+0000","last_became_active":"2024-09-10T08:33:11.446123+0000","last_became_peered":"2024-09-10T08:33:11.446123+0000","last_unstale":"2024-09-10T08:33:12.428040+0000","last_undegraded":"2024-09-10T08:33:12.428040+0000","last_fullsized":"2024-09-10T08:33:12.428040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:29.659356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427912+0000","last_change":"2024-09-10T08:33:10.422645+0000","last_active":"2024-09-10T08:33:12.427912+0000","last_peered":"2024-09-10T08:33:12.427912+0000","last_clean":"2024-09-10T08:33:12.427912+0000","last_became_active":"2024-09-10T08:33:10.422324+0000","last_became_peered":"2024-09-10T08:33:10.422324+0000","last_unstale":"2024-09-10T08:33:12.427912+0000","last_undegraded":"2024-09-10T08:33:12.427912+0000","last_fullsized":"2024-09-10T08:33:12.427912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:03.300543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699493+0000","last_change":"2024-09-10T08:33:11.451028+0000","last_active":"2024-09-10T08:33:12.699493+0000","last_peered":"2024-09-10T08:33:12.699493+0000","last_clean":"2024-09-10T08:33:12.699493+0000","last_became_active":"2024-09-10T08:33:11.450761+0000","last_became_peered":"2024-09-10T08:33:11.450761+0000","last_unstale":"2024-09-10T08:33:12.699493+0000","last_undegraded":"2024-09-10T08:33:12.699493+0000","last_fullsized":"2024-09-10T08:33:12.699493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:49.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699324+0000","last_change":"2024-09-10T08:33:10.430217+0000","last_active":"2024-09-10T08:33:12.699324+0000","last_peered":"2024-09-10T08:33:12.699324+0000","last_clean":"2024-09-10T08:33:12.699324+0000","last_became_active":"2024-09-10T08:33:10.429921+0000","last_became_peered":"2024-09-10T08:33:10.429921+0000","last_unstale":"2024-09-10T08:33:12.699324+0000","last_undegraded":"2024-09-10T08:33:12.699324+0000","last_fullsized":"2024-09-10T08:33:12.699324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:45.779745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433621+0000","last_change":"2024-09-10T08:33:11.437828+0000","last_active":"2024-09-10T08:33:12.433621+0000","last_peered":"2024-09-10T08:33:12.433621+0000","last_clean":"2024-09-10T08:33:12.433621+0000","last_became_active":"2024-09-10T08:33:11.435228+0000","last_became_peered":"2024-09-10T08:33:11.435228+0000","last_unstale":"2024-09-10T08:33:12.433621+0000","last_undegraded":"2024-09-10T08:33:12.433621+0000","last_fullsized":"2024-09-10T08:33:12.433621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:00.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"75'6","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699434+0000","last_change":"2024-09-10T08:33:10.431688+0000","last_active":"2024-09-10T08:33:12.699434+0000","last_peered":"2024-09-10T08:33:12.699434+0000","last_clean":"2024-09-10T08:33:12.699434+0000","last_became_active":"2024-09-10T08:33:10.431404+0000","last_became_peered":"2024-09-10T08:33:10.431404+0000","last_unstale":"2024-09-10T08:33:12.699434+0000","last_undegraded":"2024-09-10T08:33:12.699434+0000","last_fullsized":"2024-09-10T08:33:12.699434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:21.046869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699788+0000","last_change":"2024-09-10T08:33:11.419092+0000","last_active":"2024-09-10T08:33:12.699788+0000","last_peered":"2024-09-10T08:33:12.699788+0000","last_clean":"2024-09-10T08:33:12.699788+0000","last_became_active":"2024-09-10T08:33:11.418812+0000","last_became_peered":"2024-09-10T08:33:11.418812+0000","last_unstale":"2024-09-10T08:33:12.699788+0000","last_undegraded":"2024-09-10T08:33:12.699788+0000","last_fullsized":"2024-09-10T08:33:12.699788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:24.949496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699130+0000","last_change":"2024-09-10T08:33:10.433748+0000","last_active":"2024-09-10T08:33:12.699130+0000","last_peered":"2024-09-10T08:33:12.699130+0000","last_clean":"2024-09-10T08:33:12.699130+0000","last_became_active":"2024-09-10T08:33:10.433104+0000","last_became_peered":"2024-09-10T08:33:10.433104+0000","last_unstale":"2024-09-10T08:33:12.699130+0000","last_undegraded":"2024-09-10T08:33:12.699130+0000","last_fullsized":"2024-09-10T08:33:12.699130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:43.801698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700249+0000","last_change":"2024-09-10T08:33:11.438134+0000","last_active":"2024-09-10T08:33:12.700249+0000","last_peered":"2024-09-10T08:33:12.700249+0000","last_clean":"2024-09-10T08:33:12.700249+0000","last_became_active":"2024-09-10T08:33:11.437828+0000","last_became_peered":"2024-09-10T08:33:11.437828+0000","last_unstale":"2024-09-10T08:33:12.700249+0000","last_undegraded":"2024-09-10T08:33:12.700249+0000","last_fullsized":"2024-09-10T08:33:12.700249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:03.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699157+0000","last_change":"2024-09-10T08:33:10.435175+0000","last_active":"2024-09-10T08:33:12.699157+0000","last_peered":"2024-09-10T08:33:12.699157+0000","last_clean":"2024-09-10T08:33:12.699157+0000","last_became_active":"2024-09-10T08:33:10.434912+0000","last_became_peered":"2024-09-10T08:33:10.434912+0000","last_unstale":"2024-09-10T08:33:12.699157+0000","last_undegraded":"2024-09-10T08:33:12.699157+0000","last_fullsized":"2024-09-10T08:33:12.699157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.906688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432744+0000","last_change":"2024-09-10T08:33:11.423483+0000","last_active":"2024-09-10T08:33:12.432744+0000","last_peered":"2024-09-10T08:33:12.432744+0000","last_clean":"2024-09-10T08:33:12.432744+0000","last_became_active":"2024-09-10T08:33:11.423223+0000","last_became_peered":"2024-09-10T08:33:11.423223+0000","last_unstale":"2024-09-10T08:33:12.432744+0000","last_undegraded":"2024-09-10T08:33:12.432744+0000","last_fullsized":"2024-09-10T08:33:12.432744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:01.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699384+0000","last_change":"2024-09-10T08:33:10.436740+0000","last_active":"2024-09-10T08:33:12.699384+0000","last_peered":"2024-09-10T08:33:12.699384+0000","last_clean":"2024-09-10T08:33:12.699384+0000","last_became_active":"2024-09-10T08:33:10.435789+0000","last_became_peered":"2024-09-10T08:33:10.435789+0000","last_unstale":"2024-09-10T08:33:12.699384+0000","last_undegraded":"2024-09-10T08:33:12.699384+0000","last_fullsized":"2024-09-10T08:33:12.699384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:15.331565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432248+0000","last_change":"2024-09-10T08:33:11.433428+0000","last_active":"2024-09-10T08:33:12.432248+0000","last_peered":"2024-09-10T08:33:12.432248+0000","last_clean":"2024-09-10T08:33:12.432248+0000","last_became_active":"2024-09-10T08:33:11.433028+0000","last_became_peered":"2024-09-10T08:33:11.433028+0000","last_unstale":"2024-09-10T08:33:12.432248+0000","last_undegraded":"2024-09-10T08:33:12.432248+0000","last_fullsized":"2024-09-10T08:33:12.432248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:03.235580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699284+0000","last_change":"2024-09-10T08:33:10.436983+0000","last_active":"2024-09-10T08:33:12.699284+0000","last_peered":"2024-09-10T08:33:12.699284+0000","last_clean":"2024-09-10T08:33:12.699284+0000","last_became_active":"2024-09-10T08:33:10.436697+0000","last_became_peered":"2024-09-10T08:33:10.436697+0000","last_unstale":"2024-09-10T08:33:12.699284+0000","last_undegraded":"2024-09-10T08:33:12.699284+0000","last_fullsized":"2024-09-10T08:33:12.699284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:04.029572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427974+0000","last_change":"2024-09-10T08:33:11.447562+0000","last_active":"2024-09-10T08:33:12.427974+0000","last_peered":"2024-09-10T08:33:12.427974+0000","last_clean":"2024-09-10T08:33:12.427974+0000","last_became_active":"2024-09-10T08:33:11.446883+0000","last_became_peered":"2024-09-10T08:33:11.446883+0000","last_unstale":"2024-09-10T08:33:12.427974+0000","last_undegraded":"2024-09-10T08:33:12.427974+0000","last_fullsized":"2024-09-10T08:33:12.427974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:46.782668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700184+0000","last_change":"2024-09-10T08:33:10.435938+0000","last_active":"2024-09-10T08:33:12.700184+0000","last_peered":"2024-09-10T08:33:12.700184+0000","last_clean":"2024-09-10T08:33:12.700184+0000","last_became_active":"2024-09-10T08:33:10.435682+0000","last_became_peered":"2024-09-10T08:33:10.435682+0000","last_unstale":"2024-09-10T08:33:12.700184+0000","last_undegraded":"2024-09-10T08:33:12.700184+0000","last_fullsized":"2024-09-10T08:33:12.700184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:30.217827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428193+0000","last_change":"2024-09-10T08:33:11.437578+0000","last_active":"2024-09-10T08:33:12.428193+0000","last_peered":"2024-09-10T08:33:12.428193+0000","last_clean":"2024-09-10T08:33:12.428193+0000","last_became_active":"2024-09-10T08:33:11.437278+0000","last_became_peered":"2024-09-10T08:33:11.437278+0000","last_unstale":"2024-09-10T08:33:12.428193+0000","last_undegraded":"2024-09-10T08:33:12.428193+0000","last_fullsized":"2024-09-10T08:33:12.428193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:24.256410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427986+0000","last_change":"2024-09-10T08:33:10.434031+0000","last_active":"2024-09-10T08:33:12.427986+0000","last_peered":"2024-09-10T08:33:12.427986+0000","last_clean":"2024-09-10T08:33:12.427986+0000","last_became_active":"2024-09-10T08:33:10.433727+0000","last_became_peered":"2024-09-10T08:33:10.433727+0000","last_unstale":"2024-09-10T08:33:12.427986+0000","last_undegraded":"2024-09-10T08:33:12.427986+0000","last_fullsized":"2024-09-10T08:33:12.427986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:21.046869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432588+0000","last_change":"2024-09-10T08:33:11.439977+0000","last_active":"2024-09-10T08:33:12.432588+0000","last_peered":"2024-09-10T08:33:12.432588+0000","last_clean":"2024-09-10T08:33:12.432588+0000","last_became_active":"2024-09-10T08:33:11.439234+0000","last_became_peered":"2024-09-10T08:33:11.439234+0000","last_unstale":"2024-09-10T08:33:12.432588+0000","last_undegraded":"2024-09-10T08:33:12.432588+0000","last_fullsized":"2024-09-10T08:33:12.432588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:23.504038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427555+0000","last_change":"2024-09-10T08:33:10.425869+0000","last_active":"2024-09-10T08:33:12.427555+0000","last_peered":"2024-09-10T08:33:12.427555+0000","last_clean":"2024-09-10T08:33:12.427555+0000","last_became_active":"2024-09-10T08:33:10.425613+0000","last_became_peered":"2024-09-10T08:33:10.425613+0000","last_unstale":"2024-09-10T08:33:12.427555+0000","last_undegraded":"2024-09-10T08:33:12.427555+0000","last_fullsized":"2024-09-10T08:33:12.427555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:12.257014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432846+0000","last_change":"2024-09-10T08:33:11.438326+0000","last_active":"2024-09-10T08:33:12.432846+0000","last_peered":"2024-09-10T08:33:12.432846+0000","last_clean":"2024-09-10T08:33:12.432846+0000","last_became_active":"2024-09-10T08:33:11.438032+0000","last_became_peered":"2024-09-10T08:33:11.438032+0000","last_unstale":"2024-09-10T08:33:12.432846+0000","last_undegraded":"2024-09-10T08:33:12.432846+0000","last_fullsized":"2024-09-10T08:33:12.432846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:30.733987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699940+0000","last_change":"2024-09-10T08:33:10.428418+0000","last_active":"2024-09-10T08:33:12.699940+0000","last_peered":"2024-09-10T08:33:12.699940+0000","last_clean":"2024-09-10T08:33:12.699940+0000","last_became_active":"2024-09-10T08:33:10.427963+0000","last_became_peered":"2024-09-10T08:33:10.427963+0000","last_unstale":"2024-09-10T08:33:12.699940+0000","last_undegraded":"2024-09-10T08:33:12.699940+0000","last_fullsized":"2024-09-10T08:33:12.699940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:45.779745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699055+0000","last_change":"2024-09-10T08:33:11.433691+0000","last_active":"2024-09-10T08:33:12.699055+0000","last_peered":"2024-09-10T08:33:12.699055+0000","last_clean":"2024-09-10T08:33:12.699055+0000","last_became_active":"2024-09-10T08:33:11.432851+0000","last_became_peered":"2024-09-10T08:33:11.432851+0000","last_unstale":"2024-09-10T08:33:12.699055+0000","last_undegraded":"2024-09-10T08:33:12.699055+0000","last_fullsized":"2024-09-10T08:33:12.699055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.156368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699852+0000","last_change":"2024-09-10T08:33:10.426126+0000","last_active":"2024-09-10T08:33:12.699852+0000","last_peered":"2024-09-10T08:33:12.699852+0000","last_clean":"2024-09-10T08:33:12.699852+0000","last_became_active":"2024-09-10T08:33:10.424507+0000","last_became_peered":"2024-09-10T08:33:10.424507+0000","last_unstale":"2024-09-10T08:33:12.699852+0000","last_undegraded":"2024-09-10T08:33:12.699852+0000","last_fullsized":"2024-09-10T08:33:12.699852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:42.796790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698987+0000","last_change":"2024-09-10T08:33:11.434009+0000","last_active":"2024-09-10T08:33:12.698987+0000","last_peered":"2024-09-10T08:33:12.698987+0000","last_clean":"2024-09-10T08:33:12.698987+0000","last_became_active":"2024-09-10T08:33:11.433709+0000","last_became_peered":"2024-09-10T08:33:11.433709+0000","last_unstale":"2024-09-10T08:33:12.698987+0000","last_undegraded":"2024-09-10T08:33:12.698987+0000","last_fullsized":"2024-09-10T08:33:12.698987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.527058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427688+0000","last_change":"2024-09-10T08:33:10.427205+0000","last_active":"2024-09-10T08:33:12.427688+0000","last_peered":"2024-09-10T08:33:12.427688+0000","last_clean":"2024-09-10T08:33:12.427688+0000","last_became_active":"2024-09-10T08:33:10.424261+0000","last_became_peered":"2024-09-10T08:33:10.424261+0000","last_unstale":"2024-09-10T08:33:12.427688+0000","last_undegraded":"2024-09-10T08:33:12.427688+0000","last_fullsized":"2024-09-10T08:33:12.427688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:07.278149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699418+0000","last_change":"2024-09-10T08:33:11.422012+0000","last_active":"2024-09-10T08:33:12.699418+0000","last_peered":"2024-09-10T08:33:12.699418+0000","last_clean":"2024-09-10T08:33:12.699418+0000","last_became_active":"2024-09-10T08:33:11.421488+0000","last_became_peered":"2024-09-10T08:33:11.421488+0000","last_unstale":"2024-09-10T08:33:12.699418+0000","last_undegraded":"2024-09-10T08:33:12.699418+0000","last_fullsized":"2024-09-10T08:33:12.699418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:58.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432597+0000","last_change":"2024-09-10T08:33:10.433440+0000","last_active":"2024-09-10T08:33:12.432597+0000","last_peered":"2024-09-10T08:33:12.432597+0000","last_clean":"2024-09-10T08:33:12.432597+0000","last_became_active":"2024-09-10T08:33:10.433174+0000","last_became_peered":"2024-09-10T08:33:10.433174+0000","last_unstale":"2024-09-10T08:33:12.432597+0000","last_undegraded":"2024-09-10T08:33:12.432597+0000","last_fullsized":"2024-09-10T08:33:12.432597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:50.595174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433756+0000","last_change":"2024-09-10T08:33:11.432208+0000","last_active":"2024-09-10T08:33:12.433756+0000","last_peered":"2024-09-10T08:33:12.433756+0000","last_clean":"2024-09-10T08:33:12.433756+0000","last_became_active":"2024-09-10T08:33:11.431949+0000","last_became_peered":"2024-09-10T08:33:11.431949+0000","last_unstale":"2024-09-10T08:33:12.433756+0000","last_undegraded":"2024-09-10T08:33:12.433756+0000","last_fullsized":"2024-09-10T08:33:12.433756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:49.104713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700311+0000","last_change":"2024-09-10T08:33:10.435863+0000","last_active":"2024-09-10T08:33:12.700311+0000","last_peered":"2024-09-10T08:33:12.700311+0000","last_clean":"2024-09-10T08:33:12.700311+0000","last_became_active":"2024-09-10T08:33:10.435324+0000","last_became_peered":"2024-09-10T08:33:10.435324+0000","last_unstale":"2024-09-10T08:33:12.700311+0000","last_undegraded":"2024-09-10T08:33:12.700311+0000","last_fullsized":"2024-09-10T08:33:12.700311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:51.907383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700351+0000","last_change":"2024-09-10T08:33:11.438902+0000","last_active":"2024-09-10T08:33:12.700351+0000","last_peered":"2024-09-10T08:33:12.700351+0000","last_clean":"2024-09-10T08:33:12.700351+0000","last_became_active":"2024-09-10T08:33:11.438623+0000","last_became_peered":"2024-09-10T08:33:11.438623+0000","last_unstale":"2024-09-10T08:33:12.700351+0000","last_undegraded":"2024-09-10T08:33:12.700351+0000","last_fullsized":"2024-09-10T08:33:12.700351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:44.804621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700247+0000","last_change":"2024-09-10T08:33:10.437578+0000","last_active":"2024-09-10T08:33:12.700247+0000","last_peered":"2024-09-10T08:33:12.700247+0000","last_clean":"2024-09-10T08:33:12.700247+0000","last_became_active":"2024-09-10T08:33:10.437340+0000","last_became_peered":"2024-09-10T08:33:10.437340+0000","last_unstale":"2024-09-10T08:33:12.700247+0000","last_undegraded":"2024-09-10T08:33:12.700247+0000","last_fullsized":"2024-09-10T08:33:12.700247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:42.879403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427776+0000","last_change":"2024-09-10T08:33:11.426449+0000","last_active":"2024-09-10T08:33:12.427776+0000","last_peered":"2024-09-10T08:33:12.427776+0000","last_clean":"2024-09-10T08:33:12.427776+0000","last_became_active":"2024-09-10T08:33:11.425927+0000","last_became_peered":"2024-09-10T08:33:11.425927+0000","last_unstale":"2024-09-10T08:33:12.427776+0000","last_undegraded":"2024-09-10T08:33:12.427776+0000","last_fullsized":"2024-09-10T08:33:12.427776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:50.664540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699437+0000","last_change":"2024-09-10T08:33:10.426364+0000","last_active":"2024-09-10T08:33:12.699437+0000","last_peered":"2024-09-10T08:33:12.699437+0000","last_clean":"2024-09-10T08:33:12.699437+0000","last_became_active":"2024-09-10T08:33:10.425822+0000","last_became_peered":"2024-09-10T08:33:10.425822+0000","last_unstale":"2024-09-10T08:33:12.699437+0000","last_undegraded":"2024-09-10T08:33:12.699437+0000","last_fullsized":"2024-09-10T08:33:12.699437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:28.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699739+0000","last_change":"2024-09-10T08:33:11.434386+0000","last_active":"2024-09-10T08:33:12.699739+0000","last_peered":"2024-09-10T08:33:12.699739+0000","last_clean":"2024-09-10T08:33:12.699739+0000","last_became_active":"2024-09-10T08:33:11.433794+0000","last_became_peered":"2024-09-10T08:33:11.433794+0000","last_unstale":"2024-09-10T08:33:12.699739+0000","last_undegraded":"2024-09-10T08:33:12.699739+0000","last_fullsized":"2024-09-10T08:33:12.699739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:13.259937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699588+0000","last_change":"2024-09-10T08:33:10.432151+0000","last_active":"2024-09-10T08:33:12.699588+0000","last_peered":"2024-09-10T08:33:12.699588+0000","last_clean":"2024-09-10T08:33:12.699588+0000","last_became_active":"2024-09-10T08:33:10.431790+0000","last_became_peered":"2024-09-10T08:33:10.431790+0000","last_unstale":"2024-09-10T08:33:12.699588+0000","last_undegraded":"2024-09-10T08:33:12.699588+0000","last_fullsized":"2024-09-10T08:33:12.699588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:31.750257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432998+0000","last_change":"2024-09-10T08:33:11.429603+0000","last_active":"2024-09-10T08:33:12.432998+0000","last_peered":"2024-09-10T08:33:12.432998+0000","last_clean":"2024-09-10T08:33:12.432998+0000","last_became_active":"2024-09-10T08:33:11.428786+0000","last_became_peered":"2024-09-10T08:33:11.428786+0000","last_unstale":"2024-09-10T08:33:12.432998+0000","last_undegraded":"2024-09-10T08:33:12.432998+0000","last_fullsized":"2024-09-10T08:33:12.432998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:26.770262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699719+0000","last_change":"2024-09-10T08:33:10.428586+0000","last_active":"2024-09-10T08:33:12.699719+0000","last_peered":"2024-09-10T08:33:12.699719+0000","last_clean":"2024-09-10T08:33:12.699719+0000","last_became_active":"2024-09-10T08:33:10.428324+0000","last_became_peered":"2024-09-10T08:33:10.428324+0000","last_unstale":"2024-09-10T08:33:12.699719+0000","last_undegraded":"2024-09-10T08:33:12.699719+0000","last_fullsized":"2024-09-10T08:33:12.699719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:23.253487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699254+0000","last_change":"2024-09-10T08:33:11.445481+0000","last_active":"2024-09-10T08:33:12.699254+0000","last_peered":"2024-09-10T08:33:12.699254+0000","last_clean":"2024-09-10T08:33:12.699254+0000","last_became_active":"2024-09-10T08:33:11.444847+0000","last_became_peered":"2024-09-10T08:33:11.444847+0000","last_unstale":"2024-09-10T08:33:12.699254+0000","last_undegraded":"2024-09-10T08:33:12.699254+0000","last_fullsized":"2024-09-10T08:33:12.699254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:26.261816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433053+0000","last_change":"2024-09-10T08:33:10.428320+0000","last_active":"2024-09-10T08:33:12.433053+0000","last_peered":"2024-09-10T08:33:12.433053+0000","last_clean":"2024-09-10T08:33:12.433053+0000","last_became_active":"2024-09-10T08:33:10.427845+0000","last_became_peered":"2024-09-10T08:33:10.427845+0000","last_unstale":"2024-09-10T08:33:12.433053+0000","last_undegraded":"2024-09-10T08:33:12.433053+0000","last_fullsized":"2024-09-10T08:33:12.433053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:06.709565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699055+0000","last_change":"2024-09-10T08:33:11.428704+0000","last_active":"2024-09-10T08:33:12.699055+0000","last_peered":"2024-09-10T08:33:12.699055+0000","last_clean":"2024-09-10T08:33:12.699055+0000","last_became_active":"2024-09-10T08:33:11.428321+0000","last_became_peered":"2024-09-10T08:33:11.428321+0000","last_unstale":"2024-09-10T08:33:12.699055+0000","last_undegraded":"2024-09-10T08:33:12.699055+0000","last_fullsized":"2024-09-10T08:33:12.699055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427775+0000","last_change":"2024-09-10T08:33:10.418546+0000","last_active":"2024-09-10T08:33:12.427775+0000","last_peered":"2024-09-10T08:33:12.427775+0000","last_clean":"2024-09-10T08:33:12.427775+0000","last_became_active":"2024-09-10T08:33:10.418042+0000","last_became_peered":"2024-09-10T08:33:10.418042+0000","last_unstale":"2024-09-10T08:33:12.427775+0000","last_undegraded":"2024-09-10T08:33:12.427775+0000","last_fullsized":"2024-09-10T08:33:12.427775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:09.322187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427491+0000","last_change":"2024-09-10T08:33:11.445735+0000","last_active":"2024-09-10T08:33:12.427491+0000","last_peered":"2024-09-10T08:33:12.427491+0000","last_clean":"2024-09-10T08:33:12.427491+0000","last_became_active":"2024-09-10T08:33:11.445470+0000","last_became_peered":"2024-09-10T08:33:11.445470+0000","last_unstale":"2024-09-10T08:33:12.427491+0000","last_undegraded":"2024-09-10T08:33:12.427491+0000","last_fullsized":"2024-09-10T08:33:12.427491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.527058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699205+0000","last_change":"2024-09-10T08:33:10.427772+0000","last_active":"2024-09-10T08:33:12.699205+0000","last_peered":"2024-09-10T08:33:12.699205+0000","last_clean":"2024-09-10T08:33:12.699205+0000","last_became_active":"2024-09-10T08:33:10.427231+0000","last_became_peered":"2024-09-10T08:33:10.427231+0000","last_unstale":"2024-09-10T08:33:12.699205+0000","last_undegraded":"2024-09-10T08:33:12.699205+0000","last_fullsized":"2024-09-10T08:33:12.699205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:45.965484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432952+0000","last_change":"2024-09-10T08:33:11.436905+0000","last_active":"2024-09-10T08:33:12.432952+0000","last_peered":"2024-09-10T08:33:12.432952+0000","last_clean":"2024-09-10T08:33:12.432952+0000","last_became_active":"2024-09-10T08:33:11.436598+0000","last_became_peered":"2024-09-10T08:33:11.436598+0000","last_unstale":"2024-09-10T08:33:12.432952+0000","last_undegraded":"2024-09-10T08:33:12.432952+0000","last_fullsized":"2024-09-10T08:33:12.432952+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:17.268238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700468+0000","last_change":"2024-09-10T08:33:10.429985+0000","last_active":"2024-09-10T08:33:12.700468+0000","last_peered":"2024-09-10T08:33:12.700468+0000","last_clean":"2024-09-10T08:33:12.700468+0000","last_became_active":"2024-09-10T08:33:10.429687+0000","last_became_peered":"2024-09-10T08:33:10.429687+0000","last_unstale":"2024-09-10T08:33:12.700468+0000","last_undegraded":"2024-09-10T08:33:12.700468+0000","last_fullsized":"2024-09-10T08:33:12.700468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:12.381471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":266,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699404+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:33:12.699404+0000","last_peered":"2024-09-10T08:33:12.699404+0000","last_clean":"2024-09-10T08:33:12.699404+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:33:12.699404+0000","last_undegraded":"2024-09-10T08:33:12.699404+0000","last_fullsized":"2024-09-10T08:33:12.699404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":929792,"data_stored":390772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":933888,"data_stored":390806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":929792,"data_stored":389854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44580,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327260,"statfs":{"total":96636764160,"available":96591114240,"internally_reserved":0,"allocated":929792,"data_stored":389286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44576,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327264,"statfs":{"total":96636764160,"available":96591118336,"internally_reserved":0,"allocated":921600,"data_stored":389742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40992,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330848,"statfs":{"total":96636764160,"available":96594788352,"internally_reserved":0,"allocated":1511424,"data_stored":979528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335592,"statfs":{"total":96636764160,"available":96599646208,"internally_reserved":0,"allocated":921600,"data_stored":389230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36832,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335008,"statfs":{"total":96636764160,"available":96599048192,"internally_reserved":0,"allocated":1515520,"data_stored":979618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:33:15.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:33:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.838+0000 7fc1b0000640 1 Processor -- start 2024-09-10T08:33:15.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.838+0000 7fc1b0000640 1 -- start start 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.839+0000 7fc1b0000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1a815ed20 0x7fc1a80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.839+0000 7fc1b0000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 0x7fc1a80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.839+0000 7fc1b0000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a80d0e70 con 0x7fc1a80cf2d0 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.839+0000 7fc1b0000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a80d41c0 con 0x7fc1a815ed20 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.839+0000 7fc1b0000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80d35b0 con 0x7fc1a80d23b0 2024-09-10T08:33:15.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1a815ed20 0x7fc1a80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1a815ed20 0x7fc1a80b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46726/0 (socket says 172.21.15.52:46726) 2024-09-10T08:33:15.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 -- 172.21.15.52:0/476845635 learned_addr learned my addr 172.21.15.52:0/476845635 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:15.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1acc00640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 0x7fc1a80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 -- 172.21.15.52:0/476845635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 msgr2=0x7fc1a80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 0x7fc1a80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 -- 172.21.15.52:0/476845635 >> v1:172.21.15.176:6789/0 conn(0x7fc1a80cf2d0 legacy=0x7fc1a80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1ad600640 1 -- 172.21.15.52:0/476845635 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a80d3890 con 0x7fc1a815ed20 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.840+0000 7fc1acc00640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 0x7fc1a80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.841+0000 7fc1ad600640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a815ed20 0x7fc1a80b6260 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009e50 tx=0x7fc19c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf86fcc4906103a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1a7e00640 1 -- 172.21.15.52:0/476845635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c036070 con 0x7fc1a815ed20 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1a7e00640 1 -- 172.21.15.52:0/476845635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c031600 con 0x7fc1a815ed20 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1a7e00640 1 -- 172.21.15.52:0/476845635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0319d0 con 0x7fc1a815ed20 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 -- 172.21.15.52:0/476845635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a815ed20 msgr2=0x7fc1a80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a815ed20 0x7fc1a80b6260 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009e50 tx=0x7fc19c02a710 comp rx=0 tx=0).stop 2024-09-10T08:33:15.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 -- 172.21.15.52:0/476845635 shutdown_connections 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80d23b0 0x7fc1a80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 --2- 172.21.15.52:0/476845635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a815ed20 0x7fc1a80b6260 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 -- 172.21.15.52:0/476845635 >> 172.21.15.52:0/476845635 conn(0x7fc1a80d1260 msgr2=0x7fc1a80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 -- 172.21.15.52:0/476845635 shutdown_connections 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.842+0000 7fc1b0000640 1 -- 172.21.15.52:0/476845635 wait complete. 2024-09-10T08:33:15.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.844+0000 7fc1b0000640 1 Processor -- start 2024-09-10T08:33:15.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.844+0000 7fc1b0000640 1 -- start start 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80cf2d0 0x7fc1a815fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1a815ed20 0x7fc1a81e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80d32a0 con 0x7fc1a80d23b0 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80d3e50 con 0x7fc1a815ed20 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1b0000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a815f100 con 0x7fc1a80cf2d0 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1acc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1acc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46742/0 (socket says 172.21.15.52:46742) 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1acc00640 1 -- 172.21.15.52:0/932862955 learned_addr learned my addr 172.21.15.52:0/932862955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:15.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1ad600640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80cf2d0 0x7fc1a815fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.845+0000 7fc1ae000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1a815ed20 0x7fc1a81e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 -- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80cf2d0 msgr2=0x7fc1a815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80cf2d0 0x7fc1a815fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 -- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1a815ed20 msgr2=0x7fc1a81e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1a815ed20 0x7fc1a81e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 -- 172.21.15.52:0/932862955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a81e87a0 con 0x7fc1a80d23b0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1acc00640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e7e0 tx=0x7fc19400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194017070 con 0x7fc1a80d23b0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19400c6d0 con 0x7fc1a80d23b0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19400f040 con 0x7fc1a80d23b0 2024-09-10T08:33:15.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.846+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a81e8a80 con 0x7fc1a80d23b0 2024-09-10T08:33:15.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.847+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a81e9320 con 0x7fc1a80d23b0 2024-09-10T08:33:15.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.848+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a80b7010 con 0x7fc1a80d23b0 2024-09-10T08:33:15.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.849+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc19401a070 con 0x7fc1a80d23b0 2024-09-10T08:33:15.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.850+0000 7fc1a5600640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 0x7fc18806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:15.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.850+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7fc19408ad30 con 0x7fc1a80d23b0 2024-09-10T08:33:15.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.850+0000 7fc1ad600640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 0x7fc18806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:15.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.851+0000 7fc1ad600640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 0x7fc18806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc19c033000 tx=0x7fc19c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:15.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:15.854+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc194059080 con 0x7fc1a80d23b0 2024-09-10T08:33:16.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.034+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1a80b3f20 con 0x7fc18806be30 2024-09-10T08:33:16.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.041+0000 7fc1a5600640 1 -- 172.21.15.52:0/932862955 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7fc1a80b3f20 con 0x7fc18806be30 2024-09-10T08:33:16.044 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:33:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 msgr2=0x7fc18806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 0x7fc18806e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc19c033000 tx=0x7fc19c009000 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 msgr2=0x7fc1a81e7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e7e0 tx=0x7fc19400eca0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 shutdown_connections 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc18806be30 0x7fc18806e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1a815ed20 0x7fc1a81e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1a80d23b0 0x7fc1a81e7cb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 --2- 172.21.15.52:0/932862955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1a80cf2d0 0x7fc1a815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.044+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 >> 172.21.15.52:0/932862955 conn(0x7fc1a80d1260 msgr2=0x7fc1a80d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.045+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 shutdown_connections 2024-09-10T08:33:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.045+0000 7fc1b0000640 1 -- 172.21.15.52:0/932862955 wait complete. 2024-09-10T08:33:16.060 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-09-10T08:33:15.520339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312016,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754662704,"statfs":{"total":773094113280,"available":772774608896,"internally_reserved":0,"allocated":8593408,"data_stored":4298836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001237"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700378+0000","last_change":"2024-09-10T08:33:11.435776+0000","last_active":"2024-09-10T08:33:12.700378+0000","last_peered":"2024-09-10T08:33:12.700378+0000","last_clean":"2024-09-10T08:33:12.700378+0000","last_became_active":"2024-09-10T08:33:11.435497+0000","last_became_peered":"2024-09-10T08:33:11.435497+0000","last_unstale":"2024-09-10T08:33:12.700378+0000","last_undegraded":"2024-09-10T08:33:12.700378+0000","last_fullsized":"2024-09-10T08:33:12.700378+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:58.216449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427849+0000","last_change":"2024-09-10T08:33:11.447796+0000","last_active":"2024-09-10T08:33:12.427849+0000","last_peered":"2024-09-10T08:33:12.427849+0000","last_clean":"2024-09-10T08:33:12.427849+0000","last_became_active":"2024-09-10T08:33:11.447289+0000","last_became_peered":"2024-09-10T08:33:11.447289+0000","last_unstale":"2024-09-10T08:33:12.427849+0000","last_undegraded":"2024-09-10T08:33:12.427849+0000","last_fullsized":"2024-09-10T08:33:12.427849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:52.901497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432802+0000","last_change":"2024-09-10T08:33:11.441850+0000","last_active":"2024-09-10T08:33:12.432802+0000","last_peered":"2024-09-10T08:33:12.432802+0000","last_clean":"2024-09-10T08:33:12.432802+0000","last_became_active":"2024-09-10T08:33:11.441538+0000","last_became_peered":"2024-09-10T08:33:11.441538+0000","last_unstale":"2024-09-10T08:33:12.432802+0000","last_undegraded":"2024-09-10T08:33:12.432802+0000","last_fullsized":"2024-09-10T08:33:12.432802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:13.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432423+0000","last_change":"2024-09-10T08:33:11.441424+0000","last_active":"2024-09-10T08:33:12.432423+0000","last_peered":"2024-09-10T08:33:12.432423+0000","last_clean":"2024-09-10T08:33:12.432423+0000","last_became_active":"2024-09-10T08:33:11.441155+0000","last_became_peered":"2024-09-10T08:33:11.441155+0000","last_unstale":"2024-09-10T08:33:12.432423+0000","last_undegraded":"2024-09-10T08:33:12.432423+0000","last_fullsized":"2024-09-10T08:33:12.432423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:16.776882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432588+0000","last_change":"2024-09-10T08:33:11.431799+0000","last_active":"2024-09-10T08:33:12.432588+0000","last_peered":"2024-09-10T08:33:12.432588+0000","last_clean":"2024-09-10T08:33:12.432588+0000","last_became_active":"2024-09-10T08:33:11.430654+0000","last_became_peered":"2024-09-10T08:33:11.430654+0000","last_unstale":"2024-09-10T08:33:12.432588+0000","last_undegraded":"2024-09-10T08:33:12.432588+0000","last_fullsized":"2024-09-10T08:33:12.432588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:18.774893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699514+0000","last_change":"2024-09-10T08:33:11.439861+0000","last_active":"2024-09-10T08:33:12.699514+0000","last_peered":"2024-09-10T08:33:12.699514+0000","last_clean":"2024-09-10T08:33:12.699514+0000","last_became_active":"2024-09-10T08:33:11.439499+0000","last_became_peered":"2024-09-10T08:33:11.439499+0000","last_unstale":"2024-09-10T08:33:12.699514+0000","last_undegraded":"2024-09-10T08:33:12.699514+0000","last_fullsized":"2024-09-10T08:33:12.699514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:39.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699965+0000","last_change":"2024-09-10T08:33:11.433513+0000","last_active":"2024-09-10T08:33:12.699965+0000","last_peered":"2024-09-10T08:33:12.699965+0000","last_clean":"2024-09-10T08:33:12.699965+0000","last_became_active":"2024-09-10T08:33:11.433222+0000","last_became_peered":"2024-09-10T08:33:11.433222+0000","last_unstale":"2024-09-10T08:33:12.699965+0000","last_undegraded":"2024-09-10T08:33:12.699965+0000","last_fullsized":"2024-09-10T08:33:12.699965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:03.287463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700450+0000","last_change":"2024-09-10T08:33:11.433144+0000","last_active":"2024-09-10T08:33:12.700450+0000","last_peered":"2024-09-10T08:33:12.700450+0000","last_clean":"2024-09-10T08:33:12.700450+0000","last_became_active":"2024-09-10T08:33:11.432829+0000","last_became_peered":"2024-09-10T08:33:11.432829+0000","last_unstale":"2024-09-10T08:33:12.700450+0000","last_undegraded":"2024-09-10T08:33:12.700450+0000","last_fullsized":"2024-09-10T08:33:12.700450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:31:23.397877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433249+0000","last_change":"2024-09-10T08:33:11.433582+0000","last_active":"2024-09-10T08:33:12.433249+0000","last_peered":"2024-09-10T08:33:12.433249+0000","last_clean":"2024-09-10T08:33:12.433249+0000","last_became_active":"2024-09-10T08:33:11.432833+0000","last_became_peered":"2024-09-10T08:33:11.432833+0000","last_unstale":"2024-09-10T08:33:12.433249+0000","last_undegraded":"2024-09-10T08:33:12.433249+0000","last_fullsized":"2024-09-10T08:33:12.433249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:13.259937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699841+0000","last_change":"2024-09-10T08:33:11.439801+0000","last_active":"2024-09-10T08:33:12.699841+0000","last_peered":"2024-09-10T08:33:12.699841+0000","last_clean":"2024-09-10T08:33:12.699841+0000","last_became_active":"2024-09-10T08:33:11.439521+0000","last_became_peered":"2024-09-10T08:33:11.439521+0000","last_unstale":"2024-09-10T08:33:12.699841+0000","last_undegraded":"2024-09-10T08:33:12.699841+0000","last_fullsized":"2024-09-10T08:33:12.699841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:08.281072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700022+0000","last_change":"2024-09-10T08:33:11.433387+0000","last_active":"2024-09-10T08:33:12.700022+0000","last_peered":"2024-09-10T08:33:12.700022+0000","last_clean":"2024-09-10T08:33:12.700022+0000","last_became_active":"2024-09-10T08:33:11.433119+0000","last_became_peered":"2024-09-10T08:33:11.433119+0000","last_unstale":"2024-09-10T08:33:12.700022+0000","last_undegraded":"2024-09-10T08:33:12.700022+0000","last_fullsized":"2024-09-10T08:33:12.700022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:37.276648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699680+0000","last_change":"2024-09-10T08:33:11.432913+0000","last_active":"2024-09-10T08:33:12.699680+0000","last_peered":"2024-09-10T08:33:12.699680+0000","last_clean":"2024-09-10T08:33:12.699680+0000","last_became_active":"2024-09-10T08:33:11.430378+0000","last_became_peered":"2024-09-10T08:33:11.430378+0000","last_unstale":"2024-09-10T08:33:12.699680+0000","last_undegraded":"2024-09-10T08:33:12.699680+0000","last_fullsized":"2024-09-10T08:33:12.699680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:56.522668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432521+0000","last_change":"2024-09-10T08:33:11.439683+0000","last_active":"2024-09-10T08:33:12.432521+0000","last_peered":"2024-09-10T08:33:12.432521+0000","last_clean":"2024-09-10T08:33:12.432521+0000","last_became_active":"2024-09-10T08:33:11.439389+0000","last_became_peered":"2024-09-10T08:33:11.439389+0000","last_unstale":"2024-09-10T08:33:12.432521+0000","last_undegraded":"2024-09-10T08:33:12.432521+0000","last_fullsized":"2024-09-10T08:33:12.432521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:41.612967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699511+0000","last_change":"2024-09-10T08:33:11.442606+0000","last_active":"2024-09-10T08:33:12.699511+0000","last_peered":"2024-09-10T08:33:12.699511+0000","last_clean":"2024-09-10T08:33:12.699511+0000","last_became_active":"2024-09-10T08:33:11.441736+0000","last_became_peered":"2024-09-10T08:33:11.441736+0000","last_unstale":"2024-09-10T08:33:12.699511+0000","last_undegraded":"2024-09-10T08:33:12.699511+0000","last_fullsized":"2024-09-10T08:33:12.699511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:50.525719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699246+0000","last_change":"2024-09-10T08:33:11.425686+0000","last_active":"2024-09-10T08:33:12.699246+0000","last_peered":"2024-09-10T08:33:12.699246+0000","last_clean":"2024-09-10T08:33:12.699246+0000","last_became_active":"2024-09-10T08:33:11.425376+0000","last_became_peered":"2024-09-10T08:33:11.425376+0000","last_unstale":"2024-09-10T08:33:12.699246+0000","last_undegraded":"2024-09-10T08:33:12.699246+0000","last_fullsized":"2024-09-10T08:33:12.699246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:24.949496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700522+0000","last_change":"2024-09-10T08:33:11.443778+0000","last_active":"2024-09-10T08:33:12.700522+0000","last_peered":"2024-09-10T08:33:12.700522+0000","last_clean":"2024-09-10T08:33:12.700522+0000","last_became_active":"2024-09-10T08:33:11.443509+0000","last_became_peered":"2024-09-10T08:33:11.443509+0000","last_unstale":"2024-09-10T08:33:12.700522+0000","last_undegraded":"2024-09-10T08:33:12.700522+0000","last_fullsized":"2024-09-10T08:33:12.700522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:54.421311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433242+0000","last_change":"2024-09-10T08:33:11.428541+0000","last_active":"2024-09-10T08:33:12.433242+0000","last_peered":"2024-09-10T08:33:12.433242+0000","last_clean":"2024-09-10T08:33:12.433242+0000","last_became_active":"2024-09-10T08:33:11.428288+0000","last_became_peered":"2024-09-10T08:33:11.428288+0000","last_unstale":"2024-09-10T08:33:12.433242+0000","last_undegraded":"2024-09-10T08:33:12.433242+0000","last_fullsized":"2024-09-10T08:33:12.433242+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:40:56.359037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433667+0000","last_change":"2024-09-10T08:33:11.435726+0000","last_active":"2024-09-10T08:33:12.433667+0000","last_peered":"2024-09-10T08:33:12.433667+0000","last_clean":"2024-09-10T08:33:12.433667+0000","last_became_active":"2024-09-10T08:33:11.434751+0000","last_became_peered":"2024-09-10T08:33:11.434751+0000","last_unstale":"2024-09-10T08:33:12.433667+0000","last_undegraded":"2024-09-10T08:33:12.433667+0000","last_fullsized":"2024-09-10T08:33:12.433667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:25.349600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699764+0000","last_change":"2024-09-10T08:33:11.436124+0000","last_active":"2024-09-10T08:33:12.699764+0000","last_peered":"2024-09-10T08:33:12.699764+0000","last_clean":"2024-09-10T08:33:12.699764+0000","last_became_active":"2024-09-10T08:33:11.435858+0000","last_became_peered":"2024-09-10T08:33:11.435858+0000","last_unstale":"2024-09-10T08:33:12.699764+0000","last_undegraded":"2024-09-10T08:33:12.699764+0000","last_fullsized":"2024-09-10T08:33:12.699764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:34.249059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433341+0000","last_change":"2024-09-10T08:33:11.425738+0000","last_active":"2024-09-10T08:33:12.433341+0000","last_peered":"2024-09-10T08:33:12.433341+0000","last_clean":"2024-09-10T08:33:12.433341+0000","last_became_active":"2024-09-10T08:33:11.425463+0000","last_became_peered":"2024-09-10T08:33:11.425463+0000","last_unstale":"2024-09-10T08:33:12.433341+0000","last_undegraded":"2024-09-10T08:33:12.433341+0000","last_fullsized":"2024-09-10T08:33:12.433341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:18.033684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428320+0000","last_change":"2024-09-10T08:33:11.426318+0000","last_active":"2024-09-10T08:33:12.428320+0000","last_peered":"2024-09-10T08:33:12.428320+0000","last_clean":"2024-09-10T08:33:12.428320+0000","last_became_active":"2024-09-10T08:33:11.425981+0000","last_became_peered":"2024-09-10T08:33:11.425981+0000","last_unstale":"2024-09-10T08:33:12.428320+0000","last_undegraded":"2024-09-10T08:33:12.428320+0000","last_fullsized":"2024-09-10T08:33:12.428320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:32.753180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699649+0000","last_change":"2024-09-10T08:33:11.421551+0000","last_active":"2024-09-10T08:33:12.699649+0000","last_peered":"2024-09-10T08:33:12.699649+0000","last_clean":"2024-09-10T08:33:12.699649+0000","last_became_active":"2024-09-10T08:33:11.421280+0000","last_became_peered":"2024-09-10T08:33:11.421280+0000","last_unstale":"2024-09-10T08:33:12.699649+0000","last_undegraded":"2024-09-10T08:33:12.699649+0000","last_fullsized":"2024-09-10T08:33:12.699649+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:55.119689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699336+0000","last_change":"2024-09-10T08:33:11.446566+0000","last_active":"2024-09-10T08:33:12.699336+0000","last_peered":"2024-09-10T08:33:12.699336+0000","last_clean":"2024-09-10T08:33:12.699336+0000","last_became_active":"2024-09-10T08:33:11.446198+0000","last_became_peered":"2024-09-10T08:33:11.446198+0000","last_unstale":"2024-09-10T08:33:12.699336+0000","last_undegraded":"2024-09-10T08:33:12.699336+0000","last_fullsized":"2024-09-10T08:33:12.699336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:28:13.924784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700590+0000","last_change":"2024-09-10T08:33:11.438109+0000","last_active":"2024-09-10T08:33:12.700590+0000","last_peered":"2024-09-10T08:33:12.700590+0000","last_clean":"2024-09-10T08:33:12.700590+0000","last_became_active":"2024-09-10T08:33:11.437841+0000","last_became_peered":"2024-09-10T08:33:11.437841+0000","last_unstale":"2024-09-10T08:33:12.700590+0000","last_undegraded":"2024-09-10T08:33:12.700590+0000","last_fullsized":"2024-09-10T08:33:12.700590+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:08.509070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700198+0000","last_change":"2024-09-10T08:33:11.443377+0000","last_active":"2024-09-10T08:33:12.700198+0000","last_peered":"2024-09-10T08:33:12.700198+0000","last_clean":"2024-09-10T08:33:12.700198+0000","last_became_active":"2024-09-10T08:33:11.443049+0000","last_became_peered":"2024-09-10T08:33:11.443049+0000","last_unstale":"2024-09-10T08:33:12.700198+0000","last_undegraded":"2024-09-10T08:33:12.700198+0000","last_fullsized":"2024-09-10T08:33:12.700198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:51.197453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700006+0000","last_change":"2024-09-10T08:33:11.446943+0000","last_active":"2024-09-10T08:33:12.700006+0000","last_peered":"2024-09-10T08:33:12.700006+0000","last_clean":"2024-09-10T08:33:12.700006+0000","last_became_active":"2024-09-10T08:33:11.446701+0000","last_became_peered":"2024-09-10T08:33:11.446701+0000","last_unstale":"2024-09-10T08:33:12.700006+0000","last_undegraded":"2024-09-10T08:33:12.700006+0000","last_fullsized":"2024-09-10T08:33:12.700006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:40.809873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433484+0000","last_change":"2024-09-10T08:33:11.436303+0000","last_active":"2024-09-10T08:33:12.433484+0000","last_peered":"2024-09-10T08:33:12.433484+0000","last_clean":"2024-09-10T08:33:12.433484+0000","last_became_active":"2024-09-10T08:33:11.435664+0000","last_became_peered":"2024-09-10T08:33:11.435664+0000","last_unstale":"2024-09-10T08:33:12.433484+0000","last_undegraded":"2024-09-10T08:33:12.433484+0000","last_fullsized":"2024-09-10T08:33:12.433484+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:00.452710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427624+0000","last_change":"2024-09-10T08:33:11.431630+0000","last_active":"2024-09-10T08:33:12.427624+0000","last_peered":"2024-09-10T08:33:12.427624+0000","last_clean":"2024-09-10T08:33:12.427624+0000","last_became_active":"2024-09-10T08:33:11.431352+0000","last_became_peered":"2024-09-10T08:33:11.431352+0000","last_unstale":"2024-09-10T08:33:12.427624+0000","last_undegraded":"2024-09-10T08:33:12.427624+0000","last_fullsized":"2024-09-10T08:33:12.427624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432659+0000","last_change":"2024-09-10T08:33:11.438335+0000","last_active":"2024-09-10T08:33:12.432659+0000","last_peered":"2024-09-10T08:33:12.432659+0000","last_clean":"2024-09-10T08:33:12.432659+0000","last_became_active":"2024-09-10T08:33:11.438061+0000","last_became_peered":"2024-09-10T08:33:11.438061+0000","last_unstale":"2024-09-10T08:33:12.432659+0000","last_undegraded":"2024-09-10T08:33:12.432659+0000","last_fullsized":"2024-09-10T08:33:12.432659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:14:56.222271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699096+0000","last_change":"2024-09-10T08:33:11.435333+0000","last_active":"2024-09-10T08:33:12.699096+0000","last_peered":"2024-09-10T08:33:12.699096+0000","last_clean":"2024-09-10T08:33:12.699096+0000","last_became_active":"2024-09-10T08:33:11.435046+0000","last_became_peered":"2024-09-10T08:33:11.435046+0000","last_unstale":"2024-09-10T08:33:12.699096+0000","last_undegraded":"2024-09-10T08:33:12.699096+0000","last_fullsized":"2024-09-10T08:33:12.699096+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:04.316781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427640+0000","last_change":"2024-09-10T08:33:11.431634+0000","last_active":"2024-09-10T08:33:12.427640+0000","last_peered":"2024-09-10T08:33:12.427640+0000","last_clean":"2024-09-10T08:33:12.427640+0000","last_became_active":"2024-09-10T08:33:11.431340+0000","last_became_peered":"2024-09-10T08:33:11.431340+0000","last_unstale":"2024-09-10T08:33:12.427640+0000","last_undegraded":"2024-09-10T08:33:12.427640+0000","last_fullsized":"2024-09-10T08:33:12.427640+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:43.799713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427489+0000","last_change":"2024-09-10T08:33:11.432302+0000","last_active":"2024-09-10T08:33:12.427489+0000","last_peered":"2024-09-10T08:33:12.427489+0000","last_clean":"2024-09-10T08:33:12.427489+0000","last_became_active":"2024-09-10T08:33:11.432018+0000","last_became_peered":"2024-09-10T08:33:11.432018+0000","last_unstale":"2024-09-10T08:33:12.427489+0000","last_undegraded":"2024-09-10T08:33:12.427489+0000","last_fullsized":"2024-09-10T08:33:12.427489+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.156368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700165+0000","last_change":"2024-09-10T08:33:11.446348+0000","last_active":"2024-09-10T08:33:12.700165+0000","last_peered":"2024-09-10T08:33:12.700165+0000","last_clean":"2024-09-10T08:33:12.700165+0000","last_became_active":"2024-09-10T08:33:11.446044+0000","last_became_peered":"2024-09-10T08:33:11.446044+0000","last_unstale":"2024-09-10T08:33:12.700165+0000","last_undegraded":"2024-09-10T08:33:12.700165+0000","last_fullsized":"2024-09-10T08:33:12.700165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:14.373340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"75'4","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700203+0000","last_change":"2024-09-10T08:33:10.424360+0000","last_active":"2024-09-10T08:33:12.700203+0000","last_peered":"2024-09-10T08:33:12.700203+0000","last_clean":"2024-09-10T08:33:12.700203+0000","last_became_active":"2024-09-10T08:33:10.423469+0000","last_became_peered":"2024-09-10T08:33:10.423469+0000","last_unstale":"2024-09-10T08:33:12.700203+0000","last_undegraded":"2024-09-10T08:33:12.700203+0000","last_fullsized":"2024-09-10T08:33:12.700203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.898574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433463+0000","last_change":"2024-09-10T08:33:11.438753+0000","last_active":"2024-09-10T08:33:12.433463+0000","last_peered":"2024-09-10T08:33:12.433463+0000","last_clean":"2024-09-10T08:33:12.433463+0000","last_became_active":"2024-09-10T08:33:11.438263+0000","last_became_peered":"2024-09-10T08:33:11.438263+0000","last_unstale":"2024-09-10T08:33:12.433463+0000","last_undegraded":"2024-09-10T08:33:12.433463+0000","last_fullsized":"2024-09-10T08:33:12.433463+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:08.281072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433797+0000","last_change":"2024-09-10T08:33:10.429513+0000","last_active":"2024-09-10T08:33:12.433797+0000","last_peered":"2024-09-10T08:33:12.433797+0000","last_clean":"2024-09-10T08:33:12.433797+0000","last_became_active":"2024-09-10T08:33:10.429063+0000","last_became_peered":"2024-09-10T08:33:10.429063+0000","last_unstale":"2024-09-10T08:33:12.433797+0000","last_undegraded":"2024-09-10T08:33:12.433797+0000","last_fullsized":"2024-09-10T08:33:12.433797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:49.307854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699781+0000","last_change":"2024-09-10T08:33:11.438546+0000","last_active":"2024-09-10T08:33:12.699781+0000","last_peered":"2024-09-10T08:33:12.699781+0000","last_clean":"2024-09-10T08:33:12.699781+0000","last_became_active":"2024-09-10T08:33:11.436506+0000","last_became_peered":"2024-09-10T08:33:11.436506+0000","last_unstale":"2024-09-10T08:33:12.699781+0000","last_undegraded":"2024-09-10T08:33:12.699781+0000","last_fullsized":"2024-09-10T08:33:12.699781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:30.193150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700087+0000","last_change":"2024-09-10T08:33:10.429767+0000","last_active":"2024-09-10T08:33:12.700087+0000","last_peered":"2024-09-10T08:33:12.700087+0000","last_clean":"2024-09-10T08:33:12.700087+0000","last_became_active":"2024-09-10T08:33:10.429518+0000","last_became_peered":"2024-09-10T08:33:10.429518+0000","last_unstale":"2024-09-10T08:33:12.700087+0000","last_undegraded":"2024-09-10T08:33:12.700087+0000","last_fullsized":"2024-09-10T08:33:12.700087+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:54.527776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699603+0000","last_change":"2024-09-10T08:33:11.434623+0000","last_active":"2024-09-10T08:33:12.699603+0000","last_peered":"2024-09-10T08:33:12.699603+0000","last_clean":"2024-09-10T08:33:12.699603+0000","last_became_active":"2024-09-10T08:33:11.434091+0000","last_became_peered":"2024-09-10T08:33:11.434091+0000","last_unstale":"2024-09-10T08:33:12.699603+0000","last_undegraded":"2024-09-10T08:33:12.699603+0000","last_fullsized":"2024-09-10T08:33:12.699603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:30.733987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699836+0000","last_change":"2024-09-10T08:33:10.423456+0000","last_active":"2024-09-10T08:33:12.699836+0000","last_peered":"2024-09-10T08:33:12.699836+0000","last_clean":"2024-09-10T08:33:12.699836+0000","last_became_active":"2024-09-10T08:33:10.423176+0000","last_became_peered":"2024-09-10T08:33:10.423176+0000","last_unstale":"2024-09-10T08:33:12.699836+0000","last_undegraded":"2024-09-10T08:33:12.699836+0000","last_fullsized":"2024-09-10T08:33:12.699836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.661617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699235+0000","last_change":"2024-09-10T08:33:11.434617+0000","last_active":"2024-09-10T08:33:12.699235+0000","last_peered":"2024-09-10T08:33:12.699235+0000","last_clean":"2024-09-10T08:33:12.699235+0000","last_became_active":"2024-09-10T08:33:11.432921+0000","last_became_peered":"2024-09-10T08:33:11.432921+0000","last_unstale":"2024-09-10T08:33:12.699235+0000","last_undegraded":"2024-09-10T08:33:12.699235+0000","last_fullsized":"2024-09-10T08:33:12.699235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:14.457327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699054+0000","last_change":"2024-09-10T08:33:10.431342+0000","last_active":"2024-09-10T08:33:12.699054+0000","last_peered":"2024-09-10T08:33:12.699054+0000","last_clean":"2024-09-10T08:33:12.699054+0000","last_became_active":"2024-09-10T08:33:10.428923+0000","last_became_peered":"2024-09-10T08:33:10.428923+0000","last_unstale":"2024-09-10T08:33:12.699054+0000","last_undegraded":"2024-09-10T08:33:12.699054+0000","last_fullsized":"2024-09-10T08:33:12.699054+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.898574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700719+0000","last_change":"2024-09-10T08:33:11.433638+0000","last_active":"2024-09-10T08:33:12.700719+0000","last_peered":"2024-09-10T08:33:12.700719+0000","last_clean":"2024-09-10T08:33:12.700719+0000","last_became_active":"2024-09-10T08:33:11.433371+0000","last_became_peered":"2024-09-10T08:33:11.433371+0000","last_unstale":"2024-09-10T08:33:12.700719+0000","last_undegraded":"2024-09-10T08:33:12.700719+0000","last_fullsized":"2024-09-10T08:33:12.700719+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:58.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699037+0000","last_change":"2024-09-10T08:33:10.437989+0000","last_active":"2024-09-10T08:33:12.699037+0000","last_peered":"2024-09-10T08:33:12.699037+0000","last_clean":"2024-09-10T08:33:12.699037+0000","last_became_active":"2024-09-10T08:33:10.437717+0000","last_became_peered":"2024-09-10T08:33:10.437717+0000","last_unstale":"2024-09-10T08:33:12.699037+0000","last_undegraded":"2024-09-10T08:33:12.699037+0000","last_fullsized":"2024-09-10T08:33:12.699037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:05:56.671151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698899+0000","last_change":"2024-09-10T08:33:11.441496+0000","last_active":"2024-09-10T08:33:12.698899+0000","last_peered":"2024-09-10T08:33:12.698899+0000","last_clean":"2024-09-10T08:33:12.698899+0000","last_became_active":"2024-09-10T08:33:11.440723+0000","last_became_peered":"2024-09-10T08:33:11.440723+0000","last_unstale":"2024-09-10T08:33:12.698899+0000","last_undegraded":"2024-09-10T08:33:12.698899+0000","last_fullsized":"2024-09-10T08:33:12.698899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:52.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699543+0000","last_change":"2024-09-10T08:33:10.433454+0000","last_active":"2024-09-10T08:33:12.699543+0000","last_peered":"2024-09-10T08:33:12.699543+0000","last_clean":"2024-09-10T08:33:12.699543+0000","last_became_active":"2024-09-10T08:33:10.433133+0000","last_became_peered":"2024-09-10T08:33:10.433133+0000","last_unstale":"2024-09-10T08:33:12.699543+0000","last_undegraded":"2024-09-10T08:33:12.699543+0000","last_fullsized":"2024-09-10T08:33:12.699543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:02.831431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699584+0000","last_change":"2024-09-10T08:33:11.440869+0000","last_active":"2024-09-10T08:33:12.699584+0000","last_peered":"2024-09-10T08:33:12.699584+0000","last_clean":"2024-09-10T08:33:12.699584+0000","last_became_active":"2024-09-10T08:33:11.440514+0000","last_became_peered":"2024-09-10T08:33:11.440514+0000","last_unstale":"2024-09-10T08:33:12.699584+0000","last_undegraded":"2024-09-10T08:33:12.699584+0000","last_fullsized":"2024-09-10T08:33:12.699584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:27.808015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698961+0000","last_change":"2024-09-10T08:33:10.427751+0000","last_active":"2024-09-10T08:33:12.698961+0000","last_peered":"2024-09-10T08:33:12.698961+0000","last_clean":"2024-09-10T08:33:12.698961+0000","last_became_active":"2024-09-10T08:33:10.427482+0000","last_became_peered":"2024-09-10T08:33:10.427482+0000","last_unstale":"2024-09-10T08:33:12.698961+0000","last_undegraded":"2024-09-10T08:33:12.698961+0000","last_fullsized":"2024-09-10T08:33:12.698961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:49.661617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699904+0000","last_change":"2024-09-10T08:33:11.452506+0000","last_active":"2024-09-10T08:33:12.699904+0000","last_peered":"2024-09-10T08:33:12.699904+0000","last_clean":"2024-09-10T08:33:12.699904+0000","last_became_active":"2024-09-10T08:33:11.452139+0000","last_became_peered":"2024-09-10T08:33:11.452139+0000","last_unstale":"2024-09-10T08:33:12.699904+0000","last_undegraded":"2024-09-10T08:33:12.699904+0000","last_fullsized":"2024-09-10T08:33:12.699904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:10.325110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700078+0000","last_change":"2024-09-10T08:33:10.435609+0000","last_active":"2024-09-10T08:33:12.700078+0000","last_peered":"2024-09-10T08:33:12.700078+0000","last_clean":"2024-09-10T08:33:12.700078+0000","last_became_active":"2024-09-10T08:33:10.435314+0000","last_became_peered":"2024-09-10T08:33:10.435314+0000","last_unstale":"2024-09-10T08:33:12.700078+0000","last_undegraded":"2024-09-10T08:33:12.700078+0000","last_fullsized":"2024-09-10T08:33:12.700078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:54.094298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428040+0000","last_change":"2024-09-10T08:33:11.446444+0000","last_active":"2024-09-10T08:33:12.428040+0000","last_peered":"2024-09-10T08:33:12.428040+0000","last_clean":"2024-09-10T08:33:12.428040+0000","last_became_active":"2024-09-10T08:33:11.446123+0000","last_became_peered":"2024-09-10T08:33:11.446123+0000","last_unstale":"2024-09-10T08:33:12.428040+0000","last_undegraded":"2024-09-10T08:33:12.428040+0000","last_fullsized":"2024-09-10T08:33:12.428040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:29.659356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427912+0000","last_change":"2024-09-10T08:33:10.422645+0000","last_active":"2024-09-10T08:33:12.427912+0000","last_peered":"2024-09-10T08:33:12.427912+0000","last_clean":"2024-09-10T08:33:12.427912+0000","last_became_active":"2024-09-10T08:33:10.422324+0000","last_became_peered":"2024-09-10T08:33:10.422324+0000","last_unstale":"2024-09-10T08:33:12.427912+0000","last_undegraded":"2024-09-10T08:33:12.427912+0000","last_fullsized":"2024-09-10T08:33:12.427912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:03.300543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699493+0000","last_change":"2024-09-10T08:33:11.451028+0000","last_active":"2024-09-10T08:33:12.699493+0000","last_peered":"2024-09-10T08:33:12.699493+0000","last_clean":"2024-09-10T08:33:12.699493+0000","last_became_active":"2024-09-10T08:33:11.450761+0000","last_became_peered":"2024-09-10T08:33:11.450761+0000","last_unstale":"2024-09-10T08:33:12.699493+0000","last_undegraded":"2024-09-10T08:33:12.699493+0000","last_fullsized":"2024-09-10T08:33:12.699493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:49.035031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"75'3","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699324+0000","last_change":"2024-09-10T08:33:10.430217+0000","last_active":"2024-09-10T08:33:12.699324+0000","last_peered":"2024-09-10T08:33:12.699324+0000","last_clean":"2024-09-10T08:33:12.699324+0000","last_became_active":"2024-09-10T08:33:10.429921+0000","last_became_peered":"2024-09-10T08:33:10.429921+0000","last_unstale":"2024-09-10T08:33:12.699324+0000","last_undegraded":"2024-09-10T08:33:12.699324+0000","last_fullsized":"2024-09-10T08:33:12.699324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:45.779745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433621+0000","last_change":"2024-09-10T08:33:11.437828+0000","last_active":"2024-09-10T08:33:12.433621+0000","last_peered":"2024-09-10T08:33:12.433621+0000","last_clean":"2024-09-10T08:33:12.433621+0000","last_became_active":"2024-09-10T08:33:11.435228+0000","last_became_peered":"2024-09-10T08:33:11.435228+0000","last_unstale":"2024-09-10T08:33:12.433621+0000","last_undegraded":"2024-09-10T08:33:12.433621+0000","last_fullsized":"2024-09-10T08:33:12.433621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:00.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"75'6","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699434+0000","last_change":"2024-09-10T08:33:10.431688+0000","last_active":"2024-09-10T08:33:12.699434+0000","last_peered":"2024-09-10T08:33:12.699434+0000","last_clean":"2024-09-10T08:33:12.699434+0000","last_became_active":"2024-09-10T08:33:10.431404+0000","last_became_peered":"2024-09-10T08:33:10.431404+0000","last_unstale":"2024-09-10T08:33:12.699434+0000","last_undegraded":"2024-09-10T08:33:12.699434+0000","last_fullsized":"2024-09-10T08:33:12.699434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:21.046869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699788+0000","last_change":"2024-09-10T08:33:11.419092+0000","last_active":"2024-09-10T08:33:12.699788+0000","last_peered":"2024-09-10T08:33:12.699788+0000","last_clean":"2024-09-10T08:33:12.699788+0000","last_became_active":"2024-09-10T08:33:11.418812+0000","last_became_peered":"2024-09-10T08:33:11.418812+0000","last_unstale":"2024-09-10T08:33:12.699788+0000","last_undegraded":"2024-09-10T08:33:12.699788+0000","last_fullsized":"2024-09-10T08:33:12.699788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:24.949496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699130+0000","last_change":"2024-09-10T08:33:10.433748+0000","last_active":"2024-09-10T08:33:12.699130+0000","last_peered":"2024-09-10T08:33:12.699130+0000","last_clean":"2024-09-10T08:33:12.699130+0000","last_became_active":"2024-09-10T08:33:10.433104+0000","last_became_peered":"2024-09-10T08:33:10.433104+0000","last_unstale":"2024-09-10T08:33:12.699130+0000","last_undegraded":"2024-09-10T08:33:12.699130+0000","last_fullsized":"2024-09-10T08:33:12.699130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:43.801698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700249+0000","last_change":"2024-09-10T08:33:11.438134+0000","last_active":"2024-09-10T08:33:12.700249+0000","last_peered":"2024-09-10T08:33:12.700249+0000","last_clean":"2024-09-10T08:33:12.700249+0000","last_became_active":"2024-09-10T08:33:11.437828+0000","last_became_peered":"2024-09-10T08:33:11.437828+0000","last_unstale":"2024-09-10T08:33:12.700249+0000","last_undegraded":"2024-09-10T08:33:12.700249+0000","last_fullsized":"2024-09-10T08:33:12.700249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:03.834354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699157+0000","last_change":"2024-09-10T08:33:10.435175+0000","last_active":"2024-09-10T08:33:12.699157+0000","last_peered":"2024-09-10T08:33:12.699157+0000","last_clean":"2024-09-10T08:33:12.699157+0000","last_became_active":"2024-09-10T08:33:10.434912+0000","last_became_peered":"2024-09-10T08:33:10.434912+0000","last_unstale":"2024-09-10T08:33:12.699157+0000","last_undegraded":"2024-09-10T08:33:12.699157+0000","last_fullsized":"2024-09-10T08:33:12.699157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:50.906688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432744+0000","last_change":"2024-09-10T08:33:11.423483+0000","last_active":"2024-09-10T08:33:12.432744+0000","last_peered":"2024-09-10T08:33:12.432744+0000","last_clean":"2024-09-10T08:33:12.432744+0000","last_became_active":"2024-09-10T08:33:11.423223+0000","last_became_peered":"2024-09-10T08:33:11.423223+0000","last_unstale":"2024-09-10T08:33:12.432744+0000","last_undegraded":"2024-09-10T08:33:12.432744+0000","last_fullsized":"2024-09-10T08:33:12.432744+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:01.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699384+0000","last_change":"2024-09-10T08:33:10.436740+0000","last_active":"2024-09-10T08:33:12.699384+0000","last_peered":"2024-09-10T08:33:12.699384+0000","last_clean":"2024-09-10T08:33:12.699384+0000","last_became_active":"2024-09-10T08:33:10.435789+0000","last_became_peered":"2024-09-10T08:33:10.435789+0000","last_unstale":"2024-09-10T08:33:12.699384+0000","last_undegraded":"2024-09-10T08:33:12.699384+0000","last_fullsized":"2024-09-10T08:33:12.699384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:15.331565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432248+0000","last_change":"2024-09-10T08:33:11.433428+0000","last_active":"2024-09-10T08:33:12.432248+0000","last_peered":"2024-09-10T08:33:12.432248+0000","last_clean":"2024-09-10T08:33:12.432248+0000","last_became_active":"2024-09-10T08:33:11.433028+0000","last_became_peered":"2024-09-10T08:33:11.433028+0000","last_unstale":"2024-09-10T08:33:12.432248+0000","last_undegraded":"2024-09-10T08:33:12.432248+0000","last_fullsized":"2024-09-10T08:33:12.432248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:03.235580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"75'8","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699284+0000","last_change":"2024-09-10T08:33:10.436983+0000","last_active":"2024-09-10T08:33:12.699284+0000","last_peered":"2024-09-10T08:33:12.699284+0000","last_clean":"2024-09-10T08:33:12.699284+0000","last_became_active":"2024-09-10T08:33:10.436697+0000","last_became_peered":"2024-09-10T08:33:10.436697+0000","last_unstale":"2024-09-10T08:33:12.699284+0000","last_undegraded":"2024-09-10T08:33:12.699284+0000","last_fullsized":"2024-09-10T08:33:12.699284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:04.029572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427974+0000","last_change":"2024-09-10T08:33:11.447562+0000","last_active":"2024-09-10T08:33:12.427974+0000","last_peered":"2024-09-10T08:33:12.427974+0000","last_clean":"2024-09-10T08:33:12.427974+0000","last_became_active":"2024-09-10T08:33:11.446883+0000","last_became_peered":"2024-09-10T08:33:11.446883+0000","last_unstale":"2024-09-10T08:33:12.427974+0000","last_undegraded":"2024-09-10T08:33:12.427974+0000","last_fullsized":"2024-09-10T08:33:12.427974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:46.782668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700184+0000","last_change":"2024-09-10T08:33:10.435938+0000","last_active":"2024-09-10T08:33:12.700184+0000","last_peered":"2024-09-10T08:33:12.700184+0000","last_clean":"2024-09-10T08:33:12.700184+0000","last_became_active":"2024-09-10T08:33:10.435682+0000","last_became_peered":"2024-09-10T08:33:10.435682+0000","last_unstale":"2024-09-10T08:33:12.700184+0000","last_undegraded":"2024-09-10T08:33:12.700184+0000","last_fullsized":"2024-09-10T08:33:12.700184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:30.217827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.428193+0000","last_change":"2024-09-10T08:33:11.437578+0000","last_active":"2024-09-10T08:33:12.428193+0000","last_peered":"2024-09-10T08:33:12.428193+0000","last_clean":"2024-09-10T08:33:12.428193+0000","last_became_active":"2024-09-10T08:33:11.437278+0000","last_became_peered":"2024-09-10T08:33:11.437278+0000","last_unstale":"2024-09-10T08:33:12.428193+0000","last_undegraded":"2024-09-10T08:33:12.428193+0000","last_fullsized":"2024-09-10T08:33:12.428193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:24.256410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427986+0000","last_change":"2024-09-10T08:33:10.434031+0000","last_active":"2024-09-10T08:33:12.427986+0000","last_peered":"2024-09-10T08:33:12.427986+0000","last_clean":"2024-09-10T08:33:12.427986+0000","last_became_active":"2024-09-10T08:33:10.433727+0000","last_became_peered":"2024-09-10T08:33:10.433727+0000","last_unstale":"2024-09-10T08:33:12.427986+0000","last_undegraded":"2024-09-10T08:33:12.427986+0000","last_fullsized":"2024-09-10T08:33:12.427986+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:21.046869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432588+0000","last_change":"2024-09-10T08:33:11.439977+0000","last_active":"2024-09-10T08:33:12.432588+0000","last_peered":"2024-09-10T08:33:12.432588+0000","last_clean":"2024-09-10T08:33:12.432588+0000","last_became_active":"2024-09-10T08:33:11.439234+0000","last_became_peered":"2024-09-10T08:33:11.439234+0000","last_unstale":"2024-09-10T08:33:12.432588+0000","last_undegraded":"2024-09-10T08:33:12.432588+0000","last_fullsized":"2024-09-10T08:33:12.432588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:23.504038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"75'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427555+0000","last_change":"2024-09-10T08:33:10.425869+0000","last_active":"2024-09-10T08:33:12.427555+0000","last_peered":"2024-09-10T08:33:12.427555+0000","last_clean":"2024-09-10T08:33:12.427555+0000","last_became_active":"2024-09-10T08:33:10.425613+0000","last_became_peered":"2024-09-10T08:33:10.425613+0000","last_unstale":"2024-09-10T08:33:12.427555+0000","last_undegraded":"2024-09-10T08:33:12.427555+0000","last_fullsized":"2024-09-10T08:33:12.427555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:12.257014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432846+0000","last_change":"2024-09-10T08:33:11.438326+0000","last_active":"2024-09-10T08:33:12.432846+0000","last_peered":"2024-09-10T08:33:12.432846+0000","last_clean":"2024-09-10T08:33:12.432846+0000","last_became_active":"2024-09-10T08:33:11.438032+0000","last_became_peered":"2024-09-10T08:33:11.438032+0000","last_unstale":"2024-09-10T08:33:12.432846+0000","last_undegraded":"2024-09-10T08:33:12.432846+0000","last_fullsized":"2024-09-10T08:33:12.432846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:30.733987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699940+0000","last_change":"2024-09-10T08:33:10.428418+0000","last_active":"2024-09-10T08:33:12.699940+0000","last_peered":"2024-09-10T08:33:12.699940+0000","last_clean":"2024-09-10T08:33:12.699940+0000","last_became_active":"2024-09-10T08:33:10.427963+0000","last_became_peered":"2024-09-10T08:33:10.427963+0000","last_unstale":"2024-09-10T08:33:12.699940+0000","last_undegraded":"2024-09-10T08:33:12.699940+0000","last_fullsized":"2024-09-10T08:33:12.699940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:45.779745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699055+0000","last_change":"2024-09-10T08:33:11.433691+0000","last_active":"2024-09-10T08:33:12.699055+0000","last_peered":"2024-09-10T08:33:12.699055+0000","last_clean":"2024-09-10T08:33:12.699055+0000","last_became_active":"2024-09-10T08:33:11.432851+0000","last_became_peered":"2024-09-10T08:33:11.432851+0000","last_unstale":"2024-09-10T08:33:12.699055+0000","last_undegraded":"2024-09-10T08:33:12.699055+0000","last_fullsized":"2024-09-10T08:33:12.699055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:09.156368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699852+0000","last_change":"2024-09-10T08:33:10.426126+0000","last_active":"2024-09-10T08:33:12.699852+0000","last_peered":"2024-09-10T08:33:12.699852+0000","last_clean":"2024-09-10T08:33:12.699852+0000","last_became_active":"2024-09-10T08:33:10.424507+0000","last_became_peered":"2024-09-10T08:33:10.424507+0000","last_unstale":"2024-09-10T08:33:12.699852+0000","last_undegraded":"2024-09-10T08:33:12.699852+0000","last_fullsized":"2024-09-10T08:33:12.699852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:42.796790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.698987+0000","last_change":"2024-09-10T08:33:11.434009+0000","last_active":"2024-09-10T08:33:12.698987+0000","last_peered":"2024-09-10T08:33:12.698987+0000","last_clean":"2024-09-10T08:33:12.698987+0000","last_became_active":"2024-09-10T08:33:11.433709+0000","last_became_peered":"2024-09-10T08:33:11.433709+0000","last_unstale":"2024-09-10T08:33:12.698987+0000","last_undegraded":"2024-09-10T08:33:12.698987+0000","last_fullsized":"2024-09-10T08:33:12.698987+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.527058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427688+0000","last_change":"2024-09-10T08:33:10.427205+0000","last_active":"2024-09-10T08:33:12.427688+0000","last_peered":"2024-09-10T08:33:12.427688+0000","last_clean":"2024-09-10T08:33:12.427688+0000","last_became_active":"2024-09-10T08:33:10.424261+0000","last_became_peered":"2024-09-10T08:33:10.424261+0000","last_unstale":"2024-09-10T08:33:12.427688+0000","last_undegraded":"2024-09-10T08:33:12.427688+0000","last_fullsized":"2024-09-10T08:33:12.427688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:07.278149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699418+0000","last_change":"2024-09-10T08:33:11.422012+0000","last_active":"2024-09-10T08:33:12.699418+0000","last_peered":"2024-09-10T08:33:12.699418+0000","last_clean":"2024-09-10T08:33:12.699418+0000","last_became_active":"2024-09-10T08:33:11.421488+0000","last_became_peered":"2024-09-10T08:33:11.421488+0000","last_unstale":"2024-09-10T08:33:12.699418+0000","last_undegraded":"2024-09-10T08:33:12.699418+0000","last_fullsized":"2024-09-10T08:33:12.699418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:58.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432597+0000","last_change":"2024-09-10T08:33:10.433440+0000","last_active":"2024-09-10T08:33:12.432597+0000","last_peered":"2024-09-10T08:33:12.432597+0000","last_clean":"2024-09-10T08:33:12.432597+0000","last_became_active":"2024-09-10T08:33:10.433174+0000","last_became_peered":"2024-09-10T08:33:10.433174+0000","last_unstale":"2024-09-10T08:33:12.432597+0000","last_undegraded":"2024-09-10T08:33:12.432597+0000","last_fullsized":"2024-09-10T08:33:12.432597+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:50.595174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433756+0000","last_change":"2024-09-10T08:33:11.432208+0000","last_active":"2024-09-10T08:33:12.433756+0000","last_peered":"2024-09-10T08:33:12.433756+0000","last_clean":"2024-09-10T08:33:12.433756+0000","last_became_active":"2024-09-10T08:33:11.431949+0000","last_became_peered":"2024-09-10T08:33:11.431949+0000","last_unstale":"2024-09-10T08:33:12.433756+0000","last_undegraded":"2024-09-10T08:33:12.433756+0000","last_fullsized":"2024-09-10T08:33:12.433756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:49.104713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700311+0000","last_change":"2024-09-10T08:33:10.435863+0000","last_active":"2024-09-10T08:33:12.700311+0000","last_peered":"2024-09-10T08:33:12.700311+0000","last_clean":"2024-09-10T08:33:12.700311+0000","last_became_active":"2024-09-10T08:33:10.435324+0000","last_became_peered":"2024-09-10T08:33:10.435324+0000","last_unstale":"2024-09-10T08:33:12.700311+0000","last_undegraded":"2024-09-10T08:33:12.700311+0000","last_fullsized":"2024-09-10T08:33:12.700311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:51.907383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700351+0000","last_change":"2024-09-10T08:33:11.438902+0000","last_active":"2024-09-10T08:33:12.700351+0000","last_peered":"2024-09-10T08:33:12.700351+0000","last_clean":"2024-09-10T08:33:12.700351+0000","last_became_active":"2024-09-10T08:33:11.438623+0000","last_became_peered":"2024-09-10T08:33:11.438623+0000","last_unstale":"2024-09-10T08:33:12.700351+0000","last_undegraded":"2024-09-10T08:33:12.700351+0000","last_fullsized":"2024-09-10T08:33:12.700351+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:44.804621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700247+0000","last_change":"2024-09-10T08:33:10.437578+0000","last_active":"2024-09-10T08:33:12.700247+0000","last_peered":"2024-09-10T08:33:12.700247+0000","last_clean":"2024-09-10T08:33:12.700247+0000","last_became_active":"2024-09-10T08:33:10.437340+0000","last_became_peered":"2024-09-10T08:33:10.437340+0000","last_unstale":"2024-09-10T08:33:12.700247+0000","last_undegraded":"2024-09-10T08:33:12.700247+0000","last_fullsized":"2024-09-10T08:33:12.700247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:42.879403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427776+0000","last_change":"2024-09-10T08:33:11.426449+0000","last_active":"2024-09-10T08:33:12.427776+0000","last_peered":"2024-09-10T08:33:12.427776+0000","last_clean":"2024-09-10T08:33:12.427776+0000","last_became_active":"2024-09-10T08:33:11.425927+0000","last_became_peered":"2024-09-10T08:33:11.425927+0000","last_unstale":"2024-09-10T08:33:12.427776+0000","last_undegraded":"2024-09-10T08:33:12.427776+0000","last_fullsized":"2024-09-10T08:33:12.427776+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:50.664540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699437+0000","last_change":"2024-09-10T08:33:10.426364+0000","last_active":"2024-09-10T08:33:12.699437+0000","last_peered":"2024-09-10T08:33:12.699437+0000","last_clean":"2024-09-10T08:33:12.699437+0000","last_became_active":"2024-09-10T08:33:10.425822+0000","last_became_peered":"2024-09-10T08:33:10.425822+0000","last_unstale":"2024-09-10T08:33:12.699437+0000","last_undegraded":"2024-09-10T08:33:12.699437+0000","last_fullsized":"2024-09-10T08:33:12.699437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:28.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699739+0000","last_change":"2024-09-10T08:33:11.434386+0000","last_active":"2024-09-10T08:33:12.699739+0000","last_peered":"2024-09-10T08:33:12.699739+0000","last_clean":"2024-09-10T08:33:12.699739+0000","last_became_active":"2024-09-10T08:33:11.433794+0000","last_became_peered":"2024-09-10T08:33:11.433794+0000","last_unstale":"2024-09-10T08:33:12.699739+0000","last_undegraded":"2024-09-10T08:33:12.699739+0000","last_fullsized":"2024-09-10T08:33:12.699739+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:13.259937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699588+0000","last_change":"2024-09-10T08:33:10.432151+0000","last_active":"2024-09-10T08:33:12.699588+0000","last_peered":"2024-09-10T08:33:12.699588+0000","last_clean":"2024-09-10T08:33:12.699588+0000","last_became_active":"2024-09-10T08:33:10.431790+0000","last_became_peered":"2024-09-10T08:33:10.431790+0000","last_unstale":"2024-09-10T08:33:12.699588+0000","last_undegraded":"2024-09-10T08:33:12.699588+0000","last_fullsized":"2024-09-10T08:33:12.699588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:31.750257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432998+0000","last_change":"2024-09-10T08:33:11.429603+0000","last_active":"2024-09-10T08:33:12.432998+0000","last_peered":"2024-09-10T08:33:12.432998+0000","last_clean":"2024-09-10T08:33:12.432998+0000","last_became_active":"2024-09-10T08:33:11.428786+0000","last_became_peered":"2024-09-10T08:33:11.428786+0000","last_unstale":"2024-09-10T08:33:12.432998+0000","last_undegraded":"2024-09-10T08:33:12.432998+0000","last_fullsized":"2024-09-10T08:33:12.432998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:20:26.770262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699719+0000","last_change":"2024-09-10T08:33:10.428586+0000","last_active":"2024-09-10T08:33:12.699719+0000","last_peered":"2024-09-10T08:33:12.699719+0000","last_clean":"2024-09-10T08:33:12.699719+0000","last_became_active":"2024-09-10T08:33:10.428324+0000","last_became_peered":"2024-09-10T08:33:10.428324+0000","last_unstale":"2024-09-10T08:33:12.699719+0000","last_undegraded":"2024-09-10T08:33:12.699719+0000","last_fullsized":"2024-09-10T08:33:12.699719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:23.253487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699254+0000","last_change":"2024-09-10T08:33:11.445481+0000","last_active":"2024-09-10T08:33:12.699254+0000","last_peered":"2024-09-10T08:33:12.699254+0000","last_clean":"2024-09-10T08:33:12.699254+0000","last_became_active":"2024-09-10T08:33:11.444847+0000","last_became_peered":"2024-09-10T08:33:11.444847+0000","last_unstale":"2024-09-10T08:33:12.699254+0000","last_undegraded":"2024-09-10T08:33:12.699254+0000","last_fullsized":"2024-09-10T08:33:12.699254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:26.261816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.433053+0000","last_change":"2024-09-10T08:33:10.428320+0000","last_active":"2024-09-10T08:33:12.433053+0000","last_peered":"2024-09-10T08:33:12.433053+0000","last_clean":"2024-09-10T08:33:12.433053+0000","last_became_active":"2024-09-10T08:33:10.427845+0000","last_became_peered":"2024-09-10T08:33:10.427845+0000","last_unstale":"2024-09-10T08:33:12.433053+0000","last_undegraded":"2024-09-10T08:33:12.433053+0000","last_fullsized":"2024-09-10T08:33:12.433053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:06.709565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699055+0000","last_change":"2024-09-10T08:33:11.428704+0000","last_active":"2024-09-10T08:33:12.699055+0000","last_peered":"2024-09-10T08:33:12.699055+0000","last_clean":"2024-09-10T08:33:12.699055+0000","last_became_active":"2024-09-10T08:33:11.428321+0000","last_became_peered":"2024-09-10T08:33:11.428321+0000","last_unstale":"2024-09-10T08:33:12.699055+0000","last_undegraded":"2024-09-10T08:33:12.699055+0000","last_fullsized":"2024-09-10T08:33:12.699055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427775+0000","last_change":"2024-09-10T08:33:10.418546+0000","last_active":"2024-09-10T08:33:12.427775+0000","last_peered":"2024-09-10T08:33:12.427775+0000","last_clean":"2024-09-10T08:33:12.427775+0000","last_became_active":"2024-09-10T08:33:10.418042+0000","last_became_peered":"2024-09-10T08:33:10.418042+0000","last_unstale":"2024-09-10T08:33:12.427775+0000","last_undegraded":"2024-09-10T08:33:12.427775+0000","last_fullsized":"2024-09-10T08:33:12.427775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:09.322187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.427491+0000","last_change":"2024-09-10T08:33:11.445735+0000","last_active":"2024-09-10T08:33:12.427491+0000","last_peered":"2024-09-10T08:33:12.427491+0000","last_clean":"2024-09-10T08:33:12.427491+0000","last_became_active":"2024-09-10T08:33:11.445470+0000","last_became_peered":"2024-09-10T08:33:11.445470+0000","last_unstale":"2024-09-10T08:33:12.427491+0000","last_undegraded":"2024-09-10T08:33:12.427491+0000","last_fullsized":"2024-09-10T08:33:12.427491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:11:56.527058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699205+0000","last_change":"2024-09-10T08:33:10.427772+0000","last_active":"2024-09-10T08:33:12.699205+0000","last_peered":"2024-09-10T08:33:12.699205+0000","last_clean":"2024-09-10T08:33:12.699205+0000","last_became_active":"2024-09-10T08:33:10.427231+0000","last_became_peered":"2024-09-10T08:33:10.427231+0000","last_unstale":"2024-09-10T08:33:12.699205+0000","last_undegraded":"2024-09-10T08:33:12.699205+0000","last_fullsized":"2024-09-10T08:33:12.699205+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:45.965484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.432952+0000","last_change":"2024-09-10T08:33:11.436905+0000","last_active":"2024-09-10T08:33:12.432952+0000","last_peered":"2024-09-10T08:33:12.432952+0000","last_clean":"2024-09-10T08:33:12.432952+0000","last_became_active":"2024-09-10T08:33:11.436598+0000","last_became_peered":"2024-09-10T08:33:11.436598+0000","last_unstale":"2024-09-10T08:33:12.432952+0000","last_undegraded":"2024-09-10T08:33:12.432952+0000","last_fullsized":"2024-09-10T08:33:12.432952+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:10.401419+0000","last_clean_scrub_stamp":"2024-09-10T08:33:10.401419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:17.268238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"75'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.700468+0000","last_change":"2024-09-10T08:33:10.429985+0000","last_active":"2024-09-10T08:33:12.700468+0000","last_peered":"2024-09-10T08:33:12.700468+0000","last_clean":"2024-09-10T08:33:12.700468+0000","last_became_active":"2024-09-10T08:33:10.429687+0000","last_became_peered":"2024-09-10T08:33:10.429687+0000","last_unstale":"2024-09-10T08:33:12.700468+0000","last_undegraded":"2024-09-10T08:33:12.700468+0000","last_fullsized":"2024-09-10T08:33:12.700468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:09.398496+0000","last_clean_scrub_stamp":"2024-09-10T08:33:09.398496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:25:12.381471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":266,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T08:33:12.699404+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:33:12.699404+0000","last_peered":"2024-09-10T08:33:12.699404+0000","last_clean":"2024-09-10T08:33:12.699404+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:33:12.699404+0000","last_undegraded":"2024-09-10T08:33:12.699404+0000","last_fullsized":"2024-09-10T08:33:12.699404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":929792,"data_stored":390772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":933888,"data_stored":390806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":929792,"data_stored":389854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44580,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327260,"statfs":{"total":96636764160,"available":96591114240,"internally_reserved":0,"allocated":929792,"data_stored":389286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44576,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327264,"statfs":{"total":96636764160,"available":96591118336,"internally_reserved":0,"allocated":921600,"data_stored":389742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40992,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330848,"statfs":{"total":96636764160,"available":96594788352,"internally_reserved":0,"allocated":1511424,"data_stored":979528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36248,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335592,"statfs":{"total":96636764160,"available":96599646208,"internally_reserved":0,"allocated":921600,"data_stored":389230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36832,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335008,"statfs":{"total":96636764160,"available":96599048192,"internally_reserved":0,"allocated":1515520,"data_stored":979618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:33:16.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:33:16.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:33:16.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.265+0000 7f6e9ae00640 1 Processor -- start 2024-09-10T08:33:16.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.265+0000 7f6e9ae00640 1 -- start start 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.266+0000 7f6e9ae00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6e940cd2a0 0x7f6e9415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.266+0000 7f6e9ae00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e940714b0 con 0x7f6e940732e0 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.266+0000 7f6e9ae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e940cd880 con 0x7f6e940cce30 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.266+0000 7f6e9ae00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6e940cdb60 con 0x7f6e940cd2a0 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6e940732e0 0x7f6e940736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59636/0 (socket says 172.21.15.52:59636) 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93e00640 1 -- 172.21.15.52:0/3436405736 learned_addr learned my addr 172.21.15.52:0/3436405736 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:16.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e98e00640 1 --2- 172.21.15.52:0/3436405736 >> v2:172.21.15.176:3300/0 conn(0x7f6e940cd2a0 0x7f6e9415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3003031984 0 0) 0x7f6e940714b0 con 0x7f6e940732e0 2024-09-10T08:33:16.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e78003520 con 0x7f6e940732e0 2024-09-10T08:33:16.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295452005 0 0) 0x7f6e940cd880 con 0x7f6e940cce30 2024-09-10T08:33:16.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e940714b0 con 0x7f6e940cce30 2024-09-10T08:33:16.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3590883179 0 0) 0x7f6e78003520 con 0x7f6e940732e0 2024-09-10T08:33:16.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e98e00640 1 -- 172.21.15.52:0/3436405736 >> v1:172.21.15.176:6789/0 conn(0x7f6e940cce30 legacy=0x7f6e94071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.267+0000 7f6e98e00640 1 -- 172.21.15.52:0/3436405736 >> v1:172.21.15.52:6789/0 conn(0x7f6e940732e0 legacy=0x7f6e940736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.268+0000 7f6e98e00640 1 -- 172.21.15.52:0/3436405736 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e940cde40 con 0x7f6e940cd2a0 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e98e00640 1 --2- 172.21.15.52:0/3436405736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940cd2a0 0x7f6e9415c8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009d90 tx=0x7f6e8c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b792ad5c9f1f3bba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84001670 con 0x7f6e940cd2a0 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e8c007540 con 0x7f6e940cd2a0 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e93400640 1 -- 172.21.15.52:0/3436405736 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c007910 con 0x7f6e940cd2a0 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e9ae00640 1 -- 172.21.15.52:0/3436405736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940cd2a0 msgr2=0x7f6e9415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.269+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/3436405736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940cd2a0 0x7f6e9415c8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009d90 tx=0x7f6e8c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.270+0000 7f6e9ae00640 1 -- 172.21.15.52:0/3436405736 shutdown_connections 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.270+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/3436405736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940cd2a0 0x7f6e9415c8d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.270+0000 7f6e9ae00640 1 -- 172.21.15.52:0/3436405736 >> 172.21.15.52:0/3436405736 conn(0x7f6e9406d0f0 msgr2=0x7f6e9406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.270+0000 7f6e9ae00640 1 -- 172.21.15.52:0/3436405736 shutdown_connections 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.270+0000 7f6e9ae00640 1 -- 172.21.15.52:0/3436405736 wait complete. 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.271+0000 7f6e9ae00640 1 Processor -- start 2024-09-10T08:33:16.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.271+0000 7f6e9ae00640 1 -- start start 2024-09-10T08:33:16.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940732e0 0x7f6e9414e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 0x7f6e94145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94072500 con 0x7f6e940cce30 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e94072380 con 0x7f6e940732e0 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.272+0000 7f6e9ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9415ce10 con 0x7f6e940cd2a0 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46758/0 (socket says 172.21.15.52:46758) 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 -- 172.21.15.52:0/4290136305 learned_addr learned my addr 172.21.15.52:0/4290136305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e93e00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940732e0 0x7f6e9414e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e98e00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 0x7f6e94145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 -- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 msgr2=0x7f6e94145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 0x7f6e94145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 -- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940732e0 msgr2=0x7f6e9414e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940732e0 0x7f6e9414e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 -- 172.21.15.52:0/4290136305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9414f330 con 0x7f6e940cce30 2024-09-10T08:33:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e98e00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 0x7f6e94145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.273+0000 7f6e8b400640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c490 tx=0x7f6e7c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.274+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0052d0 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.274+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7c005470 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.274+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9414f050 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.274+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c012850 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.274+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9414a5b0 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.275+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9415d170 con 0x7f6e940cce30 2024-09-10T08:33:16.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.276+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e7c0129f0 con 0x7f6e940cce30 2024-09-10T08:33:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.277+0000 7f6e90c00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 0x7f6e7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.277+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7c08aac0 con 0x7f6e940cce30 2024-09-10T08:33:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.277+0000 7f6e93e00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 0x7f6e7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.278+0000 7f6e93e00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 0x7f6e7006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e840017e0 tx=0x7f6e84001610 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.281+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e7c0593d0 con 0x7f6e940cce30 2024-09-10T08:33:16.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.533+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6e940711f0 con 0x7f6e940cce30 2024-09-10T08:33:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.535+0000 7f6e90c00640 1 -- 172.21.15.52:0/4290136305 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f6e7c058cd0 con 0x7f6e940cce30 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:33:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.537+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 msgr2=0x7f6e7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.537+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 0x7f6e7006e320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e840017e0 tx=0x7f6e84001610 comp rx=0 tx=0).stop 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.537+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 msgr2=0x7f6e9414ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.537+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c490 tx=0x7f6e7c00c950 comp rx=0 tx=0).stop 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 shutdown_connections 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6e7006be60 0x7f6e7006e320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6e940cd2a0 0x7f6e94145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e940cce30 0x7f6e9414ce60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 --2- 172.21.15.52:0/4290136305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e940732e0 0x7f6e9414e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 >> 172.21.15.52:0/4290136305 conn(0x7f6e9406d0f0 msgr2=0x7f6e941519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 shutdown_connections 2024-09-10T08:33:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.538+0000 7f6e9ae00640 1 -- 172.21.15.52:0/4290136305 wait complete. 2024-09-10T08:33:16.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.709+0000 7fcffd600640 1 Processor -- start 2024-09-10T08:33:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.709+0000 7fcffd600640 1 -- start start 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffd600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcff80b63f0 0x7fcff80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffd600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff80cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffd600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff80cfb40 con 0x7fcff80b7a30 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffd600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcff80d27f0 con 0x7fcff80b63f0 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffd600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcff80cfe20 con 0x7fcff80b67d0 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcff7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcff80b63f0 0x7fcff80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcff7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcff80b63f0 0x7fcff80cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46766/0 (socket says 172.21.15.52:46766) 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcff7e00640 1 -- 172.21.15.52:0/3571780842 learned_addr learned my addr 172.21.15.52:0/3571780842 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.710+0000 7fcffcc00640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff80cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.711+0000 7fcff7e00640 1 -- 172.21.15.52:0/3571780842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 msgr2=0x7fcff80cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.711+0000 7fcff7e00640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff80cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.711+0000 7fcff7e00640 1 -- 172.21.15.52:0/3571780842 >> v1:172.21.15.176:6789/0 conn(0x7fcff80b7a30 legacy=0x7fcff815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:16.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.711+0000 7fcff7e00640 1 -- 172.21.15.52:0/3571780842 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff80d2e00 con 0x7fcff80b63f0 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcff7e00640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff80cef60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009870 tx=0x7fcfe802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96be598a7ada27b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcff7400640 1 -- 172.21.15.52:0/3571780842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8037070 con 0x7fcff80b63f0 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcff7400640 1 -- 172.21.15.52:0/3571780842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe8032440 con 0x7fcff80b63f0 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcff7400640 1 -- 172.21.15.52:0/3571780842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8032810 con 0x7fcff80b63f0 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 -- 172.21.15.52:0/3571780842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 msgr2=0x7fcff80cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff80cef60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009870 tx=0x7fcfe802a250 comp rx=0 tx=0).stop 2024-09-10T08:33:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 -- 172.21.15.52:0/3571780842 shutdown_connections 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff80cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 --2- 172.21.15.52:0/3571780842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff80cef60 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.712+0000 7fcffd600640 1 -- 172.21.15.52:0/3571780842 >> 172.21.15.52:0/3571780842 conn(0x7fcff80d1360 msgr2=0x7fcff80d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.713+0000 7fcffd600640 1 -- 172.21.15.52:0/3571780842 shutdown_connections 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.713+0000 7fcffd600640 1 -- 172.21.15.52:0/3571780842 wait complete. 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.714+0000 7fcffd600640 1 Processor -- start 2024-09-10T08:33:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.714+0000 7fcffd600640 1 -- start start 2024-09-10T08:33:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80b7a30 0x7fcff815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcff815e810 con 0x7fcff80b63f0 2024-09-10T08:33:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcff815e690 con 0x7fcff80b7a30 2024-09-10T08:33:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcffd600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcff815e990 con 0x7fcff80b67d0 2024-09-10T08:33:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.715+0000 7fcff7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46770/0 (socket says 172.21.15.52:46770) 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 -- 172.21.15.52:0/805972855 learned_addr learned my addr 172.21.15.52:0/805972855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcffcc00640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80b7a30 0x7fcff815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcfef400640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 -- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 msgr2=0x7fcff815a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff815a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 -- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80b7a30 msgr2=0x7fcff815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80b7a30 0x7fcff815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 -- 172.21.15.52:0/805972855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff815d5f0 con 0x7fcff80b63f0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff7e00640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8000c00 tx=0x7fcfe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.716+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8041020 con 0x7fcff80b63f0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.717+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe80306c0 con 0x7fcff80b63f0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.717+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8037040 con 0x7fcff80b63f0 2024-09-10T08:33:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.717+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff815d8d0 con 0x7fcff80b63f0 2024-09-10T08:33:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.717+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff815dbb0 con 0x7fcff80b63f0 2024-09-10T08:33:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.718+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff815df80 con 0x7fcff80b63f0 2024-09-10T08:33:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.719+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfe8044020 con 0x7fcff80b63f0 2024-09-10T08:33:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.719+0000 7fcff4c00640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 0x7fcfd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.720+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7fcfe80ab560 con 0x7fcff80b63f0 2024-09-10T08:33:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.720+0000 7fcfef400640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 0x7fcfd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.721+0000 7fcfef400640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 0x7fcfd406e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcff8159d40 tx=0x7fcfe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.724+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfe804b030 con 0x7fcff80b63f0 2024-09-10T08:33:16.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.946+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcff81580e0 con 0x7fcff80b63f0 2024-09-10T08:33:16.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.947+0000 7fcff4c00640 1 -- 172.21.15.52:0/805972855 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5228 (secure 0 0 0) 0x7fcfe8079820 con 0x7fcff80b63f0 2024-09-10T08:33:16.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:16.947 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":50,"btime":"2024-09-10T08:33:14:436162+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1578598331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1578598331},{"type":"v1","addr":"172.21.15.176:6837","nonce":1578598331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1182188200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1182188200},{"type":"v1","addr":"172.21.15.52:6835","nonce":1182188200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6298,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1714870234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1714870234},{"type":"v1","addr":"172.21.15.176:6836","nonce":1714870234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:13.858530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/177160853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":177160853},{"type":"v1","addr":"172.21.15.52:6834","nonce":177160853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6642,"qdb_cluster":[6642]},"id":5}]} 2024-09-10T08:33:16.947 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 50 2024-09-10T08:33:16.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 msgr2=0x7fcfd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 0x7fcfd406e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcff8159d40 tx=0x7fcfe0009040 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 msgr2=0x7fcff81f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8000c00 tx=0x7fcfe80046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 shutdown_connections 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfd406be30 0x7fcfd406e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80b7a30 0x7fcff815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcff80b67d0 0x7fcff815a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 --2- 172.21.15.52:0/805972855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff80b63f0 0x7fcff81f4c80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 >> 172.21.15.52:0/805972855 conn(0x7fcff80d1360 msgr2=0x7fcff80b9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 shutdown_connections 2024-09-10T08:33:16.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:16.949+0000 7fcffd600640 1 -- 172.21.15.52:0/805972855 wait complete. 2024-09-10T08:33:17.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:10.841390+0000', 'modified': '2024-09-10T08:33:13.858530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6642}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6642': {'gid': 6642, 'name': 'c', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/177160853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 177160853}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 177160853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6642, 'qdb_cluster': [6642]} 2024-09-10T08:33:17.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:33:17.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:33:17.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.528+0000 7f5d89600640 1 Processor -- start 2024-09-10T08:33:17.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.528+0000 7f5d89600640 1 -- start start 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.529+0000 7f5d89600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d84147e80 0x7f5d84070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.529+0000 7f5d89600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84148260 0x7f5d840714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.529+0000 7f5d89600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d84071b30 con 0x7f5d8406bc10 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.529+0000 7f5d89600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5d84074200 con 0x7f5d84147e80 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.529+0000 7f5d89600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d840b3e40 con 0x7f5d84148260 2024-09-10T08:33:17.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5d84147e80 0x7f5d84070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d83400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5d8406bc10 0x7f5d841623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59640/0 (socket says 172.21.15.52:59640) 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d83400640 1 -- 172.21.15.52:0/2299818096 learned_addr learned my addr 172.21.15.52:0/2299818096 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82000640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84148260 0x7f5d840714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82a00640 1 -- 172.21.15.52:0/2299818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84148260 msgr2=0x7f5d840714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82a00640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84148260 0x7f5d840714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82a00640 1 -- 172.21.15.52:0/2299818096 >> v1:172.21.15.52:6789/0 conn(0x7f5d8406bc10 legacy=0x7f5d841623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d82a00640 1 -- 172.21.15.52:0/2299818096 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d840b3510 con 0x7f5d84147e80 2024-09-10T08:33:17.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.530+0000 7f5d81600640 1 -- 172.21.15.52:0/2299818096 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461127535 0 0) 0x7f5d84071b30 con 0x7f5d8406bc10 2024-09-10T08:33:17.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.531+0000 7f5d82a00640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84147e80 0x7f5d84070f70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097a0 tx=0x7f5d7402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8642f6d393abe8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.531+0000 7f5d81600640 1 -- 172.21.15.52:0/2299818096 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74037070 con 0x7f5d84147e80 2024-09-10T08:33:17.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.531+0000 7f5d81600640 1 -- 172.21.15.52:0/2299818096 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d74032440 con 0x7f5d84147e80 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.531+0000 7f5d81600640 1 -- 172.21.15.52:0/2299818096 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74032810 con 0x7f5d84147e80 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 -- 172.21.15.52:0/2299818096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84147e80 msgr2=0x7f5d84070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84147e80 0x7f5d84070f70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5d740097a0 tx=0x7f5d7402a180 comp rx=0 tx=0).stop 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 -- 172.21.15.52:0/2299818096 shutdown_connections 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84148260 0x7f5d840714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 --2- 172.21.15.52:0/2299818096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84147e80 0x7f5d84070f70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 -- 172.21.15.52:0/2299818096 >> 172.21.15.52:0/2299818096 conn(0x7f5d840ccec0 msgr2=0x7f5d840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 -- 172.21.15.52:0/2299818096 shutdown_connections 2024-09-10T08:33:17.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.532+0000 7f5d89600640 1 -- 172.21.15.52:0/2299818096 wait complete. 2024-09-10T08:33:17.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.534+0000 7f5d89600640 1 Processor -- start 2024-09-10T08:33:17.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.534+0000 7f5d89600640 1 -- start start 2024-09-10T08:33:17.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d8406bc10 0x7f5d841f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 0x7f5d841e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840b52e0 con 0x7f5d84148260 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840b3ad0 con 0x7f5d8406bc10 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d89600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d840b5460 con 0x7f5d84147e80 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d83400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d83400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46788/0 (socket says 172.21.15.52:46788) 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d83400640 1 -- 172.21.15.52:0/2375952964 learned_addr learned my addr 172.21.15.52:0/2375952964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d82000640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 0x7f5d841e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.535+0000 7f5d82a00640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d8406bc10 0x7f5d841f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 -- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 msgr2=0x7f5d841e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 0x7f5d841e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 -- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d8406bc10 msgr2=0x7f5d841f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d8406bc10 0x7f5d841f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 -- 172.21.15.52:0/2375952964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d841e4210 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d82000640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 0x7f5d841e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d83400640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c730 tx=0x7f5d7c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d7aa00640 1 -- 172.21.15.52:0/2375952964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c018070 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d7aa00640 1 -- 172.21.15.52:0/2375952964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00ce40 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d84144060 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d7aa00640 1 -- 172.21.15.52:0/2375952964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00a860 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.536+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8412f390 con 0x7f5d84148260 2024-09-10T08:33:17.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.538+0000 7f5d7aa00640 1 -- 172.21.15.52:0/2375952964 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d7c01b070 con 0x7f5d84148260 2024-09-10T08:33:17.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.539+0000 7f5d7aa00640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 0x7f5d6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.539+0000 7f5d7aa00640 1 -- 172.21.15.52:0/2375952964 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f5d7c08a380 con 0x7f5d84148260 2024-09-10T08:33:17.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.540+0000 7f5d82a00640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 0x7f5d6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.540+0000 7f5d8c48f740 1 Processor -- start 2024-09-10T08:33:17.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.540+0000 7f5d8c48f740 1 -- start start 2024-09-10T08:33:17.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.540+0000 7f5d82a00640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 0x7f5d6406e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d74034000 tx=0x7f5d7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58e700 0x56183a571960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a5454b0 0x56183a571ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56183a4a63b0 con 0x56183a58dde0 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56183a4ab410 con 0x56183a58e700 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56183a453620 con 0x56183a5454b0 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46804/0 (socket says 172.21.15.52:46804) 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d82a00640 1 -- 172.21.15.52:0/809057749 learned_addr learned my addr 172.21.15.52:0/809057749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d82000640 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58e700 0x56183a571960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.541+0000 7f5d83400640 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a5454b0 0x56183a571ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 -- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a5454b0 msgr2=0x56183a571ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a5454b0 0x56183a571ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 -- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58e700 msgr2=0x56183a571960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58e700 0x56183a571960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 -- 172.21.15.52:0/809057749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56183a1be2d0 con 0x56183a58dde0 2024-09-10T08:33:17.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d82a00640 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009890 tx=0x7f5d7402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6301a18a77ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d6f000640 1 -- 172.21.15.52:0/809057749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74037040 con 0x56183a58dde0 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d6f000640 1 -- 172.21.15.52:0/809057749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7404e070 con 0x56183a58dde0 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.542+0000 7f5d6f000640 1 -- 172.21.15.52:0/809057749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7403c440 con 0x56183a58dde0 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 -- 172.21.15.52:0/809057749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 msgr2=0x56183a58e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009890 tx=0x7f5d7402c000 comp rx=0 tx=0).stop 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 -- 172.21.15.52:0/809057749 shutdown_connections 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a5454b0 0x56183a571ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58e700 0x56183a571960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/809057749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a58e1c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 -- 172.21.15.52:0/809057749 >> 172.21.15.52:0/809057749 conn(0x56183a544740 msgr2=0x56183a58c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 -- 172.21.15.52:0/809057749 shutdown_connections 2024-09-10T08:33:17.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.543+0000 7f5d8c48f740 1 -- 172.21.15.52:0/809057749 wait complete. 2024-09-10T08:33:17.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.544+0000 7f5d8c48f740 1 -- start start 2024-09-10T08:33:17.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.544+0000 7f5d8c48f740 1 Processor -- start 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58dde0 0x56183a56eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a546f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56183a466780 con 0x56183a58e700 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x56183a4a73d0 con 0x56183a546aa0 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56183a5480c0 con 0x56183a58dde0 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d8c48f740 10 client.0 _ll_register_callbacks cb 0x56183a4a45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d82000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d82000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46814/0 (socket says 172.21.15.52:46814) 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d82000640 1 -- 172.21.15.52:0/3251216889 learned_addr learned my addr 172.21.15.52:0/3251216889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d83400640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a546f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.545+0000 7f5d82a00640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58dde0 0x56183a56eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 -- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58dde0 msgr2=0x56183a56eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58dde0 0x56183a56eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 -- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 msgr2=0x56183a546f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a546f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 -- 172.21.15.52:0/3251216889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56183a2886b0 con 0x56183a58e700 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d82000640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5d70012550 tx=0x7f5d70012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6727d13f31976b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d63400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70019070 con 0x56183a58e700 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f5d70004300 con 0x56183a58e700 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d7404e070 con 0x56183a58e700 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.546+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5d70024050 con 0x56183a58e700 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 10 client.6765 fetch_fsmap learned FSMap version 50 2024-09-10T08:33:17.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x56183a56f3f0 con 0x56183a58e700 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7404e070 con 0x56183a58e700 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7f5d70027020 con 0x56183a58e700 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 10 client.6765 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 10 client.6765 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 20 client.6765 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a5a56d0 0x56183a5b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 4 client.6765 mds_command: new command op to 6642 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 --> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56183a4b8b40 con 0x56183a5a56d0 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.547+0000 7f5d82a00640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a5a56d0 0x56183a5b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.548+0000 7f5d82a00640 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a5a56d0 0x56183a5b37b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c358b474ddb45b server_cookie=a3c629dc3eb662c6 in_seq=0 out_seq=0 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.548+0000 7f5d63400640 10 client.6765 ms_handle_connect on v2:172.21.15.52:6832/177160853 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d63400640 1 -- 172.21.15.52:0/3251216889 <== mds.0 v2:172.21.15.52:6832/177160853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56183a4b8b40 con 0x56183a5a56d0 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d63400640 10 client.6765 handle_command_reply: tid=0 2024-09-10T08:33:17.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 client.6765 shutdown 2024-09-10T08:33:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 msgr2=0x56183a584f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5d70012550 tx=0x7f5d70012a10 comp rx=0 tx=0).stop 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 shutdown_connections 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a546f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a5a56d0 0x56183a5b37b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58e700 0x56183a584f30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d63400640 0 client.6765 ms_handle_reset on v2:172.21.15.52:6832/177160853 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/3251216889 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58dde0 0x56183a56eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 >> 172.21.15.52:0/3251216889 conn(0x56183a5454b0 msgr2=0x56183a58fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 shutdown_connections 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 1 -- 172.21.15.52:0/3251216889 wait complete. 2024-09-10T08:33:17.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.549+0000 7f5d8c48f740 20 client.6765 trim_cache size 0 max 16384 2024-09-10T08:33:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.568+0000 7f5d8c48f740 1 Processor -- start 2024-09-10T08:33:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.568+0000 7f5d8c48f740 1 -- start start 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 0x56183a58ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a545890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840c7980 con 0x56183a546aa0 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840c69a0 con 0x56183a58dde0 2024-09-10T08:33:17.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5d84130570 con 0x56183a58e700 2024-09-10T08:33:17.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46826/0 (socket says 172.21.15.52:46826) 2024-09-10T08:33:17.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82a00640 1 -- 172.21.15.52:0/1967862309 learned_addr learned my addr 172.21.15.52:0/1967862309 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82000640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 0x56183a58ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d83400640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a545890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82a00640 1 -- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 msgr2=0x56183a545890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.569+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a545890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d82a00640 1 -- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 msgr2=0x56183a58ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 0x56183a58ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d82a00640 1 -- 172.21.15.52:0/1967862309 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56183a58efa0 con 0x56183a546aa0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d82000640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 0x56183a58ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d83400640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a545890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5d74035040 tx=0x7f5d74009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992b6ede804c5079 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d6e600640 1 -- 172.21.15.52:0/1967862309 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74060070 con 0x56183a546aa0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d6e600640 1 -- 172.21.15.52:0/1967862309 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7404e040 con 0x56183a546aa0 2024-09-10T08:33:17.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.570+0000 7f5d6e600640 1 -- 172.21.15.52:0/1967862309 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74037040 con 0x56183a546aa0 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1967862309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 msgr2=0x56183a584cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5d74035040 tx=0x7f5d74009190 comp rx=0 tx=0).stop 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1967862309 shutdown_connections 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a545890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a58dde0 0x56183a58ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1967862309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a546aa0 0x56183a584cf0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1967862309 >> 172.21.15.52:0/1967862309 conn(0x56183a5454b0 msgr2=0x56183a570760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1967862309 shutdown_connections 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1967862309 wait complete. 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.571+0000 7f5d8c48f740 1 -- start start 2024-09-10T08:33:17.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 Processor -- start 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a56f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a613230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56183a585cb0 con 0x56183a58dde0 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5d84130bc0 con 0x56183a546aa0 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.572+0000 7f5d8c48f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56183a586310 con 0x56183a58e700 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d8c48f740 10 client.0 _ll_register_callbacks cb 0x7f5d70007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46832/0 (socket says 172.21.15.52:46832) 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 -- 172.21.15.52:0/1537058185 learned_addr learned my addr 172.21.15.52:0/1537058185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a56f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d83400640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a613230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 -- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 msgr2=0x56183a613230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a613230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 -- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 msgr2=0x56183a56f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a56f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 -- 172.21.15.52:0/1537058185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56183a589140 con 0x56183a58dde0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d83400640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a613230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d82000640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5d70007010 tx=0x7f5d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367bc25e143d045b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.573+0000 7f5d63400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7002d060 con 0x56183a58dde0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f5d70004300 con 0x56183a58dde0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d7404e040 con 0x56183a58dde0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5d70033050 con 0x56183a58dde0 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 10 client.6771 fetch_fsmap learned FSMap version 50 2024-09-10T08:33:17.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x56183a542480 con 0x56183a58dde0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7404e040 con 0x56183a58dde0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 50) ==== 3502+0+0 (secure 0 0 0) 0x7f5d70027040 con 0x56183a58dde0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 10 client.6771 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 10 client.6771 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 20 client.6771 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a58c950 0x56183a5a3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 4 client.6771 mds_command: new command op to 6642 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.574+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 --> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] -- command(tid 0: {"prefix": "status"}) -- 0x56183a4b2e90 con 0x56183a58c950 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a58c950 0x56183a5a3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d82a00640 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a58c950 0x56183a5a3730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d930c8a13ec81275 server_cookie=e1fba0b995ff1c0f in_seq=0 out_seq=0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d63400640 10 client.6771 ms_handle_connect on v2:172.21.15.52:6832/177160853 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d63400640 1 -- 172.21.15.52:0/1537058185 <== mds.0 v2:172.21.15.52:6832/177160853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56183a4b2e90 con 0x56183a58c950 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d63400640 10 client.6771 handle_command_reply: tid=0 2024-09-10T08:33:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.575+0000 7f5d8c48f740 1 client.6771 shutdown 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 msgr2=0x56183a612cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5d70007010 tx=0x7f5d700046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 shutdown_connections 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56183a58e700 0x56183a613230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:6832/177160853,v1:172.21.15.52:6834/177160853] conn(0x56183a58c950 0x56183a5a3730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56183a58dde0 0x56183a612cf0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 --2- 172.21.15.52:0/1537058185 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56183a546aa0 0x56183a56f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d63400640 0 client.6771 ms_handle_reset on v2:172.21.15.52:6832/177160853 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 >> 172.21.15.52:0/1537058185 conn(0x56183a5454b0 msgr2=0x56183a545890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 shutdown_connections 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 1 -- 172.21.15.52:0/1537058185 wait complete. 2024-09-10T08:33:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d8c48f740 20 client.6771 trim_cache size 0 max 16384 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6642, 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1660751820000002, 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 50, 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 76, 2024-09-10T08:33:17.581 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T08:33:17.582 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.850405906000001 2024-09-10T08:33:17.582 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.576+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 msgr2=0x7f5d6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 0x7f5d6406e320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5d74034000 tx=0x7f5d7402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 msgr2=0x7f5d841e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c730 tx=0x7f5d7c00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 shutdown_connections 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d6406be60 0x7f5d6406e320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d84148260 0x7f5d841e7170 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5d84147e80 0x7f5d841e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 --2- 172.21.15.52:0/2375952964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5d8406bc10 0x7f5d841f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 >> 172.21.15.52:0/2375952964 conn(0x7f5d840ccec0 msgr2=0x7f5d840d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 shutdown_connections 2024-09-10T08:33:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.577+0000 7f5d89600640 1 -- 172.21.15.52:0/2375952964 wait complete. 2024-09-10T08:33:17.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:33:17.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.749+0000 7f34d6a00640 1 Processor -- start 2024-09-10T08:33:17.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.749+0000 7f34d6a00640 1 -- start start 2024-09-10T08:33:17.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 0x7f34d00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d6a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 0x7f34d015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d6a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d015f3d0 con 0x7f34d0160360 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d6a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f34d015f6b0 con 0x7f34d015ec60 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34d015f990 con 0x7f34d015c0e0 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 0x7f34d015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 0x7f34d015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46838/0 (socket says 172.21.15.52:46838) 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d4c00640 1 -- 172.21.15.52:0/538692906 learned_addr learned my addr 172.21.15.52:0/538692906 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.750+0000 7f34d5600640 1 --2- 172.21.15.52:0/538692906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 0x7f34d00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.751+0000 7f34d5600640 1 -- 172.21.15.52:0/538692906 >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 msgr2=0x7f34d015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.751+0000 7f34d5600640 1 --2- 172.21.15.52:0/538692906 >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 0x7f34d015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.751+0000 7f34d5600640 1 -- 172.21.15.52:0/538692906 >> v1:172.21.15.176:6789/0 conn(0x7f34d0160360 legacy=0x7f34d00cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.751+0000 7f34d5600640 1 -- 172.21.15.52:0/538692906 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00cd270 con 0x7f34d015c0e0 2024-09-10T08:33:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.752+0000 7f34d5600640 1 --2- 172.21.15.52:0/538692906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 0x7f34d00b2f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c40097a0 tx=0x7f34c402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c26aced0de9c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.752+0000 7f34cfe00640 1 -- 172.21.15.52:0/538692906 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4037070 con 0x7f34d015c0e0 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.752+0000 7f34cfe00640 1 -- 172.21.15.52:0/538692906 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4032440 con 0x7f34d015c0e0 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.752+0000 7f34cfe00640 1 -- 172.21.15.52:0/538692906 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4032810 con 0x7f34d015c0e0 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 -- 172.21.15.52:0/538692906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 msgr2=0x7f34d00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 --2- 172.21.15.52:0/538692906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 0x7f34d00b2f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34c40097a0 tx=0x7f34c402a180 comp rx=0 tx=0).stop 2024-09-10T08:33:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 -- 172.21.15.52:0/538692906 shutdown_connections 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 --2- 172.21.15.52:0/538692906 >> v2:172.21.15.52:3300/0 conn(0x7f34d015ec60 0x7f34d015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 --2- 172.21.15.52:0/538692906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015c0e0 0x7f34d00b2f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 -- 172.21.15.52:0/538692906 >> 172.21.15.52:0/538692906 conn(0x7f34d006c240 msgr2=0x7f34d006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 -- 172.21.15.52:0/538692906 shutdown_connections 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.753+0000 7f34d6a00640 1 -- 172.21.15.52:0/538692906 wait complete. 2024-09-10T08:33:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.754+0000 7f34d6a00640 1 Processor -- start 2024-09-10T08:33:17.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.755+0000 7f34d6a00640 1 -- start start 2024-09-10T08:33:17.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.755+0000 7f34d6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.755+0000 7f34d6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015ec60 0x7f34d00ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34d0160360 0x7f34d00acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d6a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34d015c640 con 0x7f34d015c0e0 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34d015c4c0 con 0x7f34d0160360 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00cdea0 con 0x7f34d015ec60 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46848/0 (socket says 172.21.15.52:46848) 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 -- 172.21.15.52:0/4046744038 learned_addr learned my addr 172.21.15.52:0/4046744038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d4c00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015ec60 0x7f34d00ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d6000640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34d0160360 0x7f34d00acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 -- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015ec60 msgr2=0x7f34d00ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015ec60 0x7f34d00ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 -- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34d0160360 msgr2=0x7f34d00acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34d0160360 0x7f34d00acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 -- 172.21.15.52:0/4046744038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00ca000 con 0x7f34d015c0e0 2024-09-10T08:33:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.756+0000 7f34d5600640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f34c4035040 tx=0x7f34c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.757+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4037040 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.757+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4030500 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.757+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40308f0 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.757+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d00ca2e0 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.757+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d00ca8a0 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.758+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d00b2f20 con 0x7f34d015c0e0 2024-09-10T08:33:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.759+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f34c4044020 con 0x7f34d015c0e0 2024-09-10T08:33:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.760+0000 7f34cd600640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.760+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f34c40ab170 con 0x7f34d015c0e0 2024-09-10T08:33:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.760+0000 7f34d4c00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.761+0000 7f34d4c00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 0x7f34b006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f34d01f79d0 tx=0x7f34bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.764+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34c4079a80 con 0x7f34d015c0e0 2024-09-10T08:33:17.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.986+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34d00cf210 con 0x7f34d015c0e0 2024-09-10T08:33:17.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.986+0000 7f34cd600640 1 -- 172.21.15.52:0/4046744038 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) ==== 53+0+73 (secure 0 0 0) 0x7f34c4079380 con 0x7f34d015c0e0 2024-09-10T08:33:17.987 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:33:17.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 msgr2=0x7f34b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 0x7f34b006e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f34d01f79d0 tx=0x7f34bc008040 comp rx=0 tx=0).stop 2024-09-10T08:33:17.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 msgr2=0x7f34d00cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f34c4035040 tx=0x7f34c40046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 shutdown_connections 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f34b006be30 0x7f34b006e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34d0160360 0x7f34d00acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34d015ec60 0x7f34d00ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 --2- 172.21.15.52:0/4046744038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34d015c0e0 0x7f34d00cb0a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 >> 172.21.15.52:0/4046744038 conn(0x7f34d006c240 msgr2=0x7f34d00b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 shutdown_connections 2024-09-10T08:33:17.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:17.989+0000 7f34d6a00640 1 -- 172.21.15.52:0/4046744038 wait complete. 2024-09-10T08:33:18.004 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:33:18.004 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:33:18.004 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:33:18.004 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:33:18.004 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:18.005 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:33:18.005 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:33:18.005 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:33:18.005 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:18.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.005 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:33:18.040 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42404sec preferred_lft 42404sec 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:33:18.041 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:33:18.042 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:33:18.043 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:33:18.044 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:18.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.044 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:33:18.136 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:33:18.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.140 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:33:18.175 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:33:18.176 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:33:18.176 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:33:18.176 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:33:18.176 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:33:18.176 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:33:18.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:33:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:33:18.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.373 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:33:18.408 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:33:18.409 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:33:18.409 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:18.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:33:18.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:33:18.506 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:18.542 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:18.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:33:18.542 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:18.617 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:33:18.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:18.746 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:18.746 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:33:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:33:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:33:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:33:18.774 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:33:18.777 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:33:18.777 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:33:18.777 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:33:18.777 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:33:18.777 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:33:18.780 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:33:18.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:18.836 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:33:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:33:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:33:18.933 INFO:teuthology.orchestra.run.smithi052.stdout:client6418 2024-09-10T08:33:18.933 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:18.933 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:18.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:18.969 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-10T08:33:19.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:19.051 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-10T08:33:19.128 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:33:19.128 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:33:19.128 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:33:19.129 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:33:19.129 DEBUG:teuthology.orchestra.run.smithi052:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-10T08:33:19.129 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:33:19.267 INFO:teuthology.orchestra.run.smithi052.stdout:1099511627776 2024-09-10T08:33:19.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:33:19.278 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:19.278 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:19.355 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:19.355 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:19.432 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:33:19.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.629+0000 7f9c0c000640 1 Processor -- start 2024-09-10T08:33:19.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.629+0000 7f9c0c000640 1 -- start start 2024-09-10T08:33:19.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.630+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.630+0000 7f9c0c000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9c0406efb0 0x7f9c04071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.630+0000 7f9c0c000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c04072fb0 con 0x7f9c041482b0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.630+0000 7f9c0c000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9c04073290 con 0x7f9c0406efb0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.630+0000 7f9c0c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c04073570 con 0x7f9c040b49a0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c09600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9c041482b0 0x7f9c040b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59648/0 (socket says 172.21.15.52:59648) 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c09600640 1 -- 172.21.15.52:0/1136444647 learned_addr learned my addr 172.21.15.52:0/1136444647 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c0a000640 1 --2- 172.21.15.52:0/1136444647 >> v2:172.21.15.176:3300/0 conn(0x7f9c0406efb0 0x7f9c04071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c08c00640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c03e00640 1 -- 172.21.15.52:0/1136444647 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166438154 0 0) 0x7f9c04072fb0 con 0x7f9c041482b0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c03e00640 1 -- 172.21.15.52:0/1136444647 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bec003520 con 0x7f9c041482b0 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c0a000640 1 -- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 msgr2=0x7f9c04071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:19.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c0a000640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c0a000640 1 -- 172.21.15.52:0/1136444647 >> v1:172.21.15.52:6789/0 conn(0x7f9c041482b0 legacy=0x7f9c040b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.631+0000 7f9c0a000640 1 -- 172.21.15.52:0/1136444647 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0406da80 con 0x7f9c0406efb0 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.632+0000 7f9c0a000640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04071970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009d90 tx=0x7f9bfc02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4615dc6272196a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c03e00640 1 -- 172.21.15.52:0/1136444647 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc031600 con 0x7f9c0406efb0 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c03e00640 1 -- 172.21.15.52:0/1136444647 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc0317a0 con 0x7f9c0406efb0 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c03e00640 1 -- 172.21.15.52:0/1136444647 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc031b50 con 0x7f9c0406efb0 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 -- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 msgr2=0x7f9c04071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04071970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009d90 tx=0x7f9bfc02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 -- 172.21.15.52:0/1136444647 shutdown_connections 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04071970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 --2- 172.21.15.52:0/1136444647 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 -- 172.21.15.52:0/1136444647 >> 172.21.15.52:0/1136444647 conn(0x7f9c0406c240 msgr2=0x7f9c040b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 -- 172.21.15.52:0/1136444647 shutdown_connections 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.633+0000 7f9c0c000640 1 -- 172.21.15.52:0/1136444647 wait complete. 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.635+0000 7f9c0c000640 1 Processor -- start 2024-09-10T08:33:19.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.635+0000 7f9c0c000640 1 -- start start 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0406d6a0 con 0x7f9c041482b0 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c04148690 con 0x7f9c0406efb0 2024-09-10T08:33:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0406d820 con 0x7f9c040b49a0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46860/0 (socket says 172.21.15.52:46860) 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c0a000640 1 -- 172.21.15.52:0/256890307 learned_addr learned my addr 172.21.15.52:0/256890307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c08c00640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.636+0000 7f9c09600640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 -- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 msgr2=0x7f9c04159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 -- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 msgr2=0x7f9c04158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 -- 172.21.15.52:0/256890307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04142de0 con 0x7f9c041482b0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0a000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc02abc0 tx=0x7f9bfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc040070 con 0x7f9c041482b0 2024-09-10T08:33:19.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc03c850 con 0x7f9c041482b0 2024-09-10T08:33:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc03cc40 con 0x7f9c041482b0 2024-09-10T08:33:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.637+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0415d710 con 0x7f9c041482b0 2024-09-10T08:33:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.638+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0415dcd0 con 0x7f9c041482b0 2024-09-10T08:33:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.639+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0415ded0 con 0x7f9c041482b0 2024-09-10T08:33:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.640+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bfc039040 con 0x7f9c041482b0 2024-09-10T08:33:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.641+0000 7f9c01600640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 0x7f9be406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.641+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f9bfc0abf50 con 0x7f9c041482b0 2024-09-10T08:33:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.641+0000 7f9c09600640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 0x7f9be406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.642+0000 7f9c09600640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 0x7f9be406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005880 tx=0x7f9bf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:19.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.645+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c0415ded0 con 0x7f9c041482b0 2024-09-10T08:33:19.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.842+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9c040b4290 con 0x7f9c041482b0 2024-09-10T08:33:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.842+0000 7f9c01600640 1 -- 172.21.15.52:0/256890307 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f9bfc031770 con 0x7f9c041482b0 2024-09-10T08:33:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 msgr2=0x7f9be406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 0x7f9be406e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005880 tx=0x7f9bf8009040 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 msgr2=0x7f9c04142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc02abc0 tx=0x7f9bfc004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 shutdown_connections 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9be406be30 0x7f9be406e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c041482b0 0x7f9c04142390 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c040b49a0 0x7f9c04159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 --2- 172.21.15.52:0/256890307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c0406efb0 0x7f9c04158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:19.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 >> 172.21.15.52:0/256890307 conn(0x7f9c0406c240 msgr2=0x7f9c040af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 shutdown_connections 2024-09-10T08:33:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:19.845+0000 7f9c0c000640 1 -- 172.21.15.52:0/256890307 wait complete. 2024-09-10T08:33:19.861 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:33:19.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:19.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:19.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:33:19.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:19.952 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:33:20.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.158+0000 7f2a58c00640 1 Processor -- start 2024-09-10T08:33:20.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.158+0000 7f2a58c00640 1 -- start start 2024-09-10T08:33:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.159+0000 7f2a58c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 0x7f2a540b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.159+0000 7f2a58c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.159+0000 7f2a58c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a540b4020 con 0x7f2a540b5880 2024-09-10T08:33:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.159+0000 7f2a58c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2a54073b00 con 0x7f2a54145ed0 2024-09-10T08:33:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.159+0000 7f2a58c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a540b42c0 con 0x7f2a54073180 2024-09-10T08:33:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a51e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 0x7f2a540b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:56066/0 (socket says 172.21.15.52:56066) 2024-09-10T08:33:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 -- 172.21.15.52:0/2952494672 learned_addr learned my addr 172.21.15.52:0/2952494672 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 -- 172.21.15.52:0/2952494672 >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 msgr2=0x7f2a540b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 --2- 172.21.15.52:0/2952494672 >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 0x7f2a540b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 -- 172.21.15.52:0/2952494672 >> v1:172.21.15.176:6789/0 conn(0x7f2a540b5880 legacy=0x7f2a540b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a49400640 1 -- 172.21.15.52:0/2952494672 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a540b45a0 con 0x7f2a54073180 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.160+0000 7f2a51e00640 1 --2- 172.21.15.52:0/2952494672 >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 0x7f2a540b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.161+0000 7f2a49400640 1 --2- 172.21.15.52:0/2952494672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009870 tx=0x7f2a3c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c071ddf7e6303f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a51400640 1 -- 172.21.15.52:0/2952494672 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c037070 con 0x7f2a54073180 2024-09-10T08:33:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a51400640 1 -- 172.21.15.52:0/2952494672 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3c032440 con 0x7f2a54073180 2024-09-10T08:33:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a51400640 1 -- 172.21.15.52:0/2952494672 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c032810 con 0x7f2a54073180 2024-09-10T08:33:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 -- 172.21.15.52:0/2952494672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 msgr2=0x7f2a540735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 --2- 172.21.15.52:0/2952494672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009870 tx=0x7f2a3c02a250 comp rx=0 tx=0).stop 2024-09-10T08:33:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 -- 172.21.15.52:0/2952494672 shutdown_connections 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 --2- 172.21.15.52:0/2952494672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a540735c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 --2- 172.21.15.52:0/2952494672 >> v2:172.21.15.176:3300/0 conn(0x7f2a54145ed0 0x7f2a540b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 -- 172.21.15.52:0/2952494672 >> 172.21.15.52:0/2952494672 conn(0x7f2a540ccec0 msgr2=0x7f2a540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 -- 172.21.15.52:0/2952494672 shutdown_connections 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.162+0000 7f2a58c00640 1 -- 172.21.15.52:0/2952494672 wait complete. 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.164+0000 7f2a58c00640 1 Processor -- start 2024-09-10T08:33:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.164+0000 7f2a58c00640 1 -- start start 2024-09-10T08:33:20.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a541f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a540b5880 0x7f2a5415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a541462b0 con 0x7f2a54145ed0 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a540b4b60 con 0x7f2a540b5880 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a58c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a54146430 con 0x7f2a54073180 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a52800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a52800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46868/0 (socket says 172.21.15.52:46868) 2024-09-10T08:33:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a52800640 1 -- 172.21.15.52:0/1297123942 learned_addr learned my addr 172.21.15.52:0/1297123942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a49400640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a540b5880 0x7f2a5415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.165+0000 7f2a51e00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a541f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 -- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 msgr2=0x7f2a541f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a541f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 -- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a540b5880 msgr2=0x7f2a5415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a540b5880 0x7f2a5415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 -- 172.21.15.52:0/1297123942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a541e6f10 con 0x7f2a54145ed0 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a52800640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00c7a0 tx=0x7f2a4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c003b70 con 0x7f2a54145ed0 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c003d30 con 0x7f2a54145ed0 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00aa90 con 0x7f2a54145ed0 2024-09-10T08:33:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a541e71f0 con 0x7f2a54145ed0 2024-09-10T08:33:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.166+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a541e77b0 con 0x7f2a54145ed0 2024-09-10T08:33:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.168+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a54145a10 con 0x7f2a54145ed0 2024-09-10T08:33:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.168+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a4c00ac30 con 0x7f2a54145ed0 2024-09-10T08:33:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.169+0000 7f2a4aa00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 0x7f2a3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.169+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f2a4c08ac80 con 0x7f2a54145ed0 2024-09-10T08:33:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.170+0000 7f2a51e00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 0x7f2a3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.170+0000 7f2a51e00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 0x7f2a3006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009560 tx=0x7f2a44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.173+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a4c058fd0 con 0x7f2a54145ed0 2024-09-10T08:33:20.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.392+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a540735f0 con 0x7f2a54145ed0 2024-09-10T08:33:20.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.393+0000 7f2a4aa00640 1 -- 172.21.15.52:0/1297123942 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5228 (secure 0 0 0) 0x7f2a540735f0 con 0x7f2a54145ed0 2024-09-10T08:33:20.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:20.394 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":50,"btime":"2024-09-10T08:33:14:436162+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5870,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1578598331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1578598331},{"type":"v1","addr":"172.21.15.176:6837","nonce":1578598331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5879,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1182188200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1182188200},{"type":"v1","addr":"172.21.15.52:6835","nonce":1182188200}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6298,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1714870234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1714870234},{"type":"v1","addr":"172.21.15.176:6836","nonce":1714870234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:13.858530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6642},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6642":{"gid":6642,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/177160853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":177160853},{"type":"v1","addr":"172.21.15.52:6834","nonce":177160853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6642,"qdb_cluster":[6642]},"id":5}]} 2024-09-10T08:33:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 50 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 msgr2=0x7f2a3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 0x7f2a3006e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009560 tx=0x7f2a44009190 comp rx=0 tx=0).stop 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 msgr2=0x7f2a54143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00c7a0 tx=0x7f2a4c00cc60 comp rx=0 tx=0).stop 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 shutdown_connections 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a3006be30 0x7f2a3006e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a54145ed0 0x7f2a54143810 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a540b5880 0x7f2a5415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 --2- 172.21.15.52:0/1297123942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a54073180 0x7f2a541f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 >> 172.21.15.52:0/1297123942 conn(0x7f2a540ccec0 msgr2=0x7f2a540cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 shutdown_connections 2024-09-10T08:33:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.395+0000 7f2a58c00640 1 -- 172.21.15.52:0/1297123942 wait complete. 2024-09-10T08:33:20.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T08:33:20.596 INFO:teuthology.orchestra.run.smithi052.stdout:{"message":"","return_code":0} 2024-09-10T08:33:20.597 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T08:33:20.597 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:33:20.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:20.598 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:33:20.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:20.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:33:20.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:20.599 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:33:20.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:20.613 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:33:20.613 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:20.614 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:33:20.614 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:20.615 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:33:20.615 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:20.630 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:33:20.630 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:20.631 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-10T08:33:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.733+0000 7fa0e931ff40 1 Processor -- start 2024-09-10T08:33:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.733+0000 7fa0e931ff40 1 -- start start 2024-09-10T08:33:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104628080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b104467b30 con 0x55b10450b550 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b1044f3f80 con 0x55b1044f3230 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b1044f21a0 con 0x7fa0cc0022a0 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46898/0 (socket says 172.21.15.52:46898) 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 -- 172.21.15.52:0/866913935 learned_addr learned my addr 172.21.15.52:0/866913935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e5000640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104628080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e5a00640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 -- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 msgr2=0x55b10458a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 -- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 msgr2=0x55b104628080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104628080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e6400640 1 -- 172.21.15.52:0/866913935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b104594960 con 0x55b10450b550 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.734+0000 7fa0e5000640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104628080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e6400640 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x55b1044eda40 tx=0x7fa0e0005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ec25dbb7a54e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0df400640 1 -- 172.21.15.52:0/866913935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0017070 con 0x55b10450b550 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0df400640 1 -- 172.21.15.52:0/866913935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0013700 con 0x55b10450b550 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0df400640 1 -- 172.21.15.52:0/866913935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0013ad0 con 0x55b10450b550 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 -- 172.21.15.52:0/866913935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 msgr2=0x55b1046285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x55b1044eda40 tx=0x7fa0e0005d80 comp rx=0 tx=0).stop 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 -- 172.21.15.52:0/866913935 shutdown_connections 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b1046285c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104628080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/866913935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.735+0000 7fa0e931ff40 1 -- 172.21.15.52:0/866913935 >> 172.21.15.52:0/866913935 conn(0x55b1044f04f0 msgr2=0x55b10450be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.736+0000 7fa0e931ff40 1 -- 172.21.15.52:0/866913935 shutdown_connections 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.736+0000 7fa0e931ff40 1 -- 172.21.15.52:0/866913935 wait complete. 2024-09-10T08:33:20.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.736+0000 7fa0e931ff40 1 Processor -- start 2024-09-10T08:33:20.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.736+0000 7fa0e931ff40 1 -- start start 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104589d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b10458cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1044f23f0 con 0x55b10450b550 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b10450d050 con 0x55b1044f3230 2024-09-10T08:33:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e931ff40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b10450d2a0 con 0x7fa0cc0022a0 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e5000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b10458cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e5000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b10458cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46908/0 (socket says 172.21.15.52:46908) 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.737+0000 7fa0e5000640 1 -- 172.21.15.52:0/3564454460 learned_addr learned my addr 172.21.15.52:0/3564454460 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5a00640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104589d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 -- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 msgr2=0x55b10458d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e6400640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 -- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 msgr2=0x55b104589d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104589d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 -- 172.21.15.52:0/3564454460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b104591320 con 0x55b10450b550 2024-09-10T08:33:20.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5a00640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b1044f3230 0x55b104589d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e6400640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0cc0022a0 0x55b10458d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e5000640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b10458cd00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009eb0 tx=0x7fa0d4010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0de000640 1 -- 172.21.15.52:0/3564454460 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400e860 con 0x55b10450b550 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0de000640 1 -- 172.21.15.52:0/3564454460 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d400ea00 con 0x55b10450b550 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0de000640 1 -- 172.21.15.52:0/3564454460 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400edb0 con 0x55b10450b550 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.738+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b10458b560 con 0x55b10450b550 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.739+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b10458bb20 con 0x55b10450b550 2024-09-10T08:33:20.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.741+0000 7fa0de000640 1 -- 172.21.15.52:0/3564454460 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d401a450 con 0x55b10450b550 2024-09-10T08:33:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.741+0000 7fa0de000640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c806a810 0x7fa0c806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.741+0000 7fa0de000640 1 -- 172.21.15.52:0/3564454460 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d408ab90 con 0x55b10450b550 2024-09-10T08:33:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.742+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x55b104590110 0x55b104590530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.742+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76) -- 0x55b104590a70 con 0x55b104590110 2024-09-10T08:33:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.742+0000 7fa0e5a00640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c806a810 0x7fa0c806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.742+0000 7fa0e6400640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x55b104590110 0x55b104590530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.742+0000 7fa0e5a00640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c806a810 0x7fa0c806ccd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009810 tx=0x7fa0d805a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.743+0000 7fa0e6400640 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x55b104590110 0x55b104590530 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e6400640 1 -- 172.21.15.52:0/3564454460 <== osd.1 v2:172.21.15.52:6800/2452593582 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v76'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa0e0019030 con 0x55b104590110 2024-09-10T08:33:20.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x55b104590110 msgr2=0x55b104590530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x55b104590110 0x55b104590530 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c806a810 msgr2=0x7fa0c806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c806a810 0x7fa0c806ccd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009810 tx=0x7fa0d805a040 comp rx=0 tx=0).stop 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 msgr2=0x55b10458cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 --2- 172.21.15.52:0/3564454460 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b10450b550 0x55b10458cd00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009eb0 tx=0x7fa0d4010830 comp rx=0 tx=0).stop 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e6400640 1 -- 172.21.15.52:0/3564454460 reap_dead start 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 shutdown_connections 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 >> 172.21.15.52:0/3564454460 conn(0x55b1044f04f0 msgr2=0x55b10458e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 shutdown_connections 2024-09-10T08:33:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.744+0000 7fa0e931ff40 1 -- 172.21.15.52:0/3564454460 wait complete. 2024-09-10T08:33:20.749 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-10T08:33:20.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T08:33:20.750 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-10T08:33:20.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T08:33:20.751 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-10T08:33:20.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T08:33:20.751 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-10T08:33:20.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T08:33:20.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.919+0000 7fa0e6800640 1 Processor -- start 2024-09-10T08:33:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.919+0000 7f96c5c00640 1 Processor -- start 2024-09-10T08:33:20.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.919+0000 7fa0e6800640 1 -- start start 2024-09-10T08:33:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.919+0000 7f96c5c00640 1 -- start start 2024-09-10T08:33:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.920+0000 7f84b3200640 1 Processor -- start 2024-09-10T08:33:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.920+0000 7f84b3200640 1 -- start start 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.920+0000 7f96c5c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96c015e440 0x7f96c00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96c5c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96c00cf450 0x7f96c00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96c5c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c00d3990 con 0x7f96c00b6540 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96c5c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f96c00b6990 con 0x7f96c00cf450 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96c5c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f96c00d3c70 con 0x7f96c015e440 2024-09-10T08:33:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96bf400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96c00cf450 0x7f96c00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96bf400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f96c00cf450 0x7f96c00b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46922/0 (socket says 172.21.15.52:46922) 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96bf400640 1 -- 172.21.15.52:0/3740032860 learned_addr learned my addr 172.21.15.52:0/3740032860 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f96bfe00640 1 --2- 172.21.15.52:0/3740032860 >> v2:172.21.15.176:3300/0 conn(0x7f96c015e440 0x7f96c00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e6800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e6800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e0160f10 con 0x7fa0e00cf9a0 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e6800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e00b40a0 con 0x7fa0e00b3c30 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e6800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e00b4650 con 0x7fa0e00cf5c0 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e5400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e5e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa0e00b3c30 0x7fa0e0160800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39772/0 (socket says 172.21.15.52:39772) 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e5e00640 1 -- 172.21.15.52:0/1431027727 learned_addr learned my addr 172.21.15.52:0/1431027727 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7fa0e5400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:44660/0 (socket says 172.21.15.52:44660) 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f96bf400640 1 -- 172.21.15.52:0/3740032860 >> v2:172.21.15.176:3300/0 conn(0x7f96c015e440 msgr2=0x7f96c00d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f96bf400640 1 --2- 172.21.15.52:0/3740032860 >> v2:172.21.15.176:3300/0 conn(0x7f96c015e440 0x7f96c00d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f96bf400640 1 -- 172.21.15.52:0/3740032860 >> v1:172.21.15.176:6789/0 conn(0x7f96c00b6540 legacy=0x7f96c006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f96bf400640 1 -- 172.21.15.52:0/3740032860 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c00d3f50 con 0x7f96c00cf450 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f84b3200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f84ac15e4c0 0x7f84ac0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.921+0000 7f84b3200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ac0cf5e0 con 0x7f84ac0b6790 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f84b3200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ac0cf8c0 con 0x7f84ac162b70 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f84b3200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0d2980 con 0x7f84ac15e4c0 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f84b1400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f84ac162b70 0x7f84ac0b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39782/0 (socket says 172.21.15.52:39782) 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f84b1400640 1 -- 172.21.15.52:0/2862845222 learned_addr learned my addr 172.21.15.52:0/2862845222 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7f84b1e00640 1 --2- 172.21.15.52:0/2862845222 >> v2:172.21.15.176:3300/0 conn(0x7f84ac15e4c0 0x7f84ac0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7fa0e5400640 1 -- 172.21.15.52:0/1431027727 >> v1:172.21.15.176:6789/0 conn(0x7fa0e00b3c30 legacy=0x7fa0e0160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7fa0dfe00640 1 -- 172.21.15.52:0/1431027727 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045501065 0 0) 0x7fa0e00b40a0 con 0x7fa0e00b3c30 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7fa0e5400640 1 -- 172.21.15.52:0/1431027727 >> v1:172.21.15.52:6789/0 conn(0x7fa0e00cf9a0 legacy=0x7fa0e01600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.922+0000 7fa0e5400640 1 -- 172.21.15.52:0/1431027727 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e00b4370 con 0x7fa0e00cf5c0 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.923+0000 7f84b1e00640 1 -- 172.21.15.52:0/2862845222 >> v1:172.21.15.176:6789/0 conn(0x7f84ac162b70 legacy=0x7f84ac0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.923+0000 7f84b1e00640 1 -- 172.21.15.52:0/2862845222 >> v1:172.21.15.52:6789/0 conn(0x7f84ac0b6790 legacy=0x7f84ac0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.923+0000 7f84b0a00640 1 -- 172.21.15.52:0/2862845222 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748078614 0 0) 0x7f84ac0cf8c0 con 0x7f84ac162b70 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.923+0000 7f84b1e00640 1 -- 172.21.15.52:0/2862845222 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0d2c60 con 0x7f84ac15e4c0 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.923+0000 7f96bf400640 1 --2- 172.21.15.52:0/3740032860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c00cf450 0x7f96c00b6000 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f96c0068870 tx=0x7f96ac02a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26326fd2d9cdb4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.924+0000 7f96bea00640 1 -- 172.21.15.52:0/3740032860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac037070 con 0x7f96c00cf450 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.924+0000 7f96bea00640 1 -- 172.21.15.52:0/3740032860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac032640 con 0x7f96c00cf450 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.924+0000 7f96bea00640 1 -- 172.21.15.52:0/3740032860 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac02ae60 con 0x7f96c00cf450 2024-09-10T08:33:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.924+0000 7f84b1e00640 1 --2- 172.21.15.52:0/2862845222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac15e4c0 0x7f84ac0cef50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097a0 tx=0x7f84a002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba60ee757a2199d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7fa0e5400640 1 --2- 172.21.15.52:0/1431027727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4011fc0 tx=0x7fa0d4032810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7499a3b2d32faa97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 -- 172.21.15.52:0/3740032860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c00cf450 msgr2=0x7f96c00b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3740032860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c00cf450 0x7f96c00b6000 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f96c0068870 tx=0x7f96ac02a310 comp rx=0 tx=0).stop 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f84b0a00640 1 -- 172.21.15.52:0/2862845222 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0037070 con 0x7f84ac15e4c0 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f84b0a00640 1 -- 172.21.15.52:0/2862845222 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a0032440 con 0x7f84ac15e4c0 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f84b0a00640 1 -- 172.21.15.52:0/2862845222 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0032810 con 0x7f84ac15e4c0 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 -- 172.21.15.52:0/3740032860 shutdown_connections 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3740032860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c00cf450 0x7f96c00b6000 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3740032860 >> v2:172.21.15.176:3300/0 conn(0x7f96c015e440 0x7f96c00d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 -- 172.21.15.52:0/3740032860 >> 172.21.15.52:0/3740032860 conn(0x7f96c0067f80 msgr2=0x7f96c00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7fa0dfe00640 1 -- 172.21.15.52:0/1431027727 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d403f070 con 0x7fa0e00cf5c0 2024-09-10T08:33:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7fa0dfe00640 1 -- 172.21.15.52:0/1431027727 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d40114e0 con 0x7fa0e00cf5c0 2024-09-10T08:33:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7fa0dfe00640 1 -- 172.21.15.52:0/1431027727 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400fa90 con 0x7fa0e00cf5c0 2024-09-10T08:33:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 -- 172.21.15.52:0/3740032860 shutdown_connections 2024-09-10T08:33:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f96c5c00640 1 -- 172.21.15.52:0/3740032860 wait complete. 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f84b3200640 1 -- 172.21.15.52:0/2862845222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac15e4c0 msgr2=0x7f84ac0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.925+0000 7f84b3200640 1 --2- 172.21.15.52:0/2862845222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac15e4c0 0x7f84ac0cef50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097a0 tx=0x7f84a002a230 comp rx=0 tx=0).stop 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f84b3200640 1 -- 172.21.15.52:0/2862845222 shutdown_connections 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f84b3200640 1 --2- 172.21.15.52:0/2862845222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac15e4c0 0x7f84ac0cef50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f84b3200640 1 -- 172.21.15.52:0/2862845222 >> 172.21.15.52:0/2862845222 conn(0x7f84ac0d1080 msgr2=0x7f84ac0d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 -- 172.21.15.52:0/1431027727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf5c0 msgr2=0x7fa0e00b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1431027727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4011fc0 tx=0x7fa0d4032810 comp rx=0 tx=0).stop 2024-09-10T08:33:20.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f84b3200640 1 -- 172.21.15.52:0/2862845222 shutdown_connections 2024-09-10T08:33:20.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 -- 172.21.15.52:0/1431027727 shutdown_connections 2024-09-10T08:33:20.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1431027727 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf5c0 0x7fa0e00b36f0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4011fc0 tx=0x7fa0d4032810 comp rx=0 tx=0).stop 2024-09-10T08:33:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f84b3200640 1 -- 172.21.15.52:0/2862845222 wait complete. 2024-09-10T08:33:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 -- 172.21.15.52:0/1431027727 >> 172.21.15.52:0/1431027727 conn(0x7fa0e006c240 msgr2=0x7fa0e006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 -- 172.21.15.52:0/1431027727 shutdown_connections 2024-09-10T08:33:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7fa0e6800640 1 -- 172.21.15.52:0/1431027727 wait complete. 2024-09-10T08:33:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.926+0000 7f1cb0a00640 1 Processor -- start 2024-09-10T08:33:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.927+0000 7f96c5c00640 1 Processor -- start 2024-09-10T08:33:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.927+0000 7f1cb0a00640 1 -- start start 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.927+0000 7f96c5c00640 1 -- start start 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96c00b6540 0x7f96c00c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96c00cf450 0x7f96c00c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96c00b7540 con 0x7f96c015e440 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f96c015e820 con 0x7f96c00cf450 2024-09-10T08:33:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f96c00b76c0 con 0x7f96c00b6540 2024-09-10T08:33:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7fa0e6800640 1 Processor -- start 2024-09-10T08:33:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f84b3200640 1 Processor -- start 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7fa0e6800640 1 -- start start 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f84b3200640 1 -- start start 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46924/0 (socket says 172.21.15.52:46924) 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96c5200640 1 -- 172.21.15.52:0/3158811253 learned_addr learned my addr 172.21.15.52:0/3158811253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96bfe00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96c00b6540 0x7f96c00c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.928+0000 7f96bf400640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96c00cf450 0x7f96c00c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cb0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cb0a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac0d3990 con 0x7f1cac0cf450 2024-09-10T08:33:20.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cb0a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac0d3c70 con 0x7f1cac0b6710 2024-09-10T08:33:20.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cb0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0d3f50 con 0x7f1cac15e440 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f96c5200640 1 -- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96c00b6540 msgr2=0x7f96c00c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f96c5200640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96c00b6540 0x7f96c00c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f96c5200640 1 -- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96c00cf450 msgr2=0x7f96c00c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f96c5200640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96c00cf450 0x7f96c00c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f96c5200640 1 -- 172.21.15.52:0/3158811253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c00c9cc0 con 0x7f96c015e440 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cab200640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f1cac0b6710 0x7f1cac0b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39794/0 (socket says 172.21.15.52:39794) 2024-09-10T08:33:20.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1cab200640 1 -- 172.21.15.52:0/2214630045 learned_addr learned my addr 172.21.15.52:0/2214630045 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1ca9e00640 1 --1- 172.21.15.52:0/2214630045 >> v1:172.21.15.52:6789/0 conn(0x7f1cac0cf450 0x7f1cac0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59676/0 (socket says 172.21.15.52:59676) 2024-09-10T08:33:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.929+0000 7f1caa800640 1 --2- 172.21.15.52:0/2214630045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96c5200640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c6e0 tx=0x7f96b800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f1caa800640 1 -- 172.21.15.52:0/2214630045 >> v1:172.21.15.176:6789/0 conn(0x7f1cac0b6710 legacy=0x7f1cac0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f1ca9400640 1 -- 172.21.15.52:0/2214630045 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412731498 0 0) 0x7f1cac0d3c70 con 0x7f1cac0b6710 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f1caa800640 1 -- 172.21.15.52:0/2214630045 >> v1:172.21.15.52:6789/0 conn(0x7f1cac0cf450 legacy=0x7f1cac0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f1caa800640 1 -- 172.21.15.52:0/2214630045 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac0d4230 con 0x7f1cac15e440 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 0x7f84ac1607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac162b70 0x7f84ac160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac15e8a0 con 0x7f84ac15e4c0 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0cfba0 con 0x7f84ac162b70 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac15ea20 con 0x7f84ac0b6790 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f84b1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7f84b1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:56130/0 (socket says 172.21.15.52:56130) 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7f84b1e00640 1 -- 172.21.15.52:0/636852516 learned_addr learned my addr 172.21.15.52:0/636852516 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8003b70 con 0x7f96c015e440 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8003d30 con 0x7f96c015e440 2024-09-10T08:33:20.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8005310 con 0x7f96c015e440 2024-09-10T08:33:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c00c8c20 con 0x7f96c015e440 2024-09-10T08:33:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c00c91e0 con 0x7f96c015e440 2024-09-10T08:33:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7f84b2800640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac162b70 0x7f84ac160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7f84b1400640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 0x7f84ac1607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf9a0 0x7fa0e01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 0x7fa0e01570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e00b5380 con 0x7fa0e0156c10 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e00b50a0 con 0x7fa0e00cf9a0 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.930+0000 7fa0e6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e00cd140 con 0x7fa0e00b3c30 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7fa0e5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7fa0e5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:56138/0 (socket says 172.21.15.52:56138) 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7fa0e5400640 1 -- 172.21.15.52:0/1961868637 learned_addr learned my addr 172.21.15.52:0/1961868637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.931+0000 7fa0e5e00640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 0x7fa0e01570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 -- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf9a0 msgr2=0x7fa0e01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1e00640 1 -- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac162b70 msgr2=0x7f84ac160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1e00640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac162b70 0x7f84ac160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1e00640 1 -- 172.21.15.52:0/636852516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 msgr2=0x7f84ac1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf9a0 0x7fa0e01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 -- 172.21.15.52:0/1961868637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 msgr2=0x7fa0e01570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f1caa800640 1 --2- 172.21.15.52:0/2214630045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac0d3240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097d0 tx=0x7f1c9c02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e13cdf1541d8368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 0x7fa0e01570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 -- 172.21.15.52:0/1961868637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e014c6f0 con 0x7fa0e00b3c30 2024-09-10T08:33:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5e00640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 0x7fa0e01570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f1ca9400640 1 -- 172.21.15.52:0/2214630045 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c037070 con 0x7f1cac15e440 2024-09-10T08:33:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c00b6000 con 0x7f96c015e440 2024-09-10T08:33:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f1ca9400640 1 -- 172.21.15.52:0/2214630045 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c032440 con 0x7f1cac15e440 2024-09-10T08:33:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f1ca9400640 1 -- 172.21.15.52:0/2214630045 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0327f0 con 0x7f1cac15e440 2024-09-10T08:33:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1e00640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 0x7f84ac1607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1e00640 1 -- 172.21.15.52:0/636852516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0ca300 con 0x7f84ac0b6790 2024-09-10T08:33:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7f84b1400640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 0x7f84ac1607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.932+0000 7fa0e5400640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4032d80 tx=0x7fa0d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84b1e00640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f84a00098c0 tx=0x7f84a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d403f050 con 0x7fa0e00b3c30 2024-09-10T08:33:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d404b070 con 0x7fa0e00b3c30 2024-09-10T08:33:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4003a40 con 0x7fa0e00b3c30 2024-09-10T08:33:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e0158130 con 0x7fa0e00b3c30 2024-09-10T08:33:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 -- 172.21.15.52:0/2214630045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 msgr2=0x7f1cac0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/2214630045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac0d3240 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0097d0 tx=0x7f1c9c02a290 comp rx=0 tx=0).stop 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0040020 con 0x7f84ac0b6790 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 -- 172.21.15.52:0/2214630045 shutdown_connections 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/2214630045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac0d3240 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 -- 172.21.15.52:0/2214630045 >> 172.21.15.52:0/2214630045 conn(0x7f1cac067f80 msgr2=0x7f1cac0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 -- 172.21.15.52:0/2214630045 shutdown_connections 2024-09-10T08:33:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e014c990 con 0x7fa0e00b3c30 2024-09-10T08:33:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a0038040 con 0x7f84ac0b6790 2024-09-10T08:33:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac0ca5e0 con 0x7f84ac0b6790 2024-09-10T08:33:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96b80054b0 con 0x7f96c015e440 2024-09-10T08:33:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac0caba0 con 0x7f84ac0b6790 2024-09-10T08:33:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0037070 con 0x7f84ac0b6790 2024-09-10T08:33:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.933+0000 7f1cb0a00640 1 -- 172.21.15.52:0/2214630045 wait complete. 2024-09-10T08:33:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.934+0000 7f96b7e00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 0x7f96a006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.935+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e00b36f0 con 0x7fa0e00b3c30 2024-09-10T08:33:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.935+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f96b808aa90 con 0x7f96c015e440 2024-09-10T08:33:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.935+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8488005290 con 0x7f84ac0b6790 2024-09-10T08:33:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.936+0000 7f96bfe00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 0x7f96a006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.936+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0d4003be0 con 0x7fa0e00b3c30 2024-09-10T08:33:20.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.936+0000 7f1cb0a00640 1 Processor -- start 2024-09-10T08:33:20.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.936+0000 7f96bfe00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 0x7f96a006e340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f96b0006fd0 tx=0x7f96b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.937+0000 7f1cb0a00640 1 -- start start 2024-09-10T08:33:20.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.937+0000 7fa0dd600640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 0x7fa0c006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.937+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7fa0d40b3a80 con 0x7fa0e00b3c30 2024-09-10T08:33:20.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.937+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84a0043020 con 0x7f84ac0b6790 2024-09-10T08:33:20.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.937+0000 7fa0e4a00640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 0x7fa0c006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 0x7f1cac06f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0b76c0 con 0x7f1cac0cf450 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0b7540 con 0x7f1cac0b6710 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cb0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1cac0b8270 con 0x7f1cac15e440 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1caa800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1ca9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 0x7f1cac06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1caa800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:44714/0 (socket says 172.21.15.52:44714) 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1caa800640 1 -- 172.21.15.52:0/1086404855 learned_addr learned my addr 172.21.15.52:0/1086404855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:20.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f84a6000640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 0x7f849006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f1cab200640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7fa0e4a00640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 0x7fa0c006e370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000f60 tx=0x7fa0cc0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.938+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f84a00ab660 con 0x7f84ac0b6790 2024-09-10T08:33:20.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f84b1400640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 0x7f849006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 -- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 msgr2=0x7f1cac070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 -- 172.21.15.52:0/1086404855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 msgr2=0x7f1cac06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 0x7f1cac06f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 -- 172.21.15.52:0/1086404855 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1f8710 con 0x7f1cac0b6710 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1ca9e00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 0x7f1cac06f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:20.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f1caa800640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c000c00 tx=0x7f1c9c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.939+0000 7f84b1400640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 0x7f849006e340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0cebb0 tx=0x7f849c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.940+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c042020 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.940+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0309d0 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.940+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c037040 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.940+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac070240 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.940+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac1f89d0 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.941+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac0d3240 con 0x7f1cac0b6710 2024-09-10T08:33:20.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.941+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96b8058ed0 con 0x7f96c015e440 2024-09-10T08:33:20.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.942+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84a004a030 con 0x7f84ac0b6790 2024-09-10T08:33:20.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.943+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c9c045020 con 0x7f1cac0b6710 2024-09-10T08:33:20.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.943+0000 7f1ca2a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 0x7f1c8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:20.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.944+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5709+0+0 (secure 0 0 0) 0x7f1c9c0abce0 con 0x7f1cac0b6710 2024-09-10T08:33:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.944+0000 7f1ca9e00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 0x7f1c8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.944+0000 7f1ca9e00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 0x7f1c8c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0cece0 tx=0x7f1c98000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.946+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0d4082510 con 0x7fa0e00b3c30 2024-09-10T08:33:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:20.948+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c9c04c030 con 0x7f1cac0b6710 2024-09-10T08:33:21.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.197+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f8488005850 con 0x7f84ac0b6790 2024-09-10T08:33:21.199 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:33:21.198+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:33:21.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.202+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f96c00d1d00 con 0x7f96c015e440 2024-09-10T08:33:21.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.204+0000 7f84a6000640 1 -- 172.21.15.52:0/636852516 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6642 v51) ==== 95+0+0 (secure 0 0 0) 0x7f84a0032e20 con 0x7f84ac0b6790 2024-09-10T08:33:21.205 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6642 2024-09-10T08:33:21.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.205+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fa0e00726e0 con 0x7fa0e00b3c30 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 msgr2=0x7f849006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 0x7f849006e340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0cebb0 tx=0x7f849c007de0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 msgr2=0x7f84ac155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f84a00098c0 tx=0x7f84a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 shutdown_connections 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f849006be80 0x7f849006e340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84ac162b70 0x7f84ac160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac15e4c0 0x7f84ac1607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 --2- 172.21.15.52:0/636852516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84ac0b6790 0x7f84ac155ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 >> 172.21.15.52:0/636852516 conn(0x7f84ac0d1080 msgr2=0x7f84ac1e7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 shutdown_connections 2024-09-10T08:33:21.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.207+0000 7f84b3200640 1 -- 172.21.15.52:0/636852516 wait complete. 2024-09-10T08:33:21.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.209+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f1cac0ceeb0 con 0x7f1cac0b6710 2024-09-10T08:33:21.216 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:33:21.216+0000 7f82a7400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:33:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.219+0000 7f96b7e00640 1 -- 172.21.15.52:0/3158811253 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5870 v53) ==== 95+0+0 (secure 0 0 0) 0x7f96b808a020 con 0x7f96c015e440 2024-09-10T08:33:21.219 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 5870 2024-09-10T08:33:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 msgr2=0x7f96a006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 0x7f96a006e340 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f96b0006fd0 tx=0x7f96b0008040 comp rx=0 tx=0).stop 2024-09-10T08:33:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 msgr2=0x7f96c00cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c6e0 tx=0x7f96b800cba0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 shutdown_connections 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f96a006be80 0x7f96a006e340 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96c015e440 0x7f96c00cd310 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96c00cf450 0x7f96c00c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 --2- 172.21.15.52:0/3158811253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96c00b6540 0x7f96c00c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.221+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 >> 172.21.15.52:0/3158811253 conn(0x7f96c0067f80 msgr2=0x7f96c00d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.222+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 shutdown_connections 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.222+0000 7f96c5c00640 1 -- 172.21.15.52:0/3158811253 wait complete. 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.223+0000 7f1ca2a00640 1 -- 172.21.15.52:0/1086404855 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6298 v53) ==== 95+0+0 (secure 0 0 0) 0x7f1c9c07a1d0 con 0x7f1cac0b6710 2024-09-10T08:33:21.223 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6298 2024-09-10T08:33:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.223+0000 7fa0dd600640 1 -- 172.21.15.52:0/1961868637 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5879 v53) ==== 95+0+0 (secure 0 0 0) 0x7fa0d4081e10 con 0x7fa0e00b3c30 2024-09-10T08:33:21.224 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 5879 2024-09-10T08:33:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 msgr2=0x7f1c8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 0x7f1c8c06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0cece0 tx=0x7f1c98000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 msgr2=0x7f1cac1e9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c000c00 tx=0x7f1c9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 shutdown_connections 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8c06be30 0x7f1c8c06e2f0 secure :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0cece0 tx=0x7f1c98000ed0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1cac15e440 0x7f1cac070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cac0cf450 0x7f1cac06f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 --2- 172.21.15.52:0/1086404855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1cac0b6710 0x7f1cac1e9cf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.226+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 >> 172.21.15.52:0/1086404855 conn(0x7f1cac067f80 msgr2=0x7f1cac0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.228 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:33:21.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 msgr2=0x7fa0c006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 0x7fa0c006e370 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc000f60 tx=0x7fa0cc0079b0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 msgr2=0x7fa0e014a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4032d80 tx=0x7fa0d40046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 shutdown_connections 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa0c006beb0 0x7fa0c006e370 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0e0156c10 0x7fa0e01570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0e00cf9a0 0x7fa0e01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 --2- 172.21.15.52:0/1961868637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa0e00b3c30 0x7fa0e014a6e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 >> 172.21.15.52:0/1961868637 conn(0x7fa0e006c240 msgr2=0x7fa0e0155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 shutdown_connections 2024-09-10T08:33:21.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 shutdown_connections 2024-09-10T08:33:21.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7f1cb0a00640 1 -- 172.21.15.52:0/1086404855 wait complete. 2024-09-10T08:33:21.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.227+0000 7fa0e6800640 1 -- 172.21.15.52:0/1961868637 wait complete. 2024-09-10T08:33:21.234 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:33:21.235 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:21.246 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:33:21.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:33:21.248 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:33:21.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:33:21.251 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:33:21.252 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:33:21.252 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:33:21.253 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:21.254 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:33:21.254 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:21.255 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:33:21.256 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:21.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:21.368 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:33:21.384 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:33:21.387 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:33:21.387 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:33:21.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.458+0000 7f3b61800640 1 Processor -- start 2024-09-10T08:33:21.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.458+0000 7f3b61800640 1 -- start start 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b61800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3b5c147e80 0x7f3b5c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b61800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c071b30 con 0x7f3b5c06c320 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b61800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c0b3510 con 0x7f3b5c148260 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b61800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c074200 con 0x7f3b5c147e80 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b5c06c320 0x7f3b5c0b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59688/0 (socket says 172.21.15.52:59688) 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5b400640 1 -- 172.21.15.52:0/808795376 learned_addr learned my addr 172.21.15.52:0/808795376 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:21.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5aa00640 1 --2- 172.21.15.52:0/808795376 >> v2:172.21.15.176:3300/0 conn(0x7f3b5c147e80 0x7f3b5c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462742224 0 0) 0x7f3b5c071b30 con 0x7f3b5c06c320 2024-09-10T08:33:21.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b40003520 con 0x7f3b5c06c320 2024-09-10T08:33:21.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.460+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367353462 0 0) 0x7f3b5c0b3510 con 0x7f3b5c148260 2024-09-10T08:33:21.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.461+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b5c071b30 con 0x7f3b5c148260 2024-09-10T08:33:21.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.461+0000 7f3b5aa00640 1 -- 172.21.15.52:0/808795376 >> v1:172.21.15.176:6789/0 conn(0x7f3b5c148260 legacy=0x7f3b5c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.461+0000 7f3b5aa00640 1 -- 172.21.15.52:0/808795376 >> v1:172.21.15.52:6789/0 conn(0x7f3b5c06c320 legacy=0x7f3b5c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.461+0000 7f3b5aa00640 1 -- 172.21.15.52:0/808795376 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b37f0 con 0x7f3b5c147e80 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b5aa00640 1 --2- 172.21.15.52:0/808795376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c070f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097a0 tx=0x7f3b4c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5853e5a276edb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c037070 con 0x7f3b5c147e80 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c032440 con 0x7f3b5c147e80 2024-09-10T08:33:21.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b5a000640 1 -- 172.21.15.52:0/808795376 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c032810 con 0x7f3b5c147e80 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b61800640 1 -- 172.21.15.52:0/808795376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 msgr2=0x7f3b5c070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.462+0000 7f3b61800640 1 --2- 172.21.15.52:0/808795376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c070f70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097a0 tx=0x7f3b4c02a230 comp rx=0 tx=0).stop 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.463+0000 7f3b61800640 1 -- 172.21.15.52:0/808795376 shutdown_connections 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.463+0000 7f3b61800640 1 --2- 172.21.15.52:0/808795376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c070f70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.463+0000 7f3b61800640 1 -- 172.21.15.52:0/808795376 >> 172.21.15.52:0/808795376 conn(0x7f3b5c0ccec0 msgr2=0x7f3b5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.463+0000 7f3b61800640 1 -- 172.21.15.52:0/808795376 shutdown_connections 2024-09-10T08:33:21.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.463+0000 7f3b61800640 1 -- 172.21.15.52:0/808795376 wait complete. 2024-09-10T08:33:21.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.464+0000 7f3b61800640 1 Processor -- start 2024-09-10T08:33:21.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.464+0000 7f3b61800640 1 -- start start 2024-09-10T08:33:21.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c1e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c148260 0x7f3b5c1e8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0714b0 con 0x7f3b5c06c320 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b3e40 con 0x7f3b5c147e80 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b61800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c071630 con 0x7f3b5c148260 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.465+0000 7f3b5aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46988/0 (socket says 172.21.15.52:46988) 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 -- 172.21.15.52:0/249709031 learned_addr learned my addr 172.21.15.52:0/249709031 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b53e00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c1e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5b400640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c148260 0x7f3b5c1e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 -- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c148260 msgr2=0x7f3b5c1e8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c148260 0x7f3b5c1e8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 -- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 msgr2=0x7f3b5c1e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c1e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 -- 172.21.15.52:0/249709031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1e6410 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b53e00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c1e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b5aa00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c035040 tx=0x7f3b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.466+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c041030 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.467+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c03d4e0 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.467+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1e66f0 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.467+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c037040 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.467+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1e8100 con 0x7f3b5c06c320 2024-09-10T08:33:21.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.468+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c070f70 con 0x7f3b5c06c320 2024-09-10T08:33:21.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.469+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b4c044070 con 0x7f3b5c06c320 2024-09-10T08:33:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.470+0000 7f3b52a00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 0x7f3b3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.470+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f3b4c0ab6e0 con 0x7f3b5c06c320 2024-09-10T08:33:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.470+0000 7f3b53e00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 0x7f3b3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.471+0000 7f3b53e00640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 0x7f3b3806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c143c90 tx=0x7f3b44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.474+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b4c044e40 con 0x7f3b5c06c320 2024-09-10T08:33:21.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.697+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b5c1470a0 con 0x7f3b5c06c320 2024-09-10T08:33:21.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.697+0000 7f3b52a00640 1 -- 172.21.15.52:0/249709031 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+1911 (secure 0 0 0) 0x7f3b4c079f50 con 0x7f3b5c06c320 2024-09-10T08:33:21.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:21.698 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":53,"btime":"2024-09-10T08:33:21:217711+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:21.217538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-10T08:33:21.699 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 53 2024-09-10T08:33:21.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 msgr2=0x7f3b3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 0x7f3b3806e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c143c90 tx=0x7f3b44009040 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 msgr2=0x7f3b5c13fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c035040 tx=0x7f3b4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 shutdown_connections 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b3806be30 0x7f3b3806e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b5c148260 0x7f3b5c1e8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b5c147e80 0x7f3b5c1e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 --2- 172.21.15.52:0/249709031 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b5c06c320 0x7f3b5c13fbe0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 >> 172.21.15.52:0/249709031 conn(0x7f3b5c0ccec0 msgr2=0x7f3b5c0cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 shutdown_connections 2024-09-10T08:33:21.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:21.700+0000 7f3b61800640 1 -- 172.21.15.52:0/249709031 wait complete. 2024-09-10T08:33:22.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:10.841390+0000', 'modified': '2024-09-10T08:33:21.217538+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 80, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:33:22.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-10T08:33:23.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:23.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.289+0000 7f3bdc000640 1 Processor -- start 2024-09-10T08:33:23.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.289+0000 7f3bdc000640 1 -- start start 2024-09-10T08:33:23.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bdc000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3bd40b2d40 0x7f3bd406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bdc000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bdc000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd4071180 con 0x7f3bd413eb20 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bdc000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd4071ab0 con 0x7f3bd40b2d40 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bdc000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd4071460 con 0x7f3bd406c150 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bd8c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3bd413eb20 0x7f3bd415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59704/0 (socket says 172.21.15.52:59704) 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bd8c00640 1 -- 172.21.15.52:0/1456876252 learned_addr learned my addr 172.21.15.52:0/1456876252 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bd9600640 1 --2- 172.21.15.52:0/1456876252 >> v2:172.21.15.176:3300/0 conn(0x7f3bd40b2d40 0x7f3bd406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.291+0000 7f3bda000640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217594334 0 0) 0x7f3bd4071180 con 0x7f3bd413eb20 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bbc005730 con 0x7f3bd413eb20 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3366486239 0 0) 0x7f3bbc005730 con 0x7f3bd413eb20 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd9600640 1 -- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 msgr2=0x7f3bd415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd9600640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd9600640 1 -- 172.21.15.52:0/1456876252 >> v1:172.21.15.52:6789/0 conn(0x7f3bd413eb20 legacy=0x7f3bd415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.292+0000 7f3bd9600640 1 -- 172.21.15.52:0/1456876252 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd4071740 con 0x7f3bd40b2d40 2024-09-10T08:33:23.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.293+0000 7f3bd9600640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd406bc10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80097a0 tx=0x7f3bc802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236143e2ffdb7035 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.293+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8037070 con 0x7f3bd40b2d40 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.293+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc802aba0 con 0x7f3bd40b2d40 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.293+0000 7f3bd3e00640 1 -- 172.21.15.52:0/1456876252 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0001670 con 0x7f3bd40b2d40 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 -- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 msgr2=0x7f3bd406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd406bc10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80097a0 tx=0x7f3bc802a110 comp rx=0 tx=0).stop 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 -- 172.21.15.52:0/1456876252 shutdown_connections 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 --2- 172.21.15.52:0/1456876252 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd406bc10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 -- 172.21.15.52:0/1456876252 >> 172.21.15.52:0/1456876252 conn(0x7f3bd40ccec0 msgr2=0x7f3bd40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 -- 172.21.15.52:0/1456876252 shutdown_connections 2024-09-10T08:33:23.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.294+0000 7f3bdc000640 1 -- 172.21.15.52:0/1456876252 wait complete. 2024-09-10T08:33:23.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.296+0000 7f3bdc000640 1 Processor -- start 2024-09-10T08:33:23.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.296+0000 7f3bdc000640 1 -- start start 2024-09-10T08:33:23.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd40722d0 con 0x7f3bd413eb20 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4072150 con 0x7f3bd40b2d40 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bdc000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd4072450 con 0x7f3bd406c150 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46998/0 (socket says 172.21.15.52:46998) 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 -- 172.21.15.52:0/504012697 learned_addr learned my addr 172.21.15.52:0/504012697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bd8c00640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bd9600640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 -- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 msgr2=0x7f3bd415bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 -- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 msgr2=0x7f3bd413dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd413dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bda000640 1 -- 172.21.15.52:0/504012697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd415abe0 con 0x7f3bd413eb20 2024-09-10T08:33:23.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bd9600640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:23.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.297+0000 7f3bd8c00640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bda000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00efc0 tx=0x7f3bcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc018020 con 0x7f3bd413eb20 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc014480 con 0x7f3bd413eb20 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc014870 con 0x7f3bd413eb20 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd415aec0 con 0x7f3bd413eb20 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.298+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd415b480 con 0x7f3bd413eb20 2024-09-10T08:33:23.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.299+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd406bc10 con 0x7f3bd413eb20 2024-09-10T08:33:23.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.300+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3bcc005d10 con 0x7f3bd413eb20 2024-09-10T08:33:23.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.301+0000 7f3bd1600640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 0x7f3bb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:23.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.301+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f3bcc08bba0 con 0x7f3bd413eb20 2024-09-10T08:33:23.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.301+0000 7f3bd9600640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 0x7f3bb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:23.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.302+0000 7f3bd9600640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 0x7f3bb406e320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8034000 tx=0x7f3bc802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:23.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.305+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bcc022070 con 0x7f3bd413eb20 2024-09-10T08:33:23.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.527+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bd406c9c0 con 0x7f3bd413eb20 2024-09-10T08:33:23.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.528+0000 7f3bd1600640 1 -- 172.21.15.52:0/504012697 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5225 (secure 0 0 0) 0x7f3bcc010040 con 0x7f3bd413eb20 2024-09-10T08:33:23.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:23.528 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":56,"btime":"2024-09-10T08:33:23:229762+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:22.245277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-10T08:33:23.528 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 56 2024-09-10T08:33:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 msgr2=0x7f3bb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 0x7f3bb406e320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8034000 tx=0x7f3bc802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:23.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 msgr2=0x7f3bd41f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00efc0 tx=0x7f3bcc00c490 comp rx=0 tx=0).stop 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 shutdown_connections 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3bb406be60 0x7f3bb406e320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3bd413eb20 0x7f3bd41f05e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bd40b2d40 0x7f3bd413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 --2- 172.21.15.52:0/504012697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3bd406c150 0x7f3bd415bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 >> 172.21.15.52:0/504012697 conn(0x7f3bd40ccec0 msgr2=0x7f3bd40b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 shutdown_connections 2024-09-10T08:33:23.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:23.530+0000 7f3bdc000640 1 -- 172.21.15.52:0/504012697 wait complete. 2024-09-10T08:33:23.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:10.841390+0000', 'modified': '2024-09-10T08:33:22.245277+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 80, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6837': {'gid': 6837, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.52:6835/3185894602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3185894602}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3185894602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:33:23.949 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6837:up:reconnect 2024-09-10T08:33:24.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.117+0000 7fd018e00640 1 Processor -- start 2024-09-10T08:33:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.117+0000 7fd018e00640 1 -- start start 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.118+0000 7fd018e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd0140b2d40 0x7fd01406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.118+0000 7fd018e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fd01415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.118+0000 7fd018e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd014071180 con 0x7fd01413eb20 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.118+0000 7fd018e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd014071ab0 con 0x7fd0140b2d40 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.118+0000 7fd018e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd014071460 con 0x7fd01406c150 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd011400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd01413eb20 0x7fd01415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48832/0 (socket says 172.21.15.52:48832) 2024-09-10T08:33:25.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd011400640 1 -- 172.21.15.52:0/2766117859 learned_addr learned my addr 172.21.15.52:0/2766117859 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079528472 0 0) 0x7fd014071180 con 0x7fd01413eb20 2024-09-10T08:33:25.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd012800640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fd01415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff8003520 con 0x7fd01413eb20 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd011e00640 1 --2- 172.21.15.52:0/2766117859 >> v2:172.21.15.176:3300/0 conn(0x7fd0140b2d40 0x7fd01406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.119+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1362596532 0 0) 0x7fcff8003520 con 0x7fd01413eb20 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 msgr2=0x7fd01415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fd01415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 >> v2:172.21.15.176:3300/0 conn(0x7fd0140b2d40 msgr2=0x7fd01406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 --2- 172.21.15.52:0/2766117859 >> v2:172.21.15.176:3300/0 conn(0x7fd0140b2d40 0x7fd01406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd014071740 con 0x7fd01413eb20 2024-09-10T08:33:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fd000001670 con 0x7fd01413eb20 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 >> v1:172.21.15.52:6789/0 conn(0x7fd01413eb20 legacy=0x7fd01415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fcff8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fcff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd014071ab0 con 0x7fcff8004d40 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd014071460 con 0x7fcff80039b0 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcff800b9c0 con 0x7fd01406c150 2024-09-10T08:33:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fcff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd011400640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fcff8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd011e00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 -- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 msgr2=0x7fcff8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01406c150 0x7fcff8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 -- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80039b0 msgr2=0x7fcff8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd012800640 1 -- 172.21.15.52:0/2766117859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff8003520 con 0x7fcff8004d40 2024-09-10T08:33:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.120+0000 7fd011e00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcff80039b0 0x7fcff8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:25.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.121+0000 7fd012800640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fcff80051c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009fc0 tx=0x7fcff8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51c1ca3bccc00f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c009c10 con 0x7fcff8004d40 2024-09-10T08:33:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c036070 con 0x7fcff8004d40 2024-09-10T08:33:25.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd010a00640 1 -- 172.21.15.52:0/2766117859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c031880 con 0x7fcff8004d40 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 -- 172.21.15.52:0/2766117859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 msgr2=0x7fcff80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 --2- 172.21.15.52:0/2766117859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fcff80051c0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009fc0 tx=0x7fcff8005830 comp rx=0 tx=0).stop 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd012800640 1 -- 172.21.15.52:0/2766117859 reap_dead start 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 -- 172.21.15.52:0/2766117859 shutdown_connections 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 -- 172.21.15.52:0/2766117859 >> 172.21.15.52:0/2766117859 conn(0x7fd0140ccec0 msgr2=0x7fd0140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 -- 172.21.15.52:0/2766117859 shutdown_connections 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.122+0000 7fd018e00640 1 -- 172.21.15.52:0/2766117859 wait complete. 2024-09-10T08:33:25.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.124+0000 7fd018e00640 1 Processor -- start 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.124+0000 7fd018e00640 1 -- start start 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 0x7fd01415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd014142fb0 0x7fd014143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd01415c7d0 con 0x7fcff8004d40 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd01415c650 con 0x7fd014142fb0 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd018e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd014071f40 con 0x7fd01413e020 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd011e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd011e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50736/0 (socket says 172.21.15.52:50736) 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd011e00640 1 -- 172.21.15.52:0/3216055447 learned_addr learned my addr 172.21.15.52:0/3216055447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.125+0000 7fd011400640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 0x7fd01415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd012800640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd014142fb0 0x7fd014143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 -- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 msgr2=0x7fd01415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 0x7fd01415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 -- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd014142fb0 msgr2=0x7fd014143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd014142fb0 0x7fd014143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 -- 172.21.15.52:0/3216055447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01415d910 con 0x7fcff8004d40 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011400640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 0x7fd01415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd011e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd004011700 tx=0x7fd004011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400f9c0 con 0x7fcff8004d40 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00400fb60 con 0x7fcff8004d40 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004015460 con 0x7fcff8004d40 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01415dbf0 con 0x7fcff8004d40 2024-09-10T08:33:25.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.126+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01415e1b0 con 0x7fcff8004d40 2024-09-10T08:33:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.128+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01406bc10 con 0x7fcff8004d40 2024-09-10T08:33:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.128+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd004015600 con 0x7fcff8004d40 2024-09-10T08:33:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.129+0000 7fd00a000640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.129+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7fd00408b9d0 con 0x7fcff8004d40 2024-09-10T08:33:25.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.130+0000 7fd011400640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.131+0000 7fd011400640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 0x7fcff406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd01413e440 tx=0x7fd000009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.134+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd004019030 con 0x7fcff8004d40 2024-09-10T08:33:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.356+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd01415f560 con 0x7fcff8004d40 2024-09-10T08:33:25.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.357+0000 7fd00a000640 1 -- 172.21.15.52:0/3216055447 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5229 (secure 0 0 0) 0x7fd00405a230 con 0x7fcff8004d40 2024-09-10T08:33:25.357 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:25.357 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":58,"btime":"2024-09-10T08:33:25:237846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:25.237838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6837,"qdb_cluster":[6837]},"id":5}]} 2024-09-10T08:33:25.358 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 58 2024-09-10T08:33:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 msgr2=0x7fcff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 0x7fcff406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd01413e440 tx=0x7fd000009040 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 msgr2=0x7fd01415f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd004011700 tx=0x7fd004011bc0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 shutdown_connections 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcff406be30 0x7fcff406e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd014142fb0 0x7fd014143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd01413e020 0x7fd01415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 --2- 172.21.15.52:0/3216055447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcff8004d40 0x7fd01415f780 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 >> 172.21.15.52:0/3216055447 conn(0x7fd0140ccec0 msgr2=0x7fd0140d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 shutdown_connections 2024-09-10T08:33:25.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.360+0000 7fd018e00640 1 -- 172.21.15.52:0/3216055447 wait complete. 2024-09-10T08:33:25.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:10.841390+0000', 'modified': '2024-09-10T08:33:25.237838+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 80, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6837': {'gid': 6837, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6835/3185894602', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 3185894602}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3185894602}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6837, 'qdb_cluster': [6837]} 2024-09-10T08:33:25.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:33:25.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T08:33:25.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.937+0000 7f1e6aa00640 1 Processor -- start 2024-09-10T08:33:25.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.937+0000 7f1e6aa00640 1 -- start start 2024-09-10T08:33:25.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e6aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e640b6710 0x7f1e640d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e6aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e640b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e6aa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e640d3990 con 0x7f1e6415e440 2024-09-10T08:33:25.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e6aa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1e640d3c70 con 0x7f1e640b6710 2024-09-10T08:33:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e6aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640d3f50 con 0x7f1e640cf450 2024-09-10T08:33:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e69600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1e6415e440 0x7f1e640b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48844/0 (socket says 172.21.15.52:48844) 2024-09-10T08:33:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e68c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1e640b6710 0x7f1e640d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.938+0000 7f1e69600640 1 -- 172.21.15.52:0/2574896689 learned_addr learned my addr 172.21.15.52:0/2574896689 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.939+0000 7f1e6a000640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e640b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.939+0000 7f1e68c00640 1 -- 172.21.15.52:0/2574896689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 msgr2=0x7f1e640b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.939+0000 7f1e68c00640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e640b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.939+0000 7f1e68c00640 1 -- 172.21.15.52:0/2574896689 >> v1:172.21.15.52:6789/0 conn(0x7f1e6415e440 legacy=0x7f1e640b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.939+0000 7f1e68c00640 1 -- 172.21.15.52:0/2574896689 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e640d4230 con 0x7f1e640b6710 2024-09-10T08:33:25.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.940+0000 7f1e68c00640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e640b6710 0x7f1e640d3240 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1e500097a0 tx=0x7f1e5002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910556bda6f06b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.940+0000 7f1e63e00640 1 -- 172.21.15.52:0/2574896689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50037070 con 0x7f1e640b6710 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.940+0000 7f1e63e00640 1 -- 172.21.15.52:0/2574896689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50032440 con 0x7f1e640b6710 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.940+0000 7f1e63e00640 1 -- 172.21.15.52:0/2574896689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032810 con 0x7f1e640b6710 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2574896689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e640b6710 msgr2=0x7f1e640d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e640b6710 0x7f1e640d3240 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1e500097a0 tx=0x7f1e5002a230 comp rx=0 tx=0).stop 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2574896689 shutdown_connections 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e640b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2574896689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e640b6710 0x7f1e640d3240 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2574896689 >> 172.21.15.52:0/2574896689 conn(0x7f1e64067f80 msgr2=0x7f1e640d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2574896689 shutdown_connections 2024-09-10T08:33:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.941+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2574896689 wait complete. 2024-09-10T08:33:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.943+0000 7f1e6aa00640 1 Processor -- start 2024-09-10T08:33:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.943+0000 7f1e6aa00640 1 -- start start 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 0x7f1e641e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e64152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640b76c0 con 0x7f1e6415e440 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640b7540 con 0x7f1e640b6710 2024-09-10T08:33:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640b80a0 con 0x7f1e640cf450 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50756/0 (socket says 172.21.15.52:50756) 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 -- 172.21.15.52:0/2766706225 learned_addr learned my addr 172.21.15.52:0/2766706225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e68c00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e64152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e69600640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 0x7f1e641e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 -- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 msgr2=0x7f1e64152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e64152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 -- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 msgr2=0x7f1e641e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 0x7f1e641e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e6a000640 1 -- 172.21.15.52:0/2766706225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e641e4c50 con 0x7f1e6415e440 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.944+0000 7f1e69600640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 0x7f1e641e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e6a000640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007e70 tx=0x7f1e5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e61600640 1 -- 172.21.15.52:0/2766706225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c014620 con 0x7f1e6415e440 2024-09-10T08:33:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e61600640 1 -- 172.21.15.52:0/2766706225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c019070 con 0x7f1e6415e440 2024-09-10T08:33:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e641e4f30 con 0x7f1e6415e440 2024-09-10T08:33:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e61600640 1 -- 172.21.15.52:0/2766706225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c014a20 con 0x7f1e6415e440 2024-09-10T08:33:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.945+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641e54f0 con 0x7f1e6415e440 2024-09-10T08:33:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.947+0000 7f1e61600640 1 -- 172.21.15.52:0/2766706225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e5c014bc0 con 0x7f1e6415e440 2024-09-10T08:33:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.948+0000 7f1e61600640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 0x7f1e4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.948+0000 7f1e61600640 1 -- 172.21.15.52:0/2766706225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f1e5c08b810 con 0x7f1e6415e440 2024-09-10T08:33:25.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.948+0000 7f1e69600640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 0x7f1e4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.948+0000 7f1e6ee33740 1 Processor -- start 2024-09-10T08:33:25.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.949+0000 7f1e6ee33740 1 -- start start 2024-09-10T08:33:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.949+0000 7f1e69600640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 0x7f1e4406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000f60 tx=0x7f1e58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.949+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e09236a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.949+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09231f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e0922833b0 con 0x55e092322660 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e092288410 con 0x55e092324ea0 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e092230620 con 0x55e092326630 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50764/0 (socket says 172.21.15.52:50764) 2024-09-10T08:33:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 -- 172.21.15.52:0/348775609 learned_addr learned my addr 172.21.15.52:0/348775609 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e6a000640 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09231f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e69600640 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e09236a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 -- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 msgr2=0x55e09231f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09231f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 -- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 msgr2=0x55e09236a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e09236a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 -- 172.21.15.52:0/348775609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e091f9b2d0 con 0x55e092322660 2024-09-10T08:33:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.950+0000 7f1e68c00640 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1e500098c0 tx=0x7f1e5002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1093f758828cef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e55c00640 1 -- 172.21.15.52:0/348775609 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50037040 con 0x55e092322660 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e55c00640 1 -- 172.21.15.52:0/348775609 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50032820 con 0x55e092322660 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e55c00640 1 -- 172.21.15.52:0/348775609 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50032c10 con 0x55e092322660 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 -- 172.21.15.52:0/348775609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 msgr2=0x55e092325280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1e500098c0 tx=0x7f1e5002c000 comp rx=0 tx=0).stop 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 -- 172.21.15.52:0/348775609 shutdown_connections 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09231f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092322660 0x55e092325280 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/348775609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e09236a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.951+0000 7f1e6ee33740 1 -- 172.21.15.52:0/348775609 >> 172.21.15.52:0/348775609 conn(0x55e0923218f0 msgr2=0x55e092369b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.952+0000 7f1e6ee33740 1 -- 172.21.15.52:0/348775609 shutdown_connections 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.952+0000 7f1e6ee33740 1 -- 172.21.15.52:0/348775609 wait complete. 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.952+0000 7f1e6ee33740 1 -- start start 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.952+0000 7f1e6ee33740 1 Processor -- start 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e092346840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e092243780 con 0x55e092324ea0 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e0922843d0 con 0x55e092346d80 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e092320d90 con 0x55e092326630 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.953+0000 7f1e6ee33740 10 client.0 _ll_register_callbacks cb 0x55e0922815d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50780/0 (socket says 172.21.15.52:50780) 2024-09-10T08:33:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 -- 172.21.15.52:0/1313757548 learned_addr learned my addr 172.21.15.52:0/1313757548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e68c00640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e092346840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e6a000640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 -- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 msgr2=0x55e092346840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e092346840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 -- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 msgr2=0x55e09234ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 -- 172.21.15.52:0/1313757548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0920656b0 con 0x55e092324ea0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e6a000640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e69600640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1e580071b0 tx=0x7f1e58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884334a0475d6d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.954+0000 7f1e4a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58027060 con 0x55e092324ea0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f1e58010040 con 0x55e092324ea0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e50032820 con 0x55e092324ea0 2024-09-10T08:33:25.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f1e58007730 con 0x55e092324ea0 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 10 client.6876 fetch_fsmap learned FSMap version 58 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55e09234cad0 con 0x55e092324ea0 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e50032820 con 0x55e092324ea0 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f1e5800ecc0 con 0x55e092324ea0 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 10 client.6876 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 10 client.6876 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 20 client.6876 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09234da80 0x55e09237da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 4 client.6876 mds_command: new command op to 6837 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:33:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.955+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 --> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e092295b40 con 0x55e09234da80 2024-09-10T08:33:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.956+0000 7f1e68c00640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09234da80 0x55e09237da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.956+0000 7f1e68c00640 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09234da80 0x55e09237da20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd086a4912d576e7 server_cookie=d17d348c20183bd7 in_seq=0 out_seq=0 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.956+0000 7f1e4a000640 10 client.6876 ms_handle_connect on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e4a000640 1 -- 172.21.15.52:0/1313757548 <== mds.0 v2:172.21.15.52:6834/3185894602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e092295b40 con 0x55e09234da80 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e4a000640 10 client.6876 handle_command_reply: tid=0 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 client.6876 shutdown 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 msgr2=0x55e092345f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1e580071b0 tx=0x7f1e58000bc0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 shutdown_connections 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09234da80 0x55e09237da20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e092346840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/1313757548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092345f50 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 >> 172.21.15.52:0/1313757548 conn(0x55e092322660 msgr2=0x55e092369100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.957+0000 7f1e4a000640 0 client.6876 ms_handle_reset on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.958+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 shutdown_connections 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.958+0000 7f1e6ee33740 1 -- 172.21.15.52:0/1313757548 wait complete. 2024-09-10T08:33:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.958+0000 7f1e6ee33740 20 client.6876 trim_cache size 0 max 16384 2024-09-10T08:33:25.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.977+0000 7f1e6ee33740 1 Processor -- start 2024-09-10T08:33:25.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.977+0000 7f1e6ee33740 1 -- start start 2024-09-10T08:33:25.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.977+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.977+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09236b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e641ffe40 con 0x55e092324ea0 2024-09-10T08:33:25.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e641f8940 con 0x55e092346d80 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640cc830 con 0x55e092326630 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50786/0 (socket says 172.21.15.52:50786) 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 -- 172.21.15.52:0/3408253067 learned_addr learned my addr 172.21.15.52:0/3408253067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e6a000640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e68c00640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09236b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 -- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 msgr2=0x55e09236b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09236b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 -- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 msgr2=0x55e09234b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 -- 172.21.15.52:0/3408253067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e092347d30 con 0x55e092324ea0 2024-09-10T08:33:25.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e68c00640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09236b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.978+0000 7f1e69600640 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005aa0 tx=0x7f1e5801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aff5a4c9905ef04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.979+0000 7f1e55200640 1 -- 172.21.15.52:0/3408253067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58013580 con 0x55e092324ea0 2024-09-10T08:33:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.979+0000 7f1e55200640 1 -- 172.21.15.52:0/3408253067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5800ecc0 con 0x55e092324ea0 2024-09-10T08:33:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.979+0000 7f1e55200640 1 -- 172.21.15.52:0/3408253067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5800ee70 con 0x55e092324ea0 2024-09-10T08:33:25.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.979+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3408253067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 msgr2=0x55e092383f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.979+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005aa0 tx=0x7f1e5801f000 comp rx=0 tx=0).stop 2024-09-10T08:33:25.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3408253067 shutdown_connections 2024-09-10T08:33:25.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092346d80 0x55e09234b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09236b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3408253067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092324ea0 0x55e092383f60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3408253067 >> 172.21.15.52:0/3408253067 conn(0x55e092322660 msgr2=0x55e092363e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3408253067 shutdown_connections 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3408253067 wait complete. 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 -- start start 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.980+0000 7f1e6ee33740 1 Processor -- start 2024-09-10T08:33:25.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e0923d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09234a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e092364bd0 con 0x55e092346d80 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e09234ce10 con 0x55e092324ea0 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.981+0000 7f1e6ee33740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e09234de80 con 0x55e092326630 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6ee33740 10 client.0 _ll_register_callbacks cb 0x7f1e58005d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50796/0 (socket says 172.21.15.52:50796) 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 -- 172.21.15.52:0/3271708337 learned_addr learned my addr 172.21.15.52:0/3271708337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e69600640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e0923d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e68c00640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09234a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 -- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 msgr2=0x55e09234a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09234a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 -- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 msgr2=0x55e0923d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e0923d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.982+0000 7f1e6a000640 1 -- 172.21.15.52:0/3271708337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09234a970 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6a000640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007e40 tx=0x7f1e5c05dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407c093a1c94a182 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c088060 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f1e5c0600b0 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e5800ecc0 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f1e5c076050 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 10 client.6882 fetch_fsmap learned FSMap version 58 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55e092349c30 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5800ecc0 con 0x55e092346d80 2024-09-10T08:33:25.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f1e5c071bd0 con 0x55e092346d80 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 10 client.6882 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 10 client.6882 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 20 client.6882 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09238d750 0x55e092348120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 4 client.6882 mds_command: new command op to 6837 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.983+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 --> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] -- command(tid 0: {"prefix": "status"}) -- 0x55e09228fe90 con 0x55e09238d750 2024-09-10T08:33:25.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e69600640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09238d750 0x55e092348120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e69600640 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09238d750 0x55e092348120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9fb4bfd5aa3624 server_cookie=c4647e3531a4f442 in_seq=0 out_seq=0 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e4a000640 10 client.6882 ms_handle_connect on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e4a000640 1 -- 172.21.15.52:0/3271708337 <== mds.0 v2:172.21.15.52:6834/3185894602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e09228fe90 con 0x55e09238d750 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e4a000640 10 client.6882 handle_command_reply: tid=0 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.984+0000 7f1e6ee33740 1 client.6882 shutdown 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 msgr2=0x55e09237c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007e40 tx=0x7f1e5c05dd20 comp rx=0 tx=0).stop 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 shutdown_connections 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55e09238d750 0x55e092348120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e092346d80 0x55e09237c080 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e092326630 0x55e09234a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e4a000640 0 client.6882 ms_handle_reset on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 --2- 172.21.15.52:0/3271708337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e092324ea0 0x55e0923d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 >> 172.21.15.52:0/3271708337 conn(0x55e092322660 msgr2=0x55e09236b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 shutdown_connections 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 1 -- 172.21.15.52:0/3271708337 wait complete. 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.985+0000 7f1e6ee33740 20 client.6882 trim_cache size 0 max 16384 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6837, 2024-09-10T08:33:25.993 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 3.7519459679999998, 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 58, 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 80, 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 80, 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 4.5961224620000003 2024-09-10T08:33:25.994 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 msgr2=0x7f1e4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 0x7f1e4406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000f60 tx=0x7f1e58009040 comp rx=0 tx=0).stop 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 msgr2=0x7f1e640b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c007e70 tx=0x7f1e5c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 shutdown_connections 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1e4406be30 0x7f1e4406e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e6415e440 0x7f1e640b5980 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e640cf450 0x7f1e64152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 --2- 172.21.15.52:0/2766706225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e640b6710 0x7f1e641e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:25.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 >> 172.21.15.52:0/2766706225 conn(0x7f1e64067f80 msgr2=0x7f1e640ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:25.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 shutdown_connections 2024-09-10T08:33:25.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:25.986+0000 7f1e6aa00640 1 -- 172.21.15.52:0/2766706225 wait complete. 2024-09-10T08:33:26.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:33:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.157+0000 7f92dc400640 1 Processor -- start 2024-09-10T08:33:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.157+0000 7f92dc400640 1 -- start start 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92dc400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f92d4147e80 0x7f92d4070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92dc400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d4071b30 con 0x7f92d4148260 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92dc400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d40b3510 con 0x7f92d406c320 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92dc400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f92d4074200 con 0x7f92d4147e80 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92d9000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f92d4148260 0x7f92d406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48854/0 (socket says 172.21.15.52:48854) 2024-09-10T08:33:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92d9000640 1 -- 172.21.15.52:0/1155535306 learned_addr learned my addr 172.21.15.52:0/1155535306 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92d9a00640 1 --2- 172.21.15.52:0/1155535306 >> v2:172.21.15.176:3300/0 conn(0x7f92d4147e80 0x7f92d4070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.159+0000 7f92d3e00640 1 -- 172.21.15.52:0/1155535306 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391240694 0 0) 0x7f92d4071b30 con 0x7f92d4148260 2024-09-10T08:33:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.160+0000 7f92d3e00640 1 -- 172.21.15.52:0/1155535306 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92bc003520 con 0x7f92d4148260 2024-09-10T08:33:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.160+0000 7f92d9a00640 1 -- 172.21.15.52:0/1155535306 >> v1:172.21.15.176:6789/0 conn(0x7f92d406c320 legacy=0x7f92d40b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.160+0000 7f92d9a00640 1 -- 172.21.15.52:0/1155535306 >> v1:172.21.15.52:6789/0 conn(0x7f92d4148260 legacy=0x7f92d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.160+0000 7f92d9a00640 1 -- 172.21.15.52:0/1155535306 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d40b37f0 con 0x7f92d4147e80 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92d9a00640 1 --2- 172.21.15.52:0/1155535306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d4070f70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92c80097a0 tx=0x7f92c802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc9c2ddc70a0ec7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92d3e00640 1 -- 172.21.15.52:0/1155535306 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c8037070 con 0x7f92d4147e80 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92d3e00640 1 -- 172.21.15.52:0/1155535306 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c8032440 con 0x7f92d4147e80 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92d3e00640 1 -- 172.21.15.52:0/1155535306 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c80327f0 con 0x7f92d4147e80 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92dc400640 1 -- 172.21.15.52:0/1155535306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 msgr2=0x7f92d4070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.161+0000 7f92dc400640 1 --2- 172.21.15.52:0/1155535306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d4070f70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92c80097a0 tx=0x7f92c802a230 comp rx=0 tx=0).stop 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.162+0000 7f92dc400640 1 -- 172.21.15.52:0/1155535306 shutdown_connections 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.162+0000 7f92dc400640 1 --2- 172.21.15.52:0/1155535306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d4070f70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.162+0000 7f92dc400640 1 -- 172.21.15.52:0/1155535306 >> 172.21.15.52:0/1155535306 conn(0x7f92d40ccec0 msgr2=0x7f92d40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.162+0000 7f92dc400640 1 -- 172.21.15.52:0/1155535306 shutdown_connections 2024-09-10T08:33:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.162+0000 7f92dc400640 1 -- 172.21.15.52:0/1155535306 wait complete. 2024-09-10T08:33:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.163+0000 7f92dc400640 1 Processor -- start 2024-09-10T08:33:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.163+0000 7f92dc400640 1 -- start start 2024-09-10T08:33:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d406c320 0x7f92d41ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d41e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40714b0 con 0x7f92d4148260 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40b3e40 con 0x7f92d4147e80 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.164+0000 7f92dc400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92d4071630 con 0x7f92d406c320 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50804/0 (socket says 172.21.15.52:50804) 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 -- 172.21.15.52:0/3049082550 learned_addr learned my addr 172.21.15.52:0/3049082550 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92d9000640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d41e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92d9a00640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d406c320 0x7f92d41ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 -- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d406c320 msgr2=0x7f92d41ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d406c320 0x7f92d41ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 -- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 msgr2=0x7f92d41e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d41e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 -- 172.21.15.52:0/3049082550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d41eadf0 con 0x7f92d4148260 2024-09-10T08:33:26.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.165+0000 7f92da400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c730 tx=0x7f92cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:26.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.166+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc003b70 con 0x7f92d4148260 2024-09-10T08:33:26.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.166+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc003d10 con 0x7f92d4148260 2024-09-10T08:33:26.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.166+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d412fbc0 con 0x7f92d4148260 2024-09-10T08:33:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.166+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00aa30 con 0x7f92d4148260 2024-09-10T08:33:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.166+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d41e9af0 con 0x7f92d4148260 2024-09-10T08:33:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.167+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d4070f70 con 0x7f92d4148260 2024-09-10T08:33:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.168+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92cc00abd0 con 0x7f92d4148260 2024-09-10T08:33:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.169+0000 7f92d1600640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 0x7f92b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.169+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5881+0+0 (secure 0 0 0) 0x7f92cc08ad50 con 0x7f92d4148260 2024-09-10T08:33:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.169+0000 7f92d9a00640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 0x7f92b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.170+0000 7f92d9a00640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 0x7f92b406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f92c8034000 tx=0x7f92c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:26.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.173+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92cc08e030 con 0x7f92d4148260 2024-09-10T08:33:26.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.400+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f92d406c9c0 con 0x7f92d4148260 2024-09-10T08:33:26.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.400+0000 7f92d1600640 1 -- 172.21.15.52:0/3049082550 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7f92cc0596e0 con 0x7f92d4148260 2024-09-10T08:33:26.401 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 msgr2=0x7f92b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 0x7f92b406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f92c8034000 tx=0x7f92c802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 msgr2=0x7f92d4145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c730 tx=0x7f92cc00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 shutdown_connections 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f92b406be30 0x7f92b406e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92d4148260 0x7f92d4145d30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f92d4147e80 0x7f92d41e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 --2- 172.21.15.52:0/3049082550 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f92d406c320 0x7f92d41ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:26.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 >> 172.21.15.52:0/3049082550 conn(0x7f92d40ccec0 msgr2=0x7f92d406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:26.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 shutdown_connections 2024-09-10T08:33:26.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26.402+0000 7f92dc400640 1 -- 172.21.15.52:0/3049082550 wait complete. 2024-09-10T08:33:26.417 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:33:26.418 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:26.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:26.419 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:26.456 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42396sec preferred_lft 42396sec 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:33:26.457 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:33:26.458 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:33:26.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:26.459 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:33:26.549 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:33:26.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:26.552 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:33:26.588 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:33:26.588 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:33:26.588 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:33:26.588 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:33:26.588 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:33:26.589 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:33:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:33:26.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:33:26.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:26.786 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:33:26.822 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:33:26.822 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:33:26.822 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:26.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:26.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:33:26.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:33:26.918 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:26.952 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:33:26.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:33:26.953 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:27.027 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:33:27.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:27.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:27.155 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:27.155 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:33:27.184 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:33:27.184 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:33:27.184 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:33:27.185 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:33:27.185 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:33:27.187 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:33:27.187 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:33:27.187 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:33:27.187 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:33:27.187 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:33:27.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:33:27.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:27.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:27.235 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:33:27.234+0000 7f4e08a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:33:27.247 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:33:27.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:33:27.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:33:27.378 INFO:teuthology.orchestra.run.smithi052.stdout:client6053 2024-09-10T08:33:27.379 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:27.379 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:27.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:27.414 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-10T08:33:27.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:33:27.492 INFO:teuthology.orchestra.run.smithi052.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-10T08:33:27.493 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-10T08:33:27.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-10T08:33:27.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.693+0000 7fc54aa00640 1 Processor -- start 2024-09-10T08:33:27.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.693+0000 7fc54aa00640 1 -- start start 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc54aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc54415ec10 0x7fc5440d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc54aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544162fe0 0x7fc5440b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc54aa00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5440b7920 con 0x7fc5440b67b0 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc54aa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc5440b3c00 con 0x7fc544162fe0 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc54aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc544163420 con 0x7fc54415ec10 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc543400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544162fe0 0x7fc5440b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc543400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc544162fe0 0x7fc5440b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50816/0 (socket says 172.21.15.52:50816) 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.694+0000 7fc543400640 1 -- 172.21.15.52:0/2478970263 learned_addr learned my addr 172.21.15.52:0/2478970263 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.695+0000 7fc543e00640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc54415ec10 0x7fc5440d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.695+0000 7fc543400640 1 -- 172.21.15.52:0/2478970263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc54415ec10 msgr2=0x7fc5440d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.695+0000 7fc543400640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc54415ec10 0x7fc5440d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.695+0000 7fc543400640 1 -- 172.21.15.52:0/2478970263 >> v1:172.21.15.176:6789/0 conn(0x7fc5440b67b0 legacy=0x7fc54406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.695+0000 7fc543400640 1 -- 172.21.15.52:0/2478970263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440cf7c0 con 0x7fc544162fe0 2024-09-10T08:33:27.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.696+0000 7fc543400640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc544162fe0 0x7fc5440b6270 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc530009870 tx=0x7fc53002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27893bfaa796e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.696+0000 7fc542a00640 1 -- 172.21.15.52:0/2478970263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530037070 con 0x7fc544162fe0 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.696+0000 7fc542a00640 1 -- 172.21.15.52:0/2478970263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530032440 con 0x7fc544162fe0 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.696+0000 7fc542a00640 1 -- 172.21.15.52:0/2478970263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530032810 con 0x7fc544162fe0 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 -- 172.21.15.52:0/2478970263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc544162fe0 msgr2=0x7fc5440b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc544162fe0 0x7fc5440b6270 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc530009870 tx=0x7fc53002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 -- 172.21.15.52:0/2478970263 shutdown_connections 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc544162fe0 0x7fc5440b6270 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 --2- 172.21.15.52:0/2478970263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc54415ec10 0x7fc5440d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 -- 172.21.15.52:0/2478970263 >> 172.21.15.52:0/2478970263 conn(0x7fc5440d1450 msgr2=0x7fc5440d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 -- 172.21.15.52:0/2478970263 shutdown_connections 2024-09-10T08:33:27.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.697+0000 7fc54aa00640 1 -- 172.21.15.52:0/2478970263 wait complete. 2024-09-10T08:33:27.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.698+0000 7fc54aa00640 1 Processor -- start 2024-09-10T08:33:27.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.699+0000 7fc54aa00640 1 -- start start 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.699+0000 7fc54aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.699+0000 7fc54aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc54415ec10 0x7fc5441f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc54aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc544162fe0 0x7fc5440cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc54aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440d4300 con 0x7fc5440b67b0 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc54aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440cfd80 con 0x7fc54415ec10 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc54aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440d4480 con 0x7fc544162fe0 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50828/0 (socket says 172.21.15.52:50828) 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 -- 172.21.15.52:0/4239911653 learned_addr learned my addr 172.21.15.52:0/4239911653 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543400640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc54415ec10 0x7fc5441f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc548a00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc544162fe0 0x7fc5440cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 -- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc544162fe0 msgr2=0x7fc5440cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc544162fe0 0x7fc5440cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 -- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc54415ec10 msgr2=0x7fc5441f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc54415ec10 0x7fc5441f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 -- 172.21.15.52:0/4239911653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440cdef0 con 0x7fc5440b67b0 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.700+0000 7fc543e00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc53400d830 tx=0x7fc53400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.701+0000 7fc53be00640 1 -- 172.21.15.52:0/4239911653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400b6c0 con 0x7fc5440b67b0 2024-09-10T08:33:27.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.701+0000 7fc53be00640 1 -- 172.21.15.52:0/4239911653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534019070 con 0x7fc5440b67b0 2024-09-10T08:33:27.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.701+0000 7fc53be00640 1 -- 172.21.15.52:0/4239911653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400ba80 con 0x7fc5440b67b0 2024-09-10T08:33:27.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.701+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5440ce1d0 con 0x7fc5440b67b0 2024-09-10T08:33:27.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.701+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5440ce790 con 0x7fc5440b67b0 2024-09-10T08:33:27.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.704+0000 7fc53be00640 1 -- 172.21.15.52:0/4239911653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc53401e460 con 0x7fc5440b67b0 2024-09-10T08:33:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.705+0000 7fc53be00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 0x7fc52406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.705+0000 7fc53be00640 1 -- 172.21.15.52:0/4239911653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5939+0+0 (secure 0 0 0) 0x7fc53408b570 con 0x7fc5440b67b0 2024-09-10T08:33:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.705+0000 7fc54da60740 1 Processor -- start 2024-09-10T08:33:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.705+0000 7fc54da60740 1 -- start start 2024-09-10T08:33:27.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.705+0000 7fc543400640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 0x7fc52406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f75c30 0x55d650f76010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f99980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d650eaea10 con 0x55d650f91b90 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d650e56970 con 0x55d650f75c30 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d650eaa9d0 con 0x55d650f90450 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc543400640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 0x7fc52406e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc530034000 tx=0x7fc53002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc543400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc543400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50842/0 (socket says 172.21.15.52:50842) 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc543400640 1 -- 172.21.15.52:0/2229954806 learned_addr learned my addr 172.21.15.52:0/2229954806 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc543e00640 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f75c30 0x55d650f76010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.706+0000 7fc548a00640 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f99980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 -- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 msgr2=0x55d650f99980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f99980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 -- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f75c30 msgr2=0x55d650f76010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f75c30 0x55d650f76010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 -- 172.21.15.52:0/2229954806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d650c8daf0 con 0x55d650f91b90 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc543400640 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc530009870 tx=0x7fc53002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1cd83cd6ff0f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc52fe00640 1 -- 172.21.15.52:0/2229954806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53004e070 con 0x55d650f91b90 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc52fe00640 1 -- 172.21.15.52:0/2229954806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530032ba0 con 0x55d650f91b90 2024-09-10T08:33:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.707+0000 7fc52fe00640 1 -- 172.21.15.52:0/2229954806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530037040 con 0x55d650f91b90 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 -- 172.21.15.52:0/2229954806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 msgr2=0x55d650f99440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc530009870 tx=0x7fc53002c000 comp rx=0 tx=0).stop 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 -- 172.21.15.52:0/2229954806 shutdown_connections 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f99980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f99440 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 --2- 172.21.15.52:0/2229954806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f75c30 0x55d650f76010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 -- 172.21.15.52:0/2229954806 >> 172.21.15.52:0/2229954806 conn(0x55d650f48780 msgr2=0x55d650f90a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 -- 172.21.15.52:0/2229954806 shutdown_connections 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.708+0000 7fc54da60740 1 -- 172.21.15.52:0/2229954806 wait complete. 2024-09-10T08:33:27.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.709+0000 7fc54da60740 1 -- start start 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.709+0000 7fc54da60740 1 Processor -- start 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f71310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 0x55d650f8d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d650f4bbe0 con 0x55d650f8d8f0 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d650e69b90 con 0x55d650f91b90 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d650f4bec0 con 0x55d650f90450 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc54da60740 10 client.0 _ll_register_callbacks cb 0x55d650e5b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc548a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc548a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50846/0 (socket says 172.21.15.52:50846) 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc548a00640 1 -- 172.21.15.52:0/2484170804 learned_addr learned my addr 172.21.15.52:0/2484170804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc543400640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 0x55d650f8d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc543e00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f71310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc548a00640 1 -- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 msgr2=0x55d650f71310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.710+0000 7fc548a00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f71310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc548a00640 1 -- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 msgr2=0x55d650f8d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc548a00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 0x55d650f8d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc548a00640 1 -- 172.21.15.52:0/2484170804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d650b813e0 con 0x55d650f8d8f0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc543400640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 0x55d650f8d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc548a00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc53c011550 tx=0x7fc53c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a1d3874e0ae73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc52cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c006d60 con 0x55d650f8d8f0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc530032ba0 con 0x55d650f8d8f0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5939+0+0 (secure 0 0 0) 0x7fc53c010040 con 0x55d650f8d8f0 2024-09-10T08:33:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fc53c003970 con 0x55d650f8d8f0 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc54da60740 10 client.6900 fetch_fsmap learned FSMap version 58 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.711+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55d650cee280 con 0x55d650f8d8f0 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530032ba0 con 0x55d650f8d8f0 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7fc53c003b10 con 0x55d650f8d8f0 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 10 client.6900 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 10 client.6900 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 20 client.6900 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f8dd50 0x55d650fa1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 4 client.6900 mds_command: new command op to 6837 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 --> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d650ebc140 con 0x55d650f8dd50 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.712+0000 7fc543e00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f8dd50 0x55d650fa1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.713+0000 7fc543e00640 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f8dd50 0x55d650fa1240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ab19a08f95e838 server_cookie=257bc7dc2d0e0357 in_seq=0 out_seq=0 2024-09-10T08:33:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.713+0000 7fc52cc00640 10 client.6900 ms_handle_connect on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.713+0000 7fc52cc00640 1 -- 172.21.15.52:0/2484170804 <== mds.0 v2:172.21.15.52:6834/3185894602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d650ebc140 con 0x55d650f8dd50 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.713+0000 7fc52cc00640 10 client.6900 handle_command_reply: tid=0 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.713+0000 7fc54da60740 1 client.6900 shutdown 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 msgr2=0x55d650fa0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc53c011550 tx=0x7fc53c011a10 comp rx=0 tx=0).stop 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 shutdown_connections 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f8dd50 0x55d650fa1240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650fa0830 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f91b90 0x55d650f8d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 --2- 172.21.15.52:0/2484170804 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f90450 0x55d650f71310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc52cc00640 0 client.6900 ms_handle_reset on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 >> 172.21.15.52:0/2484170804 conn(0x55d650f75c30 msgr2=0x55d650f91030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 shutdown_connections 2024-09-10T08:33:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 1 -- 172.21.15.52:0/2484170804 wait complete. 2024-09-10T08:33:27.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.714+0000 7fc54da60740 20 client.6900 trim_cache size 0 max 16384 2024-09-10T08:33:27.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.732+0000 7fc54da60740 1 Processor -- start 2024-09-10T08:33:27.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.732+0000 7fc54da60740 1 -- start start 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d650f49190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f91b90 0x55d650fb47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc544200e80 con 0x55d650f8d8f0 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc544200050 con 0x55d650f90450 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc5441f8ab0 con 0x55d650f91b90 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50854/0 (socket says 172.21.15.52:50854) 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 -- 172.21.15.52:0/3075746763 learned_addr learned my addr 172.21.15.52:0/3075746763 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 -- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f91b90 msgr2=0x55d650fb47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f91b90 0x55d650fb47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 -- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 msgr2=0x55d650f49190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d650f49190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.733+0000 7fc543e00640 1 -- 172.21.15.52:0/3075746763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d650b5a4a0 con 0x55d650f8d8f0 2024-09-10T08:33:27.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc543e00640 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc5340596b0 tx=0x7fc534055af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afefcab2100c6f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc52f400640 1 -- 172.21.15.52:0/3075746763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53405dad0 con 0x55d650f8d8f0 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc52f400640 1 -- 172.21.15.52:0/3075746763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534071070 con 0x55d650f8d8f0 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc52f400640 1 -- 172.21.15.52:0/3075746763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534062300 con 0x55d650f8d8f0 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 -- 172.21.15.52:0/3075746763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 msgr2=0x55d650f8ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc5340596b0 tx=0x7fc534055af0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 -- 172.21.15.52:0/3075746763 shutdown_connections 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f91b90 0x55d650fb47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d650f49190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 --2- 172.21.15.52:0/3075746763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f8d8f0 0x55d650f8ba50 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.734+0000 7fc54da60740 1 -- 172.21.15.52:0/3075746763 >> 172.21.15.52:0/3075746763 conn(0x55d650f75c30 msgr2=0x55d650f74d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.735+0000 7fc54da60740 1 -- 172.21.15.52:0/3075746763 shutdown_connections 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.735+0000 7fc54da60740 1 -- 172.21.15.52:0/3075746763 wait complete. 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.735+0000 7fc54da60740 1 -- start start 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.735+0000 7fc54da60740 1 Processor -- start 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f8d8f0 0x55d650f49190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d65100dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440ca080 con 0x55d650f91b90 2024-09-10T08:33:27.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d650f71270 con 0x55d650f90450 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d650f877e0 con 0x55d650f8d8f0 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc54da60740 10 client.0 _ll_register_callbacks cb 0x7fc53c002140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.736+0000 7fc548a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50864/0 (socket says 172.21.15.52:50864) 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 -- 172.21.15.52:0/3297003642 learned_addr learned my addr 172.21.15.52:0/3297003642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc543400640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d65100dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc543e00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f8d8f0 0x55d650f49190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 -- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f8d8f0 msgr2=0x55d650f49190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f8d8f0 0x55d650f49190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 -- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 msgr2=0x55d65100dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d65100dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 -- 172.21.15.52:0/3297003642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d650f8a390 con 0x55d650f91b90 2024-09-10T08:33:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc548a00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0055d0 tx=0x7fc53c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7be77a5944b1001 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc52cc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c005110 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5939+0+0 (secure 0 0 0) 0x7fc53c00f450 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.737+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc534071070 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fc53c011110 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 10 client.6906 fetch_fsmap learned FSMap version 58 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x55d650f87450 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc534071070 con 0x55d650f91b90 2024-09-10T08:33:27.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7fc53c00f860 con 0x55d650f91b90 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 10 client.6906 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 10 client.6906 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 20 client.6906 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f90e80 0x55d650f70040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 4 client.6906 mds_command: new command op to 6837 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 --> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55d650eb6490 con 0x55d650f90e80 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.738+0000 7fc543e00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f90e80 0x55d650f70040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.739+0000 7fc543e00640 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f90e80 0x55d650f70040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34bf3a7b9a34d39a server_cookie=8dffca827093ae6c in_seq=0 out_seq=0 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.739+0000 7fc52cc00640 10 client.6906 ms_handle_connect on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.739+0000 7fc52cc00640 1 -- 172.21.15.52:0/3297003642 <== mds.0 v2:172.21.15.52:6834/3185894602 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d650eb6490 con 0x55d650f90e80 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.739+0000 7fc52cc00640 10 client.6906 handle_command_reply: tid=0 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.739+0000 7fc54da60740 1 client.6906 shutdown 2024-09-10T08:33:27.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 msgr2=0x55d650f90830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0055d0 tx=0x7fc53c001250 comp rx=0 tx=0).stop 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 shutdown_connections 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:6834/3185894602,v1:172.21.15.52:6835/3185894602] conn(0x55d650f90e80 0x55d650f70040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d650f91b90 0x55d650f90830 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d650f90450 0x55d65100dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 --2- 172.21.15.52:0/3297003642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d650f8d8f0 0x55d650f49190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc52cc00640 0 client.6906 ms_handle_reset on v2:172.21.15.52:6834/3185894602 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 >> 172.21.15.52:0/3297003642 conn(0x55d650f75c30 msgr2=0x55d650f74d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 shutdown_connections 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 1 -- 172.21.15.52:0/3297003642 wait complete. 2024-09-10T08:33:27.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.740+0000 7fc54da60740 20 client.6906 trim_cache size 0 max 16384 2024-09-10T08:33:27.745 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:27.745 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:33:27.745 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "fcfb402f-a5fc-478b-9ab6-ff7a388ca96f", 2024-09-10T08:33:27.745 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:33:27.745 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 msgr2=0x7fc52406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 0x7fc52406e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc530034000 tx=0x7fc53002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 msgr2=0x7fc54415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc53400d830 tx=0x7fc53400dcf0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 shutdown_connections 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc52406be30 0x7fc52406e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc544162fe0 0x7fc5440cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc54415ec10 0x7fc5441f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 --2- 172.21.15.52:0/4239911653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5440b67b0 0x7fc54415bac0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 >> 172.21.15.52:0/4239911653 conn(0x7fc5440d1450 msgr2=0x7fc5440b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 shutdown_connections 2024-09-10T08:33:27.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:27.741+0000 7fc54aa00640 1 -- 172.21.15.52:0/4239911653 wait complete. 2024-09-10T08:33:27.757 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': 'fcfb402f-a5fc-478b-9ab6-ff7a388ca96f', 'mode': 'asynchronous'}' 2024-09-10T08:33:36.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:36.377 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:33:37.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:37.758 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-10T08:33:37.801 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:33:37.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:37.920 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:38.019 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:33:38.019 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:33:38.019 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:38.019 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:38.056 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:38.056 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:38.132 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:33:38.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.330+0000 7ff621c00640 1 Processor -- start 2024-09-10T08:33:38.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.330+0000 7ff621c00640 1 -- start start 2024-09-10T08:33:38.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff621c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff61c0b6710 0x7ff61c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff621c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0cf450 0x7ff61c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff621c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0d3990 con 0x7ff61c15e440 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff621c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c0d3c70 con 0x7ff61c0b6710 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff621c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0d3f50 con 0x7ff61c0cf450 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff61b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff61c0b6710 0x7ff61c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff61b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff61c0b6710 0x7ff61c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52742/0 (socket says 172.21.15.52:52742) 2024-09-10T08:33:38.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.331+0000 7ff61b400640 1 -- 172.21.15.52:0/3867241637 learned_addr learned my addr 172.21.15.52:0/3867241637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:38.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.332+0000 7ff61b400640 1 -- 172.21.15.52:0/3867241637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0cf450 msgr2=0x7ff61c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:38.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.332+0000 7ff61b400640 1 --2- 172.21.15.52:0/3867241637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0cf450 0x7ff61c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.332+0000 7ff61b400640 1 -- 172.21.15.52:0/3867241637 >> v1:172.21.15.176:6789/0 conn(0x7ff61c15e440 legacy=0x7ff61c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:38.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.332+0000 7ff61b400640 1 -- 172.21.15.52:0/3867241637 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c0d4230 con 0x7ff61c0b6710 2024-09-10T08:33:38.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.333+0000 7ff61b400640 1 --2- 172.21.15.52:0/3867241637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c0b6710 0x7ff61c0d3240 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff608009870 tx=0x7ff60802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b1cbb98ea5855e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.333+0000 7ff61aa00640 1 -- 172.21.15.52:0/3867241637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608037070 con 0x7ff61c0b6710 2024-09-10T08:33:38.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.333+0000 7ff61aa00640 1 -- 172.21.15.52:0/3867241637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff608032440 con 0x7ff61c0b6710 2024-09-10T08:33:38.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.333+0000 7ff61aa00640 1 -- 172.21.15.52:0/3867241637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608032810 con 0x7ff61c0b6710 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 -- 172.21.15.52:0/3867241637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c0b6710 msgr2=0x7ff61c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 --2- 172.21.15.52:0/3867241637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c0b6710 0x7ff61c0d3240 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff608009870 tx=0x7ff60802a2a0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 -- 172.21.15.52:0/3867241637 shutdown_connections 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 --2- 172.21.15.52:0/3867241637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0cf450 0x7ff61c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 --2- 172.21.15.52:0/3867241637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c0b6710 0x7ff61c0d3240 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 -- 172.21.15.52:0/3867241637 >> 172.21.15.52:0/3867241637 conn(0x7ff61c067f80 msgr2=0x7ff61c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 -- 172.21.15.52:0/3867241637 shutdown_connections 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.334+0000 7ff621c00640 1 -- 172.21.15.52:0/3867241637 wait complete. 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.335+0000 7ff621c00640 1 Processor -- start 2024-09-10T08:33:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.335+0000 7ff621c00640 1 -- start start 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0b6710 0x7ff61c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c0cf450 0x7ff61c0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0b76c0 con 0x7ff61c15e440 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0b7540 con 0x7ff61c0cf450 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0b80a0 con 0x7ff61c0b6710 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.336+0000 7ff621200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52744/0 (socket says 172.21.15.52:52744) 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 -- 172.21.15.52:0/2381583942 learned_addr learned my addr 172.21.15.52:0/2381583942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff61b400640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c0cf450 0x7ff61c0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff61be00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0b6710 0x7ff61c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 -- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0b6710 msgr2=0x7ff61c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0b6710 0x7ff61c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 -- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c0cf450 msgr2=0x7ff61c0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c0cf450 0x7ff61c0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 -- 172.21.15.52:0/2381583942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c15f960 con 0x7ff61c15e440 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621200640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b970 tx=0x7ff61400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614019070 con 0x7ff61c15e440 2024-09-10T08:33:38.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61400cb60 con 0x7ff61c15e440 2024-09-10T08:33:38.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614014440 con 0x7ff61c15e440 2024-09-10T08:33:38.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.337+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c15f3a0 con 0x7ff61c15e440 2024-09-10T08:33:38.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.338+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c15fea0 con 0x7ff61c15e440 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.339+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c0b7b60 con 0x7ff61c15e440 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.340+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff61401c070 con 0x7ff61c15e440 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.340+0000 7ff613e00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.341+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7ff61408aca0 con 0x7ff61c15e440 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.341+0000 7ff61be00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.342+0000 7ff61be00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 0x7ff5fc06e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006fd0 tx=0x7ff60c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.345+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff614059550 con 0x7ff61c15e440 2024-09-10T08:33:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.539+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff61c0ce940 con 0x7ff61c15e440 2024-09-10T08:33:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.540+0000 7ff613e00640 1 -- 172.21.15.52:0/2381583942 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v82) ==== 80+0+244 (secure 0 0 0) 0x7ff614058e50 con 0x7ff61c15e440 2024-09-10T08:33:38.540 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.176:6836/1714870234 2024-09-11T08:33:21.217528+0000 2024-09-10T08:33:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.176:6834/1714870234 2024-09-11T08:33:21.217528+0000 2024-09-10T08:33:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6834/177160853 2024-09-11T08:33:21.199461+0000 2024-09-10T08:33:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6832/177160853 2024-09-11T08:33:21.199461+0000 2024-09-10T08:33:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:listed 4 entries 2024-09-10T08:33:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 msgr2=0x7ff5fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 0x7ff5fc06e320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006fd0 tx=0x7ff60c008040 comp rx=0 tx=0).stop 2024-09-10T08:33:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 msgr2=0x7ff61c15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b970 tx=0x7ff61400be30 comp rx=0 tx=0).stop 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 shutdown_connections 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5fc06be60 0x7ff5fc06e320 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff61c15e440 0x7ff61c15ea30 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff61c0cf450 0x7ff61c0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 --2- 172.21.15.52:0/2381583942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff61c0b6710 0x7ff61c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 >> 172.21.15.52:0/2381583942 conn(0x7ff61c067f80 msgr2=0x7ff61c0b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 shutdown_connections 2024-09-10T08:33:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.542+0000 7ff621c00640 1 -- 172.21.15.52:0/2381583942 wait complete. 2024-09-10T08:33:38.559 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:33:38.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:38.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:33:38.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:33:38.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:33:38.625 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:33:38.661 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:33:38.661 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:38.662 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:38.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:38.701 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:33:38.701 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:38.701 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:38.737 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:33:38.737 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:33:38.737 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:38.737 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:38.779 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:38.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.934+0000 7f6d7a800640 1 Processor -- start 2024-09-10T08:33:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.935+0000 7f6d7a800640 1 -- start start 2024-09-10T08:33:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d7a800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d74145ed0 0x7f6d740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d7a800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d74073180 0x7f6d740735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d7a800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d740b4020 con 0x7f6d740b5880 2024-09-10T08:33:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d7a800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6d74073b00 con 0x7f6d74073180 2024-09-10T08:33:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d7a800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6d740b63d0 con 0x7f6d74145ed0 2024-09-10T08:33:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d74073180 0x7f6d740735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d74073180 0x7f6d740735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52748/0 (socket says 172.21.15.52:52748) 2024-09-10T08:33:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 -- 172.21.15.52:0/3757276581 learned_addr learned my addr 172.21.15.52:0/3757276581 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 -- 172.21.15.52:0/3757276581 >> v2:172.21.15.176:3300/0 conn(0x7f6d74145ed0 msgr2=0x7f6d740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 --2- 172.21.15.52:0/3757276581 >> v2:172.21.15.176:3300/0 conn(0x7f6d74145ed0 0x7f6d740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 -- 172.21.15.52:0/3757276581 >> v1:172.21.15.176:6789/0 conn(0x7f6d740b5880 legacy=0x7f6d740b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.936+0000 7f6d6be00640 1 -- 172.21.15.52:0/3757276581 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740b42c0 con 0x7f6d74073180 2024-09-10T08:33:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.937+0000 7f6d6be00640 1 --2- 172.21.15.52:0/3757276581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d740735c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d740d1490 tx=0x7f6d5c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd93f96b8580b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d72a00640 1 -- 172.21.15.52:0/3757276581 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c037070 con 0x7f6d74073180 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d72a00640 1 -- 172.21.15.52:0/3757276581 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5c032440 con 0x7f6d74073180 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d72a00640 1 -- 172.21.15.52:0/3757276581 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c032810 con 0x7f6d74073180 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 -- 172.21.15.52:0/3757276581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 msgr2=0x7f6d740735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 --2- 172.21.15.52:0/3757276581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d740735c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d740d1490 tx=0x7f6d5c02a210 comp rx=0 tx=0).stop 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 -- 172.21.15.52:0/3757276581 shutdown_connections 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 --2- 172.21.15.52:0/3757276581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d740735c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 --2- 172.21.15.52:0/3757276581 >> v2:172.21.15.176:3300/0 conn(0x7f6d74145ed0 0x7f6d740b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 -- 172.21.15.52:0/3757276581 >> 172.21.15.52:0/3757276581 conn(0x7f6d740ccec0 msgr2=0x7f6d740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 -- 172.21.15.52:0/3757276581 shutdown_connections 2024-09-10T08:33:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.938+0000 7f6d7a800640 1 -- 172.21.15.52:0/3757276581 wait complete. 2024-09-10T08:33:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.940+0000 7f6d7a800640 1 Processor -- start 2024-09-10T08:33:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.940+0000 7f6d7a800640 1 -- start start 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 0x7f6d741e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 0x7f6d741e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b4b60 con 0x7f6d74073180 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b4880 con 0x7f6d740b5880 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d7a800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d741462b0 con 0x7f6d74145ed0 2024-09-10T08:33:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d73400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d73400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52750/0 (socket says 172.21.15.52:52750) 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d73400640 1 -- 172.21.15.52:0/1063206262 learned_addr learned my addr 172.21.15.52:0/1063206262 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.941+0000 7f6d6be00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 0x7f6d741e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73e00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 0x7f6d741e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 -- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 msgr2=0x7f6d741e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 0x7f6d741e6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 -- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 msgr2=0x7f6d741e60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 0x7f6d741e60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 -- 172.21.15.52:0/1063206262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d74141160 con 0x7f6d74073180 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73e00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 0x7f6d741e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d6be00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 0x7f6d741e60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d73400640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b410 tx=0x7f6d6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64015020 con 0x7f6d74073180 2024-09-10T08:33:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d64011850 con 0x7f6d74073180 2024-09-10T08:33:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011c40 con 0x7f6d74073180 2024-09-10T08:33:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d74141440 con 0x7f6d74073180 2024-09-10T08:33:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.942+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d74141a00 con 0x7f6d74073180 2024-09-10T08:33:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.944+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d740735c0 con 0x7f6d74073180 2024-09-10T08:33:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.944+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d64018020 con 0x7f6d74073180 2024-09-10T08:33:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.945+0000 7f6d6b400640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 0x7f6d5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.945+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7f6d6408aef0 con 0x7f6d74073180 2024-09-10T08:33:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.946+0000 7f6d6be00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 0x7f6d5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.946+0000 7f6d6be00640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 0x7f6d5006e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c034000 tx=0x7f6d5c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:38.950+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d6401f020 con 0x7f6d74073180 2024-09-10T08:33:39.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.168+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d74072190 con 0x7f6d74073180 2024-09-10T08:33:39.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.169+0000 7f6d6b400640 1 -- 172.21.15.52:0/1063206262 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5229 (secure 0 0 0) 0x7f6d640172c0 con 0x7f6d74073180 2024-09-10T08:33:39.169 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:39.170 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":58,"btime":"2024-09-10T08:33:25:237846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:25.237838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6837,"qdb_cluster":[6837]},"id":5}]} 2024-09-10T08:33:39.170 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 58 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.171+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 msgr2=0x7f6d5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.171+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 0x7f6d5006e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c034000 tx=0x7f6d5c02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.171+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 msgr2=0x7f6d7415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.171+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b410 tx=0x7f6d6400b8d0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.171+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 shutdown_connections 2024-09-10T08:33:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d5006be30 0x7f6d5006e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d74145ed0 0x7f6d741e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d740b5880 0x7f6d741e60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 --2- 172.21.15.52:0/1063206262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d74073180 0x7f6d7415b1c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 >> 172.21.15.52:0/1063206262 conn(0x7f6d740ccec0 msgr2=0x7f6d740726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 shutdown_connections 2024-09-10T08:33:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.172+0000 7f6d7a800640 1 -- 172.21.15.52:0/1063206262 wait complete. 2024-09-10T08:33:39.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:39.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.346+0000 7fc63be00640 1 Processor -- start 2024-09-10T08:33:39.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.347+0000 7fc63be00640 1 -- start start 2024-09-10T08:33:39.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc63c0cfd80 0x7fc63c163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63be00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c06f060 con 0x7fc63c0b2170 2024-09-10T08:33:39.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63be00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c06f2d0 con 0x7fc63c15c530 2024-09-10T08:33:39.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63be00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c15c910 con 0x7fc63c0cfd80 2024-09-10T08:33:39.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc63c0b2170 0x7fc63c166540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58060/0 (socket says 172.21.15.52:58060) 2024-09-10T08:33:39.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc63b400640 1 -- 172.21.15.52:0/1487580968 learned_addr learned my addr 172.21.15.52:0/1487580968 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:39.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.348+0000 7fc633e00640 1 --2- 172.21.15.52:0/1487580968 >> v2:172.21.15.176:3300/0 conn(0x7fc63c0cfd80 0x7fc63c163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175777012 0 0) 0x7fc63c06f060 con 0x7fc63c0b2170 2024-09-10T08:33:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc620003520 con 0x7fc63c0b2170 2024-09-10T08:33:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880586024 0 0) 0x7fc63c06f2d0 con 0x7fc63c15c530 2024-09-10T08:33:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc63c06f060 con 0x7fc63c15c530 2024-09-10T08:33:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3628809345 0 0) 0x7fc620003520 con 0x7fc63c0b2170 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 >> v2:172.21.15.176:3300/0 conn(0x7fc63c0cfd80 msgr2=0x7fc63c163ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 --2- 172.21.15.52:0/1487580968 >> v2:172.21.15.176:3300/0 conn(0x7fc63c0cfd80 0x7fc63c163ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 >> v1:172.21.15.176:6789/0 conn(0x7fc63c15c530 legacy=0x7fc63c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c067b60 con 0x7fc63c0b2170 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc6340019f0 con 0x7fc63c0b2170 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 >> v1:172.21.15.52:6789/0 conn(0x7fc63c0b2170 legacy=0x7fc63c166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc620003b90 0x7fc620003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc620004800 0x7fc620004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc62000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c15c910 con 0x7fc620005210 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc62000c140 con 0x7fc620004800 2024-09-10T08:33:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc62000c340 con 0x7fc620003b90 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63b400640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc62000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc63aa00640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc620003b90 0x7fc620003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.349+0000 7fc633e00640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc620004800 0x7fc620004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc63b400640 1 -- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc620003b90 msgr2=0x7fc620003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc63b400640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc620003b90 0x7fc620003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc63b400640 1 -- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc620004800 msgr2=0x7fc620004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc63b400640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc620004800 0x7fc620004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc63b400640 1 -- 172.21.15.52:0/1487580968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc620003520 con 0x7fc620005210 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.350+0000 7fc633e00640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc620004800 0x7fc620004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63b400640 1 -- 172.21.15.52:0/1487580968 reap_dead start 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63b400640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc62000b9c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc63400a730 tx=0x7fc620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451539bd54afb517 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400a350 con 0x7fc620005210 2024-09-10T08:33:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63402f070 con 0x7fc620005210 2024-09-10T08:33:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63a000640 1 -- 172.21.15.52:0/1487580968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63402bb70 con 0x7fc620005210 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.351+0000 7fc63be00640 1 -- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 msgr2=0x7fc62000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc62000b9c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc63400a730 tx=0x7fc620005830 comp rx=0 tx=0).stop 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 -- 172.21.15.52:0/1487580968 shutdown_connections 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 --2- 172.21.15.52:0/1487580968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc62000b9c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 -- 172.21.15.52:0/1487580968 >> 172.21.15.52:0/1487580968 conn(0x7fc63c0b0640 msgr2=0x7fc63c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 -- 172.21.15.52:0/1487580968 shutdown_connections 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.352+0000 7fc63be00640 1 -- 172.21.15.52:0/1487580968 wait complete. 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.353+0000 7fc63be00640 1 Processor -- start 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 -- start start 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc63c1f5c50 0x7fc63c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63c15aa90 0x7fc63c13daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c06c100 con 0x7fc620005210 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c06bf80 con 0x7fc63c15aa90 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.354+0000 7fc63be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c072bc0 con 0x7fc63c1f5c50 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52770/0 (socket says 172.21.15.52:52770) 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 -- 172.21.15.52:0/3852521723 learned_addr learned my addr 172.21.15.52:0/3852521723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc633e00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc63c1f5c50 0x7fc63c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63b400640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63c15aa90 0x7fc63c13daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 -- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc63c1f5c50 msgr2=0x7fc63c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc63c1f5c50 0x7fc63c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 -- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63c15aa90 msgr2=0x7fc63c13daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63c15aa90 0x7fc63c13daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 -- 172.21.15.52:0/3852521723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c15b280 con 0x7fc620005210 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.355+0000 7fc63aa00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00e7b0 tx=0x7fc62c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.356+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0050d0 con 0x7fc620005210 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.356+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62c018070 con 0x7fc620005210 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.356+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c13ece0 con 0x7fc620005210 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.356+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c00c6c0 con 0x7fc620005210 2024-09-10T08:33:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.356+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c15af10 con 0x7fc620005210 2024-09-10T08:33:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.357+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63c067da0 con 0x7fc620005210 2024-09-10T08:33:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.358+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc62c00c860 con 0x7fc620005210 2024-09-10T08:33:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.359+0000 7fc632a00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 0x7fc61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.359+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7fc62c08ae70 con 0x7fc620005210 2024-09-10T08:33:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.359+0000 7fc633e00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 0x7fc61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.360+0000 7fc633e00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 0x7fc61806e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc63c14b3b0 tx=0x7fc624008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.363+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc63c067da0 con 0x7fc620005210 2024-09-10T08:33:39.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.585+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc63c0cf670 con 0x7fc620005210 2024-09-10T08:33:39.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.586+0000 7fc632a00640 1 -- 172.21.15.52:0/3852521723 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5229 (secure 0 0 0) 0x7fc62c059750 con 0x7fc620005210 2024-09-10T08:33:39.587 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:39.587 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":58,"btime":"2024-09-10T08:33:25:237846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:25.237838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6837,"qdb_cluster":[6837]},"id":5}]} 2024-09-10T08:33:39.587 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 58 2024-09-10T08:33:39.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 msgr2=0x7fc61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 0x7fc61806e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc63c14b3b0 tx=0x7fc624008040 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 msgr2=0x7fc63c1f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00e7b0 tx=0x7fc62c00ec70 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 shutdown_connections 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc61806be30 0x7fc61806e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc63c15aa90 0x7fc63c13daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc63c1f5c50 0x7fc63c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 --2- 172.21.15.52:0/3852521723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc620005210 0x7fc63c1f5710 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 >> 172.21.15.52:0/3852521723 conn(0x7fc63c0b0640 msgr2=0x7fc63c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 shutdown_connections 2024-09-10T08:33:39.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.589+0000 7fc63be00640 1 -- 172.21.15.52:0/3852521723 wait complete. 2024-09-10T08:33:39.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:39.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.763+0000 7f7295a00640 1 Processor -- start 2024-09-10T08:33:39.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.763+0000 7f7295a00640 1 -- start start 2024-09-10T08:33:39.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f7295a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72900b6710 0x7f72900d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f7295a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900d3990 con 0x7f729015e440 2024-09-10T08:33:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f7295a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900d3c70 con 0x7f72900cf450 2024-09-10T08:33:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f7295a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f72900d3f50 con 0x7f72900b6710 2024-09-10T08:33:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f728fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f729015e440 0x7f72900b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58068/0 (socket says 172.21.15.52:58068) 2024-09-10T08:33:39.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.764+0000 7f728fe00640 1 -- 172.21.15.52:0/1412211728 learned_addr learned my addr 172.21.15.52:0/1412211728 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f7287400640 1 --2- 172.21.15.52:0/1412211728 >> v2:172.21.15.176:3300/0 conn(0x7f72900b6710 0x7f72900d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067245720 0 0) 0x7f72900d3990 con 0x7f729015e440 2024-09-10T08:33:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7274003520 con 0x7f729015e440 2024-09-10T08:33:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3076906388 0 0) 0x7f7274003520 con 0x7f729015e440 2024-09-10T08:33:39.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 >> v2:172.21.15.176:3300/0 conn(0x7f72900b6710 msgr2=0x7f72900d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 --2- 172.21.15.52:0/1412211728 >> v2:172.21.15.176:3300/0 conn(0x7f72900b6710 0x7f72900d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 >> v1:172.21.15.176:6789/0 conn(0x7f72900cf450 legacy=0x7f72900b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72900d4230 con 0x7f729015e440 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f72800019f0 con 0x7f729015e440 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 >> v1:172.21.15.52:6789/0 conn(0x7f729015e440 legacy=0x7f72900b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 0x7f7274003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7274004800 0x7f7274004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72740051c0 0x7f727400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72900d3f50 con 0x7f72740039b0 2024-09-10T08:33:39.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f727400c070 con 0x7f72740051c0 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f727400c270 con 0x7f7274004800 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.765+0000 7f728fe00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 0x7f7274003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f7295000640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72740051c0 0x7f727400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f7287400640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7274004800 0x7f7274004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f728fe00640 1 -- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7274004800 msgr2=0x7f7274004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f728fe00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7274004800 0x7f7274004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f728fe00640 1 -- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72740051c0 msgr2=0x7f727400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f728fe00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72740051c0 0x7f727400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f728fe00640 1 -- 172.21.15.52:0/1412211728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7274003520 con 0x7f72740039b0 2024-09-10T08:33:39.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.766+0000 7f7295000640 1 -- 172.21.15.52:0/1412211728 reap_dead start 2024-09-10T08:33:39.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.767+0000 7f728fe00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 0x7f7274003dd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f728000a840 tx=0x7f7274005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5fa7b5fc7b5996 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.767+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728000a460 con 0x7f72740039b0 2024-09-10T08:33:39.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.767+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728002f070 con 0x7f72740039b0 2024-09-10T08:33:39.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.767+0000 7f728f400640 1 -- 172.21.15.52:0/1412211728 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728002bcf0 con 0x7f72740039b0 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 -- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 msgr2=0x7f7274003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 0x7f7274003dd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f728000a840 tx=0x7f7274005830 comp rx=0 tx=0).stop 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 -- 172.21.15.52:0/1412211728 shutdown_connections 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 --2- 172.21.15.52:0/1412211728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72740039b0 0x7f7274003dd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 -- 172.21.15.52:0/1412211728 >> 172.21.15.52:0/1412211728 conn(0x7f7290067f80 msgr2=0x7f72900d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 -- 172.21.15.52:0/1412211728 shutdown_connections 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.768+0000 7f7295a00640 1 -- 172.21.15.52:0/1412211728 wait complete. 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.769+0000 7f7295a00640 1 Processor -- start 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.770+0000 7f7295a00640 1 -- start start 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.770+0000 7f7295a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72740039b0 0x7f7290148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.770+0000 7f7295a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.770+0000 7f7295a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 0x7f7290159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7295a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72900b76c0 con 0x7f7290158270 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7295a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72900b7540 con 0x7f72901f3d70 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7295a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72900d3240 con 0x7f72740039b0 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52780/0 (socket says 172.21.15.52:52780) 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 -- 172.21.15.52:0/4171694708 learned_addr learned my addr 172.21.15.52:0/4171694708 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f728fe00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72740039b0 0x7f7290148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7295000640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 0x7f7290159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 -- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72740039b0 msgr2=0x7f7290148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72740039b0 0x7f7290148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 -- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 msgr2=0x7f7290159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 0x7f7290159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7287400640 1 -- 172.21.15.52:0/4171694708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72901493c0 con 0x7f7290158270 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.771+0000 7f7295000640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 0x7f7290159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f7287400640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f72780118c0 tx=0x7f7278011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278019070 con 0x7f7290158270 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7278004240 con 0x7f7290158270 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72901496a0 con 0x7f7290158270 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727800f7c0 con 0x7f7290158270 2024-09-10T08:33:39.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.772+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7290149c60 con 0x7f7290158270 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.773+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900d3570 con 0x7f7290158270 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.774+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f727801c070 con 0x7f7290158270 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.775+0000 7f728cc00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 0x7f726c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.775+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7f727808b2a0 con 0x7f7290158270 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.775+0000 7f728fe00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 0x7f726c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.776+0000 7f728fe00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 0x7f726c06e320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7280033000 tx=0x7f7280007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:39.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.779+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72780593e0 con 0x7f7290158270 2024-09-10T08:33:39.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.966+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72900b3460 con 0x7f7290158270 2024-09-10T08:33:39.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.967+0000 7f728cc00640 1 -- 172.21.15.52:0/4171694708 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17037 (secure 0 0 0) 0x7f727805d6e0 con 0x7f7290158270 2024-09-10T08:33:39.968 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:39.968 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":82,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:28.254353+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:08.635125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:09.836766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.176:6834/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.52:6834/177160853":"2024-09-11T08:33:21.199461+0000","172.21.15.52:6832/177160853":"2024-09-11T08:33:21.199461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 msgr2=0x7f726c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 0x7f726c06e320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7280033000 tx=0x7f7280007000 comp rx=0 tx=0).stop 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 msgr2=0x7f729014a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f72780118c0 tx=0x7f7278011d80 comp rx=0 tx=0).stop 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 shutdown_connections 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f726c06be60 0x7f726c06e320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72901f3d70 0x7f7290159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7290158270 0x7f729014a460 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 --2- 172.21.15.52:0/4171694708 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72740039b0 0x7f7290148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:39.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 >> 172.21.15.52:0/4171694708 conn(0x7f7290067f80 msgr2=0x7f72900d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:39.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 shutdown_connections 2024-09-10T08:33:39.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:39.970+0000 7f7295a00640 1 -- 172.21.15.52:0/4171694708 wait complete. 2024-09-10T08:33:39.987 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:33:39.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.142+0000 7fe773e00640 1 Processor -- start 2024-09-10T08:33:40.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.142+0000 7fe773e00640 1 -- start start 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe77415e870 0x7fe7740ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7740733e0 0x7fe774072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77415f6e0 con 0x7fe7740b2170 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe774071c00 con 0x7fe7740733e0 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe77415f9c0 con 0x7fe77415e870 2024-09-10T08:33:40.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7740733e0 0x7fe774072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7740733e0 0x7fe774072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52788/0 (socket says 172.21.15.52:52788) 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe773400640 1 -- 172.21.15.52:0/3212423121 learned_addr learned my addr 172.21.15.52:0/3212423121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe76a000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe7740b2170 0x7fe774072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58070/0 (socket says 172.21.15.52:58070) 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.143+0000 7fe772a00640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe77415e870 0x7fe7740ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.144+0000 7fe773400640 1 -- 172.21.15.52:0/3212423121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe77415e870 msgr2=0x7fe7740ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.144+0000 7fe773400640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe77415e870 0x7fe7740ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.144+0000 7fe773400640 1 -- 172.21.15.52:0/3212423121 >> v1:172.21.15.52:6789/0 conn(0x7fe7740b2170 legacy=0x7fe774072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.144+0000 7fe773400640 1 -- 172.21.15.52:0/3212423121 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe774071890 con 0x7fe7740733e0 2024-09-10T08:33:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.144+0000 7fe772000640 1 -- 172.21.15.52:0/3212423121 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187484436 0 0) 0x7fe77415f6e0 con 0x7fe7740b2170 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.145+0000 7fe773400640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740733e0 0x7fe774072090 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009e50 tx=0x7fe76c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb70c55be399ee0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.145+0000 7fe772000640 1 -- 172.21.15.52:0/3212423121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c036070 con 0x7fe7740733e0 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.145+0000 7fe772000640 1 -- 172.21.15.52:0/3212423121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76c031600 con 0x7fe7740733e0 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.145+0000 7fe772000640 1 -- 172.21.15.52:0/3212423121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0319d0 con 0x7fe7740733e0 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 -- 172.21.15.52:0/3212423121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740733e0 msgr2=0x7fe774072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740733e0 0x7fe774072090 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009e50 tx=0x7fe76c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 -- 172.21.15.52:0/3212423121 shutdown_connections 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740733e0 0x7fe774072090 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 --2- 172.21.15.52:0/3212423121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe77415e870 0x7fe7740ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 -- 172.21.15.52:0/3212423121 >> 172.21.15.52:0/3212423121 conn(0x7fe7740b0640 msgr2=0x7fe7740b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 -- 172.21.15.52:0/3212423121 shutdown_connections 2024-09-10T08:33:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.146+0000 7fe773e00640 1 -- 172.21.15.52:0/3212423121 wait complete. 2024-09-10T08:33:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.147+0000 7fe773e00640 1 Processor -- start 2024-09-10T08:33:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.147+0000 7fe773e00640 1 -- start start 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7740733e0 0x7fe77414f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7741611a0 0x7fe7741588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7740aedb0 con 0x7fe7740b2170 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe774068030 con 0x7fe7741611a0 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.148+0000 7fe773e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe7740aef30 con 0x7fe7740733e0 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52800/0 (socket says 172.21.15.52:52800) 2024-09-10T08:33:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe772a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7740733e0 0x7fe77414f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 -- 172.21.15.52:0/2224576979 learned_addr learned my addr 172.21.15.52:0/2224576979 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe773400640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7741611a0 0x7fe7741588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 -- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7740733e0 msgr2=0x7fe77414f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7740733e0 0x7fe77414f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 -- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7741611a0 msgr2=0x7fe7741588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7741611a0 0x7fe7741588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 -- 172.21.15.52:0/2224576979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7741f4e00 con 0x7fe7740b2170 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.149+0000 7fe76a000640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c450 tx=0x7fe75c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.150+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c018070 con 0x7fe7740b2170 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.150+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c007480 con 0x7fe7740b2170 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.150+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0047e0 con 0x7fe7740b2170 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.150+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7741f5000 con 0x7fe7740b2170 2024-09-10T08:33:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.150+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774161a20 con 0x7fe7740b2170 2024-09-10T08:33:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.151+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77406cf10 con 0x7fe7740b2170 2024-09-10T08:33:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.152+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe75c01b070 con 0x7fe7740b2170 2024-09-10T08:33:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.153+0000 7fe76b400640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 0x7fe75006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.153+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7fe75c08a140 con 0x7fe7740b2170 2024-09-10T08:33:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.153+0000 7fe772a00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 0x7fe75006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.154+0000 7fe772a00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 0x7fe75006e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe764009b40 tx=0x7fe764009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.157+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe77406cf10 con 0x7fe7740b2170 2024-09-10T08:33:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.376+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe77406f2a0 con 0x7fe7740b2170 2024-09-10T08:33:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.376+0000 7fe76b400640 1 -- 172.21.15.52:0/2224576979 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5229 (secure 0 0 0) 0x7fe7741f4e00 con 0x7fe7740b2170 2024-09-10T08:33:40.377 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:40.377 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":58,"btime":"2024-09-10T08:33:25:237846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:25.237838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6837,"qdb_cluster":[6837]},"id":5}]} 2024-09-10T08:33:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 58 2024-09-10T08:33:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 msgr2=0x7fe75006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 0x7fe75006e2f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe764009b40 tx=0x7fe764009190 comp rx=0 tx=0).stop 2024-09-10T08:33:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 msgr2=0x7fe7741f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c450 tx=0x7fe75c00c910 comp rx=0 tx=0).stop 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 shutdown_connections 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe75006be30 0x7fe75006e2f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7741611a0 0x7fe7741588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7740b2170 0x7fe7741f48c0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 --2- 172.21.15.52:0/2224576979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe7740733e0 0x7fe77414f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 >> 172.21.15.52:0/2224576979 conn(0x7fe7740b0640 msgr2=0x7fe7740ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 shutdown_connections 2024-09-10T08:33:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.379+0000 7fe773e00640 1 -- 172.21.15.52:0/2224576979 wait complete. 2024-09-10T08:33:40.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.551+0000 7f7b84a00640 1 Processor -- start 2024-09-10T08:33:40.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.551+0000 7f7b84a00640 1 -- start start 2024-09-10T08:33:40.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.552+0000 7f7b84a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b800b2d40 0x7f7b8006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b84a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b84a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b80071180 con 0x7f7b8015bcf0 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b84a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7b80071ab0 con 0x7f7b800b2d40 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b84a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b80071460 con 0x7f7b8013eb20 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b800b2d40 0x7f7b8006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b800b2d40 0x7f7b8006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52804/0 (socket says 172.21.15.52:52804) 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 -- 172.21.15.52:0/3894703611 learned_addr learned my addr 172.21.15.52:0/3894703611 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b75400640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 -- 172.21.15.52:0/3894703611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 msgr2=0x7f7b8006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 -- 172.21.15.52:0/3894703611 >> v1:172.21.15.176:6789/0 conn(0x7f7b8015bcf0 legacy=0x7f7b8015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.553+0000 7f7b7de00640 1 -- 172.21.15.52:0/3894703611 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b80071740 con 0x7f7b800b2d40 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.554+0000 7f7b7de00640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8006bc10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7b80071c30 tx=0x7f7b7002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d857b6ad6e6940 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b7d400640 1 -- 172.21.15.52:0/3894703611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70037070 con 0x7f7b800b2d40 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b7d400640 1 -- 172.21.15.52:0/3894703611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70032440 con 0x7f7b800b2d40 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b7d400640 1 -- 172.21.15.52:0/3894703611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70032810 con 0x7f7b800b2d40 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 -- 172.21.15.52:0/3894703611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 msgr2=0x7f7b8006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8006bc10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7b80071c30 tx=0x7f7b7002a250 comp rx=0 tx=0).stop 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 -- 172.21.15.52:0/3894703611 shutdown_connections 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3894703611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8006bc10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 -- 172.21.15.52:0/3894703611 >> 172.21.15.52:0/3894703611 conn(0x7f7b800ccec0 msgr2=0x7f7b800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 -- 172.21.15.52:0/3894703611 shutdown_connections 2024-09-10T08:33:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.555+0000 7f7b84a00640 1 -- 172.21.15.52:0/3894703611 wait complete. 2024-09-10T08:33:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.557+0000 7f7b84a00640 1 Processor -- start 2024-09-10T08:33:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.557+0000 7f7b84a00640 1 -- start start 2024-09-10T08:33:40.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b8015bcf0 0x7f7b8015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800722d0 con 0x7f7b800b2d40 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b80072150 con 0x7f7b8015bcf0 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b84a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b80072450 con 0x7f7b8013eb20 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52810/0 (socket says 172.21.15.52:52810) 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 -- 172.21.15.52:0/3766963780 learned_addr learned my addr 172.21.15.52:0/3766963780 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 -- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 msgr2=0x7f7b8015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 -- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b8015bcf0 msgr2=0x7f7b8015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b8015bcf0 0x7f7b8015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.558+0000 7f7b7de00640 1 -- 172.21.15.52:0/3766963780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b80154cb0 con 0x7f7b800b2d40 2024-09-10T08:33:40.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b7de00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70041020 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b700306c0 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70037040 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b800cb900 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.559+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8015cbf0 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.560+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b8015b620 con 0x7f7b800b2d40 2024-09-10T08:33:40.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.561+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b70044020 con 0x7f7b800b2d40 2024-09-10T08:33:40.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.562+0000 7f7b76a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:40.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.562+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7f7b700ab730 con 0x7f7b800b2d40 2024-09-10T08:33:40.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.562+0000 7f7b75400640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:40.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.563+0000 7f7b75400640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b801f7eb0 tx=0x7f7b68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:40.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.566+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b8015b620 con 0x7f7b800b2d40 2024-09-10T08:33:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.787+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b800728e0 con 0x7f7b800b2d40 2024-09-10T08:33:40.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.788+0000 7f7b76a00640 1 -- 172.21.15.52:0/3766963780 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5229 (secure 0 0 0) 0x7f7b7007ee20 con 0x7f7b800b2d40 2024-09-10T08:33:40.788 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:40.789 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":58,"btime":"2024-09-10T08:33:25:237846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:10.841390+0000","modified":"2024-09-10T08:33:25.237838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6837":{"gid":6837,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/3185894602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":3185894602},{"type":"v1","addr":"172.21.15.52:6835","nonce":3185894602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6837,"qdb_cluster":[6837]},"id":5}]} 2024-09-10T08:33:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 58 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 msgr2=0x7f7b5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b801f7eb0 tx=0x7f7b68008040 comp rx=0 tx=0).stop 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 msgr2=0x7f7b8015f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b700046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 shutdown_connections 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b5c06be30 0x7f7b5c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b8015bcf0 0x7f7b8015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b8013eb20 0x7f7b8015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 --2- 172.21.15.52:0/3766963780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b800b2d40 0x7f7b8015f4a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.790+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 >> 172.21.15.52:0/3766963780 conn(0x7f7b800ccec0 msgr2=0x7f7b80140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.791+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 shutdown_connections 2024-09-10T08:33:40.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.791+0000 7f7b84a00640 1 -- 172.21.15.52:0/3766963780 wait complete. 2024-09-10T08:33:40.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:40.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.964+0000 7f7087200640 1 Processor -- start 2024-09-10T08:33:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.964+0000 7f7087200640 1 -- start start 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7087200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f708013eb20 0x7f708015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7087200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7080071180 con 0x7f70800b2d40 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7087200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7080071460 con 0x7f708006c320 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7087200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7080071ab0 con 0x7f708013eb20 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f707fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f70800b2d40 0x7f708006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58086/0 (socket says 172.21.15.52:58086) 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f707fe00640 1 -- 172.21.15.52:0/1956813054 learned_addr learned my addr 172.21.15.52:0/1956813054 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7085200640 1 --2- 172.21.15.52:0/1956813054 >> v2:172.21.15.52:3300/0 conn(0x7f708013eb20 0x7f708015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f707f400640 1 -- 172.21.15.52:0/1956813054 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384689434 0 0) 0x7f7080071180 con 0x7f70800b2d40 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f707f400640 1 -- 172.21.15.52:0/1956813054 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7064005730 con 0x7f70800b2d40 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7085200640 1 -- 172.21.15.52:0/1956813054 >> v1:172.21.15.176:6789/0 conn(0x7f708006c320 legacy=0x7f708015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7085200640 1 -- 172.21.15.52:0/1956813054 >> v1:172.21.15.52:6789/0 conn(0x7f70800b2d40 legacy=0x7f708006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.966+0000 7f7085200640 1 -- 172.21.15.52:0/1956813054 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7080071740 con 0x7f708013eb20 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7085200640 1 --2- 172.21.15.52:0/1956813054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708013eb20 0x7f708015c400 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7c72b8a8b2407 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f707f400640 1 -- 172.21.15.52:0/1956813054 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078007740 con 0x7f708013eb20 2024-09-10T08:33:41.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f707f400640 1 -- 172.21.15.52:0/1956813054 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70780078e0 con 0x7f708013eb20 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f707f400640 1 -- 172.21.15.52:0/1956813054 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078007cb0 con 0x7f708013eb20 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7087200640 1 -- 172.21.15.52:0/1956813054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708013eb20 msgr2=0x7f708015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7087200640 1 --2- 172.21.15.52:0/1956813054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708013eb20 0x7f708015c400 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707802a6f0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7087200640 1 -- 172.21.15.52:0/1956813054 shutdown_connections 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7087200640 1 --2- 172.21.15.52:0/1956813054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708013eb20 0x7f708015c400 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.968+0000 7f7087200640 1 -- 172.21.15.52:0/1956813054 >> 172.21.15.52:0/1956813054 conn(0x7f70800ccec0 msgr2=0x7f70800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.969+0000 7f7087200640 1 -- 172.21.15.52:0/1956813054 shutdown_connections 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.969+0000 7f7087200640 1 -- 172.21.15.52:0/1956813054 wait complete. 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.970+0000 7f7087200640 1 Processor -- start 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.970+0000 7f7087200640 1 -- start start 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70800b2d40 0x7f7080144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708013eb20 0x7f70801f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70800b3980 con 0x7f708006c320 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70800b3800 con 0x7f70800b2d40 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f7087200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f70800b3b00 con 0x7f708013eb20 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.971+0000 7f707fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52834/0 (socket says 172.21.15.52:52834) 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 -- 172.21.15.52:0/1833692701 learned_addr learned my addr 172.21.15.52:0/1833692701 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f7085200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708013eb20 0x7f70801f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f7077400640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70800b2d40 0x7f7080144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 -- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708013eb20 msgr2=0x7f70801f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708013eb20 0x7f70801f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 -- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70800b2d40 msgr2=0x7f7080144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70800b2d40 0x7f7080144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 -- 172.21.15.52:0/1833692701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801f4f90 con 0x7f708006c320 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.972+0000 7f707fe00640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f707000c500 tx=0x7f707000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.973+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070017070 con 0x7f708006c320 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.973+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7070005ce0 con 0x7f708006c320 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.973+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070007330 con 0x7f708006c320 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.973+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7080143db0 con 0x7f708006c320 2024-09-10T08:33:41.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.973+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708015a9d0 con 0x7f708006c320 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.974+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708006bc10 con 0x7f708006c320 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.975+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f707001a070 con 0x7f708006c320 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.975+0000 7f707cc00640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 0x7f705c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.976+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7f707008a360 con 0x7f708006c320 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.976+0000 7f7077400640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 0x7f705c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.977+0000 7f7077400640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 0x7f705c06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f70800c77b0 tx=0x7f7068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:40.980+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7070058680 con 0x7f708006c320 2024-09-10T08:33:41.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.168+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f708006c9c0 con 0x7f708006c320 2024-09-10T08:33:41.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.169+0000 7f707cc00640 1 -- 172.21.15.52:0/1833692701 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17037 (secure 0 0 0) 0x7f707005c980 con 0x7f708006c320 2024-09-10T08:33:41.170 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:41.170 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":82,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:28.254353+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:08.635125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:09.836766+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.176:6834/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.52:6834/177160853":"2024-09-11T08:33:21.199461+0000","172.21.15.52:6832/177160853":"2024-09-11T08:33:21.199461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 msgr2=0x7f705c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 0x7f705c06e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f70800c77b0 tx=0x7f7068009040 comp rx=0 tx=0).stop 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 msgr2=0x7f70801436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f707000c500 tx=0x7f707000c9c0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 shutdown_connections 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f705c06be30 0x7f705c06e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f708013eb20 0x7f70801f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70800b2d40 0x7f7080144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 --2- 172.21.15.52:0/1833692701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f708006c320 0x7f70801436d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.171+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 >> 172.21.15.52:0/1833692701 conn(0x7f70800ccec0 msgr2=0x7f70800b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.172+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 shutdown_connections 2024-09-10T08:33:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.172+0000 7f7087200640 1 -- 172.21.15.52:0/1833692701 wait complete. 2024-09-10T08:33:41.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:33:41.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.343+0000 7fcf33000640 1 Processor -- start 2024-09-10T08:33:41.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.344+0000 7fcf33000640 1 -- start start 2024-09-10T08:33:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf33000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf2c0cf5c0 0x7fcf2c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf33000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 0x7fcf2c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf33000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2c0b4370 con 0x7fcf2c1600f0 2024-09-10T08:33:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf33000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcf2c0b4650 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf33000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c0b4dc0 con 0x7fcf2c0cf9a0 2024-09-10T08:33:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf31200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 0x7fcf2c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf31c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf2c0cf5c0 0x7fcf2c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.345+0000 7fcf32600640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fcf2c1600f0 0x7fcf2c160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47984/0 (socket says 172.21.15.52:47984) 2024-09-10T08:33:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf32600640 1 -- 172.21.15.52:0/2650796280 learned_addr learned my addr 172.21.15.52:0/2650796280 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf31c00640 1 -- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 msgr2=0x7fcf2c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf31c00640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 0x7fcf2c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf31c00640 1 -- 172.21.15.52:0/2650796280 >> v1:172.21.15.176:6789/0 conn(0x7fcf2c1600f0 legacy=0x7fcf2c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf2be00640 1 -- 172.21.15.52:0/2650796280 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523249144 0 0) 0x7fcf2c0b4370 con 0x7fcf2c1600f0 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf31c00640 1 -- 172.21.15.52:0/2650796280 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c0b50a0 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.346+0000 7fcf31200640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 0x7fcf2c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.347+0000 7fcf31c00640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf5c0 0x7fcf2c0b36f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf200097a0 tx=0x7fcf2002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31edd9832511aca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.347+0000 7fcf2be00640 1 -- 172.21.15.52:0/2650796280 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20037070 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.347+0000 7fcf2be00640 1 -- 172.21.15.52:0/2650796280 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2002adb0 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.347+0000 7fcf2be00640 1 -- 172.21.15.52:0/2650796280 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20032660 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 -- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf5c0 msgr2=0x7fcf2c0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf5c0 0x7fcf2c0b36f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf200097a0 tx=0x7fcf2002a060 comp rx=0 tx=0).stop 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 -- 172.21.15.52:0/2650796280 shutdown_connections 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf9a0 0x7fcf2c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 --2- 172.21.15.52:0/2650796280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf5c0 0x7fcf2c0b36f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 -- 172.21.15.52:0/2650796280 >> 172.21.15.52:0/2650796280 conn(0x7fcf2c06c240 msgr2=0x7fcf2c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 -- 172.21.15.52:0/2650796280 shutdown_connections 2024-09-10T08:33:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.348+0000 7fcf33000640 1 -- 172.21.15.52:0/2650796280 wait complete. 2024-09-10T08:33:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.350+0000 7fcf33000640 1 Processor -- start 2024-09-10T08:33:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.350+0000 7fcf33000640 1 -- start start 2024-09-10T08:33:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf5c0 0x7fcf2c1f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf9a0 0x7fcf2c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c160e10 con 0x7fcf2c1600f0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c160c90 con 0x7fcf2c0cf9a0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf33000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c0b5880 con 0x7fcf2c0cf5c0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52846/0 (socket says 172.21.15.52:52846) 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 -- 172.21.15.52:0/3675600519 learned_addr learned my addr 172.21.15.52:0/3675600519 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf31200640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf9a0 0x7fcf2c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf31c00640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf5c0 0x7fcf2c1f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 -- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf5c0 msgr2=0x7fcf2c1f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf5c0 0x7fcf2c1f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 -- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf9a0 msgr2=0x7fcf2c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf9a0 0x7fcf2c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.351+0000 7fcf32600640 1 -- 172.21.15.52:0/3675600519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c1f3c40 con 0x7fcf2c1600f0 2024-09-10T08:33:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf32600640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c700 tx=0x7fcf2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24018070 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2400ce10 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400a860 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c1582d0 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.352+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c1f3f10 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.353+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c160580 con 0x7fcf2c1600f0 2024-09-10T08:33:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.354+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf2400aa00 con 0x7fcf2c1600f0 2024-09-10T08:33:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.355+0000 7fcf29600640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 0x7fcf0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.355+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5939+0+0 (secure 0 0 0) 0x7fcf2408a540 con 0x7fcf2c1600f0 2024-09-10T08:33:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.355+0000 7fcf31c00640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 0x7fcf0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.356+0000 7fcf31c00640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 0x7fcf0c06e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf20034000 tx=0x7fcf2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.359+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf24058710 con 0x7fcf2c1600f0 2024-09-10T08:33:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.580+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcf2c06df40 con 0x7fcf2c1600f0 2024-09-10T08:33:41.580 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:33:41.580+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:33:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.582+0000 7fcf29600640 1 -- 172.21.15.52:0/3675600519 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7fcf2405ca10 con 0x7fcf2c1600f0 2024-09-10T08:33:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:33:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 msgr2=0x7fcf0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 0x7fcf0c06e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcf20034000 tx=0x7fcf2002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 msgr2=0x7fcf2c0cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400c700 tx=0x7fcf2400cbc0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 shutdown_connections 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf0c06be30 0x7fcf0c06e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf2c1600f0 0x7fcf2c0cbd90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf2c0cf9a0 0x7fcf2c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 --2- 172.21.15.52:0/3675600519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf2c0cf5c0 0x7fcf2c1f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 >> 172.21.15.52:0/3675600519 conn(0x7fcf2c06c240 msgr2=0x7fcf2c0b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 shutdown_connections 2024-09-10T08:33:41.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.585+0000 7fcf33000640 1 -- 172.21.15.52:0/3675600519 wait complete. 2024-09-10T08:33:41.592 INFO:tasks.ceph.mds.a.smithi052.stderr: -2344> 2024-09-10T08:33:27.234+0000 7f4e08a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:33:41.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:33:41.640 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:33:41.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.762+0000 7ff98d400640 1 Processor -- start 2024-09-10T08:33:41.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.762+0000 7ff98d400640 1 -- start start 2024-09-10T08:33:41.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff98d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff98d400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff988071c70 0x7ff988072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff98d400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9880714b0 con 0x7ff9880732e0 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff98d400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff9880cd880 con 0x7ff988071c70 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff98d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9880cdb60 con 0x7ff9880cce30 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff97de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff97de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:53354/0 (socket says 172.21.15.52:53354) 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff97de00640 1 -- 172.21.15.52:0/995722024 learned_addr learned my addr 172.21.15.52:0/995722024 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:41.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.764+0000 7ff987200640 1 --2- 172.21.15.52:0/995722024 >> v2:172.21.15.176:3300/0 conn(0x7ff988071c70 0x7ff988072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.765+0000 7ff97de00640 1 -- 172.21.15.52:0/995722024 >> v2:172.21.15.176:3300/0 conn(0x7ff988071c70 msgr2=0x7ff988072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.765+0000 7ff97de00640 1 --2- 172.21.15.52:0/995722024 >> v2:172.21.15.176:3300/0 conn(0x7ff988071c70 0x7ff988072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.765+0000 7ff97de00640 1 -- 172.21.15.52:0/995722024 >> v1:172.21.15.176:6789/0 conn(0x7ff9880732e0 legacy=0x7ff9880736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.765+0000 7ff97de00640 1 -- 172.21.15.52:0/995722024 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9880cde40 con 0x7ff9880cce30 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.766+0000 7ff97de00640 1 --2- 172.21.15.52:0/995722024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a05a9c3ab825ca15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.766+0000 7ff985e00640 1 -- 172.21.15.52:0/995722024 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970037070 con 0x7ff9880cce30 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.766+0000 7ff985e00640 1 -- 172.21.15.52:0/995722024 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff970032440 con 0x7ff9880cce30 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.766+0000 7ff985e00640 1 -- 172.21.15.52:0/995722024 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970032810 con 0x7ff9880cce30 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 -- 172.21.15.52:0/995722024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 msgr2=0x7ff9880cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 --2- 172.21.15.52:0/995722024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 -- 172.21.15.52:0/995722024 shutdown_connections 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 --2- 172.21.15.52:0/995722024 >> v2:172.21.15.176:3300/0 conn(0x7ff988071c70 0x7ff988072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 --2- 172.21.15.52:0/995722024 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9880cce30 0x7ff9880cd270 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 -- 172.21.15.52:0/995722024 >> 172.21.15.52:0/995722024 conn(0x7ff98806d0f0 msgr2=0x7ff98806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 -- 172.21.15.52:0/995722024 shutdown_connections 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.767+0000 7ff98d400640 1 -- 172.21.15.52:0/995722024 wait complete. 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.768+0000 7ff98d400640 1 Processor -- start 2024-09-10T08:33:41.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.768+0000 7ff98d400640 1 -- start start 2024-09-10T08:33:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff988071c70 0x7ff988156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9880732e0 0x7ff988148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff98815ca50 con 0x7ff9880cce30 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff98815c8d0 con 0x7ff9880732e0 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.769+0000 7ff98d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff98815cbd0 con 0x7ff988071c70 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff986800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff988071c70 0x7ff988156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52874/0 (socket says 172.21.15.52:52874) 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 -- 172.21.15.52:0/2063222219 learned_addr learned my addr 172.21.15.52:0/2063222219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff97de00640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9880732e0 0x7ff988148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 -- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff988071c70 msgr2=0x7ff988156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff988071c70 0x7ff988156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 -- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9880732e0 msgr2=0x7ff988148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9880732e0 0x7ff988148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 -- 172.21.15.52:0/2063222219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff988156f40 con 0x7ff9880cce30 2024-09-10T08:33:41.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.770+0000 7ff987200640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff98000efc0 tx=0x7ff98000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.771+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980018020 con 0x7ff9880cce30 2024-09-10T08:33:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.771+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff980014480 con 0x7ff9880cce30 2024-09-10T08:33:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.771+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980014870 con 0x7ff9880cce30 2024-09-10T08:33:41.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.771+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff988157220 con 0x7ff9880cce30 2024-09-10T08:33:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.771+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9881577e0 con 0x7ff9880cce30 2024-09-10T08:33:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.772+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9880cd270 con 0x7ff9880cce30 2024-09-10T08:33:41.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.773+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff98001b020 con 0x7ff9880cce30 2024-09-10T08:33:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.774+0000 7ff97f400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 0x7ff96406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.774+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6025+0+0 (secure 0 0 0) 0x7ff98008bdd0 con 0x7ff9880cce30 2024-09-10T08:33:41.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.774+0000 7ff986800640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 0x7ff96406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.775+0000 7ff986800640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 0x7ff96406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff978000f60 tx=0x7ff978009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:41.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:41.778+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff980022020 con 0x7ff9880cce30 2024-09-10T08:33:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.002+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff9880711f0 con 0x7ff9880cce30 2024-09-10T08:33:42.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.609+0000 7ff97f400640 1 -- 172.21.15.52:0/2063222219 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) ==== 104+0+0 (secure 0 0 0) 0x7ff980010040 con 0x7ff9880cce30 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 msgr2=0x7ff96406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 0x7ff96406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff978000f60 tx=0x7ff978009040 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 msgr2=0x7ff988157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff98000efc0 tx=0x7ff98000c490 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 shutdown_connections 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff96406be30 0x7ff96406e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9880cce30 0x7ff988157fe0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9880732e0 0x7ff988148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 --2- 172.21.15.52:0/2063222219 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff988071c70 0x7ff988156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.612+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 >> 172.21.15.52:0/2063222219 conn(0x7ff98806d0f0 msgr2=0x7ff988072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.613+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 shutdown_connections 2024-09-10T08:33:42.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.613+0000 7ff98d400640 1 -- 172.21.15.52:0/2063222219 wait complete. 2024-09-10T08:33:42.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:33:42.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.835+0000 7f7403c00640 1 Processor -- start 2024-09-10T08:33:42.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.835+0000 7f7403c00640 1 -- start start 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.836+0000 7f7403c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 0x7f73fc0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7403c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b5ef0 con 0x7f73fc0aef80 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7403c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0b61d0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7403c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc148490 con 0x7f73fc1480b0 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7401c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f73fc0aef80 0x7f73fc160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:58096/0 (socket says 172.21.15.52:58096) 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7401c00640 1 -- 172.21.15.52:0/653106925 learned_addr learned my addr 172.21.15.52:0/653106925 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:42.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f7401200640 1 --2- 172.21.15.52:0/653106925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 0x7f73fc0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468708195 0 0) 0x7f73fc0b5ef0 con 0x7f73fc0aef80 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73e0003520 con 0x7f73fc0aef80 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957470273 0 0) 0x7f73fc0b61d0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.837+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73fc0b5ef0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.838+0000 7f7401200640 1 -- 172.21.15.52:0/653106925 >> v1:172.21.15.176:6789/0 conn(0x7f73fc0b58e0 legacy=0x7f73fc0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.838+0000 7f7401200640 1 -- 172.21.15.52:0/653106925 >> v1:172.21.15.52:6789/0 conn(0x7f73fc0aef80 legacy=0x7f73fc160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.838+0000 7f7401200640 1 -- 172.21.15.52:0/653106925 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0b64b0 con 0x7f73fc1480b0 2024-09-10T08:33:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.839+0000 7f7401200640 1 --2- 172.21.15.52:0/653106925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 0x7f73fc0b53a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0097d0 tx=0x7f73ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d49b758302cf15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.839+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec037070 con 0x7f73fc1480b0 2024-09-10T08:33:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.839+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec032440 con 0x7f73fc1480b0 2024-09-10T08:33:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.839+0000 7f73fbe00640 1 -- 172.21.15.52:0/653106925 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec032810 con 0x7f73fc1480b0 2024-09-10T08:33:42.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 -- 172.21.15.52:0/653106925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 msgr2=0x7f73fc0b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 --2- 172.21.15.52:0/653106925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 0x7f73fc0b53a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0097d0 tx=0x7f73ec02a180 comp rx=0 tx=0).stop 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 -- 172.21.15.52:0/653106925 shutdown_connections 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 --2- 172.21.15.52:0/653106925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc1480b0 0x7f73fc0b53a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 -- 172.21.15.52:0/653106925 >> 172.21.15.52:0/653106925 conn(0x7f73fc06c240 msgr2=0x7f73fc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 -- 172.21.15.52:0/653106925 shutdown_connections 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.840+0000 7f7403c00640 1 -- 172.21.15.52:0/653106925 wait complete. 2024-09-10T08:33:42.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.841+0000 7f7403c00640 1 Processor -- start 2024-09-10T08:33:42.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 -- start start 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc0aef80 0x7f73fc1f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73fc1480b0 0x7f73fc0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b3920 con 0x7f73fc0b58e0 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0b37a0 con 0x7f73fc1480b0 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.842+0000 7f7403c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc160c60 con 0x7f73fc0aef80 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52876/0 (socket says 172.21.15.52:52876) 2024-09-10T08:33:42.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 -- 172.21.15.52:0/2487543213 learned_addr learned my addr 172.21.15.52:0/2487543213 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:42.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f7401200640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc0aef80 0x7f73fc1f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:42.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f7401c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73fc1480b0 0x7f73fc0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 -- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc0aef80 msgr2=0x7f73fc1f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc0aef80 0x7f73fc1f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 -- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73fc1480b0 msgr2=0x7f73fc0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73fc1480b0 0x7f73fc0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.843+0000 7f73f3e00640 1 -- 172.21.15.52:0/2487543213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0c59e0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f73f3e00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c430 tx=0x7f73e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4017070 con 0x7f73fc0b58e0 2024-09-10T08:33:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e40052d0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc0c5cc0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4003810 con 0x7f73fc0b58e0 2024-09-10T08:33:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.844+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc0c6280 con 0x7f73fc0b58e0 2024-09-10T08:33:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.845+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73fc0b53a0 con 0x7f73fc0b58e0 2024-09-10T08:33:42.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.846+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f73e401a070 con 0x7f73fc0b58e0 2024-09-10T08:33:42.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.847+0000 7f73f9600640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 0x7f73d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:42.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.847+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6025+0+0 (secure 0 0 0) 0x7f73e408a390 con 0x7f73fc0b58e0 2024-09-10T08:33:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.848+0000 7f7401200640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 0x7f73d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.848+0000 7f7401200640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 0x7f73d806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f73ec034000 tx=0x7f73ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:42.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:42.852+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73e4058510 con 0x7f73fc0b58e0 2024-09-10T08:33:43.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.035+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73fc072bd0 con 0x7f73fc0b58e0 2024-09-10T08:33:43.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.619+0000 7f73f9600640 1 -- 172.21.15.52:0/2487543213 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f73e405c810 con 0x7f73fc0b58e0 2024-09-10T08:33:43.620 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:33:43.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.623+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 msgr2=0x7f73d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.623+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 0x7f73d806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f73ec034000 tx=0x7f73ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:43.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.623+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 msgr2=0x7f73fc0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.623+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c430 tx=0x7f73e400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 shutdown_connections 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f73d806be30 0x7f73d806e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73fc1480b0 0x7f73fc0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73fc0b58e0 0x7f73fc0cf200 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 --2- 172.21.15.52:0/2487543213 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73fc0aef80 0x7f73fc1f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.624+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 >> 172.21.15.52:0/2487543213 conn(0x7f73fc06c240 msgr2=0x7f73fc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.625+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 shutdown_connections 2024-09-10T08:33:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.625+0000 7f7403c00640 1 -- 172.21.15.52:0/2487543213 wait complete. 2024-09-10T08:33:43.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:33:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.806+0000 7fe35ac00640 1 Processor -- start 2024-09-10T08:33:43.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.806+0000 7fe35ac00640 1 -- start start 2024-09-10T08:33:43.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.807+0000 7fe35ac00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3541480b0 0x7fe3540b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.807+0000 7fe35ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540aef80 0x7fe354160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.807+0000 7fe35ac00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3540b5ef0 con 0x7fe3540b58e0 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.807+0000 7fe35ac00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe354148490 con 0x7fe3541480b0 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.807+0000 7fe35ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540b61d0 con 0x7fe3540aef80 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3541480b0 0x7fe3540b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3541480b0 0x7fe3540b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52892/0 (socket says 172.21.15.52:52892) 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 -- 172.21.15.52:0/509999495 learned_addr learned my addr 172.21.15.52:0/509999495 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe358c00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540aef80 0x7fe354160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 -- 172.21.15.52:0/509999495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540aef80 msgr2=0x7fe354160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540aef80 0x7fe354160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 -- 172.21.15.52:0/509999495 >> v1:172.21.15.176:6789/0 conn(0x7fe3540b58e0 legacy=0x7fe3540ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.808+0000 7fe353e00640 1 -- 172.21.15.52:0/509999495 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540b64b0 con 0x7fe3541480b0 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.809+0000 7fe353e00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3541480b0 0x7fe3540b53a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe344009870 tx=0x7fe34402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75bfef814146b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe353400640 1 -- 172.21.15.52:0/509999495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344037070 con 0x7fe3541480b0 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe353400640 1 -- 172.21.15.52:0/509999495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344032440 con 0x7fe3541480b0 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe353400640 1 -- 172.21.15.52:0/509999495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344032810 con 0x7fe3541480b0 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 -- 172.21.15.52:0/509999495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3541480b0 msgr2=0x7fe3540b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3541480b0 0x7fe3540b53a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fe344009870 tx=0x7fe34402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 -- 172.21.15.52:0/509999495 shutdown_connections 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540aef80 0x7fe354160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 --2- 172.21.15.52:0/509999495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3541480b0 0x7fe3540b53a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 -- 172.21.15.52:0/509999495 >> 172.21.15.52:0/509999495 conn(0x7fe35406c240 msgr2=0x7fe35406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 -- 172.21.15.52:0/509999495 shutdown_connections 2024-09-10T08:33:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.810+0000 7fe35ac00640 1 -- 172.21.15.52:0/509999495 wait complete. 2024-09-10T08:33:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.812+0000 7fe35ac00640 1 Processor -- start 2024-09-10T08:33:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.812+0000 7fe35ac00640 1 -- start start 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540b58e0 0x7fe3541410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 0x7fe354071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540b3920 con 0x7fe3540aef80 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540b37a0 con 0x7fe3541480b0 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe35ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe354160a90 con 0x7fe3540b58e0 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe353e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe353e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52904/0 (socket says 172.21.15.52:52904) 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.813+0000 7fe353e00640 1 -- 172.21.15.52:0/4162534854 learned_addr learned my addr 172.21.15.52:0/4162534854 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe358c00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 0x7fe354071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe34b400640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540b58e0 0x7fe3541410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 -- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540b58e0 msgr2=0x7fe3541410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540b58e0 0x7fe3541410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 -- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 msgr2=0x7fe354071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 0x7fe354071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 -- 172.21.15.52:0/4162534854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35415eaf0 con 0x7fe3540aef80 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe358c00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 0x7fe354071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe353e00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe344000c00 tx=0x7fe3440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344037040 con 0x7fe3540aef80 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344042070 con 0x7fe3540aef80 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe354141a40 con 0x7fe3540aef80 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.814+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344030880 con 0x7fe3540aef80 2024-09-10T08:33:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.815+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe354142000 con 0x7fe3540aef80 2024-09-10T08:33:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.816+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354160550 con 0x7fe3540aef80 2024-09-10T08:33:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.817+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe34402ad10 con 0x7fe3540aef80 2024-09-10T08:33:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.818+0000 7fe350c00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 0x7fe33006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.818+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5558+0+0 (secure 0 0 0) 0x7fe3440ab360 con 0x7fe3540aef80 2024-09-10T08:33:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.819+0000 7fe34b400640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 0x7fe33006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.819+0000 7fe34b400640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 0x7fe33006e320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe35413f4c0 tx=0x7fe33c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:43.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:43.822+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe344079d90 con 0x7fe3540aef80 2024-09-10T08:33:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.006+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe3540b4120 con 0x7fe3540aef80 2024-09-10T08:33:44.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.625+0000 7fe350c00640 1 -- 172.21.15.52:0/4162534854 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7fe3440ab120 con 0x7fe3540aef80 2024-09-10T08:33:44.626 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 msgr2=0x7fe33006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 0x7fe33006e320 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe35413f4c0 tx=0x7fe33c009040 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 msgr2=0x7fe35415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe344000c00 tx=0x7fe3440046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 shutdown_connections 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe33006be60 0x7fe33006e320 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3541480b0 0x7fe354071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3540b58e0 0x7fe3541410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 --2- 172.21.15.52:0/4162534854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3540aef80 0x7fe35415e5b0 secure :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fe344000c00 tx=0x7fe3440046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.629+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 >> 172.21.15.52:0/4162534854 conn(0x7fe35406c240 msgr2=0x7fe3540b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.632+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 shutdown_connections 2024-09-10T08:33:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.632+0000 7fe35ac00640 1 -- 172.21.15.52:0/4162534854 wait complete. 2024-09-10T08:33:44.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:33:44.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.814+0000 7f4ac7e00640 1 Processor -- start 2024-09-10T08:33:44.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.814+0000 7f4ac7e00640 1 -- start start 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ac00ccf30 0x7f4ac00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac7e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ac015b7c0 0x7f4ac00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac7e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00cd850 con 0x7f4ac00cead0 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac7e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac00cf2e0 con 0x7f4ac00ccf30 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac7e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac0070fe0 con 0x7f4ac015b7c0 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ac00ccf30 0x7f4ac00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ac00ccf30 0x7f4ac00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51426/0 (socket says 172.21.15.52:51426) 2024-09-10T08:33:44.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac5400640 1 -- 172.21.15.52:0/1179519986 learned_addr learned my addr 172.21.15.52:0/1179519986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.815+0000 7f4ac5e00640 1 --1- 172.21.15.52:0/1179519986 >> v1:172.21.15.52:6789/0 conn(0x7f4ac00cead0 0x7f4ac015f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55938/0 (socket says 172.21.15.52:55938) 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.816+0000 7f4ac4a00640 1 --2- 172.21.15.52:0/1179519986 >> v2:172.21.15.176:3300/0 conn(0x7f4ac015b7c0 0x7f4ac00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.816+0000 7f4ac5400640 1 -- 172.21.15.52:0/1179519986 >> v2:172.21.15.176:3300/0 conn(0x7f4ac015b7c0 msgr2=0x7f4ac00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.816+0000 7f4ac5400640 1 --2- 172.21.15.52:0/1179519986 >> v2:172.21.15.176:3300/0 conn(0x7f4ac015b7c0 0x7f4ac00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.816+0000 7f4ac5400640 1 -- 172.21.15.52:0/1179519986 >> v1:172.21.15.52:6789/0 conn(0x7f4ac00cead0 legacy=0x7f4ac015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.816+0000 7f4ac5400640 1 -- 172.21.15.52:0/1179519986 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00712c0 con 0x7f4ac00ccf30 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4ac5400640 1 --2- 172.21.15.52:0/1179519986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac00b2c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4ac01601f0 tx=0x7f4ab402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae94f8f632789960 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4abfe00640 1 -- 172.21.15.52:0/1179519986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4037070 con 0x7f4ac00ccf30 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4abfe00640 1 -- 172.21.15.52:0/1179519986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4032440 con 0x7f4ac00ccf30 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4abfe00640 1 -- 172.21.15.52:0/1179519986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4032810 con 0x7f4ac00ccf30 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4ac7e00640 1 -- 172.21.15.52:0/1179519986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 msgr2=0x7f4ac00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.817+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/1179519986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac00b2c50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4ac01601f0 tx=0x7f4ab402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 -- 172.21.15.52:0/1179519986 shutdown_connections 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/1179519986 >> v2:172.21.15.176:3300/0 conn(0x7f4ac015b7c0 0x7f4ac00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/1179519986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac00b2c50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 -- 172.21.15.52:0/1179519986 >> 172.21.15.52:0/1179519986 conn(0x7f4ac006d0f0 msgr2=0x7f4ac006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 -- 172.21.15.52:0/1179519986 shutdown_connections 2024-09-10T08:33:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.818+0000 7f4ac7e00640 1 -- 172.21.15.52:0/1179519986 wait complete. 2024-09-10T08:33:44.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.819+0000 7f4ac7e00640 1 Processor -- start 2024-09-10T08:33:44.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.819+0000 7f4ac7e00640 1 -- start start 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac00cead0 0x7f4ac01461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 0x7f4ac01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00ceee0 con 0x7f4ac00ccf30 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00cf5c0 con 0x7f4ac015b7c0 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.820+0000 7f4ac7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00cf060 con 0x7f4ac00cead0 2024-09-10T08:33:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51438/0 (socket says 172.21.15.52:51438) 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 -- 172.21.15.52:0/3223282462 learned_addr learned my addr 172.21.15.52:0/3223282462 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac4a00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac00cead0 0x7f4ac01461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 0x7f4ac01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 -- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac00cead0 msgr2=0x7f4ac01461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac00cead0 0x7f4ac01461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 -- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 msgr2=0x7f4ac01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 0x7f4ac01566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 -- 172.21.15.52:0/3223282462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac014d580 con 0x7f4ac00ccf30 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 0x7f4ac01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.821+0000 7f4ac5400640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4ab402a220 tx=0x7f4ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:44.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.822+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4041020 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.822+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab40306c0 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.822+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4037040 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.822+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac01f5150 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.822+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac0146d30 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.823+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac00cc960 con 0x7f4ac00ccf30 2024-09-10T08:33:44.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.824+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ab4044020 con 0x7f4ac00ccf30 2024-09-10T08:33:44.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.825+0000 7f4abd600640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:44.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.825+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f4ab40ab350 con 0x7f4ac00ccf30 2024-09-10T08:33:44.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.825+0000 7f4ac4a00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:44.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.826+0000 7f4ac4a00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 0x7f4aa006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ac014fc00 tx=0x7f4aac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:44.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:44.829+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ab404b030 con 0x7f4ac00ccf30 2024-09-10T08:33:45.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.015+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4ac01466f0 con 0x7f4ac00ccf30 2024-09-10T08:33:45.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.018+0000 7f4abd600640 1 -- 172.21.15.52:0/3223282462 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f4ab407ee20 con 0x7f4ac00ccf30 2024-09-10T08:33:45.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 msgr2=0x7f4aa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 0x7f4aa006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4ac014fc00 tx=0x7f4aac008040 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 msgr2=0x7f4ac015cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4ab402a220 tx=0x7f4ab40046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 shutdown_connections 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4aa006be30 0x7f4aa006e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ac015b7c0 0x7f4ac01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ac00cead0 0x7f4ac01461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 --2- 172.21.15.52:0/3223282462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ac00ccf30 0x7f4ac015cd50 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 >> 172.21.15.52:0/3223282462 conn(0x7f4ac006d0f0 msgr2=0x7f4ac0150d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 shutdown_connections 2024-09-10T08:33:45.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.021+0000 7f4ac7e00640 1 -- 172.21.15.52:0/3223282462 wait complete. 2024-09-10T08:33:45.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-10T08:33:45.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.194+0000 7fc907e00640 1 Processor -- start 2024-09-10T08:33:45.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.194+0000 7fc907e00640 1 -- start start 2024-09-10T08:33:45.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc907e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080cf450 0x7fc9080d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc907e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080d3990 con 0x7fc9080b6710 2024-09-10T08:33:45.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc907e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080d3c70 con 0x7fc90815e440 2024-09-10T08:33:45.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc907e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9080d3f50 con 0x7fc9080cf450 2024-09-10T08:33:45.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc906000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc9080b6710 0x7fc9080b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55954/0 (socket says 172.21.15.52:55954) 2024-09-10T08:33:45.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.195+0000 7fc906000640 1 -- 172.21.15.52:0/1102955446 learned_addr learned my addr 172.21.15.52:0/1102955446 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:45.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc907400640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080cf450 0x7fc9080d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033180940 0 0) 0x7fc9080d3990 con 0x7fc9080b6710 2024-09-10T08:33:45.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8ec003520 con 0x7fc9080b6710 2024-09-10T08:33:45.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178426427 0 0) 0x7fc9080d3c70 con 0x7fc90815e440 2024-09-10T08:33:45.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9080d3990 con 0x7fc90815e440 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1560099405 0 0) 0x7fc8ec003520 con 0x7fc9080b6710 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080cf450 msgr2=0x7fc9080d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080cf450 0x7fc9080d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 >> v1:172.21.15.176:6789/0 conn(0x7fc90815e440 legacy=0x7fc9080b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080d4230 con 0x7fc9080b6710 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc8f4001670 con 0x7fc9080b6710 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 >> v1:172.21.15.52:6789/0 conn(0x7fc9080b6710 legacy=0x7fc9080b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8ec003b70 0x7fc8ec003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ec004800 0x7fc8ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec0051c0 0x7fc8ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080d3f50 con 0x7fc8ec003b70 2024-09-10T08:33:45.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec00bf30 con 0x7fc8ec0051c0 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec00c130 con 0x7fc8ec004800 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.196+0000 7fc907400640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080cf450 0x7fc9080d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8ec003b70 0x7fc8ec003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906000640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ec004800 0x7fc8ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc907400640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec0051c0 0x7fc8ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 -- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ec004800 msgr2=0x7fc8ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ec004800 0x7fc8ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 -- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec0051c0 msgr2=0x7fc8ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec0051c0 0x7fc8ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906a00640 1 -- 172.21.15.52:0/1102955446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec003520 con 0x7fc8ec003b70 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.197+0000 7fc906000640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ec004800 0x7fc8ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:45.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.198+0000 7fc906a00640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8ec003b70 0x7fc8ec003f70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80018c0 tx=0x7fc8ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c73799674318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.198+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f80014e0 con 0x7fc8ec003b70 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.198+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f80052f0 con 0x7fc8ec003b70 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.198+0000 7fc905600640 1 -- 172.21.15.52:0/1102955446 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f802ac90 con 0x7fc8ec003b70 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 -- 172.21.15.52:0/1102955446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8ec003b70 msgr2=0x7fc8ec003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 --2- 172.21.15.52:0/1102955446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8ec003b70 0x7fc8ec003f70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80018c0 tx=0x7fc8ec005830 comp rx=0 tx=0).stop 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907400640 1 -- 172.21.15.52:0/1102955446 reap_dead start 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 -- 172.21.15.52:0/1102955446 shutdown_connections 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 -- 172.21.15.52:0/1102955446 >> 172.21.15.52:0/1102955446 conn(0x7fc908067f80 msgr2=0x7fc9080d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:45.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 -- 172.21.15.52:0/1102955446 shutdown_connections 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.199+0000 7fc907e00640 1 -- 172.21.15.52:0/1102955446 wait complete. 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.201+0000 7fc907e00640 1 Processor -- start 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.201+0000 7fc907e00640 1 -- start start 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec003b70 0x7fc9081e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080ce410 0x7fc9081f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080b76c0 con 0x7fc9081569d0 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080b7540 con 0x7fc8ec003b70 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9080d3240 con 0x7fc9080ce410 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51450/0 (socket says 172.21.15.52:51450) 2024-09-10T08:33:45.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc907400640 1 -- 172.21.15.52:0/3501227134 learned_addr learned my addr 172.21.15.52:0/3501227134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc906000640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080ce410 0x7fc9081f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.202+0000 7fc906a00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec003b70 0x7fc9081e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 -- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080ce410 msgr2=0x7fc9081f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080ce410 0x7fc9081f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 -- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec003b70 msgr2=0x7fc9081e3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec003b70 0x7fc9081e3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 -- 172.21.15.52:0/3501227134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080cd6b0 con 0x7fc9081569d0 2024-09-10T08:33:45.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907400640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b3f90 tx=0x7fc900011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900003990 con 0x7fc9081569d0 2024-09-10T08:33:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90001b070 con 0x7fc9081569d0 2024-09-10T08:33:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900003b70 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9081e45c0 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.203+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9080cdc10 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.204+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9080d3570 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.205+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc900005d10 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.206+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 0x7fc8e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.206+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7fc90008b340 con 0x7fc9081569d0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.206+0000 7fc906a00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 0x7fc8e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.207+0000 7fc906a00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 0x7fc8e806e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8032000 tx=0x7fc8f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.210+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9080cd6b0 con 0x7fc9081569d0 2024-09-10T08:33:45.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.463+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fc9080b56f0 con 0x7fc9081569d0 2024-09-10T08:33:45.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.627+0000 7fc8ff400640 1 -- 172.21.15.52:0/3501227134 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v255) ==== 143+0+0 (secure 0 0 0) 0x7fc900059f30 con 0x7fc9081569d0 2024-09-10T08:33:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 msgr2=0x7fc8e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 0x7fc8e806e2f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8032000 tx=0x7fc8f802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 msgr2=0x7fc9081f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b3f90 tx=0x7fc900011890 comp rx=0 tx=0).stop 2024-09-10T08:33:45.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 shutdown_connections 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e806be30 0x7fc8e806e2f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9081569d0 0x7fc9081f4a70 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9080ce410 0x7fc9081f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 --2- 172.21.15.52:0/3501227134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ec003b70 0x7fc9081e3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 >> 172.21.15.52:0/3501227134 conn(0x7fc908067f80 msgr2=0x7fc9080b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 shutdown_connections 2024-09-10T08:33:45.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.630+0000 7fc907e00640 1 -- 172.21.15.52:0/3501227134 wait complete. 2024-09-10T08:33:45.646 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-10T08:33:45.647 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-10T08:33:45.647 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:33:45.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:45.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.803+0000 7f59efe00640 1 Processor -- start 2024-09-10T08:33:45.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.803+0000 7f59efe00640 1 -- start start 2024-09-10T08:33:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59efe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59f015e440 0x7f59f00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59efe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 0x7f59f00b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59efe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f00d3990 con 0x7f59f00cf450 2024-09-10T08:33:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59efe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f59f00d3c70 con 0x7f59f015e440 2024-09-10T08:33:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59efe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00d3f50 con 0x7f59f00b6710 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59eea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59f015e440 0x7f59f00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59eea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59f015e440 0x7f59f00d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51454/0 (socket says 172.21.15.52:51454) 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59eea00640 1 -- 172.21.15.52:0/2848640364 learned_addr learned my addr 172.21.15.52:0/2848640364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.804+0000 7f59e7e00640 1 --1- 172.21.15.52:0/2848640364 >> v1:172.21.15.52:6789/0 conn(0x7f59f00cf450 0x7f59f00b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55966/0 (socket says 172.21.15.52:55966) 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59ef400640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 0x7f59f00b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59eea00640 1 -- 172.21.15.52:0/2848640364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 msgr2=0x7f59f00b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59eea00640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 0x7f59f00b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59eea00640 1 -- 172.21.15.52:0/2848640364 >> v1:172.21.15.52:6789/0 conn(0x7f59f00cf450 legacy=0x7f59f00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59eea00640 1 -- 172.21.15.52:0/2848640364 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00d4230 con 0x7f59f015e440 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59ee000640 1 -- 172.21.15.52:0/2848640364 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2468609679 0 0) 0x7f59f00d3990 con 0x7f59f00cf450 2024-09-10T08:33:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.805+0000 7f59ef400640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 0x7f59f00b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59eea00640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f00d3240 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009870 tx=0x7f59e002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191d930964cdcc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59ee000640 1 -- 172.21.15.52:0/2848640364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0037070 con 0x7f59f015e440 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59ee000640 1 -- 172.21.15.52:0/2848640364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e002ae50 con 0x7f59f015e440 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59ee000640 1 -- 172.21.15.52:0/2848640364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e0032860 con 0x7f59f015e440 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59efe00640 1 -- 172.21.15.52:0/2848640364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 msgr2=0x7f59f00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.806+0000 7f59efe00640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f00d3240 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009870 tx=0x7f59e002a300 comp rx=0 tx=0).stop 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 -- 172.21.15.52:0/2848640364 shutdown_connections 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00b6710 0x7f59f00b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 --2- 172.21.15.52:0/2848640364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f00d3240 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 -- 172.21.15.52:0/2848640364 >> 172.21.15.52:0/2848640364 conn(0x7f59f0067f80 msgr2=0x7f59f00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 -- 172.21.15.52:0/2848640364 shutdown_connections 2024-09-10T08:33:45.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.807+0000 7f59efe00640 1 -- 172.21.15.52:0/2848640364 wait complete. 2024-09-10T08:33:45.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.808+0000 7f59efe00640 1 Processor -- start 2024-09-10T08:33:45.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.808+0000 7f59efe00640 1 -- start start 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59f00b6710 0x7f59f0156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00cf450 0x7f59f0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00b76c0 con 0x7f59f015e440 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59f00b7540 con 0x7f59f00b6710 2024-09-10T08:33:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59efe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59f00b80a0 con 0x7f59f00cf450 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59ef400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.809+0000 7f59ef400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51466/0 (socket says 172.21.15.52:51466) 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 -- 172.21.15.52:0/3702083360 learned_addr learned my addr 172.21.15.52:0/3702083360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59eea00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59f00b6710 0x7f59f0156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59e7e00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00cf450 0x7f59f0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 -- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00cf450 msgr2=0x7f59f0157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00cf450 0x7f59f0157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 -- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59f00b6710 msgr2=0x7f59f0156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59f00b6710 0x7f59f0156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:45.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 -- 172.21.15.52:0/3702083360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f00cc060 con 0x7f59f015e440 2024-09-10T08:33:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59ef400640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f59e800cef0 tx=0x7f59e800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.810+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e801a070 con 0x7f59f015e440 2024-09-10T08:33:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.811+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e800d860 con 0x7f59f015e440 2024-09-10T08:33:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.811+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e800dc50 con 0x7f59f015e440 2024-09-10T08:33:45.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.811+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f00cc340 con 0x7f59f015e440 2024-09-10T08:33:45.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.811+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f00cb9a0 con 0x7f59f015e440 2024-09-10T08:33:45.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.812+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f00b7b60 con 0x7f59f015e440 2024-09-10T08:33:45.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.813+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59e801d070 con 0x7f59f015e440 2024-09-10T08:33:45.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.814+0000 7f59e6a00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 0x7f59cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:45.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.814+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f59e808b3f0 con 0x7f59f015e440 2024-09-10T08:33:45.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.815+0000 7f59eea00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 0x7f59cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:45.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.816+0000 7f59eea00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 0x7f59cc06e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59e0034000 tx=0x7f59e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:45.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:45.819+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59e8059a50 con 0x7f59f015e440 2024-09-10T08:33:46.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.005+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59f00b4360 con 0x7f59f015e440 2024-09-10T08:33:46.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.006+0000 7f59e6a00640 1 -- 172.21.15.52:0/3702083360 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+13305 (secure 0 0 0) 0x7f59e805dd50 con 0x7f59f015e440 2024-09-10T08:33:46.006 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:46.006 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":85,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:44.620843+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3185894602":"2024-09-11T08:33:41.581417+0000","172.21.15.52:6834/3185894602":"2024-09-11T08:33:41.581417+0000","172.21.15.176:6836/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.176:6834/1714870234":"2024-09-11T08:33:21.217528+0000","172.21.15.52:6834/177160853":"2024-09-11T08:33:21.199461+0000","172.21.15.52:6832/177160853":"2024-09-11T08:33:21.199461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 msgr2=0x7f59cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 0x7f59cc06e320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f59e0034000 tx=0x7f59e002e000 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 msgr2=0x7f59f01578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f59e800cef0 tx=0x7f59e800a710 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 shutdown_connections 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59cc06be60 0x7f59cc06e320 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f015e440 0x7f59f01578a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59f00cf450 0x7f59f0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 --2- 172.21.15.52:0/3702083360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59f00b6710 0x7f59f0156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 >> 172.21.15.52:0/3702083360 conn(0x7f59f0067f80 msgr2=0x7f59f00b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 shutdown_connections 2024-09-10T08:33:46.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.008+0000 7f59efe00640 1 -- 172.21.15.52:0/3702083360 wait complete. 2024-09-10T08:33:46.025 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:33:46.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:33:46.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.184+0000 7f93f4400640 1 Processor -- start 2024-09-10T08:33:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.184+0000 7f93f4400640 1 -- start start 2024-09-10T08:33:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f4400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f93ec0cce30 0x7f93ec0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f4400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0714b0 con 0x7f93ec0732e0 2024-09-10T08:33:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f4400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0cd880 con 0x7f93ec071c70 2024-09-10T08:33:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f4400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0cdb60 con 0x7f93ec0cce30 2024-09-10T08:33:46.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f93ec0732e0 0x7f93ec0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55978/0 (socket says 172.21.15.52:55978) 2024-09-10T08:33:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1a00640 1 -- 172.21.15.52:0/522405112 learned_addr learned my addr 172.21.15.52:0/522405112 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:46.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1000640 1 --2- 172.21.15.52:0/522405112 >> v2:172.21.15.52:3300/0 conn(0x7f93ec0cce30 0x7f93ec0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93ebe00640 1 -- 172.21.15.52:0/522405112 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668408085 0 0) 0x7f93ec0714b0 con 0x7f93ec0732e0 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93ebe00640 1 -- 172.21.15.52:0/522405112 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93d4003520 con 0x7f93ec0732e0 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1000640 1 -- 172.21.15.52:0/522405112 >> v1:172.21.15.176:6789/0 conn(0x7f93ec071c70 legacy=0x7f93ec15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1000640 1 -- 172.21.15.52:0/522405112 >> v1:172.21.15.52:6789/0 conn(0x7f93ec0732e0 legacy=0x7f93ec0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.186+0000 7f93f1000640 1 -- 172.21.15.52:0/522405112 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0cde40 con 0x7f93ec0cce30 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.187+0000 7f93f1000640 1 --2- 172.21.15.52:0/522405112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0cce30 0x7f93ec0cd2a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f93d80097a0 tx=0x7f93d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ea37edbc535b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93ebe00640 1 -- 172.21.15.52:0/522405112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8037070 con 0x7f93ec0cce30 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93ebe00640 1 -- 172.21.15.52:0/522405112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d802ae50 con 0x7f93ec0cce30 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93ebe00640 1 -- 172.21.15.52:0/522405112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8032640 con 0x7f93ec0cce30 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 -- 172.21.15.52:0/522405112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0cce30 msgr2=0x7f93ec0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 --2- 172.21.15.52:0/522405112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0cce30 0x7f93ec0cd2a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f93d80097a0 tx=0x7f93d802a140 comp rx=0 tx=0).stop 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 -- 172.21.15.52:0/522405112 shutdown_connections 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 --2- 172.21.15.52:0/522405112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0cce30 0x7f93ec0cd2a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 -- 172.21.15.52:0/522405112 >> 172.21.15.52:0/522405112 conn(0x7f93ec06d0f0 msgr2=0x7f93ec06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 -- 172.21.15.52:0/522405112 shutdown_connections 2024-09-10T08:33:46.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.188+0000 7f93f4400640 1 -- 172.21.15.52:0/522405112 wait complete. 2024-09-10T08:33:46.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.190+0000 7f93f4400640 1 Processor -- start 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.190+0000 7f93f4400640 1 -- start start 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ec071c70 0x7f93ec156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ec0cce30 0x7f93ec156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec15d160 con 0x7f93ec0732e0 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec15cfe0 con 0x7f93ec0cce30 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f4400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec15d2e0 con 0x7f93ec071c70 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51490/0 (socket says 172.21.15.52:51490) 2024-09-10T08:33:46.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 -- 172.21.15.52:0/2461495651 learned_addr learned my addr 172.21.15.52:0/2461495651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 -- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ec071c70 msgr2=0x7f93ec156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ec071c70 0x7f93ec156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 -- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ec0cce30 msgr2=0x7f93ec156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.191+0000 7f93f1000640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ec0cce30 0x7f93ec156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93f1000640 1 -- 172.21.15.52:0/2461495651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec1e9900 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93f1000640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f93d802a180 tx=0x7f93d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8042020 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d803d470 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8037040 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec1e7800 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.192+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec1e7dc0 con 0x7f93ec0732e0 2024-09-10T08:33:46.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.194+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec1e7610 con 0x7f93ec0732e0 2024-09-10T08:33:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.194+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93d8045020 con 0x7f93ec0732e0 2024-09-10T08:33:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.195+0000 7f93e9600640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 0x7f93cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.195+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f93d80ab450 con 0x7f93ec0732e0 2024-09-10T08:33:46.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.196+0000 7f93f1a00640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 0x7f93cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.197+0000 7f93f1a00640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 0x7f93cc06e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000f60 tx=0x7f93e00078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.200+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93d804c030 con 0x7f93ec0732e0 2024-09-10T08:33:46.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.381+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f93ec0cd2a0 con 0x7f93ec0732e0 2024-09-10T08:33:46.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.382+0000 7f93e9600640 1 -- 172.21.15.52:0/2461495651 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f93d8079fc0 con 0x7f93ec0732e0 2024-09-10T08:33:46.382 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:33:46.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 msgr2=0x7f93cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 0x7f93cc06e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000f60 tx=0x7f93e00078f0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 msgr2=0x7f93ec1e8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f93d802a180 tx=0x7f93d80046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 shutdown_connections 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f93cc06be30 0x7f93cc06e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f93ec0cce30 0x7f93ec156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93ec0732e0 0x7f93ec1e8f80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 --2- 172.21.15.52:0/2461495651 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f93ec071c70 0x7f93ec156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 >> 172.21.15.52:0/2461495651 conn(0x7f93ec06d0f0 msgr2=0x7f93ec15bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 shutdown_connections 2024-09-10T08:33:46.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.384+0000 7f93f4400640 1 -- 172.21.15.52:0/2461495651 wait complete. 2024-09-10T08:33:46.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-10T08:33:46.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.557+0000 7f3a97200640 1 Processor -- start 2024-09-10T08:33:46.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.557+0000 7f3a97200640 1 -- start start 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a97200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3a9815e440 0x7f3a980d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a97200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a980d3990 con 0x7f3a980cf450 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a97200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a980d3c70 con 0x7f3a980b6710 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a97200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3a980d3f50 con 0x7f3a9815e440 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a8d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a980cf450 0x7f3a980b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55984/0 (socket says 172.21.15.52:55984) 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.558+0000 7f3a8d400640 1 -- 172.21.15.52:0/2191316050 learned_addr learned my addr 172.21.15.52:0/2191316050 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95e00640 1 --2- 172.21.15.52:0/2191316050 >> v2:172.21.15.176:3300/0 conn(0x7f3a9815e440 0x7f3a980d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519043610 0 0) 0x7f3a980d3990 con 0x7f3a980cf450 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c003520 con 0x7f3a980cf450 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070206380 0 0) 0x7f3a980d3c70 con 0x7f3a980b6710 2024-09-10T08:33:46.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a980d3990 con 0x7f3a980b6710 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1746611327 0 0) 0x7f3a7c003520 con 0x7f3a980cf450 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 >> v2:172.21.15.176:3300/0 conn(0x7f3a9815e440 msgr2=0x7f3a980d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 --2- 172.21.15.52:0/2191316050 >> v2:172.21.15.176:3300/0 conn(0x7f3a9815e440 0x7f3a980d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 >> v1:172.21.15.176:6789/0 conn(0x7f3a980b6710 legacy=0x7f3a980b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a980d4230 con 0x7f3a980cf450 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3a80001670 con 0x7f3a980cf450 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 >> v1:172.21.15.52:6789/0 conn(0x7f3a980cf450 legacy=0x7f3a980b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 0x7f3a7c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c004800 0x7f3a7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c0051c0 0x7f3a7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980d3f50 con 0x7f3a7c003b90 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c00bfe0 con 0x7f3a7c0051c0 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.559+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c00c1e0 con 0x7f3a7c004800 2024-09-10T08:33:46.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 0x7f3a7c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a8d400640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c004800 0x7f3a7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a96800640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c0051c0 0x7f3a7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 -- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c004800 msgr2=0x7f3a7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a7c004800 0x7f3a7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 -- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c0051c0 msgr2=0x7f3a7c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c0051c0 0x7f3a7c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a95e00640 1 -- 172.21.15.52:0/2191316050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c003520 con 0x7f3a7c003b90 2024-09-10T08:33:46.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.560+0000 7f3a96800640 1 -- 172.21.15.52:0/2191316050 reap_dead start 2024-09-10T08:33:46.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.561+0000 7f3a95e00640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 0x7f3a7c003f90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009fc0 tx=0x7f3a7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d04d2825b593d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.561+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88009c10 con 0x7f3a7c003b90 2024-09-10T08:33:46.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.561+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88036070 con 0x7f3a7c003b90 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.561+0000 7f3a95400640 1 -- 172.21.15.52:0/2191316050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88031880 con 0x7f3a7c003b90 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 -- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 msgr2=0x7f3a7c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 0x7f3a7c003f90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009fc0 tx=0x7f3a7c005830 comp rx=0 tx=0).stop 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 -- 172.21.15.52:0/2191316050 shutdown_connections 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 --2- 172.21.15.52:0/2191316050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a7c003b90 0x7f3a7c003f90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 -- 172.21.15.52:0/2191316050 >> 172.21.15.52:0/2191316050 conn(0x7f3a98067f80 msgr2=0x7f3a980d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 -- 172.21.15.52:0/2191316050 shutdown_connections 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.562+0000 7f3a97200640 1 -- 172.21.15.52:0/2191316050 wait complete. 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.564+0000 7f3a97200640 1 Processor -- start 2024-09-10T08:33:46.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.564+0000 7f3a97200640 1 -- start start 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 0x7f3a98157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 0x7f3a980ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980b76c0 con 0x7f3a98158670 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980b7540 con 0x7f3a7c003b90 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a97200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a980d3240 con 0x7f3a980ca0d0 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51510/0 (socket says 172.21.15.52:51510) 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 -- 172.21.15.52:0/3559062692 learned_addr learned my addr 172.21.15.52:0/3559062692 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a96800640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 0x7f3a980ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a95e00640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 0x7f3a98157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 -- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 msgr2=0x7f3a980ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 0x7f3a980ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 -- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 msgr2=0x7f3a98157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 0x7f3a98157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a8d400640 1 -- 172.21.15.52:0/3559062692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a98157b40 con 0x7f3a98158670 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a95e00640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 0x7f3a98157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.565+0000 7f3a96800640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 0x7f3a980ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a8d400640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a80004df0 tx=0x7f3a80007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000f7b0 con 0x7f3a98158670 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80018070 con 0x7f3a98158670 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000fbd0 con 0x7f3a98158670 2024-09-10T08:33:46.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9815eea0 con 0x7f3a98158670 2024-09-10T08:33:46.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.566+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9815f460 con 0x7f3a98158670 2024-09-10T08:33:46.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.567+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a980d35d0 con 0x7f3a98158670 2024-09-10T08:33:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.568+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a8001d460 con 0x7f3a98158670 2024-09-10T08:33:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.569+0000 7f3a8ea00640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.569+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f3a8008ab30 con 0x7f3a98158670 2024-09-10T08:33:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.569+0000 7f3a95e00640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:46.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.570+0000 7f3a95e00640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 0x7f3a7406e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3a88035000 tx=0x7f3a8802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.573+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a80059720 con 0x7f3a98158670 2024-09-10T08:33:46.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:46.824+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f3a980b5710 con 0x7f3a98158670 2024-09-10T08:33:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.635+0000 7f3a8ea00640 1 -- 172.21.15.52:0/3559062692 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v257) ==== 154+0+0 (secure 0 0 0) 0x7f3a80059020 con 0x7f3a98158670 2024-09-10T08:33:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 msgr2=0x7f3a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 0x7f3a7406e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3a88035000 tx=0x7f3a8802f000 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 msgr2=0x7f3a9815b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a80004df0 tx=0x7f3a80007430 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 shutdown_connections 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a980ca0d0 0x7f3a980ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98158670 0x7f3a9815b0f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 --2- 172.21.15.52:0/3559062692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a7c003b90 0x7f3a98157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 >> 172.21.15.52:0/3559062692 conn(0x7f3a98067f80 msgr2=0x7f3a980b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 shutdown_connections 2024-09-10T08:33:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.638+0000 7f3a97200640 1 -- 172.21.15.52:0/3559062692 wait complete. 2024-09-10T08:33:47.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:33:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.820+0000 7f2ce3200640 1 Processor -- start 2024-09-10T08:33:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.820+0000 7f2ce3200640 1 -- start start 2024-09-10T08:33:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce3200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2cdc0ccf30 0x7f2cdc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce3200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc0cf2e0 con 0x7f2cdc0cead0 2024-09-10T08:33:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce3200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cdc070fe0 con 0x7f2cdc15b7c0 2024-09-10T08:33:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce3200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2cdc0712c0 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce1200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2cdc0cead0 0x7f2cdc071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55988/0 (socket says 172.21.15.52:55988) 2024-09-10T08:33:47.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2ce1200640 1 -- 172.21.15.52:0/3762210833 learned_addr learned my addr 172.21.15.52:0/3762210833 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:47.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2cdbe00640 1 --2- 172.21.15.52:0/3762210833 >> v2:172.21.15.176:3300/0 conn(0x7f2cdc0ccf30 0x7f2cdc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:47.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.822+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962699743 0 0) 0x7f2cdc0cf2e0 con 0x7f2cdc0cead0 2024-09-10T08:33:47.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc0003520 con 0x7f2cdc0cead0 2024-09-10T08:33:47.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819149905 0 0) 0x7f2cdc070fe0 con 0x7f2cdc15b7c0 2024-09-10T08:33:47.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cdc0cf2e0 con 0x7f2cdc15b7c0 2024-09-10T08:33:47.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdbe00640 1 -- 172.21.15.52:0/3762210833 >> v1:172.21.15.176:6789/0 conn(0x7f2cdc15b7c0 legacy=0x7f2cdc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdbe00640 1 -- 172.21.15.52:0/3762210833 >> v1:172.21.15.52:6789/0 conn(0x7f2cdc0cead0 legacy=0x7f2cdc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.823+0000 7f2cdbe00640 1 -- 172.21.15.52:0/3762210833 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc0715a0 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.824+0000 7f2cdbe00640 1 --2- 172.21.15.52:0/3762210833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc0b2c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0097a0 tx=0x7f2ccc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c6b330d122330d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.824+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc037070 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.824+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc032440 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.824+0000 7f2cdb400640 1 -- 172.21.15.52:0/3762210833 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc032810 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 -- 172.21.15.52:0/3762210833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 msgr2=0x7f2cdc0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 --2- 172.21.15.52:0/3762210833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc0b2c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc0097a0 tx=0x7f2ccc02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 -- 172.21.15.52:0/3762210833 shutdown_connections 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 --2- 172.21.15.52:0/3762210833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc0b2c50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 -- 172.21.15.52:0/3762210833 >> 172.21.15.52:0/3762210833 conn(0x7f2cdc06d0f0 msgr2=0x7f2cdc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 -- 172.21.15.52:0/3762210833 shutdown_connections 2024-09-10T08:33:47.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.825+0000 7f2ce3200640 1 -- 172.21.15.52:0/3762210833 wait complete. 2024-09-10T08:33:47.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.826+0000 7f2ce3200640 1 Processor -- start 2024-09-10T08:33:47.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.827+0000 7f2ce3200640 1 -- start start 2024-09-10T08:33:47.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.827+0000 7f2ce3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cdc15b7c0 0x7f2cdc0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc0cf080 con 0x7f2cdc0cead0 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2cdc0cef00 con 0x7f2cdc0ccf30 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cdc0721d0 con 0x7f2cdc15b7c0 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51526/0 (socket says 172.21.15.52:51526) 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 -- 172.21.15.52:0/2937313922 learned_addr learned my addr 172.21.15.52:0/2937313922 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cdbe00640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2ce1200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cdc15b7c0 0x7f2cdc0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 -- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cdc15b7c0 msgr2=0x7f2cdc0cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cdc15b7c0 0x7f2cdc0cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 -- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 msgr2=0x7f2cdc15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.828+0000 7f2cd3400640 1 -- 172.21.15.52:0/2937313922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cdc1507e0 con 0x7f2cdc0cead0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2cd3400640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c430 tx=0x7f2cc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4017070 con 0x7f2cdc0cead0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc40052f0 con 0x7f2cdc0cead0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4003830 con 0x7f2cdc0cead0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cdc0c9c60 con 0x7f2cdc0cead0 2024-09-10T08:33:47.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.829+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cdc0ca500 con 0x7f2cdc0cead0 2024-09-10T08:33:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.830+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cdc0b2c50 con 0x7f2cdc0cead0 2024-09-10T08:33:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.831+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cc401a070 con 0x7f2cdc0cead0 2024-09-10T08:33:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.832+0000 7f2cd8c00640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 0x7f2cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:47.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.832+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f2cc4089fe0 con 0x7f2cdc0cead0 2024-09-10T08:33:47.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.833+0000 7f2cdbe00640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 0x7f2cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:47.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.833+0000 7f2cdbe00640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 0x7f2cb806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc034000 tx=0x7f2ccc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:47.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:47.837+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cdc1507e0 con 0x7f2cdc0cead0 2024-09-10T08:33:48.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.021+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2cdc0ce8b0 con 0x7f2cdc0cead0 2024-09-10T08:33:48.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.025+0000 7f2cd8c00640 1 -- 172.21.15.52:0/2937313922 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f2cc4058590 con 0x7f2cdc0cead0 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 msgr2=0x7f2cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 0x7f2cb806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc034000 tx=0x7f2ccc02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 msgr2=0x7f2cdc14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c430 tx=0x7f2cc400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 shutdown_connections 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2cb806be30 0x7f2cb806e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cdc15b7c0 0x7f2cdc0cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cdc0cead0 0x7f2cdc14fbd0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 --2- 172.21.15.52:0/2937313922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cdc0ccf30 0x7f2cdc15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.027+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 >> 172.21.15.52:0/2937313922 conn(0x7f2cdc06d0f0 msgr2=0x7f2cdc15fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.028+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 shutdown_connections 2024-09-10T08:33:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.028+0000 7f2ce3200640 1 -- 172.21.15.52:0/2937313922 wait complete. 2024-09-10T08:33:48.044 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:33:48.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:48.133 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:33:48.225 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:33:48.225 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:48.225 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:48.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:33:48.261 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:48.261 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:48.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:48.298 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:33:48.298 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:48.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:33:48.336 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:33:48.336 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:33:48.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:33:48.374 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:33:48.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.531+0000 7f89d9e00640 1 Processor -- start 2024-09-10T08:33:48.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.531+0000 7f89d9e00640 1 -- start start 2024-09-10T08:33:48.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.532+0000 7f89d9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89d4147e80 0x7f89d4070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d9e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f89d406c320 0x7f89d40714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d9e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d4071b30 con 0x7f89d4148260 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d9e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f89d4074200 con 0x7f89d4147e80 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d9e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f89d40b3e40 con 0x7f89d406c320 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89d4147e80 0x7f89d4070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f89d4147e80 0x7f89d4070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51528/0 (socket says 172.21.15.52:51528) 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 -- 172.21.15.52:0/3817833240 learned_addr learned my addr 172.21.15.52:0/3817833240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89ca000640 1 --1- 172.21.15.52:0/3817833240 >> v1:172.21.15.52:6789/0 conn(0x7f89d4148260 0x7f89d406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56000/0 (socket says 172.21.15.52:56000) 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d3400640 1 --2- 172.21.15.52:0/3817833240 >> v2:172.21.15.176:3300/0 conn(0x7f89d406c320 0x7f89d40714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 -- 172.21.15.52:0/3817833240 >> v2:172.21.15.176:3300/0 conn(0x7f89d406c320 msgr2=0x7f89d40714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 --2- 172.21.15.52:0/3817833240 >> v2:172.21.15.176:3300/0 conn(0x7f89d406c320 0x7f89d40714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 -- 172.21.15.52:0/3817833240 >> v1:172.21.15.52:6789/0 conn(0x7f89d4148260 legacy=0x7f89d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2a00640 1 -- 172.21.15.52:0/3817833240 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40b3510 con 0x7f89d4147e80 2024-09-10T08:33:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.533+0000 7f89d2000640 1 -- 172.21.15.52:0/3817833240 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138132647 0 0) 0x7f89d4071b30 con 0x7f89d4148260 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.534+0000 7f89d2a00640 1 --2- 172.21.15.52:0/3817833240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4147e80 0x7f89d4070f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f89d40b6630 tx=0x7f89c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2794fbbdade3692d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d2000640 1 -- 172.21.15.52:0/3817833240 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4037070 con 0x7f89d4147e80 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d2000640 1 -- 172.21.15.52:0/3817833240 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c4032440 con 0x7f89d4147e80 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d2000640 1 -- 172.21.15.52:0/3817833240 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c4032810 con 0x7f89d4147e80 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 -- 172.21.15.52:0/3817833240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4147e80 msgr2=0x7f89d4070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 --2- 172.21.15.52:0/3817833240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4147e80 0x7f89d4070f70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f89d40b6630 tx=0x7f89c402a270 comp rx=0 tx=0).stop 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 -- 172.21.15.52:0/3817833240 shutdown_connections 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 --2- 172.21.15.52:0/3817833240 >> v2:172.21.15.176:3300/0 conn(0x7f89d406c320 0x7f89d40714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 --2- 172.21.15.52:0/3817833240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4147e80 0x7f89d4070f70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 -- 172.21.15.52:0/3817833240 >> 172.21.15.52:0/3817833240 conn(0x7f89d40ccec0 msgr2=0x7f89d40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 -- 172.21.15.52:0/3817833240 shutdown_connections 2024-09-10T08:33:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.535+0000 7f89d9e00640 1 -- 172.21.15.52:0/3817833240 wait complete. 2024-09-10T08:33:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.537+0000 7f89d9e00640 1 Processor -- start 2024-09-10T08:33:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.537+0000 7f89d9e00640 1 -- start start 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d406c320 0x7f89d4135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89d4147e80 0x7f89d41eb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40b42d0 con 0x7f89d4148260 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40b3ad0 con 0x7f89d406c320 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d9e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40b4450 con 0x7f89d4147e80 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51530/0 (socket says 172.21.15.52:51530) 2024-09-10T08:33:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d3400640 1 -- 172.21.15.52:0/2379133488 learned_addr learned my addr 172.21.15.52:0/2379133488 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89d2a00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d406c320 0x7f89d4135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.538+0000 7f89ca000640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89d4147e80 0x7f89d41eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 -- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89d4147e80 msgr2=0x7f89d41eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89d4147e80 0x7f89d41eb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 -- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d406c320 msgr2=0x7f89d4135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d406c320 0x7f89d4135e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 -- 172.21.15.52:0/2379133488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d41e4bf0 con 0x7f89d4148260 2024-09-10T08:33:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d3400640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e30 tx=0x7f89cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc018020 con 0x7f89d4148260 2024-09-10T08:33:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc014480 con 0x7f89d4148260 2024-09-10T08:33:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d41e4ed0 con 0x7f89d4148260 2024-09-10T08:33:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc014870 con 0x7f89d4148260 2024-09-10T08:33:48.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.539+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d41e5490 con 0x7f89d4148260 2024-09-10T08:33:48.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.540+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d406bc10 con 0x7f89d4148260 2024-09-10T08:33:48.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.541+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89cc005d10 con 0x7f89d4148260 2024-09-10T08:33:48.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.542+0000 7f89cbe00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:48.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.542+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f89cc08ba30 con 0x7f89d4148260 2024-09-10T08:33:48.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.542+0000 7f89d2a00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:48.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.543+0000 7f89d2a00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 0x7f89b006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89c4034000 tx=0x7f89c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:48.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.546+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89cc022030 con 0x7f89d4148260 2024-09-10T08:33:48.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.774+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89d4144cf0 con 0x7f89d4148260 2024-09-10T08:33:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.775+0000 7f89cbe00640 1 -- 172.21.15.52:0/2379133488 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+3905 (secure 0 0 0) 0x7f89cc010040 con 0x7f89d4148260 2024-09-10T08:33:48.775 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:48.775 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":60,"btime":"2024-09-10T08:33:42:608599+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3676718880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3676718880},{"type":"v1","addr":"172.21.15.176:6836","nonce":3676718880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/1530066994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1530066994},{"type":"v1","addr":"172.21.15.176:6837","nonce":1530066994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/969027544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":969027544},{"type":"v1","addr":"172.21.15.52:6833","nonce":969027544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/7924456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":7924456},{"type":"v1","addr":"172.21.15.52:6835","nonce":7924456}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[]} 2024-09-10T08:33:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 60 2024-09-10T08:33:48.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 msgr2=0x7f89b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 0x7f89b006e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89c4034000 tx=0x7f89c402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 msgr2=0x7f89d41e9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e30 tx=0x7f89cc00c490 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 shutdown_connections 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f89b006be30 0x7f89b006e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89d4148260 0x7f89d41e9300 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89d4147e80 0x7f89d41eb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 --2- 172.21.15.52:0/2379133488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d406c320 0x7f89d4135e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 >> 172.21.15.52:0/2379133488 conn(0x7f89d40ccec0 msgr2=0x7f89d40cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 shutdown_connections 2024-09-10T08:33:48.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:48.777+0000 7f89d9e00640 1 -- 172.21.15.52:0/2379133488 wait complete. 2024-09-10T08:33:48.794 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:33:48.795 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:33:48.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:33:48.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:48.795 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:33:48.795 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:33:48.795 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:33:48.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:48.796 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:33:48.796 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:33:48.796 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:33:48.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:48.796 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:33:48.796 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:33:48.796 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:33:48.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:33:48.809 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:33:48.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:33:48.810 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:33:48.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:33:48.812 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:33:48.812 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:33:48.813 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:33:48.813 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:33:48.853 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:33:48.854 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:48.856 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:33:48.856 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:33:48.856 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:48.857 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:48.858 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:33:48.858 DEBUG:teuthology.parallel:result is None 2024-09-10T08:33:48.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:33:48.986 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:33:48.987 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:33:48.987 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:33:48.987 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:33:48.989 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:33:48.988+0000 7f57f4400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-10T08:33:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.022+0000 7f97b1400640 1 Processor -- start 2024-09-10T08:33:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.022+0000 7f97b1400640 1 -- start start 2024-09-10T08:33:49.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97b1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97ac0b6710 0x7f97ac0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97b1400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ac0d3990 con 0x7f97ac15e440 2024-09-10T08:33:49.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97b1400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ac0d3c70 con 0x7f97ac0cf450 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97b1400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f97ac0d3f50 con 0x7f97ac0b6710 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97a3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97ac0b6710 0x7f97ac0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97abe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97ac15e440 0x7f97ac0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56018/0 (socket says 172.21.15.52:56018) 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.023+0000 7f97abe00640 1 -- 172.21.15.52:0/2611244648 learned_addr learned my addr 172.21.15.52:0/2611244648 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320731666 0 0) 0x7f97ac0d3990 con 0x7f97ac15e440 2024-09-10T08:33:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9790003520 con 0x7f97ac15e440 2024-09-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395229698 0 0) 0x7f97ac0d3c70 con 0x7f97ac0cf450 2024-09-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97ac0d3990 con 0x7f97ac0cf450 2024-09-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97a3e00640 1 -- 172.21.15.52:0/2611244648 >> v1:172.21.15.176:6789/0 conn(0x7f97ac0cf450 legacy=0x7f97ac0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97a3e00640 1 -- 172.21.15.52:0/2611244648 >> v1:172.21.15.52:6789/0 conn(0x7f97ac15e440 legacy=0x7f97ac0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.024+0000 7f97a3e00640 1 -- 172.21.15.52:0/2611244648 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac0d4230 con 0x7f97ac0b6710 2024-09-10T08:33:49.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.025+0000 7f97a3e00640 1 --2- 172.21.15.52:0/2611244648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0b6710 0x7f97ac0d3240 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f97940097a0 tx=0x7f979402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721d71628d89eb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.025+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794037070 con 0x7f97ac0b6710 2024-09-10T08:33:49.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.025+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794032440 con 0x7f97ac0b6710 2024-09-10T08:33:49.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97ab400640 1 -- 172.21.15.52:0/2611244648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940327f0 con 0x7f97ac0b6710 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 -- 172.21.15.52:0/2611244648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0b6710 msgr2=0x7f97ac0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 --2- 172.21.15.52:0/2611244648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0b6710 0x7f97ac0d3240 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f97940097a0 tx=0x7f979402a270 comp rx=0 tx=0).stop 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 -- 172.21.15.52:0/2611244648 shutdown_connections 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 --2- 172.21.15.52:0/2611244648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0b6710 0x7f97ac0d3240 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 -- 172.21.15.52:0/2611244648 >> 172.21.15.52:0/2611244648 conn(0x7f97ac067f80 msgr2=0x7f97ac0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 -- 172.21.15.52:0/2611244648 shutdown_connections 2024-09-10T08:33:49.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.026+0000 7f97b1400640 1 -- 172.21.15.52:0/2611244648 wait complete. 2024-09-10T08:33:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.028+0000 7f97b1400640 1 Processor -- start 2024-09-10T08:33:49.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.028+0000 7f97b1400640 1 -- start start 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97ac0b6710 0x7f97ac1475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97ac15e440 0x7f97ac0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac0b76c0 con 0x7f97ac0cf450 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac0b7540 con 0x7f97ac15e440 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac0b8270 con 0x7f97ac0b6710 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51562/0 (socket says 172.21.15.52:51562) 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97a3e00640 1 -- 172.21.15.52:0/2203410361 learned_addr learned my addr 172.21.15.52:0/2203410361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:49.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.029+0000 7f97b0a00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97ac15e440 0x7f97ac0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97abe00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97ac0b6710 0x7f97ac1475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 -- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97ac0b6710 msgr2=0x7f97ac1475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97ac0b6710 0x7f97ac1475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 -- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97ac15e440 msgr2=0x7f97ac0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97ac15e440 0x7f97ac0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 -- 172.21.15.52:0/2203410361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac0cb1e0 con 0x7f97ac0cf450 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a3e00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9794000c00 tx=0x7f97940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794037040 con 0x7f97ac0cf450 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9794042070 con 0x7f97ac0cf450 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794032810 con 0x7f97ac0cf450 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.030+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac1f4d80 con 0x7f97ac0cf450 2024-09-10T08:33:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.031+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac159e70 con 0x7f97ac0cf450 2024-09-10T08:33:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.032+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac0d3220 con 0x7f97ac0cf450 2024-09-10T08:33:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.032+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97940329b0 con 0x7f97ac0cf450 2024-09-10T08:33:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.033+0000 7f97a8c00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.033+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5115+0+0 (secure 0 0 0) 0x7f97940ab290 con 0x7f97ac0cf450 2024-09-10T08:33:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.034+0000 7f97abe00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.034+0000 7f97abe00640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 0x7f978806e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f979c0011e0 tx=0x7f979c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.037+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9794079830 con 0x7f97ac0cf450 2024-09-10T08:33:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.237+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f97ac0d0fc0 con 0x7f97ac0cf450 2024-09-10T08:33:49.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.647+0000 7f97a8c00640 1 -- 172.21.15.52:0/2203410361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) ==== 97+0+0 (secure 0 0 0) 0x7f979407db30 con 0x7f97ac0cf450 2024-09-10T08:33:49.647 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:33:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 msgr2=0x7f978806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 0x7f978806e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f979c0011e0 tx=0x7f979c007d30 comp rx=0 tx=0).stop 2024-09-10T08:33:49.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 msgr2=0x7f97ac0caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f9794000c00 tx=0x7f97940046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 shutdown_connections 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f978806be30 0x7f978806e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97ac15e440 0x7f97ac0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97ac0cf450 0x7f97ac0caca0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 --2- 172.21.15.52:0/2203410361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97ac0b6710 0x7f97ac1475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 >> 172.21.15.52:0/2203410361 conn(0x7f97ac067f80 msgr2=0x7f97ac0b9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 shutdown_connections 2024-09-10T08:33:49.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.650+0000 7f97b1400640 1 -- 172.21.15.52:0/2203410361 wait complete. 2024-09-10T08:33:49.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:33:49.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.827+0000 7f1482400640 1 Processor -- start 2024-09-10T08:33:49.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.827+0000 7f1482400640 1 -- start start 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 0x7f147c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f147c13eb20 0x7f147c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 0x7f147c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f147c071ab0 con 0x7f147c13eb20 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f147c071180 con 0x7f147c15bcf0 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1482400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f147c071460 con 0x7f147c0b2d40 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f147c13eb20 0x7f147c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f147c13eb20 0x7f147c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51568/0 (socket says 172.21.15.52:51568) 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 -- 172.21.15.52:0/2578220537 learned_addr learned my addr 172.21.15.52:0/2578220537 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f147b400640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 0x7f147c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f147be00640 1 --2- 172.21.15.52:0/2578220537 >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 0x7f147c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 -- 172.21.15.52:0/2578220537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 msgr2=0x7f147c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 0x7f147c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 -- 172.21.15.52:0/2578220537 >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 msgr2=0x7f147c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 --2- 172.21.15.52:0/2578220537 >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 0x7f147c15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f1473e00640 1 -- 172.21.15.52:0/2578220537 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c071740 con 0x7f147c13eb20 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f147b400640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 0x7f147c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.829+0000 7f147be00640 1 --2- 172.21.15.52:0/2578220537 >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 0x7f147c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.830+0000 7f1473e00640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c13eb20 0x7f147c06c150 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f147c1595c0 tx=0x7f146402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ec8dc4e2ed2216 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f147aa00640 1 -- 172.21.15.52:0/2578220537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464037070 con 0x7f147c13eb20 2024-09-10T08:33:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f147aa00640 1 -- 172.21.15.52:0/2578220537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1464032440 con 0x7f147c13eb20 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f147aa00640 1 -- 172.21.15.52:0/2578220537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464032810 con 0x7f147c13eb20 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 -- 172.21.15.52:0/2578220537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c13eb20 msgr2=0x7f147c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c13eb20 0x7f147c06c150 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f147c1595c0 tx=0x7f146402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 -- 172.21.15.52:0/2578220537 shutdown_connections 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 --2- 172.21.15.52:0/2578220537 >> v2:172.21.15.176:3300/0 conn(0x7f147c15bcf0 0x7f147c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c13eb20 0x7f147c06c150 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 --2- 172.21.15.52:0/2578220537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b2d40 0x7f147c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 -- 172.21.15.52:0/2578220537 >> 172.21.15.52:0/2578220537 conn(0x7f147c0ccec0 msgr2=0x7f147c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 -- 172.21.15.52:0/2578220537 shutdown_connections 2024-09-10T08:33:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.831+0000 7f1482400640 1 -- 172.21.15.52:0/2578220537 wait complete. 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.833+0000 7f1482400640 1 Processor -- start 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.833+0000 7f1482400640 1 -- start start 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c13eb20 0x7f147c13c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c15bcf0 0x7f147c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f147c15f140 con 0x7f147c0b2d40 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f147c15efc0 con 0x7f147c15bcf0 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f1482400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f147c15f2c0 con 0x7f147c13eb20 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f147b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f147b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51584/0 (socket says 172.21.15.52:51584) 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.834+0000 7f147b400640 1 -- 172.21.15.52:0/4177501787 learned_addr learned my addr 172.21.15.52:0/4177501787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147be00640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c15bcf0 0x7f147c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f1473e00640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c13eb20 0x7f147c13c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 -- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c13eb20 msgr2=0x7f147c13c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c13eb20 0x7f147c13c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 -- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c15bcf0 msgr2=0x7f147c153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c15bcf0 0x7f147c153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 -- 172.21.15.52:0/4177501787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c14e120 con 0x7f147c0b2d40 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f147b400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c7c0 tx=0x7f146c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c015070 con 0x7f147c0b2d40 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c007a30 con 0x7f147c0b2d40 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c007e00 con 0x7f147c0b2d40 2024-09-10T08:33:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.835+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c14e400 con 0x7f147c0b2d40 2024-09-10T08:33:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.836+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c14e9c0 con 0x7f147c0b2d40 2024-09-10T08:33:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.836+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c15c1a0 con 0x7f147c0b2d40 2024-09-10T08:33:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.837+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f146c018070 con 0x7f147c0b2d40 2024-09-10T08:33:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.838+0000 7f1473400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 0x7f145806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.838+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7f146c08ab20 con 0x7f147c0b2d40 2024-09-10T08:33:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.839+0000 7f1473e00640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 0x7f145806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.840+0000 7f1473e00640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 0x7f145806e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1464034000 tx=0x7f146402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:49.843+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f146c059780 con 0x7f147c0b2d40 2024-09-10T08:33:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.096+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f147c15bad0 con 0x7f147c0b2d40 2024-09-10T08:33:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.096+0000 7f1473400640 1 -- 172.21.15.52:0/4177501787 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f146c059080 con 0x7f147c0b2d40 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.097 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.098 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.099 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.100 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.101 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.102 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.103 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.104 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.105 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.106 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:50.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.108 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.109 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:33:50.110 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:33:50.111 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:33:50.111 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.111 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.111 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:33:50.111 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 msgr2=0x7f145806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 0x7f145806e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1464034000 tx=0x7f146402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 msgr2=0x7f147c14f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f146c00c7c0 tx=0x7f146c00cc80 comp rx=0 tx=0).stop 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 shutdown_connections 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145806be30 0x7f145806e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c15bcf0 0x7f147c153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c13eb20 0x7f147c13c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 --2- 172.21.15.52:0/4177501787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0b2d40 0x7f147c14f1c0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 >> 172.21.15.52:0/4177501787 conn(0x7f147c0ccec0 msgr2=0x7f147c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 shutdown_connections 2024-09-10T08:33:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.098+0000 7f1482400640 1 -- 172.21.15.52:0/4177501787 wait complete. 2024-09-10T08:33:50.114 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:33:50.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.271+0000 7f871b800640 1 Processor -- start 2024-09-10T08:33:50.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.271+0000 7f871b800640 1 -- start start 2024-09-10T08:33:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.272+0000 7f871b800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87140b2d40 0x7f871406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.272+0000 7f871b800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f871406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.272+0000 7f871b800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f871415bcf0 0x7f871415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f871b800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8714071ab0 con 0x7f87140b2d40 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f871b800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8714071180 con 0x7f871415bcf0 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f871b800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8714071460 con 0x7f871413eb20 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87140b2d40 0x7f871406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87140b2d40 0x7f871406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51598/0 (socket says 172.21.15.52:51598) 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 -- 172.21.15.52:0/1876119089 learned_addr learned my addr 172.21.15.52:0/1876119089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8719800640 1 --2- 172.21.15.52:0/1876119089 >> v2:172.21.15.176:3300/0 conn(0x7f871415bcf0 0x7f871415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8713e00640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f871406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 -- 172.21.15.52:0/1876119089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 msgr2=0x7f871406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f871406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 -- 172.21.15.52:0/1876119089 >> v2:172.21.15.176:3300/0 conn(0x7f871415bcf0 msgr2=0x7f871415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:50.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 --2- 172.21.15.52:0/1876119089 >> v2:172.21.15.176:3300/0 conn(0x7f871415bcf0 0x7f871415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.273+0000 7f8718e00640 1 -- 172.21.15.52:0/1876119089 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8714071740 con 0x7f87140b2d40 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.274+0000 7f8718e00640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87140b2d40 0x7f871406bc10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f87141595c0 tx=0x7f870802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe4905845f1d101 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f8713400640 1 -- 172.21.15.52:0/1876119089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708032790 con 0x7f87140b2d40 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f8713400640 1 -- 172.21.15.52:0/1876119089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708038070 con 0x7f87140b2d40 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f8713400640 1 -- 172.21.15.52:0/1876119089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708032b50 con 0x7f87140b2d40 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 -- 172.21.15.52:0/1876119089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87140b2d40 msgr2=0x7f871406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87140b2d40 0x7f871406bc10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f87141595c0 tx=0x7f870802c890 comp rx=0 tx=0).stop 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 -- 172.21.15.52:0/1876119089 shutdown_connections 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 --2- 172.21.15.52:0/1876119089 >> v2:172.21.15.176:3300/0 conn(0x7f871415bcf0 0x7f871415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f871406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 --2- 172.21.15.52:0/1876119089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87140b2d40 0x7f871406bc10 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 -- 172.21.15.52:0/1876119089 >> 172.21.15.52:0/1876119089 conn(0x7f87140ccec0 msgr2=0x7f87140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:50.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 -- 172.21.15.52:0/1876119089 shutdown_connections 2024-09-10T08:33:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.275+0000 7f871b800640 1 -- 172.21.15.52:0/1876119089 wait complete. 2024-09-10T08:33:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.277+0000 7f871b800640 1 Processor -- start 2024-09-10T08:33:50.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.277+0000 7f871b800640 1 -- start start 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87140b2d40 0x7f871413dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f8714155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f871415f140 con 0x7f871415bcf0 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f871415efc0 con 0x7f87140b2d40 2024-09-10T08:33:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f871b800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f871415f2c0 con 0x7f871413eb20 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f8719800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f8719800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51604/0 (socket says 172.21.15.52:51604) 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.278+0000 7f8719800640 1 -- 172.21.15.52:0/2386406409 learned_addr learned my addr 172.21.15.52:0/2386406409 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8718e00640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87140b2d40 0x7f871413dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8713e00640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f8714155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 -- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 msgr2=0x7f8714155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f8714155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 -- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87140b2d40 msgr2=0x7f871413dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87140b2d40 0x7f871413dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 -- 172.21.15.52:0/2386406409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87141578b0 con 0x7f871415bcf0 2024-09-10T08:33:50.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8719800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f870c007e60 tx=0x7f870c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c014420 con 0x7f871415bcf0 2024-09-10T08:33:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c019070 con 0x7f871415bcf0 2024-09-10T08:33:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c014820 con 0x7f871415bcf0 2024-09-10T08:33:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.279+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87140b4520 con 0x7f871415bcf0 2024-09-10T08:33:50.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.280+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87140b4ae0 con 0x7f871415bcf0 2024-09-10T08:33:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.281+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871415c1a0 con 0x7f871415bcf0 2024-09-10T08:33:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.282+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f870c0149c0 con 0x7f871415bcf0 2024-09-10T08:33:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.282+0000 7f8710c00640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 0x7f86f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.283+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7f870c08b2c0 con 0x7f871415bcf0 2024-09-10T08:33:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.283+0000 7f8718e00640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 0x7f86f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.284+0000 7f8718e00640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 0x7f86f406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8708037000 tx=0x7f8708032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.287+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f870c0598d0 con 0x7f871415bcf0 2024-09-10T08:33:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.475+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f871406c9c0 con 0x7f871415bcf0 2024-09-10T08:33:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.475+0000 7f8710c00640 1 -- 172.21.15.52:0/2386406409 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) ==== 84+0+65 (secure 0 0 0) 0x7f870c08b0c0 con 0x7f871415bcf0 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:33:50.476 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 msgr2=0x7f86f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 0x7f86f406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8708037000 tx=0x7f8708032000 comp rx=0 tx=0).stop 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 msgr2=0x7f87140b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f870c007e60 tx=0x7f870c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 shutdown_connections 2024-09-10T08:33:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f86f406be30 0x7f86f406e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f871415bcf0 0x7f87140b56d0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f871413eb20 0x7f8714155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 --2- 172.21.15.52:0/2386406409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87140b2d40 0x7f871413dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.477+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 >> 172.21.15.52:0/2386406409 conn(0x7f87140ccec0 msgr2=0x7f87140cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.478+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 shutdown_connections 2024-09-10T08:33:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.478+0000 7f871b800640 1 -- 172.21.15.52:0/2386406409 wait complete. 2024-09-10T08:33:50.494 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:33:50.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:33:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.657+0000 7fa817000640 1 Processor -- start 2024-09-10T08:33:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.657+0000 7fa817000640 1 -- start start 2024-09-10T08:33:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa817000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 0x7fa8100d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa817000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 0x7fa8100d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa817000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8100cf060 con 0x7fa8100d1510 2024-09-10T08:33:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa817000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa8100d1980 con 0x7fa8100d40b0 2024-09-10T08:33:50.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa817000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8100d34c0 con 0x7fa81015ea90 2024-09-10T08:33:50.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa815000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa8100d1510 0x7fa8100b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56034/0 (socket says 172.21.15.52:56034) 2024-09-10T08:33:50.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.658+0000 7fa815000640 1 -- 172.21.15.52:0/583091398 learned_addr learned my addr 172.21.15.52:0/583091398 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:50.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80f400640 1 --2- 172.21.15.52:0/583091398 >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 0x7fa8100d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80fe00640 1 --2- 172.21.15.52:0/583091398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 0x7fa8100d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714226931 0 0) 0x7fa8100cf060 con 0x7fa8100d1510 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f4003520 con 0x7fa8100d1510 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135152622 0 0) 0x7fa7f4003520 con 0x7fa8100d1510 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80fe00640 1 -- 172.21.15.52:0/583091398 >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 msgr2=0x7fa8100d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80fe00640 1 --2- 172.21.15.52:0/583091398 >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 0x7fa8100d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80fe00640 1 -- 172.21.15.52:0/583091398 >> v1:172.21.15.52:6789/0 conn(0x7fa8100d1510 legacy=0x7fa8100b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80fe00640 1 -- 172.21.15.52:0/583091398 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8100cf340 con 0x7fa81015ea90 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.659+0000 7fa80f400640 1 --2- 172.21.15.52:0/583091398 >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 0x7fa8100d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.660+0000 7fa80fe00640 1 --2- 172.21.15.52:0/583091398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 0x7fa8100d2f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097a0 tx=0x7fa80002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91650274b776b3db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.661+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800037070 con 0x7fa81015ea90 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.661+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80002aba0 con 0x7fa81015ea90 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.661+0000 7fa80ea00640 1 -- 172.21.15.52:0/583091398 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8080019f0 con 0x7fa81015ea90 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.661+0000 7fa817000640 1 -- 172.21.15.52:0/583091398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 msgr2=0x7fa8100d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.661+0000 7fa817000640 1 --2- 172.21.15.52:0/583091398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 0x7fa8100d2f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8000097a0 tx=0x7fa80002a110 comp rx=0 tx=0).stop 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 -- 172.21.15.52:0/583091398 shutdown_connections 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 --2- 172.21.15.52:0/583091398 >> v2:172.21.15.176:3300/0 conn(0x7fa8100d40b0 0x7fa8100d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 --2- 172.21.15.52:0/583091398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa81015ea90 0x7fa8100d2f80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 -- 172.21.15.52:0/583091398 >> 172.21.15.52:0/583091398 conn(0x7fa81006c0e0 msgr2=0x7fa81006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 -- 172.21.15.52:0/583091398 shutdown_connections 2024-09-10T08:33:50.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.662+0000 7fa817000640 1 -- 172.21.15.52:0/583091398 wait complete. 2024-09-10T08:33:50.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.663+0000 7fa817000640 1 Processor -- start 2024-09-10T08:33:50.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.663+0000 7fa817000640 1 -- start start 2024-09-10T08:33:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8100d40b0 0x7fa8100b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 0x7fa8100cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8100cfbe0 con 0x7fa8100d1510 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8100cf900 con 0x7fa81015ea90 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.664+0000 7fa817000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa81015ee70 con 0x7fa8100d40b0 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51618/0 (socket says 172.21.15.52:51618) 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 -- 172.21.15.52:0/164213455 learned_addr learned my addr 172.21.15.52:0/164213455 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80f400640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8100d40b0 0x7fa8100b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa815000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 0x7fa8100cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 -- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8100d40b0 msgr2=0x7fa8100b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8100d40b0 0x7fa8100b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 -- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 msgr2=0x7fa8100cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 0x7fa8100cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 -- 172.21.15.52:0/164213455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8100b4bd0 con 0x7fa8100d1510 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa815000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 0x7fa8100cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.665+0000 7fa80fe00640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa800035040 tx=0x7fa8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.666+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800037050 con 0x7fa8100d1510 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.666+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800043070 con 0x7fa8100d1510 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.666+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80003ca70 con 0x7fa8100d1510 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.666+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8100b4e50 con 0x7fa8100d1510 2024-09-10T08:33:50.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.666+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8100b5410 con 0x7fa8100d1510 2024-09-10T08:33:50.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.667+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8100b5ad0 con 0x7fa8100d1510 2024-09-10T08:33:50.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.668+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa80003cc10 con 0x7fa8100d1510 2024-09-10T08:33:50.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.668+0000 7fa807e00640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 0x7fa7f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:50.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.669+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7fa8000ab650 con 0x7fa8100d1510 2024-09-10T08:33:50.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.669+0000 7fa80f400640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 0x7fa7f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:50.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.670+0000 7fa80f400640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 0x7fa7f006e320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009560 tx=0x7fa7fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:50.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.673+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8100b5ad0 con 0x7fa8100d1510 2024-09-10T08:33:50.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:50.856+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa8100d0fd0 con 0x7fa8100d1510 2024-09-10T08:33:51.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.655+0000 7fa807e00640 1 -- 172.21.15.52:0/164213455 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) ==== 138+0+0 (secure 0 0 0) 0x7fa8100b4bd0 con 0x7fa8100d1510 2024-09-10T08:33:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 msgr2=0x7fa7f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 0x7fa7f006e320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009560 tx=0x7fa7fc008040 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 msgr2=0x7fa81014fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa800035040 tx=0x7fa8000046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 shutdown_connections 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7f006be60 0x7fa7f006e320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa81015ea90 0x7fa8100cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8100d40b0 0x7fa8100b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 --2- 172.21.15.52:0/164213455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8100d1510 0x7fa81014fef0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.658+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 >> 172.21.15.52:0/164213455 conn(0x7fa81006c0e0 msgr2=0x7fa8100d36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.659+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 shutdown_connections 2024-09-10T08:33:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.659+0000 7fa817000640 1 -- 172.21.15.52:0/164213455 wait complete. 2024-09-10T08:33:51.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:33:51.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.851+0000 7f288f200640 1 Processor -- start 2024-09-10T08:33:51.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.851+0000 7f288f200640 1 -- start start 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28900d32c0 0x7f28900cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 0x7f28900b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28900d36e0 con 0x7f28900b5fd0 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f28900d3950 con 0x7f28900d32c0 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28900d3c30 con 0x7f28900b7c10 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.852+0000 7f288d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28900d32c0 0x7f28900cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28900d32c0 0x7f28900cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51626/0 (socket says 172.21.15.52:51626) 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 -- 172.21.15.52:0/2445988169 learned_addr learned my addr 172.21.15.52:0/2445988169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:51.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288de00640 1 --1- 172.21.15.52:0/2445988169 >> v1:172.21.15.52:6789/0 conn(0x7f28900b5fd0 0x7f28900b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56040/0 (socket says 172.21.15.52:56040) 2024-09-10T08:33:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288e800640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 0x7f28900b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 -- 172.21.15.52:0/2445988169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 msgr2=0x7f28900b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 0x7f28900b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 -- 172.21.15.52:0/2445988169 >> v1:172.21.15.52:6789/0 conn(0x7f28900b5fd0 legacy=0x7f28900b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288d400640 1 -- 172.21.15.52:0/2445988169 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28900d3f10 con 0x7f28900d32c0 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.853+0000 7f288e800640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 0x7f28900b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.854+0000 7f288d400640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cf650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c02a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8731c14b8ddc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.854+0000 7f288ca00640 1 -- 172.21.15.52:0/2445988169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287c037070 con 0x7f28900d32c0 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.854+0000 7f288ca00640 1 -- 172.21.15.52:0/2445988169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f287c032640 con 0x7f28900d32c0 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.854+0000 7f288ca00640 1 -- 172.21.15.52:0/2445988169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287c032a10 con 0x7f28900d32c0 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 -- 172.21.15.52:0/2445988169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 msgr2=0x7f28900cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cf650 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f287c009870 tx=0x7f287c02a2f0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 -- 172.21.15.52:0/2445988169 shutdown_connections 2024-09-10T08:33:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b7c10 0x7f28900b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 --2- 172.21.15.52:0/2445988169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cf650 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 -- 172.21.15.52:0/2445988169 >> 172.21.15.52:0/2445988169 conn(0x7f28900d0fd0 msgr2=0x7f28900d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:51.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 -- 172.21.15.52:0/2445988169 shutdown_connections 2024-09-10T08:33:51.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.855+0000 7f288f200640 1 -- 172.21.15.52:0/2445988169 wait complete. 2024-09-10T08:33:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 Processor -- start 2024-09-10T08:33:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 -- start start 2024-09-10T08:33:51.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b5fd0 0x7f289015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 0x7f28900cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.857+0000 7f288f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f28900cfb90 con 0x7f28900d32c0 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f28900b7680 con 0x7f28900b7c10 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f28900cfd10 con 0x7f28900b5fd0 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51634/0 (socket says 172.21.15.52:51634) 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 -- 172.21.15.52:0/2552079343 learned_addr learned my addr 172.21.15.52:0/2552079343 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:51.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288de00640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b5fd0 0x7f289015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288d400640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 0x7f28900cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 -- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b5fd0 msgr2=0x7f289015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b5fd0 0x7f289015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 -- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 msgr2=0x7f28900cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 0x7f28900cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288e800640 1 -- 172.21.15.52:0/2552079343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28900cd830 con 0x7f28900d32c0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.858+0000 7f288d400640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 0x7f28900cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f288e800640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f288800cef0 tx=0x7f288800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288801a070 con 0x7f28900d32c0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288800d860 con 0x7f28900d32c0 2024-09-10T08:33:51.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800dc50 con 0x7f28900d32c0 2024-09-10T08:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289015a780 con 0x7f28900d32c0 2024-09-10T08:33:51.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.859+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289015ad40 con 0x7f28900d32c0 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.860+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289015e8d0 con 0x7f28900d32c0 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.861+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f288801d070 con 0x7f28900d32c0 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.862+0000 7f2886000640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 0x7f287006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.862+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5227+0+0 (secure 0 0 0) 0x7f288808b480 con 0x7f28900d32c0 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.862+0000 7f288de00640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 0x7f287006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:51.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.863+0000 7f288de00640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 0x7f287006e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28900b9f50 tx=0x7f2880007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:51.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:51.867+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2888059a70 con 0x7f28900d32c0 2024-09-10T08:33:52.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.051+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f28900b4a20 con 0x7f28900d32c0 2024-09-10T08:33:52.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.658+0000 7f2886000640 1 -- 172.21.15.52:0/2552079343 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) ==== 170+0+0 (secure 0 0 0) 0x7f288805dd70 con 0x7f28900d32c0 2024-09-10T08:33:52.659 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:33:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 msgr2=0x7f287006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 0x7f287006e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28900b9f50 tx=0x7f2880007e80 comp rx=0 tx=0).stop 2024-09-10T08:33:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 msgr2=0x7f28900cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f288800cef0 tx=0x7f288800a710 comp rx=0 tx=0).stop 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 shutdown_connections 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f287006be30 0x7f287006e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28900d32c0 0x7f28900cd2f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28900b7c10 0x7f28900cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 --2- 172.21.15.52:0/2552079343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28900b5fd0 0x7f289015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 >> 172.21.15.52:0/2552079343 conn(0x7f28900d0fd0 msgr2=0x7f28900b63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 shutdown_connections 2024-09-10T08:33:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.662+0000 7f288f200640 1 -- 172.21.15.52:0/2552079343 wait complete. 2024-09-10T08:33:52.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:33:52.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.857+0000 7f600f200640 1 Processor -- start 2024-09-10T08:33:52.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.859+0000 7f600f200640 1 -- start start 2024-09-10T08:33:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 0x7f6008070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6008144a50 0x7f6008071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600815f120 con 0x7f60080cfcb0 2024-09-10T08:33:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6008141cd0 con 0x7f6008144a50 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f600815f400 con 0x7f60080cf8d0 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6008144a50 0x7f6008071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6008144a50 0x7f6008071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51648/0 (socket says 172.21.15.52:51648) 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 -- 172.21.15.52:0/3025469812 learned_addr learned my addr 172.21.15.52:0/3025469812 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f6007e00640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 0x7f6008070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 -- 172.21.15.52:0/3025469812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 msgr2=0x7f6008070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 0x7f6008070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 -- 172.21.15.52:0/3025469812 >> v1:172.21.15.176:6789/0 conn(0x7f60080cfcb0 legacy=0x7f6008144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f600d200640 1 -- 172.21.15.52:0/3025469812 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600815f6e0 con 0x7f6008144a50 2024-09-10T08:33:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.860+0000 7f6007e00640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 0x7f6008070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600d200640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008144a50 0x7f6008071480 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6000009e50 tx=0x7f600002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936fec3ae43edcd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f6007400640 1 -- 172.21.15.52:0/3025469812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000036070 con 0x7f6008144a50 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f6007400640 1 -- 172.21.15.52:0/3025469812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000031600 con 0x7f6008144a50 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f6007400640 1 -- 172.21.15.52:0/3025469812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60000319d0 con 0x7f6008144a50 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 -- 172.21.15.52:0/3025469812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008144a50 msgr2=0x7f6008071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008144a50 0x7f6008071480 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6000009e50 tx=0x7f600002a710 comp rx=0 tx=0).stop 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 -- 172.21.15.52:0/3025469812 shutdown_connections 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6008144a50 0x7f6008071480 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 --2- 172.21.15.52:0/3025469812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f60080cf8d0 0x7f6008070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.861+0000 7f600f200640 1 -- 172.21.15.52:0/3025469812 >> 172.21.15.52:0/3025469812 conn(0x7f600806d0f0 msgr2=0x7f600806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.862+0000 7f600f200640 1 -- 172.21.15.52:0/3025469812 shutdown_connections 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.862+0000 7f600f200640 1 -- 172.21.15.52:0/3025469812 wait complete. 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.863+0000 7f600f200640 1 Processor -- start 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.863+0000 7f600f200640 1 -- start start 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60080cfcb0 0x7f60080ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6008144a50 0x7f60080ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f60080ce0f0 con 0x7f60080cf8d0 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f600815ee30 con 0x7f60080cfcb0 2024-09-10T08:33:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f600f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f60080ce270 con 0x7f6008144a50 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f6007e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f6007e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51658/0 (socket says 172.21.15.52:51658) 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f6007e00640 1 -- 172.21.15.52:0/3254358714 learned_addr learned my addr 172.21.15.52:0/3254358714 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.864+0000 7f5fff400640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60080cfcb0 0x7f60080ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f600d200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6008144a50 0x7f60080ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 -- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6008144a50 msgr2=0x7f60080ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6008144a50 0x7f60080ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 -- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60080cfcb0 msgr2=0x7f60080ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60080cfcb0 0x7f60080ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 -- 172.21.15.52:0/3254358714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081414a0 con 0x7f60080cf8d0 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6007e00640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800d7d0 tx=0x7f5ff800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:52.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8004030 con 0x7f60080cf8d0 2024-09-10T08:33:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff80041d0 con 0x7f60080cf8d0 2024-09-10T08:33:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.865+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60081406e0 con 0x7f60080cf8d0 2024-09-10T08:33:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.866+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80096a0 con 0x7f60080cf8d0 2024-09-10T08:33:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.866+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6008140ca0 con 0x7f60080cf8d0 2024-09-10T08:33:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.867+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6008144340 con 0x7f60080cf8d0 2024-09-10T08:33:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.869+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ff8009840 con 0x7f60080cf8d0 2024-09-10T08:33:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.869+0000 7f6004c00640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 0x7f5fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.869+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5609+0+0 (secure 0 0 0) 0x7f5ff808b050 con 0x7f60080cf8d0 2024-09-10T08:33:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.869+0000 7f5fff400640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 0x7f5fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.870+0000 7f5fff400640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 0x7f5fe406e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f60081f7fd0 tx=0x7f5ff0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:52.874+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ff8059370 con 0x7f60080cf8d0 2024-09-10T08:33:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.096+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f600806f260 con 0x7f60080cf8d0 2024-09-10T08:33:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.683+0000 7f6004c00640 1 -- 172.21.15.52:0/3254358714 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v63) ==== 174+0+0 (secure 0 0 0) 0x7f5ff805d670 con 0x7f60080cf8d0 2024-09-10T08:33:53.684 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 12 and data pool 13 2024-09-10T08:33:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.690+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 msgr2=0x7f5fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.690+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 0x7f5fe406e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f60081f7fd0 tx=0x7f5ff0009040 comp rx=0 tx=0).stop 2024-09-10T08:33:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 msgr2=0x7f60081581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800d7d0 tx=0x7f5ff800dc90 comp rx=0 tx=0).stop 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 shutdown_connections 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5fe406be30 0x7f5fe406e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6008144a50 0x7f60080ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60080cfcb0 0x7f60080ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 --2- 172.21.15.52:0/3254358714 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f60080cf8d0 0x7f60081581d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.691+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 >> 172.21.15.52:0/3254358714 conn(0x7f600806d0f0 msgr2=0x7f60080d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.692+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 shutdown_connections 2024-09-10T08:33:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.692+0000 7f600f200640 1 -- 172.21.15.52:0/3254358714 wait complete. 2024-09-10T08:33:53.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.881+0000 7f6b77c00640 1 Processor -- start 2024-09-10T08:33:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.881+0000 7f6b77c00640 1 -- start start 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b77c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b700716b0 0x7f6b70073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b77c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b700ce2f0 0x7f6b700ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b77c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b700d1770 con 0x7f6b7015c6b0 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b77c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6b700cdec0 con 0x7f6b700716b0 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b77c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6b700d1a50 con 0x7f6b700ce2f0 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b75200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6b7015c6b0 0x7f6b70070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56052/0 (socket says 172.21.15.52:56052) 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6b700716b0 0x7f6b70073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b75200640 1 -- 172.21.15.52:0/1881023067 learned_addr learned my addr 172.21.15.52:0/1881023067 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b75c00640 1 --2- 172.21.15.52:0/1881023067 >> v2:172.21.15.176:3300/0 conn(0x7f6b700ce2f0 0x7f6b700ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1881023067 >> v2:172.21.15.176:3300/0 conn(0x7f6b700ce2f0 msgr2=0x7f6b700ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6f400640 1 -- 172.21.15.52:0/1881023067 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174611462 0 0) 0x7f6b700d1770 con 0x7f6b7015c6b0 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6fe00640 1 --2- 172.21.15.52:0/1881023067 >> v2:172.21.15.176:3300/0 conn(0x7f6b700ce2f0 0x7f6b700ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1881023067 >> v1:172.21.15.52:6789/0 conn(0x7f6b7015c6b0 legacy=0x7f6b70070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.882+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1881023067 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700d1d30 con 0x7f6b700716b0 2024-09-10T08:33:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.883+0000 7f6b6fe00640 1 --2- 172.21.15.52:0/1881023067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700716b0 0x7f6b70073b70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6b700ccb70 tx=0x7f6b5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add495bd881600c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.883+0000 7f6b6f400640 1 -- 172.21.15.52:0/1881023067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c037070 con 0x7f6b700716b0 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.883+0000 7f6b6f400640 1 -- 172.21.15.52:0/1881023067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c032440 con 0x7f6b700716b0 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.883+0000 7f6b6f400640 1 -- 172.21.15.52:0/1881023067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c032810 con 0x7f6b700716b0 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 -- 172.21.15.52:0/1881023067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700716b0 msgr2=0x7f6b70073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1881023067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700716b0 0x7f6b70073b70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6b700ccb70 tx=0x7f6b5c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 -- 172.21.15.52:0/1881023067 shutdown_connections 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1881023067 >> v2:172.21.15.176:3300/0 conn(0x7f6b700ce2f0 0x7f6b700ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1881023067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700716b0 0x7f6b70073b70 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 -- 172.21.15.52:0/1881023067 >> 172.21.15.52:0/1881023067 conn(0x7f6b700b4300 msgr2=0x7f6b700b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 -- 172.21.15.52:0/1881023067 shutdown_connections 2024-09-10T08:33:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.885+0000 7f6b77c00640 1 -- 172.21.15.52:0/1881023067 wait complete. 2024-09-10T08:33:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.887+0000 7f6b77c00640 1 Processor -- start 2024-09-10T08:33:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.887+0000 7f6b77c00640 1 -- start start 2024-09-10T08:33:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.887+0000 7f6b77c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b700716b0 0x7f6b7006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b77c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b77c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b7015c6b0 0x7f6b700cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b77c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700d22f0 con 0x7f6b700ce2f0 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b77c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7015ca90 con 0x7f6b7015c6b0 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b77c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6b700d1400 con 0x7f6b700716b0 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51682/0 (socket says 172.21.15.52:51682) 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1822400193 learned_addr learned my addr 172.21.15.52:0/1822400193 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b75200640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b700716b0 0x7f6b7006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b75c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b7015c6b0 0x7f6b700cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b700716b0 msgr2=0x7f6b7006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b700716b0 0x7f6b7006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b7015c6b0 msgr2=0x7f6b700cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b7015c6b0 0x7f6b700cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.888+0000 7f6b6fe00640 1 -- 172.21.15.52:0/1822400193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7006dbc0 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b6fe00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c000c00 tx=0x7f6b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c037050 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c038040 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c004470 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7006d600 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.889+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7015d210 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.890+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b700b8170 con 0x7f6b700ce2f0 2024-09-10T08:33:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.891+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b5c030900 con 0x7f6b700ce2f0 2024-09-10T08:33:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.891+0000 7f6b6cc00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.891+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f6b5c0ab910 con 0x7f6b700ce2f0 2024-09-10T08:33:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.893+0000 7f6b75200640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:53.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.893+0000 7f6b75200640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 0x7f6b5006e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000f60 tx=0x7f6b64007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:53.897+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b5c079d80 con 0x7f6b700ce2f0 2024-09-10T08:33:54.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.081+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b700b2ed0 con 0x7f6b700ce2f0 2024-09-10T08:33:54.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.083+0000 7f6b6cc00640 1 -- 172.21.15.52:0/1822400193 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16757 (secure 0 0 0) 0x7f6b5c07e080 con 0x7f6b700ce2f0 2024-09-10T08:33:54.082 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:54.082 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":92,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:53.097631+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:50.900580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:52.094246+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 msgr2=0x7f6b5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 0x7f6b5006e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b64000f60 tx=0x7f6b64007d50 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 msgr2=0x7f6b70155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c000c00 tx=0x7f6b5c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 shutdown_connections 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b7015c6b0 0x7f6b700cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b700ce2f0 0x7f6b70155930 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 --2- 172.21.15.52:0/1822400193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b700716b0 0x7f6b7006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 >> 172.21.15.52:0/1822400193 conn(0x7f6b700b4300 msgr2=0x7f6b7015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 shutdown_connections 2024-09-10T08:33:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.085+0000 7f6b77c00640 1 -- 172.21.15.52:0/1822400193 wait complete. 2024-09-10T08:33:54.100 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:54.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.257+0000 7fec58a00640 1 Processor -- start 2024-09-10T08:33:54.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.257+0000 7fec58a00640 1 -- start start 2024-09-10T08:33:54.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.258+0000 7fec58a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fec5415e440 0x7fec540d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.258+0000 7fec58a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec540d3990 con 0x7fec540b6710 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.258+0000 7fec58a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec540d3c70 con 0x7fec540cf450 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.258+0000 7fec58a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fec540d3f50 con 0x7fec5415e440 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec53200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fec540b6710 0x7fec540b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49010/0 (socket says 172.21.15.52:49010) 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec53200640 1 -- 172.21.15.52:0/1154636949 learned_addr learned my addr 172.21.15.52:0/1154636949 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:54.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec52800640 1 --2- 172.21.15.52:0/1154636949 >> v2:172.21.15.176:3300/0 conn(0x7fec5415e440 0x7fec540d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168005484 0 0) 0x7fec540d3990 con 0x7fec540b6710 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec38003520 con 0x7fec540b6710 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec52800640 1 -- 172.21.15.52:0/1154636949 >> v1:172.21.15.176:6789/0 conn(0x7fec540cf450 legacy=0x7fec540b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794092020 0 0) 0x7fec540d3c70 con 0x7fec540cf450 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec52800640 1 -- 172.21.15.52:0/1154636949 >> v1:172.21.15.52:6789/0 conn(0x7fec540b6710 legacy=0x7fec540b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.259+0000 7fec52800640 1 -- 172.21.15.52:0/1154636949 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540d4230 con 0x7fec5415e440 2024-09-10T08:33:54.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.260+0000 7fec52800640 1 --2- 172.21.15.52:0/1154636949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec5415e440 0x7fec540d3240 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec440097a0 tx=0x7fec4402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2e72af7e1d2ccec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44037070 con 0x7fec5415e440 2024-09-10T08:33:54.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44032640 con 0x7fec5415e440 2024-09-10T08:33:54.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec51400640 1 -- 172.21.15.52:0/1154636949 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec440329f0 con 0x7fec5415e440 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 -- 172.21.15.52:0/1154636949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec5415e440 msgr2=0x7fec540d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 --2- 172.21.15.52:0/1154636949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec5415e440 0x7fec540d3240 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fec440097a0 tx=0x7fec4402a2c0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 -- 172.21.15.52:0/1154636949 shutdown_connections 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 --2- 172.21.15.52:0/1154636949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec5415e440 0x7fec540d3240 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 -- 172.21.15.52:0/1154636949 >> 172.21.15.52:0/1154636949 conn(0x7fec54067f80 msgr2=0x7fec540d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 -- 172.21.15.52:0/1154636949 shutdown_connections 2024-09-10T08:33:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.261+0000 7fec58a00640 1 -- 172.21.15.52:0/1154636949 wait complete. 2024-09-10T08:33:54.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.263+0000 7fec58a00640 1 Processor -- start 2024-09-10T08:33:54.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.263+0000 7fec58a00640 1 -- start start 2024-09-10T08:33:54.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec540b6710 0x7fec5414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec540cf450 0x7fec5414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec540b76c0 con 0x7fec5415e440 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec540b7540 con 0x7fec540cf450 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec58a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec540b8270 con 0x7fec540b6710 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec53200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec53200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37866/0 (socket says 172.21.15.52:37866) 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.264+0000 7fec53200640 1 -- 172.21.15.52:0/3341004823 learned_addr learned my addr 172.21.15.52:0/3341004823 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec51e00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec540cf450 0x7fec5414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec52800640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec540b6710 0x7fec5414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 -- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec540b6710 msgr2=0x7fec5414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec540b6710 0x7fec5414abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 -- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec540cf450 msgr2=0x7fec5414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec540cf450 0x7fec5414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 -- 172.21.15.52:0/3341004823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5414b270 con 0x7fec5415e440 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec53200640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00cbb0 tx=0x7fec4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c017070 con 0x7fec5415e440 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4c00ad40 con 0x7fec5415e440 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5414b550 con 0x7fec5415e440 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.265+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c012600 con 0x7fec5415e440 2024-09-10T08:33:54.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.266+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5414bb10 con 0x7fec5415e440 2024-09-10T08:33:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.267+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec540b8090 con 0x7fec5415e440 2024-09-10T08:33:54.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.268+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec4c01a070 con 0x7fec5415e440 2024-09-10T08:33:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.269+0000 7fec4aa00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 0x7fec3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.269+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fec4c08ab70 con 0x7fec5415e440 2024-09-10T08:33:54.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.269+0000 7fec52800640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 0x7fec3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.270+0000 7fec52800640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 0x7fec3406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec44034000 tx=0x7fec4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.273+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec540b8090 con 0x7fec5415e440 2024-09-10T08:33:54.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.458+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec540b37a0 con 0x7fec5415e440 2024-09-10T08:33:54.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.459+0000 7fec4aa00640 1 -- 172.21.15.52:0/3341004823 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16757 (secure 0 0 0) 0x7fec4c058ec0 con 0x7fec5415e440 2024-09-10T08:33:54.459 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:54.459 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":92,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:53.097631+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:50.900580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:52.094246+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 msgr2=0x7fec3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 0x7fec3406e2f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec44034000 tx=0x7fec4402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 msgr2=0x7fec5414c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00cbb0 tx=0x7fec4c00a430 comp rx=0 tx=0).stop 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 shutdown_connections 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec3406be30 0x7fec3406e2f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec5415e440 0x7fec5414c310 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec540cf450 0x7fec5414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 --2- 172.21.15.52:0/3341004823 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec540b6710 0x7fec5414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.461+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 >> 172.21.15.52:0/3341004823 conn(0x7fec54067f80 msgr2=0x7fec540cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.462+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 shutdown_connections 2024-09-10T08:33:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.462+0000 7fec58a00640 1 -- 172.21.15.52:0/3341004823 wait complete. 2024-09-10T08:33:54.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:33:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.636+0000 7f3e7e000640 1 Processor -- start 2024-09-10T08:33:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.637+0000 7f3e7e000640 1 -- start start 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e7e000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 0x7f3e7806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e7e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e780d3930 0x7f3e78162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e7e000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7806c8f0 con 0x7f3e780b3350 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e7e000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3e780b78a0 con 0x7f3e780d3930 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e7e000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3e780cffb0 con 0x7f3e7806bfd0 2024-09-10T08:33:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e780d3930 0x7f3e78162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e6fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e780b3350 0x7f3e781623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49026/0 (socket says 172.21.15.52:49026) 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e6fe00640 1 -- 172.21.15.52:0/1975645953 learned_addr learned my addr 172.21.15.52:0/1975645953 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77400640 1 --2- 172.21.15.52:0/1975645953 >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 0x7f3e7806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77e00640 1 -- 172.21.15.52:0/1975645953 >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 msgr2=0x7f3e7806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77e00640 1 --2- 172.21.15.52:0/1975645953 >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 0x7f3e7806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77e00640 1 -- 172.21.15.52:0/1975645953 >> v1:172.21.15.52:6789/0 conn(0x7f3e780b3350 legacy=0x7f3e781623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77e00640 1 -- 172.21.15.52:0/1975645953 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e780cf710 con 0x7f3e780d3930 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e77400640 1 --2- 172.21.15.52:0/1975645953 >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 0x7f3e7806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.638+0000 7f3e76a00640 1 -- 172.21.15.52:0/1975645953 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963258589 0 0) 0x7f3e7806c8f0 con 0x7f3e780b3350 2024-09-10T08:33:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.639+0000 7f3e77e00640 1 --2- 172.21.15.52:0/1975645953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e78162ab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806b0d0 tx=0x7f3e7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed1950627d9d5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e76a00640 1 -- 172.21.15.52:0/1975645953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70007740 con 0x7f3e780d3930 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e76a00640 1 -- 172.21.15.52:0/1975645953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e700078e0 con 0x7f3e780d3930 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e76a00640 1 -- 172.21.15.52:0/1975645953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70007cb0 con 0x7f3e780d3930 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 -- 172.21.15.52:0/1975645953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 msgr2=0x7f3e78162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 --2- 172.21.15.52:0/1975645953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e78162ab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806b0d0 tx=0x7f3e7002a6a0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 -- 172.21.15.52:0/1975645953 shutdown_connections 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 --2- 172.21.15.52:0/1975645953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e78162ab0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 --2- 172.21.15.52:0/1975645953 >> v2:172.21.15.176:3300/0 conn(0x7f3e7806bfd0 0x7f3e7806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 -- 172.21.15.52:0/1975645953 >> 172.21.15.52:0/1975645953 conn(0x7f3e780d11c0 msgr2=0x7f3e780d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 -- 172.21.15.52:0/1975645953 shutdown_connections 2024-09-10T08:33:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.640+0000 7f3e7e000640 1 -- 172.21.15.52:0/1975645953 wait complete. 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.642+0000 7f3e7e000640 1 Processor -- start 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.642+0000 7f3e7e000640 1 -- start start 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7806bfd0 0x7f3e7815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e780b3350 0x7f3e780ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e780d2400 con 0x7f3e780d3930 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e780cfcd0 con 0x7f3e780b3350 2024-09-10T08:33:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e7e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7806cd50 con 0x7f3e7806bfd0 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37878/0 (socket says 172.21.15.52:37878) 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e77e00640 1 -- 172.21.15.52:0/2799943418 learned_addr learned my addr 172.21.15.52:0/2799943418 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e6fe00640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e780b3350 0x7f3e780ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.643+0000 7f3e77400640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7806bfd0 0x7f3e7815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 -- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7806bfd0 msgr2=0x7f3e7815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7806bfd0 0x7f3e7815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 -- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e780b3350 msgr2=0x7f3e780ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e780b3350 0x7f3e780ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 -- 172.21.15.52:0/2799943418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e780cecd0 con 0x7f3e780d3930 2024-09-10T08:33:54.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e77e00640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7003f070 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.644+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e70031c40 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.645+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70009450 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.645+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e780ce9f0 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.645+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e780cbb00 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.646+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7815eae0 con 0x7f3e780d3930 2024-09-10T08:33:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.647+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e70003990 con 0x7f3e780d3930 2024-09-10T08:33:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.647+0000 7f3e6f400640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 0x7f3e5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.647+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f3e700abbb0 con 0x7f3e780d3930 2024-09-10T08:33:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.648+0000 7f3e77400640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 0x7f3e5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.648+0000 7f3e77400640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 0x7f3e5406e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3e68006fd0 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.652+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e70079f10 con 0x7f3e780d3930 2024-09-10T08:33:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:54.876+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e780ba3d0 con 0x7f3e780d3930 2024-09-10T08:33:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.694+0000 7f3e6f400640 1 -- 172.21.15.52:0/2799943418 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) ==== 118+0+0 (secure 0 0 0) 0x7f3e7007e210 con 0x7f3e780d3930 2024-09-10T08:33:55.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.697+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 msgr2=0x7f3e5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.697+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 0x7f3e5406e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3e68006fd0 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2024-09-10T08:33:55.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.697+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 msgr2=0x7f3e780acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.697+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e70004a40 comp rx=0 tx=0).stop 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 shutdown_connections 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e5406be30 0x7f3e5406e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e780d3930 0x7f3e780acc10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e780b3350 0x7f3e780ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 --2- 172.21.15.52:0/2799943418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e7806bfd0 0x7f3e7815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 >> 172.21.15.52:0/2799943418 conn(0x7f3e780d11c0 msgr2=0x7f3e780b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 shutdown_connections 2024-09-10T08:33:55.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.698+0000 7f3e7e000640 1 -- 172.21.15.52:0/2799943418 wait complete. 2024-09-10T08:33:55.716 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:33:55.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:33:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.880+0000 7f0431200640 1 Processor -- start 2024-09-10T08:33:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.881+0000 7f0431200640 1 -- start start 2024-09-10T08:33:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f0431200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 0x7f042c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:55.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f0431200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042c0714b0 con 0x7f042c0cd270 2024-09-10T08:33:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f0431200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042c073c00 con 0x7f042c0cce30 2024-09-10T08:33:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f0431200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f042c0cd880 con 0x7f042c0732e0 2024-09-10T08:33:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f042a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f042c0cd270 0x7f042c15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49036/0 (socket says 172.21.15.52:49036) 2024-09-10T08:33:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f042a800640 1 -- 172.21.15.52:0/206458223 learned_addr learned my addr 172.21.15.52:0/206458223 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:55.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.882+0000 7f0429e00640 1 --2- 172.21.15.52:0/206458223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 0x7f042c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:55.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523523905 0 0) 0x7f042c0714b0 con 0x7f042c0cd270 2024-09-10T08:33:55.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0410003520 con 0x7f042c0cd270 2024-09-10T08:33:55.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243187485 0 0) 0x7f042c073c00 con 0x7f042c0cce30 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f042c0714b0 con 0x7f042c0cce30 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429e00640 1 -- 172.21.15.52:0/206458223 >> v1:172.21.15.176:6789/0 conn(0x7f042c0cce30 legacy=0x7f042c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429e00640 1 -- 172.21.15.52:0/206458223 >> v1:172.21.15.52:6789/0 conn(0x7f042c0cd270 legacy=0x7f042c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.883+0000 7f0429e00640 1 -- 172.21.15.52:0/206458223 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0cdb60 con 0x7f042c0732e0 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.884+0000 7f0429e00640 1 --2- 172.21.15.52:0/206458223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 0x7f042c0736c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097d0 tx=0x7f041c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69cff7a401d8fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.884+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c037070 con 0x7f042c0732e0 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.884+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c032440 con 0x7f042c0732e0 2024-09-10T08:33:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.884+0000 7f0429400640 1 -- 172.21.15.52:0/206458223 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c032810 con 0x7f042c0732e0 2024-09-10T08:33:55.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 -- 172.21.15.52:0/206458223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 msgr2=0x7f042c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 --2- 172.21.15.52:0/206458223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 0x7f042c0736c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097d0 tx=0x7f041c02a180 comp rx=0 tx=0).stop 2024-09-10T08:33:55.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 -- 172.21.15.52:0/206458223 shutdown_connections 2024-09-10T08:33:55.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 --2- 172.21.15.52:0/206458223 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0732e0 0x7f042c0736c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 -- 172.21.15.52:0/206458223 >> 172.21.15.52:0/206458223 conn(0x7f042c06d0f0 msgr2=0x7f042c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:55.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 -- 172.21.15.52:0/206458223 shutdown_connections 2024-09-10T08:33:55.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.885+0000 7f0431200640 1 -- 172.21.15.52:0/206458223 wait complete. 2024-09-10T08:33:55.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.887+0000 7f0431200640 1 Processor -- start 2024-09-10T08:33:55.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.887+0000 7f0431200640 1 -- start start 2024-09-10T08:33:55.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 0x7f042c1f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:55.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0cce30 0x7f042c0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f042c06bf70 con 0x7f042c0cd270 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f042c06bdf0 con 0x7f042c0732e0 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0431200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f042c072380 con 0x7f042c0cce30 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f042a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f042a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37886/0 (socket says 172.21.15.52:37886) 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f042a800640 1 -- 172.21.15.52:0/3288344020 learned_addr learned my addr 172.21.15.52:0/3288344020 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0429e00640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 0x7f042c1f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.888+0000 7f0421400640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0cce30 0x7f042c0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 -- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0cce30 msgr2=0x7f042c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0cce30 0x7f042c0b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 -- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 msgr2=0x7f042c1f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 0x7f042c1f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 -- 172.21.15.52:0/3288344020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c156860 con 0x7f042c0cd270 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0429e00640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 0x7f042c1f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f042a800640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f042400cba0 tx=0x7f042400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424017070 con 0x7f042c0cd270 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042400ace0 con 0x7f042c0cd270 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042c147c10 con 0x7f042c0cd270 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424012620 con 0x7f042c0cd270 2024-09-10T08:33:55.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.889+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042c1481d0 con 0x7f042c0cd270 2024-09-10T08:33:55.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.890+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f042c0736c0 con 0x7f042c0cd270 2024-09-10T08:33:55.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.891+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f042401a070 con 0x7f042c0cd270 2024-09-10T08:33:55.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.893+0000 7f0422a00640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 0x7f040806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:55.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.893+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f042408ad90 con 0x7f042c0cd270 2024-09-10T08:33:55.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.893+0000 7f0429e00640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 0x7f040806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:55.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.894+0000 7f0429e00640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 0x7f040806e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f041c034000 tx=0x7f041c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:55.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:55.898+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04240596a0 con 0x7f042c0cd270 2024-09-10T08:33:56.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.119+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f042c0711f0 con 0x7f042c0cd270 2024-09-10T08:33:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.699+0000 7f0422a00640 1 -- 172.21.15.52:0/3288344020 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) ==== 122+0+0 (secure 0 0 0) 0x7f0424058fa0 con 0x7f042c0cd270 2024-09-10T08:33:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 msgr2=0x7f040806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 0x7f040806e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f041c034000 tx=0x7f041c02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 msgr2=0x7f042c1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f042400cba0 tx=0x7f042400a430 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 shutdown_connections 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f040806be30 0x7f040806e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f042c0cd270 0x7f042c1448b0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f042c0cce30 0x7f042c0b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 --2- 172.21.15.52:0/3288344020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f042c0732e0 0x7f042c1f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 >> 172.21.15.52:0/3288344020 conn(0x7f042c06d0f0 msgr2=0x7f042c15d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 shutdown_connections 2024-09-10T08:33:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.702+0000 7f0431200640 1 -- 172.21.15.52:0/3288344020 wait complete. 2024-09-10T08:33:56.719 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:33:56.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.879+0000 7fc572600640 1 Processor -- start 2024-09-10T08:33:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.880+0000 7fc572600640 1 -- start start 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc56c0b2d40 0x7fc56c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc56c13eb20 0x7fc56c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc56c071ab0 con 0x7fc56c0b2d40 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc56c071180 con 0x7fc56c13eb20 2024-09-10T08:33:56.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc572600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c071460 con 0x7fc56c15bcf0 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc56c0b2d40 0x7fc56c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc56c0b2d40 0x7fc56c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37888/0 (socket says 172.21.15.52:37888) 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 -- 172.21.15.52:0/2424185286 learned_addr learned my addr 172.21.15.52:0/2424185286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc563e00640 1 --2- 172.21.15.52:0/2424185286 >> v2:172.21.15.176:3300/0 conn(0x7fc56c13eb20 0x7fc56c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56be00640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 -- 172.21.15.52:0/2424185286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 msgr2=0x7fc56c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 -- 172.21.15.52:0/2424185286 >> v2:172.21.15.176:3300/0 conn(0x7fc56c13eb20 msgr2=0x7fc56c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.881+0000 7fc56b400640 1 --2- 172.21.15.52:0/2424185286 >> v2:172.21.15.176:3300/0 conn(0x7fc56c13eb20 0x7fc56c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.882+0000 7fc56b400640 1 -- 172.21.15.52:0/2424185286 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c071740 con 0x7fc56c0b2d40 2024-09-10T08:33:56.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.882+0000 7fc56be00640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:56.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.882+0000 7fc56b400640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c0b2d40 0x7fc56c06bc10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0d1500 tx=0x7fc55c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ac0ee7035d2fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc56aa00640 1 -- 172.21.15.52:0/2424185286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037070 con 0x7fc56c0b2d40 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc56aa00640 1 -- 172.21.15.52:0/2424185286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c032440 con 0x7fc56c0b2d40 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc56aa00640 1 -- 172.21.15.52:0/2424185286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c032810 con 0x7fc56c0b2d40 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 -- 172.21.15.52:0/2424185286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c0b2d40 msgr2=0x7fc56c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c0b2d40 0x7fc56c06bc10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0d1500 tx=0x7fc55c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 -- 172.21.15.52:0/2424185286 shutdown_connections 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 --2- 172.21.15.52:0/2424185286 >> v2:172.21.15.176:3300/0 conn(0x7fc56c13eb20 0x7fc56c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 --2- 172.21.15.52:0/2424185286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c0b2d40 0x7fc56c06bc10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 -- 172.21.15.52:0/2424185286 >> 172.21.15.52:0/2424185286 conn(0x7fc56c0ccec0 msgr2=0x7fc56c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.883+0000 7fc572600640 1 -- 172.21.15.52:0/2424185286 shutdown_connections 2024-09-10T08:33:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.884+0000 7fc572600640 1 -- 172.21.15.52:0/2424185286 wait complete. 2024-09-10T08:33:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.885+0000 7fc572600640 1 Processor -- start 2024-09-10T08:33:56.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.885+0000 7fc572600640 1 -- start start 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc56c0b2d40 0x7fc56c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c1f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c15f140 con 0x7fc56c13eb20 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c15efc0 con 0x7fc56c0b2d40 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.886+0000 7fc572600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c15f2c0 con 0x7fc56c15bcf0 2024-09-10T08:33:56.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37904/0 (socket says 172.21.15.52:37904) 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 -- 172.21.15.52:0/2023419492 learned_addr learned my addr 172.21.15.52:0/2023419492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc56be00640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c1f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc56b400640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc56c0b2d40 0x7fc56c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 -- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 msgr2=0x7fc56c1f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c1f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 -- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc56c0b2d40 msgr2=0x7fc56c13d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc56c0b2d40 0x7fc56c13d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 -- 172.21.15.52:0/2023419492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c0cc4f0 con 0x7fc56c13eb20 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.887+0000 7fc563e00640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc55400d7d0 tx=0x7fc55400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.888+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554018030 con 0x7fc56c13eb20 2024-09-10T08:33:56.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.888+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554004020 con 0x7fc56c13eb20 2024-09-10T08:33:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.888+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554004230 con 0x7fc56c13eb20 2024-09-10T08:33:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.888+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c0ca4c0 con 0x7fc56c13eb20 2024-09-10T08:33:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.888+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c0caa80 con 0x7fc56c13eb20 2024-09-10T08:33:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.889+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56c15c1a0 con 0x7fc56c13eb20 2024-09-10T08:33:56.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.890+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc55401b070 con 0x7fc56c13eb20 2024-09-10T08:33:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.891+0000 7fc563400640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.891+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fc55408aea0 con 0x7fc56c13eb20 2024-09-10T08:33:56.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.891+0000 7fc56b400640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:56.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.892+0000 7fc56b400640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 0x7fc54806e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc55c034000 tx=0x7fc55c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:56.895+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5540591f0 con 0x7fc56c13eb20 2024-09-10T08:33:57.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.116+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc56c06c9c0 con 0x7fc56c13eb20 2024-09-10T08:33:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.117+0000 7fc563400640 1 -- 172.21.15.52:0/2023419492 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5231 (secure 0 0 0) 0x7fc55405d4f0 con 0x7fc56c13eb20 2024-09-10T08:33:57.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:57.117 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":67,"btime":"2024-09-10T08:33:56:695029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3587011080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3587011080},{"type":"v1","addr":"172.21.15.176:6837","nonce":3587011080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1644703485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1644703485},{"type":"v1","addr":"172.21.15.52:6834","nonce":1644703485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3249807442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3249807442},{"type":"v1","addr":"172.21.15.52:6835","nonce":3249807442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:33:56.119676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6676":{"gid":6676,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/2093809753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2093809753},{"type":"v1","addr":"172.21.15.176:6836","nonce":2093809753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6676,"qdb_cluster":[6676]},"id":6}]} 2024-09-10T08:33:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 67 2024-09-10T08:33:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 msgr2=0x7fc54806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 0x7fc54806e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc55c034000 tx=0x7fc55c02e000 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 msgr2=0x7fc56c0cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc55400d7d0 tx=0x7fc55400dc90 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 shutdown_connections 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc54806be30 0x7fc54806e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc56c15bcf0 0x7fc56c1f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc56c13eb20 0x7fc56c0cafa0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 --2- 172.21.15.52:0/2023419492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc56c0b2d40 0x7fc56c13d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 >> 172.21.15.52:0/2023419492 conn(0x7fc56c0ccec0 msgr2=0x7fc56c071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 shutdown_connections 2024-09-10T08:33:57.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.119+0000 7fc572600640 1 -- 172.21.15.52:0/2023419492 wait complete. 2024-09-10T08:33:57.134 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:33:57.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.290+0000 7f37e9800640 1 Processor -- start 2024-09-10T08:33:57.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.290+0000 7f37e9800640 1 -- start start 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e9800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37e4147e80 0x7f37e4070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37e4148260 0x7f37e40714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e9800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e4071b30 con 0x7f37e406bc10 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e9800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f37e4074200 con 0x7f37e4148260 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e9800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37e40b3e40 con 0x7f37e4147e80 2024-09-10T08:33:57.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e2000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37e4148260 0x7f37e40714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f37e406bc10 0x7f37e41623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49048/0 (socket says 172.21.15.52:49048) 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.291+0000 7f37e3400640 1 -- 172.21.15.52:0/938515661 learned_addr learned my addr 172.21.15.52:0/938515661 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e2a00640 1 --2- 172.21.15.52:0/938515661 >> v2:172.21.15.176:3300/0 conn(0x7f37e4147e80 0x7f37e4070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e2000640 1 -- 172.21.15.52:0/938515661 >> v2:172.21.15.176:3300/0 conn(0x7f37e4147e80 msgr2=0x7f37e4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e2000640 1 --2- 172.21.15.52:0/938515661 >> v2:172.21.15.176:3300/0 conn(0x7f37e4147e80 0x7f37e4070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e2000640 1 -- 172.21.15.52:0/938515661 >> v1:172.21.15.52:6789/0 conn(0x7f37e406bc10 legacy=0x7f37e41623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e2000640 1 -- 172.21.15.52:0/938515661 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e40b3510 con 0x7f37e4148260 2024-09-10T08:33:57.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.292+0000 7f37e1600640 1 -- 172.21.15.52:0/938515661 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838378413 0 0) 0x7f37e4071b30 con 0x7f37e406bc10 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.293+0000 7f37e2000640 1 --2- 172.21.15.52:0/938515661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e4148260 0x7f37e40714b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f37e40d1500 tx=0x7f37d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75435651daa4aa3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.293+0000 7f37e1600640 1 -- 172.21.15.52:0/938515661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0037070 con 0x7f37e4148260 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.293+0000 7f37e1600640 1 -- 172.21.15.52:0/938515661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d0032440 con 0x7f37e4148260 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.293+0000 7f37e1600640 1 -- 172.21.15.52:0/938515661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0032810 con 0x7f37e4148260 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 -- 172.21.15.52:0/938515661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e4148260 msgr2=0x7f37e40714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 --2- 172.21.15.52:0/938515661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e4148260 0x7f37e40714b0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f37e40d1500 tx=0x7f37d002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 -- 172.21.15.52:0/938515661 shutdown_connections 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 --2- 172.21.15.52:0/938515661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e4148260 0x7f37e40714b0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 --2- 172.21.15.52:0/938515661 >> v2:172.21.15.176:3300/0 conn(0x7f37e4147e80 0x7f37e4070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 -- 172.21.15.52:0/938515661 >> 172.21.15.52:0/938515661 conn(0x7f37e40ccec0 msgr2=0x7f37e40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 -- 172.21.15.52:0/938515661 shutdown_connections 2024-09-10T08:33:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.294+0000 7f37e9800640 1 -- 172.21.15.52:0/938515661 wait complete. 2024-09-10T08:33:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.296+0000 7f37e9800640 1 Processor -- start 2024-09-10T08:33:57.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.296+0000 7f37e9800640 1 -- start start 2024-09-10T08:33:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37e4147e80 0x7f37e4143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37e4148260 0x7f37e413f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40b52e0 con 0x7f37e406bc10 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40b3ad0 con 0x7f37e4147e80 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e9800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40b5460 con 0x7f37e4148260 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37916/0 (socket says 172.21.15.52:37916) 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 -- 172.21.15.52:0/1844551785 learned_addr learned my addr 172.21.15.52:0/1844551785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 -- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37e4148260 msgr2=0x7f37e413f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37e4148260 0x7f37e413f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 -- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37e4147e80 msgr2=0x7f37e4143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37e4147e80 0x7f37e4143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 -- 172.21.15.52:0/1844551785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e4141770 con 0x7f37e406bc10 2024-09-10T08:33:57.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.297+0000 7f37e2a00640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e9b0 tx=0x7f37d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.298+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4017070 con 0x7f37e406bc10 2024-09-10T08:33:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.298+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d400c9a0 con 0x7f37e406bc10 2024-09-10T08:33:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.298+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d400cd90 con 0x7f37e406bc10 2024-09-10T08:33:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.298+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e413e0b0 con 0x7f37e406bc10 2024-09-10T08:33:57.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.298+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e4141cf0 con 0x7f37e406bc10 2024-09-10T08:33:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.299+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e406c080 con 0x7f37e406bc10 2024-09-10T08:33:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.300+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37d401a070 con 0x7f37e406bc10 2024-09-10T08:33:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.301+0000 7f37daa00640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.301+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f37d408af30 con 0x7f37e406bc10 2024-09-10T08:33:57.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.301+0000 7f37e2000640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.302+0000 7f37e2000640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 0x7f37c406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.305+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37d4059840 con 0x7f37e406bc10 2024-09-10T08:33:57.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.490+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37e40ce660 con 0x7f37e406bc10 2024-09-10T08:33:57.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.491+0000 7f37daa00640 1 -- 172.21.15.52:0/1844551785 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16744 (secure 0 0 0) 0x7f37d4059140 con 0x7f37e406bc10 2024-09-10T08:33:57.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:57.491 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:33:54.674573+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:50.900580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:52.094246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:33:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 msgr2=0x7f37c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 0x7f37c406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f37d0034000 tx=0x7f37d002c000 comp rx=0 tx=0).stop 2024-09-10T08:33:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 msgr2=0x7f37e413db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e9b0 tx=0x7f37d400ee70 comp rx=0 tx=0).stop 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 shutdown_connections 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37c406be30 0x7f37c406e2f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37e4148260 0x7f37e413f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37e4147e80 0x7f37e4143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 --2- 172.21.15.52:0/1844551785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37e406bc10 0x7f37e413db70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 >> 172.21.15.52:0/1844551785 conn(0x7f37e40ccec0 msgr2=0x7f37e40d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 shutdown_connections 2024-09-10T08:33:57.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.494+0000 7f37e9800640 1 -- 172.21.15.52:0/1844551785 wait complete. 2024-09-10T08:33:57.509 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:33:57.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:33:57.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.666+0000 7f1eee400640 1 Processor -- start 2024-09-10T08:33:57.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.666+0000 7f1eee400640 1 -- start start 2024-09-10T08:33:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.667+0000 7f1eee400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee815e790 0x7f1ee8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.667+0000 7f1eee400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ee8162c60 0x7f1ee80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.667+0000 7f1eee400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee81631c0 con 0x7f1ee80b5970 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.667+0000 7f1eee400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee815eb70 con 0x7f1ee8162c60 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.667+0000 7f1eee400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee80ae9a0 con 0x7f1ee815e790 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ee80b5970 0x7f1ee806f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49060/0 (socket says 172.21.15.52:49060) 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee7e00640 1 -- 172.21.15.52:0/3275680238 learned_addr learned my addr 172.21.15.52:0/3275680238 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee7400640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee815e790 0x7f1ee8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3275680238 >> v2:172.21.15.176:3300/0 conn(0x7f1ee8162c60 0x7f1ee80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6000640 1 -- 172.21.15.52:0/3275680238 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077515092 0 0) 0x7f1ee81631c0 con 0x7f1ee80b5970 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6000640 1 -- 172.21.15.52:0/3275680238 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ecc003520 con 0x7f1ee80b5970 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6a00640 1 -- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee815e790 msgr2=0x7f1ee8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee815e790 0x7f1ee8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6a00640 1 -- 172.21.15.52:0/3275680238 >> v1:172.21.15.52:6789/0 conn(0x7f1ee80b5970 legacy=0x7f1ee806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.668+0000 7f1ee6a00640 1 -- 172.21.15.52:0/3275680238 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee80aec40 con 0x7f1ee8162c60 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.669+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee8162c60 0x7f1ee80b5430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40097a0 tx=0x7f1ed402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=344f66914070d384 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1ee6000640 1 -- 172.21.15.52:0/3275680238 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4037070 con 0x7f1ee8162c60 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1ee6000640 1 -- 172.21.15.52:0/3275680238 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed402ae50 con 0x7f1ee8162c60 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1ee6000640 1 -- 172.21.15.52:0/3275680238 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4032660 con 0x7f1ee8162c60 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 -- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee8162c60 msgr2=0x7f1ee80b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee8162c60 0x7f1ee80b5430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40097a0 tx=0x7f1ed402a100 comp rx=0 tx=0).stop 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 -- 172.21.15.52:0/3275680238 shutdown_connections 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee8162c60 0x7f1ee80b5430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 --2- 172.21.15.52:0/3275680238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee815e790 0x7f1ee8073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 -- 172.21.15.52:0/3275680238 >> 172.21.15.52:0/3275680238 conn(0x7f1ee80b0a80 msgr2=0x7f1ee80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.670+0000 7f1eee400640 1 -- 172.21.15.52:0/3275680238 shutdown_connections 2024-09-10T08:33:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.671+0000 7f1eee400640 1 -- 172.21.15.52:0/3275680238 wait complete. 2024-09-10T08:33:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.672+0000 7f1eee400640 1 Processor -- start 2024-09-10T08:33:57.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.672+0000 7f1eee400640 1 -- start start 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee815e790 0x7f1ee81548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee8162c60 0x7f1ee8072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee806f430 con 0x7f1ee80b5970 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80af200 con 0x7f1ee815e790 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1eee400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee806fe40 con 0x7f1ee8162c60 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1ee7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1ee7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37926/0 (socket says 172.21.15.52:37926) 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1ee7400640 1 -- 172.21.15.52:0/3477789290 learned_addr learned my addr 172.21.15.52:0/3477789290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1ee7e00640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee8162c60 0x7f1ee8072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.673+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee815e790 0x7f1ee81548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 -- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee8162c60 msgr2=0x7f1ee8072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee8162c60 0x7f1ee8072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 -- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee815e790 msgr2=0x7f1ee81548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee815e790 0x7f1ee81548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 -- 172.21.15.52:0/3477789290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee80ce490 con 0x7f1ee80b5970 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1ee7400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800e9b0 tx=0x7f1ed800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8017070 con 0x7f1ee80b5970 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed800c9a0 con 0x7f1ee80b5970 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee80ce770 con 0x7f1ee80b5970 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.674+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed800cd90 con 0x7f1ee80b5970 2024-09-10T08:33:57.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.675+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee80cf010 con 0x7f1ee80b5970 2024-09-10T08:33:57.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.675+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee8073a40 con 0x7f1ee80b5970 2024-09-10T08:33:57.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.676+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1ed801a070 con 0x7f1ee80b5970 2024-09-10T08:33:57.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.677+0000 7f1edf400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 0x7f1ec806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:57.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.677+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f1ed808b1d0 con 0x7f1ee80b5970 2024-09-10T08:33:57.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.678+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 0x7f1ec806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:57.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.679+0000 7f1ee6a00640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 0x7f1ec806e320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4034000 tx=0x7f1ed402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:57.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.682+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ed8059490 con 0x7f1ee80b5970 2024-09-10T08:33:57.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.866+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ee806e170 con 0x7f1ec806be60 2024-09-10T08:33:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.873+0000 7f1edf400640 1 -- 172.21.15.52:0/3477789290 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7f1ee806e170 con 0x7f1ec806be60 2024-09-10T08:33:57.875 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 msgr2=0x7f1ec806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 0x7f1ec806e320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4034000 tx=0x7f1ed402e000 comp rx=0 tx=0).stop 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 msgr2=0x7f1ee80cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800e9b0 tx=0x7f1ed800ee70 comp rx=0 tx=0).stop 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 shutdown_connections 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1ec806be60 0x7f1ec806e320 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ee8162c60 0x7f1ee8072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ee815e790 0x7f1ee81548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 --2- 172.21.15.52:0/3477789290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ee80b5970 0x7f1ee80cfd50 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 >> 172.21.15.52:0/3477789290 conn(0x7f1ee80b0a80 msgr2=0x7f1ee8072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 shutdown_connections 2024-09-10T08:33:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:57.877+0000 7f1eee400640 1 -- 172.21.15.52:0/3477789290 wait complete. 2024-09-10T08:33:57.892 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-10T08:33:57.531266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284476,"kb_used_data":9992,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754690244,"statfs":{"total":773094113280,"available":772802809856,"internally_reserved":0,"allocated":10231808,"data_stored":5054348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.873915"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680324+0000","last_change":"2024-09-10T08:33:53.688643+0000","last_active":"2024-09-10T08:33:54.680324+0000","last_peered":"2024-09-10T08:33:54.680324+0000","last_clean":"2024-09-10T08:33:54.680324+0000","last_became_active":"2024-09-10T08:33:53.687900+0000","last_became_peered":"2024-09-10T08:33:53.687900+0000","last_unstale":"2024-09-10T08:33:54.680324+0000","last_undegraded":"2024-09-10T08:33:54.680324+0000","last_fullsized":"2024-09-10T08:33:54.680324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:34.789110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702358+0000","last_change":"2024-09-10T08:33:53.692453+0000","last_active":"2024-09-10T08:33:54.702358+0000","last_peered":"2024-09-10T08:33:54.702358+0000","last_clean":"2024-09-10T08:33:54.702358+0000","last_became_active":"2024-09-10T08:33:53.691723+0000","last_became_peered":"2024-09-10T08:33:53.691723+0000","last_unstale":"2024-09-10T08:33:54.702358+0000","last_undegraded":"2024-09-10T08:33:54.702358+0000","last_fullsized":"2024-09-10T08:33:54.702358+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:56.628379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678908+0000","last_change":"2024-09-10T08:33:53.697819+0000","last_active":"2024-09-10T08:33:54.678908+0000","last_peered":"2024-09-10T08:33:54.678908+0000","last_clean":"2024-09-10T08:33:54.678908+0000","last_became_active":"2024-09-10T08:33:53.696832+0000","last_became_peered":"2024-09-10T08:33:53.696832+0000","last_unstale":"2024-09-10T08:33:54.678908+0000","last_undegraded":"2024-09-10T08:33:54.678908+0000","last_fullsized":"2024-09-10T08:33:54.678908+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:53.389511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.699454+0000","last_change":"2024-09-10T08:33:53.690198+0000","last_active":"2024-09-10T08:33:53.699454+0000","last_peered":"2024-09-10T08:33:53.699454+0000","last_clean":"2024-09-10T08:33:53.699454+0000","last_became_active":"2024-09-10T08:33:53.688473+0000","last_became_peered":"2024-09-10T08:33:53.688473+0000","last_unstale":"2024-09-10T08:33:53.699454+0000","last_undegraded":"2024-09-10T08:33:53.699454+0000","last_fullsized":"2024-09-10T08:33:53.699454+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:27.563352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.695747+0000","last_change":"2024-09-10T08:33:53.692676+0000","last_active":"2024-09-10T08:33:53.695747+0000","last_peered":"2024-09-10T08:33:53.695747+0000","last_clean":"2024-09-10T08:33:53.695747+0000","last_became_active":"2024-09-10T08:33:53.692397+0000","last_became_peered":"2024-09-10T08:33:53.692397+0000","last_unstale":"2024-09-10T08:33:53.695747+0000","last_undegraded":"2024-09-10T08:33:53.695747+0000","last_fullsized":"2024-09-10T08:33:53.695747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:19.866152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679242+0000","last_change":"2024-09-10T08:33:53.700617+0000","last_active":"2024-09-10T08:33:54.679242+0000","last_peered":"2024-09-10T08:33:54.679242+0000","last_clean":"2024-09-10T08:33:54.679242+0000","last_became_active":"2024-09-10T08:33:53.700324+0000","last_became_peered":"2024-09-10T08:33:53.700324+0000","last_unstale":"2024-09-10T08:33:54.679242+0000","last_undegraded":"2024-09-10T08:33:54.679242+0000","last_fullsized":"2024-09-10T08:33:54.679242+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:37.419190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702064+0000","last_change":"2024-09-10T08:33:53.699452+0000","last_active":"2024-09-10T08:33:54.702064+0000","last_peered":"2024-09-10T08:33:54.702064+0000","last_clean":"2024-09-10T08:33:54.702064+0000","last_became_active":"2024-09-10T08:33:53.699158+0000","last_became_peered":"2024-09-10T08:33:53.699158+0000","last_unstale":"2024-09-10T08:33:54.702064+0000","last_undegraded":"2024-09-10T08:33:54.702064+0000","last_fullsized":"2024-09-10T08:33:54.702064+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:23.064913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710833+0000","last_change":"2024-09-10T08:33:53.704230+0000","last_active":"2024-09-10T08:33:53.710833+0000","last_peered":"2024-09-10T08:33:53.710833+0000","last_clean":"2024-09-10T08:33:53.710833+0000","last_became_active":"2024-09-10T08:33:53.703879+0000","last_became_peered":"2024-09-10T08:33:53.703879+0000","last_unstale":"2024-09-10T08:33:53.710833+0000","last_undegraded":"2024-09-10T08:33:53.710833+0000","last_fullsized":"2024-09-10T08:33:53.710833+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:36.168284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680406+0000","last_change":"2024-09-10T08:33:53.688858+0000","last_active":"2024-09-10T08:33:54.680406+0000","last_peered":"2024-09-10T08:33:54.680406+0000","last_clean":"2024-09-10T08:33:54.680406+0000","last_became_active":"2024-09-10T08:33:53.688592+0000","last_became_peered":"2024-09-10T08:33:53.688592+0000","last_unstale":"2024-09-10T08:33:54.680406+0000","last_undegraded":"2024-09-10T08:33:54.680406+0000","last_fullsized":"2024-09-10T08:33:54.680406+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678747+0000","last_change":"2024-09-10T08:33:53.691472+0000","last_active":"2024-09-10T08:33:54.678747+0000","last_peered":"2024-09-10T08:33:54.678747+0000","last_clean":"2024-09-10T08:33:54.678747+0000","last_became_active":"2024-09-10T08:33:53.690976+0000","last_became_peered":"2024-09-10T08:33:53.690976+0000","last_unstale":"2024-09-10T08:33:54.678747+0000","last_undegraded":"2024-09-10T08:33:54.678747+0000","last_fullsized":"2024-09-10T08:33:54.678747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:35.459891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699871+0000","last_change":"2024-09-10T08:33:53.701775+0000","last_active":"2024-09-10T08:33:54.699871+0000","last_peered":"2024-09-10T08:33:54.699871+0000","last_clean":"2024-09-10T08:33:54.699871+0000","last_became_active":"2024-09-10T08:33:53.701458+0000","last_became_peered":"2024-09-10T08:33:53.701458+0000","last_unstale":"2024-09-10T08:33:54.699871+0000","last_undegraded":"2024-09-10T08:33:54.699871+0000","last_fullsized":"2024-09-10T08:33:54.699871+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:39.789611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.707567+0000","last_change":"2024-09-10T08:33:53.697761+0000","last_active":"2024-09-10T08:33:53.707567+0000","last_peered":"2024-09-10T08:33:53.707567+0000","last_clean":"2024-09-10T08:33:53.707567+0000","last_became_active":"2024-09-10T08:33:53.697422+0000","last_became_peered":"2024-09-10T08:33:53.697422+0000","last_unstale":"2024-09-10T08:33:53.707567+0000","last_undegraded":"2024-09-10T08:33:53.707567+0000","last_fullsized":"2024-09-10T08:33:53.707567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.695727+0000","last_change":"2024-09-10T08:33:53.689486+0000","last_active":"2024-09-10T08:33:53.695727+0000","last_peered":"2024-09-10T08:33:53.695727+0000","last_clean":"2024-09-10T08:33:53.695727+0000","last_became_active":"2024-09-10T08:33:53.689158+0000","last_became_peered":"2024-09-10T08:33:53.689158+0000","last_unstale":"2024-09-10T08:33:53.695727+0000","last_undegraded":"2024-09-10T08:33:53.695727+0000","last_fullsized":"2024-09-10T08:33:53.695727+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:50.449159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679562+0000","last_change":"2024-09-10T08:33:53.708346+0000","last_active":"2024-09-10T08:33:54.679562+0000","last_peered":"2024-09-10T08:33:54.679562+0000","last_clean":"2024-09-10T08:33:54.679562+0000","last_became_active":"2024-09-10T08:33:53.704704+0000","last_became_peered":"2024-09-10T08:33:53.704704+0000","last_unstale":"2024-09-10T08:33:54.679562+0000","last_undegraded":"2024-09-10T08:33:54.679562+0000","last_fullsized":"2024-09-10T08:33:54.679562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.785739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702073+0000","last_change":"2024-09-10T08:33:53.708185+0000","last_active":"2024-09-10T08:33:54.702073+0000","last_peered":"2024-09-10T08:33:54.702073+0000","last_clean":"2024-09-10T08:33:54.702073+0000","last_became_active":"2024-09-10T08:33:53.707881+0000","last_became_peered":"2024-09-10T08:33:53.707881+0000","last_unstale":"2024-09-10T08:33:54.702073+0000","last_undegraded":"2024-09-10T08:33:54.702073+0000","last_fullsized":"2024-09-10T08:33:54.702073+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:19.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679081+0000","last_change":"2024-09-10T08:33:53.693828+0000","last_active":"2024-09-10T08:33:54.679081+0000","last_peered":"2024-09-10T08:33:54.679081+0000","last_clean":"2024-09-10T08:33:54.679081+0000","last_became_active":"2024-09-10T08:33:53.693223+0000","last_became_peered":"2024-09-10T08:33:53.693223+0000","last_unstale":"2024-09-10T08:33:54.679081+0000","last_undegraded":"2024-09-10T08:33:54.679081+0000","last_fullsized":"2024-09-10T08:33:54.679081+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:22.265739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.707423+0000","last_change":"2024-09-10T08:33:53.702494+0000","last_active":"2024-09-10T08:33:53.707423+0000","last_peered":"2024-09-10T08:33:53.707423+0000","last_clean":"2024-09-10T08:33:53.707423+0000","last_became_active":"2024-09-10T08:33:53.701072+0000","last_became_peered":"2024-09-10T08:33:53.701072+0000","last_unstale":"2024-09-10T08:33:53.707423+0000","last_undegraded":"2024-09-10T08:33:53.707423+0000","last_fullsized":"2024-09-10T08:33:53.707423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699585+0000","last_change":"2024-09-10T08:33:53.706947+0000","last_active":"2024-09-10T08:33:54.699585+0000","last_peered":"2024-09-10T08:33:54.699585+0000","last_clean":"2024-09-10T08:33:54.699585+0000","last_became_active":"2024-09-10T08:33:53.705139+0000","last_became_peered":"2024-09-10T08:33:53.705139+0000","last_unstale":"2024-09-10T08:33:54.699585+0000","last_undegraded":"2024-09-10T08:33:54.699585+0000","last_fullsized":"2024-09-10T08:33:54.699585+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:17.437870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680218+0000","last_change":"2024-09-10T08:33:53.700811+0000","last_active":"2024-09-10T08:33:54.680218+0000","last_peered":"2024-09-10T08:33:54.680218+0000","last_clean":"2024-09-10T08:33:54.680218+0000","last_became_active":"2024-09-10T08:33:53.693722+0000","last_became_peered":"2024-09-10T08:33:53.693722+0000","last_unstale":"2024-09-10T08:33:54.680218+0000","last_undegraded":"2024-09-10T08:33:54.680218+0000","last_fullsized":"2024-09-10T08:33:54.680218+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680142+0000","last_change":"2024-09-10T08:33:53.692750+0000","last_active":"2024-09-10T08:33:54.680142+0000","last_peered":"2024-09-10T08:33:54.680142+0000","last_clean":"2024-09-10T08:33:54.680142+0000","last_became_active":"2024-09-10T08:33:53.692477+0000","last_became_peered":"2024-09-10T08:33:53.692477+0000","last_unstale":"2024-09-10T08:33:54.680142+0000","last_undegraded":"2024-09-10T08:33:54.680142+0000","last_fullsized":"2024-09-10T08:33:54.680142+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:34.789110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709266+0000","last_change":"2024-09-10T08:33:53.701857+0000","last_active":"2024-09-10T08:33:53.709266+0000","last_peered":"2024-09-10T08:33:53.709266+0000","last_clean":"2024-09-10T08:33:53.709266+0000","last_became_active":"2024-09-10T08:33:53.701184+0000","last_became_peered":"2024-09-10T08:33:53.701184+0000","last_unstale":"2024-09-10T08:33:53.709266+0000","last_undegraded":"2024-09-10T08:33:53.709266+0000","last_fullsized":"2024-09-10T08:33:53.709266+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:36.855144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679806+0000","last_change":"2024-09-10T08:33:53.706196+0000","last_active":"2024-09-10T08:33:54.679806+0000","last_peered":"2024-09-10T08:33:54.679806+0000","last_clean":"2024-09-10T08:33:54.679806+0000","last_became_active":"2024-09-10T08:33:53.695326+0000","last_became_peered":"2024-09-10T08:33:53.695326+0000","last_unstale":"2024-09-10T08:33:54.679806+0000","last_undegraded":"2024-09-10T08:33:54.679806+0000","last_fullsized":"2024-09-10T08:33:54.679806+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:35.165345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.701686+0000","last_change":"2024-09-10T08:33:53.690198+0000","last_active":"2024-09-10T08:33:53.701686+0000","last_peered":"2024-09-10T08:33:53.701686+0000","last_clean":"2024-09-10T08:33:53.701686+0000","last_became_active":"2024-09-10T08:33:53.689925+0000","last_became_peered":"2024-09-10T08:33:53.689925+0000","last_unstale":"2024-09-10T08:33:53.701686+0000","last_undegraded":"2024-09-10T08:33:53.701686+0000","last_fullsized":"2024-09-10T08:33:53.701686+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699801+0000","last_change":"2024-09-10T08:33:53.705670+0000","last_active":"2024-09-10T08:33:54.699801+0000","last_peered":"2024-09-10T08:33:54.699801+0000","last_clean":"2024-09-10T08:33:54.699801+0000","last_became_active":"2024-09-10T08:33:53.703161+0000","last_became_peered":"2024-09-10T08:33:53.703161+0000","last_unstale":"2024-09-10T08:33:54.699801+0000","last_undegraded":"2024-09-10T08:33:54.699801+0000","last_fullsized":"2024-09-10T08:33:54.699801+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:50.023255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699734+0000","last_change":"2024-09-10T08:33:53.706489+0000","last_active":"2024-09-10T08:33:54.699734+0000","last_peered":"2024-09-10T08:33:54.699734+0000","last_clean":"2024-09-10T08:33:54.699734+0000","last_became_active":"2024-09-10T08:33:53.706223+0000","last_became_peered":"2024-09-10T08:33:53.706223+0000","last_unstale":"2024-09-10T08:33:54.699734+0000","last_undegraded":"2024-09-10T08:33:54.699734+0000","last_fullsized":"2024-09-10T08:33:54.699734+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:33.065118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.698755+0000","last_change":"2024-09-10T08:33:53.694669+0000","last_active":"2024-09-10T08:33:53.698755+0000","last_peered":"2024-09-10T08:33:53.698755+0000","last_clean":"2024-09-10T08:33:53.698755+0000","last_became_active":"2024-09-10T08:33:53.694387+0000","last_became_peered":"2024-09-10T08:33:53.694387+0000","last_unstale":"2024-09-10T08:33:53.698755+0000","last_undegraded":"2024-09-10T08:33:53.698755+0000","last_fullsized":"2024-09-10T08:33:53.698755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:24.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.706265+0000","last_change":"2024-09-10T08:33:53.704364+0000","last_active":"2024-09-10T08:33:53.706265+0000","last_peered":"2024-09-10T08:33:53.706265+0000","last_clean":"2024-09-10T08:33:53.706265+0000","last_became_active":"2024-09-10T08:33:53.704048+0000","last_became_peered":"2024-09-10T08:33:53.704048+0000","last_unstale":"2024-09-10T08:33:53.706265+0000","last_undegraded":"2024-09-10T08:33:53.706265+0000","last_fullsized":"2024-09-10T08:33:53.706265+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:52.207436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680164+0000","last_change":"2024-09-10T08:33:53.690774+0000","last_active":"2024-09-10T08:33:54.680164+0000","last_peered":"2024-09-10T08:33:54.680164+0000","last_clean":"2024-09-10T08:33:54.680164+0000","last_became_active":"2024-09-10T08:33:53.690512+0000","last_became_peered":"2024-09-10T08:33:53.690512+0000","last_unstale":"2024-09-10T08:33:54.680164+0000","last_undegraded":"2024-09-10T08:33:54.680164+0000","last_fullsized":"2024-09-10T08:33:54.680164+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:21.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709291+0000","last_change":"2024-09-10T08:33:53.702087+0000","last_active":"2024-09-10T08:33:53.709291+0000","last_peered":"2024-09-10T08:33:53.709291+0000","last_clean":"2024-09-10T08:33:53.709291+0000","last_became_active":"2024-09-10T08:33:53.701546+0000","last_became_peered":"2024-09-10T08:33:53.701546+0000","last_unstale":"2024-09-10T08:33:53.709291+0000","last_undegraded":"2024-09-10T08:33:53.709291+0000","last_fullsized":"2024-09-10T08:33:53.709291+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:29.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679879+0000","last_change":"2024-09-10T08:33:53.706440+0000","last_active":"2024-09-10T08:33:54.679879+0000","last_peered":"2024-09-10T08:33:54.679879+0000","last_clean":"2024-09-10T08:33:54.679879+0000","last_became_active":"2024-09-10T08:33:53.698058+0000","last_became_peered":"2024-09-10T08:33:53.698058+0000","last_unstale":"2024-09-10T08:33:54.679879+0000","last_undegraded":"2024-09-10T08:33:54.679879+0000","last_fullsized":"2024-09-10T08:33:54.679879+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:21.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678596+0000","last_change":"2024-09-10T08:33:53.700677+0000","last_active":"2024-09-10T08:33:54.678596+0000","last_peered":"2024-09-10T08:33:54.678596+0000","last_clean":"2024-09-10T08:33:54.678596+0000","last_became_active":"2024-09-10T08:33:53.700317+0000","last_became_peered":"2024-09-10T08:33:53.700317+0000","last_unstale":"2024-09-10T08:33:54.678596+0000","last_undegraded":"2024-09-10T08:33:54.678596+0000","last_fullsized":"2024-09-10T08:33:54.678596+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:50.764109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678593+0000","last_change":"2024-09-10T08:33:53.699319+0000","last_active":"2024-09-10T08:33:54.678593+0000","last_peered":"2024-09-10T08:33:54.678593+0000","last_clean":"2024-09-10T08:33:54.678593+0000","last_became_active":"2024-09-10T08:33:53.699027+0000","last_became_peered":"2024-09-10T08:33:53.699027+0000","last_unstale":"2024-09-10T08:33:54.678593+0000","last_undegraded":"2024-09-10T08:33:54.678593+0000","last_fullsized":"2024-09-10T08:33:54.678593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:32.570200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.708158+0000","last_change":"2024-09-10T08:33:53.703593+0000","last_active":"2024-09-10T08:33:53.708158+0000","last_peered":"2024-09-10T08:33:53.708158+0000","last_clean":"2024-09-10T08:33:53.708158+0000","last_became_active":"2024-09-10T08:33:53.703299+0000","last_became_peered":"2024-09-10T08:33:53.703299+0000","last_unstale":"2024-09-10T08:33:53.708158+0000","last_undegraded":"2024-09-10T08:33:53.708158+0000","last_fullsized":"2024-09-10T08:33:53.708158+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:13.807181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"92'4","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.718881+0000","last_change":"2024-09-10T08:33:52.691471+0000","last_active":"2024-09-10T08:33:53.718881+0000","last_peered":"2024-09-10T08:33:53.718881+0000","last_clean":"2024-09-10T08:33:53.718881+0000","last_became_active":"2024-09-10T08:33:52.680704+0000","last_became_peered":"2024-09-10T08:33:52.680704+0000","last_unstale":"2024-09-10T08:33:53.718881+0000","last_undegraded":"2024-09-10T08:33:53.718881+0000","last_fullsized":"2024-09-10T08:33:53.718881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.775498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680485+0000","last_change":"2024-09-10T08:33:53.688854+0000","last_active":"2024-09-10T08:33:54.680485+0000","last_peered":"2024-09-10T08:33:54.680485+0000","last_clean":"2024-09-10T08:33:54.680485+0000","last_became_active":"2024-09-10T08:33:53.688260+0000","last_became_peered":"2024-09-10T08:33:53.688260+0000","last_unstale":"2024-09-10T08:33:54.680485+0000","last_undegraded":"2024-09-10T08:33:54.680485+0000","last_fullsized":"2024-09-10T08:33:54.680485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678861+0000","last_change":"2024-09-10T08:33:52.685339+0000","last_active":"2024-09-10T08:33:54.678861+0000","last_peered":"2024-09-10T08:33:54.678861+0000","last_clean":"2024-09-10T08:33:54.678861+0000","last_became_active":"2024-09-10T08:33:52.684827+0000","last_became_peered":"2024-09-10T08:33:52.684827+0000","last_unstale":"2024-09-10T08:33:54.678861+0000","last_undegraded":"2024-09-10T08:33:54.678861+0000","last_fullsized":"2024-09-10T08:33:54.678861+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:45.565784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709629+0000","last_change":"2024-09-10T08:33:53.704864+0000","last_active":"2024-09-10T08:33:53.709629+0000","last_peered":"2024-09-10T08:33:53.709629+0000","last_clean":"2024-09-10T08:33:53.709629+0000","last_became_active":"2024-09-10T08:33:53.703028+0000","last_became_peered":"2024-09-10T08:33:53.703028+0000","last_unstale":"2024-09-10T08:33:53.709629+0000","last_undegraded":"2024-09-10T08:33:53.709629+0000","last_fullsized":"2024-09-10T08:33:53.709629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:17.437870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699887+0000","last_change":"2024-09-10T08:33:52.681243+0000","last_active":"2024-09-10T08:33:54.699887+0000","last_peered":"2024-09-10T08:33:54.699887+0000","last_clean":"2024-09-10T08:33:54.699887+0000","last_became_active":"2024-09-10T08:33:52.680938+0000","last_became_peered":"2024-09-10T08:33:52.680938+0000","last_unstale":"2024-09-10T08:33:54.699887+0000","last_undegraded":"2024-09-10T08:33:54.699887+0000","last_fullsized":"2024-09-10T08:33:54.699887+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:25.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680343+0000","last_change":"2024-09-10T08:33:53.715614+0000","last_active":"2024-09-10T08:33:54.680343+0000","last_peered":"2024-09-10T08:33:54.680343+0000","last_clean":"2024-09-10T08:33:54.680343+0000","last_became_active":"2024-09-10T08:33:53.715267+0000","last_became_peered":"2024-09-10T08:33:53.715267+0000","last_unstale":"2024-09-10T08:33:54.680343+0000","last_undegraded":"2024-09-10T08:33:54.680343+0000","last_fullsized":"2024-09-10T08:33:54.680343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"92'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.715219+0000","last_change":"2024-09-10T08:33:52.677242+0000","last_active":"2024-09-10T08:33:53.715219+0000","last_peered":"2024-09-10T08:33:53.715219+0000","last_clean":"2024-09-10T08:33:53.715219+0000","last_became_active":"2024-09-10T08:33:52.676869+0000","last_became_peered":"2024-09-10T08:33:52.676869+0000","last_unstale":"2024-09-10T08:33:53.715219+0000","last_undegraded":"2024-09-10T08:33:53.715219+0000","last_fullsized":"2024-09-10T08:33:53.715219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:19.786062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710794+0000","last_change":"2024-09-10T08:33:53.704845+0000","last_active":"2024-09-10T08:33:53.710794+0000","last_peered":"2024-09-10T08:33:53.710794+0000","last_clean":"2024-09-10T08:33:53.710794+0000","last_became_active":"2024-09-10T08:33:53.704195+0000","last_became_peered":"2024-09-10T08:33:53.704195+0000","last_unstale":"2024-09-10T08:33:53.710794+0000","last_undegraded":"2024-09-10T08:33:53.710794+0000","last_fullsized":"2024-09-10T08:33:53.710794+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:43.721984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.716236+0000","last_change":"2024-09-10T08:33:52.680192+0000","last_active":"2024-09-10T08:33:53.716236+0000","last_peered":"2024-09-10T08:33:53.716236+0000","last_clean":"2024-09-10T08:33:53.716236+0000","last_became_active":"2024-09-10T08:33:52.679359+0000","last_became_peered":"2024-09-10T08:33:52.679359+0000","last_unstale":"2024-09-10T08:33:53.716236+0000","last_undegraded":"2024-09-10T08:33:53.716236+0000","last_fullsized":"2024-09-10T08:33:53.716236+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:34.159309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678725+0000","last_change":"2024-09-10T08:33:53.682457+0000","last_active":"2024-09-10T08:33:54.678725+0000","last_peered":"2024-09-10T08:33:54.678725+0000","last_clean":"2024-09-10T08:33:54.678725+0000","last_became_active":"2024-09-10T08:33:53.682117+0000","last_became_peered":"2024-09-10T08:33:53.682117+0000","last_unstale":"2024-09-10T08:33:54.678725+0000","last_undegraded":"2024-09-10T08:33:54.678725+0000","last_fullsized":"2024-09-10T08:33:54.678725+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:10.157258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679332+0000","last_change":"2024-09-10T08:33:52.688334+0000","last_active":"2024-09-10T08:33:54.679332+0000","last_peered":"2024-09-10T08:33:54.679332+0000","last_clean":"2024-09-10T08:33:54.679332+0000","last_became_active":"2024-09-10T08:33:52.687647+0000","last_became_peered":"2024-09-10T08:33:52.687647+0000","last_unstale":"2024-09-10T08:33:54.679332+0000","last_undegraded":"2024-09-10T08:33:54.679332+0000","last_fullsized":"2024-09-10T08:33:54.679332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:32.059081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680134+0000","last_change":"2024-09-10T08:33:53.707133+0000","last_active":"2024-09-10T08:33:54.680134+0000","last_peered":"2024-09-10T08:33:54.680134+0000","last_clean":"2024-09-10T08:33:54.680134+0000","last_became_active":"2024-09-10T08:33:53.706784+0000","last_became_peered":"2024-09-10T08:33:53.706784+0000","last_unstale":"2024-09-10T08:33:54.680134+0000","last_undegraded":"2024-09-10T08:33:54.680134+0000","last_fullsized":"2024-09-10T08:33:54.680134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:35.165345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679898+0000","last_change":"2024-09-10T08:33:52.688743+0000","last_active":"2024-09-10T08:33:54.679898+0000","last_peered":"2024-09-10T08:33:54.679898+0000","last_clean":"2024-09-10T08:33:54.679898+0000","last_became_active":"2024-09-10T08:33:52.688456+0000","last_became_peered":"2024-09-10T08:33:52.688456+0000","last_unstale":"2024-09-10T08:33:54.679898+0000","last_undegraded":"2024-09-10T08:33:54.679898+0000","last_fullsized":"2024-09-10T08:33:54.679898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:58.339554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679551+0000","last_change":"2024-09-10T08:33:53.698416+0000","last_active":"2024-09-10T08:33:54.679551+0000","last_peered":"2024-09-10T08:33:54.679551+0000","last_clean":"2024-09-10T08:33:54.679551+0000","last_became_active":"2024-09-10T08:33:53.698089+0000","last_became_peered":"2024-09-10T08:33:53.698089+0000","last_unstale":"2024-09-10T08:33:54.679551+0000","last_undegraded":"2024-09-10T08:33:54.679551+0000","last_fullsized":"2024-09-10T08:33:54.679551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:13.475789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679447+0000","last_change":"2024-09-10T08:33:52.686456+0000","last_active":"2024-09-10T08:33:54.679447+0000","last_peered":"2024-09-10T08:33:54.679447+0000","last_clean":"2024-09-10T08:33:54.679447+0000","last_became_active":"2024-09-10T08:33:52.685983+0000","last_became_peered":"2024-09-10T08:33:52.685983+0000","last_unstale":"2024-09-10T08:33:54.679447+0000","last_undegraded":"2024-09-10T08:33:54.679447+0000","last_fullsized":"2024-09-10T08:33:54.679447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:14.002183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680293+0000","last_change":"2024-09-10T08:33:53.685917+0000","last_active":"2024-09-10T08:33:54.680293+0000","last_peered":"2024-09-10T08:33:54.680293+0000","last_clean":"2024-09-10T08:33:54.680293+0000","last_became_active":"2024-09-10T08:33:53.685626+0000","last_became_peered":"2024-09-10T08:33:53.685626+0000","last_unstale":"2024-09-10T08:33:54.680293+0000","last_undegraded":"2024-09-10T08:33:54.680293+0000","last_fullsized":"2024-09-10T08:33:54.680293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680591+0000","last_change":"2024-09-10T08:33:52.686401+0000","last_active":"2024-09-10T08:33:54.680591+0000","last_peered":"2024-09-10T08:33:54.680591+0000","last_clean":"2024-09-10T08:33:54.680591+0000","last_became_active":"2024-09-10T08:33:52.686153+0000","last_became_peered":"2024-09-10T08:33:52.686153+0000","last_unstale":"2024-09-10T08:33:54.680591+0000","last_undegraded":"2024-09-10T08:33:54.680591+0000","last_fullsized":"2024-09-10T08:33:54.680591+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:58.339554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680556+0000","last_change":"2024-09-10T08:33:53.707453+0000","last_active":"2024-09-10T08:33:54.680556+0000","last_peered":"2024-09-10T08:33:54.680556+0000","last_clean":"2024-09-10T08:33:54.680556+0000","last_became_active":"2024-09-10T08:33:53.707148+0000","last_became_peered":"2024-09-10T08:33:53.707148+0000","last_unstale":"2024-09-10T08:33:54.680556+0000","last_undegraded":"2024-09-10T08:33:54.680556+0000","last_fullsized":"2024-09-10T08:33:54.680556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678958+0000","last_change":"2024-09-10T08:33:52.682588+0000","last_active":"2024-09-10T08:33:54.678958+0000","last_peered":"2024-09-10T08:33:54.678958+0000","last_clean":"2024-09-10T08:33:54.678958+0000","last_became_active":"2024-09-10T08:33:52.682060+0000","last_became_peered":"2024-09-10T08:33:52.682060+0000","last_unstale":"2024-09-10T08:33:54.678958+0000","last_undegraded":"2024-09-10T08:33:54.678958+0000","last_fullsized":"2024-09-10T08:33:54.678958+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:55.706331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699348+0000","last_change":"2024-09-10T08:33:53.715180+0000","last_active":"2024-09-10T08:33:54.699348+0000","last_peered":"2024-09-10T08:33:54.699348+0000","last_clean":"2024-09-10T08:33:54.699348+0000","last_became_active":"2024-09-10T08:33:53.713930+0000","last_became_peered":"2024-09-10T08:33:53.713930+0000","last_unstale":"2024-09-10T08:33:54.699348+0000","last_undegraded":"2024-09-10T08:33:54.699348+0000","last_fullsized":"2024-09-10T08:33:54.699348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"92'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680447+0000","last_change":"2024-09-10T08:33:52.686573+0000","last_active":"2024-09-10T08:33:54.680447+0000","last_peered":"2024-09-10T08:33:54.680447+0000","last_clean":"2024-09-10T08:33:54.680447+0000","last_became_active":"2024-09-10T08:33:52.686294+0000","last_became_peered":"2024-09-10T08:33:52.686294+0000","last_unstale":"2024-09-10T08:33:54.680447+0000","last_undegraded":"2024-09-10T08:33:54.680447+0000","last_fullsized":"2024-09-10T08:33:54.680447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:05.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.713183+0000","last_change":"2024-09-10T08:33:53.712236+0000","last_active":"2024-09-10T08:33:53.713183+0000","last_peered":"2024-09-10T08:33:53.713183+0000","last_clean":"2024-09-10T08:33:53.713183+0000","last_became_active":"2024-09-10T08:33:53.711905+0000","last_became_peered":"2024-09-10T08:33:53.711905+0000","last_unstale":"2024-09-10T08:33:53.713183+0000","last_undegraded":"2024-09-10T08:33:53.713183+0000","last_fullsized":"2024-09-10T08:33:53.713183+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:56.179377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.719443+0000","last_change":"2024-09-10T08:33:52.676911+0000","last_active":"2024-09-10T08:33:53.719443+0000","last_peered":"2024-09-10T08:33:53.719443+0000","last_clean":"2024-09-10T08:33:53.719443+0000","last_became_active":"2024-09-10T08:33:52.676642+0000","last_became_peered":"2024-09-10T08:33:52.676642+0000","last_unstale":"2024-09-10T08:33:53.719443+0000","last_undegraded":"2024-09-10T08:33:53.719443+0000","last_fullsized":"2024-09-10T08:33:53.719443+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:20.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699577+0000","last_change":"2024-09-10T08:33:53.706297+0000","last_active":"2024-09-10T08:33:54.699577+0000","last_peered":"2024-09-10T08:33:54.699577+0000","last_clean":"2024-09-10T08:33:54.699577+0000","last_became_active":"2024-09-10T08:33:53.704399+0000","last_became_peered":"2024-09-10T08:33:53.704399+0000","last_unstale":"2024-09-10T08:33:54.699577+0000","last_undegraded":"2024-09-10T08:33:54.699577+0000","last_fullsized":"2024-09-10T08:33:54.699577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:36.168284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"92'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.717254+0000","last_change":"2024-09-10T08:33:52.678312+0000","last_active":"2024-09-10T08:33:53.717254+0000","last_peered":"2024-09-10T08:33:53.717254+0000","last_clean":"2024-09-10T08:33:53.717254+0000","last_became_active":"2024-09-10T08:33:52.677020+0000","last_became_peered":"2024-09-10T08:33:52.677020+0000","last_unstale":"2024-09-10T08:33:53.717254+0000","last_undegraded":"2024-09-10T08:33:53.717254+0000","last_fullsized":"2024-09-10T08:33:53.717254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:17.851981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680099+0000","last_change":"2024-09-10T08:33:53.707336+0000","last_active":"2024-09-10T08:33:54.680099+0000","last_peered":"2024-09-10T08:33:54.680099+0000","last_clean":"2024-09-10T08:33:54.680099+0000","last_became_active":"2024-09-10T08:33:53.707003+0000","last_became_peered":"2024-09-10T08:33:53.707003+0000","last_unstale":"2024-09-10T08:33:54.680099+0000","last_undegraded":"2024-09-10T08:33:54.680099+0000","last_fullsized":"2024-09-10T08:33:54.680099+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.785739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702063+0000","last_change":"2024-09-10T08:33:52.681297+0000","last_active":"2024-09-10T08:33:54.702063+0000","last_peered":"2024-09-10T08:33:54.702063+0000","last_clean":"2024-09-10T08:33:54.702063+0000","last_became_active":"2024-09-10T08:33:52.680989+0000","last_became_peered":"2024-09-10T08:33:52.680989+0000","last_unstale":"2024-09-10T08:33:54.702063+0000","last_undegraded":"2024-09-10T08:33:54.702063+0000","last_fullsized":"2024-09-10T08:33:54.702063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:32.059081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679526+0000","last_change":"2024-09-10T08:33:53.703891+0000","last_active":"2024-09-10T08:33:54.679526+0000","last_peered":"2024-09-10T08:33:54.679526+0000","last_clean":"2024-09-10T08:33:54.679526+0000","last_became_active":"2024-09-10T08:33:53.703617+0000","last_became_peered":"2024-09-10T08:33:53.703617+0000","last_unstale":"2024-09-10T08:33:54.679526+0000","last_undegraded":"2024-09-10T08:33:54.679526+0000","last_fullsized":"2024-09-10T08:33:54.679526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:37.352261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679019+0000","last_change":"2024-09-10T08:33:52.681840+0000","last_active":"2024-09-10T08:33:54.679019+0000","last_peered":"2024-09-10T08:33:54.679019+0000","last_clean":"2024-09-10T08:33:54.679019+0000","last_became_active":"2024-09-10T08:33:52.681600+0000","last_became_peered":"2024-09-10T08:33:52.681600+0000","last_unstale":"2024-09-10T08:33:54.679019+0000","last_undegraded":"2024-09-10T08:33:54.679019+0000","last_fullsized":"2024-09-10T08:33:54.679019+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:16.431833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699303+0000","last_change":"2024-09-10T08:33:53.705532+0000","last_active":"2024-09-10T08:33:54.699303+0000","last_peered":"2024-09-10T08:33:54.699303+0000","last_clean":"2024-09-10T08:33:54.699303+0000","last_became_active":"2024-09-10T08:33:53.704633+0000","last_became_peered":"2024-09-10T08:33:53.704633+0000","last_unstale":"2024-09-10T08:33:54.699303+0000","last_undegraded":"2024-09-10T08:33:54.699303+0000","last_fullsized":"2024-09-10T08:33:54.699303+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"92'8","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699745+0000","last_change":"2024-09-10T08:33:52.690168+0000","last_active":"2024-09-10T08:33:54.699745+0000","last_peered":"2024-09-10T08:33:54.699745+0000","last_clean":"2024-09-10T08:33:54.699745+0000","last_became_active":"2024-09-10T08:33:52.689848+0000","last_became_peered":"2024-09-10T08:33:52.689848+0000","last_unstale":"2024-09-10T08:33:54.699745+0000","last_undegraded":"2024-09-10T08:33:54.699745+0000","last_fullsized":"2024-09-10T08:33:54.699745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:31.698414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.708139+0000","last_change":"2024-09-10T08:33:53.703284+0000","last_active":"2024-09-10T08:33:53.708139+0000","last_peered":"2024-09-10T08:33:53.708139+0000","last_clean":"2024-09-10T08:33:53.708139+0000","last_became_active":"2024-09-10T08:33:53.703009+0000","last_became_peered":"2024-09-10T08:33:53.703009+0000","last_unstale":"2024-09-10T08:33:53.708139+0000","last_undegraded":"2024-09-10T08:33:53.708139+0000","last_fullsized":"2024-09-10T08:33:53.708139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:41.056620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.717327+0000","last_change":"2024-09-10T08:33:52.681476+0000","last_active":"2024-09-10T08:33:53.717327+0000","last_peered":"2024-09-10T08:33:53.717327+0000","last_clean":"2024-09-10T08:33:53.717327+0000","last_became_active":"2024-09-10T08:33:52.681172+0000","last_became_peered":"2024-09-10T08:33:52.681172+0000","last_unstale":"2024-09-10T08:33:53.717327+0000","last_undegraded":"2024-09-10T08:33:53.717327+0000","last_fullsized":"2024-09-10T08:33:53.717327+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:27.353779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678974+0000","last_change":"2024-09-10T08:33:53.697286+0000","last_active":"2024-09-10T08:33:54.678974+0000","last_peered":"2024-09-10T08:33:54.678974+0000","last_clean":"2024-09-10T08:33:54.678974+0000","last_became_active":"2024-09-10T08:33:53.696804+0000","last_became_peered":"2024-09-10T08:33:53.696804+0000","last_unstale":"2024-09-10T08:33:54.678974+0000","last_undegraded":"2024-09-10T08:33:54.678974+0000","last_fullsized":"2024-09-10T08:33:54.678974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:17.968758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680249+0000","last_change":"2024-09-10T08:33:52.688828+0000","last_active":"2024-09-10T08:33:54.680249+0000","last_peered":"2024-09-10T08:33:54.680249+0000","last_clean":"2024-09-10T08:33:54.680249+0000","last_became_active":"2024-09-10T08:33:52.688409+0000","last_became_peered":"2024-09-10T08:33:52.688409+0000","last_unstale":"2024-09-10T08:33:54.680249+0000","last_undegraded":"2024-09-10T08:33:54.680249+0000","last_fullsized":"2024-09-10T08:33:54.680249+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:11.442154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.706208+0000","last_change":"2024-09-10T08:33:53.698394+0000","last_active":"2024-09-10T08:33:53.706208+0000","last_peered":"2024-09-10T08:33:53.706208+0000","last_clean":"2024-09-10T08:33:53.706208+0000","last_became_active":"2024-09-10T08:33:53.698128+0000","last_became_peered":"2024-09-10T08:33:53.698128+0000","last_unstale":"2024-09-10T08:33:53.706208+0000","last_undegraded":"2024-09-10T08:33:53.706208+0000","last_fullsized":"2024-09-10T08:33:53.706208+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680254+0000","last_change":"2024-09-10T08:33:52.685574+0000","last_active":"2024-09-10T08:33:54.680254+0000","last_peered":"2024-09-10T08:33:54.680254+0000","last_clean":"2024-09-10T08:33:54.680254+0000","last_became_active":"2024-09-10T08:33:52.685268+0000","last_became_peered":"2024-09-10T08:33:52.685268+0000","last_unstale":"2024-09-10T08:33:54.680254+0000","last_undegraded":"2024-09-10T08:33:54.680254+0000","last_fullsized":"2024-09-10T08:33:54.680254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:06.198499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702038+0000","last_change":"2024-09-10T08:33:53.711749+0000","last_active":"2024-09-10T08:33:54.702038+0000","last_peered":"2024-09-10T08:33:54.702038+0000","last_clean":"2024-09-10T08:33:54.702038+0000","last_became_active":"2024-09-10T08:33:53.708449+0000","last_became_peered":"2024-09-10T08:33:53.708449+0000","last_unstale":"2024-09-10T08:33:54.702038+0000","last_undegraded":"2024-09-10T08:33:54.702038+0000","last_fullsized":"2024-09-10T08:33:54.702038+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:16.504099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679803+0000","last_change":"2024-09-10T08:33:52.690398+0000","last_active":"2024-09-10T08:33:54.679803+0000","last_peered":"2024-09-10T08:33:54.679803+0000","last_clean":"2024-09-10T08:33:54.679803+0000","last_became_active":"2024-09-10T08:33:52.690118+0000","last_became_peered":"2024-09-10T08:33:52.690118+0000","last_unstale":"2024-09-10T08:33:54.679803+0000","last_undegraded":"2024-09-10T08:33:54.679803+0000","last_fullsized":"2024-09-10T08:33:54.679803+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:36.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.711539+0000","last_change":"2024-09-10T08:33:53.709096+0000","last_active":"2024-09-10T08:33:53.711539+0000","last_peered":"2024-09-10T08:33:53.711539+0000","last_clean":"2024-09-10T08:33:53.711539+0000","last_became_active":"2024-09-10T08:33:53.705692+0000","last_became_peered":"2024-09-10T08:33:53.705692+0000","last_unstale":"2024-09-10T08:33:53.711539+0000","last_undegraded":"2024-09-10T08:33:53.711539+0000","last_fullsized":"2024-09-10T08:33:53.711539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.851164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702170+0000","last_change":"2024-09-10T08:33:52.673589+0000","last_active":"2024-09-10T08:33:54.702170+0000","last_peered":"2024-09-10T08:33:54.702170+0000","last_clean":"2024-09-10T08:33:54.702170+0000","last_became_active":"2024-09-10T08:33:52.673136+0000","last_became_peered":"2024-09-10T08:33:52.673136+0000","last_unstale":"2024-09-10T08:33:54.702170+0000","last_undegraded":"2024-09-10T08:33:54.702170+0000","last_fullsized":"2024-09-10T08:33:54.702170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710837+0000","last_change":"2024-09-10T08:33:53.703937+0000","last_active":"2024-09-10T08:33:53.710837+0000","last_peered":"2024-09-10T08:33:53.710837+0000","last_clean":"2024-09-10T08:33:53.710837+0000","last_became_active":"2024-09-10T08:33:53.703593+0000","last_became_peered":"2024-09-10T08:33:53.703593+0000","last_unstale":"2024-09-10T08:33:53.710837+0000","last_undegraded":"2024-09-10T08:33:53.710837+0000","last_fullsized":"2024-09-10T08:33:53.710837+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:09.673622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699514+0000","last_change":"2024-09-10T08:33:52.682692+0000","last_active":"2024-09-10T08:33:54.699514+0000","last_peered":"2024-09-10T08:33:54.699514+0000","last_clean":"2024-09-10T08:33:54.699514+0000","last_became_active":"2024-09-10T08:33:52.682409+0000","last_became_peered":"2024-09-10T08:33:52.682409+0000","last_unstale":"2024-09-10T08:33:54.699514+0000","last_undegraded":"2024-09-10T08:33:54.699514+0000","last_fullsized":"2024-09-10T08:33:54.699514+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:37.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709950+0000","last_change":"2024-09-10T08:33:53.706276+0000","last_active":"2024-09-10T08:33:53.709950+0000","last_peered":"2024-09-10T08:33:53.709950+0000","last_clean":"2024-09-10T08:33:53.709950+0000","last_became_active":"2024-09-10T08:33:53.705925+0000","last_became_peered":"2024-09-10T08:33:53.705925+0000","last_unstale":"2024-09-10T08:33:53.709950+0000","last_undegraded":"2024-09-10T08:33:53.709950+0000","last_fullsized":"2024-09-10T08:33:53.709950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:33.065118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679564+0000","last_change":"2024-09-10T08:33:52.684727+0000","last_active":"2024-09-10T08:33:54.679564+0000","last_peered":"2024-09-10T08:33:54.679564+0000","last_clean":"2024-09-10T08:33:54.679564+0000","last_became_active":"2024-09-10T08:33:52.684455+0000","last_became_peered":"2024-09-10T08:33:52.684455+0000","last_unstale":"2024-09-10T08:33:54.679564+0000","last_undegraded":"2024-09-10T08:33:54.679564+0000","last_fullsized":"2024-09-10T08:33:54.679564+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:05.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.705538+0000","last_change":"2024-09-10T08:33:53.702410+0000","last_active":"2024-09-10T08:33:53.705538+0000","last_peered":"2024-09-10T08:33:53.705538+0000","last_clean":"2024-09-10T08:33:53.705538+0000","last_became_active":"2024-09-10T08:33:53.702099+0000","last_became_peered":"2024-09-10T08:33:53.702099+0000","last_unstale":"2024-09-10T08:33:53.705538+0000","last_undegraded":"2024-09-10T08:33:53.705538+0000","last_fullsized":"2024-09-10T08:33:53.705538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:52.415147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680075+0000","last_change":"2024-09-10T08:33:52.687725+0000","last_active":"2024-09-10T08:33:54.680075+0000","last_peered":"2024-09-10T08:33:54.680075+0000","last_clean":"2024-09-10T08:33:54.680075+0000","last_became_active":"2024-09-10T08:33:52.687452+0000","last_became_peered":"2024-09-10T08:33:52.687452+0000","last_unstale":"2024-09-10T08:33:54.680075+0000","last_undegraded":"2024-09-10T08:33:54.680075+0000","last_fullsized":"2024-09-10T08:33:54.680075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:20.377647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.712341+0000","last_change":"2024-09-10T08:33:53.709231+0000","last_active":"2024-09-10T08:33:53.712341+0000","last_peered":"2024-09-10T08:33:53.712341+0000","last_clean":"2024-09-10T08:33:53.712341+0000","last_became_active":"2024-09-10T08:33:53.708911+0000","last_became_peered":"2024-09-10T08:33:53.708911+0000","last_unstale":"2024-09-10T08:33:53.712341+0000","last_undegraded":"2024-09-10T08:33:53.712341+0000","last_fullsized":"2024-09-10T08:33:53.712341+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:19.290376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"93'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.701363+0000","last_change":"2024-09-10T08:33:52.674114+0000","last_active":"2024-09-10T08:33:54.701363+0000","last_peered":"2024-09-10T08:33:54.701363+0000","last_clean":"2024-09-10T08:33:54.701363+0000","last_became_active":"2024-09-10T08:33:52.673833+0000","last_became_peered":"2024-09-10T08:33:52.673833+0000","last_unstale":"2024-09-10T08:33:54.701363+0000","last_undegraded":"2024-09-10T08:33:54.701363+0000","last_fullsized":"2024-09-10T08:33:54.701363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:18.567706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.700649+0000","last_change":"2024-09-10T08:33:53.697025+0000","last_active":"2024-09-10T08:33:53.700649+0000","last_peered":"2024-09-10T08:33:53.700649+0000","last_clean":"2024-09-10T08:33:53.700649+0000","last_became_active":"2024-09-10T08:33:53.696577+0000","last_became_peered":"2024-09-10T08:33:53.696577+0000","last_unstale":"2024-09-10T08:33:53.700649+0000","last_undegraded":"2024-09-10T08:33:53.700649+0000","last_fullsized":"2024-09-10T08:33:53.700649+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:53.442709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.686968+0000","last_change":"2024-09-10T08:33:52.677746+0000","last_active":"2024-09-10T08:33:53.686968+0000","last_peered":"2024-09-10T08:33:53.686968+0000","last_clean":"2024-09-10T08:33:53.686968+0000","last_became_active":"2024-09-10T08:33:52.677478+0000","last_became_peered":"2024-09-10T08:33:52.677478+0000","last_unstale":"2024-09-10T08:33:53.686968+0000","last_undegraded":"2024-09-10T08:33:53.686968+0000","last_fullsized":"2024-09-10T08:33:53.686968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:33.783073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678921+0000","last_change":"2024-09-10T08:33:53.685279+0000","last_active":"2024-09-10T08:33:54.678921+0000","last_peered":"2024-09-10T08:33:54.678921+0000","last_clean":"2024-09-10T08:33:54.678921+0000","last_became_active":"2024-09-10T08:33:53.684998+0000","last_became_peered":"2024-09-10T08:33:53.684998+0000","last_unstale":"2024-09-10T08:33:54.678921+0000","last_undegraded":"2024-09-10T08:33:54.678921+0000","last_fullsized":"2024-09-10T08:33:54.678921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:55.286538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679380+0000","last_change":"2024-09-10T08:33:52.685279+0000","last_active":"2024-09-10T08:33:54.679380+0000","last_peered":"2024-09-10T08:33:54.679380+0000","last_clean":"2024-09-10T08:33:54.679380+0000","last_became_active":"2024-09-10T08:33:52.684928+0000","last_became_peered":"2024-09-10T08:33:52.684928+0000","last_unstale":"2024-09-10T08:33:54.679380+0000","last_undegraded":"2024-09-10T08:33:54.679380+0000","last_fullsized":"2024-09-10T08:33:54.679380+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680053+0000","last_change":"2024-09-10T08:33:53.683529+0000","last_active":"2024-09-10T08:33:54.680053+0000","last_peered":"2024-09-10T08:33:54.680053+0000","last_clean":"2024-09-10T08:33:54.680053+0000","last_became_active":"2024-09-10T08:33:53.682914+0000","last_became_peered":"2024-09-10T08:33:53.682914+0000","last_unstale":"2024-09-10T08:33:54.680053+0000","last_undegraded":"2024-09-10T08:33:54.680053+0000","last_fullsized":"2024-09-10T08:33:54.680053+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:13.475789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702303+0000","last_change":"2024-09-10T08:33:52.682175+0000","last_active":"2024-09-10T08:33:54.702303+0000","last_peered":"2024-09-10T08:33:54.702303+0000","last_clean":"2024-09-10T08:33:54.702303+0000","last_became_active":"2024-09-10T08:33:52.681879+0000","last_became_peered":"2024-09-10T08:33:52.681879+0000","last_unstale":"2024-09-10T08:33:54.702303+0000","last_undegraded":"2024-09-10T08:33:54.702303+0000","last_fullsized":"2024-09-10T08:33:54.702303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:38.783574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699465+0000","last_change":"2024-09-10T08:33:53.699538+0000","last_active":"2024-09-10T08:33:54.699465+0000","last_peered":"2024-09-10T08:33:54.699465+0000","last_clean":"2024-09-10T08:33:54.699465+0000","last_became_active":"2024-09-10T08:33:53.697874+0000","last_became_peered":"2024-09-10T08:33:53.697874+0000","last_unstale":"2024-09-10T08:33:54.699465+0000","last_undegraded":"2024-09-10T08:33:54.699465+0000","last_fullsized":"2024-09-10T08:33:54.699465+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:13.807181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679402+0000","last_change":"2024-09-10T08:33:52.690110+0000","last_active":"2024-09-10T08:33:54.679402+0000","last_peered":"2024-09-10T08:33:54.679402+0000","last_clean":"2024-09-10T08:33:54.679402+0000","last_became_active":"2024-09-10T08:33:52.689765+0000","last_became_peered":"2024-09-10T08:33:52.689765+0000","last_unstale":"2024-09-10T08:33:54.679402+0000","last_undegraded":"2024-09-10T08:33:54.679402+0000","last_fullsized":"2024-09-10T08:33:54.679402+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:38.783574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680020+0000","last_change":"2024-09-10T08:33:53.683233+0000","last_active":"2024-09-10T08:33:54.680020+0000","last_peered":"2024-09-10T08:33:54.680020+0000","last_clean":"2024-09-10T08:33:54.680020+0000","last_became_active":"2024-09-10T08:33:53.682926+0000","last_became_peered":"2024-09-10T08:33:53.682926+0000","last_unstale":"2024-09-10T08:33:54.680020+0000","last_undegraded":"2024-09-10T08:33:54.680020+0000","last_fullsized":"2024-09-10T08:33:54.680020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:26.137366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679983+0000","last_change":"2024-09-10T08:33:52.687287+0000","last_active":"2024-09-10T08:33:54.679983+0000","last_peered":"2024-09-10T08:33:54.679983+0000","last_clean":"2024-09-10T08:33:54.679983+0000","last_became_active":"2024-09-10T08:33:52.686054+0000","last_became_peered":"2024-09-10T08:33:52.686054+0000","last_unstale":"2024-09-10T08:33:54.679983+0000","last_undegraded":"2024-09-10T08:33:54.679983+0000","last_fullsized":"2024-09-10T08:33:54.679983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:14.002183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680038+0000","last_change":"2024-09-10T08:33:53.693097+0000","last_active":"2024-09-10T08:33:54.680038+0000","last_peered":"2024-09-10T08:33:54.680038+0000","last_clean":"2024-09-10T08:33:54.680038+0000","last_became_active":"2024-09-10T08:33:53.692826+0000","last_became_peered":"2024-09-10T08:33:53.692826+0000","last_unstale":"2024-09-10T08:33:54.680038+0000","last_undegraded":"2024-09-10T08:33:54.680038+0000","last_fullsized":"2024-09-10T08:33:54.680038+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:37.352261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.685711+0000","last_change":"2024-09-10T08:33:52.672164+0000","last_active":"2024-09-10T08:33:53.685711+0000","last_peered":"2024-09-10T08:33:53.685711+0000","last_clean":"2024-09-10T08:33:53.685711+0000","last_became_active":"2024-09-10T08:33:52.671450+0000","last_became_peered":"2024-09-10T08:33:52.671450+0000","last_unstale":"2024-09-10T08:33:53.685711+0000","last_undegraded":"2024-09-10T08:33:53.685711+0000","last_fullsized":"2024-09-10T08:33:53.685711+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:36.779702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699436+0000","last_change":"2024-09-10T08:33:53.714549+0000","last_active":"2024-09-10T08:33:54.699436+0000","last_peered":"2024-09-10T08:33:54.699436+0000","last_clean":"2024-09-10T08:33:54.699436+0000","last_became_active":"2024-09-10T08:33:53.713465+0000","last_became_peered":"2024-09-10T08:33:53.713465+0000","last_unstale":"2024-09-10T08:33:54.699436+0000","last_undegraded":"2024-09-10T08:33:54.699436+0000","last_fullsized":"2024-09-10T08:33:54.699436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:41.056620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.715088+0000","last_change":"2024-09-10T08:33:52.683854+0000","last_active":"2024-09-10T08:33:53.715088+0000","last_peered":"2024-09-10T08:33:53.715088+0000","last_clean":"2024-09-10T08:33:53.715088+0000","last_became_active":"2024-09-10T08:33:52.683523+0000","last_became_peered":"2024-09-10T08:33:52.683523+0000","last_unstale":"2024-09-10T08:33:53.715088+0000","last_undegraded":"2024-09-10T08:33:53.715088+0000","last_fullsized":"2024-09-10T08:33:53.715088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:36.576295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":295,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680089+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:33:54.680089+0000","last_peered":"2024-09-10T08:33:54.680089+0000","last_clean":"2024-09-10T08:33:54.680089+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:33:54.680089+0000","last_undegraded":"2024-09-10T08:33:54.680089+0000","last_fullsized":"2024-09-10T08:33:54.680089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36448,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335392,"statfs":{"total":96636764160,"available":96599441408,"internally_reserved":0,"allocated":1126400,"data_stored":483669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36456,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335384,"statfs":{"total":96636764160,"available":96599433216,"internally_reserved":0,"allocated":1130496,"data_stored":484271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40608,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331232,"statfs":{"total":96636764160,"available":96595181568,"internally_reserved":0,"allocated":1126400,"data_stored":483633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1134592,"data_stored":484273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1122304,"data_stored":483599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1720320,"data_stored":1074057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1138688,"data_stored":485233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1732608,"data_stored":1075613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:33:57.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:33:58.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.088+0000 7fd63f200640 1 Processor -- start 2024-09-10T08:33:58.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.088+0000 7fd63f200640 1 -- start start 2024-09-10T08:33:58.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd64015e440 0x7fd6400d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400cf450 0x7fd6400b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6400b6540 0x7fd64006bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd6400b6990 con 0x7fd6400cf450 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd6400d3990 con 0x7fd64015e440 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd63f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400d3c70 con 0x7fd6400b6540 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd637e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400cf450 0x7fd6400b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd637e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd6400cf450 0x7fd6400b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37940/0 (socket says 172.21.15.52:37940) 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.089+0000 7fd637e00640 1 -- 172.21.15.52:0/2739541786 learned_addr learned my addr 172.21.15.52:0/2739541786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd63e800640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6400b6540 0x7fd64006bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd63de00640 1 --2- 172.21.15.52:0/2739541786 >> v2:172.21.15.176:3300/0 conn(0x7fd64015e440 0x7fd6400d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd637e00640 1 -- 172.21.15.52:0/2739541786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6400b6540 msgr2=0x7fd64006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd637e00640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6400b6540 0x7fd64006bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd637e00640 1 -- 172.21.15.52:0/2739541786 >> v2:172.21.15.176:3300/0 conn(0x7fd64015e440 msgr2=0x7fd6400d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:58.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd637e00640 1 --2- 172.21.15.52:0/2739541786 >> v2:172.21.15.176:3300/0 conn(0x7fd64015e440 0x7fd6400d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.090+0000 7fd637e00640 1 -- 172.21.15.52:0/2739541786 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400d3f50 con 0x7fd6400cf450 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.091+0000 7fd637e00640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6400b6000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd640068870 tx=0x7fd62802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e90184b12170fec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.091+0000 7fd63d400640 1 -- 172.21.15.52:0/2739541786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628037070 con 0x7fd6400cf450 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.091+0000 7fd63d400640 1 -- 172.21.15.52:0/2739541786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628032440 con 0x7fd6400cf450 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.091+0000 7fd63d400640 1 -- 172.21.15.52:0/2739541786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628032810 con 0x7fd6400cf450 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 -- 172.21.15.52:0/2739541786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 msgr2=0x7fd6400b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6400b6000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd640068870 tx=0x7fd62802a270 comp rx=0 tx=0).stop 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 -- 172.21.15.52:0/2739541786 shutdown_connections 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd6400b6540 0x7fd64006bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 --2- 172.21.15.52:0/2739541786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6400b6000 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 --2- 172.21.15.52:0/2739541786 >> v2:172.21.15.176:3300/0 conn(0x7fd64015e440 0x7fd6400d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 -- 172.21.15.52:0/2739541786 >> 172.21.15.52:0/2739541786 conn(0x7fd640067f80 msgr2=0x7fd6400d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 -- 172.21.15.52:0/2739541786 shutdown_connections 2024-09-10T08:33:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.092+0000 7fd63f200640 1 -- 172.21.15.52:0/2739541786 wait complete. 2024-09-10T08:33:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.094+0000 7fd63f200640 1 Processor -- start 2024-09-10T08:33:58.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.094+0000 7fd63f200640 1 -- start start 2024-09-10T08:33:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 0x7fd6400cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64015e440 0x7fd6400ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400b7540 con 0x7fd6400cf450 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd64015e820 con 0x7fd6400b6540 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400b76c0 con 0x7fd64015e440 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37942/0 (socket says 172.21.15.52:37942) 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 -- 172.21.15.52:0/3458459715 learned_addr learned my addr 172.21.15.52:0/3458459715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63de00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 0x7fd6400cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63e800640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64015e440 0x7fd6400ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 -- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64015e440 msgr2=0x7fd6400ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64015e440 0x7fd6400ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 -- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 msgr2=0x7fd6400cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 0x7fd6400cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd637e00640 1 -- 172.21.15.52:0/3458459715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400cdb60 con 0x7fd6400cf450 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.095+0000 7fd63de00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 0x7fd6400cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd637e00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd62802a2b0 tx=0x7fd6280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628041020 con 0x7fd6400cf450 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6280306c0 con 0x7fd6400cf450 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6400cde20 con 0x7fd6400cf450 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628037040 con 0x7fd6400cf450 2024-09-10T08:33:58.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.096+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64015f8e0 con 0x7fd6400cf450 2024-09-10T08:33:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.097+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6400cd940 con 0x7fd6400cf450 2024-09-10T08:33:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.098+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd628044020 con 0x7fd6400cf450 2024-09-10T08:33:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.099+0000 7fd636000640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 0x7fd61c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.099+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fd6280ab630 con 0x7fd6400cf450 2024-09-10T08:33:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.099+0000 7fd63de00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 0x7fd61c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.100+0000 7fd63de00640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 0x7fd61c06e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b970 tx=0x7fd630008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.103+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd62804b030 con 0x7fd6400cf450 2024-09-10T08:33:58.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.284+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6400d1bc0 con 0x7fd61c06be60 2024-09-10T08:33:58.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.291+0000 7fd636000640 1 -- 172.21.15.52:0/3458459715 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7fd6400d1bc0 con 0x7fd61c06be60 2024-09-10T08:33:58.293 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:58.294 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:33:58.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 msgr2=0x7fd61c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 0x7fd61c06e320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd63000b970 tx=0x7fd630008040 comp rx=0 tx=0).stop 2024-09-10T08:33:58.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 msgr2=0x7fd6401600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd62802a2b0 tx=0x7fd6280046c0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 shutdown_connections 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd61c06be60 0x7fd61c06e320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd64015e440 0x7fd6400ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6400cf450 0x7fd6401600e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 --2- 172.21.15.52:0/3458459715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd6400b6540 0x7fd6400cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 >> 172.21.15.52:0/3458459715 conn(0x7fd640067f80 msgr2=0x7fd6400d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 shutdown_connections 2024-09-10T08:33:58.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.295+0000 7fd63f200640 1 -- 172.21.15.52:0/3458459715 wait complete. 2024-09-10T08:33:58.310 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-10T08:33:57.531266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284476,"kb_used_data":9992,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754690244,"statfs":{"total":773094113280,"available":772802809856,"internally_reserved":0,"allocated":10231808,"data_stored":5054348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.873915"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680324+0000","last_change":"2024-09-10T08:33:53.688643+0000","last_active":"2024-09-10T08:33:54.680324+0000","last_peered":"2024-09-10T08:33:54.680324+0000","last_clean":"2024-09-10T08:33:54.680324+0000","last_became_active":"2024-09-10T08:33:53.687900+0000","last_became_peered":"2024-09-10T08:33:53.687900+0000","last_unstale":"2024-09-10T08:33:54.680324+0000","last_undegraded":"2024-09-10T08:33:54.680324+0000","last_fullsized":"2024-09-10T08:33:54.680324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:34.789110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702358+0000","last_change":"2024-09-10T08:33:53.692453+0000","last_active":"2024-09-10T08:33:54.702358+0000","last_peered":"2024-09-10T08:33:54.702358+0000","last_clean":"2024-09-10T08:33:54.702358+0000","last_became_active":"2024-09-10T08:33:53.691723+0000","last_became_peered":"2024-09-10T08:33:53.691723+0000","last_unstale":"2024-09-10T08:33:54.702358+0000","last_undegraded":"2024-09-10T08:33:54.702358+0000","last_fullsized":"2024-09-10T08:33:54.702358+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:06:56.628379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678908+0000","last_change":"2024-09-10T08:33:53.697819+0000","last_active":"2024-09-10T08:33:54.678908+0000","last_peered":"2024-09-10T08:33:54.678908+0000","last_clean":"2024-09-10T08:33:54.678908+0000","last_became_active":"2024-09-10T08:33:53.696832+0000","last_became_peered":"2024-09-10T08:33:53.696832+0000","last_unstale":"2024-09-10T08:33:54.678908+0000","last_undegraded":"2024-09-10T08:33:54.678908+0000","last_fullsized":"2024-09-10T08:33:54.678908+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:53.389511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.699454+0000","last_change":"2024-09-10T08:33:53.690198+0000","last_active":"2024-09-10T08:33:53.699454+0000","last_peered":"2024-09-10T08:33:53.699454+0000","last_clean":"2024-09-10T08:33:53.699454+0000","last_became_active":"2024-09-10T08:33:53.688473+0000","last_became_peered":"2024-09-10T08:33:53.688473+0000","last_unstale":"2024-09-10T08:33:53.699454+0000","last_undegraded":"2024-09-10T08:33:53.699454+0000","last_fullsized":"2024-09-10T08:33:53.699454+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:27.563352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.695747+0000","last_change":"2024-09-10T08:33:53.692676+0000","last_active":"2024-09-10T08:33:53.695747+0000","last_peered":"2024-09-10T08:33:53.695747+0000","last_clean":"2024-09-10T08:33:53.695747+0000","last_became_active":"2024-09-10T08:33:53.692397+0000","last_became_peered":"2024-09-10T08:33:53.692397+0000","last_unstale":"2024-09-10T08:33:53.695747+0000","last_undegraded":"2024-09-10T08:33:53.695747+0000","last_fullsized":"2024-09-10T08:33:53.695747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:19.866152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679242+0000","last_change":"2024-09-10T08:33:53.700617+0000","last_active":"2024-09-10T08:33:54.679242+0000","last_peered":"2024-09-10T08:33:54.679242+0000","last_clean":"2024-09-10T08:33:54.679242+0000","last_became_active":"2024-09-10T08:33:53.700324+0000","last_became_peered":"2024-09-10T08:33:53.700324+0000","last_unstale":"2024-09-10T08:33:54.679242+0000","last_undegraded":"2024-09-10T08:33:54.679242+0000","last_fullsized":"2024-09-10T08:33:54.679242+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:37.419190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702064+0000","last_change":"2024-09-10T08:33:53.699452+0000","last_active":"2024-09-10T08:33:54.702064+0000","last_peered":"2024-09-10T08:33:54.702064+0000","last_clean":"2024-09-10T08:33:54.702064+0000","last_became_active":"2024-09-10T08:33:53.699158+0000","last_became_peered":"2024-09-10T08:33:53.699158+0000","last_unstale":"2024-09-10T08:33:54.702064+0000","last_undegraded":"2024-09-10T08:33:54.702064+0000","last_fullsized":"2024-09-10T08:33:54.702064+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:23.064913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710833+0000","last_change":"2024-09-10T08:33:53.704230+0000","last_active":"2024-09-10T08:33:53.710833+0000","last_peered":"2024-09-10T08:33:53.710833+0000","last_clean":"2024-09-10T08:33:53.710833+0000","last_became_active":"2024-09-10T08:33:53.703879+0000","last_became_peered":"2024-09-10T08:33:53.703879+0000","last_unstale":"2024-09-10T08:33:53.710833+0000","last_undegraded":"2024-09-10T08:33:53.710833+0000","last_fullsized":"2024-09-10T08:33:53.710833+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:36.168284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680406+0000","last_change":"2024-09-10T08:33:53.688858+0000","last_active":"2024-09-10T08:33:54.680406+0000","last_peered":"2024-09-10T08:33:54.680406+0000","last_clean":"2024-09-10T08:33:54.680406+0000","last_became_active":"2024-09-10T08:33:53.688592+0000","last_became_peered":"2024-09-10T08:33:53.688592+0000","last_unstale":"2024-09-10T08:33:54.680406+0000","last_undegraded":"2024-09-10T08:33:54.680406+0000","last_fullsized":"2024-09-10T08:33:54.680406+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678747+0000","last_change":"2024-09-10T08:33:53.691472+0000","last_active":"2024-09-10T08:33:54.678747+0000","last_peered":"2024-09-10T08:33:54.678747+0000","last_clean":"2024-09-10T08:33:54.678747+0000","last_became_active":"2024-09-10T08:33:53.690976+0000","last_became_peered":"2024-09-10T08:33:53.690976+0000","last_unstale":"2024-09-10T08:33:54.678747+0000","last_undegraded":"2024-09-10T08:33:54.678747+0000","last_fullsized":"2024-09-10T08:33:54.678747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:35.459891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699871+0000","last_change":"2024-09-10T08:33:53.701775+0000","last_active":"2024-09-10T08:33:54.699871+0000","last_peered":"2024-09-10T08:33:54.699871+0000","last_clean":"2024-09-10T08:33:54.699871+0000","last_became_active":"2024-09-10T08:33:53.701458+0000","last_became_peered":"2024-09-10T08:33:53.701458+0000","last_unstale":"2024-09-10T08:33:54.699871+0000","last_undegraded":"2024-09-10T08:33:54.699871+0000","last_fullsized":"2024-09-10T08:33:54.699871+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:39.789611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.707567+0000","last_change":"2024-09-10T08:33:53.697761+0000","last_active":"2024-09-10T08:33:53.707567+0000","last_peered":"2024-09-10T08:33:53.707567+0000","last_clean":"2024-09-10T08:33:53.707567+0000","last_became_active":"2024-09-10T08:33:53.697422+0000","last_became_peered":"2024-09-10T08:33:53.697422+0000","last_unstale":"2024-09-10T08:33:53.707567+0000","last_undegraded":"2024-09-10T08:33:53.707567+0000","last_fullsized":"2024-09-10T08:33:53.707567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.695727+0000","last_change":"2024-09-10T08:33:53.689486+0000","last_active":"2024-09-10T08:33:53.695727+0000","last_peered":"2024-09-10T08:33:53.695727+0000","last_clean":"2024-09-10T08:33:53.695727+0000","last_became_active":"2024-09-10T08:33:53.689158+0000","last_became_peered":"2024-09-10T08:33:53.689158+0000","last_unstale":"2024-09-10T08:33:53.695727+0000","last_undegraded":"2024-09-10T08:33:53.695727+0000","last_fullsized":"2024-09-10T08:33:53.695727+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:50.449159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679562+0000","last_change":"2024-09-10T08:33:53.708346+0000","last_active":"2024-09-10T08:33:54.679562+0000","last_peered":"2024-09-10T08:33:54.679562+0000","last_clean":"2024-09-10T08:33:54.679562+0000","last_became_active":"2024-09-10T08:33:53.704704+0000","last_became_peered":"2024-09-10T08:33:53.704704+0000","last_unstale":"2024-09-10T08:33:54.679562+0000","last_undegraded":"2024-09-10T08:33:54.679562+0000","last_fullsized":"2024-09-10T08:33:54.679562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.785739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702073+0000","last_change":"2024-09-10T08:33:53.708185+0000","last_active":"2024-09-10T08:33:54.702073+0000","last_peered":"2024-09-10T08:33:54.702073+0000","last_clean":"2024-09-10T08:33:54.702073+0000","last_became_active":"2024-09-10T08:33:53.707881+0000","last_became_peered":"2024-09-10T08:33:53.707881+0000","last_unstale":"2024-09-10T08:33:54.702073+0000","last_undegraded":"2024-09-10T08:33:54.702073+0000","last_fullsized":"2024-09-10T08:33:54.702073+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:19.531687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679081+0000","last_change":"2024-09-10T08:33:53.693828+0000","last_active":"2024-09-10T08:33:54.679081+0000","last_peered":"2024-09-10T08:33:54.679081+0000","last_clean":"2024-09-10T08:33:54.679081+0000","last_became_active":"2024-09-10T08:33:53.693223+0000","last_became_peered":"2024-09-10T08:33:53.693223+0000","last_unstale":"2024-09-10T08:33:54.679081+0000","last_undegraded":"2024-09-10T08:33:54.679081+0000","last_fullsized":"2024-09-10T08:33:54.679081+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:25:22.265739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.707423+0000","last_change":"2024-09-10T08:33:53.702494+0000","last_active":"2024-09-10T08:33:53.707423+0000","last_peered":"2024-09-10T08:33:53.707423+0000","last_clean":"2024-09-10T08:33:53.707423+0000","last_became_active":"2024-09-10T08:33:53.701072+0000","last_became_peered":"2024-09-10T08:33:53.701072+0000","last_unstale":"2024-09-10T08:33:53.707423+0000","last_undegraded":"2024-09-10T08:33:53.707423+0000","last_fullsized":"2024-09-10T08:33:53.707423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699585+0000","last_change":"2024-09-10T08:33:53.706947+0000","last_active":"2024-09-10T08:33:54.699585+0000","last_peered":"2024-09-10T08:33:54.699585+0000","last_clean":"2024-09-10T08:33:54.699585+0000","last_became_active":"2024-09-10T08:33:53.705139+0000","last_became_peered":"2024-09-10T08:33:53.705139+0000","last_unstale":"2024-09-10T08:33:54.699585+0000","last_undegraded":"2024-09-10T08:33:54.699585+0000","last_fullsized":"2024-09-10T08:33:54.699585+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:17.437870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680218+0000","last_change":"2024-09-10T08:33:53.700811+0000","last_active":"2024-09-10T08:33:54.680218+0000","last_peered":"2024-09-10T08:33:54.680218+0000","last_clean":"2024-09-10T08:33:54.680218+0000","last_became_active":"2024-09-10T08:33:53.693722+0000","last_became_peered":"2024-09-10T08:33:53.693722+0000","last_unstale":"2024-09-10T08:33:54.680218+0000","last_undegraded":"2024-09-10T08:33:54.680218+0000","last_fullsized":"2024-09-10T08:33:54.680218+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680142+0000","last_change":"2024-09-10T08:33:53.692750+0000","last_active":"2024-09-10T08:33:54.680142+0000","last_peered":"2024-09-10T08:33:54.680142+0000","last_clean":"2024-09-10T08:33:54.680142+0000","last_became_active":"2024-09-10T08:33:53.692477+0000","last_became_peered":"2024-09-10T08:33:53.692477+0000","last_unstale":"2024-09-10T08:33:54.680142+0000","last_undegraded":"2024-09-10T08:33:54.680142+0000","last_fullsized":"2024-09-10T08:33:54.680142+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:34.789110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709266+0000","last_change":"2024-09-10T08:33:53.701857+0000","last_active":"2024-09-10T08:33:53.709266+0000","last_peered":"2024-09-10T08:33:53.709266+0000","last_clean":"2024-09-10T08:33:53.709266+0000","last_became_active":"2024-09-10T08:33:53.701184+0000","last_became_peered":"2024-09-10T08:33:53.701184+0000","last_unstale":"2024-09-10T08:33:53.709266+0000","last_undegraded":"2024-09-10T08:33:53.709266+0000","last_fullsized":"2024-09-10T08:33:53.709266+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:36.855144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679806+0000","last_change":"2024-09-10T08:33:53.706196+0000","last_active":"2024-09-10T08:33:54.679806+0000","last_peered":"2024-09-10T08:33:54.679806+0000","last_clean":"2024-09-10T08:33:54.679806+0000","last_became_active":"2024-09-10T08:33:53.695326+0000","last_became_peered":"2024-09-10T08:33:53.695326+0000","last_unstale":"2024-09-10T08:33:54.679806+0000","last_undegraded":"2024-09-10T08:33:54.679806+0000","last_fullsized":"2024-09-10T08:33:54.679806+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:35.165345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.701686+0000","last_change":"2024-09-10T08:33:53.690198+0000","last_active":"2024-09-10T08:33:53.701686+0000","last_peered":"2024-09-10T08:33:53.701686+0000","last_clean":"2024-09-10T08:33:53.701686+0000","last_became_active":"2024-09-10T08:33:53.689925+0000","last_became_peered":"2024-09-10T08:33:53.689925+0000","last_unstale":"2024-09-10T08:33:53.701686+0000","last_undegraded":"2024-09-10T08:33:53.701686+0000","last_fullsized":"2024-09-10T08:33:53.701686+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699801+0000","last_change":"2024-09-10T08:33:53.705670+0000","last_active":"2024-09-10T08:33:54.699801+0000","last_peered":"2024-09-10T08:33:54.699801+0000","last_clean":"2024-09-10T08:33:54.699801+0000","last_became_active":"2024-09-10T08:33:53.703161+0000","last_became_peered":"2024-09-10T08:33:53.703161+0000","last_unstale":"2024-09-10T08:33:54.699801+0000","last_undegraded":"2024-09-10T08:33:54.699801+0000","last_fullsized":"2024-09-10T08:33:54.699801+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:50.023255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699734+0000","last_change":"2024-09-10T08:33:53.706489+0000","last_active":"2024-09-10T08:33:54.699734+0000","last_peered":"2024-09-10T08:33:54.699734+0000","last_clean":"2024-09-10T08:33:54.699734+0000","last_became_active":"2024-09-10T08:33:53.706223+0000","last_became_peered":"2024-09-10T08:33:53.706223+0000","last_unstale":"2024-09-10T08:33:54.699734+0000","last_undegraded":"2024-09-10T08:33:54.699734+0000","last_fullsized":"2024-09-10T08:33:54.699734+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:33.065118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.698755+0000","last_change":"2024-09-10T08:33:53.694669+0000","last_active":"2024-09-10T08:33:53.698755+0000","last_peered":"2024-09-10T08:33:53.698755+0000","last_clean":"2024-09-10T08:33:53.698755+0000","last_became_active":"2024-09-10T08:33:53.694387+0000","last_became_peered":"2024-09-10T08:33:53.694387+0000","last_unstale":"2024-09-10T08:33:53.698755+0000","last_undegraded":"2024-09-10T08:33:53.698755+0000","last_fullsized":"2024-09-10T08:33:53.698755+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:50:24.303886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.706265+0000","last_change":"2024-09-10T08:33:53.704364+0000","last_active":"2024-09-10T08:33:53.706265+0000","last_peered":"2024-09-10T08:33:53.706265+0000","last_clean":"2024-09-10T08:33:53.706265+0000","last_became_active":"2024-09-10T08:33:53.704048+0000","last_became_peered":"2024-09-10T08:33:53.704048+0000","last_unstale":"2024-09-10T08:33:53.706265+0000","last_undegraded":"2024-09-10T08:33:53.706265+0000","last_fullsized":"2024-09-10T08:33:53.706265+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:52.207436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680164+0000","last_change":"2024-09-10T08:33:53.690774+0000","last_active":"2024-09-10T08:33:54.680164+0000","last_peered":"2024-09-10T08:33:54.680164+0000","last_clean":"2024-09-10T08:33:54.680164+0000","last_became_active":"2024-09-10T08:33:53.690512+0000","last_became_peered":"2024-09-10T08:33:53.690512+0000","last_unstale":"2024-09-10T08:33:54.680164+0000","last_undegraded":"2024-09-10T08:33:54.680164+0000","last_fullsized":"2024-09-10T08:33:54.680164+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:21.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709291+0000","last_change":"2024-09-10T08:33:53.702087+0000","last_active":"2024-09-10T08:33:53.709291+0000","last_peered":"2024-09-10T08:33:53.709291+0000","last_clean":"2024-09-10T08:33:53.709291+0000","last_became_active":"2024-09-10T08:33:53.701546+0000","last_became_peered":"2024-09-10T08:33:53.701546+0000","last_unstale":"2024-09-10T08:33:53.709291+0000","last_undegraded":"2024-09-10T08:33:53.709291+0000","last_fullsized":"2024-09-10T08:33:53.709291+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:25:29.165573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679879+0000","last_change":"2024-09-10T08:33:53.706440+0000","last_active":"2024-09-10T08:33:54.679879+0000","last_peered":"2024-09-10T08:33:54.679879+0000","last_clean":"2024-09-10T08:33:54.679879+0000","last_became_active":"2024-09-10T08:33:53.698058+0000","last_became_peered":"2024-09-10T08:33:53.698058+0000","last_unstale":"2024-09-10T08:33:54.679879+0000","last_undegraded":"2024-09-10T08:33:54.679879+0000","last_fullsized":"2024-09-10T08:33:54.679879+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:21.532686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678596+0000","last_change":"2024-09-10T08:33:53.700677+0000","last_active":"2024-09-10T08:33:54.678596+0000","last_peered":"2024-09-10T08:33:54.678596+0000","last_clean":"2024-09-10T08:33:54.678596+0000","last_became_active":"2024-09-10T08:33:53.700317+0000","last_became_peered":"2024-09-10T08:33:53.700317+0000","last_unstale":"2024-09-10T08:33:54.678596+0000","last_undegraded":"2024-09-10T08:33:54.678596+0000","last_fullsized":"2024-09-10T08:33:54.678596+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:50.764109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678593+0000","last_change":"2024-09-10T08:33:53.699319+0000","last_active":"2024-09-10T08:33:54.678593+0000","last_peered":"2024-09-10T08:33:54.678593+0000","last_clean":"2024-09-10T08:33:54.678593+0000","last_became_active":"2024-09-10T08:33:53.699027+0000","last_became_peered":"2024-09-10T08:33:53.699027+0000","last_unstale":"2024-09-10T08:33:54.678593+0000","last_undegraded":"2024-09-10T08:33:54.678593+0000","last_fullsized":"2024-09-10T08:33:54.678593+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:21:32.570200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.708158+0000","last_change":"2024-09-10T08:33:53.703593+0000","last_active":"2024-09-10T08:33:53.708158+0000","last_peered":"2024-09-10T08:33:53.708158+0000","last_clean":"2024-09-10T08:33:53.708158+0000","last_became_active":"2024-09-10T08:33:53.703299+0000","last_became_peered":"2024-09-10T08:33:53.703299+0000","last_unstale":"2024-09-10T08:33:53.708158+0000","last_undegraded":"2024-09-10T08:33:53.708158+0000","last_fullsized":"2024-09-10T08:33:53.708158+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:13.807181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"92'4","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.718881+0000","last_change":"2024-09-10T08:33:52.691471+0000","last_active":"2024-09-10T08:33:53.718881+0000","last_peered":"2024-09-10T08:33:53.718881+0000","last_clean":"2024-09-10T08:33:53.718881+0000","last_became_active":"2024-09-10T08:33:52.680704+0000","last_became_peered":"2024-09-10T08:33:52.680704+0000","last_unstale":"2024-09-10T08:33:53.718881+0000","last_undegraded":"2024-09-10T08:33:53.718881+0000","last_fullsized":"2024-09-10T08:33:53.718881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:12.775498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680485+0000","last_change":"2024-09-10T08:33:53.688854+0000","last_active":"2024-09-10T08:33:54.680485+0000","last_peered":"2024-09-10T08:33:54.680485+0000","last_clean":"2024-09-10T08:33:54.680485+0000","last_became_active":"2024-09-10T08:33:53.688260+0000","last_became_peered":"2024-09-10T08:33:53.688260+0000","last_unstale":"2024-09-10T08:33:54.680485+0000","last_undegraded":"2024-09-10T08:33:54.680485+0000","last_fullsized":"2024-09-10T08:33:54.680485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678861+0000","last_change":"2024-09-10T08:33:52.685339+0000","last_active":"2024-09-10T08:33:54.678861+0000","last_peered":"2024-09-10T08:33:54.678861+0000","last_clean":"2024-09-10T08:33:54.678861+0000","last_became_active":"2024-09-10T08:33:52.684827+0000","last_became_peered":"2024-09-10T08:33:52.684827+0000","last_unstale":"2024-09-10T08:33:54.678861+0000","last_undegraded":"2024-09-10T08:33:54.678861+0000","last_fullsized":"2024-09-10T08:33:54.678861+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:45.565784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709629+0000","last_change":"2024-09-10T08:33:53.704864+0000","last_active":"2024-09-10T08:33:53.709629+0000","last_peered":"2024-09-10T08:33:53.709629+0000","last_clean":"2024-09-10T08:33:53.709629+0000","last_became_active":"2024-09-10T08:33:53.703028+0000","last_became_peered":"2024-09-10T08:33:53.703028+0000","last_unstale":"2024-09-10T08:33:53.709629+0000","last_undegraded":"2024-09-10T08:33:53.709629+0000","last_fullsized":"2024-09-10T08:33:53.709629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:17.437870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699887+0000","last_change":"2024-09-10T08:33:52.681243+0000","last_active":"2024-09-10T08:33:54.699887+0000","last_peered":"2024-09-10T08:33:54.699887+0000","last_clean":"2024-09-10T08:33:54.699887+0000","last_became_active":"2024-09-10T08:33:52.680938+0000","last_became_peered":"2024-09-10T08:33:52.680938+0000","last_unstale":"2024-09-10T08:33:54.699887+0000","last_undegraded":"2024-09-10T08:33:54.699887+0000","last_fullsized":"2024-09-10T08:33:54.699887+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:25.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680343+0000","last_change":"2024-09-10T08:33:53.715614+0000","last_active":"2024-09-10T08:33:54.680343+0000","last_peered":"2024-09-10T08:33:54.680343+0000","last_clean":"2024-09-10T08:33:54.680343+0000","last_became_active":"2024-09-10T08:33:53.715267+0000","last_became_peered":"2024-09-10T08:33:53.715267+0000","last_unstale":"2024-09-10T08:33:54.680343+0000","last_undegraded":"2024-09-10T08:33:54.680343+0000","last_fullsized":"2024-09-10T08:33:54.680343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.101237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"92'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.715219+0000","last_change":"2024-09-10T08:33:52.677242+0000","last_active":"2024-09-10T08:33:53.715219+0000","last_peered":"2024-09-10T08:33:53.715219+0000","last_clean":"2024-09-10T08:33:53.715219+0000","last_became_active":"2024-09-10T08:33:52.676869+0000","last_became_peered":"2024-09-10T08:33:52.676869+0000","last_unstale":"2024-09-10T08:33:53.715219+0000","last_undegraded":"2024-09-10T08:33:53.715219+0000","last_fullsized":"2024-09-10T08:33:53.715219+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:19.786062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710794+0000","last_change":"2024-09-10T08:33:53.704845+0000","last_active":"2024-09-10T08:33:53.710794+0000","last_peered":"2024-09-10T08:33:53.710794+0000","last_clean":"2024-09-10T08:33:53.710794+0000","last_became_active":"2024-09-10T08:33:53.704195+0000","last_became_peered":"2024-09-10T08:33:53.704195+0000","last_unstale":"2024-09-10T08:33:53.710794+0000","last_undegraded":"2024-09-10T08:33:53.710794+0000","last_fullsized":"2024-09-10T08:33:53.710794+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:43.721984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.716236+0000","last_change":"2024-09-10T08:33:52.680192+0000","last_active":"2024-09-10T08:33:53.716236+0000","last_peered":"2024-09-10T08:33:53.716236+0000","last_clean":"2024-09-10T08:33:53.716236+0000","last_became_active":"2024-09-10T08:33:52.679359+0000","last_became_peered":"2024-09-10T08:33:52.679359+0000","last_unstale":"2024-09-10T08:33:53.716236+0000","last_undegraded":"2024-09-10T08:33:53.716236+0000","last_fullsized":"2024-09-10T08:33:53.716236+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:34.159309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678725+0000","last_change":"2024-09-10T08:33:53.682457+0000","last_active":"2024-09-10T08:33:54.678725+0000","last_peered":"2024-09-10T08:33:54.678725+0000","last_clean":"2024-09-10T08:33:54.678725+0000","last_became_active":"2024-09-10T08:33:53.682117+0000","last_became_peered":"2024-09-10T08:33:53.682117+0000","last_unstale":"2024-09-10T08:33:54.678725+0000","last_undegraded":"2024-09-10T08:33:54.678725+0000","last_fullsized":"2024-09-10T08:33:54.678725+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:10.157258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679332+0000","last_change":"2024-09-10T08:33:52.688334+0000","last_active":"2024-09-10T08:33:54.679332+0000","last_peered":"2024-09-10T08:33:54.679332+0000","last_clean":"2024-09-10T08:33:54.679332+0000","last_became_active":"2024-09-10T08:33:52.687647+0000","last_became_peered":"2024-09-10T08:33:52.687647+0000","last_unstale":"2024-09-10T08:33:54.679332+0000","last_undegraded":"2024-09-10T08:33:54.679332+0000","last_fullsized":"2024-09-10T08:33:54.679332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:32.059081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680134+0000","last_change":"2024-09-10T08:33:53.707133+0000","last_active":"2024-09-10T08:33:54.680134+0000","last_peered":"2024-09-10T08:33:54.680134+0000","last_clean":"2024-09-10T08:33:54.680134+0000","last_became_active":"2024-09-10T08:33:53.706784+0000","last_became_peered":"2024-09-10T08:33:53.706784+0000","last_unstale":"2024-09-10T08:33:54.680134+0000","last_undegraded":"2024-09-10T08:33:54.680134+0000","last_fullsized":"2024-09-10T08:33:54.680134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:35.165345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679898+0000","last_change":"2024-09-10T08:33:52.688743+0000","last_active":"2024-09-10T08:33:54.679898+0000","last_peered":"2024-09-10T08:33:54.679898+0000","last_clean":"2024-09-10T08:33:54.679898+0000","last_became_active":"2024-09-10T08:33:52.688456+0000","last_became_peered":"2024-09-10T08:33:52.688456+0000","last_unstale":"2024-09-10T08:33:54.679898+0000","last_undegraded":"2024-09-10T08:33:54.679898+0000","last_fullsized":"2024-09-10T08:33:54.679898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:58.339554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679551+0000","last_change":"2024-09-10T08:33:53.698416+0000","last_active":"2024-09-10T08:33:54.679551+0000","last_peered":"2024-09-10T08:33:54.679551+0000","last_clean":"2024-09-10T08:33:54.679551+0000","last_became_active":"2024-09-10T08:33:53.698089+0000","last_became_peered":"2024-09-10T08:33:53.698089+0000","last_unstale":"2024-09-10T08:33:54.679551+0000","last_undegraded":"2024-09-10T08:33:54.679551+0000","last_fullsized":"2024-09-10T08:33:54.679551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:13.475789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679447+0000","last_change":"2024-09-10T08:33:52.686456+0000","last_active":"2024-09-10T08:33:54.679447+0000","last_peered":"2024-09-10T08:33:54.679447+0000","last_clean":"2024-09-10T08:33:54.679447+0000","last_became_active":"2024-09-10T08:33:52.685983+0000","last_became_peered":"2024-09-10T08:33:52.685983+0000","last_unstale":"2024-09-10T08:33:54.679447+0000","last_undegraded":"2024-09-10T08:33:54.679447+0000","last_fullsized":"2024-09-10T08:33:54.679447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:14.002183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680293+0000","last_change":"2024-09-10T08:33:53.685917+0000","last_active":"2024-09-10T08:33:54.680293+0000","last_peered":"2024-09-10T08:33:54.680293+0000","last_clean":"2024-09-10T08:33:54.680293+0000","last_became_active":"2024-09-10T08:33:53.685626+0000","last_became_peered":"2024-09-10T08:33:53.685626+0000","last_unstale":"2024-09-10T08:33:54.680293+0000","last_undegraded":"2024-09-10T08:33:54.680293+0000","last_fullsized":"2024-09-10T08:33:54.680293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:14:07.658326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680591+0000","last_change":"2024-09-10T08:33:52.686401+0000","last_active":"2024-09-10T08:33:54.680591+0000","last_peered":"2024-09-10T08:33:54.680591+0000","last_clean":"2024-09-10T08:33:54.680591+0000","last_became_active":"2024-09-10T08:33:52.686153+0000","last_became_peered":"2024-09-10T08:33:52.686153+0000","last_unstale":"2024-09-10T08:33:54.680591+0000","last_undegraded":"2024-09-10T08:33:54.680591+0000","last_fullsized":"2024-09-10T08:33:54.680591+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:58.339554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680556+0000","last_change":"2024-09-10T08:33:53.707453+0000","last_active":"2024-09-10T08:33:54.680556+0000","last_peered":"2024-09-10T08:33:54.680556+0000","last_clean":"2024-09-10T08:33:54.680556+0000","last_became_active":"2024-09-10T08:33:53.707148+0000","last_became_peered":"2024-09-10T08:33:53.707148+0000","last_unstale":"2024-09-10T08:33:54.680556+0000","last_undegraded":"2024-09-10T08:33:54.680556+0000","last_fullsized":"2024-09-10T08:33:54.680556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678958+0000","last_change":"2024-09-10T08:33:52.682588+0000","last_active":"2024-09-10T08:33:54.678958+0000","last_peered":"2024-09-10T08:33:54.678958+0000","last_clean":"2024-09-10T08:33:54.678958+0000","last_became_active":"2024-09-10T08:33:52.682060+0000","last_became_peered":"2024-09-10T08:33:52.682060+0000","last_unstale":"2024-09-10T08:33:54.678958+0000","last_undegraded":"2024-09-10T08:33:54.678958+0000","last_fullsized":"2024-09-10T08:33:54.678958+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:55.706331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699348+0000","last_change":"2024-09-10T08:33:53.715180+0000","last_active":"2024-09-10T08:33:54.699348+0000","last_peered":"2024-09-10T08:33:54.699348+0000","last_clean":"2024-09-10T08:33:54.699348+0000","last_became_active":"2024-09-10T08:33:53.713930+0000","last_became_peered":"2024-09-10T08:33:53.713930+0000","last_unstale":"2024-09-10T08:33:54.699348+0000","last_undegraded":"2024-09-10T08:33:54.699348+0000","last_fullsized":"2024-09-10T08:33:54.699348+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:53.668226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"92'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680447+0000","last_change":"2024-09-10T08:33:52.686573+0000","last_active":"2024-09-10T08:33:54.680447+0000","last_peered":"2024-09-10T08:33:54.680447+0000","last_clean":"2024-09-10T08:33:54.680447+0000","last_became_active":"2024-09-10T08:33:52.686294+0000","last_became_peered":"2024-09-10T08:33:52.686294+0000","last_unstale":"2024-09-10T08:33:54.680447+0000","last_undegraded":"2024-09-10T08:33:54.680447+0000","last_fullsized":"2024-09-10T08:33:54.680447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:05.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.713183+0000","last_change":"2024-09-10T08:33:53.712236+0000","last_active":"2024-09-10T08:33:53.713183+0000","last_peered":"2024-09-10T08:33:53.713183+0000","last_clean":"2024-09-10T08:33:53.713183+0000","last_became_active":"2024-09-10T08:33:53.711905+0000","last_became_peered":"2024-09-10T08:33:53.711905+0000","last_unstale":"2024-09-10T08:33:53.713183+0000","last_undegraded":"2024-09-10T08:33:53.713183+0000","last_fullsized":"2024-09-10T08:33:53.713183+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:56.179377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"92'6","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.719443+0000","last_change":"2024-09-10T08:33:52.676911+0000","last_active":"2024-09-10T08:33:53.719443+0000","last_peered":"2024-09-10T08:33:53.719443+0000","last_clean":"2024-09-10T08:33:53.719443+0000","last_became_active":"2024-09-10T08:33:52.676642+0000","last_became_peered":"2024-09-10T08:33:52.676642+0000","last_unstale":"2024-09-10T08:33:53.719443+0000","last_undegraded":"2024-09-10T08:33:53.719443+0000","last_fullsized":"2024-09-10T08:33:53.719443+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:20.526650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699577+0000","last_change":"2024-09-10T08:33:53.706297+0000","last_active":"2024-09-10T08:33:54.699577+0000","last_peered":"2024-09-10T08:33:54.699577+0000","last_clean":"2024-09-10T08:33:54.699577+0000","last_became_active":"2024-09-10T08:33:53.704399+0000","last_became_peered":"2024-09-10T08:33:53.704399+0000","last_unstale":"2024-09-10T08:33:54.699577+0000","last_undegraded":"2024-09-10T08:33:54.699577+0000","last_fullsized":"2024-09-10T08:33:54.699577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:36.168284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"92'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.717254+0000","last_change":"2024-09-10T08:33:52.678312+0000","last_active":"2024-09-10T08:33:53.717254+0000","last_peered":"2024-09-10T08:33:53.717254+0000","last_clean":"2024-09-10T08:33:53.717254+0000","last_became_active":"2024-09-10T08:33:52.677020+0000","last_became_peered":"2024-09-10T08:33:52.677020+0000","last_unstale":"2024-09-10T08:33:53.717254+0000","last_undegraded":"2024-09-10T08:33:53.717254+0000","last_fullsized":"2024-09-10T08:33:53.717254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:44:17.851981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680099+0000","last_change":"2024-09-10T08:33:53.707336+0000","last_active":"2024-09-10T08:33:54.680099+0000","last_peered":"2024-09-10T08:33:54.680099+0000","last_clean":"2024-09-10T08:33:54.680099+0000","last_became_active":"2024-09-10T08:33:53.707003+0000","last_became_peered":"2024-09-10T08:33:53.707003+0000","last_unstale":"2024-09-10T08:33:54.680099+0000","last_undegraded":"2024-09-10T08:33:54.680099+0000","last_fullsized":"2024-09-10T08:33:54.680099+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.785739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702063+0000","last_change":"2024-09-10T08:33:52.681297+0000","last_active":"2024-09-10T08:33:54.702063+0000","last_peered":"2024-09-10T08:33:54.702063+0000","last_clean":"2024-09-10T08:33:54.702063+0000","last_became_active":"2024-09-10T08:33:52.680989+0000","last_became_peered":"2024-09-10T08:33:52.680989+0000","last_unstale":"2024-09-10T08:33:54.702063+0000","last_undegraded":"2024-09-10T08:33:54.702063+0000","last_fullsized":"2024-09-10T08:33:54.702063+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:32.059081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679526+0000","last_change":"2024-09-10T08:33:53.703891+0000","last_active":"2024-09-10T08:33:54.679526+0000","last_peered":"2024-09-10T08:33:54.679526+0000","last_clean":"2024-09-10T08:33:54.679526+0000","last_became_active":"2024-09-10T08:33:53.703617+0000","last_became_peered":"2024-09-10T08:33:53.703617+0000","last_unstale":"2024-09-10T08:33:54.679526+0000","last_undegraded":"2024-09-10T08:33:54.679526+0000","last_fullsized":"2024-09-10T08:33:54.679526+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:37.352261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679019+0000","last_change":"2024-09-10T08:33:52.681840+0000","last_active":"2024-09-10T08:33:54.679019+0000","last_peered":"2024-09-10T08:33:54.679019+0000","last_clean":"2024-09-10T08:33:54.679019+0000","last_became_active":"2024-09-10T08:33:52.681600+0000","last_became_peered":"2024-09-10T08:33:52.681600+0000","last_unstale":"2024-09-10T08:33:54.679019+0000","last_undegraded":"2024-09-10T08:33:54.679019+0000","last_fullsized":"2024-09-10T08:33:54.679019+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:16.431833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699303+0000","last_change":"2024-09-10T08:33:53.705532+0000","last_active":"2024-09-10T08:33:54.699303+0000","last_peered":"2024-09-10T08:33:54.699303+0000","last_clean":"2024-09-10T08:33:54.699303+0000","last_became_active":"2024-09-10T08:33:53.704633+0000","last_became_peered":"2024-09-10T08:33:53.704633+0000","last_unstale":"2024-09-10T08:33:54.699303+0000","last_undegraded":"2024-09-10T08:33:54.699303+0000","last_fullsized":"2024-09-10T08:33:54.699303+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"92'8","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699745+0000","last_change":"2024-09-10T08:33:52.690168+0000","last_active":"2024-09-10T08:33:54.699745+0000","last_peered":"2024-09-10T08:33:54.699745+0000","last_clean":"2024-09-10T08:33:54.699745+0000","last_became_active":"2024-09-10T08:33:52.689848+0000","last_became_peered":"2024-09-10T08:33:52.689848+0000","last_unstale":"2024-09-10T08:33:54.699745+0000","last_undegraded":"2024-09-10T08:33:54.699745+0000","last_fullsized":"2024-09-10T08:33:54.699745+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:31.698414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.708139+0000","last_change":"2024-09-10T08:33:53.703284+0000","last_active":"2024-09-10T08:33:53.708139+0000","last_peered":"2024-09-10T08:33:53.708139+0000","last_clean":"2024-09-10T08:33:53.708139+0000","last_became_active":"2024-09-10T08:33:53.703009+0000","last_became_peered":"2024-09-10T08:33:53.703009+0000","last_unstale":"2024-09-10T08:33:53.708139+0000","last_undegraded":"2024-09-10T08:33:53.708139+0000","last_fullsized":"2024-09-10T08:33:53.708139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:41.056620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.717327+0000","last_change":"2024-09-10T08:33:52.681476+0000","last_active":"2024-09-10T08:33:53.717327+0000","last_peered":"2024-09-10T08:33:53.717327+0000","last_clean":"2024-09-10T08:33:53.717327+0000","last_became_active":"2024-09-10T08:33:52.681172+0000","last_became_peered":"2024-09-10T08:33:52.681172+0000","last_unstale":"2024-09-10T08:33:53.717327+0000","last_undegraded":"2024-09-10T08:33:53.717327+0000","last_fullsized":"2024-09-10T08:33:53.717327+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:27.353779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678974+0000","last_change":"2024-09-10T08:33:53.697286+0000","last_active":"2024-09-10T08:33:54.678974+0000","last_peered":"2024-09-10T08:33:54.678974+0000","last_clean":"2024-09-10T08:33:54.678974+0000","last_became_active":"2024-09-10T08:33:53.696804+0000","last_became_peered":"2024-09-10T08:33:53.696804+0000","last_unstale":"2024-09-10T08:33:54.678974+0000","last_undegraded":"2024-09-10T08:33:54.678974+0000","last_fullsized":"2024-09-10T08:33:54.678974+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:17.968758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680249+0000","last_change":"2024-09-10T08:33:52.688828+0000","last_active":"2024-09-10T08:33:54.680249+0000","last_peered":"2024-09-10T08:33:54.680249+0000","last_clean":"2024-09-10T08:33:54.680249+0000","last_became_active":"2024-09-10T08:33:52.688409+0000","last_became_peered":"2024-09-10T08:33:52.688409+0000","last_unstale":"2024-09-10T08:33:54.680249+0000","last_undegraded":"2024-09-10T08:33:54.680249+0000","last_fullsized":"2024-09-10T08:33:54.680249+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:11.442154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.706208+0000","last_change":"2024-09-10T08:33:53.698394+0000","last_active":"2024-09-10T08:33:53.706208+0000","last_peered":"2024-09-10T08:33:53.706208+0000","last_clean":"2024-09-10T08:33:53.706208+0000","last_became_active":"2024-09-10T08:33:53.698128+0000","last_became_peered":"2024-09-10T08:33:53.698128+0000","last_unstale":"2024-09-10T08:33:53.706208+0000","last_undegraded":"2024-09-10T08:33:53.706208+0000","last_fullsized":"2024-09-10T08:33:53.706208+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.544059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680254+0000","last_change":"2024-09-10T08:33:52.685574+0000","last_active":"2024-09-10T08:33:54.680254+0000","last_peered":"2024-09-10T08:33:54.680254+0000","last_clean":"2024-09-10T08:33:54.680254+0000","last_became_active":"2024-09-10T08:33:52.685268+0000","last_became_peered":"2024-09-10T08:33:52.685268+0000","last_unstale":"2024-09-10T08:33:54.680254+0000","last_undegraded":"2024-09-10T08:33:54.680254+0000","last_fullsized":"2024-09-10T08:33:54.680254+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:06.198499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702038+0000","last_change":"2024-09-10T08:33:53.711749+0000","last_active":"2024-09-10T08:33:54.702038+0000","last_peered":"2024-09-10T08:33:54.702038+0000","last_clean":"2024-09-10T08:33:54.702038+0000","last_became_active":"2024-09-10T08:33:53.708449+0000","last_became_peered":"2024-09-10T08:33:53.708449+0000","last_unstale":"2024-09-10T08:33:54.702038+0000","last_undegraded":"2024-09-10T08:33:54.702038+0000","last_fullsized":"2024-09-10T08:33:54.702038+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:16.504099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679803+0000","last_change":"2024-09-10T08:33:52.690398+0000","last_active":"2024-09-10T08:33:54.679803+0000","last_peered":"2024-09-10T08:33:54.679803+0000","last_clean":"2024-09-10T08:33:54.679803+0000","last_became_active":"2024-09-10T08:33:52.690118+0000","last_became_peered":"2024-09-10T08:33:52.690118+0000","last_unstale":"2024-09-10T08:33:54.679803+0000","last_undegraded":"2024-09-10T08:33:54.679803+0000","last_fullsized":"2024-09-10T08:33:54.679803+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:36.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.711539+0000","last_change":"2024-09-10T08:33:53.709096+0000","last_active":"2024-09-10T08:33:53.711539+0000","last_peered":"2024-09-10T08:33:53.711539+0000","last_clean":"2024-09-10T08:33:53.711539+0000","last_became_active":"2024-09-10T08:33:53.705692+0000","last_became_peered":"2024-09-10T08:33:53.705692+0000","last_unstale":"2024-09-10T08:33:53.711539+0000","last_undegraded":"2024-09-10T08:33:53.711539+0000","last_fullsized":"2024-09-10T08:33:53.711539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:38:23.851164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702170+0000","last_change":"2024-09-10T08:33:52.673589+0000","last_active":"2024-09-10T08:33:54.702170+0000","last_peered":"2024-09-10T08:33:54.702170+0000","last_clean":"2024-09-10T08:33:54.702170+0000","last_became_active":"2024-09-10T08:33:52.673136+0000","last_became_peered":"2024-09-10T08:33:52.673136+0000","last_unstale":"2024-09-10T08:33:54.702170+0000","last_undegraded":"2024-09-10T08:33:54.702170+0000","last_fullsized":"2024-09-10T08:33:54.702170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.710837+0000","last_change":"2024-09-10T08:33:53.703937+0000","last_active":"2024-09-10T08:33:53.710837+0000","last_peered":"2024-09-10T08:33:53.710837+0000","last_clean":"2024-09-10T08:33:53.710837+0000","last_became_active":"2024-09-10T08:33:53.703593+0000","last_became_peered":"2024-09-10T08:33:53.703593+0000","last_unstale":"2024-09-10T08:33:53.710837+0000","last_undegraded":"2024-09-10T08:33:53.710837+0000","last_fullsized":"2024-09-10T08:33:53.710837+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:09.673622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699514+0000","last_change":"2024-09-10T08:33:52.682692+0000","last_active":"2024-09-10T08:33:54.699514+0000","last_peered":"2024-09-10T08:33:54.699514+0000","last_clean":"2024-09-10T08:33:54.699514+0000","last_became_active":"2024-09-10T08:33:52.682409+0000","last_became_peered":"2024-09-10T08:33:52.682409+0000","last_unstale":"2024-09-10T08:33:54.699514+0000","last_undegraded":"2024-09-10T08:33:54.699514+0000","last_fullsized":"2024-09-10T08:33:54.699514+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:37.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.709950+0000","last_change":"2024-09-10T08:33:53.706276+0000","last_active":"2024-09-10T08:33:53.709950+0000","last_peered":"2024-09-10T08:33:53.709950+0000","last_clean":"2024-09-10T08:33:53.709950+0000","last_became_active":"2024-09-10T08:33:53.705925+0000","last_became_peered":"2024-09-10T08:33:53.705925+0000","last_unstale":"2024-09-10T08:33:53.709950+0000","last_undegraded":"2024-09-10T08:33:53.709950+0000","last_fullsized":"2024-09-10T08:33:53.709950+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:33.065118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679564+0000","last_change":"2024-09-10T08:33:52.684727+0000","last_active":"2024-09-10T08:33:54.679564+0000","last_peered":"2024-09-10T08:33:54.679564+0000","last_clean":"2024-09-10T08:33:54.679564+0000","last_became_active":"2024-09-10T08:33:52.684455+0000","last_became_peered":"2024-09-10T08:33:52.684455+0000","last_unstale":"2024-09-10T08:33:54.679564+0000","last_undegraded":"2024-09-10T08:33:54.679564+0000","last_fullsized":"2024-09-10T08:33:54.679564+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:05.157125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.705538+0000","last_change":"2024-09-10T08:33:53.702410+0000","last_active":"2024-09-10T08:33:53.705538+0000","last_peered":"2024-09-10T08:33:53.705538+0000","last_clean":"2024-09-10T08:33:53.705538+0000","last_became_active":"2024-09-10T08:33:53.702099+0000","last_became_peered":"2024-09-10T08:33:53.702099+0000","last_unstale":"2024-09-10T08:33:53.705538+0000","last_undegraded":"2024-09-10T08:33:53.705538+0000","last_fullsized":"2024-09-10T08:33:53.705538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:57:52.415147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680075+0000","last_change":"2024-09-10T08:33:52.687725+0000","last_active":"2024-09-10T08:33:54.680075+0000","last_peered":"2024-09-10T08:33:54.680075+0000","last_clean":"2024-09-10T08:33:54.680075+0000","last_became_active":"2024-09-10T08:33:52.687452+0000","last_became_peered":"2024-09-10T08:33:52.687452+0000","last_unstale":"2024-09-10T08:33:54.680075+0000","last_undegraded":"2024-09-10T08:33:54.680075+0000","last_fullsized":"2024-09-10T08:33:54.680075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:07:20.377647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.712341+0000","last_change":"2024-09-10T08:33:53.709231+0000","last_active":"2024-09-10T08:33:53.712341+0000","last_peered":"2024-09-10T08:33:53.712341+0000","last_clean":"2024-09-10T08:33:53.712341+0000","last_became_active":"2024-09-10T08:33:53.708911+0000","last_became_peered":"2024-09-10T08:33:53.708911+0000","last_unstale":"2024-09-10T08:33:53.712341+0000","last_undegraded":"2024-09-10T08:33:53.712341+0000","last_fullsized":"2024-09-10T08:33:53.712341+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:19.290376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"93'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.701363+0000","last_change":"2024-09-10T08:33:52.674114+0000","last_active":"2024-09-10T08:33:54.701363+0000","last_peered":"2024-09-10T08:33:54.701363+0000","last_clean":"2024-09-10T08:33:54.701363+0000","last_became_active":"2024-09-10T08:33:52.673833+0000","last_became_peered":"2024-09-10T08:33:52.673833+0000","last_unstale":"2024-09-10T08:33:54.701363+0000","last_undegraded":"2024-09-10T08:33:54.701363+0000","last_fullsized":"2024-09-10T08:33:54.701363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:18.567706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.700649+0000","last_change":"2024-09-10T08:33:53.697025+0000","last_active":"2024-09-10T08:33:53.700649+0000","last_peered":"2024-09-10T08:33:53.700649+0000","last_clean":"2024-09-10T08:33:53.700649+0000","last_became_active":"2024-09-10T08:33:53.696577+0000","last_became_peered":"2024-09-10T08:33:53.696577+0000","last_unstale":"2024-09-10T08:33:53.700649+0000","last_undegraded":"2024-09-10T08:33:53.700649+0000","last_fullsized":"2024-09-10T08:33:53.700649+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:53.442709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.686968+0000","last_change":"2024-09-10T08:33:52.677746+0000","last_active":"2024-09-10T08:33:53.686968+0000","last_peered":"2024-09-10T08:33:53.686968+0000","last_clean":"2024-09-10T08:33:53.686968+0000","last_became_active":"2024-09-10T08:33:52.677478+0000","last_became_peered":"2024-09-10T08:33:52.677478+0000","last_unstale":"2024-09-10T08:33:53.686968+0000","last_undegraded":"2024-09-10T08:33:53.686968+0000","last_fullsized":"2024-09-10T08:33:53.686968+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:33.783073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.678921+0000","last_change":"2024-09-10T08:33:53.685279+0000","last_active":"2024-09-10T08:33:54.678921+0000","last_peered":"2024-09-10T08:33:54.678921+0000","last_clean":"2024-09-10T08:33:54.678921+0000","last_became_active":"2024-09-10T08:33:53.684998+0000","last_became_peered":"2024-09-10T08:33:53.684998+0000","last_unstale":"2024-09-10T08:33:54.678921+0000","last_undegraded":"2024-09-10T08:33:54.678921+0000","last_fullsized":"2024-09-10T08:33:54.678921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:55.286538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679380+0000","last_change":"2024-09-10T08:33:52.685279+0000","last_active":"2024-09-10T08:33:54.679380+0000","last_peered":"2024-09-10T08:33:54.679380+0000","last_clean":"2024-09-10T08:33:54.679380+0000","last_became_active":"2024-09-10T08:33:52.684928+0000","last_became_peered":"2024-09-10T08:33:52.684928+0000","last_unstale":"2024-09-10T08:33:54.679380+0000","last_undegraded":"2024-09-10T08:33:54.679380+0000","last_fullsized":"2024-09-10T08:33:54.679380+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:49.017218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680053+0000","last_change":"2024-09-10T08:33:53.683529+0000","last_active":"2024-09-10T08:33:54.680053+0000","last_peered":"2024-09-10T08:33:54.680053+0000","last_clean":"2024-09-10T08:33:54.680053+0000","last_became_active":"2024-09-10T08:33:53.682914+0000","last_became_peered":"2024-09-10T08:33:53.682914+0000","last_unstale":"2024-09-10T08:33:54.680053+0000","last_undegraded":"2024-09-10T08:33:54.680053+0000","last_fullsized":"2024-09-10T08:33:54.680053+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:13.475789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.702303+0000","last_change":"2024-09-10T08:33:52.682175+0000","last_active":"2024-09-10T08:33:54.702303+0000","last_peered":"2024-09-10T08:33:54.702303+0000","last_clean":"2024-09-10T08:33:54.702303+0000","last_became_active":"2024-09-10T08:33:52.681879+0000","last_became_peered":"2024-09-10T08:33:52.681879+0000","last_unstale":"2024-09-10T08:33:54.702303+0000","last_undegraded":"2024-09-10T08:33:54.702303+0000","last_fullsized":"2024-09-10T08:33:54.702303+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:38.783574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699465+0000","last_change":"2024-09-10T08:33:53.699538+0000","last_active":"2024-09-10T08:33:54.699465+0000","last_peered":"2024-09-10T08:33:54.699465+0000","last_clean":"2024-09-10T08:33:54.699465+0000","last_became_active":"2024-09-10T08:33:53.697874+0000","last_became_peered":"2024-09-10T08:33:53.697874+0000","last_unstale":"2024-09-10T08:33:54.699465+0000","last_undegraded":"2024-09-10T08:33:54.699465+0000","last_fullsized":"2024-09-10T08:33:54.699465+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:13.807181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679402+0000","last_change":"2024-09-10T08:33:52.690110+0000","last_active":"2024-09-10T08:33:54.679402+0000","last_peered":"2024-09-10T08:33:54.679402+0000","last_clean":"2024-09-10T08:33:54.679402+0000","last_became_active":"2024-09-10T08:33:52.689765+0000","last_became_peered":"2024-09-10T08:33:52.689765+0000","last_unstale":"2024-09-10T08:33:54.679402+0000","last_undegraded":"2024-09-10T08:33:54.679402+0000","last_fullsized":"2024-09-10T08:33:54.679402+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:38.783574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680020+0000","last_change":"2024-09-10T08:33:53.683233+0000","last_active":"2024-09-10T08:33:54.680020+0000","last_peered":"2024-09-10T08:33:54.680020+0000","last_clean":"2024-09-10T08:33:54.680020+0000","last_became_active":"2024-09-10T08:33:53.682926+0000","last_became_peered":"2024-09-10T08:33:53.682926+0000","last_unstale":"2024-09-10T08:33:54.680020+0000","last_undegraded":"2024-09-10T08:33:54.680020+0000","last_fullsized":"2024-09-10T08:33:54.680020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:26.137366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.679983+0000","last_change":"2024-09-10T08:33:52.687287+0000","last_active":"2024-09-10T08:33:54.679983+0000","last_peered":"2024-09-10T08:33:54.679983+0000","last_clean":"2024-09-10T08:33:54.679983+0000","last_became_active":"2024-09-10T08:33:52.686054+0000","last_became_peered":"2024-09-10T08:33:52.686054+0000","last_unstale":"2024-09-10T08:33:54.679983+0000","last_undegraded":"2024-09-10T08:33:54.679983+0000","last_fullsized":"2024-09-10T08:33:54.679983+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:26:14.002183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680038+0000","last_change":"2024-09-10T08:33:53.693097+0000","last_active":"2024-09-10T08:33:54.680038+0000","last_peered":"2024-09-10T08:33:54.680038+0000","last_clean":"2024-09-10T08:33:54.680038+0000","last_became_active":"2024-09-10T08:33:53.692826+0000","last_became_peered":"2024-09-10T08:33:53.692826+0000","last_unstale":"2024-09-10T08:33:54.680038+0000","last_undegraded":"2024-09-10T08:33:54.680038+0000","last_fullsized":"2024-09-10T08:33:54.680038+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:37.352261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.685711+0000","last_change":"2024-09-10T08:33:52.672164+0000","last_active":"2024-09-10T08:33:53.685711+0000","last_peered":"2024-09-10T08:33:53.685711+0000","last_clean":"2024-09-10T08:33:53.685711+0000","last_became_active":"2024-09-10T08:33:52.671450+0000","last_became_peered":"2024-09-10T08:33:52.671450+0000","last_unstale":"2024-09-10T08:33:53.685711+0000","last_undegraded":"2024-09-10T08:33:53.685711+0000","last_fullsized":"2024-09-10T08:33:53.685711+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:36.779702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.699436+0000","last_change":"2024-09-10T08:33:53.714549+0000","last_active":"2024-09-10T08:33:54.699436+0000","last_peered":"2024-09-10T08:33:54.699436+0000","last_clean":"2024-09-10T08:33:54.699436+0000","last_became_active":"2024-09-10T08:33:53.713465+0000","last_became_peered":"2024-09-10T08:33:53.713465+0000","last_unstale":"2024-09-10T08:33:54.699436+0000","last_undegraded":"2024-09-10T08:33:54.699436+0000","last_fullsized":"2024-09-10T08:33:54.699436+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:52.656458+0000","last_clean_scrub_stamp":"2024-09-10T08:33:52.656458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:41.056620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"92'1","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-10T08:33:53.715088+0000","last_change":"2024-09-10T08:33:52.683854+0000","last_active":"2024-09-10T08:33:53.715088+0000","last_peered":"2024-09-10T08:33:53.715088+0000","last_clean":"2024-09-10T08:33:53.715088+0000","last_became_active":"2024-09-10T08:33:52.683523+0000","last_became_peered":"2024-09-10T08:33:52.683523+0000","last_unstale":"2024-09-10T08:33:53.715088+0000","last_undegraded":"2024-09-10T08:33:53.715088+0000","last_fullsized":"2024-09-10T08:33:53.715088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:33:51.650422+0000","last_clean_scrub_stamp":"2024-09-10T08:33:51.650422+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:36.576295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":295,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-10T08:33:54.680089+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:33:54.680089+0000","last_peered":"2024-09-10T08:33:54.680089+0000","last_clean":"2024-09-10T08:33:54.680089+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:33:54.680089+0000","last_undegraded":"2024-09-10T08:33:54.680089+0000","last_fullsized":"2024-09-10T08:33:54.680089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36448,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335392,"statfs":{"total":96636764160,"available":96599441408,"internally_reserved":0,"allocated":1126400,"data_stored":483669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36456,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335384,"statfs":{"total":96636764160,"available":96599433216,"internally_reserved":0,"allocated":1130496,"data_stored":484271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509506,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40608,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331232,"statfs":{"total":96636764160,"available":96595181568,"internally_reserved":0,"allocated":1126400,"data_stored":483633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1134592,"data_stored":484273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1122304,"data_stored":483599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1720320,"data_stored":1074057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1138688,"data_stored":485233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1732608,"data_stored":1075613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:33:58.315 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:33:58.315 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:33:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.515+0000 7f2eb4c00640 1 Processor -- start 2024-09-10T08:33:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.516+0000 7f2eb4c00640 1 -- start start 2024-09-10T08:33:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eb4c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2eb015c310 0x7f2eb0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eb4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2eb00d0880 0x7f2eb00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eb4c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb0072a10 con 0x7f2eb00725c0 2024-09-10T08:33:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eb4c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb00afa10 con 0x7f2eb00d0880 2024-09-10T08:33:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eb4c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb0071220 con 0x7f2eb015c310 2024-09-10T08:33:58.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eafe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2eb00d0880 0x7f2eb00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2ea7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2eb00725c0 0x7f2eb00d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49062/0 (socket says 172.21.15.52:49062) 2024-09-10T08:33:58.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2ea7e00640 1 -- 172.21.15.52:0/2482043062 learned_addr learned my addr 172.21.15.52:0/2482043062 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:58.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.517+0000 7f2eaf400640 1 --2- 172.21.15.52:0/2482043062 >> v2:172.21.15.176:3300/0 conn(0x7f2eb015c310 0x7f2eb0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.518+0000 7f2eafe00640 1 -- 172.21.15.52:0/2482043062 >> v2:172.21.15.176:3300/0 conn(0x7f2eb015c310 msgr2=0x7f2eb0071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.518+0000 7f2eafe00640 1 --2- 172.21.15.52:0/2482043062 >> v2:172.21.15.176:3300/0 conn(0x7f2eb015c310 0x7f2eb0071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.518+0000 7f2eafe00640 1 -- 172.21.15.52:0/2482043062 >> v1:172.21.15.52:6789/0 conn(0x7f2eb00725c0 legacy=0x7f2eb00d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.518+0000 7f2eafe00640 1 -- 172.21.15.52:0/2482043062 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb0071500 con 0x7f2eb00d0880 2024-09-10T08:33:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eafe00640 1 --2- 172.21.15.52:0/2482043062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00d0880 0x7f2eb00cdf80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00b5670 tx=0x7f2ea802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde40c3316387d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eaea00640 1 -- 172.21.15.52:0/2482043062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007740 con 0x7f2eb00d0880 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eaea00640 1 -- 172.21.15.52:0/2482043062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea80078e0 con 0x7f2eb00d0880 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eaea00640 1 -- 172.21.15.52:0/2482043062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007cb0 con 0x7f2eb00d0880 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 -- 172.21.15.52:0/2482043062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00d0880 msgr2=0x7f2eb00cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/2482043062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00d0880 0x7f2eb00cdf80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00b5670 tx=0x7f2ea802a680 comp rx=0 tx=0).stop 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 -- 172.21.15.52:0/2482043062 shutdown_connections 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/2482043062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00d0880 0x7f2eb00cdf80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/2482043062 >> v2:172.21.15.176:3300/0 conn(0x7f2eb015c310 0x7f2eb0071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.519+0000 7f2eb4c00640 1 -- 172.21.15.52:0/2482043062 >> 172.21.15.52:0/2482043062 conn(0x7f2eb006bc10 msgr2=0x7f2eb006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.520+0000 7f2eb4c00640 1 -- 172.21.15.52:0/2482043062 shutdown_connections 2024-09-10T08:33:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.520+0000 7f2eb4c00640 1 -- 172.21.15.52:0/2482043062 wait complete. 2024-09-10T08:33:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.521+0000 7f2eb4c00640 1 Processor -- start 2024-09-10T08:33:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.521+0000 7f2eb4c00640 1 -- start start 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 0x7f2eb01f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb015c310 0x7f2eb00b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0073e30 con 0x7f2eb00725c0 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb00af6c0 con 0x7f2eb015c310 2024-09-10T08:33:58.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eb4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb0073fb0 con 0x7f2eb00d0880 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eaf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37960/0 (socket says 172.21.15.52:37960) 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.522+0000 7f2eaf400640 1 -- 172.21.15.52:0/639178893 learned_addr learned my addr 172.21.15.52:0/639178893 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2ea7e00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 0x7f2eb01f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eafe00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb015c310 0x7f2eb00b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 -- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 msgr2=0x7f2eb01f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 0x7f2eb01f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 -- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb015c310 msgr2=0x7f2eb00b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb015c310 0x7f2eb00b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 -- 172.21.15.52:0/639178893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb015e150 con 0x7f2eb00725c0 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2ea7e00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 0x7f2eb01f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:58.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eaf400640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000d800 tx=0x7f2ea000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000b660 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0019070 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.523+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb015e430 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.524+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000ba20 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.524+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb015e9f0 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.525+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb015c6f0 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.526+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ea000bbc0 con 0x7f2eb00725c0 2024-09-10T08:33:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.526+0000 7f2ea7400640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 0x7f2e8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.526+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f2ea008b1f0 con 0x7f2eb00725c0 2024-09-10T08:33:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.527+0000 7f2ea7e00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 0x7f2e8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.528+0000 7f2ea7e00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 0x7f2e8c06e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00af3e0 tx=0x7f2e98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.531+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ea0059b90 con 0x7f2eb00725c0 2024-09-10T08:33:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.782+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2eb015a4c0 con 0x7f2eb00725c0 2024-09-10T08:33:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.785+0000 7f2ea7400640 1 -- 172.21.15.52:0/639178893 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f2ea0059490 con 0x7f2eb00725c0 2024-09-10T08:33:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:33:58.785 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:33:58.785 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:33:58.786 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:33:58.786 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 msgr2=0x7f2e8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 0x7f2e8c06e320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00af3e0 tx=0x7f2e98009040 comp rx=0 tx=0).stop 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 msgr2=0x7f2eb014d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000d800 tx=0x7f2ea000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 shutdown_connections 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e8c06be60 0x7f2e8c06e320 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2eb015c310 0x7f2eb00b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2eb00d0880 0x7f2eb01f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 --2- 172.21.15.52:0/639178893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2eb00725c0 0x7f2eb014d2b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 >> 172.21.15.52:0/639178893 conn(0x7f2eb006bc10 msgr2=0x7f2eb015c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 shutdown_connections 2024-09-10T08:33:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.787+0000 7f2eb4c00640 1 -- 172.21.15.52:0/639178893 wait complete. 2024-09-10T08:33:58.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:33:58.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.957+0000 7ff0ae600640 1 Processor -- start 2024-09-10T08:33:58.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.957+0000 7ff0ae600640 1 -- start start 2024-09-10T08:33:58.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.958+0000 7ff0ae600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0a80b2d40 0x7ff0a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.958+0000 7ff0ae600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a813eb20 0x7ff0a806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0ae600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a8071180 con 0x7ff0a815bcf0 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0ae600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a8071ab0 con 0x7ff0a80b2d40 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0ae600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8071460 con 0x7ff0a813eb20 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0a80b2d40 0x7ff0a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff0a815bcf0 0x7ff0a815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49068/0 (socket says 172.21.15.52:49068) 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7e00640 1 -- 172.21.15.52:0/314419822 learned_addr learned my addr 172.21.15.52:0/314419822 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7400640 1 -- 172.21.15.52:0/314419822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a813eb20 msgr2=0x7ff0a806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7400640 1 --2- 172.21.15.52:0/314419822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a813eb20 0x7ff0a806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7400640 1 -- 172.21.15.52:0/314419822 >> v1:172.21.15.52:6789/0 conn(0x7ff0a815bcf0 legacy=0x7ff0a815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a7400640 1 -- 172.21.15.52:0/314419822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8071740 con 0x7ff0a80b2d40 2024-09-10T08:33:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.959+0000 7ff0a6a00640 1 -- 172.21.15.52:0/314419822 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935422900 0 0) 0x7ff0a8071180 con 0x7ff0a815bcf0 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.960+0000 7ff0a7400640 1 --2- 172.21.15.52:0/314419822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a80b2d40 0x7ff0a806bc10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8071c30 tx=0x7ff09802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbc00e762d3e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.960+0000 7ff0a6a00640 1 -- 172.21.15.52:0/314419822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098037070 con 0x7ff0a80b2d40 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0a6a00640 1 -- 172.21.15.52:0/314419822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098032440 con 0x7ff0a80b2d40 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0a6a00640 1 -- 172.21.15.52:0/314419822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098032810 con 0x7ff0a80b2d40 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 -- 172.21.15.52:0/314419822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a80b2d40 msgr2=0x7ff0a806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 --2- 172.21.15.52:0/314419822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a80b2d40 0x7ff0a806bc10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8071c30 tx=0x7ff09802a180 comp rx=0 tx=0).stop 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 -- 172.21.15.52:0/314419822 shutdown_connections 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 --2- 172.21.15.52:0/314419822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a813eb20 0x7ff0a806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 --2- 172.21.15.52:0/314419822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a80b2d40 0x7ff0a806bc10 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 -- 172.21.15.52:0/314419822 >> 172.21.15.52:0/314419822 conn(0x7ff0a80ccec0 msgr2=0x7ff0a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 -- 172.21.15.52:0/314419822 shutdown_connections 2024-09-10T08:33:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.961+0000 7ff0ae600640 1 -- 172.21.15.52:0/314419822 wait complete. 2024-09-10T08:33:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.963+0000 7ff0ae600640 1 Processor -- start 2024-09-10T08:33:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.963+0000 7ff0ae600640 1 -- start start 2024-09-10T08:33:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 0x7ff0a813e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a815bcf0 0x7ff0a815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80722d0 con 0x7ff0a813eb20 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8072150 con 0x7ff0a80b2d40 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0ae600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8072450 con 0x7ff0a815bcf0 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff09fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff09fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37984/0 (socket says 172.21.15.52:37984) 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff09fe00640 1 -- 172.21.15.52:0/2327755907 learned_addr learned my addr 172.21.15.52:0/2327755907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0a7400640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 0x7ff0a813e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.964+0000 7ff0a7e00640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a815bcf0 0x7ff0a815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 -- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a815bcf0 msgr2=0x7ff0a815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a815bcf0 0x7ff0a815e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 -- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 msgr2=0x7ff0a813e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 0x7ff0a813e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:58.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 -- 172.21.15.52:0/2327755907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a81426e0 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff0a7400640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 0x7ff0a813e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09fe00640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff09000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090015020 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090011890 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090011c80 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81429c0 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.965+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a8142f80 con 0x7ff0a813eb20 2024-09-10T08:33:58.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.966+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a8072860 con 0x7ff0a813eb20 2024-09-10T08:33:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.967+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff090018020 con 0x7ff0a813eb20 2024-09-10T08:33:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.968+0000 7ff09f400640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:58.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.968+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7ff09008b0c0 con 0x7ff0a813eb20 2024-09-10T08:33:58.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.969+0000 7ff0a7400640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:58.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.970+0000 7ff0a7400640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 0x7ff08406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff098034000 tx=0x7ff09802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:58.972+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff09001f020 con 0x7ff0a813eb20 2024-09-10T08:33:59.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.193+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0a806c9c0 con 0x7ff0a813eb20 2024-09-10T08:33:59.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.193+0000 7ff09f400640 1 -- 172.21.15.52:0/2327755907 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5231 (secure 0 0 0) 0x7ff09000d040 con 0x7ff0a813eb20 2024-09-10T08:33:59.194 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:33:59.194 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":67,"btime":"2024-09-10T08:33:56:695029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3587011080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3587011080},{"type":"v1","addr":"172.21.15.176:6837","nonce":3587011080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1644703485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1644703485},{"type":"v1","addr":"172.21.15.52:6834","nonce":1644703485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3249807442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3249807442},{"type":"v1","addr":"172.21.15.52:6835","nonce":3249807442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:33:56.119676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6676":{"gid":6676,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/2093809753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2093809753},{"type":"v1","addr":"172.21.15.176:6836","nonce":2093809753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6676,"qdb_cluster":[6676]},"id":6}]} 2024-09-10T08:33:59.194 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 67 2024-09-10T08:33:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 msgr2=0x7ff08406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 0x7ff08406e2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff098034000 tx=0x7ff09802e000 comp rx=0 tx=0).stop 2024-09-10T08:33:59.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 msgr2=0x7ff0a8143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff09000b450 tx=0x7ff09000b910 comp rx=0 tx=0).stop 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 shutdown_connections 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0a815bcf0 0x7ff0a815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0a813eb20 0x7ff0a8143780 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.195+0000 7ff0ae600640 1 --2- 172.21.15.52:0/2327755907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0a80b2d40 0x7ff0a813e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.196+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 >> 172.21.15.52:0/2327755907 conn(0x7ff0a80ccec0 msgr2=0x7ff0a80b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.196+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 shutdown_connections 2024-09-10T08:33:59.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.196+0000 7ff0ae600640 1 -- 172.21.15.52:0/2327755907 wait complete. 2024-09-10T08:33:59.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:53.097952+0000', 'modified': '2024-09-10T08:33:56.119676+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6676}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6676': {'gid': 6676, 'name': 'b', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6836/2093809753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 2093809753}, {'type': 'v1', 'addr': '172.21.15.176:6836', 'nonce': 2093809753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6676, 'qdb_cluster': [6676]} 2024-09-10T08:33:59.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:33:59.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T08:33:59.651 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-09-10T08:33:59.651+0000 7f4245e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:33:59.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.775+0000 7f8cc2e00640 1 Processor -- start 2024-09-10T08:33:59.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.775+0000 7f8cc2e00640 1 -- start start 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cc2e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cbc145ed0 0x7f8cbc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cc2e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 0x7f8cbc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cc2e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cbc0b4020 con 0x7f8cbc0b5880 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cc2e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc073b00 con 0x7f8cbc145ed0 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cc2e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8cbc0b63d0 con 0x7f8cbc073180 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cbc145ed0 0x7f8cbc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8cbc145ed0 0x7f8cbc0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37998/0 (socket says 172.21.15.52:37998) 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1556603019 learned_addr learned my addr 172.21.15.52:0/1556603019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1556603019 >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 0x7f8cbc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1556603019 >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 msgr2=0x7f8cbc0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1556603019 >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 0x7f8cbc0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1556603019 >> v1:172.21.15.176:6789/0 conn(0x7f8cbc0b5880 legacy=0x7f8cbc0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1556603019 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc0b42c0 con 0x7f8cbc145ed0 2024-09-10T08:33:59.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.777+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1556603019 >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 0x7f8cbc0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.778+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1556603019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc0b5080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc069cd0 tx=0x7f8cac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83313341197565e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cbb400640 1 -- 172.21.15.52:0/1556603019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac037070 con 0x7f8cbc145ed0 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cbb400640 1 -- 172.21.15.52:0/1556603019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac032440 con 0x7f8cbc145ed0 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cbb400640 1 -- 172.21.15.52:0/1556603019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac032810 con 0x7f8cbc145ed0 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 -- 172.21.15.52:0/1556603019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc145ed0 msgr2=0x7f8cbc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/1556603019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc0b5080 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc069cd0 tx=0x7f8cac02a210 comp rx=0 tx=0).stop 2024-09-10T08:33:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 -- 172.21.15.52:0/1556603019 shutdown_connections 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/1556603019 >> v2:172.21.15.176:3300/0 conn(0x7f8cbc073180 0x7f8cbc0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/1556603019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc0b5080 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 -- 172.21.15.52:0/1556603019 >> 172.21.15.52:0/1556603019 conn(0x7f8cbc0ccec0 msgr2=0x7f8cbc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 -- 172.21.15.52:0/1556603019 shutdown_connections 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.779+0000 7f8cc2e00640 1 -- 172.21.15.52:0/1556603019 wait complete. 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.781+0000 7f8cc2e00640 1 Processor -- start 2024-09-10T08:33:59.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.781+0000 7f8cc2e00640 1 -- start start 2024-09-10T08:33:59.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cbc073180 0x7f8cbc1e9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc0b4b60 con 0x7f8cbc0b5880 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc0b4880 con 0x7f8cbc145ed0 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc1462b0 con 0x7f8cbc073180 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38008/0 (socket says 172.21.15.52:38008) 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cb3400640 1 -- 172.21.15.52:0/2984138746 learned_addr learned my addr 172.21.15.52:0/2984138746 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.782+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cbc073180 0x7f8cbc1e9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 -- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cbc073180 msgr2=0x7f8cbc1e9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cbc073180 0x7f8cbc1e9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 -- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cbc145ed0 msgr2=0x7f8cbc15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 -- 172.21.15.52:0/2984138746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cbc1e8860 con 0x7f8cbc0b5880 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c7f0 tx=0x7f8ca400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb8c00640 1 -- 172.21.15.52:0/2984138746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4015070 con 0x7f8cbc0b5880 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb8c00640 1 -- 172.21.15.52:0/2984138746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca4007820 con 0x7f8cbc0b5880 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cb8c00640 1 -- 172.21.15.52:0/2984138746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4007bd0 con 0x7f8cbc0b5880 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cbc1e8b40 con 0x7f8cbc0b5880 2024-09-10T08:33:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.783+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cbc1e9100 con 0x7f8cbc0b5880 2024-09-10T08:33:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.786+0000 7f8cb8c00640 1 -- 172.21.15.52:0/2984138746 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ca4018070 con 0x7f8cbc0b5880 2024-09-10T08:33:59.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.787+0000 7f8cc5c55740 1 Processor -- start 2024-09-10T08:33:59.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.787+0000 7f8cc5c55740 1 -- start start 2024-09-10T08:33:59.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.787+0000 7f8cb8c00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 0x7f8c9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cb8c00640 1 -- 172.21.15.52:0/2984138746 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f8ca408aef0 con 0x7f8cbc0b5880 2024-09-10T08:33:59.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 0x7f8c9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53dcf0 0x55900b583490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b538570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55900b49c3b0 con 0x55900b53b4b0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55900b4a1410 con 0x55900b53dcf0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55900b449620 con 0x55900b53f480 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38010/0 (socket says 172.21.15.52:38010) 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cb3400640 1 -- 172.21.15.52:0/2967273973 learned_addr learned my addr 172.21.15.52:0/2967273973 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.788+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53dcf0 0x55900b583490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b538570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 -- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 msgr2=0x55900b538570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b538570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 0x7f8c9806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4001ec0 tx=0x7f8cb40015d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 -- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53dcf0 msgr2=0x55900b583490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53dcf0 0x55900b583490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 -- 172.21.15.52:0/2967273973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900b1b42d0 con 0x55900b53b4b0 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb3400640 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4089360 tx=0x7f8ca4059390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb47421b19710256 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb0c00640 1 -- 172.21.15.52:0/2967273973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca401f040 con 0x55900b53b4b0 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb0c00640 1 -- 172.21.15.52:0/2967273973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca4057550 con 0x55900b53b4b0 2024-09-10T08:33:59.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.789+0000 7f8cb0c00640 1 -- 172.21.15.52:0/2967273973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40558c0 con 0x55900b53b4b0 2024-09-10T08:33:59.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 -- 172.21.15.52:0/2967273973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 msgr2=0x55900b53e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4089360 tx=0x7f8ca4059390 comp rx=0 tx=0).stop 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 -- 172.21.15.52:0/2967273973 shutdown_connections 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b538570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53b4b0 0x55900b53e0d0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/2967273973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53dcf0 0x55900b583490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 -- 172.21.15.52:0/2967273973 >> 172.21.15.52:0/2967273973 conn(0x55900b53a740 msgr2=0x55900b582960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 -- 172.21.15.52:0/2967273973 shutdown_connections 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.790+0000 7f8cc5c55740 1 -- 172.21.15.52:0/2967273973 wait complete. 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.791+0000 7f8cc5c55740 1 -- start start 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.791+0000 7f8cc5c55740 1 Processor -- start 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53f480 0x55900b54f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b551a00 0x55900b57cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55900b45c780 con 0x55900b53dcf0 2024-09-10T08:33:59.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55900b49d3d0 con 0x55900b53f480 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55900b539be0 con 0x55900b551a00 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc5c55740 10 client.0 _ll_register_callbacks cb 0x55900b49a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38020/0 (socket says 172.21.15.52:38020) 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1881129947 learned_addr learned my addr 172.21.15.52:0/1881129947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b551a00 0x55900b57cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.792+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53f480 0x55900b54f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b551a00 msgr2=0x55900b57cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b551a00 0x55900b57cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53f480 msgr2=0x55900b54f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53f480 0x55900b54f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1881129947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900b27e6b0 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02a250 tx=0x7f8cac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59acc7ab561fdca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8ca9600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac042070 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f8cac047ab0 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.793+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca4057550 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f8cac037040 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 10 client.7182 fetch_fsmap learned FSMap version 67 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55900b5526c0 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca4057550 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7f8cac047cb0 con 0x55900b53dcf0 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 10 client.7182 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 10 client.7182 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 20 client.7182 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b57fc30 0x55900b592f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 4 client.7182 mds_command: new command op to 6676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:33:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.794+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 --> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55900b4aeb40 con 0x55900b57fc30 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.795+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b57fc30 0x55900b592f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.795+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b57fc30 0x55900b592f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa21473fd5182b35 server_cookie=acea072dbd7d5e in_seq=0 out_seq=0 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.795+0000 7f8ca9600640 10 client.7182 ms_handle_connect on v2:172.21.15.176:6834/2093809753 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8ca9600640 1 -- 172.21.15.52:0/1881129947 <== mds.0 v2:172.21.15.176:6834/2093809753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55900b4aeb40 con 0x55900b57fc30 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8ca9600640 10 client.7182 handle_command_reply: tid=0 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 client.7182 shutdown 2024-09-10T08:33:59.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 msgr2=0x55900b596910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02a250 tx=0x7f8cac004730 comp rx=0 tx=0).stop 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 shutdown_connections 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b57fc30 0x55900b592f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b551a00 0x55900b57cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b53f480 0x55900b54f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1881129947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b596910 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8ca9600640 0 client.7182 ms_handle_reset on v2:172.21.15.176:6834/2093809753 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 >> 172.21.15.52:0/1881129947 conn(0x55900b53b4b0 msgr2=0x55900b581ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 shutdown_connections 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1881129947 wait complete. 2024-09-10T08:33:59.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.797+0000 7f8cc5c55740 20 client.7182 trim_cache size 0 max 16384 2024-09-10T08:33:59.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.816+0000 7f8cc5c55740 1 Processor -- start 2024-09-10T08:33:59.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.816+0000 7f8cc5c55740 1 -- start start 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53dcf0 0x55900b591ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1ffe10 con 0x55900b53f480 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cbc1e2250 con 0x55900b551a00 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8cbc1e28a0 con 0x55900b53dcf0 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38022/0 (socket says 172.21.15.52:38022) 2024-09-10T08:33:59.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 -- 172.21.15.52:0/1870087903 learned_addr learned my addr 172.21.15.52:0/1870087903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53dcf0 0x55900b591ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 -- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53dcf0 msgr2=0x55900b591ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53dcf0 0x55900b591ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 -- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 msgr2=0x55900b5fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5fadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.817+0000 7f8cb3400640 1 -- 172.21.15.52:0/1870087903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55900b49d360 con 0x55900b53f480 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4061cf0 tx=0x7f8ca401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1689f2b11f0efc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cabe00640 1 -- 172.21.15.52:0/1870087903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca401f040 con 0x55900b53f480 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cabe00640 1 -- 172.21.15.52:0/1870087903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40558c0 con 0x55900b53f480 2024-09-10T08:33:59.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cabe00640 1 -- 172.21.15.52:0/1870087903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40586a0 con 0x55900b53f480 2024-09-10T08:33:59.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1870087903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 msgr2=0x55900b563f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4061cf0 tx=0x7f8ca401b000 comp rx=0 tx=0).stop 2024-09-10T08:33:59.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1870087903 shutdown_connections 2024-09-10T08:33:59.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53f480 0x55900b563f00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1870087903 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53dcf0 0x55900b591ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.818+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1870087903 >> 172.21.15.52:0/1870087903 conn(0x55900b53b4b0 msgr2=0x55900b580ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.819+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1870087903 shutdown_connections 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.819+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1870087903 wait complete. 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.819+0000 7f8cc5c55740 1 -- start start 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.819+0000 7f8cc5c55740 1 Processor -- start 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b5e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55900b537750 con 0x55900b53dcf0 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55900b57f2b0 con 0x55900b551a00 2024-09-10T08:33:59.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55900b5800a0 con 0x55900b53f480 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cc5c55740 10 client.0 _ll_register_callbacks cb 0x7f8cac0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.820+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38036/0 (socket says 172.21.15.52:38036) 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1934613333 learned_addr learned my addr 172.21.15.52:0/1934613333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b5e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cc0e00640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 msgr2=0x55900b5e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b5e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 msgr2=0x55900b5e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 -- 172.21.15.52:0/1934613333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55900b537a50 con 0x55900b53dcf0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8cbbe00640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02a250 tx=0x7f8cac009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb95798c5670cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8ca9600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:33:59.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.821+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac054070 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca40558c0 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f8cac003820 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f8cac042040 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 10 client.7188 fetch_fsmap learned FSMap version 67 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55900b57e9e0 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40558c0 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7f8cac063080 con 0x55900b53dcf0 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 10 client.7188 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 10 client.7188 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 20 client.7188 populate_metadata read hostname 'smithi052' 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b5681f0 0x55900b6010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 4 client.7188 mds_command: new command op to 6676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:33:59.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.822+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 --> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] -- command(tid 0: {"prefix": "status"}) -- 0x55900b4a8e90 con 0x55900b5681f0 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b5681f0 0x55900b6010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8cb3400640 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b5681f0 0x55900b6010a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c56e2f487420d14 server_cookie=dbae91fa552cd3bd in_seq=0 out_seq=0 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8ca9600640 10 client.7188 ms_handle_connect on v2:172.21.15.176:6834/2093809753 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8ca9600640 1 -- 172.21.15.52:0/1934613333 <== mds.0 v2:172.21.15.176:6834/2093809753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55900b4a8e90 con 0x55900b5681f0 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8ca9600640 10 client.7188 handle_command_reply: tid=0 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.823+0000 7f8cc5c55740 1 client.7188 shutdown 2024-09-10T08:33:59.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 msgr2=0x55900b57e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8cac02a250 tx=0x7f8cac009240 comp rx=0 tx=0).stop 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 shutdown_connections 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55900b5681f0 0x55900b6010a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55900b551a00 0x55900b5e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55900b53f480 0x55900b5e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 --2- 172.21.15.52:0/1934613333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55900b53dcf0 0x55900b57e4a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 >> 172.21.15.52:0/1934613333 conn(0x55900b53b4b0 msgr2=0x55900b591ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8ca9600640 0 client.7188 ms_handle_reset on v2:172.21.15.176:6834/2093809753 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 shutdown_connections 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 1 -- 172.21.15.52:0/1934613333 wait complete. 2024-09-10T08:33:59.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc5c55740 20 client.7188 trim_cache size 0 max 16384 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 6676, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1383299449999997, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 67, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 93, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 93, 2024-09-10T08:33:59.829 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.834183887 2024-09-10T08:33:59.830 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:33:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 msgr2=0x7f8c9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 0x7f8c9806e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4001ec0 tx=0x7f8cb40015d0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 msgr2=0x7f8cbc1e6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.824+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c7f0 tx=0x7f8ca400ccb0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 shutdown_connections 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c9806be30 0x7f8c9806e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cbc145ed0 0x7f8cbc15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8cbc0b5880 0x7f8cbc1e6490 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 --2- 172.21.15.52:0/2984138746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8cbc073180 0x7f8cbc1e9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 >> 172.21.15.52:0/2984138746 conn(0x7f8cbc0ccec0 msgr2=0x7f8cbc0cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 shutdown_connections 2024-09-10T08:33:59.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.825+0000 7f8cc2e00640 1 -- 172.21.15.52:0/2984138746 wait complete. 2024-09-10T08:33:59.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:33:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.995+0000 7f72d5a00640 1 Processor -- start 2024-09-10T08:33:59.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.995+0000 7f72d5a00640 1 -- start start 2024-09-10T08:33:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72d5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d015e790 0x7f72d0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72d5a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72d0162c60 0x7f72d00b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:33:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72d5a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d01631c0 con 0x7f72d00b5970 2024-09-10T08:33:59.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72d5a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f72d015eb70 con 0x7f72d0162c60 2024-09-10T08:33:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72d5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00ae9a0 con 0x7f72d015e790 2024-09-10T08:33:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72c6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72d0162c60 0x7f72d00b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72c6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72d0162c60 0x7f72d00b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38042/0 (socket says 172.21.15.52:38042) 2024-09-10T08:33:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72c6000640 1 -- 172.21.15.52:0/3517360785 learned_addr learned my addr 172.21.15.52:0/3517360785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:33:59.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.997+0000 7f72cea00640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d015e790 0x7f72d0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:33:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.998+0000 7f72c6000640 1 -- 172.21.15.52:0/3517360785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d015e790 msgr2=0x7f72d0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:33:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.998+0000 7f72c6000640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d015e790 0x7f72d0073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:33:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.998+0000 7f72c6000640 1 -- 172.21.15.52:0/3517360785 >> v1:172.21.15.176:6789/0 conn(0x7f72d00b5970 legacy=0x7f72d006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:33:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.998+0000 7f72c6000640 1 -- 172.21.15.52:0/3517360785 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00aec40 con 0x7f72d0162c60 2024-09-10T08:33:59.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.999+0000 7f72c6000640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d0162c60 0x7f72d00b5430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009870 tx=0x7f72b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9957dba548cd972d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.999+0000 7f72ce000640 1 -- 172.21.15.52:0/3517360785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037070 con 0x7f72d0162c60 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.999+0000 7f72ce000640 1 -- 172.21.15.52:0/3517360785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8032440 con 0x7f72d0162c60 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:33:59.999+0000 7f72ce000640 1 -- 172.21.15.52:0/3517360785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8032810 con 0x7f72d0162c60 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 -- 172.21.15.52:0/3517360785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d0162c60 msgr2=0x7f72d00b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d0162c60 0x7f72d00b5430 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009870 tx=0x7f72b802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 -- 172.21.15.52:0/3517360785 shutdown_connections 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d0162c60 0x7f72d00b5430 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 --2- 172.21.15.52:0/3517360785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d015e790 0x7f72d0073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 -- 172.21.15.52:0/3517360785 >> 172.21.15.52:0/3517360785 conn(0x7f72d00b0a80 msgr2=0x7f72d00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 -- 172.21.15.52:0/3517360785 shutdown_connections 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.000+0000 7f72d5a00640 1 -- 172.21.15.52:0/3517360785 wait complete. 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.001+0000 7f72d5a00640 1 Processor -- start 2024-09-10T08:34:00.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 -- start start 2024-09-10T08:34:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72d00b5970 0x7f72d0149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d0162c60 0x7f72d00cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72d006f430 con 0x7f72d015e790 2024-09-10T08:34:00.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00af200 con 0x7f72d00b5970 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.002+0000 7f72d5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72d006fe40 con 0x7f72d0162c60 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38056/0 (socket says 172.21.15.52:38056) 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 -- 172.21.15.52:0/2060046774 learned_addr learned my addr 172.21.15.52:0/2060046774 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72cea00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72d00b5970 0x7f72d0149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72cf400640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d0162c60 0x7f72d00cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 -- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d0162c60 msgr2=0x7f72d00cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d0162c60 0x7f72d00cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 -- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72d00b5970 msgr2=0x7f72d0149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72d00b5970 0x7f72d0149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 -- 172.21.15.52:0/2060046774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01608f0 con 0x7f72d015e790 2024-09-10T08:34:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.003+0000 7f72c6000640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f72b802a200 tx=0x7f72b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.004+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8041030 con 0x7f72d015e790 2024-09-10T08:34:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.004+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8030440 con 0x7f72d015e790 2024-09-10T08:34:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.004+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037040 con 0x7f72d015e790 2024-09-10T08:34:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.004+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d0160330 con 0x7f72d015e790 2024-09-10T08:34:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.004+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d0160c00 con 0x7f72d015e790 2024-09-10T08:34:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.005+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d00b3000 con 0x7f72d015e790 2024-09-10T08:34:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.006+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72b8044070 con 0x7f72d015e790 2024-09-10T08:34:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.007+0000 7f72c7400640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 0x7f72ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.007+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f72b80ab320 con 0x7f72d015e790 2024-09-10T08:34:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.007+0000 7f72cea00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 0x7f72ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.008+0000 7f72cea00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 0x7f72ac06e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009b40 tx=0x7f72c0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.011+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72d00b3000 con 0x7f72d015e790 2024-09-10T08:34:00.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.232+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f72d00b2290 con 0x7f72d015e790 2024-09-10T08:34:00.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.232+0000 7f72c7400640 1 -- 172.21.15.52:0/2060046774 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) ==== 53+0+73 (secure 0 0 0) 0x7f72b8079710 con 0x7f72d015e790 2024-09-10T08:34:00.233 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 msgr2=0x7f72ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 0x7f72ac06e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009b40 tx=0x7f72c0009190 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 msgr2=0x7f72d014a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f72b802a200 tx=0x7f72b80046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 shutdown_connections 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72ac06be30 0x7f72ac06e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72d0162c60 0x7f72d00cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72d015e790 0x7f72d014a000 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 --2- 172.21.15.52:0/2060046774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72d00b5970 0x7f72d0149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:00.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 >> 172.21.15.52:0/2060046774 conn(0x7f72d00b0a80 msgr2=0x7f72d0157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:00.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 shutdown_connections 2024-09-10T08:34:00.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00.234+0000 7f72d5a00640 1 -- 172.21.15.52:0/2060046774 wait complete. 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:00.250 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:34:00.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:34:00.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:34:00.251 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:00.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.251 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:34:00.287 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42362sec preferred_lft 42362sec 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:34:00.288 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:34:00.289 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:00.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.290 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:34:00.380 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:34:00.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.383 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:34:00.419 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:34:00.419 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:34:00.419 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:34:00.419 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:34:00.419 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:34:00.420 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:34:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:34:00.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:00.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.616 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:34:00.651 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:34:00.651 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:34:00.652 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:00.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.652 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:34:00.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:34:00.749 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:00.784 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:00.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:34:00.784 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:00.858 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:34:00.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:00.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:00.987 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:00.987 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:34:01.015 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:01.015 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:34:01.015 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:34:01.015 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:34:01.015 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:34:01.016 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:34:01.017 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:34:01.017 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:34:01.017 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:34:01.017 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:34:01.020 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:34:01.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:01.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:01.076 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:34:01.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:34:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:01.176 INFO:teuthology.orchestra.run.smithi052.stdout:client6793 2024-09-10T08:34:01.177 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:01.177 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:01.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:01.212 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-10T08:34:01.295 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:34:01.296 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:34:01.296 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:34:01.296 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:01.296 DEBUG:teuthology.orchestra.run.smithi052:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-10T08:34:01.296 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:34:01.437 INFO:teuthology.orchestra.run.smithi052.stdout:1099511627776 2024-09-10T08:34:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:01.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:01.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.644+0000 7f9eb8400640 1 Processor -- start 2024-09-10T08:34:01.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.644+0000 7f9eb8400640 1 -- start start 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.645+0000 7f9eb8400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9eb013eb20 0x7f9eb015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.645+0000 7f9eb8400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb0071180 con 0x7f9eb00b2d40 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb8400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb0071460 con 0x7f9eb006c320 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb8400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb0071ab0 con 0x7f9eb013eb20 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb5a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9eb00b2d40 0x7f9eb006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49074/0 (socket says 172.21.15.52:49074) 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb5a00640 1 -- 172.21.15.52:0/986989417 learned_addr learned my addr 172.21.15.52:0/986989417 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb6400640 1 --2- 172.21.15.52:0/986989417 >> v2:172.21.15.52:3300/0 conn(0x7f9eb013eb20 0x7f9eb015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:01.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eafe00640 1 -- 172.21.15.52:0/986989417 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736911072 0 0) 0x7f9eb0071180 con 0x7f9eb00b2d40 2024-09-10T08:34:01.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb6400640 1 -- 172.21.15.52:0/986989417 >> v1:172.21.15.176:6789/0 conn(0x7f9eb006c320 legacy=0x7f9eb015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:01.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb6400640 1 -- 172.21.15.52:0/986989417 >> v1:172.21.15.52:6789/0 conn(0x7f9eb00b2d40 legacy=0x7f9eb006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.646+0000 7f9eb6400640 1 -- 172.21.15.52:0/986989417 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb0071740 con 0x7f9eb013eb20 2024-09-10T08:34:01.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.647+0000 7f9eb6400640 1 --2- 172.21.15.52:0/986989417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb015c400 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac08a95da92e8b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:01.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.647+0000 7f9eafe00640 1 -- 172.21.15.52:0/986989417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007740 con 0x7f9eb013eb20 2024-09-10T08:34:01.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.647+0000 7f9eafe00640 1 -- 172.21.15.52:0/986989417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea80078e0 con 0x7f9eb013eb20 2024-09-10T08:34:01.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.647+0000 7f9eafe00640 1 -- 172.21.15.52:0/986989417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007cb0 con 0x7f9eb013eb20 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 -- 172.21.15.52:0/986989417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 msgr2=0x7f9eb015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 --2- 172.21.15.52:0/986989417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb015c400 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea802a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 -- 172.21.15.52:0/986989417 shutdown_connections 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 --2- 172.21.15.52:0/986989417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb015c400 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 -- 172.21.15.52:0/986989417 >> 172.21.15.52:0/986989417 conn(0x7f9eb00ccec0 msgr2=0x7f9eb00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 -- 172.21.15.52:0/986989417 shutdown_connections 2024-09-10T08:34:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.648+0000 7f9eb8400640 1 -- 172.21.15.52:0/986989417 wait complete. 2024-09-10T08:34:01.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.650+0000 7f9eb8400640 1 Processor -- start 2024-09-10T08:34:01.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.650+0000 7f9eb8400640 1 -- start start 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb006c320 0x7f9eb013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb00b2d40 0x7f9eb01f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb01666e0 con 0x7f9eb013eb20 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb0166560 con 0x7f9eb00b2d40 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb0166860 con 0x7f9eb006c320 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38068/0 (socket says 172.21.15.52:38068) 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb6400640 1 -- 172.21.15.52:0/3987659166 learned_addr learned my addr 172.21.15.52:0/3987659166 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb5a00640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb006c320 0x7f9eb013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.651+0000 7f9eb5000640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb00b2d40 0x7f9eb01f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 -- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb006c320 msgr2=0x7f9eb013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb006c320 0x7f9eb013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 -- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb00b2d40 msgr2=0x7f9eb01f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb00b2d40 0x7f9eb01f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 -- 172.21.15.52:0/3987659166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb0165ab0 con 0x7f9eb013eb20 2024-09-10T08:34:01.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb6400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8040070 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8031c40 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8003990 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb0141d40 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.652+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb0142020 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.654+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb006bc10 con 0x7f9eb013eb20 2024-09-10T08:34:01.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.654+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ea8039040 con 0x7f9eb013eb20 2024-09-10T08:34:01.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.655+0000 7f9ead600640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:01.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.655+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea80abe80 con 0x7f9eb013eb20 2024-09-10T08:34:01.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.656+0000 7f9eb5a00640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:01.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.657+0000 7f9eb5a00640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 0x7f9e9006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4000f60 tx=0x7f9ea4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:01.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.660+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ea807a140 con 0x7f9eb013eb20 2024-09-10T08:34:01.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.884+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb0141390 con 0x7f9eb013eb20 2024-09-10T08:34:01.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.885+0000 7f9ead600640 1 -- 172.21.15.52:0/3987659166 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5231 (secure 0 0 0) 0x7f9ea807e440 con 0x7f9eb013eb20 2024-09-10T08:34:01.885 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:01.886 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":67,"btime":"2024-09-10T08:33:56:695029+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6149,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3587011080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3587011080},{"type":"v1","addr":"172.21.15.176:6837","nonce":3587011080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6152,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1644703485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1644703485},{"type":"v1","addr":"172.21.15.52:6834","nonce":1644703485}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6155,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3249807442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3249807442},{"type":"v1","addr":"172.21.15.52:6835","nonce":3249807442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:33:56.119676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6676":{"gid":6676,"name":"b","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/2093809753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2093809753},{"type":"v1","addr":"172.21.15.176:6836","nonce":2093809753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6676,"qdb_cluster":[6676]},"id":6}]} 2024-09-10T08:34:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 67 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 msgr2=0x7f9e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 0x7f9e9006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4000f60 tx=0x7f9ea4007d50 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 msgr2=0x7f9eb01405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009d90 tx=0x7f9ea8004a40 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 shutdown_connections 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9e9006be30 0x7f9e9006e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9eb013eb20 0x7f9eb01405c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9eb00b2d40 0x7f9eb01f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 --2- 172.21.15.52:0/3987659166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9eb006c320 0x7f9eb013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 >> 172.21.15.52:0/3987659166 conn(0x7f9eb00ccec0 msgr2=0x7f9eb01379f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 shutdown_connections 2024-09-10T08:34:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:01.887+0000 7f9eb8400640 1 -- 172.21.15.52:0/3987659166 wait complete. 2024-09-10T08:34:01.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1099511627776 2024-09-10T08:34:02.082 INFO:teuthology.orchestra.run.smithi176.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:34:01.291966+0000","btime":"2024-09-10T08:34:01.291966+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:34:01.291966+0000","atime":"2024-09-10T08:34:01.291966+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6793,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6793,"want_loner":6793,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:34:02.082 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:34:01.291966+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-10T08:34:01.291966+0000", "change_attr": 0, "client_caps": [ { "client_id": 6793, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-10T08:34:01.291966+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6793, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:34:01.291966+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6793, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:34:02.083 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:02.083 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:02.119 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:34:02.119 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:34:02.119 DEBUG:teuthology.orchestra.run.smithi052:> import uuid 2024-09-10T08:34:02.119 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:02.119 DEBUG:teuthology.orchestra.run.smithi052:> n = 21 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = False 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> if 0 > 0: 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = True 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> dpath = os.path.dirname(path) 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> fnameprefix = os.path.basename(path) 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> os.makedirs(dpath, exist_ok=True) 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T08:34:02.120 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> for i in range(n): 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> f.write(f"{i}") 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> f.flush() 2024-09-10T08:34:02.121 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(f.fileno()) 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> os.unlink(fpath) 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> if create_hard_links: 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> for j in range(0): 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> finally: 2024-09-10T08:34:02.122 DEBUG:teuthology.orchestra.run.smithi052:> os.close(dirfd) 2024-09-10T08:34:02.123 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:34:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:02.304 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:02.304 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:02.379 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:02.380 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:02.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:34:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.652+0000 7f7fb7400640 1 Processor -- start 2024-09-10T08:34:02.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.653+0000 7f7fb7400640 1 -- start start 2024-09-10T08:34:02.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 0x7f7fb00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 0x7f7fb00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb7400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb00b4020 con 0x7f7fb00b5880 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb7400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb0073b00 con 0x7f7fb0145ed0 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb7400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb00b42c0 con 0x7f7fb0073180 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb4a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 0x7f7fb00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fafe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 0x7f7fb00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb5400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f7fb00b5880 0x7f7fb00b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60554/0 (socket says 172.21.15.52:60554) 2024-09-10T08:34:02.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.654+0000 7f7fb5400640 1 -- 172.21.15.52:0/517904387 learned_addr learned my addr 172.21.15.52:0/517904387 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:02.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7faf400640 1 -- 172.21.15.52:0/517904387 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884072086 0 0) 0x7f7fb00b4020 con 0x7f7fb00b5880 2024-09-10T08:34:02.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7fafe00640 1 -- 172.21.15.52:0/517904387 >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 msgr2=0x7f7fb00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:02.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7fafe00640 1 --2- 172.21.15.52:0/517904387 >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 0x7f7fb00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7fafe00640 1 -- 172.21.15.52:0/517904387 >> v1:172.21.15.176:6789/0 conn(0x7f7fb00b5880 legacy=0x7f7fb00b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7fafe00640 1 -- 172.21.15.52:0/517904387 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb00b45a0 con 0x7f7fb0073180 2024-09-10T08:34:02.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.655+0000 7f7fb4a00640 1 --2- 172.21.15.52:0/517904387 >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 0x7f7fb00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:02.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.656+0000 7f7fafe00640 1 --2- 172.21.15.52:0/517904387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 0x7f7fb00735c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0097a0 tx=0x7f7f9c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257efb8e516f0ace server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:02.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.656+0000 7f7faf400640 1 -- 172.21.15.52:0/517904387 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c037070 con 0x7f7fb0073180 2024-09-10T08:34:02.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.656+0000 7f7faf400640 1 -- 172.21.15.52:0/517904387 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c032440 con 0x7f7fb0073180 2024-09-10T08:34:02.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.656+0000 7f7faf400640 1 -- 172.21.15.52:0/517904387 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c032810 con 0x7f7fb0073180 2024-09-10T08:34:02.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 -- 172.21.15.52:0/517904387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 msgr2=0x7f7fb00735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 --2- 172.21.15.52:0/517904387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 0x7f7fb00735c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0097a0 tx=0x7f7f9c02a180 comp rx=0 tx=0).stop 2024-09-10T08:34:02.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 -- 172.21.15.52:0/517904387 shutdown_connections 2024-09-10T08:34:02.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 --2- 172.21.15.52:0/517904387 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb0073180 0x7f7fb00735c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 --2- 172.21.15.52:0/517904387 >> v2:172.21.15.176:3300/0 conn(0x7f7fb0145ed0 0x7f7fb00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 -- 172.21.15.52:0/517904387 >> 172.21.15.52:0/517904387 conn(0x7f7fb00ccec0 msgr2=0x7f7fb00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:02.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 -- 172.21.15.52:0/517904387 shutdown_connections 2024-09-10T08:34:02.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.657+0000 7f7fb7400640 1 -- 172.21.15.52:0/517904387 wait complete. 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.659+0000 7f7fb7400640 1 Processor -- start 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.659+0000 7f7fb7400640 1 -- start start 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b5880 0x7f7fb013feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 0x7f7fb01403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb01462b0 con 0x7f7fb0073180 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb00b4b60 con 0x7f7fb0145ed0 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb7400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb0146430 con 0x7f7fb00b5880 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38084/0 (socket says 172.21.15.52:38084) 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 -- 172.21.15.52:0/1490666184 learned_addr learned my addr 172.21.15.52:0/1490666184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fafe00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b5880 0x7f7fb013feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb5400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 0x7f7fb01403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 -- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b5880 msgr2=0x7f7fb013feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b5880 0x7f7fb013feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 -- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 msgr2=0x7f7fb01403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 0x7f7fb01403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb4a00640 1 -- 172.21.15.52:0/1490666184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01f3fb0 con 0x7f7fb0073180 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.660+0000 7f7fb5400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 0x7f7fb01403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:02.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7fb4a00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e960 tx=0x7f7fa400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4017070 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb0158e70 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa400c9a0 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400cd70 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.661+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb0159430 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.662+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb00735c0 con 0x7f7fb0073180 2024-09-10T08:34:02.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.663+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fa401a070 con 0x7f7fb0073180 2024-09-10T08:34:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.664+0000 7f7facc00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 0x7f7f9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.664+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f7fa408b080 con 0x7f7fb0073180 2024-09-10T08:34:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.664+0000 7f7fafe00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 0x7f7f9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.665+0000 7f7fafe00640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 0x7f7f9006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c034000 tx=0x7f7f9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.669+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fa4059340 con 0x7f7fb0073180 2024-09-10T08:34:02.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.865+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7fb00008d0 con 0x7f7fb0073180 2024-09-10T08:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.865+0000 7f7facc00640 1 -- 172.21.15.52:0/1490666184 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7f7fa405d640 con 0x7f7fb0073180 2024-09-10T08:34:02.866 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:34:02.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 msgr2=0x7f7f9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 0x7f7f9006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c034000 tx=0x7f7f9c02e000 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 msgr2=0x7f7fb013f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400e960 tx=0x7f7fa400ee20 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 shutdown_connections 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f9006be30 0x7f7f9006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb0145ed0 0x7f7fb01403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b5880 0x7f7fb013feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 --2- 172.21.15.52:0/1490666184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0073180 0x7f7fb013f970 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 >> 172.21.15.52:0/1490666184 conn(0x7f7fb00ccec0 msgr2=0x7f7fb0070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 shutdown_connections 2024-09-10T08:34:02.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:02.868+0000 7f7fb7400640 1 -- 172.21.15.52:0/1490666184 wait complete. 2024-09-10T08:34:02.885 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:34:02.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:02.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:03.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:34:03.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:03.007 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:34:03.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-10T08:34:03.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.248+0000 7fbf7fe00640 1 Processor -- start 2024-09-10T08:34:03.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.248+0000 7fbf7fe00640 1 -- start start 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 0x7fbf800cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf8015ea30 0x7fbf8015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8015f3a0 con 0x7fbf8015e650 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800cf650 con 0x7fbf8015ea30 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbf800735d0 con 0x7fbf800ceca0 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf8015ea30 0x7fbf8015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbf8015ea30 0x7fbf8015ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38098/0 (socket says 172.21.15.52:38098) 2024-09-10T08:34:03.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf7f400640 1 -- 172.21.15.52:0/3542701192 learned_addr learned my addr 172.21.15.52:0/3542701192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.249+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3542701192 >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 0x7fbf800cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.250+0000 7fbf7f400640 1 -- 172.21.15.52:0/3542701192 >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 msgr2=0x7fbf800cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.250+0000 7fbf7f400640 1 --2- 172.21.15.52:0/3542701192 >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 0x7fbf800cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.250+0000 7fbf7f400640 1 -- 172.21.15.52:0/3542701192 >> v1:172.21.15.176:6789/0 conn(0x7fbf8015e650 legacy=0x7fbf80073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.250+0000 7fbf7f400640 1 -- 172.21.15.52:0/3542701192 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf80074170 con 0x7fbf8015ea30 2024-09-10T08:34:03.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.250+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3542701192 >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 0x7fbf800cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:03.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.251+0000 7fbf7f400640 1 --2- 172.21.15.52:0/3542701192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf8015ea30 0x7fbf8015ee60 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbf800d23d0 tx=0x7fbf7802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7144c28e6d70e51f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.251+0000 7fbf7e000640 1 -- 172.21.15.52:0/3542701192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78036070 con 0x7fbf8015ea30 2024-09-10T08:34:03.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.251+0000 7fbf7e000640 1 -- 172.21.15.52:0/3542701192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf78031600 con 0x7fbf8015ea30 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.251+0000 7fbf7e000640 1 -- 172.21.15.52:0/3542701192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf780319d0 con 0x7fbf8015ea30 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 -- 172.21.15.52:0/3542701192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf8015ea30 msgr2=0x7fbf8015ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/3542701192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf8015ea30 0x7fbf8015ee60 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbf800d23d0 tx=0x7fbf7802a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 -- 172.21.15.52:0/3542701192 shutdown_connections 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/3542701192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf8015ea30 0x7fbf8015ee60 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/3542701192 >> v2:172.21.15.176:3300/0 conn(0x7fbf800ceca0 0x7fbf800cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 -- 172.21.15.52:0/3542701192 >> 172.21.15.52:0/3542701192 conn(0x7fbf800b40d0 msgr2=0x7fbf800b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 -- 172.21.15.52:0/3542701192 shutdown_connections 2024-09-10T08:34:03.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.252+0000 7fbf7fe00640 1 -- 172.21.15.52:0/3542701192 wait complete. 2024-09-10T08:34:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.253+0000 7fbf7fe00640 1 Processor -- start 2024-09-10T08:34:03.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 -- start start 2024-09-10T08:34:03.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf8015e650 0x7fbf80145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf8015ea30 0x7fbf800cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80072f80 con 0x7fbf800ceca0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8015f930 con 0x7fbf8015e650 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.254+0000 7fbf7fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf80073260 con 0x7fbf8015ea30 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38114/0 (socket says 172.21.15.52:38114) 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1667523196 learned_addr learned my addr 172.21.15.52:0/1667523196 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf8015e650 0x7fbf80145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7f400640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf8015ea30 0x7fbf800cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf8015ea30 msgr2=0x7fbf800cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf8015ea30 0x7fbf800cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf8015e650 msgr2=0x7fbf80145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf8015e650 0x7fbf80145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1667523196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf800b53d0 con 0x7fbf800ceca0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.255+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000c430 tx=0x7fbf7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.256+0000 7fbf76a00640 1 -- 172.21.15.52:0/1667523196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf700052d0 con 0x7fbf800ceca0 2024-09-10T08:34:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.256+0000 7fbf76a00640 1 -- 172.21.15.52:0/1667523196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf70005490 con 0x7fbf800ceca0 2024-09-10T08:34:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.256+0000 7fbf76a00640 1 -- 172.21.15.52:0/1667523196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70007260 con 0x7fbf800ceca0 2024-09-10T08:34:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.256+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf800b56b0 con 0x7fbf800ceca0 2024-09-10T08:34:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.256+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf800b5f50 con 0x7fbf800ceca0 2024-09-10T08:34:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.258+0000 7fbf76a00640 1 -- 172.21.15.52:0/1667523196 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf70007400 con 0x7fbf800ceca0 2024-09-10T08:34:03.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.259+0000 7fbf76a00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 0x7fbf5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.259+0000 7fbf76a00640 1 -- 172.21.15.52:0/1667523196 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fbf7008a330 con 0x7fbf800ceca0 2024-09-10T08:34:03.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.259+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 0x7fbf5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.259+0000 7fbf8882f740 1 Processor -- start 2024-09-10T08:34:03.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 -- start start 2024-09-10T08:34:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 0x7fbf5c06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbf8015ce00 tx=0x7fbf68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cb28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ce33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edd2c00660 con 0x55edd2c989e0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55edd2ba8680 con 0x55edd2ce2ea0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.260+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55edd2bfc620 con 0x55edd2cb24f0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38126/0 (socket says 172.21.15.52:38126) 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 -- 172.21.15.52:0/1027767638 learned_addr learned my addr 172.21.15.52:0/1027767638 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cb28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf7f400640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ce33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 -- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 msgr2=0x55edd2cb28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cb28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 -- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 msgr2=0x55edd2ce33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ce33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf77e00640 1 -- 172.21.15.52:0/1027767638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd29dd7d0 con 0x55edd2c989e0 2024-09-10T08:34:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.261+0000 7fbf7f400640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ce33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbf68011aa0 tx=0x7fbf68014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ce45458714559f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf6f400640 1 -- 172.21.15.52:0/1027767638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800f040 con 0x55edd2c989e0 2024-09-10T08:34:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf6f400640 1 -- 172.21.15.52:0/1027767638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68026070 con 0x55edd2c989e0 2024-09-10T08:34:03.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf6f400640 1 -- 172.21.15.52:0/1027767638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68015dc0 con 0x55edd2c989e0 2024-09-10T08:34:03.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf8882f740 1 -- 172.21.15.52:0/1027767638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 msgr2=0x55edd2c97240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbf68011aa0 tx=0x7fbf68014000 comp rx=0 tx=0).stop 2024-09-10T08:34:03.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf8882f740 1 -- 172.21.15.52:0/1027767638 shutdown_connections 2024-09-10T08:34:03.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ce33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.262+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2c989e0 0x55edd2c97240 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1027767638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cb28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 -- 172.21.15.52:0/1027767638 >> 172.21.15.52:0/1027767638 conn(0x55edd2c99410 msgr2=0x55edd2ce1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 -- 172.21.15.52:0/1027767638 shutdown_connections 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 -- 172.21.15.52:0/1027767638 wait complete. 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 -- start start 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.263+0000 7fbf8882f740 1 Processor -- start 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2cb24f0 0x55edd2ca1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb1180 0x55edd2c9ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55edd2c97940 con 0x55edd2ce2ea0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55edd2b894c0 con 0x55edd2cb24f0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55edd2c97c20 con 0x55edd2cb1180 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.264+0000 7fbf8882f740 10 client.0 _ll_register_callbacks cb 0x55edd2bf8e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf7f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb1180 0x55edd2c9ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38132/0 (socket says 172.21.15.52:38132) 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 -- 172.21.15.52:0/3643345719 learned_addr learned my addr 172.21.15.52:0/3643345719 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2cb24f0 0x55edd2ca1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 -- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb1180 msgr2=0x55edd2c9ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb1180 0x55edd2c9ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 -- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2cb24f0 msgr2=0x55edd2ca1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2cb24f0 0x55edd2ca1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 -- 172.21.15.52:0/3643345719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd29133f0 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbf68022000 tx=0x7fbf68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1e140862f5994f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.265+0000 7fbf63e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6802f070 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf68026070 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fbf68005da0 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fbf6803a050 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 10 client.7218 fetch_fsmap learned FSMap version 67 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55edd28d30f0 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68026070 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fbf6803d020 con 0x55edd2ce2ea0 2024-09-10T08:34:03.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 10 client.7218 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 10 client.7218 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 20 client.7218 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.266+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2c9fa00 0x55edd2ca46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.267+0000 7fbf8882f740 4 client.7218 mds_command: new command op to 6676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.267+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 --> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edd2c0dd90 con 0x55edd2c9fa00 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.267+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2c9fa00 0x55edd2ca46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.268+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2c9fa00 0x55edd2ca46a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d05e3030707e12 server_cookie=274db2a21edf3471 in_seq=0 out_seq=0 2024-09-10T08:34:03.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.268+0000 7fbf63e00640 10 client.7218 ms_handle_connect on v2:172.21.15.176:6834/2093809753 2024-09-10T08:34:03.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf63e00640 1 -- 172.21.15.52:0/3643345719 <== mds.0 v2:172.21.15.176:6834/2093809753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edd2c0dd90 con 0x55edd2c9fa00 2024-09-10T08:34:03.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf63e00640 10 client.7218 handle_command_reply: tid=0 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 client.7218 shutdown 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 msgr2=0x55edd2cb0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbf68022000 tx=0x7fbf68004730 comp rx=0 tx=0).stop 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 shutdown_connections 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2c9fa00 0x55edd2ca46a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb1180 0x55edd2c9ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2ce2ea0 0x55edd2cb0c40 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3643345719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2cb24f0 0x55edd2ca1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf63e00640 0 client.7218 ms_handle_reset on v2:172.21.15.176:6834/2093809753 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 >> 172.21.15.52:0/3643345719 conn(0x55edd2c989e0 msgr2=0x55edd2c96140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 shutdown_connections 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 1 -- 172.21.15.52:0/3643345719 wait complete. 2024-09-10T08:34:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.269+0000 7fbf8882f740 20 client.7218 trim_cache size 0 max 16384 2024-09-10T08:34:03.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.284+0000 7fbf8882f740 1 Processor -- start 2024-09-10T08:34:03.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 -- start start 2024-09-10T08:34:03.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cde780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2cf3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf80200b00 con 0x55edd2cb1180 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf801ffb00 con 0x55edd2ce2ea0 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.285+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf800b7040 con 0x55edd2cb24f0 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38140/0 (socket says 172.21.15.52:38140) 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1205235357 learned_addr learned my addr 172.21.15.52:0/1205235357 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7f400640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2cf3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cde780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 msgr2=0x55edd2cde780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cde780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 msgr2=0x55edd2cf3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2cf3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 -- 172.21.15.52:0/1205235357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd2ca1aa0 con 0x55edd2cb1180 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf77e00640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cde780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.286+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbf70058620 tx=0x7fbf70014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be02d45e5f99f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf6ea00640 1 -- 172.21.15.52:0/1205235357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70056990 con 0x55edd2cb1180 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf6ea00640 1 -- 172.21.15.52:0/1205235357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7008a0b0 con 0x55edd2cb1180 2024-09-10T08:34:03.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf6ea00640 1 -- 172.21.15.52:0/1205235357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70057ae0 con 0x55edd2cb1180 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 -- 172.21.15.52:0/1205235357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 msgr2=0x55edd2cde240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbf70058620 tx=0x7fbf70014040 comp rx=0 tx=0).stop 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 -- 172.21.15.52:0/1205235357 shutdown_connections 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2cf3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2cde780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 --2- 172.21.15.52:0/1205235357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2cde240 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 -- 172.21.15.52:0/1205235357 >> 172.21.15.52:0/1205235357 conn(0x55edd2c989e0 msgr2=0x55edd2ca4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 -- 172.21.15.52:0/1205235357 shutdown_connections 2024-09-10T08:34:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.287+0000 7fbf8882f740 1 -- 172.21.15.52:0/1205235357 wait complete. 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.288+0000 7fbf8882f740 1 -- start start 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.288+0000 7fbf8882f740 1 Processor -- start 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2d5a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ca0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf800b7690 con 0x55edd2cb1180 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55edd2d642a0 con 0x55edd2ce2ea0 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55edd2d61160 con 0x55edd2cb24f0 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf8882f740 10 client.0 _ll_register_callbacks cb 0x7fbf78034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf7ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38150/0 (socket says 172.21.15.52:38150) 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.289+0000 7fbf7ea00640 1 -- 172.21.15.52:0/3727216121 learned_addr learned my addr 172.21.15.52:0/3727216121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2d5a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7f400640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ca0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 -- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 msgr2=0x55edd2d5a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2d5a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 -- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 msgr2=0x55edd2ca0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ca0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 -- 172.21.15.52:0/3727216121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd2d63dd0 con 0x55edd2cb1180 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7f400640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ca0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2d5a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf7ea00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbf70054af0 tx=0x7fbf7000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c304ee6a6570812b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf63e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70057ce0 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fbf7005db20 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf7008a0b0 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7fbf70056a50 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf8882f740 10 client.7224 fetch_fsmap learned FSMap version 67 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.290+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) -- 0x55edd2cfbe20 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf7008a0b0 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 67) ==== 3502+0+0 (secure 0 0 0) 0x7fbf700543e0 con 0x55edd2cb1180 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 10 client.7224 fetch_fsmap finished waiting for FSMap version 67 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 10 client.7224 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-10T08:34:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 20 client.7224 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2ca0e40 0x55edd2cde240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 4 client.7224 mds_command: new command op to 6676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 --> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edd2c080e0 con 0x55edd2ca0e40 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.291+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2ca0e40 0x55edd2cde240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.292+0000 7fbf77e00640 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2ca0e40 0x55edd2cde240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64354ac53cac1afa server_cookie=b5199c4874630d69 in_seq=0 out_seq=0 2024-09-10T08:34:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.292+0000 7fbf63e00640 10 client.7224 ms_handle_connect on v2:172.21.15.176:6834/2093809753 2024-09-10T08:34:03.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf63e00640 1 -- 172.21.15.52:0/3727216121 <== mds.0 v2:172.21.15.176:6834/2093809753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edd2c080e0 con 0x55edd2ca0e40 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf63e00640 10 client.7224 handle_command_reply: tid=0 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 client.7224 shutdown 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 msgr2=0x55edd2d63890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbf70054af0 tx=0x7fbf7000a000 comp rx=0 tx=0).stop 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 shutdown_connections 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:6834/2093809753,v1:172.21.15.176:6836/2093809753] conn(0x55edd2ca0e40 0x55edd2cde240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55edd2ce2ea0 0x55edd2ca0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55edd2cb24f0 0x55edd2d5a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 --2- 172.21.15.52:0/3727216121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55edd2cb1180 0x55edd2d63890 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf63e00640 0 client.7224 ms_handle_reset on v2:172.21.15.176:6834/2093809753 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 >> 172.21.15.52:0/3727216121 conn(0x55edd2c989e0 msgr2=0x55edd2d04960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 shutdown_connections 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 1 -- 172.21.15.52:0/3727216121 wait complete. 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.305+0000 7fbf8882f740 20 client.7224 trim_cache size 0 max 16384 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:34:03.307 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:34:03.308 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:34:03.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 msgr2=0x7fbf5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 0x7fbf5c06e2f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbf8015ce00 tx=0x7fbf68008040 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 msgr2=0x7fbf8015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000c430 tx=0x7fbf7000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 shutdown_connections 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf5c06be30 0x7fbf5c06e2f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf8015ea30 0x7fbf800cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf8015e650 0x7fbf80145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 --2- 172.21.15.52:0/1667523196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf800ceca0 0x7fbf8015c8c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 >> 172.21.15.52:0/1667523196 conn(0x7fbf800b40d0 msgr2=0x7fbf80161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 shutdown_connections 2024-09-10T08:34:03.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.306+0000 7fbf7fe00640 1 -- 172.21.15.52:0/1667523196 wait complete. 2024-09-10T08:34:03.322 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:34:03.322 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:03.322 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:34:03.323 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:03.323 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:34:03.323 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:03.324 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:34:03.324 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:03.337 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:34:03.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-10T08:34:03.339 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:34:03.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-10T08:34:03.339 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:34:03.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-10T08:34:03.341 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:34:03.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-10T08:34:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.545+0000 7f189d400640 1 Processor -- start 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.545+0000 7f189d400640 1 -- start start 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.546+0000 7f189d400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1898073bc0 0x7f189806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.546+0000 7f189d400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18980712a0 con 0x7f189814c480 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.546+0000 7f189d400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1898072c70 con 0x7f1898073750 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.546+0000 7f189d400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f18980732c0 con 0x7f1898073bc0 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.547+0000 7f1896800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f189814c480 0x7f1898163be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49078/0 (socket says 172.21.15.52:49078) 2024-09-10T08:34:03.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.547+0000 7f1896800640 1 -- 172.21.15.52:0/4118107066 learned_addr learned my addr 172.21.15.52:0/4118107066 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:03.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.547+0000 7f1897200640 1 --2- 172.21.15.52:0/4118107066 >> v2:172.21.15.176:3300/0 conn(0x7f1898073bc0 0x7f189806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.547+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565216867 0 0) 0x7f18980712a0 con 0x7f189814c480 2024-09-10T08:34:03.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.547+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c003520 con 0x7f189814c480 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153906620 0 0) 0x7f1898072c70 con 0x7f1898073750 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18980712a0 con 0x7f1898073750 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1897200640 1 -- 172.21.15.52:0/4118107066 >> v1:172.21.15.176:6789/0 conn(0x7f1898073750 legacy=0x7f1898164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1897200640 1 -- 172.21.15.52:0/4118107066 >> v1:172.21.15.52:6789/0 conn(0x7f189814c480 legacy=0x7f1898163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1839609526 0 0) 0x7f187c003520 con 0x7f189814c480 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.548+0000 7f1897200640 1 -- 172.21.15.52:0/4118107066 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1898072f50 con 0x7f1898073bc0 2024-09-10T08:34:03.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7fb98b000640 1 Processor -- start 2024-09-10T08:34:03.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7f1897200640 1 --2- 172.21.15.52:0/4118107066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1898073bc0 0x7f189806bc10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1890009d90 tx=0x7f189002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a12878ba4ffcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7fb98b000640 1 -- start start 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890007740 con 0x7f1898073bc0 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18900078e0 con 0x7f1898073bc0 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.549+0000 7f1895400640 1 -- 172.21.15.52:0/4118107066 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890007cb0 con 0x7f1898073bc0 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 -- 172.21.15.52:0/4118107066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1898073bc0 msgr2=0x7f189806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 --2- 172.21.15.52:0/4118107066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1898073bc0 0x7f189806bc10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1890009d90 tx=0x7f189002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 -- 172.21.15.52:0/4118107066 shutdown_connections 2024-09-10T08:34:03.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 --2- 172.21.15.52:0/4118107066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1898073bc0 0x7f189806bc10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 -- 172.21.15.52:0/4118107066 >> 172.21.15.52:0/4118107066 conn(0x7f18980ccec0 msgr2=0x7f18980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 -- 172.21.15.52:0/4118107066 shutdown_connections 2024-09-10T08:34:03.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.550+0000 7f189d400640 1 -- 172.21.15.52:0/4118107066 wait complete. 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98b000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb98415e4c0 0x7fb9840cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9840b6790 0x7fb9840d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98b000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9840cf5e0 con 0x7fb984162b70 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98b000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb9840cf8c0 con 0x7fb98415e4c0 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9840d2980 con 0x7fb9840b6790 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb989c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb98415e4c0 0x7fb9840cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb989c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb98415e4c0 0x7fb9840cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36550/0 (socket says 172.21.15.52:36550) 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb989c00640 1 -- 172.21.15.52:0/3189985250 learned_addr learned my addr 172.21.15.52:0/3189985250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.551+0000 7fb98a600640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9840b6790 0x7fb9840d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.552+0000 7fb989c00640 1 -- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9840b6790 msgr2=0x7fb9840d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.552+0000 7fb989c00640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9840b6790 0x7fb9840d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.552+0000 7fb989c00640 1 -- 172.21.15.52:0/3189985250 >> v1:172.21.15.52:6789/0 conn(0x7fb984162b70 legacy=0x7fb9840b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:03.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.552+0000 7fb989c00640 1 -- 172.21.15.52:0/3189985250 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9840d2c60 con 0x7fb98415e4c0 2024-09-10T08:34:03.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.552+0000 7f189d400640 1 Processor -- start 2024-09-10T08:34:03.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.553+0000 7fb734200640 1 Processor -- start 2024-09-10T08:34:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.553+0000 7f189d400640 1 -- start start 2024-09-10T08:34:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.553+0000 7fb734200640 1 -- start start 2024-09-10T08:34:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.553+0000 7fb989c00640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb98415e4c0 0x7fb9840cef50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb97802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32ee5a2cb138f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7fb983e00640 1 -- 172.21.15.52:0/3189985250 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978037070 con 0x7fb98415e4c0 2024-09-10T08:34:03.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7fb983e00640 1 -- 172.21.15.52:0/3189985250 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978032440 con 0x7fb98415e4c0 2024-09-10T08:34:03.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7fb983e00640 1 -- 172.21.15.52:0/3189985250 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978032810 con 0x7fb98415e4c0 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 0x7f18981491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f189814c480 0x7f18980c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18980b6350 con 0x7f1898073bc0 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1898071580 con 0x7f189814c480 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.554+0000 7f189d400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18980b64d0 con 0x7f1898073750 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1895e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 0x7f18981491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:59218/0 (socket says 172.21.15.52:59218) 2024-09-10T08:34:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 -- 172.21.15.52:0/2468179641 learned_addr learned my addr 172.21.15.52:0/2468179641 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 -- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb98415e4c0 msgr2=0x7fb9840cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb98415e4c0 0x7fb9840cef50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb97802a210 comp rx=0 tx=0).stop 2024-09-10T08:34:03.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1897200640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f189814c480 0x7f18980c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb734200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb72c0b5080 0x7fb72c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb734200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0b4020 con 0x7fb72c145ed0 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb734200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0b42c0 con 0x7fb72c073890 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb734200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c0b45a0 con 0x7fb72c0b5080 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb731800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb72c145ed0 0x7fb72c073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49096/0 (socket says 172.21.15.52:49096) 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb731800640 1 -- 172.21.15.52:0/2525226785 learned_addr learned my addr 172.21.15.52:0/2525226785 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 -- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f189814c480 msgr2=0x7f18980c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f189814c480 0x7f18980c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7f1896800640 1 -- 172.21.15.52:0/2468179641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 msgr2=0x7f18981491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 -- 172.21.15.52:0/3189985250 shutdown_connections 2024-09-10T08:34:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9840b6790 0x7fb9840d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 --2- 172.21.15.52:0/3189985250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb98415e4c0 0x7fb9840cef50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.555+0000 7fb98b000640 1 -- 172.21.15.52:0/3189985250 >> 172.21.15.52:0/3189985250 conn(0x7fb9840d1080 msgr2=0x7fb9840d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7f1896800640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 0x7f18981491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7f1896800640 1 -- 172.21.15.52:0/2468179641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1898135140 con 0x7f1898073750 2024-09-10T08:34:03.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb732200640 1 --2- 172.21.15.52:0/2525226785 >> v2:172.21.15.176:3300/0 conn(0x7fb72c0b5080 0x7fb72c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb98b000640 1 -- 172.21.15.52:0/3189985250 shutdown_connections 2024-09-10T08:34:03.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7f1895e00640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 0x7f18981491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:03.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113545560 0 0) 0x7fb72c0b4020 con 0x7fb72c145ed0 2024-09-10T08:34:03.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb714003520 con 0x7fb72c145ed0 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759161156 0 0) 0x7fb72c0b42c0 con 0x7fb72c073890 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb72c0b4020 con 0x7fb72c073890 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb732200640 1 -- 172.21.15.52:0/2525226785 >> v1:172.21.15.176:6789/0 conn(0x7fb72c073890 legacy=0x7fb72c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb732200640 1 -- 172.21.15.52:0/2525226785 >> v1:172.21.15.52:6789/0 conn(0x7fb72c145ed0 legacy=0x7fb72c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb732200640 1 -- 172.21.15.52:0/2525226785 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0b4880 con 0x7fb72c0b5080 2024-09-10T08:34:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7fb98b000640 1 -- 172.21.15.52:0/3189985250 wait complete. 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7f1896800640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f188800c3e0 tx=0x7f1888001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.556+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888017070 con 0x7f1898073750 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.557+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888005d00 con 0x7f1898073750 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.557+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1898135420 con 0x7f1898073750 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.557+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888007310 con 0x7f1898073750 2024-09-10T08:34:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.557+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18981359e0 con 0x7f1898073750 2024-09-10T08:34:03.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb732200640 1 --2- 172.21.15.52:0/2525226785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c0b5080 0x7fb72c0b5f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb724009d90 tx=0x7fb72402a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e837385661ce4cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1898163be0 con 0x7f1898073750 2024-09-10T08:34:03.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb98b000640 1 Processor -- start 2024-09-10T08:34:03.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724037070 con 0x7fb72c0b5080 2024-09-10T08:34:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb98b000640 1 -- start start 2024-09-10T08:34:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb724007740 con 0x7fb72c0b5080 2024-09-10T08:34:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.558+0000 7fb72be00640 1 -- 172.21.15.52:0/2525226785 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724007b10 con 0x7fb72c0b5080 2024-09-10T08:34:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fca5e600640 1 Processor -- start 2024-09-10T08:34:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 -- 172.21.15.52:0/2525226785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c0b5080 msgr2=0x7fb72c0b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 --2- 172.21.15.52:0/2525226785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c0b5080 0x7fb72c0b5f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb724009d90 tx=0x7fb72402a780 comp rx=0 tx=0).stop 2024-09-10T08:34:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fca5e600640 1 -- start start 2024-09-10T08:34:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 -- 172.21.15.52:0/2525226785 shutdown_connections 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 --2- 172.21.15.52:0/2525226785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c0b5080 0x7fb72c0b5f90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 -- 172.21.15.52:0/2525226785 >> 172.21.15.52:0/2525226785 conn(0x7fb72c0ccec0 msgr2=0x7fb72c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 -- 172.21.15.52:0/2525226785 shutdown_connections 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.559+0000 7fb734200640 1 -- 172.21.15.52:0/2525226785 wait complete. 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98415e4c0 0x7fb9840cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb984162b70 0x7fb9840ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb98415e8a0 con 0x7fb98415e4c0 2024-09-10T08:34:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9840cfba0 con 0x7fb9840b6790 2024-09-10T08:34:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f188801a070 con 0x7f1898073750 2024-09-10T08:34:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98b000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb98415ea20 con 0x7fb984162b70 2024-09-10T08:34:03.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb989c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb989c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:36580/0 (socket says 172.21.15.52:36580) 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb989c00640 1 -- 172.21.15.52:0/2769338622 learned_addr learned my addr 172.21.15.52:0/2769338622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb98a600640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb984162b70 0x7fb9840ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.560+0000 7fb989200640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98415e4c0 0x7fb9840cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca5e600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 0x7fca580d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca5e600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca580d3990 con 0x7fca580b6710 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 -- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb984162b70 msgr2=0x7fb9840ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb984162b70 0x7fb9840ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 -- 172.21.15.52:0/2769338622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98415e4c0 msgr2=0x7fb9840cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98415e4c0 0x7fb9840cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 -- 172.21.15.52:0/2769338622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb984160a60 con 0x7fb9840b6790 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca5e600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca580d3c70 con 0x7fca5815e440 2024-09-10T08:34:03.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca5e600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca580d3f50 con 0x7fca580cf450 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca57e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca580b6710 0x7fca580b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49106/0 (socket says 172.21.15.52:49106) 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca57e00640 1 -- 172.21.15.52:0/2310001067 learned_addr learned my addr 172.21.15.52:0/2310001067 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fca5dc00640 1 --2- 172.21.15.52:0/2310001067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 0x7fca580d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7fb989c00640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb9780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7f188ea00640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 0x7f187806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.561+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f188808a280 con 0x7f1898073750 2024-09-10T08:34:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978041020 con 0x7fb9840b6790 2024-09-10T08:34:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb734200640 1 Processor -- start 2024-09-10T08:34:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fca57400640 1 -- 172.21.15.52:0/2310001067 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010569079 0 0) 0x7fca580d3990 con 0x7fca580b6710 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fca57400640 1 -- 172.21.15.52:0/2310001067 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca40003520 con 0x7fca580b6710 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fca5dc00640 1 -- 172.21.15.52:0/2310001067 >> v1:172.21.15.176:6789/0 conn(0x7fca5815e440 legacy=0x7fca580b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fca5dc00640 1 -- 172.21.15.52:0/2310001067 >> v1:172.21.15.52:6789/0 conn(0x7fca580b6710 legacy=0x7fca580b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fca5dc00640 1 -- 172.21.15.52:0/2310001067 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca580d4230 con 0x7fca580cf450 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb734200640 1 -- start start 2024-09-10T08:34:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7f1895e00640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 0x7f187806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb978030640 con 0x7fb9840b6790 2024-09-10T08:34:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978037040 con 0x7fb9840b6790 2024-09-10T08:34:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb984160d40 con 0x7fb9840b6790 2024-09-10T08:34:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.562+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb984161300 con 0x7fb9840b6790 2024-09-10T08:34:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7f1895e00640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 0x7f187806e340 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1884007fd0 tx=0x7f1884009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb72c0b5080 0x7fb72c140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c145ed0 0x7fb72c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c146430 con 0x7fb72c073890 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1462b0 con 0x7fb72c145ed0 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb734200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c15cdc0 con 0x7fb72c0b5080 2024-09-10T08:34:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fca5dc00640 1 --2- 172.21.15.52:0/2310001067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 0x7fca580d3240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca50009dc0 tx=0x7fca5002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4b1608e5fd5300 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb731800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38176/0 (socket says 172.21.15.52:38176) 2024-09-10T08:34:03.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 -- 172.21.15.52:0/3189790806 learned_addr learned my addr 172.21.15.52:0/3189790806 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb732200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c145ed0 0x7fb72c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.563+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9840cef50 con 0x7fb9840b6790 2024-09-10T08:34:03.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb730e00640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb72c0b5080 0x7fb72c140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 -- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb72c0b5080 msgr2=0x7fb72c140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb72c0b5080 0x7fb72c140f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 -- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c145ed0 msgr2=0x7fb72c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c145ed0 0x7fb72c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 -- 172.21.15.52:0/3189790806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c13d0d0 con 0x7fb72c073890 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb731800640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c3f0 tx=0x7fb72000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.564+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb978044020 con 0x7fb9840b6790 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.565+0000 7fb981600640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 0x7fb96406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.565+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fb9780ab4b0 con 0x7fb9840b6790 2024-09-10T08:34:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.565+0000 7fca57400640 1 -- 172.21.15.52:0/2310001067 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50007740 con 0x7fca580cf450 2024-09-10T08:34:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca57400640 1 -- 172.21.15.52:0/2310001067 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500078e0 con 0x7fca580cf450 2024-09-10T08:34:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca57400640 1 -- 172.21.15.52:0/2310001067 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50007c90 con 0x7fca580cf450 2024-09-10T08:34:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720017070 con 0x7fb72c073890 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720005ce0 con 0x7fb72c073890 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720007310 con 0x7fb72c073890 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c1419d0 con 0x7fb72c073890 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18880585c0 con 0x7f1898073750 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb989200640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 0x7fb96406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c141f90 con 0x7fb72c073890 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca5e600640 1 -- 172.21.15.52:0/2310001067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 msgr2=0x7fca580d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca5e600640 1 --2- 172.21.15.52:0/2310001067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 0x7fca580d3240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca50009dc0 tx=0x7fca5002a760 comp rx=0 tx=0).stop 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca5e600640 1 -- 172.21.15.52:0/2310001067 shutdown_connections 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca5e600640 1 --2- 172.21.15.52:0/2310001067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca580cf450 0x7fca580d3240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.566+0000 7fca5e600640 1 -- 172.21.15.52:0/2310001067 >> 172.21.15.52:0/2310001067 conn(0x7fca58067f80 msgr2=0x7fca580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.567+0000 7fca5e600640 1 -- 172.21.15.52:0/2310001067 shutdown_connections 2024-09-10T08:34:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.567+0000 7fb989200640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 0x7fb96406e340 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb9840cd1e0 tx=0x7fb970009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.567+0000 7fca5e600640 1 -- 172.21.15.52:0/2310001067 wait complete. 2024-09-10T08:34:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.568+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0b5880 con 0x7fb72c073890 2024-09-10T08:34:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.569+0000 7fca5e600640 1 Processor -- start 2024-09-10T08:34:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.569+0000 7fca5e600640 1 -- start start 2024-09-10T08:34:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.569+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb72001a070 con 0x7fb72c073890 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca580b6710 0x7fca581e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca5815e440 0x7fca58155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca580b76c0 con 0x7fca580cf450 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca580b7540 con 0x7fca580b6710 2024-09-10T08:34:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb97804b030 con 0x7fb9840b6790 2024-09-10T08:34:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca5e600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca580b8270 con 0x7fca5815e440 2024-09-10T08:34:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca57e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38180/0 (socket says 172.21.15.52:38180) 2024-09-10T08:34:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.570+0000 7fca57e00640 1 -- 172.21.15.52:0/407478574 learned_addr learned my addr 172.21.15.52:0/407478574 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca5d200640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca580b6710 0x7fca581e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca5dc00640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca5815e440 0x7fca58155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fb729600640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 0x7fb70c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fb72008a150 con 0x7fb72c073890 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 -- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca5815e440 msgr2=0x7fca58155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca5815e440 0x7fca58155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 -- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca580b6710 msgr2=0x7fca581e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:03.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca580b6710 0x7fca581e9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:03.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 -- 172.21.15.52:0/407478574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca581e3cf0 con 0x7fca580cf450 2024-09-10T08:34:03.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fb730e00640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 0x7fb70c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.571+0000 7fca57e00640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c530 tx=0x7fca4400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.572+0000 7fb730e00640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 0x7fb70c06e370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb718007fd0 tx=0x7fb718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44017070 con 0x7fca580cf450 2024-09-10T08:34:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44005ce0 con 0x7fca580cf450 2024-09-10T08:34:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5815a8d0 con 0x7fca580cf450 2024-09-10T08:34:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb720058520 con 0x7fb72c073890 2024-09-10T08:34:03.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca58156b00 con 0x7fca580cf450 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.576+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44007290 con 0x7fca580cf450 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.577+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca580d3240 con 0x7fca580cf450 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.579+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca4401a070 con 0x7fca580cf450 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.580+0000 7fca54c00640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 0x7fca3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.580+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fca4408a1f0 con 0x7fca580cf450 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.580+0000 7fca5d200640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 0x7fca3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.581+0000 7fca5d200640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 0x7fca3806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca580cec60 tx=0x7fca4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.585+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca440584b0 con 0x7fca580cf450 2024-09-10T08:34:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.836+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fb72c0b39f0 con 0x7fb72c073890 2024-09-10T08:34:03.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.842+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fca580ba330 con 0x7fca580cf450 2024-09-10T08:34:03.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.972+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f18980ccca0 con 0x7f1898073750 2024-09-10T08:34:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:03.975+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fb9840b8e10 con 0x7fb9840b6790 2024-09-10T08:34:04.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.808+0000 7fb729600640 1 -- 172.21.15.52:0/3189790806 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6152 v68) ==== 95+0+0 (secure 0 0 0) 0x7fb72005c820 con 0x7fb72c073890 2024-09-10T08:34:04.809 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6152 2024-09-10T08:34:04.811 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:34:04.811+0000 7f82a7400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:34:04.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 msgr2=0x7fb70c06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 0x7fb70c06e370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb718007fd0 tx=0x7fb718009040 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 msgr2=0x7fb72c13cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c3f0 tx=0x7fb72000c8b0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 shutdown_connections 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.811+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb70c06beb0 0x7fb70c06e370 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb72c145ed0 0x7fb72c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb72c0b5080 0x7fb72c140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 --2- 172.21.15.52:0/3189790806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c073890 0x7fb72c13cb90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 >> 172.21.15.52:0/3189790806 conn(0x7fb72c0ccec0 msgr2=0x7fb72c144d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 shutdown_connections 2024-09-10T08:34:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.812+0000 7fb734200640 1 -- 172.21.15.52:0/3189790806 wait complete. 2024-09-10T08:34:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.813+0000 7fca54c00640 1 -- 172.21.15.52:0/407478574 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6676 v69) ==== 95+0+0 (secure 0 0 0) 0x7fca4405c7b0 con 0x7fca580cf450 2024-09-10T08:34:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6676 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.816+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 msgr2=0x7fca3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.816+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 0x7fca3806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca580cec60 tx=0x7fca4c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.816+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 msgr2=0x7fca580caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.816+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c530 tx=0x7fca4400c9f0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 shutdown_connections 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca3806be30 0x7fca3806e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca5815e440 0x7fca58155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca580cf450 0x7fca580caa30 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 --2- 172.21.15.52:0/407478574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca580b6710 0x7fca581e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 >> 172.21.15.52:0/407478574 conn(0x7fca58067f80 msgr2=0x7fca580b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 shutdown_connections 2024-09-10T08:34:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.817+0000 7fca5e600640 1 -- 172.21.15.52:0/407478574 wait complete. 2024-09-10T08:34:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.823+0000 7f188ea00640 1 -- 172.21.15.52:0/2468179641 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6149 v70) ==== 95+0+0 (secure 0 0 0) 0x7f188805c8c0 con 0x7f1898073750 2024-09-10T08:34:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6149 2024-09-10T08:34:04.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 msgr2=0x7f187806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 0x7f187806e340 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1884007fd0 tx=0x7f1884009040 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 msgr2=0x7f18981eedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f188800c3e0 tx=0x7f1888001e70 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 shutdown_connections 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f187806be80 0x7f187806e340 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f189814c480 0x7f18980c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1898073bc0 0x7f18981491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 --2- 172.21.15.52:0/2468179641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1898073750 0x7f18981eedc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 >> 172.21.15.52:0/2468179641 conn(0x7f18980ccec0 msgr2=0x7f189806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 shutdown_connections 2024-09-10T08:34:04.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:04.829+0000 7f189d400640 1 -- 172.21.15.52:0/2468179641 wait complete. 2024-09-10T08:34:04.838 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:34:04.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:34:04.842 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:34:04.843 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:04.845 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:34:04.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:34:04.850 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:34:04.850 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:04.851 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:34:04.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:34:04.855 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:34:04.855 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:04.974 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:34:04.983 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:34:04.986 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:34:05.807 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:34:05.807+0000 7f82a7400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:34:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.812+0000 7fb981600640 1 -- 172.21.15.52:0/2769338622 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6155 v71) ==== 95+0+0 (secure 0 0 0) 0x7fb9780797f0 con 0x7fb9840b6790 2024-09-10T08:34:05.813 INFO:teuthology.orchestra.run.smithi052.stderr:failed mds gid 6155 2024-09-10T08:34:05.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 msgr2=0x7fb96406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 0x7fb96406e340 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb9840cd1e0 tx=0x7fb970009060 comp rx=0 tx=0).stop 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 msgr2=0x7fb98415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb978009870 tx=0x7fb9780046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 shutdown_connections 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb96406be80 0x7fb96406e340 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb984162b70 0x7fb9840ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:05.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98415e4c0 0x7fb9840cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.815+0000 7fb98b000640 1 --2- 172.21.15.52:0/2769338622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9840b6790 0x7fb98415da00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.816+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 >> 172.21.15.52:0/2769338622 conn(0x7fb9840d1080 msgr2=0x7fb9840d4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.816+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 shutdown_connections 2024-09-10T08:34:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:05.816+0000 7fb98b000640 1 -- 172.21.15.52:0/2769338622 wait complete. 2024-09-10T08:34:05.840 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:34:05.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:34:05.844 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:34:05.845 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:05.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:05.979 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:34:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.006+0000 7f376cc00640 1 Processor -- start 2024-09-10T08:34:06.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.006+0000 7f376cc00640 1 -- start start 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.007+0000 7f376cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376815ed20 0x7f37680b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f376cc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37680d23b0 0x7f37680b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f376cc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37680d0e70 con 0x7f37680cf2d0 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f376cc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37680d41c0 con 0x7f37680d23b0 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f376cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37680d35b0 con 0x7f376815ed20 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3766800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f37680cf2d0 0x7f37680cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39596/0 (socket says 172.21.15.52:39596) 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3766800640 1 -- 172.21.15.52:0/3327164609 learned_addr learned my addr 172.21.15.52:0/3327164609 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765400640 1 --2- 172.21.15.52:0/3327164609 >> v2:172.21.15.176:3300/0 conn(0x7f37680d23b0 0x7f37680b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765e00640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376815ed20 0x7f37680b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3764a00640 1 -- 172.21.15.52:0/3327164609 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2663090571 0 0) 0x7f3760001490 con 0x7f37680cf2d0 2024-09-10T08:34:06.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3764a00640 1 -- 172.21.15.52:0/3327164609 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f374c003520 con 0x7f37680cf2d0 2024-09-10T08:34:06.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765400640 1 -- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376815ed20 msgr2=0x7f37680b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:06.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765400640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376815ed20 0x7f37680b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765400640 1 -- 172.21.15.52:0/3327164609 >> v1:172.21.15.52:6789/0 conn(0x7f37680cf2d0 legacy=0x7f37680cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.008+0000 7f3765400640 1 -- 172.21.15.52:0/3327164609 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37680d3890 con 0x7f37680d23b0 2024-09-10T08:34:06.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f3765400640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680d23b0 0x7f37680b67a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=256d5bde479fd1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:06.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f3764a00640 1 -- 172.21.15.52:0/3327164609 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754037070 con 0x7f37680d23b0 2024-09-10T08:34:06.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f3764a00640 1 -- 172.21.15.52:0/3327164609 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3754032440 con 0x7f37680d23b0 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f3764a00640 1 -- 172.21.15.52:0/3327164609 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754032810 con 0x7f37680d23b0 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 -- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680d23b0 msgr2=0x7f37680b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680d23b0 0x7f37680b67a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37540097a0 tx=0x7f375402a180 comp rx=0 tx=0).stop 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 -- 172.21.15.52:0/3327164609 shutdown_connections 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680d23b0 0x7f37680b67a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 --2- 172.21.15.52:0/3327164609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f376815ed20 0x7f37680b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.010+0000 7f376cc00640 1 -- 172.21.15.52:0/3327164609 >> 172.21.15.52:0/3327164609 conn(0x7f37680d1260 msgr2=0x7f37680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:06.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.011+0000 7f376cc00640 1 -- 172.21.15.52:0/3327164609 shutdown_connections 2024-09-10T08:34:06.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.011+0000 7f376cc00640 1 -- 172.21.15.52:0/3327164609 wait complete. 2024-09-10T08:34:06.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.012+0000 7f376cc00640 1 Processor -- start 2024-09-10T08:34:06.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.013+0000 7f376cc00640 1 -- start start 2024-09-10T08:34:06.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 0x7f3768154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 0x7f3768155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37680d32a0 con 0x7f376815ed20 2024-09-10T08:34:06.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37680d3e50 con 0x7f37680cf2d0 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f376cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f376815f100 con 0x7f37680d23b0 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f3766800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f3766800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39922/0 (socket says 172.21.15.52:39922) 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f3766800640 1 -- 172.21.15.52:0/2244715087 learned_addr learned my addr 172.21.15.52:0/2244715087 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f3765400640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 0x7f3768155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.014+0000 7f3765e00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 0x7f3768154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 -- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 msgr2=0x7f3768155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 0x7f3768155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 -- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 msgr2=0x7f3768154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 0x7f3768154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 -- 172.21.15.52:0/2244715087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3768154d70 con 0x7f376815ed20 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3765400640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 0x7f3768155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3765e00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 0x7f3768154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f3766800640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f376000cb50 tx=0x7f376000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760017070 con 0x7f376815ed20 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376000ad40 con 0x7f376815ed20 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37681e74b0 con 0x7f376815ed20 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.015+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760012620 con 0x7f376815ed20 2024-09-10T08:34:06.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.016+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37681e7a70 con 0x7f376815ed20 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.017+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37680b7010 con 0x7f376815ed20 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.018+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f376001a070 con 0x7f376815ed20 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.019+0000 7f375e000640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 0x7f374806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.019+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f376008ad30 con 0x7f376815ed20 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.019+0000 7f3765e00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 0x7f374806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.020+0000 7f3765e00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 0x7f374806e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3758007d90 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.024+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37680d0e70 con 0x7f376815ed20 2024-09-10T08:34:06.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.247+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37680b46e0 con 0x7f376815ed20 2024-09-10T08:34:06.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.247+0000 7f375e000640 1 -- 172.21.15.52:0/2244715087 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+4397 (secure 0 0 0) 0x7f3760058f40 con 0x7f376815ed20 2024-09-10T08:34:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":72,"btime":"2024-09-10T08:34:05:812946+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:05.812925+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:replay","state_seq":1,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-10T08:34:06.248 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 72 2024-09-10T08:34:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 msgr2=0x7f374806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 0x7f374806e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3758007d90 tx=0x7f3758008040 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 msgr2=0x7f37681582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f376000cb50 tx=0x7f376000a430 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 shutdown_connections 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f374806be60 0x7f374806e320 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f376815ed20 0x7f37681582f0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37680d23b0 0x7f3768155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 --2- 172.21.15.52:0/2244715087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37680cf2d0 0x7f3768154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 >> 172.21.15.52:0/2244715087 conn(0x7f37680d1260 msgr2=0x7f37680d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 shutdown_connections 2024-09-10T08:34:06.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:06.250+0000 7f376cc00640 1 -- 172.21.15.52:0/2244715087 wait complete. 2024-09-10T08:34:06.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:06.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:06.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:53.097952+0000', 'modified': '2024-09-10T08:34:05.812925+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7251': {'gid': 7251, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/3825724165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 3825724165}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 3825724165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:34:06.668 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7251:up:replay 2024-09-10T08:34:07.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.837+0000 7f647b200640 1 Processor -- start 2024-09-10T08:34:07.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.837+0000 7f647b200640 1 -- start start 2024-09-10T08:34:07.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f647b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f647c15e440 0x7f647c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f647b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0d3990 con 0x7f647c0b6710 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f647b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c0d3c70 con 0x7f647c0cf450 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f647b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0d3f50 con 0x7f647c15e440 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f6479e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f647c15e440 0x7f647c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.838+0000 7f647a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f647c0b6710 0x7f647c0b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39612/0 (socket says 172.21.15.52:39612) 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.839+0000 7f6479e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f647c15e440 0x7f647c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39932/0 (socket says 172.21.15.52:39932) 2024-09-10T08:34:07.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.839+0000 7f647a800640 1 -- 172.21.15.52:0/2732711148 learned_addr learned my addr 172.21.15.52:0/2732711148 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:07.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.839+0000 7f6479e00640 1 -- 172.21.15.52:0/2732711148 >> v1:172.21.15.176:6789/0 conn(0x7f647c0cf450 legacy=0x7f647c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:07.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.839+0000 7f6479e00640 1 -- 172.21.15.52:0/2732711148 >> v1:172.21.15.52:6789/0 conn(0x7f647c0b6710 legacy=0x7f647c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:07.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.839+0000 7f6479e00640 1 -- 172.21.15.52:0/2732711148 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0d4230 con 0x7f647c15e440 2024-09-10T08:34:07.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.840+0000 7f6479e00640 1 --2- 172.21.15.52:0/2732711148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c15e440 0x7f647c0d3240 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097a0 tx=0x7f646c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556c043ff76758b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:07.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.840+0000 7f6478a00640 1 -- 172.21.15.52:0/2732711148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c037070 con 0x7f647c15e440 2024-09-10T08:34:07.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.840+0000 7f6478a00640 1 -- 172.21.15.52:0/2732711148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c032640 con 0x7f647c15e440 2024-09-10T08:34:07.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.840+0000 7f6478a00640 1 -- 172.21.15.52:0/2732711148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c032a10 con 0x7f647c15e440 2024-09-10T08:34:07.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 -- 172.21.15.52:0/2732711148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c15e440 msgr2=0x7f647c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:07.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 --2- 172.21.15.52:0/2732711148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c15e440 0x7f647c0d3240 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097a0 tx=0x7f646c02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 -- 172.21.15.52:0/2732711148 shutdown_connections 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 --2- 172.21.15.52:0/2732711148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c15e440 0x7f647c0d3240 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 -- 172.21.15.52:0/2732711148 >> 172.21.15.52:0/2732711148 conn(0x7f647c067f80 msgr2=0x7f647c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 -- 172.21.15.52:0/2732711148 shutdown_connections 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.841+0000 7f647b200640 1 -- 172.21.15.52:0/2732711148 wait complete. 2024-09-10T08:34:07.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.842+0000 7f647b200640 1 Processor -- start 2024-09-10T08:34:07.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.843+0000 7f647b200640 1 -- start start 2024-09-10T08:34:07.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.843+0000 7f647b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:07.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.843+0000 7f647b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 0x7f647c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:07.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f647b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c15e440 0x7f647c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:07.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f647b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b76c0 con 0x7f647c0b6710 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f647b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0b7540 con 0x7f647c0cf450 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f647b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0b8270 con 0x7f647c15e440 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39940/0 (socket says 172.21.15.52:39940) 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 -- 172.21.15.52:0/919290174 learned_addr learned my addr 172.21.15.52:0/919290174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479400640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 0x7f647c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 -- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c15e440 msgr2=0x7f647c0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c15e440 0x7f647c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 -- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 msgr2=0x7f647c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 0x7f647c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 -- 172.21.15.52:0/919290174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c160840 con 0x7f647c0b6710 2024-09-10T08:34:07.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479400640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 0x7f647c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:07.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.844+0000 7f6479e00640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f646c035040 tx=0x7f646c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:07.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.845+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c041030 con 0x7f647c0b6710 2024-09-10T08:34:07.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.845+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f646c030750 con 0x7f647c0b6710 2024-09-10T08:34:07.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.845+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c037040 con 0x7f647c0b6710 2024-09-10T08:34:07.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.845+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c160af0 con 0x7f647c0b6710 2024-09-10T08:34:07.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.845+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1610b0 con 0x7f647c0b6710 2024-09-10T08:34:07.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.846+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c0b5700 con 0x7f647c0b6710 2024-09-10T08:34:07.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.847+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f646c044070 con 0x7f647c0b6710 2024-09-10T08:34:07.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.848+0000 7f6472000640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:07.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.848+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f646c0ab7f0 con 0x7f647c0b6710 2024-09-10T08:34:07.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.848+0000 7f6479400640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:07.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.849+0000 7f6479400640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 0x7f645c06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f647c161d10 tx=0x7f6468009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:07.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:07.852+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f647c0b5700 con 0x7f647c0b6710 2024-09-10T08:34:08.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.072+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f647c0d3020 con 0x7f647c0b6710 2024-09-10T08:34:08.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.072+0000 7f6472000640 1 -- 172.21.15.52:0/919290174 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5222 (secure 0 0 0) 0x7f647c0d3020 con 0x7f647c0b6710 2024-09-10T08:34:08.073 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:08.073 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":74,"btime":"2024-09-10T08:34:07:824089+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:06.825580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-10T08:34:08.073 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 74 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.074+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 msgr2=0x7f645c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.074+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 0x7f645c06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f647c161d10 tx=0x7f6468009040 comp rx=0 tx=0).stop 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.074+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 msgr2=0x7f647c160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.074+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f646c035040 tx=0x7f646c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 shutdown_connections 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f645c06be30 0x7f645c06e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f647c15e440 0x7f647c0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f647c0cf450 0x7f647c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 --2- 172.21.15.52:0/919290174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f647c0b6710 0x7f647c160300 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:08.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 >> 172.21.15.52:0/919290174 conn(0x7f647c067f80 msgr2=0x7f647c0b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:08.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 shutdown_connections 2024-09-10T08:34:08.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:08.075+0000 7f647b200640 1 -- 172.21.15.52:0/919290174 wait complete. 2024-09-10T08:34:08.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:53.097952+0000', 'modified': '2024-09-10T08:34:06.825580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7251': {'gid': 7251, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.52:6833/3825724165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 3825724165}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 3825724165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T08:34:08.493 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7251:up:rejoin 2024-09-10T08:34:09.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:09.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.662+0000 7fce86a00640 1 Processor -- start 2024-09-10T08:34:09.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.662+0000 7fce86a00640 1 -- start start 2024-09-10T08:34:09.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce8015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce800cfb40 con 0x7fce800b7a30 2024-09-10T08:34:09.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce800cfe20 con 0x7fce800b63f0 2024-09-10T08:34:09.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce800d27f0 con 0x7fce800cf670 2024-09-10T08:34:09.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fce800b7a30 0x7fce8015e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39628/0 (socket says 172.21.15.52:39628) 2024-09-10T08:34:09.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.663+0000 7fce86000640 1 -- 172.21.15.52:0/3952800868 learned_addr learned my addr 172.21.15.52:0/3952800868 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:09.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce84c00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce8015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097954396 0 0) 0x7fce800cfb40 con 0x7fce800b7a30 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce68003520 con 0x7fce800b7a30 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728147376 0 0) 0x7fce68003520 con 0x7fce800b7a30 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 msgr2=0x7fce8015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce8015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 >> v1:172.21.15.176:6789/0 conn(0x7fce800b63f0 legacy=0x7fce800cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce800d2e00 con 0x7fce800b7a30 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fce780019f0 con 0x7fce800b7a30 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 >> v1:172.21.15.52:6789/0 conn(0x7fce800b7a30 legacy=0x7fce8015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce680039e0 0x7fce68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce6800baf0 con 0x7fce68004800 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce6800bca0 con 0x7fce680039e0 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.664+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce6800bea0 con 0x7fce800cf670 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce85600640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce680039e0 0x7fce68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce86000640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 -- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 msgr2=0x7fce680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce800cf670 0x7fce680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 -- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce680039e0 msgr2=0x7fce68003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce680039e0 0x7fce68003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.665+0000 7fce84c00640 1 -- 172.21.15.52:0/3952800868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce68003520 con 0x7fce68004800 2024-09-10T08:34:09.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.666+0000 7fce84c00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce68004c80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009a90 tx=0x7fce68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cde8289f5532a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:09.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.666+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c036070 con 0x7fce68004800 2024-09-10T08:34:09.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.666+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c031400 con 0x7fce68004800 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.666+0000 7fce7fe00640 1 -- 172.21.15.52:0/3952800868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c009690 con 0x7fce68004800 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 -- 172.21.15.52:0/3952800868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 msgr2=0x7fce68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 --2- 172.21.15.52:0/3952800868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce68004c80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009a90 tx=0x7fce68005830 comp rx=0 tx=0).stop 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86000640 1 -- 172.21.15.52:0/3952800868 reap_dead start 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 -- 172.21.15.52:0/3952800868 shutdown_connections 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 -- 172.21.15.52:0/3952800868 >> 172.21.15.52:0/3952800868 conn(0x7fce800d1360 msgr2=0x7fce800d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 -- 172.21.15.52:0/3952800868 shutdown_connections 2024-09-10T08:34:09.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.667+0000 7fce86a00640 1 -- 172.21.15.52:0/3952800868 wait complete. 2024-09-10T08:34:09.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.669+0000 7fce86a00640 1 Processor -- start 2024-09-10T08:34:09.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.669+0000 7fce86a00640 1 -- start start 2024-09-10T08:34:09.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce801f7280 0x7fce801589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce801f4430 0x7fce800ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce800b6950 con 0x7fce68004800 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce800b67d0 con 0x7fce801f7280 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fce800b6ad0 con 0x7fce801f4430 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce85600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce85600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39954/0 (socket says 172.21.15.52:39954) 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce85600640 1 -- 172.21.15.52:0/2418686067 learned_addr learned my addr 172.21.15.52:0/2418686067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce84c00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce801f7280 0x7fce801589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.670+0000 7fce86000640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce801f4430 0x7fce800ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 -- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce801f4430 msgr2=0x7fce800ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce801f4430 0x7fce800ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 -- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce801f7280 msgr2=0x7fce801589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce801f7280 0x7fce801589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 -- 172.21.15.52:0/2418686067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce801f7700 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce85600640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fce7400f820 tx=0x7fce7400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce740052e0 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce74018070 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7400d970 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801f3c40 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.671+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801f7c90 con 0x7fce68004800 2024-09-10T08:34:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.672+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce800cef60 con 0x7fce68004800 2024-09-10T08:34:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.673+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce7400db10 con 0x7fce68004800 2024-09-10T08:34:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.674+0000 7fce7d600640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.674+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fce7408ad40 con 0x7fce68004800 2024-09-10T08:34:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.675+0000 7fce84c00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.675+0000 7fce84c00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fce6c033000 tx=0x7fce6c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:09.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.679+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce74058fe0 con 0x7fce68004800 2024-09-10T08:34:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.905+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce80161bd0 con 0x7fce68004800 2024-09-10T08:34:09.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.906+0000 7fce7d600640 1 -- 172.21.15.52:0/2418686067 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7fce7405d2e0 con 0x7fce68004800 2024-09-10T08:34:09.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:09.906 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:09.907 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 msgr2=0x7fce6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fce6c033000 tx=0x7fce6c008030 comp rx=0 tx=0).stop 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 msgr2=0x7fce800b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fce7400f820 tx=0x7fce7400fce0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 shutdown_connections 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce801f4430 0x7fce800ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce801f7280 0x7fce801589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 --2- 172.21.15.52:0/2418686067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce68004800 0x7fce800b5b00 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 >> 172.21.15.52:0/2418686067 conn(0x7fce800d1360 msgr2=0x7fce800b9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 shutdown_connections 2024-09-10T08:34:09.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:09.908+0000 7fce86a00640 1 -- 172.21.15.52:0/2418686067 wait complete. 2024-09-10T08:34:10.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:33:53.097952+0000', 'modified': '2024-09-10T08:34:08.832399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7251': {'gid': 7251, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6833/3825724165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 3825724165}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 3825724165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7251, 'qdb_cluster': [7251]} 2024-09-10T08:34:10.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:34:10.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-10T08:34:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.486+0000 7f2258e00640 1 Processor -- start 2024-09-10T08:34:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.487+0000 7f2258e00640 1 -- start start 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2258e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2254145ed0 0x7f22540b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2258e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22540b4020 con 0x7f22540b5f90 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2258e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22540b42c0 con 0x7f2254073180 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2258e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f22540b63d0 con 0x7f2254145ed0 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2251e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2254145ed0 0x7f22540b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2251e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2254145ed0 0x7f22540b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39968/0 (socket says 172.21.15.52:39968) 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2251e00640 1 -- 172.21.15.52:0/4096695903 learned_addr learned my addr 172.21.15.52:0/4096695903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.488+0000 7f2252800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f22540b5f90 0x7f225415cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39642/0 (socket says 172.21.15.52:39642) 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.489+0000 7f2251e00640 1 -- 172.21.15.52:0/4096695903 >> v1:172.21.15.176:6789/0 conn(0x7f2254073180 legacy=0x7f22540b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.489+0000 7f2251e00640 1 -- 172.21.15.52:0/4096695903 >> v1:172.21.15.52:6789/0 conn(0x7f22540b5f90 legacy=0x7f225415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.489+0000 7f2251e00640 1 -- 172.21.15.52:0/4096695903 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22540b45a0 con 0x7f2254145ed0 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2251e00640 1 --2- 172.21.15.52:0/4096695903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2254145ed0 0x7f22540b5080 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2244009870 tx=0x7f224402a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c73dfb424f876ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2251400640 1 -- 172.21.15.52:0/4096695903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244037070 con 0x7f2254145ed0 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2251400640 1 -- 172.21.15.52:0/4096695903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2244032640 con 0x7f2254145ed0 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2251400640 1 -- 172.21.15.52:0/4096695903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244032a10 con 0x7f2254145ed0 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2258e00640 1 -- 172.21.15.52:0/4096695903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2254145ed0 msgr2=0x7f22540b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2258e00640 1 --2- 172.21.15.52:0/4096695903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2254145ed0 0x7f22540b5080 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2244009870 tx=0x7f224402a2f0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2258e00640 1 -- 172.21.15.52:0/4096695903 shutdown_connections 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2258e00640 1 --2- 172.21.15.52:0/4096695903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2254145ed0 0x7f22540b5080 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.490+0000 7f2258e00640 1 -- 172.21.15.52:0/4096695903 >> 172.21.15.52:0/4096695903 conn(0x7f22540ccec0 msgr2=0x7f22540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.491+0000 7f2258e00640 1 -- 172.21.15.52:0/4096695903 shutdown_connections 2024-09-10T08:34:10.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.491+0000 7f2258e00640 1 -- 172.21.15.52:0/4096695903 wait complete. 2024-09-10T08:34:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.492+0000 7f2258e00640 1 Processor -- start 2024-09-10T08:34:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.492+0000 7f2258e00640 1 -- start start 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2254073180 0x7f22541e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2254145ed0 0x7f225414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f22541462b0 con 0x7f22540b5f90 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22540b4b60 con 0x7f2254145ed0 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2258e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2254146430 con 0x7f2254073180 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.493+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39972/0 (socket says 172.21.15.52:39972) 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 -- 172.21.15.52:0/355052856 learned_addr learned my addr 172.21.15.52:0/355052856 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2252800640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2254145ed0 0x7f225414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2251e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2254073180 0x7f22541e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 -- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2254073180 msgr2=0x7f22541e9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2254073180 0x7f22541e9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 -- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2254145ed0 msgr2=0x7f225414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2254145ed0 0x7f225414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 -- 172.21.15.52:0/355052856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22541e79c0 con 0x7f22540b5f90 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f2249400640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f223c00c3c0 tx=0x7f223c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.494+0000 7f224aa00640 1 -- 172.21.15.52:0/355052856 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c0052d0 con 0x7f22540b5f90 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.495+0000 7f224aa00640 1 -- 172.21.15.52:0/355052856 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223c005490 con 0x7f22540b5f90 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.495+0000 7f224aa00640 1 -- 172.21.15.52:0/355052856 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c007260 con 0x7f22540b5f90 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.495+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22541ea270 con 0x7f22540b5f90 2024-09-10T08:34:10.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.495+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22541ea830 con 0x7f22540b5f90 2024-09-10T08:34:10.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.497+0000 7f224aa00640 1 -- 172.21.15.52:0/355052856 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f223c007400 con 0x7f22540b5f90 2024-09-10T08:34:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.498+0000 7f224aa00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 0x7f223006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.498+0000 7f224aa00640 1 -- 172.21.15.52:0/355052856 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f223c08a3e0 con 0x7f22540b5f90 2024-09-10T08:34:10.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.498+0000 7f225be13740 1 Processor -- start 2024-09-10T08:34:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.498+0000 7f225be13740 1 -- start start 2024-09-10T08:34:10.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.498+0000 7f2251e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 0x7f223006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a937c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377f480 0x556a93778570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a936dc3b0 con 0x556a9377b4b0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a936e1410 con 0x556a9377f480 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a93689620 con 0x556a9377dcf0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2251e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 0x7f223006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2244034000 tx=0x7f224402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39976/0 (socket says 172.21.15.52:39976) 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2249400640 1 -- 172.21.15.52:0/3144040187 learned_addr learned my addr 172.21.15.52:0/3144040187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2251e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a937c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.499+0000 7f2252800640 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377f480 0x556a93778570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 -- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 msgr2=0x556a937c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a937c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 -- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377f480 msgr2=0x556a93778570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377f480 0x556a93778570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 -- 172.21.15.52:0/3144040187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a933f42d0 con 0x556a9377b4b0 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2249400640 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f223c088730 tx=0x7f223c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c132c54b53a5bf57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2242a00640 1 -- 172.21.15.52:0/3144040187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c0568f0 con 0x556a9377b4b0 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2242a00640 1 -- 172.21.15.52:0/3144040187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223c08a0c0 con 0x556a9377b4b0 2024-09-10T08:34:10.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.500+0000 7f2242a00640 1 -- 172.21.15.52:0/3144040187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c057a40 con 0x556a9377b4b0 2024-09-10T08:34:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 -- 172.21.15.52:0/3144040187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 msgr2=0x556a9377e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f223c088730 tx=0x7f223c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 -- 172.21.15.52:0/3144040187 shutdown_connections 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377f480 0x556a93778570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377b4b0 0x556a9377e0d0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 --2- 172.21.15.52:0/3144040187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a937c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 -- 172.21.15.52:0/3144040187 >> 172.21.15.52:0/3144040187 conn(0x556a9377a740 msgr2=0x556a937c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 -- 172.21.15.52:0/3144040187 shutdown_connections 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.501+0000 7f225be13740 1 -- 172.21.15.52:0/3144040187 wait complete. 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.502+0000 7f225be13740 1 -- start start 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.502+0000 7f225be13740 1 Processor -- start 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a9379dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a9369c780 con 0x556a9377f480 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a936dd3d0 con 0x556a9379ea70 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a93779be0 con 0x556a9377dcf0 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f225be13740 10 client.0 _ll_register_callbacks cb 0x556a936da5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39990/0 (socket says 172.21.15.52:39990) 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f2249400640 1 -- 172.21.15.52:0/339705476 learned_addr learned my addr 172.21.15.52:0/339705476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2252800640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.503+0000 7f2251e00640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a9379dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 -- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 msgr2=0x556a9379dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a9379dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 -- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 msgr2=0x556a937d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937d2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 -- 172.21.15.52:0/339705476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a934be6b0 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2249400640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f223c00c390 tx=0x7f223c088690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ddba40086857a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2237400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c075060 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f223c088330 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f223c08a0c0 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f223c054890 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f225be13740 10 client.7311 fetch_fsmap learned FSMap version 75 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.504+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x556a9379f5d0 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f223c08a0c0 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f223c077300 con 0x556a9377f480 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 10 client.7311 fetch_fsmap finished waiting for FSMap version 75 2024-09-10T08:34:10.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 10 client.7311 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 20 client.7311 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937d6050 0x556a937d6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 4 client.7311 mds_command: new command op to 7251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 --> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a936eeb40 con 0x556a937d6050 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.505+0000 7f2251e00640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937d6050 0x556a937d6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.506+0000 7f2251e00640 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937d6050 0x556a937d6430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213a80030a6b2f40 server_cookie=d4d495584de2dfe2 in_seq=0 out_seq=0 2024-09-10T08:34:10.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.506+0000 7f2237400640 10 client.7311 ms_handle_connect on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.506+0000 7f2237400640 1 -- 172.21.15.52:0/339705476 <== mds.0 v2:172.21.15.52:6832/3825724165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a936eeb40 con 0x556a937d6050 2024-09-10T08:34:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.506+0000 7f2237400640 10 client.7311 handle_command_reply: tid=0 2024-09-10T08:34:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 client.7311 shutdown 2024-09-10T08:34:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 msgr2=0x556a9379e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f223c00c390 tx=0x7f223c088690 comp rx=0 tx=0).stop 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 shutdown_connections 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937d6050 0x556a937d6430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379e530 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 --2- 172.21.15.52:0/339705476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377dcf0 0x556a9379dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 >> 172.21.15.52:0/339705476 conn(0x556a9377b4b0 msgr2=0x556a937c09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f2237400640 0 client.7311 ms_handle_reset on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 shutdown_connections 2024-09-10T08:34:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 1 -- 172.21.15.52:0/339705476 wait complete. 2024-09-10T08:34:10.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.507+0000 7f225be13740 20 client.7311 trim_cache size 0 max 16384 2024-09-10T08:34:10.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.526+0000 7f225be13740 1 Processor -- start 2024-09-10T08:34:10.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.526+0000 7f225be13740 1 -- start start 2024-09-10T08:34:10.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377f480 0x556a937c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f22542000f0 con 0x556a9377dcf0 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f22541e3ad0 con 0x556a9379ea70 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f22541e4120 con 0x556a9377f480 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39992/0 (socket says 172.21.15.52:39992) 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 -- 172.21.15.52:0/1812367179 learned_addr learned my addr 172.21.15.52:0/1812367179 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 -- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377f480 msgr2=0x556a937c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377f480 0x556a937c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 -- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 msgr2=0x556a937c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 -- 172.21.15.52:0/1812367179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a937a2a80 con 0x556a9377dcf0 2024-09-10T08:34:10.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.527+0000 7f2251e00640 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f22440090b0 tx=0x7f224402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15fea6b3acdada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f2242000640 1 -- 172.21.15.52:0/1812367179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244055070 con 0x556a9377dcf0 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f2242000640 1 -- 172.21.15.52:0/1812367179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224404f4f0 con 0x556a9377dcf0 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f2242000640 1 -- 172.21.15.52:0/1812367179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244037040 con 0x556a9377dcf0 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 -- 172.21.15.52:0/1812367179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 msgr2=0x556a937c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f22440090b0 tx=0x7f224402c000 comp rx=0 tx=0).stop 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 -- 172.21.15.52:0/1812367179 shutdown_connections 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9379ea70 0x556a937c0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9377f480 0x556a937c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 --2- 172.21.15.52:0/1812367179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377dcf0 0x556a937c3060 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 -- 172.21.15.52:0/1812367179 >> 172.21.15.52:0/1812367179 conn(0x556a9377b4b0 msgr2=0x556a937c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 -- 172.21.15.52:0/1812367179 shutdown_connections 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.528+0000 7f225be13740 1 -- 172.21.15.52:0/1812367179 wait complete. 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.529+0000 7f225be13740 1 -- start start 2024-09-10T08:34:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.529+0000 7f225be13740 1 Processor -- start 2024-09-10T08:34:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377dcf0 0x556a93841050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9379ea70 0x556a937c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a9369c780 con 0x556a9377f480 2024-09-10T08:34:10.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a936dd3d0 con 0x556a9377dcf0 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a937d59f0 con 0x556a9379ea70 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f225be13740 10 client.0 _ll_register_callbacks cb 0x7f224c004ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.530+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2251e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377dcf0 0x556a93841050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40006/0 (socket says 172.21.15.52:40006) 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 -- 172.21.15.52:0/1386252134 learned_addr learned my addr 172.21.15.52:0/1386252134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2252800640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9379ea70 0x556a937c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 -- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9379ea70 msgr2=0x556a937c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9379ea70 0x556a937c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 -- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377dcf0 msgr2=0x556a93841050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377dcf0 0x556a93841050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 -- 172.21.15.52:0/1386252134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a937c2c20 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2249400640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f223c054a50 tx=0x7f223c000f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e333f58643ac45ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2237400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c075070 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f223c088530 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.531+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f224404f4f0 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f223c057a40 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 10 client.7317 fetch_fsmap learned FSMap version 75 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x556a937c2c20 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224404f4f0 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f223c07e030 con 0x556a9377f480 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 10 client.7317 fetch_fsmap finished waiting for FSMap version 75 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 10 client.7317 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 20 client.7317 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:10.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937c0f20 0x556a937c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 4 client.7317 mds_command: new command op to 7251 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.532+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 --> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] -- command(tid 0: {"prefix": "status"}) -- 0x556a936e8e90 con 0x556a937c0f20 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f2251e00640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937c0f20 0x556a937c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f2251e00640 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937c0f20 0x556a937c5e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fe85f5462118b1 server_cookie=7334c5994e60694a in_seq=0 out_seq=0 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f2237400640 10 client.7317 ms_handle_connect on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f2237400640 1 -- 172.21.15.52:0/1386252134 <== mds.0 v2:172.21.15.52:6832/3825724165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556a936e8e90 con 0x556a937c0f20 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f2237400640 10 client.7317 handle_command_reply: tid=0 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.533+0000 7f225be13740 1 client.7317 shutdown 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 msgr2=0x556a9379d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f223c054a50 tx=0x7f223c000f70 comp rx=0 tx=0).stop 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 shutdown_connections 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x556a937c0f20 0x556a937c5e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a9379ea70 0x556a937c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a9377f480 0x556a9379d950 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 --2- 172.21.15.52:0/1386252134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a9377dcf0 0x556a93841050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 >> 172.21.15.52:0/1386252134 conn(0x556a9377b4b0 msgr2=0x556a937c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f2237400640 0 client.7317 ms_handle_reset on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 shutdown_connections 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 1 -- 172.21.15.52:0/1386252134 wait complete. 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.534+0000 7f225be13740 20 client.7317 trim_cache size 0 max 16384 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:34:10.539 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7251, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 4.7155004170000003, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 75, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 97, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 97, 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 5.5559502060000003 2024-09-10T08:34:10.540 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 msgr2=0x7f223006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 0x7f223006e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2244034000 tx=0x7f224402e000 comp rx=0 tx=0).stop 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 msgr2=0x7f22541e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f223c00c3c0 tx=0x7f223c00c880 comp rx=0 tx=0).stop 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 shutdown_connections 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f223006be30 0x7f223006e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2254145ed0 0x7f225414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22540b5f90 0x7f22541e7480 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 --2- 172.21.15.52:0/355052856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2254073180 0x7f22541e9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 >> 172.21.15.52:0/355052856 conn(0x7f22540ccec0 msgr2=0x7f22540b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 shutdown_connections 2024-09-10T08:34:10.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.535+0000 7f2258e00640 1 -- 172.21.15.52:0/355052856 wait complete. 2024-09-10T08:34:10.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-10T08:34:10.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.709+0000 7f2338c00640 1 Processor -- start 2024-09-10T08:34:10.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.709+0000 7f2338c00640 1 -- start start 2024-09-10T08:34:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f2338c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f23340d0730 0x7f233415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f2338c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2334072240 0x7f23340726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f2338c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233415cf80 con 0x7f2334070de0 2024-09-10T08:34:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f2338c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2334072c10 con 0x7f2334072240 2024-09-10T08:34:10.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f2338c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2334071b10 con 0x7f23340d0730 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.710+0000 7f232be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2334072240 0x7f23340726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2334072240 0x7f23340726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40022/0 (socket says 172.21.15.52:40022) 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 -- 172.21.15.52:0/3255715268 learned_addr learned my addr 172.21.15.52:0/3255715268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f2333400640 1 --2- 172.21.15.52:0/3255715268 >> v2:172.21.15.176:3300/0 conn(0x7f23340d0730 0x7f233415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 -- 172.21.15.52:0/3255715268 >> v2:172.21.15.176:3300/0 conn(0x7f23340d0730 msgr2=0x7f233415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 --2- 172.21.15.52:0/3255715268 >> v2:172.21.15.176:3300/0 conn(0x7f23340d0730 0x7f233415ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 -- 172.21.15.52:0/3255715268 >> v1:172.21.15.176:6789/0 conn(0x7f2334070de0 legacy=0x7f2334071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.711+0000 7f232be00640 1 -- 172.21.15.52:0/3255715268 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2334071df0 con 0x7f2334072240 2024-09-10T08:34:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.712+0000 7f232be00640 1 --2- 172.21.15.52:0/3255715268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334072240 0x7f23340726d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f23340d11e0 tx=0x7f231c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6fc4ec603d784 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.712+0000 7f2332a00640 1 -- 172.21.15.52:0/3255715268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c037070 con 0x7f2334072240 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.712+0000 7f2332a00640 1 -- 172.21.15.52:0/3255715268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c032440 con 0x7f2334072240 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.712+0000 7f2332a00640 1 -- 172.21.15.52:0/3255715268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c032810 con 0x7f2334072240 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 -- 172.21.15.52:0/3255715268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334072240 msgr2=0x7f23340726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 --2- 172.21.15.52:0/3255715268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334072240 0x7f23340726d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f23340d11e0 tx=0x7f231c02a270 comp rx=0 tx=0).stop 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 -- 172.21.15.52:0/3255715268 shutdown_connections 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 --2- 172.21.15.52:0/3255715268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334072240 0x7f23340726d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 --2- 172.21.15.52:0/3255715268 >> v2:172.21.15.176:3300/0 conn(0x7f23340d0730 0x7f233415ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 -- 172.21.15.52:0/3255715268 >> 172.21.15.52:0/3255715268 conn(0x7f233406bc10 msgr2=0x7f233406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 -- 172.21.15.52:0/3255715268 shutdown_connections 2024-09-10T08:34:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.713+0000 7f2338c00640 1 -- 172.21.15.52:0/3255715268 wait complete. 2024-09-10T08:34:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.714+0000 7f2338c00640 1 Processor -- start 2024-09-10T08:34:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 -- start start 2024-09-10T08:34:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2334072240 0x7f2334156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23340d0730 0x7f233414adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23340d0b10 con 0x7f2334070de0 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23340b3670 con 0x7f23340d0730 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.715+0000 7f2338c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23340b3b90 con 0x7f2334072240 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40030/0 (socket says 172.21.15.52:40030) 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 -- 172.21.15.52:0/3738275997 learned_addr learned my addr 172.21.15.52:0/3738275997 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f232be00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2334072240 0x7f2334156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333e00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23340d0730 0x7f233414adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 -- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2334072240 msgr2=0x7f2334156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2334072240 0x7f2334156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 -- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23340d0730 msgr2=0x7f233414adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23340d0730 0x7f233414adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 -- 172.21.15.52:0/3738275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2334155de0 con 0x7f2334070de0 2024-09-10T08:34:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.716+0000 7f2333400640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f232400e870 tx=0x7f232400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.717+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324017070 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.717+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232400c940 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.717+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232400cd30 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.717+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23341560c0 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.717+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2334156680 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.718+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23340726d0 con 0x7f2334070de0 2024-09-10T08:34:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.719+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f232401a070 con 0x7f2334070de0 2024-09-10T08:34:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.720+0000 7f232b400640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 0x7f231006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.720+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f232408b170 con 0x7f2334070de0 2024-09-10T08:34:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.720+0000 7f232be00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 0x7f231006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:10.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.721+0000 7f232be00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 0x7f231006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f231c034000 tx=0x7f231c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:10.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.724+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2324059380 con 0x7f2334070de0 2024-09-10T08:34:10.820 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-10T08:34:10.820+0000 7eff0a400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:34:10.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.908+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f233415b640 con 0x7f2334070de0 2024-09-10T08:34:10.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.912+0000 7f232b400640 1 -- 172.21.15.52:0/3738275997 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f232405d680 con 0x7f2334070de0 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 msgr2=0x7f231006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 0x7f231006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f231c034000 tx=0x7f231c02e000 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 msgr2=0x7f2334155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f232400e870 tx=0x7f232400ed30 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 shutdown_connections 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f231006be30 0x7f231006e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23340d0730 0x7f233414adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2334072240 0x7f2334156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 --2- 172.21.15.52:0/3738275997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2334070de0 0x7f2334155080 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 >> 172.21.15.52:0/3738275997 conn(0x7f233406bc10 msgr2=0x7f23340b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:10.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 shutdown_connections 2024-09-10T08:34:10.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:10.914+0000 7f2338c00640 1 -- 172.21.15.52:0/3738275997 wait complete. 2024-09-10T08:34:10.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-10T08:34:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.089+0000 7f27f0800640 1 Processor -- start 2024-09-10T08:34:11.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.089+0000 7f27f0800640 1 -- start start 2024-09-10T08:34:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.090+0000 7f27f0800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f27e80732e0 0x7f27e80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.090+0000 7f27f0800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27e80cd2a0 0x7f27e815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27f0800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80714b0 con 0x7f27e80cce30 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27f0800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f27e8073c00 con 0x7f27e80cd2a0 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27f0800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f27e80cd880 con 0x7f27e80732e0 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27e80cd2a0 0x7f27e815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f27e80cd2a0 0x7f27e815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40044/0 (socket says 172.21.15.52:40044) 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 -- 172.21.15.52:0/1644216075 learned_addr learned my addr 172.21.15.52:0/1644216075 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ede00640 1 --2- 172.21.15.52:0/1644216075 >> v2:172.21.15.176:3300/0 conn(0x7f27e80732e0 0x7f27e80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 -- 172.21.15.52:0/1644216075 >> v2:172.21.15.176:3300/0 conn(0x7f27e80732e0 msgr2=0x7f27e80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 --2- 172.21.15.52:0/1644216075 >> v2:172.21.15.176:3300/0 conn(0x7f27e80732e0 0x7f27e80736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 -- 172.21.15.52:0/1644216075 >> v1:172.21.15.176:6789/0 conn(0x7f27e80cce30 legacy=0x7f27e8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.091+0000 7f27ee800640 1 -- 172.21.15.52:0/1644216075 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80cdb60 con 0x7f27e80cd2a0 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.092+0000 7f27ee800640 1 --2- 172.21.15.52:0/1644216075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e815c8d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b6780 tx=0x7f27e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3649833b51a22e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27eca00640 1 -- 172.21.15.52:0/1644216075 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4036070 con 0x7f27e80cd2a0 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27eca00640 1 -- 172.21.15.52:0/1644216075 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e4031600 con 0x7f27e80cd2a0 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27eca00640 1 -- 172.21.15.52:0/1644216075 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40319d0 con 0x7f27e80cd2a0 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 -- 172.21.15.52:0/1644216075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 msgr2=0x7f27e815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 --2- 172.21.15.52:0/1644216075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e815c8d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b6780 tx=0x7f27e402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 -- 172.21.15.52:0/1644216075 shutdown_connections 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 --2- 172.21.15.52:0/1644216075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e815c8d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 --2- 172.21.15.52:0/1644216075 >> v2:172.21.15.176:3300/0 conn(0x7f27e80732e0 0x7f27e80736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 -- 172.21.15.52:0/1644216075 >> 172.21.15.52:0/1644216075 conn(0x7f27e806d0f0 msgr2=0x7f27e806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:11.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 -- 172.21.15.52:0/1644216075 shutdown_connections 2024-09-10T08:34:11.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.093+0000 7f27f0800640 1 -- 172.21.15.52:0/1644216075 wait complete. 2024-09-10T08:34:11.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.095+0000 7f27f0800640 1 Processor -- start 2024-09-10T08:34:11.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.095+0000 7f27f0800640 1 -- start start 2024-09-10T08:34:11.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27e80732e0 0x7f27e81f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 0x7f27e8158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f27e806bf70 con 0x7f27e80cd2a0 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f27e806bdf0 con 0x7f27e80732e0 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27f0800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f27e8072380 con 0x7f27e80cce30 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27ee800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27ee800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40052/0 (socket says 172.21.15.52:40052) 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27ee800640 1 -- 172.21.15.52:0/1138495785 learned_addr learned my addr 172.21.15.52:0/1138495785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27ede00640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27e80732e0 0x7f27e81f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.096+0000 7f27ed400640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 0x7f27e8158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 -- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 msgr2=0x7f27e8158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 0x7f27e8158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 -- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27e80732e0 msgr2=0x7f27e81f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27e80732e0 0x7f27e81f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 -- 172.21.15.52:0/1138495785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80c6760 con 0x7f27e80cd2a0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ed400640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 0x7f27e8158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27ee800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009f40 tx=0x7f27e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e403f020 con 0x7f27e80cd2a0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e4037040 con 0x7f27e80cd2a0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4036070 con 0x7f27e80cd2a0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e80c6a40 con 0x7f27e80cd2a0 2024-09-10T08:34:11.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.097+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e80c7000 con 0x7f27e80cd2a0 2024-09-10T08:34:11.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.098+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e80736c0 con 0x7f27e80cd2a0 2024-09-10T08:34:11.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.099+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27e4042020 con 0x7f27e80cd2a0 2024-09-10T08:34:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.100+0000 7f27e2000640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 0x7f27cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.100+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f27e40ab640 con 0x7f27e80cd2a0 2024-09-10T08:34:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.101+0000 7f27ede00640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 0x7f27cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.101+0000 7f27ede00640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 0x7f27cc06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0079a0 tx=0x7f27dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.105+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27e4049020 con 0x7f27e80cd2a0 2024-09-10T08:34:11.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.287+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f27e80c71d0 con 0x7f27e80cd2a0 2024-09-10T08:34:11.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.291+0000 7f27e2000640 1 -- 172.21.15.52:0/1138495785 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7f27e4079f40 con 0x7f27e80cd2a0 2024-09-10T08:34:11.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.293+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 msgr2=0x7f27cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.293+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 0x7f27cc06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27dc0079a0 tx=0x7f27dc008040 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.293+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 msgr2=0x7f27e80c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.293+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009f40 tx=0x7f27e4004a40 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 shutdown_connections 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f27cc06be30 0x7f27cc06e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f27e80cd2a0 0x7f27e80c7870 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f27e80cce30 0x7f27e8158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 --2- 172.21.15.52:0/1138495785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27e80732e0 0x7f27e81f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 >> 172.21.15.52:0/1138495785 conn(0x7f27e806d0f0 msgr2=0x7f27e806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:11.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 shutdown_connections 2024-09-10T08:34:11.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.294+0000 7f27f0800640 1 -- 172.21.15.52:0/1138495785 wait complete. 2024-09-10T08:34:11.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-10T08:34:11.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.468+0000 7f439da00640 1 Processor -- start 2024-09-10T08:34:11.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.468+0000 7f439da00640 1 -- start start 2024-09-10T08:34:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.469+0000 7f439da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43980ccf30 0x7f43980b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.469+0000 7f439da00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f439815b7c0 0x7f43980cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.469+0000 7f439da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980cead0 0x7f439815f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f439da00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f43980cd850 con 0x7f43980ccf30 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f439da00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f43980cf2e0 con 0x7f439815b7c0 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f439da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4398070fe0 con 0x7f43980cead0 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43980ccf30 0x7f43980b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f43980ccf30 0x7f43980b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40064/0 (socket says 172.21.15.52:40064) 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 -- 172.21.15.52:0/2474321590 learned_addr learned my addr 172.21.15.52:0/2474321590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4397400640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980cead0 0x7f439815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f438fe00640 1 --2- 172.21.15.52:0/2474321590 >> v2:172.21.15.176:3300/0 conn(0x7f439815b7c0 0x7f43980cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 -- 172.21.15.52:0/2474321590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980cead0 msgr2=0x7f439815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980cead0 0x7f439815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 -- 172.21.15.52:0/2474321590 >> v2:172.21.15.176:3300/0 conn(0x7f439815b7c0 msgr2=0x7f43980cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 --2- 172.21.15.52:0/2474321590 >> v2:172.21.15.176:3300/0 conn(0x7f439815b7c0 0x7f43980cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.470+0000 7f4396a00640 1 -- 172.21.15.52:0/2474321590 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980712c0 con 0x7f43980ccf30 2024-09-10T08:34:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.471+0000 7f4396a00640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980ccf30 0x7f43980b2c50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f43981601f0 tx=0x7f438802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fafe584cb6df55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f4396000640 1 -- 172.21.15.52:0/2474321590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388037070 con 0x7f43980ccf30 2024-09-10T08:34:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f4396000640 1 -- 172.21.15.52:0/2474321590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388032440 con 0x7f43980ccf30 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f4396000640 1 -- 172.21.15.52:0/2474321590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388032810 con 0x7f43980ccf30 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 -- 172.21.15.52:0/2474321590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980ccf30 msgr2=0x7f43980b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980ccf30 0x7f43980b2c50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f43981601f0 tx=0x7f438802a140 comp rx=0 tx=0).stop 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 -- 172.21.15.52:0/2474321590 shutdown_connections 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 --2- 172.21.15.52:0/2474321590 >> v2:172.21.15.176:3300/0 conn(0x7f439815b7c0 0x7f43980cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980cead0 0x7f439815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 --2- 172.21.15.52:0/2474321590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980ccf30 0x7f43980b2c50 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 -- 172.21.15.52:0/2474321590 >> 172.21.15.52:0/2474321590 conn(0x7f439806d0f0 msgr2=0x7f439806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 -- 172.21.15.52:0/2474321590 shutdown_connections 2024-09-10T08:34:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.472+0000 7f439da00640 1 -- 172.21.15.52:0/2474321590 wait complete. 2024-09-10T08:34:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.474+0000 7f439da00640 1 Processor -- start 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.474+0000 7f439da00640 1 -- start start 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980ccf30 0x7f439814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 0x7f43981458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43980cef20 con 0x7f43980cead0 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f43980cf5c0 con 0x7f439815b7c0 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f439da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f43980cf0a0 con 0x7f43980ccf30 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f438fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f438fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40078/0 (socket says 172.21.15.52:40078) 2024-09-10T08:34:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f438fe00640 1 -- 172.21.15.52:0/3634497915 learned_addr learned my addr 172.21.15.52:0/3634497915 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f4396a00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980ccf30 0x7f439814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.475+0000 7f4397400640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 0x7f43981458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 -- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980ccf30 msgr2=0x7f439814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980ccf30 0x7f439814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 -- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 msgr2=0x7f43981458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 0x7f43981458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 -- 172.21.15.52:0/3634497915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398146790 con 0x7f43980cead0 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f4397400640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 0x7f43981458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438fe00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f438000d800 tx=0x7f438000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438000b6c0 con 0x7f43980cead0 2024-09-10T08:34:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4380019070 con 0x7f43980cead0 2024-09-10T08:34:11.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438000ba80 con 0x7f43980cead0 2024-09-10T08:34:11.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439814ba80 con 0x7f43980cead0 2024-09-10T08:34:11.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.476+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439814c040 con 0x7f43980cead0 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.477+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43980cc960 con 0x7f43980cead0 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.478+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f438000bc20 con 0x7f43980cead0 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.479+0000 7f438ea00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 0x7f437406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.479+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f438008b2f0 con 0x7f43980cead0 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.480+0000 7f4396a00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 0x7f437406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.480+0000 7f4396a00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 0x7f437406e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.483+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4398146790 con 0x7f43980cead0 2024-09-10T08:34:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.666+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f439814c7b0 con 0x7f43980cead0 2024-09-10T08:34:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.670+0000 7f438ea00640 1 -- 172.21.15.52:0/3634497915 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f4380059be0 con 0x7f43980cead0 2024-09-10T08:34:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.672+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 msgr2=0x7f437406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.672+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 0x7f437406e320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4388034000 tx=0x7f438802e000 comp rx=0 tx=0).stop 2024-09-10T08:34:11.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.672+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 msgr2=0x7f4398148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.672+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f438000d800 tx=0x7f438000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 shutdown_connections 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f437406be60 0x7f437406e320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f439815b7c0 0x7f43981458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43980cead0 0x7f4398148e60 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 --2- 172.21.15.52:0/3634497915 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43980ccf30 0x7f439814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 >> 172.21.15.52:0/3634497915 conn(0x7f439806d0f0 msgr2=0x7f43980b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 shutdown_connections 2024-09-10T08:34:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.673+0000 7f439da00640 1 -- 172.21.15.52:0/3634497915 wait complete. 2024-09-10T08:34:11.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:11.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.844+0000 7f951f000640 1 Processor -- start 2024-09-10T08:34:11.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.845+0000 7f951f000640 1 -- start start 2024-09-10T08:34:11.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951f000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f95180b2d40 0x7f951806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951f000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9518071180 con 0x7f951806c150 2024-09-10T08:34:11.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951f000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9518071460 con 0x7f951813eb20 2024-09-10T08:34:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951f000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9518071ab0 con 0x7f95180b2d40 2024-09-10T08:34:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951d000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f951806c150 0x7f9518071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39658/0 (socket says 172.21.15.52:39658) 2024-09-10T08:34:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f951d000640 1 -- 172.21.15.52:0/4230552874 learned_addr learned my addr 172.21.15.52:0/4230552874 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.846+0000 7f9517e00640 1 --2- 172.21.15.52:0/4230552874 >> v2:172.21.15.176:3300/0 conn(0x7f95180b2d40 0x7f951806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.847+0000 7f9517400640 1 -- 172.21.15.52:0/4230552874 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890593226 0 0) 0x7f9518071180 con 0x7f951806c150 2024-09-10T08:34:11.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.847+0000 7f9517400640 1 -- 172.21.15.52:0/4230552874 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94fc005730 con 0x7f951806c150 2024-09-10T08:34:11.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.847+0000 7f9517e00640 1 -- 172.21.15.52:0/4230552874 >> v1:172.21.15.176:6789/0 conn(0x7f951813eb20 legacy=0x7f951815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.847+0000 7f9517e00640 1 -- 172.21.15.52:0/4230552874 >> v1:172.21.15.52:6789/0 conn(0x7f951806c150 legacy=0x7f9518071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.847+0000 7f9517e00640 1 -- 172.21.15.52:0/4230552874 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9518071740 con 0x7f95180b2d40 2024-09-10T08:34:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.848+0000 7f9517e00640 1 --2- 172.21.15.52:0/4230552874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95180b2d40 0x7f951806bc10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95080097a0 tx=0x7f950802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6564aa4a523ec7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.848+0000 7f9517400640 1 -- 172.21.15.52:0/4230552874 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508037070 con 0x7f95180b2d40 2024-09-10T08:34:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.848+0000 7f9517400640 1 -- 172.21.15.52:0/4230552874 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508032440 con 0x7f95180b2d40 2024-09-10T08:34:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.848+0000 7f9517400640 1 -- 172.21.15.52:0/4230552874 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508032810 con 0x7f95180b2d40 2024-09-10T08:34:11.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 -- 172.21.15.52:0/4230552874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95180b2d40 msgr2=0x7f951806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 --2- 172.21.15.52:0/4230552874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95180b2d40 0x7f951806bc10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95080097a0 tx=0x7f950802a230 comp rx=0 tx=0).stop 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 -- 172.21.15.52:0/4230552874 shutdown_connections 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 --2- 172.21.15.52:0/4230552874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95180b2d40 0x7f951806bc10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 -- 172.21.15.52:0/4230552874 >> 172.21.15.52:0/4230552874 conn(0x7f95180ccec0 msgr2=0x7f95180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 -- 172.21.15.52:0/4230552874 shutdown_connections 2024-09-10T08:34:11.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.849+0000 7f951f000640 1 -- 172.21.15.52:0/4230552874 wait complete. 2024-09-10T08:34:11.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.850+0000 7f951f000640 1 Processor -- start 2024-09-10T08:34:11.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 -- start start 2024-09-10T08:34:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95180b2d40 0x7f95181427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f951813eb20 0x7f951815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f951815c7d0 con 0x7f951806c150 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f951815c650 con 0x7f951813eb20 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.851+0000 7f951f000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9518072650 con 0x7f95180b2d40 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40086/0 (socket says 172.21.15.52:40086) 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 -- 172.21.15.52:0/236728440 learned_addr learned my addr 172.21.15.52:0/236728440 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f951d000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f951813eb20 0x7f951815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f950fe00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95180b2d40 0x7f95181427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 -- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95180b2d40 msgr2=0x7f95181427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95180b2d40 0x7f95181427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 -- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f951813eb20 msgr2=0x7f951815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:11.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f951813eb20 0x7f951815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:11.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 -- 172.21.15.52:0/236728440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951815d690 con 0x7f951806c150 2024-09-10T08:34:11.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.852+0000 7f9517e00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9508035040 tx=0x7f95080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.853+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508037040 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.853+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508030500 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.853+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951815d930 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.853+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508030910 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.853+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951815e1d0 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.854+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9518071280 con 0x7f951806c150 2024-09-10T08:34:11.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.855+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9508044020 con 0x7f951806c150 2024-09-10T08:34:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.856+0000 7f9514c00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 0x7f94f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.856+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f95080ab200 con 0x7f951806c150 2024-09-10T08:34:11.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.856+0000 7f950fe00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 0x7f94f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:11.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.857+0000 7f950fe00640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 0x7f94f406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95181581c0 tx=0x7f9500009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:11.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:11.860+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9518071280 con 0x7f951806c150 2024-09-10T08:34:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.084+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f951806bc10 con 0x7f951806c150 2024-09-10T08:34:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.084+0000 7f9514c00640 1 -- 172.21.15.52:0/236728440 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7f9508079af0 con 0x7f951806c150 2024-09-10T08:34:12.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:12.085 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 msgr2=0x7f94f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 0x7f94f406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f95181581c0 tx=0x7f9500009040 comp rx=0 tx=0).stop 2024-09-10T08:34:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 msgr2=0x7f9518144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f9508035040 tx=0x7f95080046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 shutdown_connections 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f94f406be30 0x7f94f406e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f951813eb20 0x7f951815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95180b2d40 0x7f95181427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 --2- 172.21.15.52:0/236728440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f951806c150 0x7f9518144930 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 >> 172.21.15.52:0/236728440 conn(0x7f95180ccec0 msgr2=0x7f951815b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 shutdown_connections 2024-09-10T08:34:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.087+0000 7f951f000640 1 -- 172.21.15.52:0/236728440 wait complete. 2024-09-10T08:34:12.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T08:34:12.277 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:34:02.290953+0000","btime":"2024-09-10T08:34:01.291966+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:34:02.290953+0000","atime":"2024-09-10T08:34:01.291966+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:34:02.290953+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:34:12.398 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:34:01.291966+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:34:01.291966+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:34:02.290953+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T08:34:02.290953+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:34:02.290953+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:34:12.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:12.399 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-10T08:34:12.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.558+0000 7f0598600640 1 Processor -- start 2024-09-10T08:34:12.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.558+0000 7f0598600640 1 -- start start 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.559+0000 7f0598600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0590169780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.559+0000 7f0598600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059015ee80 con 0x7f05900735c0 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.559+0000 7f0598600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059015f160 con 0x7f059015e6e0 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.559+0000 7f0598600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f059015fc40 con 0x7f0590167390 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f0595200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f05900735c0 0x7f05900739e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39672/0 (socket says 172.21.15.52:39672) 2024-09-10T08:34:12.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f0595200640 1 -- 172.21.15.52:0/400440100 learned_addr learned my addr 172.21.15.52:0/400440100 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f0596600640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0590169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815170513 0 0) 0x7f059015ee80 con 0x7f05900735c0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0578003520 con 0x7f05900735c0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349849540 0 0) 0x7f059015f160 con 0x7f059015e6e0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f059015ee80 con 0x7f059015e6e0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2714368491 0 0) 0x7f0578003520 con 0x7f05900735c0 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 msgr2=0x7f0590169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0590169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 >> v1:172.21.15.176:6789/0 conn(0x7f059015e6e0 legacy=0x7f05900b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059015f440 con 0x7f05900735c0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f057c001670 con 0x7f05900735c0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.560+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 >> v1:172.21.15.52:6789/0 conn(0x7f05900735c0 legacy=0x7f05900739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0578003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780040d0 0x7f0578004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0578004d40 0x7f05780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f059015fc40 con 0x7f05780040d0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f057800baa0 con 0x7f0578004d40 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f057800bca0 con 0x7f0590167390 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780040d0 0x7f0578004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0596600640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0578004d40 0x7f05780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595c00640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0578003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 -- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 msgr2=0x7f0578003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0590167390 0x7f0578003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 -- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0578004d40 msgr2=0x7f05780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0578004d40 0x7f05780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.561+0000 7f0595200640 1 -- 172.21.15.52:0/400440100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0578003520 con 0x7f05780040d0 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.562+0000 7f0595200640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780040d0 0x7f0578004800 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c210 tx=0x7f0578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b838d1265375f2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c007ce0 con 0x7f05780040d0 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c005ad0 con 0x7f05780040d0 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f058fe00640 1 -- 172.21.15.52:0/400440100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c007070 con 0x7f05780040d0 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 -- 172.21.15.52:0/400440100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780040d0 msgr2=0x7f0578004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 --2- 172.21.15.52:0/400440100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05780040d0 0x7f0578004800 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c210 tx=0x7f0578005830 comp rx=0 tx=0).stop 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0596600640 1 -- 172.21.15.52:0/400440100 reap_dead start 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 -- 172.21.15.52:0/400440100 shutdown_connections 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 -- 172.21.15.52:0/400440100 >> 172.21.15.52:0/400440100 conn(0x7f0590067950 msgr2=0x7f0590067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 -- 172.21.15.52:0/400440100 shutdown_connections 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.563+0000 7f0598600640 1 -- 172.21.15.52:0/400440100 wait complete. 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.565+0000 7f0598600640 1 Processor -- start 2024-09-10T08:34:12.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.565+0000 7f0598600640 1 -- start start 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 0x7f059014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 0x7f059014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b48f0 con 0x7f0590153dd0 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b4c10 con 0x7f05900b4190 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0598600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f05900b5710 con 0x7f05780040d0 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40110/0 (socket says 172.21.15.52:40110) 2024-09-10T08:34:12.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0596600640 1 -- 172.21.15.52:0/2200539390 learned_addr learned my addr 172.21.15.52:0/2200539390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0595200640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 0x7f059014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.566+0000 7f0595c00640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 0x7f059014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 -- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 msgr2=0x7f059014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 0x7f059014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 -- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 msgr2=0x7f059014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 0x7f059014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 -- 172.21.15.52:0/2200539390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05901542d0 con 0x7f0590153dd0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0595c00640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 0x7f059014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0595200640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 0x7f059014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0596600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f05900b4e70 tx=0x7f058800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f058d600640 1 -- 172.21.15.52:0/2200539390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058800fde0 con 0x7f0590153dd0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f058d600640 1 -- 172.21.15.52:0/2200539390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588015430 con 0x7f0590153dd0 2024-09-10T08:34:12.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f058d600640 1 -- 172.21.15.52:0/2200539390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588015820 con 0x7f0590153dd0 2024-09-10T08:34:12.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05900b33d0 con 0x7f0590153dd0 2024-09-10T08:34:12.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.567+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05900b3990 con 0x7f0590153dd0 2024-09-10T08:34:12.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.569+0000 7f058d600640 1 -- 172.21.15.52:0/2200539390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05880159c0 con 0x7f0590153dd0 2024-09-10T08:34:12.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.570+0000 7f058d600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.570+0000 7f058d600640 1 -- 172.21.15.52:0/2200539390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f058808bd80 con 0x7f0590153dd0 2024-09-10T08:34:12.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.571+0000 7f0595c00640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.571+0000 7f059b5ef740 1 Processor -- start 2024-09-10T08:34:12.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.571+0000 7f059b5ef740 1 -- start start 2024-09-10T08:34:12.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.571+0000 7f0595c00640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 0x7f057006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0584007fd0 tx=0x7f0584009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 0x5597e8298020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5597e81d1970 con 0x5597e82b2460 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5597e81798d0 con 0x5597e82b3ba0 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5597e81cd930 con 0x5597e8297c40 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40118/0 (socket says 172.21.15.52:40118) 2024-09-10T08:34:12.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 -- 172.21.15.52:0/2179170054 learned_addr learned my addr 172.21.15.52:0/2179170054 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0595200640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 -- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 msgr2=0x5597e8298020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0595c00640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 0x5597e8298020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 0x5597e8298020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 -- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 msgr2=0x5597e82bb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82bb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0596600640 1 -- 172.21.15.52:0/2179170054 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e7fb0a20 con 0x5597e82b2460 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0595200640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.572+0000 7f0595c00640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 0x5597e8298020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f0596600640 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0588002230 tx=0x7f058805a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2303e8091f08633 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f0582000640 1 -- 172.21.15.52:0/2179170054 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588062b50 con 0x5597e82b2460 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f0582000640 1 -- 172.21.15.52:0/2179170054 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588058010 con 0x5597e82b2460 2024-09-10T08:34:12.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f0582000640 1 -- 172.21.15.52:0/2179170054 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880565e0 con 0x5597e82b2460 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f059b5ef740 1 -- 172.21.15.52:0/2179170054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 msgr2=0x5597e82bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.573+0000 7f059b5ef740 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f0588002230 tx=0x7f058805a730 comp rx=0 tx=0).stop 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 -- 172.21.15.52:0/2179170054 shutdown_connections 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82bb990 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 --2- 172.21.15.52:0/2179170054 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e8297c40 0x5597e8298020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 -- 172.21.15.52:0/2179170054 >> 172.21.15.52:0/2179170054 conn(0x5597e826a500 msgr2=0x5597e82b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 -- 172.21.15.52:0/2179170054 shutdown_connections 2024-09-10T08:34:12.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 -- 172.21.15.52:0/2179170054 wait complete. 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.574+0000 7f059b5ef740 1 -- start start 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 Processor -- start 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b2460 0x5597e82af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8299760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5597e826dbf0 con 0x5597e82b3ba0 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5597e818caf0 con 0x5597e82b2460 2024-09-10T08:34:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.575+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5597e826ded0 con 0x5597e82afd80 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f059b5ef740 10 client.0 _ll_register_callbacks cb 0x5597e817e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40120/0 (socket says 172.21.15.52:40120) 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 -- 172.21.15.52:0/1233221068 learned_addr learned my addr 172.21.15.52:0/1233221068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0596600640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8299760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595c00640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b2460 0x5597e82af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 -- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 msgr2=0x5597e8299760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8299760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 -- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b2460 msgr2=0x5597e82af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b2460 0x5597e82af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.576+0000 7f0595200640 1 -- 172.21.15.52:0/1233221068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e7ea4310 con 0x5597e82b3ba0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0595200640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c300 tx=0x7f057c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d6e57b938edafa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0047e0 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f057c004980 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0588058010 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f057c004b80 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f059b5ef740 10 client.7353 fetch_fsmap learned FSMap version 75 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5597e80111b0 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588058010 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.577+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f057c04f080 con 0x5597e82b3ba0 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 10 client.7353 fetch_fsmap finished waiting for FSMap version 75 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 10 client.7353 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 20 client.7353 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e82cd170 0x5597e82cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 4 client.7353 mds_command: new command op to 7251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 --> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597e81a6100 con 0x5597e82cd170 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f0595c00640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e82cd170 0x5597e82cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f0595c00640 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e82cd170 0x5597e82cf560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11870362a7c2b59a server_cookie=f611366eefd857a0 in_seq=0 out_seq=0 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.578+0000 7f0576a00640 10 client.7353 ms_handle_connect on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f0576a00640 1 -- 172.21.15.52:0/1233221068 <== mds.0 v2:172.21.15.52:6832/3825724165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597e81a6100 con 0x5597e82cd170 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f0576a00640 10 client.7353 handle_command_reply: tid=0 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f059b5ef740 1 client.7353 shutdown 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 msgr2=0x5597e8295bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c300 tx=0x7f057c02c000 comp rx=0 tx=0).stop 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 shutdown_connections 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.579+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e82cd170 0x5597e82cf560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8299760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e8295bc0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1233221068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b2460 0x5597e82af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f0576a00640 0 client.7353 ms_handle_reset on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 >> 172.21.15.52:0/1233221068 conn(0x5597e8297c40 msgr2=0x5597e82b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 shutdown_connections 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 1 -- 172.21.15.52:0/1233221068 wait complete. 2024-09-10T08:34:12.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.580+0000 7f059b5ef740 20 client.7353 trim_cache size 0 max 16384 2024-09-10T08:34:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.598+0000 7f059b5ef740 1 Processor -- start 2024-09-10T08:34:12.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.598+0000 7f059b5ef740 1 -- start start 2024-09-10T08:34:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8293f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0590201700 con 0x5597e82b2460 2024-09-10T08:34:12.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0590200720 con 0x5597e82b3ba0 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0590150680 con 0x5597e82afd80 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f0595200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f0595200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40132/0 (socket says 172.21.15.52:40132) 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f0595200640 1 -- 172.21.15.52:0/1959863021 learned_addr learned my addr 172.21.15.52:0/1959863021 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f0596600640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.599+0000 7f0595c00640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8293f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 -- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 msgr2=0x5597e8293f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8293f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 -- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 msgr2=0x5597e82b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 -- 172.21.15.52:0/1959863021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e7e7d3d0 con 0x5597e82b2460 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595c00640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8293f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:12.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0595200640 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c210 tx=0x7f057c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212982d5d3f3b787 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0581600640 1 -- 172.21.15.52:0/1959863021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c053070 con 0x5597e82b2460 2024-09-10T08:34:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0581600640 1 -- 172.21.15.52:0/1959863021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c044070 con 0x5597e82b2460 2024-09-10T08:34:12.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.600+0000 7f0581600640 1 -- 172.21.15.52:0/1959863021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0047e0 con 0x5597e82b2460 2024-09-10T08:34:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- 172.21.15.52:0/1959863021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 msgr2=0x5597e82b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f057c00c210 tx=0x7f057c02d000 comp rx=0 tx=0).stop 2024-09-10T08:34:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- 172.21.15.52:0/1959863021 shutdown_connections 2024-09-10T08:34:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82b3ba0 0x5597e82b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b2460 0x5597e82b4300 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 --2- 172.21.15.52:0/1959863021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82afd80 0x5597e8293f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- 172.21.15.52:0/1959863021 >> 172.21.15.52:0/1959863021 conn(0x5597e8297c40 msgr2=0x5597e82af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- 172.21.15.52:0/1959863021 shutdown_connections 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- 172.21.15.52:0/1959863021 wait complete. 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.601+0000 7f059b5ef740 1 -- start start 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.602+0000 7f059b5ef740 1 Processor -- start 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.602+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82afd80 0x5597e82d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.602+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82b2460 0x5597e8330420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f059b5ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f059b5ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05902000d0 con 0x5597e82b3ba0 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5597e826ecd0 con 0x5597e82afd80 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f059b5ef740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5597e82b1100 con 0x5597e82b2460 2024-09-10T08:34:12.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f059b5ef740 10 client.0 _ll_register_callbacks cb 0x7f0578003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40142/0 (socket says 172.21.15.52:40142) 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 -- 172.21.15.52:0/373705551 learned_addr learned my addr 172.21.15.52:0/373705551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0595c00640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82afd80 0x5597e82d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0595200640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82b2460 0x5597e8330420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 -- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82b2460 msgr2=0x5597e8330420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82b2460 0x5597e8330420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 -- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82afd80 msgr2=0x5597e82d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82afd80 0x5597e82d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.603+0000 7f0596600640 1 -- 172.21.15.52:0/373705551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e82d08f0 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0596600640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f05880563d0 tx=0x7f058801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0afe3c314686863 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588058270 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f05880626c0 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f057c044070 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f05880628c0 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 10 client.7359 fetch_fsmap learned FSMap version 75 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5597e82c2b50 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c044070 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f0588083b50 con 0x5597e82b3ba0 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 10 client.7359 fetch_fsmap finished waiting for FSMap version 75 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 10 client.7359 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-10T08:34:12.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 20 client.7359 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e8330960 0x5597e82b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 4 client.7359 mds_command: new command op to 7251 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.604+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 --> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x5597e81df0a0 con 0x5597e8330960 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.605+0000 7f0595c00640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e8330960 0x5597e82b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.605+0000 7f0595c00640 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e8330960 0x5597e82b4610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96856c5a4906079a server_cookie=241026f4309ac6d2 in_seq=0 out_seq=0 2024-09-10T08:34:12.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.605+0000 7f0576a00640 10 client.7359 ms_handle_connect on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f0576a00640 1 -- 172.21.15.52:0/373705551 <== mds.0 v2:172.21.15.52:6832/3825724165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5597e81df0a0 con 0x5597e8330960 2024-09-10T08:34:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f0576a00640 10 client.7359 handle_command_reply: tid=0 2024-09-10T08:34:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 client.7359 shutdown 2024-09-10T08:34:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 msgr2=0x5597e82b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f05880563d0 tx=0x7f058801e000 comp rx=0 tx=0).stop 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 shutdown_connections 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:6832/3825724165,v1:172.21.15.52:6833/3825724165] conn(0x5597e8330960 0x5597e82b4610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5597e82b3ba0 0x5597e82b40d0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5597e82b2460 0x5597e8330420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 --2- 172.21.15.52:0/373705551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5597e82afd80 0x5597e82d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f0576a00640 0 client.7359 ms_handle_reset on v2:172.21.15.52:6832/3825724165 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 >> 172.21.15.52:0/373705551 conn(0x5597e8297c40 msgr2=0x5597e8293f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 shutdown_connections 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 1 -- 172.21.15.52:0/373705551 wait complete. 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.606+0000 7f059b5ef740 20 client.7359 trim_cache size 0 max 16384 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "86a1e57e-80d2-494a-86f4-d472f0d95e24", 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:34:12.612 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 msgr2=0x7f057006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 0x7f057006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0584007fd0 tx=0x7f0584009040 comp rx=0 tx=0).stop 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 msgr2=0x7f059014de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f05900b4e70 tx=0x7f058800f580 comp rx=0 tx=0).stop 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 shutdown_connections 2024-09-10T08:34:12.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f057006be30 0x7f057006e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0590153dd0 0x7f059014de10 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05900b4190 0x7f059014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 --2- 172.21.15.52:0/2200539390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05780040d0 0x7f059014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 >> 172.21.15.52:0/2200539390 conn(0x7f0590067950 msgr2=0x7f0590161030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 shutdown_connections 2024-09-10T08:34:12.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.607+0000 7f0598600640 1 -- 172.21.15.52:0/2200539390 wait complete. 2024-09-10T08:34:12.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:12.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.779+0000 7fdb56000640 1 Processor -- start 2024-09-10T08:34:12.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.779+0000 7fdb56000640 1 -- start start 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.780+0000 7fdb56000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb50145ed0 0x7fdb500b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb56000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb500b4020 con 0x7fdb50073180 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb56000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb500b42c0 con 0x7fdb500b5f90 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb56000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb500b63d0 con 0x7fdb50145ed0 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb50145ed0 0x7fdb500b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb50145ed0 0x7fdb500b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40144/0 (socket says 172.21.15.52:40144) 2024-09-10T08:34:12.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 -- 172.21.15.52:0/2670310545 learned_addr learned my addr 172.21.15.52:0/2670310545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 -- 172.21.15.52:0/2670310545 >> v1:172.21.15.176:6789/0 conn(0x7fdb500b5f90 legacy=0x7fdb5015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:12.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 -- 172.21.15.52:0/2670310545 >> v1:172.21.15.52:6789/0 conn(0x7fdb50073180 legacy=0x7fdb500b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4f400640 1 -- 172.21.15.52:0/2670310545 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb500b45a0 con 0x7fdb50145ed0 2024-09-10T08:34:12.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.781+0000 7fdb4ea00640 1 -- 172.21.15.52:0/2670310545 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344475509 0 0) 0x7fdb500b4020 con 0x7fdb50073180 2024-09-10T08:34:12.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.782+0000 7fdb4f400640 1 --2- 172.21.15.52:0/2670310545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb50145ed0 0x7fdb500b5080 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb4002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c18584c546c330 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb4ea00640 1 -- 172.21.15.52:0/2670310545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40037070 con 0x7fdb50145ed0 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb4ea00640 1 -- 172.21.15.52:0/2670310545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4002ae50 con 0x7fdb50145ed0 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb4ea00640 1 -- 172.21.15.52:0/2670310545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40032860 con 0x7fdb50145ed0 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 -- 172.21.15.52:0/2670310545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb50145ed0 msgr2=0x7fdb500b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 --2- 172.21.15.52:0/2670310545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb50145ed0 0x7fdb500b5080 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009870 tx=0x7fdb4002a300 comp rx=0 tx=0).stop 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 -- 172.21.15.52:0/2670310545 shutdown_connections 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 --2- 172.21.15.52:0/2670310545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb50145ed0 0x7fdb500b5080 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 -- 172.21.15.52:0/2670310545 >> 172.21.15.52:0/2670310545 conn(0x7fdb500ccec0 msgr2=0x7fdb500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 -- 172.21.15.52:0/2670310545 shutdown_connections 2024-09-10T08:34:12.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.783+0000 7fdb56000640 1 -- 172.21.15.52:0/2670310545 wait complete. 2024-09-10T08:34:12.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.785+0000 7fdb56000640 1 Processor -- start 2024-09-10T08:34:12.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.785+0000 7fdb56000640 1 -- start start 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb50073180 0x7fdb50159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb50145ed0 0x7fdb501427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb501462b0 con 0x7fdb500b5f90 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500b4b60 con 0x7fdb50145ed0 2024-09-10T08:34:12.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb56000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb50146430 con 0x7fdb50073180 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40158/0 (socket says 172.21.15.52:40158) 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb47e00640 1 -- 172.21.15.52:0/2538084820 learned_addr learned my addr 172.21.15.52:0/2538084820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.786+0000 7fdb4f400640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb50073180 0x7fdb50159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb4fe00640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb50145ed0 0x7fdb501427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 -- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb50073180 msgr2=0x7fdb50159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb50073180 0x7fdb50159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 -- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb50145ed0 msgr2=0x7fdb501427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb50145ed0 0x7fdb501427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 -- 172.21.15.52:0/2538084820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb50141150 con 0x7fdb500b5f90 2024-09-10T08:34:12.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47e00640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c390 tx=0x7fdb3800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38017070 con 0x7fdb500b5f90 2024-09-10T08:34:12.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb380052d0 con 0x7fdb500b5f90 2024-09-10T08:34:12.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb500c66e0 con 0x7fdb500b5f90 2024-09-10T08:34:12.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.787+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38003850 con 0x7fdb500b5f90 2024-09-10T08:34:12.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.788+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb500c6ca0 con 0x7fdb500b5f90 2024-09-10T08:34:12.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.789+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb500b5080 con 0x7fdb500b5f90 2024-09-10T08:34:12.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.790+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb3801a070 con 0x7fdb500b5f90 2024-09-10T08:34:12.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.791+0000 7fdb47400640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 0x7fdb2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:12.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.791+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fdb3808a190 con 0x7fdb500b5f90 2024-09-10T08:34:12.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.791+0000 7fdb4f400640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 0x7fdb2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:12.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.792+0000 7fdb4f400640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 0x7fdb2c06e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034000 tx=0x7fdb4002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:12.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:12.795+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb380584d0 con 0x7fdb500b5f90 2024-09-10T08:34:13.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.017+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb500cd9b0 con 0x7fdb500b5f90 2024-09-10T08:34:13.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.017+0000 7fdb47400640 1 -- 172.21.15.52:0/2538084820 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7fdb3805c7d0 con 0x7fdb500b5f90 2024-09-10T08:34:13.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:13.018 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:13.018 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:13.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 msgr2=0x7fdb2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 0x7fdb2c06e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb40034000 tx=0x7fdb4002e000 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 msgr2=0x7fdb501408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c390 tx=0x7fdb3800c850 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 shutdown_connections 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb2c06be30 0x7fdb2c06e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb50145ed0 0x7fdb501427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb500b5f90 0x7fdb501408c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 --2- 172.21.15.52:0/2538084820 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb50073180 0x7fdb50159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 >> 172.21.15.52:0/2538084820 conn(0x7fdb500ccec0 msgr2=0x7fdb500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 shutdown_connections 2024-09-10T08:34:13.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:13.020+0000 7fdb56000640 1 -- 172.21.15.52:0/2538084820 wait complete. 2024-09-10T08:34:13.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T08:34:13.212 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:34:02.290953+0000","btime":"2024-09-10T08:34:01.291966+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:34:02.290953+0000","atime":"2024-09-10T08:34:01.291966+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:34:02.290953+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:34:13.212 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:34:01.291966+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:34:01.291966+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:34:02.290953+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T08:34:02.290953+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:34:02.290953+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:34:13.213 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-10T08:34:18.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:18.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.381+0000 7fa361a00640 1 Processor -- start 2024-09-10T08:34:18.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.381+0000 7fa361a00640 1 -- start start 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.382+0000 7fa361a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.382+0000 7fa361a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa35c0cf450 0x7fa35c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.382+0000 7fa361a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35c0d3990 con 0x7fa35c15e440 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.382+0000 7fa361a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa35c0d3c70 con 0x7fa35c0cf450 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.382+0000 7fa361a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c0d3f50 con 0x7fa35c0b6710 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa35c15e440 0x7fa35c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47994/0 (socket says 172.21.15.52:47994) 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35be00640 1 -- 172.21.15.52:0/1851625081 learned_addr learned my addr 172.21.15.52:0/1851625081 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35b400640 1 --2- 172.21.15.52:0/1851625081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa361000640 1 --2- 172.21.15.52:0/1851625081 >> v2:172.21.15.176:3300/0 conn(0x7fa35c0cf450 0x7fa35c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35aa00640 1 -- 172.21.15.52:0/1851625081 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102542422 0 0) 0x7fa35c0d3990 con 0x7fa35c15e440 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35aa00640 1 -- 172.21.15.52:0/1851625081 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa340003520 con 0x7fa35c15e440 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35b400640 1 -- 172.21.15.52:0/1851625081 >> v2:172.21.15.176:3300/0 conn(0x7fa35c0cf450 msgr2=0x7fa35c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35b400640 1 --2- 172.21.15.52:0/1851625081 >> v2:172.21.15.176:3300/0 conn(0x7fa35c0cf450 0x7fa35c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35b400640 1 -- 172.21.15.52:0/1851625081 >> v1:172.21.15.52:6789/0 conn(0x7fa35c15e440 legacy=0x7fa35c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.383+0000 7fa35b400640 1 -- 172.21.15.52:0/1851625081 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c0d4230 con 0x7fa35c0b6710 2024-09-10T08:34:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.384+0000 7fa35b400640 1 --2- 172.21.15.52:0/1851625081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c0d3240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3480097a0 tx=0x7fa34802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f892abf3e86761a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa35aa00640 1 -- 172.21.15.52:0/1851625081 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348037070 con 0x7fa35c0b6710 2024-09-10T08:34:18.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa35aa00640 1 -- 172.21.15.52:0/1851625081 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348032440 con 0x7fa35c0b6710 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa35aa00640 1 -- 172.21.15.52:0/1851625081 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348032810 con 0x7fa35c0b6710 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 -- 172.21.15.52:0/1851625081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 msgr2=0x7fa35c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 --2- 172.21.15.52:0/1851625081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c0d3240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3480097a0 tx=0x7fa34802a210 comp rx=0 tx=0).stop 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 -- 172.21.15.52:0/1851625081 shutdown_connections 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 --2- 172.21.15.52:0/1851625081 >> v2:172.21.15.176:3300/0 conn(0x7fa35c0cf450 0x7fa35c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 --2- 172.21.15.52:0/1851625081 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c0d3240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.385+0000 7fa361a00640 1 -- 172.21.15.52:0/1851625081 >> 172.21.15.52:0/1851625081 conn(0x7fa35c067f80 msgr2=0x7fa35c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.386+0000 7fa361a00640 1 -- 172.21.15.52:0/1851625081 shutdown_connections 2024-09-10T08:34:18.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.386+0000 7fa361a00640 1 -- 172.21.15.52:0/1851625081 wait complete. 2024-09-10T08:34:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.387+0000 7fa361a00640 1 Processor -- start 2024-09-10T08:34:18.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.387+0000 7fa361a00640 1 -- start start 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c15e440 0x7fa35c160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0b76c0 con 0x7fa35c0cf450 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c0b7540 con 0x7fa35c15e440 2024-09-10T08:34:18.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa361a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa35c0b80a0 con 0x7fa35c0b6710 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa35b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa35b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51498/0 (socket says 172.21.15.52:51498) 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.388+0000 7fa35b400640 1 -- 172.21.15.52:0/815566121 learned_addr learned my addr 172.21.15.52:0/815566121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35be00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa361000640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c15e440 0x7fa35c160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 -- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 msgr2=0x7fa35c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 -- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c15e440 msgr2=0x7fa35c160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c15e440 0x7fa35c160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 -- 172.21.15.52:0/815566121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c1f7c90 con 0x7fa35c0cf450 2024-09-10T08:34:18.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.389+0000 7fa35b400640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa348035040 tx=0x7fa3480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:18.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.390+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348041030 con 0x7fa35c0cf450 2024-09-10T08:34:18.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.390+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34803d4e0 con 0x7fa35c0cf450 2024-09-10T08:34:18.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.390+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35c1f7f70 con 0x7fa35c0cf450 2024-09-10T08:34:18.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.390+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa348037040 con 0x7fa35c0cf450 2024-09-10T08:34:18.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.390+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35c1f8530 con 0x7fa35c0cf450 2024-09-10T08:34:18.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.391+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35c0b7b60 con 0x7fa35c0cf450 2024-09-10T08:34:18.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.392+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa348044070 con 0x7fa35c0cf450 2024-09-10T08:34:18.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.393+0000 7fa353e00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 0x7fa33c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:18.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.393+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fa3480ab540 con 0x7fa35c0cf450 2024-09-10T08:34:18.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.393+0000 7fa35be00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 0x7fa33c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:18.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.394+0000 7fa35be00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 0x7fa33c06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005880 tx=0x7fa34c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:18.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.397+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa348079760 con 0x7fa35c0cf450 2024-09-10T08:34:18.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.619+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa35c0b33c0 con 0x7fa35c0cf450 2024-09-10T08:34:18.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.619+0000 7fa353e00640 1 -- 172.21.15.52:0/815566121 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7fa34807da60 con 0x7fa35c0cf450 2024-09-10T08:34:18.620 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:18.620 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:18.620 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 msgr2=0x7fa33c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 0x7fa33c06e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa34c005880 tx=0x7fa34c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 msgr2=0x7fa35c150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa348035040 tx=0x7fa3480046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 shutdown_connections 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa33c06be30 0x7fa33c06e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.621+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa35c15e440 0x7fa35c160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.622+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa35c0cf450 0x7fa35c150320 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.622+0000 7fa361a00640 1 --2- 172.21.15.52:0/815566121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa35c0b6710 0x7fa35c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.622+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 >> 172.21.15.52:0/815566121 conn(0x7fa35c067f80 msgr2=0x7fa35c0ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.622+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 shutdown_connections 2024-09-10T08:34:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:18.622+0000 7fa361a00640 1 -- 172.21.15.52:0/815566121 wait complete. 2024-09-10T08:34:18.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-10T08:34:18.813 INFO:teuthology.orchestra.run.smithi052.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-10T08:34:02.290953+0000","btime":"2024-09-10T08:34:01.291966+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-10T08:34:02.290953+0000","atime":"2024-09-10T08:34:01.291966+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-10T08:34:02.290953+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-10T08:34:02.291953+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-10T08:34:12.608358+0000","last_scrub_version":128,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-10T08:34:18.814 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-10T08:34:01.291966+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-10T08:34:01.291966+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-10T08:34:02.290953+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-10T08:34:02.290953+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-10T08:34:12.608358+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-10T08:34:02.290953+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-10T08:34:02.291953+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-10T08:34:18.814 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-10T08:34:18.814 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:34:18.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:34:18.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:34:19.016 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:34:19.016 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:34:19.016 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:19.017 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:19.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:34:19.053 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:34:19.053 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:34:19.053 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:19.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:34:19.091 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:34:19.092 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:19.092 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:19.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:34:19.128 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:34:19.128 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:34:19.128 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:19.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:34:19.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:19.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.324+0000 7f1c7f200640 1 Processor -- start 2024-09-10T08:34:19.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.324+0000 7f1c7f200640 1 -- start start 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c780b6710 0x7f1c780d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1c780cf450 0x7f1c780b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780d3990 con 0x7f1c7815e440 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1c780d3c70 con 0x7f1c780b6710 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1c780d3f50 con 0x7f1c780cf450 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1c780b6710 0x7f1c780d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1c7815e440 0x7f1c780b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47998/0 (socket says 172.21.15.52:47998) 2024-09-10T08:34:19.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.325+0000 7f1c7de00640 1 -- 172.21.15.52:0/907407422 learned_addr learned my addr 172.21.15.52:0/907407422 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7e800640 1 --2- 172.21.15.52:0/907407422 >> v2:172.21.15.176:3300/0 conn(0x7f1c780cf450 0x7f1c780b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7d400640 1 -- 172.21.15.52:0/907407422 >> v2:172.21.15.176:3300/0 conn(0x7f1c780cf450 msgr2=0x7f1c780b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7d400640 1 --2- 172.21.15.52:0/907407422 >> v2:172.21.15.176:3300/0 conn(0x7f1c780cf450 0x7f1c780b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7d400640 1 -- 172.21.15.52:0/907407422 >> v1:172.21.15.52:6789/0 conn(0x7f1c7815e440 legacy=0x7f1c780b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7d400640 1 -- 172.21.15.52:0/907407422 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780d4230 con 0x7f1c780b6710 2024-09-10T08:34:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.326+0000 7f1c7ca00640 1 -- 172.21.15.52:0/907407422 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54251447 0 0) 0x7f1c780d3990 con 0x7f1c7815e440 2024-09-10T08:34:19.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.327+0000 7f1c7d400640 1 --2- 172.21.15.52:0/907407422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c780b6710 0x7f1c780d3240 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1c780d4510 tx=0x7f1c6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc05ce43123d9c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.327+0000 7f1c7ca00640 1 -- 172.21.15.52:0/907407422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68037070 con 0x7f1c780b6710 2024-09-10T08:34:19.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.327+0000 7f1c7ca00640 1 -- 172.21.15.52:0/907407422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c68032440 con 0x7f1c780b6710 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.327+0000 7f1c7ca00640 1 -- 172.21.15.52:0/907407422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68032810 con 0x7f1c780b6710 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 -- 172.21.15.52:0/907407422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c780b6710 msgr2=0x7f1c780d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 --2- 172.21.15.52:0/907407422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c780b6710 0x7f1c780d3240 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1c780d4510 tx=0x7f1c6802a230 comp rx=0 tx=0).stop 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 -- 172.21.15.52:0/907407422 shutdown_connections 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 --2- 172.21.15.52:0/907407422 >> v2:172.21.15.176:3300/0 conn(0x7f1c780cf450 0x7f1c780b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 --2- 172.21.15.52:0/907407422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c780b6710 0x7f1c780d3240 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 -- 172.21.15.52:0/907407422 >> 172.21.15.52:0/907407422 conn(0x7f1c78067f80 msgr2=0x7f1c780d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 -- 172.21.15.52:0/907407422 shutdown_connections 2024-09-10T08:34:19.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.328+0000 7f1c7f200640 1 -- 172.21.15.52:0/907407422 wait complete. 2024-09-10T08:34:19.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.330+0000 7f1c7f200640 1 Processor -- start 2024-09-10T08:34:19.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.330+0000 7f1c7f200640 1 -- start start 2024-09-10T08:34:19.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.330+0000 7f1c7f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c780b6710 0x7f1c781f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780cf450 0x7f1c78156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780b76c0 con 0x7f1c7815e440 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780b7540 con 0x7f1c780b6710 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1c780b80a0 con 0x7f1c780cf450 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51522/0 (socket says 172.21.15.52:51522) 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 -- 172.21.15.52:0/1469840616 learned_addr learned my addr 172.21.15.52:0/1469840616 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7de00640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c780b6710 0x7f1c781f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7d400640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780cf450 0x7f1c78156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 -- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780cf450 msgr2=0x7f1c78156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780cf450 0x7f1c78156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 -- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c780b6710 msgr2=0x7f1c781f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c780b6710 0x7f1c781f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.331+0000 7f1c7e800640 1 -- 172.21.15.52:0/1469840616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78152940 con 0x7f1c7815e440 2024-09-10T08:34:19.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c7e800640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1c74007e70 tx=0x7f1c7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c74014420 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c74019070 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c74014820 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c78152c20 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.332+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781531e0 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.333+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c780b7b60 con 0x7f1c7815e440 2024-09-10T08:34:19.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.334+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c740149c0 con 0x7f1c7815e440 2024-09-10T08:34:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.335+0000 7f1c72000640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 0x7f1c5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.335+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f1c7408b790 con 0x7f1c7815e440 2024-09-10T08:34:19.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.335+0000 7f1c7de00640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 0x7f1c5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.336+0000 7f1c7de00640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 0x7f1c5c06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c007fd0 tx=0x7f1c6c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.339+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c74059910 con 0x7f1c7815e440 2024-09-10T08:34:19.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.561+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c781f3c20 con 0x7f1c7815e440 2024-09-10T08:34:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.561+0000 7f1c72000640 1 -- 172.21.15.52:0/1469840616 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7f1c7405dc10 con 0x7f1c7815e440 2024-09-10T08:34:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:19.562 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:19.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 msgr2=0x7f1c5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 0x7f1c5c06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c007fd0 tx=0x7f1c6c007de0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 msgr2=0x7f1c78153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1c74007e70 tx=0x7f1c7400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 shutdown_connections 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c5c06be30 0x7f1c5c06e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c7815e440 0x7f1c78153dd0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780cf450 0x7f1c78156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 --2- 172.21.15.52:0/1469840616 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c780b6710 0x7f1c781f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 >> 172.21.15.52:0/1469840616 conn(0x7f1c78067f80 msgr2=0x7f1c7815a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 shutdown_connections 2024-09-10T08:34:19.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.564+0000 7f1c7f200640 1 -- 172.21.15.52:0/1469840616 wait complete. 2024-09-10T08:34:19.581 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:19.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.737+0000 7ff644600640 1 Processor -- start 2024-09-10T08:34:19.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.737+0000 7ff644600640 1 -- start start 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff63c13eb20 0x7ff63c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff63c15bcf0 0x7ff63c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff63c071ab0 con 0x7ff63c13eb20 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff63c071180 con 0x7ff63c15bcf0 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff644600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff63c071460 con 0x7ff63c0b2d40 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff63c13eb20 0x7ff63c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff63c13eb20 0x7ff63c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51538/0 (socket says 172.21.15.52:51538) 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 -- 172.21.15.52:0/408914886 learned_addr learned my addr 172.21.15.52:0/408914886 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff642600640 1 --2- 172.21.15.52:0/408914886 >> v2:172.21.15.176:3300/0 conn(0x7ff63c15bcf0 0x7ff63c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641c00640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 -- 172.21.15.52:0/408914886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 msgr2=0x7ff63c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 -- 172.21.15.52:0/408914886 >> v2:172.21.15.176:3300/0 conn(0x7ff63c15bcf0 msgr2=0x7ff63c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 --2- 172.21.15.52:0/408914886 >> v2:172.21.15.176:3300/0 conn(0x7ff63c15bcf0 0x7ff63c15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.739+0000 7ff641200640 1 -- 172.21.15.52:0/408914886 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c071740 con 0x7ff63c13eb20 2024-09-10T08:34:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.740+0000 7ff641200640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c13eb20 0x7ff63c06c150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff63c1595c0 tx=0x7ff62802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ed810613ae09fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff63be00640 1 -- 172.21.15.52:0/408914886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628037070 con 0x7ff63c13eb20 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff63be00640 1 -- 172.21.15.52:0/408914886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff628032440 con 0x7ff63c13eb20 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff63be00640 1 -- 172.21.15.52:0/408914886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628032810 con 0x7ff63c13eb20 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 -- 172.21.15.52:0/408914886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c13eb20 msgr2=0x7ff63c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c13eb20 0x7ff63c06c150 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff63c1595c0 tx=0x7ff62802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 -- 172.21.15.52:0/408914886 shutdown_connections 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 --2- 172.21.15.52:0/408914886 >> v2:172.21.15.176:3300/0 conn(0x7ff63c15bcf0 0x7ff63c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c13eb20 0x7ff63c06c150 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 --2- 172.21.15.52:0/408914886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 -- 172.21.15.52:0/408914886 >> 172.21.15.52:0/408914886 conn(0x7ff63c0ccec0 msgr2=0x7ff63c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 -- 172.21.15.52:0/408914886 shutdown_connections 2024-09-10T08:34:19.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.741+0000 7ff644600640 1 -- 172.21.15.52:0/408914886 wait complete. 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.743+0000 7ff644600640 1 Processor -- start 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.743+0000 7ff644600640 1 -- start start 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff63c13eb20 0x7ff63c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c15f140 con 0x7ff63c15bcf0 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c15efc0 con 0x7ff63c13eb20 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff644600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff63c15f2c0 con 0x7ff63c0b2d40 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff642600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff642600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51542/0 (socket says 172.21.15.52:51542) 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff642600640 1 -- 172.21.15.52:0/4122222250 learned_addr learned my addr 172.21.15.52:0/4122222250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff641200640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff63c13eb20 0x7ff63c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.744+0000 7ff641c00640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 -- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 msgr2=0x7ff63c0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c0c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 -- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff63c13eb20 msgr2=0x7ff63c0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff63c13eb20 0x7ff63c0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 -- 172.21.15.52:0/4122222250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c156f90 con 0x7ff63c15bcf0 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff641c00640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c0c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff642600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff634007e90 tx=0x7ff63400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634014420 con 0x7ff63c15bcf0 2024-09-10T08:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff634019070 con 0x7ff63c15bcf0 2024-09-10T08:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c0b6270 con 0x7ff63c15bcf0 2024-09-10T08:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.745+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634014800 con 0x7ff63c15bcf0 2024-09-10T08:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.746+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c1574f0 con 0x7ff63c15bcf0 2024-09-10T08:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.747+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c15c1a0 con 0x7ff63c15bcf0 2024-09-10T08:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.747+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6340149a0 con 0x7ff63c15bcf0 2024-09-10T08:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.748+0000 7ff639600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 0x7ff61c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.748+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7ff63408b6a0 con 0x7ff63c15bcf0 2024-09-10T08:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.749+0000 7ff641c00640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 0x7ff61c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.750+0000 7ff641c00640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 0x7ff61c06e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff630006fd0 tx=0x7ff630008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.753+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff63c156f90 con 0x7ff63c15bcf0 2024-09-10T08:34:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.972+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff63c15eca0 con 0x7ff63c15bcf0 2024-09-10T08:34:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.972+0000 7ff639600640 1 -- 172.21.15.52:0/4122222250 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7ff634059f90 con 0x7ff63c15bcf0 2024-09-10T08:34:19.973 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:19.973 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 msgr2=0x7ff61c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 0x7ff61c06e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff630006fd0 tx=0x7ff630008040 comp rx=0 tx=0).stop 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 msgr2=0x7ff63c157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff634007e90 tx=0x7ff63400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 shutdown_connections 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff61c06be30 0x7ff61c06e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.974+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff63c15bcf0 0x7ff63c157cf0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.975+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff63c13eb20 0x7ff63c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.975+0000 7ff644600640 1 --2- 172.21.15.52:0/4122222250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff63c0b2d40 0x7ff63c0c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.975+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 >> 172.21.15.52:0/4122222250 conn(0x7ff63c0ccec0 msgr2=0x7ff63c15b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.975+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 shutdown_connections 2024-09-10T08:34:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:19.975+0000 7ff644600640 1 -- 172.21.15.52:0/4122222250 wait complete. 2024-09-10T08:34:19.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:20.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.148+0000 7fd372a00640 1 Processor -- start 2024-09-10T08:34:20.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.148+0000 7fd372a00640 1 -- start start 2024-09-10T08:34:20.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd372a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 0x7fd36c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd372a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36c0b4020 con 0x7fd36c145ed0 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd372a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36c0b42c0 con 0x7fd36c073890 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd372a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c0b45a0 con 0x7fd36c0b5080 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd36be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd36c145ed0 0x7fd36c073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48012/0 (socket says 172.21.15.52:48012) 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd36be00640 1 -- 172.21.15.52:0/3229835938 learned_addr learned my addr 172.21.15.52:0/3229835938 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.149+0000 7fd370a00640 1 --2- 172.21.15.52:0/3229835938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 0x7fd36c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619444042 0 0) 0x7fd36c0b4020 con 0x7fd36c145ed0 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd350003520 con 0x7fd36c145ed0 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538944530 0 0) 0x7fd36c0b42c0 con 0x7fd36c073890 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36c0b4020 con 0x7fd36c073890 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd370a00640 1 -- 172.21.15.52:0/3229835938 >> v1:172.21.15.176:6789/0 conn(0x7fd36c073890 legacy=0x7fd36c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd370a00640 1 -- 172.21.15.52:0/3229835938 >> v1:172.21.15.52:6789/0 conn(0x7fd36c145ed0 legacy=0x7fd36c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.150+0000 7fd370a00640 1 -- 172.21.15.52:0/3229835938 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c0b4880 con 0x7fd36c0b5080 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.151+0000 7fd370a00640 1 --2- 172.21.15.52:0/3229835938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 0x7fd36c0b5f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd364009dc0 tx=0x7fd36402a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31e33c093368ac12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364007740 con 0x7fd36c0b5080 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3640078e0 con 0x7fd36c0b5080 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd36b400640 1 -- 172.21.15.52:0/3229835938 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd364007c90 con 0x7fd36c0b5080 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 -- 172.21.15.52:0/3229835938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 msgr2=0x7fd36c0b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 --2- 172.21.15.52:0/3229835938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 0x7fd36c0b5f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd364009dc0 tx=0x7fd36402a760 comp rx=0 tx=0).stop 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 -- 172.21.15.52:0/3229835938 shutdown_connections 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 --2- 172.21.15.52:0/3229835938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c0b5080 0x7fd36c0b5f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 -- 172.21.15.52:0/3229835938 >> 172.21.15.52:0/3229835938 conn(0x7fd36c0ccec0 msgr2=0x7fd36c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 -- 172.21.15.52:0/3229835938 shutdown_connections 2024-09-10T08:34:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.152+0000 7fd372a00640 1 -- 172.21.15.52:0/3229835938 wait complete. 2024-09-10T08:34:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.154+0000 7fd372a00640 1 Processor -- start 2024-09-10T08:34:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.154+0000 7fd372a00640 1 -- start start 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c073890 0x7fd36c0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd36c145ed0 0x7fd36c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c146430 con 0x7fd36c0b5080 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c1462b0 con 0x7fd36c145ed0 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd372a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c15cdc0 con 0x7fd36c073890 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd363e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd363e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51556/0 (socket says 172.21.15.52:51556) 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.155+0000 7fd363e00640 1 -- 172.21.15.52:0/2272846704 learned_addr learned my addr 172.21.15.52:0/2272846704 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd36be00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c073890 0x7fd36c0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd370a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd36c145ed0 0x7fd36c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 -- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c073890 msgr2=0x7fd36c0aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c073890 0x7fd36c0aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 -- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd36c145ed0 msgr2=0x7fd36c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd36c145ed0 0x7fd36c0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 -- 172.21.15.52:0/2272846704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c13e5f0 con 0x7fd36c0b5080 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd363e00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c500 tx=0x7fd35400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3540052d0 con 0x7fd36c0b5080 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd354005490 con 0x7fd36c0b5080 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c13e8d0 con 0x7fd36c0b5080 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.156+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354012870 con 0x7fd36c0b5080 2024-09-10T08:34:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.157+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c13ee90 con 0x7fd36c0b5080 2024-09-10T08:34:20.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.158+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36c1436e0 con 0x7fd36c0b5080 2024-09-10T08:34:20.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.158+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd354012a10 con 0x7fd36c0b5080 2024-09-10T08:34:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.159+0000 7fd368c00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 0x7fd34806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.159+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fd35408ac30 con 0x7fd36c0b5080 2024-09-10T08:34:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.160+0000 7fd36be00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 0x7fd34806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.160+0000 7fd36be00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 0x7fd34806e320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005880 tx=0x7fd35c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.163+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd354058e50 con 0x7fd36c0b5080 2024-09-10T08:34:20.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.350+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd36c13f0d0 con 0x7fd36c0b5080 2024-09-10T08:34:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.352+0000 7fd368c00640 1 -- 172.21.15.52:0/2272846704 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+17005 (secure 0 0 0) 0x7fd35405d150 con 0x7fd36c0b5080 2024-09-10T08:34:20.352 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:20.353 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":97,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:05.808293+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:50.900580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:52.094246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.52:6833/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.176:6836/2093809753":"2024-09-11T08:34:04.811999+0000","172.21.15.176:6834/2093809753":"2024-09-11T08:34:04.811999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 msgr2=0x7fd34806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 0x7fd34806e320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd35c005880 tx=0x7fd35c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 msgr2=0x7fd36c15c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c500 tx=0x7fd35400c9c0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 shutdown_connections 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd34806be60 0x7fd34806e320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd36c145ed0 0x7fd36c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd36c0b5080 0x7fd36c15c380 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 --2- 172.21.15.52:0/2272846704 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd36c073890 0x7fd36c0aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 >> 172.21.15.52:0/2272846704 conn(0x7fd36c0ccec0 msgr2=0x7fd36c1444d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:20.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.354+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 shutdown_connections 2024-09-10T08:34:20.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.355+0000 7fd372a00640 1 -- 172.21.15.52:0/2272846704 wait complete. 2024-09-10T08:34:20.372 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:34:20.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.527+0000 7fad22600640 1 Processor -- start 2024-09-10T08:34:20.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.527+0000 7fad22600640 1 -- start start 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.528+0000 7fad22600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad1c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.528+0000 7fad22600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0b4020 con 0x7fad1c073890 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.528+0000 7fad22600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0b42c0 con 0x7fad1c145ed0 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.528+0000 7fad22600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0b45a0 con 0x7fad1c0b5080 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fad1c073890 0x7fad1c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48020/0 (socket says 172.21.15.52:48020) 2024-09-10T08:34:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1aa00640 1 -- 172.21.15.52:0/3732241220 learned_addr learned my addr 172.21.15.52:0/3732241220 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1be00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad1c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239353438 0 0) 0x7fad1c0b4020 con 0x7fad1c073890 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad00003520 con 0x7fad1c073890 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123475625 0 0) 0x7fad00003520 con 0x7fad1c073890 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 msgr2=0x7fad1c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad1c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 >> v1:172.21.15.176:6789/0 conn(0x7fad1c145ed0 legacy=0x7fad1c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.529+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b4880 con 0x7fad1c073890 2024-09-10T08:34:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fad08001690 con 0x7fad1c073890 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 >> v1:172.21.15.52:6789/0 conn(0x7fad1c073890 legacy=0x7fad1c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad000039e0 0x7fad00003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0b45a0 con 0x7fad00004d40 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad0000b9c0 con 0x7fad000039e0 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad0000bbc0 con 0x7fad1c0b5080 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1aa00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1b400640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad000039e0 0x7fad00003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 -- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 msgr2=0x7fad00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c0b5080 0x7fad00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 -- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad000039e0 msgr2=0x7fad00003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:20.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad000039e0 0x7fad00003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.530+0000 7fad1be00640 1 -- 172.21.15.52:0/3732241220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad00003520 con 0x7fad00004d40 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.531+0000 7fad1be00640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad000051c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fc0 tx=0x7fad00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999e393b5f0866d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14009c10 con 0x7fad00004d40 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad14036070 con 0x7fad00004d40 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad1a000640 1 -- 172.21.15.52:0/3732241220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14031880 con 0x7fad00004d40 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 -- 172.21.15.52:0/3732241220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 msgr2=0x7fad000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 --2- 172.21.15.52:0/3732241220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad000051c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fc0 tx=0x7fad00005830 comp rx=0 tx=0).stop 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad1be00640 1 -- 172.21.15.52:0/3732241220 reap_dead start 2024-09-10T08:34:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 -- 172.21.15.52:0/3732241220 shutdown_connections 2024-09-10T08:34:20.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 -- 172.21.15.52:0/3732241220 >> 172.21.15.52:0/3732241220 conn(0x7fad1c0ccec0 msgr2=0x7fad1c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:20.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 -- 172.21.15.52:0/3732241220 shutdown_connections 2024-09-10T08:34:20.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.532+0000 7fad22600640 1 -- 172.21.15.52:0/3732241220 wait complete. 2024-09-10T08:34:20.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.534+0000 7fad22600640 1 Processor -- start 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.534+0000 7fad22600640 1 -- start start 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c1440d0 0x7fad1c144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad1c1efd00 0x7fad1c1f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c146430 con 0x7fad00004d40 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1462b0 con 0x7fad1c1efd00 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad22600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0b5f90 con 0x7fad1c1440d0 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad1b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad1b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51588/0 (socket says 172.21.15.52:51588) 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad1b400640 1 -- 172.21.15.52:0/3300515694 learned_addr learned my addr 172.21.15.52:0/3300515694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad1aa00640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c1440d0 0x7fad1c144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.535+0000 7fad1be00640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad1c1efd00 0x7fad1c1f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 -- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c1440d0 msgr2=0x7fad1c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c1440d0 0x7fad1c144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 -- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad1c1efd00 msgr2=0x7fad1c1f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad1c1efd00 0x7fad1c1f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 -- 172.21.15.52:0/3300515694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c1f0a80 con 0x7fad00004d40 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad1b400640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00f7c0 tx=0x7fad0c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0052e0 con 0x7fad00004d40 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c018070 con 0x7fad00004d40 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00d970 con 0x7fad00004d40 2024-09-10T08:34:20.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c154400 con 0x7fad00004d40 2024-09-10T08:34:20.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.536+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c1549c0 con 0x7fad00004d40 2024-09-10T08:34:20.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.537+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c154bc0 con 0x7fad00004d40 2024-09-10T08:34:20.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.538+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad0c00db10 con 0x7fad00004d40 2024-09-10T08:34:20.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.539+0000 7fad13400640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 0x7facfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.539+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fad0c08ae60 con 0x7fad00004d40 2024-09-10T08:34:20.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.540+0000 7fad1aa00640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 0x7facfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.540+0000 7fad1aa00640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 0x7facfc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad08001050 tx=0x7fad08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.543+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad1c154bc0 con 0x7fad00004d40 2024-09-10T08:34:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.765+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad1c0b6290 con 0x7fad00004d40 2024-09-10T08:34:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.766+0000 7fad13400640 1 -- 172.21.15.52:0/3300515694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7fad0c01a310 con 0x7fad00004d40 2024-09-10T08:34:20.766 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:20.767 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 msgr2=0x7facfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 0x7facfc06e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad08001050 tx=0x7fad08009040 comp rx=0 tx=0).stop 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 msgr2=0x7fad1c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00f7c0 tx=0x7fad0c00fc80 comp rx=0 tx=0).stop 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 shutdown_connections 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7facfc06be30 0x7facfc06e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad1c1efd00 0x7fad1c1f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fad1c1440d0 0x7fad1c144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 --2- 172.21.15.52:0/3300515694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad00004d40 0x7fad1c156d30 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.768+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 >> 172.21.15.52:0/3300515694 conn(0x7fad1c0ccec0 msgr2=0x7fad1c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.769+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 shutdown_connections 2024-09-10T08:34:20.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.769+0000 7fad22600640 1 -- 172.21.15.52:0/3300515694 wait complete. 2024-09-10T08:34:20.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.941+0000 7fbb25e00640 1 Processor -- start 2024-09-10T08:34:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.941+0000 7fbb25e00640 1 -- start start 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.942+0000 7fbb25e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbb200b2d40 0x7fbb2006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.942+0000 7fbb25e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb20071180 con 0x7fbb2006c150 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb25e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb20071460 con 0x7fbb2013eb20 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb25e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbb20071ab0 con 0x7fbb200b2d40 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbb200b2d40 0x7fbb2006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbb200b2d40 0x7fbb2006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51594/0 (socket says 172.21.15.52:51594) 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 -- 172.21.15.52:0/1808685983 learned_addr learned my addr 172.21.15.52:0/1808685983 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbb2006c150 0x7fbb20071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48034/0 (socket says 172.21.15.52:48034) 2024-09-10T08:34:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 -- 172.21.15.52:0/1808685983 >> v1:172.21.15.176:6789/0 conn(0x7fbb2013eb20 legacy=0x7fbb2015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 -- 172.21.15.52:0/1808685983 >> v1:172.21.15.52:6789/0 conn(0x7fbb2006c150 legacy=0x7fbb20071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.943+0000 7fbb1ea00640 1 -- 172.21.15.52:0/1808685983 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb20071740 con 0x7fbb200b2d40 2024-09-10T08:34:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.944+0000 7fbb1ea00640 1 --2- 172.21.15.52:0/1808685983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2006bc10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238b455e0ac1ceee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.944+0000 7fbb1e000640 1 -- 172.21.15.52:0/1808685983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10037070 con 0x7fbb200b2d40 2024-09-10T08:34:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.944+0000 7fbb1e000640 1 -- 172.21.15.52:0/1808685983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb10032440 con 0x7fbb200b2d40 2024-09-10T08:34:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.944+0000 7fbb1e000640 1 -- 172.21.15.52:0/1808685983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10032810 con 0x7fbb200b2d40 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 -- 172.21.15.52:0/1808685983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 msgr2=0x7fbb2006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 --2- 172.21.15.52:0/1808685983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2006bc10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1002a2a0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 -- 172.21.15.52:0/1808685983 shutdown_connections 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 --2- 172.21.15.52:0/1808685983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2006bc10 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 -- 172.21.15.52:0/1808685983 >> 172.21.15.52:0/1808685983 conn(0x7fbb200ccec0 msgr2=0x7fbb200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 -- 172.21.15.52:0/1808685983 shutdown_connections 2024-09-10T08:34:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.945+0000 7fbb25e00640 1 -- 172.21.15.52:0/1808685983 wait complete. 2024-09-10T08:34:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.947+0000 7fbb25e00640 1 Processor -- start 2024-09-10T08:34:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.947+0000 7fbb25e00640 1 -- start start 2024-09-10T08:34:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2006c150 0x7fbb20158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb2013eb20 0x7fbb2013c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2015c7d0 con 0x7fbb200b2d40 2024-09-10T08:34:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2015c650 con 0x7fbb2013eb20 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb25e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb20072650 con 0x7fbb2006c150 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb1ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2006c150 0x7fbb20158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51606/0 (socket says 172.21.15.52:51606) 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 -- 172.21.15.52:0/2531346501 learned_addr learned my addr 172.21.15.52:0/2531346501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb1f400640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb2013eb20 0x7fbb2013c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 -- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2006c150 msgr2=0x7fbb20158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2006c150 0x7fbb20158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 -- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb2013eb20 msgr2=0x7fbb2013c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb2013eb20 0x7fbb2013c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.948+0000 7fbb16000640 1 -- 172.21.15.52:0/2531346501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2015fc10 con 0x7fbb200b2d40 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb16000640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b3c0 tx=0x7fbb0800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08011830 con 0x7fbb200b2d40 2024-09-10T08:34:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb08016070 con 0x7fbb200b2d40 2024-09-10T08:34:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08011c50 con 0x7fbb200b2d40 2024-09-10T08:34:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb20156230 con 0x7fbb200b2d40 2024-09-10T08:34:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.949+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb201567f0 con 0x7fbb200b2d40 2024-09-10T08:34:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.950+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb201569f0 con 0x7fbb200b2d40 2024-09-10T08:34:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.951+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb0801b460 con 0x7fbb200b2d40 2024-09-10T08:34:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.952+0000 7fbb17e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.952+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fbb0808a8d0 con 0x7fbb200b2d40 2024-09-10T08:34:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.952+0000 7fbb1ea00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:20.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.953+0000 7fbb1ea00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 0x7fbafc06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb10034000 tx=0x7fbb1002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:20.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:20.956+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb201569f0 con 0x7fbb200b2d40 2024-09-10T08:34:21.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.175+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb2006bc10 con 0x7fbb200b2d40 2024-09-10T08:34:21.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.176+0000 7fbb17e00640 1 -- 172.21.15.52:0/2531346501 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5229 (secure 0 0 0) 0x7fbb08020020 con 0x7fbb200b2d40 2024-09-10T08:34:21.176 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:21.177 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":75,"btime":"2024-09-10T08:34:08:832409+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:33:53.097952+0000","modified":"2024-09-10T08:34:08.832399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6833/3825724165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3825724165},{"type":"v1","addr":"172.21.15.52:6833","nonce":3825724165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7251,"qdb_cluster":[7251]},"id":6}]} 2024-09-10T08:34:21.177 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 75 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 msgr2=0x7fbafc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 0x7fbafc06e2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb10034000 tx=0x7fbb1002e000 comp rx=0 tx=0).stop 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 msgr2=0x7fbb2013bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b3c0 tx=0x7fbb0800b880 comp rx=0 tx=0).stop 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 shutdown_connections 2024-09-10T08:34:21.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbafc06be30 0x7fbafc06e2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb2013eb20 0x7fbb2013c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb200b2d40 0x7fbb2013bbf0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 --2- 172.21.15.52:0/2531346501 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb2006c150 0x7fbb20158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.178+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 >> 172.21.15.52:0/2531346501 conn(0x7fbb200ccec0 msgr2=0x7fbb201413c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.179+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 shutdown_connections 2024-09-10T08:34:21.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.179+0000 7fbb25e00640 1 -- 172.21.15.52:0/2531346501 wait complete. 2024-09-10T08:34:21.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.350+0000 7fc8b1400640 1 Processor -- start 2024-09-10T08:34:21.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.350+0000 7fc8b1400640 1 -- start start 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8ac160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8b1400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8ac071b60 con 0x7fc8ac15c420 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8b1400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8ac0b1e20 con 0x7fc8ac0b1990 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ac0d04c0 con 0x7fc8ac0d2c30 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8aa800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc8ac15c420 0x7fc8ac0d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48048/0 (socket says 172.21.15.52:48048) 2024-09-10T08:34:21.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.351+0000 7fc8aa800640 1 -- 172.21.15.52:0/2125451438 learned_addr learned my addr 172.21.15.52:0/2125451438 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8ac160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827745796 0 0) 0x7fc8ac071b60 con 0x7fc8ac15c420 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc890003520 con 0x7fc8ac15c420 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1525101591 0 0) 0x7fc890003520 con 0x7fc8ac15c420 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 msgr2=0x7fc8ac160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8ac160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 >> v1:172.21.15.176:6789/0 conn(0x7fc8ac0b1990 legacy=0x7fc8ac0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac0715a0 con 0x7fc8ac15c420 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc89c001670 con 0x7fc8ac15c420 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 >> v1:172.21.15.52:6789/0 conn(0x7fc8ac15c420 legacy=0x7fc8ac0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc890004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc890004d40 0x7fc8900051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac0d04c0 con 0x7fc890003fb0 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc89000bc50 con 0x7fc890004d40 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.352+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc89000be50 con 0x7fc8ac0d2c30 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc890004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8aa800640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8ab200640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc890004d40 0x7fc8900051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 -- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 msgr2=0x7fc8900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0d2c30 0x7fc8900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 -- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc890004d40 msgr2=0x7fc8900051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc890004d40 0x7fc8900051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.353+0000 7fc8a9e00640 1 -- 172.21.15.52:0/2125451438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890003520 con 0x7fc890003fb0 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.354+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc890004800 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac074290 tx=0x7fc890005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf99ac07a576f61a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.354+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898036070 con 0x7fc890003fb0 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.354+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898031400 con 0x7fc890003fb0 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.354+0000 7fc8a9400640 1 -- 172.21.15.52:0/2125451438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898009690 con 0x7fc890003fb0 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 -- 172.21.15.52:0/2125451438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 msgr2=0x7fc890004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2125451438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc890004800 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac074290 tx=0x7fc890005830 comp rx=0 tx=0).stop 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8ab200640 1 -- 172.21.15.52:0/2125451438 reap_dead start 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 -- 172.21.15.52:0/2125451438 shutdown_connections 2024-09-10T08:34:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 -- 172.21.15.52:0/2125451438 >> 172.21.15.52:0/2125451438 conn(0x7fc8ac067fb0 msgr2=0x7fc8ac06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 -- 172.21.15.52:0/2125451438 shutdown_connections 2024-09-10T08:34:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.355+0000 7fc8b1400640 1 -- 172.21.15.52:0/2125451438 wait complete. 2024-09-10T08:34:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.357+0000 7fc8b1400640 1 Processor -- start 2024-09-10T08:34:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.357+0000 7fc8b1400640 1 -- start start 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 0x7fc8ac150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 0x7fc8ac150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac160a40 con 0x7fc890003fb0 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ac15c800 con 0x7fc8ac0cc470 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ac160bc0 con 0x7fc8ac0cb940 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51628/0 (socket says 172.21.15.52:51628) 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8aa800640 1 -- 172.21.15.52:0/2809398563 learned_addr learned my addr 172.21.15.52:0/2809398563 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 0x7fc8ac150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.358+0000 7fc8ab200640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 0x7fc8ac150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 -- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 msgr2=0x7fc8ac150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 0x7fc8ac150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 -- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 msgr2=0x7fc8ac150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 0x7fc8ac150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 -- 172.21.15.52:0/2809398563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac0cc9e0 con 0x7fc890003fb0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 0x7fc8ac150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8ab200640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 0x7fc8ac150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8aa800640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007290 tx=0x7fc89c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00f960 con 0x7fc890003fb0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c018070 con 0x7fc890003fb0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00fd80 con 0x7fc890003fb0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8ac0cccc0 con 0x7fc890003fb0 2024-09-10T08:34:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.359+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8ac06d520 con 0x7fc890003fb0 2024-09-10T08:34:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.360+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8ac06d720 con 0x7fc890003fb0 2024-09-10T08:34:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.361+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc89c01d460 con 0x7fc890003fb0 2024-09-10T08:34:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.362+0000 7fc8a2a00640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 0x7fc88c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.362+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7fc89c08af30 con 0x7fc890003fb0 2024-09-10T08:34:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.363+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 0x7fc88c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.364+0000 7fc8a9e00640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 0x7fc88c06e320 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc898033000 tx=0x7fc898008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.367+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8ac06d720 con 0x7fc890003fb0 2024-09-10T08:34:21.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.552+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8ac0b3680 con 0x7fc890003fb0 2024-09-10T08:34:21.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.553+0000 7fc8a2a00640 1 -- 172.21.15.52:0/2809398563 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+17005 (secure 0 0 0) 0x7fc89c0597a0 con 0x7fc890003fb0 2024-09-10T08:34:21.554 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:21.554 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":97,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:05.808293+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:33:50.900580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-10T08:33:52.094246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.52:6833/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.176:6836/2093809753":"2024-09-11T08:34:04.811999+0000","172.21.15.176:6834/2093809753":"2024-09-11T08:34:04.811999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:21.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.555+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 msgr2=0x7fc88c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.555+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 0x7fc88c06e320 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc898033000 tx=0x7fc898008030 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.555+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 msgr2=0x7fc8ac14d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.555+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc89c007290 tx=0x7fc89c007690 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 shutdown_connections 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc88c06be60 0x7fc88c06e320 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc8ac0cb940 0x7fc8ac150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8ac0cc470 0x7fc8ac150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 --2- 172.21.15.52:0/2809398563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc890003fb0 0x7fc8ac14d230 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 >> 172.21.15.52:0/2809398563 conn(0x7fc8ac067fb0 msgr2=0x7fc8ac1570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:21.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 shutdown_connections 2024-09-10T08:34:21.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.556+0000 7fc8b1400640 1 -- 172.21.15.52:0/2809398563 wait complete. 2024-09-10T08:34:21.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:34:21.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.731+0000 7f3e97c00640 1 Processor -- start 2024-09-10T08:34:21.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.731+0000 7f3e97c00640 1 -- start start 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.732+0000 7f3e97c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e900b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.732+0000 7f3e97c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900b4020 con 0x7f3e90145ed0 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.732+0000 7f3e97c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e900b42c0 con 0x7f3e90073890 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.732+0000 7f3e97c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900b45a0 con 0x7f3e900b5080 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e95200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e90145ed0 0x7f3e90073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48060/0 (socket says 172.21.15.52:48060) 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e95200640 1 -- 172.21.15.52:0/2208110121 learned_addr learned my addr 172.21.15.52:0/2208110121 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e95c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e900b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815601536 0 0) 0x7f3e900b4020 con 0x7f3e90145ed0 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e78003520 con 0x7f3e90145ed0 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87014046 0 0) 0x7f3e900b42c0 con 0x7f3e90073890 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e900b4020 con 0x7f3e90073890 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 271081324 0 0) 0x7f3e78003520 con 0x7f3e90145ed0 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 msgr2=0x7f3e900b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e900b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 >> v1:172.21.15.176:6789/0 conn(0x7f3e90073890 legacy=0x7f3e900b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900b4880 con 0x7f3e90145ed0 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.733+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3e84001690 con 0x7f3e90145ed0 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 >> v1:172.21.15.52:6789/0 conn(0x7f3e90145ed0 legacy=0x7f3e90073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e78003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78004120 0x7f3e78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900b45a0 con 0x7f3e78004d40 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7800bb00 con 0x7f3e78004120 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7800bd00 con 0x7f3e900b5080 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95200640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e78003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e8fe00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78004120 0x7f3e78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 -- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 msgr2=0x7f3e78003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e900b5080 0x7f3e78003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 -- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78004120 msgr2=0x7f3e78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e78004120 0x7f3e78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.734+0000 7f3e95c00640 1 -- 172.21.15.52:0/2208110121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e78003520 con 0x7f3e78004d40 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.735+0000 7f3e95c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e780051c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009fc0 tx=0x7f3e78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8874ca3d35420425 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88009c10 con 0x7f3e78004d40 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e88036070 con 0x7f3e78004d40 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e8f400640 1 -- 172.21.15.52:0/2208110121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88031880 con 0x7f3e78004d40 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 -- 172.21.15.52:0/2208110121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 msgr2=0x7f3e780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 --2- 172.21.15.52:0/2208110121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e780051c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009fc0 tx=0x7f3e78005830 comp rx=0 tx=0).stop 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e95c00640 1 -- 172.21.15.52:0/2208110121 reap_dead start 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 -- 172.21.15.52:0/2208110121 shutdown_connections 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 -- 172.21.15.52:0/2208110121 >> 172.21.15.52:0/2208110121 conn(0x7f3e900ccec0 msgr2=0x7f3e900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 -- 172.21.15.52:0/2208110121 shutdown_connections 2024-09-10T08:34:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.736+0000 7f3e97c00640 1 -- 172.21.15.52:0/2208110121 wait complete. 2024-09-10T08:34:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.738+0000 7f3e97c00640 1 Processor -- start 2024-09-10T08:34:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.738+0000 7f3e97c00640 1 -- start start 2024-09-10T08:34:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e901f4700 0x7f3e90145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e90157af0 0x7f3e90157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90146430 con 0x7f3e78004d40 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e901462b0 con 0x7f3e901f4700 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e97c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900b5f90 con 0x7f3e90157af0 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e95200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e95200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51644/0 (socket says 172.21.15.52:51644) 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.739+0000 7f3e95200640 1 -- 172.21.15.52:0/1952294914 learned_addr learned my addr 172.21.15.52:0/1952294914 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e8fe00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e901f4700 0x7f3e90145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e90157af0 0x7f3e90157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 -- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e90157af0 msgr2=0x7f3e90157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e90157af0 0x7f3e90157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 -- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e901f4700 msgr2=0x7f3e90145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e901f4700 0x7f3e90145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 -- 172.21.15.52:0/1952294914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e901584e0 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e95200640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007340 tx=0x7f3e84007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400f8c0 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84018070 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400fca0 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.740+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e901f5700 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.741+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901f4e60 con 0x7f3e78004d40 2024-09-10T08:34:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.742+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e900b62e0 con 0x7f3e78004d40 2024-09-10T08:34:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.742+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e8401d460 con 0x7f3e78004d40 2024-09-10T08:34:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.743+0000 7f3e8cc00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 0x7f3e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.743+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5881+0+0 (secure 0 0 0) 0x7f3e8408af40 con 0x7f3e78004d40 2024-09-10T08:34:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.744+0000 7f3e8fe00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 0x7f3e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.744+0000 7f3e8fe00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 0x7f3e7006e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3e90073860 tx=0x7f3e7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.748+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e901584e0 con 0x7f3e78004d40 2024-09-10T08:34:21.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.968+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e901f59a0 con 0x7f3e78004d40 2024-09-10T08:34:21.968 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:34:21.968+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:34:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.971+0000 7f3e8cc00640 1 -- 172.21.15.52:0/1952294914 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 161+0+0 (secure 0 0 0) 0x7f3e84059830 con 0x7f3e78004d40 2024-09-10T08:34:21.971 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 msgr2=0x7f3e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 0x7f3e7006e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3e90073860 tx=0x7f3e7c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 msgr2=0x7f3e9013d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007340 tx=0x7f3e84007800 comp rx=0 tx=0).stop 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 shutdown_connections 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e7006be30 0x7f3e7006e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e90157af0 0x7f3e90157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e901f4700 0x7f3e90145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 --2- 172.21.15.52:0/1952294914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e78004d40 0x7f3e9013d260 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.973+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 >> 172.21.15.52:0/1952294914 conn(0x7f3e900ccec0 msgr2=0x7f3e900d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.974+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 shutdown_connections 2024-09-10T08:34:21.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:21.974+0000 7f3e97c00640 1 -- 172.21.15.52:0/1952294914 wait complete. 2024-09-10T08:34:21.980 INFO:tasks.ceph.mds.a.smithi052.stderr: -1498> 2024-09-10T08:34:10.820+0000 7eff0a400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:34:21.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:34:22.025 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:34:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.149+0000 7f6ac4200640 1 Processor -- start 2024-09-10T08:34:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.149+0000 7f6ac4200640 1 -- start start 2024-09-10T08:34:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac4200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6abc0ccf30 0x7f6abc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac4200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6abc0cead0 0x7f6abc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac4200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc0cf2e0 con 0x7f6abc15b7c0 2024-09-10T08:34:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac4200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc070fe0 con 0x7f6abc0cead0 2024-09-10T08:34:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac4200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc0712c0 con 0x7f6abc0ccf30 2024-09-10T08:34:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6abc0cead0 0x7f6abc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6abc0cead0 0x7f6abc071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51664/0 (socket says 172.21.15.52:51664) 2024-09-10T08:34:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 -- 172.21.15.52:0/2413719997 learned_addr learned my addr 172.21.15.52:0/2413719997 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac1800640 1 --2- 172.21.15.52:0/2413719997 >> v2:172.21.15.176:3300/0 conn(0x7f6abc0ccf30 0x7f6abc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 -- 172.21.15.52:0/2413719997 >> v2:172.21.15.176:3300/0 conn(0x7f6abc0ccf30 msgr2=0x7f6abc0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 --2- 172.21.15.52:0/2413719997 >> v2:172.21.15.176:3300/0 conn(0x7f6abc0ccf30 0x7f6abc0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 -- 172.21.15.52:0/2413719997 >> v1:172.21.15.52:6789/0 conn(0x7f6abc15b7c0 legacy=0x7f6abc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.151+0000 7f6ac2200640 1 -- 172.21.15.52:0/2413719997 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc0715a0 con 0x7f6abc0cead0 2024-09-10T08:34:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.152+0000 7f6ac2200640 1 --2- 172.21.15.52:0/2413719997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0cead0 0x7f6abc071ac0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6abc06f1c0 tx=0x7f6ab402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67d35c092b677a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6abbe00640 1 -- 172.21.15.52:0/2413719997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4036070 con 0x7f6abc0cead0 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6abbe00640 1 -- 172.21.15.52:0/2413719997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4031600 con 0x7f6abc0cead0 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6abbe00640 1 -- 172.21.15.52:0/2413719997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40319d0 con 0x7f6abc0cead0 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 -- 172.21.15.52:0/2413719997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0cead0 msgr2=0x7f6abc071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 --2- 172.21.15.52:0/2413719997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0cead0 0x7f6abc071ac0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6abc06f1c0 tx=0x7f6ab402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 -- 172.21.15.52:0/2413719997 shutdown_connections 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 --2- 172.21.15.52:0/2413719997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0cead0 0x7f6abc071ac0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 --2- 172.21.15.52:0/2413719997 >> v2:172.21.15.176:3300/0 conn(0x7f6abc0ccf30 0x7f6abc0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 -- 172.21.15.52:0/2413719997 >> 172.21.15.52:0/2413719997 conn(0x7f6abc06d0f0 msgr2=0x7f6abc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 -- 172.21.15.52:0/2413719997 shutdown_connections 2024-09-10T08:34:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.153+0000 7f6ac4200640 1 -- 172.21.15.52:0/2413719997 wait complete. 2024-09-10T08:34:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.155+0000 7f6ac4200640 1 Processor -- start 2024-09-10T08:34:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.155+0000 7f6ac4200640 1 -- start start 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6abc0cead0 0x7f6abc1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6abc15b7c0 0x7f6abc1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0cf080 con 0x7f6abc0ccf30 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0cef00 con 0x7f6abc0cead0 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac4200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc072000 con 0x7f6abc15b7c0 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51676/0 (socket says 172.21.15.52:51676) 2024-09-10T08:34:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.156+0000 7f6ac1800640 1 -- 172.21.15.52:0/3720606434 learned_addr learned my addr 172.21.15.52:0/3720606434 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac2200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6abc15b7c0 0x7f6abc1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac0e00640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6abc0cead0 0x7f6abc1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 -- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6abc15b7c0 msgr2=0x7f6abc1547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6abc15b7c0 0x7f6abc1547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 -- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6abc0cead0 msgr2=0x7f6abc1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6abc0cead0 0x7f6abc1598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 -- 172.21.15.52:0/3720606434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc158e50 con 0x7f6abc0ccf30 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac1800640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9b0 tx=0x7f6ab000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0017070 con 0x7f6abc0ccf30 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab000c9a0 con 0x7f6abc0ccf30 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.157+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc155050 con 0x7f6abc0ccf30 2024-09-10T08:34:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.158+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000cd90 con 0x7f6abc0ccf30 2024-09-10T08:34:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.158+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc1593d0 con 0x7f6abc0ccf30 2024-09-10T08:34:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.159+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc0b2c50 con 0x7f6abc0ccf30 2024-09-10T08:34:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.160+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ab001a070 con 0x7f6abc0ccf30 2024-09-10T08:34:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.161+0000 7f6ab9600640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 0x7f6a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.161+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5967+0+0 (secure 0 0 0) 0x7f6ab008af80 con 0x7f6abc0ccf30 2024-09-10T08:34:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.162+0000 7f6ac0e00640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 0x7f6a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.162+0000 7f6ac0e00640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 0x7f6a9c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6abc157900 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:22.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.165+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab0059140 con 0x7f6abc0ccf30 2024-09-10T08:34:22.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.385+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6abc0761d0 con 0x7f6abc0ccf30 2024-09-10T08:34:22.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.972+0000 7f6ab9600640 1 -- 172.21.15.52:0/3720606434 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f6ab005d440 con 0x7f6abc0ccf30 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 msgr2=0x7f6a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 0x7f6a9c06e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6abc157900 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 msgr2=0x7f6abc1f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e9b0 tx=0x7f6ab000ee70 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 shutdown_connections 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9c06be30 0x7f6a9c06e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6abc15b7c0 0x7f6abc1547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6abc0cead0 0x7f6abc1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 --2- 172.21.15.52:0/3720606434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6abc0ccf30 0x7f6abc1f47d0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 >> 172.21.15.52:0/3720606434 conn(0x7f6abc06d0f0 msgr2=0x7f6abc0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:22.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 shutdown_connections 2024-09-10T08:34:22.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:22.975+0000 7f6ac4200640 1 -- 172.21.15.52:0/3720606434 wait complete. 2024-09-10T08:34:22.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:34:23.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.196+0000 7fcb2a400640 1 Processor -- start 2024-09-10T08:34:23.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.196+0000 7fcb2a400640 1 -- start start 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb24148170 0x7fcb240af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 0x7fcb2406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 0x7fcb2406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240b0140 con 0x7fcb24148170 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240ae870 con 0x7fcb240af800 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.197+0000 7fcb2a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb240aee30 con 0x7fcb2406c150 2024-09-10T08:34:23.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb24148170 0x7fcb240af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb24148170 0x7fcb240af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51680/0 (socket says 172.21.15.52:51680) 2024-09-10T08:34:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 -- 172.21.15.52:0/1817742700 learned_addr learned my addr 172.21.15.52:0/1817742700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23e00640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 0x7fcb2406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/1817742700 >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 0x7fcb2406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 -- 172.21.15.52:0/1817742700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 msgr2=0x7fcb2406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 0x7fcb2406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 -- 172.21.15.52:0/1817742700 >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 msgr2=0x7fcb2406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 --2- 172.21.15.52:0/1817742700 >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 0x7fcb2406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23400640 1 -- 172.21.15.52:0/1817742700 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2406e340 con 0x7fcb24148170 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb23e00640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 0x7fcb2406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.198+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/1817742700 >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 0x7fcb2406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.199+0000 7fcb23400640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24148170 0x7fcb240af2c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcb240b3530 tx=0x7fcb1402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ae81e7c4edbc9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb22a00640 1 -- 172.21.15.52:0/1817742700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14037070 con 0x7fcb24148170 2024-09-10T08:34:23.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb22a00640 1 -- 172.21.15.52:0/1817742700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb14032440 con 0x7fcb24148170 2024-09-10T08:34:23.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb22a00640 1 -- 172.21.15.52:0/1817742700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14032810 con 0x7fcb24148170 2024-09-10T08:34:23.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 -- 172.21.15.52:0/1817742700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24148170 msgr2=0x7fcb240af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24148170 0x7fcb240af2c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcb240b3530 tx=0x7fcb1402a140 comp rx=0 tx=0).stop 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 -- 172.21.15.52:0/1817742700 shutdown_connections 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 --2- 172.21.15.52:0/1817742700 >> v2:172.21.15.176:3300/0 conn(0x7fcb240af800 0x7fcb2406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb2406c150 0x7fcb2406d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 --2- 172.21.15.52:0/1817742700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24148170 0x7fcb240af2c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 -- 172.21.15.52:0/1817742700 >> 172.21.15.52:0/1817742700 conn(0x7fcb240b2580 msgr2=0x7fcb240b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 -- 172.21.15.52:0/1817742700 shutdown_connections 2024-09-10T08:34:23.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.200+0000 7fcb2a400640 1 -- 172.21.15.52:0/1817742700 wait complete. 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.202+0000 7fcb2a400640 1 Processor -- start 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.202+0000 7fcb2a400640 1 -- start start 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 0x7fcb2415ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 0x7fcb24142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24148550 con 0x7fcb2406c150 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240aeac0 con 0x7fcb24148170 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb2a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb241486d0 con 0x7fcb240af800 2024-09-10T08:34:23.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51688/0 (socket says 172.21.15.52:51688) 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 -- 172.21.15.52:0/4225255034 learned_addr learned my addr 172.21.15.52:0/4225255034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 -- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 msgr2=0x7fcb2415ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 0x7fcb2415ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23e00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 0x7fcb24142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 0x7fcb2415ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 -- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 msgr2=0x7fcb24142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 0x7fcb24142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23400640 1 -- 172.21.15.52:0/4225255034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2415e8b0 con 0x7fcb2406c150 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb23e00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 0x7fcb24142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.203+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 0x7fcb2415ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:23.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb23400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14041020 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb140306c0 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb24160640 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14037040 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.204+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb24160c00 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.205+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2406bc10 con 0x7fcb2406c150 2024-09-10T08:34:23.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.206+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb14044020 con 0x7fcb2406c150 2024-09-10T08:34:23.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.207+0000 7fcb1be00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 0x7fcb0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:23.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.207+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5967+0+0 (secure 0 0 0) 0x7fcb140ab740 con 0x7fcb2406c150 2024-09-10T08:34:23.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.208+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 0x7fcb0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:23.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.208+0000 7fcb1aa00640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 0x7fcb0006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006fd0 tx=0x7fcb0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:23.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.211+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb1404b030 con 0x7fcb2406c150 2024-09-10T08:34:23.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.398+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcb240b0460 con 0x7fcb2406c150 2024-09-10T08:34:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.978+0000 7fcb1be00640 1 -- 172.21.15.52:0/4225255034 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7fcb1407ee20 con 0x7fcb2406c150 2024-09-10T08:34:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:34:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 msgr2=0x7fcb0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 0x7fcb0006e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006fd0 tx=0x7fcb0c008040 comp rx=0 tx=0).stop 2024-09-10T08:34:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 msgr2=0x7fcb24140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb140046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 shutdown_connections 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb0006be30 0x7fcb0006e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb24148170 0x7fcb24142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb240af800 0x7fcb2415ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 --2- 172.21.15.52:0/4225255034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb2406c150 0x7fcb24140250 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 >> 172.21.15.52:0/4225255034 conn(0x7fcb240b2580 msgr2=0x7fcb24071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.982+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 shutdown_connections 2024-09-10T08:34:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:23.983+0000 7fcb2a400640 1 -- 172.21.15.52:0/4225255034 wait complete. 2024-09-10T08:34:24.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:34:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.169+0000 7f346de00640 1 Processor -- start 2024-09-10T08:34:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.169+0000 7f346de00640 1 -- start start 2024-09-10T08:34:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 0x7f34680b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34680b21a0 0x7f34680cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34680cf960 0x7f346815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f34680b2600 con 0x7f34680cf960 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f34680b01e0 con 0x7f3468155b20 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.170+0000 7f346de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34680b0680 con 0x7f34680b21a0 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34680cf960 0x7f346815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f34680cf960 0x7f346815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57298/0 (socket says 172.21.15.52:57298) 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 -- 172.21.15.52:0/321420089 learned_addr learned my addr 172.21.15.52:0/321420089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3466000640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34680b21a0 0x7f34680cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3466a00640 1 --2- 172.21.15.52:0/321420089 >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 0x7f34680b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 -- 172.21.15.52:0/321420089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34680b21a0 msgr2=0x7f34680cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34680b21a0 0x7f34680cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 -- 172.21.15.52:0/321420089 >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 msgr2=0x7f34680b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:24.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 --2- 172.21.15.52:0/321420089 >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 0x7f34680b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3467400640 1 -- 172.21.15.52:0/321420089 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34680ccf70 con 0x7f34680cf960 2024-09-10T08:34:24.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.171+0000 7f3466a00640 1 --2- 172.21.15.52:0/321420089 >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 0x7f34680b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.172+0000 7f3467400640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680cf960 0x7f346815ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f346806f370 tx=0x7f346002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7c1bd63220eb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f3465600640 1 -- 172.21.15.52:0/321420089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460036070 con 0x7f34680cf960 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f3465600640 1 -- 172.21.15.52:0/321420089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3460031600 con 0x7f34680cf960 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f3465600640 1 -- 172.21.15.52:0/321420089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600319d0 con 0x7f34680cf960 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 -- 172.21.15.52:0/321420089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680cf960 msgr2=0x7f346815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680cf960 0x7f346815ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f346806f370 tx=0x7f346002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 -- 172.21.15.52:0/321420089 shutdown_connections 2024-09-10T08:34:24.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680cf960 0x7f346815ef70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 --2- 172.21.15.52:0/321420089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34680b21a0 0x7f34680cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 --2- 172.21.15.52:0/321420089 >> v2:172.21.15.176:3300/0 conn(0x7f3468155b20 0x7f34680b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 -- 172.21.15.52:0/321420089 >> 172.21.15.52:0/321420089 conn(0x7f346806c240 msgr2=0x7f346806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 -- 172.21.15.52:0/321420089 shutdown_connections 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.173+0000 7f346de00640 1 -- 172.21.15.52:0/321420089 wait complete. 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.175+0000 7f346de00640 1 Processor -- start 2024-09-10T08:34:24.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.175+0000 7f346de00640 1 -- start start 2024-09-10T08:34:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 0x7f346814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3468155b20 0x7f3468158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34680cef00 con 0x7f34680b21a0 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34680cec20 con 0x7f34680cf960 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f346de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f34680cfdb0 con 0x7f3468155b20 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f3466a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f3466a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57304/0 (socket says 172.21.15.52:57304) 2024-09-10T08:34:24.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.176+0000 7f3466a00640 1 -- 172.21.15.52:0/2905004283 learned_addr learned my addr 172.21.15.52:0/2905004283 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:24.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 -- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3468155b20 msgr2=0x7f3468158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3468155b20 0x7f3468158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 -- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 msgr2=0x7f346814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466000640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 0x7f346814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 0x7f346814d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 -- 172.21.15.52:0/2905004283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468155fa0 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466000640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 0x7f346814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f3466a00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f345800c820 tx=0x7f345800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458015070 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3458007a30 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458007de0 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34681564f0 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.177+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3468156210 con 0x7f34680b21a0 2024-09-10T08:34:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.178+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34680ce610 con 0x7f34680b21a0 2024-09-10T08:34:24.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.179+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3458018070 con 0x7f34680b21a0 2024-09-10T08:34:24.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.180+0000 7f345f400640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 0x7f344806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:24.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.180+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5529+0+0 (secure 0 0 0) 0x7f345808ac80 con 0x7f34680b21a0 2024-09-10T08:34:24.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.181+0000 7f3466000640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 0x7f344806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:24.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.182+0000 7f3466000640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 0x7f344806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34680b2d30 tx=0x7f3454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.185+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3458059640 con 0x7f34680b21a0 2024-09-10T08:34:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.368+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34680b0930 con 0x7f34680b21a0 2024-09-10T08:34:24.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.980+0000 7f345f400640 1 -- 172.21.15.52:0/2905004283 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f3458058f40 con 0x7f34680b21a0 2024-09-10T08:34:24.981 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:34:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.987+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 msgr2=0x7f344806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.987+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 0x7f344806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34680b2d30 tx=0x7f3454008040 comp rx=0 tx=0).stop 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.987+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 msgr2=0x7f3468156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.987+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f345800c820 tx=0x7f345800cce0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 shutdown_connections 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f344806be30 0x7f344806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3468155b20 0x7f3468158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34680cf960 0x7f346814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 --2- 172.21.15.52:0/2905004283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34680b21a0 0x7f3468156880 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.988+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 >> 172.21.15.52:0/2905004283 conn(0x7f346806c240 msgr2=0x7f34680b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.989+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 shutdown_connections 2024-09-10T08:34:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:24.989+0000 7f346de00640 1 -- 172.21.15.52:0/2905004283 wait complete. 2024-09-10T08:34:25.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-10T08:34:25.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.174+0000 7f8b7da00640 1 Processor -- start 2024-09-10T08:34:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.174+0000 7f8b7da00640 1 -- start start 2024-09-10T08:34:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.175+0000 7f8b7da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7815c310 0x7f8b78071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.175+0000 7f8b7da00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b780725c0 0x7f8b780d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b7da00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b780afa10 con 0x7f8b780d06b0 2024-09-10T08:34:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b7da00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8b780d0b00 con 0x7f8b780725c0 2024-09-10T08:34:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b7da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b78071220 con 0x7f8b7815c310 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8b780725c0 0x7f8b780d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b7d000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8b780d06b0 0x7f8b780cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60900/0 (socket says 172.21.15.52:60900) 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b7d000640 1 -- 172.21.15.52:0/3470159931 learned_addr learned my addr 172.21.15.52:0/3470159931 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77e00640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7815c310 0x7f8b78071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77400640 1 -- 172.21.15.52:0/3470159931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7815c310 msgr2=0x7f8b78071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77400640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7815c310 0x7f8b78071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77400640 1 -- 172.21.15.52:0/3470159931 >> v1:172.21.15.52:6789/0 conn(0x7f8b780d06b0 legacy=0x7f8b780cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.176+0000 7f8b77400640 1 -- 172.21.15.52:0/3470159931 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b78071500 con 0x7f8b780725c0 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.177+0000 7f8b77400640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b780d0170 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843d6a6ea739a2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b76a00640 1 -- 172.21.15.52:0/3470159931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64037070 con 0x7f8b780725c0 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b76a00640 1 -- 172.21.15.52:0/3470159931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64032440 con 0x7f8b780725c0 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b76a00640 1 -- 172.21.15.52:0/3470159931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64032810 con 0x7f8b780725c0 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 -- 172.21.15.52:0/3470159931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 msgr2=0x7f8b780d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b780d0170 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402a180 comp rx=0 tx=0).stop 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 -- 172.21.15.52:0/3470159931 shutdown_connections 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b780d0170 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 --2- 172.21.15.52:0/3470159931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b7815c310 0x7f8b78071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 -- 172.21.15.52:0/3470159931 >> 172.21.15.52:0/3470159931 conn(0x7f8b7806bc10 msgr2=0x7f8b7806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 -- 172.21.15.52:0/3470159931 shutdown_connections 2024-09-10T08:34:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.178+0000 7f8b7da00640 1 -- 172.21.15.52:0/3470159931 wait complete. 2024-09-10T08:34:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.180+0000 7f8b7da00640 1 Processor -- start 2024-09-10T08:34:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.180+0000 7f8b7da00640 1 -- start start 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b780d06b0 0x7f8b780b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b7815c310 0x7f8b781f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780af6c0 con 0x7f8b780725c0 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780729e0 con 0x7f8b7815c310 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8b78073e30 con 0x7f8b780d06b0 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b77e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57318/0 (socket says 172.21.15.52:57318) 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b77e00640 1 -- 172.21.15.52:0/2572507898 learned_addr learned my addr 172.21.15.52:0/2572507898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b77400640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b780d06b0 0x7f8b780b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.181+0000 7f8b7d000640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b7815c310 0x7f8b781f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 -- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b780d06b0 msgr2=0x7f8b780b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b780d06b0 0x7f8b780b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 -- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b7815c310 msgr2=0x7f8b781f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b7815c310 0x7f8b781f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 -- 172.21.15.52:0/2572507898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b780b1480 con 0x7f8b780725c0 2024-09-10T08:34:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b77e00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d5f0 tx=0x7f8b6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680125f0 con 0x7f8b780725c0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b68019070 con 0x7f8b780725c0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680129d0 con 0x7f8b780725c0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b780b1760 con 0x7f8b780725c0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.182+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b780b1d20 con 0x7f8b780725c0 2024-09-10T08:34:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.183+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7815c6f0 con 0x7f8b780725c0 2024-09-10T08:34:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.184+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b68012b70 con 0x7f8b780725c0 2024-09-10T08:34:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.185+0000 7f8b6fe00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 0x7f8b5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.185+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f8b6808b060 con 0x7f8b780725c0 2024-09-10T08:34:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.186+0000 7f8b77400640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 0x7f8b5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.186+0000 7f8b77400640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 0x7f8b5806e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b64034000 tx=0x7f8b6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.189+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b68059bc0 con 0x7f8b780725c0 2024-09-10T08:34:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.372+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f8b780d0130 con 0x7f8b780725c0 2024-09-10T08:34:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.375+0000 7f8b6fe00640 1 -- 172.21.15.52:0/2572507898 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v30) ==== 101+0+0 (secure 0 0 0) 0x7f8b680594c0 con 0x7f8b780725c0 2024-09-10T08:34:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 msgr2=0x7f8b5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 0x7f8b5806e2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b64034000 tx=0x7f8b6402e000 comp rx=0 tx=0).stop 2024-09-10T08:34:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 msgr2=0x7f8b7814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800d5f0 tx=0x7f8b6800dab0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 shutdown_connections 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8b5806be30 0x7f8b5806e2f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b7815c310 0x7f8b781f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b780d06b0 0x7f8b780b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 --2- 172.21.15.52:0/2572507898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b780725c0 0x7f8b7814f8b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 >> 172.21.15.52:0/2572507898 conn(0x7f8b7806bc10 msgr2=0x7f8b78072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 shutdown_connections 2024-09-10T08:34:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.378+0000 7f8b7da00640 1 -- 172.21.15.52:0/2572507898 wait complete. 2024-09-10T08:34:25.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-10T08:34:25.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.552+0000 7f7ea3800640 1 Processor -- start 2024-09-10T08:34:25.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.553+0000 7f7ea3800640 1 -- start start 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea3800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7e9c15b7c0 0x7f7e9c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea3800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9c0cf2e0 con 0x7f7e9c0ccf30 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea3800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e9c070fe0 con 0x7f7e9c0cead0 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea3800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7e9c0712c0 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea0e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7e9c0ccf30 0x7f7e9c0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60912/0 (socket says 172.21.15.52:60912) 2024-09-10T08:34:25.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7ea0e00640 1 -- 172.21.15.52:0/3401411661 learned_addr learned my addr 172.21.15.52:0/3401411661 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:25.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7e9be00640 1 --2- 172.21.15.52:0/3401411661 >> v2:172.21.15.176:3300/0 conn(0x7f7e9c15b7c0 0x7f7e9c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.554+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488901088 0 0) 0x7f7e9c0cf2e0 con 0x7f7e9c0ccf30 2024-09-10T08:34:25.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.555+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e84003520 con 0x7f7e9c0ccf30 2024-09-10T08:34:25.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.555+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2390059608 0 0) 0x7f7e84003520 con 0x7f7e9c0ccf30 2024-09-10T08:34:25.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.555+0000 7f7e9be00640 1 -- 172.21.15.52:0/3401411661 >> v1:172.21.15.176:6789/0 conn(0x7f7e9c0cead0 legacy=0x7f7e9c071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.555+0000 7f7e9be00640 1 -- 172.21.15.52:0/3401411661 >> v1:172.21.15.52:6789/0 conn(0x7f7e9c0ccf30 legacy=0x7f7e9c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.555+0000 7f7e9be00640 1 -- 172.21.15.52:0/3401411661 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c0715a0 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.556+0000 7f7e9be00640 1 --2- 172.21.15.52:0/3401411661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c0b2c50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097a0 tx=0x7f7e8802c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc56a246c619127f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.556+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88039070 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.556+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8802cdd0 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.556+0000 7f7e9b400640 1 -- 172.21.15.52:0/3401411661 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e90001670 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 -- 172.21.15.52:0/3401411661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 msgr2=0x7f7e9c0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 --2- 172.21.15.52:0/3401411661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c0b2c50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e880097a0 tx=0x7f7e8802c340 comp rx=0 tx=0).stop 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 -- 172.21.15.52:0/3401411661 shutdown_connections 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 --2- 172.21.15.52:0/3401411661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c0b2c50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 -- 172.21.15.52:0/3401411661 >> 172.21.15.52:0/3401411661 conn(0x7f7e9c06d0f0 msgr2=0x7f7e9c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 -- 172.21.15.52:0/3401411661 shutdown_connections 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.557+0000 7f7ea3800640 1 -- 172.21.15.52:0/3401411661 wait complete. 2024-09-10T08:34:25.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.558+0000 7f7ea3800640 1 Processor -- start 2024-09-10T08:34:25.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.559+0000 7f7ea3800640 1 -- start start 2024-09-10T08:34:25.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e9c0ccf30 0x7f7e9c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c1f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c0cf080 con 0x7f7e9c0cead0 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c0cef00 con 0x7f7e9c15b7c0 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea3800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9c0721d0 con 0x7f7e9c0ccf30 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7e9be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7e9be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57326/0 (socket says 172.21.15.52:57326) 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7e9be00640 1 -- 172.21.15.52:0/2159137725 learned_addr learned my addr 172.21.15.52:0/2159137725 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea1800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c1f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.560+0000 7f7ea0e00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e9c0ccf30 0x7f7e9c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 -- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e9c0ccf30 msgr2=0x7f7e9c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e9c0ccf30 0x7f7e9c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 -- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 msgr2=0x7f7e9c1f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c1f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 -- 172.21.15.52:0/2159137725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9c153ab0 con 0x7f7e9c0cead0 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e9be00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7e88037040 tx=0x7f7e880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88039040 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e88044070 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88006e10 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c153d90 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.561+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c154350 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.562+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9c0ce8b0 con 0x7f7e9c0cead0 2024-09-10T08:34:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.563+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e8803f890 con 0x7f7e9c0cead0 2024-09-10T08:34:25.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.564+0000 7f7e98c00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.564+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f7e880ab1d0 con 0x7f7e9c0cead0 2024-09-10T08:34:25.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.564+0000 7f7ea0e00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.565+0000 7f7ea0e00640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005880 tx=0x7f7e90000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.569+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e88079770 con 0x7f7e9c0cead0 2024-09-10T08:34:25.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.762+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f7e9c0d0290 con 0x7f7e9c0cead0 2024-09-10T08:34:25.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.765+0000 7f7e98c00640 1 -- 172.21.15.52:0/2159137725 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v31) ==== 101+0+0 (secure 0 0 0) 0x7f7e8807da70 con 0x7f7e9c0cead0 2024-09-10T08:34:25.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 msgr2=0x7f7e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005880 tx=0x7f7e90000bc0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 msgr2=0x7f7e9c151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7e88037040 tx=0x7f7e880046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 shutdown_connections 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7e7c06be30 0x7f7e7c06e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e9c15b7c0 0x7f7e9c1f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e9c0cead0 0x7f7e9c151850 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 --2- 172.21.15.52:0/2159137725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e9c0ccf30 0x7f7e9c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 >> 172.21.15.52:0/2159137725 conn(0x7f7e9c06d0f0 msgr2=0x7f7e9c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 shutdown_connections 2024-09-10T08:34:25.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.768+0000 7f7ea3800640 1 -- 172.21.15.52:0/2159137725 wait complete. 2024-09-10T08:34:25.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-10T08:34:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.941+0000 7f51d8400640 1 Processor -- start 2024-09-10T08:34:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.941+0000 7f51d8400640 1 -- start start 2024-09-10T08:34:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d8400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d8400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51d00cf2e0 con 0x7f51d00ccf30 2024-09-10T08:34:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d8400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f51d0070fe0 con 0x7f51d00cead0 2024-09-10T08:34:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51d00712c0 con 0x7f51d015b7c0 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d6400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39546/0 (socket says 172.21.15.52:39546) 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d5000640 1 -- 172.21.15.52:0/1985203597 learned_addr learned my addr 172.21.15.52:0/1985203597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.943+0000 7f51d6400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:49220/0 (socket says 172.21.15.52:49220) 2024-09-10T08:34:25.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.944+0000 7f51d5000640 1 -- 172.21.15.52:0/1985203597 >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 msgr2=0x7f51d0071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.944+0000 7f51d5000640 1 --2- 172.21.15.52:0/1985203597 >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.944+0000 7f51d5000640 1 -- 172.21.15.52:0/1985203597 >> v1:172.21.15.176:6789/0 conn(0x7f51d00ccf30 legacy=0x7f51d00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.944+0000 7f51d5000640 1 -- 172.21.15.52:0/1985203597 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d00715a0 con 0x7f51d015b7c0 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.944+0000 7f51d6400640 1 --2- 172.21.15.52:0/1985203597 >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.945+0000 7f51d5000640 1 --2- 172.21.15.52:0/1985203597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00bb10 tx=0x7f51bc02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1e10f8a1605e622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.945+0000 7f51cfe00640 1 -- 172.21.15.52:0/1985203597 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc032790 con 0x7f51d015b7c0 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.945+0000 7f51cfe00640 1 -- 172.21.15.52:0/1985203597 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc038070 con 0x7f51d015b7c0 2024-09-10T08:34:25.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.945+0000 7f51cfe00640 1 -- 172.21.15.52:0/1985203597 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc032b50 con 0x7f51d015b7c0 2024-09-10T08:34:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 -- 172.21.15.52:0/1985203597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 msgr2=0x7f51d00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 --2- 172.21.15.52:0/1985203597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00bb10 tx=0x7f51bc02c890 comp rx=0 tx=0).stop 2024-09-10T08:34:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 -- 172.21.15.52:0/1985203597 shutdown_connections 2024-09-10T08:34:25.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 --2- 172.21.15.52:0/1985203597 >> v2:172.21.15.176:3300/0 conn(0x7f51d00cead0 0x7f51d0071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 --2- 172.21.15.52:0/1985203597 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d015b7c0 0x7f51d00b2c50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 -- 172.21.15.52:0/1985203597 >> 172.21.15.52:0/1985203597 conn(0x7f51d006d0f0 msgr2=0x7f51d006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 -- 172.21.15.52:0/1985203597 shutdown_connections 2024-09-10T08:34:25.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.946+0000 7f51d8400640 1 -- 172.21.15.52:0/1985203597 wait complete. 2024-09-10T08:34:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.948+0000 7f51d8400640 1 Processor -- start 2024-09-10T08:34:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.948+0000 7f51d8400640 1 -- start start 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d00cead0 0x7f51d015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51d015b7c0 0x7f51d0153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51d00cf0c0 con 0x7f51d00ccf30 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51d00cef40 con 0x7f51d015b7c0 2024-09-10T08:34:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d8400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51d0072000 con 0x7f51d00cead0 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57340/0 (socket says 172.21.15.52:57340) 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 -- 172.21.15.52:0/2051811942 learned_addr learned my addr 172.21.15.52:0/2051811942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5000640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d00cead0 0x7f51d015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d6400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51d015b7c0 0x7f51d0153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 -- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d00cead0 msgr2=0x7f51d015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d00cead0 0x7f51d015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 -- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51d015b7c0 msgr2=0x7f51d0153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51d015b7c0 0x7f51d0153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.949+0000 7f51d5a00640 1 -- 172.21.15.52:0/2051811942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d015bf20 con 0x7f51d00ccf30 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51d5a00640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c400 tx=0x7f51c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40052d0 con 0x7f51d00ccf30 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c4005490 con 0x7f51d00ccf30 2024-09-10T08:34:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4007260 con 0x7f51d00ccf30 2024-09-10T08:34:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d015c200 con 0x7f51d00ccf30 2024-09-10T08:34:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.950+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d015c7c0 con 0x7f51d00ccf30 2024-09-10T08:34:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.951+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d0071ac0 con 0x7f51d00ccf30 2024-09-10T08:34:25.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.952+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f51c4007400 con 0x7f51d00ccf30 2024-09-10T08:34:25.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.953+0000 7f51cd600640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 0x7f51b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:25.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.953+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f51c408a280 con 0x7f51d00ccf30 2024-09-10T08:34:25.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.953+0000 7f51d5000640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 0x7f51b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:25.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.954+0000 7f51d5000640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 0x7f51b006e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f51bc037000 tx=0x7f51bc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:25.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:25.957+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51c4058d50 con 0x7f51d00ccf30 2024-09-10T08:34:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.147+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f51d00cc960 con 0x7f51d00ccf30 2024-09-10T08:34:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.151+0000 7f51cd600640 1 -- 172.21.15.52:0/2051811942 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v32) ==== 101+0+0 (secure 0 0 0) 0x7f51c4058650 con 0x7f51d00ccf30 2024-09-10T08:34:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.153+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 msgr2=0x7f51b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.153+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 0x7f51b006e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f51bc037000 tx=0x7f51bc032000 comp rx=0 tx=0).stop 2024-09-10T08:34:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.153+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 msgr2=0x7f51d014e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.153+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c400 tx=0x7f51c400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 shutdown_connections 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f51b006be30 0x7f51b006e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51d015b7c0 0x7f51d0153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51d00cead0 0x7f51d015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 --2- 172.21.15.52:0/2051811942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51d00ccf30 0x7f51d014e450 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 >> 172.21.15.52:0/2051811942 conn(0x7f51d006d0f0 msgr2=0x7f51d00ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 shutdown_connections 2024-09-10T08:34:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.154+0000 7f51d8400640 1 -- 172.21.15.52:0/2051811942 wait complete. 2024-09-10T08:34:26.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:34:26.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.327+0000 7fde36800640 1 Processor -- start 2024-09-10T08:34:26.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.327+0000 7fde36800640 1 -- start start 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde300732e0 0x7fde300736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde300cce30 0x7fde300cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde30071c70 0x7fde300720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fde300714b0 con 0x7fde300cce30 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fde30073c00 con 0x7fde300732e0 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde36800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde300cd880 con 0x7fde30071c70 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde300cce30 0x7fde300cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde300cce30 0x7fde300cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57348/0 (socket says 172.21.15.52:57348) 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 -- 172.21.15.52:0/2689759056 learned_addr learned my addr 172.21.15.52:0/2689759056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde2f400640 1 --2- 172.21.15.52:0/2689759056 >> v2:172.21.15.176:3300/0 conn(0x7fde300732e0 0x7fde300736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde2fe00640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde30071c70 0x7fde300720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 -- 172.21.15.52:0/2689759056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde30071c70 msgr2=0x7fde300720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde30071c70 0x7fde300720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 -- 172.21.15.52:0/2689759056 >> v2:172.21.15.176:3300/0 conn(0x7fde300732e0 msgr2=0x7fde300736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 --2- 172.21.15.52:0/2689759056 >> v2:172.21.15.176:3300/0 conn(0x7fde300732e0 0x7fde300736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.329+0000 7fde27e00640 1 -- 172.21.15.52:0/2689759056 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde300cdb60 con 0x7fde300cce30 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.330+0000 7fde27e00640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde300cd2a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fde300b6780 tx=0x7fde1802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eb233f0702cf04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.330+0000 7fde2ea00640 1 -- 172.21.15.52:0/2689759056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18037070 con 0x7fde300cce30 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde2ea00640 1 -- 172.21.15.52:0/2689759056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18032440 con 0x7fde300cce30 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde2ea00640 1 -- 172.21.15.52:0/2689759056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18032810 con 0x7fde300cce30 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 -- 172.21.15.52:0/2689759056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 msgr2=0x7fde300cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde300cd2a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fde300b6780 tx=0x7fde1802a140 comp rx=0 tx=0).stop 2024-09-10T08:34:26.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 -- 172.21.15.52:0/2689759056 shutdown_connections 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde30071c70 0x7fde300720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 --2- 172.21.15.52:0/2689759056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde300cd2a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 --2- 172.21.15.52:0/2689759056 >> v2:172.21.15.176:3300/0 conn(0x7fde300732e0 0x7fde300736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 -- 172.21.15.52:0/2689759056 >> 172.21.15.52:0/2689759056 conn(0x7fde3006d0f0 msgr2=0x7fde3006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 -- 172.21.15.52:0/2689759056 shutdown_connections 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.331+0000 7fde36800640 1 -- 172.21.15.52:0/2689759056 wait complete. 2024-09-10T08:34:26.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.333+0000 7fde36800640 1 Processor -- start 2024-09-10T08:34:26.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.333+0000 7fde36800640 1 -- start start 2024-09-10T08:34:26.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30071c70 0x7fde30157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300732e0 0x7fde301542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde3006bf70 con 0x7fde300cce30 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde3006bdf0 con 0x7fde30071c70 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde36800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde3015c8d0 con 0x7fde300732e0 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57354/0 (socket says 172.21.15.52:57354) 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 -- 172.21.15.52:0/1197037271 learned_addr learned my addr 172.21.15.52:0/1197037271 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde27e00640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300732e0 0x7fde301542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2f400640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30071c70 0x7fde30157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 -- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300732e0 msgr2=0x7fde301542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300732e0 0x7fde301542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 -- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30071c70 msgr2=0x7fde30157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30071c70 0x7fde30157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.334+0000 7fde2fe00640 1 -- 172.21.15.52:0/1197037271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde30151520 con 0x7fde300cce30 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde2fe00640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fde28007e90 tx=0x7fde2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28014420 con 0x7fde300cce30 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde28019070 con 0x7fde300cce30 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28014820 con 0x7fde300cce30 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde30151800 con 0x7fde300cce30 2024-09-10T08:34:26.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.335+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3015ebd0 con 0x7fde300cce30 2024-09-10T08:34:26.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.336+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde301569f0 con 0x7fde300cce30 2024-09-10T08:34:26.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.337+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde280149c0 con 0x7fde300cce30 2024-09-10T08:34:26.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.338+0000 7fde27400640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 0x7fde0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.339+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7fde2808b470 con 0x7fde300cce30 2024-09-10T08:34:26.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.339+0000 7fde2f400640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 0x7fde0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.340+0000 7fde2f400640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 0x7fde0c06e320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fde20006fd0 tx=0x7fde20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.343+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde2805a070 con 0x7fde300cce30 2024-09-10T08:34:26.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.527+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fde300736c0 con 0x7fde300cce30 2024-09-10T08:34:26.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.530+0000 7fde27400640 1 -- 172.21.15.52:0/1197037271 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7fde28059970 con 0x7fde300cce30 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.532+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 msgr2=0x7fde0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.532+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 0x7fde0c06e320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fde20006fd0 tx=0x7fde20008040 comp rx=0 tx=0).stop 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.532+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 msgr2=0x7fde3015d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.532+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fde28007e90 tx=0x7fde2800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 shutdown_connections 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde0c06be60 0x7fde0c06e320 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde300cce30 0x7fde3015d220 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde300732e0 0x7fde301542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 --2- 172.21.15.52:0/1197037271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30071c70 0x7fde30157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 >> 172.21.15.52:0/1197037271 conn(0x7fde3006d0f0 msgr2=0x7fde300cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:26.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 shutdown_connections 2024-09-10T08:34:26.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.533+0000 7fde36800640 1 -- 172.21.15.52:0/1197037271 wait complete. 2024-09-10T08:34:26.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-10T08:34:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.704+0000 7fea78400640 1 Processor -- start 2024-09-10T08:34:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.705+0000 7fea78400640 1 -- start start 2024-09-10T08:34:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea78400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea700b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea78400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea700b4020 con 0x7fea700b5f90 2024-09-10T08:34:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea78400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea700b42c0 con 0x7fea70073180 2024-09-10T08:34:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea78400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea700b45a0 con 0x7fea70145ed0 2024-09-10T08:34:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea76400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fea700b5f90 0x7fea7015cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60918/0 (socket says 172.21.15.52:60918) 2024-09-10T08:34:26.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea76400640 1 -- 172.21.15.52:0/3451340931 learned_addr learned my addr 172.21.15.52:0/3451340931 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.706+0000 7fea75a00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea700b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784831922 0 0) 0x7fea700b4020 con 0x7fea700b5f90 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea58003520 con 0x7fea700b5f90 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887370926 0 0) 0x7fea700b42c0 con 0x7fea70073180 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea700b4020 con 0x7fea70073180 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1290350350 0 0) 0x7fea58003520 con 0x7fea700b5f90 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 msgr2=0x7fea700b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea700b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 >> v1:172.21.15.176:6789/0 conn(0x7fea70073180 legacy=0x7fea700b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea700b4880 con 0x7fea700b5f90 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fea680019f0 con 0x7fea700b5f90 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 >> v1:172.21.15.52:6789/0 conn(0x7fea700b5f90 legacy=0x7fea7015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea58004800 0x7fea58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea700b45a0 con 0x7fea58003b70 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea5800ba70 con 0x7fea58004800 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea5800bc70 con 0x7fea70145ed0 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.707+0000 7fea75a00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea76400640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75000640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea58004800 0x7fea58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75a00640 1 -- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 msgr2=0x7fea580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75a00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea70145ed0 0x7fea580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75a00640 1 -- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea58004800 msgr2=0x7fea58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75a00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea58004800 0x7fea58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.708+0000 7fea75a00640 1 -- 172.21.15.52:0/3451340931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58003520 con 0x7fea58003b70 2024-09-10T08:34:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.709+0000 7fea75a00640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea58003f70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ac0 tx=0x7fea58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43df446c5e8e576f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.709+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64036070 con 0x7fea58003b70 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.709+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea64031400 con 0x7fea58003b70 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.709+0000 7fea6fe00640 1 -- 172.21.15.52:0/3451340931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64009690 con 0x7fea58003b70 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 -- 172.21.15.52:0/3451340931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 msgr2=0x7fea58003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 --2- 172.21.15.52:0/3451340931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea58003f70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ac0 tx=0x7fea58005830 comp rx=0 tx=0).stop 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea76400640 1 -- 172.21.15.52:0/3451340931 reap_dead start 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 -- 172.21.15.52:0/3451340931 shutdown_connections 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 -- 172.21.15.52:0/3451340931 >> 172.21.15.52:0/3451340931 conn(0x7fea700ccec0 msgr2=0x7fea700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 -- 172.21.15.52:0/3451340931 shutdown_connections 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.710+0000 7fea78400640 1 -- 172.21.15.52:0/3451340931 wait complete. 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.711+0000 7fea78400640 1 Processor -- start 2024-09-10T08:34:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.711+0000 7fea78400640 1 -- start start 2024-09-10T08:34:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea700b1d50 0x7fea701f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea701e3510 0x7fea700d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea70146430 con 0x7fea58003b70 2024-09-10T08:34:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea701462b0 con 0x7fea701e3510 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.712+0000 7fea78400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea700b5080 con 0x7fea700b1d50 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57374/0 (socket says 172.21.15.52:57374) 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 -- 172.21.15.52:0/3949396622 learned_addr learned my addr 172.21.15.52:0/3949396622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75000640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea700b1d50 0x7fea701f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea76400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea701e3510 0x7fea700d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 -- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea700b1d50 msgr2=0x7fea701f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea700b1d50 0x7fea701f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 -- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea701e3510 msgr2=0x7fea700d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea701e3510 0x7fea700d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 -- 172.21.15.52:0/3949396622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea701e3d40 con 0x7fea58003b70 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.713+0000 7fea75a00640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fea6402abb0 tx=0x7fea64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.714+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64040020 con 0x7fea58003b70 2024-09-10T08:34:26.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.714+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea64003940 con 0x7fea58003b70 2024-09-10T08:34:26.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.714+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64036040 con 0x7fea58003b70 2024-09-10T08:34:26.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.714+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea701e4020 con 0x7fea58003b70 2024-09-10T08:34:26.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.714+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea701f4d10 con 0x7fea58003b70 2024-09-10T08:34:26.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.715+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea700735c0 con 0x7fea58003b70 2024-09-10T08:34:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.716+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea64043020 con 0x7fea58003b70 2024-09-10T08:34:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.716+0000 7fea6d600640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 0x7fea5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.716+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7fea640aa7f0 con 0x7fea58003b70 2024-09-10T08:34:26.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.717+0000 7fea75000640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 0x7fea5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.718+0000 7fea75000640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 0x7fea5006e320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fea70142a50 tx=0x7fea5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.721+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea64078d00 con 0x7fea58003b70 2024-09-10T08:34:26.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.971+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7fea700c5dd0 con 0x7fea58003b70 2024-09-10T08:34:26.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.984+0000 7fea6d600640 1 -- 172.21.15.52:0/3949396622 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v293) ==== 151+0+0 (secure 0 0 0) 0x7fea6407d000 con 0x7fea58003b70 2024-09-10T08:34:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 msgr2=0x7fea5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 0x7fea5006e320 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fea70142a50 tx=0x7fea5c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 msgr2=0x7fea7015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fea6402abb0 tx=0x7fea64004730 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 shutdown_connections 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea5006be60 0x7fea5006e320 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea701e3510 0x7fea700d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea700b1d50 0x7fea701f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 --2- 172.21.15.52:0/3949396622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea58003b70 0x7fea7015c110 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 >> 172.21.15.52:0/3949396622 conn(0x7fea700ccec0 msgr2=0x7fea7013ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 shutdown_connections 2024-09-10T08:34:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:26.986+0000 7fea78400640 1 -- 172.21.15.52:0/3949396622 wait complete. 2024-09-10T08:34:27.002 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-10T08:34:27.002 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-10T08:34:27.002 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-10T08:34:27.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:27.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.158+0000 7f6332400640 1 Processor -- start 2024-09-10T08:34:27.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.158+0000 7f6332400640 1 -- start start 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.159+0000 7f6332400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f632c073890 0x7f632c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.159+0000 7f6332400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c0b4020 con 0x7f632c145ed0 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f6332400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632c0b42c0 con 0x7f632c0b5880 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f6332400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f632c0b63f0 con 0x7f632c073890 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f632b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f632c145ed0 0x7f632c073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60922/0 (socket says 172.21.15.52:60922) 2024-09-10T08:34:27.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f632b400640 1 -- 172.21.15.52:0/3150826440 learned_addr learned my addr 172.21.15.52:0/3150826440 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f6323e00640 1 --2- 172.21.15.52:0/3150826440 >> v2:172.21.15.176:3300/0 conn(0x7f632c073890 0x7f632c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167364812 0 0) 0x7f632c0b4020 con 0x7f632c145ed0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6310003520 con 0x7f632c145ed0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.160+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2260459325 0 0) 0x7f6310003520 con 0x7f632c145ed0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 >> v2:172.21.15.176:3300/0 conn(0x7f632c073890 msgr2=0x7f632c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 --2- 172.21.15.52:0/3150826440 >> v2:172.21.15.176:3300/0 conn(0x7f632c073890 0x7f632c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 >> v1:172.21.15.176:6789/0 conn(0x7f632c0b5880 legacy=0x7f632c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c0b45a0 con 0x7f632c145ed0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f631c001690 con 0x7f632c145ed0 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 >> v1:172.21.15.52:6789/0 conn(0x7f632c145ed0 legacy=0x7f632c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310003a00 0x7f6310003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 0x7f6310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f631000c090 con 0x7f6310004800 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f631000c240 con 0x7f6310003a00 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f631000c440 con 0x7f63100051c0 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 0x7f6310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632b400640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310003a00 0x7f6310003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632be00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 -- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63100051c0 msgr2=0x7f631000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63100051c0 0x7f631000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 -- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310003a00 msgr2=0x7f6310003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310003a00 0x7f6310003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f6323e00640 1 -- 172.21.15.52:0/3150826440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6310003520 con 0x7f6310004800 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632b400640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310003a00 0x7f6310003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.161+0000 7f632be00640 1 -- 172.21.15.52:0/3150826440 reap_dead start 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.162+0000 7f6323e00640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 0x7f6310004c80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6314009ac0 tx=0x7f6310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3bd9cd3fc4f1be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314036070 con 0x7f6310004800 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6314031400 con 0x7f6310004800 2024-09-10T08:34:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f632aa00640 1 -- 172.21.15.52:0/3150826440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314009690 con 0x7f6310004800 2024-09-10T08:34:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 -- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 msgr2=0x7f6310004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 0x7f6310004c80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6314009ac0 tx=0x7f6310005830 comp rx=0 tx=0).stop 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 -- 172.21.15.52:0/3150826440 shutdown_connections 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 --2- 172.21.15.52:0/3150826440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310004800 0x7f6310004c80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 -- 172.21.15.52:0/3150826440 >> 172.21.15.52:0/3150826440 conn(0x7f632c0ccec0 msgr2=0x7f632c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 -- 172.21.15.52:0/3150826440 shutdown_connections 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.163+0000 7f6332400640 1 -- 172.21.15.52:0/3150826440 wait complete. 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.165+0000 7f6332400640 1 Processor -- start 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.165+0000 7f6332400640 1 -- start start 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310004800 0x7f632c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f632c1407e0 0x7f632c140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1462b0 con 0x7f632c13fba0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0b4b60 con 0x7f6310004800 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6332400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f632c146430 con 0x7f632c1407e0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6323e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6323e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57388/0 (socket says 172.21.15.52:57388) 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f6323e00640 1 -- 172.21.15.52:0/2383735976 learned_addr learned my addr 172.21.15.52:0/2383735976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f632b400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310004800 0x7f632c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.166+0000 7f632be00640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f632c1407e0 0x7f632c140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 -- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f632c1407e0 msgr2=0x7f632c140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f632c1407e0 0x7f632c140c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 -- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310004800 msgr2=0x7f632c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310004800 0x7f632c159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 -- 172.21.15.52:0/2383735976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c159ab0 con 0x7f632c13fba0 2024-09-10T08:34:27.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323e00640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6314009be0 tx=0x7f6314004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314040020 con 0x7f632c13fba0 2024-09-10T08:34:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6314003c40 con 0x7f632c13fba0 2024-09-10T08:34:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314036040 con 0x7f632c13fba0 2024-09-10T08:34:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.167+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c0cb2d0 con 0x7f632c13fba0 2024-09-10T08:34:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.168+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c071e00 con 0x7f632c13fba0 2024-09-10T08:34:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.169+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c0b5080 con 0x7f632c13fba0 2024-09-10T08:34:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.170+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6314043020 con 0x7f632c13fba0 2024-09-10T08:34:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.170+0000 7f6323400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 0x7f630806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.171+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f63140aac00 con 0x7f632c13fba0 2024-09-10T08:34:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.171+0000 7f632b400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 0x7f630806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.172+0000 7f632b400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 0x7f630806e320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f631c001eb0 tx=0x7f631c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.175+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63140b1080 con 0x7f632c13fba0 2024-09-10T08:34:27.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.359+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f632c0d0860 con 0x7f632c13fba0 2024-09-10T08:34:27.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.360+0000 7f6323400640 1 -- 172.21.15.52:0/2383735976 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+13308 (secure 0 0 0) 0x7f631404a070 con 0x7f632c13fba0 2024-09-10T08:34:27.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:27.360 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":100,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:24.979170+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6833/3825724165":"2024-09-11T08:34:21.969593+0000","172.21.15.52:6832/3825724165":"2024-09-11T08:34:21.969593+0000","172.21.15.52:6835/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.52:6833/3249807442":"2024-09-11T08:34:05.808268+0000","172.21.15.176:6836/2093809753":"2024-09-11T08:34:04.811999+0000","172.21.15.176:6834/2093809753":"2024-09-11T08:34:04.811999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 msgr2=0x7f630806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 0x7f630806e320 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f631c001eb0 tx=0x7f631c007040 comp rx=0 tx=0).stop 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 msgr2=0x7f632c0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6314009be0 tx=0x7f6314004730 comp rx=0 tx=0).stop 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 shutdown_connections 2024-09-10T08:34:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f630806be60 0x7f630806e320 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f632c1407e0 0x7f632c140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f632c13fba0 0x7f632c0cad90 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 --2- 172.21.15.52:0/2383735976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6310004800 0x7f632c159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.362+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 >> 172.21.15.52:0/2383735976 conn(0x7f632c0ccec0 msgr2=0x7f632c0cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.363+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 shutdown_connections 2024-09-10T08:34:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.363+0000 7f6332400640 1 -- 172.21.15.52:0/2383735976 wait complete. 2024-09-10T08:34:27.379 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:34:27.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:34:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.538+0000 7f6f8d000640 1 Processor -- start 2024-09-10T08:34:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.538+0000 7f6f8d000640 1 -- start start 2024-09-10T08:34:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f8d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f880cf8d0 0x7f6f88070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f88144a50 0x7f6f88071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f8d000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8815f120 con 0x7f6f880cfcb0 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f8d000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6f88141cd0 con 0x7f6f880cf8d0 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f8d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f88144e70 con 0x7f6f88144a50 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.539+0000 7f6f85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f880cf8d0 0x7f6f88070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f880cf8d0 0x7f6f88070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57394/0 (socket says 172.21.15.52:57394) 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 -- 172.21.15.52:0/97143155 learned_addr learned my addr 172.21.15.52:0/97143155 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f86800640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f88144a50 0x7f6f88071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 -- 172.21.15.52:0/97143155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f88144a50 msgr2=0x7f6f88071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f88144a50 0x7f6f88071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 -- 172.21.15.52:0/97143155 >> v1:172.21.15.176:6789/0 conn(0x7f6f880cfcb0 legacy=0x7f6f88144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.540+0000 7f6f85e00640 1 -- 172.21.15.52:0/97143155 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8815f400 con 0x7f6f880cf8d0 2024-09-10T08:34:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.541+0000 7f6f85e00640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f880cf8d0 0x7f6f88070f40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009870 tx=0x7f6f7802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a66189bc033dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.541+0000 7f6f84a00640 1 -- 172.21.15.52:0/97143155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78037070 con 0x7f6f880cf8d0 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.541+0000 7f6f84a00640 1 -- 172.21.15.52:0/97143155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78032440 con 0x7f6f880cf8d0 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.541+0000 7f6f84a00640 1 -- 172.21.15.52:0/97143155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78032810 con 0x7f6f880cf8d0 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 -- 172.21.15.52:0/97143155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f880cf8d0 msgr2=0x7f6f88070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f880cf8d0 0x7f6f88070f40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009870 tx=0x7f6f7802a250 comp rx=0 tx=0).stop 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 -- 172.21.15.52:0/97143155 shutdown_connections 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f88144a50 0x7f6f88071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 --2- 172.21.15.52:0/97143155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f880cf8d0 0x7f6f88070f40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 -- 172.21.15.52:0/97143155 >> 172.21.15.52:0/97143155 conn(0x7f6f8806d0f0 msgr2=0x7f6f8806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 -- 172.21.15.52:0/97143155 shutdown_connections 2024-09-10T08:34:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.542+0000 7f6f8d000640 1 -- 172.21.15.52:0/97143155 wait complete. 2024-09-10T08:34:27.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.544+0000 7f6f8d000640 1 Processor -- start 2024-09-10T08:34:27.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.544+0000 7f6f8d000640 1 -- start start 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f880cf8d0 0x7f6f8813ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f880cfcb0 0x7f6f881e95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8815ee30 con 0x7f6f88144a50 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8815f9c0 con 0x7f6f880cf8d0 2024-09-10T08:34:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f8d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f880ce0f0 con 0x7f6f880cfcb0 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57410/0 (socket says 172.21.15.52:57410) 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 -- 172.21.15.52:0/2908428476 learned_addr learned my addr 172.21.15.52:0/2908428476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f85e00640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f880cf8d0 0x7f6f8813ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f85400640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f880cfcb0 0x7f6f881e95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 -- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f880cfcb0 msgr2=0x7f6f881e95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f880cfcb0 0x7f6f881e95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 -- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f880cf8d0 msgr2=0x7f6f8813ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f880cf8d0 0x7f6f8813ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.545+0000 7f6f86800640 1 -- 172.21.15.52:0/2908428476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f881404d0 con 0x7f6f88144a50 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f86800640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007e60 tx=0x7f6f8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80014420 con 0x7f6f88144a50 2024-09-10T08:34:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f80019070 con 0x7f6f88144a50 2024-09-10T08:34:27.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80014820 con 0x7f6f88144a50 2024-09-10T08:34:27.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f880c9970 con 0x7f6f88144a50 2024-09-10T08:34:27.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.546+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f880c9f30 con 0x7f6f88144a50 2024-09-10T08:34:27.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.547+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8806f8e0 con 0x7f6f88144a50 2024-09-10T08:34:27.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.548+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f800149c0 con 0x7f6f88144a50 2024-09-10T08:34:27.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.549+0000 7f6f7e000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 0x7f6f6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.549+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f6f8008b2d0 con 0x7f6f88144a50 2024-09-10T08:34:27.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.549+0000 7f6f85e00640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 0x7f6f6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.550+0000 7f6f85e00640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 0x7f6f6806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6f78034000 tx=0x7f6f7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.553+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f8806f8e0 con 0x7f6f88144a50 2024-09-10T08:34:27.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.736+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f8806f260 con 0x7f6f88144a50 2024-09-10T08:34:27.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.736+0000 7f6f7e000640 1 -- 172.21.15.52:0/2908428476 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7f6f80059870 con 0x7f6f88144a50 2024-09-10T08:34:27.737 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:34:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 msgr2=0x7f6f6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 0x7f6f6806e2f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6f78034000 tx=0x7f6f7802e000 comp rx=0 tx=0).stop 2024-09-10T08:34:27.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 msgr2=0x7f6f881f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6f80007e60 tx=0x7f6f8000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 shutdown_connections 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f6806be30 0x7f6f6806e2f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f88144a50 0x7f6f881f4d60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f880cfcb0 0x7f6f881e95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 --2- 172.21.15.52:0/2908428476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f880cf8d0 0x7f6f8813ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 >> 172.21.15.52:0/2908428476 conn(0x7f6f8806d0f0 msgr2=0x7f6f88142200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 shutdown_connections 2024-09-10T08:34:27.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.739+0000 7f6f8d000640 1 -- 172.21.15.52:0/2908428476 wait complete. 2024-09-10T08:34:27.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-10T08:34:27.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.911+0000 7f6970200640 1 Processor -- start 2024-09-10T08:34:27.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.911+0000 7f6970200640 1 -- start start 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f6970200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69680b2d40 0x7f696806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f6970200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6968071180 con 0x7f696813eb20 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f6970200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6968071460 con 0x7f696806c150 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f6970200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6968071ab0 con 0x7f69680b2d40 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69680b2d40 0x7f696806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f69680b2d40 0x7f696806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57424/0 (socket says 172.21.15.52:57424) 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696d800640 1 -- 172.21.15.52:0/540528428 learned_addr learned my addr 172.21.15.52:0/540528428 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696ce00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f696813eb20 0x7f696815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60926/0 (socket says 172.21.15.52:60926) 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696d800640 1 -- 172.21.15.52:0/540528428 >> v1:172.21.15.176:6789/0 conn(0x7f696806c150 legacy=0x7f6968071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f696d800640 1 -- 172.21.15.52:0/540528428 >> v1:172.21.15.52:6789/0 conn(0x7f696813eb20 legacy=0x7f696815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.913+0000 7f6967e00640 1 -- 172.21.15.52:0/540528428 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124489241 0 0) 0x7f6968071180 con 0x7f696813eb20 2024-09-10T08:34:27.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.914+0000 7f696d800640 1 -- 172.21.15.52:0/540528428 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6968071740 con 0x7f69680b2d40 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f696d800640 1 --2- 172.21.15.52:0/540528428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696806bc10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e87cdec51a1ecd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6967e00640 1 -- 172.21.15.52:0/540528428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c037070 con 0x7f69680b2d40 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6967e00640 1 -- 172.21.15.52:0/540528428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695c02ae50 con 0x7f69680b2d40 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6967e00640 1 -- 172.21.15.52:0/540528428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c032860 con 0x7f69680b2d40 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 -- 172.21.15.52:0/540528428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 msgr2=0x7f696806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 --2- 172.21.15.52:0/540528428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696806bc10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c02a300 comp rx=0 tx=0).stop 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 -- 172.21.15.52:0/540528428 shutdown_connections 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 --2- 172.21.15.52:0/540528428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696806bc10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 -- 172.21.15.52:0/540528428 >> 172.21.15.52:0/540528428 conn(0x7f69680ccec0 msgr2=0x7f69680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 -- 172.21.15.52:0/540528428 shutdown_connections 2024-09-10T08:34:27.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.915+0000 7f6970200640 1 -- 172.21.15.52:0/540528428 wait complete. 2024-09-10T08:34:27.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.917+0000 7f6970200640 1 Processor -- start 2024-09-10T08:34:27.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.917+0000 7f6970200640 1 -- start start 2024-09-10T08:34:27.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f696806c150 0x7f696815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 0x7f696815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f696815c7d0 con 0x7f69680b2d40 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f696815c650 con 0x7f696806c150 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f6970200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6968072650 con 0x7f696813eb20 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f696ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f696ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57430/0 (socket says 172.21.15.52:57430) 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f696ce00640 1 -- 172.21.15.52:0/893439766 learned_addr learned my addr 172.21.15.52:0/893439766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f696d800640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f696806c150 0x7f696815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.918+0000 7f696e200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 0x7f696815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 -- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 msgr2=0x7f696815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 0x7f696815f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 -- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f696806c150 msgr2=0x7f696815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f696806c150 0x7f696815e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 -- 172.21.15.52:0/893439766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696815d0f0 con 0x7f69680b2d40 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696e200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 0x7f696815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f696ce00640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f695400c3f0 tx=0x7f695400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69540074e0 con 0x7f69680b2d40 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69540047e0 con 0x7f69680b2d40 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696815d3d0 con 0x7f69680b2d40 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954004bd0 con 0x7f69680b2d40 2024-09-10T08:34:27.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.919+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696815d990 con 0x7f69680b2d40 2024-09-10T08:34:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.921+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696806bc10 con 0x7f69680b2d40 2024-09-10T08:34:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.921+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6954011070 con 0x7f69680b2d40 2024-09-10T08:34:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.923+0000 7f6965600640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.923+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f695408a780 con 0x7f69680b2d40 2024-09-10T08:34:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.923+0000 7f696d800640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.924+0000 7f696d800640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 0x7f694806e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f695c034000 tx=0x7f695c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:27.927+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6954059370 con 0x7f69680b2d40 2024-09-10T08:34:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.178+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f696806c9c0 con 0x7f69680b2d40 2024-09-10T08:34:28.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.991+0000 7f6965600640 1 -- 172.21.15.52:0/893439766 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v295) ==== 161+0+0 (secure 0 0 0) 0x7f695405f070 con 0x7f69680b2d40 2024-09-10T08:34:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 msgr2=0x7f694806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 0x7f694806e2f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f695c034000 tx=0x7f695c02e000 comp rx=0 tx=0).stop 2024-09-10T08:34:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 msgr2=0x7f696813e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f695400c3f0 tx=0x7f695400c8b0 comp rx=0 tx=0).stop 2024-09-10T08:34:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 shutdown_connections 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f694806be30 0x7f694806e2f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f696813eb20 0x7f696815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69680b2d40 0x7f696813e110 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 --2- 172.21.15.52:0/893439766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f696806c150 0x7f696815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 >> 172.21.15.52:0/893439766 conn(0x7f69680ccec0 msgr2=0x7f6968144700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 shutdown_connections 2024-09-10T08:34:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:28.994+0000 7f6970200640 1 -- 172.21.15.52:0/893439766 wait complete. 2024-09-10T08:34:29.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:34:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.176+0000 7f4254e00640 1 Processor -- start 2024-09-10T08:34:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.176+0000 7f4254e00640 1 -- start start 2024-09-10T08:34:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.177+0000 7f4254e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42500cee10 0x7f425006e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.177+0000 7f4254e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42500cfb90 0x7f42501682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.177+0000 7f4254e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425015ebb0 con 0x7f425015e7d0 2024-09-10T08:34:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.177+0000 7f4254e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f425006f0a0 con 0x7f42500cee10 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.177+0000 7f4254e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f42500cf820 con 0x7f42500cfb90 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42500cee10 0x7f425006e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42500cee10 0x7f425006e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57436/0 (socket says 172.21.15.52:57436) 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f425015e7d0 0x7f42500ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60938/0 (socket says 172.21.15.52:60938) 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 -- 172.21.15.52:0/118658339 learned_addr learned my addr 172.21.15.52:0/118658339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424fe00640 1 --2- 172.21.15.52:0/118658339 >> v2:172.21.15.176:3300/0 conn(0x7f42500cfb90 0x7f42501682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 -- 172.21.15.52:0/118658339 >> v2:172.21.15.176:3300/0 conn(0x7f42500cfb90 msgr2=0x7f42501682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 --2- 172.21.15.52:0/118658339 >> v2:172.21.15.176:3300/0 conn(0x7f42500cfb90 0x7f42501682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 -- 172.21.15.52:0/118658339 >> v1:172.21.15.52:6789/0 conn(0x7f425015e7d0 legacy=0x7f42500ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.178+0000 7f424ea00640 1 -- 172.21.15.52:0/118658339 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42500aff40 con 0x7f42500cee10 2024-09-10T08:34:29.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.179+0000 7f424ea00640 1 --2- 172.21.15.52:0/118658339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cee10 0x7f425006e200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f425006c970 tx=0x7f423c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4231a4808a4722 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.179+0000 7f424e000640 1 -- 172.21.15.52:0/118658339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c037070 con 0x7f42500cee10 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.179+0000 7f424e000640 1 -- 172.21.15.52:0/118658339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423c032440 con 0x7f42500cee10 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.179+0000 7f424e000640 1 -- 172.21.15.52:0/118658339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c032810 con 0x7f42500cee10 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 -- 172.21.15.52:0/118658339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cee10 msgr2=0x7f425006e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 --2- 172.21.15.52:0/118658339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cee10 0x7f425006e200 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f425006c970 tx=0x7f423c02a2a0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 -- 172.21.15.52:0/118658339 shutdown_connections 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 --2- 172.21.15.52:0/118658339 >> v2:172.21.15.176:3300/0 conn(0x7f42500cfb90 0x7f42501682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 --2- 172.21.15.52:0/118658339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cee10 0x7f425006e200 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 -- 172.21.15.52:0/118658339 >> 172.21.15.52:0/118658339 conn(0x7f4250067f80 msgr2=0x7f425006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 -- 172.21.15.52:0/118658339 shutdown_connections 2024-09-10T08:34:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.180+0000 7f4254e00640 1 -- 172.21.15.52:0/118658339 wait complete. 2024-09-10T08:34:29.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.182+0000 7f4254e00640 1 Processor -- start 2024-09-10T08:34:29.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.182+0000 7f4254e00640 1 -- start start 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42500cee10 0x7f42500b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 0x7f4250150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f425006edc0 con 0x7f42500cfb90 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f425006eae0 con 0x7f425015e7d0 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f4254e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42500aea10 con 0x7f42500cee10 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57450/0 (socket says 172.21.15.52:57450) 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 -- 172.21.15.52:0/4160944023 learned_addr learned my addr 172.21.15.52:0/4160944023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424f400640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42500cee10 0x7f42500b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424fe00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 0x7f4250150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 -- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42500cee10 msgr2=0x7f42500b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42500cee10 0x7f42500b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 -- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 msgr2=0x7f4250150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 0x7f4250150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424ea00640 1 -- 172.21.15.52:0/4160944023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4250154430 con 0x7f42500cfb90 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.183+0000 7f424fe00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 0x7f4250150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f424ea00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c041020 con 0x7f42500cfb90 2024-09-10T08:34:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423c0306c0 con 0x7f42500cfb90 2024-09-10T08:34:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c037040 con 0x7f42500cfb90 2024-09-10T08:34:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4250154710 con 0x7f42500cfb90 2024-09-10T08:34:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.184+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4250154cd0 con 0x7f42500cfb90 2024-09-10T08:34:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.185+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4250071180 con 0x7f42500cfb90 2024-09-10T08:34:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.186+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f423c044020 con 0x7f42500cfb90 2024-09-10T08:34:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.187+0000 7f4247400640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 0x7f423006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.187+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f423c0ab410 con 0x7f42500cfb90 2024-09-10T08:34:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.187+0000 7f424f400640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 0x7f423006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.188+0000 7f424f400640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 0x7f423006e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4240007fd0 tx=0x7f4240007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.191+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f423c04b030 con 0x7f42500cfb90 2024-09-10T08:34:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.374+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f425015aee0 con 0x7f42500cfb90 2024-09-10T08:34:29.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.377+0000 7f4247400640 1 -- 172.21.15.52:0/4160944023 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f423c07a000 con 0x7f42500cfb90 2024-09-10T08:34:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 msgr2=0x7f423006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 0x7f423006e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4240007fd0 tx=0x7f4240007c40 comp rx=0 tx=0).stop 2024-09-10T08:34:29.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 msgr2=0x7f42501f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 shutdown_connections 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423006be60 0x7f423006e320 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f425015e7d0 0x7f4250150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42500cfb90 0x7f42501f4680 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 --2- 172.21.15.52:0/4160944023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42500cee10 0x7f42500b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 >> 172.21.15.52:0/4160944023 conn(0x7f4250067f80 msgr2=0x7f425015b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 shutdown_connections 2024-09-10T08:34:29.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.380+0000 7f4254e00640 1 -- 172.21.15.52:0/4160944023 wait complete. 2024-09-10T08:34:29.396 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:34:29.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:34:29.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:34:29.571 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:34:29.571 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:29.571 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:29.607 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:34:29.607 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:34:29.607 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:29.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:34:29.644 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:29.644 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:29.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:34:29.682 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:34:29.682 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:29.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:34:29.720 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:34:29.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:29.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.877+0000 7f770b800640 1 Processor -- start 2024-09-10T08:34:29.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.877+0000 7f770b800640 1 -- start start 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f770b800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7704145ed0 0x7f77040b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f770b800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77040b5f90 0x7f77040735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f770b800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77040b4020 con 0x7f7704073180 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f770b800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7704073b00 con 0x7f7704145ed0 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f770b800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f77040b42c0 con 0x7f77040b5f90 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f7703e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7704073180 0x7f77040b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60950/0 (socket says 172.21.15.52:60950) 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.878+0000 7f7703e00640 1 -- 172.21.15.52:0/1270576468 learned_addr learned my addr 172.21.15.52:0/1270576468 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7708e00640 1 --2- 172.21.15.52:0/1270576468 >> v2:172.21.15.176:3300/0 conn(0x7f7704145ed0 0x7f77040b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7709800640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77040b5f90 0x7f77040735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7703400640 1 -- 172.21.15.52:0/1270576468 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54709714 0 0) 0x7f77040b4020 con 0x7f7704073180 2024-09-10T08:34:29.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7703400640 1 -- 172.21.15.52:0/1270576468 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76ec003520 con 0x7f7704073180 2024-09-10T08:34:29.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7708e00640 1 -- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77040b5f90 msgr2=0x7f77040735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:29.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7708e00640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77040b5f90 0x7f77040735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7708e00640 1 -- 172.21.15.52:0/1270576468 >> v1:172.21.15.52:6789/0 conn(0x7f7704073180 legacy=0x7f77040b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.879+0000 7f7708e00640 1 -- 172.21.15.52:0/1270576468 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77040b45a0 con 0x7f7704145ed0 2024-09-10T08:34:29.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.880+0000 7f7708e00640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704145ed0 0x7f77040b5080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7704073c80 tx=0x7f76f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0874344dea8e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.880+0000 7f7703400640 1 -- 172.21.15.52:0/1270576468 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8037070 con 0x7f7704145ed0 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.880+0000 7f7703400640 1 -- 172.21.15.52:0/1270576468 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f8032440 con 0x7f7704145ed0 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.880+0000 7f7703400640 1 -- 172.21.15.52:0/1270576468 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8032810 con 0x7f7704145ed0 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 -- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704145ed0 msgr2=0x7f77040b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704145ed0 0x7f77040b5080 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7704073c80 tx=0x7f76f802a180 comp rx=0 tx=0).stop 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 -- 172.21.15.52:0/1270576468 shutdown_connections 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77040b5f90 0x7f77040735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 --2- 172.21.15.52:0/1270576468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704145ed0 0x7f77040b5080 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 -- 172.21.15.52:0/1270576468 >> 172.21.15.52:0/1270576468 conn(0x7f77040ccec0 msgr2=0x7f77040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 -- 172.21.15.52:0/1270576468 shutdown_connections 2024-09-10T08:34:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.881+0000 7f770b800640 1 -- 172.21.15.52:0/1270576468 wait complete. 2024-09-10T08:34:29.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.883+0000 7f770b800640 1 Processor -- start 2024-09-10T08:34:29.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.883+0000 7f770b800640 1 -- start start 2024-09-10T08:34:29.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704073180 0x7f77041f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7704145ed0 0x7f7704072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77041462b0 con 0x7f77040b5f90 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f77040b4b60 con 0x7f7704073180 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f770b800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7704146430 con 0x7f7704145ed0 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f7703e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f7703e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57462/0 (socket says 172.21.15.52:57462) 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f7703e00640 1 -- 172.21.15.52:0/2831521846 learned_addr learned my addr 172.21.15.52:0/2831521846 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f7708e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704073180 0x7f77041f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.884+0000 7f7709800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7704145ed0 0x7f7704072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 -- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7704145ed0 msgr2=0x7f7704072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7704145ed0 0x7f7704072270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 -- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704073180 msgr2=0x7f77041f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704073180 0x7f77041f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 -- 172.21.15.52:0/2831521846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7704154ac0 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7703e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f76f00010e0 tx=0x7f76f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0017070 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f0005d00 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77041f51e0 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00072b0 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.885+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77041f54c0 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.886+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77040735c0 con 0x7f77040b5f90 2024-09-10T08:34:29.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.887+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76f001a070 con 0x7f77040b5f90 2024-09-10T08:34:29.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.889+0000 7f7700c00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:29.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.889+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7f76f0089fb0 con 0x7f77040b5f90 2024-09-10T08:34:29.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.889+0000 7f7708e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:29.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.890+0000 7f7708e00640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f76f8034000 tx=0x7f76f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:29.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:29.893+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76f0058550 con 0x7f77040b5f90 2024-09-10T08:34:30.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.118+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7704071250 con 0x7f77040b5f90 2024-09-10T08:34:30.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.119+0000 7f7700c00640 1 -- 172.21.15.52:0/2831521846 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+3914 (secure 0 0 0) 0x7f76f005c850 con 0x7f77040b5f90 2024-09-10T08:34:30.119 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:30.120 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"btime":"2024-09-10T08:34:22:972016+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6871,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/886975630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":886975630},{"type":"v1","addr":"172.21.15.176:6835","nonce":886975630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/4108974823","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":4108974823},{"type":"v1","addr":"172.21.15.176:6837","nonce":4108974823}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1447399401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":1447399401},{"type":"v1","addr":"172.21.15.52:6835","nonce":1447399401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2680233531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2680233531},{"type":"v1","addr":"172.21.15.52:6833","nonce":2680233531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-09-10T08:34:30.120 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 77 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 msgr2=0x7f76e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f76f8034000 tx=0x7f76f802e000 comp rx=0 tx=0).stop 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 msgr2=0x7f7704071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f76f00010e0 tx=0x7f76f000c960 comp rx=0 tx=0).stop 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 shutdown_connections 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7704145ed0 0x7f7704072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77040b5f90 0x7f7704071d30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 --2- 172.21.15.52:0/2831521846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7704073180 0x7f77041f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.121+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 >> 172.21.15.52:0/2831521846 conn(0x7f77040ccec0 msgr2=0x7f77040cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:30.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.122+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 shutdown_connections 2024-09-10T08:34:30.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.122+0000 7f770b800640 1 -- 172.21.15.52:0/2831521846 wait complete. 2024-09-10T08:34:30.139 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:34:30.140 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:34:30.140 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:34:30.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:30.140 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:34:30.140 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:34:30.140 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:34:30.141 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:30.141 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:34:30.141 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:34:30.141 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:34:30.141 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:30.141 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:34:30.141 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:34:30.142 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:34:30.142 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:34:30.154 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:34:30.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:34:30.155 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:34:30.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:34:30.156 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:34:30.157 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:34:30.157 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:34:30.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:34:30.198 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:34:30.198 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:30.200 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:34:30.200 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:30.201 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:34:30.201 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:30.203 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:34:30.203 DEBUG:teuthology.parallel:result is None 2024-09-10T08:34:30.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:34:30.330 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:34:30.332 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:34:30.333 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:34:30.333 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:34:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.368+0000 7fca84c00640 1 Processor -- start 2024-09-10T08:34:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.368+0000 7fca84c00640 1 -- start start 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca84c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca8015eab0 0x7fca8015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca84c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fca800b66b0 0x7fca800b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca84c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca800b7000 con 0x7fca80162490 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca84c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fca8015f570 con 0x7fca8015eab0 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca84c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fca8015f850 con 0x7fca800b66b0 2024-09-10T08:34:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca7de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca8015eab0 0x7fca8015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca7d400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca80162490 0x7fca800d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60976/0 (socket says 172.21.15.52:60976) 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.369+0000 7fca7d400640 1 -- 172.21.15.52:0/2627240705 learned_addr learned my addr 172.21.15.52:0/2627240705 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7e800640 1 --2- 172.21.15.52:0/2627240705 >> v2:172.21.15.176:3300/0 conn(0x7fca800b66b0 0x7fca800b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7de00640 1 -- 172.21.15.52:0/2627240705 >> v2:172.21.15.176:3300/0 conn(0x7fca800b66b0 msgr2=0x7fca800b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7de00640 1 --2- 172.21.15.52:0/2627240705 >> v2:172.21.15.176:3300/0 conn(0x7fca800b66b0 0x7fca800b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7de00640 1 -- 172.21.15.52:0/2627240705 >> v1:172.21.15.52:6789/0 conn(0x7fca80162490 legacy=0x7fca800d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7de00640 1 -- 172.21.15.52:0/2627240705 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8015fb30 con 0x7fca8015eab0 2024-09-10T08:34:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.370+0000 7fca7ca00640 1 -- 172.21.15.52:0/2627240705 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626773684 0 0) 0x7fca6c001110 con 0x7fca80162490 2024-09-10T08:34:30.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.371+0000 7fca7de00640 1 --2- 172.21.15.52:0/2627240705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca8015eab0 0x7fca8015ee90 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fca8008d8c0 tx=0x7fca7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24432634d7f6912b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:30.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.371+0000 7fca7ca00640 1 -- 172.21.15.52:0/2627240705 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70037070 con 0x7fca8015eab0 2024-09-10T08:34:30.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.371+0000 7fca7ca00640 1 -- 172.21.15.52:0/2627240705 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca70032440 con 0x7fca8015eab0 2024-09-10T08:34:30.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.371+0000 7fca7ca00640 1 -- 172.21.15.52:0/2627240705 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70032810 con 0x7fca8015eab0 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 -- 172.21.15.52:0/2627240705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca8015eab0 msgr2=0x7fca8015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 --2- 172.21.15.52:0/2627240705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca8015eab0 0x7fca8015ee90 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fca8008d8c0 tx=0x7fca7002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 -- 172.21.15.52:0/2627240705 shutdown_connections 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 --2- 172.21.15.52:0/2627240705 >> v2:172.21.15.176:3300/0 conn(0x7fca800b66b0 0x7fca800b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 --2- 172.21.15.52:0/2627240705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca8015eab0 0x7fca8015ee90 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 -- 172.21.15.52:0/2627240705 >> 172.21.15.52:0/2627240705 conn(0x7fca800d16d0 msgr2=0x7fca800d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 -- 172.21.15.52:0/2627240705 shutdown_connections 2024-09-10T08:34:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.372+0000 7fca84c00640 1 -- 172.21.15.52:0/2627240705 wait complete. 2024-09-10T08:34:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.373+0000 7fca84c00640 1 Processor -- start 2024-09-10T08:34:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.374+0000 7fca84c00640 1 -- start start 2024-09-10T08:34:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.374+0000 7fca84c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca84c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca8015eab0 0x7fca8015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca84c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca80162490 0x7fca800cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca84c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca800d4460 con 0x7fca800b66b0 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca84c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca800cef20 con 0x7fca80162490 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca84c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca800d45e0 con 0x7fca8015eab0 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57518/0 (socket says 172.21.15.52:57518) 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 -- 172.21.15.52:0/3976708748 learned_addr learned my addr 172.21.15.52:0/3976708748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7d400640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca8015eab0 0x7fca8015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7e800640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca80162490 0x7fca800cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 -- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca8015eab0 msgr2=0x7fca8015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca8015eab0 0x7fca8015c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 -- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca80162490 msgr2=0x7fca800cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca80162490 0x7fca800cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.375+0000 7fca7de00640 1 -- 172.21.15.52:0/3976708748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8015abb0 con 0x7fca800b66b0 2024-09-10T08:34:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca7de00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fca70009890 tx=0x7fca700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70037040 con 0x7fca800b66b0 2024-09-10T08:34:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca70042070 con 0x7fca800b66b0 2024-09-10T08:34:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70030960 con 0x7fca800b66b0 2024-09-10T08:34:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8015ae90 con 0x7fca800b66b0 2024-09-10T08:34:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.376+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8015b450 con 0x7fca800b66b0 2024-09-10T08:34:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.378+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca800b6ac0 con 0x7fca800b66b0 2024-09-10T08:34:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.379+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca70030b00 con 0x7fca800b66b0 2024-09-10T08:34:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.380+0000 7fca76000640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 0x7fca6006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:30.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.380+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5115+0+0 (secure 0 0 0) 0x7fca700abee0 con 0x7fca800b66b0 2024-09-10T08:34:30.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.381+0000 7fca7d400640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 0x7fca6006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:30.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.382+0000 7fca7d400640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 0x7fca6006e3f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca801f7b20 tx=0x7fca6c007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:30.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.386+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca7007a470 con 0x7fca800b66b0 2024-09-10T08:34:30.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:30.583+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fca800ba7b0 con 0x7fca800b66b0 2024-09-10T08:34:31.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.396+0000 7fca76000640 1 -- 172.21.15.52:0/3976708748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) ==== 97+0+0 (secure 0 0 0) 0x7fca7007e770 con 0x7fca800b66b0 2024-09-10T08:34:31.397 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:34:31.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 msgr2=0x7fca6006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 0x7fca6006e3f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fca801f7b20 tx=0x7fca6c007b50 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 msgr2=0x7fca8015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fca70009890 tx=0x7fca700046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 shutdown_connections 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca6006bf30 0x7fca6006e3f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca80162490 0x7fca800cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca8015eab0 0x7fca8015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 --2- 172.21.15.52:0/3976708748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca800b66b0 0x7fca8015a560 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 >> 172.21.15.52:0/3976708748 conn(0x7fca800d16d0 msgr2=0x7fca8006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 shutdown_connections 2024-09-10T08:34:31.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.399+0000 7fca84c00640 1 -- 172.21.15.52:0/3976708748 wait complete. 2024-09-10T08:34:31.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:34:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.574+0000 7f0df1800640 1 Processor -- start 2024-09-10T08:34:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.574+0000 7f0df1800640 1 -- start start 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0df1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0df1800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0dec06c150 0x7f0dec15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0df1800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dec071180 con 0x7f0dec13eb20 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0df1800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0dec071ab0 con 0x7f0dec06c150 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0df1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec071460 con 0x7f0dec0b2d40 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0de2000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0dec13eb20 0x7f0dec15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60980/0 (socket says 172.21.15.52:60980) 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0de2000640 1 -- 172.21.15.52:0/1232489709 learned_addr learned my addr 172.21.15.52:0/1232489709 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0deb400640 1 --2- 172.21.15.52:0/1232489709 >> v2:172.21.15.176:3300/0 conn(0x7f0dec06c150 0x7f0dec15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0deaa00640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202854807 0 0) 0x7f0dec071180 con 0x7f0dec13eb20 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.576+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd0005730 con 0x7f0dec13eb20 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1152955353 0 0) 0x7f0dd0005730 con 0x7f0dec13eb20 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 msgr2=0x7f0dec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dec06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 >> v2:172.21.15.176:3300/0 conn(0x7f0dec06c150 msgr2=0x7f0dec15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 --2- 172.21.15.52:0/1232489709 >> v2:172.21.15.176:3300/0 conn(0x7f0dec06c150 0x7f0dec15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec071740 con 0x7f0dec13eb20 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f0dd4001670 con 0x7f0dec13eb20 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 >> v1:172.21.15.52:6789/0 conn(0x7f0dec13eb20 legacy=0x7f0dec15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dd0005bc0 0x7f0dd0006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dd0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0006590 0x7f0dd0006f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec071ab0 con 0x7f0dd0005bc0 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec071460 con 0x7f0dd0006590 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd00077f0 con 0x7f0dec0b2d40 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0deaa00640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dd0005bc0 0x7f0dd0006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0de2000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dd0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.577+0000 7f0deb400640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0006590 0x7f0dd0006f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deaa00640 1 -- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 msgr2=0x7f0dd0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deaa00640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dd0006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deaa00640 1 -- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0006590 msgr2=0x7f0dd0006f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deaa00640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0006590 0x7f0dd0006f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deaa00640 1 -- 172.21.15.52:0/1232489709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd0005730 con 0x7f0dd0005bc0 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0deb400640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0006590 0x7f0dd0006f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.578+0000 7f0de2000640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec0b2d40 0x7f0dd0006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0deaa00640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dd0005bc0 0x7f0dd0006000 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009ac0 tx=0x7f0dd0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e559994ca55c3301 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc036070 con 0x7f0dd0005bc0 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc031400 con 0x7f0dd0005bc0 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0dea000640 1 -- 172.21.15.52:0/1232489709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc009690 con 0x7f0dd0005bc0 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0df1800640 1 -- 172.21.15.52:0/1232489709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dd0005bc0 msgr2=0x7f0dd0006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0df1800640 1 --2- 172.21.15.52:0/1232489709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dd0005bc0 0x7f0dd0006000 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009ac0 tx=0x7f0dd0007a40 comp rx=0 tx=0).stop 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0deb400640 1 -- 172.21.15.52:0/1232489709 reap_dead start 2024-09-10T08:34:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0df1800640 1 -- 172.21.15.52:0/1232489709 shutdown_connections 2024-09-10T08:34:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.579+0000 7f0df1800640 1 -- 172.21.15.52:0/1232489709 >> 172.21.15.52:0/1232489709 conn(0x7f0dec0ccec0 msgr2=0x7f0dec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.580+0000 7f0df1800640 1 -- 172.21.15.52:0/1232489709 shutdown_connections 2024-09-10T08:34:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.580+0000 7f0df1800640 1 -- 172.21.15.52:0/1232489709 wait complete. 2024-09-10T08:34:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.581+0000 7f0df1800640 1 Processor -- start 2024-09-10T08:34:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.581+0000 7f0df1800640 1 -- start start 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0005bc0 0x7f0dec15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec13de50 0x7f0dec15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec06bfa0 con 0x7f0dec13e2d0 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec06be20 con 0x7f0dd0005bc0 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0df1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec071f40 con 0x7f0dec13de50 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.582+0000 7f0deb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57524/0 (socket says 172.21.15.52:57524) 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 -- 172.21.15.52:0/343161658 learned_addr learned my addr 172.21.15.52:0/343161658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0de2000640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec13de50 0x7f0dec15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deaa00640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0005bc0 0x7f0dec15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 -- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec13de50 msgr2=0x7f0dec15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec13de50 0x7f0dec15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 -- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0005bc0 msgr2=0x7f0dec15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0005bc0 0x7f0dec15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 -- 172.21.15.52:0/343161658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec15b800 con 0x7f0dec13e2d0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.583+0000 7f0deb400640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0dec159590 tx=0x7f0de4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.584+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de401a030 con 0x7f0dec13e2d0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.584+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4010d80 con 0x7f0dec13e2d0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.584+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4003bd0 con 0x7f0dec13e2d0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.584+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec15bae0 con 0x7f0dec13e2d0 2024-09-10T08:34:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.584+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec15c0a0 con 0x7f0dec13e2d0 2024-09-10T08:34:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.585+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec072370 con 0x7f0dec13e2d0 2024-09-10T08:34:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.586+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0de401d070 con 0x7f0dec13e2d0 2024-09-10T08:34:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.587+0000 7f0de3400640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 0x7f0dc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.587+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 4857+0+0 (secure 0 0 0) 0x7f0de408af60 con 0x7f0dec13e2d0 2024-09-10T08:34:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.587+0000 7f0deaa00640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 0x7f0dc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:31.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.588+0000 7f0deaa00640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 0x7f0dc806e320 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc033000 tx=0x7f0ddc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:31.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.591+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0de4059600 con 0x7f0dec13e2d0 2024-09-10T08:34:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.849+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0dec06c9c0 con 0x7f0dec13e2d0 2024-09-10T08:34:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.849+0000 7f0de3400640 1 -- 172.21.15.52:0/343161658 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f0de405d900 con 0x7f0dec13e2d0 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:34:31.850 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.851 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:34:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.854 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:34:31.855 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.856 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:34:31.857 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.858 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:34:31.859 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.860 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:34:31.861 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.862 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:34:31.863 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:34:31.864 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.864 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:31.864 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:34:31.864 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 msgr2=0x7f0dc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 0x7f0dc806e320 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc033000 tx=0x7f0ddc008030 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 msgr2=0x7f0dec15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f0dec159590 tx=0x7f0de4010590 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 shutdown_connections 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0dc806be60 0x7f0dc806e320 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dec13e2d0 0x7f0dec15e460 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0dec13de50 0x7f0dec15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 --2- 172.21.15.52:0/343161658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0dd0005bc0 0x7f0dec15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 >> 172.21.15.52:0/343161658 conn(0x7f0dec0ccec0 msgr2=0x7f0dec156120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:31.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 shutdown_connections 2024-09-10T08:34:31.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:31.852+0000 7f0df1800640 1 -- 172.21.15.52:0/343161658 wait complete. 2024-09-10T08:34:31.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:34:32.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.026+0000 7fec81800640 1 Processor -- start 2024-09-10T08:34:32.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.026+0000 7fec81800640 1 -- start start 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.027+0000 7fec81800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec7c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.027+0000 7fec81800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c071180 con 0x7fec7c13eb20 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.027+0000 7fec81800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c071460 con 0x7fec7c06c150 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.027+0000 7fec81800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c071ab0 con 0x7fec7c0b2d40 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec72000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fec7c13eb20 0x7fec7c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60994/0 (socket says 172.21.15.52:60994) 2024-09-10T08:34:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec72000640 1 -- 172.21.15.52:0/4077748215 learned_addr learned my addr 172.21.15.52:0/4077748215 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7aa00640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec7c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409294176 0 0) 0x7fec7c071180 con 0x7fec7c13eb20 2024-09-10T08:34:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec60003520 con 0x7fec7c13eb20 2024-09-10T08:34:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3521615498 0 0) 0x7fec60003520 con 0x7fec7c13eb20 2024-09-10T08:34:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 msgr2=0x7fec7c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec7c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 >> v1:172.21.15.176:6789/0 conn(0x7fec7c06c150 legacy=0x7fec7c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.028+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c071740 con 0x7fec7c13eb20 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fec64001670 con 0x7fec7c13eb20 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 >> v1:172.21.15.52:6789/0 conn(0x7fec7c13eb20 legacy=0x7fec7c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec600039e0 0x7fec60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec60004d40 0x7fec600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c071ab0 con 0x7fec60004d40 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec6000baa0 con 0x7fec600039e0 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec6000bca0 con 0x7fec7c0b2d40 2024-09-10T08:34:32.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec60004d40 0x7fec600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7aa00640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec600039e0 0x7fec60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec72000640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 -- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 msgr2=0x7fec60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec7c0b2d40 0x7fec60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 -- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec600039e0 msgr2=0x7fec60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec600039e0 0x7fec60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.029+0000 7fec7b400640 1 -- 172.21.15.52:0/4077748215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec60003520 con 0x7fec60004d40 2024-09-10T08:34:32.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.030+0000 7fec7b400640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec60004d40 0x7fec600051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fec74001e20 tx=0x7fec60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff82e302d6040018 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74001a70 con 0x7fec60004d40 2024-09-10T08:34:32.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7402ae40 con 0x7fec60004d40 2024-09-10T08:34:32.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec7a000640 1 -- 172.21.15.52:0/4077748215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74003bb0 con 0x7fec60004d40 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 -- 172.21.15.52:0/4077748215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec60004d40 msgr2=0x7fec600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 --2- 172.21.15.52:0/4077748215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec60004d40 0x7fec600051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fec74001e20 tx=0x7fec60005830 comp rx=0 tx=0).stop 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec7b400640 1 -- 172.21.15.52:0/4077748215 reap_dead start 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 -- 172.21.15.52:0/4077748215 shutdown_connections 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 -- 172.21.15.52:0/4077748215 >> 172.21.15.52:0/4077748215 conn(0x7fec7c0ccec0 msgr2=0x7fec7c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 -- 172.21.15.52:0/4077748215 shutdown_connections 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.031+0000 7fec81800640 1 -- 172.21.15.52:0/4077748215 wait complete. 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.033+0000 7fec81800640 1 Processor -- start 2024-09-10T08:34:32.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.033+0000 7fec81800640 1 -- start start 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60004d40 0x7fec7c1f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec7c15dc00 0x7fec7c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c06bfa0 con 0x7fec7c154ea0 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c06be20 con 0x7fec7c15dc00 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec81800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c15c400 con 0x7fec60004d40 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57542/0 (socket says 172.21.15.52:57542) 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 -- 172.21.15.52:0/3871645303 learned_addr learned my addr 172.21.15.52:0/3871645303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:32.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec7aa00640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60004d40 0x7fec7c1f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec7b400640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec7c15dc00 0x7fec7c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 -- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60004d40 msgr2=0x7fec7c1f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60004d40 0x7fec7c1f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 -- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec7c15dc00 msgr2=0x7fec7c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.034+0000 7fec72000640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec7c15dc00 0x7fec7c0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec72000640 1 -- 172.21.15.52:0/3871645303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c15e110 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec72000640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fec64004f40 tx=0x7fec64007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400f750 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec64018070 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400fb30 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c15a600 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.035+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c15abc0 con 0x7fec7c154ea0 2024-09-10T08:34:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.036+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c15adc0 con 0x7fec7c154ea0 2024-09-10T08:34:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.037+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec6400fcd0 con 0x7fec7c154ea0 2024-09-10T08:34:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.038+0000 7fec73400640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 0x7fec5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.039+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 4857+0+0 (secure 0 0 0) 0x7fec6408a950 con 0x7fec7c154ea0 2024-09-10T08:34:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.039+0000 7fec7aa00640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 0x7fec5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.040+0000 7fec7aa00640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 0x7fec5806e320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fec7c1f7cf0 tx=0x7fec6c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.043+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec7c15adc0 con 0x7fec7c154ea0 2024-09-10T08:34:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.232+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fec7c144d80 con 0x7fec7c154ea0 2024-09-10T08:34:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.232+0000 7fec73400640 1 -- 172.21.15.52:0/3871645303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) ==== 84+0+65 (secure 0 0 0) 0x7fec64059650 con 0x7fec7c154ea0 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:34:32.233 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 msgr2=0x7fec5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 0x7fec5806e320 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fec7c1f7cf0 tx=0x7fec6c009190 comp rx=0 tx=0).stop 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 msgr2=0x7fec7c15d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fec64004f40 tx=0x7fec64007430 comp rx=0 tx=0).stop 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 shutdown_connections 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fec5806be60 0x7fec5806e320 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fec7c15dc00 0x7fec7c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec7c154ea0 0x7fec7c15d6c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 --2- 172.21.15.52:0/3871645303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fec60004d40 0x7fec7c1f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.234+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 >> 172.21.15.52:0/3871645303 conn(0x7fec7c0ccec0 msgr2=0x7fec7c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.235+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 shutdown_connections 2024-09-10T08:34:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.235+0000 7fec81800640 1 -- 172.21.15.52:0/3871645303 wait complete. 2024-09-10T08:34:32.250 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:34:32.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.410+0000 7f5e82200640 1 Processor -- start 2024-09-10T08:34:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.411+0000 7f5e82200640 1 -- start start 2024-09-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e82200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c0ae870 0x7f5e7c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e82200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e7c160550 0x7f5e7c1609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e82200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7c0b5ef0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e82200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7c148490 con 0x7f5e7c160550 2024-09-10T08:34:32.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e82200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7c0af1f0 con 0x7f5e7c0ae870 2024-09-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e7be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e7c160550 0x7f5e7c1609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e7b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e7c1480b0 0x7f5e7c0b53a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32778/0 (socket says 172.21.15.52:32778) 2024-09-10T08:34:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e7b400640 1 -- 172.21.15.52:0/2935224573 learned_addr learned my addr 172.21.15.52:0/2935224573 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.412+0000 7f5e73e00640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c0ae870 0x7f5e7c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.413+0000 7f5e7be00640 1 -- 172.21.15.52:0/2935224573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c0ae870 msgr2=0x7f5e7c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.413+0000 7f5e7be00640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c0ae870 0x7f5e7c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.413+0000 7f5e7be00640 1 -- 172.21.15.52:0/2935224573 >> v1:172.21.15.52:6789/0 conn(0x7f5e7c1480b0 legacy=0x7f5e7c0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.413+0000 7f5e7be00640 1 -- 172.21.15.52:0/2935224573 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c0b61d0 con 0x7f5e7c160550 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.413+0000 7f5e7aa00640 1 -- 172.21.15.52:0/2935224573 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214738079 0 0) 0x7f5e7c0b5ef0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e7be00640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c160550 0x7f5e7c1609c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009d90 tx=0x7f5e7402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f9a17605ca5df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e7aa00640 1 -- 172.21.15.52:0/2935224573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74031600 con 0x7f5e7c160550 2024-09-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e7aa00640 1 -- 172.21.15.52:0/2935224573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e740317a0 con 0x7f5e7c160550 2024-09-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e7aa00640 1 -- 172.21.15.52:0/2935224573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74031b70 con 0x7f5e7c160550 2024-09-10T08:34:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 -- 172.21.15.52:0/2935224573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c160550 msgr2=0x7f5e7c1609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c160550 0x7f5e7c1609c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009d90 tx=0x7f5e7402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 -- 172.21.15.52:0/2935224573 shutdown_connections 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c160550 0x7f5e7c1609c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 --2- 172.21.15.52:0/2935224573 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c0ae870 0x7f5e7c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.414+0000 7f5e82200640 1 -- 172.21.15.52:0/2935224573 >> 172.21.15.52:0/2935224573 conn(0x7f5e7c06c240 msgr2=0x7f5e7c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.415+0000 7f5e82200640 1 -- 172.21.15.52:0/2935224573 shutdown_connections 2024-09-10T08:34:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.415+0000 7f5e82200640 1 -- 172.21.15.52:0/2935224573 wait complete. 2024-09-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.416+0000 7f5e82200640 1 Processor -- start 2024-09-10T08:34:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.416+0000 7f5e82200640 1 -- start start 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e7c0ae870 0x7f5e7c1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c160550 0x7f5e7c1451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c0b37a0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c160030 con 0x7f5e7c0ae870 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e82200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7c0b3920 con 0x7f5e7c160550 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e73e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e73e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57568/0 (socket says 172.21.15.52:57568) 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e73e00640 1 -- 172.21.15.52:0/1892983842 learned_addr learned my addr 172.21.15.52:0/1892983842 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.417+0000 7f5e7b400640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e7c0ae870 0x7f5e7c1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e7be00640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c160550 0x7f5e7c1451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 -- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c160550 msgr2=0x7f5e7c1451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c160550 0x7f5e7c1451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 -- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e7c0ae870 msgr2=0x7f5e7c1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e7c0ae870 0x7f5e7c1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 -- 172.21.15.52:0/1892983842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c1f4fc0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73e00640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400d800 tx=0x7f5e6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400b6c0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e64019070 con 0x7f5e7c1480b0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c1f5790 con 0x7f5e7c1480b0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.418+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6400ba80 con 0x7f5e7c1480b0 2024-09-10T08:34:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.419+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c1f5fd0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.420+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7c0aecb0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.421+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e6400bc20 con 0x7f5e7c1480b0 2024-09-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.421+0000 7f5e73400640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 0x7f5e5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.421+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 4857+0+0 (secure 0 0 0) 0x7f5e6408aea0 con 0x7f5e7c1480b0 2024-09-10T08:34:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.422+0000 7f5e7b400640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 0x7f5e5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:32.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.422+0000 7f5e7b400640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 0x7f5e5806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c000f60 tx=0x7f5e6c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:32.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.426+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e7c1f5790 con 0x7f5e7c1480b0 2024-09-10T08:34:32.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:32.614+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5e7c1f2180 con 0x7f5e7c1480b0 2024-09-10T08:34:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.400+0000 7f5e73400640 1 -- 172.21.15.52:0/1892983842 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) ==== 138+0+0 (secure 0 0 0) 0x7f5e7c1f4fc0 con 0x7f5e7c1480b0 2024-09-10T08:34:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:34:33.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 msgr2=0x7f5e5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 0x7f5e5806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c000f60 tx=0x7f5e6c007d50 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 msgr2=0x7f5e7c1f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400d800 tx=0x7f5e6400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 shutdown_connections 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e5806be30 0x7f5e5806e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e7c160550 0x7f5e7c1451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c1480b0 0x7f5e7c1f1c40 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 --2- 172.21.15.52:0/1892983842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e7c0ae870 0x7f5e7c1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.404+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 >> 172.21.15.52:0/1892983842 conn(0x7f5e7c06c240 msgr2=0x7f5e7c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:33.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.405+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 shutdown_connections 2024-09-10T08:34:33.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.405+0000 7f5e82200640 1 -- 172.21.15.52:0/1892983842 wait complete. 2024-09-10T08:34:33.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:34:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.591+0000 7fafa4000640 1 Processor -- start 2024-09-10T08:34:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.591+0000 7fafa4000640 1 -- start start 2024-09-10T08:34:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa4000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf9c0732e0 0x7faf9c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa4000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c0714b0 con 0x7faf9c0cce30 2024-09-10T08:34:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa4000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c073c00 con 0x7faf9c0732e0 2024-09-10T08:34:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa4000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c0cd880 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa1600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf9c0732e0 0x7faf9c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa0c00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7faf9c0cce30 0x7faf9c071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:51720/0 (socket says 172.21.15.52:51720) 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa0c00640 1 -- 172.21.15.52:0/1497840605 learned_addr learned my addr 172.21.15.52:0/1497840605 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.593+0000 7fafa2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39810/0 (socket says 172.21.15.52:39810) 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7faf9be00640 1 -- 172.21.15.52:0/1497840605 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737066911 0 0) 0x7faf9c0714b0 con 0x7faf9c0cce30 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa1600640 1 -- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 msgr2=0x7faf9c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa1600640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa1600640 1 -- 172.21.15.52:0/1497840605 >> v1:172.21.15.176:6789/0 conn(0x7faf9c0cce30 legacy=0x7faf9c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa1600640 1 -- 172.21.15.52:0/1497840605 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0cdb60 con 0x7faf9c0732e0 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.594+0000 7fafa2000640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.595+0000 7fafa1600640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c0736c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf900097a0 tx=0x7faf9002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7781a721e4f23e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7faf9be00640 1 -- 172.21.15.52:0/1497840605 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90037070 con 0x7faf9c0732e0 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7faf9be00640 1 -- 172.21.15.52:0/1497840605 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9002ae50 con 0x7faf9c0732e0 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7faf9be00640 1 -- 172.21.15.52:0/1497840605 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90032660 con 0x7faf9c0732e0 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 -- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 msgr2=0x7faf9c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c0736c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf900097a0 tx=0x7faf9002a100 comp rx=0 tx=0).stop 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 -- 172.21.15.52:0/1497840605 shutdown_connections 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cd2a0 0x7faf9c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 --2- 172.21.15.52:0/1497840605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c0736c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 -- 172.21.15.52:0/1497840605 >> 172.21.15.52:0/1497840605 conn(0x7faf9c06d0f0 msgr2=0x7faf9c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:33.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 -- 172.21.15.52:0/1497840605 shutdown_connections 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.596+0000 7fafa4000640 1 -- 172.21.15.52:0/1497840605 wait complete. 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.598+0000 7fafa4000640 1 Processor -- start 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.598+0000 7fafa4000640 1 -- start start 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cce30 0x7faf9c156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06bf70 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06bdf0 con 0x7faf9c0732e0 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa4000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c072380 con 0x7faf9c0cce30 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57572/0 (socket says 172.21.15.52:57572) 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.599+0000 7fafa2000640 1 -- 172.21.15.52:0/3588472098 learned_addr learned my addr 172.21.15.52:0/3588472098 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:33.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa0c00640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cce30 0x7faf9c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa1600640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 -- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cce30 msgr2=0x7faf9c156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cce30 0x7faf9c156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 -- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 msgr2=0x7faf9c148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 -- 172.21.15.52:0/3588472098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c156d00 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7fafa2000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efc0 tx=0x7faf94009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.600+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94018030 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.601+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9400cd80 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.601+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94003bb0 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.601+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c156fe0 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.601+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1575a0 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.602+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c0736c0 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.603+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf9401b070 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.604+0000 7faf99600640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 0x7faf7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:33.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.604+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5227+0+0 (secure 0 0 0) 0x7faf9408b550 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.605+0000 7fafa1600640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 0x7faf7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:33.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.605+0000 7fafa1600640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 0x7faf7c06e320 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faf90034000 tx=0x7faf9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:33.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.609+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf94010040 con 0x7faf9c0cd2a0 2024-09-10T08:34:33.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:33.794+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faf9c074d50 con 0x7faf9c0cd2a0 2024-09-10T08:34:34.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.408+0000 7faf99600640 1 -- 172.21.15.52:0/3588472098 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) ==== 170+0+0 (secure 0 0 0) 0x7faf94059a80 con 0x7faf9c0cd2a0 2024-09-10T08:34:34.409 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.411+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 msgr2=0x7faf7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.411+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 0x7faf7c06e320 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faf90034000 tx=0x7faf9002e000 comp rx=0 tx=0).stop 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.411+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 msgr2=0x7faf9c157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.411+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efc0 tx=0x7faf94009f90 comp rx=0 tx=0).stop 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 shutdown_connections 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faf7c06be60 0x7faf7c06e320 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf9c0cd2a0 0x7faf9c157da0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c0cce30 0x7faf9c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 --2- 172.21.15.52:0/3588472098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf9c0732e0 0x7faf9c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.412+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 >> 172.21.15.52:0/3588472098 conn(0x7faf9c06d0f0 msgr2=0x7faf9c15ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:34.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.414+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 shutdown_connections 2024-09-10T08:34:34.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.414+0000 7fafa4000640 1 -- 172.21.15.52:0/3588472098 wait complete. 2024-09-10T08:34:34.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:34:34.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.604+0000 7f3cc8000640 1 Processor -- start 2024-09-10T08:34:34.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.604+0000 7f3cc8000640 1 -- start start 2024-09-10T08:34:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc8000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cfcb0 0x7f3cc0144340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc8000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3cc0071650 0x7f3cc0144880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc8000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc015f120 con 0x7f3cc00cf8d0 2024-09-10T08:34:34.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc8000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc0141cd0 con 0x7f3cc0071650 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc8000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc015f400 con 0x7f3cc00cfcb0 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3cc0071650 0x7f3cc0144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3cc0071650 0x7f3cc0144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43242/0 (socket says 172.21.15.52:43242) 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 -- 172.21.15.52:0/2202824767 learned_addr learned my addr 172.21.15.52:0/2202824767 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc4c00640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cfcb0 0x7f3cc0144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 -- 172.21.15.52:0/2202824767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cfcb0 msgr2=0x7f3cc0144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cfcb0 0x7f3cc0144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.606+0000 7f3cc6000640 1 -- 172.21.15.52:0/2202824767 >> v1:172.21.15.176:6789/0 conn(0x7f3cc00cf8d0 legacy=0x7f3cc0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.607+0000 7f3cc6000640 1 -- 172.21.15.52:0/2202824767 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc015f6e0 con 0x7f3cc0071650 2024-09-10T08:34:34.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc6000640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc0144880 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009e50 tx=0x7f3cb802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e64787cf2b38e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cbfe00640 1 -- 172.21.15.52:0/2202824767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8036070 con 0x7f3cc0071650 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cbfe00640 1 -- 172.21.15.52:0/2202824767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8031600 con 0x7f3cc0071650 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cbfe00640 1 -- 172.21.15.52:0/2202824767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80319d0 con 0x7f3cc0071650 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 -- 172.21.15.52:0/2202824767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 msgr2=0x7f3cc0144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc0144880 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009e50 tx=0x7f3cb802a710 comp rx=0 tx=0).stop 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 -- 172.21.15.52:0/2202824767 shutdown_connections 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc0144880 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 --2- 172.21.15.52:0/2202824767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cfcb0 0x7f3cc0144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 -- 172.21.15.52:0/2202824767 >> 172.21.15.52:0/2202824767 conn(0x7f3cc006d0f0 msgr2=0x7f3cc006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.608+0000 7f3cc8000640 1 -- 172.21.15.52:0/2202824767 shutdown_connections 2024-09-10T08:34:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.609+0000 7f3cc8000640 1 -- 172.21.15.52:0/2202824767 wait complete. 2024-09-10T08:34:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.610+0000 7f3cc8000640 1 Processor -- start 2024-09-10T08:34:34.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.610+0000 7f3cc8000640 1 -- start start 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cf8d0 0x7f3cc0158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cc00cfcb0 0x7f3cc01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc015ee30 con 0x7f3cc0071650 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc0144dc0 con 0x7f3cc00cfcb0 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc8000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc00ce0f0 con 0x7f3cc00cf8d0 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43246/0 (socket says 172.21.15.52:43246) 2024-09-10T08:34:34.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc5600640 1 -- 172.21.15.52:0/3213871320 learned_addr learned my addr 172.21.15.52:0/3213871320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc6000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cc00cfcb0 0x7f3cc01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.611+0000 7f3cc4c00640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cf8d0 0x7f3cc0158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 -- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cf8d0 msgr2=0x7f3cc0158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cf8d0 0x7f3cc0158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 -- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cc00cfcb0 msgr2=0x7f3cc01589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:34.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cc00cfcb0 0x7f3cc01589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 -- 172.21.15.52:0/3213871320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc013f2d0 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc5600640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c400 tx=0x7f3cb400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40052d0 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb4005490 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4007260 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.612+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc013e230 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.613+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc013ead0 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.613+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc013e620 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.615+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cb4007400 con 0x7f3cc0071650 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.616+0000 7f3cbd600640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 0x7f3ca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.616+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5609+0+0 (secure 0 0 0) 0x7f3cb408a750 con 0x7f3cc0071650 2024-09-10T08:34:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.616+0000 7f3cc4c00640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 0x7f3ca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.617+0000 7f3cc4c00640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 0x7f3ca006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3cc01f82b0 tx=0x7f3cac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.619+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3cb4058b80 con 0x7f3cc0071650 2024-09-10T08:34:34.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:34.842+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3cc0070f40 con 0x7f3cc0071650 2024-09-10T08:34:35.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.411+0000 7f3cbd600640 1 -- 172.21.15.52:0/3213871320 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v79) ==== 174+0+0 (secure 0 0 0) 0x7f3cb405ce80 con 0x7f3cc0071650 2024-09-10T08:34:35.411 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 14 and data pool 15 2024-09-10T08:34:35.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.417+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 msgr2=0x7f3ca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.417+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 0x7f3ca006e2f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3cc01f82b0 tx=0x7f3cac008040 comp rx=0 tx=0).stop 2024-09-10T08:34:35.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.417+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 msgr2=0x7f3cc01437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.417+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c400 tx=0x7f3cb400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.418+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 shutdown_connections 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ca006be30 0x7f3ca006e2f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3cc00cfcb0 0x7f3cc01589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3cc00cf8d0 0x7f3cc0158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 --2- 172.21.15.52:0/3213871320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cc0071650 0x7f3cc01437a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 >> 172.21.15.52:0/3213871320 conn(0x7f3cc006d0f0 msgr2=0x7f3cc0071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:35.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 shutdown_connections 2024-09-10T08:34:35.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.419+0000 7f3cc8000640 1 -- 172.21.15.52:0/3213871320 wait complete. 2024-09-10T08:34:35.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.619+0000 7f3e4b200640 1 Processor -- start 2024-09-10T08:34:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.619+0000 7f3e4b200640 1 -- start start 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e4b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e441482b0 0x7f3e440b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e4b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e44072440 0x7f3e440728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e4b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e44072fb0 con 0x7f3e440b47d0 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e4b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3e44073290 con 0x7f3e441482b0 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e4b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3e44073570 con 0x7f3e44072440 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e43e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e441482b0 0x7f3e440b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e3b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e440b47d0 0x7f3e4406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40076/0 (socket says 172.21.15.52:40076) 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e43e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e441482b0 0x7f3e440b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43260/0 (socket says 172.21.15.52:43260) 2024-09-10T08:34:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.620+0000 7f3e3b400640 1 -- 172.21.15.52:0/2272250769 learned_addr learned my addr 172.21.15.52:0/2272250769 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.621+0000 7f3e43e00640 1 -- 172.21.15.52:0/2272250769 >> v2:172.21.15.176:3300/0 conn(0x7f3e44072440 msgr2=0x7f3e440728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.621+0000 7f3e43e00640 1 --2- 172.21.15.52:0/2272250769 >> v2:172.21.15.176:3300/0 conn(0x7f3e44072440 0x7f3e440728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.621+0000 7f3e43e00640 1 -- 172.21.15.52:0/2272250769 >> v1:172.21.15.52:6789/0 conn(0x7f3e440b47d0 legacy=0x7f3e4406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.621+0000 7f3e43e00640 1 -- 172.21.15.52:0/2272250769 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4406da80 con 0x7f3e441482b0 2024-09-10T08:34:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.621+0000 7f3e43400640 1 -- 172.21.15.52:0/2272250769 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370438128 0 0) 0x7f3e44072fb0 con 0x7f3e440b47d0 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.622+0000 7f3e43e00640 1 --2- 172.21.15.52:0/2272250769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e441482b0 0x7f3e440b4290 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3e440b3440 tx=0x7f3e3402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ebece02469b496 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.622+0000 7f3e43400640 1 -- 172.21.15.52:0/2272250769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34007740 con 0x7f3e441482b0 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.622+0000 7f3e43400640 1 -- 172.21.15.52:0/2272250769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e340078e0 con 0x7f3e441482b0 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.622+0000 7f3e43400640 1 -- 172.21.15.52:0/2272250769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34007cb0 con 0x7f3e441482b0 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 -- 172.21.15.52:0/2272250769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e441482b0 msgr2=0x7f3e440b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 --2- 172.21.15.52:0/2272250769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e441482b0 0x7f3e440b4290 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f3e440b3440 tx=0x7f3e3402a5f0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 -- 172.21.15.52:0/2272250769 shutdown_connections 2024-09-10T08:34:35.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 --2- 172.21.15.52:0/2272250769 >> v2:172.21.15.176:3300/0 conn(0x7f3e44072440 0x7f3e440728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 --2- 172.21.15.52:0/2272250769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e441482b0 0x7f3e440b4290 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 -- 172.21.15.52:0/2272250769 >> 172.21.15.52:0/2272250769 conn(0x7f3e4406c240 msgr2=0x7f3e440b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 -- 172.21.15.52:0/2272250769 shutdown_connections 2024-09-10T08:34:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.623+0000 7f3e4b200640 1 -- 172.21.15.52:0/2272250769 wait complete. 2024-09-10T08:34:35.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.624+0000 7f3e4b200640 1 Processor -- start 2024-09-10T08:34:35.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.625+0000 7f3e4b200640 1 -- start start 2024-09-10T08:34:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.625+0000 7f3e4b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.625+0000 7f3e4b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e440b47d0 0x7f3e44161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.625+0000 7f3e4b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e441482b0 0x7f3e441445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e4b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4406d6a0 con 0x7f3e44072440 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e4b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44148690 con 0x7f3e441482b0 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e4b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4406d820 con 0x7f3e440b47d0 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43276/0 (socket says 172.21.15.52:43276) 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 -- 172.21.15.52:0/276853093 learned_addr learned my addr 172.21.15.52:0/276853093 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 -- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e440b47d0 msgr2=0x7f3e44161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e440b47d0 0x7f3e44161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 -- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e441482b0 msgr2=0x7f3e441445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e441482b0 0x7f3e441445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 -- 172.21.15.52:0/276853093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441600d0 con 0x7f3e44072440 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.626+0000 7f3e43e00640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.627+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34040070 con 0x7f3e44072440 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.627+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e34031c40 con 0x7f3e44072440 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.627+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3403c420 con 0x7f3e44072440 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.627+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e441603b0 con 0x7f3e44072440 2024-09-10T08:34:35.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.627+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e44160970 con 0x7f3e44072440 2024-09-10T08:34:35.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.628+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e440b4290 con 0x7f3e44072440 2024-09-10T08:34:35.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.629+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e34039040 con 0x7f3e44072440 2024-09-10T08:34:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.630+0000 7f3e40c00640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 0x7f3e2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.630+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f3e340ac5b0 con 0x7f3e44072440 2024-09-10T08:34:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.630+0000 7f3e3b400640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 0x7f3e2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.631+0000 7f3e3b400640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 0x7f3e2006e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c007fd0 tx=0x7f3e2c007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:35.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.634+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e3407aec0 con 0x7f3e44072440 2024-09-10T08:34:35.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.820+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e440b2280 con 0x7f3e44072440 2024-09-10T08:34:35.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.822+0000 7f3e40c00640 1 -- 172.21.15.52:0/276853093 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+16704 (secure 0 0 0) 0x7f3e3407a7c0 con 0x7f3e44072440 2024-09-10T08:34:35.822 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:35.823 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":108,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:34.843716+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:34:32.657199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T08:34:33.836749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 msgr2=0x7f3e2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 0x7f3e2006e320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c007fd0 tx=0x7f3e2c007920 comp rx=0 tx=0).stop 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 msgr2=0x7f3e4413fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e34004a40 comp rx=0 tx=0).stop 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 shutdown_connections 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e2006be60 0x7f3e2006e320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e441482b0 0x7f3e441445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e440b47d0 0x7f3e44161450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 --2- 172.21.15.52:0/276853093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e44072440 0x7f3e4413fb30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:35.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 >> 172.21.15.52:0/276853093 conn(0x7f3e4406c240 msgr2=0x7f3e4406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:35.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.824+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 shutdown_connections 2024-09-10T08:34:35.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.825+0000 7f3e4b200640 1 -- 172.21.15.52:0/276853093 wait complete. 2024-09-10T08:34:35.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:35.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.996+0000 7fa496800640 1 Processor -- start 2024-09-10T08:34:35.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.996+0000 7fa496800640 1 -- start start 2024-09-10T08:34:35.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa49014c480 0x7fa490163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490073750 0x7fa490073b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa490164650 0x7fa490164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa4900732c0 con 0x7fa490164650 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa490164120 con 0x7fa49014c480 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa496800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4900712a0 con 0x7fa490073750 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa490164650 0x7fa490164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa490164650 0x7fa490164b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43278/0 (socket says 172.21.15.52:43278) 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 -- 172.21.15.52:0/1957493931 learned_addr learned my addr 172.21.15.52:0/1957493931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa487e00640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490073750 0x7fa490073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48f400640 1 --2- 172.21.15.52:0/1957493931 >> v2:172.21.15.176:3300/0 conn(0x7fa49014c480 0x7fa490163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 -- 172.21.15.52:0/1957493931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490073750 msgr2=0x7fa490073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:35.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490073750 0x7fa490073b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 -- 172.21.15.52:0/1957493931 >> v2:172.21.15.176:3300/0 conn(0x7fa49014c480 msgr2=0x7fa490163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:36.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 --2- 172.21.15.52:0/1957493931 >> v2:172.21.15.176:3300/0 conn(0x7fa49014c480 0x7fa490163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.998+0000 7fa48fe00640 1 -- 172.21.15.52:0/1957493931 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa490072c70 con 0x7fa490164650 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:35.999+0000 7fa48fe00640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490164650 0x7fa490164b00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa490069be0 tx=0x7fa48802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd906d9253f0fae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa48ea00640 1 -- 172.21.15.52:0/1957493931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488036070 con 0x7fa490164650 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa48ea00640 1 -- 172.21.15.52:0/1957493931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa488031600 con 0x7fa490164650 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa48ea00640 1 -- 172.21.15.52:0/1957493931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4880319d0 con 0x7fa490164650 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 -- 172.21.15.52:0/1957493931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490164650 msgr2=0x7fa490164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490164650 0x7fa490164b00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa490069be0 tx=0x7fa48802a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 -- 172.21.15.52:0/1957493931 shutdown_connections 2024-09-10T08:34:36.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490164650 0x7fa490164b00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 --2- 172.21.15.52:0/1957493931 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490073750 0x7fa490073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 --2- 172.21.15.52:0/1957493931 >> v2:172.21.15.176:3300/0 conn(0x7fa49014c480 0x7fa490163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 -- 172.21.15.52:0/1957493931 >> 172.21.15.52:0/1957493931 conn(0x7fa4900ccec0 msgr2=0x7fa4900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 -- 172.21.15.52:0/1957493931 shutdown_connections 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.000+0000 7fa496800640 1 -- 172.21.15.52:0/1957493931 wait complete. 2024-09-10T08:34:36.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.002+0000 7fa496800640 1 Processor -- start 2024-09-10T08:34:36.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.002+0000 7fa496800640 1 -- start start 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa49014c480 0x7fa49006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490164650 0x7fa49006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa490071580 con 0x7fa490073750 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa490070f70 con 0x7fa49014c480 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa496800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4900b6350 con 0x7fa490164650 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa48f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa48f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43284/0 (socket says 172.21.15.52:43284) 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa48f400640 1 -- 172.21.15.52:0/4116439458 learned_addr learned my addr 172.21.15.52:0/4116439458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa487e00640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa49014c480 0x7fa49006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.003+0000 7fa48fe00640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490164650 0x7fa49006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 -- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490164650 msgr2=0x7fa49006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490164650 0x7fa49006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 -- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa49014c480 msgr2=0x7fa49006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa49014c480 0x7fa49006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 -- 172.21.15.52:0/4116439458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa490141f80 con 0x7fa490073750 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa48f400640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d830 tx=0x7fa48000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000b6c0 con 0x7fa490073750 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa480019070 con 0x7fa490073750 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000ba80 con 0x7fa490073750 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa490142260 con 0x7fa490073750 2024-09-10T08:34:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.004+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa490142820 con 0x7fa490073750 2024-09-10T08:34:36.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.005+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490163be0 con 0x7fa490073750 2024-09-10T08:34:36.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.006+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa48001e460 con 0x7fa490073750 2024-09-10T08:34:36.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.007+0000 7fa487400640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 0x7fa46c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.007+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7fa48008b3d0 con 0x7fa490073750 2024-09-10T08:34:36.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.008+0000 7fa487e00640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 0x7fa46c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.008+0000 7fa487e00640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 0x7fa46c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa490166670 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.011+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa480059720 con 0x7fa490073750 2024-09-10T08:34:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.201+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4900cdbf0 con 0x7fa490073750 2024-09-10T08:34:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.202+0000 7fa487400640 1 -- 172.21.15.52:0/4116439458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+16704 (secure 0 0 0) 0x7fa48005da20 con 0x7fa490073750 2024-09-10T08:34:36.203 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:36.203 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":108,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:34.843716+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:34:32.657199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T08:34:33.836749+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 msgr2=0x7fa46c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 0x7fa46c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa490166670 tx=0x7fa478008040 comp rx=0 tx=0).stop 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 msgr2=0x7fa490143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d830 tx=0x7fa48000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 shutdown_connections 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa46c06be30 0x7fa46c06e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa490164650 0x7fa49006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa49014c480 0x7fa49006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 --2- 172.21.15.52:0/4116439458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa490073750 0x7fa490143020 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 >> 172.21.15.52:0/4116439458 conn(0x7fa4900ccec0 msgr2=0x7fa490163160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.204+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 shutdown_connections 2024-09-10T08:34:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.205+0000 7fa496800640 1 -- 172.21.15.52:0/4116439458 wait complete. 2024-09-10T08:34:36.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:34:36.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.381+0000 7f9786a00640 1 Processor -- start 2024-09-10T08:34:36.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.381+0000 7f9786a00640 1 -- start start 2024-09-10T08:34:36.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9786a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9786a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97800d1e60 0x7f978015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9786a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800cef10 con 0x7f97800d1a80 2024-09-10T08:34:36.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9786a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f97800d01d0 con 0x7f97800d1e60 2024-09-10T08:34:36.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9786a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f978015fc10 con 0x7f978015c570 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9784a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97800d1e60 0x7f978015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9784a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97800d1e60 0x7f978015eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43296/0 (socket says 172.21.15.52:43296) 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.382+0000 7f9784a00640 1 -- 172.21.15.52:0/2444034830 learned_addr learned my addr 172.21.15.52:0/2444034830 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.383+0000 7f977f400640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.383+0000 7f9784a00640 1 -- 172.21.15.52:0/2444034830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 msgr2=0x7f97800cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.383+0000 7f9784a00640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.383+0000 7f9784a00640 1 -- 172.21.15.52:0/2444034830 >> v1:172.21.15.176:6789/0 conn(0x7f97800d1a80 legacy=0x7f978015be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:36.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.383+0000 7f9784a00640 1 -- 172.21.15.52:0/2444034830 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800cf1d0 con 0x7f97800d1e60 2024-09-10T08:34:36.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.384+0000 7f9784a00640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f978015eee0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9778009e50 tx=0x7f977802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fa8939f6a82b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.384+0000 7f977ea00640 1 -- 172.21.15.52:0/2444034830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778036070 con 0x7f97800d1e60 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.384+0000 7f977ea00640 1 -- 172.21.15.52:0/2444034830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9778031600 con 0x7f97800d1e60 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.384+0000 7f977ea00640 1 -- 172.21.15.52:0/2444034830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97780319d0 con 0x7f97800d1e60 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 -- 172.21.15.52:0/2444034830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 msgr2=0x7f978015eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f978015eee0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9778009e50 tx=0x7f977802a710 comp rx=0 tx=0).stop 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 -- 172.21.15.52:0/2444034830 shutdown_connections 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f978015eee0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 --2- 172.21.15.52:0/2444034830 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 -- 172.21.15.52:0/2444034830 >> 172.21.15.52:0/2444034830 conn(0x7f9780067d70 msgr2=0x7f9780068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 -- 172.21.15.52:0/2444034830 shutdown_connections 2024-09-10T08:34:36.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.385+0000 7f9786a00640 1 -- 172.21.15.52:0/2444034830 wait complete. 2024-09-10T08:34:36.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.387+0000 7f9786a00640 1 Processor -- start 2024-09-10T08:34:36.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.387+0000 7f9786a00640 1 -- start start 2024-09-10T08:34:36.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97800d1a80 0x7f9780153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f978015f420 con 0x7f97800d1e60 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97800cf790 con 0x7f97800d1a80 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9786a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f978015f5a0 con 0x7f978015c570 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43308/0 (socket says 172.21.15.52:43308) 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 -- 172.21.15.52:0/3531324973 learned_addr learned my addr 172.21.15.52:0/3531324973 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f9784a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977fe00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97800d1a80 0x7f9780153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 -- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 msgr2=0x7f97800ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 -- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97800d1a80 msgr2=0x7f9780153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97800d1a80 0x7f9780153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.388+0000 7f977f400640 1 -- 172.21.15.52:0/3531324973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9780160990 con 0x7f97800d1e60 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f977f400640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f976c00d5f0 tx=0x7f976c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0125f0 con 0x7f97800d1e60 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c019070 con 0x7f97800d1e60 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9780160c70 con 0x7f97800d1e60 2024-09-10T08:34:36.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0129d0 con 0x7f97800d1e60 2024-09-10T08:34:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.389+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9780161230 con 0x7f97800d1e60 2024-09-10T08:34:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.390+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978015eee0 con 0x7f97800d1e60 2024-09-10T08:34:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.391+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f976c012b70 con 0x7f97800d1e60 2024-09-10T08:34:36.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.392+0000 7f9777e00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 0x7f976006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:36.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.392+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f976c08b110 con 0x7f97800d1e60 2024-09-10T08:34:36.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.393+0000 7f977fe00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 0x7f976006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:36.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.394+0000 7f977fe00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 0x7f976006e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f97801566f0 tx=0x7f9770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:36.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.397+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f976c059460 con 0x7f97800d1e60 2024-09-10T08:34:36.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:36.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:34:36.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:36.625+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f978015e250 con 0x7f97800d1e60 2024-09-10T08:34:37.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.437+0000 7f9777e00640 1 -- 172.21.15.52:0/3531324973 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7f976c05d760 con 0x7f97800d1e60 2024-09-10T08:34:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 msgr2=0x7f976006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 0x7f976006e2f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f97801566f0 tx=0x7f9770009040 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 msgr2=0x7f97800cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f976c00d5f0 tx=0x7f976c00dab0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 shutdown_connections 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f976006be30 0x7f976006e2f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f978015c570 0x7f97800ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97800d1e60 0x7f97800cde90 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 --2- 172.21.15.52:0/3531324973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97800d1a80 0x7f9780153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 >> 172.21.15.52:0/3531324973 conn(0x7f9780067d70 msgr2=0x7f9780158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 shutdown_connections 2024-09-10T08:34:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.441+0000 7f9786a00640 1 -- 172.21.15.52:0/3531324973 wait complete. 2024-09-10T08:34:37.461 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:34:37.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:34:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.627+0000 7f5005400640 1 Processor -- start 2024-09-10T08:34:37.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.627+0000 7f5005400640 1 -- start start 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f5005400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f50000cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f5005400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50000714b0 con 0x7f50000732e0 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f5005400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50000cd880 con 0x7f5000071c70 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f5005400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50000cdb60 con 0x7f50000cce30 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f4ffe800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50000732e0 0x7f50000736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40088/0 (socket says 172.21.15.52:40088) 2024-09-10T08:34:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f4ffe800640 1 -- 172.21.15.52:0/366360316 learned_addr learned my addr 172.21.15.52:0/366360316 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f50000cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036871960 0 0) 0x7f50000714b0 con 0x7f50000732e0 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.629+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe4003520 con 0x7f50000732e0 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2151089704 0 0) 0x7f4fe4003520 con 0x7f50000732e0 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 msgr2=0x7f50000cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:37.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f50000cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 >> v1:172.21.15.176:6789/0 conn(0x7f5000071c70 legacy=0x7f500015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50000cde40 con 0x7f50000732e0 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f4ff0001670 con 0x7f50000732e0 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 >> v1:172.21.15.52:6789/0 conn(0x7f50000732e0 legacy=0x7f50000736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f4fe40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f4fe4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50000cdb60 con 0x7f4fe4003fb0 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe400bbb0 con 0x7f4fe4004d40 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe400bdb0 con 0x7f50000cce30 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f4fe4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ffe800640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f4fe40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4fff200640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 -- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 msgr2=0x7f4fe40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50000cce30 0x7f4fe40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 -- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fe4004d40 msgr2=0x7f4fe40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fe4004d40 0x7f4fe40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.630+0000 7f4ff5e00640 1 -- 172.21.15.52:0/366360316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe4003520 con 0x7f4fe4003fb0 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.631+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f4fe4004800 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009a90 tx=0x7f4fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba7ac016b7f3a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8036070 con 0x7f4fe4003fb0 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8031400 con 0x7f4fe4003fb0 2024-09-10T08:34:37.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f4ffde00640 1 -- 172.21.15.52:0/366360316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8009690 con 0x7f4fe4003fb0 2024-09-10T08:34:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 -- 172.21.15.52:0/366360316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 msgr2=0x7f4fe4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 --2- 172.21.15.52:0/366360316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f4fe4004800 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009a90 tx=0x7f4fe4005830 comp rx=0 tx=0).stop 2024-09-10T08:34:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f4fff200640 1 -- 172.21.15.52:0/366360316 reap_dead start 2024-09-10T08:34:37.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 -- 172.21.15.52:0/366360316 shutdown_connections 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 -- 172.21.15.52:0/366360316 >> 172.21.15.52:0/366360316 conn(0x7f500006d0f0 msgr2=0x7f500006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 -- 172.21.15.52:0/366360316 shutdown_connections 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.632+0000 7f5005400640 1 -- 172.21.15.52:0/366360316 wait complete. 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.634+0000 7f5005400640 1 Processor -- start 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.634+0000 7f5005400640 1 -- start start 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5000152560 0x7f5000149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5000158e80 0x7f50001551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50000cd3f0 con 0x7f4fe4003fb0 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50000cd270 con 0x7f5000152560 2024-09-10T08:34:37.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f5005400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50000cd570 con 0x7f5000158e80 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f4ffe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f4ffe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43328/0 (socket says 172.21.15.52:43328) 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f4ffe800640 1 -- 172.21.15.52:0/690237610 learned_addr learned my addr 172.21.15.52:0/690237610 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5000152560 0x7f5000149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.635+0000 7f4fff200640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5000158e80 0x7f50001551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 -- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5000158e80 msgr2=0x7f50001551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5000158e80 0x7f50001551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 -- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5000152560 msgr2=0x7f5000149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5000152560 0x7f5000149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 -- 172.21.15.52:0/690237610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50001498b0 con 0x7f4fe4003fb0 2024-09-10T08:34:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ffe800640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000e830 tx=0x7f4ff000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000c870 con 0x7f4fe4003fb0 2024-09-10T08:34:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0018070 con 0x7f4fe4003fb0 2024-09-10T08:34:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000cc70 con 0x7f4fe4003fb0 2024-09-10T08:34:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5000157de0 con 0x7f4fe4003fb0 2024-09-10T08:34:37.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.636+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50001583a0 con 0x7f4fe4003fb0 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.637+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000072120 con 0x7f4fe4003fb0 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.638+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ff001d460 con 0x7f4fe4003fb0 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.639+0000 7f4ff7400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.640+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f4ff008ae40 con 0x7f4fe4003fb0 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.640+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:37.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.641+0000 7f4ff5e00640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8033000 tx=0x7f4fe8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:37.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.644+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50001498b0 con 0x7f4fe4003fb0 2024-09-10T08:34:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:37.861+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f50000711f0 con 0x7f4fe4003fb0 2024-09-10T08:34:38.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.444+0000 7f4ff7400640 1 -- 172.21.15.52:0/690237610 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f4ff0059100 con 0x7f4fe4003fb0 2024-09-10T08:34:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 msgr2=0x7f4fdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8033000 tx=0x7f4fe8008030 comp rx=0 tx=0).stop 2024-09-10T08:34:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 msgr2=0x7f500015d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4ff000e830 tx=0x7f4ff000ecf0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 shutdown_connections 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5000158e80 0x7f50001551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5000152560 0x7f5000149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 --2- 172.21.15.52:0/690237610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fe4003fb0 0x7f500015d210 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 >> 172.21.15.52:0/690237610 conn(0x7f500006d0f0 msgr2=0x7f50000b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 shutdown_connections 2024-09-10T08:34:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.447+0000 7f5005400640 1 -- 172.21.15.52:0/690237610 wait complete. 2024-09-10T08:34:38.466 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:34:38.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:38.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.627+0000 7fbb6dc00640 1 Processor -- start 2024-09-10T08:34:38.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.628+0000 7fbb6dc00640 1 -- start start 2024-09-10T08:34:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.629+0000 7fbb6dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6806e740 0x7fbb6815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.629+0000 7fbb6dc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb680b54b0 0x7fbb6806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.629+0000 7fbb6dc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb68162f30 con 0x7fbb6806eb20 2024-09-10T08:34:38.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.629+0000 7fbb6dc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbb68162390 con 0x7fbb680b54b0 2024-09-10T08:34:38.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.629+0000 7fbb6dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb68162040 con 0x7fbb6806e740 2024-09-10T08:34:38.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb680b54b0 0x7fbb6806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6806e740 0x7fbb6815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbb680b54b0 0x7fbb6806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:38612/0 (socket says 172.21.15.52:38612) 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb5fe00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fbb6806eb20 0x7fbb68162820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41282/0 (socket says 172.21.15.52:41282) 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 -- 172.21.15.52:0/3068754917 learned_addr learned my addr 172.21.15.52:0/3068754917 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 -- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6806e740 msgr2=0x7fbb6815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 --2- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6806e740 0x7fbb6815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 -- 172.21.15.52:0/3068754917 >> v1:172.21.15.176:6789/0 conn(0x7fbb6806eb20 legacy=0x7fbb68162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.630+0000 7fbb6d200640 1 -- 172.21.15.52:0/3068754917 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6815f2a0 con 0x7fbb680b54b0 2024-09-10T08:34:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.631+0000 7fbb6d200640 1 --2- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb680b54b0 0x7fbb6806f2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e50 tx=0x7fbb6002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c23ba31ca9d8219 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.631+0000 7fbb67400640 1 -- 172.21.15.52:0/3068754917 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60036070 con 0x7fbb680b54b0 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.631+0000 7fbb67400640 1 -- 172.21.15.52:0/3068754917 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb60031600 con 0x7fbb680b54b0 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.631+0000 7fbb67400640 1 -- 172.21.15.52:0/3068754917 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb600319d0 con 0x7fbb680b54b0 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb680b54b0 msgr2=0x7fbb6806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb680b54b0 0x7fbb6806f2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009e50 tx=0x7fbb6002a710 comp rx=0 tx=0).stop 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3068754917 shutdown_connections 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb680b54b0 0x7fbb6806f2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3068754917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb6806e740 0x7fbb6815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3068754917 >> 172.21.15.52:0/3068754917 conn(0x7fbb680b41b0 msgr2=0x7fbb680b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3068754917 shutdown_connections 2024-09-10T08:34:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.632+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3068754917 wait complete. 2024-09-10T08:34:38.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.634+0000 7fbb6dc00640 1 Processor -- start 2024-09-10T08:34:38.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.634+0000 7fbb6dc00640 1 -- start start 2024-09-10T08:34:38.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6806eb20 0x7fbb680cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 0x7fbb68151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6815ef40 con 0x7fbb6806e740 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6815f860 con 0x7fbb6806eb20 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6806f830 con 0x7fbb680b54b0 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43338/0 (socket says 172.21.15.52:43338) 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb67e00640 1 -- 172.21.15.52:0/3715390638 learned_addr learned my addr 172.21.15.52:0/3715390638 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb5fe00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6806eb20 0x7fbb680cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.635+0000 7fbb6d200640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 0x7fbb68151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 -- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 msgr2=0x7fbb68151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 0x7fbb68151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 -- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6806eb20 msgr2=0x7fbb680cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6806eb20 0x7fbb680cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 -- 172.21.15.52:0/3715390638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb681e9050 con 0x7fbb6806e740 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb6d200640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 0x7fbb68151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb67e00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e870 tx=0x7fbb5800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58017070 con 0x7fbb6806e740 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb5800c940 con 0x7fbb6806e740 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800cd30 con 0x7fbb6806e740 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb680ce660 con 0x7fbb6806e740 2024-09-10T08:34:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.636+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb681e92f0 con 0x7fbb6806e740 2024-09-10T08:34:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.637+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6815ea00 con 0x7fbb6806e740 2024-09-10T08:34:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.638+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb5801a070 con 0x7fbb6806e740 2024-09-10T08:34:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.639+0000 7fbb64c00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.639+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5808ad00 con 0x7fbb6806e740 2024-09-10T08:34:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.640+0000 7fbb5fe00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.640+0000 7fbb5fe00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 0x7fbb4406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbb6815dd30 tx=0x7fbb50007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:38.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.643+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb58058fc0 con 0x7fbb6806e740 2024-09-10T08:34:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.861+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb6815df20 con 0x7fbb6806e740 2024-09-10T08:34:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.862+0000 7fbb64c00640 1 -- 172.21.15.52:0/3715390638 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5228 (secure 0 0 0) 0x7fbb5805d2c0 con 0x7fbb6806e740 2024-09-10T08:34:38.863 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:38.863 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":83,"btime":"2024-09-10T08:34:38:438541+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:37.863394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:34:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 83 2024-09-10T08:34:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 msgr2=0x7fbb4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 0x7fbb4406e2f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbb6815dd30 tx=0x7fbb50007e80 comp rx=0 tx=0).stop 2024-09-10T08:34:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 msgr2=0x7fbb680b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800e870 tx=0x7fbb5800ed30 comp rx=0 tx=0).stop 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 shutdown_connections 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbb4406be30 0x7fbb4406e2f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbb680b54b0 0x7fbb68151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbb6806eb20 0x7fbb680cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 --2- 172.21.15.52:0/3715390638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb6806e740 0x7fbb680b0d60 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 >> 172.21.15.52:0/3715390638 conn(0x7fbb680b41b0 msgr2=0x7fbb680b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 shutdown_connections 2024-09-10T08:34:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:38.864+0000 7fbb6dc00640 1 -- 172.21.15.52:0/3715390638 wait complete. 2024-09-10T08:34:38.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:34:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.036+0000 7fe58d600640 1 Processor -- start 2024-09-10T08:34:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.036+0000 7fe58d600640 1 -- start start 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe58d600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe58813eb20 0x7fe58815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe58d600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe588071180 con 0x7fe5880b2d40 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe58d600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe588071460 con 0x7fe58806c320 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe58d600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe588071ab0 con 0x7fe58813eb20 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe586a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5880b2d40 0x7fe58806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40104/0 (socket says 172.21.15.52:40104) 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe586a00640 1 -- 172.21.15.52:0/577710946 learned_addr learned my addr 172.21.15.52:0/577710946 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe587400640 1 --2- 172.21.15.52:0/577710946 >> v2:172.21.15.52:3300/0 conn(0x7fe58813eb20 0x7fe58815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe587400640 1 -- 172.21.15.52:0/577710946 >> v1:172.21.15.176:6789/0 conn(0x7fe58806c320 legacy=0x7fe58815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe587400640 1 -- 172.21.15.52:0/577710946 >> v1:172.21.15.52:6789/0 conn(0x7fe5880b2d40 legacy=0x7fe58806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.038+0000 7fe587400640 1 -- 172.21.15.52:0/577710946 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe588071740 con 0x7fe58813eb20 2024-09-10T08:34:39.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.039+0000 7fe587400640 1 --2- 172.21.15.52:0/577710946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58813eb20 0x7fe58815c400 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe580009d90 tx=0x7fe58002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289c3cebb056cb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe586000640 1 -- 172.21.15.52:0/577710946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580007740 con 0x7fe58813eb20 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe586000640 1 -- 172.21.15.52:0/577710946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5800078e0 con 0x7fe58813eb20 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe586000640 1 -- 172.21.15.52:0/577710946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580007cb0 con 0x7fe58813eb20 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 -- 172.21.15.52:0/577710946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58813eb20 msgr2=0x7fe58815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 --2- 172.21.15.52:0/577710946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58813eb20 0x7fe58815c400 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fe580009d90 tx=0x7fe58002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 -- 172.21.15.52:0/577710946 shutdown_connections 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 --2- 172.21.15.52:0/577710946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58813eb20 0x7fe58815c400 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 -- 172.21.15.52:0/577710946 >> 172.21.15.52:0/577710946 conn(0x7fe5880ccec0 msgr2=0x7fe5880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 -- 172.21.15.52:0/577710946 shutdown_connections 2024-09-10T08:34:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.040+0000 7fe58d600640 1 -- 172.21.15.52:0/577710946 wait complete. 2024-09-10T08:34:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.042+0000 7fe58d600640 1 Processor -- start 2024-09-10T08:34:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.042+0000 7fe58d600640 1 -- start start 2024-09-10T08:34:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880b2d40 0x7fe58815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58813eb20 0x7fe588144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881666e0 con 0x7fe58806c320 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe588166560 con 0x7fe5880b2d40 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe58d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe588166860 con 0x7fe58813eb20 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43368/0 (socket says 172.21.15.52:43368) 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 -- 172.21.15.52:0/4148668299 learned_addr learned my addr 172.21.15.52:0/4148668299 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe57fe00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880b2d40 0x7fe58815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe587400640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58813eb20 0x7fe588144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 -- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58813eb20 msgr2=0x7fe588144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58813eb20 0x7fe588144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 -- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880b2d40 msgr2=0x7fe58815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880b2d40 0x7fe58815ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.043+0000 7fe586a00640 1 -- 172.21.15.52:0/4148668299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58813d790 con 0x7fe58806c320 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe586a00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c4a0 tx=0x7fe57800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578017070 con 0x7fe58806c320 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe578005ce0 con 0x7fe58806c320 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578007270 con 0x7fe58806c320 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58813da70 con 0x7fe58806c320 2024-09-10T08:34:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.044+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58813e030 con 0x7fe58806c320 2024-09-10T08:34:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.045+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58806bc10 con 0x7fe58806c320 2024-09-10T08:34:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.046+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe57801a070 con 0x7fe58806c320 2024-09-10T08:34:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.048+0000 7fe57ea00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 0x7fe56406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.048+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fe57808a140 con 0x7fe58806c320 2024-09-10T08:34:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.048+0000 7fe57fe00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 0x7fe56406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.049+0000 7fe57fe00640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 0x7fe56406e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe588155530 tx=0x7fe570009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.052+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe578058400 con 0x7fe58806c320 2024-09-10T08:34:39.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.241+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe58806c9c0 con 0x7fe58806c320 2024-09-10T08:34:39.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.242+0000 7fe57ea00640 1 -- 172.21.15.52:0/4148668299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+16691 (secure 0 0 0) 0x7fe57805c700 con 0x7fe58806c320 2024-09-10T08:34:39.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:39.243 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":109,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:34:36.423251+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:34:32.657199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T08:34:33.836749+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:34:39.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 msgr2=0x7fe56406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 0x7fe56406e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe588155530 tx=0x7fe570009040 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 msgr2=0x7fe58813c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c4a0 tx=0x7fe57800c960 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 shutdown_connections 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe56406be60 0x7fe56406e320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe58813eb20 0x7fe588144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5880b2d40 0x7fe58815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 --2- 172.21.15.52:0/4148668299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe58806c320 0x7fe58813c5d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 >> 172.21.15.52:0/4148668299 conn(0x7fe5880ccec0 msgr2=0x7fe588156090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 shutdown_connections 2024-09-10T08:34:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.244+0000 7fe58d600640 1 -- 172.21.15.52:0/4148668299 wait complete. 2024-09-10T08:34:39.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:34:39.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:34:39.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.417+0000 7f8d4c400640 1 Processor -- start 2024-09-10T08:34:39.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.417+0000 7f8d4c400640 1 -- start start 2024-09-10T08:34:39.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.418+0000 7f8d4c400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d44073890 0x7f8d440b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.418+0000 7f8d4c400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d440b4020 con 0x7f8d440b5880 2024-09-10T08:34:39.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.418+0000 7f8d4c400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d440b42c0 con 0x7f8d44145ed0 2024-09-10T08:34:39.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.418+0000 7f8d4c400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440b63f0 con 0x7f8d44073890 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d44073890 0x7f8d440b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d44073890 0x7f8d440b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43382/0 (socket says 172.21.15.52:43382) 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d4a400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8d440b5880 0x7f8d440b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40116/0 (socket says 172.21.15.52:40116) 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 -- 172.21.15.52:0/2019098145 learned_addr learned my addr 172.21.15.52:0/2019098145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 -- 172.21.15.52:0/2019098145 >> v1:172.21.15.176:6789/0 conn(0x7f8d44145ed0 legacy=0x7f8d44073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 -- 172.21.15.52:0/2019098145 >> v1:172.21.15.52:6789/0 conn(0x7f8d440b5880 legacy=0x7f8d440b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.419+0000 7f8d49000640 1 -- 172.21.15.52:0/2019098145 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d440b45a0 con 0x7f8d44073890 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.420+0000 7f8d49000640 1 --2- 172.21.15.52:0/2019098145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d440b5080 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009870 tx=0x7f8d3002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc7cb0ea4aa7205 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.420+0000 7f8d43e00640 1 -- 172.21.15.52:0/2019098145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30037070 con 0x7f8d44073890 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.420+0000 7f8d43e00640 1 -- 172.21.15.52:0/2019098145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d30032440 con 0x7f8d44073890 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.420+0000 7f8d43e00640 1 -- 172.21.15.52:0/2019098145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30032810 con 0x7f8d44073890 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 -- 172.21.15.52:0/2019098145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 msgr2=0x7f8d440b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 --2- 172.21.15.52:0/2019098145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d440b5080 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009870 tx=0x7f8d3002a2a0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 -- 172.21.15.52:0/2019098145 shutdown_connections 2024-09-10T08:34:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 --2- 172.21.15.52:0/2019098145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d440b5080 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 -- 172.21.15.52:0/2019098145 >> 172.21.15.52:0/2019098145 conn(0x7f8d440ccec0 msgr2=0x7f8d440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 -- 172.21.15.52:0/2019098145 shutdown_connections 2024-09-10T08:34:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.421+0000 7f8d4c400640 1 -- 172.21.15.52:0/2019098145 wait complete. 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.423+0000 7f8d4c400640 1 Processor -- start 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.423+0000 7f8d4c400640 1 -- start start 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d440b5880 0x7f8d4413ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 0x7f8d441f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d441462b0 con 0x7f8d44073890 2024-09-10T08:34:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440b4b60 con 0x7f8d44145ed0 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4c400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d44146430 con 0x7f8d440b5880 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43394/0 (socket says 172.21.15.52:43394) 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49a00640 1 -- 172.21.15.52:0/4047809699 learned_addr learned my addr 172.21.15.52:0/4047809699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49000640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d440b5880 0x7f8d4413ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d4a400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 0x7f8d441f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49a00640 1 -- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d440b5880 msgr2=0x7f8d4413ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.424+0000 7f8d49a00640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d440b5880 0x7f8d4413ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d49a00640 1 -- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 msgr2=0x7f8d441f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d49a00640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 0x7f8d441f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d49a00640 1 -- 172.21.15.52:0/4047809699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d44071b20 con 0x7f8d44073890 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d4a400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 0x7f8d441f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d49a00640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800b420 tx=0x7f8d3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011830 con 0x7f8d44073890 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d38016070 con 0x7f8d44073890 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011c10 con 0x7f8d44073890 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d44071dc0 con 0x7f8d44073890 2024-09-10T08:34:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.425+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d44072380 con 0x7f8d44073890 2024-09-10T08:34:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.426+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d440b5080 con 0x7f8d44073890 2024-09-10T08:34:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.427+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d3801b460 con 0x7f8d44073890 2024-09-10T08:34:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.428+0000 7f8d41600640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 0x7f8d2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.428+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f8d3808a8b0 con 0x7f8d44073890 2024-09-10T08:34:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.429+0000 7f8d49000640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 0x7f8d2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.429+0000 7f8d49000640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 0x7f8d2406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8d30034000 tx=0x7f8d3002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.432+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d38020020 con 0x7f8d44073890 2024-09-10T08:34:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.614+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d44144b30 con 0x7f8d2406be30 2024-09-10T08:34:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.622+0000 7f8d41600640 1 -- 172.21.15.52:0/4047809699 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247856 (secure 0 0 0) 0x7f8d44144b30 con 0x7f8d2406be30 2024-09-10T08:34:39.625 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:39.627 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:34:39.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 msgr2=0x7f8d2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 0x7f8d2406e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8d30034000 tx=0x7f8d3002e000 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 msgr2=0x7f8d44072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800b420 tx=0x7f8d3800b8e0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 shutdown_connections 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d2406be30 0x7f8d2406e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d44145ed0 0x7f8d441f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d440b5880 0x7f8d4413ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 --2- 172.21.15.52:0/4047809699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d44073890 0x7f8d44072b80 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 >> 172.21.15.52:0/4047809699 conn(0x7f8d440ccec0 msgr2=0x7f8d44142a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 shutdown_connections 2024-09-10T08:34:39.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.626+0000 7f8d4c400640 1 -- 172.21.15.52:0/4047809699 wait complete. 2024-09-10T08:34:39.642 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-10T08:34:39.542052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285944,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754688776,"statfs":{"total":773094113280,"available":772801306624,"internally_reserved":0,"allocated":11726848,"data_stored":5749609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423405+0000","last_change":"2024-09-10T08:34:34.423405+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423405+0000","last_undegraded":"2024-09-10T08:34:34.423405+0000","last_fullsized":"2024-09-10T08:34:34.423405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424012+0000","last_change":"2024-09-10T08:34:34.424012+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424012+0000","last_undegraded":"2024-09-10T08:34:34.424012+0000","last_fullsized":"2024-09-10T08:34:34.424012+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417459+0000","last_change":"2024-09-10T08:34:34.417459+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417459+0000","last_undegraded":"2024-09-10T08:34:34.417459+0000","last_fullsized":"2024-09-10T08:34:34.417459+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422481+0000","last_change":"2024-09-10T08:34:34.422481+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422481+0000","last_undegraded":"2024-09-10T08:34:34.422481+0000","last_fullsized":"2024-09-10T08:34:34.422481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423151+0000","last_change":"2024-09-10T08:34:34.423151+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423151+0000","last_undegraded":"2024-09-10T08:34:34.423151+0000","last_fullsized":"2024-09-10T08:34:34.423151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.428193+0000","last_change":"2024-09-10T08:34:34.428193+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.428193+0000","last_undegraded":"2024-09-10T08:34:34.428193+0000","last_fullsized":"2024-09-10T08:34:34.428193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421753+0000","last_change":"2024-09-10T08:34:34.421753+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421753+0000","last_undegraded":"2024-09-10T08:34:34.421753+0000","last_fullsized":"2024-09-10T08:34:34.421753+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414130+0000","last_change":"2024-09-10T08:34:34.414130+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414130+0000","last_undegraded":"2024-09-10T08:34:34.414130+0000","last_fullsized":"2024-09-10T08:34:34.414130+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.427123+0000","last_change":"2024-09-10T08:34:34.427123+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.427123+0000","last_undegraded":"2024-09-10T08:34:34.427123+0000","last_fullsized":"2024-09-10T08:34:34.427123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419005+0000","last_change":"2024-09-10T08:34:34.419005+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419005+0000","last_undegraded":"2024-09-10T08:34:34.419005+0000","last_fullsized":"2024-09-10T08:34:34.419005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426478+0000","last_change":"2024-09-10T08:34:34.426478+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426478+0000","last_undegraded":"2024-09-10T08:34:34.426478+0000","last_fullsized":"2024-09-10T08:34:34.426478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415318+0000","last_change":"2024-09-10T08:34:34.415318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415318+0000","last_undegraded":"2024-09-10T08:34:34.415318+0000","last_fullsized":"2024-09-10T08:34:34.415318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423543+0000","last_change":"2024-09-10T08:34:34.423543+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423543+0000","last_undegraded":"2024-09-10T08:34:34.423543+0000","last_fullsized":"2024-09-10T08:34:34.423543+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418977+0000","last_change":"2024-09-10T08:34:34.418977+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418977+0000","last_undegraded":"2024-09-10T08:34:34.418977+0000","last_fullsized":"2024-09-10T08:34:34.418977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418677+0000","last_change":"2024-09-10T08:34:34.418677+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418677+0000","last_undegraded":"2024-09-10T08:34:34.418677+0000","last_fullsized":"2024-09-10T08:34:34.418677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420232+0000","last_change":"2024-09-10T08:34:34.420232+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420232+0000","last_undegraded":"2024-09-10T08:34:34.420232+0000","last_fullsized":"2024-09-10T08:34:34.420232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436806+0000","last_change":"2024-09-10T08:34:35.443743+0000","last_active":"2024-09-10T08:34:36.436806+0000","last_peered":"2024-09-10T08:34:36.436806+0000","last_clean":"2024-09-10T08:34:36.436806+0000","last_became_active":"2024-09-10T08:34:35.443367+0000","last_became_peered":"2024-09-10T08:34:35.443367+0000","last_unstale":"2024-09-10T08:34:36.436806+0000","last_undegraded":"2024-09-10T08:34:36.436806+0000","last_fullsized":"2024-09-10T08:34:36.436806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:46.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423568+0000","last_change":"2024-09-10T08:34:34.423568+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423568+0000","last_undegraded":"2024-09-10T08:34:34.423568+0000","last_fullsized":"2024-09-10T08:34:34.423568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438213+0000","last_change":"2024-09-10T08:34:35.433604+0000","last_active":"2024-09-10T08:34:36.438213+0000","last_peered":"2024-09-10T08:34:36.438213+0000","last_clean":"2024-09-10T08:34:36.438213+0000","last_became_active":"2024-09-10T08:34:35.433332+0000","last_became_peered":"2024-09-10T08:34:35.433332+0000","last_unstale":"2024-09-10T08:34:36.438213+0000","last_undegraded":"2024-09-10T08:34:36.438213+0000","last_fullsized":"2024-09-10T08:34:36.438213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.004100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414910+0000","last_change":"2024-09-10T08:34:34.414910+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414910+0000","last_undegraded":"2024-09-10T08:34:34.414910+0000","last_fullsized":"2024-09-10T08:34:34.414910+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415306+0000","last_change":"2024-09-10T08:34:34.415306+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415306+0000","last_undegraded":"2024-09-10T08:34:34.415306+0000","last_fullsized":"2024-09-10T08:34:34.415306+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416567+0000","last_change":"2024-09-10T08:34:34.416567+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416567+0000","last_undegraded":"2024-09-10T08:34:34.416567+0000","last_fullsized":"2024-09-10T08:34:34.416567+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418087+0000","last_change":"2024-09-10T08:34:34.418087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418087+0000","last_undegraded":"2024-09-10T08:34:34.418087+0000","last_fullsized":"2024-09-10T08:34:34.418087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417954+0000","last_change":"2024-09-10T08:34:34.417954+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417954+0000","last_undegraded":"2024-09-10T08:34:34.417954+0000","last_fullsized":"2024-09-10T08:34:34.417954+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419218+0000","last_change":"2024-09-10T08:34:34.419218+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419218+0000","last_undegraded":"2024-09-10T08:34:34.419218+0000","last_fullsized":"2024-09-10T08:34:34.419218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424784+0000","last_change":"2024-09-10T08:34:34.424784+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424784+0000","last_undegraded":"2024-09-10T08:34:34.424784+0000","last_fullsized":"2024-09-10T08:34:34.424784+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418759+0000","last_change":"2024-09-10T08:34:34.418759+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418759+0000","last_undegraded":"2024-09-10T08:34:34.418759+0000","last_fullsized":"2024-09-10T08:34:34.418759+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417269+0000","last_change":"2024-09-10T08:34:34.417269+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417269+0000","last_undegraded":"2024-09-10T08:34:34.417269+0000","last_fullsized":"2024-09-10T08:34:34.417269+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423145+0000","last_change":"2024-09-10T08:34:34.423145+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423145+0000","last_undegraded":"2024-09-10T08:34:34.423145+0000","last_fullsized":"2024-09-10T08:34:34.423145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420804+0000","last_change":"2024-09-10T08:34:34.420804+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420804+0000","last_undegraded":"2024-09-10T08:34:34.420804+0000","last_fullsized":"2024-09-10T08:34:34.420804+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417187+0000","last_change":"2024-09-10T08:34:34.417187+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417187+0000","last_undegraded":"2024-09-10T08:34:34.417187+0000","last_fullsized":"2024-09-10T08:34:34.417187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419892+0000","last_change":"2024-09-10T08:34:34.419892+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419892+0000","last_undegraded":"2024-09-10T08:34:34.419892+0000","last_fullsized":"2024-09-10T08:34:34.419892+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437098+0000","last_change":"2024-09-10T08:34:35.442470+0000","last_active":"2024-09-10T08:34:36.437098+0000","last_peered":"2024-09-10T08:34:36.437098+0000","last_clean":"2024-09-10T08:34:36.437098+0000","last_became_active":"2024-09-10T08:34:35.442205+0000","last_became_peered":"2024-09-10T08:34:35.442205+0000","last_unstale":"2024-09-10T08:34:36.437098+0000","last_undegraded":"2024-09-10T08:34:36.437098+0000","last_fullsized":"2024-09-10T08:34:36.437098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:47.215931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.440376+0000","last_change":"2024-09-10T08:34:34.438667+0000","last_active":"2024-09-10T08:34:34.440376+0000","last_peered":"2024-09-10T08:34:34.440376+0000","last_clean":"2024-09-10T08:34:34.440376+0000","last_became_active":"2024-09-10T08:34:34.437256+0000","last_became_peered":"2024-09-10T08:34:34.437256+0000","last_unstale":"2024-09-10T08:34:34.440376+0000","last_undegraded":"2024-09-10T08:34:34.440376+0000","last_fullsized":"2024-09-10T08:34:34.440376+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:12.032750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424132+0000","last_change":"2024-09-10T08:34:34.424132+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424132+0000","last_undegraded":"2024-09-10T08:34:34.424132+0000","last_fullsized":"2024-09-10T08:34:34.424132+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437261+0000","last_change":"2024-09-10T08:34:34.435974+0000","last_active":"2024-09-10T08:34:34.437261+0000","last_peered":"2024-09-10T08:34:34.437261+0000","last_clean":"2024-09-10T08:34:34.437261+0000","last_became_active":"2024-09-10T08:34:34.435612+0000","last_became_peered":"2024-09-10T08:34:34.435612+0000","last_unstale":"2024-09-10T08:34:34.437261+0000","last_undegraded":"2024-09-10T08:34:34.437261+0000","last_fullsized":"2024-09-10T08:34:34.437261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:23.863413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422013+0000","last_change":"2024-09-10T08:34:34.422013+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422013+0000","last_undegraded":"2024-09-10T08:34:34.422013+0000","last_fullsized":"2024-09-10T08:34:34.422013+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435921+0000","last_change":"2024-09-10T08:34:34.432133+0000","last_active":"2024-09-10T08:34:34.435921+0000","last_peered":"2024-09-10T08:34:34.435921+0000","last_clean":"2024-09-10T08:34:34.435921+0000","last_became_active":"2024-09-10T08:34:34.430805+0000","last_became_peered":"2024-09-10T08:34:34.430805+0000","last_unstale":"2024-09-10T08:34:34.435921+0000","last_undegraded":"2024-09-10T08:34:34.435921+0000","last_fullsized":"2024-09-10T08:34:34.435921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.049469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417889+0000","last_change":"2024-09-10T08:34:34.417889+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417889+0000","last_undegraded":"2024-09-10T08:34:34.417889+0000","last_fullsized":"2024-09-10T08:34:34.417889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436519+0000","last_change":"2024-09-10T08:34:34.431738+0000","last_active":"2024-09-10T08:34:34.436519+0000","last_peered":"2024-09-10T08:34:34.436519+0000","last_clean":"2024-09-10T08:34:34.436519+0000","last_became_active":"2024-09-10T08:34:34.431422+0000","last_became_peered":"2024-09-10T08:34:34.431422+0000","last_unstale":"2024-09-10T08:34:34.436519+0000","last_undegraded":"2024-09-10T08:34:34.436519+0000","last_fullsized":"2024-09-10T08:34:34.436519+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.202570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414801+0000","last_change":"2024-09-10T08:34:34.414801+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414801+0000","last_undegraded":"2024-09-10T08:34:34.414801+0000","last_fullsized":"2024-09-10T08:34:34.414801+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438218+0000","last_change":"2024-09-10T08:34:34.434494+0000","last_active":"2024-09-10T08:34:34.438218+0000","last_peered":"2024-09-10T08:34:34.438218+0000","last_clean":"2024-09-10T08:34:34.438218+0000","last_became_active":"2024-09-10T08:34:34.434024+0000","last_became_peered":"2024-09-10T08:34:34.434024+0000","last_unstale":"2024-09-10T08:34:34.438218+0000","last_undegraded":"2024-09-10T08:34:34.438218+0000","last_fullsized":"2024-09-10T08:34:34.438218+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:34.132190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422502+0000","last_change":"2024-09-10T08:34:34.422502+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422502+0000","last_undegraded":"2024-09-10T08:34:34.422502+0000","last_fullsized":"2024-09-10T08:34:34.422502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439841+0000","last_change":"2024-09-10T08:34:34.438384+0000","last_active":"2024-09-10T08:34:34.439841+0000","last_peered":"2024-09-10T08:34:34.439841+0000","last_clean":"2024-09-10T08:34:34.439841+0000","last_became_active":"2024-09-10T08:34:34.438128+0000","last_became_peered":"2024-09-10T08:34:34.438128+0000","last_unstale":"2024-09-10T08:34:34.439841+0000","last_undegraded":"2024-09-10T08:34:34.439841+0000","last_fullsized":"2024-09-10T08:34:34.439841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:06.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419381+0000","last_change":"2024-09-10T08:34:34.419381+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419381+0000","last_undegraded":"2024-09-10T08:34:34.419381+0000","last_fullsized":"2024-09-10T08:34:34.419381+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434541+0000","last_change":"2024-09-10T08:34:34.433790+0000","last_active":"2024-09-10T08:34:34.434541+0000","last_peered":"2024-09-10T08:34:34.434541+0000","last_clean":"2024-09-10T08:34:34.434541+0000","last_became_active":"2024-09-10T08:34:34.433508+0000","last_became_peered":"2024-09-10T08:34:34.433508+0000","last_unstale":"2024-09-10T08:34:34.434541+0000","last_undegraded":"2024-09-10T08:34:34.434541+0000","last_fullsized":"2024-09-10T08:34:34.434541+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:55.607496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414844+0000","last_change":"2024-09-10T08:34:34.414844+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414844+0000","last_undegraded":"2024-09-10T08:34:34.414844+0000","last_fullsized":"2024-09-10T08:34:34.414844+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437607+0000","last_change":"2024-09-10T08:34:34.436720+0000","last_active":"2024-09-10T08:34:36.437607+0000","last_peered":"2024-09-10T08:34:36.437607+0000","last_clean":"2024-09-10T08:34:36.437607+0000","last_became_active":"2024-09-10T08:34:34.436399+0000","last_became_peered":"2024-09-10T08:34:34.436399+0000","last_unstale":"2024-09-10T08:34:36.437607+0000","last_undegraded":"2024-09-10T08:34:36.437607+0000","last_fullsized":"2024-09-10T08:34:36.437607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.115469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423181+0000","last_change":"2024-09-10T08:34:34.423181+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423181+0000","last_undegraded":"2024-09-10T08:34:34.423181+0000","last_fullsized":"2024-09-10T08:34:34.423181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.428223+0000","last_change":"2024-09-10T08:34:34.423542+0000","last_active":"2024-09-10T08:34:34.428223+0000","last_peered":"2024-09-10T08:34:34.428223+0000","last_clean":"2024-09-10T08:34:34.428223+0000","last_became_active":"2024-09-10T08:34:34.423263+0000","last_became_peered":"2024-09-10T08:34:34.423263+0000","last_unstale":"2024-09-10T08:34:34.428223+0000","last_undegraded":"2024-09-10T08:34:34.428223+0000","last_fullsized":"2024-09-10T08:34:34.428223+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417758+0000","last_change":"2024-09-10T08:34:34.417758+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417758+0000","last_undegraded":"2024-09-10T08:34:34.417758+0000","last_fullsized":"2024-09-10T08:34:34.417758+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436487+0000","last_change":"2024-09-10T08:34:34.431042+0000","last_active":"2024-09-10T08:34:34.436487+0000","last_peered":"2024-09-10T08:34:34.436487+0000","last_clean":"2024-09-10T08:34:34.436487+0000","last_became_active":"2024-09-10T08:34:34.430781+0000","last_became_peered":"2024-09-10T08:34:34.430781+0000","last_unstale":"2024-09-10T08:34:34.436487+0000","last_undegraded":"2024-09-10T08:34:34.436487+0000","last_fullsized":"2024-09-10T08:34:34.436487+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:50.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424550+0000","last_change":"2024-09-10T08:34:34.424550+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424550+0000","last_undegraded":"2024-09-10T08:34:34.424550+0000","last_fullsized":"2024-09-10T08:34:34.424550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434286+0000","last_change":"2024-09-10T08:34:34.430619+0000","last_active":"2024-09-10T08:34:34.434286+0000","last_peered":"2024-09-10T08:34:34.434286+0000","last_clean":"2024-09-10T08:34:34.434286+0000","last_became_active":"2024-09-10T08:34:34.430054+0000","last_became_peered":"2024-09-10T08:34:34.430054+0000","last_unstale":"2024-09-10T08:34:34.434286+0000","last_undegraded":"2024-09-10T08:34:34.434286+0000","last_fullsized":"2024-09-10T08:34:34.434286+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416408+0000","last_change":"2024-09-10T08:34:34.416408+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416408+0000","last_undegraded":"2024-09-10T08:34:34.416408+0000","last_fullsized":"2024-09-10T08:34:34.416408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434253+0000","last_change":"2024-09-10T08:34:34.433126+0000","last_active":"2024-09-10T08:34:34.434253+0000","last_peered":"2024-09-10T08:34:34.434253+0000","last_clean":"2024-09-10T08:34:34.434253+0000","last_became_active":"2024-09-10T08:34:34.431890+0000","last_became_peered":"2024-09-10T08:34:34.431890+0000","last_unstale":"2024-09-10T08:34:34.434253+0000","last_undegraded":"2024-09-10T08:34:34.434253+0000","last_fullsized":"2024-09-10T08:34:34.434253+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:37.371058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418118+0000","last_change":"2024-09-10T08:34:34.418118+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418118+0000","last_undegraded":"2024-09-10T08:34:34.418118+0000","last_fullsized":"2024-09-10T08:34:34.418118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436653+0000","last_change":"2024-09-10T08:34:34.437471+0000","last_active":"2024-09-10T08:34:36.436653+0000","last_peered":"2024-09-10T08:34:36.436653+0000","last_clean":"2024-09-10T08:34:36.436653+0000","last_became_active":"2024-09-10T08:34:34.436355+0000","last_became_peered":"2024-09-10T08:34:34.436355+0000","last_unstale":"2024-09-10T08:34:36.436653+0000","last_undegraded":"2024-09-10T08:34:36.436653+0000","last_fullsized":"2024-09-10T08:34:36.436653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414087+0000","last_change":"2024-09-10T08:34:34.414087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414087+0000","last_undegraded":"2024-09-10T08:34:34.414087+0000","last_fullsized":"2024-09-10T08:34:34.414087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439131+0000","last_change":"2024-09-10T08:34:34.437445+0000","last_active":"2024-09-10T08:34:34.439131+0000","last_peered":"2024-09-10T08:34:34.439131+0000","last_clean":"2024-09-10T08:34:34.439131+0000","last_became_active":"2024-09-10T08:34:34.437178+0000","last_became_peered":"2024-09-10T08:34:34.437178+0000","last_unstale":"2024-09-10T08:34:34.439131+0000","last_undegraded":"2024-09-10T08:34:34.439131+0000","last_fullsized":"2024-09-10T08:34:34.439131+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419699+0000","last_change":"2024-09-10T08:34:34.419699+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419699+0000","last_undegraded":"2024-09-10T08:34:34.419699+0000","last_fullsized":"2024-09-10T08:34:34.419699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.423657+0000","last_change":"2024-09-10T08:34:34.421209+0000","last_active":"2024-09-10T08:34:34.423657+0000","last_peered":"2024-09-10T08:34:34.423657+0000","last_clean":"2024-09-10T08:34:34.423657+0000","last_became_active":"2024-09-10T08:34:34.420857+0000","last_became_peered":"2024-09-10T08:34:34.420857+0000","last_unstale":"2024-09-10T08:34:34.423657+0000","last_undegraded":"2024-09-10T08:34:34.423657+0000","last_fullsized":"2024-09-10T08:34:34.423657+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:03.807592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414783+0000","last_change":"2024-09-10T08:34:34.414783+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414783+0000","last_undegraded":"2024-09-10T08:34:34.414783+0000","last_fullsized":"2024-09-10T08:34:34.414783+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438057+0000","last_change":"2024-09-10T08:34:34.434724+0000","last_active":"2024-09-10T08:34:34.438057+0000","last_peered":"2024-09-10T08:34:34.438057+0000","last_clean":"2024-09-10T08:34:34.438057+0000","last_became_active":"2024-09-10T08:34:34.431717+0000","last_became_peered":"2024-09-10T08:34:34.431717+0000","last_unstale":"2024-09-10T08:34:34.438057+0000","last_undegraded":"2024-09-10T08:34:34.438057+0000","last_fullsized":"2024-09-10T08:34:34.438057+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:36.029217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417318+0000","last_change":"2024-09-10T08:34:34.417318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417318+0000","last_undegraded":"2024-09-10T08:34:34.417318+0000","last_fullsized":"2024-09-10T08:34:34.417318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435023+0000","last_change":"2024-09-10T08:34:34.433626+0000","last_active":"2024-09-10T08:34:34.435023+0000","last_peered":"2024-09-10T08:34:34.435023+0000","last_clean":"2024-09-10T08:34:34.435023+0000","last_became_active":"2024-09-10T08:34:34.431050+0000","last_became_peered":"2024-09-10T08:34:34.431050+0000","last_unstale":"2024-09-10T08:34:34.435023+0000","last_undegraded":"2024-09-10T08:34:34.435023+0000","last_fullsized":"2024-09-10T08:34:34.435023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:21.214168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416319+0000","last_change":"2024-09-10T08:34:34.416319+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416319+0000","last_undegraded":"2024-09-10T08:34:34.416319+0000","last_fullsized":"2024-09-10T08:34:34.416319+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436434+0000","last_change":"2024-09-10T08:34:34.435089+0000","last_active":"2024-09-10T08:34:34.436434+0000","last_peered":"2024-09-10T08:34:34.436434+0000","last_clean":"2024-09-10T08:34:34.436434+0000","last_became_active":"2024-09-10T08:34:34.434758+0000","last_became_peered":"2024-09-10T08:34:34.434758+0000","last_unstale":"2024-09-10T08:34:34.436434+0000","last_undegraded":"2024-09-10T08:34:34.436434+0000","last_fullsized":"2024-09-10T08:34:34.436434+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.014201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414347+0000","last_change":"2024-09-10T08:34:34.414347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414347+0000","last_undegraded":"2024-09-10T08:34:34.414347+0000","last_fullsized":"2024-09-10T08:34:34.414347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436650+0000","last_change":"2024-09-10T08:34:34.432248+0000","last_active":"2024-09-10T08:34:36.436650+0000","last_peered":"2024-09-10T08:34:36.436650+0000","last_clean":"2024-09-10T08:34:36.436650+0000","last_became_active":"2024-09-10T08:34:34.431912+0000","last_became_peered":"2024-09-10T08:34:34.431912+0000","last_unstale":"2024-09-10T08:34:36.436650+0000","last_undegraded":"2024-09-10T08:34:36.436650+0000","last_fullsized":"2024-09-10T08:34:36.436650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:34.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436624+0000","last_change":"2024-09-10T08:34:35.435254+0000","last_active":"2024-09-10T08:34:36.436624+0000","last_peered":"2024-09-10T08:34:36.436624+0000","last_clean":"2024-09-10T08:34:36.436624+0000","last_became_active":"2024-09-10T08:34:35.435000+0000","last_became_peered":"2024-09-10T08:34:35.435000+0000","last_unstale":"2024-09-10T08:34:36.436624+0000","last_undegraded":"2024-09-10T08:34:36.436624+0000","last_fullsized":"2024-09-10T08:34:36.436624+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:29.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433086+0000","last_change":"2024-09-10T08:34:34.430005+0000","last_active":"2024-09-10T08:34:34.433086+0000","last_peered":"2024-09-10T08:34:34.433086+0000","last_clean":"2024-09-10T08:34:34.433086+0000","last_became_active":"2024-09-10T08:34:34.429669+0000","last_became_peered":"2024-09-10T08:34:34.429669+0000","last_unstale":"2024-09-10T08:34:34.433086+0000","last_undegraded":"2024-09-10T08:34:34.433086+0000","last_fullsized":"2024-09-10T08:34:34.433086+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:13.312879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436730+0000","last_change":"2024-09-10T08:34:35.428979+0000","last_active":"2024-09-10T08:34:36.436730+0000","last_peered":"2024-09-10T08:34:36.436730+0000","last_clean":"2024-09-10T08:34:36.436730+0000","last_became_active":"2024-09-10T08:34:35.428705+0000","last_became_peered":"2024-09-10T08:34:35.428705+0000","last_unstale":"2024-09-10T08:34:36.436730+0000","last_undegraded":"2024-09-10T08:34:36.436730+0000","last_fullsized":"2024-09-10T08:34:36.436730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:08.670337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437851+0000","last_change":"2024-09-10T08:34:34.437024+0000","last_active":"2024-09-10T08:34:34.437851+0000","last_peered":"2024-09-10T08:34:34.437851+0000","last_clean":"2024-09-10T08:34:34.437851+0000","last_became_active":"2024-09-10T08:34:34.436737+0000","last_became_peered":"2024-09-10T08:34:34.436737+0000","last_unstale":"2024-09-10T08:34:34.437851+0000","last_undegraded":"2024-09-10T08:34:34.437851+0000","last_fullsized":"2024-09-10T08:34:34.437851+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:33.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419466+0000","last_change":"2024-09-10T08:34:34.419466+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419466+0000","last_undegraded":"2024-09-10T08:34:34.419466+0000","last_fullsized":"2024-09-10T08:34:34.419466+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433426+0000","last_change":"2024-09-10T08:34:34.432017+0000","last_active":"2024-09-10T08:34:34.433426+0000","last_peered":"2024-09-10T08:34:34.433426+0000","last_clean":"2024-09-10T08:34:34.433426+0000","last_became_active":"2024-09-10T08:34:34.431711+0000","last_became_peered":"2024-09-10T08:34:34.431711+0000","last_unstale":"2024-09-10T08:34:34.433426+0000","last_undegraded":"2024-09-10T08:34:34.433426+0000","last_fullsized":"2024-09-10T08:34:34.433426+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415930+0000","last_change":"2024-09-10T08:34:34.415930+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415930+0000","last_undegraded":"2024-09-10T08:34:34.415930+0000","last_fullsized":"2024-09-10T08:34:34.415930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.431916+0000","last_change":"2024-09-10T08:34:34.429461+0000","last_active":"2024-09-10T08:34:34.431916+0000","last_peered":"2024-09-10T08:34:34.431916+0000","last_clean":"2024-09-10T08:34:34.431916+0000","last_became_active":"2024-09-10T08:34:34.429128+0000","last_became_peered":"2024-09-10T08:34:34.429128+0000","last_unstale":"2024-09-10T08:34:34.431916+0000","last_undegraded":"2024-09-10T08:34:34.431916+0000","last_fullsized":"2024-09-10T08:34:34.431916+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:18.010285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437345+0000","last_change":"2024-09-10T08:34:35.434825+0000","last_active":"2024-09-10T08:34:36.437345+0000","last_peered":"2024-09-10T08:34:36.437345+0000","last_clean":"2024-09-10T08:34:36.437345+0000","last_became_active":"2024-09-10T08:34:35.430948+0000","last_became_peered":"2024-09-10T08:34:35.430948+0000","last_unstale":"2024-09-10T08:34:36.437345+0000","last_undegraded":"2024-09-10T08:34:36.437345+0000","last_fullsized":"2024-09-10T08:34:36.437345+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:16.603302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.422234+0000","last_change":"2024-09-10T08:34:34.419784+0000","last_active":"2024-09-10T08:34:34.422234+0000","last_peered":"2024-09-10T08:34:34.422234+0000","last_clean":"2024-09-10T08:34:34.422234+0000","last_became_active":"2024-09-10T08:34:34.419506+0000","last_became_peered":"2024-09-10T08:34:34.419506+0000","last_unstale":"2024-09-10T08:34:34.422234+0000","last_undegraded":"2024-09-10T08:34:34.422234+0000","last_fullsized":"2024-09-10T08:34:34.422234+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436975+0000","last_change":"2024-09-10T08:34:35.433095+0000","last_active":"2024-09-10T08:34:36.436975+0000","last_peered":"2024-09-10T08:34:36.436975+0000","last_clean":"2024-09-10T08:34:36.436975+0000","last_became_active":"2024-09-10T08:34:35.431572+0000","last_became_peered":"2024-09-10T08:34:35.431572+0000","last_unstale":"2024-09-10T08:34:36.436975+0000","last_undegraded":"2024-09-10T08:34:36.436975+0000","last_fullsized":"2024-09-10T08:34:36.436975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.472360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437455+0000","last_change":"2024-09-10T08:34:34.431957+0000","last_active":"2024-09-10T08:34:36.437455+0000","last_peered":"2024-09-10T08:34:36.437455+0000","last_clean":"2024-09-10T08:34:36.437455+0000","last_became_active":"2024-09-10T08:34:34.428639+0000","last_became_peered":"2024-09-10T08:34:34.428639+0000","last_unstale":"2024-09-10T08:34:36.437455+0000","last_undegraded":"2024-09-10T08:34:36.437455+0000","last_fullsized":"2024-09-10T08:34:36.437455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416347+0000","last_change":"2024-09-10T08:34:34.416347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416347+0000","last_undegraded":"2024-09-10T08:34:34.416347+0000","last_fullsized":"2024-09-10T08:34:34.416347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437852+0000","last_change":"2024-09-10T08:34:34.427424+0000","last_active":"2024-09-10T08:34:36.437852+0000","last_peered":"2024-09-10T08:34:36.437852+0000","last_clean":"2024-09-10T08:34:36.437852+0000","last_became_active":"2024-09-10T08:34:34.426305+0000","last_became_peered":"2024-09-10T08:34:34.426305+0000","last_unstale":"2024-09-10T08:34:36.437852+0000","last_undegraded":"2024-09-10T08:34:36.437852+0000","last_fullsized":"2024-09-10T08:34:36.437852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:18.049964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426042+0000","last_change":"2024-09-10T08:34:34.426042+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426042+0000","last_undegraded":"2024-09-10T08:34:34.426042+0000","last_fullsized":"2024-09-10T08:34:34.426042+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.424845+0000","last_change":"2024-09-10T08:34:34.423423+0000","last_active":"2024-09-10T08:34:34.424845+0000","last_peered":"2024-09-10T08:34:34.424845+0000","last_clean":"2024-09-10T08:34:34.424845+0000","last_became_active":"2024-09-10T08:34:34.419996+0000","last_became_peered":"2024-09-10T08:34:34.419996+0000","last_unstale":"2024-09-10T08:34:34.424845+0000","last_undegraded":"2024-09-10T08:34:34.424845+0000","last_fullsized":"2024-09-10T08:34:34.424845+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.102494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436802+0000","last_change":"2024-09-10T08:34:35.440388+0000","last_active":"2024-09-10T08:34:36.436802+0000","last_peered":"2024-09-10T08:34:36.436802+0000","last_clean":"2024-09-10T08:34:36.436802+0000","last_became_active":"2024-09-10T08:34:35.439549+0000","last_became_peered":"2024-09-10T08:34:35.439549+0000","last_unstale":"2024-09-10T08:34:36.436802+0000","last_undegraded":"2024-09-10T08:34:36.436802+0000","last_fullsized":"2024-09-10T08:34:36.436802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435737+0000","last_change":"2024-09-10T08:34:34.433704+0000","last_active":"2024-09-10T08:34:34.435737+0000","last_peered":"2024-09-10T08:34:34.435737+0000","last_clean":"2024-09-10T08:34:34.435737+0000","last_became_active":"2024-09-10T08:34:34.433401+0000","last_became_peered":"2024-09-10T08:34:34.433401+0000","last_unstale":"2024-09-10T08:34:34.435737+0000","last_undegraded":"2024-09-10T08:34:34.435737+0000","last_fullsized":"2024-09-10T08:34:34.435737+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:24.167963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421561+0000","last_change":"2024-09-10T08:34:34.421561+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421561+0000","last_undegraded":"2024-09-10T08:34:34.421561+0000","last_fullsized":"2024-09-10T08:34:34.421561+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433574+0000","last_change":"2024-09-10T08:34:34.431145+0000","last_active":"2024-09-10T08:34:34.433574+0000","last_peered":"2024-09-10T08:34:34.433574+0000","last_clean":"2024-09-10T08:34:34.433574+0000","last_became_active":"2024-09-10T08:34:34.430713+0000","last_became_peered":"2024-09-10T08:34:34.430713+0000","last_unstale":"2024-09-10T08:34:34.433574+0000","last_undegraded":"2024-09-10T08:34:34.433574+0000","last_fullsized":"2024-09-10T08:34:34.433574+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:34.185388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437587+0000","last_change":"2024-09-10T08:34:35.447833+0000","last_active":"2024-09-10T08:34:36.437587+0000","last_peered":"2024-09-10T08:34:36.437587+0000","last_clean":"2024-09-10T08:34:36.437587+0000","last_became_active":"2024-09-10T08:34:35.447138+0000","last_became_peered":"2024-09-10T08:34:35.447138+0000","last_unstale":"2024-09-10T08:34:36.437587+0000","last_undegraded":"2024-09-10T08:34:36.437587+0000","last_fullsized":"2024-09-10T08:34:36.437587+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:34.020654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.442435+0000","last_change":"2024-09-10T08:34:34.439809+0000","last_active":"2024-09-10T08:34:34.442435+0000","last_peered":"2024-09-10T08:34:34.442435+0000","last_clean":"2024-09-10T08:34:34.442435+0000","last_became_active":"2024-09-10T08:34:34.438918+0000","last_became_peered":"2024-09-10T08:34:34.438918+0000","last_unstale":"2024-09-10T08:34:34.442435+0000","last_undegraded":"2024-09-10T08:34:34.442435+0000","last_fullsized":"2024-09-10T08:34:34.442435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414144+0000","last_change":"2024-09-10T08:34:34.414144+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414144+0000","last_undegraded":"2024-09-10T08:34:34.414144+0000","last_fullsized":"2024-09-10T08:34:34.414144+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.430158+0000","last_change":"2024-09-10T08:34:34.428151+0000","last_active":"2024-09-10T08:34:34.430158+0000","last_peered":"2024-09-10T08:34:34.430158+0000","last_clean":"2024-09-10T08:34:34.430158+0000","last_became_active":"2024-09-10T08:34:34.427824+0000","last_became_peered":"2024-09-10T08:34:34.427824+0000","last_unstale":"2024-09-10T08:34:34.430158+0000","last_undegraded":"2024-09-10T08:34:34.430158+0000","last_fullsized":"2024-09-10T08:34:34.430158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:23.156216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416638+0000","last_change":"2024-09-10T08:34:34.416638+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416638+0000","last_undegraded":"2024-09-10T08:34:34.416638+0000","last_fullsized":"2024-09-10T08:34:34.416638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433174+0000","last_change":"2024-09-10T08:34:34.431301+0000","last_active":"2024-09-10T08:34:34.433174+0000","last_peered":"2024-09-10T08:34:34.433174+0000","last_clean":"2024-09-10T08:34:34.433174+0000","last_became_active":"2024-09-10T08:34:34.430954+0000","last_became_peered":"2024-09-10T08:34:34.430954+0000","last_unstale":"2024-09-10T08:34:34.433174+0000","last_undegraded":"2024-09-10T08:34:34.433174+0000","last_fullsized":"2024-09-10T08:34:34.433174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:00.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":319,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.416242+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:34:34.416242+0000","last_peered":"2024-09-10T08:34:34.416242+0000","last_clean":"2024-09-10T08:34:34.416242+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:34:34.416242+0000","last_undegraded":"2024-09-10T08:34:34.416242+0000","last_fullsized":"2024-09-10T08:34:34.416242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40796,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331044,"statfs":{"total":96636764160,"available":96594989056,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1908736,"data_stored":1161203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":1175946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:34:39.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:34:39.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.838+0000 7fa51ac00640 1 Processor -- start 2024-09-10T08:34:39.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.838+0000 7fa51ac00640 1 -- start start 2024-09-10T08:34:39.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51415e6d0 0x7fa514071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa51406cd20 0x7fa5140b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa514070b80 0x7fa5140b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa5140b77e0 con 0x7fa514070b80 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa51415eab0 con 0x7fa51406cd20 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa51ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa51415ed70 con 0x7fa51415e6d0 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa518c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa514070b80 0x7fa5140b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa518c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa514070b80 0x7fa5140b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43402/0 (socket says 172.21.15.52:43402) 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.839+0000 7fa518c00640 1 -- 172.21.15.52:0/1314430768 learned_addr learned my addr 172.21.15.52:0/1314430768 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa513e00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51415e6d0 0x7fa514071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa513400640 1 --2- 172.21.15.52:0/1314430768 >> v2:172.21.15.176:3300/0 conn(0x7fa51406cd20 0x7fa5140b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa518c00640 1 -- 172.21.15.52:0/1314430768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51415e6d0 msgr2=0x7fa514071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa518c00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51415e6d0 0x7fa514071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa518c00640 1 -- 172.21.15.52:0/1314430768 >> v2:172.21.15.176:3300/0 conn(0x7fa51406cd20 msgr2=0x7fa5140b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa518c00640 1 --2- 172.21.15.52:0/1314430768 >> v2:172.21.15.176:3300/0 conn(0x7fa51406cd20 0x7fa5140b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.840+0000 7fa518c00640 1 -- 172.21.15.52:0/1314430768 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51415f050 con 0x7fa514070b80 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.841+0000 7fa518c00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa5140b72a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa5140d32f0 tx=0x7fa50c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f198a76cf62de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.841+0000 7fa512a00640 1 -- 172.21.15.52:0/1314430768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c036070 con 0x7fa514070b80 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.841+0000 7fa512a00640 1 -- 172.21.15.52:0/1314430768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c031600 con 0x7fa514070b80 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.841+0000 7fa512a00640 1 -- 172.21.15.52:0/1314430768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0319d0 con 0x7fa514070b80 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 -- 172.21.15.52:0/1314430768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 msgr2=0x7fa5140b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa5140b72a0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa5140d32f0 tx=0x7fa50c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 -- 172.21.15.52:0/1314430768 shutdown_connections 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 --2- 172.21.15.52:0/1314430768 >> v2:172.21.15.176:3300/0 conn(0x7fa51406cd20 0x7fa5140b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa5140b72a0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 --2- 172.21.15.52:0/1314430768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51415e6d0 0x7fa514071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 -- 172.21.15.52:0/1314430768 >> 172.21.15.52:0/1314430768 conn(0x7fa514067fb0 msgr2=0x7fa51406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 -- 172.21.15.52:0/1314430768 shutdown_connections 2024-09-10T08:34:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.842+0000 7fa51ac00640 1 -- 172.21.15.52:0/1314430768 wait complete. 2024-09-10T08:34:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.844+0000 7fa51ac00640 1 Processor -- start 2024-09-10T08:34:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.844+0000 7fa51ac00640 1 -- start start 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51406cd20 0x7fa51414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 0x7fa514158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa51415f8f0 con 0x7fa514070b80 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa51415f610 con 0x7fa51415e6d0 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa51ac00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140718d0 con 0x7fa51406cd20 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43406/0 (socket says 172.21.15.52:43406) 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 -- 172.21.15.52:0/3106322914 learned_addr learned my addr 172.21.15.52:0/3106322914 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513e00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51406cd20 0x7fa51414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa518c00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 0x7fa514158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 -- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51406cd20 msgr2=0x7fa51414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51406cd20 0x7fa51414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 -- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 msgr2=0x7fa514158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 0x7fa514158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa513400640 1 -- 172.21.15.52:0/3106322914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51414c9f0 con 0x7fa514070b80 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.845+0000 7fa518c00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 0x7fa514158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:39.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa513400640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e870 tx=0x7fa50000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500017070 con 0x7fa514070b80 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50000ee60 con 0x7fa514070b80 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50000cb00 con 0x7fa514070b80 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51414ccd0 con 0x7fa514070b80 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.846+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51414d570 con 0x7fa514070b80 2024-09-10T08:34:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.847+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514071390 con 0x7fa514070b80 2024-09-10T08:34:39.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.848+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa50001a070 con 0x7fa514070b80 2024-09-10T08:34:39.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.849+0000 7fa50be00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:39.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.849+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fa50008aff0 con 0x7fa514070b80 2024-09-10T08:34:39.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.849+0000 7fa513e00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:39.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.850+0000 7fa513e00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 0x7fa4f406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa504009ac0 tx=0x7fa504009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:39.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:39.853+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5000592d0 con 0x7fa514070b80 2024-09-10T08:34:40.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.035+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa51415c560 con 0x7fa4f406be30 2024-09-10T08:34:40.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.042+0000 7fa50be00640 1 -- 172.21.15.52:0/3106322914 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247856 (secure 0 0 0) 0x7fa51415c560 con 0x7fa4f406be30 2024-09-10T08:34:40.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:40.047 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:34:40.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.045+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 msgr2=0x7fa4f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.045+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 0x7fa4f406e2f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa504009ac0 tx=0x7fa504009190 comp rx=0 tx=0).stop 2024-09-10T08:34:40.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.045+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 msgr2=0x7fa51414a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.045+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e870 tx=0x7fa50000ed30 comp rx=0 tx=0).stop 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 shutdown_connections 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa4f406be30 0x7fa4f406e2f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa51415e6d0 0x7fa514158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa514070b80 0x7fa51414a1b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 --2- 172.21.15.52:0/3106322914 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa51406cd20 0x7fa51414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 >> 172.21.15.52:0/3106322914 conn(0x7fa514067fb0 msgr2=0x7fa5140b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 shutdown_connections 2024-09-10T08:34:40.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.046+0000 7fa51ac00640 1 -- 172.21.15.52:0/3106322914 wait complete. 2024-09-10T08:34:40.062 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-10T08:34:39.542052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285944,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754688776,"statfs":{"total":773094113280,"available":772801306624,"internally_reserved":0,"allocated":11726848,"data_stored":5749609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423405+0000","last_change":"2024-09-10T08:34:34.423405+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423405+0000","last_undegraded":"2024-09-10T08:34:34.423405+0000","last_fullsized":"2024-09-10T08:34:34.423405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424012+0000","last_change":"2024-09-10T08:34:34.424012+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424012+0000","last_undegraded":"2024-09-10T08:34:34.424012+0000","last_fullsized":"2024-09-10T08:34:34.424012+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417459+0000","last_change":"2024-09-10T08:34:34.417459+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417459+0000","last_undegraded":"2024-09-10T08:34:34.417459+0000","last_fullsized":"2024-09-10T08:34:34.417459+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422481+0000","last_change":"2024-09-10T08:34:34.422481+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422481+0000","last_undegraded":"2024-09-10T08:34:34.422481+0000","last_fullsized":"2024-09-10T08:34:34.422481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423151+0000","last_change":"2024-09-10T08:34:34.423151+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423151+0000","last_undegraded":"2024-09-10T08:34:34.423151+0000","last_fullsized":"2024-09-10T08:34:34.423151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.428193+0000","last_change":"2024-09-10T08:34:34.428193+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.428193+0000","last_undegraded":"2024-09-10T08:34:34.428193+0000","last_fullsized":"2024-09-10T08:34:34.428193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421753+0000","last_change":"2024-09-10T08:34:34.421753+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421753+0000","last_undegraded":"2024-09-10T08:34:34.421753+0000","last_fullsized":"2024-09-10T08:34:34.421753+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414130+0000","last_change":"2024-09-10T08:34:34.414130+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414130+0000","last_undegraded":"2024-09-10T08:34:34.414130+0000","last_fullsized":"2024-09-10T08:34:34.414130+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.427123+0000","last_change":"2024-09-10T08:34:34.427123+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.427123+0000","last_undegraded":"2024-09-10T08:34:34.427123+0000","last_fullsized":"2024-09-10T08:34:34.427123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419005+0000","last_change":"2024-09-10T08:34:34.419005+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419005+0000","last_undegraded":"2024-09-10T08:34:34.419005+0000","last_fullsized":"2024-09-10T08:34:34.419005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426478+0000","last_change":"2024-09-10T08:34:34.426478+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426478+0000","last_undegraded":"2024-09-10T08:34:34.426478+0000","last_fullsized":"2024-09-10T08:34:34.426478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415318+0000","last_change":"2024-09-10T08:34:34.415318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415318+0000","last_undegraded":"2024-09-10T08:34:34.415318+0000","last_fullsized":"2024-09-10T08:34:34.415318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423543+0000","last_change":"2024-09-10T08:34:34.423543+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423543+0000","last_undegraded":"2024-09-10T08:34:34.423543+0000","last_fullsized":"2024-09-10T08:34:34.423543+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418977+0000","last_change":"2024-09-10T08:34:34.418977+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418977+0000","last_undegraded":"2024-09-10T08:34:34.418977+0000","last_fullsized":"2024-09-10T08:34:34.418977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418677+0000","last_change":"2024-09-10T08:34:34.418677+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418677+0000","last_undegraded":"2024-09-10T08:34:34.418677+0000","last_fullsized":"2024-09-10T08:34:34.418677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420232+0000","last_change":"2024-09-10T08:34:34.420232+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420232+0000","last_undegraded":"2024-09-10T08:34:34.420232+0000","last_fullsized":"2024-09-10T08:34:34.420232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436806+0000","last_change":"2024-09-10T08:34:35.443743+0000","last_active":"2024-09-10T08:34:36.436806+0000","last_peered":"2024-09-10T08:34:36.436806+0000","last_clean":"2024-09-10T08:34:36.436806+0000","last_became_active":"2024-09-10T08:34:35.443367+0000","last_became_peered":"2024-09-10T08:34:35.443367+0000","last_unstale":"2024-09-10T08:34:36.436806+0000","last_undegraded":"2024-09-10T08:34:36.436806+0000","last_fullsized":"2024-09-10T08:34:36.436806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:46.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423568+0000","last_change":"2024-09-10T08:34:34.423568+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423568+0000","last_undegraded":"2024-09-10T08:34:34.423568+0000","last_fullsized":"2024-09-10T08:34:34.423568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438213+0000","last_change":"2024-09-10T08:34:35.433604+0000","last_active":"2024-09-10T08:34:36.438213+0000","last_peered":"2024-09-10T08:34:36.438213+0000","last_clean":"2024-09-10T08:34:36.438213+0000","last_became_active":"2024-09-10T08:34:35.433332+0000","last_became_peered":"2024-09-10T08:34:35.433332+0000","last_unstale":"2024-09-10T08:34:36.438213+0000","last_undegraded":"2024-09-10T08:34:36.438213+0000","last_fullsized":"2024-09-10T08:34:36.438213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.004100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414910+0000","last_change":"2024-09-10T08:34:34.414910+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414910+0000","last_undegraded":"2024-09-10T08:34:34.414910+0000","last_fullsized":"2024-09-10T08:34:34.414910+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415306+0000","last_change":"2024-09-10T08:34:34.415306+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415306+0000","last_undegraded":"2024-09-10T08:34:34.415306+0000","last_fullsized":"2024-09-10T08:34:34.415306+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416567+0000","last_change":"2024-09-10T08:34:34.416567+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416567+0000","last_undegraded":"2024-09-10T08:34:34.416567+0000","last_fullsized":"2024-09-10T08:34:34.416567+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418087+0000","last_change":"2024-09-10T08:34:34.418087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418087+0000","last_undegraded":"2024-09-10T08:34:34.418087+0000","last_fullsized":"2024-09-10T08:34:34.418087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417954+0000","last_change":"2024-09-10T08:34:34.417954+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417954+0000","last_undegraded":"2024-09-10T08:34:34.417954+0000","last_fullsized":"2024-09-10T08:34:34.417954+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419218+0000","last_change":"2024-09-10T08:34:34.419218+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419218+0000","last_undegraded":"2024-09-10T08:34:34.419218+0000","last_fullsized":"2024-09-10T08:34:34.419218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424784+0000","last_change":"2024-09-10T08:34:34.424784+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424784+0000","last_undegraded":"2024-09-10T08:34:34.424784+0000","last_fullsized":"2024-09-10T08:34:34.424784+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418759+0000","last_change":"2024-09-10T08:34:34.418759+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418759+0000","last_undegraded":"2024-09-10T08:34:34.418759+0000","last_fullsized":"2024-09-10T08:34:34.418759+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417269+0000","last_change":"2024-09-10T08:34:34.417269+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417269+0000","last_undegraded":"2024-09-10T08:34:34.417269+0000","last_fullsized":"2024-09-10T08:34:34.417269+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423145+0000","last_change":"2024-09-10T08:34:34.423145+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423145+0000","last_undegraded":"2024-09-10T08:34:34.423145+0000","last_fullsized":"2024-09-10T08:34:34.423145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420804+0000","last_change":"2024-09-10T08:34:34.420804+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420804+0000","last_undegraded":"2024-09-10T08:34:34.420804+0000","last_fullsized":"2024-09-10T08:34:34.420804+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417187+0000","last_change":"2024-09-10T08:34:34.417187+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417187+0000","last_undegraded":"2024-09-10T08:34:34.417187+0000","last_fullsized":"2024-09-10T08:34:34.417187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419892+0000","last_change":"2024-09-10T08:34:34.419892+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419892+0000","last_undegraded":"2024-09-10T08:34:34.419892+0000","last_fullsized":"2024-09-10T08:34:34.419892+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437098+0000","last_change":"2024-09-10T08:34:35.442470+0000","last_active":"2024-09-10T08:34:36.437098+0000","last_peered":"2024-09-10T08:34:36.437098+0000","last_clean":"2024-09-10T08:34:36.437098+0000","last_became_active":"2024-09-10T08:34:35.442205+0000","last_became_peered":"2024-09-10T08:34:35.442205+0000","last_unstale":"2024-09-10T08:34:36.437098+0000","last_undegraded":"2024-09-10T08:34:36.437098+0000","last_fullsized":"2024-09-10T08:34:36.437098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:47.215931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.440376+0000","last_change":"2024-09-10T08:34:34.438667+0000","last_active":"2024-09-10T08:34:34.440376+0000","last_peered":"2024-09-10T08:34:34.440376+0000","last_clean":"2024-09-10T08:34:34.440376+0000","last_became_active":"2024-09-10T08:34:34.437256+0000","last_became_peered":"2024-09-10T08:34:34.437256+0000","last_unstale":"2024-09-10T08:34:34.440376+0000","last_undegraded":"2024-09-10T08:34:34.440376+0000","last_fullsized":"2024-09-10T08:34:34.440376+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:12.032750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424132+0000","last_change":"2024-09-10T08:34:34.424132+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424132+0000","last_undegraded":"2024-09-10T08:34:34.424132+0000","last_fullsized":"2024-09-10T08:34:34.424132+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437261+0000","last_change":"2024-09-10T08:34:34.435974+0000","last_active":"2024-09-10T08:34:34.437261+0000","last_peered":"2024-09-10T08:34:34.437261+0000","last_clean":"2024-09-10T08:34:34.437261+0000","last_became_active":"2024-09-10T08:34:34.435612+0000","last_became_peered":"2024-09-10T08:34:34.435612+0000","last_unstale":"2024-09-10T08:34:34.437261+0000","last_undegraded":"2024-09-10T08:34:34.437261+0000","last_fullsized":"2024-09-10T08:34:34.437261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:23.863413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422013+0000","last_change":"2024-09-10T08:34:34.422013+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422013+0000","last_undegraded":"2024-09-10T08:34:34.422013+0000","last_fullsized":"2024-09-10T08:34:34.422013+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435921+0000","last_change":"2024-09-10T08:34:34.432133+0000","last_active":"2024-09-10T08:34:34.435921+0000","last_peered":"2024-09-10T08:34:34.435921+0000","last_clean":"2024-09-10T08:34:34.435921+0000","last_became_active":"2024-09-10T08:34:34.430805+0000","last_became_peered":"2024-09-10T08:34:34.430805+0000","last_unstale":"2024-09-10T08:34:34.435921+0000","last_undegraded":"2024-09-10T08:34:34.435921+0000","last_fullsized":"2024-09-10T08:34:34.435921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.049469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417889+0000","last_change":"2024-09-10T08:34:34.417889+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417889+0000","last_undegraded":"2024-09-10T08:34:34.417889+0000","last_fullsized":"2024-09-10T08:34:34.417889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436519+0000","last_change":"2024-09-10T08:34:34.431738+0000","last_active":"2024-09-10T08:34:34.436519+0000","last_peered":"2024-09-10T08:34:34.436519+0000","last_clean":"2024-09-10T08:34:34.436519+0000","last_became_active":"2024-09-10T08:34:34.431422+0000","last_became_peered":"2024-09-10T08:34:34.431422+0000","last_unstale":"2024-09-10T08:34:34.436519+0000","last_undegraded":"2024-09-10T08:34:34.436519+0000","last_fullsized":"2024-09-10T08:34:34.436519+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.202570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414801+0000","last_change":"2024-09-10T08:34:34.414801+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414801+0000","last_undegraded":"2024-09-10T08:34:34.414801+0000","last_fullsized":"2024-09-10T08:34:34.414801+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438218+0000","last_change":"2024-09-10T08:34:34.434494+0000","last_active":"2024-09-10T08:34:34.438218+0000","last_peered":"2024-09-10T08:34:34.438218+0000","last_clean":"2024-09-10T08:34:34.438218+0000","last_became_active":"2024-09-10T08:34:34.434024+0000","last_became_peered":"2024-09-10T08:34:34.434024+0000","last_unstale":"2024-09-10T08:34:34.438218+0000","last_undegraded":"2024-09-10T08:34:34.438218+0000","last_fullsized":"2024-09-10T08:34:34.438218+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:34.132190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422502+0000","last_change":"2024-09-10T08:34:34.422502+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422502+0000","last_undegraded":"2024-09-10T08:34:34.422502+0000","last_fullsized":"2024-09-10T08:34:34.422502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439841+0000","last_change":"2024-09-10T08:34:34.438384+0000","last_active":"2024-09-10T08:34:34.439841+0000","last_peered":"2024-09-10T08:34:34.439841+0000","last_clean":"2024-09-10T08:34:34.439841+0000","last_became_active":"2024-09-10T08:34:34.438128+0000","last_became_peered":"2024-09-10T08:34:34.438128+0000","last_unstale":"2024-09-10T08:34:34.439841+0000","last_undegraded":"2024-09-10T08:34:34.439841+0000","last_fullsized":"2024-09-10T08:34:34.439841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:06.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419381+0000","last_change":"2024-09-10T08:34:34.419381+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419381+0000","last_undegraded":"2024-09-10T08:34:34.419381+0000","last_fullsized":"2024-09-10T08:34:34.419381+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434541+0000","last_change":"2024-09-10T08:34:34.433790+0000","last_active":"2024-09-10T08:34:34.434541+0000","last_peered":"2024-09-10T08:34:34.434541+0000","last_clean":"2024-09-10T08:34:34.434541+0000","last_became_active":"2024-09-10T08:34:34.433508+0000","last_became_peered":"2024-09-10T08:34:34.433508+0000","last_unstale":"2024-09-10T08:34:34.434541+0000","last_undegraded":"2024-09-10T08:34:34.434541+0000","last_fullsized":"2024-09-10T08:34:34.434541+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:55.607496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414844+0000","last_change":"2024-09-10T08:34:34.414844+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414844+0000","last_undegraded":"2024-09-10T08:34:34.414844+0000","last_fullsized":"2024-09-10T08:34:34.414844+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437607+0000","last_change":"2024-09-10T08:34:34.436720+0000","last_active":"2024-09-10T08:34:36.437607+0000","last_peered":"2024-09-10T08:34:36.437607+0000","last_clean":"2024-09-10T08:34:36.437607+0000","last_became_active":"2024-09-10T08:34:34.436399+0000","last_became_peered":"2024-09-10T08:34:34.436399+0000","last_unstale":"2024-09-10T08:34:36.437607+0000","last_undegraded":"2024-09-10T08:34:36.437607+0000","last_fullsized":"2024-09-10T08:34:36.437607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.115469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423181+0000","last_change":"2024-09-10T08:34:34.423181+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423181+0000","last_undegraded":"2024-09-10T08:34:34.423181+0000","last_fullsized":"2024-09-10T08:34:34.423181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.428223+0000","last_change":"2024-09-10T08:34:34.423542+0000","last_active":"2024-09-10T08:34:34.428223+0000","last_peered":"2024-09-10T08:34:34.428223+0000","last_clean":"2024-09-10T08:34:34.428223+0000","last_became_active":"2024-09-10T08:34:34.423263+0000","last_became_peered":"2024-09-10T08:34:34.423263+0000","last_unstale":"2024-09-10T08:34:34.428223+0000","last_undegraded":"2024-09-10T08:34:34.428223+0000","last_fullsized":"2024-09-10T08:34:34.428223+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417758+0000","last_change":"2024-09-10T08:34:34.417758+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417758+0000","last_undegraded":"2024-09-10T08:34:34.417758+0000","last_fullsized":"2024-09-10T08:34:34.417758+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436487+0000","last_change":"2024-09-10T08:34:34.431042+0000","last_active":"2024-09-10T08:34:34.436487+0000","last_peered":"2024-09-10T08:34:34.436487+0000","last_clean":"2024-09-10T08:34:34.436487+0000","last_became_active":"2024-09-10T08:34:34.430781+0000","last_became_peered":"2024-09-10T08:34:34.430781+0000","last_unstale":"2024-09-10T08:34:34.436487+0000","last_undegraded":"2024-09-10T08:34:34.436487+0000","last_fullsized":"2024-09-10T08:34:34.436487+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:50.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424550+0000","last_change":"2024-09-10T08:34:34.424550+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424550+0000","last_undegraded":"2024-09-10T08:34:34.424550+0000","last_fullsized":"2024-09-10T08:34:34.424550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434286+0000","last_change":"2024-09-10T08:34:34.430619+0000","last_active":"2024-09-10T08:34:34.434286+0000","last_peered":"2024-09-10T08:34:34.434286+0000","last_clean":"2024-09-10T08:34:34.434286+0000","last_became_active":"2024-09-10T08:34:34.430054+0000","last_became_peered":"2024-09-10T08:34:34.430054+0000","last_unstale":"2024-09-10T08:34:34.434286+0000","last_undegraded":"2024-09-10T08:34:34.434286+0000","last_fullsized":"2024-09-10T08:34:34.434286+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416408+0000","last_change":"2024-09-10T08:34:34.416408+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416408+0000","last_undegraded":"2024-09-10T08:34:34.416408+0000","last_fullsized":"2024-09-10T08:34:34.416408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434253+0000","last_change":"2024-09-10T08:34:34.433126+0000","last_active":"2024-09-10T08:34:34.434253+0000","last_peered":"2024-09-10T08:34:34.434253+0000","last_clean":"2024-09-10T08:34:34.434253+0000","last_became_active":"2024-09-10T08:34:34.431890+0000","last_became_peered":"2024-09-10T08:34:34.431890+0000","last_unstale":"2024-09-10T08:34:34.434253+0000","last_undegraded":"2024-09-10T08:34:34.434253+0000","last_fullsized":"2024-09-10T08:34:34.434253+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:37.371058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418118+0000","last_change":"2024-09-10T08:34:34.418118+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418118+0000","last_undegraded":"2024-09-10T08:34:34.418118+0000","last_fullsized":"2024-09-10T08:34:34.418118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436653+0000","last_change":"2024-09-10T08:34:34.437471+0000","last_active":"2024-09-10T08:34:36.436653+0000","last_peered":"2024-09-10T08:34:36.436653+0000","last_clean":"2024-09-10T08:34:36.436653+0000","last_became_active":"2024-09-10T08:34:34.436355+0000","last_became_peered":"2024-09-10T08:34:34.436355+0000","last_unstale":"2024-09-10T08:34:36.436653+0000","last_undegraded":"2024-09-10T08:34:36.436653+0000","last_fullsized":"2024-09-10T08:34:36.436653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414087+0000","last_change":"2024-09-10T08:34:34.414087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414087+0000","last_undegraded":"2024-09-10T08:34:34.414087+0000","last_fullsized":"2024-09-10T08:34:34.414087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439131+0000","last_change":"2024-09-10T08:34:34.437445+0000","last_active":"2024-09-10T08:34:34.439131+0000","last_peered":"2024-09-10T08:34:34.439131+0000","last_clean":"2024-09-10T08:34:34.439131+0000","last_became_active":"2024-09-10T08:34:34.437178+0000","last_became_peered":"2024-09-10T08:34:34.437178+0000","last_unstale":"2024-09-10T08:34:34.439131+0000","last_undegraded":"2024-09-10T08:34:34.439131+0000","last_fullsized":"2024-09-10T08:34:34.439131+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419699+0000","last_change":"2024-09-10T08:34:34.419699+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419699+0000","last_undegraded":"2024-09-10T08:34:34.419699+0000","last_fullsized":"2024-09-10T08:34:34.419699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.423657+0000","last_change":"2024-09-10T08:34:34.421209+0000","last_active":"2024-09-10T08:34:34.423657+0000","last_peered":"2024-09-10T08:34:34.423657+0000","last_clean":"2024-09-10T08:34:34.423657+0000","last_became_active":"2024-09-10T08:34:34.420857+0000","last_became_peered":"2024-09-10T08:34:34.420857+0000","last_unstale":"2024-09-10T08:34:34.423657+0000","last_undegraded":"2024-09-10T08:34:34.423657+0000","last_fullsized":"2024-09-10T08:34:34.423657+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:03.807592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414783+0000","last_change":"2024-09-10T08:34:34.414783+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414783+0000","last_undegraded":"2024-09-10T08:34:34.414783+0000","last_fullsized":"2024-09-10T08:34:34.414783+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438057+0000","last_change":"2024-09-10T08:34:34.434724+0000","last_active":"2024-09-10T08:34:34.438057+0000","last_peered":"2024-09-10T08:34:34.438057+0000","last_clean":"2024-09-10T08:34:34.438057+0000","last_became_active":"2024-09-10T08:34:34.431717+0000","last_became_peered":"2024-09-10T08:34:34.431717+0000","last_unstale":"2024-09-10T08:34:34.438057+0000","last_undegraded":"2024-09-10T08:34:34.438057+0000","last_fullsized":"2024-09-10T08:34:34.438057+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:36.029217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417318+0000","last_change":"2024-09-10T08:34:34.417318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417318+0000","last_undegraded":"2024-09-10T08:34:34.417318+0000","last_fullsized":"2024-09-10T08:34:34.417318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435023+0000","last_change":"2024-09-10T08:34:34.433626+0000","last_active":"2024-09-10T08:34:34.435023+0000","last_peered":"2024-09-10T08:34:34.435023+0000","last_clean":"2024-09-10T08:34:34.435023+0000","last_became_active":"2024-09-10T08:34:34.431050+0000","last_became_peered":"2024-09-10T08:34:34.431050+0000","last_unstale":"2024-09-10T08:34:34.435023+0000","last_undegraded":"2024-09-10T08:34:34.435023+0000","last_fullsized":"2024-09-10T08:34:34.435023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:21.214168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416319+0000","last_change":"2024-09-10T08:34:34.416319+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416319+0000","last_undegraded":"2024-09-10T08:34:34.416319+0000","last_fullsized":"2024-09-10T08:34:34.416319+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436434+0000","last_change":"2024-09-10T08:34:34.435089+0000","last_active":"2024-09-10T08:34:34.436434+0000","last_peered":"2024-09-10T08:34:34.436434+0000","last_clean":"2024-09-10T08:34:34.436434+0000","last_became_active":"2024-09-10T08:34:34.434758+0000","last_became_peered":"2024-09-10T08:34:34.434758+0000","last_unstale":"2024-09-10T08:34:34.436434+0000","last_undegraded":"2024-09-10T08:34:34.436434+0000","last_fullsized":"2024-09-10T08:34:34.436434+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.014201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414347+0000","last_change":"2024-09-10T08:34:34.414347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414347+0000","last_undegraded":"2024-09-10T08:34:34.414347+0000","last_fullsized":"2024-09-10T08:34:34.414347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436650+0000","last_change":"2024-09-10T08:34:34.432248+0000","last_active":"2024-09-10T08:34:36.436650+0000","last_peered":"2024-09-10T08:34:36.436650+0000","last_clean":"2024-09-10T08:34:36.436650+0000","last_became_active":"2024-09-10T08:34:34.431912+0000","last_became_peered":"2024-09-10T08:34:34.431912+0000","last_unstale":"2024-09-10T08:34:36.436650+0000","last_undegraded":"2024-09-10T08:34:36.436650+0000","last_fullsized":"2024-09-10T08:34:36.436650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:34.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436624+0000","last_change":"2024-09-10T08:34:35.435254+0000","last_active":"2024-09-10T08:34:36.436624+0000","last_peered":"2024-09-10T08:34:36.436624+0000","last_clean":"2024-09-10T08:34:36.436624+0000","last_became_active":"2024-09-10T08:34:35.435000+0000","last_became_peered":"2024-09-10T08:34:35.435000+0000","last_unstale":"2024-09-10T08:34:36.436624+0000","last_undegraded":"2024-09-10T08:34:36.436624+0000","last_fullsized":"2024-09-10T08:34:36.436624+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:29.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433086+0000","last_change":"2024-09-10T08:34:34.430005+0000","last_active":"2024-09-10T08:34:34.433086+0000","last_peered":"2024-09-10T08:34:34.433086+0000","last_clean":"2024-09-10T08:34:34.433086+0000","last_became_active":"2024-09-10T08:34:34.429669+0000","last_became_peered":"2024-09-10T08:34:34.429669+0000","last_unstale":"2024-09-10T08:34:34.433086+0000","last_undegraded":"2024-09-10T08:34:34.433086+0000","last_fullsized":"2024-09-10T08:34:34.433086+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:13.312879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436730+0000","last_change":"2024-09-10T08:34:35.428979+0000","last_active":"2024-09-10T08:34:36.436730+0000","last_peered":"2024-09-10T08:34:36.436730+0000","last_clean":"2024-09-10T08:34:36.436730+0000","last_became_active":"2024-09-10T08:34:35.428705+0000","last_became_peered":"2024-09-10T08:34:35.428705+0000","last_unstale":"2024-09-10T08:34:36.436730+0000","last_undegraded":"2024-09-10T08:34:36.436730+0000","last_fullsized":"2024-09-10T08:34:36.436730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:08.670337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437851+0000","last_change":"2024-09-10T08:34:34.437024+0000","last_active":"2024-09-10T08:34:34.437851+0000","last_peered":"2024-09-10T08:34:34.437851+0000","last_clean":"2024-09-10T08:34:34.437851+0000","last_became_active":"2024-09-10T08:34:34.436737+0000","last_became_peered":"2024-09-10T08:34:34.436737+0000","last_unstale":"2024-09-10T08:34:34.437851+0000","last_undegraded":"2024-09-10T08:34:34.437851+0000","last_fullsized":"2024-09-10T08:34:34.437851+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:33.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419466+0000","last_change":"2024-09-10T08:34:34.419466+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419466+0000","last_undegraded":"2024-09-10T08:34:34.419466+0000","last_fullsized":"2024-09-10T08:34:34.419466+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433426+0000","last_change":"2024-09-10T08:34:34.432017+0000","last_active":"2024-09-10T08:34:34.433426+0000","last_peered":"2024-09-10T08:34:34.433426+0000","last_clean":"2024-09-10T08:34:34.433426+0000","last_became_active":"2024-09-10T08:34:34.431711+0000","last_became_peered":"2024-09-10T08:34:34.431711+0000","last_unstale":"2024-09-10T08:34:34.433426+0000","last_undegraded":"2024-09-10T08:34:34.433426+0000","last_fullsized":"2024-09-10T08:34:34.433426+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415930+0000","last_change":"2024-09-10T08:34:34.415930+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415930+0000","last_undegraded":"2024-09-10T08:34:34.415930+0000","last_fullsized":"2024-09-10T08:34:34.415930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.431916+0000","last_change":"2024-09-10T08:34:34.429461+0000","last_active":"2024-09-10T08:34:34.431916+0000","last_peered":"2024-09-10T08:34:34.431916+0000","last_clean":"2024-09-10T08:34:34.431916+0000","last_became_active":"2024-09-10T08:34:34.429128+0000","last_became_peered":"2024-09-10T08:34:34.429128+0000","last_unstale":"2024-09-10T08:34:34.431916+0000","last_undegraded":"2024-09-10T08:34:34.431916+0000","last_fullsized":"2024-09-10T08:34:34.431916+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:18.010285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437345+0000","last_change":"2024-09-10T08:34:35.434825+0000","last_active":"2024-09-10T08:34:36.437345+0000","last_peered":"2024-09-10T08:34:36.437345+0000","last_clean":"2024-09-10T08:34:36.437345+0000","last_became_active":"2024-09-10T08:34:35.430948+0000","last_became_peered":"2024-09-10T08:34:35.430948+0000","last_unstale":"2024-09-10T08:34:36.437345+0000","last_undegraded":"2024-09-10T08:34:36.437345+0000","last_fullsized":"2024-09-10T08:34:36.437345+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:16.603302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.422234+0000","last_change":"2024-09-10T08:34:34.419784+0000","last_active":"2024-09-10T08:34:34.422234+0000","last_peered":"2024-09-10T08:34:34.422234+0000","last_clean":"2024-09-10T08:34:34.422234+0000","last_became_active":"2024-09-10T08:34:34.419506+0000","last_became_peered":"2024-09-10T08:34:34.419506+0000","last_unstale":"2024-09-10T08:34:34.422234+0000","last_undegraded":"2024-09-10T08:34:34.422234+0000","last_fullsized":"2024-09-10T08:34:34.422234+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436975+0000","last_change":"2024-09-10T08:34:35.433095+0000","last_active":"2024-09-10T08:34:36.436975+0000","last_peered":"2024-09-10T08:34:36.436975+0000","last_clean":"2024-09-10T08:34:36.436975+0000","last_became_active":"2024-09-10T08:34:35.431572+0000","last_became_peered":"2024-09-10T08:34:35.431572+0000","last_unstale":"2024-09-10T08:34:36.436975+0000","last_undegraded":"2024-09-10T08:34:36.436975+0000","last_fullsized":"2024-09-10T08:34:36.436975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.472360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437455+0000","last_change":"2024-09-10T08:34:34.431957+0000","last_active":"2024-09-10T08:34:36.437455+0000","last_peered":"2024-09-10T08:34:36.437455+0000","last_clean":"2024-09-10T08:34:36.437455+0000","last_became_active":"2024-09-10T08:34:34.428639+0000","last_became_peered":"2024-09-10T08:34:34.428639+0000","last_unstale":"2024-09-10T08:34:36.437455+0000","last_undegraded":"2024-09-10T08:34:36.437455+0000","last_fullsized":"2024-09-10T08:34:36.437455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416347+0000","last_change":"2024-09-10T08:34:34.416347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416347+0000","last_undegraded":"2024-09-10T08:34:34.416347+0000","last_fullsized":"2024-09-10T08:34:34.416347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437852+0000","last_change":"2024-09-10T08:34:34.427424+0000","last_active":"2024-09-10T08:34:36.437852+0000","last_peered":"2024-09-10T08:34:36.437852+0000","last_clean":"2024-09-10T08:34:36.437852+0000","last_became_active":"2024-09-10T08:34:34.426305+0000","last_became_peered":"2024-09-10T08:34:34.426305+0000","last_unstale":"2024-09-10T08:34:36.437852+0000","last_undegraded":"2024-09-10T08:34:36.437852+0000","last_fullsized":"2024-09-10T08:34:36.437852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:18.049964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426042+0000","last_change":"2024-09-10T08:34:34.426042+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426042+0000","last_undegraded":"2024-09-10T08:34:34.426042+0000","last_fullsized":"2024-09-10T08:34:34.426042+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.424845+0000","last_change":"2024-09-10T08:34:34.423423+0000","last_active":"2024-09-10T08:34:34.424845+0000","last_peered":"2024-09-10T08:34:34.424845+0000","last_clean":"2024-09-10T08:34:34.424845+0000","last_became_active":"2024-09-10T08:34:34.419996+0000","last_became_peered":"2024-09-10T08:34:34.419996+0000","last_unstale":"2024-09-10T08:34:34.424845+0000","last_undegraded":"2024-09-10T08:34:34.424845+0000","last_fullsized":"2024-09-10T08:34:34.424845+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.102494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436802+0000","last_change":"2024-09-10T08:34:35.440388+0000","last_active":"2024-09-10T08:34:36.436802+0000","last_peered":"2024-09-10T08:34:36.436802+0000","last_clean":"2024-09-10T08:34:36.436802+0000","last_became_active":"2024-09-10T08:34:35.439549+0000","last_became_peered":"2024-09-10T08:34:35.439549+0000","last_unstale":"2024-09-10T08:34:36.436802+0000","last_undegraded":"2024-09-10T08:34:36.436802+0000","last_fullsized":"2024-09-10T08:34:36.436802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435737+0000","last_change":"2024-09-10T08:34:34.433704+0000","last_active":"2024-09-10T08:34:34.435737+0000","last_peered":"2024-09-10T08:34:34.435737+0000","last_clean":"2024-09-10T08:34:34.435737+0000","last_became_active":"2024-09-10T08:34:34.433401+0000","last_became_peered":"2024-09-10T08:34:34.433401+0000","last_unstale":"2024-09-10T08:34:34.435737+0000","last_undegraded":"2024-09-10T08:34:34.435737+0000","last_fullsized":"2024-09-10T08:34:34.435737+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:24.167963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421561+0000","last_change":"2024-09-10T08:34:34.421561+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421561+0000","last_undegraded":"2024-09-10T08:34:34.421561+0000","last_fullsized":"2024-09-10T08:34:34.421561+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433574+0000","last_change":"2024-09-10T08:34:34.431145+0000","last_active":"2024-09-10T08:34:34.433574+0000","last_peered":"2024-09-10T08:34:34.433574+0000","last_clean":"2024-09-10T08:34:34.433574+0000","last_became_active":"2024-09-10T08:34:34.430713+0000","last_became_peered":"2024-09-10T08:34:34.430713+0000","last_unstale":"2024-09-10T08:34:34.433574+0000","last_undegraded":"2024-09-10T08:34:34.433574+0000","last_fullsized":"2024-09-10T08:34:34.433574+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:34.185388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437587+0000","last_change":"2024-09-10T08:34:35.447833+0000","last_active":"2024-09-10T08:34:36.437587+0000","last_peered":"2024-09-10T08:34:36.437587+0000","last_clean":"2024-09-10T08:34:36.437587+0000","last_became_active":"2024-09-10T08:34:35.447138+0000","last_became_peered":"2024-09-10T08:34:35.447138+0000","last_unstale":"2024-09-10T08:34:36.437587+0000","last_undegraded":"2024-09-10T08:34:36.437587+0000","last_fullsized":"2024-09-10T08:34:36.437587+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:34.020654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.442435+0000","last_change":"2024-09-10T08:34:34.439809+0000","last_active":"2024-09-10T08:34:34.442435+0000","last_peered":"2024-09-10T08:34:34.442435+0000","last_clean":"2024-09-10T08:34:34.442435+0000","last_became_active":"2024-09-10T08:34:34.438918+0000","last_became_peered":"2024-09-10T08:34:34.438918+0000","last_unstale":"2024-09-10T08:34:34.442435+0000","last_undegraded":"2024-09-10T08:34:34.442435+0000","last_fullsized":"2024-09-10T08:34:34.442435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414144+0000","last_change":"2024-09-10T08:34:34.414144+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414144+0000","last_undegraded":"2024-09-10T08:34:34.414144+0000","last_fullsized":"2024-09-10T08:34:34.414144+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.430158+0000","last_change":"2024-09-10T08:34:34.428151+0000","last_active":"2024-09-10T08:34:34.430158+0000","last_peered":"2024-09-10T08:34:34.430158+0000","last_clean":"2024-09-10T08:34:34.430158+0000","last_became_active":"2024-09-10T08:34:34.427824+0000","last_became_peered":"2024-09-10T08:34:34.427824+0000","last_unstale":"2024-09-10T08:34:34.430158+0000","last_undegraded":"2024-09-10T08:34:34.430158+0000","last_fullsized":"2024-09-10T08:34:34.430158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:23.156216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416638+0000","last_change":"2024-09-10T08:34:34.416638+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416638+0000","last_undegraded":"2024-09-10T08:34:34.416638+0000","last_fullsized":"2024-09-10T08:34:34.416638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433174+0000","last_change":"2024-09-10T08:34:34.431301+0000","last_active":"2024-09-10T08:34:34.433174+0000","last_peered":"2024-09-10T08:34:34.433174+0000","last_clean":"2024-09-10T08:34:34.433174+0000","last_became_active":"2024-09-10T08:34:34.430954+0000","last_became_peered":"2024-09-10T08:34:34.430954+0000","last_unstale":"2024-09-10T08:34:34.433174+0000","last_undegraded":"2024-09-10T08:34:34.433174+0000","last_fullsized":"2024-09-10T08:34:34.433174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:00.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":319,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.416242+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:34:34.416242+0000","last_peered":"2024-09-10T08:34:34.416242+0000","last_clean":"2024-09-10T08:34:34.416242+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:34:34.416242+0000","last_undegraded":"2024-09-10T08:34:34.416242+0000","last_fullsized":"2024-09-10T08:34:34.416242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40796,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331044,"statfs":{"total":96636764160,"available":96594989056,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1908736,"data_stored":1161203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":1175946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:34:40.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:34:40.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.257+0000 7fe197800640 1 Processor -- start 2024-09-10T08:34:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.257+0000 7fe197800640 1 -- start start 2024-09-10T08:34:40.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.258+0000 7fe197800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe190145ed0 0x7fe1900b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.258+0000 7fe197800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1900735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.258+0000 7fe197800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900b4020 con 0x7fe190073180 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.258+0000 7fe197800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe190073b00 con 0x7fe190145ed0 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.258+0000 7fe197800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900b42c0 con 0x7fe1900b5f90 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe190145ed0 0x7fe1900b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe190145ed0 0x7fe1900b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43418/0 (socket says 172.21.15.52:43418) 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 -- 172.21.15.52:0/245207686 learned_addr learned my addr 172.21.15.52:0/245207686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe195800640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1900735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 -- 172.21.15.52:0/245207686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 msgr2=0x7fe1900735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1900735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 -- 172.21.15.52:0/245207686 >> v1:172.21.15.176:6789/0 conn(0x7fe190073180 legacy=0x7fe1900b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe194e00640 1 -- 172.21.15.52:0/245207686 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900b45a0 con 0x7fe190145ed0 2024-09-10T08:34:40.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.259+0000 7fe195800640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1900735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.260+0000 7fe194e00640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190145ed0 0x7fe1900b5080 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe190073c80 tx=0x7fe18402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da1fd72b586e55b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.260+0000 7fe18f400640 1 -- 172.21.15.52:0/245207686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184037070 con 0x7fe190145ed0 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.260+0000 7fe18f400640 1 -- 172.21.15.52:0/245207686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe184032440 con 0x7fe190145ed0 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe18f400640 1 -- 172.21.15.52:0/245207686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184032810 con 0x7fe190145ed0 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 -- 172.21.15.52:0/245207686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190145ed0 msgr2=0x7fe1900b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190145ed0 0x7fe1900b5080 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe190073c80 tx=0x7fe18402a250 comp rx=0 tx=0).stop 2024-09-10T08:34:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 -- 172.21.15.52:0/245207686 shutdown_connections 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1900735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 --2- 172.21.15.52:0/245207686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190145ed0 0x7fe1900b5080 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 -- 172.21.15.52:0/245207686 >> 172.21.15.52:0/245207686 conn(0x7fe1900ccec0 msgr2=0x7fe1900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 -- 172.21.15.52:0/245207686 shutdown_connections 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.261+0000 7fe197800640 1 -- 172.21.15.52:0/245207686 wait complete. 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.263+0000 7fe197800640 1 Processor -- start 2024-09-10T08:34:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.263+0000 7fe197800640 1 -- start start 2024-09-10T08:34:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1901e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 0x7fe19015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe1901462b0 con 0x7fe190073180 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b4b60 con 0x7fe190145ed0 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe197800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe190146430 con 0x7fe1900b5f90 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe194e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe194e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43420/0 (socket says 172.21.15.52:43420) 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe194e00640 1 -- 172.21.15.52:0/2257212773 learned_addr learned my addr 172.21.15.52:0/2257212773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe195800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 0x7fe19015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.264+0000 7fe18fe00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1901e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 -- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 msgr2=0x7fe1901e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1901e64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 -- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 msgr2=0x7fe19015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 0x7fe19015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 -- 172.21.15.52:0/2257212773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901e5a00 con 0x7fe190073180 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe195800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 0x7fe19015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe18fe00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1901e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe194e00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe18402a290 tx=0x7fe1840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184041020 con 0x7fe190073180 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1840306c0 con 0x7fe190073180 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184037040 con 0x7fe190073180 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.265+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901f89c0 con 0x7fe190073180 2024-09-10T08:34:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.266+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901e5ca0 con 0x7fe190073180 2024-09-10T08:34:40.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.266+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900735c0 con 0x7fe190073180 2024-09-10T08:34:40.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.267+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe184044020 con 0x7fe190073180 2024-09-10T08:34:40.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.268+0000 7fe18cc00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.268+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fe1840ab740 con 0x7fe190073180 2024-09-10T08:34:40.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.269+0000 7fe18fe00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.270+0000 7fe18fe00640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 0x7fe17006e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007fd0 tx=0x7fe17c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.272+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe18404b030 con 0x7fe190073180 2024-09-10T08:34:40.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.457+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1900b2bf0 con 0x7fe17006be30 2024-09-10T08:34:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.464+0000 7fe18cc00640 1 -- 172.21.15.52:0/2257212773 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247856 (secure 0 0 0) 0x7fe1900b2bf0 con 0x7fe17006be30 2024-09-10T08:34:40.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:40.469 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:34:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 msgr2=0x7fe17006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 0x7fe17006e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007fd0 tx=0x7fe17c009040 comp rx=0 tx=0).stop 2024-09-10T08:34:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 msgr2=0x7fe1901f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe18402a290 tx=0x7fe1840046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 shutdown_connections 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe17006be30 0x7fe17006e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe190145ed0 0x7fe19015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1900b5f90 0x7fe1901e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 --2- 172.21.15.52:0/2257212773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe190073180 0x7fe1901f8480 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 >> 172.21.15.52:0/2257212773 conn(0x7fe1900ccec0 msgr2=0x7fe190144d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 shutdown_connections 2024-09-10T08:34:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.468+0000 7fe197800640 1 -- 172.21.15.52:0/2257212773 wait complete. 2024-09-10T08:34:40.483 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-10T08:34:39.542052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285944,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754688776,"statfs":{"total":773094113280,"available":772801306624,"internally_reserved":0,"allocated":11726848,"data_stored":5749609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423405+0000","last_change":"2024-09-10T08:34:34.423405+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423405+0000","last_undegraded":"2024-09-10T08:34:34.423405+0000","last_fullsized":"2024-09-10T08:34:34.423405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424012+0000","last_change":"2024-09-10T08:34:34.424012+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424012+0000","last_undegraded":"2024-09-10T08:34:34.424012+0000","last_fullsized":"2024-09-10T08:34:34.424012+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417459+0000","last_change":"2024-09-10T08:34:34.417459+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417459+0000","last_undegraded":"2024-09-10T08:34:34.417459+0000","last_fullsized":"2024-09-10T08:34:34.417459+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422481+0000","last_change":"2024-09-10T08:34:34.422481+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422481+0000","last_undegraded":"2024-09-10T08:34:34.422481+0000","last_fullsized":"2024-09-10T08:34:34.422481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423151+0000","last_change":"2024-09-10T08:34:34.423151+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423151+0000","last_undegraded":"2024-09-10T08:34:34.423151+0000","last_fullsized":"2024-09-10T08:34:34.423151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.428193+0000","last_change":"2024-09-10T08:34:34.428193+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.428193+0000","last_undegraded":"2024-09-10T08:34:34.428193+0000","last_fullsized":"2024-09-10T08:34:34.428193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421753+0000","last_change":"2024-09-10T08:34:34.421753+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421753+0000","last_undegraded":"2024-09-10T08:34:34.421753+0000","last_fullsized":"2024-09-10T08:34:34.421753+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414130+0000","last_change":"2024-09-10T08:34:34.414130+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414130+0000","last_undegraded":"2024-09-10T08:34:34.414130+0000","last_fullsized":"2024-09-10T08:34:34.414130+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.427123+0000","last_change":"2024-09-10T08:34:34.427123+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.427123+0000","last_undegraded":"2024-09-10T08:34:34.427123+0000","last_fullsized":"2024-09-10T08:34:34.427123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419005+0000","last_change":"2024-09-10T08:34:34.419005+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419005+0000","last_undegraded":"2024-09-10T08:34:34.419005+0000","last_fullsized":"2024-09-10T08:34:34.419005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426478+0000","last_change":"2024-09-10T08:34:34.426478+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426478+0000","last_undegraded":"2024-09-10T08:34:34.426478+0000","last_fullsized":"2024-09-10T08:34:34.426478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415318+0000","last_change":"2024-09-10T08:34:34.415318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415318+0000","last_undegraded":"2024-09-10T08:34:34.415318+0000","last_fullsized":"2024-09-10T08:34:34.415318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423543+0000","last_change":"2024-09-10T08:34:34.423543+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423543+0000","last_undegraded":"2024-09-10T08:34:34.423543+0000","last_fullsized":"2024-09-10T08:34:34.423543+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418977+0000","last_change":"2024-09-10T08:34:34.418977+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418977+0000","last_undegraded":"2024-09-10T08:34:34.418977+0000","last_fullsized":"2024-09-10T08:34:34.418977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418677+0000","last_change":"2024-09-10T08:34:34.418677+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418677+0000","last_undegraded":"2024-09-10T08:34:34.418677+0000","last_fullsized":"2024-09-10T08:34:34.418677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420232+0000","last_change":"2024-09-10T08:34:34.420232+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420232+0000","last_undegraded":"2024-09-10T08:34:34.420232+0000","last_fullsized":"2024-09-10T08:34:34.420232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436806+0000","last_change":"2024-09-10T08:34:35.443743+0000","last_active":"2024-09-10T08:34:36.436806+0000","last_peered":"2024-09-10T08:34:36.436806+0000","last_clean":"2024-09-10T08:34:36.436806+0000","last_became_active":"2024-09-10T08:34:35.443367+0000","last_became_peered":"2024-09-10T08:34:35.443367+0000","last_unstale":"2024-09-10T08:34:36.436806+0000","last_undegraded":"2024-09-10T08:34:36.436806+0000","last_fullsized":"2024-09-10T08:34:36.436806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:46.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423568+0000","last_change":"2024-09-10T08:34:34.423568+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423568+0000","last_undegraded":"2024-09-10T08:34:34.423568+0000","last_fullsized":"2024-09-10T08:34:34.423568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438213+0000","last_change":"2024-09-10T08:34:35.433604+0000","last_active":"2024-09-10T08:34:36.438213+0000","last_peered":"2024-09-10T08:34:36.438213+0000","last_clean":"2024-09-10T08:34:36.438213+0000","last_became_active":"2024-09-10T08:34:35.433332+0000","last_became_peered":"2024-09-10T08:34:35.433332+0000","last_unstale":"2024-09-10T08:34:36.438213+0000","last_undegraded":"2024-09-10T08:34:36.438213+0000","last_fullsized":"2024-09-10T08:34:36.438213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.004100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414910+0000","last_change":"2024-09-10T08:34:34.414910+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414910+0000","last_undegraded":"2024-09-10T08:34:34.414910+0000","last_fullsized":"2024-09-10T08:34:34.414910+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415306+0000","last_change":"2024-09-10T08:34:34.415306+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415306+0000","last_undegraded":"2024-09-10T08:34:34.415306+0000","last_fullsized":"2024-09-10T08:34:34.415306+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416567+0000","last_change":"2024-09-10T08:34:34.416567+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416567+0000","last_undegraded":"2024-09-10T08:34:34.416567+0000","last_fullsized":"2024-09-10T08:34:34.416567+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418087+0000","last_change":"2024-09-10T08:34:34.418087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418087+0000","last_undegraded":"2024-09-10T08:34:34.418087+0000","last_fullsized":"2024-09-10T08:34:34.418087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417954+0000","last_change":"2024-09-10T08:34:34.417954+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417954+0000","last_undegraded":"2024-09-10T08:34:34.417954+0000","last_fullsized":"2024-09-10T08:34:34.417954+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419218+0000","last_change":"2024-09-10T08:34:34.419218+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419218+0000","last_undegraded":"2024-09-10T08:34:34.419218+0000","last_fullsized":"2024-09-10T08:34:34.419218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424784+0000","last_change":"2024-09-10T08:34:34.424784+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424784+0000","last_undegraded":"2024-09-10T08:34:34.424784+0000","last_fullsized":"2024-09-10T08:34:34.424784+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418759+0000","last_change":"2024-09-10T08:34:34.418759+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418759+0000","last_undegraded":"2024-09-10T08:34:34.418759+0000","last_fullsized":"2024-09-10T08:34:34.418759+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417269+0000","last_change":"2024-09-10T08:34:34.417269+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417269+0000","last_undegraded":"2024-09-10T08:34:34.417269+0000","last_fullsized":"2024-09-10T08:34:34.417269+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423145+0000","last_change":"2024-09-10T08:34:34.423145+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423145+0000","last_undegraded":"2024-09-10T08:34:34.423145+0000","last_fullsized":"2024-09-10T08:34:34.423145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420804+0000","last_change":"2024-09-10T08:34:34.420804+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420804+0000","last_undegraded":"2024-09-10T08:34:34.420804+0000","last_fullsized":"2024-09-10T08:34:34.420804+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417187+0000","last_change":"2024-09-10T08:34:34.417187+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417187+0000","last_undegraded":"2024-09-10T08:34:34.417187+0000","last_fullsized":"2024-09-10T08:34:34.417187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419892+0000","last_change":"2024-09-10T08:34:34.419892+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419892+0000","last_undegraded":"2024-09-10T08:34:34.419892+0000","last_fullsized":"2024-09-10T08:34:34.419892+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437098+0000","last_change":"2024-09-10T08:34:35.442470+0000","last_active":"2024-09-10T08:34:36.437098+0000","last_peered":"2024-09-10T08:34:36.437098+0000","last_clean":"2024-09-10T08:34:36.437098+0000","last_became_active":"2024-09-10T08:34:35.442205+0000","last_became_peered":"2024-09-10T08:34:35.442205+0000","last_unstale":"2024-09-10T08:34:36.437098+0000","last_undegraded":"2024-09-10T08:34:36.437098+0000","last_fullsized":"2024-09-10T08:34:36.437098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:47.215931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.440376+0000","last_change":"2024-09-10T08:34:34.438667+0000","last_active":"2024-09-10T08:34:34.440376+0000","last_peered":"2024-09-10T08:34:34.440376+0000","last_clean":"2024-09-10T08:34:34.440376+0000","last_became_active":"2024-09-10T08:34:34.437256+0000","last_became_peered":"2024-09-10T08:34:34.437256+0000","last_unstale":"2024-09-10T08:34:34.440376+0000","last_undegraded":"2024-09-10T08:34:34.440376+0000","last_fullsized":"2024-09-10T08:34:34.440376+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:12.032750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424132+0000","last_change":"2024-09-10T08:34:34.424132+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424132+0000","last_undegraded":"2024-09-10T08:34:34.424132+0000","last_fullsized":"2024-09-10T08:34:34.424132+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437261+0000","last_change":"2024-09-10T08:34:34.435974+0000","last_active":"2024-09-10T08:34:34.437261+0000","last_peered":"2024-09-10T08:34:34.437261+0000","last_clean":"2024-09-10T08:34:34.437261+0000","last_became_active":"2024-09-10T08:34:34.435612+0000","last_became_peered":"2024-09-10T08:34:34.435612+0000","last_unstale":"2024-09-10T08:34:34.437261+0000","last_undegraded":"2024-09-10T08:34:34.437261+0000","last_fullsized":"2024-09-10T08:34:34.437261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:23.863413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422013+0000","last_change":"2024-09-10T08:34:34.422013+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422013+0000","last_undegraded":"2024-09-10T08:34:34.422013+0000","last_fullsized":"2024-09-10T08:34:34.422013+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435921+0000","last_change":"2024-09-10T08:34:34.432133+0000","last_active":"2024-09-10T08:34:34.435921+0000","last_peered":"2024-09-10T08:34:34.435921+0000","last_clean":"2024-09-10T08:34:34.435921+0000","last_became_active":"2024-09-10T08:34:34.430805+0000","last_became_peered":"2024-09-10T08:34:34.430805+0000","last_unstale":"2024-09-10T08:34:34.435921+0000","last_undegraded":"2024-09-10T08:34:34.435921+0000","last_fullsized":"2024-09-10T08:34:34.435921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.049469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417889+0000","last_change":"2024-09-10T08:34:34.417889+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417889+0000","last_undegraded":"2024-09-10T08:34:34.417889+0000","last_fullsized":"2024-09-10T08:34:34.417889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436519+0000","last_change":"2024-09-10T08:34:34.431738+0000","last_active":"2024-09-10T08:34:34.436519+0000","last_peered":"2024-09-10T08:34:34.436519+0000","last_clean":"2024-09-10T08:34:34.436519+0000","last_became_active":"2024-09-10T08:34:34.431422+0000","last_became_peered":"2024-09-10T08:34:34.431422+0000","last_unstale":"2024-09-10T08:34:34.436519+0000","last_undegraded":"2024-09-10T08:34:34.436519+0000","last_fullsized":"2024-09-10T08:34:34.436519+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.202570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414801+0000","last_change":"2024-09-10T08:34:34.414801+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414801+0000","last_undegraded":"2024-09-10T08:34:34.414801+0000","last_fullsized":"2024-09-10T08:34:34.414801+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438218+0000","last_change":"2024-09-10T08:34:34.434494+0000","last_active":"2024-09-10T08:34:34.438218+0000","last_peered":"2024-09-10T08:34:34.438218+0000","last_clean":"2024-09-10T08:34:34.438218+0000","last_became_active":"2024-09-10T08:34:34.434024+0000","last_became_peered":"2024-09-10T08:34:34.434024+0000","last_unstale":"2024-09-10T08:34:34.438218+0000","last_undegraded":"2024-09-10T08:34:34.438218+0000","last_fullsized":"2024-09-10T08:34:34.438218+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:34.132190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422502+0000","last_change":"2024-09-10T08:34:34.422502+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422502+0000","last_undegraded":"2024-09-10T08:34:34.422502+0000","last_fullsized":"2024-09-10T08:34:34.422502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439841+0000","last_change":"2024-09-10T08:34:34.438384+0000","last_active":"2024-09-10T08:34:34.439841+0000","last_peered":"2024-09-10T08:34:34.439841+0000","last_clean":"2024-09-10T08:34:34.439841+0000","last_became_active":"2024-09-10T08:34:34.438128+0000","last_became_peered":"2024-09-10T08:34:34.438128+0000","last_unstale":"2024-09-10T08:34:34.439841+0000","last_undegraded":"2024-09-10T08:34:34.439841+0000","last_fullsized":"2024-09-10T08:34:34.439841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:06.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419381+0000","last_change":"2024-09-10T08:34:34.419381+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419381+0000","last_undegraded":"2024-09-10T08:34:34.419381+0000","last_fullsized":"2024-09-10T08:34:34.419381+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434541+0000","last_change":"2024-09-10T08:34:34.433790+0000","last_active":"2024-09-10T08:34:34.434541+0000","last_peered":"2024-09-10T08:34:34.434541+0000","last_clean":"2024-09-10T08:34:34.434541+0000","last_became_active":"2024-09-10T08:34:34.433508+0000","last_became_peered":"2024-09-10T08:34:34.433508+0000","last_unstale":"2024-09-10T08:34:34.434541+0000","last_undegraded":"2024-09-10T08:34:34.434541+0000","last_fullsized":"2024-09-10T08:34:34.434541+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:55.607496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414844+0000","last_change":"2024-09-10T08:34:34.414844+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414844+0000","last_undegraded":"2024-09-10T08:34:34.414844+0000","last_fullsized":"2024-09-10T08:34:34.414844+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437607+0000","last_change":"2024-09-10T08:34:34.436720+0000","last_active":"2024-09-10T08:34:36.437607+0000","last_peered":"2024-09-10T08:34:36.437607+0000","last_clean":"2024-09-10T08:34:36.437607+0000","last_became_active":"2024-09-10T08:34:34.436399+0000","last_became_peered":"2024-09-10T08:34:34.436399+0000","last_unstale":"2024-09-10T08:34:36.437607+0000","last_undegraded":"2024-09-10T08:34:36.437607+0000","last_fullsized":"2024-09-10T08:34:36.437607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.115469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423181+0000","last_change":"2024-09-10T08:34:34.423181+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423181+0000","last_undegraded":"2024-09-10T08:34:34.423181+0000","last_fullsized":"2024-09-10T08:34:34.423181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.428223+0000","last_change":"2024-09-10T08:34:34.423542+0000","last_active":"2024-09-10T08:34:34.428223+0000","last_peered":"2024-09-10T08:34:34.428223+0000","last_clean":"2024-09-10T08:34:34.428223+0000","last_became_active":"2024-09-10T08:34:34.423263+0000","last_became_peered":"2024-09-10T08:34:34.423263+0000","last_unstale":"2024-09-10T08:34:34.428223+0000","last_undegraded":"2024-09-10T08:34:34.428223+0000","last_fullsized":"2024-09-10T08:34:34.428223+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417758+0000","last_change":"2024-09-10T08:34:34.417758+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417758+0000","last_undegraded":"2024-09-10T08:34:34.417758+0000","last_fullsized":"2024-09-10T08:34:34.417758+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436487+0000","last_change":"2024-09-10T08:34:34.431042+0000","last_active":"2024-09-10T08:34:34.436487+0000","last_peered":"2024-09-10T08:34:34.436487+0000","last_clean":"2024-09-10T08:34:34.436487+0000","last_became_active":"2024-09-10T08:34:34.430781+0000","last_became_peered":"2024-09-10T08:34:34.430781+0000","last_unstale":"2024-09-10T08:34:34.436487+0000","last_undegraded":"2024-09-10T08:34:34.436487+0000","last_fullsized":"2024-09-10T08:34:34.436487+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:50.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424550+0000","last_change":"2024-09-10T08:34:34.424550+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424550+0000","last_undegraded":"2024-09-10T08:34:34.424550+0000","last_fullsized":"2024-09-10T08:34:34.424550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434286+0000","last_change":"2024-09-10T08:34:34.430619+0000","last_active":"2024-09-10T08:34:34.434286+0000","last_peered":"2024-09-10T08:34:34.434286+0000","last_clean":"2024-09-10T08:34:34.434286+0000","last_became_active":"2024-09-10T08:34:34.430054+0000","last_became_peered":"2024-09-10T08:34:34.430054+0000","last_unstale":"2024-09-10T08:34:34.434286+0000","last_undegraded":"2024-09-10T08:34:34.434286+0000","last_fullsized":"2024-09-10T08:34:34.434286+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416408+0000","last_change":"2024-09-10T08:34:34.416408+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416408+0000","last_undegraded":"2024-09-10T08:34:34.416408+0000","last_fullsized":"2024-09-10T08:34:34.416408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434253+0000","last_change":"2024-09-10T08:34:34.433126+0000","last_active":"2024-09-10T08:34:34.434253+0000","last_peered":"2024-09-10T08:34:34.434253+0000","last_clean":"2024-09-10T08:34:34.434253+0000","last_became_active":"2024-09-10T08:34:34.431890+0000","last_became_peered":"2024-09-10T08:34:34.431890+0000","last_unstale":"2024-09-10T08:34:34.434253+0000","last_undegraded":"2024-09-10T08:34:34.434253+0000","last_fullsized":"2024-09-10T08:34:34.434253+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:37.371058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418118+0000","last_change":"2024-09-10T08:34:34.418118+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418118+0000","last_undegraded":"2024-09-10T08:34:34.418118+0000","last_fullsized":"2024-09-10T08:34:34.418118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436653+0000","last_change":"2024-09-10T08:34:34.437471+0000","last_active":"2024-09-10T08:34:36.436653+0000","last_peered":"2024-09-10T08:34:36.436653+0000","last_clean":"2024-09-10T08:34:36.436653+0000","last_became_active":"2024-09-10T08:34:34.436355+0000","last_became_peered":"2024-09-10T08:34:34.436355+0000","last_unstale":"2024-09-10T08:34:36.436653+0000","last_undegraded":"2024-09-10T08:34:36.436653+0000","last_fullsized":"2024-09-10T08:34:36.436653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414087+0000","last_change":"2024-09-10T08:34:34.414087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414087+0000","last_undegraded":"2024-09-10T08:34:34.414087+0000","last_fullsized":"2024-09-10T08:34:34.414087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439131+0000","last_change":"2024-09-10T08:34:34.437445+0000","last_active":"2024-09-10T08:34:34.439131+0000","last_peered":"2024-09-10T08:34:34.439131+0000","last_clean":"2024-09-10T08:34:34.439131+0000","last_became_active":"2024-09-10T08:34:34.437178+0000","last_became_peered":"2024-09-10T08:34:34.437178+0000","last_unstale":"2024-09-10T08:34:34.439131+0000","last_undegraded":"2024-09-10T08:34:34.439131+0000","last_fullsized":"2024-09-10T08:34:34.439131+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419699+0000","last_change":"2024-09-10T08:34:34.419699+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419699+0000","last_undegraded":"2024-09-10T08:34:34.419699+0000","last_fullsized":"2024-09-10T08:34:34.419699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.423657+0000","last_change":"2024-09-10T08:34:34.421209+0000","last_active":"2024-09-10T08:34:34.423657+0000","last_peered":"2024-09-10T08:34:34.423657+0000","last_clean":"2024-09-10T08:34:34.423657+0000","last_became_active":"2024-09-10T08:34:34.420857+0000","last_became_peered":"2024-09-10T08:34:34.420857+0000","last_unstale":"2024-09-10T08:34:34.423657+0000","last_undegraded":"2024-09-10T08:34:34.423657+0000","last_fullsized":"2024-09-10T08:34:34.423657+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:03.807592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414783+0000","last_change":"2024-09-10T08:34:34.414783+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414783+0000","last_undegraded":"2024-09-10T08:34:34.414783+0000","last_fullsized":"2024-09-10T08:34:34.414783+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438057+0000","last_change":"2024-09-10T08:34:34.434724+0000","last_active":"2024-09-10T08:34:34.438057+0000","last_peered":"2024-09-10T08:34:34.438057+0000","last_clean":"2024-09-10T08:34:34.438057+0000","last_became_active":"2024-09-10T08:34:34.431717+0000","last_became_peered":"2024-09-10T08:34:34.431717+0000","last_unstale":"2024-09-10T08:34:34.438057+0000","last_undegraded":"2024-09-10T08:34:34.438057+0000","last_fullsized":"2024-09-10T08:34:34.438057+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:36.029217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417318+0000","last_change":"2024-09-10T08:34:34.417318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417318+0000","last_undegraded":"2024-09-10T08:34:34.417318+0000","last_fullsized":"2024-09-10T08:34:34.417318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435023+0000","last_change":"2024-09-10T08:34:34.433626+0000","last_active":"2024-09-10T08:34:34.435023+0000","last_peered":"2024-09-10T08:34:34.435023+0000","last_clean":"2024-09-10T08:34:34.435023+0000","last_became_active":"2024-09-10T08:34:34.431050+0000","last_became_peered":"2024-09-10T08:34:34.431050+0000","last_unstale":"2024-09-10T08:34:34.435023+0000","last_undegraded":"2024-09-10T08:34:34.435023+0000","last_fullsized":"2024-09-10T08:34:34.435023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:21.214168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416319+0000","last_change":"2024-09-10T08:34:34.416319+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416319+0000","last_undegraded":"2024-09-10T08:34:34.416319+0000","last_fullsized":"2024-09-10T08:34:34.416319+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436434+0000","last_change":"2024-09-10T08:34:34.435089+0000","last_active":"2024-09-10T08:34:34.436434+0000","last_peered":"2024-09-10T08:34:34.436434+0000","last_clean":"2024-09-10T08:34:34.436434+0000","last_became_active":"2024-09-10T08:34:34.434758+0000","last_became_peered":"2024-09-10T08:34:34.434758+0000","last_unstale":"2024-09-10T08:34:34.436434+0000","last_undegraded":"2024-09-10T08:34:34.436434+0000","last_fullsized":"2024-09-10T08:34:34.436434+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.014201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414347+0000","last_change":"2024-09-10T08:34:34.414347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414347+0000","last_undegraded":"2024-09-10T08:34:34.414347+0000","last_fullsized":"2024-09-10T08:34:34.414347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436650+0000","last_change":"2024-09-10T08:34:34.432248+0000","last_active":"2024-09-10T08:34:36.436650+0000","last_peered":"2024-09-10T08:34:36.436650+0000","last_clean":"2024-09-10T08:34:36.436650+0000","last_became_active":"2024-09-10T08:34:34.431912+0000","last_became_peered":"2024-09-10T08:34:34.431912+0000","last_unstale":"2024-09-10T08:34:36.436650+0000","last_undegraded":"2024-09-10T08:34:36.436650+0000","last_fullsized":"2024-09-10T08:34:36.436650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:34.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436624+0000","last_change":"2024-09-10T08:34:35.435254+0000","last_active":"2024-09-10T08:34:36.436624+0000","last_peered":"2024-09-10T08:34:36.436624+0000","last_clean":"2024-09-10T08:34:36.436624+0000","last_became_active":"2024-09-10T08:34:35.435000+0000","last_became_peered":"2024-09-10T08:34:35.435000+0000","last_unstale":"2024-09-10T08:34:36.436624+0000","last_undegraded":"2024-09-10T08:34:36.436624+0000","last_fullsized":"2024-09-10T08:34:36.436624+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:29.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433086+0000","last_change":"2024-09-10T08:34:34.430005+0000","last_active":"2024-09-10T08:34:34.433086+0000","last_peered":"2024-09-10T08:34:34.433086+0000","last_clean":"2024-09-10T08:34:34.433086+0000","last_became_active":"2024-09-10T08:34:34.429669+0000","last_became_peered":"2024-09-10T08:34:34.429669+0000","last_unstale":"2024-09-10T08:34:34.433086+0000","last_undegraded":"2024-09-10T08:34:34.433086+0000","last_fullsized":"2024-09-10T08:34:34.433086+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:13.312879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436730+0000","last_change":"2024-09-10T08:34:35.428979+0000","last_active":"2024-09-10T08:34:36.436730+0000","last_peered":"2024-09-10T08:34:36.436730+0000","last_clean":"2024-09-10T08:34:36.436730+0000","last_became_active":"2024-09-10T08:34:35.428705+0000","last_became_peered":"2024-09-10T08:34:35.428705+0000","last_unstale":"2024-09-10T08:34:36.436730+0000","last_undegraded":"2024-09-10T08:34:36.436730+0000","last_fullsized":"2024-09-10T08:34:36.436730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:08.670337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437851+0000","last_change":"2024-09-10T08:34:34.437024+0000","last_active":"2024-09-10T08:34:34.437851+0000","last_peered":"2024-09-10T08:34:34.437851+0000","last_clean":"2024-09-10T08:34:34.437851+0000","last_became_active":"2024-09-10T08:34:34.436737+0000","last_became_peered":"2024-09-10T08:34:34.436737+0000","last_unstale":"2024-09-10T08:34:34.437851+0000","last_undegraded":"2024-09-10T08:34:34.437851+0000","last_fullsized":"2024-09-10T08:34:34.437851+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:33.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419466+0000","last_change":"2024-09-10T08:34:34.419466+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419466+0000","last_undegraded":"2024-09-10T08:34:34.419466+0000","last_fullsized":"2024-09-10T08:34:34.419466+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433426+0000","last_change":"2024-09-10T08:34:34.432017+0000","last_active":"2024-09-10T08:34:34.433426+0000","last_peered":"2024-09-10T08:34:34.433426+0000","last_clean":"2024-09-10T08:34:34.433426+0000","last_became_active":"2024-09-10T08:34:34.431711+0000","last_became_peered":"2024-09-10T08:34:34.431711+0000","last_unstale":"2024-09-10T08:34:34.433426+0000","last_undegraded":"2024-09-10T08:34:34.433426+0000","last_fullsized":"2024-09-10T08:34:34.433426+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415930+0000","last_change":"2024-09-10T08:34:34.415930+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415930+0000","last_undegraded":"2024-09-10T08:34:34.415930+0000","last_fullsized":"2024-09-10T08:34:34.415930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.431916+0000","last_change":"2024-09-10T08:34:34.429461+0000","last_active":"2024-09-10T08:34:34.431916+0000","last_peered":"2024-09-10T08:34:34.431916+0000","last_clean":"2024-09-10T08:34:34.431916+0000","last_became_active":"2024-09-10T08:34:34.429128+0000","last_became_peered":"2024-09-10T08:34:34.429128+0000","last_unstale":"2024-09-10T08:34:34.431916+0000","last_undegraded":"2024-09-10T08:34:34.431916+0000","last_fullsized":"2024-09-10T08:34:34.431916+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:18.010285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437345+0000","last_change":"2024-09-10T08:34:35.434825+0000","last_active":"2024-09-10T08:34:36.437345+0000","last_peered":"2024-09-10T08:34:36.437345+0000","last_clean":"2024-09-10T08:34:36.437345+0000","last_became_active":"2024-09-10T08:34:35.430948+0000","last_became_peered":"2024-09-10T08:34:35.430948+0000","last_unstale":"2024-09-10T08:34:36.437345+0000","last_undegraded":"2024-09-10T08:34:36.437345+0000","last_fullsized":"2024-09-10T08:34:36.437345+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:16.603302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.422234+0000","last_change":"2024-09-10T08:34:34.419784+0000","last_active":"2024-09-10T08:34:34.422234+0000","last_peered":"2024-09-10T08:34:34.422234+0000","last_clean":"2024-09-10T08:34:34.422234+0000","last_became_active":"2024-09-10T08:34:34.419506+0000","last_became_peered":"2024-09-10T08:34:34.419506+0000","last_unstale":"2024-09-10T08:34:34.422234+0000","last_undegraded":"2024-09-10T08:34:34.422234+0000","last_fullsized":"2024-09-10T08:34:34.422234+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436975+0000","last_change":"2024-09-10T08:34:35.433095+0000","last_active":"2024-09-10T08:34:36.436975+0000","last_peered":"2024-09-10T08:34:36.436975+0000","last_clean":"2024-09-10T08:34:36.436975+0000","last_became_active":"2024-09-10T08:34:35.431572+0000","last_became_peered":"2024-09-10T08:34:35.431572+0000","last_unstale":"2024-09-10T08:34:36.436975+0000","last_undegraded":"2024-09-10T08:34:36.436975+0000","last_fullsized":"2024-09-10T08:34:36.436975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.472360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437455+0000","last_change":"2024-09-10T08:34:34.431957+0000","last_active":"2024-09-10T08:34:36.437455+0000","last_peered":"2024-09-10T08:34:36.437455+0000","last_clean":"2024-09-10T08:34:36.437455+0000","last_became_active":"2024-09-10T08:34:34.428639+0000","last_became_peered":"2024-09-10T08:34:34.428639+0000","last_unstale":"2024-09-10T08:34:36.437455+0000","last_undegraded":"2024-09-10T08:34:36.437455+0000","last_fullsized":"2024-09-10T08:34:36.437455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416347+0000","last_change":"2024-09-10T08:34:34.416347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416347+0000","last_undegraded":"2024-09-10T08:34:34.416347+0000","last_fullsized":"2024-09-10T08:34:34.416347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437852+0000","last_change":"2024-09-10T08:34:34.427424+0000","last_active":"2024-09-10T08:34:36.437852+0000","last_peered":"2024-09-10T08:34:36.437852+0000","last_clean":"2024-09-10T08:34:36.437852+0000","last_became_active":"2024-09-10T08:34:34.426305+0000","last_became_peered":"2024-09-10T08:34:34.426305+0000","last_unstale":"2024-09-10T08:34:36.437852+0000","last_undegraded":"2024-09-10T08:34:36.437852+0000","last_fullsized":"2024-09-10T08:34:36.437852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:18.049964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426042+0000","last_change":"2024-09-10T08:34:34.426042+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426042+0000","last_undegraded":"2024-09-10T08:34:34.426042+0000","last_fullsized":"2024-09-10T08:34:34.426042+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.424845+0000","last_change":"2024-09-10T08:34:34.423423+0000","last_active":"2024-09-10T08:34:34.424845+0000","last_peered":"2024-09-10T08:34:34.424845+0000","last_clean":"2024-09-10T08:34:34.424845+0000","last_became_active":"2024-09-10T08:34:34.419996+0000","last_became_peered":"2024-09-10T08:34:34.419996+0000","last_unstale":"2024-09-10T08:34:34.424845+0000","last_undegraded":"2024-09-10T08:34:34.424845+0000","last_fullsized":"2024-09-10T08:34:34.424845+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.102494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436802+0000","last_change":"2024-09-10T08:34:35.440388+0000","last_active":"2024-09-10T08:34:36.436802+0000","last_peered":"2024-09-10T08:34:36.436802+0000","last_clean":"2024-09-10T08:34:36.436802+0000","last_became_active":"2024-09-10T08:34:35.439549+0000","last_became_peered":"2024-09-10T08:34:35.439549+0000","last_unstale":"2024-09-10T08:34:36.436802+0000","last_undegraded":"2024-09-10T08:34:36.436802+0000","last_fullsized":"2024-09-10T08:34:36.436802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435737+0000","last_change":"2024-09-10T08:34:34.433704+0000","last_active":"2024-09-10T08:34:34.435737+0000","last_peered":"2024-09-10T08:34:34.435737+0000","last_clean":"2024-09-10T08:34:34.435737+0000","last_became_active":"2024-09-10T08:34:34.433401+0000","last_became_peered":"2024-09-10T08:34:34.433401+0000","last_unstale":"2024-09-10T08:34:34.435737+0000","last_undegraded":"2024-09-10T08:34:34.435737+0000","last_fullsized":"2024-09-10T08:34:34.435737+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:24.167963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421561+0000","last_change":"2024-09-10T08:34:34.421561+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421561+0000","last_undegraded":"2024-09-10T08:34:34.421561+0000","last_fullsized":"2024-09-10T08:34:34.421561+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433574+0000","last_change":"2024-09-10T08:34:34.431145+0000","last_active":"2024-09-10T08:34:34.433574+0000","last_peered":"2024-09-10T08:34:34.433574+0000","last_clean":"2024-09-10T08:34:34.433574+0000","last_became_active":"2024-09-10T08:34:34.430713+0000","last_became_peered":"2024-09-10T08:34:34.430713+0000","last_unstale":"2024-09-10T08:34:34.433574+0000","last_undegraded":"2024-09-10T08:34:34.433574+0000","last_fullsized":"2024-09-10T08:34:34.433574+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:34.185388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437587+0000","last_change":"2024-09-10T08:34:35.447833+0000","last_active":"2024-09-10T08:34:36.437587+0000","last_peered":"2024-09-10T08:34:36.437587+0000","last_clean":"2024-09-10T08:34:36.437587+0000","last_became_active":"2024-09-10T08:34:35.447138+0000","last_became_peered":"2024-09-10T08:34:35.447138+0000","last_unstale":"2024-09-10T08:34:36.437587+0000","last_undegraded":"2024-09-10T08:34:36.437587+0000","last_fullsized":"2024-09-10T08:34:36.437587+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:34.020654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.442435+0000","last_change":"2024-09-10T08:34:34.439809+0000","last_active":"2024-09-10T08:34:34.442435+0000","last_peered":"2024-09-10T08:34:34.442435+0000","last_clean":"2024-09-10T08:34:34.442435+0000","last_became_active":"2024-09-10T08:34:34.438918+0000","last_became_peered":"2024-09-10T08:34:34.438918+0000","last_unstale":"2024-09-10T08:34:34.442435+0000","last_undegraded":"2024-09-10T08:34:34.442435+0000","last_fullsized":"2024-09-10T08:34:34.442435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414144+0000","last_change":"2024-09-10T08:34:34.414144+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414144+0000","last_undegraded":"2024-09-10T08:34:34.414144+0000","last_fullsized":"2024-09-10T08:34:34.414144+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.430158+0000","last_change":"2024-09-10T08:34:34.428151+0000","last_active":"2024-09-10T08:34:34.430158+0000","last_peered":"2024-09-10T08:34:34.430158+0000","last_clean":"2024-09-10T08:34:34.430158+0000","last_became_active":"2024-09-10T08:34:34.427824+0000","last_became_peered":"2024-09-10T08:34:34.427824+0000","last_unstale":"2024-09-10T08:34:34.430158+0000","last_undegraded":"2024-09-10T08:34:34.430158+0000","last_fullsized":"2024-09-10T08:34:34.430158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:23.156216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416638+0000","last_change":"2024-09-10T08:34:34.416638+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416638+0000","last_undegraded":"2024-09-10T08:34:34.416638+0000","last_fullsized":"2024-09-10T08:34:34.416638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433174+0000","last_change":"2024-09-10T08:34:34.431301+0000","last_active":"2024-09-10T08:34:34.433174+0000","last_peered":"2024-09-10T08:34:34.433174+0000","last_clean":"2024-09-10T08:34:34.433174+0000","last_became_active":"2024-09-10T08:34:34.430954+0000","last_became_peered":"2024-09-10T08:34:34.430954+0000","last_unstale":"2024-09-10T08:34:34.433174+0000","last_undegraded":"2024-09-10T08:34:34.433174+0000","last_fullsized":"2024-09-10T08:34:34.433174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:00.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":319,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.416242+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:34:34.416242+0000","last_peered":"2024-09-10T08:34:34.416242+0000","last_clean":"2024-09-10T08:34:34.416242+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:34:34.416242+0000","last_undegraded":"2024-09-10T08:34:34.416242+0000","last_fullsized":"2024-09-10T08:34:34.416242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40796,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331044,"statfs":{"total":96636764160,"available":96594989056,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1908736,"data_stored":1161203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":1175946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:34:40.487 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3f is not active+clean 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423405+0000', 'last_change': '2024-09-10T08:34:34.423405+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423405+0000', 'last_undegraded': '2024-09-10T08:34:34.423405+0000', 'last_fullsized': '2024-09-10T08:34:34.423405+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3e is not active+clean 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.424012+0000', 'last_change': '2024-09-10T08:34:34.424012+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.424012+0000', 'last_undegraded': '2024-09-10T08:34:34.424012+0000', 'last_fullsized': '2024-09-10T08:34:34.424012+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417459+0000', 'last_change': '2024-09-10T08:34:34.417459+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417459+0000', 'last_undegraded': '2024-09-10T08:34:34.417459+0000', 'last_fullsized': '2024-09-10T08:34:34.417459+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3c is not active+clean 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.422481+0000', 'last_change': '2024-09-10T08:34:34.422481+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.422481+0000', 'last_undegraded': '2024-09-10T08:34:34.422481+0000', 'last_fullsized': '2024-09-10T08:34:34.422481+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-10T08:34:40.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423151+0000', 'last_change': '2024-09-10T08:34:34.423151+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423151+0000', 'last_undegraded': '2024-09-10T08:34:34.423151+0000', 'last_fullsized': '2024-09-10T08:34:34.423151+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.489 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-10T08:34:40.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.428193+0000', 'last_change': '2024-09-10T08:34:34.428193+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.428193+0000', 'last_undegraded': '2024-09-10T08:34:34.428193+0000', 'last_fullsized': '2024-09-10T08:34:34.428193+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.489 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-10T08:34:40.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.421753+0000', 'last_change': '2024-09-10T08:34:34.421753+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.421753+0000', 'last_undegraded': '2024-09-10T08:34:34.421753+0000', 'last_fullsized': '2024-09-10T08:34:34.421753+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.489 INFO:tasks.ceph.ceph_manager.ceph:PG 15.38 is not active+clean 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414130+0000', 'last_change': '2024-09-10T08:34:34.414130+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414130+0000', 'last_undegraded': '2024-09-10T08:34:34.414130+0000', 'last_fullsized': '2024-09-10T08:34:34.414130+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.427123+0000', 'last_change': '2024-09-10T08:34:34.427123+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.427123+0000', 'last_undegraded': '2024-09-10T08:34:34.427123+0000', 'last_fullsized': '2024-09-10T08:34:34.427123+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419005+0000', 'last_change': '2024-09-10T08:34:34.419005+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419005+0000', 'last_undegraded': '2024-09-10T08:34:34.419005+0000', 'last_fullsized': '2024-09-10T08:34:34.419005+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.426478+0000', 'last_change': '2024-09-10T08:34:34.426478+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.426478+0000', 'last_undegraded': '2024-09-10T08:34:34.426478+0000', 'last_fullsized': '2024-09-10T08:34:34.426478+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.415318+0000', 'last_change': '2024-09-10T08:34:34.415318+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.415318+0000', 'last_undegraded': '2024-09-10T08:34:34.415318+0000', 'last_fullsized': '2024-09-10T08:34:34.415318+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.490 INFO:tasks.ceph.ceph_manager.ceph:PG 15.33 is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423543+0000', 'last_change': '2024-09-10T08:34:34.423543+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423543+0000', 'last_undegraded': '2024-09-10T08:34:34.423543+0000', 'last_fullsized': '2024-09-10T08:34:34.423543+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:PG 15.32 is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.418977+0000', 'last_change': '2024-09-10T08:34:34.418977+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.418977+0000', 'last_undegraded': '2024-09-10T08:34:34.418977+0000', 'last_fullsized': '2024-09-10T08:34:34.418977+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:PG 15.31 is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.418677+0000', 'last_change': '2024-09-10T08:34:34.418677+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.418677+0000', 'last_undegraded': '2024-09-10T08:34:34.418677+0000', 'last_fullsized': '2024-09-10T08:34:34.418677+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.420232+0000', 'last_change': '2024-09-10T08:34:34.420232+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.420232+0000', 'last_undegraded': '2024-09-10T08:34:34.420232+0000', 'last_fullsized': '2024-09-10T08:34:34.420232+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2e is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423568+0000', 'last_change': '2024-09-10T08:34:34.423568+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423568+0000', 'last_undegraded': '2024-09-10T08:34:34.423568+0000', 'last_fullsized': '2024-09-10T08:34:34.423568+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-10T08:34:40.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414910+0000', 'last_change': '2024-09-10T08:34:34.414910+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414910+0000', 'last_undegraded': '2024-09-10T08:34:34.414910+0000', 'last_fullsized': '2024-09-10T08:34:34.414910+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2b is not active+clean 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.415306+0000', 'last_change': '2024-09-10T08:34:34.415306+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.415306+0000', 'last_undegraded': '2024-09-10T08:34:34.415306+0000', 'last_fullsized': '2024-09-10T08:34:34.415306+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2a is not active+clean 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.416567+0000', 'last_change': '2024-09-10T08:34:34.416567+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.416567+0000', 'last_undegraded': '2024-09-10T08:34:34.416567+0000', 'last_fullsized': '2024-09-10T08:34:34.416567+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:PG 15.29 is not active+clean 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.418087+0000', 'last_change': '2024-09-10T08:34:34.418087+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.418087+0000', 'last_undegraded': '2024-09-10T08:34:34.418087+0000', 'last_fullsized': '2024-09-10T08:34:34.418087+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-10T08:34:40.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417954+0000', 'last_change': '2024-09-10T08:34:34.417954+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417954+0000', 'last_undegraded': '2024-09-10T08:34:34.417954+0000', 'last_fullsized': '2024-09-10T08:34:34.417954+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419218+0000', 'last_change': '2024-09-10T08:34:34.419218+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419218+0000', 'last_undegraded': '2024-09-10T08:34:34.419218+0000', 'last_fullsized': '2024-09-10T08:34:34.419218+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.26 is not active+clean 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.424784+0000', 'last_change': '2024-09-10T08:34:34.424784+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.424784+0000', 'last_undegraded': '2024-09-10T08:34:34.424784+0000', 'last_fullsized': '2024-09-10T08:34:34.424784+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.418759+0000', 'last_change': '2024-09-10T08:34:34.418759+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.418759+0000', 'last_undegraded': '2024-09-10T08:34:34.418759+0000', 'last_fullsized': '2024-09-10T08:34:34.418759+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417269+0000', 'last_change': '2024-09-10T08:34:34.417269+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417269+0000', 'last_undegraded': '2024-09-10T08:34:34.417269+0000', 'last_fullsized': '2024-09-10T08:34:34.417269+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.23 is not active+clean 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423145+0000', 'last_change': '2024-09-10T08:34:34.423145+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423145+0000', 'last_undegraded': '2024-09-10T08:34:34.423145+0000', 'last_fullsized': '2024-09-10T08:34:34.423145+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.493 INFO:tasks.ceph.ceph_manager.ceph:PG 15.22 is not active+clean 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.420804+0000', 'last_change': '2024-09-10T08:34:34.420804+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.420804+0000', 'last_undegraded': '2024-09-10T08:34:34.420804+0000', 'last_fullsized': '2024-09-10T08:34:34.420804+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417187+0000', 'last_change': '2024-09-10T08:34:34.417187+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417187+0000', 'last_undegraded': '2024-09-10T08:34:34.417187+0000', 'last_fullsized': '2024-09-10T08:34:34.417187+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:PG 15.20 is not active+clean 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419892+0000', 'last_change': '2024-09-10T08:34:34.419892+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419892+0000', 'last_undegraded': '2024-09-10T08:34:34.419892+0000', 'last_fullsized': '2024-09-10T08:34:34.419892+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1f is not active+clean 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.424132+0000', 'last_change': '2024-09-10T08:34:34.424132+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.424132+0000', 'last_undegraded': '2024-09-10T08:34:34.424132+0000', 'last_fullsized': '2024-09-10T08:34:34.424132+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1c is not active+clean 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.422013+0000', 'last_change': '2024-09-10T08:34:34.422013+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.422013+0000', 'last_undegraded': '2024-09-10T08:34:34.422013+0000', 'last_fullsized': '2024-09-10T08:34:34.422013+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.494 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417889+0000', 'last_change': '2024-09-10T08:34:34.417889+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417889+0000', 'last_undegraded': '2024-09-10T08:34:34.417889+0000', 'last_fullsized': '2024-09-10T08:34:34.417889+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414801+0000', 'last_change': '2024-09-10T08:34:34.414801+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414801+0000', 'last_undegraded': '2024-09-10T08:34:34.414801+0000', 'last_fullsized': '2024-09-10T08:34:34.414801+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.422502+0000', 'last_change': '2024-09-10T08:34:34.422502+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.422502+0000', 'last_undegraded': '2024-09-10T08:34:34.422502+0000', 'last_fullsized': '2024-09-10T08:34:34.422502+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:PG 15.18 is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419381+0000', 'last_change': '2024-09-10T08:34:34.419381+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419381+0000', 'last_undegraded': '2024-09-10T08:34:34.419381+0000', 'last_fullsized': '2024-09-10T08:34:34.419381+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414844+0000', 'last_change': '2024-09-10T08:34:34.414844+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414844+0000', 'last_undegraded': '2024-09-10T08:34:34.414844+0000', 'last_fullsized': '2024-09-10T08:34:34.414844+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:PG 15.16 is not active+clean 2024-09-10T08:34:40.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.423181+0000', 'last_change': '2024-09-10T08:34:34.423181+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.423181+0000', 'last_undegraded': '2024-09-10T08:34:34.423181+0000', 'last_fullsized': '2024-09-10T08:34:34.423181+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417758+0000', 'last_change': '2024-09-10T08:34:34.417758+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417758+0000', 'last_undegraded': '2024-09-10T08:34:34.417758+0000', 'last_fullsized': '2024-09-10T08:34:34.417758+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.424550+0000', 'last_change': '2024-09-10T08:34:34.424550+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.424550+0000', 'last_undegraded': '2024-09-10T08:34:34.424550+0000', 'last_fullsized': '2024-09-10T08:34:34.424550+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.416408+0000', 'last_change': '2024-09-10T08:34:34.416408+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.416408+0000', 'last_undegraded': '2024-09-10T08:34:34.416408+0000', 'last_fullsized': '2024-09-10T08:34:34.416408+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:PG 15.12 is not active+clean 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.418118+0000', 'last_change': '2024-09-10T08:34:34.418118+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.418118+0000', 'last_undegraded': '2024-09-10T08:34:34.418118+0000', 'last_fullsized': '2024-09-10T08:34:34.418118+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.496 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414087+0000', 'last_change': '2024-09-10T08:34:34.414087+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414087+0000', 'last_undegraded': '2024-09-10T08:34:34.414087+0000', 'last_fullsized': '2024-09-10T08:34:34.414087+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419699+0000', 'last_change': '2024-09-10T08:34:34.419699+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419699+0000', 'last_undegraded': '2024-09-10T08:34:34.419699+0000', 'last_fullsized': '2024-09-10T08:34:34.419699+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:PG 15.11 is not active+clean 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414783+0000', 'last_change': '2024-09-10T08:34:34.414783+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414783+0000', 'last_undegraded': '2024-09-10T08:34:34.414783+0000', 'last_fullsized': '2024-09-10T08:34:34.414783+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.417318+0000', 'last_change': '2024-09-10T08:34:34.417318+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.417318+0000', 'last_undegraded': '2024-09-10T08:34:34.417318+0000', 'last_fullsized': '2024-09-10T08:34:34.417318+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-10T08:34:40.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.416319+0000', 'last_change': '2024-09-10T08:34:34.416319+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.416319+0000', 'last_undegraded': '2024-09-10T08:34:34.416319+0000', 'last_fullsized': '2024-09-10T08:34:34.416319+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414347+0000', 'last_change': '2024-09-10T08:34:34.414347+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414347+0000', 'last_undegraded': '2024-09-10T08:34:34.414347+0000', 'last_fullsized': '2024-09-10T08:34:34.414347+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:PG 15.8 is not active+clean 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.419466+0000', 'last_change': '2024-09-10T08:34:34.419466+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.419466+0000', 'last_undegraded': '2024-09-10T08:34:34.419466+0000', 'last_fullsized': '2024-09-10T08:34:34.419466+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.415930+0000', 'last_change': '2024-09-10T08:34:34.415930+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.415930+0000', 'last_undegraded': '2024-09-10T08:34:34.415930+0000', 'last_fullsized': '2024-09-10T08:34:34.415930+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-10T08:34:40.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.416347+0000', 'last_change': '2024-09-10T08:34:34.416347+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.416347+0000', 'last_undegraded': '2024-09-10T08:34:34.416347+0000', 'last_fullsized': '2024-09-10T08:34:34.416347+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.426042+0000', 'last_change': '2024-09-10T08:34:34.426042+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.426042+0000', 'last_undegraded': '2024-09-10T08:34:34.426042+0000', 'last_fullsized': '2024-09-10T08:34:34.426042+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.421561+0000', 'last_change': '2024-09-10T08:34:34.421561+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.421561+0000', 'last_undegraded': '2024-09-10T08:34:34.421561+0000', 'last_fullsized': '2024-09-10T08:34:34.421561+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.414144+0000', 'last_change': '2024-09-10T08:34:34.414144+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.414144+0000', 'last_undegraded': '2024-09-10T08:34:34.414144+0000', 'last_fullsized': '2024-09-10T08:34:34.414144+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:PG 15.e is not active+clean 2024-09-10T08:34:40.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 107, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:34:34.416638+0000', 'last_change': '2024-09-10T08:34:34.416638+0000', 'last_active': '2024-09-10T08:34:34.402665+0000', 'last_peered': '2024-09-10T08:34:34.402665+0000', 'last_clean': '2024-09-10T08:34:34.402665+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:34:34.416638+0000', 'last_undegraded': '2024-09-10T08:34:34.416638+0000', 'last_fullsized': '2024-09-10T08:34:34.416638+0000', 'mapping_epoch': 107, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 107, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'last_clean_scrub_stamp': '2024-09-10T08:34:34.402665+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-10T08:34:40.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:34:40.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.679+0000 7f6aba400640 1 Processor -- start 2024-09-10T08:34:40.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.679+0000 7f6aba400640 1 -- start start 2024-09-10T08:34:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.680+0000 7f6aba400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 0x7f6ab406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.680+0000 7f6aba400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 0x7f6ab406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.680+0000 7f6aba400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab4071180 con 0x7f6ab415bcf0 2024-09-10T08:34:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.680+0000 7f6aba400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab4071ab0 con 0x7f6ab40b2d40 2024-09-10T08:34:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.680+0000 7f6aba400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab4071460 con 0x7f6ab413eb20 2024-09-10T08:34:40.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6ab3400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 0x7f6ab406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 0x7f6ab406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6ab3e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6ab415bcf0 0x7f6ab415c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:41332/0 (socket says 172.21.15.52:41332) 2024-09-10T08:34:40.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6ab3e00640 1 -- 172.21.15.52:0/952110851 learned_addr learned my addr 172.21.15.52:0/952110851 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:40.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6ab2a00640 1 -- 172.21.15.52:0/952110851 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122196644 0 0) 0x7f6ab4071180 con 0x7f6ab415bcf0 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6ab2a00640 1 -- 172.21.15.52:0/952110851 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a98003520 con 0x7f6ab415bcf0 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6aabe00640 1 -- 172.21.15.52:0/952110851 >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 msgr2=0x7f6ab406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6aabe00640 1 --2- 172.21.15.52:0/952110851 >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 0x7f6ab406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.681+0000 7f6aabe00640 1 -- 172.21.15.52:0/952110851 >> v1:172.21.15.176:6789/0 conn(0x7f6ab415bcf0 legacy=0x7f6ab415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.682+0000 7f6aabe00640 1 -- 172.21.15.52:0/952110851 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab4071740 con 0x7f6ab413eb20 2024-09-10T08:34:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.682+0000 7f6ab3400640 1 --2- 172.21.15.52:0/952110851 >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 0x7f6ab406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aabe00640 1 --2- 172.21.15.52:0/952110851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 0x7f6ab406c150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4071c30 tx=0x7f6a9c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc8c84826870ea69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6ab2a00640 1 -- 172.21.15.52:0/952110851 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c037070 con 0x7f6ab413eb20 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6ab2a00640 1 -- 172.21.15.52:0/952110851 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9c032440 con 0x7f6ab413eb20 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6ab2a00640 1 -- 172.21.15.52:0/952110851 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c032810 con 0x7f6ab413eb20 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 -- 172.21.15.52:0/952110851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 msgr2=0x7f6ab406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 --2- 172.21.15.52:0/952110851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 0x7f6ab406c150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4071c30 tx=0x7f6a9c02a180 comp rx=0 tx=0).stop 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 -- 172.21.15.52:0/952110851 shutdown_connections 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 --2- 172.21.15.52:0/952110851 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab413eb20 0x7f6ab406c150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 --2- 172.21.15.52:0/952110851 >> v2:172.21.15.176:3300/0 conn(0x7f6ab40b2d40 0x7f6ab406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 -- 172.21.15.52:0/952110851 >> 172.21.15.52:0/952110851 conn(0x7f6ab40ccec0 msgr2=0x7f6ab40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.683+0000 7f6aba400640 1 -- 172.21.15.52:0/952110851 shutdown_connections 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.684+0000 7f6aba400640 1 -- 172.21.15.52:0/952110851 wait complete. 2024-09-10T08:34:40.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.685+0000 7f6aba400640 1 Processor -- start 2024-09-10T08:34:40.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.685+0000 7f6aba400640 1 -- start start 2024-09-10T08:34:40.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 0x7f6ab413d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab415bcf0 0x7f6ab415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab40722d0 con 0x7f6ab413eb20 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4072150 con 0x7f6ab40b2d40 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aba400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab4072450 con 0x7f6ab415bcf0 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43428/0 (socket says 172.21.15.52:43428) 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6aabe00640 1 -- 172.21.15.52:0/1730680522 learned_addr learned my addr 172.21.15.52:0/1730680522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.686+0000 7f6ab3400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 0x7f6ab413d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6ab3e00640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab415bcf0 0x7f6ab415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 -- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab415bcf0 msgr2=0x7f6ab415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab415bcf0 0x7f6ab415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 -- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 msgr2=0x7f6ab413d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 0x7f6ab413d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 -- 172.21.15.52:0/1730680522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab40b4c20 con 0x7f6ab413eb20 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6ab3400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 0x7f6ab413d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aabe00640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c000c00 tx=0x7f6a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c041020 con 0x7f6ab413eb20 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab40b4f00 con 0x7f6ab413eb20 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a9c03d700 con 0x7f6ab413eb20 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c037040 con 0x7f6ab413eb20 2024-09-10T08:34:40.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.687+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab40b54c0 con 0x7f6ab413eb20 2024-09-10T08:34:40.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.688+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab40728e0 con 0x7f6ab413eb20 2024-09-10T08:34:40.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.689+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a9c044020 con 0x7f6ab413eb20 2024-09-10T08:34:40.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.690+0000 7f6aab400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 0x7f6a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:40.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.690+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f6a9c0ab730 con 0x7f6ab413eb20 2024-09-10T08:34:40.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.691+0000 7f6ab3400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 0x7f6a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:40.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.692+0000 7f6ab3400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 0x7f6a9006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009ba0 tx=0x7f6aa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:40.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.695+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a9c04b030 con 0x7f6ab413eb20 2024-09-10T08:34:40.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.946+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6ab406c9c0 con 0x7f6ab413eb20 2024-09-10T08:34:40.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.946+0000 7f6aab400640 1 -- 172.21.15.52:0/1730680522 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1303 (secure 0 0 0) 0x7f6a9c07a050 con 0x7f6ab413eb20 2024-09-10T08:34:40.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:40.947 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":380,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"active+clean","count":42}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590402,"bytes_used":292806656,"bytes_avail":772801306624,"bytes_total":773094113280,"inactive_pgs_ratio":0.56701028347015381,"write_bytes_sec":1194,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":83,"btime":"2024-09-10T08:34:38:438541+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7542}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-10T08:34:05.533652+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:34:40.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 msgr2=0x7f6a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 0x7f6a9006e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009ba0 tx=0x7f6aa4008040 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 msgr2=0x7f6ab40b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c000c00 tx=0x7f6a9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 shutdown_connections 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6a9006be30 0x7f6a9006e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ab415bcf0 0x7f6ab415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ab413eb20 0x7f6ab40b4390 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 --2- 172.21.15.52:0/1730680522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ab40b2d40 0x7f6ab413d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 >> 172.21.15.52:0/1730680522 conn(0x7f6ab40ccec0 msgr2=0x7f6ab4072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 shutdown_connections 2024-09-10T08:34:40.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:40.949+0000 7f6aba400640 1 -- 172.21.15.52:0/1730680522 wait complete. 2024-09-10T08:34:40.965 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:34:40.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:34:41.004 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:34:41.004+0000 7f93fd600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:34:41.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.120+0000 7fc7ebe00640 1 Processor -- start 2024-09-10T08:34:41.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.121+0000 7fc7ebe00640 1 -- start start 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7ebe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7ebe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ec0b4370 con 0x7fc7ec0cf5c0 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7ebe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc7ec0b4650 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec0b4dc0 con 0x7fc7ec0b3e00 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7eb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7eb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43436/0 (socket says 172.21.15.52:43436) 2024-09-10T08:34:41.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7eb400640 1 -- 172.21.15.52:0/596536461 learned_addr learned my addr 172.21.15.52:0/596536461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.122+0000 7fc7e2000640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.123+0000 7fc7eb400640 1 -- 172.21.15.52:0/596536461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 msgr2=0x7fc7ec15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.123+0000 7fc7eb400640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.123+0000 7fc7eb400640 1 -- 172.21.15.52:0/596536461 >> v1:172.21.15.176:6789/0 conn(0x7fc7ec0cf5c0 legacy=0x7fc7ec0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:41.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.123+0000 7fc7eb400640 1 -- 172.21.15.52:0/596536461 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0b50a0 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7eb400640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009e50 tx=0x7fc7e402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8336bbaf6fdf1fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7ea000640 1 -- 172.21.15.52:0/596536461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4036070 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7ea000640 1 -- 172.21.15.52:0/596536461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e4031600 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7ea000640 1 -- 172.21.15.52:0/596536461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40319d0 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7ebe00640 1 -- 172.21.15.52:0/596536461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 msgr2=0x7fc7ec15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:41.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.124+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009e50 tx=0x7fc7e402a5f0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 -- 172.21.15.52:0/596536461 shutdown_connections 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec15c520 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/596536461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 -- 172.21.15.52:0/596536461 >> 172.21.15.52:0/596536461 conn(0x7fc7ec06c240 msgr2=0x7fc7ec06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 -- 172.21.15.52:0/596536461 shutdown_connections 2024-09-10T08:34:41.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.125+0000 7fc7ebe00640 1 -- 172.21.15.52:0/596536461 wait complete. 2024-09-10T08:34:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.126+0000 7fc7ebe00640 1 Processor -- start 2024-09-10T08:34:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.126+0000 7fc7ebe00640 1 -- start start 2024-09-10T08:34:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0cf5c0 0x7fc7ec158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec15cbe0 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec15ca60 con 0x7fc7ec0cf5c0 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.127+0000 7fc7ebe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec15cd60 con 0x7fc7ec0b3e00 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43450/0 (socket says 172.21.15.52:43450) 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7e2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0cf5c0 0x7fc7ec158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 -- 172.21.15.52:0/2655396526 learned_addr learned my addr 172.21.15.52:0/2655396526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eaa00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 -- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 msgr2=0x7fc7ec147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:41.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 -- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0cf5c0 msgr2=0x7fc7ec158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0cf5c0 0x7fc7ec158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 -- 172.21.15.52:0/2655396526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec15b640 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.128+0000 7fc7eb400640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4034040 tx=0x7fc7e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.129+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4036050 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.129+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e4042070 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.129+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4009510 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.129+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec15b920 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.129+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec15b260 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.130+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec0b36f0 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.131+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7e4007bd0 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.132+0000 7fc7e3400640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.132+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fc7e40abc00 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.132+0000 7fc7eaa00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.133+0000 7fc7eaa00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 0x7fc7c806e320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc001780 tx=0x7fc7dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:41.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.136+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7e4079f50 con 0x7fc7ec0cf9a0 2024-09-10T08:34:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.317+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7ec0cd880 con 0x7fc7c806be60 2024-09-10T08:34:41.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.324+0000 7fc7e3400640 1 -- 172.21.15.52:0/2655396526 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247856 (secure 0 0 0) 0x7fc7ec0cd880 con 0x7fc7c806be60 2024-09-10T08:34:41.327 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 msgr2=0x7fc7c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 0x7fc7c806e320 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc001780 tx=0x7fc7dc009040 comp rx=0 tx=0).stop 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 msgr2=0x7fc7ec159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4034040 tx=0x7fc7e4004a40 comp rx=0 tx=0).stop 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 shutdown_connections 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc7c806be60 0x7fc7c806e320 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7ec0cf9a0 0x7fc7ec159190 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7ec0cf5c0 0x7fc7ec158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 --2- 172.21.15.52:0/2655396526 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7ec0b3e00 0x7fc7ec147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 >> 172.21.15.52:0/2655396526 conn(0x7fc7ec06c240 msgr2=0x7fc7ec15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 shutdown_connections 2024-09-10T08:34:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:41.328+0000 7fc7ebe00640 1 -- 172.21.15.52:0/2655396526 wait complete. 2024-09-10T08:34:41.344 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-10T08:34:39.542052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285944,"kb_used_data":11452,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754688776,"statfs":{"total":773094113280,"available":772801306624,"internally_reserved":0,"allocated":11726848,"data_stored":5749609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423405+0000","last_change":"2024-09-10T08:34:34.423405+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423405+0000","last_undegraded":"2024-09-10T08:34:34.423405+0000","last_fullsized":"2024-09-10T08:34:34.423405+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424012+0000","last_change":"2024-09-10T08:34:34.424012+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424012+0000","last_undegraded":"2024-09-10T08:34:34.424012+0000","last_fullsized":"2024-09-10T08:34:34.424012+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417459+0000","last_change":"2024-09-10T08:34:34.417459+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417459+0000","last_undegraded":"2024-09-10T08:34:34.417459+0000","last_fullsized":"2024-09-10T08:34:34.417459+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422481+0000","last_change":"2024-09-10T08:34:34.422481+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422481+0000","last_undegraded":"2024-09-10T08:34:34.422481+0000","last_fullsized":"2024-09-10T08:34:34.422481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423151+0000","last_change":"2024-09-10T08:34:34.423151+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423151+0000","last_undegraded":"2024-09-10T08:34:34.423151+0000","last_fullsized":"2024-09-10T08:34:34.423151+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.428193+0000","last_change":"2024-09-10T08:34:34.428193+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.428193+0000","last_undegraded":"2024-09-10T08:34:34.428193+0000","last_fullsized":"2024-09-10T08:34:34.428193+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421753+0000","last_change":"2024-09-10T08:34:34.421753+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421753+0000","last_undegraded":"2024-09-10T08:34:34.421753+0000","last_fullsized":"2024-09-10T08:34:34.421753+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414130+0000","last_change":"2024-09-10T08:34:34.414130+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414130+0000","last_undegraded":"2024-09-10T08:34:34.414130+0000","last_fullsized":"2024-09-10T08:34:34.414130+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.427123+0000","last_change":"2024-09-10T08:34:34.427123+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.427123+0000","last_undegraded":"2024-09-10T08:34:34.427123+0000","last_fullsized":"2024-09-10T08:34:34.427123+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419005+0000","last_change":"2024-09-10T08:34:34.419005+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419005+0000","last_undegraded":"2024-09-10T08:34:34.419005+0000","last_fullsized":"2024-09-10T08:34:34.419005+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426478+0000","last_change":"2024-09-10T08:34:34.426478+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426478+0000","last_undegraded":"2024-09-10T08:34:34.426478+0000","last_fullsized":"2024-09-10T08:34:34.426478+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415318+0000","last_change":"2024-09-10T08:34:34.415318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415318+0000","last_undegraded":"2024-09-10T08:34:34.415318+0000","last_fullsized":"2024-09-10T08:34:34.415318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423543+0000","last_change":"2024-09-10T08:34:34.423543+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423543+0000","last_undegraded":"2024-09-10T08:34:34.423543+0000","last_fullsized":"2024-09-10T08:34:34.423543+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418977+0000","last_change":"2024-09-10T08:34:34.418977+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418977+0000","last_undegraded":"2024-09-10T08:34:34.418977+0000","last_fullsized":"2024-09-10T08:34:34.418977+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418677+0000","last_change":"2024-09-10T08:34:34.418677+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418677+0000","last_undegraded":"2024-09-10T08:34:34.418677+0000","last_fullsized":"2024-09-10T08:34:34.418677+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420232+0000","last_change":"2024-09-10T08:34:34.420232+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420232+0000","last_undegraded":"2024-09-10T08:34:34.420232+0000","last_fullsized":"2024-09-10T08:34:34.420232+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436806+0000","last_change":"2024-09-10T08:34:35.443743+0000","last_active":"2024-09-10T08:34:36.436806+0000","last_peered":"2024-09-10T08:34:36.436806+0000","last_clean":"2024-09-10T08:34:36.436806+0000","last_became_active":"2024-09-10T08:34:35.443367+0000","last_became_peered":"2024-09-10T08:34:35.443367+0000","last_unstale":"2024-09-10T08:34:36.436806+0000","last_undegraded":"2024-09-10T08:34:36.436806+0000","last_fullsized":"2024-09-10T08:34:36.436806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:46.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423568+0000","last_change":"2024-09-10T08:34:34.423568+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423568+0000","last_undegraded":"2024-09-10T08:34:34.423568+0000","last_fullsized":"2024-09-10T08:34:34.423568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438213+0000","last_change":"2024-09-10T08:34:35.433604+0000","last_active":"2024-09-10T08:34:36.438213+0000","last_peered":"2024-09-10T08:34:36.438213+0000","last_clean":"2024-09-10T08:34:36.438213+0000","last_became_active":"2024-09-10T08:34:35.433332+0000","last_became_peered":"2024-09-10T08:34:35.433332+0000","last_unstale":"2024-09-10T08:34:36.438213+0000","last_undegraded":"2024-09-10T08:34:36.438213+0000","last_fullsized":"2024-09-10T08:34:36.438213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.004100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414910+0000","last_change":"2024-09-10T08:34:34.414910+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414910+0000","last_undegraded":"2024-09-10T08:34:34.414910+0000","last_fullsized":"2024-09-10T08:34:34.414910+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415306+0000","last_change":"2024-09-10T08:34:34.415306+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415306+0000","last_undegraded":"2024-09-10T08:34:34.415306+0000","last_fullsized":"2024-09-10T08:34:34.415306+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416567+0000","last_change":"2024-09-10T08:34:34.416567+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416567+0000","last_undegraded":"2024-09-10T08:34:34.416567+0000","last_fullsized":"2024-09-10T08:34:34.416567+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418087+0000","last_change":"2024-09-10T08:34:34.418087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418087+0000","last_undegraded":"2024-09-10T08:34:34.418087+0000","last_fullsized":"2024-09-10T08:34:34.418087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417954+0000","last_change":"2024-09-10T08:34:34.417954+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417954+0000","last_undegraded":"2024-09-10T08:34:34.417954+0000","last_fullsized":"2024-09-10T08:34:34.417954+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419218+0000","last_change":"2024-09-10T08:34:34.419218+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419218+0000","last_undegraded":"2024-09-10T08:34:34.419218+0000","last_fullsized":"2024-09-10T08:34:34.419218+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424784+0000","last_change":"2024-09-10T08:34:34.424784+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424784+0000","last_undegraded":"2024-09-10T08:34:34.424784+0000","last_fullsized":"2024-09-10T08:34:34.424784+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418759+0000","last_change":"2024-09-10T08:34:34.418759+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418759+0000","last_undegraded":"2024-09-10T08:34:34.418759+0000","last_fullsized":"2024-09-10T08:34:34.418759+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417269+0000","last_change":"2024-09-10T08:34:34.417269+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417269+0000","last_undegraded":"2024-09-10T08:34:34.417269+0000","last_fullsized":"2024-09-10T08:34:34.417269+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423145+0000","last_change":"2024-09-10T08:34:34.423145+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423145+0000","last_undegraded":"2024-09-10T08:34:34.423145+0000","last_fullsized":"2024-09-10T08:34:34.423145+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.420804+0000","last_change":"2024-09-10T08:34:34.420804+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.420804+0000","last_undegraded":"2024-09-10T08:34:34.420804+0000","last_fullsized":"2024-09-10T08:34:34.420804+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417187+0000","last_change":"2024-09-10T08:34:34.417187+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417187+0000","last_undegraded":"2024-09-10T08:34:34.417187+0000","last_fullsized":"2024-09-10T08:34:34.417187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419892+0000","last_change":"2024-09-10T08:34:34.419892+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419892+0000","last_undegraded":"2024-09-10T08:34:34.419892+0000","last_fullsized":"2024-09-10T08:34:34.419892+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437098+0000","last_change":"2024-09-10T08:34:35.442470+0000","last_active":"2024-09-10T08:34:36.437098+0000","last_peered":"2024-09-10T08:34:36.437098+0000","last_clean":"2024-09-10T08:34:36.437098+0000","last_became_active":"2024-09-10T08:34:35.442205+0000","last_became_peered":"2024-09-10T08:34:35.442205+0000","last_unstale":"2024-09-10T08:34:36.437098+0000","last_undegraded":"2024-09-10T08:34:36.437098+0000","last_fullsized":"2024-09-10T08:34:36.437098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:47.215931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.440376+0000","last_change":"2024-09-10T08:34:34.438667+0000","last_active":"2024-09-10T08:34:34.440376+0000","last_peered":"2024-09-10T08:34:34.440376+0000","last_clean":"2024-09-10T08:34:34.440376+0000","last_became_active":"2024-09-10T08:34:34.437256+0000","last_became_peered":"2024-09-10T08:34:34.437256+0000","last_unstale":"2024-09-10T08:34:34.440376+0000","last_undegraded":"2024-09-10T08:34:34.440376+0000","last_fullsized":"2024-09-10T08:34:34.440376+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:04:12.032750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424132+0000","last_change":"2024-09-10T08:34:34.424132+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424132+0000","last_undegraded":"2024-09-10T08:34:34.424132+0000","last_fullsized":"2024-09-10T08:34:34.424132+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437261+0000","last_change":"2024-09-10T08:34:34.435974+0000","last_active":"2024-09-10T08:34:34.437261+0000","last_peered":"2024-09-10T08:34:34.437261+0000","last_clean":"2024-09-10T08:34:34.437261+0000","last_became_active":"2024-09-10T08:34:34.435612+0000","last_became_peered":"2024-09-10T08:34:34.435612+0000","last_unstale":"2024-09-10T08:34:34.437261+0000","last_undegraded":"2024-09-10T08:34:34.437261+0000","last_fullsized":"2024-09-10T08:34:34.437261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:23.863413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422013+0000","last_change":"2024-09-10T08:34:34.422013+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422013+0000","last_undegraded":"2024-09-10T08:34:34.422013+0000","last_fullsized":"2024-09-10T08:34:34.422013+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435921+0000","last_change":"2024-09-10T08:34:34.432133+0000","last_active":"2024-09-10T08:34:34.435921+0000","last_peered":"2024-09-10T08:34:34.435921+0000","last_clean":"2024-09-10T08:34:34.435921+0000","last_became_active":"2024-09-10T08:34:34.430805+0000","last_became_peered":"2024-09-10T08:34:34.430805+0000","last_unstale":"2024-09-10T08:34:34.435921+0000","last_undegraded":"2024-09-10T08:34:34.435921+0000","last_fullsized":"2024-09-10T08:34:34.435921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.049469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417889+0000","last_change":"2024-09-10T08:34:34.417889+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417889+0000","last_undegraded":"2024-09-10T08:34:34.417889+0000","last_fullsized":"2024-09-10T08:34:34.417889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436519+0000","last_change":"2024-09-10T08:34:34.431738+0000","last_active":"2024-09-10T08:34:34.436519+0000","last_peered":"2024-09-10T08:34:34.436519+0000","last_clean":"2024-09-10T08:34:34.436519+0000","last_became_active":"2024-09-10T08:34:34.431422+0000","last_became_peered":"2024-09-10T08:34:34.431422+0000","last_unstale":"2024-09-10T08:34:34.436519+0000","last_undegraded":"2024-09-10T08:34:34.436519+0000","last_fullsized":"2024-09-10T08:34:34.436519+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.202570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414801+0000","last_change":"2024-09-10T08:34:34.414801+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414801+0000","last_undegraded":"2024-09-10T08:34:34.414801+0000","last_fullsized":"2024-09-10T08:34:34.414801+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438218+0000","last_change":"2024-09-10T08:34:34.434494+0000","last_active":"2024-09-10T08:34:34.438218+0000","last_peered":"2024-09-10T08:34:34.438218+0000","last_clean":"2024-09-10T08:34:34.438218+0000","last_became_active":"2024-09-10T08:34:34.434024+0000","last_became_peered":"2024-09-10T08:34:34.434024+0000","last_unstale":"2024-09-10T08:34:34.438218+0000","last_undegraded":"2024-09-10T08:34:34.438218+0000","last_fullsized":"2024-09-10T08:34:34.438218+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:34.132190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.422502+0000","last_change":"2024-09-10T08:34:34.422502+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.422502+0000","last_undegraded":"2024-09-10T08:34:34.422502+0000","last_fullsized":"2024-09-10T08:34:34.422502+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439841+0000","last_change":"2024-09-10T08:34:34.438384+0000","last_active":"2024-09-10T08:34:34.439841+0000","last_peered":"2024-09-10T08:34:34.439841+0000","last_clean":"2024-09-10T08:34:34.439841+0000","last_became_active":"2024-09-10T08:34:34.438128+0000","last_became_peered":"2024-09-10T08:34:34.438128+0000","last_unstale":"2024-09-10T08:34:34.439841+0000","last_undegraded":"2024-09-10T08:34:34.439841+0000","last_fullsized":"2024-09-10T08:34:34.439841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:06.410447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419381+0000","last_change":"2024-09-10T08:34:34.419381+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419381+0000","last_undegraded":"2024-09-10T08:34:34.419381+0000","last_fullsized":"2024-09-10T08:34:34.419381+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434541+0000","last_change":"2024-09-10T08:34:34.433790+0000","last_active":"2024-09-10T08:34:34.434541+0000","last_peered":"2024-09-10T08:34:34.434541+0000","last_clean":"2024-09-10T08:34:34.434541+0000","last_became_active":"2024-09-10T08:34:34.433508+0000","last_became_peered":"2024-09-10T08:34:34.433508+0000","last_unstale":"2024-09-10T08:34:34.434541+0000","last_undegraded":"2024-09-10T08:34:34.434541+0000","last_fullsized":"2024-09-10T08:34:34.434541+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:55.607496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414844+0000","last_change":"2024-09-10T08:34:34.414844+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414844+0000","last_undegraded":"2024-09-10T08:34:34.414844+0000","last_fullsized":"2024-09-10T08:34:34.414844+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437607+0000","last_change":"2024-09-10T08:34:34.436720+0000","last_active":"2024-09-10T08:34:36.437607+0000","last_peered":"2024-09-10T08:34:36.437607+0000","last_clean":"2024-09-10T08:34:36.437607+0000","last_became_active":"2024-09-10T08:34:34.436399+0000","last_became_peered":"2024-09-10T08:34:34.436399+0000","last_unstale":"2024-09-10T08:34:36.437607+0000","last_undegraded":"2024-09-10T08:34:36.437607+0000","last_fullsized":"2024-09-10T08:34:36.437607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.115469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.423181+0000","last_change":"2024-09-10T08:34:34.423181+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.423181+0000","last_undegraded":"2024-09-10T08:34:34.423181+0000","last_fullsized":"2024-09-10T08:34:34.423181+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.428223+0000","last_change":"2024-09-10T08:34:34.423542+0000","last_active":"2024-09-10T08:34:34.428223+0000","last_peered":"2024-09-10T08:34:34.428223+0000","last_clean":"2024-09-10T08:34:34.428223+0000","last_became_active":"2024-09-10T08:34:34.423263+0000","last_became_peered":"2024-09-10T08:34:34.423263+0000","last_unstale":"2024-09-10T08:34:34.428223+0000","last_undegraded":"2024-09-10T08:34:34.428223+0000","last_fullsized":"2024-09-10T08:34:34.428223+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417758+0000","last_change":"2024-09-10T08:34:34.417758+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417758+0000","last_undegraded":"2024-09-10T08:34:34.417758+0000","last_fullsized":"2024-09-10T08:34:34.417758+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436487+0000","last_change":"2024-09-10T08:34:34.431042+0000","last_active":"2024-09-10T08:34:34.436487+0000","last_peered":"2024-09-10T08:34:34.436487+0000","last_clean":"2024-09-10T08:34:34.436487+0000","last_became_active":"2024-09-10T08:34:34.430781+0000","last_became_peered":"2024-09-10T08:34:34.430781+0000","last_unstale":"2024-09-10T08:34:34.436487+0000","last_undegraded":"2024-09-10T08:34:34.436487+0000","last_fullsized":"2024-09-10T08:34:34.436487+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:50.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.424550+0000","last_change":"2024-09-10T08:34:34.424550+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.424550+0000","last_undegraded":"2024-09-10T08:34:34.424550+0000","last_fullsized":"2024-09-10T08:34:34.424550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434286+0000","last_change":"2024-09-10T08:34:34.430619+0000","last_active":"2024-09-10T08:34:34.434286+0000","last_peered":"2024-09-10T08:34:34.434286+0000","last_clean":"2024-09-10T08:34:34.434286+0000","last_became_active":"2024-09-10T08:34:34.430054+0000","last_became_peered":"2024-09-10T08:34:34.430054+0000","last_unstale":"2024-09-10T08:34:34.434286+0000","last_undegraded":"2024-09-10T08:34:34.434286+0000","last_fullsized":"2024-09-10T08:34:34.434286+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.340515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416408+0000","last_change":"2024-09-10T08:34:34.416408+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416408+0000","last_undegraded":"2024-09-10T08:34:34.416408+0000","last_fullsized":"2024-09-10T08:34:34.416408+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.434253+0000","last_change":"2024-09-10T08:34:34.433126+0000","last_active":"2024-09-10T08:34:34.434253+0000","last_peered":"2024-09-10T08:34:34.434253+0000","last_clean":"2024-09-10T08:34:34.434253+0000","last_became_active":"2024-09-10T08:34:34.431890+0000","last_became_peered":"2024-09-10T08:34:34.431890+0000","last_unstale":"2024-09-10T08:34:34.434253+0000","last_undegraded":"2024-09-10T08:34:34.434253+0000","last_fullsized":"2024-09-10T08:34:34.434253+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:37.371058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.418118+0000","last_change":"2024-09-10T08:34:34.418118+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.418118+0000","last_undegraded":"2024-09-10T08:34:34.418118+0000","last_fullsized":"2024-09-10T08:34:34.418118+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436653+0000","last_change":"2024-09-10T08:34:34.437471+0000","last_active":"2024-09-10T08:34:36.436653+0000","last_peered":"2024-09-10T08:34:36.436653+0000","last_clean":"2024-09-10T08:34:36.436653+0000","last_became_active":"2024-09-10T08:34:34.436355+0000","last_became_peered":"2024-09-10T08:34:34.436355+0000","last_unstale":"2024-09-10T08:34:36.436653+0000","last_undegraded":"2024-09-10T08:34:36.436653+0000","last_fullsized":"2024-09-10T08:34:36.436653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414087+0000","last_change":"2024-09-10T08:34:34.414087+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414087+0000","last_undegraded":"2024-09-10T08:34:34.414087+0000","last_fullsized":"2024-09-10T08:34:34.414087+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.439131+0000","last_change":"2024-09-10T08:34:34.437445+0000","last_active":"2024-09-10T08:34:34.439131+0000","last_peered":"2024-09-10T08:34:34.439131+0000","last_clean":"2024-09-10T08:34:34.439131+0000","last_became_active":"2024-09-10T08:34:34.437178+0000","last_became_peered":"2024-09-10T08:34:34.437178+0000","last_unstale":"2024-09-10T08:34:34.439131+0000","last_undegraded":"2024-09-10T08:34:34.439131+0000","last_fullsized":"2024-09-10T08:34:34.439131+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419699+0000","last_change":"2024-09-10T08:34:34.419699+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419699+0000","last_undegraded":"2024-09-10T08:34:34.419699+0000","last_fullsized":"2024-09-10T08:34:34.419699+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.423657+0000","last_change":"2024-09-10T08:34:34.421209+0000","last_active":"2024-09-10T08:34:34.423657+0000","last_peered":"2024-09-10T08:34:34.423657+0000","last_clean":"2024-09-10T08:34:34.423657+0000","last_became_active":"2024-09-10T08:34:34.420857+0000","last_became_peered":"2024-09-10T08:34:34.420857+0000","last_unstale":"2024-09-10T08:34:34.423657+0000","last_undegraded":"2024-09-10T08:34:34.423657+0000","last_fullsized":"2024-09-10T08:34:34.423657+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:03.807592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414783+0000","last_change":"2024-09-10T08:34:34.414783+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414783+0000","last_undegraded":"2024-09-10T08:34:34.414783+0000","last_fullsized":"2024-09-10T08:34:34.414783+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.438057+0000","last_change":"2024-09-10T08:34:34.434724+0000","last_active":"2024-09-10T08:34:34.438057+0000","last_peered":"2024-09-10T08:34:34.438057+0000","last_clean":"2024-09-10T08:34:34.438057+0000","last_became_active":"2024-09-10T08:34:34.431717+0000","last_became_peered":"2024-09-10T08:34:34.431717+0000","last_unstale":"2024-09-10T08:34:34.438057+0000","last_undegraded":"2024-09-10T08:34:34.438057+0000","last_fullsized":"2024-09-10T08:34:34.438057+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:36.029217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.417318+0000","last_change":"2024-09-10T08:34:34.417318+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.417318+0000","last_undegraded":"2024-09-10T08:34:34.417318+0000","last_fullsized":"2024-09-10T08:34:34.417318+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435023+0000","last_change":"2024-09-10T08:34:34.433626+0000","last_active":"2024-09-10T08:34:34.435023+0000","last_peered":"2024-09-10T08:34:34.435023+0000","last_clean":"2024-09-10T08:34:34.435023+0000","last_became_active":"2024-09-10T08:34:34.431050+0000","last_became_peered":"2024-09-10T08:34:34.431050+0000","last_unstale":"2024-09-10T08:34:34.435023+0000","last_undegraded":"2024-09-10T08:34:34.435023+0000","last_fullsized":"2024-09-10T08:34:34.435023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:21.214168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416319+0000","last_change":"2024-09-10T08:34:34.416319+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416319+0000","last_undegraded":"2024-09-10T08:34:34.416319+0000","last_fullsized":"2024-09-10T08:34:34.416319+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.436434+0000","last_change":"2024-09-10T08:34:34.435089+0000","last_active":"2024-09-10T08:34:34.436434+0000","last_peered":"2024-09-10T08:34:34.436434+0000","last_clean":"2024-09-10T08:34:34.436434+0000","last_became_active":"2024-09-10T08:34:34.434758+0000","last_became_peered":"2024-09-10T08:34:34.434758+0000","last_unstale":"2024-09-10T08:34:34.436434+0000","last_undegraded":"2024-09-10T08:34:34.436434+0000","last_fullsized":"2024-09-10T08:34:34.436434+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:03:53.014201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414347+0000","last_change":"2024-09-10T08:34:34.414347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414347+0000","last_undegraded":"2024-09-10T08:34:34.414347+0000","last_fullsized":"2024-09-10T08:34:34.414347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436650+0000","last_change":"2024-09-10T08:34:34.432248+0000","last_active":"2024-09-10T08:34:36.436650+0000","last_peered":"2024-09-10T08:34:36.436650+0000","last_clean":"2024-09-10T08:34:36.436650+0000","last_became_active":"2024-09-10T08:34:34.431912+0000","last_became_peered":"2024-09-10T08:34:34.431912+0000","last_unstale":"2024-09-10T08:34:36.436650+0000","last_undegraded":"2024-09-10T08:34:36.436650+0000","last_fullsized":"2024-09-10T08:34:36.436650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:34.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436624+0000","last_change":"2024-09-10T08:34:35.435254+0000","last_active":"2024-09-10T08:34:36.436624+0000","last_peered":"2024-09-10T08:34:36.436624+0000","last_clean":"2024-09-10T08:34:36.436624+0000","last_became_active":"2024-09-10T08:34:35.435000+0000","last_became_peered":"2024-09-10T08:34:35.435000+0000","last_unstale":"2024-09-10T08:34:36.436624+0000","last_undegraded":"2024-09-10T08:34:36.436624+0000","last_fullsized":"2024-09-10T08:34:36.436624+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:29.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433086+0000","last_change":"2024-09-10T08:34:34.430005+0000","last_active":"2024-09-10T08:34:34.433086+0000","last_peered":"2024-09-10T08:34:34.433086+0000","last_clean":"2024-09-10T08:34:34.433086+0000","last_became_active":"2024-09-10T08:34:34.429669+0000","last_became_peered":"2024-09-10T08:34:34.429669+0000","last_unstale":"2024-09-10T08:34:34.433086+0000","last_undegraded":"2024-09-10T08:34:34.433086+0000","last_fullsized":"2024-09-10T08:34:34.433086+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:13.312879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436730+0000","last_change":"2024-09-10T08:34:35.428979+0000","last_active":"2024-09-10T08:34:36.436730+0000","last_peered":"2024-09-10T08:34:36.436730+0000","last_clean":"2024-09-10T08:34:36.436730+0000","last_became_active":"2024-09-10T08:34:35.428705+0000","last_became_peered":"2024-09-10T08:34:35.428705+0000","last_unstale":"2024-09-10T08:34:36.436730+0000","last_undegraded":"2024-09-10T08:34:36.436730+0000","last_fullsized":"2024-09-10T08:34:36.436730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:08.670337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.437851+0000","last_change":"2024-09-10T08:34:34.437024+0000","last_active":"2024-09-10T08:34:34.437851+0000","last_peered":"2024-09-10T08:34:34.437851+0000","last_clean":"2024-09-10T08:34:34.437851+0000","last_became_active":"2024-09-10T08:34:34.436737+0000","last_became_peered":"2024-09-10T08:34:34.436737+0000","last_unstale":"2024-09-10T08:34:34.437851+0000","last_undegraded":"2024-09-10T08:34:34.437851+0000","last_fullsized":"2024-09-10T08:34:34.437851+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:33.157826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.419466+0000","last_change":"2024-09-10T08:34:34.419466+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.419466+0000","last_undegraded":"2024-09-10T08:34:34.419466+0000","last_fullsized":"2024-09-10T08:34:34.419466+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433426+0000","last_change":"2024-09-10T08:34:34.432017+0000","last_active":"2024-09-10T08:34:34.433426+0000","last_peered":"2024-09-10T08:34:34.433426+0000","last_clean":"2024-09-10T08:34:34.433426+0000","last_became_active":"2024-09-10T08:34:34.431711+0000","last_became_peered":"2024-09-10T08:34:34.431711+0000","last_unstale":"2024-09-10T08:34:34.433426+0000","last_undegraded":"2024-09-10T08:34:34.433426+0000","last_fullsized":"2024-09-10T08:34:34.433426+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:58.711437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.415930+0000","last_change":"2024-09-10T08:34:34.415930+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.415930+0000","last_undegraded":"2024-09-10T08:34:34.415930+0000","last_fullsized":"2024-09-10T08:34:34.415930+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.431916+0000","last_change":"2024-09-10T08:34:34.429461+0000","last_active":"2024-09-10T08:34:34.431916+0000","last_peered":"2024-09-10T08:34:34.431916+0000","last_clean":"2024-09-10T08:34:34.431916+0000","last_became_active":"2024-09-10T08:34:34.429128+0000","last_became_peered":"2024-09-10T08:34:34.429128+0000","last_unstale":"2024-09-10T08:34:34.431916+0000","last_undegraded":"2024-09-10T08:34:34.431916+0000","last_fullsized":"2024-09-10T08:34:34.431916+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:18.010285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437345+0000","last_change":"2024-09-10T08:34:35.434825+0000","last_active":"2024-09-10T08:34:36.437345+0000","last_peered":"2024-09-10T08:34:36.437345+0000","last_clean":"2024-09-10T08:34:36.437345+0000","last_became_active":"2024-09-10T08:34:35.430948+0000","last_became_peered":"2024-09-10T08:34:35.430948+0000","last_unstale":"2024-09-10T08:34:36.437345+0000","last_undegraded":"2024-09-10T08:34:36.437345+0000","last_fullsized":"2024-09-10T08:34:36.437345+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:16.603302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.422234+0000","last_change":"2024-09-10T08:34:34.419784+0000","last_active":"2024-09-10T08:34:34.422234+0000","last_peered":"2024-09-10T08:34:34.422234+0000","last_clean":"2024-09-10T08:34:34.422234+0000","last_became_active":"2024-09-10T08:34:34.419506+0000","last_became_peered":"2024-09-10T08:34:34.419506+0000","last_unstale":"2024-09-10T08:34:34.422234+0000","last_undegraded":"2024-09-10T08:34:34.422234+0000","last_fullsized":"2024-09-10T08:34:34.422234+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436975+0000","last_change":"2024-09-10T08:34:35.433095+0000","last_active":"2024-09-10T08:34:36.436975+0000","last_peered":"2024-09-10T08:34:36.436975+0000","last_clean":"2024-09-10T08:34:36.436975+0000","last_became_active":"2024-09-10T08:34:35.431572+0000","last_became_peered":"2024-09-10T08:34:35.431572+0000","last_unstale":"2024-09-10T08:34:36.436975+0000","last_undegraded":"2024-09-10T08:34:36.436975+0000","last_fullsized":"2024-09-10T08:34:36.436975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.472360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437455+0000","last_change":"2024-09-10T08:34:34.431957+0000","last_active":"2024-09-10T08:34:36.437455+0000","last_peered":"2024-09-10T08:34:36.437455+0000","last_clean":"2024-09-10T08:34:36.437455+0000","last_became_active":"2024-09-10T08:34:34.428639+0000","last_became_peered":"2024-09-10T08:34:34.428639+0000","last_unstale":"2024-09-10T08:34:36.437455+0000","last_undegraded":"2024-09-10T08:34:36.437455+0000","last_fullsized":"2024-09-10T08:34:36.437455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416347+0000","last_change":"2024-09-10T08:34:34.416347+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416347+0000","last_undegraded":"2024-09-10T08:34:34.416347+0000","last_fullsized":"2024-09-10T08:34:34.416347+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437852+0000","last_change":"2024-09-10T08:34:34.427424+0000","last_active":"2024-09-10T08:34:36.437852+0000","last_peered":"2024-09-10T08:34:36.437852+0000","last_clean":"2024-09-10T08:34:36.437852+0000","last_became_active":"2024-09-10T08:34:34.426305+0000","last_became_peered":"2024-09-10T08:34:34.426305+0000","last_unstale":"2024-09-10T08:34:36.437852+0000","last_undegraded":"2024-09-10T08:34:36.437852+0000","last_fullsized":"2024-09-10T08:34:36.437852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:18.049964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.426042+0000","last_change":"2024-09-10T08:34:34.426042+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.426042+0000","last_undegraded":"2024-09-10T08:34:34.426042+0000","last_fullsized":"2024-09-10T08:34:34.426042+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.424845+0000","last_change":"2024-09-10T08:34:34.423423+0000","last_active":"2024-09-10T08:34:34.424845+0000","last_peered":"2024-09-10T08:34:34.424845+0000","last_clean":"2024-09-10T08:34:34.424845+0000","last_became_active":"2024-09-10T08:34:34.419996+0000","last_became_peered":"2024-09-10T08:34:34.419996+0000","last_unstale":"2024-09-10T08:34:34.424845+0000","last_undegraded":"2024-09-10T08:34:34.424845+0000","last_fullsized":"2024-09-10T08:34:34.424845+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.102494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436802+0000","last_change":"2024-09-10T08:34:35.440388+0000","last_active":"2024-09-10T08:34:36.436802+0000","last_peered":"2024-09-10T08:34:36.436802+0000","last_clean":"2024-09-10T08:34:36.436802+0000","last_became_active":"2024-09-10T08:34:35.439549+0000","last_became_peered":"2024-09-10T08:34:35.439549+0000","last_unstale":"2024-09-10T08:34:36.436802+0000","last_undegraded":"2024-09-10T08:34:36.436802+0000","last_fullsized":"2024-09-10T08:34:36.436802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.435737+0000","last_change":"2024-09-10T08:34:34.433704+0000","last_active":"2024-09-10T08:34:34.435737+0000","last_peered":"2024-09-10T08:34:34.435737+0000","last_clean":"2024-09-10T08:34:34.435737+0000","last_became_active":"2024-09-10T08:34:34.433401+0000","last_became_peered":"2024-09-10T08:34:34.433401+0000","last_unstale":"2024-09-10T08:34:34.435737+0000","last_undegraded":"2024-09-10T08:34:34.435737+0000","last_fullsized":"2024-09-10T08:34:34.435737+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:24.167963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.421561+0000","last_change":"2024-09-10T08:34:34.421561+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.421561+0000","last_undegraded":"2024-09-10T08:34:34.421561+0000","last_fullsized":"2024-09-10T08:34:34.421561+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433574+0000","last_change":"2024-09-10T08:34:34.431145+0000","last_active":"2024-09-10T08:34:34.433574+0000","last_peered":"2024-09-10T08:34:34.433574+0000","last_clean":"2024-09-10T08:34:34.433574+0000","last_became_active":"2024-09-10T08:34:34.430713+0000","last_became_peered":"2024-09-10T08:34:34.430713+0000","last_unstale":"2024-09-10T08:34:34.433574+0000","last_undegraded":"2024-09-10T08:34:34.433574+0000","last_fullsized":"2024-09-10T08:34:34.433574+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:34.185388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437587+0000","last_change":"2024-09-10T08:34:35.447833+0000","last_active":"2024-09-10T08:34:36.437587+0000","last_peered":"2024-09-10T08:34:36.437587+0000","last_clean":"2024-09-10T08:34:36.437587+0000","last_became_active":"2024-09-10T08:34:35.447138+0000","last_became_peered":"2024-09-10T08:34:35.447138+0000","last_unstale":"2024-09-10T08:34:36.437587+0000","last_undegraded":"2024-09-10T08:34:36.437587+0000","last_fullsized":"2024-09-10T08:34:36.437587+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:34.020654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.442435+0000","last_change":"2024-09-10T08:34:34.439809+0000","last_active":"2024-09-10T08:34:34.442435+0000","last_peered":"2024-09-10T08:34:34.442435+0000","last_clean":"2024-09-10T08:34:34.442435+0000","last_became_active":"2024-09-10T08:34:34.438918+0000","last_became_peered":"2024-09-10T08:34:34.438918+0000","last_unstale":"2024-09-10T08:34:34.442435+0000","last_undegraded":"2024-09-10T08:34:34.442435+0000","last_fullsized":"2024-09-10T08:34:34.442435+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:57.246778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.414144+0000","last_change":"2024-09-10T08:34:34.414144+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.414144+0000","last_undegraded":"2024-09-10T08:34:34.414144+0000","last_fullsized":"2024-09-10T08:34:34.414144+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.430158+0000","last_change":"2024-09-10T08:34:34.428151+0000","last_active":"2024-09-10T08:34:34.430158+0000","last_peered":"2024-09-10T08:34:34.430158+0000","last_clean":"2024-09-10T08:34:34.430158+0000","last_became_active":"2024-09-10T08:34:34.427824+0000","last_became_peered":"2024-09-10T08:34:34.427824+0000","last_unstale":"2024-09-10T08:34:34.430158+0000","last_undegraded":"2024-09-10T08:34:34.430158+0000","last_fullsized":"2024-09-10T08:34:34.430158+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:23.156216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":107,"state":"creating+peering","last_fresh":"2024-09-10T08:34:34.416638+0000","last_change":"2024-09-10T08:34:34.416638+0000","last_active":"2024-09-10T08:34:34.402665+0000","last_peered":"2024-09-10T08:34:34.402665+0000","last_clean":"2024-09-10T08:34:34.402665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:34:34.416638+0000","last_undegraded":"2024-09-10T08:34:34.416638+0000","last_fullsized":"2024-09-10T08:34:34.416638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.433174+0000","last_change":"2024-09-10T08:34:34.431301+0000","last_active":"2024-09-10T08:34:34.433174+0000","last_peered":"2024-09-10T08:34:34.433174+0000","last_clean":"2024-09-10T08:34:34.433174+0000","last_became_active":"2024-09-10T08:34:34.430954+0000","last_became_peered":"2024-09-10T08:34:34.430954+0000","last_unstale":"2024-09-10T08:34:34.433174+0000","last_undegraded":"2024-09-10T08:34:34.433174+0000","last_fullsized":"2024-09-10T08:34:34.433174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:00.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":319,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-10T08:34:34.416242+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:34:34.416242+0000","last_peered":"2024-09-10T08:34:34.416242+0000","last_clean":"2024-09-10T08:34:34.416242+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:34:34.416242+0000","last_undegraded":"2024-09-10T08:34:34.416242+0000","last_fullsized":"2024-09-10T08:34:34.416242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40796,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331044,"statfs":{"total":96636764160,"available":96594989056,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1302528,"data_stored":564560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41372,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330468,"statfs":{"total":96636764160,"available":96594399232,"internally_reserved":0,"allocated":1908736,"data_stored":1161203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1314816,"data_stored":570835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":1175946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:34:44.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:34:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.519+0000 7f21ca800640 1 Processor -- start 2024-09-10T08:34:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.520+0000 7f21ca800640 1 -- start start 2024-09-10T08:34:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.521+0000 7f21ca800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4148260 0x7f21c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.521+0000 7f21ca800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21c4071680 0x7f21c406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.521+0000 7f21ca800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c4071b30 con 0x7f21c4147e80 2024-09-10T08:34:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.521+0000 7f21ca800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f21c4074200 con 0x7f21c4071680 2024-09-10T08:34:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.521+0000 7f21ca800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40b3e40 con 0x7f21c4148260 2024-09-10T08:34:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f21c4071680 0x7f21c406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f21c4147e80 0x7f21c4070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:38726/0 (socket says 172.21.15.52:38726) 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21bbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4148260 0x7f21c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3400640 1 -- 172.21.15.52:0/3307248870 learned_addr learned my addr 172.21.15.52:0/3307248870 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3e00640 1 -- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4148260 msgr2=0x7f21c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3e00640 1 --2- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4148260 0x7f21c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3e00640 1 -- 172.21.15.52:0/3307248870 >> v1:172.21.15.176:6789/0 conn(0x7f21c4147e80 legacy=0x7f21c4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c3e00640 1 -- 172.21.15.52:0/3307248870 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c40b3510 con 0x7f21c4071680 2024-09-10T08:34:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.522+0000 7f21c2a00640 1 -- 172.21.15.52:0/3307248870 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898801154 0 0) 0x7f21c4071b30 con 0x7f21c4147e80 2024-09-10T08:34:44.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.523+0000 7f21c3e00640 1 --2- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4071680 0x7f21c406c150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009d90 tx=0x7f21bc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b72713e4f07cb841 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21c2a00640 1 -- 172.21.15.52:0/3307248870 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc007740 con 0x7f21c4071680 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21c2a00640 1 -- 172.21.15.52:0/3307248870 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc0078e0 con 0x7f21c4071680 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21c2a00640 1 -- 172.21.15.52:0/3307248870 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc007cb0 con 0x7f21c4071680 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 -- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4071680 msgr2=0x7f21c406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 --2- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4071680 0x7f21c406c150 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009d90 tx=0x7f21bc02a660 comp rx=0 tx=0).stop 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 -- 172.21.15.52:0/3307248870 shutdown_connections 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 --2- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4071680 0x7f21c406c150 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 --2- 172.21.15.52:0/3307248870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4148260 0x7f21c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 -- 172.21.15.52:0/3307248870 >> 172.21.15.52:0/3307248870 conn(0x7f21c40ccec0 msgr2=0x7f21c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:44.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 -- 172.21.15.52:0/3307248870 shutdown_connections 2024-09-10T08:34:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.524+0000 7f21ca800640 1 -- 172.21.15.52:0/3307248870 wait complete. 2024-09-10T08:34:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.526+0000 7f21ca800640 1 Processor -- start 2024-09-10T08:34:44.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.526+0000 7f21ca800640 1 -- start start 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4147e80 0x7f21c40b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4148260 0x7f21c40b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40b42d0 con 0x7f21c4071680 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40b3ad0 con 0x7f21c4148260 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21ca800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40b4450 con 0x7f21c4147e80 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50290/0 (socket says 172.21.15.52:50290) 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.527+0000 7f21c3400640 1 -- 172.21.15.52:0/3712341238 learned_addr learned my addr 172.21.15.52:0/3712341238 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:44.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21bbe00640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4147e80 0x7f21c40b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3e00640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4148260 0x7f21c40b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 -- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4147e80 msgr2=0x7f21c40b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4147e80 0x7f21c40b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 -- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4148260 msgr2=0x7f21c40b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4148260 0x7f21c40b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 -- 172.21.15.52:0/3712341238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c413ea30 con 0x7f21c4071680 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21c3400640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c4d0 tx=0x7f21b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.528+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4018070 con 0x7f21c4071680 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.529+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b4007500 con 0x7f21c4071680 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.529+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4004a20 con 0x7f21c4071680 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.529+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c40acaa0 con 0x7f21c4071680 2024-09-10T08:34:44.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.529+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c40adcd0 con 0x7f21c4071680 2024-09-10T08:34:44.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.530+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c4070f70 con 0x7f21c4071680 2024-09-10T08:34:44.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.531+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21b401b070 con 0x7f21c4071680 2024-09-10T08:34:44.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.532+0000 7f21bb400640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.532+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f21b408a1a0 con 0x7f21c4071680 2024-09-10T08:34:44.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.532+0000 7f21bbe00640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.533+0000 7f21bbe00640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 0x7f21a006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21c40cfb00 tx=0x7f21ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.536+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21c413ea30 con 0x7f21c4071680 2024-09-10T08:34:44.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.721+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21c41455b0 con 0x7f21a006be30 2024-09-10T08:34:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.728+0000 7f21bb400640 1 -- 172.21.15.52:0/3712341238 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f21c41455b0 con 0x7f21a006be30 2024-09-10T08:34:44.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:34:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 msgr2=0x7f21a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 0x7f21a006e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f21c40cfb00 tx=0x7f21ac009190 comp rx=0 tx=0).stop 2024-09-10T08:34:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 msgr2=0x7f21c413e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c4d0 tx=0x7f21b400c990 comp rx=0 tx=0).stop 2024-09-10T08:34:44.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 shutdown_connections 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c4148260 0x7f21c40b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c4147e80 0x7f21c40b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 --2- 172.21.15.52:0/3712341238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c4071680 0x7f21c413e010 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 >> 172.21.15.52:0/3712341238 conn(0x7f21c40ccec0 msgr2=0x7f21c40cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 shutdown_connections 2024-09-10T08:34:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.732+0000 7f21ca800640 1 -- 172.21.15.52:0/3712341238 wait complete. 2024-09-10T08:34:44.749 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-10T08:34:43.543122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":286192,"kb_used_data":11688,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754688528,"statfs":{"total":773094113280,"available":772801052672,"internally_reserved":0,"allocated":11968512,"data_stored":5856836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.130078"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453793+0000","last_change":"2024-09-10T08:34:35.444402+0000","last_active":"2024-09-10T08:34:36.453793+0000","last_peered":"2024-09-10T08:34:36.453793+0000","last_clean":"2024-09-10T08:34:36.453793+0000","last_became_active":"2024-09-10T08:34:35.444143+0000","last_became_peered":"2024-09-10T08:34:35.444143+0000","last_unstale":"2024-09-10T08:34:36.453793+0000","last_undegraded":"2024-09-10T08:34:36.453793+0000","last_fullsized":"2024-09-10T08:34:36.453793+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:34.323465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453844+0000","last_change":"2024-09-10T08:34:35.435096+0000","last_active":"2024-09-10T08:34:36.453844+0000","last_peered":"2024-09-10T08:34:36.453844+0000","last_clean":"2024-09-10T08:34:36.453844+0000","last_became_active":"2024-09-10T08:34:35.434564+0000","last_became_peered":"2024-09-10T08:34:35.434564+0000","last_unstale":"2024-09-10T08:34:36.453844+0000","last_undegraded":"2024-09-10T08:34:36.453844+0000","last_fullsized":"2024-09-10T08:34:36.453844+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:42.076356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437285+0000","last_change":"2024-09-10T08:34:35.434982+0000","last_active":"2024-09-10T08:34:36.437285+0000","last_peered":"2024-09-10T08:34:36.437285+0000","last_clean":"2024-09-10T08:34:36.437285+0000","last_became_active":"2024-09-10T08:34:35.434663+0000","last_became_peered":"2024-09-10T08:34:35.434663+0000","last_unstale":"2024-09-10T08:34:36.437285+0000","last_undegraded":"2024-09-10T08:34:36.437285+0000","last_fullsized":"2024-09-10T08:34:36.437285+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:39.446256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453661+0000","last_change":"2024-09-10T08:34:35.428623+0000","last_active":"2024-09-10T08:34:36.453661+0000","last_peered":"2024-09-10T08:34:36.453661+0000","last_clean":"2024-09-10T08:34:36.453661+0000","last_became_active":"2024-09-10T08:34:35.428305+0000","last_became_peered":"2024-09-10T08:34:35.428305+0000","last_unstale":"2024-09-10T08:34:36.453661+0000","last_undegraded":"2024-09-10T08:34:36.453661+0000","last_fullsized":"2024-09-10T08:34:36.453661+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:52:39.446256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452680+0000","last_change":"2024-09-10T08:34:35.443327+0000","last_active":"2024-09-10T08:34:36.452680+0000","last_peered":"2024-09-10T08:34:36.452680+0000","last_clean":"2024-09-10T08:34:36.452680+0000","last_became_active":"2024-09-10T08:34:35.443004+0000","last_became_peered":"2024-09-10T08:34:35.443004+0000","last_unstale":"2024-09-10T08:34:36.452680+0000","last_undegraded":"2024-09-10T08:34:36.452680+0000","last_fullsized":"2024-09-10T08:34:36.452680+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:10:50.663725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452735+0000","last_change":"2024-09-10T08:34:35.437916+0000","last_active":"2024-09-10T08:34:36.452735+0000","last_peered":"2024-09-10T08:34:36.452735+0000","last_clean":"2024-09-10T08:34:36.452735+0000","last_became_active":"2024-09-10T08:34:35.437521+0000","last_became_peered":"2024-09-10T08:34:35.437521+0000","last_unstale":"2024-09-10T08:34:36.452735+0000","last_undegraded":"2024-09-10T08:34:36.452735+0000","last_fullsized":"2024-09-10T08:34:36.452735+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:55:12.635299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452535+0000","last_change":"2024-09-10T08:34:35.442238+0000","last_active":"2024-09-10T08:34:36.452535+0000","last_peered":"2024-09-10T08:34:36.452535+0000","last_clean":"2024-09-10T08:34:36.452535+0000","last_became_active":"2024-09-10T08:34:35.439920+0000","last_became_peered":"2024-09-10T08:34:35.439920+0000","last_unstale":"2024-09-10T08:34:36.452535+0000","last_undegraded":"2024-09-10T08:34:36.452535+0000","last_fullsized":"2024-09-10T08:34:36.452535+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:58.680664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437163+0000","last_change":"2024-09-10T08:34:35.427968+0000","last_active":"2024-09-10T08:34:36.437163+0000","last_peered":"2024-09-10T08:34:36.437163+0000","last_clean":"2024-09-10T08:34:36.437163+0000","last_became_active":"2024-09-10T08:34:35.426089+0000","last_became_peered":"2024-09-10T08:34:35.426089+0000","last_unstale":"2024-09-10T08:34:36.437163+0000","last_undegraded":"2024-09-10T08:34:36.437163+0000","last_fullsized":"2024-09-10T08:34:36.437163+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:53.946763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453160+0000","last_change":"2024-09-10T08:34:35.436125+0000","last_active":"2024-09-10T08:34:36.453160+0000","last_peered":"2024-09-10T08:34:36.453160+0000","last_clean":"2024-09-10T08:34:36.453160+0000","last_became_active":"2024-09-10T08:34:35.435371+0000","last_became_peered":"2024-09-10T08:34:35.435371+0000","last_unstale":"2024-09-10T08:34:36.453160+0000","last_undegraded":"2024-09-10T08:34:36.453160+0000","last_fullsized":"2024-09-10T08:34:36.453160+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:58.838944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451856+0000","last_change":"2024-09-10T08:34:35.436608+0000","last_active":"2024-09-10T08:34:36.451856+0000","last_peered":"2024-09-10T08:34:36.451856+0000","last_clean":"2024-09-10T08:34:36.451856+0000","last_became_active":"2024-09-10T08:34:35.436319+0000","last_became_peered":"2024-09-10T08:34:35.436319+0000","last_unstale":"2024-09-10T08:34:36.451856+0000","last_undegraded":"2024-09-10T08:34:36.451856+0000","last_fullsized":"2024-09-10T08:34:36.451856+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:07.413975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452807+0000","last_change":"2024-09-10T08:34:35.438644+0000","last_active":"2024-09-10T08:34:36.452807+0000","last_peered":"2024-09-10T08:34:36.452807+0000","last_clean":"2024-09-10T08:34:36.452807+0000","last_became_active":"2024-09-10T08:34:35.438355+0000","last_became_peered":"2024-09-10T08:34:35.438355+0000","last_unstale":"2024-09-10T08:34:36.452807+0000","last_undegraded":"2024-09-10T08:34:36.452807+0000","last_fullsized":"2024-09-10T08:34:36.452807+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:10.367728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451997+0000","last_change":"2024-09-10T08:34:35.429240+0000","last_active":"2024-09-10T08:34:36.451997+0000","last_peered":"2024-09-10T08:34:36.451997+0000","last_clean":"2024-09-10T08:34:36.451997+0000","last_became_active":"2024-09-10T08:34:35.428920+0000","last_became_peered":"2024-09-10T08:34:35.428920+0000","last_unstale":"2024-09-10T08:34:36.451997+0000","last_undegraded":"2024-09-10T08:34:36.451997+0000","last_fullsized":"2024-09-10T08:34:36.451997+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:07.413975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452710+0000","last_change":"2024-09-10T08:34:35.449280+0000","last_active":"2024-09-10T08:34:36.452710+0000","last_peered":"2024-09-10T08:34:36.452710+0000","last_clean":"2024-09-10T08:34:36.452710+0000","last_became_active":"2024-09-10T08:34:35.448412+0000","last_became_peered":"2024-09-10T08:34:35.448412+0000","last_unstale":"2024-09-10T08:34:36.452710+0000","last_undegraded":"2024-09-10T08:34:36.452710+0000","last_fullsized":"2024-09-10T08:34:36.452710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:37.032745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452745+0000","last_change":"2024-09-10T08:34:35.441427+0000","last_active":"2024-09-10T08:34:36.452745+0000","last_peered":"2024-09-10T08:34:36.452745+0000","last_clean":"2024-09-10T08:34:36.452745+0000","last_became_active":"2024-09-10T08:34:35.441139+0000","last_became_peered":"2024-09-10T08:34:35.441139+0000","last_unstale":"2024-09-10T08:34:36.452745+0000","last_undegraded":"2024-09-10T08:34:36.452745+0000","last_fullsized":"2024-09-10T08:34:36.452745+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:53.412401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453072+0000","last_change":"2024-09-10T08:34:35.430092+0000","last_active":"2024-09-10T08:34:36.453072+0000","last_peered":"2024-09-10T08:34:36.453072+0000","last_clean":"2024-09-10T08:34:36.453072+0000","last_became_active":"2024-09-10T08:34:35.429810+0000","last_became_peered":"2024-09-10T08:34:35.429810+0000","last_unstale":"2024-09-10T08:34:36.453072+0000","last_undegraded":"2024-09-10T08:34:36.453072+0000","last_fullsized":"2024-09-10T08:34:36.453072+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:21.945456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452422+0000","last_change":"2024-09-10T08:34:35.450889+0000","last_active":"2024-09-10T08:34:36.452422+0000","last_peered":"2024-09-10T08:34:36.452422+0000","last_clean":"2024-09-10T08:34:36.452422+0000","last_became_active":"2024-09-10T08:34:35.450512+0000","last_became_peered":"2024-09-10T08:34:35.450512+0000","last_unstale":"2024-09-10T08:34:36.452422+0000","last_undegraded":"2024-09-10T08:34:36.452422+0000","last_fullsized":"2024-09-10T08:34:36.452422+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:45.362174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436806+0000","last_change":"2024-09-10T08:34:35.443743+0000","last_active":"2024-09-10T08:34:36.436806+0000","last_peered":"2024-09-10T08:34:36.436806+0000","last_clean":"2024-09-10T08:34:36.436806+0000","last_became_active":"2024-09-10T08:34:35.443367+0000","last_became_peered":"2024-09-10T08:34:35.443367+0000","last_unstale":"2024-09-10T08:34:36.436806+0000","last_undegraded":"2024-09-10T08:34:36.436806+0000","last_fullsized":"2024-09-10T08:34:36.436806+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:46.181739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453808+0000","last_change":"2024-09-10T08:34:35.427597+0000","last_active":"2024-09-10T08:34:36.453808+0000","last_peered":"2024-09-10T08:34:36.453808+0000","last_clean":"2024-09-10T08:34:36.453808+0000","last_became_active":"2024-09-10T08:34:35.427213+0000","last_became_peered":"2024-09-10T08:34:35.427213+0000","last_unstale":"2024-09-10T08:34:36.453808+0000","last_undegraded":"2024-09-10T08:34:36.453808+0000","last_fullsized":"2024-09-10T08:34:36.453808+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:54.679816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438213+0000","last_change":"2024-09-10T08:34:35.433604+0000","last_active":"2024-09-10T08:34:36.438213+0000","last_peered":"2024-09-10T08:34:36.438213+0000","last_clean":"2024-09-10T08:34:36.438213+0000","last_became_active":"2024-09-10T08:34:35.433332+0000","last_became_peered":"2024-09-10T08:34:35.433332+0000","last_unstale":"2024-09-10T08:34:36.438213+0000","last_undegraded":"2024-09-10T08:34:36.438213+0000","last_fullsized":"2024-09-10T08:34:36.438213+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:08.004100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452015+0000","last_change":"2024-09-10T08:34:35.444907+0000","last_active":"2024-09-10T08:34:36.452015+0000","last_peered":"2024-09-10T08:34:36.452015+0000","last_clean":"2024-09-10T08:34:36.452015+0000","last_became_active":"2024-09-10T08:34:35.444415+0000","last_became_peered":"2024-09-10T08:34:35.444415+0000","last_unstale":"2024-09-10T08:34:36.452015+0000","last_undegraded":"2024-09-10T08:34:36.452015+0000","last_fullsized":"2024-09-10T08:34:36.452015+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:21.203699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438027+0000","last_change":"2024-09-10T08:34:35.433768+0000","last_active":"2024-09-10T08:34:36.438027+0000","last_peered":"2024-09-10T08:34:36.438027+0000","last_clean":"2024-09-10T08:34:36.438027+0000","last_became_active":"2024-09-10T08:34:35.433266+0000","last_became_peered":"2024-09-10T08:34:35.433266+0000","last_unstale":"2024-09-10T08:34:36.438027+0000","last_undegraded":"2024-09-10T08:34:36.438027+0000","last_fullsized":"2024-09-10T08:34:36.438027+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:34.323465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436879+0000","last_change":"2024-09-10T08:34:35.452461+0000","last_active":"2024-09-10T08:34:36.436879+0000","last_peered":"2024-09-10T08:34:36.436879+0000","last_clean":"2024-09-10T08:34:36.436879+0000","last_became_active":"2024-09-10T08:34:35.452154+0000","last_became_peered":"2024-09-10T08:34:35.452154+0000","last_unstale":"2024-09-10T08:34:36.436879+0000","last_undegraded":"2024-09-10T08:34:36.436879+0000","last_fullsized":"2024-09-10T08:34:36.436879+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:14.033021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453260+0000","last_change":"2024-09-10T08:34:35.440378+0000","last_active":"2024-09-10T08:34:36.453260+0000","last_peered":"2024-09-10T08:34:36.453260+0000","last_clean":"2024-09-10T08:34:36.453260+0000","last_became_active":"2024-09-10T08:34:35.440013+0000","last_became_peered":"2024-09-10T08:34:35.440013+0000","last_unstale":"2024-09-10T08:34:36.453260+0000","last_undegraded":"2024-09-10T08:34:36.453260+0000","last_fullsized":"2024-09-10T08:34:36.453260+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:51.520032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431682+0000","last_change":"2024-09-10T08:34:35.432162+0000","last_active":"2024-09-10T08:34:36.431682+0000","last_peered":"2024-09-10T08:34:36.431682+0000","last_clean":"2024-09-10T08:34:36.431682+0000","last_became_active":"2024-09-10T08:34:35.431540+0000","last_became_peered":"2024-09-10T08:34:35.431540+0000","last_unstale":"2024-09-10T08:34:36.431682+0000","last_undegraded":"2024-09-10T08:34:36.431682+0000","last_fullsized":"2024-09-10T08:34:36.431682+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:42.076356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451858+0000","last_change":"2024-09-10T08:34:35.441222+0000","last_active":"2024-09-10T08:34:36.451858+0000","last_peered":"2024-09-10T08:34:36.451858+0000","last_clean":"2024-09-10T08:34:36.451858+0000","last_became_active":"2024-09-10T08:34:35.440925+0000","last_became_peered":"2024-09-10T08:34:35.440925+0000","last_unstale":"2024-09-10T08:34:36.451858+0000","last_undegraded":"2024-09-10T08:34:36.451858+0000","last_fullsized":"2024-09-10T08:34:36.451858+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:21.203699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453074+0000","last_change":"2024-09-10T08:34:35.449274+0000","last_active":"2024-09-10T08:34:36.453074+0000","last_peered":"2024-09-10T08:34:36.453074+0000","last_clean":"2024-09-10T08:34:36.453074+0000","last_became_active":"2024-09-10T08:34:35.448825+0000","last_became_peered":"2024-09-10T08:34:35.448825+0000","last_unstale":"2024-09-10T08:34:36.453074+0000","last_undegraded":"2024-09-10T08:34:36.453074+0000","last_fullsized":"2024-09-10T08:34:36.453074+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:04.011946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.432096+0000","last_change":"2024-09-10T08:34:35.441955+0000","last_active":"2024-09-10T08:34:36.432096+0000","last_peered":"2024-09-10T08:34:36.432096+0000","last_clean":"2024-09-10T08:34:36.432096+0000","last_became_active":"2024-09-10T08:34:35.441386+0000","last_became_peered":"2024-09-10T08:34:35.441386+0000","last_unstale":"2024-09-10T08:34:36.432096+0000","last_undegraded":"2024-09-10T08:34:36.432096+0000","last_fullsized":"2024-09-10T08:34:36.432096+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:08.900245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431825+0000","last_change":"2024-09-10T08:34:35.428848+0000","last_active":"2024-09-10T08:34:36.431825+0000","last_peered":"2024-09-10T08:34:36.431825+0000","last_clean":"2024-09-10T08:34:36.431825+0000","last_became_active":"2024-09-10T08:34:35.424846+0000","last_became_peered":"2024-09-10T08:34:35.424846+0000","last_unstale":"2024-09-10T08:34:36.431825+0000","last_undegraded":"2024-09-10T08:34:36.431825+0000","last_fullsized":"2024-09-10T08:34:36.431825+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:24.289097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452869+0000","last_change":"2024-09-10T08:34:35.443189+0000","last_active":"2024-09-10T08:34:36.452869+0000","last_peered":"2024-09-10T08:34:36.452869+0000","last_clean":"2024-09-10T08:34:36.452869+0000","last_became_active":"2024-09-10T08:34:35.442928+0000","last_became_peered":"2024-09-10T08:34:35.442928+0000","last_unstale":"2024-09-10T08:34:36.452869+0000","last_undegraded":"2024-09-10T08:34:36.452869+0000","last_fullsized":"2024-09-10T08:34:36.452869+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:59.714965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452591+0000","last_change":"2024-09-10T08:34:35.448553+0000","last_active":"2024-09-10T08:34:36.452591+0000","last_peered":"2024-09-10T08:34:36.452591+0000","last_clean":"2024-09-10T08:34:36.452591+0000","last_became_active":"2024-09-10T08:34:35.448218+0000","last_became_peered":"2024-09-10T08:34:35.448218+0000","last_unstale":"2024-09-10T08:34:36.452591+0000","last_undegraded":"2024-09-10T08:34:36.452591+0000","last_fullsized":"2024-09-10T08:34:36.452591+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:35.135718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437033+0000","last_change":"2024-09-10T08:34:35.432906+0000","last_active":"2024-09-10T08:34:36.437033+0000","last_peered":"2024-09-10T08:34:36.437033+0000","last_clean":"2024-09-10T08:34:36.437033+0000","last_became_active":"2024-09-10T08:34:35.432618+0000","last_became_peered":"2024-09-10T08:34:35.432618+0000","last_unstale":"2024-09-10T08:34:36.437033+0000","last_undegraded":"2024-09-10T08:34:36.437033+0000","last_fullsized":"2024-09-10T08:34:36.437033+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:21.945456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452517+0000","last_change":"2024-09-10T08:34:35.440563+0000","last_active":"2024-09-10T08:34:36.452517+0000","last_peered":"2024-09-10T08:34:36.452517+0000","last_clean":"2024-09-10T08:34:36.452517+0000","last_became_active":"2024-09-10T08:34:35.440301+0000","last_became_peered":"2024-09-10T08:34:35.440301+0000","last_unstale":"2024-09-10T08:34:36.452517+0000","last_undegraded":"2024-09-10T08:34:36.452517+0000","last_fullsized":"2024-09-10T08:34:36.452517+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:01.036583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437098+0000","last_change":"2024-09-10T08:34:35.442470+0000","last_active":"2024-09-10T08:34:36.437098+0000","last_peered":"2024-09-10T08:34:36.437098+0000","last_clean":"2024-09-10T08:34:36.437098+0000","last_became_active":"2024-09-10T08:34:35.442205+0000","last_became_peered":"2024-09-10T08:34:35.442205+0000","last_unstale":"2024-09-10T08:34:36.437098+0000","last_undegraded":"2024-09-10T08:34:36.437098+0000","last_fullsized":"2024-09-10T08:34:36.437098+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:47.215931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"108'4","reported_seq":18,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453266+0000","last_change":"2024-09-10T08:34:34.438667+0000","last_active":"2024-09-10T08:34:36.453266+0000","last_peered":"2024-09-10T08:34:36.453266+0000","last_clean":"2024-09-10T08:34:36.453266+0000","last_became_active":"2024-09-10T08:34:34.437256+0000","last_became_peered":"2024-09-10T08:34:34.437256+0000","last_unstale":"2024-09-10T08:34:36.453266+0000","last_undegraded":"2024-09-10T08:34:36.453266+0000","last_fullsized":"2024-09-10T08:34:36.453266+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:37.371058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453296+0000","last_change":"2024-09-10T08:34:35.448595+0000","last_active":"2024-09-10T08:34:36.453296+0000","last_peered":"2024-09-10T08:34:36.453296+0000","last_clean":"2024-09-10T08:34:36.453296+0000","last_became_active":"2024-09-10T08:34:35.448265+0000","last_became_peered":"2024-09-10T08:34:35.448265+0000","last_unstale":"2024-09-10T08:34:36.453296+0000","last_undegraded":"2024-09-10T08:34:36.453296+0000","last_fullsized":"2024-09-10T08:34:36.453296+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:19.165396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452969+0000","last_change":"2024-09-10T08:34:34.435974+0000","last_active":"2024-09-10T08:34:36.452969+0000","last_peered":"2024-09-10T08:34:36.452969+0000","last_clean":"2024-09-10T08:34:36.452969+0000","last_became_active":"2024-09-10T08:34:34.435612+0000","last_became_peered":"2024-09-10T08:34:34.435612+0000","last_unstale":"2024-09-10T08:34:36.452969+0000","last_undegraded":"2024-09-10T08:34:36.452969+0000","last_fullsized":"2024-09-10T08:34:36.452969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:30:31.734559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453644+0000","last_change":"2024-09-10T08:34:35.431072+0000","last_active":"2024-09-10T08:34:36.453644+0000","last_peered":"2024-09-10T08:34:36.453644+0000","last_clean":"2024-09-10T08:34:36.453644+0000","last_became_active":"2024-09-10T08:34:35.430574+0000","last_became_peered":"2024-09-10T08:34:35.430574+0000","last_unstale":"2024-09-10T08:34:36.453644+0000","last_undegraded":"2024-09-10T08:34:36.453644+0000","last_fullsized":"2024-09-10T08:34:36.453644+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:39:53.946763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437392+0000","last_change":"2024-09-10T08:34:34.432133+0000","last_active":"2024-09-10T08:34:36.437392+0000","last_peered":"2024-09-10T08:34:36.437392+0000","last_clean":"2024-09-10T08:34:36.437392+0000","last_became_active":"2024-09-10T08:34:34.430805+0000","last_became_peered":"2024-09-10T08:34:34.430805+0000","last_unstale":"2024-09-10T08:34:36.437392+0000","last_undegraded":"2024-09-10T08:34:36.437392+0000","last_fullsized":"2024-09-10T08:34:36.437392+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:00.608831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452481+0000","last_change":"2024-09-10T08:34:35.444153+0000","last_active":"2024-09-10T08:34:36.452481+0000","last_peered":"2024-09-10T08:34:36.452481+0000","last_clean":"2024-09-10T08:34:36.452481+0000","last_became_active":"2024-09-10T08:34:35.443880+0000","last_became_peered":"2024-09-10T08:34:35.443880+0000","last_unstale":"2024-09-10T08:34:36.452481+0000","last_undegraded":"2024-09-10T08:34:36.452481+0000","last_fullsized":"2024-09-10T08:34:36.452481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:25.171491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453747+0000","last_change":"2024-09-10T08:34:34.431738+0000","last_active":"2024-09-10T08:34:36.453747+0000","last_peered":"2024-09-10T08:34:36.453747+0000","last_clean":"2024-09-10T08:34:36.453747+0000","last_became_active":"2024-09-10T08:34:34.431422+0000","last_became_peered":"2024-09-10T08:34:34.431422+0000","last_unstale":"2024-09-10T08:34:36.453747+0000","last_undegraded":"2024-09-10T08:34:36.453747+0000","last_fullsized":"2024-09-10T08:34:36.453747+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451861+0000","last_change":"2024-09-10T08:34:35.443465+0000","last_active":"2024-09-10T08:34:36.451861+0000","last_peered":"2024-09-10T08:34:36.451861+0000","last_clean":"2024-09-10T08:34:36.451861+0000","last_became_active":"2024-09-10T08:34:35.443032+0000","last_became_peered":"2024-09-10T08:34:35.443032+0000","last_unstale":"2024-09-10T08:34:36.451861+0000","last_undegraded":"2024-09-10T08:34:36.451861+0000","last_fullsized":"2024-09-10T08:34:36.451861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:25.171491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453224+0000","last_change":"2024-09-10T08:34:34.434494+0000","last_active":"2024-09-10T08:34:36.453224+0000","last_peered":"2024-09-10T08:34:36.453224+0000","last_clean":"2024-09-10T08:34:36.453224+0000","last_became_active":"2024-09-10T08:34:34.434024+0000","last_became_peered":"2024-09-10T08:34:34.434024+0000","last_unstale":"2024-09-10T08:34:36.453224+0000","last_undegraded":"2024-09-10T08:34:36.453224+0000","last_fullsized":"2024-09-10T08:34:36.453224+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:18.010285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452843+0000","last_change":"2024-09-10T08:34:35.442580+0000","last_active":"2024-09-10T08:34:36.452843+0000","last_peered":"2024-09-10T08:34:36.452843+0000","last_clean":"2024-09-10T08:34:36.452843+0000","last_became_active":"2024-09-10T08:34:35.441981+0000","last_became_peered":"2024-09-10T08:34:35.441981+0000","last_unstale":"2024-09-10T08:34:36.452843+0000","last_undegraded":"2024-09-10T08:34:36.452843+0000","last_fullsized":"2024-09-10T08:34:36.452843+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:05.857797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436995+0000","last_change":"2024-09-10T08:34:34.438384+0000","last_active":"2024-09-10T08:34:36.436995+0000","last_peered":"2024-09-10T08:34:36.436995+0000","last_clean":"2024-09-10T08:34:36.436995+0000","last_became_active":"2024-09-10T08:34:34.438128+0000","last_became_peered":"2024-09-10T08:34:34.438128+0000","last_unstale":"2024-09-10T08:34:36.436995+0000","last_undegraded":"2024-09-10T08:34:36.436995+0000","last_fullsized":"2024-09-10T08:34:36.436995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:53:31.191838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452373+0000","last_change":"2024-09-10T08:34:35.444336+0000","last_active":"2024-09-10T08:34:36.452373+0000","last_peered":"2024-09-10T08:34:36.452373+0000","last_clean":"2024-09-10T08:34:36.452373+0000","last_became_active":"2024-09-10T08:34:35.444068+0000","last_became_peered":"2024-09-10T08:34:35.444068+0000","last_unstale":"2024-09-10T08:34:36.452373+0000","last_undegraded":"2024-09-10T08:34:36.452373+0000","last_fullsized":"2024-09-10T08:34:36.452373+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:17.206098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452634+0000","last_change":"2024-09-10T08:34:34.433790+0000","last_active":"2024-09-10T08:34:36.452634+0000","last_peered":"2024-09-10T08:34:36.452634+0000","last_clean":"2024-09-10T08:34:36.452634+0000","last_became_active":"2024-09-10T08:34:34.433508+0000","last_became_peered":"2024-09-10T08:34:34.433508+0000","last_unstale":"2024-09-10T08:34:36.452634+0000","last_undegraded":"2024-09-10T08:34:36.452634+0000","last_fullsized":"2024-09-10T08:34:36.452634+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:52.188675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451616+0000","last_change":"2024-09-10T08:34:35.439710+0000","last_active":"2024-09-10T08:34:36.451616+0000","last_peered":"2024-09-10T08:34:36.451616+0000","last_clean":"2024-09-10T08:34:36.451616+0000","last_became_active":"2024-09-10T08:34:35.439409+0000","last_became_peered":"2024-09-10T08:34:35.439409+0000","last_unstale":"2024-09-10T08:34:36.451616+0000","last_undegraded":"2024-09-10T08:34:36.451616+0000","last_fullsized":"2024-09-10T08:34:36.451616+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:19.013813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437607+0000","last_change":"2024-09-10T08:34:34.436720+0000","last_active":"2024-09-10T08:34:36.437607+0000","last_peered":"2024-09-10T08:34:36.437607+0000","last_clean":"2024-09-10T08:34:36.437607+0000","last_became_active":"2024-09-10T08:34:34.436399+0000","last_became_peered":"2024-09-10T08:34:34.436399+0000","last_unstale":"2024-09-10T08:34:36.437607+0000","last_undegraded":"2024-09-10T08:34:36.437607+0000","last_fullsized":"2024-09-10T08:34:36.437607+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:09.115469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453926+0000","last_change":"2024-09-10T08:34:35.448132+0000","last_active":"2024-09-10T08:34:36.453926+0000","last_peered":"2024-09-10T08:34:36.453926+0000","last_clean":"2024-09-10T08:34:36.453926+0000","last_became_active":"2024-09-10T08:34:35.447870+0000","last_became_peered":"2024-09-10T08:34:35.447870+0000","last_unstale":"2024-09-10T08:34:36.453926+0000","last_undegraded":"2024-09-10T08:34:36.453926+0000","last_fullsized":"2024-09-10T08:34:36.453926+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:59.635745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438246+0000","last_change":"2024-09-10T08:34:34.423542+0000","last_active":"2024-09-10T08:34:36.438246+0000","last_peered":"2024-09-10T08:34:36.438246+0000","last_clean":"2024-09-10T08:34:36.438246+0000","last_became_active":"2024-09-10T08:34:34.423263+0000","last_became_peered":"2024-09-10T08:34:34.423263+0000","last_unstale":"2024-09-10T08:34:36.438246+0000","last_undegraded":"2024-09-10T08:34:36.438246+0000","last_fullsized":"2024-09-10T08:34:36.438246+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:05.046565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.432163+0000","last_change":"2024-09-10T08:34:35.436394+0000","last_active":"2024-09-10T08:34:36.432163+0000","last_peered":"2024-09-10T08:34:36.432163+0000","last_clean":"2024-09-10T08:34:36.432163+0000","last_became_active":"2024-09-10T08:34:35.436044+0000","last_became_peered":"2024-09-10T08:34:35.436044+0000","last_unstale":"2024-09-10T08:34:36.432163+0000","last_undegraded":"2024-09-10T08:34:36.432163+0000","last_fullsized":"2024-09-10T08:34:36.432163+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:52.489379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453953+0000","last_change":"2024-09-10T08:34:34.431042+0000","last_active":"2024-09-10T08:34:36.453953+0000","last_peered":"2024-09-10T08:34:36.453953+0000","last_clean":"2024-09-10T08:34:36.453953+0000","last_became_active":"2024-09-10T08:34:34.430781+0000","last_became_peered":"2024-09-10T08:34:34.430781+0000","last_unstale":"2024-09-10T08:34:36.453953+0000","last_undegraded":"2024-09-10T08:34:36.453953+0000","last_fullsized":"2024-09-10T08:34:36.453953+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:23.156216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452820+0000","last_change":"2024-09-10T08:34:35.437378+0000","last_active":"2024-09-10T08:34:36.452820+0000","last_peered":"2024-09-10T08:34:36.452820+0000","last_clean":"2024-09-10T08:34:36.452820+0000","last_became_active":"2024-09-10T08:34:35.435410+0000","last_became_peered":"2024-09-10T08:34:35.435410+0000","last_unstale":"2024-09-10T08:34:36.452820+0000","last_undegraded":"2024-09-10T08:34:36.452820+0000","last_fullsized":"2024-09-10T08:34:36.452820+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:18:40.891128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"108'3","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452994+0000","last_change":"2024-09-10T08:34:34.430619+0000","last_active":"2024-09-10T08:34:36.452994+0000","last_peered":"2024-09-10T08:34:36.452994+0000","last_clean":"2024-09-10T08:34:36.452994+0000","last_became_active":"2024-09-10T08:34:34.430054+0000","last_became_peered":"2024-09-10T08:34:34.430054+0000","last_unstale":"2024-09-10T08:34:36.452994+0000","last_undegraded":"2024-09-10T08:34:36.452994+0000","last_fullsized":"2024-09-10T08:34:36.452994+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:32.644577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.432092+0000","last_change":"2024-09-10T08:34:35.447437+0000","last_active":"2024-09-10T08:34:36.432092+0000","last_peered":"2024-09-10T08:34:36.432092+0000","last_clean":"2024-09-10T08:34:36.432092+0000","last_became_active":"2024-09-10T08:34:35.446787+0000","last_became_peered":"2024-09-10T08:34:35.446787+0000","last_unstale":"2024-09-10T08:34:36.432092+0000","last_undegraded":"2024-09-10T08:34:36.432092+0000","last_fullsized":"2024-09-10T08:34:36.432092+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:49.392823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"108'6","reported_seq":20,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452162+0000","last_change":"2024-09-10T08:34:34.433126+0000","last_active":"2024-09-10T08:34:36.452162+0000","last_peered":"2024-09-10T08:34:36.452162+0000","last_clean":"2024-09-10T08:34:36.452162+0000","last_became_active":"2024-09-10T08:34:34.431890+0000","last_became_peered":"2024-09-10T08:34:34.431890+0000","last_unstale":"2024-09-10T08:34:36.452162+0000","last_undegraded":"2024-09-10T08:34:36.452162+0000","last_fullsized":"2024-09-10T08:34:36.452162+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:16.202570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452923+0000","last_change":"2024-09-10T08:34:35.447892+0000","last_active":"2024-09-10T08:34:36.452923+0000","last_peered":"2024-09-10T08:34:36.452923+0000","last_clean":"2024-09-10T08:34:36.452923+0000","last_became_active":"2024-09-10T08:34:35.447558+0000","last_became_peered":"2024-09-10T08:34:35.447558+0000","last_unstale":"2024-09-10T08:34:36.452923+0000","last_undegraded":"2024-09-10T08:34:36.452923+0000","last_fullsized":"2024-09-10T08:34:36.452923+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:52:14.033021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436653+0000","last_change":"2024-09-10T08:34:34.437471+0000","last_active":"2024-09-10T08:34:36.436653+0000","last_peered":"2024-09-10T08:34:36.436653+0000","last_clean":"2024-09-10T08:34:36.436653+0000","last_became_active":"2024-09-10T08:34:34.436355+0000","last_became_peered":"2024-09-10T08:34:34.436355+0000","last_unstale":"2024-09-10T08:34:36.436653+0000","last_undegraded":"2024-09-10T08:34:36.436653+0000","last_fullsized":"2024-09-10T08:34:36.436653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.928594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438223+0000","last_change":"2024-09-10T08:34:35.428290+0000","last_active":"2024-09-10T08:34:36.438223+0000","last_peered":"2024-09-10T08:34:36.438223+0000","last_clean":"2024-09-10T08:34:36.438223+0000","last_became_active":"2024-09-10T08:34:35.427998+0000","last_became_peered":"2024-09-10T08:34:35.427998+0000","last_unstale":"2024-09-10T08:34:36.438223+0000","last_undegraded":"2024-09-10T08:34:36.438223+0000","last_fullsized":"2024-09-10T08:34:36.438223+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:42.076356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453018+0000","last_change":"2024-09-10T08:34:34.437445+0000","last_active":"2024-09-10T08:34:36.453018+0000","last_peered":"2024-09-10T08:34:36.453018+0000","last_clean":"2024-09-10T08:34:36.453018+0000","last_became_active":"2024-09-10T08:34:34.437178+0000","last_became_peered":"2024-09-10T08:34:34.437178+0000","last_unstale":"2024-09-10T08:34:36.453018+0000","last_undegraded":"2024-09-10T08:34:36.453018+0000","last_fullsized":"2024-09-10T08:34:36.453018+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:03.008418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452472+0000","last_change":"2024-09-10T08:34:35.445707+0000","last_active":"2024-09-10T08:34:36.452472+0000","last_peered":"2024-09-10T08:34:36.452472+0000","last_clean":"2024-09-10T08:34:36.452472+0000","last_became_active":"2024-09-10T08:34:35.444655+0000","last_became_peered":"2024-09-10T08:34:35.444655+0000","last_unstale":"2024-09-10T08:34:36.452472+0000","last_undegraded":"2024-09-10T08:34:36.452472+0000","last_fullsized":"2024-09-10T08:34:36.452472+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:40.537877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451841+0000","last_change":"2024-09-10T08:34:34.421209+0000","last_active":"2024-09-10T08:34:36.451841+0000","last_peered":"2024-09-10T08:34:36.451841+0000","last_clean":"2024-09-10T08:34:36.451841+0000","last_became_active":"2024-09-10T08:34:34.420857+0000","last_became_peered":"2024-09-10T08:34:34.420857+0000","last_unstale":"2024-09-10T08:34:36.451841+0000","last_undegraded":"2024-09-10T08:34:36.451841+0000","last_fullsized":"2024-09-10T08:34:36.451841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:11:50.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437067+0000","last_change":"2024-09-10T08:34:35.425731+0000","last_active":"2024-09-10T08:34:36.437067+0000","last_peered":"2024-09-10T08:34:36.437067+0000","last_clean":"2024-09-10T08:34:36.437067+0000","last_became_active":"2024-09-10T08:34:35.425428+0000","last_became_peered":"2024-09-10T08:34:35.425428+0000","last_unstale":"2024-09-10T08:34:36.437067+0000","last_undegraded":"2024-09-10T08:34:36.437067+0000","last_fullsized":"2024-09-10T08:34:36.437067+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:51.520032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"108'8","reported_seq":22,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452631+0000","last_change":"2024-09-10T08:34:34.434724+0000","last_active":"2024-09-10T08:34:36.452631+0000","last_peered":"2024-09-10T08:34:36.452631+0000","last_clean":"2024-09-10T08:34:36.452631+0000","last_became_active":"2024-09-10T08:34:34.431717+0000","last_became_peered":"2024-09-10T08:34:34.431717+0000","last_unstale":"2024-09-10T08:34:36.452631+0000","last_undegraded":"2024-09-10T08:34:36.452631+0000","last_fullsized":"2024-09-10T08:34:36.452631+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:24.167963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.432197+0000","last_change":"2024-09-10T08:34:35.433878+0000","last_active":"2024-09-10T08:34:36.432197+0000","last_peered":"2024-09-10T08:34:36.432197+0000","last_clean":"2024-09-10T08:34:36.432197+0000","last_became_active":"2024-09-10T08:34:35.432858+0000","last_became_peered":"2024-09-10T08:34:35.432858+0000","last_unstale":"2024-09-10T08:34:36.432197+0000","last_undegraded":"2024-09-10T08:34:36.432197+0000","last_fullsized":"2024-09-10T08:34:36.432197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:00:40.161629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452004+0000","last_change":"2024-09-10T08:34:34.433626+0000","last_active":"2024-09-10T08:34:36.452004+0000","last_peered":"2024-09-10T08:34:36.452004+0000","last_clean":"2024-09-10T08:34:36.452004+0000","last_became_active":"2024-09-10T08:34:34.431050+0000","last_became_peered":"2024-09-10T08:34:34.431050+0000","last_unstale":"2024-09-10T08:34:36.452004+0000","last_undegraded":"2024-09-10T08:34:36.452004+0000","last_fullsized":"2024-09-10T08:34:36.452004+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:17.419030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431919+0000","last_change":"2024-09-10T08:34:35.433160+0000","last_active":"2024-09-10T08:34:36.431919+0000","last_peered":"2024-09-10T08:34:36.431919+0000","last_clean":"2024-09-10T08:34:36.431919+0000","last_became_active":"2024-09-10T08:34:35.432813+0000","last_became_peered":"2024-09-10T08:34:35.432813+0000","last_unstale":"2024-09-10T08:34:36.431919+0000","last_undegraded":"2024-09-10T08:34:36.431919+0000","last_fullsized":"2024-09-10T08:34:36.431919+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:26.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453053+0000","last_change":"2024-09-10T08:34:34.435089+0000","last_active":"2024-09-10T08:34:36.453053+0000","last_peered":"2024-09-10T08:34:36.453053+0000","last_clean":"2024-09-10T08:34:36.453053+0000","last_became_active":"2024-09-10T08:34:34.434758+0000","last_became_peered":"2024-09-10T08:34:34.434758+0000","last_unstale":"2024-09-10T08:34:36.453053+0000","last_undegraded":"2024-09-10T08:34:36.453053+0000","last_fullsized":"2024-09-10T08:34:36.453053+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:40:11.406224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452162+0000","last_change":"2024-09-10T08:34:35.443600+0000","last_active":"2024-09-10T08:34:36.452162+0000","last_peered":"2024-09-10T08:34:36.452162+0000","last_clean":"2024-09-10T08:34:36.452162+0000","last_became_active":"2024-09-10T08:34:35.443083+0000","last_became_peered":"2024-09-10T08:34:35.443083+0000","last_unstale":"2024-09-10T08:34:36.452162+0000","last_undegraded":"2024-09-10T08:34:36.452162+0000","last_fullsized":"2024-09-10T08:34:36.452162+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:08.683317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436650+0000","last_change":"2024-09-10T08:34:34.432248+0000","last_active":"2024-09-10T08:34:36.436650+0000","last_peered":"2024-09-10T08:34:36.436650+0000","last_clean":"2024-09-10T08:34:36.436650+0000","last_became_active":"2024-09-10T08:34:34.431912+0000","last_became_peered":"2024-09-10T08:34:34.431912+0000","last_unstale":"2024-09-10T08:34:36.436650+0000","last_undegraded":"2024-09-10T08:34:36.436650+0000","last_fullsized":"2024-09-10T08:34:36.436650+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:34.255053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436624+0000","last_change":"2024-09-10T08:34:35.435254+0000","last_active":"2024-09-10T08:34:36.436624+0000","last_peered":"2024-09-10T08:34:36.436624+0000","last_clean":"2024-09-10T08:34:36.436624+0000","last_became_active":"2024-09-10T08:34:35.435000+0000","last_became_peered":"2024-09-10T08:34:35.435000+0000","last_unstale":"2024-09-10T08:34:36.436624+0000","last_undegraded":"2024-09-10T08:34:36.436624+0000","last_fullsized":"2024-09-10T08:34:36.436624+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:29.208286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.453412+0000","last_change":"2024-09-10T08:34:34.430005+0000","last_active":"2024-09-10T08:34:36.453412+0000","last_peered":"2024-09-10T08:34:36.453412+0000","last_clean":"2024-09-10T08:34:36.453412+0000","last_became_active":"2024-09-10T08:34:34.429669+0000","last_became_peered":"2024-09-10T08:34:34.429669+0000","last_unstale":"2024-09-10T08:34:36.453412+0000","last_undegraded":"2024-09-10T08:34:36.453412+0000","last_fullsized":"2024-09-10T08:34:36.453412+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.049469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436730+0000","last_change":"2024-09-10T08:34:35.428979+0000","last_active":"2024-09-10T08:34:36.436730+0000","last_peered":"2024-09-10T08:34:36.436730+0000","last_clean":"2024-09-10T08:34:36.436730+0000","last_became_active":"2024-09-10T08:34:35.428705+0000","last_became_peered":"2024-09-10T08:34:35.428705+0000","last_unstale":"2024-09-10T08:34:36.436730+0000","last_undegraded":"2024-09-10T08:34:36.436730+0000","last_fullsized":"2024-09-10T08:34:36.436730+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:08.670337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431712+0000","last_change":"2024-09-10T08:34:34.437024+0000","last_active":"2024-09-10T08:34:36.431712+0000","last_peered":"2024-09-10T08:34:36.431712+0000","last_clean":"2024-09-10T08:34:36.431712+0000","last_became_active":"2024-09-10T08:34:34.436737+0000","last_became_peered":"2024-09-10T08:34:34.436737+0000","last_unstale":"2024-09-10T08:34:36.431712+0000","last_undegraded":"2024-09-10T08:34:36.431712+0000","last_fullsized":"2024-09-10T08:34:36.431712+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:04.593842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452629+0000","last_change":"2024-09-10T08:34:35.445544+0000","last_active":"2024-09-10T08:34:36.452629+0000","last_peered":"2024-09-10T08:34:36.452629+0000","last_clean":"2024-09-10T08:34:36.452629+0000","last_became_active":"2024-09-10T08:34:35.445016+0000","last_became_peered":"2024-09-10T08:34:35.445016+0000","last_unstale":"2024-09-10T08:34:36.452629+0000","last_undegraded":"2024-09-10T08:34:36.452629+0000","last_fullsized":"2024-09-10T08:34:36.452629+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:37.925583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451544+0000","last_change":"2024-09-10T08:34:34.432017+0000","last_active":"2024-09-10T08:34:36.451544+0000","last_peered":"2024-09-10T08:34:36.451544+0000","last_clean":"2024-09-10T08:34:36.451544+0000","last_became_active":"2024-09-10T08:34:34.431711+0000","last_became_peered":"2024-09-10T08:34:34.431711+0000","last_unstale":"2024-09-10T08:34:36.451544+0000","last_undegraded":"2024-09-10T08:34:36.451544+0000","last_fullsized":"2024-09-10T08:34:36.451544+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:18.161868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431768+0000","last_change":"2024-09-10T08:34:35.440308+0000","last_active":"2024-09-10T08:34:36.431768+0000","last_peered":"2024-09-10T08:34:36.431768+0000","last_clean":"2024-09-10T08:34:36.431768+0000","last_became_active":"2024-09-10T08:34:35.440001+0000","last_became_peered":"2024-09-10T08:34:35.440001+0000","last_unstale":"2024-09-10T08:34:36.431768+0000","last_undegraded":"2024-09-10T08:34:36.431768+0000","last_fullsized":"2024-09-10T08:34:36.431768+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:59.635745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436398+0000","last_change":"2024-09-10T08:34:34.429461+0000","last_active":"2024-09-10T08:34:36.436398+0000","last_peered":"2024-09-10T08:34:36.436398+0000","last_clean":"2024-09-10T08:34:36.436398+0000","last_became_active":"2024-09-10T08:34:34.429128+0000","last_became_peered":"2024-09-10T08:34:34.429128+0000","last_unstale":"2024-09-10T08:34:36.436398+0000","last_undegraded":"2024-09-10T08:34:36.436398+0000","last_fullsized":"2024-09-10T08:34:36.436398+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:20.200171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437345+0000","last_change":"2024-09-10T08:34:35.434825+0000","last_active":"2024-09-10T08:34:36.437345+0000","last_peered":"2024-09-10T08:34:36.437345+0000","last_clean":"2024-09-10T08:34:36.437345+0000","last_became_active":"2024-09-10T08:34:35.430948+0000","last_became_peered":"2024-09-10T08:34:35.430948+0000","last_unstale":"2024-09-10T08:34:36.437345+0000","last_undegraded":"2024-09-10T08:34:36.437345+0000","last_fullsized":"2024-09-10T08:34:36.437345+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:16.603302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"108'2","reported_seq":16,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452161+0000","last_change":"2024-09-10T08:34:34.419784+0000","last_active":"2024-09-10T08:34:36.452161+0000","last_peered":"2024-09-10T08:34:36.452161+0000","last_clean":"2024-09-10T08:34:36.452161+0000","last_became_active":"2024-09-10T08:34:34.419506+0000","last_became_peered":"2024-09-10T08:34:34.419506+0000","last_unstale":"2024-09-10T08:34:36.452161+0000","last_undegraded":"2024-09-10T08:34:36.452161+0000","last_fullsized":"2024-09-10T08:34:36.452161+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:27:31.506788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436975+0000","last_change":"2024-09-10T08:34:35.433095+0000","last_active":"2024-09-10T08:34:36.436975+0000","last_peered":"2024-09-10T08:34:36.436975+0000","last_clean":"2024-09-10T08:34:36.436975+0000","last_became_active":"2024-09-10T08:34:35.431572+0000","last_became_peered":"2024-09-10T08:34:35.431572+0000","last_unstale":"2024-09-10T08:34:36.436975+0000","last_undegraded":"2024-09-10T08:34:36.436975+0000","last_fullsized":"2024-09-10T08:34:36.436975+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:02:39.472360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"109'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437455+0000","last_change":"2024-09-10T08:34:34.431957+0000","last_active":"2024-09-10T08:34:36.437455+0000","last_peered":"2024-09-10T08:34:36.437455+0000","last_clean":"2024-09-10T08:34:36.437455+0000","last_became_active":"2024-09-10T08:34:34.428639+0000","last_became_peered":"2024-09-10T08:34:34.428639+0000","last_unstale":"2024-09-10T08:34:36.437455+0000","last_undegraded":"2024-09-10T08:34:36.437455+0000","last_fullsized":"2024-09-10T08:34:36.437455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438142+0000","last_change":"2024-09-10T08:34:35.434699+0000","last_active":"2024-09-10T08:34:36.438142+0000","last_peered":"2024-09-10T08:34:36.438142+0000","last_clean":"2024-09-10T08:34:36.438142+0000","last_became_active":"2024-09-10T08:34:35.429016+0000","last_became_peered":"2024-09-10T08:34:35.429016+0000","last_unstale":"2024-09-10T08:34:36.438142+0000","last_undegraded":"2024-09-10T08:34:36.438142+0000","last_fullsized":"2024-09-10T08:34:36.438142+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:54.679816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437852+0000","last_change":"2024-09-10T08:34:34.427424+0000","last_active":"2024-09-10T08:34:36.437852+0000","last_peered":"2024-09-10T08:34:36.437852+0000","last_clean":"2024-09-10T08:34:36.437852+0000","last_became_active":"2024-09-10T08:34:34.426305+0000","last_became_peered":"2024-09-10T08:34:34.426305+0000","last_unstale":"2024-09-10T08:34:36.437852+0000","last_undegraded":"2024-09-10T08:34:36.437852+0000","last_fullsized":"2024-09-10T08:34:36.437852+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:18.049964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452963+0000","last_change":"2024-09-10T08:34:35.439559+0000","last_active":"2024-09-10T08:34:36.452963+0000","last_peered":"2024-09-10T08:34:36.452963+0000","last_clean":"2024-09-10T08:34:36.452963+0000","last_became_active":"2024-09-10T08:34:35.437751+0000","last_became_peered":"2024-09-10T08:34:35.437751+0000","last_unstale":"2024-09-10T08:34:36.452963+0000","last_undegraded":"2024-09-10T08:34:36.452963+0000","last_fullsized":"2024-09-10T08:34:36.452963+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:57.758129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431881+0000","last_change":"2024-09-10T08:34:34.423423+0000","last_active":"2024-09-10T08:34:36.431881+0000","last_peered":"2024-09-10T08:34:36.431881+0000","last_clean":"2024-09-10T08:34:36.431881+0000","last_became_active":"2024-09-10T08:34:34.419996+0000","last_became_peered":"2024-09-10T08:34:34.419996+0000","last_unstale":"2024-09-10T08:34:36.431881+0000","last_undegraded":"2024-09-10T08:34:36.431881+0000","last_fullsized":"2024-09-10T08:34:36.431881+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:00.033055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436802+0000","last_change":"2024-09-10T08:34:35.440388+0000","last_active":"2024-09-10T08:34:36.436802+0000","last_peered":"2024-09-10T08:34:36.436802+0000","last_clean":"2024-09-10T08:34:36.436802+0000","last_became_active":"2024-09-10T08:34:35.439549+0000","last_became_peered":"2024-09-10T08:34:35.439549+0000","last_unstale":"2024-09-10T08:34:36.436802+0000","last_undegraded":"2024-09-10T08:34:36.436802+0000","last_fullsized":"2024-09-10T08:34:36.436802+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:09.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438275+0000","last_change":"2024-09-10T08:34:34.433704+0000","last_active":"2024-09-10T08:34:36.438275+0000","last_peered":"2024-09-10T08:34:36.438275+0000","last_clean":"2024-09-10T08:34:36.438275+0000","last_became_active":"2024-09-10T08:34:34.433401+0000","last_became_peered":"2024-09-10T08:34:34.433401+0000","last_unstale":"2024-09-10T08:34:36.438275+0000","last_undegraded":"2024-09-10T08:34:36.438275+0000","last_fullsized":"2024-09-10T08:34:36.438275+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:18.325010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452955+0000","last_change":"2024-09-10T08:34:35.442301+0000","last_active":"2024-09-10T08:34:36.452955+0000","last_peered":"2024-09-10T08:34:36.452955+0000","last_clean":"2024-09-10T08:34:36.452955+0000","last_became_active":"2024-09-10T08:34:35.441782+0000","last_became_peered":"2024-09-10T08:34:35.441782+0000","last_unstale":"2024-09-10T08:34:36.452955+0000","last_undegraded":"2024-09-10T08:34:36.452955+0000","last_fullsized":"2024-09-10T08:34:36.452955+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:31.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.431812+0000","last_change":"2024-09-10T08:34:34.431145+0000","last_active":"2024-09-10T08:34:36.431812+0000","last_peered":"2024-09-10T08:34:36.431812+0000","last_clean":"2024-09-10T08:34:36.431812+0000","last_became_active":"2024-09-10T08:34:34.430713+0000","last_became_peered":"2024-09-10T08:34:34.430713+0000","last_unstale":"2024-09-10T08:34:36.431812+0000","last_undegraded":"2024-09-10T08:34:36.431812+0000","last_fullsized":"2024-09-10T08:34:36.431812+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:36.922055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.437587+0000","last_change":"2024-09-10T08:34:35.447833+0000","last_active":"2024-09-10T08:34:36.437587+0000","last_peered":"2024-09-10T08:34:36.437587+0000","last_clean":"2024-09-10T08:34:36.437587+0000","last_became_active":"2024-09-10T08:34:35.447138+0000","last_became_peered":"2024-09-10T08:34:35.447138+0000","last_unstale":"2024-09-10T08:34:36.437587+0000","last_undegraded":"2024-09-10T08:34:36.437587+0000","last_fullsized":"2024-09-10T08:34:36.437587+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:34.020654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.452441+0000","last_change":"2024-09-10T08:34:34.439809+0000","last_active":"2024-09-10T08:34:36.452441+0000","last_peered":"2024-09-10T08:34:36.452441+0000","last_clean":"2024-09-10T08:34:36.452441+0000","last_became_active":"2024-09-10T08:34:34.438918+0000","last_became_peered":"2024-09-10T08:34:34.438918+0000","last_unstale":"2024-09-10T08:34:36.452441+0000","last_undegraded":"2024-09-10T08:34:36.452441+0000","last_fullsized":"2024-09-10T08:34:36.452441+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:30:00.274366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451756+0000","last_change":"2024-09-10T08:34:35.431804+0000","last_active":"2024-09-10T08:34:36.451756+0000","last_peered":"2024-09-10T08:34:36.451756+0000","last_clean":"2024-09-10T08:34:36.451756+0000","last_became_active":"2024-09-10T08:34:35.431524+0000","last_became_peered":"2024-09-10T08:34:35.431524+0000","last_unstale":"2024-09-10T08:34:36.451756+0000","last_undegraded":"2024-09-10T08:34:36.451756+0000","last_fullsized":"2024-09-10T08:34:36.451756+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:00.052997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.436516+0000","last_change":"2024-09-10T08:34:34.428151+0000","last_active":"2024-09-10T08:34:36.436516+0000","last_peered":"2024-09-10T08:34:36.436516+0000","last_clean":"2024-09-10T08:34:36.436516+0000","last_became_active":"2024-09-10T08:34:34.427824+0000","last_became_peered":"2024-09-10T08:34:34.427824+0000","last_unstale":"2024-09-10T08:34:36.436516+0000","last_undegraded":"2024-09-10T08:34:36.436516+0000","last_fullsized":"2024-09-10T08:34:36.436516+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:07.679789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.438261+0000","last_change":"2024-09-10T08:34:35.432174+0000","last_active":"2024-09-10T08:34:36.438261+0000","last_peered":"2024-09-10T08:34:36.438261+0000","last_clean":"2024-09-10T08:34:36.438261+0000","last_became_active":"2024-09-10T08:34:35.431800+0000","last_became_peered":"2024-09-10T08:34:35.431800+0000","last_unstale":"2024-09-10T08:34:36.438261+0000","last_undegraded":"2024-09-10T08:34:36.438261+0000","last_fullsized":"2024-09-10T08:34:36.438261+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:34.402665+0000","last_clean_scrub_stamp":"2024-09-10T08:34:34.402665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:59.635745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"108'1","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451807+0000","last_change":"2024-09-10T08:34:34.431301+0000","last_active":"2024-09-10T08:34:36.451807+0000","last_peered":"2024-09-10T08:34:36.451807+0000","last_clean":"2024-09-10T08:34:36.451807+0000","last_became_active":"2024-09-10T08:34:34.430954+0000","last_became_peered":"2024-09-10T08:34:34.430954+0000","last_unstale":"2024-09-10T08:34:36.451807+0000","last_undegraded":"2024-09-10T08:34:36.451807+0000","last_fullsized":"2024-09-10T08:34:36.451807+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:34:33.399137+0000","last_clean_scrub_stamp":"2024-09-10T08:34:33.399137+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:13.312879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":324,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-09-10T08:34:36.451710+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:34:36.451710+0000","last_peered":"2024-09-10T08:34:36.451710+0000","last_clean":"2024-09-10T08:34:36.451710+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:34:36.451710+0000","last_undegraded":"2024-09-10T08:34:36.451710+0000","last_fullsized":"2024-09-10T08:34:36.451710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1343488,"data_stored":584492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36664,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335176,"statfs":{"total":96636764160,"available":96599220224,"internally_reserved":0,"allocated":1339392,"data_stored":583910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40824,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331016,"statfs":{"total":96636764160,"available":96594960384,"internally_reserved":0,"allocated":1343488,"data_stored":584492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1351680,"data_stored":584104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1343488,"data_stored":583980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":1953792,"data_stored":1176002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509518,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36656,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335184,"statfs":{"total":96636764160,"available":96599228416,"internally_reserved":0,"allocated":1339392,"data_stored":583910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":1953792,"data_stored":1175946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:34:44.754 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:34:44.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:34:44.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.953+0000 7f0116800640 1 Processor -- start 2024-09-10T08:34:44.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.953+0000 7f0116800640 1 -- start start 2024-09-10T08:34:44.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.954+0000 7f0116800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.954+0000 7f0116800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0110072240 0x7f01100726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.954+0000 7f0116800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011015cf80 con 0x7f0110070de0 2024-09-10T08:34:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.954+0000 7f0116800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0110072be0 con 0x7f0110072240 2024-09-10T08:34:44.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.954+0000 7f0116800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0110071b10 con 0x7f01100d0730 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0115400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0114a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0110072240 0x7f01100726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0115400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:52688/0 (socket says 172.21.15.52:52688) 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0115400640 1 -- 172.21.15.52:0/469062479 learned_addr learned my addr 172.21.15.52:0/469062479 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0114a00640 1 -- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 msgr2=0x7f011015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0114a00640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0114a00640 1 -- 172.21.15.52:0/469062479 >> v1:172.21.15.176:6789/0 conn(0x7f0110070de0 legacy=0x7f0110071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0114a00640 1 -- 172.21.15.52:0/469062479 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0110071df0 con 0x7f0110072240 2024-09-10T08:34:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.955+0000 7f0115400640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.956+0000 7f0114a00640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0110072240 0x7f01100726a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097a0 tx=0x7f00fc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c739b6a99f2ae657 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f010fe00640 1 -- 172.21.15.52:0/469062479 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc037070 con 0x7f0110072240 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f010fe00640 1 -- 172.21.15.52:0/469062479 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc032440 con 0x7f0110072240 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f010fe00640 1 -- 172.21.15.52:0/469062479 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc032810 con 0x7f0110072240 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 -- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0110072240 msgr2=0x7f01100726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0110072240 0x7f01100726a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097a0 tx=0x7f00fc02a180 comp rx=0 tx=0).stop 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 -- 172.21.15.52:0/469062479 shutdown_connections 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0110072240 0x7f01100726a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 --2- 172.21.15.52:0/469062479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01100d0730 0x7f011015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 -- 172.21.15.52:0/469062479 >> 172.21.15.52:0/469062479 conn(0x7f011006bc10 msgr2=0x7f011006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:44.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 -- 172.21.15.52:0/469062479 shutdown_connections 2024-09-10T08:34:44.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.957+0000 7f0116800640 1 -- 172.21.15.52:0/469062479 wait complete. 2024-09-10T08:34:44.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.959+0000 7f0116800640 1 Processor -- start 2024-09-10T08:34:44.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.959+0000 7f0116800640 1 -- start start 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0110070de0 0x7f011014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01100d0730 0x7f01101e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01100d0b10 con 0x7f0110072240 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01100b3670 con 0x7f01100d0730 2024-09-10T08:34:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0116800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01100b3b90 con 0x7f0110070de0 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0114a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0114a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50294/0 (socket says 172.21.15.52:50294) 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.960+0000 7f0114a00640 1 -- 172.21.15.52:0/2759857415 learned_addr learned my addr 172.21.15.52:0/2759857415 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0115400640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0110070de0 0x7f011014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0115e00640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01100d0730 0x7f01101e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 -- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0110070de0 msgr2=0x7f011014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0110070de0 0x7f011014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 -- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01100d0730 msgr2=0x7f01101e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01100d0730 0x7f01101e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 -- 172.21.15.52:0/2759857415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0110158690 con 0x7f0110072240 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.961+0000 7f0114a00640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f00fc035040 tx=0x7f00fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.962+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc037040 con 0x7f0110072240 2024-09-10T08:34:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.962+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc030500 con 0x7f0110072240 2024-09-10T08:34:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.962+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc030910 con 0x7f0110072240 2024-09-10T08:34:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.962+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01101e5650 con 0x7f0110072240 2024-09-10T08:34:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.962+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01101e5c10 con 0x7f0110072240 2024-09-10T08:34:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.963+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01100726a0 con 0x7f0110072240 2024-09-10T08:34:44.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.964+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00fc044020 con 0x7f0110072240 2024-09-10T08:34:44.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.965+0000 7f010d600640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 0x7f00f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:44.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.965+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f00fc0ab0b0 con 0x7f0110072240 2024-09-10T08:34:44.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.965+0000 7f0115400640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 0x7f00f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:44.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.966+0000 7f0115400640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 0x7f00f006e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0104006ca0 tx=0x7f0104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:44.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:44.969+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00fc0792e0 con 0x7f0110072240 2024-09-10T08:34:45.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.222+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f011015b340 con 0x7f0110072240 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.225+0000 7f010d600640 1 -- 172.21.15.52:0/2759857415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f00fc07d5e0 con 0x7f0110072240 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:34:45.225 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:34:45.226 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 msgr2=0x7f00f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 0x7f00f006e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0104006ca0 tx=0x7f0104008040 comp rx=0 tx=0).stop 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 msgr2=0x7f01101e4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f00fc035040 tx=0x7f00fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 shutdown_connections 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f00f006be30 0x7f00f006e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01100d0730 0x7f01101e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0110072240 0x7f01101e4f50 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 --2- 172.21.15.52:0/2759857415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0110070de0 0x7f011014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 >> 172.21.15.52:0/2759857415 conn(0x7f011006bc10 msgr2=0x7f01100b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.227+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 shutdown_connections 2024-09-10T08:34:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.228+0000 7f0116800640 1 -- 172.21.15.52:0/2759857415 wait complete. 2024-09-10T08:34:45.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:34:45.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.399+0000 7f0f59c00640 1 Processor -- start 2024-09-10T08:34:45.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.399+0000 7f0f59c00640 1 -- start start 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.400+0000 7f0f59c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f5415e990 0x7f0f540d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.400+0000 7f0f59c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540d4410 con 0x7f0f540b6910 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.400+0000 7f0f59c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540d3370 con 0x7f0f540cf030 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.400+0000 7f0f59c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0f540d3650 con 0x7f0f5415e990 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.400+0000 7f0f52a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f5415e990 0x7f0f540d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.401+0000 7f0f53400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f540b6910 0x7f0f540b79b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45486/0 (socket says 172.21.15.52:45486) 2024-09-10T08:34:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.401+0000 7f0f53400640 1 -- 172.21.15.52:0/418684658 learned_addr learned my addr 172.21.15.52:0/418684658 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.401+0000 7f0f52a00640 1 -- 172.21.15.52:0/418684658 >> v1:172.21.15.176:6789/0 conn(0x7f0f540cf030 legacy=0x7f0f540b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.401+0000 7f0f52a00640 1 -- 172.21.15.52:0/418684658 >> v1:172.21.15.52:6789/0 conn(0x7f0f540b6910 legacy=0x7f0f540b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.401+0000 7f0f52a00640 1 -- 172.21.15.52:0/418684658 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540d3930 con 0x7f0f5415e990 2024-09-10T08:34:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.402+0000 7f0f52a00640 1 --2- 172.21.15.52:0/418684658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5415e990 0x7f0f540d2a00 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc2ec99996e025b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.402+0000 7f0f51600640 1 -- 172.21.15.52:0/418684658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44037070 con 0x7f0f5415e990 2024-09-10T08:34:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.402+0000 7f0f51600640 1 -- 172.21.15.52:0/418684658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44032440 con 0x7f0f5415e990 2024-09-10T08:34:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.402+0000 7f0f51600640 1 -- 172.21.15.52:0/418684658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44032810 con 0x7f0f5415e990 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 -- 172.21.15.52:0/418684658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5415e990 msgr2=0x7f0f540d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 --2- 172.21.15.52:0/418684658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5415e990 0x7f0f540d2a00 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097a0 tx=0x7f0f4402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 -- 172.21.15.52:0/418684658 shutdown_connections 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 --2- 172.21.15.52:0/418684658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5415e990 0x7f0f540d2a00 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 -- 172.21.15.52:0/418684658 >> 172.21.15.52:0/418684658 conn(0x7f0f540d4780 msgr2=0x7f0f540d4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 -- 172.21.15.52:0/418684658 shutdown_connections 2024-09-10T08:34:45.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.403+0000 7f0f59c00640 1 -- 172.21.15.52:0/418684658 wait complete. 2024-09-10T08:34:45.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.405+0000 7f0f59c00640 1 Processor -- start 2024-09-10T08:34:45.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.405+0000 7f0f59c00640 1 -- start start 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.405+0000 7f0f59c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f540b6910 0x7f0f5415f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f59c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f59c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 0x7f0f540c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f59c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5415ed70 con 0x7f0f540cf030 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f59c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540d3ef0 con 0x7f0f5415e990 2024-09-10T08:34:45.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f59c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5415eef0 con 0x7f0f540b6910 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50298/0 (socket says 172.21.15.52:50298) 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 -- 172.21.15.52:0/800099513 learned_addr learned my addr 172.21.15.52:0/800099513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52a00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f540b6910 0x7f0f5415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f53400640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 0x7f0f540c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 -- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f540b6910 msgr2=0x7f0f5415f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f540b6910 0x7f0f5415f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 -- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 msgr2=0x7f0f540c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 0x7f0f540c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f52000640 1 -- 172.21.15.52:0/800099513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5415ff80 con 0x7f0f540cf030 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.406+0000 7f0f53400640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 0x7f0f540c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:45.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f52000640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c400 tx=0x7f0f4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400052d0 con 0x7f0f540cf030 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40005490 con 0x7f0f540cf030 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40007260 con 0x7f0f540cf030 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f54160260 con 0x7f0f540cf030 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.407+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f54160820 con 0x7f0f540cf030 2024-09-10T08:34:45.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.408+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f540d3060 con 0x7f0f540cf030 2024-09-10T08:34:45.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.409+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f40007400 con 0x7f0f540cf030 2024-09-10T08:34:45.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.410+0000 7f0f4aa00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:45.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.410+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4008a300 con 0x7f0f540cf030 2024-09-10T08:34:45.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.410+0000 7f0f52a00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:45.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.411+0000 7f0f52a00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0f44034000 tx=0x7f0f4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:45.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.415+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f40058650 con 0x7f0f540cf030 2024-09-10T08:34:45.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.639+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f5415d120 con 0x7f0f540cf030 2024-09-10T08:34:45.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.640+0000 7f0f4aa00640 1 -- 172.21.15.52:0/800099513 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5228 (secure 0 0 0) 0x7f0f4005c950 con 0x7f0f540cf030 2024-09-10T08:34:45.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:34:45.640 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":83,"btime":"2024-09-10T08:34:38:438541+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:37.863394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:34:45.640 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 83 2024-09-10T08:34:45.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 msgr2=0x7f0f3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 0x7f0f3406e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0f44034000 tx=0x7f0f4402e000 comp rx=0 tx=0).stop 2024-09-10T08:34:45.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 msgr2=0x7f0f54157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:45.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c400 tx=0x7f0f4000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 shutdown_connections 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f3406be30 0x7f0f3406e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f5415e990 0x7f0f540c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f540cf030 0x7f0f54157a20 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 --2- 172.21.15.52:0/800099513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f540b6910 0x7f0f5415f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 >> 172.21.15.52:0/800099513 conn(0x7f0f540d4780 msgr2=0x7f0f5415d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 shutdown_connections 2024-09-10T08:34:45.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:45.642+0000 7f0f59c00640 1 -- 172.21.15.52:0/800099513 wait complete. 2024-09-10T08:34:46.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:34:34.844032+0000', 'modified': '2024-09-10T08:34:37.863394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7542}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7542': {'gid': 7542, 'name': 'c', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/3438113283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 3438113283}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3438113283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7542, 'qdb_cluster': [7542]} 2024-09-10T08:34:46.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:34:46.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:34:46.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.222+0000 7f08e8200640 1 Processor -- start 2024-09-10T08:34:46.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.222+0000 7f08e8200640 1 -- start start 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.223+0000 7f08e8200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.223+0000 7f08e8200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e0071b30 con 0x7f08e006c320 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.223+0000 7f08e8200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e00b3510 con 0x7f08e0148260 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.223+0000 7f08e8200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08e0074200 con 0x7f08e0147e80 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e6200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f08e006c320 0x7f08e00b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45498/0 (socket says 172.21.15.52:45498) 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e6200640 1 -- 172.21.15.52:0/3026521045 learned_addr learned my addr 172.21.15.52:0/3026521045 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:46.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e5800640 1 --2- 172.21.15.52:0/3026521045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e0070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135357399 0 0) 0x7f08e0071b30 con 0x7f08e006c320 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08c8003520 con 0x7f08e006c320 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977626490 0 0) 0x7f08e00b3510 con 0x7f08e0148260 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e0071b30 con 0x7f08e0148260 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e5800640 1 -- 172.21.15.52:0/3026521045 >> v1:172.21.15.176:6789/0 conn(0x7f08e0148260 legacy=0x7f08e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e5800640 1 -- 172.21.15.52:0/3026521045 >> v1:172.21.15.52:6789/0 conn(0x7f08e006c320 legacy=0x7f08e00b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.224+0000 7f08e5800640 1 -- 172.21.15.52:0/3026521045 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e00b37f0 con 0x7f08e0147e80 2024-09-10T08:34:46.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.225+0000 7f08e5800640 1 --2- 172.21.15.52:0/3026521045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e0070f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f08d40097d0 tx=0x7f08d402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2dd97d4f8ed6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037070 con 0x7f08e0147e80 2024-09-10T08:34:46.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4032440 con 0x7f08e0147e80 2024-09-10T08:34:46.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08dfe00640 1 -- 172.21.15.52:0/3026521045 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d40327f0 con 0x7f08e0147e80 2024-09-10T08:34:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 -- 172.21.15.52:0/3026521045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 msgr2=0x7f08e0070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 --2- 172.21.15.52:0/3026521045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e0070f70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f08d40097d0 tx=0x7f08d402a210 comp rx=0 tx=0).stop 2024-09-10T08:34:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 -- 172.21.15.52:0/3026521045 shutdown_connections 2024-09-10T08:34:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 --2- 172.21.15.52:0/3026521045 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e0070f70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 -- 172.21.15.52:0/3026521045 >> 172.21.15.52:0/3026521045 conn(0x7f08e00ccec0 msgr2=0x7f08e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.226+0000 7f08e8200640 1 -- 172.21.15.52:0/3026521045 shutdown_connections 2024-09-10T08:34:46.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.227+0000 7f08e8200640 1 -- 172.21.15.52:0/3026521045 wait complete. 2024-09-10T08:34:46.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.228+0000 7f08e8200640 1 Processor -- start 2024-09-10T08:34:46.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.228+0000 7f08e8200640 1 -- start start 2024-09-10T08:34:46.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e006c320 0x7f08e01428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e01e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00714b0 con 0x7f08e0148260 2024-09-10T08:34:46.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08e00b3e40 con 0x7f08e006c320 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e8200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08e0071630 con 0x7f08e0147e80 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50312/0 (socket says 172.21.15.52:50312) 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.229+0000 7f08e6200640 1 -- 172.21.15.52:0/55008040 learned_addr learned my addr 172.21.15.52:0/55008040 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e5800640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e006c320 0x7f08e01428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e4e00640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e01e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 -- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 msgr2=0x7f08e01e9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e01e9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 -- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e006c320 msgr2=0x7f08e01428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e006c320 0x7f08e01428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 -- 172.21.15.52:0/55008040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e01e9a40 con 0x7f08e0148260 2024-09-10T08:34:46.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08e6200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cba0 tx=0x7f08d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.230+0000 7f08dd600640 1 -- 172.21.15.52:0/55008040 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8017070 con 0x7f08e0148260 2024-09-10T08:34:46.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.231+0000 7f08dd600640 1 -- 172.21.15.52:0/55008040 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d800ace0 con 0x7f08e0148260 2024-09-10T08:34:46.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.231+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e0142ed0 con 0x7f08e0148260 2024-09-10T08:34:46.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.231+0000 7f08dd600640 1 -- 172.21.15.52:0/55008040 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8012620 con 0x7f08e0148260 2024-09-10T08:34:46.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.231+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e0143490 con 0x7f08e0148260 2024-09-10T08:34:46.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.233+0000 7f08dd600640 1 -- 172.21.15.52:0/55008040 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08d801a070 con 0x7f08e0148260 2024-09-10T08:34:46.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.233+0000 7f08dd600640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 0x7f08c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.233+0000 7f08dd600640 1 -- 172.21.15.52:0/55008040 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f08d808ac30 con 0x7f08e0148260 2024-09-10T08:34:46.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.234+0000 7f08e5800640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 0x7f08c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.234+0000 7f08eb280740 1 Processor -- start 2024-09-10T08:34:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.234+0000 7f08eb280740 1 -- start start 2024-09-10T08:34:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08e5800640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 0x7f08c006e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f08d4034000 tx=0x7f08d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29584b0 0x5577f295b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2955570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5577f28b93b0 con 0x5577f295acf0 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5577f28be410 con 0x5577f29584b0 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5577f2866620 con 0x5577f295c480 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.235+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50328/0 (socket says 172.21.15.52:50328) 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 -- 172.21.15.52:0/4061838899 learned_addr learned my addr 172.21.15.52:0/4061838899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e4e00640 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29584b0 0x5577f295b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 -- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 msgr2=0x5577f2955570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2955570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 -- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29584b0 msgr2=0x5577f295b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29584b0 0x5577f295b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 -- 172.21.15.52:0/4061838899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f25d12d0 con 0x5577f295acf0 2024-09-10T08:34:46.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08e5800640 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f08d40094f0 tx=0x7f08d402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cb55add19f329d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.236+0000 7f08d2000640 1 -- 172.21.15.52:0/4061838899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d404e070 con 0x5577f295acf0 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08d2000640 1 -- 172.21.15.52:0/4061838899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4032bd0 con 0x5577f295acf0 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08d2000640 1 -- 172.21.15.52:0/4061838899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037040 con 0x5577f295acf0 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 -- 172.21.15.52:0/4061838899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 msgr2=0x5577f29a0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f08d40094f0 tx=0x7f08d402c000 comp rx=0 tx=0).stop 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 -- 172.21.15.52:0/4061838899 shutdown_connections 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2955570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29584b0 0x5577f295b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 --2- 172.21.15.52:0/4061838899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29a0490 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 -- 172.21.15.52:0/4061838899 >> 172.21.15.52:0/4061838899 conn(0x5577f2957740 msgr2=0x5577f299f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 -- 172.21.15.52:0/4061838899 shutdown_connections 2024-09-10T08:34:46.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.237+0000 7f08eb280740 1 -- 172.21.15.52:0/4061838899 wait complete. 2024-09-10T08:34:46.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.238+0000 7f08eb280740 1 -- start start 2024-09-10T08:34:46.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.238+0000 7f08eb280740 1 Processor -- start 2024-09-10T08:34:46.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295acf0 0x5577f29af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 0x5577f297e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5577f2879780 con 0x5577f29826d0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5577f28ba3d0 con 0x5577f295c480 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5577f2956be0 con 0x5577f295acf0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.239+0000 7f08eb280740 10 client.0 _ll_register_callbacks cb 0x5577f28b75d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50332/0 (socket says 172.21.15.52:50332) 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 -- 172.21.15.52:0/4114471649 learned_addr learned my addr 172.21.15.52:0/4114471649 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e5800640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295acf0 0x5577f29af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e4e00640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 0x5577f297e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 -- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295acf0 msgr2=0x5577f29af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295acf0 0x5577f29af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 -- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 msgr2=0x5577f297e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 0x5577f297e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 -- 172.21.15.52:0/4114471649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577f269b6b0 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e4e00640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 0x5577f297e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08e6200640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f08d80553e0 tx=0x7f08d8059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74ab384d5780eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.240+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d8061820 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f08d8004b60 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d4032bd0 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f08d8004d60 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 10 client.7677 fetch_fsmap learned FSMap version 83 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5577f299b850 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4032bd0 con 0x5577f29826d0 2024-09-10T08:34:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f08d8076080 con 0x5577f29826d0 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 10 client.7677 fetch_fsmap finished waiting for FSMap version 83 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 10 client.7677 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 20 client.7677 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f299ad50 0x5577f29b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 4 client.7677 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.241+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577f28cbb40 con 0x5577f299ad50 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.242+0000 7f08e5800640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f299ad50 0x5577f29b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.242+0000 7f08e5800640 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f299ad50 0x5577f29b3bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d4ed359eef1de62 server_cookie=48cb3b728a2c17dd in_seq=0 out_seq=0 2024-09-10T08:34:46.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.242+0000 7f08c6a00640 10 client.7677 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:34:46.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08c6a00640 1 -- 172.21.15.52:0/4114471649 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577f28cbb40 con 0x5577f299ad50 2024-09-10T08:34:46.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08c6a00640 10 client.7677 handle_command_reply: tid=0 2024-09-10T08:34:46.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 client.7677 shutdown 2024-09-10T08:34:46.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 msgr2=0x5577f297e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f08d80553e0 tx=0x7f08d8059040 comp rx=0 tx=0).stop 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 shutdown_connections 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f299ad50 0x5577f29b3bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f29826d0 0x5577f297e6d0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f295c480 0x5577f297e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 --2- 172.21.15.52:0/4114471649 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295acf0 0x5577f29af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08c6a00640 0 client.7677 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 >> 172.21.15.52:0/4114471649 conn(0x5577f29584b0 msgr2=0x5577f299f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 shutdown_connections 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.243+0000 7f08eb280740 1 -- 172.21.15.52:0/4114471649 wait complete. 2024-09-10T08:34:46.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.244+0000 7f08eb280740 20 client.7677 trim_cache size 0 max 16384 2024-09-10T08:34:46.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.262+0000 7f08eb280740 1 Processor -- start 2024-09-10T08:34:46.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.262+0000 7f08eb280740 1 -- start start 2024-09-10T08:34:46.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2984df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f2985330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01ff9b0 con 0x5577f295acf0 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08e01fed10 con 0x5577f29826d0 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08e01ff360 con 0x5577f295c480 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50342/0 (socket says 172.21.15.52:50342) 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.263+0000 7f08e5800640 1 -- 172.21.15.52:0/3636368679 learned_addr learned my addr 172.21.15.52:0/3636368679 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e6200640 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f2985330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e4e00640 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2984df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 -- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 msgr2=0x5577f2984df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2984df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 -- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 msgr2=0x5577f2985330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f2985330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 -- 172.21.15.52:0/3636368679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577f2956270 con 0x5577f295acf0 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08e5800640 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f08d40098f0 tx=0x7f08d403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afabfe01cab533f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08d1600640 1 -- 172.21.15.52:0/3636368679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d404e040 con 0x5577f295acf0 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08d1600640 1 -- 172.21.15.52:0/3636368679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4050040 con 0x5577f295acf0 2024-09-10T08:34:46.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.264+0000 7f08d1600640 1 -- 172.21.15.52:0/3636368679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037040 con 0x5577f295acf0 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 -- 172.21.15.52:0/3636368679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 msgr2=0x5577f29c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f08d40098f0 tx=0x7f08d403c000 comp rx=0 tx=0).stop 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 -- 172.21.15.52:0/3636368679 shutdown_connections 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f2985330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2984df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 --2- 172.21.15.52:0/3636368679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c4060 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 -- 172.21.15.52:0/3636368679 >> 172.21.15.52:0/3636368679 conn(0x5577f29584b0 msgr2=0x5577f29802e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 -- 172.21.15.52:0/3636368679 shutdown_connections 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.265+0000 7f08eb280740 1 -- 172.21.15.52:0/3636368679 wait complete. 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.266+0000 7f08eb280740 1 -- start start 2024-09-10T08:34:46.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.266+0000 7f08eb280740 1 Processor -- start 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2a23dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f29b99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5577f299abd0 con 0x5577f295acf0 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5577f29afcf0 con 0x5577f29826d0 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5577f299b220 con 0x5577f295c480 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08eb280740 10 client.0 _ll_register_callbacks cb 0x7f08cc007b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50348/0 (socket says 172.21.15.52:50348) 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 -- 172.21.15.52:0/56876331 learned_addr learned my addr 172.21.15.52:0/56876331 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e6200640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f29b99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 -- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 msgr2=0x5577f2a23dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e4e00640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2a23dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2a23dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 -- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 msgr2=0x5577f29b99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f29b99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e5800640 1 -- 172.21.15.52:0/56876331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577f299d0c0 con 0x5577f295acf0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e6200640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f29b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.267+0000 7f08e4e00640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2a23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08e5800640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f08d4032720 tx=0x7f08d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34260b948b3312 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d4037030 con 0x5577f295acf0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f08d40043c0 con 0x5577f295acf0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08d4050040 con 0x5577f295acf0 2024-09-10T08:34:46.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f08d406b050 con 0x5577f295acf0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08eb280740 10 client.7683 fetch_fsmap learned FSMap version 83 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5577f29550e0 con 0x5577f295acf0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.268+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d4050040 con 0x5577f295acf0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f08d406e020 con 0x5577f295acf0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 10 client.7683 fetch_fsmap finished waiting for FSMap version 83 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 10 client.7683 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 20 client.7683 populate_metadata read hostname 'smithi052' 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f2a26ba0 0x5577f2a26f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 4 client.7683 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "status"}) -- 0x5577f28c5e90 con 0x5577f2a26ba0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08e4e00640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f2a26ba0 0x5577f2a26f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08e4e00640 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f2a26ba0 0x5577f2a26f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18366470d55af64 server_cookie=67800d3071c553ee in_seq=0 out_seq=0 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.269+0000 7f08c6a00640 10 client.7683 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08c6a00640 1 -- 172.21.15.52:0/56876331 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5577f28c5e90 con 0x5577f2a26ba0 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08c6a00640 10 client.7683 handle_command_reply: tid=0 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 client.7683 shutdown 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 msgr2=0x5577f29c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f08d4032720 tx=0x7f08d4004730 comp rx=0 tx=0).stop 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 shutdown_connections 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x5577f2a26ba0 0x5577f2a26f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5577f29826d0 0x5577f29b99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5577f295c480 0x5577f2a23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 --2- 172.21.15.52:0/56876331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577f295acf0 0x5577f29c2ea0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08c6a00640 0 client.7683 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:34:46.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 >> 172.21.15.52:0/56876331 conn(0x5577f29584b0 msgr2=0x5577f29c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 shutdown_connections 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 1 -- 172.21.15.52:0/56876331 wait complete. 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.270+0000 7f08eb280740 20 client.7683 trim_cache size 0 max 16384 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7542, 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:34:46.276 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.858251328, 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 83, 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 109, 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 109, 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.932468874 2024-09-10T08:34:46.277 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 msgr2=0x7f08c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 0x7f08c006e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f08d4034000 tx=0x7f08d402e000 comp rx=0 tx=0).stop 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 msgr2=0x7f08e015e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f08d800cba0 tx=0x7f08d800a430 comp rx=0 tx=0).stop 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 shutdown_connections 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f08c006be30 0x7f08c006e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08e0148260 0x7f08e015e5f0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e0147e80 0x7f08e01e9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 --2- 172.21.15.52:0/55008040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e006c320 0x7f08e01428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 >> 172.21.15.52:0/55008040 conn(0x7f08e00ccec0 msgr2=0x7f08e00cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 shutdown_connections 2024-09-10T08:34:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.271+0000 7f08e8200640 1 -- 172.21.15.52:0/55008040 wait complete. 2024-09-10T08:34:46.286 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:34:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.443+0000 7fc799600640 1 Processor -- start 2024-09-10T08:34:46.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.443+0000 7fc799600640 1 -- start start 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.444+0000 7fc799600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 0x7fc79415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.444+0000 7fc799600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7940b6660 con 0x7fc7941522d0 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.444+0000 7fc799600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79415cce0 con 0x7fc79415d7c0 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.444+0000 7fc799600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc79415f860 con 0x7fc79415eec0 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc7941522d0 0x7fc7940b5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45510/0 (socket says 172.21.15.52:45510) 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793e00640 1 -- 172.21.15.52:0/1042783055 learned_addr learned my addr 172.21.15.52:0/1042783055 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:34:46.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793400640 1 --2- 172.21.15.52:0/1042783055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 0x7fc79415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895581542 0 0) 0x7fc7940b6660 con 0x7fc7941522d0 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc778005730 con 0x7fc7941522d0 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520978537 0 0) 0x7fc79415cce0 con 0x7fc79415d7c0 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793400640 1 -- 172.21.15.52:0/1042783055 >> v1:172.21.15.176:6789/0 conn(0x7fc79415d7c0 legacy=0x7fc79415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793400640 1 -- 172.21.15.52:0/1042783055 >> v1:172.21.15.52:6789/0 conn(0x7fc7941522d0 legacy=0x7fc7940b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.445+0000 7fc793400640 1 -- 172.21.15.52:0/1042783055 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79415cfc0 con 0x7fc79415eec0 2024-09-10T08:34:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.446+0000 7fc793400640 1 --2- 172.21.15.52:0/1042783055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 0x7fc79415f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7800097d0 tx=0x7fc78002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e1bf39201c1fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780037070 con 0x7fc79415eec0 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc780032440 con 0x7fc79415eec0 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc792a00640 1 -- 172.21.15.52:0/1042783055 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7800327f0 con 0x7fc79415eec0 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 -- 172.21.15.52:0/1042783055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 msgr2=0x7fc79415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 --2- 172.21.15.52:0/1042783055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 0x7fc79415f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7800097d0 tx=0x7fc78002a210 comp rx=0 tx=0).stop 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 -- 172.21.15.52:0/1042783055 shutdown_connections 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 --2- 172.21.15.52:0/1042783055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415eec0 0x7fc79415f320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 -- 172.21.15.52:0/1042783055 >> 172.21.15.52:0/1042783055 conn(0x7fc79406c240 msgr2=0x7fc79406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 -- 172.21.15.52:0/1042783055 shutdown_connections 2024-09-10T08:34:46.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.447+0000 7fc799600640 1 -- 172.21.15.52:0/1042783055 wait complete. 2024-09-10T08:34:46.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.449+0000 7fc799600640 1 Processor -- start 2024-09-10T08:34:46.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.449+0000 7fc799600640 1 -- start start 2024-09-10T08:34:46.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7941522d0 0x7fc794072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415d7c0 0x7fc7941f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc79415fc80 con 0x7fc79415eec0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc79415ca90 con 0x7fc7941522d0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc799600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940b62b0 con 0x7fc79415d7c0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc798c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc798c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50360/0 (socket says 172.21.15.52:50360) 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc798c00640 1 -- 172.21.15.52:0/3070744575 learned_addr learned my addr 172.21.15.52:0/3070744575 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc793400640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415d7c0 0x7fc7941f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.450+0000 7fc793e00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7941522d0 0x7fc794072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 -- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415d7c0 msgr2=0x7fc7941f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415d7c0 0x7fc7941f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 -- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7941522d0 msgr2=0x7fc794072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7941522d0 0x7fc794072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 -- 172.21.15.52:0/3070744575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7941f38f0 con 0x7fc79415eec0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc798c00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c790 tx=0x7fc78c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c003da0 con 0x7fc79415eec0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c005070 con 0x7fc79415eec0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c005460 con 0x7fc79415eec0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.451+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7941f3bd0 con 0x7fc79415eec0 2024-09-10T08:34:46.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.452+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7941f08e0 con 0x7fc79415eec0 2024-09-10T08:34:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.453+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7941526b0 con 0x7fc79415eec0 2024-09-10T08:34:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.453+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc78c005600 con 0x7fc79415eec0 2024-09-10T08:34:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.454+0000 7fc78be00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 0x7fc77406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.454+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7fc78c08ac50 con 0x7fc79415eec0 2024-09-10T08:34:46.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.455+0000 7fc793e00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 0x7fc77406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:46.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.456+0000 7fc793e00640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 0x7fc77406e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc784005880 tx=0x7fc784009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:46.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.459+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc78c058fa0 con 0x7fc79415eec0 2024-09-10T08:34:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.679+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc79415e2d0 con 0x7fc79415eec0 2024-09-10T08:34:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.680+0000 7fc78be00640 1 -- 172.21.15.52:0/3070744575 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7fc78c05d2a0 con 0x7fc79415eec0 2024-09-10T08:34:46.680 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:34:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 msgr2=0x7fc77406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 0x7fc77406e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc784005880 tx=0x7fc784009040 comp rx=0 tx=0).stop 2024-09-10T08:34:46.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 msgr2=0x7fc7941f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c790 tx=0x7fc78c00cc50 comp rx=0 tx=0).stop 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 shutdown_connections 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc77406be30 0x7fc77406e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc79415eec0 0x7fc7941f2ff0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc79415d7c0 0x7fc7941f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 --2- 172.21.15.52:0/3070744575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7941522d0 0x7fc794072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 >> 172.21.15.52:0/3070744575 conn(0x7fc79406c240 msgr2=0x7fc7940b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 shutdown_connections 2024-09-10T08:34:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46.682+0000 7fc799600640 1 -- 172.21.15.52:0/3070744575 wait complete. 2024-09-10T08:34:46.697 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:34:46.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:34:46.698 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:46.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:46.698 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:46.734 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42316sec preferred_lft 42316sec 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:34:46.735 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:34:46.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:46.737 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:34:46.828 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:34:46.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:46.831 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:34:46.868 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:34:46.868 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:34:46.868 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:34:46.868 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:34:46.868 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:34:46.868 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:34:46.868 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:34:46.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:34:46.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:34:46.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:34:46.869 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:34:46.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:34:47.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:47.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:47.064 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:34:47.099 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:34:47.099 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:34:47.100 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:47.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:47.100 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:34:47.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:34:47.196 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:47.231 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:34:47.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:34:47.231 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:47.306 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:34:47.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:47.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:47.435 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:47.435 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:34:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:34:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:34:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:34:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:34:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:34:47.464 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:34:47.464 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:34:47.464 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:34:47.464 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:34:47.464 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:34:47.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:34:47.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:47.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:34:47.523 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:34:47.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:34:47.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:34:47.621 INFO:teuthology.orchestra.run.smithi052.stdout:client6584 2024-09-10T08:34:47.622 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:47.622 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:47.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-10T08:34:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.859+0000 7f2317e00640 1 Processor -- start 2024-09-10T08:34:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.859+0000 7f2317e00640 1 -- start start 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.860+0000 7f2317e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2318073b40 0x7f2318160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.860+0000 7f2317e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23181422f0 con 0x7f2318073f20 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.860+0000 7f2317e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23181425d0 con 0x7f23180cef30 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.860+0000 7f2317e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f231813f660 con 0x7f2318073b40 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.860+0000 7f2316a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2318073b40 0x7f2318160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2318073b40 0x7f2318160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50370/0 (socket says 172.21.15.52:50370) 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2318073f20 0x7f2318141980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45516/0 (socket says 172.21.15.52:45516) 2024-09-10T08:34:47.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316a00640 1 -- 172.21.15.52:0/862637076 learned_addr learned my addr 172.21.15.52:0/862637076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316a00640 1 -- 172.21.15.52:0/862637076 >> v1:172.21.15.176:6789/0 conn(0x7f23180cef30 legacy=0x7f231815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:34:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316a00640 1 -- 172.21.15.52:0/862637076 >> v1:172.21.15.52:6789/0 conn(0x7f2318073f20 legacy=0x7f2318141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.861+0000 7f2316a00640 1 -- 172.21.15.52:0/862637076 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231815ff20 con 0x7f2318073b40 2024-09-10T08:34:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.862+0000 7f2316a00640 1 --2- 172.21.15.52:0/862637076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073b40 0x7f2318160720 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90e70cca1e8f165 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.862+0000 7f2315600640 1 -- 172.21.15.52:0/862637076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308037070 con 0x7f2318073b40 2024-09-10T08:34:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.862+0000 7f2315600640 1 -- 172.21.15.52:0/862637076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2308032440 con 0x7f2318073b40 2024-09-10T08:34:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.862+0000 7f2315600640 1 -- 172.21.15.52:0/862637076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308032810 con 0x7f2318073b40 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 -- 172.21.15.52:0/862637076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073b40 msgr2=0x7f2318160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 --2- 172.21.15.52:0/862637076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073b40 0x7f2318160720 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802a210 comp rx=0 tx=0).stop 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 -- 172.21.15.52:0/862637076 shutdown_connections 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 --2- 172.21.15.52:0/862637076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073b40 0x7f2318160720 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 -- 172.21.15.52:0/862637076 >> 172.21.15.52:0/862637076 conn(0x7f23180b1fd0 msgr2=0x7f23180b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 -- 172.21.15.52:0/862637076 shutdown_connections 2024-09-10T08:34:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.863+0000 7f2317e00640 1 -- 172.21.15.52:0/862637076 wait complete. 2024-09-10T08:34:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.865+0000 7f2317e00640 1 Processor -- start 2024-09-10T08:34:47.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.865+0000 7f2317e00640 1 -- start start 2024-09-10T08:34:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2318073b40 0x7f2318143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 0x7f2318153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2318142090 con 0x7f2318073f20 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2318160290 con 0x7f2318073b40 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f23180cf3c0 con 0x7f23180cef30 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2316000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2316000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50374/0 (socket says 172.21.15.52:50374) 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2316000640 1 -- 172.21.15.52:0/461127949 learned_addr learned my addr 172.21.15.52:0/461127949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2316a00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2318073b40 0x7f2318143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.866+0000 7f2317400640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 0x7f2318153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 -- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 msgr2=0x7f2318153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 0x7f2318153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 -- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2318073b40 msgr2=0x7f2318143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2318073b40 0x7f2318143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 -- 172.21.15.52:0/461127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2318144450 con 0x7f2318073f20 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2317400640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 0x7f2318153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2316000640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f230400c400 tx=0x7f230400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23040074e0 con 0x7f2318073f20 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2304007680 con 0x7f2318073f20 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304004a00 con 0x7f2318073f20 2024-09-10T08:34:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2318144730 con 0x7f2318073f20 2024-09-10T08:34:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.867+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2318144cf0 con 0x7f2318073f20 2024-09-10T08:34:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.868+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23180cf780 con 0x7f2318073f20 2024-09-10T08:34:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.869+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f230401a020 con 0x7f2318073f20 2024-09-10T08:34:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.870+0000 7f230ea00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:34:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.870+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f230408a5f0 con 0x7f2318073f20 2024-09-10T08:34:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.871+0000 7f2316a00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:34:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.871+0000 7f2316a00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 0x7f22f806e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2308034000 tx=0x7f230802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:34:47.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:47.875+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2304058f90 con 0x7f2318073f20 2024-09-10T08:34:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.099+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f23180b1620 con 0x7f2318073f20 2024-09-10T08:34:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.612+0000 7f230ea00640 1 -- 172.21.15.52:0/461127949 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v84) ==== 167+0+0 (secure 0 0 0) 0x7f2304058890 con 0x7f2318073f20 2024-09-10T08:34:48.612 INFO:teuthology.orchestra.run.smithi052.stderr:enabled new snapshots 2024-09-10T08:34:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 msgr2=0x7f22f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 0x7f22f806e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2308034000 tx=0x7f230802e000 comp rx=0 tx=0).stop 2024-09-10T08:34:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 msgr2=0x7f231813ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:34:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f230400c400 tx=0x7f230400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:34:48.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 shutdown_connections 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22f806be30 0x7f22f806e2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f23180cef30 0x7f2318153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2318073f20 0x7f231813ebf0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 --2- 172.21.15.52:0/461127949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2318073b40 0x7f2318143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 >> 172.21.15.52:0/461127949 conn(0x7f23180b1fd0 msgr2=0x7f2318071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 shutdown_connections 2024-09-10T08:34:48.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:34:48.615+0000 7f2317e00640 1 -- 172.21.15.52:0/461127949 wait complete. 2024-09-10T08:34:48.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:34:48.633 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-10T08:34:48.678 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:34:48.678 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:34:48.754 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:34:48.754 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> import uuid 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> n = 2000 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = False 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> if 3 > 0: 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> create_hard_links = True 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> dpath = os.path.dirname(path) 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> fnameprefix = os.path.basename(path) 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> os.makedirs(dpath, exist_ok=True) 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:34:48.755 DEBUG:teuthology.orchestra.run.smithi052:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> for i in range(n): 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> with open(fpath, '"'"'w'"'"') as f: 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> f.write(f"{i}") 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> f.flush() 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(f.fileno()) 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> os.unlink(fpath) 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> if create_hard_links: 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> for j in range(3): 2024-09-10T08:34:48.756 DEBUG:teuthology.orchestra.run.smithi052:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-10T08:34:48.757 DEBUG:teuthology.orchestra.run.smithi052:> if False: 2024-09-10T08:34:48.757 DEBUG:teuthology.orchestra.run.smithi052:> os.fsync(dirfd) 2024-09-10T08:34:48.757 DEBUG:teuthology.orchestra.run.smithi052:> finally: 2024-09-10T08:34:48.757 DEBUG:teuthology.orchestra.run.smithi052:> os.close(dirfd) 2024-09-10T08:34:48.757 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:35:06.721 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:06.725 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:21.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:35:21.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:35:21.781 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T08:35:21.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:35:21.872 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-10T08:35:36.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:36.832 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:35:50.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:35:50.785 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-10T08:35:50.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-10T08:35:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.076+0000 7f559be00640 1 Processor -- start 2024-09-10T08:35:51.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.076+0000 7f559be00640 1 -- start start 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f559be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 0x7f55940736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f559be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55940cd270 0x7f559415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f559be00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55940714b0 con 0x7f55940cce30 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f559be00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5594073c00 con 0x7f55940cd270 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f559be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55940cd880 con 0x7f55940732e0 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55940cd270 0x7f559415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55940cd270 0x7f559415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53832/0 (socket says 172.21.15.52:53832) 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 -- 172.21.15.52:0/2648468631 learned_addr learned my addr 172.21.15.52:0/2648468631 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599400640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 0x7f55940736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 -- 172.21.15.52:0/2648468631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 msgr2=0x7f55940736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 0x7f55940736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 -- 172.21.15.52:0/2648468631 >> v1:172.21.15.176:6789/0 conn(0x7f55940cce30 legacy=0x7f5594071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599e00640 1 -- 172.21.15.52:0/2648468631 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55940cdb60 con 0x7f55940cd270 2024-09-10T08:35:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.078+0000 7f5599400640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 0x7f55940736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.079+0000 7f5599e00640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f559415c8d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f558c009e50 tx=0x7f558c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa5d2a5cebda939 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f5593e00640 1 -- 172.21.15.52:0/2648468631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c036070 con 0x7f55940cd270 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f5593e00640 1 -- 172.21.15.52:0/2648468631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c031600 con 0x7f55940cd270 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f5593e00640 1 -- 172.21.15.52:0/2648468631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0319d0 con 0x7f55940cd270 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 -- 172.21.15.52:0/2648468631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 msgr2=0x7f559415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f559415c8d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f558c009e50 tx=0x7f558c02a680 comp rx=0 tx=0).stop 2024-09-10T08:35:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 -- 172.21.15.52:0/2648468631 shutdown_connections 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f559415c8d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 --2- 172.21.15.52:0/2648468631 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940732e0 0x7f55940736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 -- 172.21.15.52:0/2648468631 >> 172.21.15.52:0/2648468631 conn(0x7f559406d0f0 msgr2=0x7f559406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 -- 172.21.15.52:0/2648468631 shutdown_connections 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.080+0000 7f559be00640 1 -- 172.21.15.52:0/2648468631 wait complete. 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.082+0000 7f559be00640 1 Processor -- start 2024-09-10T08:35:51.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.082+0000 7f559be00640 1 -- start start 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 0x7f55941e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 0x7f55941f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f559406bf70 con 0x7f55940cd270 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f559406bdf0 con 0x7f55940732e0 2024-09-10T08:35:51.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f559be00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5594072380 con 0x7f55940cce30 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53844/0 (socket says 172.21.15.52:53844) 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f5599e00640 1 -- 172.21.15.52:0/3638138701 learned_addr learned my addr 172.21.15.52:0/3638138701 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f5598a00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 0x7f55941f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.083+0000 7f5599400640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 0x7f55941e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 -- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 msgr2=0x7f55941f4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 0x7f55941f4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 -- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 msgr2=0x7f55941e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 0x7f55941e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 -- 172.21.15.52:0/3638138701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55941e61e0 con 0x7f55940cd270 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5598a00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 0x7f55941f4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599400640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 0x7f55941e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5599e00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f558c009e50 tx=0x7f558c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5591600640 1 -- 172.21.15.52:0/3638138701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c036050 con 0x7f55940cd270 2024-09-10T08:35:51.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5591600640 1 -- 172.21.15.52:0/3638138701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c042070 con 0x7f55940cd270 2024-09-10T08:35:51.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f5591600640 1 -- 172.21.15.52:0/3638138701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c009510 con 0x7f55940cd270 2024-09-10T08:35:51.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55941e64c0 con 0x7f55940cd270 2024-09-10T08:35:51.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.084+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55941e7f10 con 0x7f55940cd270 2024-09-10T08:35:51.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.087+0000 7f5591600640 1 -- 172.21.15.52:0/3638138701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f558c007bd0 con 0x7f55940cd270 2024-09-10T08:35:51.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.088+0000 7f5591600640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 0x7f557406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.088+0000 7f5591600640 1 -- 172.21.15.52:0/3638138701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f558c0abdd0 con 0x7f55940cd270 2024-09-10T08:35:51.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.089+0000 7f559ec35740 1 Processor -- start 2024-09-10T08:35:51.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.089+0000 7f5599400640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 0x7f557406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.089+0000 7f559ec35740 1 -- start start 2024-09-10T08:35:51.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.089+0000 7f5599400640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 0x7f557406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5588006fd0 tx=0x7f5588008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.089+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c07fa80 0x563e5c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f559ec35740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c07a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f559ec35740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563e5c046cf0 con 0x563e5c07d240 2024-09-10T08:35:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563e5bfe27f0 con 0x563e5c081210 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563e5bf8a800 con 0x563e5c07fa80 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5599400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c07fa80 0x563e5c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53860/0 (socket says 172.21.15.52:53860) 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 -- 172.21.15.52:0/2395025646 learned_addr learned my addr 172.21.15.52:0/2395025646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5599e00640 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c07a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 -- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c07fa80 msgr2=0x563e5c0c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c07fa80 0x563e5c0c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 -- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 msgr2=0x563e5c07a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c07a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.090+0000 7f5598a00640 1 -- 172.21.15.52:0/2395025646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5bdbf7d0 con 0x563e5c07d240 2024-09-10T08:35:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f5598a00640 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5580001510 tx=0x7f55800019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a507577e75e7bc89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f5585c00640 1 -- 172.21.15.52:0/2395025646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580019070 con 0x563e5c07d240 2024-09-10T08:35:51.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f5585c00640 1 -- 172.21.15.52:0/2395025646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55800052e0 con 0x563e5c07d240 2024-09-10T08:35:51.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f5585c00640 1 -- 172.21.15.52:0/2395025646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800037f0 con 0x563e5c07d240 2024-09-10T08:35:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f559ec35740 1 -- 172.21.15.52:0/2395025646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 msgr2=0x563e5c07fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f559ec35740 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5580001510 tx=0x7f55800019d0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f559ec35740 1 -- 172.21.15.52:0/2395025646 shutdown_connections 2024-09-10T08:35:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.091+0000 7f559ec35740 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c07a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07d240 0x563e5c07fe60 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 --2- 172.21.15.52:0/2395025646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c07fa80 0x563e5c0c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 -- 172.21.15.52:0/2395025646 >> 172.21.15.52:0/2395025646 conn(0x563e5c07c240 msgr2=0x563e5c0c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 -- 172.21.15.52:0/2395025646 shutdown_connections 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 -- 172.21.15.52:0/2395025646 wait complete. 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 -- start start 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.092+0000 7f559ec35740 1 Processor -- start 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c07ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c0a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563e5bf6b750 con 0x563e5c0a0e00 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563e5bfde7b0 con 0x563e5c07fa80 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563e5c07b6e0 con 0x563e5c081210 2024-09-10T08:35:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.093+0000 7f559ec35740 10 client.0 _ll_register_callbacks cb 0x563e5bcf4be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53876/0 (socket says 172.21.15.52:53876) 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 -- 172.21.15.52:0/2910150390 learned_addr learned my addr 172.21.15.52:0/2910150390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c07ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5598a00640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c0a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 -- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 msgr2=0x563e5c0a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c0a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 -- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 msgr2=0x563e5c07ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c07ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 -- 172.21.15.52:0/2910150390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5bcb50f0 con 0x563e5c0a0e00 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f5599e00640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f558c02ac70 tx=0x7f558c031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a10af4c72a4dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.094+0000 7f557a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:35:51.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0a3d60 con 0x563e5c0a0e00 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f558c0793d0 con 0x563e5c0a0e00 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55800052e0 con 0x563e5c0a0e00 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f558c082b60 con 0x563e5c0a0e00 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 10 client.7710 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563e5be1ff60 con 0x563e5c0a0e00 2024-09-10T08:35:51.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55800052e0 con 0x563e5c0a0e00 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f558c075cd0 con 0x563e5c0a0e00 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 10 client.7710 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 10 client.7710 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 20 client.7710 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.095+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c09f2d0 0x563e5c09f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.096+0000 7f559ec35740 4 client.7710 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.096+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e5bfeff20 con 0x563e5c09f2d0 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.096+0000 7f5599400640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c09f2d0 0x563e5c09f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.096+0000 7f5599400640 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c09f2d0 0x563e5c09f720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e5f756b010889 server_cookie=68661fa16fb67c84 in_seq=0 out_seq=0 2024-09-10T08:35:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.096+0000 7f557a000640 10 client.7710 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f557a000640 1 -- 172.21.15.52:0/2910150390 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e5bfeff20 con 0x563e5c09f2d0 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f557a000640 10 client.7710 handle_command_reply: tid=0 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 client.7710 shutdown 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 msgr2=0x563e5c07e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f558c02ac70 tx=0x7f558c031740 comp rx=0 tx=0).stop 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 shutdown_connections 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c09f2d0 0x563e5c09f720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c07e4b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c0a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 --2- 172.21.15.52:0/2910150390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c07ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f557a000640 0 client.7710 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.097+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 >> 172.21.15.52:0/2910150390 conn(0x563e5c07d240 msgr2=0x563e5c0c3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.098+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 shutdown_connections 2024-09-10T08:35:51.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.098+0000 7f559ec35740 1 -- 172.21.15.52:0/2910150390 wait complete. 2024-09-10T08:35:51.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.098+0000 7f559ec35740 20 client.7710 trim_cache size 0 max 16384 2024-09-10T08:35:51.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.114+0000 7f559ec35740 1 Processor -- start 2024-09-10T08:35:51.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.114+0000 7f559ec35740 1 -- start start 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c075610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c0a0e00 0x563e5c0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5594200f80 con 0x563e5c07fa80 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55941fff90 con 0x563e5c081210 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55941e94d0 con 0x563e5c0a0e00 2024-09-10T08:35:51.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.115+0000 7f5599400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53884/0 (socket says 172.21.15.52:53884) 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 -- 172.21.15.52:0/2739127257 learned_addr learned my addr 172.21.15.52:0/2739127257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5598a00640 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599e00640 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c0a0e00 0x563e5c0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 -- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c0a0e00 msgr2=0x563e5c0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c0a0e00 0x563e5c0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 -- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 msgr2=0x563e5c075610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c075610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 -- 172.21.15.52:0/2739127257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5bc8e1b0 con 0x563e5c07fa80 2024-09-10T08:35:51.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5599400640 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f558800fa30 tx=0x7f5588015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605cf5c1eca2b985 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5585200640 1 -- 172.21.15.52:0/2739127257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558801b040 con 0x563e5c07fa80 2024-09-10T08:35:51.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5585200640 1 -- 172.21.15.52:0/2739127257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558801c040 con 0x563e5c07fa80 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.116+0000 7f5585200640 1 -- 172.21.15.52:0/2739127257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588023660 con 0x563e5c07fa80 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 -- 172.21.15.52:0/2739127257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 msgr2=0x563e5c07a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f558800fa30 tx=0x7f5588015000 comp rx=0 tx=0).stop 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 -- 172.21.15.52:0/2739127257 shutdown_connections 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c0a0e00 0x563e5c0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c081210 0x563e5c075610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 --2- 172.21.15.52:0/2739127257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c07fa80 0x563e5c07a000 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 -- 172.21.15.52:0/2739127257 >> 172.21.15.52:0/2739127257 conn(0x563e5c07d240 msgr2=0x563e5c07a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 -- 172.21.15.52:0/2739127257 shutdown_connections 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.117+0000 7f559ec35740 1 -- 172.21.15.52:0/2739127257 wait complete. 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.118+0000 7f559ec35740 1 -- start start 2024-09-10T08:35:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.118+0000 7f559ec35740 1 Processor -- start 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c0c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c142340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f55941ff930 con 0x563e5c0a0e00 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563e5c0e8f90 con 0x563e5c07fa80 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563e5c0c0e20 con 0x563e5c081210 2024-09-10T08:35:51.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f559ec35740 10 client.0 _ll_register_callbacks cb 0x7f558c079d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f5599e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53886/0 (socket says 172.21.15.52:53886) 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f5599e00640 1 -- 172.21.15.52:0/1217039941 learned_addr learned my addr 172.21.15.52:0/1217039941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f5599400640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c0c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.119+0000 7f5598a00640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 -- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 msgr2=0x563e5c142340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c142340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 -- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 msgr2=0x563e5c0e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 -- 172.21.15.52:0/1217039941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5c0c0950 con 0x563e5c07fa80 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599e00640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:35:51.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f5599400640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c0c0410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x563e5c0d4d20 tx=0x7f5588004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f99a67eba9d3a063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f557a000640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558801b040 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f5588023440 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558801c040 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f5588023640 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.120+0000 7f559ec35740 10 client.7261 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563e5c142880 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558801c040 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f55880237e0 con 0x563e5c07fa80 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 10 client.7261 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 10 client.7261 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 20 client.7261 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c0e8b20 0x563e5c07a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 4 client.7261 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "perf dump"}) -- 0x563e5bfea270 con 0x563e5c0e8b20 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.121+0000 7f5598a00640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c0e8b20 0x563e5c07a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f5598a00640 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c0e8b20 0x563e5c07a570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e09a5739e8ceca server_cookie=c8f168b49e600048 in_seq=0 out_seq=0 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f557a000640 10 client.7261 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f557a000640 1 -- 172.21.15.52:0/1217039941 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17993 (crc 0 0 0) 0x563e5bfea270 con 0x563e5c0e8b20 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f557a000640 10 client.7261 handle_command_reply: tid=0 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 client.7261 shutdown 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 msgr2=0x563e5c0c0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c0c0410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x563e5c0d4d20 tx=0x7f5588004730 comp rx=0 tx=0).stop 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 shutdown_connections 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563e5c0e8b20 0x563e5c07a570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e5c0a0e00 0x563e5c0e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563e5c081210 0x563e5c142340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f557a000640 0 client.7261 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.122+0000 7f559ec35740 1 --2- 172.21.15.52:0/1217039941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563e5c07fa80 0x563e5c0c0410 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.123+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 >> 172.21.15.52:0/1217039941 conn(0x563e5c07d240 msgr2=0x563e5c0c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.123+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 shutdown_connections 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.123+0000 7f559ec35740 1 -- 172.21.15.52:0/1217039941 wait complete. 2024-09-10T08:35:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.123+0000 7f559ec35740 20 client.7261 trim_cache size 0 max 16384 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 26839, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 48758, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 9889940, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 36433302, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 10, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-10T08:35:51.128 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 4.656891737, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 2.665643677, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 3.042773778, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.023018882, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 48758, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.449650982, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000029731 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 71417, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.017466917, 2024-09-10T08:35:51.129 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000244 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 119632, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 21680 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1964, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1982, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 693122, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 31351490, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.288172607, 2024-09-10T08:35:51.130 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.149305793, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.050769670, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.071874124, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1981, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.248955794, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000125671 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T08:35:51.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 117136 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2225, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2225, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 559320, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 40201704, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.320447308, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.170686214, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.056562482, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.076483225, 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:35:51.132 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2224, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.522997969, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000235160 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T08:35:51.133 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1319, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 15.372570815, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.011654716 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:35:51.134 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1948, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.712921702, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000365976 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25724, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25724, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25724, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 337.564367647, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.013122545 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.135 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 19904, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 19904, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 19903, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T08:35:51.136 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 128, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 128, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 46803, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46265, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 112, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T08:35:51.137 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:35:51.138 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 598, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4021, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2599, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2020, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 57, 2024-09-10T08:35:51.139 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14096 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 2000, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4186, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 1874, 2024-09-10T08:35:51.140 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2242, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T08:35:51.141 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 24139, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 24139, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 31, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 31, 2024-09-10T08:35:51.142 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 3, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 93090884, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2607, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 106.554132469, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.040872317 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T08:35:51.143 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 2014, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2014, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 19904, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19905, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 1, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 128, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 8190, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 8062, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 112992, 2024-09-10T08:35:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28668, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25724, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 4, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.158784912, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001079392 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.145 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 30, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005658225, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000188607 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 7.367113679, 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001227852 2024-09-10T08:35:51.146 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7438, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.755939824, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000639411 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.147 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.148 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000050040, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000050040 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003857722, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.003857722 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.029443404, 2024-09-10T08:35:51.150 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.029443404 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000102008, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000102008 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.105663720, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.013207965 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2242, 2024-09-10T08:35:51.151 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 302.904113864, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.135104421 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.152 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.060875891, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.060875891 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.153 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000275847, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000275847 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T08:35:51.154 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.155 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 20.172488511, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002521561 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T08:35:51.156 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 17965, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 17965, 2024-09-10T08:35:51.157 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 62, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:35:51.158 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:35:51.159 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:35:51.160 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 16465966, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 6205, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5600, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 81, 2024-09-10T08:35:51.161 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 21906437, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 893144, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T08:35:51.162 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 4737, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 89375556, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 37, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 4737, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4737, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 35.523523971, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.007499160 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4737, 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4842 2024-09-10T08:35:51.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 4737, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 52, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 4685, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 52, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2659, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 34, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T08:35:51.164 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1874, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 33, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T08:35:51.165 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T08:35:51.166 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 111, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 3, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 130, 2024-09-10T08:35:51.167 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 27 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T08:35:51.168 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 1874, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 1874, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 31023, 2024-09-10T08:35:51.169 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 8345080, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 31023, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 31023, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8345080, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T08:35:51.170 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4737, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 89579822, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4737, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 89579822, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.171 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4737, 2024-09-10T08:35:51.172 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 4737, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4737, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 4737, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 1874, 2024-09-10T08:35:51.173 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 204266, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 1874, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 52, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 204266, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x55f2975ba500": { 2024-09-10T08:35:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 84, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 24139, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 88896580, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 24139, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2607, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 88896496, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:35:51.175 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:35:51.176 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.176 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.176 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:35:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.123+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 msgr2=0x7f557406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 0x7f557406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5588006fd0 tx=0x7f5588008040 comp rx=0 tx=0).stop 2024-09-10T08:35:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 msgr2=0x7f55941f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f558c009e50 tx=0x7f558c004a40 comp rx=0 tx=0).stop 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 shutdown_connections 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f557406be30 0x7f557406e2f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55940cd270 0x7f55941f47d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55940cce30 0x7f55941f4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 --2- 172.21.15.52:0/3638138701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55940732e0 0x7f55941e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 >> 172.21.15.52:0/3638138701 conn(0x7f559406d0f0 msgr2=0x7f559406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 shutdown_connections 2024-09-10T08:35:51.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.124+0000 7f559be00640 1 -- 172.21.15.52:0/3638138701 wait complete. 2024-09-10T08:35:51.179 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-10T08:35:51.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:35:51.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-10T08:35:51.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.341+0000 7fa9cb600640 1 Processor -- start 2024-09-10T08:35:51.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.341+0000 7fa9cb600640 1 -- start start 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 0x7fa9c40d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c40d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9c40d32e0 0x7fa9c4162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c40d1d00 con 0x7fa9c40d32e0 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c40d10f0 con 0x7fa9c415ea10 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9cb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40d13d0 con 0x7fa9c40b3fe0 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9c9600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9c40d32e0 0x7fa9c4162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9c9600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9c40d32e0 0x7fa9c4162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53894/0 (socket says 172.21.15.52:53894) 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9c9600640 1 -- 172.21.15.52:0/3880057890 learned_addr learned my addr 172.21.15.52:0/3880057890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c40d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.342+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/3880057890 >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 0x7fa9c40d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c9600640 1 -- 172.21.15.52:0/3880057890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 msgr2=0x7fa9c40d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c40d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c9600640 1 -- 172.21.15.52:0/3880057890 >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 msgr2=0x7fa9c40d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3880057890 >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 0x7fa9c40d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c9600640 1 -- 172.21.15.52:0/3880057890 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40d16b0 con 0x7fa9c40d32e0 2024-09-10T08:35:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.343+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/3880057890 >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 0x7fa9c40d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.344+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40d32e0 0x7fa9c4162450 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa9c408efc0 tx=0x7fa9bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7aeb524df3fca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.344+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3880057890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc036070 con 0x7fa9c40d32e0 2024-09-10T08:35:51.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.344+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3880057890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc031600 con 0x7fa9c40d32e0 2024-09-10T08:35:51.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.344+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3880057890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0319d0 con 0x7fa9c40d32e0 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 -- 172.21.15.52:0/3880057890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40d32e0 msgr2=0x7fa9c4162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40d32e0 0x7fa9c4162450 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa9c408efc0 tx=0x7fa9bc02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 -- 172.21.15.52:0/3880057890 shutdown_connections 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40d32e0 0x7fa9c4162450 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3880057890 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c40d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3880057890 >> v2:172.21.15.176:3300/0 conn(0x7fa9c415ea10 0x7fa9c40d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 -- 172.21.15.52:0/3880057890 >> 172.21.15.52:0/3880057890 conn(0x7fa9c409dd60 msgr2=0x7fa9c40d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 -- 172.21.15.52:0/3880057890 shutdown_connections 2024-09-10T08:35:51.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.345+0000 7fa9cb600640 1 -- 172.21.15.52:0/3880057890 wait complete. 2024-09-10T08:35:51.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.346+0000 7fa9cb600640 1 Processor -- start 2024-09-10T08:35:51.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 -- start start 2024-09-10T08:35:51.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40d32e0 0x7fa9c40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4162990 con 0x7fa9c415ea10 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40d2ae0 con 0x7fa9c40d32e0 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.347+0000 7fa9cb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c4162b10 con 0x7fa9c40b3fe0 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53904/0 (socket says 172.21.15.52:53904) 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 -- 172.21.15.52:0/3286325521 learned_addr learned my addr 172.21.15.52:0/3286325521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40d32e0 0x7fa9c40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 -- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 msgr2=0x7fa9c41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 -- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40d32e0 msgr2=0x7fa9c40b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40d32e0 0x7fa9c40b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 -- 172.21.15.52:0/3286325521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40cce60 con 0x7fa9c415ea10 2024-09-10T08:35:51.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.348+0000 7fa9c9600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034040 tx=0x7fa9bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.349+0000 7fa9c1600640 1 -- 172.21.15.52:0/3286325521 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc036050 con 0x7fa9c415ea10 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.349+0000 7fa9c1600640 1 -- 172.21.15.52:0/3286325521 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc042070 con 0x7fa9c415ea10 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.349+0000 7fa9c1600640 1 -- 172.21.15.52:0/3286325521 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc009510 con 0x7fa9c415ea10 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.349+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c40cd140 con 0x7fa9c415ea10 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.349+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c40cd700 con 0x7fa9c415ea10 2024-09-10T08:35:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.351+0000 7fa9c1600640 1 -- 172.21.15.52:0/3286325521 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9bc007bf0 con 0x7fa9c415ea10 2024-09-10T08:35:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.352+0000 7fa9c1600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 0x7fa9a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.352+0000 7fa9c1600640 1 -- 172.21.15.52:0/3286325521 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7fa9bc0abc90 con 0x7fa9c415ea10 2024-09-10T08:35:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.352+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 0x7fa9a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.352+0000 7fa9ce4c7740 1 Processor -- start 2024-09-10T08:35:51.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 -- start start 2024-09-10T08:35:51.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 0x7fa9a006e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4006fd0 tx=0x7fa9b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917dcec40 0x558917dcf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917deaba0 0x558917df2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558917d08970 con 0x558917de9460 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558917cb08d0 con 0x558917dcec40 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.353+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558917d04930 con 0x558917deaba0 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53912/0 (socket says 172.21.15.52:53912) 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 -- 172.21.15.52:0/2095586734 learned_addr learned my addr 172.21.15.52:0/2095586734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917dcec40 0x558917dcf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917deaba0 0x558917df2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 -- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917deaba0 msgr2=0x558917df2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917deaba0 0x558917df2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 -- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917dcec40 msgr2=0x558917dcf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917dcec40 0x558917dcf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 -- 172.21.15.52:0/2095586734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558917ae7a20 con 0x558917de9460 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.354+0000 7fa9c9600640 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc02ac90 tx=0x7fa9bc0093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745c1c65c52a2716 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9b9200640 1 -- 172.21.15.52:0/2095586734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc092020 con 0x558917de9460 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9b9200640 1 -- 172.21.15.52:0/2095586734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc037040 con 0x558917de9460 2024-09-10T08:35:51.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9b9200640 1 -- 172.21.15.52:0/2095586734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc07a6f0 con 0x558917de9460 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2095586734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 msgr2=0x558917df2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc02ac90 tx=0x7fa9bc0093a0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2095586734 shutdown_connections 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917df2990 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917deaba0 0x558917df2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2095586734 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917dcec40 0x558917dcf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2095586734 >> 172.21.15.52:0/2095586734 conn(0x558917da1500 msgr2=0x558917de9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2095586734 shutdown_connections 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.355+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2095586734 wait complete. 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.356+0000 7fa9ce4c7740 1 -- start start 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.356+0000 7fa9ce4c7740 1 Processor -- start 2024-09-10T08:35:51.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917dfd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de1280 0x558917de2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558917cb08d0 con 0x558917de9460 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x558917cc3af0 con 0x558917deaba0 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558917d08970 con 0x558917de1280 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9ce4c7740 10 client.0 _ll_register_callbacks cb 0x558917cb55d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.357+0000 7fa9c8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de1280 0x558917de2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53928/0 (socket says 172.21.15.52:53928) 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 -- 172.21.15.52:0/43054586 learned_addr learned my addr 172.21.15.52:0/43054586 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917dfd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 -- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de1280 msgr2=0x558917de2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de1280 0x558917de2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 -- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 msgr2=0x558917dfd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917dfd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 -- 172.21.15.52:0/43054586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589179db310 con 0x558917de9460 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4014490 tx=0x7fa9b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78db33939ac32759 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.358+0000 7fa9b1600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4025020 con 0x558917de9460 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9bc037040 con 0x558917de9460 2024-09-10T08:35:51.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7fa9b40158e0 con 0x558917de9460 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fa9b402f050 con 0x558917de9460 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 10 client.7728 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x558917b481b0 con 0x558917de9460 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc037040 con 0x558917de9460 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fa9b4032020 con 0x558917de9460 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 10 client.7728 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 10 client.7728 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 20 client.7728 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917dcc900 0x558917dccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 4 client.7728 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.359+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558917cdd100 con 0x558917dcc900 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.360+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917dcc900 0x558917dccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.360+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917dcc900 0x558917dccce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70b536214f4ff75 server_cookie=8b6e4e423ff0bfa4 in_seq=0 out_seq=0 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.360+0000 7fa9b1600640 10 client.7728 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9b1600640 1 -- 172.21.15.52:0/43054586 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558917cdd100 con 0x558917dcc900 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9b1600640 10 client.7728 handle_command_reply: tid=0 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 client.7728 shutdown 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 msgr2=0x558917dca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4014490 tx=0x7fa9b4004730 comp rx=0 tx=0).stop 2024-09-10T08:35:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 shutdown_connections 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917dcc900 0x558917dccce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de1280 0x558917de2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917dfd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/43054586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de9460 0x558917dca360 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 >> 172.21.15.52:0/43054586 conn(0x558917dcec40 msgr2=0x558917deb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9b1600640 0 client.7728 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 shutdown_connections 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.361+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/43054586 wait complete. 2024-09-10T08:35:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.362+0000 7fa9ce4c7740 20 client.7728 trim_cache size 0 max 16384 2024-09-10T08:35:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.380+0000 7fa9ce4c7740 1 Processor -- start 2024-09-10T08:35:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.380+0000 7fa9ce4c7740 1 -- start start 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 0x558917ddfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917de2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4201040 con 0x558917deaba0 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4200040 con 0x558917de1280 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40cc3b0 con 0x558917de9460 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53944/0 (socket says 172.21.15.52:53944) 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 -- 172.21.15.52:0/1606380605 learned_addr learned my addr 172.21.15.52:0/1606380605 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 0x558917ddfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917de2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 -- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 msgr2=0x558917de2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917de2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 -- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 msgr2=0x558917ddfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 0x558917ddfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c9600640 1 -- 172.21.15.52:0/1606380605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589179b43d0 con 0x558917deaba0 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917de2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.381+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 0x558917ddfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9c9600640 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc02ac90 tx=0x7fa9bc049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a9b773bbf1d901 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9b3e00640 1 -- 172.21.15.52:0/1606380605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc079ff0 con 0x558917deaba0 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9b3e00640 1 -- 172.21.15.52:0/1606380605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc088070 con 0x558917deaba0 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9b3e00640 1 -- 172.21.15.52:0/1606380605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc07e3a0 con 0x558917deaba0 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/1606380605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 msgr2=0x558917da4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.382+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc02ac90 tx=0x7fa9bc049000 comp rx=0 tx=0).stop 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/1606380605 shutdown_connections 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917deaba0 0x558917da4e00 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917de2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/1606380605 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917de1280 0x558917ddfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/1606380605 >> 172.21.15.52:0/1606380605 conn(0x558917dcec40 msgr2=0x558917d9a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/1606380605 shutdown_connections 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/1606380605 wait complete. 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 -- start start 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.383+0000 7fa9ce4c7740 1 Processor -- start 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917e676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917e68900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558917dfd0b0 con 0x558917de1280 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c41ffb40 con 0x558917deaba0 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x558917de0190 con 0x558917de9460 2024-09-10T08:35:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.384+0000 7fa9ce4c7740 10 client.0 _ll_register_callbacks cb 0x7fa9b400de20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53956/0 (socket says 172.21.15.52:53956) 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 -- 172.21.15.52:0/2260922719 learned_addr learned my addr 172.21.15.52:0/2260922719 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917e676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c9600640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917e68900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 -- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 msgr2=0x558917e676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917e676e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 -- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 msgr2=0x558917e68900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917e68900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 -- 172.21.15.52:0/2260922719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558917da58b0 con 0x558917de1280 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c9600640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917e68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9c8c00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d510 tx=0x7fa9b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b986fd113487e70e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9b1600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4025070 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.385+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7fa9b40158e0 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9bc088070 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fa9b403d050 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 10 client.7734 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x558917e692c0 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc088070 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fa9b4040020 con 0x558917de1280 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 10 client.7734 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 10 client.7734 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 20 client.7734 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917e68e40 0x558917dc9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 4 client.7734 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-10T08:35:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x558917d160a0 con 0x558917e68e40 2024-09-10T08:35:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.386+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917e68e40 0x558917dc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.387+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917e68e40 0x558917dc9f00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee3258629df1ae7 server_cookie=7a2059975b3431cf in_seq=0 out_seq=0 2024-09-10T08:35:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.387+0000 7fa9b1600640 10 client.7734 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9b1600640 1 -- 172.21.15.52:0/2260922719 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558917d160a0 con 0x558917e68e40 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9b1600640 10 client.7734 handle_command_reply: tid=0 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 client.7734 shutdown 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 msgr2=0x558917da5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d510 tx=0x7fa9b4014000 comp rx=0 tx=0).stop 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 shutdown_connections 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x558917e68e40 0x558917dc9f00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x558917deaba0 0x558917e68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x558917de9460 0x558917e676e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 --2- 172.21.15.52:0/2260922719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558917de1280 0x558917da5370 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 >> 172.21.15.52:0/2260922719 conn(0x558917dcec40 msgr2=0x558917dccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9b1600640 0 client.7734 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 shutdown_connections 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.399+0000 7fa9ce4c7740 1 -- 172.21.15.52:0/2260922719 wait complete. 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9ce4c7740 20 client.7734 trim_cache size 0 max 16384 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b1848dd1-ea0f-417c-b0e9-36d35ed7e66e", 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:35:51.401 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:35:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 msgr2=0x7fa9a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 0x7fa9a006e320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4006fd0 tx=0x7fa9b4008040 comp rx=0 tx=0).stop 2024-09-10T08:35:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 msgr2=0x7fa9c40c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034040 tx=0x7fa9bc004a40 comp rx=0 tx=0).stop 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 shutdown_connections 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be60 0x7fa9a006e320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c415ea10 0x7fa9c40c8210 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40d32e0 0x7fa9c40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 --2- 172.21.15.52:0/3286325521 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c40b3fe0 0x7fa9c41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.400+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 >> 172.21.15.52:0/3286325521 conn(0x7fa9c409dd60 msgr2=0x7fa9c40b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.401+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 shutdown_connections 2024-09-10T08:35:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.401+0000 7fa9cb600640 1 -- 172.21.15.52:0/3286325521 wait complete. 2024-09-10T08:35:51.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:35:51.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T08:35:51.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.652+0000 7f37f1000640 1 Processor -- start 2024-09-10T08:35:51.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.652+0000 7f37f1000640 1 -- start start 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37f1000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37ec0d32c0 0x7f37ec0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37f1000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37ec0b7c10 0x7f37ec0b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37f1000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37ec0d36e0 con 0x7f37ec0b5fd0 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37f1000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec0d3950 con 0x7f37ec0b7c10 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37f1000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec0d3c30 con 0x7f37ec0d32c0 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37ebe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37ec0b7c10 0x7f37ec0b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37ebe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f37ec0b7c10 0x7f37ec0b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53970/0 (socket says 172.21.15.52:53970) 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37eb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f37ec0b5fd0 0x7f37ec0b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33182/0 (socket says 172.21.15.52:33182) 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.653+0000 7f37ebe00640 1 -- 172.21.15.52:0/2343840015 learned_addr learned my addr 172.21.15.52:0/2343840015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37eaa00640 1 --2- 172.21.15.52:0/2343840015 >> v2:172.21.15.176:3300/0 conn(0x7f37ec0d32c0 0x7f37ec0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37ebe00640 1 -- 172.21.15.52:0/2343840015 >> v2:172.21.15.176:3300/0 conn(0x7f37ec0d32c0 msgr2=0x7f37ec0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37ebe00640 1 --2- 172.21.15.52:0/2343840015 >> v2:172.21.15.176:3300/0 conn(0x7f37ec0d32c0 0x7f37ec0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37ebe00640 1 -- 172.21.15.52:0/2343840015 >> v1:172.21.15.52:6789/0 conn(0x7f37ec0b5fd0 legacy=0x7f37ec0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37ebe00640 1 -- 172.21.15.52:0/2343840015 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec0d3f10 con 0x7f37ec0b7c10 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.654+0000 7f37ea000640 1 -- 172.21.15.52:0/2343840015 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288928995 0 0) 0x7f37ec0d36e0 con 0x7f37ec0b5fd0 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.655+0000 7f37ebe00640 1 --2- 172.21.15.52:0/2343840015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0b7c10 0x7f37ec0b80a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f37ec161fa0 tx=0x7f37e402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582f797648e220cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.655+0000 7f37ea000640 1 -- 172.21.15.52:0/2343840015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4036070 con 0x7f37ec0b7c10 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.655+0000 7f37ea000640 1 -- 172.21.15.52:0/2343840015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4031600 con 0x7f37ec0b7c10 2024-09-10T08:35:51.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.655+0000 7f37ea000640 1 -- 172.21.15.52:0/2343840015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40319f0 con 0x7f37ec0b7c10 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 -- 172.21.15.52:0/2343840015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0b7c10 msgr2=0x7f37ec0b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 --2- 172.21.15.52:0/2343840015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0b7c10 0x7f37ec0b80a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f37ec161fa0 tx=0x7f37e402a7c0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 -- 172.21.15.52:0/2343840015 shutdown_connections 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 --2- 172.21.15.52:0/2343840015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0b7c10 0x7f37ec0b80a0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 --2- 172.21.15.52:0/2343840015 >> v2:172.21.15.176:3300/0 conn(0x7f37ec0d32c0 0x7f37ec0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 -- 172.21.15.52:0/2343840015 >> 172.21.15.52:0/2343840015 conn(0x7f37ec0d0fd0 msgr2=0x7f37ec0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 -- 172.21.15.52:0/2343840015 shutdown_connections 2024-09-10T08:35:51.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.656+0000 7f37f1000640 1 -- 172.21.15.52:0/2343840015 wait complete. 2024-09-10T08:35:51.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.658+0000 7f37f1000640 1 Processor -- start 2024-09-10T08:35:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.658+0000 7f37f1000640 1 -- start start 2024-09-10T08:35:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 0x7f37ec153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 0x7f37ec1f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0cfb90 con 0x7f37ec0d32c0 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0b7680 con 0x7f37ec0b5fd0 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37f1000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec0cfd10 con 0x7f37ec0b7c10 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53972/0 (socket says 172.21.15.52:53972) 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 -- 172.21.15.52:0/898612951 learned_addr learned my addr 172.21.15.52:0/898612951 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37eb400640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 0x7f37ec153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37eaa00640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 0x7f37ec1f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 -- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 msgr2=0x7f37ec1f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 0x7f37ec1f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 -- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 msgr2=0x7f37ec153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 0x7f37ec153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.659+0000 7f37ebe00640 1 -- 172.21.15.52:0/898612951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec15f5d0 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37eaa00640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 0x7f37ec1f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37eb400640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 0x7f37ec153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37ebe00640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009f40 tx=0x7f37e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37e3400640 1 -- 172.21.15.52:0/898612951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4041020 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37e3400640 1 -- 172.21.15.52:0/898612951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4007820 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37e3400640 1 -- 172.21.15.52:0/898612951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4036040 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec15f8b0 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.660+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec15fe70 con 0x7f37ec0d32c0 2024-09-10T08:35:51.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.662+0000 7f37e3400640 1 -- 172.21.15.52:0/898612951 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37e4044020 con 0x7f37ec0d32c0 2024-09-10T08:35:51.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.663+0000 7f37e3400640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 0x7f37cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.663+0000 7f37e3400640 1 -- 172.21.15.52:0/898612951 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f37e40abbc0 con 0x7f37ec0d32c0 2024-09-10T08:35:51.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.664+0000 7f37eb400640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 0x7f37cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.664+0000 7f37f53c1740 1 Processor -- start 2024-09-10T08:35:51.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.664+0000 7f37f53c1740 1 -- start start 2024-09-10T08:35:51.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37eb400640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 0x7f37cc06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f37dc000f60 tx=0x7f37dc007c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f24942d9e0 0x55f24942c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249477ea0 0x55f2494783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f249395660 con 0x55f2494474f0 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f24933d680 con 0x55f24942d9e0 2024-09-10T08:35:51.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f249391620 con 0x55f249477ea0 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53980/0 (socket says 172.21.15.52:53980) 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37eb400640 1 -- 172.21.15.52:0/1576441796 learned_addr learned my addr 172.21.15.52:0/1576441796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.665+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f24942d9e0 0x55f24942c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37ebe00640 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249477ea0 0x55f2494783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 -- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249477ea0 msgr2=0x55f2494783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249477ea0 0x55f2494783f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 -- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f24942d9e0 msgr2=0x55f24942c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f24942d9e0 0x55f24942c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 -- 172.21.15.52:0/1576441796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2491727d0 con 0x55f2494474f0 2024-09-10T08:35:51.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37eb400640 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f37dc005df0 tx=0x7f37dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d8d1169bb0aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37d7e00640 1 -- 172.21.15.52:0/1576441796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc005e20 con 0x55f2494474f0 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37d7e00640 1 -- 172.21.15.52:0/1576441796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc0159c0 con 0x55f2494474f0 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.666+0000 7f37d7e00640 1 -- 172.21.15.52:0/1576441796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc015d70 con 0x55f2494474f0 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 -- 172.21.15.52:0/1576441796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 msgr2=0x55f2494478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f37dc005df0 tx=0x7f37dc012000 comp rx=0 tx=0).stop 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 -- 172.21.15.52:0/1576441796 shutdown_connections 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249477ea0 0x55f2494783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f24942d9e0 0x55f24942c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1576441796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f2494478d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 -- 172.21.15.52:0/1576441796 >> 172.21.15.52:0/1576441796 conn(0x55f24942e410 msgr2=0x55f249476a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 -- 172.21.15.52:0/1576441796 shutdown_connections 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.667+0000 7f37f53c1740 1 -- 172.21.15.52:0/1576441796 wait complete. 2024-09-10T08:35:51.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.668+0000 7f37f53c1740 1 -- start start 2024-09-10T08:35:51.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.668+0000 7f37f53c1740 1 Processor -- start 2024-09-10T08:35:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24945cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f2494861b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f24942c940 con 0x55f249477ea0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f24931e4c0 con 0x55f249471fb0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f24942cc20 con 0x55f2494474f0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37f53c1740 10 client.0 _ll_register_callbacks cb 0x55f24938de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53982/0 (socket says 172.21.15.52:53982) 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37eaa00640 1 -- 172.21.15.52:0/1930715776 learned_addr learned my addr 172.21.15.52:0/1930715776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37eb400640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24945cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.669+0000 7f37ebe00640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f2494861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 -- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 msgr2=0x55f24945cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24945cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 -- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 msgr2=0x55f2494861b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f2494861b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 -- 172.21.15.52:0/1930715776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2490a83f0 con 0x55f249477ea0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37ebe00640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f2494861b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eb400640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24945cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f37d8014430 tx=0x7f37d80148f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff69cba4f7fe1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003610 con 0x55f249477ea0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f37d80037b0 con 0x55f249477ea0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37dc0159c0 con 0x55f249477ea0 2024-09-10T08:35:51.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f37d8026050 con 0x55f249477ea0 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37f53c1740 10 client.7749 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.670+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55f2490680f0 con 0x55f249477ea0 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc0159c0 con 0x55f249477ea0 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f37d8029020 con 0x55f249477ea0 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 10 client.7749 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 10 client.7749 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 20 client.7749 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24946cc30 0x55f24946d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 4 client.7749 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2493a2d90 con 0x55f24946cc30 2024-09-10T08:35:51.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.671+0000 7f37eb400640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24946cc30 0x55f24946d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.672+0000 7f37eb400640 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24946cc30 0x55f24946d040 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9ba80257f93bc3 server_cookie=aafcede35adaead8 in_seq=0 out_seq=0 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.672+0000 7f37d4c00640 10 client.7749 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.672+0000 7f37d4c00640 1 -- 172.21.15.52:0/1930715776 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2493a2d90 con 0x55f24946cc30 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.672+0000 7f37d4c00640 10 client.7749 handle_command_reply: tid=0 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.672+0000 7f37f53c1740 1 client.7749 shutdown 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 msgr2=0x55f249471a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f37d8014430 tx=0x7f37d80148f0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 shutdown_connections 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24946cc30 0x55f24946d040 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f2494861b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249471a70 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1930715776 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24945cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37d4c00640 0 client.7749 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 >> 172.21.15.52:0/1930715776 conn(0x55f24942d9e0 msgr2=0x55f24942b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 shutdown_connections 2024-09-10T08:35:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 1 -- 172.21.15.52:0/1930715776 wait complete. 2024-09-10T08:35:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.673+0000 7f37f53c1740 20 client.7749 trim_cache size 0 max 16384 2024-09-10T08:35:51.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.691+0000 7f37f53c1740 1 Processor -- start 2024-09-10T08:35:51.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.691+0000 7f37f53c1740 1 -- start start 2024-09-10T08:35:51.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24942b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f249445ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec200910 con 0x55f249477ea0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0cdfc0 con 0x55f249471fb0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec0cc340 con 0x55f2494474f0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37ebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53992/0 (socket says 172.21.15.52:53992) 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37ebe00640 1 -- 172.21.15.52:0/91373583 learned_addr learned my addr 172.21.15.52:0/91373583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37eaa00640 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f249445ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.692+0000 7f37eb400640 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24942b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 -- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 msgr2=0x55f24942b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24942b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 -- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 msgr2=0x55f249445ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f249445ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 -- 172.21.15.52:0/91373583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f24920b980 con 0x55f249477ea0 2024-09-10T08:35:51.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37ebe00640 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f37e402adb0 tx=0x7f37e4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1002da56968db294 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37d7400640 1 -- 172.21.15.52:0/91373583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4096070 con 0x55f249477ea0 2024-09-10T08:35:51.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37d7400640 1 -- 172.21.15.52:0/91373583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e40a7070 con 0x55f249477ea0 2024-09-10T08:35:51.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.693+0000 7f37d7400640 1 -- 172.21.15.52:0/91373583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e407d040 con 0x55f249477ea0 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 -- 172.21.15.52:0/91373583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 msgr2=0x55f249446000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f37e402adb0 tx=0x7f37e4009510 comp rx=0 tx=0).stop 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 -- 172.21.15.52:0/91373583 shutdown_connections 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f249477ea0 0x55f249446000 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249471fb0 0x55f249445ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 --2- 172.21.15.52:0/91373583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f2494474f0 0x55f24942b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 -- 172.21.15.52:0/91373583 >> 172.21.15.52:0/91373583 conn(0x55f24942d9e0 msgr2=0x55f24945ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 -- 172.21.15.52:0/91373583 shutdown_connections 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.694+0000 7f37f53c1740 1 -- 172.21.15.52:0/91373583 wait complete. 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.695+0000 7f37f53c1740 1 -- start start 2024-09-10T08:35:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.695+0000 7f37f53c1740 1 Processor -- start 2024-09-10T08:35:51.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249471fb0 0x55f2494db270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249477ea0 0x55f24945c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f24946dcf0 con 0x55f2494474f0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0cd970 con 0x55f249477ea0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f249446b60 con 0x55f249471fb0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37f53c1740 10 client.0 _ll_register_callbacks cb 0x7f37d8009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37eaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249471fb0 0x55f2494db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54006/0 (socket says 172.21.15.52:54006) 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37eb400640 1 -- 172.21.15.52:0/1766051279 learned_addr learned my addr 172.21.15.52:0/1766051279 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.696+0000 7f37ebe00640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249477ea0 0x55f24945c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 -- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249471fb0 msgr2=0x55f2494db270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249471fb0 0x55f2494db270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 -- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249477ea0 msgr2=0x55f24945c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:35:51.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249477ea0 0x55f24945c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 -- 172.21.15.52:0/1766051279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f249432710 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37eb400640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f37dc005dc0 tx=0x7f37dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76806805f68be07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc015b50 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37e40a7070 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5796+0+0 (secure 0 0 0) 0x7f37dc015cf0 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f37dc037050 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37f53c1740 10 client.7755 fetch_fsmap learned FSMap version 84 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.697+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55f2494db7b0 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e40a7070 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f37dc03a020 con 0x55f2494474f0 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 10 client.7755 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 10 client.7755 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:35:51.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 20 client.7755 populate_metadata read hostname 'smithi052' 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24945cf10 0x55f249445ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 4 client.7755 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f24939d0e0 con 0x55f24945cf10 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.698+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24945cf10 0x55f249445ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37eaa00640 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24945cf10 0x55f249445ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab4e3e2f0e72c37e server_cookie=84e994647276a66e in_seq=0 out_seq=0 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37d4c00640 10 client.7755 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37d4c00640 1 -- 172.21.15.52:0/1766051279 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55f24939d0e0 con 0x55f24945cf10 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37d4c00640 10 client.7755 handle_command_reply: tid=0 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 client.7755 shutdown 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 msgr2=0x55f249496940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f37dc005dc0 tx=0x7f37dc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 shutdown_connections 2024-09-10T08:35:51.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x55f24945cf10 0x55f249445ac0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f249477ea0 0x55f24945c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f249471fb0 0x55f2494db270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 --2- 172.21.15.52:0/1766051279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2494474f0 0x55f249496940 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 >> 172.21.15.52:0/1766051279 conn(0x55f24942d9e0 msgr2=0x55f249446d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37d4c00640 0 client.7755 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 shutdown_connections 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 1 -- 172.21.15.52:0/1766051279 wait complete. 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.699+0000 7f37f53c1740 20 client.7755 trim_cache size 0 max 16384 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:35:51.704 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: "b1848dd1-ea0f-417c-b0e9-36d35ed7e66e": { 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "~mds0", 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "b1848dd1-ea0f-417c-b0e9-36d35ed7e66e", 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:35:51.705 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 msgr2=0x7f37cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 0x7f37cc06e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f37dc000f60 tx=0x7f37dc007c30 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 msgr2=0x7f37ec0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009f40 tx=0x7f37e4004a40 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 shutdown_connections 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f37cc06be30 0x7f37cc06e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37ec0d32c0 0x7f37ec0c9790 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37ec0b7c10 0x7f37ec1f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 --2- 172.21.15.52:0/898612951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37ec0b5fd0 0x7f37ec153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:35:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 >> 172.21.15.52:0/898612951 conn(0x7f37ec0d0fd0 msgr2=0x7f37ec0b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:35:51.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 shutdown_connections 2024-09-10T08:35:51.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:35:51.700+0000 7f37f1000640 1 -- 172.21.15.52:0/898612951 wait complete. 2024-09-10T08:35:51.715 INFO:tasks.cephfs.filesystem:scrub status for tag:b1848dd1-ea0f-417c-b0e9-36d35ed7e66e - {'path': '~mds0', 'tag': 'b1848dd1-ea0f-417c-b0e9-36d35ed7e66e', 'options': 'recursive'} 2024-09-10T08:36:06.922 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:06.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:21.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:21.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-10T08:36:21.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.891+0000 7f1553e00640 1 Processor -- start 2024-09-10T08:36:21.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.891+0000 7f1553e00640 1 -- start start 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15540b5fd0 0x7f15540d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 0x7f15540cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15540d3950 con 0x7f1554067950 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f15540d3c30 con 0x7f15540b5fd0 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f15540d3f10 con 0x7f15540b63b0 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1552a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15540b5fd0 0x7f15540d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1552a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15540b5fd0 0x7f15540d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60636/0 (socket says 172.21.15.52:60636) 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1552a00640 1 -- 172.21.15.52:0/3696647817 learned_addr learned my addr 172.21.15.52:0/3696647817 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.892+0000 7f1553400640 1 --1- 172.21.15.52:0/3696647817 >> v1:172.21.15.52:6789/0 conn(0x7f1554067950 0x7f1554067e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43784/0 (socket says 172.21.15.52:43784) 2024-09-10T08:36:21.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552000640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 0x7f15540cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552a00640 1 -- 172.21.15.52:0/3696647817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 msgr2=0x7f15540cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552a00640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 0x7f15540cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552a00640 1 -- 172.21.15.52:0/3696647817 >> v1:172.21.15.52:6789/0 conn(0x7f1554067950 legacy=0x7f1554067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552a00640 1 -- 172.21.15.52:0/3696647817 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540d41f0 con 0x7f15540b5fd0 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1551600640 1 -- 172.21.15.52:0/3696647817 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333046872 0 0) 0x7f15540d3950 con 0x7f1554067950 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.893+0000 7f1552000640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 0x7f15540cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.894+0000 7f1552a00640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540b5fd0 0x7f15540d32c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f154402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c491a8775b75d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.894+0000 7f1551600640 1 -- 172.21.15.52:0/3696647817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544037070 con 0x7f15540b5fd0 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.894+0000 7f1551600640 1 -- 172.21.15.52:0/3696647817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154402ae50 con 0x7f15540b5fd0 2024-09-10T08:36:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.894+0000 7f1551600640 1 -- 172.21.15.52:0/3696647817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544032860 con 0x7f15540b5fd0 2024-09-10T08:36:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 -- 172.21.15.52:0/3696647817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540b5fd0 msgr2=0x7f15540d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540b5fd0 0x7f15540d32c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f1544009870 tx=0x7f154402a300 comp rx=0 tx=0).stop 2024-09-10T08:36:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 -- 172.21.15.52:0/3696647817 shutdown_connections 2024-09-10T08:36:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b63b0 0x7f15540cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 --2- 172.21.15.52:0/3696647817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15540b5fd0 0x7f15540d32c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 -- 172.21.15.52:0/3696647817 >> 172.21.15.52:0/3696647817 conn(0x7f15540d0fd0 msgr2=0x7f15540d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 -- 172.21.15.52:0/3696647817 shutdown_connections 2024-09-10T08:36:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.895+0000 7f1553e00640 1 -- 172.21.15.52:0/3696647817 wait complete. 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.896+0000 7f1553e00640 1 Processor -- start 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 -- start start 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b5fd0 0x7f15540c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15540b63b0 0x7f15540b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15540cfd10 con 0x7f1554067950 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15540cfb90 con 0x7f15540b63b0 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.897+0000 7f1553e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f15540b67d0 con 0x7f15540b5fd0 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60646/0 (socket says 172.21.15.52:60646) 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 -- 172.21.15.52:0/536437146 learned_addr learned my addr 172.21.15.52:0/536437146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 -- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b5fd0 msgr2=0x7f15540c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b5fd0 0x7f15540c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 -- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15540b63b0 msgr2=0x7f15540b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15540b63b0 0x7f15540b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 -- 172.21.15.52:0/536437146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15540c8120 con 0x7f1554067950 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f1552a00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1544000c00 tx=0x7f15440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.898+0000 7f154aa00640 1 -- 172.21.15.52:0/536437146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544041020 con 0x7f1554067950 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.899+0000 7f154aa00640 1 -- 172.21.15.52:0/536437146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154403c890 con 0x7f1554067950 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.899+0000 7f154aa00640 1 -- 172.21.15.52:0/536437146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544037040 con 0x7f1554067950 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.899+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15540c8400 con 0x7f1554067950 2024-09-10T08:36:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.899+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15540c89c0 con 0x7f1554067950 2024-09-10T08:36:21.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.901+0000 7f154aa00640 1 -- 172.21.15.52:0/536437146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1544044020 con 0x7f1554067950 2024-09-10T08:36:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.902+0000 7f154aa00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 0x7f153406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.902+0000 7f154aa00640 1 -- 172.21.15.52:0/536437146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f15440ab840 con 0x7f1554067950 2024-09-10T08:36:21.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.903+0000 7f1552000640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 0x7f153406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.903+0000 7f155c7db740 1 Processor -- start 2024-09-10T08:36:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.903+0000 7f155c7db740 1 -- start start 2024-09-10T08:36:21.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.903+0000 7f1552000640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 0x7f153406e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1540006fd0 tx=0x7f1540008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 0x564a4358f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a434f8660 con 0x564a435aa4f0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564a434a0680 con 0x564a435909e0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564a434f4620 con 0x564a435daea0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60650/0 (socket says 172.21.15.52:60650) 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 -- 172.21.15.52:0/3789624592 learned_addr learned my addr 172.21.15.52:0/3789624592 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552000640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 0x564a4358f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1553400640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 -- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 msgr2=0x564a435db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435db3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 -- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 msgr2=0x564a4358f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 0x564a4358f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.904+0000 7f1552a00640 1 -- 172.21.15.52:0/3789624592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a432d57d0 con 0x564a435aa4f0 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f1552000640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 0x564a4358f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f1553400640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435db3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f1552a00640 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1544075ef0 tx=0x7f1544079990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663e1bc8d62d5293 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f153f400640 1 -- 172.21.15.52:0/3789624592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154407de40 con 0x564a435aa4f0 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f153f400640 1 -- 172.21.15.52:0/3789624592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154402ae50 con 0x564a435aa4f0 2024-09-10T08:36:21.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.905+0000 7f153f400640 1 -- 172.21.15.52:0/3789624592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544082670 con 0x564a435aa4f0 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- 172.21.15.52:0/3789624592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 msgr2=0x564a435aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f1544075ef0 tx=0x7f1544079990 comp rx=0 tx=0).stop 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- 172.21.15.52:0/3789624592 shutdown_connections 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435db3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435909e0 0x564a4358f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 --2- 172.21.15.52:0/3789624592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435aa8d0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- 172.21.15.52:0/3789624592 >> 172.21.15.52:0/3789624592 conn(0x564a43591410 msgr2=0x564a435d9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- 172.21.15.52:0/3789624592 shutdown_connections 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- 172.21.15.52:0/3789624592 wait complete. 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.906+0000 7f155c7db740 1 -- start start 2024-09-10T08:36:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.907+0000 7f155c7db740 1 Processor -- start 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.907+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 0x564a435d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435d6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a434f8660 con 0x564a435ed5d0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564a434814c0 con 0x564a435aa4f0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564a4358f940 con 0x564a435daea0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f155c7db740 10 client.0 _ll_register_callbacks cb 0x564a434f0e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60662/0 (socket says 172.21.15.52:60662) 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 -- 172.21.15.52:0/1223132328 learned_addr learned my addr 172.21.15.52:0/1223132328 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1552a00640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 0x564a435d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1552000640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 -- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 msgr2=0x564a435d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435d6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 -- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 msgr2=0x564a435d4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 0x564a435d4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1553400640 1 -- 172.21.15.52:0/1223132328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4320b3f0 con 0x564a435ed5d0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1552a00640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 0x564a435d4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.908+0000 7f1552000640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435d6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1553400640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d460 tx=0x7f154c00d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7093f3a2c07291d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c019060 con 0x564a435ed5d0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f154402ae50 con 0x564a435ed5d0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f154c014b90 con 0x564a435ed5d0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f154c014d90 con 0x564a435ed5d0 2024-09-10T08:36:21.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 10 client.7770 fetch_fsmap learned FSMap version 84 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x564a431cb0f0 con 0x564a435ed5d0 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f154402ae50 con 0x564a435ed5d0 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f154c0070d0 con 0x564a435ed5d0 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 10 client.7770 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 10 client.7770 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.909+0000 7f155c7db740 20 client.7770 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d0d60 0x564a435d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f155c7db740 4 client.7770 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a43505d90 con 0x564a435d0d60 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f1552a00640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d0d60 0x564a435d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f1552a00640 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d0d60 0x564a435d1140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30b03ec6c312afc4 server_cookie=d47a94dda59fcaf7 in_seq=0 out_seq=0 2024-09-10T08:36:21.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.910+0000 7f1533e00640 10 client.7770 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f1533e00640 1 -- 172.21.15.52:0/1223132328 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a43505d90 con 0x564a435d0d60 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f1533e00640 10 client.7770 handle_command_reply: tid=0 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 client.7770 shutdown 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 msgr2=0x564a435cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d460 tx=0x7f154c00d920 comp rx=0 tx=0).stop 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 shutdown_connections 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d0d60 0x564a435d1140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435cf7d0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a435d6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 --2- 172.21.15.52:0/1223132328 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435aa4f0 0x564a435d4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f1533e00640 0 client.7770 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 >> 172.21.15.52:0/1223132328 conn(0x564a435909e0 msgr2=0x564a4358fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.911+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 shutdown_connections 2024-09-10T08:36:21.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.912+0000 7f155c7db740 1 -- 172.21.15.52:0/1223132328 wait complete. 2024-09-10T08:36:21.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.912+0000 7f155c7db740 20 client.7770 trim_cache size 0 max 16384 2024-09-10T08:36:21.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.930+0000 7f155c7db740 1 Processor -- start 2024-09-10T08:36:21.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.930+0000 7f155c7db740 1 -- start start 2024-09-10T08:36:21.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.930+0000 7f155c7db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.930+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a4358fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435ed5d0 0x564a43590370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f155c7db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1554200af0 con 0x564a435aa4f0 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15541ffb10 con 0x564a435ed5d0 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1554155700 con 0x564a435daea0 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60664/0 (socket says 172.21.15.52:60664) 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 -- 172.21.15.52:0/3213416810 learned_addr learned my addr 172.21.15.52:0/3213416810 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 -- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 msgr2=0x564a4358fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a4358fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 -- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435ed5d0 msgr2=0x564a43590370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435ed5d0 0x564a43590370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 -- 172.21.15.52:0/3213416810 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4358e9c0 con 0x564a435aa4f0 2024-09-10T08:36:21.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.931+0000 7f1552a00640 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1544075ef0 tx=0x7f1544047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b08dbba1900b344 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f153ea00640 1 -- 172.21.15.52:0/3213416810 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544077b30 con 0x564a435aa4f0 2024-09-10T08:36:21.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f153ea00640 1 -- 172.21.15.52:0/3213416810 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1544077d90 con 0x564a435aa4f0 2024-09-10T08:36:21.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f153ea00640 1 -- 172.21.15.52:0/3213416810 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544079cf0 con 0x564a435aa4f0 2024-09-10T08:36:21.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 -- 172.21.15.52:0/3213416810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 msgr2=0x564a435d2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1544075ef0 tx=0x7f1544047000 comp rx=0 tx=0).stop 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 -- 172.21.15.52:0/3213416810 shutdown_connections 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435ed5d0 0x564a43590370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435daea0 0x564a4358fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 --2- 172.21.15.52:0/3213416810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435aa4f0 0x564a435d2230 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 -- 172.21.15.52:0/3213416810 >> 172.21.15.52:0/3213416810 conn(0x564a435909e0 msgr2=0x564a435d70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 -- 172.21.15.52:0/3213416810 shutdown_connections 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.932+0000 7f155c7db740 1 -- 172.21.15.52:0/3213416810 wait complete. 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.933+0000 7f155c7db740 1 -- start start 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.933+0000 7f155c7db740 1 Processor -- start 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435aa4f0 0x564a43590020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435daea0 0x564a435d8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1554155d50 con 0x564a435ed5d0 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564a43592370 con 0x564a435daea0 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564a4365bef0 con 0x564a435aa4f0 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.934+0000 7f155c7db740 10 client.0 _ll_register_callbacks cb 0x7f154c001630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:21.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60680/0 (socket says 172.21.15.52:60680) 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 -- 172.21.15.52:0/3840033217 learned_addr learned my addr 172.21.15.52:0/3840033217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1552a00640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435aa4f0 0x564a43590020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1552000640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435daea0 0x564a435d8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 -- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435aa4f0 msgr2=0x564a43590020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435aa4f0 0x564a43590020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 -- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435daea0 msgr2=0x564a435d8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435daea0 0x564a435d8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 -- 172.21.15.52:0/3840033217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a435ec170 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1553400640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f154c002160 tx=0x7f154c001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1998acf306a2b326 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1533e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.935+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c0079a0 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f154c024040 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1544077d90 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f154c033050 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 10 client.7776 fetch_fsmap learned FSMap version 84 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x564a43590560 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1544077d90 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f154c036020 con 0x564a435ed5d0 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 10 client.7776 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 10 client.7776 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:36:21.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 20 client.7776 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d8690 0x564a435fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 4 client.7776 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a435000e0 con 0x564a435d8690 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.936+0000 7f1552a00640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d8690 0x564a435fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f1552a00640 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d8690 0x564a435fdde0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5b6eddda2a07fd server_cookie=3666b7d5c9c460f6 in_seq=0 out_seq=0 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f1533e00640 10 client.7776 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f1533e00640 1 -- 172.21.15.52:0/3840033217 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564a435000e0 con 0x564a435d8690 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f1533e00640 10 client.7776 handle_command_reply: tid=0 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 client.7776 shutdown 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 msgr2=0x564a435fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f154c002160 tx=0x7f154c001400 comp rx=0 tx=0).stop 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 shutdown_connections 2024-09-10T08:36:21.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x564a435d8690 0x564a435fdde0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a435ed5d0 0x564a435fd8a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564a435daea0 0x564a435d8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 --2- 172.21.15.52:0/3840033217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564a435aa4f0 0x564a43590020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f1533e00640 0 client.7776 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.937+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 >> 172.21.15.52:0/3840033217 conn(0x564a435909e0 msgr2=0x564a435d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 shutdown_connections 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f155c7db740 1 -- 172.21.15.52:0/3840033217 wait complete. 2024-09-10T08:36:21.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f155c7db740 20 client.7776 trim_cache size 0 max 16384 2024-09-10T08:36:21.945 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:36:21.945 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:36:21.945 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:36:21.945 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:36:21.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 msgr2=0x7f153406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 0x7f153406e2f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1540006fd0 tx=0x7f1540008040 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 msgr2=0x7f15541547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f1544000c00 tx=0x7f15440046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 shutdown_connections 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f153406be30 0x7f153406e2f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15540b63b0 0x7f15540b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15540b5fd0 0x7f15540c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 --2- 172.21.15.52:0/536437146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1554067950 0x7f15541547a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 >> 172.21.15.52:0/536437146 conn(0x7f15540d0fd0 msgr2=0x7f155415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.938+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 shutdown_connections 2024-09-10T08:36:21.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:21.939+0000 7f1553e00640 1 -- 172.21.15.52:0/536437146 wait complete. 2024-09-10T08:36:21.954 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:36:21.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-10T08:36:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.112+0000 7ffa88800640 1 Processor -- start 2024-09-10T08:36:22.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.113+0000 7ffa88800640 1 -- start start 2024-09-10T08:36:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa88800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa800736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa88800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa800cd270 0x7ffa8015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa88800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa800714b0 con 0x7ffa800cce30 2024-09-10T08:36:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa88800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffa80073c00 con 0x7ffa800cd270 2024-09-10T08:36:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa88800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800cd880 con 0x7ffa800732e0 2024-09-10T08:36:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa85400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ffa800cce30 0x7ffa80071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43792/0 (socket says 172.21.15.52:43792) 2024-09-10T08:36:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa85400640 1 -- 172.21.15.52:0/1184649191 learned_addr learned my addr 172.21.15.52:0/1184649191 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:22.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa86800640 1 --2- 172.21.15.52:0/1184649191 >> v2:172.21.15.52:3300/0 conn(0x7ffa800cd270 0x7ffa8015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.114+0000 7ffa85e00640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa800736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa84a00640 1 -- 172.21.15.52:0/1184649191 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294355030 0 0) 0x7ffa800714b0 con 0x7ffa800cce30 2024-09-10T08:36:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa84a00640 1 -- 172.21.15.52:0/1184649191 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa68003520 con 0x7ffa800cce30 2024-09-10T08:36:22.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa86800640 1 -- 172.21.15.52:0/1184649191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 msgr2=0x7ffa800736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa86800640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa800736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa86800640 1 -- 172.21.15.52:0/1184649191 >> v1:172.21.15.52:6789/0 conn(0x7ffa800cce30 legacy=0x7ffa80071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa86800640 1 -- 172.21.15.52:0/1184649191 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800cdb60 con 0x7ffa800cd270 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.115+0000 7ffa85e00640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa800736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa86800640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa8015c8d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0e7961fa4f0964 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa84a00640 1 -- 172.21.15.52:0/1184649191 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c031600 con 0x7ffa800cd270 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa84a00640 1 -- 172.21.15.52:0/1184649191 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c0317a0 con 0x7ffa800cd270 2024-09-10T08:36:22.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa84a00640 1 -- 172.21.15.52:0/1184649191 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c031b70 con 0x7ffa800cd270 2024-09-10T08:36:22.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa88800640 1 -- 172.21.15.52:0/1184649191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 msgr2=0x7ffa8015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.116+0000 7ffa88800640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa8015c8d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009d90 tx=0x7ffa7c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 -- 172.21.15.52:0/1184649191 shutdown_connections 2024-09-10T08:36:22.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa8015c8d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 --2- 172.21.15.52:0/1184649191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa800736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 -- 172.21.15.52:0/1184649191 >> 172.21.15.52:0/1184649191 conn(0x7ffa8006d0f0 msgr2=0x7ffa8006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 -- 172.21.15.52:0/1184649191 shutdown_connections 2024-09-10T08:36:22.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.117+0000 7ffa88800640 1 -- 172.21.15.52:0/1184649191 wait complete. 2024-09-10T08:36:22.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.118+0000 7ffa88800640 1 Processor -- start 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.118+0000 7ffa88800640 1 -- start start 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa8014a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa800cce30 0x7ffa801494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8006bf70 con 0x7ffa800cd270 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8006bdf0 con 0x7ffa800cce30 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.119+0000 7ffa88800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa80072380 con 0x7ffa800732e0 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60698/0 (socket says 172.21.15.52:60698) 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 -- 172.21.15.52:0/2453349350 learned_addr learned my addr 172.21.15.52:0/2453349350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa8014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa85400640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa800cce30 0x7ffa801494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 -- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 msgr2=0x7ffa8014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa8014a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 -- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa800cce30 msgr2=0x7ffa801494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa800cce30 0x7ffa801494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 -- 172.21.15.52:0/2453349350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa801499e0 con 0x7ffa800cd270 2024-09-10T08:36:22.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.120+0000 7ffa86800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c02abc0 tx=0x7ffa7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.121+0000 7ffa7a000640 1 -- 172.21.15.52:0/2453349350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c040070 con 0x7ffa800cd270 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.121+0000 7ffa7a000640 1 -- 172.21.15.52:0/2453349350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c030b60 con 0x7ffa800cd270 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.121+0000 7ffa7a000640 1 -- 172.21.15.52:0/2453349350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c009450 con 0x7ffa800cd270 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.121+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa80147920 con 0x7ffa800cd270 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.121+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa801486e0 con 0x7ffa800cd270 2024-09-10T08:36:22.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.123+0000 7ffa7a000640 1 -- 172.21.15.52:0/2453349350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa7c039040 con 0x7ffa800cd270 2024-09-10T08:36:22.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.125+0000 7ffa7a000640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 0x7ffa6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.125+0000 7ffa7a000640 1 -- 172.21.15.52:0/2453349350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7ffa7c0ac440 con 0x7ffa800cd270 2024-09-10T08:36:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.125+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 0x7ffa6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.125+0000 7ffa8b6aa740 1 Processor -- start 2024-09-10T08:36:22.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.125+0000 7ffa8b6aa740 1 -- start start 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 0x7ffa6406e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffa74006fd0 tx=0x7ffa74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e70240 0x563f80e72e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80e6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563f80e39cf0 con 0x563f80e72a80 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563f80dd57f0 con 0x563f80e74210 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563f80d7d800 con 0x563f80e70240 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60714/0 (socket says 172.21.15.52:60714) 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.126+0000 7ffa85e00640 1 -- 172.21.15.52:0/2773455076 learned_addr learned my addr 172.21.15.52:0/2773455076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa86800640 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80e6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85400640 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e70240 0x563f80e72e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 -- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e70240 msgr2=0x563f80e72e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e70240 0x563f80e72e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 -- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 msgr2=0x563f80e6d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80e6d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 -- 172.21.15.52:0/2773455076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f80bb27d0 con 0x563f80e72a80 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400b980 tx=0x7ffa74004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e1428bfa2b97f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa6e600640 1 -- 172.21.15.52:0/2773455076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7401c050 con 0x563f80e72a80 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa6e600640 1 -- 172.21.15.52:0/2773455076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74026070 con 0x563f80e72a80 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.127+0000 7ffa6e600640 1 -- 172.21.15.52:0/2773455076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74016e10 con 0x563f80e72a80 2024-09-10T08:36:22.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2773455076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 msgr2=0x563f80eb8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400b980 tx=0x7ffa74004610 comp rx=0 tx=0).stop 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2773455076 shutdown_connections 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80e6d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e70240 0x563f80e72e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2773455076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80eb8220 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2773455076 >> 172.21.15.52:0/2773455076 conn(0x563f80e6f240 msgr2=0x563f80eb76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2773455076 shutdown_connections 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.128+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2773455076 wait complete. 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.129+0000 7ffa8b6aa740 1 -- start start 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.129+0000 7ffa8b6aa740 1 Processor -- start 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e72a80 0x563f80e8b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e9b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563f80d5e750 con 0x563f80e9bc60 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563f80dd17b0 con 0x563f80e72a80 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563f80e6e6e0 con 0x563f80e74210 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa8b6aa740 10 client.0 _ll_register_callbacks cb 0x563f80ae7be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60718/0 (socket says 172.21.15.52:60718) 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa86800640 1 -- 172.21.15.52:0/4257970078 learned_addr learned my addr 172.21.15.52:0/4257970078 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa85e00640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e72a80 0x563f80e8b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.130+0000 7ffa85400640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e9b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 -- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 msgr2=0x563f80e9b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e9b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 -- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e72a80 msgr2=0x563f80e8b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e72a80 0x563f80e8b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 -- 172.21.15.52:0/4257970078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f80aa80f0 con 0x563f80e9bc60 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa86800640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0aa820 tx=0x7ffa7c07a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a20f761ec1f04c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa62a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c04a040 con 0x563f80e9bc60 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7ffa7c0ac0b0 con 0x563f80e9bc60 2024-09-10T08:36:22.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.131+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa74026070 con 0x563f80e9bc60 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c083300 con 0x563f80e9bc60 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 10 client.7791 fetch_fsmap learned FSMap version 84 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563f80c12f60 con 0x563f80e9bc60 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74026070 con 0x563f80e9bc60 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7ffa7c0aace0 con 0x563f80e9bc60 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 10 client.7791 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 10 client.7791 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 20 client.7791 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80e9a580 0x563f80e9a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 4 client.7791 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f80de2f20 con 0x563f80e9a580 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.132+0000 7ffa85e00640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80e9a580 0x563f80e9a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.133+0000 7ffa85e00640 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80e9a580 0x563f80e9a990 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d91a103697d8026f server_cookie=9462636cbd53e842 in_seq=0 out_seq=0 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.133+0000 7ffa62a00640 10 client.7791 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa62a00640 1 -- 172.21.15.52:0/4257970078 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f80de2f20 con 0x563f80e9a580 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa62a00640 10 client.7791 handle_command_reply: tid=0 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 client.7791 shutdown 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 msgr2=0x563f80e6c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0aa820 tx=0x7ffa7c07a1b0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 shutdown_connections 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80e9a580 0x563f80e9a990 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e6c880 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e9b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/4257970078 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e72a80 0x563f80e8b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 >> 172.21.15.52:0/4257970078 conn(0x563f80e70240 msgr2=0x563f80eb5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa62a00640 0 client.7791 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 shutdown_connections 2024-09-10T08:36:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/4257970078 wait complete. 2024-09-10T08:36:22.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.134+0000 7ffa8b6aa740 20 client.7791 trim_cache size 0 max 16384 2024-09-10T08:36:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.151+0000 7ffa8b6aa740 1 Processor -- start 2024-09-10T08:36:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.151+0000 7ffa8b6aa740 1 -- start start 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e72260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 0x563f80e6bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa80200d50 con 0x563f80e72a80 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801ffdb0 con 0x563f80e9bc60 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8014bca0 con 0x563f80e74210 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60728/0 (socket says 172.21.15.52:60728) 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.152+0000 7ffa85e00640 1 -- 172.21.15.52:0/962566895 learned_addr learned my addr 172.21.15.52:0/962566895 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa86800640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 0x563f80e6bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 -- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 msgr2=0x563f80e72260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85400640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e72260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e72260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 -- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 msgr2=0x563f80e6bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 0x563f80e6bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 -- 172.21.15.52:0/962566895 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f80a811b0 con 0x563f80e72a80 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa86800640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 0x563f80e6bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85400640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e72260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa85e00640 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffa74023040 tx=0x7ffa74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a809af00875c9133 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa6dc00640 1 -- 172.21.15.52:0/962566895 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7403a070 con 0x563f80e72a80 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa6dc00640 1 -- 172.21.15.52:0/962566895 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74026040 con 0x563f80e72a80 2024-09-10T08:36:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.153+0000 7ffa6dc00640 1 -- 172.21.15.52:0/962566895 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7401c050 con 0x563f80e72a80 2024-09-10T08:36:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/962566895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 msgr2=0x563f80e71d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffa74023040 tx=0x7ffa74017000 comp rx=0 tx=0).stop 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/962566895 shutdown_connections 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e9bc60 0x563f80e6bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e74210 0x563f80e72260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/962566895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e72a80 0x563f80e71d20 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/962566895 >> 172.21.15.52:0/962566895 conn(0x563f80e70240 msgr2=0x563f80e9b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/962566895 shutdown_connections 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.154+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/962566895 wait complete. 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.155+0000 7ffa8b6aa740 1 -- start start 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.155+0000 7ffa8b6aa740 1 Processor -- start 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e72a80 0x563f80e6daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80ec7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563f80e6ff70 con 0x563f80e9bc60 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8015e680 con 0x563f80e74210 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563f80e0ebb0 con 0x563f80e72a80 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa8b6aa740 10 client.0 _ll_register_callbacks cb 0x7ffa7c076b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60730/0 (socket says 172.21.15.52:60730) 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 -- 172.21.15.52:0/2689236237 learned_addr learned my addr 172.21.15.52:0/2689236237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa85400640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80ec7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e72a80 0x563f80e6daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 -- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e72a80 msgr2=0x563f80e6daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e72a80 0x563f80e6daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 -- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 msgr2=0x563f80ec7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80ec7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.156+0000 7ffa86800640 1 -- 172.21.15.52:0/2689236237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f80e8da60 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa86800640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c02a610 tx=0x7ffa7c0aa750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d472c23fa2960f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c04a040 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7ffa7c082e70 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa74026040 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c07a310 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 10 client.7797 fetch_fsmap learned FSMap version 84 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x563f80e9d330 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74026040 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7ffa7c08ebb0 con 0x563f80e9bc60 2024-09-10T08:36:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 10 client.7797 fetch_fsmap finished waiting for FSMap version 84 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 10 client.7797 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 20 client.7797 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80ec75a0 0x563f80e88970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 4 client.7797 mds_command: new command op to 7542 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.157+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 --> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] -- command(tid 0: {"prefix": "perf dump"}) -- 0x563f80ddd270 con 0x563f80ec75a0 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.158+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80ec75a0 0x563f80e88970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.158+0000 7ffa85e00640 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80ec75a0 0x563f80e88970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cfc44d33825e816 server_cookie=28a251d9cecea259 in_seq=0 out_seq=0 2024-09-10T08:36:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.158+0000 7ffa62a00640 10 client.7797 ms_handle_connect on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:22.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa62a00640 1 -- 172.21.15.52:0/2689236237 <== mds.0 v2:172.21.15.52:6833/3438113283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18004 (crc 0 0 0) 0x563f80ddd270 con 0x563f80ec75a0 2024-09-10T08:36:22.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa62a00640 10 client.7797 handle_command_reply: tid=0 2024-09-10T08:36:22.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 client.7797 shutdown 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 msgr2=0x563f80e88430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c02a610 tx=0x7ffa7c0aa750 comp rx=0 tx=0).stop 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 shutdown_connections 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:6833/3438113283,v1:172.21.15.52:6835/3438113283] conn(0x563f80ec75a0 0x563f80e88970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563f80e9bc60 0x563f80e88430 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563f80e74210 0x563f80ec7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 --2- 172.21.15.52:0/2689236237 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563f80e72a80 0x563f80e6daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa62a00640 0 client.7797 ms_handle_reset on v2:172.21.15.52:6833/3438113283 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 >> 172.21.15.52:0/2689236237 conn(0x563f80e70240 msgr2=0x563f80eb45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 shutdown_connections 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.159+0000 7ffa8b6aa740 1 -- 172.21.15.52:0/2689236237 wait complete. 2024-09-10T08:36:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa8b6aa740 20 client.7797 trim_cache size 0 max 16384 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 27578, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 49464, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 10085662, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 36781031, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 18, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-10T08:36:22.165 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 4.738635415, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 2.700206891, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 3.064029490, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.042436266, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 49464, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.532531083, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000030982 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 71462, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.017474226, 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000244 2024-09-10T08:36:22.166 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 123776, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 28672 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3432, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3456, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 1268532, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 32047168, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.415392868, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.199481217, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.080700639, 2024-09-10T08:36:22.167 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.107049368, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3455, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.455938066, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000131964 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T08:36:22.168 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 127984 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 4111, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 4111, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 1038812, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 42036608, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 4, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.496721787, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.239601594, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.098056268, 2024-09-10T08:36:22.169 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.127467636, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4110, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.796038095, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000193683 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:36:22.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2885, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 15.700977576, 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005442279 2024-09-10T08:36:22.171 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3904, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.943443170, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000241660 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 25724, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 25724, 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T08:36:22.172 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 25724, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 337.564367647, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.013122545 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 12, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 17904, 2024-09-10T08:36:22.173 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 17904, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 17903, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 2, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 2, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 46804, 2024-09-10T08:36:22.174 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 46266, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 112, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T08:36:22.175 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 2011, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 2011, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 11, 2024-09-10T08:36:22.176 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 1, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 10, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 2000, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 598, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 4021, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 2599, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 2020, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 58, 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 14096 2024-09-10T08:36:22.177 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T08:36:22.178 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 4186, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 3874, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 2242, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:36:22.179 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 1, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T08:36:22.180 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 26146, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 26146, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 33, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T08:36:22.181 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 33, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 4, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 94304892, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2611, 2024-09-10T08:36:22.182 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 106.588793844, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.040822977 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 14, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 2015, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 2001, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 13, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 17904, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19905, 2024-09-10T08:36:22.183 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 2001, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 2, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 8190, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 8188, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 101144, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 231788 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 28668, 2024-09-10T08:36:22.184 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 25724, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 6, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2000, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2.158784912, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001079392 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 30, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005658225, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000188607 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.185 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 6000, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 7.367113679, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001227852 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7438, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.755939824, 2024-09-10T08:36:22.186 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000639411 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.187 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000050040, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000050040 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.188 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003857722, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.003857722 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.189 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.029443404, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.029443404 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000102008, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000102008 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T08:36:22.190 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.105663720, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.013207965 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2242, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 302.904113864, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.135104421 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T08:36:22.191 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.060875891, 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.060875891 2024-09-10T08:36:22.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000275847, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000275847 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.193 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T08:36:22.194 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8000, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 20.172488511, 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002521561 2024-09-10T08:36:22.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-10T08:36:22.196 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 17965, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 17965, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 92, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:36:22.197 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:36:22.198 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:36:22.199 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 250712, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 92, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 5704, 2024-09-10T08:36:22.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 83, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 13483957, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 661765, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T08:36:22.201 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 8773, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 90804358, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 37, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 8773, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8773, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 48.590348787, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005538624 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8773, 2024-09-10T08:36:22.202 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 8880 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 8773, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 2071, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 6702, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 11, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 59, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 2669, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 38, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T08:36:22.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 1874, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 2033, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 2012, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 22, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T08:36:22.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T08:36:22.205 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 113, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 5, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T08:36:22.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 134, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 28 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "osd-slow-ops": { 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.207 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 32, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 32, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 3874, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 3874, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 35116, 2024-09-10T08:36:22.208 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 9226661, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 35116, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 35116, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 9226661, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.209 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8773, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 91210624, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8773, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 91210624, 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:36:22.210 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 8773, 2024-09-10T08:36:22.211 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 8773, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 8773, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 8773, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:36:22.212 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 3874, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 406266, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 3874, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 58, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 406266, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:22.213 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x55f2975ba500": { 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 26146, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 90110588, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 26146, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2611, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 90110588, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T08:36:22.214 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T08:36:22.215 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T08:36:22.215 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.215 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:22.215 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:36:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 msgr2=0x7ffa6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 0x7ffa6406e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffa74006fd0 tx=0x7ffa74008040 comp rx=0 tx=0).stop 2024-09-10T08:36:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 msgr2=0x7ffa801473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c02abc0 tx=0x7ffa7c004a40 comp rx=0 tx=0).stop 2024-09-10T08:36:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 shutdown_connections 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffa6406be30 0x7ffa6406e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa800cd270 0x7ffa801473e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa800cce30 0x7ffa801494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 --2- 172.21.15.52:0/2453349350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa800732e0 0x7ffa8014a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 >> 172.21.15.52:0/2453349350 conn(0x7ffa8006d0f0 msgr2=0x7ffa8006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 shutdown_connections 2024-09-10T08:36:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.160+0000 7ffa88800640 1 -- 172.21.15.52:0/2453349350 wait complete. 2024-09-10T08:36:22.218 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:36:22.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:36:22.307 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:36:22.394 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:36:22.394 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:36:22.394 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:22.394 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:22.430 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:22.430 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:22.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:36:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.704+0000 7f62dda00640 1 Processor -- start 2024-09-10T08:36:22.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.704+0000 7f62dda00640 1 -- start start 2024-09-10T08:36:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62dda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d80b2d40 0x7f62d806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62dda00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62d813eb20 0x7f62d806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62dda00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62d8071180 con 0x7f62d815bcf0 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62dda00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f62d8071ab0 con 0x7f62d813eb20 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62dda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f62d8071460 con 0x7f62d80b2d40 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62d813eb20 0x7f62d806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62d813eb20 0x7f62d806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60744/0 (socket says 172.21.15.52:60744) 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 -- 172.21.15.52:0/2792329948 learned_addr learned my addr 172.21.15.52:0/2792329948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62d6a00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d80b2d40 0x7f62d806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 -- 172.21.15.52:0/2792329948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d80b2d40 msgr2=0x7f62d806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d80b2d40 0x7f62d806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 -- 172.21.15.52:0/2792329948 >> v1:172.21.15.176:6789/0 conn(0x7f62d815bcf0 legacy=0x7f62d815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.706+0000 7f62cfe00640 1 -- 172.21.15.52:0/2792329948 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8071740 con 0x7f62d813eb20 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.707+0000 7f62cfe00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d813eb20 0x7f62d806c150 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f62d8071c30 tx=0x7f62c002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2bdd5962f521a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62d6000640 1 -- 172.21.15.52:0/2792329948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0037070 con 0x7f62d813eb20 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62d6000640 1 -- 172.21.15.52:0/2792329948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c0032440 con 0x7f62d813eb20 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62d6000640 1 -- 172.21.15.52:0/2792329948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0032810 con 0x7f62d813eb20 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 -- 172.21.15.52:0/2792329948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d813eb20 msgr2=0x7f62d806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d813eb20 0x7f62d806c150 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f62d8071c30 tx=0x7f62c002a250 comp rx=0 tx=0).stop 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 -- 172.21.15.52:0/2792329948 shutdown_connections 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d813eb20 0x7f62d806c150 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 --2- 172.21.15.52:0/2792329948 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d80b2d40 0x7f62d806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 -- 172.21.15.52:0/2792329948 >> 172.21.15.52:0/2792329948 conn(0x7f62d80ccec0 msgr2=0x7f62d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 -- 172.21.15.52:0/2792329948 shutdown_connections 2024-09-10T08:36:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.708+0000 7f62dda00640 1 -- 172.21.15.52:0/2792329948 wait complete. 2024-09-10T08:36:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.710+0000 7f62dda00640 1 Processor -- start 2024-09-10T08:36:22.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.710+0000 7f62dda00640 1 -- start start 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62d813eb20 0x7f62d8164510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 0x7f62d8153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f62d80722d0 con 0x7f62d80b2d40 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8072150 con 0x7f62d813eb20 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62dda00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f62d8072450 con 0x7f62d815bcf0 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62d6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62d6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60750/0 (socket says 172.21.15.52:60750) 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62d6a00640 1 -- 172.21.15.52:0/1073201620 learned_addr learned my addr 172.21.15.52:0/1073201620 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62cfe00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62d813eb20 0x7f62d8164510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.711+0000 7f62d7400640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 0x7f62d8153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 -- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 msgr2=0x7f62d8153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 0x7f62d8153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 -- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62d813eb20 msgr2=0x7f62d8164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62d813eb20 0x7f62d8164510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 -- 172.21.15.52:0/1073201620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8167e60 con 0x7f62d80b2d40 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d7400640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 0x7f62d8153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:22.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62d6a00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d800 tx=0x7f62c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c800b660 con 0x7f62d80b2d40 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c8019070 con 0x7f62d80b2d40 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d8168140 con 0x7f62d80b2d40 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c800ba60 con 0x7f62d80b2d40 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.712+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d8154760 con 0x7f62d80b2d40 2024-09-10T08:36:22.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.713+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d80728e0 con 0x7f62d80b2d40 2024-09-10T08:36:22.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.714+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62c800bc00 con 0x7f62d80b2d40 2024-09-10T08:36:22.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.717+0000 7f62cea00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 0x7f62b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:22.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.717+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f62c808b290 con 0x7f62d80b2d40 2024-09-10T08:36:22.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.717+0000 7f62cfe00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 0x7f62b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:22.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.717+0000 7f62cfe00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 0x7f62b406e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f62c0034000 tx=0x7f62c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:22.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.720+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62c8059be0 con 0x7f62d80b2d40 2024-09-10T08:36:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.916+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f62d806c9c0 con 0x7f62d80b2d40 2024-09-10T08:36:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.917+0000 7f62cea00640 1 -- 172.21.15.52:0/1073201620 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f62c80594e0 con 0x7f62d80b2d40 2024-09-10T08:36:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:36:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 msgr2=0x7f62b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 0x7f62b406e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f62c0034000 tx=0x7f62c002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 msgr2=0x7f62d8167470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d800 tx=0x7f62c800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 shutdown_connections 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f62b406be30 0x7f62b406e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62d815bcf0 0x7f62d8153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62d813eb20 0x7f62d8164510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 --2- 172.21.15.52:0/1073201620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62d80b2d40 0x7f62d8167470 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 >> 172.21.15.52:0/1073201620 conn(0x7f62d80ccec0 msgr2=0x7f62d813db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 shutdown_connections 2024-09-10T08:36:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:22.919+0000 7f62dda00640 1 -- 172.21.15.52:0/1073201620 wait complete. 2024-09-10T08:36:22.935 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:36:22.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:22.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:36:23.009 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:36:23.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:23.009 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:36:23.066 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:36:23.067 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:36:23.067 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:23.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:36:23.104 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:36:23.104 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:23.104 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:23.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:36:23.139 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:36:23.139 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:36:23.139 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:23.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:36:23.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.336+0000 7fd141200640 1 Processor -- start 2024-09-10T08:36:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.336+0000 7fd141200640 1 -- start start 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd141200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd13c15e440 0x7fd13c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd141200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd13c0cf450 0x7fd13c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd141200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13c0d3990 con 0x7fd13c0b6540 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd141200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd13c0b6990 con 0x7fd13c15e440 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd141200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd13c0d3c70 con 0x7fd13c0cf450 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd13c15e440 0x7fd13c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd13c15e440 0x7fd13c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60756/0 (socket says 172.21.15.52:60756) 2024-09-10T08:36:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd13c0b6540 0x7fd13c06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43796/0 (socket says 172.21.15.52:43796) 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 -- 172.21.15.52:0/4147466523 learned_addr learned my addr 172.21.15.52:0/4147466523 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13aa00640 1 --2- 172.21.15.52:0/4147466523 >> v2:172.21.15.176:3300/0 conn(0x7fd13c0cf450 0x7fd13c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 -- 172.21.15.52:0/4147466523 >> v2:172.21.15.176:3300/0 conn(0x7fd13c0cf450 msgr2=0x7fd13c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 --2- 172.21.15.52:0/4147466523 >> v2:172.21.15.176:3300/0 conn(0x7fd13c0cf450 0x7fd13c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 -- 172.21.15.52:0/4147466523 >> v1:172.21.15.52:6789/0 conn(0x7fd13c0b6540 legacy=0x7fd13c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.337+0000 7fd13b400640 1 -- 172.21.15.52:0/4147466523 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c0d3f50 con 0x7fd13c15e440 2024-09-10T08:36:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.338+0000 7fd13b400640 1 --2- 172.21.15.52:0/4147466523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c15e440 0x7fd13c0d3240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b3f90 tx=0x7fd12c02a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0ad44a4fc4d2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.338+0000 7fd13a000640 1 -- 172.21.15.52:0/4147466523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c037070 con 0x7fd13c15e440 2024-09-10T08:36:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.338+0000 7fd13a000640 1 -- 172.21.15.52:0/4147466523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c032640 con 0x7fd13c15e440 2024-09-10T08:36:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.338+0000 7fd13a000640 1 -- 172.21.15.52:0/4147466523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c02ae60 con 0x7fd13c15e440 2024-09-10T08:36:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 -- 172.21.15.52:0/4147466523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c15e440 msgr2=0x7fd13c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 --2- 172.21.15.52:0/4147466523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c15e440 0x7fd13c0d3240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0b3f90 tx=0x7fd12c02a310 comp rx=0 tx=0).stop 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 -- 172.21.15.52:0/4147466523 shutdown_connections 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 --2- 172.21.15.52:0/4147466523 >> v2:172.21.15.176:3300/0 conn(0x7fd13c0cf450 0x7fd13c0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 --2- 172.21.15.52:0/4147466523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c15e440 0x7fd13c0d3240 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 -- 172.21.15.52:0/4147466523 >> 172.21.15.52:0/4147466523 conn(0x7fd13c067f80 msgr2=0x7fd13c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 -- 172.21.15.52:0/4147466523 shutdown_connections 2024-09-10T08:36:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.339+0000 7fd141200640 1 -- 172.21.15.52:0/4147466523 wait complete. 2024-09-10T08:36:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.340+0000 7fd141200640 1 Processor -- start 2024-09-10T08:36:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 -- start start 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd13c0b6540 0x7fd13c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13c15e440 0x7fd13c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c0b7540 con 0x7fd13c0cf450 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c15e820 con 0x7fd13c15e440 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.341+0000 7fd141200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd13c0b76c0 con 0x7fd13c0b6540 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60764/0 (socket says 172.21.15.52:60764) 2024-09-10T08:36:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 -- 172.21.15.52:0/2823606062 learned_addr learned my addr 172.21.15.52:0/2823606062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13b400640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd13c0b6540 0x7fd13c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13be00640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13c15e440 0x7fd13c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 -- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd13c0b6540 msgr2=0x7fd13c157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd13c0b6540 0x7fd13c157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 -- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13c15e440 msgr2=0x7fd13c15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13c15e440 0x7fd13c15ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 -- 172.21.15.52:0/2823606062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c158020 con 0x7fd13c0cf450 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.342+0000 7fd13aa00640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd12800d800 tx=0x7fd12800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.343+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12800b6c0 con 0x7fd13c0cf450 2024-09-10T08:36:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.343+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128019070 con 0x7fd13c0cf450 2024-09-10T08:36:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.343+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13c1e7850 con 0x7fd13c0cf450 2024-09-10T08:36:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.343+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12800ba80 con 0x7fd13c0cf450 2024-09-10T08:36:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.343+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13c1e7e10 con 0x7fd13c0cf450 2024-09-10T08:36:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.344+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13c0b4b60 con 0x7fd13c0cf450 2024-09-10T08:36:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.346+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd12800bc20 con 0x7fd13c0cf450 2024-09-10T08:36:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.346+0000 7fd133400640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 0x7fd11c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.346+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7fd12808b410 con 0x7fd13c0cf450 2024-09-10T08:36:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.346+0000 7fd13b400640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 0x7fd11c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.348+0000 7fd13b400640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 0x7fd11c06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd12c034000 tx=0x7fd12c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.350+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd128059cd0 con 0x7fd13c0cf450 2024-09-10T08:36:23.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.570+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13c0b4880 con 0x7fd13c0cf450 2024-09-10T08:36:23.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.571+0000 7fd133400640 1 -- 172.21.15.52:0/2823606062 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5228 (secure 0 0 0) 0x7fd1280595d0 con 0x7fd13c0cf450 2024-09-10T08:36:23.572 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:23.572 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"btime":"2024-09-10T08:34:48:607435+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:48.100580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:36:23.572 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 84 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 msgr2=0x7fd11c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 0x7fd11c06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd12c034000 tx=0x7fd12c02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 msgr2=0x7fd13c1e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd12800d800 tx=0x7fd12800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 shutdown_connections 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11c06be30 0x7fd11c06e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13c15e440 0x7fd13c15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd13c0cf450 0x7fd13c1e94c0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 --2- 172.21.15.52:0/2823606062 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd13c0b6540 0x7fd13c157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 >> 172.21.15.52:0/2823606062 conn(0x7fd13c067f80 msgr2=0x7fd13c0b9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:23.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 shutdown_connections 2024-09-10T08:36:23.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.574+0000 7fd141200640 1 -- 172.21.15.52:0/2823606062 wait complete. 2024-09-10T08:36:23.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.747+0000 7f82a3800640 1 Processor -- start 2024-09-10T08:36:23.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.747+0000 7f82a3800640 1 -- start start 2024-09-10T08:36:23.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a3800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f829c14c480 0x7f829c163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a3800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f829c073750 0x7f829c073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a3800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829c164120 con 0x7f829c164650 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a3800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f829c0732c0 con 0x7f829c073750 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a3800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f829c0712a0 con 0x7f829c14c480 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f829c073750 0x7f829c073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f829c073750 0x7f829c073bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60774/0 (socket says 172.21.15.52:60774) 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 -- 172.21.15.52:0/437151903 learned_addr learned my addr 172.21.15.52:0/437151903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:23.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f82a0e00640 1 --2- 172.21.15.52:0/437151903 >> v2:172.21.15.176:3300/0 conn(0x7f829c14c480 0x7f829c163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 -- 172.21.15.52:0/437151903 >> v2:172.21.15.176:3300/0 conn(0x7f829c14c480 msgr2=0x7f829c163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 --2- 172.21.15.52:0/437151903 >> v2:172.21.15.176:3300/0 conn(0x7f829c14c480 0x7f829c163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 -- 172.21.15.52:0/437151903 >> v1:172.21.15.176:6789/0 conn(0x7f829c164650 legacy=0x7f829c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.749+0000 7f829be00640 1 -- 172.21.15.52:0/437151903 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c072c70 con 0x7f829c073750 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f829be00640 1 --2- 172.21.15.52:0/437151903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c073750 0x7f829c073bc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f829c069be0 tx=0x7f828802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e21948064e92b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f829b400640 1 -- 172.21.15.52:0/437151903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288037070 con 0x7f829c073750 2024-09-10T08:36:23.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f829b400640 1 -- 172.21.15.52:0/437151903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8288032440 con 0x7f829c073750 2024-09-10T08:36:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f829b400640 1 -- 172.21.15.52:0/437151903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288032810 con 0x7f829c073750 2024-09-10T08:36:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f82a3800640 1 -- 172.21.15.52:0/437151903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c073750 msgr2=0x7f829c073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.751+0000 7f82a3800640 1 --2- 172.21.15.52:0/437151903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c073750 0x7f829c073bc0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f829c069be0 tx=0x7f828802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 -- 172.21.15.52:0/437151903 shutdown_connections 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 --2- 172.21.15.52:0/437151903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c073750 0x7f829c073bc0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 --2- 172.21.15.52:0/437151903 >> v2:172.21.15.176:3300/0 conn(0x7f829c14c480 0x7f829c163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 -- 172.21.15.52:0/437151903 >> 172.21.15.52:0/437151903 conn(0x7f829c0ccec0 msgr2=0x7f829c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 -- 172.21.15.52:0/437151903 shutdown_connections 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.752+0000 7f82a3800640 1 -- 172.21.15.52:0/437151903 wait complete. 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.753+0000 7f82a3800640 1 Processor -- start 2024-09-10T08:36:23.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.753+0000 7f82a3800640 1 -- start start 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c073750 0x7f829c1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c14c480 0x7f829c0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f829c071580 con 0x7f829c164650 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f829c070f70 con 0x7f829c14c480 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a3800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f829c0b6350 con 0x7f829c073750 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.754+0000 7f82a1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60776/0 (socket says 172.21.15.52:60776) 2024-09-10T08:36:23.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 -- 172.21.15.52:0/2154519393 learned_addr learned my addr 172.21.15.52:0/2154519393 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f829be00640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c14c480 0x7f829c0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a0e00640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c073750 0x7f829c1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 -- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c073750 msgr2=0x7f829c1ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c073750 0x7f829c1ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 -- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c14c480 msgr2=0x7f829c0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c14c480 0x7f829c0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 -- 172.21.15.52:0/2154519393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c160b50 con 0x7f829c164650 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a1800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f829400c7a0 tx=0x7f829400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294003b70 con 0x7f829c164650 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8294003d30 con 0x7f829c164650 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.755+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c1edf20 con 0x7f829c164650 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.756+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829400aa90 con 0x7f829c164650 2024-09-10T08:36:23.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.756+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c1ee4e0 con 0x7f829c164650 2024-09-10T08:36:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.757+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829c073bc0 con 0x7f829c164650 2024-09-10T08:36:23.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.758+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f829400ac30 con 0x7f829c164650 2024-09-10T08:36:23.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.759+0000 7f8298c00640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 0x7f827c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:23.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.759+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f829408ace0 con 0x7f829c164650 2024-09-10T08:36:23.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.759+0000 7f82a0e00640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 0x7f827c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:23.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.760+0000 7f82a0e00640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 0x7f827c06e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8290009b40 tx=0x7f8290009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:23.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.763+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f829c164120 con 0x7f829c164650 2024-09-10T08:36:23.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.986+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f829c0cdbf0 con 0x7f829c164650 2024-09-10T08:36:23.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.987+0000 7f8298c00640 1 -- 172.21.15.52:0/2154519393 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5228 (secure 0 0 0) 0x7f8294058fd0 con 0x7f829c164650 2024-09-10T08:36:23.987 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:23.987 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"btime":"2024-09-10T08:34:48:607435+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:48.100580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:36:23.987 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 84 2024-09-10T08:36:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.989+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 msgr2=0x7f827c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.989+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 0x7f827c06e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8290009b40 tx=0x7f8290009190 comp rx=0 tx=0).stop 2024-09-10T08:36:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.989+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 msgr2=0x7f829c0c5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:23.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.989+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f829400c7a0 tx=0x7f829400cc60 comp rx=0 tx=0).stop 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 shutdown_connections 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f827c06be30 0x7f827c06e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f829c164650 0x7f829c0c5920 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f829c14c480 0x7f829c0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 --2- 172.21.15.52:0/2154519393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f829c073750 0x7f829c1ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 >> 172.21.15.52:0/2154519393 conn(0x7f829c0ccec0 msgr2=0x7f829c1621d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 shutdown_connections 2024-09-10T08:36:23.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:23.990+0000 7f82a3800640 1 -- 172.21.15.52:0/2154519393 wait complete. 2024-09-10T08:36:24.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.161+0000 7f4c8d600640 1 Processor -- start 2024-09-10T08:36:24.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.161+0000 7f4c8d600640 1 -- start start 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.162+0000 7f4c8d600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4c880b2d40 0x7f4c8806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.162+0000 7f4c8d600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c88071180 con 0x7f4c8806c150 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c8d600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c88071460 con 0x7f4c8813eb20 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c8d600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4c88071ab0 con 0x7f4c880b2d40 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c87400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4c8806c150 0x7f4c88071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54888/0 (socket says 172.21.15.52:54888) 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c87400640 1 -- 172.21.15.52:0/843062708 learned_addr learned my addr 172.21.15.52:0/843062708 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:24.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c86a00640 1 --2- 172.21.15.52:0/843062708 >> v2:172.21.15.176:3300/0 conn(0x7f4c880b2d40 0x7f4c8806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c86000640 1 -- 172.21.15.52:0/843062708 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180148313 0 0) 0x7f4c88071180 con 0x7f4c8806c150 2024-09-10T08:36:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c86a00640 1 -- 172.21.15.52:0/843062708 >> v1:172.21.15.176:6789/0 conn(0x7f4c8813eb20 legacy=0x7f4c8815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c86a00640 1 -- 172.21.15.52:0/843062708 >> v1:172.21.15.52:6789/0 conn(0x7f4c8806c150 legacy=0x7f4c88071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.163+0000 7f4c86a00640 1 -- 172.21.15.52:0/843062708 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c88071740 con 0x7f4c880b2d40 2024-09-10T08:36:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.164+0000 7f4c86a00640 1 --2- 172.21.15.52:0/843062708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c880b2d40 0x7f4c8806bc10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4c780097a0 tx=0x7f4c7802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b69ecb440fd887 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c86000640 1 -- 172.21.15.52:0/843062708 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78037070 con 0x7f4c880b2d40 2024-09-10T08:36:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c86000640 1 -- 172.21.15.52:0/843062708 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78032440 con 0x7f4c880b2d40 2024-09-10T08:36:24.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c86000640 1 -- 172.21.15.52:0/843062708 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78032810 con 0x7f4c880b2d40 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 -- 172.21.15.52:0/843062708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c880b2d40 msgr2=0x7f4c8806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 --2- 172.21.15.52:0/843062708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c880b2d40 0x7f4c8806bc10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4c780097a0 tx=0x7f4c7802a230 comp rx=0 tx=0).stop 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 -- 172.21.15.52:0/843062708 shutdown_connections 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 --2- 172.21.15.52:0/843062708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c880b2d40 0x7f4c8806bc10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 -- 172.21.15.52:0/843062708 >> 172.21.15.52:0/843062708 conn(0x7f4c880ccec0 msgr2=0x7f4c880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:24.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 -- 172.21.15.52:0/843062708 shutdown_connections 2024-09-10T08:36:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.165+0000 7f4c8d600640 1 -- 172.21.15.52:0/843062708 wait complete. 2024-09-10T08:36:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.167+0000 7f4c8d600640 1 Processor -- start 2024-09-10T08:36:24.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.167+0000 7f4c8d600640 1 -- start start 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 0x7f4c88156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c880b2d40 0x7f4c880ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8815c7d0 con 0x7f4c8813eb20 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8815c650 con 0x7f4c8806c150 2024-09-10T08:36:24.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c8d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4c88072650 con 0x7f4c880b2d40 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c87400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c86a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 0x7f4c88156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c87400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50398/0 (socket says 172.21.15.52:50398) 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c87400640 1 -- 172.21.15.52:0/710668069 learned_addr learned my addr 172.21.15.52:0/710668069 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.168+0000 7f4c7fe00640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c880b2d40 0x7f4c880ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 -- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c880b2d40 msgr2=0x7f4c880ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c880b2d40 0x7f4c880ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 -- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 msgr2=0x7f4c88156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 0x7f4c88156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 -- 172.21.15.52:0/710668069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c88157460 con 0x7f4c8813eb20 2024-09-10T08:36:24.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c86a00640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 0x7f4c88156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:24.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c87400640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c7a0 tx=0x7f4c8000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80018070 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8000a640 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.169+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000aab0 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.170+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c880b4ac0 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.170+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8813e3c0 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.171+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8806bc10 con 0x7f4c8813eb20 2024-09-10T08:36:24.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.172+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c8000ac50 con 0x7f4c8813eb20 2024-09-10T08:36:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.173+0000 7f4c7ea00640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 0x7f4c6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.173+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f4c8008a410 con 0x7f4c8813eb20 2024-09-10T08:36:24.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.173+0000 7f4c86a00640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 0x7f4c6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.174+0000 7f4c86a00640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 0x7f4c6406e320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4c78034000 tx=0x7f4c7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.177+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c80058680 con 0x7f4c8813eb20 2024-09-10T08:36:24.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.365+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c880cfcb0 con 0x7f4c8813eb20 2024-09-10T08:36:24.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.366+0000 7f4c7ea00640 1 -- 172.21.15.52:0/710668069 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16902 (secure 0 0 0) 0x7f4c80087220 con 0x7f4c8813eb20 2024-09-10T08:36:24.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:24.366 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":113,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:05.415418+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:34:32.657199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T08:34:33.836749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":112,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.8","mappings":[{"from":4,"to":0}]},{"pgid":"14.18","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.368+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 msgr2=0x7f4c6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.368+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 0x7f4c6406e320 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4c78034000 tx=0x7f4c7802e000 comp rx=0 tx=0).stop 2024-09-10T08:36:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.368+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 msgr2=0x7f4c880caeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.368+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000c7a0 tx=0x7f4c8000cc60 comp rx=0 tx=0).stop 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 shutdown_connections 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4c6406be60 0x7f4c6406e320 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c8813eb20 0x7f4c880caeb0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c880b2d40 0x7f4c880ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 --2- 172.21.15.52:0/710668069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c8806c150 0x7f4c88156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 >> 172.21.15.52:0/710668069 conn(0x7f4c880ccec0 msgr2=0x7f4c8815a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 shutdown_connections 2024-09-10T08:36:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.369+0000 7f4c8d600640 1 -- 172.21.15.52:0/710668069 wait complete. 2024-09-10T08:36:24.384 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:36:24.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.541+0000 7f4140800640 1 Processor -- start 2024-09-10T08:36:24.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.541+0000 7f4140800640 1 -- start start 2024-09-10T08:36:24.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.542+0000 7f4140800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41380b2d40 0x7f413806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.542+0000 7f4140800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413813eb20 0x7f413806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f4140800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4138071180 con 0x7f413815bcf0 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f4140800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4138071ab0 con 0x7f41380b2d40 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f4140800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4138071460 con 0x7f413813eb20 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41380b2d40 0x7f413806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41380b2d40 0x7f413806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50404/0 (socket says 172.21.15.52:50404) 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 -- 172.21.15.52:0/771500455 learned_addr learned my addr 172.21.15.52:0/771500455 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 -- 172.21.15.52:0/771500455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413813eb20 msgr2=0x7f413806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 --2- 172.21.15.52:0/771500455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413813eb20 0x7f413806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 -- 172.21.15.52:0/771500455 >> v1:172.21.15.176:6789/0 conn(0x7f413815bcf0 legacy=0x7f413815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:24.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.543+0000 7f413de00640 1 -- 172.21.15.52:0/771500455 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4138071740 con 0x7f41380b2d40 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.544+0000 7f413de00640 1 --2- 172.21.15.52:0/771500455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41380b2d40 0x7f413806bc10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4138071c30 tx=0x7f412c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e1c44b3cb71e69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f413ca00640 1 -- 172.21.15.52:0/771500455 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c037070 con 0x7f41380b2d40 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f413ca00640 1 -- 172.21.15.52:0/771500455 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412c032440 con 0x7f41380b2d40 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f413ca00640 1 -- 172.21.15.52:0/771500455 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c032810 con 0x7f41380b2d40 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 -- 172.21.15.52:0/771500455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41380b2d40 msgr2=0x7f413806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 --2- 172.21.15.52:0/771500455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41380b2d40 0x7f413806bc10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4138071c30 tx=0x7f412c02a200 comp rx=0 tx=0).stop 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 -- 172.21.15.52:0/771500455 shutdown_connections 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 --2- 172.21.15.52:0/771500455 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413813eb20 0x7f413806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 --2- 172.21.15.52:0/771500455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41380b2d40 0x7f413806bc10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 -- 172.21.15.52:0/771500455 >> 172.21.15.52:0/771500455 conn(0x7f41380ccec0 msgr2=0x7f41380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 -- 172.21.15.52:0/771500455 shutdown_connections 2024-09-10T08:36:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.545+0000 7f4140800640 1 -- 172.21.15.52:0/771500455 wait complete. 2024-09-10T08:36:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.547+0000 7f4140800640 1 Processor -- start 2024-09-10T08:36:24.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.547+0000 7f4140800640 1 -- start start 2024-09-10T08:36:24.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 0x7f4138139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 0x7f413813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41380722d0 con 0x7f413813eb20 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4138072150 con 0x7f41380b2d40 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f4140800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4138072450 con 0x7f413815bcf0 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50412/0 (socket says 172.21.15.52:50412) 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 -- 172.21.15.52:0/840471163 learned_addr learned my addr 172.21.15.52:0/840471163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413e800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 0x7f413813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 -- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 msgr2=0x7f413813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413de00640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 0x7f4138139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 0x7f413813d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 -- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 msgr2=0x7f4138139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 0x7f4138139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.548+0000 7f413d400640 1 -- 172.21.15.52:0/840471163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41381567d0 con 0x7f413813eb20 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f413de00640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 0x7f4138139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f413e800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 0x7f413813d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f413d400640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f412800b450 tx=0x7f412800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128015020 con 0x7f413813eb20 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4128011890 con 0x7f413813eb20 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4138156ab0 con 0x7f413813eb20 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128011c80 con 0x7f413813eb20 2024-09-10T08:36:24.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.549+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4138157350 con 0x7f413813eb20 2024-09-10T08:36:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.550+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4138156c80 con 0x7f413813eb20 2024-09-10T08:36:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.551+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4128018020 con 0x7f413813eb20 2024-09-10T08:36:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.552+0000 7f4132000640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.552+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f412808b1a0 con 0x7f413813eb20 2024-09-10T08:36:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.552+0000 7f413de00640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.553+0000 7f413de00640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f412c034000 tx=0x7f412c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.556+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f412801f020 con 0x7f413813eb20 2024-09-10T08:36:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.776+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4138072940 con 0x7f413813eb20 2024-09-10T08:36:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.777+0000 7f4132000640 1 -- 172.21.15.52:0/840471163 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5228 (secure 0 0 0) 0x7f412800d040 con 0x7f413813eb20 2024-09-10T08:36:24.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:24.776 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"btime":"2024-09-10T08:34:48:607435+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:48.100580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:36:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 84 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.778+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 msgr2=0x7f411c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.778+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 0x7f411c06e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f412c034000 tx=0x7f412c02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.778+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 msgr2=0x7f4138155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.778+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f412800b450 tx=0x7f412800b910 comp rx=0 tx=0).stop 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 shutdown_connections 2024-09-10T08:36:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f411c06be30 0x7f411c06e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f413815bcf0 0x7f413813d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f413813eb20 0x7f4138155d50 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 --2- 172.21.15.52:0/840471163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41380b2d40 0x7f4138139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 >> 172.21.15.52:0/840471163 conn(0x7f41380ccec0 msgr2=0x7f41380cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 shutdown_connections 2024-09-10T08:36:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.779+0000 7f4140800640 1 -- 172.21.15.52:0/840471163 wait complete. 2024-09-10T08:36:24.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:24.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.950+0000 7f7a7ce00640 1 Processor -- start 2024-09-10T08:36:24.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.950+0000 7f7a7ce00640 1 -- start start 2024-09-10T08:36:24.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.951+0000 7f7a7ce00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7815e440 0x7f7a780d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.951+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a780b6710 0x7f7a780b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.951+0000 7f7a7ce00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a780d3990 con 0x7f7a780cf450 2024-09-10T08:36:24.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.951+0000 7f7a7ce00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780d3c70 con 0x7f7a7815e440 2024-09-10T08:36:24.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.951+0000 7f7a7ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780d3f50 con 0x7f7a780b6710 2024-09-10T08:36:24.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7815e440 0x7f7a780d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a780b6710 0x7f7a780b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a7815e440 0x7f7a780d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:47204/0 (socket says 172.21.15.52:47204) 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 -- 172.21.15.52:0/299157027 learned_addr learned my addr 172.21.15.52:0/299157027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a76a00640 1 --1- 172.21.15.52:0/299157027 >> v1:172.21.15.176:6789/0 conn(0x7f7a780cf450 0x7f7a780b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:46980/0 (socket says 172.21.15.52:46980) 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 -- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a780b6710 msgr2=0x7f7a780b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 --2- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a780b6710 0x7f7a780b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 -- 172.21.15.52:0/299157027 >> v1:172.21.15.176:6789/0 conn(0x7f7a780cf450 legacy=0x7f7a780b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.952+0000 7f7a77400640 1 -- 172.21.15.52:0/299157027 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a780d4230 con 0x7f7a7815e440 2024-09-10T08:36:24.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.953+0000 7f7a77400640 1 --2- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7815e440 0x7f7a780d3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009870 tx=0x7f7a6802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e1d2d2ce29400a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a76000640 1 -- 172.21.15.52:0/299157027 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68037070 con 0x7f7a7815e440 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a76000640 1 -- 172.21.15.52:0/299157027 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6802ae50 con 0x7f7a7815e440 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a76000640 1 -- 172.21.15.52:0/299157027 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68032860 con 0x7f7a7815e440 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 -- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7815e440 msgr2=0x7f7a780d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7815e440 0x7f7a780d3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009870 tx=0x7f7a6802a300 comp rx=0 tx=0).stop 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 -- 172.21.15.52:0/299157027 shutdown_connections 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a780b6710 0x7f7a780b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/299157027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a7815e440 0x7f7a780d3240 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 -- 172.21.15.52:0/299157027 >> 172.21.15.52:0/299157027 conn(0x7f7a78067f80 msgr2=0x7f7a780d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 -- 172.21.15.52:0/299157027 shutdown_connections 2024-09-10T08:36:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.954+0000 7f7a7ce00640 1 -- 172.21.15.52:0/299157027 wait complete. 2024-09-10T08:36:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.956+0000 7f7a7ce00640 1 Processor -- start 2024-09-10T08:36:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.956+0000 7f7a7ce00640 1 -- start start 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a780cf450 0x7f7a78160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 0x7f7a78161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780b76c0 con 0x7f7a780b6710 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780b7540 con 0x7f7a780cf450 2024-09-10T08:36:24.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a7ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780b80a0 con 0x7f7a7815e440 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a77400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a77400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50424/0 (socket says 172.21.15.52:50424) 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a77400640 1 -- 172.21.15.52:0/2498364303 learned_addr learned my addr 172.21.15.52:0/2498364303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a76a00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a780cf450 0x7f7a78160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.957+0000 7f7a77e00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 0x7f7a78161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 -- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 msgr2=0x7f7a78161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 0x7f7a78161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 -- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a780cf450 msgr2=0x7f7a78160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a780cf450 0x7f7a78160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 -- 172.21.15.52:0/2498364303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a780c9d60 con 0x7f7a780b6710 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77e00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 0x7f7a78161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:24.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a77400640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000c00 tx=0x7f7a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68041070 con 0x7f7a780b6710 2024-09-10T08:36:24.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6803c660 con 0x7f7a780b6710 2024-09-10T08:36:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68037040 con 0x7f7a780b6710 2024-09-10T08:36:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.958+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a780c8cc0 con 0x7f7a780b6710 2024-09-10T08:36:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.959+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a780c9280 con 0x7f7a780b6710 2024-09-10T08:36:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.959+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a780b7b60 con 0x7f7a780b6710 2024-09-10T08:36:24.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.960+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a68044070 con 0x7f7a780b6710 2024-09-10T08:36:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.962+0000 7f7a6f400640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 0x7f7a5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:24.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.962+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f7a680ab550 con 0x7f7a780b6710 2024-09-10T08:36:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.962+0000 7f7a76a00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 0x7f7a5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.963+0000 7f7a76a00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 0x7f7a5806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7a78159250 tx=0x7f7a64007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:24.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:24.966+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a68079850 con 0x7f7a780b6710 2024-09-10T08:36:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.188+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a780d33e0 con 0x7f7a780b6710 2024-09-10T08:36:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.189+0000 7f7a6f400640 1 -- 172.21.15.52:0/2498364303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5228 (secure 0 0 0) 0x7f7a6807db50 con 0x7f7a780b6710 2024-09-10T08:36:25.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:25.188 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":84,"btime":"2024-09-10T08:34:48:607435+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-10T08:34:34.844032+0000","modified":"2024-09-10T08:34:48.100580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7542},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7542":{"gid":7542,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3438113283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3438113283},{"type":"v1","addr":"172.21.15.52:6835","nonce":3438113283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7542,"qdb_cluster":[7542]},"id":7}]} 2024-09-10T08:36:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 84 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 msgr2=0x7f7a5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 0x7f7a5806e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7a78159250 tx=0x7f7a64007e80 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 msgr2=0x7f7a7814fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7a68000c00 tx=0x7f7a680046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 shutdown_connections 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5806be30 0x7f7a5806e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a7815e440 0x7f7a78161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a780cf450 0x7f7a78160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 --2- 172.21.15.52:0/2498364303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a780b6710 0x7f7a7814fb60 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 >> 172.21.15.52:0/2498364303 conn(0x7f7a78067f80 msgr2=0x7f7a780d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 shutdown_connections 2024-09-10T08:36:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.191+0000 7f7a7ce00640 1 -- 172.21.15.52:0/2498364303 wait complete. 2024-09-10T08:36:25.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.362+0000 7f4648e00640 1 Processor -- start 2024-09-10T08:36:25.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.363+0000 7f4648e00640 1 -- start start 2024-09-10T08:36:25.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4648e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4648e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4644073180 0x7f46440735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4648e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46440b4020 con 0x7f46440b5880 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4648e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4644073b00 con 0x7f4644073180 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4648e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f46440b42c0 con 0x7f4644145ed0 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4641e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4639400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4644073180 0x7f46440735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4641e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42578/0 (socket says 172.21.15.52:42578) 2024-09-10T08:36:25.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.364+0000 7f4641e00640 1 -- 172.21.15.52:0/620897777 learned_addr learned my addr 172.21.15.52:0/620897777 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.365+0000 7f4641e00640 1 -- 172.21.15.52:0/620897777 >> v2:172.21.15.176:3300/0 conn(0x7f4644073180 msgr2=0x7f46440735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.365+0000 7f4641e00640 1 --2- 172.21.15.52:0/620897777 >> v2:172.21.15.176:3300/0 conn(0x7f4644073180 0x7f46440735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.365+0000 7f4641e00640 1 -- 172.21.15.52:0/620897777 >> v1:172.21.15.176:6789/0 conn(0x7f46440b5880 legacy=0x7f46440b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.365+0000 7f4641e00640 1 -- 172.21.15.52:0/620897777 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46440b45a0 con 0x7f4644145ed0 2024-09-10T08:36:25.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.366+0000 7f4641e00640 1 --2- 172.21.15.52:0/620897777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662c994b5b5761ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.366+0000 7f4641400640 1 -- 172.21.15.52:0/620897777 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634037070 con 0x7f4644145ed0 2024-09-10T08:36:25.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.366+0000 7f4641400640 1 -- 172.21.15.52:0/620897777 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4634032440 con 0x7f4644145ed0 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.366+0000 7f4641400640 1 -- 172.21.15.52:0/620897777 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634032810 con 0x7f4644145ed0 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 -- 172.21.15.52:0/620897777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 msgr2=0x7f46440b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 --2- 172.21.15.52:0/620897777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4634009870 tx=0x7f463402a270 comp rx=0 tx=0).stop 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 -- 172.21.15.52:0/620897777 shutdown_connections 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 --2- 172.21.15.52:0/620897777 >> v2:172.21.15.176:3300/0 conn(0x7f4644073180 0x7f46440735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 --2- 172.21.15.52:0/620897777 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4644145ed0 0x7f46440b5080 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 -- 172.21.15.52:0/620897777 >> 172.21.15.52:0/620897777 conn(0x7f46440ccec0 msgr2=0x7f46440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 -- 172.21.15.52:0/620897777 shutdown_connections 2024-09-10T08:36:25.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.367+0000 7f4648e00640 1 -- 172.21.15.52:0/620897777 wait complete. 2024-09-10T08:36:25.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.369+0000 7f4648e00640 1 Processor -- start 2024-09-10T08:36:25.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.369+0000 7f4648e00640 1 -- start start 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46440b5880 0x7f464413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4644145ed0 0x7f46440727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46441462b0 con 0x7f4644073180 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46440b4b60 con 0x7f4644145ed0 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4648e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4644146430 con 0x7f46440b5880 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4641e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4641e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50438/0 (socket says 172.21.15.52:50438) 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4641e00640 1 -- 172.21.15.52:0/2796265584 learned_addr learned my addr 172.21.15.52:0/2796265584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4642800640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4644145ed0 0x7f46440727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.370+0000 7f4639400640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46440b5880 0x7f464413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 -- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46440b5880 msgr2=0x7f464413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46440b5880 0x7f464413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 -- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4644145ed0 msgr2=0x7f46440727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4644145ed0 0x7f46440727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 -- 172.21.15.52:0/2796265584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4644071520 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4641e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f463402a2b0 tx=0x7f46340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634041030 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4634030440 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4644071800 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634037040 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.371+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4644071fe0 con 0x7f4644073180 2024-09-10T08:36:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.372+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46440735c0 con 0x7f4644073180 2024-09-10T08:36:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.373+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4634044070 con 0x7f4644073180 2024-09-10T08:36:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.374+0000 7f463aa00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 0x7f462006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.374+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f46340ab500 con 0x7f4644073180 2024-09-10T08:36:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.374+0000 7f4639400640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 0x7f462006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.375+0000 7f4639400640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 0x7f462006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46441e5710 tx=0x7f462c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.378+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4634079770 con 0x7f4644073180 2024-09-10T08:36:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.562+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46440ce980 con 0x7f4644073180 2024-09-10T08:36:25.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.563+0000 7f463aa00640 1 -- 172.21.15.52:0/2796265584 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16902 (secure 0 0 0) 0x7f463407da70 con 0x7f4644073180 2024-09-10T08:36:25.563 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:25.563 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":113,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:05.415418+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:34:32.657199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-10T08:34:33.836749+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":112,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":5,"to":3}]},{"pgid":"14.8","mappings":[{"from":4,"to":0}]},{"pgid":"14.18","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:25.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 msgr2=0x7f462006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 0x7f462006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f46441e5710 tx=0x7f462c009190 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 msgr2=0x7f46440c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f463402a2b0 tx=0x7f46340046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 shutdown_connections 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f462006be30 0x7f462006e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4644145ed0 0x7f46440727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46440b5880 0x7f464413d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 --2- 172.21.15.52:0/2796265584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4644073180 0x7f46440c6540 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 >> 172.21.15.52:0/2796265584 conn(0x7f46440ccec0 msgr2=0x7f46440b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 shutdown_connections 2024-09-10T08:36:25.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.566+0000 7f4648e00640 1 -- 172.21.15.52:0/2796265584 wait complete. 2024-09-10T08:36:25.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:36:25.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.741+0000 7f247a200640 1 Processor -- start 2024-09-10T08:36:25.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.741+0000 7f247a200640 1 -- start start 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2474147e80 0x7f2474070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2474148260 0x7f24740714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406bc10 0x7f247406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f247406c5c0 con 0x7f2474148260 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2474074200 con 0x7f2474147e80 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.742+0000 7f247a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24740b3e40 con 0x7f247406bc10 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2474148260 0x7f24740714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2474148260 0x7f24740714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50442/0 (socket says 172.21.15.52:50442) 2024-09-10T08:36:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 -- 172.21.15.52:0/1022054515 learned_addr learned my addr 172.21.15.52:0/1022054515 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2473e00640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406bc10 0x7f247406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2473400640 1 --2- 172.21.15.52:0/1022054515 >> v2:172.21.15.176:3300/0 conn(0x7f2474147e80 0x7f2474070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 -- 172.21.15.52:0/1022054515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406bc10 msgr2=0x7f247406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406bc10 0x7f247406c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 -- 172.21.15.52:0/1022054515 >> v2:172.21.15.176:3300/0 conn(0x7f2474147e80 msgr2=0x7f2474070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 --2- 172.21.15.52:0/1022054515 >> v2:172.21.15.176:3300/0 conn(0x7f2474147e80 0x7f2474070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.743+0000 7f2472a00640 1 -- 172.21.15.52:0/1022054515 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474071b30 con 0x7f2474148260 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.744+0000 7f2472a00640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474148260 0x7f24740714b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f24740d1500 tx=0x7f246002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfcd9ad1a7c2a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.744+0000 7f2472000640 1 -- 172.21.15.52:0/1022054515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460037070 con 0x7f2474148260 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.744+0000 7f2472000640 1 -- 172.21.15.52:0/1022054515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2460032440 con 0x7f2474148260 2024-09-10T08:36:25.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.744+0000 7f2472000640 1 -- 172.21.15.52:0/1022054515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460032810 con 0x7f2474148260 2024-09-10T08:36:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 -- 172.21.15.52:0/1022054515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474148260 msgr2=0x7f24740714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474148260 0x7f24740714b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f24740d1500 tx=0x7f246002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 -- 172.21.15.52:0/1022054515 shutdown_connections 2024-09-10T08:36:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f247406bc10 0x7f247406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 --2- 172.21.15.52:0/1022054515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2474148260 0x7f24740714b0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 --2- 172.21.15.52:0/1022054515 >> v2:172.21.15.176:3300/0 conn(0x7f2474147e80 0x7f2474070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 -- 172.21.15.52:0/1022054515 >> 172.21.15.52:0/1022054515 conn(0x7f24740ccec0 msgr2=0x7f24740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 -- 172.21.15.52:0/1022054515 shutdown_connections 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.745+0000 7f247a200640 1 -- 172.21.15.52:0/1022054515 wait complete. 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.747+0000 7f247a200640 1 Processor -- start 2024-09-10T08:36:25.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.747+0000 7f247a200640 1 -- start start 2024-09-10T08:36:25.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474147e80 0x7f24740cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2474148260 0x7f24741f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24740b3ad0 con 0x7f247406bc10 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24740b37f0 con 0x7f2474147e80 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f247a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24741623c0 con 0x7f2474148260 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50446/0 (socket says 172.21.15.52:50446) 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 -- 172.21.15.52:0/1280443093 learned_addr learned my addr 172.21.15.52:0/1280443093 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2472a00640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474147e80 0x7f24740cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473e00640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2474148260 0x7f24741f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 -- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2474148260 msgr2=0x7f24741f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2474148260 0x7f24741f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 -- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474147e80 msgr2=0x7f24740cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474147e80 0x7f24740cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.748+0000 7f2473400640 1 -- 172.21.15.52:0/1280443093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247413e8b0 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f2473400640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f246400e9b0 tx=0x7f246400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464017070 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246400c9a0 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246400cd90 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247413eb90 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.749+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247413f150 con 0x7f247406bc10 2024-09-10T08:36:25.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.750+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247406c080 con 0x7f247406bc10 2024-09-10T08:36:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.751+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f246401a070 con 0x7f247406bc10 2024-09-10T08:36:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.752+0000 7f246b400640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 0x7f245406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:25.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.752+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5824+0+0 (secure 0 0 0) 0x7f246408b240 con 0x7f247406bc10 2024-09-10T08:36:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.753+0000 7f2472a00640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 0x7f245406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.753+0000 7f2472a00640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 0x7f245406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2460034000 tx=0x7f246002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:25.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.757+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2464059b90 con 0x7f247406bc10 2024-09-10T08:36:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.976+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f24740b29a0 con 0x7f247406bc10 2024-09-10T08:36:25.976 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:36:25.976+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:36:25.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.978+0000 7f246b400640 1 -- 172.21.15.52:0/1280443093 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) ==== 161+0+0 (secure 0 0 0) 0x7f2464059490 con 0x7f247406bc10 2024-09-10T08:36:25.977 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:36:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 msgr2=0x7f245406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 0x7f245406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2460034000 tx=0x7f246002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 msgr2=0x7f247413f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f246400e9b0 tx=0x7f246400ee70 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 shutdown_connections 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245406be30 0x7f245406e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2474148260 0x7f24741f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474147e80 0x7f24740cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 --2- 172.21.15.52:0/1280443093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f247406bc10 0x7f247413f950 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 >> 172.21.15.52:0/1280443093 conn(0x7f24740ccec0 msgr2=0x7f24740cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 shutdown_connections 2024-09-10T08:36:25.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:25.982+0000 7f247a200640 1 -- 172.21.15.52:0/1280443093 wait complete. 2024-09-10T08:36:25.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:36:26.057 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:36:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.161+0000 7f5072200640 1 Processor -- start 2024-09-10T08:36:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.161+0000 7f5072200640 1 -- start start 2024-09-10T08:36:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f5072200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f506c15e620 0x7f506c0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f5072200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f506c0d2660 0x7f506c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f5072200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506c0d3250 con 0x7f506c0d14a0 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f5072200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f506c0b7680 con 0x7f506c0d2660 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f5072200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f506c0b78b0 con 0x7f506c15e620 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.162+0000 7f506be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f506c0d2660 0x7f506c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f5071800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f506c0d14a0 0x7f506c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54904/0 (socket says 172.21.15.52:54904) 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f506c0d2660 0x7f506c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50478/0 (socket says 172.21.15.52:50478) 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f5071800640 1 -- 172.21.15.52:0/694366528 learned_addr learned my addr 172.21.15.52:0/694366528 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f5070e00640 1 --2- 172.21.15.52:0/694366528 >> v2:172.21.15.176:3300/0 conn(0x7f506c15e620 0x7f506c0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506be00640 1 -- 172.21.15.52:0/694366528 >> v2:172.21.15.176:3300/0 conn(0x7f506c15e620 msgr2=0x7f506c0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506be00640 1 --2- 172.21.15.52:0/694366528 >> v2:172.21.15.176:3300/0 conn(0x7f506c15e620 0x7f506c0d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506be00640 1 -- 172.21.15.52:0/694366528 >> v1:172.21.15.52:6789/0 conn(0x7f506c0d14a0 legacy=0x7f506c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506be00640 1 -- 172.21.15.52:0/694366528 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c15ea00 con 0x7f506c0d2660 2024-09-10T08:36:26.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.163+0000 7f506b400640 1 -- 172.21.15.52:0/694366528 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689813886 0 0) 0x7f506c0d3250 con 0x7f506c0d14a0 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.164+0000 7f506be00640 1 --2- 172.21.15.52:0/694366528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d2660 0x7f506c0d0f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d5650 tx=0x7f505802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aec5c7fbbb31de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.164+0000 7f506b400640 1 -- 172.21.15.52:0/694366528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058037070 con 0x7f506c0d2660 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.164+0000 7f506b400640 1 -- 172.21.15.52:0/694366528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058032440 con 0x7f506c0d2660 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.164+0000 7f506b400640 1 -- 172.21.15.52:0/694366528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058032810 con 0x7f506c0d2660 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 -- 172.21.15.52:0/694366528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d2660 msgr2=0x7f506c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 --2- 172.21.15.52:0/694366528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d2660 0x7f506c0d0f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d5650 tx=0x7f505802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 -- 172.21.15.52:0/694366528 shutdown_connections 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 --2- 172.21.15.52:0/694366528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d2660 0x7f506c0d0f60 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 --2- 172.21.15.52:0/694366528 >> v2:172.21.15.176:3300/0 conn(0x7f506c15e620 0x7f506c0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 -- 172.21.15.52:0/694366528 >> 172.21.15.52:0/694366528 conn(0x7f506c067950 msgr2=0x7f506c067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 -- 172.21.15.52:0/694366528 shutdown_connections 2024-09-10T08:36:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.165+0000 7f5072200640 1 -- 172.21.15.52:0/694366528 wait complete. 2024-09-10T08:36:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.167+0000 7f5072200640 1 Processor -- start 2024-09-10T08:36:26.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.167+0000 7f5072200640 1 -- start start 2024-09-10T08:36:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 0x7f506c1f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c15e620 0x7f506c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f506c0d40a0 con 0x7f506c0d14a0 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f506c0d2f70 con 0x7f506c15e620 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5072200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f506c0b9080 con 0x7f506c0d2660 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50492/0 (socket says 172.21.15.52:50492) 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 -- 172.21.15.52:0/1239644878 learned_addr learned my addr 172.21.15.52:0/1239644878 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5071800640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c15e620 0x7f506c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f506be00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 0x7f506c1f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 -- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 msgr2=0x7f506c1f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 0x7f506c1f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 -- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c15e620 msgr2=0x7f506c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c15e620 0x7f506c156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f5070e00640 1 -- 172.21.15.52:0/1239644878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c1e9b70 con 0x7f506c0d14a0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.168+0000 7f506be00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 0x7f506c1f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5070e00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f506000e870 tx=0x7f506000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060017070 con 0x7f506c0d14a0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506000c940 con 0x7f506c0d14a0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506000cd30 con 0x7f506c0d14a0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c1e6f70 con 0x7f506c0d14a0 2024-09-10T08:36:26.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.169+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c1f54a0 con 0x7f506c0d14a0 2024-09-10T08:36:26.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.170+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c0d0f60 con 0x7f506c0d14a0 2024-09-10T08:36:26.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.171+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f506001a070 con 0x7f506c0d14a0 2024-09-10T08:36:26.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.172+0000 7f5068c00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 0x7f504c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:26.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.172+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5882+0+0 (secure 0 0 0) 0x7f506008b140 con 0x7f506c0d14a0 2024-09-10T08:36:26.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.172+0000 7f506be00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 0x7f504c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:26.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.173+0000 7f506be00640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 0x7f504c06e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5058034000 tx=0x7f505802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:26.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.176+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5060059a30 con 0x7f506c0d14a0 2024-09-10T08:36:26.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.397+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f506c0d3ab0 con 0x7f506c0d14a0 2024-09-10T08:36:26.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.980+0000 7f5068c00640 1 -- 172.21.15.52:0/1239644878 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) ==== 104+0+0 (secure 0 0 0) 0x7f5060059330 con 0x7f506c0d14a0 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.982+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 msgr2=0x7f504c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.982+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 0x7f504c06e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5058034000 tx=0x7f505802e000 comp rx=0 tx=0).stop 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.982+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 msgr2=0x7f506c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.982+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f506000e870 tx=0x7f506000ed30 comp rx=0 tx=0).stop 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 shutdown_connections 2024-09-10T08:36:26.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f504c06be30 0x7f504c06e2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c15e620 0x7f506c156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c0d2660 0x7f506c1f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 --2- 172.21.15.52:0/1239644878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c0d14a0 0x7f506c152b60 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 >> 172.21.15.52:0/1239644878 conn(0x7f506c067950 msgr2=0x7f506c0b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 shutdown_connections 2024-09-10T08:36:26.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:26.983+0000 7f5072200640 1 -- 172.21.15.52:0/1239644878 wait complete. 2024-09-10T08:36:27.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:36:27.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.162+0000 7f83d0400640 1 Processor -- start 2024-09-10T08:36:27.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.163+0000 7f83d0400640 1 -- start start 2024-09-10T08:36:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83d0400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83c815f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83d0400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c80aee10 con 0x7f83c8073030 2024-09-10T08:36:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83d0400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c80af0f0 con 0x7f83c81555b0 2024-09-10T08:36:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83d0400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83c80af3d0 con 0x7f83c80ae870 2024-09-10T08:36:27.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83cd000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f83c8073030 0x7f83c80b4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54912/0 (socket says 172.21.15.52:54912) 2024-09-10T08:36:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83cd000640 1 -- 172.21.15.52:0/2946011857 learned_addr learned my addr 172.21.15.52:0/2946011857 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.164+0000 7f83ce400640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83c815f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828609394 0 0) 0x7f83c80aee10 con 0x7f83c8073030 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b0003520 con 0x7f83c8073030 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2912189977 0 0) 0x7f83c80af0f0 con 0x7f83c81555b0 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c80aee10 con 0x7f83c81555b0 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399028855 0 0) 0x7f83b0003520 con 0x7f83c8073030 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 msgr2=0x7f83c815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83c815f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 >> v1:172.21.15.176:6789/0 conn(0x7f83c81555b0 legacy=0x7f83c8072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c80af6b0 con 0x7f83c8073030 2024-09-10T08:36:27.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f83b4001670 con 0x7f83c8073030 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 >> v1:172.21.15.52:6789/0 conn(0x7f83c8073030 legacy=0x7f83c80b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b0003b70 0x7f83b0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b0004800 0x7f83b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80af3d0 con 0x7f83b0003b70 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83b000ba70 con 0x7f83b0004800 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83b000bc40 con 0x7f83c80ae870 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83cda00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b0003b70 0x7f83b0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83cd000640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b0004800 0x7f83b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.165+0000 7f83ce400640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83cda00640 1 -- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 msgr2=0x7f83b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:27.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83cda00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83cda00640 1 -- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b0004800 msgr2=0x7f83b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83cda00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b0004800 0x7f83b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83cda00640 1 -- 172.21.15.52:0/2946011857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b0003520 con 0x7f83b0003b70 2024-09-10T08:36:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.166+0000 7f83ce400640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c80ae870 0x7f83b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:27.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83cda00640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b0003b70 0x7f83b0003f70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0018d0 tx=0x7f83b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa610d2b69cdcd08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0014f0 con 0x7f83b0003b70 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc0052d0 con 0x7f83b0003b70 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83c7e00640 1 -- 172.21.15.52:0/2946011857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc02ac30 con 0x7f83b0003b70 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83d0400640 1 -- 172.21.15.52:0/2946011857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b0003b70 msgr2=0x7f83b0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83d0400640 1 --2- 172.21.15.52:0/2946011857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83b0003b70 0x7f83b0003f70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0018d0 tx=0x7f83b0005830 comp rx=0 tx=0).stop 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.167+0000 7f83ce400640 1 -- 172.21.15.52:0/2946011857 reap_dead start 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.168+0000 7f83d0400640 1 -- 172.21.15.52:0/2946011857 shutdown_connections 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.168+0000 7f83d0400640 1 -- 172.21.15.52:0/2946011857 >> 172.21.15.52:0/2946011857 conn(0x7f83c806c030 msgr2=0x7f83c806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.168+0000 7f83d0400640 1 -- 172.21.15.52:0/2946011857 shutdown_connections 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.168+0000 7f83d0400640 1 -- 172.21.15.52:0/2946011857 wait complete. 2024-09-10T08:36:27.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.169+0000 7f83d0400640 1 Processor -- start 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.169+0000 7f83d0400640 1 -- start start 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83b0003b70 0x7f83c81424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c8143210 0x7f83c8144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8155b10 con 0x7f83c8144830 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8155990 con 0x7f83c8143210 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83d0400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83c806f770 con 0x7f83b0003b70 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83cd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83cd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50500/0 (socket says 172.21.15.52:50500) 2024-09-10T08:36:27.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.170+0000 7f83cd000640 1 -- 172.21.15.52:0/2286626247 learned_addr learned my addr 172.21.15.52:0/2286626247 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cda00640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83b0003b70 0x7f83c81424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 -- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83b0003b70 msgr2=0x7f83c81424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83b0003b70 0x7f83c81424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 -- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c8143210 msgr2=0x7f83c8144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c8143210 0x7f83c8144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 -- 172.21.15.52:0/2286626247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c81429e0 con 0x7f83c8144830 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83cd000640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f83b4004fd0 tx=0x7f83b40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b401a070 con 0x7f83c8144830 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b400f6d0 con 0x7f83c8144830 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b400faa0 con 0x7f83c8144830 2024-09-10T08:36:27.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.171+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c8143790 con 0x7f83c8144830 2024-09-10T08:36:27.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.172+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c8143d50 con 0x7f83c8144830 2024-09-10T08:36:27.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.173+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c815f6a0 con 0x7f83c8144830 2024-09-10T08:36:27.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.173+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83b401d070 con 0x7f83c8144830 2024-09-10T08:36:27.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.174+0000 7f83c5600640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 0x7f83a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:27.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.174+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5882+0+0 (secure 0 0 0) 0x7f83b408a6b0 con 0x7f83c8144830 2024-09-10T08:36:27.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.175+0000 7f83cda00640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 0x7f83a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:27.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.175+0000 7f83cda00640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 0x7f83a806e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f83bc032000 tx=0x7f83bc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:27.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.179+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83b4058fa0 con 0x7f83c8144830 2024-09-10T08:36:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.361+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f83c815fb00 con 0x7f83c8144830 2024-09-10T08:36:27.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.987+0000 7f83c5600640 1 -- 172.21.15.52:0/2286626247 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) ==== 181+0+0 (secure 0 0 0) 0x7f83b40588a0 con 0x7f83c8144830 2024-09-10T08:36:27.987 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:36:27.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.990+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 msgr2=0x7f83a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.990+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 0x7f83a806e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f83bc032000 tx=0x7f83bc009030 comp rx=0 tx=0).stop 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.990+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 msgr2=0x7f83c8142cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.990+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f83b4004fd0 tx=0x7f83b40074f0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 shutdown_connections 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83a806be30 0x7f83a806e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c8143210 0x7f83c8144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83c8144830 0x7f83c8142cd0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 --2- 172.21.15.52:0/2286626247 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83b0003b70 0x7f83c81424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:27.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 >> 172.21.15.52:0/2286626247 conn(0x7f83c806c030 msgr2=0x7f83c8071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:27.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 shutdown_connections 2024-09-10T08:36:27.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:27.991+0000 7f83d0400640 1 -- 172.21.15.52:0/2286626247 wait complete. 2024-09-10T08:36:28.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:36:28.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.174+0000 7f4a60000640 1 Processor -- start 2024-09-10T08:36:28.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.174+0000 7f4a60000640 1 -- start start 2024-09-10T08:36:28.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a58155b20 0x7f4a580b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a580b21a0 0x7f4a580cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a5815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4a580b01e0 con 0x7f4a580b21a0 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4a580b0680 con 0x7f4a58155b20 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.175+0000 7f4a60000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580ccf70 con 0x7f4a580cf960 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a580b21a0 0x7f4a580cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a580b21a0 0x7f4a580cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50512/0 (socket says 172.21.15.52:50512) 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 -- 172.21.15.52:0/1063505743 learned_addr learned my addr 172.21.15.52:0/1063505743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5e000640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a5815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5d600640 1 --2- 172.21.15.52:0/1063505743 >> v2:172.21.15.176:3300/0 conn(0x7f4a58155b20 0x7f4a580b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 -- 172.21.15.52:0/1063505743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 msgr2=0x7f4a5815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:28.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a5815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 -- 172.21.15.52:0/1063505743 >> v2:172.21.15.176:3300/0 conn(0x7f4a58155b20 msgr2=0x7f4a580b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:28.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/1063505743 >> v2:172.21.15.176:3300/0 conn(0x7f4a58155b20 0x7f4a580b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.176+0000 7f4a5cc00640 1 -- 172.21.15.52:0/1063505743 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a580ce940 con 0x7f4a580b21a0 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.177+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a580cf420 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4a580b0890 tx=0x7f4a4402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dbb198c96307a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.177+0000 7f4a57e00640 1 -- 172.21.15.52:0/1063505743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44037070 con 0x7f4a580b21a0 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.177+0000 7f4a57e00640 1 -- 172.21.15.52:0/1063505743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a44032440 con 0x7f4a580b21a0 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.177+0000 7f4a57e00640 1 -- 172.21.15.52:0/1063505743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44032810 con 0x7f4a580b21a0 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 -- 172.21.15.52:0/1063505743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 msgr2=0x7f4a580cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a580cf420 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4a580b0890 tx=0x7f4a4402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 -- 172.21.15.52:0/1063505743 shutdown_connections 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a5815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 --2- 172.21.15.52:0/1063505743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a580cf420 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 --2- 172.21.15.52:0/1063505743 >> v2:172.21.15.176:3300/0 conn(0x7f4a58155b20 0x7f4a580b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 -- 172.21.15.52:0/1063505743 >> 172.21.15.52:0/1063505743 conn(0x7f4a5806c240 msgr2=0x7f4a5806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 -- 172.21.15.52:0/1063505743 shutdown_connections 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.178+0000 7f4a60000640 1 -- 172.21.15.52:0/1063505743 wait complete. 2024-09-10T08:36:28.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.180+0000 7f4a60000640 1 Processor -- start 2024-09-10T08:36:28.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.180+0000 7f4a60000640 1 -- start start 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a580b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a58155b20 0x7f4a580b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580ce610 con 0x7f4a580b21a0 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580cef00 con 0x7f4a58155b20 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a60000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580cfd80 con 0x7f4a580cf960 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a5d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50524/0 (socket says 172.21.15.52:50524) 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a5d600640 1 -- 172.21.15.52:0/3807303870 learned_addr learned my addr 172.21.15.52:0/3807303870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.181+0000 7f4a5e000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a58155b20 0x7f4a580b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a580b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 -- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 msgr2=0x7f4a580b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a580b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 -- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a58155b20 msgr2=0x7f4a580b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a58155b20 0x7f4a580b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 -- 172.21.15.52:0/3807303870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a580b4bc0 con 0x7f4a580b21a0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a580b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a5d600640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00d800 tx=0x7f4a4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00b6c0 con 0x7f4a580b21a0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c019070 con 0x7f4a580b21a0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5815c3c0 con 0x7f4a580b21a0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00ba80 con 0x7f4a580b21a0 2024-09-10T08:36:28.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.182+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5815c980 con 0x7f4a580b21a0 2024-09-10T08:36:28.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.183+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a580cffe0 con 0x7f4a580b21a0 2024-09-10T08:36:28.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.184+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a4c00bc20 con 0x7f4a580b21a0 2024-09-10T08:36:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.185+0000 7f4a55600640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.186+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5357+0+0 (secure 0 0 0) 0x7f4a4c08b1e0 con 0x7f4a580b21a0 2024-09-10T08:36:28.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.186+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:28.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.187+0000 7f4a5cc00640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 0x7f4a3806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4a44034000 tx=0x7f4a4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:28.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.190+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a580cffe0 con 0x7f4a580b21a0 2024-09-10T08:36:28.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.378+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4a58159160 con 0x7f4a580b21a0 2024-09-10T08:36:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.988+0000 7f4a55600640 1 -- 172.21.15.52:0/3807303870 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) ==== 169+0+0 (secure 0 0 0) 0x7f4a580b4bc0 con 0x7f4a580b21a0 2024-09-10T08:36:28.988 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:36:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.994+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 msgr2=0x7f4a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:28.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.994+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 0x7f4a3806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4a44034000 tx=0x7f4a4402e000 comp rx=0 tx=0).stop 2024-09-10T08:36:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.994+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 msgr2=0x7f4a5814bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:28.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.994+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00d800 tx=0x7f4a4c00dcc0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 shutdown_connections 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a3806be30 0x7f4a3806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a58155b20 0x7f4a580b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a580cf960 0x7f4a580b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 --2- 172.21.15.52:0/3807303870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a580b21a0 0x7f4a5814bba0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.996+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 >> 172.21.15.52:0/3807303870 conn(0x7f4a5806c240 msgr2=0x7f4a58154730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:28.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.997+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 shutdown_connections 2024-09-10T08:36:28.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:28.997+0000 7f4a60000640 1 -- 172.21.15.52:0/3807303870 wait complete. 2024-09-10T08:36:29.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:36:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.180+0000 7f6f13600640 1 Processor -- start 2024-09-10T08:36:29.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.181+0000 7f6f13600640 1 -- start start 2024-09-10T08:36:29.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f13600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f0c0732e0 0x7f6f0c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f13600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f0c0cce30 0x7f6f0c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f13600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0c0714b0 con 0x7f6f0c071c70 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f13600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0c073c00 con 0x7f6f0c0732e0 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f13600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0c0cd880 con 0x7f6f0c0cce30 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f10c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f0c0732e0 0x7f6f0c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f10c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6f0c0732e0 0x7f6f0c0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50536/0 (socket says 172.21.15.52:50536) 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f10c00640 1 -- 172.21.15.52:0/55123680 learned_addr learned my addr 172.21.15.52:0/55123680 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:29.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.182+0000 7f6f03e00640 1 --2- 172.21.15.52:0/55123680 >> v2:172.21.15.176:3300/0 conn(0x7f6f0c0cce30 0x7f6f0c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.183+0000 7f6f10c00640 1 -- 172.21.15.52:0/55123680 >> v2:172.21.15.176:3300/0 conn(0x7f6f0c0cce30 msgr2=0x7f6f0c0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.183+0000 7f6f10c00640 1 --2- 172.21.15.52:0/55123680 >> v2:172.21.15.176:3300/0 conn(0x7f6f0c0cce30 0x7f6f0c0cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.183+0000 7f6f10c00640 1 -- 172.21.15.52:0/55123680 >> v1:172.21.15.176:6789/0 conn(0x7f6f0c071c70 legacy=0x7f6f0c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.183+0000 7f6f10c00640 1 -- 172.21.15.52:0/55123680 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c0cdb60 con 0x7f6f0c0732e0 2024-09-10T08:36:29.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.184+0000 7f6f10c00640 1 --2- 172.21.15.52:0/55123680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0736c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0c57f0 tx=0x7f6efc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16390bb59d7b9b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.184+0000 7f6f0be00640 1 -- 172.21.15.52:0/55123680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc037070 con 0x7f6f0c0732e0 2024-09-10T08:36:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.184+0000 7f6f0be00640 1 -- 172.21.15.52:0/55123680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc032440 con 0x7f6f0c0732e0 2024-09-10T08:36:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.184+0000 7f6f0be00640 1 -- 172.21.15.52:0/55123680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc032810 con 0x7f6f0c0732e0 2024-09-10T08:36:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 -- 172.21.15.52:0/55123680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 msgr2=0x7f6f0c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 --2- 172.21.15.52:0/55123680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0736c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0c57f0 tx=0x7f6efc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 -- 172.21.15.52:0/55123680 shutdown_connections 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 --2- 172.21.15.52:0/55123680 >> v2:172.21.15.176:3300/0 conn(0x7f6f0c0cce30 0x7f6f0c0cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 --2- 172.21.15.52:0/55123680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0736c0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 -- 172.21.15.52:0/55123680 >> 172.21.15.52:0/55123680 conn(0x7f6f0c06d0f0 msgr2=0x7f6f0c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 -- 172.21.15.52:0/55123680 shutdown_connections 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.185+0000 7f6f13600640 1 -- 172.21.15.52:0/55123680 wait complete. 2024-09-10T08:36:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.186+0000 7f6f13600640 1 Processor -- start 2024-09-10T08:36:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.186+0000 7f6f13600640 1 -- start start 2024-09-10T08:36:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f0c071c70 0x7f6f0c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 0x7f6f0c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c06bf70 con 0x7f6f0c0732e0 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c06bdf0 con 0x7f6f0c0cce30 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f13600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c15cfe0 con 0x7f6f0c071c70 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.187+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50544/0 (socket says 172.21.15.52:50544) 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 -- 172.21.15.52:0/1383103959 learned_addr learned my addr 172.21.15.52:0/1383103959 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f10c00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f0c071c70 0x7f6f0c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f11600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 0x7f6f0c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 -- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f0c071c70 msgr2=0x7f6f0c151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f0c071c70 0x7f6f0c151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 -- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 msgr2=0x7f6f0c0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 0x7f6f0c0cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 -- 172.21.15.52:0/1383103959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c1f45d0 con 0x7f6f0c0732e0 2024-09-10T08:36:29.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f11600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 0x7f6f0c0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:29.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f03e00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d5f0 tx=0x7f6ef400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.188+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40125f0 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.189+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef4019070 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.189+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40129d0 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.189+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0c0b2460 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.189+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c157c00 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.190+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0c15d370 con 0x7f6f0c0732e0 2024-09-10T08:36:29.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.191+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ef4012b70 con 0x7f6f0c0732e0 2024-09-10T08:36:29.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.191+0000 7f6f09600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 0x7f6ee806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.191+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f6ef408af50 con 0x7f6f0c0732e0 2024-09-10T08:36:29.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.192+0000 7f6f10c00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 0x7f6ee806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.192+0000 7f6f10c00640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 0x7f6ee806e320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6efc034000 tx=0x7f6efc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.195+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ef4059b60 con 0x7f6f0c0732e0 2024-09-10T08:36:29.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.383+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f6f0c15ba60 con 0x7f6f0c0732e0 2024-09-10T08:36:29.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.387+0000 7f6f09600640 1 -- 172.21.15.52:0/1383103959 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f6ef4059460 con 0x7f6f0c0732e0 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 msgr2=0x7f6ee806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 0x7f6ee806e320 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6efc034000 tx=0x7f6efc02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 msgr2=0x7f6f0c0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d5f0 tx=0x7f6ef400dab0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 shutdown_connections 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ee806be60 0x7f6ee806e320 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f0c0cce30 0x7f6f0c0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f0c0732e0 0x7f6f0c0ce0f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 --2- 172.21.15.52:0/1383103959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f0c071c70 0x7f6f0c151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 >> 172.21.15.52:0/1383103959 conn(0x7f6f0c06d0f0 msgr2=0x7f6f0c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 shutdown_connections 2024-09-10T08:36:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.389+0000 7f6f13600640 1 -- 172.21.15.52:0/1383103959 wait complete. 2024-09-10T08:36:29.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-10T08:36:29.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.562+0000 7f729f200640 1 Processor -- start 2024-09-10T08:36:29.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.562+0000 7f729f200640 1 -- start start 2024-09-10T08:36:29.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.563+0000 7f729f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.563+0000 7f729f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 0x7f72a015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.563+0000 7f729f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a00b6660 con 0x7f72a00b60e0 2024-09-10T08:36:29.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.563+0000 7f729f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f72a015ca90 con 0x7f72a015f5d0 2024-09-10T08:36:29.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.563+0000 7f729f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72a015cce0 con 0x7f72a01522d0 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 0x7f72a015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42696/0 (socket says 172.21.15.52:42696) 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 -- 172.21.15.52:0/2858952342 learned_addr learned my addr 172.21.15.52:0/2858952342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729e800640 1 --2- 172.21.15.52:0/2858952342 >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 0x7f72a015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:47336/0 (socket says 172.21.15.52:47336) 2024-09-10T08:36:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 -- 172.21.15.52:0/2858952342 >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 msgr2=0x7f72a015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:29.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 --2- 172.21.15.52:0/2858952342 >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 0x7f72a015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 -- 172.21.15.52:0/2858952342 >> v1:172.21.15.176:6789/0 conn(0x7f72a00b60e0 legacy=0x7f72a015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.564+0000 7f729de00640 1 -- 172.21.15.52:0/2858952342 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a015cfc0 con 0x7f72a01522d0 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.565+0000 7f729de00640 1 --2- 172.21.15.52:0/2858952342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7290009870 tx=0x7f729002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c27187324d2979b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729ca00640 1 -- 172.21.15.52:0/2858952342 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290037070 con 0x7f72a01522d0 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729ca00640 1 -- 172.21.15.52:0/2858952342 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7290032440 con 0x7f72a01522d0 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729ca00640 1 -- 172.21.15.52:0/2858952342 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290032810 con 0x7f72a01522d0 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 -- 172.21.15.52:0/2858952342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 msgr2=0x7f72a00b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 --2- 172.21.15.52:0/2858952342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7290009870 tx=0x7f729002a250 comp rx=0 tx=0).stop 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 -- 172.21.15.52:0/2858952342 shutdown_connections 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 --2- 172.21.15.52:0/2858952342 >> v2:172.21.15.176:3300/0 conn(0x7f72a015f5d0 0x7f72a015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 --2- 172.21.15.52:0/2858952342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a01522d0 0x7f72a00b5ba0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 -- 172.21.15.52:0/2858952342 >> 172.21.15.52:0/2858952342 conn(0x7f72a006c240 msgr2=0x7f72a006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:29.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 -- 172.21.15.52:0/2858952342 shutdown_connections 2024-09-10T08:36:29.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.566+0000 7f729f200640 1 -- 172.21.15.52:0/2858952342 wait complete. 2024-09-10T08:36:29.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.568+0000 7f729f200640 1 Processor -- start 2024-09-10T08:36:29.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.568+0000 7f729f200640 1 -- start start 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 0x7f72a01f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a015f5d0 0x7f72a01663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72a01526b0 con 0x7f72a01522d0 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72a015fc80 con 0x7f72a00b60e0 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72a0152830 con 0x7f72a015f5d0 2024-09-10T08:36:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50548/0 (socket says 172.21.15.52:50548) 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.569+0000 7f729d400640 1 -- 172.21.15.52:0/2145823740 learned_addr learned my addr 172.21.15.52:0/2145823740 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729de00640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 0x7f72a01f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729e800640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a015f5d0 0x7f72a01663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 -- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a015f5d0 msgr2=0x7f72a01663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a015f5d0 0x7f72a01663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 -- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 msgr2=0x7f72a01f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 0x7f72a01f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 -- 172.21.15.52:0/2145823740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a0167020 con 0x7f72a01522d0 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729de00640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 0x7f72a01f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:29.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729d400640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f728c00c440 tx=0x7f728c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c0052d0 con 0x7f72a01522d0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c005470 con 0x7f72a01522d0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c007260 con 0x7f72a01522d0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.570+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a0167300 con 0x7f72a01522d0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.571+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a0167ba0 con 0x7f72a01522d0 2024-09-10T08:36:29.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.572+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a0167da0 con 0x7f72a01522d0 2024-09-10T08:36:29.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.573+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f728c007400 con 0x7f72a01522d0 2024-09-10T08:36:29.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.573+0000 7f7296000640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 0x7f728006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.573+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f728c08a120 con 0x7f72a01522d0 2024-09-10T08:36:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.574+0000 7f729de00640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 0x7f728006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:29.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.575+0000 7f729de00640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 0x7f728006e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7290034000 tx=0x7f729002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:29.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.578+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72a0167da0 con 0x7f72a01522d0 2024-09-10T08:36:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.831+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f72a00b5ba0 con 0x7f72a01522d0 2024-09-10T08:36:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.990+0000 7f7296000640 1 -- 172.21.15.52:0/2145823740 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v370) ==== 158+0+0 (secure 0 0 0) 0x7f728c058d30 con 0x7f72a01522d0 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 msgr2=0x7f728006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 0x7f728006e2f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7290034000 tx=0x7f729002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 msgr2=0x7f72a014ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f728c00c440 tx=0x7f728c001e70 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 shutdown_connections 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f728006be30 0x7f728006e2f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72a015f5d0 0x7f72a01663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a01522d0 0x7f72a014ac50 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 --2- 172.21.15.52:0/2145823740 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72a00b60e0 0x7f72a01f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:29.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 >> 172.21.15.52:0/2145823740 conn(0x7f72a006c240 msgr2=0x7f72a015ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:29.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 shutdown_connections 2024-09-10T08:36:29.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:29.992+0000 7f729f200640 1 -- 172.21.15.52:0/2145823740 wait complete. 2024-09-10T08:36:30.008 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-10T08:36:30.009 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T08:36:30.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.165+0000 7f6d61400640 1 Processor -- start 2024-09-10T08:36:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.165+0000 7f6d61400640 1 -- start start 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 0x7f6d5c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 0x7f6d5c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d5c1600f0 0x7f6d5c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c0b4650 con 0x7f6d5c1600f0 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c0b4370 con 0x7f6d5c0cf9a0 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d61400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0b4dc0 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d60a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d5c1600f0 0x7f6d5c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d60a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d5c1600f0 0x7f6d5c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50552/0 (socket says 172.21.15.52:50552) 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.166+0000 7f6d60a00640 1 -- 172.21.15.52:0/3826567794 learned_addr learned my addr 172.21.15.52:0/3826567794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d5be00640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 0x7f6d5c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d53e00640 1 --2- 172.21.15.52:0/3826567794 >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 0x7f6d5c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d60a00640 1 -- 172.21.15.52:0/3826567794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 msgr2=0x7f6d5c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d60a00640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 0x7f6d5c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d60a00640 1 -- 172.21.15.52:0/3826567794 >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 msgr2=0x7f6d5c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d60a00640 1 --2- 172.21.15.52:0/3826567794 >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 0x7f6d5c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d60a00640 1 -- 172.21.15.52:0/3826567794 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c0b50a0 con 0x7f6d5c1600f0 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d53e00640 1 --2- 172.21.15.52:0/3826567794 >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 0x7f6d5c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.167+0000 7f6d5be00640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 0x7f6d5c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.168+0000 7f6d60a00640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c1600f0 0x7f6d5c160580 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c06c7e0 tx=0x7f6d5402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4531ed92934f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.168+0000 7f6d5b400640 1 -- 172.21.15.52:0/3826567794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54036070 con 0x7f6d5c1600f0 2024-09-10T08:36:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.168+0000 7f6d5b400640 1 -- 172.21.15.52:0/3826567794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54031600 con 0x7f6d5c1600f0 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.168+0000 7f6d5b400640 1 -- 172.21.15.52:0/3826567794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d540319d0 con 0x7f6d5c1600f0 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 -- 172.21.15.52:0/3826567794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c1600f0 msgr2=0x7f6d5c160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c1600f0 0x7f6d5c160580 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c06c7e0 tx=0x7f6d5402a570 comp rx=0 tx=0).stop 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 -- 172.21.15.52:0/3826567794 shutdown_connections 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 --2- 172.21.15.52:0/3826567794 >> v2:172.21.15.176:3300/0 conn(0x7f6d5c0cf9a0 0x7f6d5c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c1600f0 0x7f6d5c160580 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 --2- 172.21.15.52:0/3826567794 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c0cf5c0 0x7f6d5c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 -- 172.21.15.52:0/3826567794 >> 172.21.15.52:0/3826567794 conn(0x7f6d5c06c240 msgr2=0x7f6d5c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 -- 172.21.15.52:0/3826567794 shutdown_connections 2024-09-10T08:36:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.169+0000 7f6d61400640 1 -- 172.21.15.52:0/3826567794 wait complete. 2024-09-10T08:36:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.170+0000 7f6d61400640 1 Processor -- start 2024-09-10T08:36:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 -- start start 2024-09-10T08:36:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5c0cf9a0 0x7f6d5c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c1600f0 0x7f6d5c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c160c40 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c160ac0 con 0x7f6d5c0cf9a0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.171+0000 7f6d61400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c160dc0 con 0x7f6d5c1600f0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50554/0 (socket says 172.21.15.52:50554) 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 -- 172.21.15.52:0/2540806491 learned_addr learned my addr 172.21.15.52:0/2540806491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d53e00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5c0cf9a0 0x7f6d5c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d60a00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c1600f0 0x7f6d5c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 -- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c1600f0 msgr2=0x7f6d5c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c1600f0 0x7f6d5c0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 -- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5c0cf9a0 msgr2=0x7f6d5c153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5c0cf9a0 0x7f6d5c153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 -- 172.21.15.52:0/2540806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c145380 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d5be00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00d800 tx=0x7f6d4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.172+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c018070 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.173+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c004030 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.173+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004400 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.173+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c0cd4b0 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.173+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c0cda70 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.174+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c160580 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.175+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d4c0096a0 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.176+0000 7f6d58c00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 0x7f6d3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.176+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f6d4c08af80 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.176+0000 7f6d53e00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 0x7f6d3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.177+0000 7f6d53e00640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 0x7f6d3806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c152a10 tx=0x7f6d44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.180+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d4c059c20 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.372+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d5c071b40 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.373+0000 7f6d58c00640 1 -- 172.21.15.52:0/2540806491 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+13054 (secure 0 0 0) 0x7f6d4c059520 con 0x7f6d5c0cf5c0 2024-09-10T08:36:30.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:30.373 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":116,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:28.987430+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3438113283":"2024-09-11T08:36:25.976684+0000","172.21.15.52:6833/3438113283":"2024-09-11T08:36:25.976684+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 msgr2=0x7f6d3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 0x7f6d3806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c152a10 tx=0x7f6d44008040 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 msgr2=0x7f6d5c144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00d800 tx=0x7f6d4c00dcc0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 shutdown_connections 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d3806be30 0x7f6d3806e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d5c1600f0 0x7f6d5c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d5c0cf9a0 0x7f6d5c153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 --2- 172.21.15.52:0/2540806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d5c0cf5c0 0x7f6d5c144e40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 >> 172.21.15.52:0/2540806491 conn(0x7f6d5c06c240 msgr2=0x7f6d5c158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 shutdown_connections 2024-09-10T08:36:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.375+0000 7f6d61400640 1 -- 172.21.15.52:0/2540806491 wait complete. 2024-09-10T08:36:30.392 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:36:30.392 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:36:30.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.551+0000 7f672c600640 1 Processor -- start 2024-09-10T08:36:30.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.551+0000 7f672c600640 1 -- start start 2024-09-10T08:36:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.552+0000 7f672c600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67240ccf30 0x7f67240b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.552+0000 7f672c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 0x7f6724071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.552+0000 7f672c600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67240cf2e0 con 0x7f672415b7c0 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.552+0000 7f672c600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6724070fe0 con 0x7f67240ccf30 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.552+0000 7f672c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67240712c0 con 0x7f67240cead0 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67240ccf30 0x7f67240b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67240ccf30 0x7f67240b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50560/0 (socket says 172.21.15.52:50560) 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 -- 172.21.15.52:0/2462912581 learned_addr learned my addr 172.21.15.52:0/2462912581 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f672a600640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 0x7f6724071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 -- 172.21.15.52:0/2462912581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 msgr2=0x7f6724071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 0x7f6724071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 -- 172.21.15.52:0/2462912581 >> v1:172.21.15.176:6789/0 conn(0x7f672415b7c0 legacy=0x7f67240cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f6729c00640 1 -- 172.21.15.52:0/2462912581 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67240715a0 con 0x7f67240ccf30 2024-09-10T08:36:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.553+0000 7f672a600640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 0x7f6724071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:30.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.554+0000 7f6729c00640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67240ccf30 0x7f67240b2c50 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6718009870 tx=0x7f671802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49e0b4d957bb9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.554+0000 7f6723e00640 1 -- 172.21.15.52:0/2462912581 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718037070 con 0x7f67240ccf30 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f6723e00640 1 -- 172.21.15.52:0/2462912581 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6718032440 con 0x7f67240ccf30 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f6723e00640 1 -- 172.21.15.52:0/2462912581 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718032810 con 0x7f67240ccf30 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 -- 172.21.15.52:0/2462912581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67240ccf30 msgr2=0x7f67240b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67240ccf30 0x7f67240b2c50 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6718009870 tx=0x7f671802a180 comp rx=0 tx=0).stop 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 -- 172.21.15.52:0/2462912581 shutdown_connections 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240cead0 0x7f6724071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 --2- 172.21.15.52:0/2462912581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67240ccf30 0x7f67240b2c50 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 -- 172.21.15.52:0/2462912581 >> 172.21.15.52:0/2462912581 conn(0x7f672406d0f0 msgr2=0x7f672406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 -- 172.21.15.52:0/2462912581 shutdown_connections 2024-09-10T08:36:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.555+0000 7f672c600640 1 -- 172.21.15.52:0/2462912581 wait complete. 2024-09-10T08:36:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.557+0000 7f672c600640 1 Processor -- start 2024-09-10T08:36:30.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.557+0000 7f672c600640 1 -- start start 2024-09-10T08:36:30.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240ccf30 0x7f672413e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67240cead0 0x7f6724150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67240cf0c0 con 0x7f672415b7c0 2024-09-10T08:36:30.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67240cef40 con 0x7f67240cead0 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6724072000 con 0x7f67240ccf30 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50564/0 (socket says 172.21.15.52:50564) 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f672a600640 1 -- 172.21.15.52:0/1665452806 learned_addr learned my addr 172.21.15.52:0/1665452806 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f6729c00640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240ccf30 0x7f672413e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.558+0000 7f6729200640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67240cead0 0x7f6724150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 -- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240ccf30 msgr2=0x7f672413e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240ccf30 0x7f672413e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 -- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67240cead0 msgr2=0x7f6724150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67240cead0 0x7f6724150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 -- 172.21.15.52:0/1665452806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672413e670 con 0x7f672415b7c0 2024-09-10T08:36:30.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672a600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f671c00cef0 tx=0x7f671c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c01a070 con 0x7f672415b7c0 2024-09-10T08:36:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f671c00d860 con 0x7f672415b7c0 2024-09-10T08:36:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672414f460 con 0x7f672415b7c0 2024-09-10T08:36:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.559+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00dc50 con 0x7f672415b7c0 2024-09-10T08:36:30.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.560+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672414fa20 con 0x7f672415b7c0 2024-09-10T08:36:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.560+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67240b2c50 con 0x7f672415b7c0 2024-09-10T08:36:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.561+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f671c01d070 con 0x7f672415b7c0 2024-09-10T08:36:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.562+0000 7f6721600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.562+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f671c08b3a0 con 0x7f672415b7c0 2024-09-10T08:36:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.563+0000 7f6729c00640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.564+0000 7f6729c00640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6718034000 tx=0x7f671802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.567+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f672413e670 con 0x7f672415b7c0 2024-09-10T08:36:30.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.751+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f67240d0290 con 0x7f672415b7c0 2024-09-10T08:36:30.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.751+0000 7f6721600640 1 -- 172.21.15.52:0/1665452806 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7f671c059ab0 con 0x7f672415b7c0 2024-09-10T08:36:30.752 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.753+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 msgr2=0x7f670406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.753+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6718034000 tx=0x7f671802e000 comp rx=0 tx=0).stop 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.753+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 msgr2=0x7f6724150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.753+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f671c00cef0 tx=0x7f671c00a710 comp rx=0 tx=0).stop 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 shutdown_connections 2024-09-10T08:36:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f672415b7c0 0x7f6724150e80 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67240cead0 0x7f6724150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 --2- 172.21.15.52:0/1665452806 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67240ccf30 0x7f672413e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 >> 172.21.15.52:0/1665452806 conn(0x7f672406d0f0 msgr2=0x7f67240cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 shutdown_connections 2024-09-10T08:36:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.754+0000 7f672c600640 1 -- 172.21.15.52:0/1665452806 wait complete. 2024-09-10T08:36:30.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-10T08:36:30.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.925+0000 7fe333200640 1 Processor -- start 2024-09-10T08:36:30.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.925+0000 7fe333200640 1 -- start start 2024-09-10T08:36:30.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.926+0000 7fe333200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 0x7fe3340d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe333200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe333200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3340d3990 con 0x7fe3340b6540 2024-09-10T08:36:30.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe333200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe3340b69b0 con 0x7fe33415e440 2024-09-10T08:36:30.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe333200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3340d3c70 con 0x7fe3340cf450 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe331e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 0x7fe3340d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe32be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe32be00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42736/0 (socket says 172.21.15.52:42736) 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe331e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 0x7fe3340d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:47364/0 (socket says 172.21.15.52:47364) 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.927+0000 7fe32be00640 1 -- 172.21.15.52:0/4269795859 learned_addr learned my addr 172.21.15.52:0/4269795859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.928+0000 7fe32be00640 1 -- 172.21.15.52:0/4269795859 >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 msgr2=0x7fe3340d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:30.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.928+0000 7fe32be00640 1 --2- 172.21.15.52:0/4269795859 >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 0x7fe3340d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.928+0000 7fe32be00640 1 -- 172.21.15.52:0/4269795859 >> v1:172.21.15.176:6789/0 conn(0x7fe3340b6540 legacy=0x7fe33406bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.928+0000 7fe32be00640 1 -- 172.21.15.52:0/4269795859 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3340d3f50 con 0x7fe3340cf450 2024-09-10T08:36:30.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe32be00640 1 --2- 172.21.15.52:0/4269795859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5135b46f74dc90a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe331400640 1 -- 172.21.15.52:0/4269795859 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c037070 con 0x7fe3340cf450 2024-09-10T08:36:30.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe331400640 1 -- 172.21.15.52:0/4269795859 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c02ae50 con 0x7fe3340cf450 2024-09-10T08:36:30.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe331400640 1 -- 172.21.15.52:0/4269795859 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c032860 con 0x7fe3340cf450 2024-09-10T08:36:30.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe333200640 1 -- 172.21.15.52:0/4269795859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 msgr2=0x7fe3340b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe333200640 1 --2- 172.21.15.52:0/4269795859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009870 tx=0x7fe31c02a300 comp rx=0 tx=0).stop 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe333200640 1 -- 172.21.15.52:0/4269795859 shutdown_connections 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe333200640 1 --2- 172.21.15.52:0/4269795859 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3340cf450 0x7fe3340b6000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.929+0000 7fe333200640 1 --2- 172.21.15.52:0/4269795859 >> v2:172.21.15.176:3300/0 conn(0x7fe33415e440 0x7fe3340d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.930+0000 7fe333200640 1 -- 172.21.15.52:0/4269795859 >> 172.21.15.52:0/4269795859 conn(0x7fe334067f80 msgr2=0x7fe3340d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.930+0000 7fe333200640 1 -- 172.21.15.52:0/4269795859 shutdown_connections 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.930+0000 7fe333200640 1 -- 172.21.15.52:0/4269795859 wait complete. 2024-09-10T08:36:30.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.931+0000 7fe333200640 1 Processor -- start 2024-09-10T08:36:30.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.931+0000 7fe333200640 1 -- start start 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 0x7fe3340ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33415e440 0x7fe334160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340b7540 con 0x7fe3340cf450 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe33415e820 con 0x7fe3340b6540 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe333200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe3340b76c0 con 0x7fe33415e440 2024-09-10T08:36:30.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe32be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe32be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50574/0 (socket says 172.21.15.52:50574) 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.932+0000 7fe32be00640 1 -- 172.21.15.52:0/824589391 learned_addr learned my addr 172.21.15.52:0/824589391 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe331e00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 0x7fe3340ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe332800640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33415e440 0x7fe334160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 -- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33415e440 msgr2=0x7fe334160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33415e440 0x7fe334160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 -- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 msgr2=0x7fe3340ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:30.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 0x7fe3340ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 -- 172.21.15.52:0/824589391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3340cd560 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe331e00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 0x7fe3340ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.933+0000 7fe32be00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.934+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c041020 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.934+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c03c870 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.934+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c037040 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.934+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3340cd840 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.934+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3340cde00 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.935+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3340b6000 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.936+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe31c044020 con 0x7fe3340cf450 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.937+0000 7fe32a000640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 0x7fe31006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:30.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.937+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fe31c0ab2b0 con 0x7fe3340cf450 2024-09-10T08:36:30.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.937+0000 7fe331e00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 0x7fe31006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:30.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.938+0000 7fe331e00640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 0x7fe31006e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e90 tx=0x7fe324009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:30.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:30.941+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe31c04b030 con 0x7fe3340cf450 2024-09-10T08:36:31.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:31.193+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fe3341f5040 con 0x7fe3340cf450 2024-09-10T08:36:31.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:31.997+0000 7fe32a000640 1 -- 172.21.15.52:0/824589391 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v372) ==== 147+0+0 (secure 0 0 0) 0x7fe31c079870 con 0x7fe3340cf450 2024-09-10T08:36:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 msgr2=0x7fe31006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 0x7fe31006e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e90 tx=0x7fe324009190 comp rx=0 tx=0).stop 2024-09-10T08:36:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 msgr2=0x7fe3340b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 shutdown_connections 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe31006be30 0x7fe31006e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe33415e440 0x7fe334160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3340cf450 0x7fe3340b9bb0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 --2- 172.21.15.52:0/824589391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3340b6540 0x7fe3340ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.000+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 >> 172.21.15.52:0/824589391 conn(0x7fe334067f80 msgr2=0x7fe3341577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.001+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 shutdown_connections 2024-09-10T08:36:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.001+0000 7fe333200640 1 -- 172.21.15.52:0/824589391 wait complete. 2024-09-10T08:36:32.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:36:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.183+0000 7f0e1a800640 1 Processor -- start 2024-09-10T08:36:32.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.183+0000 7f0e1a800640 1 -- start start 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.184+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e1415e620 0x7f0e140d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e1a800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e140d2660 0x7f0e140d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e1a800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e140d3250 con 0x7f0e140d14a0 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e1a800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0e140b7680 con 0x7f0e140d2660 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e1a800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e140b78b0 con 0x7f0e1415e620 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e18a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e140d2660 0x7f0e140d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e19e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0e140d14a0 0x7f0e140b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54914/0 (socket says 172.21.15.52:54914) 2024-09-10T08:36:32.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e19e00640 1 -- 172.21.15.52:0/1179404096 learned_addr learned my addr 172.21.15.52:0/1179404096 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e19400640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e1415e620 0x7f0e140d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e13e00640 1 -- 172.21.15.52:0/1179404096 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789707913 0 0) 0x7f0e140d3250 con 0x7f0e140d14a0 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e18a00640 1 -- 172.21.15.52:0/1179404096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e1415e620 msgr2=0x7f0e140d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e18a00640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e1415e620 0x7f0e140d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e18a00640 1 -- 172.21.15.52:0/1179404096 >> v1:172.21.15.52:6789/0 conn(0x7f0e140d14a0 legacy=0x7f0e140b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.185+0000 7f0e18a00640 1 -- 172.21.15.52:0/1179404096 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1415ea00 con 0x7f0e140d2660 2024-09-10T08:36:32.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.186+0000 7f0e18a00640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e140d2660 0x7f0e140d0f60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097a0 tx=0x7f0e0002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e66b47c582f229 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e13e00640 1 -- 172.21.15.52:0/1179404096 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00037070 con 0x7f0e140d2660 2024-09-10T08:36:32.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e13e00640 1 -- 172.21.15.52:0/1179404096 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e00032440 con 0x7f0e140d2660 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e13e00640 1 -- 172.21.15.52:0/1179404096 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00032810 con 0x7f0e140d2660 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 -- 172.21.15.52:0/1179404096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e140d2660 msgr2=0x7f0e140d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e140d2660 0x7f0e140d0f60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0e000097a0 tx=0x7f0e0002a180 comp rx=0 tx=0).stop 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 -- 172.21.15.52:0/1179404096 shutdown_connections 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e140d2660 0x7f0e140d0f60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1179404096 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e1415e620 0x7f0e140d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 -- 172.21.15.52:0/1179404096 >> 172.21.15.52:0/1179404096 conn(0x7f0e14067950 msgr2=0x7f0e14067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 -- 172.21.15.52:0/1179404096 shutdown_connections 2024-09-10T08:36:32.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.187+0000 7f0e1a800640 1 -- 172.21.15.52:0/1179404096 wait complete. 2024-09-10T08:36:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.189+0000 7f0e1a800640 1 Processor -- start 2024-09-10T08:36:32.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.189+0000 7f0e1a800640 1 -- start start 2024-09-10T08:36:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e140d14a0 0x7f0e1415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e140d2660 0x7f0e14157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0e140d40a0 con 0x7f0e1415e620 2024-09-10T08:36:32.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e140d2f70 con 0x7f0e140d2660 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e1a800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0e140b9080 con 0x7f0e140d14a0 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50594/0 (socket says 172.21.15.52:50594) 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e19e00640 1 -- 172.21.15.52:0/1432338624 learned_addr learned my addr 172.21.15.52:0/1432338624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.190+0000 7f0e18a00640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e140d2660 0x7f0e14157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19400640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e140d14a0 0x7f0e1415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 -- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e140d14a0 msgr2=0x7f0e1415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e140d14a0 0x7f0e1415add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 -- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e140d2660 msgr2=0x7f0e14157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e140d2660 0x7f0e14157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 -- 172.21.15.52:0/1432338624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e141585f0 con 0x7f0e1415e620 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e19e00640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c7a0 tx=0x7f0e0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c018070 con 0x7f0e1415e620 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c00a640 con 0x7f0e1415e620 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00aab0 con 0x7f0e1415e620 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.191+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e141588d0 con 0x7f0e1415e620 2024-09-10T08:36:32.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.192+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e14158e90 con 0x7f0e1415e620 2024-09-10T08:36:32.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.193+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e140d0f60 con 0x7f0e1415e620 2024-09-10T08:36:32.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.193+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e0c00ac50 con 0x7f0e1415e620 2024-09-10T08:36:32.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.194+0000 7f0e11600640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 0x7f0df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.194+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f0e0c08a0f0 con 0x7f0e1415e620 2024-09-10T08:36:32.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.195+0000 7f0e19400640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 0x7f0df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.195+0000 7f0e19400640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 0x7f0df406e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009aa0 tx=0x7f0e08009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.199+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e0c058740 con 0x7f0e1415e620 2024-09-10T08:36:32.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.385+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0e140d1930 con 0x7f0e1415e620 2024-09-10T08:36:32.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.389+0000 7f0e11600640 1 -- 172.21.15.52:0/1432338624 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f0e0c05ca40 con 0x7f0e1415e620 2024-09-10T08:36:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 msgr2=0x7f0df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 0x7f0df406e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009aa0 tx=0x7f0e08009190 comp rx=0 tx=0).stop 2024-09-10T08:36:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 msgr2=0x7f0e141e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c7a0 tx=0x7f0e0c00cc60 comp rx=0 tx=0).stop 2024-09-10T08:36:32.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 shutdown_connections 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0df406be30 0x7f0df406e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e1415e620 0x7f0e141e6fe0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e140d2660 0x7f0e14157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 --2- 172.21.15.52:0/1432338624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0e140d14a0 0x7f0e1415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 >> 172.21.15.52:0/1432338624 conn(0x7f0e14067950 msgr2=0x7f0e140d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 shutdown_connections 2024-09-10T08:36:32.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.391+0000 7f0e1a800640 1 -- 172.21.15.52:0/1432338624 wait complete. 2024-09-10T08:36:32.408 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:36:32.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:36:32.504 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:36:32.593 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:36:32.593 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:32.593 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:32.629 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:36:32.629 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:36:32.629 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:32.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:36:32.667 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:32.667 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:32.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:36:32.704 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:36:32.704 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:32.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:36:32.744 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:36:32.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:32.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.899+0000 7fceace00640 1 Processor -- start 2024-09-10T08:36:32.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.899+0000 7fceace00640 1 -- start start 2024-09-10T08:36:32.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fceace00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcea8071680 0x7fcea8169750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fceace00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea8071b30 con 0x7fcea8147e80 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fceace00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea80b3510 con 0x7fcea8148260 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fceace00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcea8074200 con 0x7fcea8071680 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcea8071680 0x7fcea8169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea5e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcea8147e80 0x7fcea8070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54928/0 (socket says 172.21.15.52:54928) 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea5e00640 1 -- 172.21.15.52:0/1799471785 learned_addr learned my addr 172.21.15.52:0/1799471785 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea6800640 1 -- 172.21.15.52:0/1799471785 >> v1:172.21.15.176:6789/0 conn(0x7fcea8148260 legacy=0x7fcea806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea6800640 1 -- 172.21.15.52:0/1799471785 >> v1:172.21.15.52:6789/0 conn(0x7fcea8147e80 legacy=0x7fcea8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.901+0000 7fcea6800640 1 -- 172.21.15.52:0/1799471785 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea80b37f0 con 0x7fcea8071680 2024-09-10T08:36:32.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.902+0000 7fcea6800640 1 --2- 172.21.15.52:0/1799471785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8071680 0x7fcea8169750 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009d90 tx=0x7fcea002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12cd89c69d219ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fcea5400640 1 -- 172.21.15.52:0/1799471785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0007740 con 0x7fcea8071680 2024-09-10T08:36:32.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fcea5400640 1 -- 172.21.15.52:0/1799471785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea00078e0 con 0x7fcea8071680 2024-09-10T08:36:32.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fcea5400640 1 -- 172.21.15.52:0/1799471785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0007cb0 con 0x7fcea8071680 2024-09-10T08:36:32.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 -- 172.21.15.52:0/1799471785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8071680 msgr2=0x7fcea8169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 --2- 172.21.15.52:0/1799471785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8071680 0x7fcea8169750 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009d90 tx=0x7fcea002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 -- 172.21.15.52:0/1799471785 shutdown_connections 2024-09-10T08:36:32.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 --2- 172.21.15.52:0/1799471785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8071680 0x7fcea8169750 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 -- 172.21.15.52:0/1799471785 >> 172.21.15.52:0/1799471785 conn(0x7fcea80ccec0 msgr2=0x7fcea80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:32.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.903+0000 7fceace00640 1 -- 172.21.15.52:0/1799471785 shutdown_connections 2024-09-10T08:36:32.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.904+0000 7fceace00640 1 -- 172.21.15.52:0/1799471785 wait complete. 2024-09-10T08:36:32.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.905+0000 7fceace00640 1 Processor -- start 2024-09-10T08:36:32.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.905+0000 7fceace00640 1 -- start start 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcea8071680 0x7fcea81f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcea8148260 0x7fcea81e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcea806c320 con 0x7fcea8147e80 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcea80b3e40 con 0x7fcea8148260 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fceace00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcea806c4a0 con 0x7fcea8071680 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fce9fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fce9fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50616/0 (socket says 172.21.15.52:50616) 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fce9fe00640 1 -- 172.21.15.52:0/1184802653 learned_addr learned my addr 172.21.15.52:0/1184802653 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:32.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fcea5e00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcea8071680 0x7fcea81f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.906+0000 7fcea6800640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcea8148260 0x7fcea81e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 -- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcea8071680 msgr2=0x7fcea81f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcea8071680 0x7fcea81f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 -- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcea8148260 msgr2=0x7fcea81e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcea8148260 0x7fcea81e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 -- 172.21.15.52:0/1184802653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea81f4d90 con 0x7fcea8147e80 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9fe00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c3c0 tx=0x7fce9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce900052d0 con 0x7fcea8147e80 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce90005490 con 0x7fcea8147e80 2024-09-10T08:36:32.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea81f4870 con 0x7fcea8147e80 2024-09-10T08:36:32.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90007260 con 0x7fcea8147e80 2024-09-10T08:36:32.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.907+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea81e4d90 con 0x7fcea8147e80 2024-09-10T08:36:32.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.908+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea8070f70 con 0x7fcea8147e80 2024-09-10T08:36:32.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.909+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce90007400 con 0x7fcea8147e80 2024-09-10T08:36:32.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.910+0000 7fce9e000640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:32.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.910+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7fce9008a0e0 con 0x7fcea8147e80 2024-09-10T08:36:32.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.911+0000 7fcea5e00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:32.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.912+0000 7fcea5e00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 0x7fce8406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fce98005880 tx=0x7fce98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:32.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:32.915+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce90058cf0 con 0x7fcea8147e80 2024-09-10T08:36:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.137+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcea8145760 con 0x7fcea8147e80 2024-09-10T08:36:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.137+0000 7fce9e000640 1 -- 172.21.15.52:0/1184802653 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+3914 (secure 0 0 0) 0x7fce900585f0 con 0x7fcea8147e80 2024-09-10T08:36:33.138 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:33.138 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":86,"btime":"2024-09-10T08:36:26:978553+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3777794183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3777794183},{"type":"v1","addr":"172.21.15.176:6837","nonce":3777794183}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7099,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2018064173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2018064173},{"type":"v1","addr":"172.21.15.176:6836","nonce":2018064173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7533,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/127871207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":127871207},{"type":"v1","addr":"172.21.15.52:6834","nonce":127871207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1040346078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1040346078},{"type":"v1","addr":"172.21.15.52:6835","nonce":1040346078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86}],"filesystems":[]} 2024-09-10T08:36:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 86 2024-09-10T08:36:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 msgr2=0x7fce8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 0x7fce8406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fce98005880 tx=0x7fce98009040 comp rx=0 tx=0).stop 2024-09-10T08:36:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 msgr2=0x7fcea81e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c3c0 tx=0x7fce9000c880 comp rx=0 tx=0).stop 2024-09-10T08:36:33.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 shutdown_connections 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fce8406be30 0x7fce8406e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcea8148260 0x7fcea81e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcea8147e80 0x7fcea81e3f40 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 --2- 172.21.15.52:0/1184802653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcea8071680 0x7fcea81f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 >> 172.21.15.52:0/1184802653 conn(0x7fcea80ccec0 msgr2=0x7fcea80739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.139+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 shutdown_connections 2024-09-10T08:36:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.140+0000 7fceace00640 1 -- 172.21.15.52:0/1184802653 wait complete. 2024-09-10T08:36:33.156 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:36:33.156 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:36:33.156 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:36:33.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:36:33.157 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:36:33.157 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:36:33.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:36:33.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:36:33.157 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:36:33.157 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:36:33.158 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:36:33.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:36:33.158 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:36:33.158 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:36:33.158 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:36:33.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:36:33.174 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:36:33.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:36:33.176 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:36:33.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:36:33.177 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:36:33.177 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:36:33.178 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:36:33.178 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:36:33.219 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:36:33.220 DEBUG:teuthology.parallel:result is None 2024-09-10T08:36:33.221 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:36:33.221 DEBUG:teuthology.parallel:result is None 2024-09-10T08:36:33.222 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:36:33.222 DEBUG:teuthology.parallel:result is None 2024-09-10T08:36:33.223 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:36:33.223 DEBUG:teuthology.parallel:result is None 2024-09-10T08:36:33.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:36:33.352 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:36:33.352 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:36:33.353 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:36:33.353 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:36:33.354 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:36:33.354+0000 7f6e54800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-10T08:36:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.391+0000 7f16f7e00640 1 Processor -- start 2024-09-10T08:36:33.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.391+0000 7f16f7e00640 1 -- start start 2024-09-10T08:36:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f16f80b6710 0x7f16f80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 0x7f16f80b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f80d3990 con 0x7f16f815e440 2024-09-10T08:36:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80d3c70 con 0x7f16f80b6710 2024-09-10T08:36:33.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80d3f50 con 0x7f16f80cf450 2024-09-10T08:36:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f6a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f16f815e440 0x7f16f80b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47066/0 (socket says 172.21.15.52:47066) 2024-09-10T08:36:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f6a00640 1 -- 172.21.15.52:0/1485385461 learned_addr learned my addr 172.21.15.52:0/1485385461 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.392+0000 7f16f7400640 1 --2- 172.21.15.52:0/1485385461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 0x7f16f80b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f6000640 1 --2- 172.21.15.52:0/1485385461 >> v2:172.21.15.176:3300/0 conn(0x7f16f80b6710 0x7f16f80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f5600640 1 -- 172.21.15.52:0/1485385461 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332526097 0 0) 0x7f16f80d3990 con 0x7f16f815e440 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f5600640 1 -- 172.21.15.52:0/1485385461 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16dc003520 con 0x7f16f815e440 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f7400640 1 -- 172.21.15.52:0/1485385461 >> v2:172.21.15.176:3300/0 conn(0x7f16f80b6710 msgr2=0x7f16f80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f7400640 1 --2- 172.21.15.52:0/1485385461 >> v2:172.21.15.176:3300/0 conn(0x7f16f80b6710 0x7f16f80d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f7400640 1 -- 172.21.15.52:0/1485385461 >> v1:172.21.15.176:6789/0 conn(0x7f16f815e440 legacy=0x7f16f80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.393+0000 7f16f7400640 1 -- 172.21.15.52:0/1485385461 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80d4230 con 0x7f16f80cf450 2024-09-10T08:36:33.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.394+0000 7f16f7400640 1 --2- 172.21.15.52:0/1485385461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 0x7f16f80b7b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e13de5bdc87bb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.394+0000 7f16f5600640 1 -- 172.21.15.52:0/1485385461 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0007740 con 0x7f16f80cf450 2024-09-10T08:36:33.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.394+0000 7f16f5600640 1 -- 172.21.15.52:0/1485385461 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f00078e0 con 0x7f16f80cf450 2024-09-10T08:36:33.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.394+0000 7f16f5600640 1 -- 172.21.15.52:0/1485385461 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0007cb0 con 0x7f16f80cf450 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 -- 172.21.15.52:0/1485385461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 msgr2=0x7f16f80b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 --2- 172.21.15.52:0/1485385461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 0x7f16f80b7b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 -- 172.21.15.52:0/1485385461 shutdown_connections 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 --2- 172.21.15.52:0/1485385461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f80cf450 0x7f16f80b7b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 --2- 172.21.15.52:0/1485385461 >> v2:172.21.15.176:3300/0 conn(0x7f16f80b6710 0x7f16f80d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 -- 172.21.15.52:0/1485385461 >> 172.21.15.52:0/1485385461 conn(0x7f16f8067f80 msgr2=0x7f16f80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 -- 172.21.15.52:0/1485385461 shutdown_connections 2024-09-10T08:36:33.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.395+0000 7f16f7e00640 1 -- 172.21.15.52:0/1485385461 wait complete. 2024-09-10T08:36:33.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.397+0000 7f16f7e00640 1 Processor -- start 2024-09-10T08:36:33.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.397+0000 7f16f7e00640 1 -- start start 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.397+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16f80b6710 0x7f16f80b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f815e440 0x7f16f80ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80b76c0 con 0x7f16f80b6710 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80b7540 con 0x7f16f80cf450 2024-09-10T08:36:33.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80b80a0 con 0x7f16f815e440 2024-09-10T08:36:33.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f815e440 0x7f16f80ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:47428/0 (socket says 172.21.15.52:47428) 2024-09-10T08:36:33.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 -- 172.21.15.52:0/3287935814 learned_addr learned my addr 172.21.15.52:0/3287935814 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6a00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16f80b6710 0x7f16f80b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 -- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f815e440 msgr2=0x7f16f80ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f815e440 0x7f16f80ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 -- 172.21.15.52:0/3287935814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16f80b6710 msgr2=0x7f16f80b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16f80b6710 0x7f16f80b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.398+0000 7f16f6000640 1 -- 172.21.15.52:0/3287935814 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80acc80 con 0x7f16f80cf450 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16f6000640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f16e400e9b0 tx=0x7f16e400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4017070 con 0x7f16f80cf450 2024-09-10T08:36:33.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e400c9a0 con 0x7f16f80cf450 2024-09-10T08:36:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e400cd90 con 0x7f16f80cf450 2024-09-10T08:36:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f80acf60 con 0x7f16f80cf450 2024-09-10T08:36:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.399+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f80ad520 con 0x7f16f80cf450 2024-09-10T08:36:33.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.400+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f80b7b60 con 0x7f16f80cf450 2024-09-10T08:36:33.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.402+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16e401a070 con 0x7f16f80cf450 2024-09-10T08:36:33.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.402+0000 7f16eea00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 0x7f16d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:33.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.403+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 4943+0+0 (secure 0 0 0) 0x7f16e408af60 con 0x7f16f80cf450 2024-09-10T08:36:33.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.403+0000 7f16f6a00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 0x7f16d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:33.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.404+0000 7f16f6a00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 0x7f16d806e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005880 tx=0x7f16e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:33.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.407+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16e40595a0 con 0x7f16f80cf450 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:33.604+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f16f80b3680 con 0x7f16f80cf450 2024-09-10T08:36:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.013+0000 7f16eea00640 1 -- 172.21.15.52:0/3287935814 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) ==== 97+0+0 (secure 0 0 0) 0x7f16e405d8a0 con 0x7f16f80cf450 2024-09-10T08:36:34.014 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:36:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.016+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 msgr2=0x7f16d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.016+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 0x7f16d806e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005880 tx=0x7f16e8009040 comp rx=0 tx=0).stop 2024-09-10T08:36:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.016+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 msgr2=0x7f16f80add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.016+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f16e400e9b0 tx=0x7f16e400ee70 comp rx=0 tx=0).stop 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 shutdown_connections 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f16d806be30 0x7f16d806e2f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16f815e440 0x7f16f80ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16f80cf450 0x7f16f80add20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 --2- 172.21.15.52:0/3287935814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16f80b6710 0x7f16f80b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 >> 172.21.15.52:0/3287935814 conn(0x7f16f8067f80 msgr2=0x7f16f80d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 shutdown_connections 2024-09-10T08:36:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.017+0000 7f16f7e00640 1 -- 172.21.15.52:0/3287935814 wait complete. 2024-09-10T08:36:34.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:36:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.196+0000 7fd161a00640 1 Processor -- start 2024-09-10T08:36:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.196+0000 7fd161a00640 1 -- start start 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd161a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 0x7fd15c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd161a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd15c0cf450 0x7fd15c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd161a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15c0d3990 con 0x7fd15c0b6540 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd161a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd15c0b69b0 con 0x7fd15c0cf450 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd161a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c0d3c70 con 0x7fd15c15e440 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd15b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd15c0cf450 0x7fd15c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd15b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd15c0cf450 0x7fd15c0b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42002/0 (socket says 172.21.15.52:42002) 2024-09-10T08:36:34.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.197+0000 7fd15b400640 1 -- 172.21.15.52:0/3828039946 learned_addr learned my addr 172.21.15.52:0/3828039946 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15be00640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 0x7fd15c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15b400640 1 -- 172.21.15.52:0/3828039946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 msgr2=0x7fd15c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15b400640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 0x7fd15c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15b400640 1 -- 172.21.15.52:0/3828039946 >> v1:172.21.15.176:6789/0 conn(0x7fd15c0b6540 legacy=0x7fd15c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15b400640 1 -- 172.21.15.52:0/3828039946 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0d3f50 con 0x7fd15c0cf450 2024-09-10T08:36:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.198+0000 7fd15be00640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 0x7fd15c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.199+0000 7fd15b400640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c0cf450 0x7fd15c0b6000 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fd148009870 tx=0x7fd14802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25880976762b098d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.199+0000 7fd15aa00640 1 -- 172.21.15.52:0/3828039946 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148037070 con 0x7fd15c0cf450 2024-09-10T08:36:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.199+0000 7fd15aa00640 1 -- 172.21.15.52:0/3828039946 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148032640 con 0x7fd15c0cf450 2024-09-10T08:36:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.199+0000 7fd15aa00640 1 -- 172.21.15.52:0/3828039946 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148032a10 con 0x7fd15c0cf450 2024-09-10T08:36:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 -- 172.21.15.52:0/3828039946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c0cf450 msgr2=0x7fd15c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c0cf450 0x7fd15c0b6000 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fd148009870 tx=0x7fd14802a2e0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 -- 172.21.15.52:0/3828039946 shutdown_connections 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c0cf450 0x7fd15c0b6000 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 --2- 172.21.15.52:0/3828039946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c15e440 0x7fd15c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 -- 172.21.15.52:0/3828039946 >> 172.21.15.52:0/3828039946 conn(0x7fd15c067f80 msgr2=0x7fd15c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 -- 172.21.15.52:0/3828039946 shutdown_connections 2024-09-10T08:36:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.200+0000 7fd161a00640 1 -- 172.21.15.52:0/3828039946 wait complete. 2024-09-10T08:36:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.201+0000 7fd161a00640 1 Processor -- start 2024-09-10T08:36:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 -- start start 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd15c0b6540 0x7fd15c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c0cf450 0x7fd15c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c0b7540 con 0x7fd15c15e440 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c15e820 con 0x7fd15c0b6540 2024-09-10T08:36:34.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.202+0000 7fd161a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c0b76c0 con 0x7fd15c0cf450 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42008/0 (socket says 172.21.15.52:42008) 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 -- 172.21.15.52:0/3614434972 learned_addr learned my addr 172.21.15.52:0/3614434972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd15be00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd15c0b6540 0x7fd15c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd15b400640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c0cf450 0x7fd15c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 -- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c0cf450 msgr2=0x7fd15c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c0cf450 0x7fd15c1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 -- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd15c0b6540 msgr2=0x7fd15c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd15c0b6540 0x7fd15c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.203+0000 7fd161000640 1 -- 172.21.15.52:0/3614434972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0cd8d0 con 0x7fd15c15e440 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd161000640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c740 tx=0x7fd15400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154016020 con 0x7fd15c15e440 2024-09-10T08:36:34.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15400ce50 con 0x7fd15c15e440 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154003970 con 0x7fd15c15e440 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15c0cdbb0 con 0x7fd15c15e440 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.204+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15c0ce170 con 0x7fd15c15e440 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.205+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15c0b6000 con 0x7fd15c15e440 2024-09-10T08:36:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.206+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd154003b10 con 0x7fd15c15e440 2024-09-10T08:36:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.207+0000 7fd153e00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.207+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4857+0+0 (secure 0 0 0) 0x7fd15408a680 con 0x7fd15c15e440 2024-09-10T08:36:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.207+0000 7fd15be00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.208+0000 7fd15be00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 0x7fd13c06e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd14c006e80 tx=0x7fd14c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.211+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd154020020 con 0x7fd15c15e440 2024-09-10T08:36:34.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.466+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd15c0b5260 con 0x7fd15c15e440 2024-09-10T08:36:34.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.467+0000 7fd153e00640 1 -- 172.21.15.52:0/3614434972 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fd15405f070 con 0x7fd15c15e440 2024-09-10T08:36:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:36:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:36:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:36:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:36:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:36:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:36:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:36:34.482 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.469+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 msgr2=0x7fd13c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.469+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 0x7fd13c06e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd14c006e80 tx=0x7fd14c008040 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.469+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 msgr2=0x7fd15c1609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.469+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c740 tx=0x7fd15400cc00 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 shutdown_connections 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd13c06be30 0x7fd13c06e2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd15c15e440 0x7fd15c1609e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd15c0cf450 0x7fd15c1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 --2- 172.21.15.52:0/3614434972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd15c0b6540 0x7fd15c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 >> 172.21.15.52:0/3614434972 conn(0x7fd15c067f80 msgr2=0x7fd15c0d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 shutdown_connections 2024-09-10T08:36:34.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.470+0000 7fd161a00640 1 -- 172.21.15.52:0/3614434972 wait complete. 2024-09-10T08:36:34.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:36:34.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.642+0000 7f55e2800640 1 Processor -- start 2024-09-10T08:36:34.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.642+0000 7f55e2800640 1 -- start start 2024-09-10T08:36:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.643+0000 7f55e2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55dc0b2d40 0x7f55dc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55e2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc13eb20 0x7f55dc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55e2800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc071180 con 0x7f55dc15bcf0 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55e2800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f55dc071ab0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55e2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc071460 con 0x7f55dc13eb20 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55dc0b2d40 0x7f55dc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55dc0b2d40 0x7f55dc06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42010/0 (socket says 172.21.15.52:42010) 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 -- 172.21.15.52:0/795450205 learned_addr learned my addr 172.21.15.52:0/795450205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55d3e00640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc13eb20 0x7f55dc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 -- 172.21.15.52:0/795450205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc13eb20 msgr2=0x7f55dc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc13eb20 0x7f55dc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 -- 172.21.15.52:0/795450205 >> v1:172.21.15.176:6789/0 conn(0x7f55dc15bcf0 legacy=0x7f55dc15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.644+0000 7f55db400640 1 -- 172.21.15.52:0/795450205 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc071740 con 0x7f55dc0b2d40 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.645+0000 7f55db400640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc06bc10 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f55dc071c30 tx=0x7f55cc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4cbe9e13bcb199 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55daa00640 1 -- 172.21.15.52:0/795450205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc037070 con 0x7f55dc0b2d40 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55daa00640 1 -- 172.21.15.52:0/795450205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc032440 con 0x7f55dc0b2d40 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55daa00640 1 -- 172.21.15.52:0/795450205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc032810 con 0x7f55dc0b2d40 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 -- 172.21.15.52:0/795450205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 msgr2=0x7f55dc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc06bc10 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f55dc071c30 tx=0x7f55cc02a250 comp rx=0 tx=0).stop 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 -- 172.21.15.52:0/795450205 shutdown_connections 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc13eb20 0x7f55dc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 --2- 172.21.15.52:0/795450205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc06bc10 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 -- 172.21.15.52:0/795450205 >> 172.21.15.52:0/795450205 conn(0x7f55dc0ccec0 msgr2=0x7f55dc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 -- 172.21.15.52:0/795450205 shutdown_connections 2024-09-10T08:36:34.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.646+0000 7f55e2800640 1 -- 172.21.15.52:0/795450205 wait complete. 2024-09-10T08:36:34.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.648+0000 7f55e2800640 1 Processor -- start 2024-09-10T08:36:34.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.648+0000 7f55e2800640 1 -- start start 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55dc13eb20 0x7f55dc1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc15bcf0 0x7f55dc158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc0722d0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc072150 con 0x7f55dc13eb20 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55e2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc072450 con 0x7f55dc15bcf0 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55db400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42016/0 (socket says 172.21.15.52:42016) 2024-09-10T08:36:34.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55db400640 1 -- 172.21.15.52:0/3615342217 learned_addr learned my addr 172.21.15.52:0/3615342217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55d3e00640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55dc13eb20 0x7f55dc1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.649+0000 7f55dbe00640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc15bcf0 0x7f55dc158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 -- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc15bcf0 msgr2=0x7f55dc158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc15bcf0 0x7f55dc158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 -- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55dc13eb20 msgr2=0x7f55dc1f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55dc13eb20 0x7f55dc1f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 -- 172.21.15.52:0/3615342217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc1f9160 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55db400640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02a290 tx=0x7f55cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc041020 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc0306c0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc037040 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.650+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc0cba00 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.651+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc0cbfc0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.652+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc0728e0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.652+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55cc044020 con 0x7f55dc0b2d40 2024-09-10T08:36:34.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.653+0000 7f55d3400640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:34.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.653+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4857+0+0 (secure 0 0 0) 0x7f55cc0ab120 con 0x7f55dc0b2d40 2024-09-10T08:36:34.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.654+0000 7f55d3e00640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:34.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.654+0000 7f55d3e00640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 0x7f55b806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0cb100 tx=0x7f55c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:34.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.657+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55cc04b030 con 0x7f55dc0b2d40 2024-09-10T08:36:34.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.843+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f55dc06c9c0 con 0x7f55dc0b2d40 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.843+0000 7f55d3400640 1 -- 172.21.15.52:0/3615342217 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) ==== 84+0+65 (secure 0 0 0) 0x7f55dc1f9160 con 0x7f55dc0b2d40 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:36:34.844 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 msgr2=0x7f55b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 0x7f55b806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0cb100 tx=0x7f55c4008040 comp rx=0 tx=0).stop 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 msgr2=0x7f55dc13d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f55cc02a290 tx=0x7f55cc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 shutdown_connections 2024-09-10T08:36:34.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f55b806be30 0x7f55b806e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55dc15bcf0 0x7f55dc158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55dc13eb20 0x7f55dc1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.845+0000 7f55e2800640 1 --2- 172.21.15.52:0/3615342217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55dc0b2d40 0x7f55dc13d650 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.846+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 >> 172.21.15.52:0/3615342217 conn(0x7f55dc0ccec0 msgr2=0x7f55dc140600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.846+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 shutdown_connections 2024-09-10T08:36:34.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:34.846+0000 7f55e2800640 1 -- 172.21.15.52:0/3615342217 wait complete. 2024-09-10T08:36:34.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:36:34.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:36:35.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.023+0000 7f8265600640 1 Processor -- start 2024-09-10T08:36:35.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.023+0000 7f8265600640 1 -- start start 2024-09-10T08:36:35.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f8265600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8260161c60 0x7f826006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f8265600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82600b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f8265600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8260162040 con 0x7f82600b7bf0 2024-09-10T08:36:35.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f8265600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f826006e240 con 0x7f8260161c60 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f8265600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82600d5040 con 0x7f826006de00 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.024+0000 7f825fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8260161c60 0x7f826006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f8264c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f82600b7bf0 0x7f82600b8020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37696/0 (socket says 172.21.15.52:37696) 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8260161c60 0x7f826006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42030/0 (socket says 172.21.15.52:42030) 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f8264c00640 1 -- 172.21.15.52:0/3363886224 learned_addr learned my addr 172.21.15.52:0/3363886224 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825f400640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82600b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825fe00640 1 -- 172.21.15.52:0/3363886224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 msgr2=0x7f82600b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825fe00640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82600b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825fe00640 1 -- 172.21.15.52:0/3363886224 >> v1:172.21.15.52:6789/0 conn(0x7f82600b7bf0 legacy=0x7f82600b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825fe00640 1 -- 172.21.15.52:0/3363886224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82600d5320 con 0x7f8260161c60 2024-09-10T08:36:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.025+0000 7f825ea00640 1 -- 172.21.15.52:0/3363886224 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413615939 0 0) 0x7f8260162040 con 0x7f82600b7bf0 2024-09-10T08:36:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.026+0000 7f825fe00640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f826006d8c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f82500097a0 tx=0x7f825002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e572408dca12cee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.026+0000 7f825ea00640 1 -- 172.21.15.52:0/3363886224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250037070 con 0x7f8260161c60 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.026+0000 7f825ea00640 1 -- 172.21.15.52:0/3363886224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8250032440 con 0x7f8260161c60 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.026+0000 7f825ea00640 1 -- 172.21.15.52:0/3363886224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250032810 con 0x7f8260161c60 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 -- 172.21.15.52:0/3363886224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 msgr2=0x7f826006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f826006d8c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f82500097a0 tx=0x7f825002a180 comp rx=0 tx=0).stop 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 -- 172.21.15.52:0/3363886224 shutdown_connections 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82600b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 --2- 172.21.15.52:0/3363886224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f826006d8c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 -- 172.21.15.52:0/3363886224 >> 172.21.15.52:0/3363886224 conn(0x7f82600d1630 msgr2=0x7f82600d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 -- 172.21.15.52:0/3363886224 shutdown_connections 2024-09-10T08:36:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.027+0000 7f8265600640 1 -- 172.21.15.52:0/3363886224 wait complete. 2024-09-10T08:36:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.029+0000 7f8265600640 1 Processor -- start 2024-09-10T08:36:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.029+0000 7f8265600640 1 -- start start 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82601f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82600b7bf0 0x7f82600ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f82600b8730 con 0x7f8260161c60 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f82600cfc80 con 0x7f82600b7bf0 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8265600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f82600d42c0 con 0x7f826006de00 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42038/0 (socket says 172.21.15.52:42038) 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 -- 172.21.15.52:0/3343418362 learned_addr learned my addr 172.21.15.52:0/3343418362 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f825fe00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82601f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f825f400640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82600b7bf0 0x7f82600ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 -- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 msgr2=0x7f82601f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82601f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 -- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82600b7bf0 msgr2=0x7f82600ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82600b7bf0 0x7f82600ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.030+0000 7f8264c00640 1 -- 172.21.15.52:0/3343418362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826015bd90 con 0x7f8260161c60 2024-09-10T08:36:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8264c00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f825800c7d0 tx=0x7f825800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258018070 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825800a640 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826015c070 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825800aa70 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.031+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826015c630 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.032+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82600b3920 con 0x7f8260161c60 2024-09-10T08:36:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.033+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f825801b070 con 0x7f8260161c60 2024-09-10T08:36:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.034+0000 7f8257e00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 0x7f824006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.034+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4857+0+0 (secure 0 0 0) 0x7f825808a1b0 con 0x7f8260161c60 2024-09-10T08:36:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.034+0000 7f825fe00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 0x7f824006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.035+0000 7f825fe00640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 0x7f824006e320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8250034000 tx=0x7f825002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.038+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8258058e10 con 0x7f8260161c60 2024-09-10T08:36:35.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:35.223+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f826006e3f0 con 0x7f8260161c60 2024-09-10T08:36:36.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.017+0000 7f8257e00640 1 -- 172.21.15.52:0/3343418362 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v121) ==== 138+0+0 (secure 0 0 0) 0x7f8258058710 con 0x7f8260161c60 2024-09-10T08:36:36.018 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:36:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 msgr2=0x7f824006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 0x7f824006e320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8250034000 tx=0x7f825002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 msgr2=0x7f82600d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f825800c7d0 tx=0x7f825800cc90 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 shutdown_connections 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f824006be60 0x7f824006e320 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8260161c60 0x7f82600d2f00 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82600b7bf0 0x7f82600ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 --2- 172.21.15.52:0/3343418362 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f826006de00 0x7f82601f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 >> 172.21.15.52:0/3343418362 conn(0x7f82600d1630 msgr2=0x7f82600cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:36.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 shutdown_connections 2024-09-10T08:36:36.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.021+0000 7f8265600640 1 -- 172.21.15.52:0/3343418362 wait complete. 2024-09-10T08:36:36.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:36:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.211+0000 7f1629400640 1 Processor -- start 2024-09-10T08:36:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.211+0000 7f1629400640 1 -- start start 2024-09-10T08:36:36.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1629400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f16240b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1629400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16240cf2e0 con 0x7f16240ccf30 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1629400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1624070fe0 con 0x7f16240cead0 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1629400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16240712c0 con 0x7f162415b7c0 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1622800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f16240ccf30 0x7f16240cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37700/0 (socket says 172.21.15.52:37700) 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f1622800640 1 -- 172.21.15.52:0/2282298636 learned_addr learned my addr 172.21.15.52:0/2282298636 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:36.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.212+0000 7f161be00640 1 --2- 172.21.15.52:0/2282298636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f16240b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228776650 0 0) 0x7f16240cf2e0 con 0x7f16240ccf30 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1608003520 con 0x7f16240ccf30 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f161be00640 1 -- 172.21.15.52:0/2282298636 >> v1:172.21.15.176:6789/0 conn(0x7f16240cead0 legacy=0x7f1624071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290014255 0 0) 0x7f1624070fe0 con 0x7f16240cead0 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f161be00640 1 -- 172.21.15.52:0/2282298636 >> v1:172.21.15.52:6789/0 conn(0x7f16240ccf30 legacy=0x7f16240cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.213+0000 7f161be00640 1 -- 172.21.15.52:0/2282298636 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16240715a0 con 0x7f162415b7c0 2024-09-10T08:36:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.214+0000 7f161be00640 1 --2- 172.21.15.52:0/2282298636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f16240b2c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097d0 tx=0x7f160c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aecc93db36eac42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:36.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.214+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c037070 con 0x7f162415b7c0 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.214+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160c032440 con 0x7f162415b7c0 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.214+0000 7f1621e00640 1 -- 172.21.15.52:0/2282298636 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160c032810 con 0x7f162415b7c0 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 -- 172.21.15.52:0/2282298636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 msgr2=0x7f16240b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 --2- 172.21.15.52:0/2282298636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f16240b2c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f160c0097d0 tx=0x7f160c02a180 comp rx=0 tx=0).stop 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 -- 172.21.15.52:0/2282298636 shutdown_connections 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 --2- 172.21.15.52:0/2282298636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f16240b2c50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 -- 172.21.15.52:0/2282298636 >> 172.21.15.52:0/2282298636 conn(0x7f162406d0f0 msgr2=0x7f162406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 -- 172.21.15.52:0/2282298636 shutdown_connections 2024-09-10T08:36:36.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.215+0000 7f1629400640 1 -- 172.21.15.52:0/2282298636 wait complete. 2024-09-10T08:36:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.217+0000 7f1629400640 1 Processor -- start 2024-09-10T08:36:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.217+0000 7f1629400640 1 -- start start 2024-09-10T08:36:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 0x7f162415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f162414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f16240cf0c0 con 0x7f16240ccf30 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16240cef40 con 0x7f16240cead0 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1629400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16240721d0 con 0x7f162415b7c0 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42044/0 (socket says 172.21.15.52:42044) 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 -- 172.21.15.52:0/1402264458 learned_addr learned my addr 172.21.15.52:0/1402264458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 -- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 msgr2=0x7f162414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1623200640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f162414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f161be00640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 0x7f162415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f162414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 -- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 msgr2=0x7f162415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 0x7f162415a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1622800640 1 -- 172.21.15.52:0/1402264458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162415ae20 con 0x7f16240ccf30 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f161be00640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 0x7f162415a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.218+0000 7f1623200640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f162414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f1622800640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f161400c430 tx=0x7f161400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614017070 con 0x7f16240ccf30 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1614005ce0 con 0x7f16240ccf30 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162414f3c0 con 0x7f16240ccf30 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16140072f0 con 0x7f16240ccf30 2024-09-10T08:36:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.219+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162414f980 con 0x7f16240ccf30 2024-09-10T08:36:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.220+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16240b2c50 con 0x7f16240ccf30 2024-09-10T08:36:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.221+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f161401a070 con 0x7f16240ccf30 2024-09-10T08:36:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.222+0000 7f161aa00640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 0x7f160006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.222+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5227+0+0 (secure 0 0 0) 0x7f161408a190 con 0x7f16240ccf30 2024-09-10T08:36:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.222+0000 7f161be00640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 0x7f160006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.223+0000 7f161be00640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 0x7f160006e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f160c034000 tx=0x7f160c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.227+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1614058d10 con 0x7f16240ccf30 2024-09-10T08:36:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:36.414+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f16240cc960 con 0x7f16240ccf30 2024-09-10T08:36:37.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:37.023 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.021+0000 7f161aa00640 1 -- 172.21.15.52:0/1402264458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v122) ==== 170+0+0 (secure 0 0 0) 0x7f1614058610 con 0x7f16240ccf30 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 msgr2=0x7f160006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 0x7f160006e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f160c034000 tx=0x7f160c02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 msgr2=0x7f162414ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f161400c430 tx=0x7f161400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 shutdown_connections 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f160006be30 0x7f160006e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f162415b7c0 0x7f162414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16240cead0 0x7f162415a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 --2- 172.21.15.52:0/1402264458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f16240ccf30 0x7f162414ed30 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 >> 172.21.15.52:0/1402264458 conn(0x7f162406d0f0 msgr2=0x7f16240cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 shutdown_connections 2024-09-10T08:36:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.024+0000 7f1629400640 1 -- 172.21.15.52:0/1402264458 wait complete. 2024-09-10T08:36:37.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:36:37.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.262+0000 7f15be800640 1 Processor -- start 2024-09-10T08:36:37.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.262+0000 7f15be800640 1 -- start start 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15be800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15b80b5fd0 0x7f15b80d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15be800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b80d3950 con 0x7f15b80b63b0 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15be800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b80d3c30 con 0x7f15b80b7c10 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15be800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f15b80d3f10 con 0x7f15b80b5fd0 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15bd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15b80b5fd0 0x7f15b80d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15bca00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f15b80b63b0 0x7f15b80cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37708/0 (socket says 172.21.15.52:37708) 2024-09-10T08:36:37.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.263+0000 7f15bca00640 1 -- 172.21.15.52:0/1828635553 learned_addr learned my addr 172.21.15.52:0/1828635553 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:37.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.264+0000 7f15bd400640 1 -- 172.21.15.52:0/1828635553 >> v1:172.21.15.176:6789/0 conn(0x7f15b80b7c10 legacy=0x7f15b80b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.264+0000 7f15bd400640 1 -- 172.21.15.52:0/1828635553 >> v1:172.21.15.52:6789/0 conn(0x7f15b80b63b0 legacy=0x7f15b80cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.264+0000 7f15bd400640 1 -- 172.21.15.52:0/1828635553 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b80d41f0 con 0x7f15b80b5fd0 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.265+0000 7f15bd400640 1 --2- 172.21.15.52:0/1828635553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b5fd0 0x7f15b80d32c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0097a0 tx=0x7f15ac02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8a82c140f6538e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.265+0000 7f15b7e00640 1 -- 172.21.15.52:0/1828635553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac037070 con 0x7f15b80b5fd0 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.265+0000 7f15b7e00640 1 -- 172.21.15.52:0/1828635553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15ac032640 con 0x7f15b80b5fd0 2024-09-10T08:36:37.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.265+0000 7f15b7e00640 1 -- 172.21.15.52:0/1828635553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac032a10 con 0x7f15b80b5fd0 2024-09-10T08:36:37.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 -- 172.21.15.52:0/1828635553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b5fd0 msgr2=0x7f15b80d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 --2- 172.21.15.52:0/1828635553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b5fd0 0x7f15b80d32c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0097a0 tx=0x7f15ac02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 -- 172.21.15.52:0/1828635553 shutdown_connections 2024-09-10T08:36:37.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 --2- 172.21.15.52:0/1828635553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b5fd0 0x7f15b80d32c0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 -- 172.21.15.52:0/1828635553 >> 172.21.15.52:0/1828635553 conn(0x7f15b80d0fd0 msgr2=0x7f15b80d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:37.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 -- 172.21.15.52:0/1828635553 shutdown_connections 2024-09-10T08:36:37.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.266+0000 7f15be800640 1 -- 172.21.15.52:0/1828635553 wait complete. 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.267+0000 7f15be800640 1 Processor -- start 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 -- start start 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 0x7f15b81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 0x7f15b8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15b80b6950 con 0x7f15b80b7c10 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15b80b67d0 con 0x7f15b80b5fd0 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.268+0000 7f15be800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f15b815e7f0 con 0x7f15b80b63b0 2024-09-10T08:36:37.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42064/0 (socket says 172.21.15.52:42064) 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 -- 172.21.15.52:0/1338705342 learned_addr learned my addr 172.21.15.52:0/1338705342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bca00640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 0x7f15b8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 -- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 msgr2=0x7f15b8157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bd400640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 0x7f15b81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 0x7f15b8157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 -- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 msgr2=0x7f15b81536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 0x7f15b81536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bde00640 1 -- 172.21.15.52:0/1338705342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b8153bf0 con 0x7f15b80b7c10 2024-09-10T08:36:37.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bca00640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 0x7f15b8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.269+0000 7f15bd400640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 0x7f15b81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15bde00640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c6b0 tx=0x7f15b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0003b70 con 0x7f15b80b7c10 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b0003d30 con 0x7f15b80b7c10 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0005310 con 0x7f15b80b7c10 2024-09-10T08:36:37.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b80cab80 con 0x7f15b80b7c10 2024-09-10T08:36:37.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.270+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b80cb140 con 0x7f15b80b7c10 2024-09-10T08:36:37.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.271+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b80d32c0 con 0x7f15b80b7c10 2024-09-10T08:36:37.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.272+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15b00054b0 con 0x7f15b80b7c10 2024-09-10T08:36:37.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.273+0000 7f15b5600640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 0x7f159806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:37.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.273+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5609+0+0 (secure 0 0 0) 0x7f15b008ade0 con 0x7f15b80b7c10 2024-09-10T08:36:37.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.274+0000 7f15bd400640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 0x7f159806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:37.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.275+0000 7f15bd400640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 0x7f159806e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f15ac034000 tx=0x7f15ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.278+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15b00596c0 con 0x7f15b80b7c10 2024-09-10T08:36:37.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:37.502+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f15b80b9250 con 0x7f15b80b7c10 2024-09-10T08:36:38.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.055+0000 7f15b5600640 1 -- 172.21.15.52:0/1338705342 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v89) ==== 174+0+0 (secure 0 0 0) 0x7f15b0058fc0 con 0x7f15b80b7c10 2024-09-10T08:36:38.059 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 16 and data pool 17 2024-09-10T08:36:38.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.062+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 msgr2=0x7f159806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.062+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 0x7f159806e2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f15ac034000 tx=0x7f15ac02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:38.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 msgr2=0x7f15b80b9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c6b0 tx=0x7f15b000cb70 comp rx=0 tx=0).stop 2024-09-10T08:36:38.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 shutdown_connections 2024-09-10T08:36:38.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f159806be30 0x7f159806e2f0 secure :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f15ac034000 tx=0x7f15ac02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b80b7c10 0x7f15b80b9770 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15b80b63b0 0x7f15b8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 --2- 172.21.15.52:0/1338705342 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15b80b5fd0 0x7f15b81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.063+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 >> 172.21.15.52:0/1338705342 conn(0x7f15b80d0fd0 msgr2=0x7f15b80d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.065+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 shutdown_connections 2024-09-10T08:36:38.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.066+0000 7f15be800640 1 -- 172.21.15.52:0/1338705342 wait complete. 2024-09-10T08:36:38.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:38.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.256+0000 7f129f200640 1 Processor -- start 2024-09-10T08:36:38.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.257+0000 7f129f200640 1 -- start start 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12a00b3e00 0x7f12a015bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12a00cf9a0 0x7f12a015c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00b4370 con 0x7f12a00cf5c0 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f12a00b4650 con 0x7f12a00cf9a0 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f12a00b4dc0 con 0x7f12a00b3e00 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12a00cf9a0 0x7f12a015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f12a00cf5c0 0x7f12a00b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37712/0 (socket says 172.21.15.52:37712) 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129de00640 1 -- 172.21.15.52:0/86495690 learned_addr learned my addr 172.21.15.52:0/86495690 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f1297e00640 1 --2- 172.21.15.52:0/86495690 >> v2:172.21.15.176:3300/0 conn(0x7f12a00b3e00 0x7f12a015bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129e800640 1 -- 172.21.15.52:0/86495690 >> v2:172.21.15.176:3300/0 conn(0x7f12a00b3e00 msgr2=0x7f12a015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:38.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.258+0000 7f129e800640 1 --2- 172.21.15.52:0/86495690 >> v2:172.21.15.176:3300/0 conn(0x7f12a00b3e00 0x7f12a015bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.259+0000 7f129e800640 1 -- 172.21.15.52:0/86495690 >> v1:172.21.15.52:6789/0 conn(0x7f12a00cf5c0 legacy=0x7f12a00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.259+0000 7f129e800640 1 -- 172.21.15.52:0/86495690 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00b50a0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.259+0000 7f129d400640 1 -- 172.21.15.52:0/86495690 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487872364 0 0) 0x7f12a00b4370 con 0x7f12a00cf5c0 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129e800640 1 --2- 172.21.15.52:0/86495690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a015c520 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f12a00b4c10 tx=0x7f129802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0ca7682b55fcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129d400640 1 -- 172.21.15.52:0/86495690 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298007740 con 0x7f12a00cf9a0 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129d400640 1 -- 172.21.15.52:0/86495690 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12980078e0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129d400640 1 -- 172.21.15.52:0/86495690 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298007cb0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 -- 172.21.15.52:0/86495690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 msgr2=0x7f12a015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 --2- 172.21.15.52:0/86495690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a015c520 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f12a00b4c10 tx=0x7f129802a560 comp rx=0 tx=0).stop 2024-09-10T08:36:38.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 -- 172.21.15.52:0/86495690 shutdown_connections 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 --2- 172.21.15.52:0/86495690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a015c520 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 --2- 172.21.15.52:0/86495690 >> v2:172.21.15.176:3300/0 conn(0x7f12a00b3e00 0x7f12a015bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 -- 172.21.15.52:0/86495690 >> 172.21.15.52:0/86495690 conn(0x7f12a006c240 msgr2=0x7f12a006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.260+0000 7f129f200640 1 -- 172.21.15.52:0/86495690 shutdown_connections 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.261+0000 7f129f200640 1 -- 172.21.15.52:0/86495690 wait complete. 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.262+0000 7f129f200640 1 Processor -- start 2024-09-10T08:36:38.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.262+0000 7f129f200640 1 -- start start 2024-09-10T08:36:38.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a00b3e00 0x7f12a0146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a00cf5c0 0x7f12a0157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12a015cbe0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12a015ca60 con 0x7f12a00b3e00 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12a015cd60 con 0x7f12a00cf5c0 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42094/0 (socket says 172.21.15.52:42094) 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129e800640 1 -- 172.21.15.52:0/380748380 learned_addr learned my addr 172.21.15.52:0/380748380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.263+0000 7f129de00640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a00b3e00 0x7f12a0146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f1297e00640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a00cf5c0 0x7f12a0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 -- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a00cf5c0 msgr2=0x7f12a0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a00cf5c0 0x7f12a0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 -- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a00b3e00 msgr2=0x7f12a0146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a00b3e00 0x7f12a0146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 -- 172.21.15.52:0/380748380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a01f6560 con 0x7f12a00cf9a0 2024-09-10T08:36:38.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f129e800640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f129802ab50 tx=0x7f1298004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.264+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129803f070 con 0x7f12a00cf9a0 2024-09-10T08:36:38.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.265+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298031bc0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.265+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298044460 con 0x7f12a00cf9a0 2024-09-10T08:36:38.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.265+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a01f57a0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.265+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a01f5d60 con 0x7f12a00cf9a0 2024-09-10T08:36:38.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.266+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a00762f0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.267+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1298007790 con 0x7f12a00cf9a0 2024-09-10T08:36:38.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.268+0000 7f1296000640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.268+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f12980ac630 con 0x7f12a00cf9a0 2024-09-10T08:36:38.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.268+0000 7f129de00640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.269+0000 7f129de00640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 0x7f127c06e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.273+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12a00762f0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.460+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a00b36f0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.461+0000 7f1296000640 1 -- 172.21.15.52:0/380748380 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16768 (secure 0 0 0) 0x7f129807a8f0 con 0x7f12a00cf9a0 2024-09-10T08:36:38.462 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:38.462 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:37.504029+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:36:35.265667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T08:36:36.457296+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.463+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 msgr2=0x7f127c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.463+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 0x7f127c06e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290007d50 comp rx=0 tx=0).stop 2024-09-10T08:36:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.463+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 msgr2=0x7f12a0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.463+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f129802ab50 tx=0x7f1298004a40 comp rx=0 tx=0).stop 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 shutdown_connections 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f127c06be30 0x7f127c06e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12a00cf9a0 0x7f12a0157540 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12a00cf5c0 0x7f12a0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 --2- 172.21.15.52:0/380748380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12a00b3e00 0x7f12a0146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 >> 172.21.15.52:0/380748380 conn(0x7f12a006c240 msgr2=0x7f12a006e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 shutdown_connections 2024-09-10T08:36:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.464+0000 7f129f200640 1 -- 172.21.15.52:0/380748380 wait complete. 2024-09-10T08:36:38.481 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.638+0000 7fde63600640 1 Processor -- start 2024-09-10T08:36:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.638+0000 7fde63600640 1 -- start start 2024-09-10T08:36:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde63600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde63600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde5c13eb20 0x7fde5c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde63600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5c071180 con 0x7fde5c15bcf0 2024-09-10T08:36:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde63600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fde5c071ab0 con 0x7fde5c13eb20 2024-09-10T08:36:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde63600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c071460 con 0x7fde5c0b2d40 2024-09-10T08:36:38.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde60c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde5be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fde5c13eb20 0x7fde5c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde60c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:45176/0 (socket says 172.21.15.52:45176) 2024-09-10T08:36:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.640+0000 7fde60c00640 1 -- 172.21.15.52:0/2035147257 learned_addr learned my addr 172.21.15.52:0/2035147257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.641+0000 7fde60c00640 1 -- 172.21.15.52:0/2035147257 >> v2:172.21.15.176:3300/0 conn(0x7fde5c13eb20 msgr2=0x7fde5c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.641+0000 7fde60c00640 1 --2- 172.21.15.52:0/2035147257 >> v2:172.21.15.176:3300/0 conn(0x7fde5c13eb20 0x7fde5c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.641+0000 7fde60c00640 1 -- 172.21.15.52:0/2035147257 >> v1:172.21.15.176:6789/0 conn(0x7fde5c15bcf0 legacy=0x7fde5c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.641+0000 7fde60c00640 1 -- 172.21.15.52:0/2035147257 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c071740 con 0x7fde5c0b2d40 2024-09-10T08:36:38.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.642+0000 7fde60c00640 1 --2- 172.21.15.52:0/2035147257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde5c071c30 tx=0x7fde5002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cff009c1f0e747 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.642+0000 7fde5b400640 1 -- 172.21.15.52:0/2035147257 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50037070 con 0x7fde5c0b2d40 2024-09-10T08:36:38.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.642+0000 7fde5b400640 1 -- 172.21.15.52:0/2035147257 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde50032440 con 0x7fde5c0b2d40 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.642+0000 7fde5b400640 1 -- 172.21.15.52:0/2035147257 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50032810 con 0x7fde5c0b2d40 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 -- 172.21.15.52:0/2035147257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 msgr2=0x7fde5c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 --2- 172.21.15.52:0/2035147257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde5c071c30 tx=0x7fde5002a250 comp rx=0 tx=0).stop 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 -- 172.21.15.52:0/2035147257 shutdown_connections 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 --2- 172.21.15.52:0/2035147257 >> v2:172.21.15.176:3300/0 conn(0x7fde5c13eb20 0x7fde5c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 --2- 172.21.15.52:0/2035147257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c06bc10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 -- 172.21.15.52:0/2035147257 >> 172.21.15.52:0/2035147257 conn(0x7fde5c0ccec0 msgr2=0x7fde5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 -- 172.21.15.52:0/2035147257 shutdown_connections 2024-09-10T08:36:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.643+0000 7fde63600640 1 -- 172.21.15.52:0/2035147257 wait complete. 2024-09-10T08:36:38.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.644+0000 7fde63600640 1 Processor -- start 2024-09-10T08:36:38.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.645+0000 7fde63600640 1 -- start start 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde5c15bcf0 0x7fde5c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c0722d0 con 0x7fde5c13eb20 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c072150 con 0x7fde5c15bcf0 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde63600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c072450 con 0x7fde5c0b2d40 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42102/0 (socket says 172.21.15.52:42102) 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 -- 172.21.15.52:0/657540506 learned_addr learned my addr 172.21.15.52:0/657540506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:38.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde60c00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde61600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde5c15bcf0 0x7fde5c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 -- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 msgr2=0x7fde5c13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c13e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 -- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde5c15bcf0 msgr2=0x7fde5c1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde5c15bcf0 0x7fde5c1584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.646+0000 7fde5be00640 1 -- 172.21.15.52:0/657540506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c15e050 con 0x7fde5c13eb20 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde60c00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde5be00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e980 tx=0x7fde4800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48017070 con 0x7fde5c13eb20 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4800ca00 con 0x7fde5c13eb20 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c15e2f0 con 0x7fde5c13eb20 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4800cdd0 con 0x7fde5c13eb20 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.647+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c15e8b0 con 0x7fde5c13eb20 2024-09-10T08:36:38.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.648+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c15efd0 con 0x7fde5c13eb20 2024-09-10T08:36:38.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.649+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde4801a070 con 0x7fde5c13eb20 2024-09-10T08:36:38.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.651+0000 7fde58c00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 0x7fde3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:38.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.651+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fde4808ae60 con 0x7fde5c13eb20 2024-09-10T08:36:38.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.651+0000 7fde60c00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 0x7fde3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:38.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.652+0000 7fde60c00640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 0x7fde3c06e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde50034000 tx=0x7fde5002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:38.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.655+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde48059800 con 0x7fde5c13eb20 2024-09-10T08:36:38.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.840+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde5c0728e0 con 0x7fde5c13eb20 2024-09-10T08:36:38.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.841+0000 7fde58c00640 1 -- 172.21.15.52:0/657540506 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16768 (secure 0 0 0) 0x7fde48059100 con 0x7fde5c13eb20 2024-09-10T08:36:38.842 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:38.842 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:37.504029+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:36:35.265667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T08:36:36.457296+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.843+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 msgr2=0x7fde3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.843+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 0x7fde3c06e320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde50034000 tx=0x7fde5002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.843+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 msgr2=0x7fde5c15db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.843+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e980 tx=0x7fde4800ee40 comp rx=0 tx=0).stop 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 shutdown_connections 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde3c06be60 0x7fde3c06e320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde5c15bcf0 0x7fde5c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde5c13eb20 0x7fde5c15db10 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 --2- 172.21.15.52:0/657540506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde5c0b2d40 0x7fde5c13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 >> 172.21.15.52:0/657540506 conn(0x7fde5c0ccec0 msgr2=0x7fde5c13f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 shutdown_connections 2024-09-10T08:36:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:38.844+0000 7fde63600640 1 -- 172.21.15.52:0/657540506 wait complete. 2024-09-10T08:36:38.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:36:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.019+0000 7ff60fe00640 1 Processor -- start 2024-09-10T08:36:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.019+0000 7ff60fe00640 1 -- start start 2024-09-10T08:36:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6100b5fd0 0x7ff6100d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6100cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6100d3950 con 0x7ff610067950 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff6100d3c30 con 0x7ff6100b5fd0 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6100d3f10 con 0x7ff6100b63b0 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6100b5fd0 0x7ff6100d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6100b5fd0 0x7ff6100d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42118/0 (socket says 172.21.15.52:42118) 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.020+0000 7ff60ea00640 1 -- 172.21.15.52:0/2700124281 learned_addr learned my addr 172.21.15.52:0/2700124281 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60e000640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6100cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60ea00640 1 -- 172.21.15.52:0/2700124281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 msgr2=0x7ff6100cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60ea00640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6100cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60ea00640 1 -- 172.21.15.52:0/2700124281 >> v1:172.21.15.176:6789/0 conn(0x7ff610067950 legacy=0x7ff610067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60ea00640 1 -- 172.21.15.52:0/2700124281 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6100d41f0 con 0x7ff6100b5fd0 2024-09-10T08:36:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.021+0000 7ff60e000640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6100cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.022+0000 7ff60ea00640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100d32c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ff600009870 tx=0x7ff60002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8207c0338dc1b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.022+0000 7ff60d600640 1 -- 172.21.15.52:0/2700124281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600037070 con 0x7ff6100b5fd0 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.022+0000 7ff60d600640 1 -- 172.21.15.52:0/2700124281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60002ae50 con 0x7ff6100b5fd0 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.022+0000 7ff60d600640 1 -- 172.21.15.52:0/2700124281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600032860 con 0x7ff6100b5fd0 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 -- 172.21.15.52:0/2700124281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 msgr2=0x7ff6100d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100d32c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ff600009870 tx=0x7ff60002a300 comp rx=0 tx=0).stop 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 -- 172.21.15.52:0/2700124281 shutdown_connections 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6100cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 --2- 172.21.15.52:0/2700124281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100d32c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 -- 172.21.15.52:0/2700124281 >> 172.21.15.52:0/2700124281 conn(0x7ff6100d0fd0 msgr2=0x7ff6100d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 -- 172.21.15.52:0/2700124281 shutdown_connections 2024-09-10T08:36:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.023+0000 7ff60fe00640 1 -- 172.21.15.52:0/2700124281 wait complete. 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.024+0000 7ff60fe00640 1 Processor -- start 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 -- start start 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 0x7ff6101530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6101610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6100cfd10 con 0x7ff6100b5fd0 2024-09-10T08:36:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6100cfb90 con 0x7ff610067950 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.025+0000 7ff60fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6100b67d0 con 0x7ff6100b63b0 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42130/0 (socket says 172.21.15.52:42130) 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 -- 172.21.15.52:0/3770088390 learned_addr learned my addr 172.21.15.52:0/3770088390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60ea00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 0x7ff6101530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60f400640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6101610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 -- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 msgr2=0x7ff6101610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6101610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 -- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 msgr2=0x7ff6101530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 0x7ff6101530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 -- 172.21.15.52:0/3770088390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6100cd4b0 con 0x7ff6100b5fd0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60ea00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 0x7ff6101530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.026+0000 7ff60e000640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d7d0 tx=0x7ff5fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.027+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0096a0 con 0x7ff6100b5fd0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.027+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5fc019070 con 0x7ff6100b5fd0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.027+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc009a80 con 0x7ff6100b5fd0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.027+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6100cd790 con 0x7ff6100b5fd0 2024-09-10T08:36:39.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.027+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6100cdd50 con 0x7ff6100b5fd0 2024-09-10T08:36:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.028+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61015e7f0 con 0x7ff6100b5fd0 2024-09-10T08:36:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.029+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5fc009c20 con 0x7ff6100b5fd0 2024-09-10T08:36:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.030+0000 7ff606a00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.030+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7ff5fc08b250 con 0x7ff6100b5fd0 2024-09-10T08:36:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.030+0000 7ff60ea00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.031+0000 7ff60ea00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 0x7ff5f006e320 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff600034000 tx=0x7ff60002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.034+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5fc059bf0 con 0x7ff6100b5fd0 2024-09-10T08:36:39.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:39.257+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff6100b9290 con 0x7ff6100b5fd0 2024-09-10T08:36:40.019 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:36:40.019+0000 7f6e4d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:36:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.069+0000 7ff606a00640 1 -- 172.21.15.52:0/3770088390 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) ==== 118+0+0 (secure 0 0 0) 0x7ff5fc0594f0 con 0x7ff6100b5fd0 2024-09-10T08:36:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 msgr2=0x7ff5f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 0x7ff5f006e320 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff600034000 tx=0x7ff60002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 msgr2=0x7ff6100cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d7d0 tx=0x7ff5fc00dc90 comp rx=0 tx=0).stop 2024-09-10T08:36:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 shutdown_connections 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5f006be60 0x7ff5f006e320 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6100b63b0 0x7ff6101610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6100b5fd0 0x7ff6100cca00 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 --2- 172.21.15.52:0/3770088390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff610067950 0x7ff6101530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.072+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 >> 172.21.15.52:0/3770088390 conn(0x7ff6100d0fd0 msgr2=0x7ff6100d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.073+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 shutdown_connections 2024-09-10T08:36:40.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.073+0000 7ff60fe00640 1 -- 172.21.15.52:0/3770088390 wait complete. 2024-09-10T08:36:40.091 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:36:40.091 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:36:40.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.255+0000 7f44d0800640 1 Processor -- start 2024-09-10T08:36:40.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.255+0000 7f44d0800640 1 -- start start 2024-09-10T08:36:40.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.256+0000 7f44d0800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c80732e0 0x7f44c80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.256+0000 7f44d0800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 0x7f44c815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.256+0000 7f44d0800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c80714b0 con 0x7f44c80cce30 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.256+0000 7f44d0800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f44c8073c00 con 0x7f44c80732e0 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.256+0000 7f44d0800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f44c80cd880 con 0x7f44c80cd2a0 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c80732e0 0x7f44c80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f44c80732e0 0x7f44c80736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42132/0 (socket says 172.21.15.52:42132) 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 -- 172.21.15.52:0/2405247453 learned_addr learned my addr 172.21.15.52:0/2405247453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44ce800640 1 --2- 172.21.15.52:0/2405247453 >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 0x7f44c815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 -- 172.21.15.52:0/2405247453 >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 msgr2=0x7f44c815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 --2- 172.21.15.52:0/2405247453 >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 0x7f44c815c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 -- 172.21.15.52:0/2405247453 >> v1:172.21.15.176:6789/0 conn(0x7f44c80cce30 legacy=0x7f44c8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44cde00640 1 -- 172.21.15.52:0/2405247453 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80cdb60 con 0x7f44c80732e0 2024-09-10T08:36:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.257+0000 7f44ce800640 1 --2- 172.21.15.52:0/2405247453 >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 0x7f44c815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:40.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.258+0000 7f44cde00640 1 --2- 172.21.15.52:0/2405247453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80732e0 0x7f44c80736c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c5550 tx=0x7f44bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ac95ebaa9e32cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.258+0000 7f44cca00640 1 -- 172.21.15.52:0/2405247453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc037070 con 0x7f44c80732e0 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.258+0000 7f44cca00640 1 -- 172.21.15.52:0/2405247453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc032440 con 0x7f44c80732e0 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.258+0000 7f44cca00640 1 -- 172.21.15.52:0/2405247453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc032810 con 0x7f44c80732e0 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 -- 172.21.15.52:0/2405247453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80732e0 msgr2=0x7f44c80736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 --2- 172.21.15.52:0/2405247453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80732e0 0x7f44c80736c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f44c80c5550 tx=0x7f44bc02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 -- 172.21.15.52:0/2405247453 shutdown_connections 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 --2- 172.21.15.52:0/2405247453 >> v2:172.21.15.176:3300/0 conn(0x7f44c80cd2a0 0x7f44c815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 --2- 172.21.15.52:0/2405247453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80732e0 0x7f44c80736c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 -- 172.21.15.52:0/2405247453 >> 172.21.15.52:0/2405247453 conn(0x7f44c806d0f0 msgr2=0x7f44c806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 -- 172.21.15.52:0/2405247453 shutdown_connections 2024-09-10T08:36:40.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.259+0000 7f44d0800640 1 -- 172.21.15.52:0/2405247453 wait complete. 2024-09-10T08:36:40.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.261+0000 7f44d0800640 1 Processor -- start 2024-09-10T08:36:40.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.261+0000 7f44d0800640 1 -- start start 2024-09-10T08:36:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c80732e0 0x7f44c81f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c80cce30 0x7f44c80c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44c806bf70 con 0x7f44c80cd2a0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44c806bdf0 con 0x7f44c80cce30 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44d0800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f44c8072380 con 0x7f44c80732e0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42134/0 (socket says 172.21.15.52:42134) 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 -- 172.21.15.52:0/2516072156 learned_addr learned my addr 172.21.15.52:0/2516072156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44cd400640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c80cce30 0x7f44c80c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44cde00640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c80732e0 0x7f44c81f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 -- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c80732e0 msgr2=0x7f44c81f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c80732e0 0x7f44c81f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 -- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c80cce30 msgr2=0x7f44c80c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c80cce30 0x7f44c80c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.262+0000 7f44ce800640 1 -- 172.21.15.52:0/2516072156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c81f5760 con 0x7f44c80cd2a0 2024-09-10T08:36:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44ce800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f44c400cf20 tx=0x7f44c400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c401a070 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c400d840 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c400dc30 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c81f5a40 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.263+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c81f6000 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.264+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c80736c0 con 0x7f44c80cd2a0 2024-09-10T08:36:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.265+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44c401d070 con 0x7f44c80cd2a0 2024-09-10T08:36:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.266+0000 7f44c2000640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.266+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f44c408b6e0 con 0x7f44c80cd2a0 2024-09-10T08:36:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.266+0000 7f44cde00640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:40.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.267+0000 7f44cde00640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 0x7f44ac06e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f44bc034000 tx=0x7f44bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:40.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.270+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44c4059a60 con 0x7f44c80cd2a0 2024-09-10T08:36:40.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:40.490+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f44c80711f0 con 0x7f44c80cd2a0 2024-09-10T08:36:41.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.070+0000 7f44c2000640 1 -- 172.21.15.52:0/2516072156 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) ==== 122+0+0 (secure 0 0 0) 0x7f44c405dd60 con 0x7f44c80cd2a0 2024-09-10T08:36:41.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.073+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 msgr2=0x7f44ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.073+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 0x7f44ac06e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f44bc034000 tx=0x7f44bc02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:41.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.073+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 msgr2=0x7f44c8151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.073+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f44c400cf20 tx=0x7f44c400a7d0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 shutdown_connections 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f44ac06be30 0x7f44ac06e2f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44c80cd2a0 0x7f44c8151bb0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f44c80cce30 0x7f44c80c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 --2- 172.21.15.52:0/2516072156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44c80732e0 0x7f44c81f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 >> 172.21.15.52:0/2516072156 conn(0x7f44c806d0f0 msgr2=0x7f44c806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 shutdown_connections 2024-09-10T08:36:41.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.074+0000 7f44d0800640 1 -- 172.21.15.52:0/2516072156 wait complete. 2024-09-10T08:36:41.092 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:36:41.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:41.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.252+0000 7f06a9800640 1 Processor -- start 2024-09-10T08:36:41.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.252+0000 7f06a9800640 1 -- start start 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.253+0000 7f06a9800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f06a406c320 0x7f06a415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.253+0000 7f06a9800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a4071180 con 0x7f06a413eb20 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.253+0000 7f06a9800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a4071460 con 0x7f06a40b2d40 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.253+0000 7f06a9800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f06a4071ab0 con 0x7f06a406c320 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f06a3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f06a413eb20 0x7f06a415c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37714/0 (socket says 172.21.15.52:37714) 2024-09-10T08:36:41.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f06a3400640 1 -- 172.21.15.52:0/1971577521 learned_addr learned my addr 172.21.15.52:0/1971577521 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f069a000640 1 --2- 172.21.15.52:0/1971577521 >> v2:172.21.15.176:3300/0 conn(0x7f06a406c320 0x7f06a415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f06a2000640 1 -- 172.21.15.52:0/1971577521 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306385606 0 0) 0x7f06a4071180 con 0x7f06a413eb20 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f06a2000640 1 -- 172.21.15.52:0/1971577521 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0688003520 con 0x7f06a413eb20 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f069a000640 1 -- 172.21.15.52:0/1971577521 >> v1:172.21.15.176:6789/0 conn(0x7f06a40b2d40 legacy=0x7f06a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.254+0000 7f069a000640 1 -- 172.21.15.52:0/1971577521 >> v1:172.21.15.52:6789/0 conn(0x7f06a413eb20 legacy=0x7f06a415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.255+0000 7f069a000640 1 -- 172.21.15.52:0/1971577521 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a4071740 con 0x7f06a406c320 2024-09-10T08:36:41.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f069a000640 1 --2- 172.21.15.52:0/1971577521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a406c320 0x7f06a415bcf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f068c0097a0 tx=0x7f068c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa9bc9c30971557 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a2000640 1 -- 172.21.15.52:0/1971577521 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c037070 con 0x7f06a406c320 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a2000640 1 -- 172.21.15.52:0/1971577521 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068c032440 con 0x7f06a406c320 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a2000640 1 -- 172.21.15.52:0/1971577521 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c032810 con 0x7f06a406c320 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a9800640 1 -- 172.21.15.52:0/1971577521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a406c320 msgr2=0x7f06a415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a9800640 1 --2- 172.21.15.52:0/1971577521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a406c320 0x7f06a415bcf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f068c0097a0 tx=0x7f068c02a230 comp rx=0 tx=0).stop 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a9800640 1 -- 172.21.15.52:0/1971577521 shutdown_connections 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.256+0000 7f06a9800640 1 --2- 172.21.15.52:0/1971577521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a406c320 0x7f06a415bcf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.257+0000 7f06a9800640 1 -- 172.21.15.52:0/1971577521 >> 172.21.15.52:0/1971577521 conn(0x7f06a40ccec0 msgr2=0x7f06a40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.257+0000 7f06a9800640 1 -- 172.21.15.52:0/1971577521 shutdown_connections 2024-09-10T08:36:41.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.257+0000 7f06a9800640 1 -- 172.21.15.52:0/1971577521 wait complete. 2024-09-10T08:36:41.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.258+0000 7f06a9800640 1 Processor -- start 2024-09-10T08:36:41.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.258+0000 7f06a9800640 1 -- start start 2024-09-10T08:36:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a40b2d40 0x7f06a41f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a413eb20 0x7f06a41f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40b36f0 con 0x7f06a406c320 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40b3570 con 0x7f06a413eb20 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a9800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06a40b3870 con 0x7f06a40b2d40 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42148/0 (socket says 172.21.15.52:42148) 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.259+0000 7f06a2a00640 1 -- 172.21.15.52:0/1403616908 learned_addr learned my addr 172.21.15.52:0/1403616908 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f069a000640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a40b2d40 0x7f06a41f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a3400640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a413eb20 0x7f06a41f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 -- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a40b2d40 msgr2=0x7f06a41f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a40b2d40 0x7f06a41f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 -- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a413eb20 msgr2=0x7f06a41f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a413eb20 0x7f06a41f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 -- 172.21.15.52:0/1403616908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a415aa00 con 0x7f06a406c320 2024-09-10T08:36:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f06a2a00640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f069400c400 tx=0x7f069400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.260+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940052d0 con 0x7f06a406c320 2024-09-10T08:36:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.261+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0694005490 con 0x7f06a406c320 2024-09-10T08:36:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.261+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a415ace0 con 0x7f06a406c320 2024-09-10T08:36:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.261+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694007260 con 0x7f06a406c320 2024-09-10T08:36:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.261+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a415b2a0 con 0x7f06a406c320 2024-09-10T08:36:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.262+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a406bc10 con 0x7f06a406c320 2024-09-10T08:36:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.263+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0694007400 con 0x7f06a406c320 2024-09-10T08:36:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.264+0000 7f069b400640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 0x7f068006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.264+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f069408a7e0 con 0x7f06a406c320 2024-09-10T08:36:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.264+0000 7f069a000640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 0x7f068006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.265+0000 7f069a000640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 0x7f068006e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f068c034000 tx=0x7f068c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.268+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0694058bb0 con 0x7f06a406c320 2024-09-10T08:36:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.488+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06a406c9c0 con 0x7f06a406c320 2024-09-10T08:36:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.489+0000 7f069b400640 1 -- 172.21.15.52:0/1403616908 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7f069405ceb0 con 0x7f06a406c320 2024-09-10T08:36:41.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:41.490 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:36:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 msgr2=0x7f068006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 0x7f068006e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f068c034000 tx=0x7f068c02e000 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 msgr2=0x7f06a413dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f069400c400 tx=0x7f069400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 shutdown_connections 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f068006be30 0x7f068006e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06a413eb20 0x7f06a41f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06a40b2d40 0x7f06a41f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 --2- 172.21.15.52:0/1403616908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a406c320 0x7f06a413dce0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 >> 172.21.15.52:0/1403616908 conn(0x7f06a40ccec0 msgr2=0x7f06a40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:41.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 shutdown_connections 2024-09-10T08:36:41.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.491+0000 7f06a9800640 1 -- 172.21.15.52:0/1403616908 wait complete. 2024-09-10T08:36:41.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:36:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.663+0000 7fa9ca400640 1 Processor -- start 2024-09-10T08:36:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.663+0000 7fa9ca400640 1 -- start start 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.664+0000 7fa9ca400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9c40b2d40 0x7fa9c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.664+0000 7fa9ca400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9c415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.664+0000 7fa9ca400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c4071180 con 0x7fa9c413eb20 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.664+0000 7fa9ca400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c4071ab0 con 0x7fa9c40b2d40 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.664+0000 7fa9ca400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c4071460 con 0x7fa9c406c150 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9bbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa9c413eb20 0x7fa9c415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37724/0 (socket says 172.21.15.52:37724) 2024-09-10T08:36:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9bbe00640 1 -- 172.21.15.52:0/3395286671 learned_addr learned my addr 172.21.15.52:0/3395286671 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9c3400640 1 --2- 172.21.15.52:0/3395286671 >> v2:172.21.15.176:3300/0 conn(0x7fa9c40b2d40 0x7fa9c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9c415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023382051 0 0) 0x7fa9c4071180 con 0x7fa9c413eb20 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a8003520 con 0x7fa9c413eb20 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.665+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847208066 0 0) 0x7fa9a8003520 con 0x7fa9c413eb20 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 msgr2=0x7fa9c415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9c415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 >> v2:172.21.15.176:3300/0 conn(0x7fa9c40b2d40 msgr2=0x7fa9c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 --2- 172.21.15.52:0/3395286671 >> v2:172.21.15.176:3300/0 conn(0x7fa9c40b2d40 0x7fa9c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c4071740 con 0x7fa9c413eb20 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fa9ac001670 con 0x7fa9c413eb20 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 >> v1:172.21.15.52:6789/0 conn(0x7fa9c413eb20 legacy=0x7fa9c415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9a8004d40 0x7fa9a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4071ab0 con 0x7fa9a8004d40 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4071460 con 0x7fa9a80039b0 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a800dbd0 con 0x7fa9c406c150 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3400640 1 --2- 172.21.15.52:0/3395286671 >> v2:172.21.15.176:3300/0 conn(0x7fa9c40b2d40 0x7fa9c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9a8004d40 0x7fa9a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3400640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 msgr2=0x7fa9a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9c406c150 0x7fa9a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80039b0 msgr2=0x7fa9a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9a80039b0 0x7fa9a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.666+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3395286671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a8003520 con 0x7fa9a8004d40 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.667+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9a8004d40 0x7fa9a80051c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009fc0 tx=0x7fa9a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a17ef6d2adc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc009c10 con 0x7fa9a8004d40 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc036070 con 0x7fa9a8004d40 2024-09-10T08:36:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9c2a00640 1 -- 172.21.15.52:0/3395286671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc031880 con 0x7fa9a8004d40 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 -- 172.21.15.52:0/3395286671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9a8004d40 msgr2=0x7fa9a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 --2- 172.21.15.52:0/3395286671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9a8004d40 0x7fa9a80051c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009fc0 tx=0x7fa9a8005830 comp rx=0 tx=0).stop 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9c3e00640 1 -- 172.21.15.52:0/3395286671 reap_dead start 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 -- 172.21.15.52:0/3395286671 shutdown_connections 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 -- 172.21.15.52:0/3395286671 >> 172.21.15.52:0/3395286671 conn(0x7fa9c40ccec0 msgr2=0x7fa9c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:41.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 -- 172.21.15.52:0/3395286671 shutdown_connections 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.668+0000 7fa9ca400640 1 -- 172.21.15.52:0/3395286671 wait complete. 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.670+0000 7fa9ca400640 1 Processor -- start 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.670+0000 7fa9ca400640 1 -- start start 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a8004d40 0x7fa9c40b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40cbd80 0x7fa9c40b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c415c7d0 con 0x7fa9c40cc200 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c415c650 con 0x7fa9c40cbd80 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9ca400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c4071f40 con 0x7fa9a8004d40 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9c3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42152/0 (socket says 172.21.15.52:42152) 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9c3e00640 1 -- 172.21.15.52:0/1398821350 learned_addr learned my addr 172.21.15.52:0/1398821350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9bbe00640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40cbd80 0x7fa9c40b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.671+0000 7fa9c3400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a8004d40 0x7fa9c40b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 -- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a8004d40 msgr2=0x7fa9c40b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a8004d40 0x7fa9c40b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 -- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40cbd80 msgr2=0x7fa9c40b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40cbd80 0x7fa9c40b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 -- 172.21.15.52:0/1398821350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40c9890 con 0x7fa9c40cc200 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9c3e00640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc033040 tx=0x7fa9bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc009c10 con 0x7fa9c40cc200 2024-09-10T08:36:41.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc031dd0 con 0x7fa9c40cc200 2024-09-10T08:36:41.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc003bd0 con 0x7fa9c40cc200 2024-09-10T08:36:41.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c40b39b0 con 0x7fa9c40cc200 2024-09-10T08:36:41.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.672+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c40c9e10 con 0x7fa9c40cc200 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.674+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c40ca250 con 0x7fa9c40cc200 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.674+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9bc005d10 con 0x7fa9c40cc200 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.675+0000 7fa9bb400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 0x7fa9a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.675+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa9bc0ac080 con 0x7fa9c40cc200 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.676+0000 7fa9c3400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 0x7fa9a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.676+0000 7fa9c3400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 0x7fa9a006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40093d0 tx=0x7fa9b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:41.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.680+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9bc07a470 con 0x7fa9c40cc200 2024-09-10T08:36:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.866+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9c406bc10 con 0x7fa9c40cc200 2024-09-10T08:36:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.867+0000 7fa9bb400640 1 -- 172.21.15.52:0/1398821350 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16755 (secure 0 0 0) 0x7fa9bc07e770 con 0x7fa9c40cc200 2024-09-10T08:36:41.867 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:41.868 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":124,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:39.053620+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:36:35.265667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T08:36:36.457296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:36:41.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 msgr2=0x7fa9a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 0x7fa9a006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40093d0 tx=0x7fa9b4008040 comp rx=0 tx=0).stop 2024-09-10T08:36:41.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 msgr2=0x7fa9c413dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:41.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc033040 tx=0x7fa9bc009750 comp rx=0 tx=0).stop 2024-09-10T08:36:41.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 shutdown_connections 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa9a006be30 0x7fa9a006e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c40cc200 0x7fa9c413dac0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c40cbd80 0x7fa9c40b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 --2- 172.21.15.52:0/1398821350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9a8004d40 0x7fa9c40b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 >> 172.21.15.52:0/1398821350 conn(0x7fa9c40ccec0 msgr2=0x7fa9c40cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.869+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 shutdown_connections 2024-09-10T08:36:41.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:41.870+0000 7fa9ca400640 1 -- 172.21.15.52:0/1398821350 wait complete. 2024-09-10T08:36:41.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:36:41.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:36:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.041+0000 7ff7a2600640 1 Processor -- start 2024-09-10T08:36:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.041+0000 7ff7a2600640 1 -- start start 2024-09-10T08:36:42.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a2600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff79c1522d0 0x7ff79c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 0x7ff79c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a2600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79c0b6660 con 0x7ff79c0b60e0 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a2600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff79c15ca90 con 0x7ff79c1522d0 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c15cce0 con 0x7ff79c15f5d0 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff79c1522d0 0x7ff79c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff79c1522d0 0x7ff79c0b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42162/0 (socket says 172.21.15.52:42162) 2024-09-10T08:36:42.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.042+0000 7ff7a1200640 1 -- 172.21.15.52:0/4071232625 learned_addr learned my addr 172.21.15.52:0/4071232625 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1200640 1 -- 172.21.15.52:0/4071232625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 msgr2=0x7ff79c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1c00640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 0x7ff79c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1200640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 0x7ff79c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1200640 1 -- 172.21.15.52:0/4071232625 >> v1:172.21.15.176:6789/0 conn(0x7ff79c0b60e0 legacy=0x7ff79c15eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1200640 1 -- 172.21.15.52:0/4071232625 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c15cfc0 con 0x7ff79c1522d0 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.043+0000 7ff7a1c00640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 0x7ff79c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.044+0000 7ff7a1200640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c0b5ba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff79c15cc10 tx=0x7ff79002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e49433d3ec90f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.044+0000 7ff79b400640 1 -- 172.21.15.52:0/4071232625 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790037070 con 0x7ff79c1522d0 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.044+0000 7ff79b400640 1 -- 172.21.15.52:0/4071232625 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff790032440 con 0x7ff79c1522d0 2024-09-10T08:36:42.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.044+0000 7ff79b400640 1 -- 172.21.15.52:0/4071232625 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790032810 con 0x7ff79c1522d0 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 -- 172.21.15.52:0/4071232625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 msgr2=0x7ff79c0b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c0b5ba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff79c15cc10 tx=0x7ff79002a200 comp rx=0 tx=0).stop 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 -- 172.21.15.52:0/4071232625 shutdown_connections 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c15f5d0 0x7ff79c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 --2- 172.21.15.52:0/4071232625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c0b5ba0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 -- 172.21.15.52:0/4071232625 >> 172.21.15.52:0/4071232625 conn(0x7ff79c06c240 msgr2=0x7ff79c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 -- 172.21.15.52:0/4071232625 shutdown_connections 2024-09-10T08:36:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.045+0000 7ff7a2600640 1 -- 172.21.15.52:0/4071232625 wait complete. 2024-09-10T08:36:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.046+0000 7ff7a2600640 1 Processor -- start 2024-09-10T08:36:42.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.047+0000 7ff7a2600640 1 -- start start 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 0x7ff79c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 0x7ff79c14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c1526b0 con 0x7ff79c1522d0 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c15fc80 con 0x7ff79c15f5d0 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a2600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c152830 con 0x7ff79c0b60e0 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42166/0 (socket says 172.21.15.52:42166) 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 -- 172.21.15.52:0/117722130 learned_addr learned my addr 172.21.15.52:0/117722130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a1c00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 0x7ff79c14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 -- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 msgr2=0x7ff79c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a1200640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 0x7ff79c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 0x7ff79c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 -- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 msgr2=0x7ff79c14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 0x7ff79c14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff79be00640 1 -- 172.21.15.52:0/117722130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c1531c0 con 0x7ff79c1522d0 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a1c00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 0x7ff79c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.048+0000 7ff7a1200640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 0x7ff79c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff79be00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c430 tx=0x7ff78800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788011790 con 0x7ff79c1522d0 2024-09-10T08:36:42.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788017070 con 0x7ff79c1522d0 2024-09-10T08:36:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788011bb0 con 0x7ff79c1522d0 2024-09-10T08:36:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79c152ee0 con 0x7ff79c1522d0 2024-09-10T08:36:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.049+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79c1566b0 con 0x7ff79c1522d0 2024-09-10T08:36:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.050+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79c14e490 con 0x7ff79c1522d0 2024-09-10T08:36:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.051+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff78801c460 con 0x7ff79c1522d0 2024-09-10T08:36:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.052+0000 7ff798c00640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.052+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7ff78808ad50 con 0x7ff79c1522d0 2024-09-10T08:36:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.053+0000 7ff7a1200640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.054+0000 7ff7a1200640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 0x7ff77c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.057+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff79c14e490 con 0x7ff79c1522d0 2024-09-10T08:36:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.240+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff79c0b5ba0 con 0x7ff77c06be30 2024-09-10T08:36:42.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.247+0000 7ff798c00640 1 -- 172.21.15.52:0/117722130 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252467 (secure 0 0 0) 0x7ff79c0b5ba0 con 0x7ff77c06be30 2024-09-10T08:36:42.251 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 msgr2=0x7ff77c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 0x7ff77c06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff790034000 tx=0x7ff79002e000 comp rx=0 tx=0).stop 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 msgr2=0x7ff79c149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff78800c430 tx=0x7ff78800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 shutdown_connections 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff79c15f5d0 0x7ff79c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff79c1522d0 0x7ff79c149bb0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 --2- 172.21.15.52:0/117722130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff79c0b60e0 0x7ff79c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 >> 172.21.15.52:0/117722130 conn(0x7ff79c06c240 msgr2=0x7ff79c15d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 shutdown_connections 2024-09-10T08:36:42.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.252+0000 7ff7a2600640 1 -- 172.21.15.52:0/117722130 wait complete. 2024-09-10T08:36:42.268 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-10T08:36:41.573732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365356,"kb_used_data":13112,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754609364,"statfs":{"total":773094113280,"available":772719988736,"internally_reserved":0,"allocated":13426688,"data_stored":6522117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.554202"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775659+0000","last_change":"2024-09-10T08:36:38.057386+0000","last_active":"2024-09-10T08:36:39.775659+0000","last_peered":"2024-09-10T08:36:39.775659+0000","last_clean":"2024-09-10T08:36:39.775659+0000","last_became_active":"2024-09-10T08:36:38.056855+0000","last_became_peered":"2024-09-10T08:36:38.056855+0000","last_unstale":"2024-09-10T08:36:39.775659+0000","last_undegraded":"2024-09-10T08:36:39.775659+0000","last_fullsized":"2024-09-10T08:36:39.775659+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:54.641377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057931+0000","last_change":"2024-09-10T08:36:38.065889+0000","last_active":"2024-09-10T08:36:39.057931+0000","last_peered":"2024-09-10T08:36:39.057931+0000","last_clean":"2024-09-10T08:36:39.057931+0000","last_became_active":"2024-09-10T08:36:38.065444+0000","last_became_peered":"2024-09-10T08:36:38.065444+0000","last_unstale":"2024-09-10T08:36:39.057931+0000","last_undegraded":"2024-09-10T08:36:39.057931+0000","last_fullsized":"2024-09-10T08:36:39.057931+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:40.105386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059199+0000","last_change":"2024-09-10T08:36:38.076326+0000","last_active":"2024-09-10T08:36:39.059199+0000","last_peered":"2024-09-10T08:36:39.059199+0000","last_clean":"2024-09-10T08:36:39.059199+0000","last_became_active":"2024-09-10T08:36:38.075731+0000","last_became_peered":"2024-09-10T08:36:38.075731+0000","last_unstale":"2024-09-10T08:36:39.059199+0000","last_undegraded":"2024-09-10T08:36:39.059199+0000","last_fullsized":"2024-09-10T08:36:39.059199+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:43.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059341+0000","last_change":"2024-09-10T08:36:38.064119+0000","last_active":"2024-09-10T08:36:39.059341+0000","last_peered":"2024-09-10T08:36:39.059341+0000","last_clean":"2024-09-10T08:36:39.059341+0000","last_became_active":"2024-09-10T08:36:38.063827+0000","last_became_peered":"2024-09-10T08:36:38.063827+0000","last_unstale":"2024-09-10T08:36:39.059341+0000","last_undegraded":"2024-09-10T08:36:39.059341+0000","last_fullsized":"2024-09-10T08:36:39.059341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:41.577558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775921+0000","last_change":"2024-09-10T08:36:38.077263+0000","last_active":"2024-09-10T08:36:39.775921+0000","last_peered":"2024-09-10T08:36:39.775921+0000","last_clean":"2024-09-10T08:36:39.775921+0000","last_became_active":"2024-09-10T08:36:38.076967+0000","last_became_peered":"2024-09-10T08:36:38.076967+0000","last_unstale":"2024-09-10T08:36:39.775921+0000","last_undegraded":"2024-09-10T08:36:39.775921+0000","last_fullsized":"2024-09-10T08:36:39.775921+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:34.520887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.072557+0000","last_change":"2024-09-10T08:36:38.070545+0000","last_active":"2024-09-10T08:36:38.072557+0000","last_peered":"2024-09-10T08:36:38.072557+0000","last_clean":"2024-09-10T08:36:38.072557+0000","last_became_active":"2024-09-10T08:36:38.070201+0000","last_became_peered":"2024-09-10T08:36:38.070201+0000","last_unstale":"2024-09-10T08:36:38.072557+0000","last_undegraded":"2024-09-10T08:36:38.072557+0000","last_fullsized":"2024-09-10T08:36:38.072557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:06.614834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070378+0000","last_change":"2024-09-10T08:36:38.074156+0000","last_active":"2024-09-10T08:36:39.070378+0000","last_peered":"2024-09-10T08:36:39.070378+0000","last_clean":"2024-09-10T08:36:39.070378+0000","last_became_active":"2024-09-10T08:36:38.073721+0000","last_became_peered":"2024-09-10T08:36:38.073721+0000","last_unstale":"2024-09-10T08:36:39.070378+0000","last_undegraded":"2024-09-10T08:36:39.070378+0000","last_fullsized":"2024-09-10T08:36:39.070378+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:08.045202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070389+0000","last_change":"2024-09-10T08:36:38.064459+0000","last_active":"2024-09-10T08:36:39.070389+0000","last_peered":"2024-09-10T08:36:39.070389+0000","last_clean":"2024-09-10T08:36:39.070389+0000","last_became_active":"2024-09-10T08:36:38.064168+0000","last_became_peered":"2024-09-10T08:36:38.064168+0000","last_unstale":"2024-09-10T08:36:39.070389+0000","last_undegraded":"2024-09-10T08:36:39.070389+0000","last_fullsized":"2024-09-10T08:36:39.070389+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:34.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775675+0000","last_change":"2024-09-10T08:36:38.060008+0000","last_active":"2024-09-10T08:36:39.775675+0000","last_peered":"2024-09-10T08:36:39.775675+0000","last_clean":"2024-09-10T08:36:39.775675+0000","last_became_active":"2024-09-10T08:36:38.059715+0000","last_became_peered":"2024-09-10T08:36:38.059715+0000","last_unstale":"2024-09-10T08:36:39.775675+0000","last_undegraded":"2024-09-10T08:36:39.775675+0000","last_fullsized":"2024-09-10T08:36:39.775675+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.497105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776401+0000","last_change":"2024-09-10T08:36:38.074621+0000","last_active":"2024-09-10T08:36:39.776401+0000","last_peered":"2024-09-10T08:36:39.776401+0000","last_clean":"2024-09-10T08:36:39.776401+0000","last_became_active":"2024-09-10T08:36:38.074196+0000","last_became_peered":"2024-09-10T08:36:38.074196+0000","last_unstale":"2024-09-10T08:36:39.776401+0000","last_undegraded":"2024-09-10T08:36:39.776401+0000","last_fullsized":"2024-09-10T08:36:39.776401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:47.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070681+0000","last_change":"2024-09-10T08:36:38.062944+0000","last_active":"2024-09-10T08:36:39.070681+0000","last_peered":"2024-09-10T08:36:39.070681+0000","last_clean":"2024-09-10T08:36:39.070681+0000","last_became_active":"2024-09-10T08:36:38.062604+0000","last_became_peered":"2024-09-10T08:36:38.062604+0000","last_unstale":"2024-09-10T08:36:39.070681+0000","last_undegraded":"2024-09-10T08:36:39.070681+0000","last_fullsized":"2024-09-10T08:36:39.070681+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:55.843260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776086+0000","last_change":"2024-09-10T08:36:38.071402+0000","last_active":"2024-09-10T08:36:39.776086+0000","last_peered":"2024-09-10T08:36:39.776086+0000","last_clean":"2024-09-10T08:36:39.776086+0000","last_became_active":"2024-09-10T08:36:38.071147+0000","last_became_peered":"2024-09-10T08:36:38.071147+0000","last_unstale":"2024-09-10T08:36:39.776086+0000","last_undegraded":"2024-09-10T08:36:39.776086+0000","last_fullsized":"2024-09-10T08:36:39.776086+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:01.455029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057826+0000","last_change":"2024-09-10T08:36:38.069763+0000","last_active":"2024-09-10T08:36:39.057826+0000","last_peered":"2024-09-10T08:36:39.057826+0000","last_clean":"2024-09-10T08:36:39.057826+0000","last_became_active":"2024-09-10T08:36:38.069493+0000","last_became_peered":"2024-09-10T08:36:38.069493+0000","last_unstale":"2024-09-10T08:36:39.057826+0000","last_undegraded":"2024-09-10T08:36:39.057826+0000","last_fullsized":"2024-09-10T08:36:39.057826+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:01.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774910+0000","last_change":"2024-09-10T08:36:38.063799+0000","last_active":"2024-09-10T08:36:39.774910+0000","last_peered":"2024-09-10T08:36:39.774910+0000","last_clean":"2024-09-10T08:36:39.774910+0000","last_became_active":"2024-09-10T08:36:38.063536+0000","last_became_peered":"2024-09-10T08:36:38.063536+0000","last_unstale":"2024-09-10T08:36:39.774910+0000","last_undegraded":"2024-09-10T08:36:39.774910+0000","last_fullsized":"2024-09-10T08:36:39.774910+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:01.455029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775640+0000","last_change":"2024-09-10T08:36:38.067800+0000","last_active":"2024-09-10T08:36:39.775640+0000","last_peered":"2024-09-10T08:36:39.775640+0000","last_clean":"2024-09-10T08:36:39.775640+0000","last_became_active":"2024-09-10T08:36:38.067519+0000","last_became_peered":"2024-09-10T08:36:38.067519+0000","last_unstale":"2024-09-10T08:36:39.775640+0000","last_undegraded":"2024-09-10T08:36:39.775640+0000","last_fullsized":"2024-09-10T08:36:39.775640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:14.229431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775126+0000","last_change":"2024-09-10T08:36:38.069818+0000","last_active":"2024-09-10T08:36:39.775126+0000","last_peered":"2024-09-10T08:36:39.775126+0000","last_clean":"2024-09-10T08:36:39.775126+0000","last_became_active":"2024-09-10T08:36:38.069441+0000","last_became_peered":"2024-09-10T08:36:38.069441+0000","last_unstale":"2024-09-10T08:36:39.775126+0000","last_undegraded":"2024-09-10T08:36:39.775126+0000","last_fullsized":"2024-09-10T08:36:39.775126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:12.983814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059240+0000","last_change":"2024-09-10T08:36:38.077631+0000","last_active":"2024-09-10T08:36:39.059240+0000","last_peered":"2024-09-10T08:36:39.059240+0000","last_clean":"2024-09-10T08:36:39.059240+0000","last_became_active":"2024-09-10T08:36:38.077320+0000","last_became_peered":"2024-09-10T08:36:38.077320+0000","last_unstale":"2024-09-10T08:36:39.059240+0000","last_undegraded":"2024-09-10T08:36:39.059240+0000","last_fullsized":"2024-09-10T08:36:39.059240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:08.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070721+0000","last_change":"2024-09-10T08:36:38.058790+0000","last_active":"2024-09-10T08:36:39.070721+0000","last_peered":"2024-09-10T08:36:39.070721+0000","last_clean":"2024-09-10T08:36:39.070721+0000","last_became_active":"2024-09-10T08:36:38.058508+0000","last_became_peered":"2024-09-10T08:36:38.058508+0000","last_unstale":"2024-09-10T08:36:39.070721+0000","last_undegraded":"2024-09-10T08:36:39.070721+0000","last_fullsized":"2024-09-10T08:36:39.070721+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:05.754327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059253+0000","last_change":"2024-09-10T08:36:38.073227+0000","last_active":"2024-09-10T08:36:39.059253+0000","last_peered":"2024-09-10T08:36:39.059253+0000","last_clean":"2024-09-10T08:36:39.059253+0000","last_became_active":"2024-09-10T08:36:38.072893+0000","last_became_peered":"2024-09-10T08:36:38.072893+0000","last_unstale":"2024-09-10T08:36:39.059253+0000","last_undegraded":"2024-09-10T08:36:39.059253+0000","last_fullsized":"2024-09-10T08:36:39.059253+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:00.374214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059043+0000","last_change":"2024-09-10T08:36:38.067193+0000","last_active":"2024-09-10T08:36:39.059043+0000","last_peered":"2024-09-10T08:36:39.059043+0000","last_clean":"2024-09-10T08:36:39.059043+0000","last_became_active":"2024-09-10T08:36:38.066315+0000","last_became_peered":"2024-09-10T08:36:38.066315+0000","last_unstale":"2024-09-10T08:36:39.059043+0000","last_undegraded":"2024-09-10T08:36:39.059043+0000","last_fullsized":"2024-09-10T08:36:39.059043+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:15.251385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070907+0000","last_change":"2024-09-10T08:36:38.068437+0000","last_active":"2024-09-10T08:36:39.070907+0000","last_peered":"2024-09-10T08:36:39.070907+0000","last_clean":"2024-09-10T08:36:39.070907+0000","last_became_active":"2024-09-10T08:36:38.068163+0000","last_became_peered":"2024-09-10T08:36:38.068163+0000","last_unstale":"2024-09-10T08:36:39.070907+0000","last_undegraded":"2024-09-10T08:36:39.070907+0000","last_fullsized":"2024-09-10T08:36:39.070907+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.767837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073285+0000","last_change":"2024-09-10T08:36:38.072104+0000","last_active":"2024-09-10T08:36:38.073285+0000","last_peered":"2024-09-10T08:36:38.073285+0000","last_clean":"2024-09-10T08:36:38.073285+0000","last_became_active":"2024-09-10T08:36:38.070575+0000","last_became_peered":"2024-09-10T08:36:38.070575+0000","last_unstale":"2024-09-10T08:36:38.073285+0000","last_undegraded":"2024-09-10T08:36:38.073285+0000","last_fullsized":"2024-09-10T08:36:38.073285+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:40.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775281+0000","last_change":"2024-09-10T08:36:38.055723+0000","last_active":"2024-09-10T08:36:39.775281+0000","last_peered":"2024-09-10T08:36:39.775281+0000","last_clean":"2024-09-10T08:36:39.775281+0000","last_became_active":"2024-09-10T08:36:38.055331+0000","last_became_peered":"2024-09-10T08:36:38.055331+0000","last_unstale":"2024-09-10T08:36:39.775281+0000","last_undegraded":"2024-09-10T08:36:39.775281+0000","last_fullsized":"2024-09-10T08:36:39.775281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:36.282724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059107+0000","last_change":"2024-09-10T08:36:38.062091+0000","last_active":"2024-09-10T08:36:39.059107+0000","last_peered":"2024-09-10T08:36:39.059107+0000","last_clean":"2024-09-10T08:36:39.059107+0000","last_became_active":"2024-09-10T08:36:38.061800+0000","last_became_peered":"2024-09-10T08:36:38.061800+0000","last_unstale":"2024-09-10T08:36:39.059107+0000","last_undegraded":"2024-09-10T08:36:39.059107+0000","last_fullsized":"2024-09-10T08:36:39.059107+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:55.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070746+0000","last_change":"2024-09-10T08:36:38.065140+0000","last_active":"2024-09-10T08:36:39.070746+0000","last_peered":"2024-09-10T08:36:39.070746+0000","last_clean":"2024-09-10T08:36:39.070746+0000","last_became_active":"2024-09-10T08:36:38.063686+0000","last_became_peered":"2024-09-10T08:36:38.063686+0000","last_unstale":"2024-09-10T08:36:39.070746+0000","last_undegraded":"2024-09-10T08:36:39.070746+0000","last_fullsized":"2024-09-10T08:36:39.070746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:33.598273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.070465+0000","last_change":"2024-09-10T08:36:38.068423+0000","last_active":"2024-09-10T08:36:38.070465+0000","last_peered":"2024-09-10T08:36:38.070465+0000","last_clean":"2024-09-10T08:36:38.070465+0000","last_became_active":"2024-09-10T08:36:38.068142+0000","last_became_peered":"2024-09-10T08:36:38.068142+0000","last_unstale":"2024-09-10T08:36:38.070465+0000","last_undegraded":"2024-09-10T08:36:38.070465+0000","last_fullsized":"2024-09-10T08:36:38.070465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:54.464633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059819+0000","last_change":"2024-09-10T08:36:38.065606+0000","last_active":"2024-09-10T08:36:39.059819+0000","last_peered":"2024-09-10T08:36:39.059819+0000","last_clean":"2024-09-10T08:36:39.059819+0000","last_became_active":"2024-09-10T08:36:38.065312+0000","last_became_peered":"2024-09-10T08:36:38.065312+0000","last_unstale":"2024-09-10T08:36:39.059819+0000","last_undegraded":"2024-09-10T08:36:39.059819+0000","last_fullsized":"2024-09-10T08:36:39.059819+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:43.663859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073442+0000","last_change":"2024-09-10T08:36:38.069083+0000","last_active":"2024-09-10T08:36:38.073442+0000","last_peered":"2024-09-10T08:36:38.073442+0000","last_clean":"2024-09-10T08:36:38.073442+0000","last_became_active":"2024-09-10T08:36:38.068803+0000","last_became_peered":"2024-09-10T08:36:38.068803+0000","last_unstale":"2024-09-10T08:36:38.073442+0000","last_undegraded":"2024-09-10T08:36:38.073442+0000","last_fullsized":"2024-09-10T08:36:38.073442+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:00.913531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775023+0000","last_change":"2024-09-10T08:36:38.068039+0000","last_active":"2024-09-10T08:36:39.775023+0000","last_peered":"2024-09-10T08:36:39.775023+0000","last_clean":"2024-09-10T08:36:39.775023+0000","last_became_active":"2024-09-10T08:36:38.064659+0000","last_became_peered":"2024-09-10T08:36:38.064659+0000","last_unstale":"2024-09-10T08:36:39.775023+0000","last_undegraded":"2024-09-10T08:36:39.775023+0000","last_fullsized":"2024-09-10T08:36:39.775023+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.070114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070786+0000","last_change":"2024-09-10T08:36:38.062540+0000","last_active":"2024-09-10T08:36:39.070786+0000","last_peered":"2024-09-10T08:36:39.070786+0000","last_clean":"2024-09-10T08:36:39.070786+0000","last_became_active":"2024-09-10T08:36:38.062229+0000","last_became_peered":"2024-09-10T08:36:38.062229+0000","last_unstale":"2024-09-10T08:36:39.070786+0000","last_undegraded":"2024-09-10T08:36:39.070786+0000","last_fullsized":"2024-09-10T08:36:39.070786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:05.208226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775289+0000","last_change":"2024-09-10T08:36:38.055224+0000","last_active":"2024-09-10T08:36:39.775289+0000","last_peered":"2024-09-10T08:36:39.775289+0000","last_clean":"2024-09-10T08:36:39.775289+0000","last_became_active":"2024-09-10T08:36:38.054891+0000","last_became_peered":"2024-09-10T08:36:38.054891+0000","last_unstale":"2024-09-10T08:36:39.775289+0000","last_undegraded":"2024-09-10T08:36:39.775289+0000","last_fullsized":"2024-09-10T08:36:39.775289+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:49.793132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775394+0000","last_change":"2024-09-10T08:36:38.077520+0000","last_active":"2024-09-10T08:36:39.775394+0000","last_peered":"2024-09-10T08:36:39.775394+0000","last_clean":"2024-09-10T08:36:39.775394+0000","last_became_active":"2024-09-10T08:36:38.077199+0000","last_became_peered":"2024-09-10T08:36:38.077199+0000","last_unstale":"2024-09-10T08:36:39.775394+0000","last_undegraded":"2024-09-10T08:36:39.775394+0000","last_fullsized":"2024-09-10T08:36:39.775394+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:43.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775500+0000","last_change":"2024-09-10T08:36:38.060404+0000","last_active":"2024-09-10T08:36:39.775500+0000","last_peered":"2024-09-10T08:36:39.775500+0000","last_clean":"2024-09-10T08:36:39.775500+0000","last_became_active":"2024-09-10T08:36:38.058713+0000","last_became_peered":"2024-09-10T08:36:38.058713+0000","last_unstale":"2024-09-10T08:36:39.775500+0000","last_undegraded":"2024-09-10T08:36:39.775500+0000","last_fullsized":"2024-09-10T08:36:39.775500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:44.344556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"123'4","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775370+0000","last_change":"2024-09-10T08:36:37.038050+0000","last_active":"2024-09-10T08:36:39.775370+0000","last_peered":"2024-09-10T08:36:39.775370+0000","last_clean":"2024-09-10T08:36:39.775370+0000","last_became_active":"2024-09-10T08:36:37.037770+0000","last_became_peered":"2024-09-10T08:36:37.037770+0000","last_unstale":"2024-09-10T08:36:39.775370+0000","last_undegraded":"2024-09-10T08:36:39.775370+0000","last_fullsized":"2024-09-10T08:36:39.775370+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:39.463369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775313+0000","last_change":"2024-09-10T08:36:38.067596+0000","last_active":"2024-09-10T08:36:39.775313+0000","last_peered":"2024-09-10T08:36:39.775313+0000","last_clean":"2024-09-10T08:36:39.775313+0000","last_became_active":"2024-09-10T08:36:38.067338+0000","last_became_peered":"2024-09-10T08:36:38.067338+0000","last_unstale":"2024-09-10T08:36:39.775313+0000","last_undegraded":"2024-09-10T08:36:39.775313+0000","last_fullsized":"2024-09-10T08:36:39.775313+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:39.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058031+0000","last_change":"2024-09-10T08:36:37.049267+0000","last_active":"2024-09-10T08:36:39.058031+0000","last_peered":"2024-09-10T08:36:39.058031+0000","last_clean":"2024-09-10T08:36:39.058031+0000","last_became_active":"2024-09-10T08:36:37.048930+0000","last_became_peered":"2024-09-10T08:36:37.048930+0000","last_unstale":"2024-09-10T08:36:39.058031+0000","last_undegraded":"2024-09-10T08:36:39.058031+0000","last_fullsized":"2024-09-10T08:36:39.058031+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:31.716709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073464+0000","last_change":"2024-09-10T08:36:38.068165+0000","last_active":"2024-09-10T08:36:38.073464+0000","last_peered":"2024-09-10T08:36:38.073464+0000","last_clean":"2024-09-10T08:36:38.073464+0000","last_became_active":"2024-09-10T08:36:38.067309+0000","last_became_peered":"2024-09-10T08:36:38.067309+0000","last_unstale":"2024-09-10T08:36:38.073464+0000","last_undegraded":"2024-09-10T08:36:38.073464+0000","last_fullsized":"2024-09-10T08:36:38.073464+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:47.290805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059774+0000","last_change":"2024-09-10T08:36:37.046494+0000","last_active":"2024-09-10T08:36:39.059774+0000","last_peered":"2024-09-10T08:36:39.059774+0000","last_clean":"2024-09-10T08:36:39.059774+0000","last_became_active":"2024-09-10T08:36:37.046229+0000","last_became_peered":"2024-09-10T08:36:37.046229+0000","last_unstale":"2024-09-10T08:36:39.059774+0000","last_undegraded":"2024-09-10T08:36:39.059774+0000","last_fullsized":"2024-09-10T08:36:39.059774+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:19.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059161+0000","last_change":"2024-09-10T08:36:38.076573+0000","last_active":"2024-09-10T08:36:39.059161+0000","last_peered":"2024-09-10T08:36:39.059161+0000","last_clean":"2024-09-10T08:36:39.059161+0000","last_became_active":"2024-09-10T08:36:38.076085+0000","last_became_peered":"2024-09-10T08:36:38.076085+0000","last_unstale":"2024-09-10T08:36:39.059161+0000","last_undegraded":"2024-09-10T08:36:39.059161+0000","last_fullsized":"2024-09-10T08:36:39.059161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:12.983814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059895+0000","last_change":"2024-09-10T08:36:37.044152+0000","last_active":"2024-09-10T08:36:39.059895+0000","last_peered":"2024-09-10T08:36:39.059895+0000","last_clean":"2024-09-10T08:36:39.059895+0000","last_became_active":"2024-09-10T08:36:37.041129+0000","last_became_peered":"2024-09-10T08:36:37.041129+0000","last_unstale":"2024-09-10T08:36:39.059895+0000","last_undegraded":"2024-09-10T08:36:39.059895+0000","last_fullsized":"2024-09-10T08:36:39.059895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:32.964152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059289+0000","last_change":"2024-09-10T08:36:38.065081+0000","last_active":"2024-09-10T08:36:39.059289+0000","last_peered":"2024-09-10T08:36:39.059289+0000","last_clean":"2024-09-10T08:36:39.059289+0000","last_became_active":"2024-09-10T08:36:38.060675+0000","last_became_peered":"2024-09-10T08:36:38.060675+0000","last_unstale":"2024-09-10T08:36:39.059289+0000","last_undegraded":"2024-09-10T08:36:39.059289+0000","last_fullsized":"2024-09-10T08:36:39.059289+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:42.425656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059010+0000","last_change":"2024-09-10T08:36:37.052449+0000","last_active":"2024-09-10T08:36:39.059010+0000","last_peered":"2024-09-10T08:36:39.059010+0000","last_clean":"2024-09-10T08:36:39.059010+0000","last_became_active":"2024-09-10T08:36:37.051593+0000","last_became_peered":"2024-09-10T08:36:37.051593+0000","last_unstale":"2024-09-10T08:36:39.059010+0000","last_undegraded":"2024-09-10T08:36:39.059010+0000","last_fullsized":"2024-09-10T08:36:39.059010+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:59.501990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070746+0000","last_change":"2024-09-10T08:36:38.070653+0000","last_active":"2024-09-10T08:36:39.070746+0000","last_peered":"2024-09-10T08:36:39.070746+0000","last_clean":"2024-09-10T08:36:39.070746+0000","last_became_active":"2024-09-10T08:36:38.070377+0000","last_became_peered":"2024-09-10T08:36:38.070377+0000","last_unstale":"2024-09-10T08:36:39.070746+0000","last_undegraded":"2024-09-10T08:36:39.070746+0000","last_fullsized":"2024-09-10T08:36:39.070746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:28.443732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775095+0000","last_change":"2024-09-10T08:36:37.048907+0000","last_active":"2024-09-10T08:36:39.775095+0000","last_peered":"2024-09-10T08:36:39.775095+0000","last_clean":"2024-09-10T08:36:39.775095+0000","last_became_active":"2024-09-10T08:36:37.047749+0000","last_became_peered":"2024-09-10T08:36:37.047749+0000","last_unstale":"2024-09-10T08:36:39.775095+0000","last_undegraded":"2024-09-10T08:36:39.775095+0000","last_fullsized":"2024-09-10T08:36:39.775095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:57.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775550+0000","last_change":"2024-09-10T08:36:38.074806+0000","last_active":"2024-09-10T08:36:39.775550+0000","last_peered":"2024-09-10T08:36:39.775550+0000","last_clean":"2024-09-10T08:36:39.775550+0000","last_became_active":"2024-09-10T08:36:38.074446+0000","last_became_peered":"2024-09-10T08:36:38.074446+0000","last_unstale":"2024-09-10T08:36:39.775550+0000","last_undegraded":"2024-09-10T08:36:39.775550+0000","last_fullsized":"2024-09-10T08:36:39.775550+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:00.374214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070450+0000","last_change":"2024-09-10T08:36:37.045992+0000","last_active":"2024-09-10T08:36:39.070450+0000","last_peered":"2024-09-10T08:36:39.070450+0000","last_clean":"2024-09-10T08:36:39.070450+0000","last_became_active":"2024-09-10T08:36:37.045013+0000","last_became_peered":"2024-09-10T08:36:37.045013+0000","last_unstale":"2024-09-10T08:36:39.070450+0000","last_undegraded":"2024-09-10T08:36:39.070450+0000","last_fullsized":"2024-09-10T08:36:39.070450+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:44.588178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070404+0000","last_change":"2024-09-10T08:36:38.076332+0000","last_active":"2024-09-10T08:36:39.070404+0000","last_peered":"2024-09-10T08:36:39.070404+0000","last_clean":"2024-09-10T08:36:39.070404+0000","last_became_active":"2024-09-10T08:36:38.075274+0000","last_became_peered":"2024-09-10T08:36:38.075274+0000","last_unstale":"2024-09-10T08:36:39.070404+0000","last_undegraded":"2024-09-10T08:36:39.070404+0000","last_fullsized":"2024-09-10T08:36:39.070404+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:42.553817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775663+0000","last_change":"2024-09-10T08:36:37.057460+0000","last_active":"2024-09-10T08:36:39.775663+0000","last_peered":"2024-09-10T08:36:39.775663+0000","last_clean":"2024-09-10T08:36:39.775663+0000","last_became_active":"2024-09-10T08:36:37.056923+0000","last_became_peered":"2024-09-10T08:36:37.056923+0000","last_unstale":"2024-09-10T08:36:39.775663+0000","last_undegraded":"2024-09-10T08:36:39.775663+0000","last_fullsized":"2024-09-10T08:36:39.775663+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:15.079377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057972+0000","last_change":"2024-09-10T08:36:38.056600+0000","last_active":"2024-09-10T08:36:39.057972+0000","last_peered":"2024-09-10T08:36:39.057972+0000","last_clean":"2024-09-10T08:36:39.057972+0000","last_became_active":"2024-09-10T08:36:38.056280+0000","last_became_peered":"2024-09-10T08:36:38.056280+0000","last_unstale":"2024-09-10T08:36:39.057972+0000","last_undegraded":"2024-09-10T08:36:39.057972+0000","last_fullsized":"2024-09-10T08:36:39.057972+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:45.024029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059974+0000","last_change":"2024-09-10T08:36:37.042384+0000","last_active":"2024-09-10T08:36:39.059974+0000","last_peered":"2024-09-10T08:36:39.059974+0000","last_clean":"2024-09-10T08:36:39.059974+0000","last_became_active":"2024-09-10T08:36:37.042079+0000","last_became_peered":"2024-09-10T08:36:37.042079+0000","last_unstale":"2024-09-10T08:36:39.059974+0000","last_undegraded":"2024-09-10T08:36:39.059974+0000","last_fullsized":"2024-09-10T08:36:39.059974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:17.331978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058239+0000","last_change":"2024-09-10T08:36:38.067569+0000","last_active":"2024-09-10T08:36:39.058239+0000","last_peered":"2024-09-10T08:36:39.058239+0000","last_clean":"2024-09-10T08:36:39.058239+0000","last_became_active":"2024-09-10T08:36:38.067266+0000","last_became_peered":"2024-09-10T08:36:38.067266+0000","last_unstale":"2024-09-10T08:36:39.058239+0000","last_undegraded":"2024-09-10T08:36:39.058239+0000","last_fullsized":"2024-09-10T08:36:39.058239+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:17.796029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776498+0000","last_change":"2024-09-10T08:36:37.053601+0000","last_active":"2024-09-10T08:36:39.776498+0000","last_peered":"2024-09-10T08:36:39.776498+0000","last_clean":"2024-09-10T08:36:39.776498+0000","last_became_active":"2024-09-10T08:36:37.053267+0000","last_became_peered":"2024-09-10T08:36:37.053267+0000","last_unstale":"2024-09-10T08:36:39.776498+0000","last_undegraded":"2024-09-10T08:36:39.776498+0000","last_fullsized":"2024-09-10T08:36:39.776498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:04.965789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.077478+0000","last_change":"2024-09-10T08:36:38.075931+0000","last_active":"2024-09-10T08:36:38.077478+0000","last_peered":"2024-09-10T08:36:38.077478+0000","last_clean":"2024-09-10T08:36:38.077478+0000","last_became_active":"2024-09-10T08:36:38.075387+0000","last_became_peered":"2024-09-10T08:36:38.075387+0000","last_unstale":"2024-09-10T08:36:38.077478+0000","last_undegraded":"2024-09-10T08:36:38.077478+0000","last_fullsized":"2024-09-10T08:36:38.077478+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:31.008559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"123'3","reported_seq":17,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776104+0000","last_change":"2024-09-10T08:36:37.053203+0000","last_active":"2024-09-10T08:36:39.776104+0000","last_peered":"2024-09-10T08:36:39.776104+0000","last_clean":"2024-09-10T08:36:39.776104+0000","last_became_active":"2024-09-10T08:36:37.052870+0000","last_became_peered":"2024-09-10T08:36:37.052870+0000","last_unstale":"2024-09-10T08:36:39.776104+0000","last_undegraded":"2024-09-10T08:36:39.776104+0000","last_fullsized":"2024-09-10T08:36:39.776104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:19.173459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070743+0000","last_change":"2024-09-10T08:36:38.072835+0000","last_active":"2024-09-10T08:36:39.070743+0000","last_peered":"2024-09-10T08:36:39.070743+0000","last_clean":"2024-09-10T08:36:39.070743+0000","last_became_active":"2024-09-10T08:36:38.072567+0000","last_became_peered":"2024-09-10T08:36:38.072567+0000","last_unstale":"2024-09-10T08:36:39.070743+0000","last_undegraded":"2024-09-10T08:36:39.070743+0000","last_fullsized":"2024-09-10T08:36:39.070743+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:53.747388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"123'6","reported_seq":20,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060045+0000","last_change":"2024-09-10T08:36:37.041101+0000","last_active":"2024-09-10T08:36:39.060045+0000","last_peered":"2024-09-10T08:36:39.060045+0000","last_clean":"2024-09-10T08:36:39.060045+0000","last_became_active":"2024-09-10T08:36:37.040824+0000","last_became_peered":"2024-09-10T08:36:37.040824+0000","last_unstale":"2024-09-10T08:36:39.060045+0000","last_undegraded":"2024-09-10T08:36:39.060045+0000","last_fullsized":"2024-09-10T08:36:39.060045+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:00.528928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775485+0000","last_change":"2024-09-10T08:36:38.079644+0000","last_active":"2024-09-10T08:36:39.775485+0000","last_peered":"2024-09-10T08:36:39.775485+0000","last_clean":"2024-09-10T08:36:39.775485+0000","last_became_active":"2024-09-10T08:36:38.079219+0000","last_became_peered":"2024-09-10T08:36:38.079219+0000","last_unstale":"2024-09-10T08:36:39.775485+0000","last_undegraded":"2024-09-10T08:36:39.775485+0000","last_fullsized":"2024-09-10T08:36:39.775485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:08.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776056+0000","last_change":"2024-09-10T08:36:37.047872+0000","last_active":"2024-09-10T08:36:39.776056+0000","last_peered":"2024-09-10T08:36:39.776056+0000","last_clean":"2024-09-10T08:36:39.776056+0000","last_became_active":"2024-09-10T08:36:37.047585+0000","last_became_peered":"2024-09-10T08:36:37.047585+0000","last_unstale":"2024-09-10T08:36:39.776056+0000","last_undegraded":"2024-09-10T08:36:39.776056+0000","last_fullsized":"2024-09-10T08:36:39.776056+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.737057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059680+0000","last_change":"2024-09-10T08:36:38.063274+0000","last_active":"2024-09-10T08:36:39.059680+0000","last_peered":"2024-09-10T08:36:39.059680+0000","last_clean":"2024-09-10T08:36:39.059680+0000","last_became_active":"2024-09-10T08:36:38.060912+0000","last_became_peered":"2024-09-10T08:36:38.060912+0000","last_unstale":"2024-09-10T08:36:39.059680+0000","last_undegraded":"2024-09-10T08:36:39.059680+0000","last_fullsized":"2024-09-10T08:36:39.059680+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:41.689609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058935+0000","last_change":"2024-09-10T08:36:37.054726+0000","last_active":"2024-09-10T08:36:39.058935+0000","last_peered":"2024-09-10T08:36:39.058935+0000","last_clean":"2024-09-10T08:36:39.058935+0000","last_became_active":"2024-09-10T08:36:37.053777+0000","last_became_peered":"2024-09-10T08:36:37.053777+0000","last_unstale":"2024-09-10T08:36:39.058935+0000","last_undegraded":"2024-09-10T08:36:39.058935+0000","last_fullsized":"2024-09-10T08:36:39.058935+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:04.965789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059510+0000","last_change":"2024-09-10T08:36:38.067529+0000","last_active":"2024-09-10T08:36:39.059510+0000","last_peered":"2024-09-10T08:36:39.059510+0000","last_clean":"2024-09-10T08:36:39.059510+0000","last_became_active":"2024-09-10T08:36:38.066072+0000","last_became_peered":"2024-09-10T08:36:38.066072+0000","last_unstale":"2024-09-10T08:36:39.059510+0000","last_undegraded":"2024-09-10T08:36:39.059510+0000","last_fullsized":"2024-09-10T08:36:39.059510+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:34.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"123'8","reported_seq":22,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775010+0000","last_change":"2024-09-10T08:36:37.050976+0000","last_active":"2024-09-10T08:36:39.775010+0000","last_peered":"2024-09-10T08:36:39.775010+0000","last_clean":"2024-09-10T08:36:39.775010+0000","last_became_active":"2024-09-10T08:36:37.050679+0000","last_became_peered":"2024-09-10T08:36:37.050679+0000","last_unstale":"2024-09-10T08:36:39.775010+0000","last_undegraded":"2024-09-10T08:36:39.775010+0000","last_fullsized":"2024-09-10T08:36:39.775010+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:48.555959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775506+0000","last_change":"2024-09-10T08:36:38.064963+0000","last_active":"2024-09-10T08:36:39.775506+0000","last_peered":"2024-09-10T08:36:39.775506+0000","last_clean":"2024-09-10T08:36:39.775506+0000","last_became_active":"2024-09-10T08:36:38.064338+0000","last_became_peered":"2024-09-10T08:36:38.064338+0000","last_unstale":"2024-09-10T08:36:39.775506+0000","last_undegraded":"2024-09-10T08:36:39.775506+0000","last_fullsized":"2024-09-10T08:36:39.775506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:21.786609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"123'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.084938+0000","last_change":"2024-09-10T08:36:37.056130+0000","last_active":"2024-09-10T08:36:38.084938+0000","last_peered":"2024-09-10T08:36:38.084938+0000","last_clean":"2024-09-10T08:36:38.084938+0000","last_became_active":"2024-09-10T08:36:37.051293+0000","last_became_peered":"2024-09-10T08:36:37.051293+0000","last_unstale":"2024-09-10T08:36:38.084938+0000","last_undegraded":"2024-09-10T08:36:38.084938+0000","last_fullsized":"2024-09-10T08:36:38.084938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:42.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775825+0000","last_change":"2024-09-10T08:36:38.059445+0000","last_active":"2024-09-10T08:36:39.775825+0000","last_peered":"2024-09-10T08:36:39.775825+0000","last_clean":"2024-09-10T08:36:39.775825+0000","last_became_active":"2024-09-10T08:36:38.058514+0000","last_became_peered":"2024-09-10T08:36:38.058514+0000","last_unstale":"2024-09-10T08:36:39.775825+0000","last_undegraded":"2024-09-10T08:36:39.775825+0000","last_fullsized":"2024-09-10T08:36:39.775825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:58.280774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776566+0000","last_change":"2024-09-10T08:36:37.048641+0000","last_active":"2024-09-10T08:36:39.776566+0000","last_peered":"2024-09-10T08:36:39.776566+0000","last_clean":"2024-09-10T08:36:39.776566+0000","last_became_active":"2024-09-10T08:36:37.048326+0000","last_became_peered":"2024-09-10T08:36:37.048326+0000","last_unstale":"2024-09-10T08:36:39.776566+0000","last_undegraded":"2024-09-10T08:36:39.776566+0000","last_fullsized":"2024-09-10T08:36:39.776566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:14.492128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070703+0000","last_change":"2024-09-10T08:36:38.058931+0000","last_active":"2024-09-10T08:36:39.070703+0000","last_peered":"2024-09-10T08:36:39.070703+0000","last_clean":"2024-09-10T08:36:39.070703+0000","last_became_active":"2024-09-10T08:36:38.058566+0000","last_became_peered":"2024-09-10T08:36:38.058566+0000","last_unstale":"2024-09-10T08:36:39.070703+0000","last_undegraded":"2024-09-10T08:36:39.070703+0000","last_fullsized":"2024-09-10T08:36:39.070703+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:06.380173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775244+0000","last_change":"2024-09-10T08:36:37.053393+0000","last_active":"2024-09-10T08:36:39.775244+0000","last_peered":"2024-09-10T08:36:39.775244+0000","last_clean":"2024-09-10T08:36:39.775244+0000","last_became_active":"2024-09-10T08:36:37.053045+0000","last_became_peered":"2024-09-10T08:36:37.053045+0000","last_unstale":"2024-09-10T08:36:39.775244+0000","last_undegraded":"2024-09-10T08:36:39.775244+0000","last_fullsized":"2024-09-10T08:36:39.775244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:37.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775169+0000","last_change":"2024-09-10T08:36:38.062698+0000","last_active":"2024-09-10T08:36:39.775169+0000","last_peered":"2024-09-10T08:36:39.775169+0000","last_clean":"2024-09-10T08:36:39.775169+0000","last_became_active":"2024-09-10T08:36:38.062422+0000","last_became_peered":"2024-09-10T08:36:38.062422+0000","last_unstale":"2024-09-10T08:36:39.775169+0000","last_undegraded":"2024-09-10T08:36:39.775169+0000","last_fullsized":"2024-09-10T08:36:39.775169+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:20.315534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775101+0000","last_change":"2024-09-10T08:36:37.046519+0000","last_active":"2024-09-10T08:36:39.775101+0000","last_peered":"2024-09-10T08:36:39.775101+0000","last_clean":"2024-09-10T08:36:39.775101+0000","last_became_active":"2024-09-10T08:36:37.045448+0000","last_became_peered":"2024-09-10T08:36:37.045448+0000","last_unstale":"2024-09-10T08:36:39.775101+0000","last_undegraded":"2024-09-10T08:36:39.775101+0000","last_fullsized":"2024-09-10T08:36:39.775101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:14.492128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058817+0000","last_change":"2024-09-10T08:36:38.072292+0000","last_active":"2024-09-10T08:36:39.058817+0000","last_peered":"2024-09-10T08:36:39.058817+0000","last_clean":"2024-09-10T08:36:39.058817+0000","last_became_active":"2024-09-10T08:36:38.071955+0000","last_became_peered":"2024-09-10T08:36:38.071955+0000","last_unstale":"2024-09-10T08:36:39.058817+0000","last_undegraded":"2024-09-10T08:36:39.058817+0000","last_fullsized":"2024-09-10T08:36:39.058817+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:01.296750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776177+0000","last_change":"2024-09-10T08:36:37.053176+0000","last_active":"2024-09-10T08:36:39.776177+0000","last_peered":"2024-09-10T08:36:39.776177+0000","last_clean":"2024-09-10T08:36:39.776177+0000","last_became_active":"2024-09-10T08:36:37.050756+0000","last_became_peered":"2024-09-10T08:36:37.050756+0000","last_unstale":"2024-09-10T08:36:39.776177+0000","last_undegraded":"2024-09-10T08:36:39.776177+0000","last_fullsized":"2024-09-10T08:36:39.776177+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:59.501990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775208+0000","last_change":"2024-09-10T08:36:38.058193+0000","last_active":"2024-09-10T08:36:39.775208+0000","last_peered":"2024-09-10T08:36:39.775208+0000","last_clean":"2024-09-10T08:36:39.775208+0000","last_became_active":"2024-09-10T08:36:38.057898+0000","last_became_peered":"2024-09-10T08:36:38.057898+0000","last_unstale":"2024-09-10T08:36:39.775208+0000","last_undegraded":"2024-09-10T08:36:39.775208+0000","last_fullsized":"2024-09-10T08:36:39.775208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:20.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775208+0000","last_change":"2024-09-10T08:36:37.052658+0000","last_active":"2024-09-10T08:36:39.775208+0000","last_peered":"2024-09-10T08:36:39.775208+0000","last_clean":"2024-09-10T08:36:39.775208+0000","last_became_active":"2024-09-10T08:36:37.052340+0000","last_became_peered":"2024-09-10T08:36:37.052340+0000","last_unstale":"2024-09-10T08:36:39.775208+0000","last_undegraded":"2024-09-10T08:36:39.775208+0000","last_fullsized":"2024-09-10T08:36:39.775208+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:46.118779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775053+0000","last_change":"2024-09-10T08:36:38.060731+0000","last_active":"2024-09-10T08:36:39.775053+0000","last_peered":"2024-09-10T08:36:39.775053+0000","last_clean":"2024-09-10T08:36:39.775053+0000","last_became_active":"2024-09-10T08:36:38.057532+0000","last_became_peered":"2024-09-10T08:36:38.057532+0000","last_unstale":"2024-09-10T08:36:39.775053+0000","last_undegraded":"2024-09-10T08:36:39.775053+0000","last_fullsized":"2024-09-10T08:36:39.775053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:37.779868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058899+0000","last_change":"2024-09-10T08:36:37.048130+0000","last_active":"2024-09-10T08:36:39.058899+0000","last_peered":"2024-09-10T08:36:39.058899+0000","last_clean":"2024-09-10T08:36:39.058899+0000","last_became_active":"2024-09-10T08:36:37.047872+0000","last_became_peered":"2024-09-10T08:36:37.047872+0000","last_unstale":"2024-09-10T08:36:39.058899+0000","last_undegraded":"2024-09-10T08:36:39.058899+0000","last_fullsized":"2024-09-10T08:36:39.058899+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:49.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776423+0000","last_change":"2024-09-10T08:36:38.075609+0000","last_active":"2024-09-10T08:36:39.776423+0000","last_peered":"2024-09-10T08:36:39.776423+0000","last_clean":"2024-09-10T08:36:39.776423+0000","last_became_active":"2024-09-10T08:36:38.075290+0000","last_became_peered":"2024-09-10T08:36:38.075290+0000","last_unstale":"2024-09-10T08:36:39.776423+0000","last_undegraded":"2024-09-10T08:36:39.776423+0000","last_fullsized":"2024-09-10T08:36:39.776423+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:56.729227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059056+0000","last_change":"2024-09-10T08:36:37.051460+0000","last_active":"2024-09-10T08:36:39.059056+0000","last_peered":"2024-09-10T08:36:39.059056+0000","last_clean":"2024-09-10T08:36:39.059056+0000","last_became_active":"2024-09-10T08:36:37.051154+0000","last_became_peered":"2024-09-10T08:36:37.051154+0000","last_unstale":"2024-09-10T08:36:39.059056+0000","last_undegraded":"2024-09-10T08:36:39.059056+0000","last_fullsized":"2024-09-10T08:36:39.059056+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:35.501604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775124+0000","last_change":"2024-09-10T08:36:38.057865+0000","last_active":"2024-09-10T08:36:39.775124+0000","last_peered":"2024-09-10T08:36:39.775124+0000","last_clean":"2024-09-10T08:36:39.775124+0000","last_became_active":"2024-09-10T08:36:38.057605+0000","last_became_peered":"2024-09-10T08:36:38.057605+0000","last_unstale":"2024-09-10T08:36:39.775124+0000","last_undegraded":"2024-09-10T08:36:39.775124+0000","last_fullsized":"2024-09-10T08:36:39.775124+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:37.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060034+0000","last_change":"2024-09-10T08:36:37.043580+0000","last_active":"2024-09-10T08:36:39.060034+0000","last_peered":"2024-09-10T08:36:39.060034+0000","last_clean":"2024-09-10T08:36:39.060034+0000","last_became_active":"2024-09-10T08:36:37.042146+0000","last_became_peered":"2024-09-10T08:36:37.042146+0000","last_unstale":"2024-09-10T08:36:39.060034+0000","last_undegraded":"2024-09-10T08:36:39.060034+0000","last_fullsized":"2024-09-10T08:36:39.060034+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:16.789987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.077207+0000","last_change":"2024-09-10T08:36:38.075730+0000","last_active":"2024-09-10T08:36:38.077207+0000","last_peered":"2024-09-10T08:36:38.077207+0000","last_clean":"2024-09-10T08:36:38.077207+0000","last_became_active":"2024-09-10T08:36:38.075434+0000","last_became_peered":"2024-09-10T08:36:38.075434+0000","last_unstale":"2024-09-10T08:36:38.077207+0000","last_undegraded":"2024-09-10T08:36:38.077207+0000","last_fullsized":"2024-09-10T08:36:38.077207+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:58.713108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"124'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.072416+0000","last_change":"2024-09-10T08:36:37.052238+0000","last_active":"2024-09-10T08:36:39.072416+0000","last_peered":"2024-09-10T08:36:39.072416+0000","last_clean":"2024-09-10T08:36:39.072416+0000","last_became_active":"2024-09-10T08:36:37.051930+0000","last_became_peered":"2024-09-10T08:36:37.051930+0000","last_unstale":"2024-09-10T08:36:39.072416+0000","last_undegraded":"2024-09-10T08:36:39.072416+0000","last_fullsized":"2024-09-10T08:36:39.072416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:59.353425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775210+0000","last_change":"2024-09-10T08:36:38.068388+0000","last_active":"2024-09-10T08:36:39.775210+0000","last_peered":"2024-09-10T08:36:39.775210+0000","last_clean":"2024-09-10T08:36:39.775210+0000","last_became_active":"2024-09-10T08:36:38.068121+0000","last_became_peered":"2024-09-10T08:36:38.068121+0000","last_unstale":"2024-09-10T08:36:39.775210+0000","last_undegraded":"2024-09-10T08:36:39.775210+0000","last_fullsized":"2024-09-10T08:36:39.775210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.284492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059932+0000","last_change":"2024-09-10T08:36:37.051063+0000","last_active":"2024-09-10T08:36:39.059932+0000","last_peered":"2024-09-10T08:36:39.059932+0000","last_clean":"2024-09-10T08:36:39.059932+0000","last_became_active":"2024-09-10T08:36:37.050779+0000","last_became_peered":"2024-09-10T08:36:37.050779+0000","last_unstale":"2024-09-10T08:36:39.059932+0000","last_undegraded":"2024-09-10T08:36:39.059932+0000","last_fullsized":"2024-09-10T08:36:39.059932+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:39.099344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775206+0000","last_change":"2024-09-10T08:36:38.057462+0000","last_active":"2024-09-10T08:36:39.775206+0000","last_peered":"2024-09-10T08:36:39.775206+0000","last_clean":"2024-09-10T08:36:39.775206+0000","last_became_active":"2024-09-10T08:36:38.057152+0000","last_became_peered":"2024-09-10T08:36:38.057152+0000","last_unstale":"2024-09-10T08:36:39.775206+0000","last_undegraded":"2024-09-10T08:36:39.775206+0000","last_fullsized":"2024-09-10T08:36:39.775206+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:15.786955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060001+0000","last_change":"2024-09-10T08:36:37.055563+0000","last_active":"2024-09-10T08:36:39.060001+0000","last_peered":"2024-09-10T08:36:39.060001+0000","last_clean":"2024-09-10T08:36:39.060001+0000","last_became_active":"2024-09-10T08:36:37.054502+0000","last_became_peered":"2024-09-10T08:36:37.054502+0000","last_unstale":"2024-09-10T08:36:39.060001+0000","last_undegraded":"2024-09-10T08:36:39.060001+0000","last_fullsized":"2024-09-10T08:36:39.060001+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:44.017987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058817+0000","last_change":"2024-09-10T08:36:38.068466+0000","last_active":"2024-09-10T08:36:39.058817+0000","last_peered":"2024-09-10T08:36:39.058817+0000","last_clean":"2024-09-10T08:36:39.058817+0000","last_became_active":"2024-09-10T08:36:38.068149+0000","last_became_peered":"2024-09-10T08:36:38.068149+0000","last_unstale":"2024-09-10T08:36:39.058817+0000","last_undegraded":"2024-09-10T08:36:39.058817+0000","last_fullsized":"2024-09-10T08:36:39.058817+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:53.279810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070864+0000","last_change":"2024-09-10T08:36:37.040125+0000","last_active":"2024-09-10T08:36:39.070864+0000","last_peered":"2024-09-10T08:36:39.070864+0000","last_clean":"2024-09-10T08:36:39.070864+0000","last_became_active":"2024-09-10T08:36:37.039832+0000","last_became_peered":"2024-09-10T08:36:37.039832+0000","last_unstale":"2024-09-10T08:36:39.070864+0000","last_undegraded":"2024-09-10T08:36:39.070864+0000","last_fullsized":"2024-09-10T08:36:39.070864+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:24.800623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775011+0000","last_change":"2024-09-10T08:36:38.068749+0000","last_active":"2024-09-10T08:36:39.775011+0000","last_peered":"2024-09-10T08:36:39.775011+0000","last_clean":"2024-09-10T08:36:39.775011+0000","last_became_active":"2024-09-10T08:36:38.068447+0000","last_became_peered":"2024-09-10T08:36:38.068447+0000","last_unstale":"2024-09-10T08:36:39.775011+0000","last_undegraded":"2024-09-10T08:36:39.775011+0000","last_fullsized":"2024-09-10T08:36:39.775011+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:56.729227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774867+0000","last_change":"2024-09-10T08:36:37.046671+0000","last_active":"2024-09-10T08:36:39.774867+0000","last_peered":"2024-09-10T08:36:39.774867+0000","last_clean":"2024-09-10T08:36:39.774867+0000","last_became_active":"2024-09-10T08:36:37.046379+0000","last_became_peered":"2024-09-10T08:36:37.046379+0000","last_unstale":"2024-09-10T08:36:39.774867+0000","last_undegraded":"2024-09-10T08:36:39.774867+0000","last_fullsized":"2024-09-10T08:36:39.774867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:20.251113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774959+0000","last_change":"2024-09-10T08:36:38.070127+0000","last_active":"2024-09-10T08:36:39.774959+0000","last_peered":"2024-09-10T08:36:39.774959+0000","last_clean":"2024-09-10T08:36:39.774959+0000","last_became_active":"2024-09-10T08:36:38.069835+0000","last_became_peered":"2024-09-10T08:36:38.069835+0000","last_unstale":"2024-09-10T08:36:39.774959+0000","last_undegraded":"2024-09-10T08:36:39.774959+0000","last_fullsized":"2024-09-10T08:36:39.774959+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:47.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775391+0000","last_change":"2024-09-10T08:36:37.050055+0000","last_active":"2024-09-10T08:36:39.775391+0000","last_peered":"2024-09-10T08:36:39.775391+0000","last_clean":"2024-09-10T08:36:39.775391+0000","last_became_active":"2024-09-10T08:36:37.049698+0000","last_became_peered":"2024-09-10T08:36:37.049698+0000","last_unstale":"2024-09-10T08:36:39.775391+0000","last_undegraded":"2024-09-10T08:36:39.775391+0000","last_fullsized":"2024-09-10T08:36:39.775391+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:31.716709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.068657+0000","last_change":"2024-09-10T08:36:38.064032+0000","last_active":"2024-09-10T08:36:38.068657+0000","last_peered":"2024-09-10T08:36:38.068657+0000","last_clean":"2024-09-10T08:36:38.068657+0000","last_became_active":"2024-09-10T08:36:38.063697+0000","last_became_peered":"2024-09-10T08:36:38.063697+0000","last_unstale":"2024-09-10T08:36:38.068657+0000","last_undegraded":"2024-09-10T08:36:38.068657+0000","last_fullsized":"2024-09-10T08:36:38.068657+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:14.893048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.058435+0000","last_change":"2024-09-10T08:36:37.054402+0000","last_active":"2024-09-10T08:36:38.058435+0000","last_peered":"2024-09-10T08:36:38.058435+0000","last_clean":"2024-09-10T08:36:38.058435+0000","last_became_active":"2024-09-10T08:36:37.051911+0000","last_became_peered":"2024-09-10T08:36:37.051911+0000","last_unstale":"2024-09-10T08:36:38.058435+0000","last_undegraded":"2024-09-10T08:36:38.058435+0000","last_fullsized":"2024-09-10T08:36:38.058435+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:01.228406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058958+0000","last_change":"2024-09-10T08:36:38.064589+0000","last_active":"2024-09-10T08:36:39.058958+0000","last_peered":"2024-09-10T08:36:39.058958+0000","last_clean":"2024-09-10T08:36:39.058958+0000","last_became_active":"2024-09-10T08:36:38.064272+0000","last_became_peered":"2024-09-10T08:36:38.064272+0000","last_unstale":"2024-09-10T08:36:39.058958+0000","last_undegraded":"2024-09-10T08:36:39.058958+0000","last_fullsized":"2024-09-10T08:36:39.058958+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:58.280774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057504+0000","last_change":"2024-09-10T08:36:37.044829+0000","last_active":"2024-09-10T08:36:39.057504+0000","last_peered":"2024-09-10T08:36:39.057504+0000","last_clean":"2024-09-10T08:36:39.057504+0000","last_became_active":"2024-09-10T08:36:37.044540+0000","last_became_peered":"2024-09-10T08:36:37.044540+0000","last_unstale":"2024-09-10T08:36:39.057504+0000","last_undegraded":"2024-09-10T08:36:39.057504+0000","last_fullsized":"2024-09-10T08:36:39.057504+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:46.118779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058474+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:36:39.058474+0000","last_peered":"2024-09-10T08:36:39.058474+0000","last_clean":"2024-09-10T08:36:39.058474+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:36:39.058474+0000","last_undegraded":"2024-09-10T08:36:39.058474+0000","last_fullsized":"2024-09-10T08:36:39.058474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":667302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50720,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321120,"statfs":{"total":96636764160,"available":96584826880,"internally_reserved":0,"allocated":1519616,"data_stored":665566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50748,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321092,"statfs":{"total":96636764160,"available":96584798208,"internally_reserved":0,"allocated":1548288,"data_stored":673568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1519616,"data_stored":665566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54908,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316932,"statfs":{"total":96636764160,"available":96580538368,"internally_reserved":0,"allocated":1544192,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2125824,"data_stored":1262234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1527808,"data_stored":666218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542243,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51292,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320548,"statfs":{"total":96636764160,"available":96584241152,"internally_reserved":0,"allocated":2101248,"data_stored":1249159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:36:42.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:36:42.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.464+0000 7f357d200640 1 Processor -- start 2024-09-10T08:36:42.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.464+0000 7f357d200640 1 -- start start 2024-09-10T08:36:42.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f357d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f357815e440 0x7f35780d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f357d200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f35780b6710 0x7f35780b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f357d200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35780d3990 con 0x7f35780cf450 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f357d200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f35780d3c70 con 0x7f357815e440 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f357d200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f35780d3f50 con 0x7f35780b6710 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f3577400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f357815e440 0x7f35780d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f3576a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f35780cf450 0x7f35780b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37726/0 (socket says 172.21.15.52:37726) 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f3577400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f357815e440 0x7f35780d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42176/0 (socket says 172.21.15.52:42176) 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.465+0000 7f3576a00640 1 -- 172.21.15.52:0/2503305348 learned_addr learned my addr 172.21.15.52:0/2503305348 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3577e00640 1 --2- 172.21.15.52:0/2503305348 >> v2:172.21.15.176:3300/0 conn(0x7f35780b6710 0x7f35780b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3577400640 1 -- 172.21.15.52:0/2503305348 >> v2:172.21.15.176:3300/0 conn(0x7f35780b6710 msgr2=0x7f35780b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3577400640 1 --2- 172.21.15.52:0/2503305348 >> v2:172.21.15.176:3300/0 conn(0x7f35780b6710 0x7f35780b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3577400640 1 -- 172.21.15.52:0/2503305348 >> v1:172.21.15.52:6789/0 conn(0x7f35780cf450 legacy=0x7f35780b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3577400640 1 -- 172.21.15.52:0/2503305348 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780d4230 con 0x7f357815e440 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.466+0000 7f3576000640 1 -- 172.21.15.52:0/2503305348 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159659823 0 0) 0x7f35780d3990 con 0x7f35780cf450 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.467+0000 7f3577400640 1 --2- 172.21.15.52:0/2503305348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f357815e440 0x7f35780d3240 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f35780d24b0 tx=0x7f356802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd432c8a155f47d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.467+0000 7f3576000640 1 -- 172.21.15.52:0/2503305348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568037070 con 0x7f357815e440 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.467+0000 7f3576000640 1 -- 172.21.15.52:0/2503305348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568032440 con 0x7f357815e440 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.467+0000 7f3576000640 1 -- 172.21.15.52:0/2503305348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568032810 con 0x7f357815e440 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 -- 172.21.15.52:0/2503305348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f357815e440 msgr2=0x7f35780d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 --2- 172.21.15.52:0/2503305348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f357815e440 0x7f35780d3240 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f35780d24b0 tx=0x7f356802a250 comp rx=0 tx=0).stop 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 -- 172.21.15.52:0/2503305348 shutdown_connections 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 --2- 172.21.15.52:0/2503305348 >> v2:172.21.15.176:3300/0 conn(0x7f35780b6710 0x7f35780b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 --2- 172.21.15.52:0/2503305348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f357815e440 0x7f35780d3240 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 -- 172.21.15.52:0/2503305348 >> 172.21.15.52:0/2503305348 conn(0x7f3578067f80 msgr2=0x7f35780d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 -- 172.21.15.52:0/2503305348 shutdown_connections 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.468+0000 7f357d200640 1 -- 172.21.15.52:0/2503305348 wait complete. 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.470+0000 7f357d200640 1 Processor -- start 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.470+0000 7f357d200640 1 -- start start 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35780b6710 0x7f35780ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 0x7f357815faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35780b76c0 con 0x7f35780cf450 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35780b7540 con 0x7f357815e440 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f357d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35780b80a0 con 0x7f35780b6710 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42184/0 (socket says 172.21.15.52:42184) 2024-09-10T08:36:42.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 -- 172.21.15.52:0/1490375015 learned_addr learned my addr 172.21.15.52:0/1490375015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 -- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35780b6710 msgr2=0x7f35780ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35780b6710 0x7f35780ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3577e00640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 0x7f357815faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 -- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 msgr2=0x7f357815faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 0x7f357815faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3576a00640 1 -- 172.21.15.52:0/1490375015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780ce660 con 0x7f35780cf450 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.471+0000 7f3577e00640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 0x7f357815faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f3576a00640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f356400c4d0 tx=0x7f356400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564018070 con 0x7f35780cf450 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564007500 con 0x7f35780cf450 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564004a20 con 0x7f35780cf450 2024-09-10T08:36:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35780cc200 con 0x7f35780cf450 2024-09-10T08:36:42.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.472+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3578152e10 con 0x7f35780cf450 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.473+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35780b7b60 con 0x7f35780cf450 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.474+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3564004bc0 con 0x7f35780cf450 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.475+0000 7f356f400640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 0x7f355806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.475+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f356408a200 con 0x7f35780cf450 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.475+0000 7f3577400640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 0x7f355806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.476+0000 7f3577400640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 0x7f355806e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3568034000 tx=0x7f356802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.479+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3564058b10 con 0x7f35780cf450 2024-09-10T08:36:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.661+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35780caf00 con 0x7f355806be30 2024-09-10T08:36:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.668+0000 7f356f400640 1 -- 172.21.15.52:0/1490375015 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252467 (secure 0 0 0) 0x7f35780caf00 con 0x7f355806be30 2024-09-10T08:36:42.671 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:42.673 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 msgr2=0x7f355806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 0x7f355806e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3568034000 tx=0x7f356802c000 comp rx=0 tx=0).stop 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 msgr2=0x7f35781528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f356400c4d0 tx=0x7f356400c990 comp rx=0 tx=0).stop 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 shutdown_connections 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f355806be30 0x7f355806e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f357815e440 0x7f357815faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35780cf450 0x7f35781528d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 --2- 172.21.15.52:0/1490375015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35780b6710 0x7f35780ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 >> 172.21.15.52:0/1490375015 conn(0x7f3578067f80 msgr2=0x7f35780b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 shutdown_connections 2024-09-10T08:36:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.673+0000 7f357d200640 1 -- 172.21.15.52:0/1490375015 wait complete. 2024-09-10T08:36:42.688 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-10T08:36:41.573732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":365356,"kb_used_data":13112,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754609364,"statfs":{"total":773094113280,"available":772719988736,"internally_reserved":0,"allocated":13426688,"data_stored":6522117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":360500784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.554202"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775659+0000","last_change":"2024-09-10T08:36:38.057386+0000","last_active":"2024-09-10T08:36:39.775659+0000","last_peered":"2024-09-10T08:36:39.775659+0000","last_clean":"2024-09-10T08:36:39.775659+0000","last_became_active":"2024-09-10T08:36:38.056855+0000","last_became_peered":"2024-09-10T08:36:38.056855+0000","last_unstale":"2024-09-10T08:36:39.775659+0000","last_undegraded":"2024-09-10T08:36:39.775659+0000","last_fullsized":"2024-09-10T08:36:39.775659+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:54.641377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057931+0000","last_change":"2024-09-10T08:36:38.065889+0000","last_active":"2024-09-10T08:36:39.057931+0000","last_peered":"2024-09-10T08:36:39.057931+0000","last_clean":"2024-09-10T08:36:39.057931+0000","last_became_active":"2024-09-10T08:36:38.065444+0000","last_became_peered":"2024-09-10T08:36:38.065444+0000","last_unstale":"2024-09-10T08:36:39.057931+0000","last_undegraded":"2024-09-10T08:36:39.057931+0000","last_fullsized":"2024-09-10T08:36:39.057931+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:40.105386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059199+0000","last_change":"2024-09-10T08:36:38.076326+0000","last_active":"2024-09-10T08:36:39.059199+0000","last_peered":"2024-09-10T08:36:39.059199+0000","last_clean":"2024-09-10T08:36:39.059199+0000","last_became_active":"2024-09-10T08:36:38.075731+0000","last_became_peered":"2024-09-10T08:36:38.075731+0000","last_unstale":"2024-09-10T08:36:39.059199+0000","last_undegraded":"2024-09-10T08:36:39.059199+0000","last_fullsized":"2024-09-10T08:36:39.059199+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:43.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059341+0000","last_change":"2024-09-10T08:36:38.064119+0000","last_active":"2024-09-10T08:36:39.059341+0000","last_peered":"2024-09-10T08:36:39.059341+0000","last_clean":"2024-09-10T08:36:39.059341+0000","last_became_active":"2024-09-10T08:36:38.063827+0000","last_became_peered":"2024-09-10T08:36:38.063827+0000","last_unstale":"2024-09-10T08:36:39.059341+0000","last_undegraded":"2024-09-10T08:36:39.059341+0000","last_fullsized":"2024-09-10T08:36:39.059341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:41.577558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775921+0000","last_change":"2024-09-10T08:36:38.077263+0000","last_active":"2024-09-10T08:36:39.775921+0000","last_peered":"2024-09-10T08:36:39.775921+0000","last_clean":"2024-09-10T08:36:39.775921+0000","last_became_active":"2024-09-10T08:36:38.076967+0000","last_became_peered":"2024-09-10T08:36:38.076967+0000","last_unstale":"2024-09-10T08:36:39.775921+0000","last_undegraded":"2024-09-10T08:36:39.775921+0000","last_fullsized":"2024-09-10T08:36:39.775921+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:34.520887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.072557+0000","last_change":"2024-09-10T08:36:38.070545+0000","last_active":"2024-09-10T08:36:38.072557+0000","last_peered":"2024-09-10T08:36:38.072557+0000","last_clean":"2024-09-10T08:36:38.072557+0000","last_became_active":"2024-09-10T08:36:38.070201+0000","last_became_peered":"2024-09-10T08:36:38.070201+0000","last_unstale":"2024-09-10T08:36:38.072557+0000","last_undegraded":"2024-09-10T08:36:38.072557+0000","last_fullsized":"2024-09-10T08:36:38.072557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:06.614834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070378+0000","last_change":"2024-09-10T08:36:38.074156+0000","last_active":"2024-09-10T08:36:39.070378+0000","last_peered":"2024-09-10T08:36:39.070378+0000","last_clean":"2024-09-10T08:36:39.070378+0000","last_became_active":"2024-09-10T08:36:38.073721+0000","last_became_peered":"2024-09-10T08:36:38.073721+0000","last_unstale":"2024-09-10T08:36:39.070378+0000","last_undegraded":"2024-09-10T08:36:39.070378+0000","last_fullsized":"2024-09-10T08:36:39.070378+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:26:08.045202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070389+0000","last_change":"2024-09-10T08:36:38.064459+0000","last_active":"2024-09-10T08:36:39.070389+0000","last_peered":"2024-09-10T08:36:39.070389+0000","last_clean":"2024-09-10T08:36:39.070389+0000","last_became_active":"2024-09-10T08:36:38.064168+0000","last_became_peered":"2024-09-10T08:36:38.064168+0000","last_unstale":"2024-09-10T08:36:39.070389+0000","last_undegraded":"2024-09-10T08:36:39.070389+0000","last_fullsized":"2024-09-10T08:36:39.070389+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:34.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775675+0000","last_change":"2024-09-10T08:36:38.060008+0000","last_active":"2024-09-10T08:36:39.775675+0000","last_peered":"2024-09-10T08:36:39.775675+0000","last_clean":"2024-09-10T08:36:39.775675+0000","last_became_active":"2024-09-10T08:36:38.059715+0000","last_became_peered":"2024-09-10T08:36:38.059715+0000","last_unstale":"2024-09-10T08:36:39.775675+0000","last_undegraded":"2024-09-10T08:36:39.775675+0000","last_fullsized":"2024-09-10T08:36:39.775675+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:41.497105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776401+0000","last_change":"2024-09-10T08:36:38.074621+0000","last_active":"2024-09-10T08:36:39.776401+0000","last_peered":"2024-09-10T08:36:39.776401+0000","last_clean":"2024-09-10T08:36:39.776401+0000","last_became_active":"2024-09-10T08:36:38.074196+0000","last_became_peered":"2024-09-10T08:36:38.074196+0000","last_unstale":"2024-09-10T08:36:39.776401+0000","last_undegraded":"2024-09-10T08:36:39.776401+0000","last_fullsized":"2024-09-10T08:36:39.776401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:47.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070681+0000","last_change":"2024-09-10T08:36:38.062944+0000","last_active":"2024-09-10T08:36:39.070681+0000","last_peered":"2024-09-10T08:36:39.070681+0000","last_clean":"2024-09-10T08:36:39.070681+0000","last_became_active":"2024-09-10T08:36:38.062604+0000","last_became_peered":"2024-09-10T08:36:38.062604+0000","last_unstale":"2024-09-10T08:36:39.070681+0000","last_undegraded":"2024-09-10T08:36:39.070681+0000","last_fullsized":"2024-09-10T08:36:39.070681+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:55.843260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776086+0000","last_change":"2024-09-10T08:36:38.071402+0000","last_active":"2024-09-10T08:36:39.776086+0000","last_peered":"2024-09-10T08:36:39.776086+0000","last_clean":"2024-09-10T08:36:39.776086+0000","last_became_active":"2024-09-10T08:36:38.071147+0000","last_became_peered":"2024-09-10T08:36:38.071147+0000","last_unstale":"2024-09-10T08:36:39.776086+0000","last_undegraded":"2024-09-10T08:36:39.776086+0000","last_fullsized":"2024-09-10T08:36:39.776086+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:01.455029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057826+0000","last_change":"2024-09-10T08:36:38.069763+0000","last_active":"2024-09-10T08:36:39.057826+0000","last_peered":"2024-09-10T08:36:39.057826+0000","last_clean":"2024-09-10T08:36:39.057826+0000","last_became_active":"2024-09-10T08:36:38.069493+0000","last_became_peered":"2024-09-10T08:36:38.069493+0000","last_unstale":"2024-09-10T08:36:39.057826+0000","last_undegraded":"2024-09-10T08:36:39.057826+0000","last_fullsized":"2024-09-10T08:36:39.057826+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:01.534969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774910+0000","last_change":"2024-09-10T08:36:38.063799+0000","last_active":"2024-09-10T08:36:39.774910+0000","last_peered":"2024-09-10T08:36:39.774910+0000","last_clean":"2024-09-10T08:36:39.774910+0000","last_became_active":"2024-09-10T08:36:38.063536+0000","last_became_peered":"2024-09-10T08:36:38.063536+0000","last_unstale":"2024-09-10T08:36:39.774910+0000","last_undegraded":"2024-09-10T08:36:39.774910+0000","last_fullsized":"2024-09-10T08:36:39.774910+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:53:01.455029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775640+0000","last_change":"2024-09-10T08:36:38.067800+0000","last_active":"2024-09-10T08:36:39.775640+0000","last_peered":"2024-09-10T08:36:39.775640+0000","last_clean":"2024-09-10T08:36:39.775640+0000","last_became_active":"2024-09-10T08:36:38.067519+0000","last_became_peered":"2024-09-10T08:36:38.067519+0000","last_unstale":"2024-09-10T08:36:39.775640+0000","last_undegraded":"2024-09-10T08:36:39.775640+0000","last_fullsized":"2024-09-10T08:36:39.775640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:14.229431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775126+0000","last_change":"2024-09-10T08:36:38.069818+0000","last_active":"2024-09-10T08:36:39.775126+0000","last_peered":"2024-09-10T08:36:39.775126+0000","last_clean":"2024-09-10T08:36:39.775126+0000","last_became_active":"2024-09-10T08:36:38.069441+0000","last_became_peered":"2024-09-10T08:36:38.069441+0000","last_unstale":"2024-09-10T08:36:39.775126+0000","last_undegraded":"2024-09-10T08:36:39.775126+0000","last_fullsized":"2024-09-10T08:36:39.775126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:12.983814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059240+0000","last_change":"2024-09-10T08:36:38.077631+0000","last_active":"2024-09-10T08:36:39.059240+0000","last_peered":"2024-09-10T08:36:39.059240+0000","last_clean":"2024-09-10T08:36:39.059240+0000","last_became_active":"2024-09-10T08:36:38.077320+0000","last_became_peered":"2024-09-10T08:36:38.077320+0000","last_unstale":"2024-09-10T08:36:39.059240+0000","last_undegraded":"2024-09-10T08:36:39.059240+0000","last_fullsized":"2024-09-10T08:36:39.059240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:08.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070721+0000","last_change":"2024-09-10T08:36:38.058790+0000","last_active":"2024-09-10T08:36:39.070721+0000","last_peered":"2024-09-10T08:36:39.070721+0000","last_clean":"2024-09-10T08:36:39.070721+0000","last_became_active":"2024-09-10T08:36:38.058508+0000","last_became_peered":"2024-09-10T08:36:38.058508+0000","last_unstale":"2024-09-10T08:36:39.070721+0000","last_undegraded":"2024-09-10T08:36:39.070721+0000","last_fullsized":"2024-09-10T08:36:39.070721+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:05.754327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059253+0000","last_change":"2024-09-10T08:36:38.073227+0000","last_active":"2024-09-10T08:36:39.059253+0000","last_peered":"2024-09-10T08:36:39.059253+0000","last_clean":"2024-09-10T08:36:39.059253+0000","last_became_active":"2024-09-10T08:36:38.072893+0000","last_became_peered":"2024-09-10T08:36:38.072893+0000","last_unstale":"2024-09-10T08:36:39.059253+0000","last_undegraded":"2024-09-10T08:36:39.059253+0000","last_fullsized":"2024-09-10T08:36:39.059253+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:00.374214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059043+0000","last_change":"2024-09-10T08:36:38.067193+0000","last_active":"2024-09-10T08:36:39.059043+0000","last_peered":"2024-09-10T08:36:39.059043+0000","last_clean":"2024-09-10T08:36:39.059043+0000","last_became_active":"2024-09-10T08:36:38.066315+0000","last_became_peered":"2024-09-10T08:36:38.066315+0000","last_unstale":"2024-09-10T08:36:39.059043+0000","last_undegraded":"2024-09-10T08:36:39.059043+0000","last_fullsized":"2024-09-10T08:36:39.059043+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:57:15.251385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070907+0000","last_change":"2024-09-10T08:36:38.068437+0000","last_active":"2024-09-10T08:36:39.070907+0000","last_peered":"2024-09-10T08:36:39.070907+0000","last_clean":"2024-09-10T08:36:39.070907+0000","last_became_active":"2024-09-10T08:36:38.068163+0000","last_became_peered":"2024-09-10T08:36:38.068163+0000","last_unstale":"2024-09-10T08:36:39.070907+0000","last_undegraded":"2024-09-10T08:36:39.070907+0000","last_fullsized":"2024-09-10T08:36:39.070907+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:57.767837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073285+0000","last_change":"2024-09-10T08:36:38.072104+0000","last_active":"2024-09-10T08:36:38.073285+0000","last_peered":"2024-09-10T08:36:38.073285+0000","last_clean":"2024-09-10T08:36:38.073285+0000","last_became_active":"2024-09-10T08:36:38.070575+0000","last_became_peered":"2024-09-10T08:36:38.070575+0000","last_unstale":"2024-09-10T08:36:38.073285+0000","last_undegraded":"2024-09-10T08:36:38.073285+0000","last_fullsized":"2024-09-10T08:36:38.073285+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:40.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775281+0000","last_change":"2024-09-10T08:36:38.055723+0000","last_active":"2024-09-10T08:36:39.775281+0000","last_peered":"2024-09-10T08:36:39.775281+0000","last_clean":"2024-09-10T08:36:39.775281+0000","last_became_active":"2024-09-10T08:36:38.055331+0000","last_became_peered":"2024-09-10T08:36:38.055331+0000","last_unstale":"2024-09-10T08:36:39.775281+0000","last_undegraded":"2024-09-10T08:36:39.775281+0000","last_fullsized":"2024-09-10T08:36:39.775281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:36.282724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059107+0000","last_change":"2024-09-10T08:36:38.062091+0000","last_active":"2024-09-10T08:36:39.059107+0000","last_peered":"2024-09-10T08:36:39.059107+0000","last_clean":"2024-09-10T08:36:39.059107+0000","last_became_active":"2024-09-10T08:36:38.061800+0000","last_became_peered":"2024-09-10T08:36:38.061800+0000","last_unstale":"2024-09-10T08:36:39.059107+0000","last_undegraded":"2024-09-10T08:36:39.059107+0000","last_fullsized":"2024-09-10T08:36:39.059107+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:55.402515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070746+0000","last_change":"2024-09-10T08:36:38.065140+0000","last_active":"2024-09-10T08:36:39.070746+0000","last_peered":"2024-09-10T08:36:39.070746+0000","last_clean":"2024-09-10T08:36:39.070746+0000","last_became_active":"2024-09-10T08:36:38.063686+0000","last_became_peered":"2024-09-10T08:36:38.063686+0000","last_unstale":"2024-09-10T08:36:39.070746+0000","last_undegraded":"2024-09-10T08:36:39.070746+0000","last_fullsized":"2024-09-10T08:36:39.070746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:33.598273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.070465+0000","last_change":"2024-09-10T08:36:38.068423+0000","last_active":"2024-09-10T08:36:38.070465+0000","last_peered":"2024-09-10T08:36:38.070465+0000","last_clean":"2024-09-10T08:36:38.070465+0000","last_became_active":"2024-09-10T08:36:38.068142+0000","last_became_peered":"2024-09-10T08:36:38.068142+0000","last_unstale":"2024-09-10T08:36:38.070465+0000","last_undegraded":"2024-09-10T08:36:38.070465+0000","last_fullsized":"2024-09-10T08:36:38.070465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:49:54.464633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059819+0000","last_change":"2024-09-10T08:36:38.065606+0000","last_active":"2024-09-10T08:36:39.059819+0000","last_peered":"2024-09-10T08:36:39.059819+0000","last_clean":"2024-09-10T08:36:39.059819+0000","last_became_active":"2024-09-10T08:36:38.065312+0000","last_became_peered":"2024-09-10T08:36:38.065312+0000","last_unstale":"2024-09-10T08:36:39.059819+0000","last_undegraded":"2024-09-10T08:36:39.059819+0000","last_fullsized":"2024-09-10T08:36:39.059819+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:43.663859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073442+0000","last_change":"2024-09-10T08:36:38.069083+0000","last_active":"2024-09-10T08:36:38.073442+0000","last_peered":"2024-09-10T08:36:38.073442+0000","last_clean":"2024-09-10T08:36:38.073442+0000","last_became_active":"2024-09-10T08:36:38.068803+0000","last_became_peered":"2024-09-10T08:36:38.068803+0000","last_unstale":"2024-09-10T08:36:38.073442+0000","last_undegraded":"2024-09-10T08:36:38.073442+0000","last_fullsized":"2024-09-10T08:36:38.073442+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:00.913531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775023+0000","last_change":"2024-09-10T08:36:38.068039+0000","last_active":"2024-09-10T08:36:39.775023+0000","last_peered":"2024-09-10T08:36:39.775023+0000","last_clean":"2024-09-10T08:36:39.775023+0000","last_became_active":"2024-09-10T08:36:38.064659+0000","last_became_peered":"2024-09-10T08:36:38.064659+0000","last_unstale":"2024-09-10T08:36:39.775023+0000","last_undegraded":"2024-09-10T08:36:39.775023+0000","last_fullsized":"2024-09-10T08:36:39.775023+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:21.070114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070786+0000","last_change":"2024-09-10T08:36:38.062540+0000","last_active":"2024-09-10T08:36:39.070786+0000","last_peered":"2024-09-10T08:36:39.070786+0000","last_clean":"2024-09-10T08:36:39.070786+0000","last_became_active":"2024-09-10T08:36:38.062229+0000","last_became_peered":"2024-09-10T08:36:38.062229+0000","last_unstale":"2024-09-10T08:36:39.070786+0000","last_undegraded":"2024-09-10T08:36:39.070786+0000","last_fullsized":"2024-09-10T08:36:39.070786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:05.208226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775289+0000","last_change":"2024-09-10T08:36:38.055224+0000","last_active":"2024-09-10T08:36:39.775289+0000","last_peered":"2024-09-10T08:36:39.775289+0000","last_clean":"2024-09-10T08:36:39.775289+0000","last_became_active":"2024-09-10T08:36:38.054891+0000","last_became_peered":"2024-09-10T08:36:38.054891+0000","last_unstale":"2024-09-10T08:36:39.775289+0000","last_undegraded":"2024-09-10T08:36:39.775289+0000","last_fullsized":"2024-09-10T08:36:39.775289+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:49.793132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775394+0000","last_change":"2024-09-10T08:36:38.077520+0000","last_active":"2024-09-10T08:36:39.775394+0000","last_peered":"2024-09-10T08:36:39.775394+0000","last_clean":"2024-09-10T08:36:39.775394+0000","last_became_active":"2024-09-10T08:36:38.077199+0000","last_became_peered":"2024-09-10T08:36:38.077199+0000","last_unstale":"2024-09-10T08:36:39.775394+0000","last_undegraded":"2024-09-10T08:36:39.775394+0000","last_fullsized":"2024-09-10T08:36:39.775394+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:43.507213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775500+0000","last_change":"2024-09-10T08:36:38.060404+0000","last_active":"2024-09-10T08:36:39.775500+0000","last_peered":"2024-09-10T08:36:39.775500+0000","last_clean":"2024-09-10T08:36:39.775500+0000","last_became_active":"2024-09-10T08:36:38.058713+0000","last_became_peered":"2024-09-10T08:36:38.058713+0000","last_unstale":"2024-09-10T08:36:39.775500+0000","last_undegraded":"2024-09-10T08:36:39.775500+0000","last_fullsized":"2024-09-10T08:36:39.775500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:52:44.344556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"123'4","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775370+0000","last_change":"2024-09-10T08:36:37.038050+0000","last_active":"2024-09-10T08:36:39.775370+0000","last_peered":"2024-09-10T08:36:39.775370+0000","last_clean":"2024-09-10T08:36:39.775370+0000","last_became_active":"2024-09-10T08:36:37.037770+0000","last_became_peered":"2024-09-10T08:36:37.037770+0000","last_unstale":"2024-09-10T08:36:39.775370+0000","last_undegraded":"2024-09-10T08:36:39.775370+0000","last_fullsized":"2024-09-10T08:36:39.775370+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:39.463369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775313+0000","last_change":"2024-09-10T08:36:38.067596+0000","last_active":"2024-09-10T08:36:39.775313+0000","last_peered":"2024-09-10T08:36:39.775313+0000","last_clean":"2024-09-10T08:36:39.775313+0000","last_became_active":"2024-09-10T08:36:38.067338+0000","last_became_peered":"2024-09-10T08:36:38.067338+0000","last_unstale":"2024-09-10T08:36:39.775313+0000","last_undegraded":"2024-09-10T08:36:39.775313+0000","last_fullsized":"2024-09-10T08:36:39.775313+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:39.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058031+0000","last_change":"2024-09-10T08:36:37.049267+0000","last_active":"2024-09-10T08:36:39.058031+0000","last_peered":"2024-09-10T08:36:39.058031+0000","last_clean":"2024-09-10T08:36:39.058031+0000","last_became_active":"2024-09-10T08:36:37.048930+0000","last_became_peered":"2024-09-10T08:36:37.048930+0000","last_unstale":"2024-09-10T08:36:39.058031+0000","last_undegraded":"2024-09-10T08:36:39.058031+0000","last_fullsized":"2024-09-10T08:36:39.058031+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:31.716709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.073464+0000","last_change":"2024-09-10T08:36:38.068165+0000","last_active":"2024-09-10T08:36:38.073464+0000","last_peered":"2024-09-10T08:36:38.073464+0000","last_clean":"2024-09-10T08:36:38.073464+0000","last_became_active":"2024-09-10T08:36:38.067309+0000","last_became_peered":"2024-09-10T08:36:38.067309+0000","last_unstale":"2024-09-10T08:36:38.073464+0000","last_undegraded":"2024-09-10T08:36:38.073464+0000","last_fullsized":"2024-09-10T08:36:38.073464+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:47.290805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059774+0000","last_change":"2024-09-10T08:36:37.046494+0000","last_active":"2024-09-10T08:36:39.059774+0000","last_peered":"2024-09-10T08:36:39.059774+0000","last_clean":"2024-09-10T08:36:39.059774+0000","last_became_active":"2024-09-10T08:36:37.046229+0000","last_became_peered":"2024-09-10T08:36:37.046229+0000","last_unstale":"2024-09-10T08:36:39.059774+0000","last_undegraded":"2024-09-10T08:36:39.059774+0000","last_fullsized":"2024-09-10T08:36:39.059774+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:19.739988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059161+0000","last_change":"2024-09-10T08:36:38.076573+0000","last_active":"2024-09-10T08:36:39.059161+0000","last_peered":"2024-09-10T08:36:39.059161+0000","last_clean":"2024-09-10T08:36:39.059161+0000","last_became_active":"2024-09-10T08:36:38.076085+0000","last_became_peered":"2024-09-10T08:36:38.076085+0000","last_unstale":"2024-09-10T08:36:39.059161+0000","last_undegraded":"2024-09-10T08:36:39.059161+0000","last_fullsized":"2024-09-10T08:36:39.059161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:12.983814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059895+0000","last_change":"2024-09-10T08:36:37.044152+0000","last_active":"2024-09-10T08:36:39.059895+0000","last_peered":"2024-09-10T08:36:39.059895+0000","last_clean":"2024-09-10T08:36:39.059895+0000","last_became_active":"2024-09-10T08:36:37.041129+0000","last_became_peered":"2024-09-10T08:36:37.041129+0000","last_unstale":"2024-09-10T08:36:39.059895+0000","last_undegraded":"2024-09-10T08:36:39.059895+0000","last_fullsized":"2024-09-10T08:36:39.059895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:32.964152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059289+0000","last_change":"2024-09-10T08:36:38.065081+0000","last_active":"2024-09-10T08:36:39.059289+0000","last_peered":"2024-09-10T08:36:39.059289+0000","last_clean":"2024-09-10T08:36:39.059289+0000","last_became_active":"2024-09-10T08:36:38.060675+0000","last_became_peered":"2024-09-10T08:36:38.060675+0000","last_unstale":"2024-09-10T08:36:39.059289+0000","last_undegraded":"2024-09-10T08:36:39.059289+0000","last_fullsized":"2024-09-10T08:36:39.059289+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:54:42.425656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059010+0000","last_change":"2024-09-10T08:36:37.052449+0000","last_active":"2024-09-10T08:36:39.059010+0000","last_peered":"2024-09-10T08:36:39.059010+0000","last_clean":"2024-09-10T08:36:39.059010+0000","last_became_active":"2024-09-10T08:36:37.051593+0000","last_became_peered":"2024-09-10T08:36:37.051593+0000","last_unstale":"2024-09-10T08:36:39.059010+0000","last_undegraded":"2024-09-10T08:36:39.059010+0000","last_fullsized":"2024-09-10T08:36:39.059010+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:59.501990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070746+0000","last_change":"2024-09-10T08:36:38.070653+0000","last_active":"2024-09-10T08:36:39.070746+0000","last_peered":"2024-09-10T08:36:39.070746+0000","last_clean":"2024-09-10T08:36:39.070746+0000","last_became_active":"2024-09-10T08:36:38.070377+0000","last_became_peered":"2024-09-10T08:36:38.070377+0000","last_unstale":"2024-09-10T08:36:39.070746+0000","last_undegraded":"2024-09-10T08:36:39.070746+0000","last_fullsized":"2024-09-10T08:36:39.070746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:28.443732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775095+0000","last_change":"2024-09-10T08:36:37.048907+0000","last_active":"2024-09-10T08:36:39.775095+0000","last_peered":"2024-09-10T08:36:39.775095+0000","last_clean":"2024-09-10T08:36:39.775095+0000","last_became_active":"2024-09-10T08:36:37.047749+0000","last_became_peered":"2024-09-10T08:36:37.047749+0000","last_unstale":"2024-09-10T08:36:39.775095+0000","last_undegraded":"2024-09-10T08:36:39.775095+0000","last_fullsized":"2024-09-10T08:36:39.775095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:57.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775550+0000","last_change":"2024-09-10T08:36:38.074806+0000","last_active":"2024-09-10T08:36:39.775550+0000","last_peered":"2024-09-10T08:36:39.775550+0000","last_clean":"2024-09-10T08:36:39.775550+0000","last_became_active":"2024-09-10T08:36:38.074446+0000","last_became_peered":"2024-09-10T08:36:38.074446+0000","last_unstale":"2024-09-10T08:36:39.775550+0000","last_undegraded":"2024-09-10T08:36:39.775550+0000","last_fullsized":"2024-09-10T08:36:39.775550+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:47:00.374214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070450+0000","last_change":"2024-09-10T08:36:37.045992+0000","last_active":"2024-09-10T08:36:39.070450+0000","last_peered":"2024-09-10T08:36:39.070450+0000","last_clean":"2024-09-10T08:36:39.070450+0000","last_became_active":"2024-09-10T08:36:37.045013+0000","last_became_peered":"2024-09-10T08:36:37.045013+0000","last_unstale":"2024-09-10T08:36:39.070450+0000","last_undegraded":"2024-09-10T08:36:39.070450+0000","last_fullsized":"2024-09-10T08:36:39.070450+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:44.588178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070404+0000","last_change":"2024-09-10T08:36:38.076332+0000","last_active":"2024-09-10T08:36:39.070404+0000","last_peered":"2024-09-10T08:36:39.070404+0000","last_clean":"2024-09-10T08:36:39.070404+0000","last_became_active":"2024-09-10T08:36:38.075274+0000","last_became_peered":"2024-09-10T08:36:38.075274+0000","last_unstale":"2024-09-10T08:36:39.070404+0000","last_undegraded":"2024-09-10T08:36:39.070404+0000","last_fullsized":"2024-09-10T08:36:39.070404+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:42.553817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775663+0000","last_change":"2024-09-10T08:36:37.057460+0000","last_active":"2024-09-10T08:36:39.775663+0000","last_peered":"2024-09-10T08:36:39.775663+0000","last_clean":"2024-09-10T08:36:39.775663+0000","last_became_active":"2024-09-10T08:36:37.056923+0000","last_became_peered":"2024-09-10T08:36:37.056923+0000","last_unstale":"2024-09-10T08:36:39.775663+0000","last_undegraded":"2024-09-10T08:36:39.775663+0000","last_fullsized":"2024-09-10T08:36:39.775663+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:15.079377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057972+0000","last_change":"2024-09-10T08:36:38.056600+0000","last_active":"2024-09-10T08:36:39.057972+0000","last_peered":"2024-09-10T08:36:39.057972+0000","last_clean":"2024-09-10T08:36:39.057972+0000","last_became_active":"2024-09-10T08:36:38.056280+0000","last_became_peered":"2024-09-10T08:36:38.056280+0000","last_unstale":"2024-09-10T08:36:39.057972+0000","last_undegraded":"2024-09-10T08:36:39.057972+0000","last_fullsized":"2024-09-10T08:36:39.057972+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:45.024029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059974+0000","last_change":"2024-09-10T08:36:37.042384+0000","last_active":"2024-09-10T08:36:39.059974+0000","last_peered":"2024-09-10T08:36:39.059974+0000","last_clean":"2024-09-10T08:36:39.059974+0000","last_became_active":"2024-09-10T08:36:37.042079+0000","last_became_peered":"2024-09-10T08:36:37.042079+0000","last_unstale":"2024-09-10T08:36:39.059974+0000","last_undegraded":"2024-09-10T08:36:39.059974+0000","last_fullsized":"2024-09-10T08:36:39.059974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:17.331978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058239+0000","last_change":"2024-09-10T08:36:38.067569+0000","last_active":"2024-09-10T08:36:39.058239+0000","last_peered":"2024-09-10T08:36:39.058239+0000","last_clean":"2024-09-10T08:36:39.058239+0000","last_became_active":"2024-09-10T08:36:38.067266+0000","last_became_peered":"2024-09-10T08:36:38.067266+0000","last_unstale":"2024-09-10T08:36:39.058239+0000","last_undegraded":"2024-09-10T08:36:39.058239+0000","last_fullsized":"2024-09-10T08:36:39.058239+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:17.796029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776498+0000","last_change":"2024-09-10T08:36:37.053601+0000","last_active":"2024-09-10T08:36:39.776498+0000","last_peered":"2024-09-10T08:36:39.776498+0000","last_clean":"2024-09-10T08:36:39.776498+0000","last_became_active":"2024-09-10T08:36:37.053267+0000","last_became_peered":"2024-09-10T08:36:37.053267+0000","last_unstale":"2024-09-10T08:36:39.776498+0000","last_undegraded":"2024-09-10T08:36:39.776498+0000","last_fullsized":"2024-09-10T08:36:39.776498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:04.965789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.077478+0000","last_change":"2024-09-10T08:36:38.075931+0000","last_active":"2024-09-10T08:36:38.077478+0000","last_peered":"2024-09-10T08:36:38.077478+0000","last_clean":"2024-09-10T08:36:38.077478+0000","last_became_active":"2024-09-10T08:36:38.075387+0000","last_became_peered":"2024-09-10T08:36:38.075387+0000","last_unstale":"2024-09-10T08:36:38.077478+0000","last_undegraded":"2024-09-10T08:36:38.077478+0000","last_fullsized":"2024-09-10T08:36:38.077478+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:31.008559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"123'3","reported_seq":17,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776104+0000","last_change":"2024-09-10T08:36:37.053203+0000","last_active":"2024-09-10T08:36:39.776104+0000","last_peered":"2024-09-10T08:36:39.776104+0000","last_clean":"2024-09-10T08:36:39.776104+0000","last_became_active":"2024-09-10T08:36:37.052870+0000","last_became_peered":"2024-09-10T08:36:37.052870+0000","last_unstale":"2024-09-10T08:36:39.776104+0000","last_undegraded":"2024-09-10T08:36:39.776104+0000","last_fullsized":"2024-09-10T08:36:39.776104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:19.173459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070743+0000","last_change":"2024-09-10T08:36:38.072835+0000","last_active":"2024-09-10T08:36:39.070743+0000","last_peered":"2024-09-10T08:36:39.070743+0000","last_clean":"2024-09-10T08:36:39.070743+0000","last_became_active":"2024-09-10T08:36:38.072567+0000","last_became_peered":"2024-09-10T08:36:38.072567+0000","last_unstale":"2024-09-10T08:36:39.070743+0000","last_undegraded":"2024-09-10T08:36:39.070743+0000","last_fullsized":"2024-09-10T08:36:39.070743+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:53.747388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"123'6","reported_seq":20,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060045+0000","last_change":"2024-09-10T08:36:37.041101+0000","last_active":"2024-09-10T08:36:39.060045+0000","last_peered":"2024-09-10T08:36:39.060045+0000","last_clean":"2024-09-10T08:36:39.060045+0000","last_became_active":"2024-09-10T08:36:37.040824+0000","last_became_peered":"2024-09-10T08:36:37.040824+0000","last_unstale":"2024-09-10T08:36:39.060045+0000","last_undegraded":"2024-09-10T08:36:39.060045+0000","last_fullsized":"2024-09-10T08:36:39.060045+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:00.528928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775485+0000","last_change":"2024-09-10T08:36:38.079644+0000","last_active":"2024-09-10T08:36:39.775485+0000","last_peered":"2024-09-10T08:36:39.775485+0000","last_clean":"2024-09-10T08:36:39.775485+0000","last_became_active":"2024-09-10T08:36:38.079219+0000","last_became_peered":"2024-09-10T08:36:38.079219+0000","last_unstale":"2024-09-10T08:36:39.775485+0000","last_undegraded":"2024-09-10T08:36:39.775485+0000","last_fullsized":"2024-09-10T08:36:39.775485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:08.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776056+0000","last_change":"2024-09-10T08:36:37.047872+0000","last_active":"2024-09-10T08:36:39.776056+0000","last_peered":"2024-09-10T08:36:39.776056+0000","last_clean":"2024-09-10T08:36:39.776056+0000","last_became_active":"2024-09-10T08:36:37.047585+0000","last_became_peered":"2024-09-10T08:36:37.047585+0000","last_unstale":"2024-09-10T08:36:39.776056+0000","last_undegraded":"2024-09-10T08:36:39.776056+0000","last_fullsized":"2024-09-10T08:36:39.776056+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:26.737057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059680+0000","last_change":"2024-09-10T08:36:38.063274+0000","last_active":"2024-09-10T08:36:39.059680+0000","last_peered":"2024-09-10T08:36:39.059680+0000","last_clean":"2024-09-10T08:36:39.059680+0000","last_became_active":"2024-09-10T08:36:38.060912+0000","last_became_peered":"2024-09-10T08:36:38.060912+0000","last_unstale":"2024-09-10T08:36:39.059680+0000","last_undegraded":"2024-09-10T08:36:39.059680+0000","last_fullsized":"2024-09-10T08:36:39.059680+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:41.689609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058935+0000","last_change":"2024-09-10T08:36:37.054726+0000","last_active":"2024-09-10T08:36:39.058935+0000","last_peered":"2024-09-10T08:36:39.058935+0000","last_clean":"2024-09-10T08:36:39.058935+0000","last_became_active":"2024-09-10T08:36:37.053777+0000","last_became_peered":"2024-09-10T08:36:37.053777+0000","last_unstale":"2024-09-10T08:36:39.058935+0000","last_undegraded":"2024-09-10T08:36:39.058935+0000","last_fullsized":"2024-09-10T08:36:39.058935+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:04.965789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059510+0000","last_change":"2024-09-10T08:36:38.067529+0000","last_active":"2024-09-10T08:36:39.059510+0000","last_peered":"2024-09-10T08:36:39.059510+0000","last_clean":"2024-09-10T08:36:39.059510+0000","last_became_active":"2024-09-10T08:36:38.066072+0000","last_became_peered":"2024-09-10T08:36:38.066072+0000","last_unstale":"2024-09-10T08:36:39.059510+0000","last_undegraded":"2024-09-10T08:36:39.059510+0000","last_fullsized":"2024-09-10T08:36:39.059510+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:34.170720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"123'8","reported_seq":22,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775010+0000","last_change":"2024-09-10T08:36:37.050976+0000","last_active":"2024-09-10T08:36:39.775010+0000","last_peered":"2024-09-10T08:36:39.775010+0000","last_clean":"2024-09-10T08:36:39.775010+0000","last_became_active":"2024-09-10T08:36:37.050679+0000","last_became_peered":"2024-09-10T08:36:37.050679+0000","last_unstale":"2024-09-10T08:36:39.775010+0000","last_undegraded":"2024-09-10T08:36:39.775010+0000","last_fullsized":"2024-09-10T08:36:39.775010+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:48.555959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775506+0000","last_change":"2024-09-10T08:36:38.064963+0000","last_active":"2024-09-10T08:36:39.775506+0000","last_peered":"2024-09-10T08:36:39.775506+0000","last_clean":"2024-09-10T08:36:39.775506+0000","last_became_active":"2024-09-10T08:36:38.064338+0000","last_became_peered":"2024-09-10T08:36:38.064338+0000","last_unstale":"2024-09-10T08:36:39.775506+0000","last_undegraded":"2024-09-10T08:36:39.775506+0000","last_fullsized":"2024-09-10T08:36:39.775506+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:21.786609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"123'1","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.084938+0000","last_change":"2024-09-10T08:36:37.056130+0000","last_active":"2024-09-10T08:36:38.084938+0000","last_peered":"2024-09-10T08:36:38.084938+0000","last_clean":"2024-09-10T08:36:38.084938+0000","last_became_active":"2024-09-10T08:36:37.051293+0000","last_became_peered":"2024-09-10T08:36:37.051293+0000","last_unstale":"2024-09-10T08:36:38.084938+0000","last_undegraded":"2024-09-10T08:36:38.084938+0000","last_fullsized":"2024-09-10T08:36:38.084938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:42.822852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775825+0000","last_change":"2024-09-10T08:36:38.059445+0000","last_active":"2024-09-10T08:36:39.775825+0000","last_peered":"2024-09-10T08:36:39.775825+0000","last_clean":"2024-09-10T08:36:39.775825+0000","last_became_active":"2024-09-10T08:36:38.058514+0000","last_became_peered":"2024-09-10T08:36:38.058514+0000","last_unstale":"2024-09-10T08:36:39.775825+0000","last_undegraded":"2024-09-10T08:36:39.775825+0000","last_fullsized":"2024-09-10T08:36:39.775825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:58.280774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776566+0000","last_change":"2024-09-10T08:36:37.048641+0000","last_active":"2024-09-10T08:36:39.776566+0000","last_peered":"2024-09-10T08:36:39.776566+0000","last_clean":"2024-09-10T08:36:39.776566+0000","last_became_active":"2024-09-10T08:36:37.048326+0000","last_became_peered":"2024-09-10T08:36:37.048326+0000","last_unstale":"2024-09-10T08:36:39.776566+0000","last_undegraded":"2024-09-10T08:36:39.776566+0000","last_fullsized":"2024-09-10T08:36:39.776566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:14.492128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070703+0000","last_change":"2024-09-10T08:36:38.058931+0000","last_active":"2024-09-10T08:36:39.070703+0000","last_peered":"2024-09-10T08:36:39.070703+0000","last_clean":"2024-09-10T08:36:39.070703+0000","last_became_active":"2024-09-10T08:36:38.058566+0000","last_became_peered":"2024-09-10T08:36:38.058566+0000","last_unstale":"2024-09-10T08:36:39.070703+0000","last_undegraded":"2024-09-10T08:36:39.070703+0000","last_fullsized":"2024-09-10T08:36:39.070703+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:06.380173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"123'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775244+0000","last_change":"2024-09-10T08:36:37.053393+0000","last_active":"2024-09-10T08:36:39.775244+0000","last_peered":"2024-09-10T08:36:39.775244+0000","last_clean":"2024-09-10T08:36:39.775244+0000","last_became_active":"2024-09-10T08:36:37.053045+0000","last_became_peered":"2024-09-10T08:36:37.053045+0000","last_unstale":"2024-09-10T08:36:39.775244+0000","last_undegraded":"2024-09-10T08:36:39.775244+0000","last_fullsized":"2024-09-10T08:36:39.775244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:09:37.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775169+0000","last_change":"2024-09-10T08:36:38.062698+0000","last_active":"2024-09-10T08:36:39.775169+0000","last_peered":"2024-09-10T08:36:39.775169+0000","last_clean":"2024-09-10T08:36:39.775169+0000","last_became_active":"2024-09-10T08:36:38.062422+0000","last_became_peered":"2024-09-10T08:36:38.062422+0000","last_unstale":"2024-09-10T08:36:39.775169+0000","last_undegraded":"2024-09-10T08:36:39.775169+0000","last_fullsized":"2024-09-10T08:36:39.775169+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:20.315534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775101+0000","last_change":"2024-09-10T08:36:37.046519+0000","last_active":"2024-09-10T08:36:39.775101+0000","last_peered":"2024-09-10T08:36:39.775101+0000","last_clean":"2024-09-10T08:36:39.775101+0000","last_became_active":"2024-09-10T08:36:37.045448+0000","last_became_peered":"2024-09-10T08:36:37.045448+0000","last_unstale":"2024-09-10T08:36:39.775101+0000","last_undegraded":"2024-09-10T08:36:39.775101+0000","last_fullsized":"2024-09-10T08:36:39.775101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:14.492128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058817+0000","last_change":"2024-09-10T08:36:38.072292+0000","last_active":"2024-09-10T08:36:39.058817+0000","last_peered":"2024-09-10T08:36:39.058817+0000","last_clean":"2024-09-10T08:36:39.058817+0000","last_became_active":"2024-09-10T08:36:38.071955+0000","last_became_peered":"2024-09-10T08:36:38.071955+0000","last_unstale":"2024-09-10T08:36:39.058817+0000","last_undegraded":"2024-09-10T08:36:39.058817+0000","last_fullsized":"2024-09-10T08:36:39.058817+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:01.296750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776177+0000","last_change":"2024-09-10T08:36:37.053176+0000","last_active":"2024-09-10T08:36:39.776177+0000","last_peered":"2024-09-10T08:36:39.776177+0000","last_clean":"2024-09-10T08:36:39.776177+0000","last_became_active":"2024-09-10T08:36:37.050756+0000","last_became_peered":"2024-09-10T08:36:37.050756+0000","last_unstale":"2024-09-10T08:36:39.776177+0000","last_undegraded":"2024-09-10T08:36:39.776177+0000","last_fullsized":"2024-09-10T08:36:39.776177+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:59.501990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775208+0000","last_change":"2024-09-10T08:36:38.058193+0000","last_active":"2024-09-10T08:36:39.775208+0000","last_peered":"2024-09-10T08:36:39.775208+0000","last_clean":"2024-09-10T08:36:39.775208+0000","last_became_active":"2024-09-10T08:36:38.057898+0000","last_became_peered":"2024-09-10T08:36:38.057898+0000","last_unstale":"2024-09-10T08:36:39.775208+0000","last_undegraded":"2024-09-10T08:36:39.775208+0000","last_fullsized":"2024-09-10T08:36:39.775208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:20.989092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775208+0000","last_change":"2024-09-10T08:36:37.052658+0000","last_active":"2024-09-10T08:36:39.775208+0000","last_peered":"2024-09-10T08:36:39.775208+0000","last_clean":"2024-09-10T08:36:39.775208+0000","last_became_active":"2024-09-10T08:36:37.052340+0000","last_became_peered":"2024-09-10T08:36:37.052340+0000","last_unstale":"2024-09-10T08:36:39.775208+0000","last_undegraded":"2024-09-10T08:36:39.775208+0000","last_fullsized":"2024-09-10T08:36:39.775208+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:46.118779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775053+0000","last_change":"2024-09-10T08:36:38.060731+0000","last_active":"2024-09-10T08:36:39.775053+0000","last_peered":"2024-09-10T08:36:39.775053+0000","last_clean":"2024-09-10T08:36:39.775053+0000","last_became_active":"2024-09-10T08:36:38.057532+0000","last_became_peered":"2024-09-10T08:36:38.057532+0000","last_unstale":"2024-09-10T08:36:39.775053+0000","last_undegraded":"2024-09-10T08:36:39.775053+0000","last_fullsized":"2024-09-10T08:36:39.775053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:50:37.779868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058899+0000","last_change":"2024-09-10T08:36:37.048130+0000","last_active":"2024-09-10T08:36:39.058899+0000","last_peered":"2024-09-10T08:36:39.058899+0000","last_clean":"2024-09-10T08:36:39.058899+0000","last_became_active":"2024-09-10T08:36:37.047872+0000","last_became_peered":"2024-09-10T08:36:37.047872+0000","last_unstale":"2024-09-10T08:36:39.058899+0000","last_undegraded":"2024-09-10T08:36:39.058899+0000","last_fullsized":"2024-09-10T08:36:39.058899+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:49.569419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.776423+0000","last_change":"2024-09-10T08:36:38.075609+0000","last_active":"2024-09-10T08:36:39.776423+0000","last_peered":"2024-09-10T08:36:39.776423+0000","last_clean":"2024-09-10T08:36:39.776423+0000","last_became_active":"2024-09-10T08:36:38.075290+0000","last_became_peered":"2024-09-10T08:36:38.075290+0000","last_unstale":"2024-09-10T08:36:39.776423+0000","last_undegraded":"2024-09-10T08:36:39.776423+0000","last_fullsized":"2024-09-10T08:36:39.776423+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:56.729227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059056+0000","last_change":"2024-09-10T08:36:37.051460+0000","last_active":"2024-09-10T08:36:39.059056+0000","last_peered":"2024-09-10T08:36:39.059056+0000","last_clean":"2024-09-10T08:36:39.059056+0000","last_became_active":"2024-09-10T08:36:37.051154+0000","last_became_peered":"2024-09-10T08:36:37.051154+0000","last_unstale":"2024-09-10T08:36:39.059056+0000","last_undegraded":"2024-09-10T08:36:39.059056+0000","last_fullsized":"2024-09-10T08:36:39.059056+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:35.501604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775124+0000","last_change":"2024-09-10T08:36:38.057865+0000","last_active":"2024-09-10T08:36:39.775124+0000","last_peered":"2024-09-10T08:36:39.775124+0000","last_clean":"2024-09-10T08:36:39.775124+0000","last_became_active":"2024-09-10T08:36:38.057605+0000","last_became_peered":"2024-09-10T08:36:38.057605+0000","last_unstale":"2024-09-10T08:36:39.775124+0000","last_undegraded":"2024-09-10T08:36:39.775124+0000","last_fullsized":"2024-09-10T08:36:39.775124+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:37.947302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"123'2","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060034+0000","last_change":"2024-09-10T08:36:37.043580+0000","last_active":"2024-09-10T08:36:39.060034+0000","last_peered":"2024-09-10T08:36:39.060034+0000","last_clean":"2024-09-10T08:36:39.060034+0000","last_became_active":"2024-09-10T08:36:37.042146+0000","last_became_peered":"2024-09-10T08:36:37.042146+0000","last_unstale":"2024-09-10T08:36:39.060034+0000","last_undegraded":"2024-09-10T08:36:39.060034+0000","last_fullsized":"2024-09-10T08:36:39.060034+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:16.789987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.077207+0000","last_change":"2024-09-10T08:36:38.075730+0000","last_active":"2024-09-10T08:36:38.077207+0000","last_peered":"2024-09-10T08:36:38.077207+0000","last_clean":"2024-09-10T08:36:38.077207+0000","last_became_active":"2024-09-10T08:36:38.075434+0000","last_became_peered":"2024-09-10T08:36:38.075434+0000","last_unstale":"2024-09-10T08:36:38.077207+0000","last_undegraded":"2024-09-10T08:36:38.077207+0000","last_fullsized":"2024-09-10T08:36:38.077207+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:58.713108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"124'1","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.072416+0000","last_change":"2024-09-10T08:36:37.052238+0000","last_active":"2024-09-10T08:36:39.072416+0000","last_peered":"2024-09-10T08:36:39.072416+0000","last_clean":"2024-09-10T08:36:39.072416+0000","last_became_active":"2024-09-10T08:36:37.051930+0000","last_became_peered":"2024-09-10T08:36:37.051930+0000","last_unstale":"2024-09-10T08:36:39.072416+0000","last_undegraded":"2024-09-10T08:36:39.072416+0000","last_fullsized":"2024-09-10T08:36:39.072416+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:59.353425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775210+0000","last_change":"2024-09-10T08:36:38.068388+0000","last_active":"2024-09-10T08:36:39.775210+0000","last_peered":"2024-09-10T08:36:39.775210+0000","last_clean":"2024-09-10T08:36:39.775210+0000","last_became_active":"2024-09-10T08:36:38.068121+0000","last_became_peered":"2024-09-10T08:36:38.068121+0000","last_unstale":"2024-09-10T08:36:39.775210+0000","last_undegraded":"2024-09-10T08:36:39.775210+0000","last_fullsized":"2024-09-10T08:36:39.775210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.284492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.059932+0000","last_change":"2024-09-10T08:36:37.051063+0000","last_active":"2024-09-10T08:36:39.059932+0000","last_peered":"2024-09-10T08:36:39.059932+0000","last_clean":"2024-09-10T08:36:39.059932+0000","last_became_active":"2024-09-10T08:36:37.050779+0000","last_became_peered":"2024-09-10T08:36:37.050779+0000","last_unstale":"2024-09-10T08:36:39.059932+0000","last_undegraded":"2024-09-10T08:36:39.059932+0000","last_fullsized":"2024-09-10T08:36:39.059932+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:21:39.099344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775206+0000","last_change":"2024-09-10T08:36:38.057462+0000","last_active":"2024-09-10T08:36:39.775206+0000","last_peered":"2024-09-10T08:36:39.775206+0000","last_clean":"2024-09-10T08:36:39.775206+0000","last_became_active":"2024-09-10T08:36:38.057152+0000","last_became_peered":"2024-09-10T08:36:38.057152+0000","last_unstale":"2024-09-10T08:36:39.775206+0000","last_undegraded":"2024-09-10T08:36:39.775206+0000","last_fullsized":"2024-09-10T08:36:39.775206+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:15.786955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.060001+0000","last_change":"2024-09-10T08:36:37.055563+0000","last_active":"2024-09-10T08:36:39.060001+0000","last_peered":"2024-09-10T08:36:39.060001+0000","last_clean":"2024-09-10T08:36:39.060001+0000","last_became_active":"2024-09-10T08:36:37.054502+0000","last_became_peered":"2024-09-10T08:36:37.054502+0000","last_unstale":"2024-09-10T08:36:39.060001+0000","last_undegraded":"2024-09-10T08:36:39.060001+0000","last_fullsized":"2024-09-10T08:36:39.060001+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:57:44.017987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058817+0000","last_change":"2024-09-10T08:36:38.068466+0000","last_active":"2024-09-10T08:36:39.058817+0000","last_peered":"2024-09-10T08:36:39.058817+0000","last_clean":"2024-09-10T08:36:39.058817+0000","last_became_active":"2024-09-10T08:36:38.068149+0000","last_became_peered":"2024-09-10T08:36:38.068149+0000","last_unstale":"2024-09-10T08:36:39.058817+0000","last_undegraded":"2024-09-10T08:36:39.058817+0000","last_fullsized":"2024-09-10T08:36:39.058817+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:12:53.279810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.070864+0000","last_change":"2024-09-10T08:36:37.040125+0000","last_active":"2024-09-10T08:36:39.070864+0000","last_peered":"2024-09-10T08:36:39.070864+0000","last_clean":"2024-09-10T08:36:39.070864+0000","last_became_active":"2024-09-10T08:36:37.039832+0000","last_became_peered":"2024-09-10T08:36:37.039832+0000","last_unstale":"2024-09-10T08:36:39.070864+0000","last_undegraded":"2024-09-10T08:36:39.070864+0000","last_fullsized":"2024-09-10T08:36:39.070864+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:07:24.800623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775011+0000","last_change":"2024-09-10T08:36:38.068749+0000","last_active":"2024-09-10T08:36:39.775011+0000","last_peered":"2024-09-10T08:36:39.775011+0000","last_clean":"2024-09-10T08:36:39.775011+0000","last_became_active":"2024-09-10T08:36:38.068447+0000","last_became_peered":"2024-09-10T08:36:38.068447+0000","last_unstale":"2024-09-10T08:36:39.775011+0000","last_undegraded":"2024-09-10T08:36:39.775011+0000","last_fullsized":"2024-09-10T08:36:39.775011+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:56.729227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774867+0000","last_change":"2024-09-10T08:36:37.046671+0000","last_active":"2024-09-10T08:36:39.774867+0000","last_peered":"2024-09-10T08:36:39.774867+0000","last_clean":"2024-09-10T08:36:39.774867+0000","last_became_active":"2024-09-10T08:36:37.046379+0000","last_became_peered":"2024-09-10T08:36:37.046379+0000","last_unstale":"2024-09-10T08:36:39.774867+0000","last_undegraded":"2024-09-10T08:36:39.774867+0000","last_fullsized":"2024-09-10T08:36:39.774867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:31:20.251113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.774959+0000","last_change":"2024-09-10T08:36:38.070127+0000","last_active":"2024-09-10T08:36:39.774959+0000","last_peered":"2024-09-10T08:36:39.774959+0000","last_clean":"2024-09-10T08:36:39.774959+0000","last_became_active":"2024-09-10T08:36:38.069835+0000","last_became_peered":"2024-09-10T08:36:38.069835+0000","last_unstale":"2024-09-10T08:36:39.774959+0000","last_undegraded":"2024-09-10T08:36:39.774959+0000","last_fullsized":"2024-09-10T08:36:39.774959+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:47.315592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.775391+0000","last_change":"2024-09-10T08:36:37.050055+0000","last_active":"2024-09-10T08:36:39.775391+0000","last_peered":"2024-09-10T08:36:39.775391+0000","last_clean":"2024-09-10T08:36:39.775391+0000","last_became_active":"2024-09-10T08:36:37.049698+0000","last_became_peered":"2024-09-10T08:36:37.049698+0000","last_unstale":"2024-09-10T08:36:39.775391+0000","last_undegraded":"2024-09-10T08:36:39.775391+0000","last_fullsized":"2024-09-10T08:36:39.775391+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:31.716709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.068657+0000","last_change":"2024-09-10T08:36:38.064032+0000","last_active":"2024-09-10T08:36:38.068657+0000","last_peered":"2024-09-10T08:36:38.068657+0000","last_clean":"2024-09-10T08:36:38.068657+0000","last_became_active":"2024-09-10T08:36:38.063697+0000","last_became_peered":"2024-09-10T08:36:38.063697+0000","last_unstale":"2024-09-10T08:36:38.068657+0000","last_undegraded":"2024-09-10T08:36:38.068657+0000","last_fullsized":"2024-09-10T08:36:38.068657+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:14.893048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-10T08:36:38.058435+0000","last_change":"2024-09-10T08:36:37.054402+0000","last_active":"2024-09-10T08:36:38.058435+0000","last_peered":"2024-09-10T08:36:38.058435+0000","last_clean":"2024-09-10T08:36:38.058435+0000","last_became_active":"2024-09-10T08:36:37.051911+0000","last_became_peered":"2024-09-10T08:36:37.051911+0000","last_unstale":"2024-09-10T08:36:38.058435+0000","last_undegraded":"2024-09-10T08:36:38.058435+0000","last_fullsized":"2024-09-10T08:36:38.058435+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:01.228406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058958+0000","last_change":"2024-09-10T08:36:38.064589+0000","last_active":"2024-09-10T08:36:39.058958+0000","last_peered":"2024-09-10T08:36:39.058958+0000","last_clean":"2024-09-10T08:36:39.058958+0000","last_became_active":"2024-09-10T08:36:38.064272+0000","last_became_peered":"2024-09-10T08:36:38.064272+0000","last_unstale":"2024-09-10T08:36:39.058958+0000","last_undegraded":"2024-09-10T08:36:39.058958+0000","last_fullsized":"2024-09-10T08:36:39.058958+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:37.018750+0000","last_clean_scrub_stamp":"2024-09-10T08:36:37.018750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:58.280774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.057504+0000","last_change":"2024-09-10T08:36:37.044829+0000","last_active":"2024-09-10T08:36:39.057504+0000","last_peered":"2024-09-10T08:36:39.057504+0000","last_clean":"2024-09-10T08:36:39.057504+0000","last_became_active":"2024-09-10T08:36:37.044540+0000","last_became_peered":"2024-09-10T08:36:37.044540+0000","last_unstale":"2024-09-10T08:36:39.057504+0000","last_undegraded":"2024-09-10T08:36:39.057504+0000","last_fullsized":"2024-09-10T08:36:39.057504+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:36:36.012709+0000","last_clean_scrub_stamp":"2024-09-10T08:36:36.012709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:46.118779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":354,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-10T08:36:39.058474+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:36:39.058474+0000","last_peered":"2024-09-10T08:36:39.058474+0000","last_clean":"2024-09-10T08:36:39.058474+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:36:39.058474+0000","last_undegraded":"2024-09-10T08:36:39.058474+0000","last_fullsized":"2024-09-10T08:36:39.058474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":667302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50720,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321120,"statfs":{"total":96636764160,"available":96584826880,"internally_reserved":0,"allocated":1519616,"data_stored":665566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50748,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321092,"statfs":{"total":96636764160,"available":96584798208,"internally_reserved":0,"allocated":1548288,"data_stored":673568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1519616,"data_stored":665566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54908,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316932,"statfs":{"total":96636764160,"available":96580538368,"internally_reserved":0,"allocated":1544192,"data_stored":672504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2125824,"data_stored":1262234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343316,"statfs":{"total":96636764160,"available":96607555584,"internally_reserved":0,"allocated":1527808,"data_stored":666218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542243,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51292,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320548,"statfs":{"total":96636764160,"available":96584241152,"internally_reserved":0,"allocated":2101248,"data_stored":1249159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:36:42.692 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:36:42.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:36:42.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.892+0000 7fdc27e00640 1 Processor -- start 2024-09-10T08:36:42.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.892+0000 7fdc27e00640 1 -- start start 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc280b5fd0 0x7fdc280d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 0x7fdc280cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc280d3950 con 0x7fdc28067950 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdc280d3c30 con 0x7fdc280b5fd0 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdc280d3f10 con 0x7fdc280b63b0 2024-09-10T08:36:42.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc26a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc280b5fd0 0x7fdc280d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdc28067950 0x7fdc28067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37738/0 (socket says 172.21.15.52:37738) 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.893+0000 7fdc27400640 1 -- 172.21.15.52:0/2740119171 learned_addr learned my addr 172.21.15.52:0/2740119171 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26000640 1 --2- 172.21.15.52:0/2740119171 >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 0x7fdc280cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26a00640 1 -- 172.21.15.52:0/2740119171 >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 msgr2=0x7fdc280cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26a00640 1 --2- 172.21.15.52:0/2740119171 >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 0x7fdc280cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26a00640 1 -- 172.21.15.52:0/2740119171 >> v1:172.21.15.52:6789/0 conn(0x7fdc28067950 legacy=0x7fdc28067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26a00640 1 -- 172.21.15.52:0/2740119171 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc280d41f0 con 0x7fdc280b5fd0 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc25600640 1 -- 172.21.15.52:0/2740119171 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299016406 0 0) 0x7fdc280d3950 con 0x7fdc28067950 2024-09-10T08:36:42.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.894+0000 7fdc26000640 1 --2- 172.21.15.52:0/2740119171 >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 0x7fdc280cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:42.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.895+0000 7fdc26a00640 1 --2- 172.21.15.52:0/2740119171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc280d32c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fdc28161fa0 tx=0x7fdc1802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5733114856d0873 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.895+0000 7fdc25600640 1 -- 172.21.15.52:0/2740119171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18037070 con 0x7fdc280b5fd0 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.895+0000 7fdc25600640 1 -- 172.21.15.52:0/2740119171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc18032440 con 0x7fdc280b5fd0 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.895+0000 7fdc25600640 1 -- 172.21.15.52:0/2740119171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18032810 con 0x7fdc280b5fd0 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 -- 172.21.15.52:0/2740119171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 msgr2=0x7fdc280d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 --2- 172.21.15.52:0/2740119171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc280d32c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fdc28161fa0 tx=0x7fdc1802a250 comp rx=0 tx=0).stop 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 -- 172.21.15.52:0/2740119171 shutdown_connections 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 --2- 172.21.15.52:0/2740119171 >> v2:172.21.15.176:3300/0 conn(0x7fdc280b63b0 0x7fdc280cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 --2- 172.21.15.52:0/2740119171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc280d32c0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 -- 172.21.15.52:0/2740119171 >> 172.21.15.52:0/2740119171 conn(0x7fdc280d0fd0 msgr2=0x7fdc280d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 -- 172.21.15.52:0/2740119171 shutdown_connections 2024-09-10T08:36:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.896+0000 7fdc27e00640 1 -- 172.21.15.52:0/2740119171 wait complete. 2024-09-10T08:36:42.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.898+0000 7fdc27e00640 1 Processor -- start 2024-09-10T08:36:42.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.898+0000 7fdc27e00640 1 -- start start 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc28067950 0x7fdc280cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc280b63b0 0x7fdc28160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc280cfd10 con 0x7fdc280b5fd0 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc280cfb90 con 0x7fdc28067950 2024-09-10T08:36:42.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc280b67d0 con 0x7fdc280b63b0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42196/0 (socket says 172.21.15.52:42196) 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 -- 172.21.15.52:0/3794614549 learned_addr learned my addr 172.21.15.52:0/3794614549 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc27400640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc280b63b0 0x7fdc28160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26a00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc28067950 0x7fdc280cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 -- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc280b63b0 msgr2=0x7fdc28160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc280b63b0 0x7fdc28160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 -- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc28067950 msgr2=0x7fdc280cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc28067950 0x7fdc280cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.899+0000 7fdc26000640 1 -- 172.21.15.52:0/3794614549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc280cd8c0 con 0x7fdc280b5fd0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc26000640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e7e0 tx=0x7fdc1400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400f040 con 0x7fdc280b5fd0 2024-09-10T08:36:42.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14004030 con 0x7fdc280b5fd0 2024-09-10T08:36:42.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc281f7760 con 0x7fdc280b5fd0 2024-09-10T08:36:42.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004400 con 0x7fdc280b5fd0 2024-09-10T08:36:42.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.900+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281f7d20 con 0x7fdc280b5fd0 2024-09-10T08:36:42.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.901+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2815f970 con 0x7fdc280b5fd0 2024-09-10T08:36:42.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.902+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc1400c6d0 con 0x7fdc280b5fd0 2024-09-10T08:36:42.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.903+0000 7fdc1ea00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 0x7fdc0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:42.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.903+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fdc1408aca0 con 0x7fdc280b5fd0 2024-09-10T08:36:42.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.903+0000 7fdc26a00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 0x7fdc0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:42.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.904+0000 7fdc26a00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 0x7fdc0806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdc18034000 tx=0x7fdc1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:42.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:42.907+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc14017020 con 0x7fdc280b5fd0 2024-09-10T08:36:43.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.160+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdc280b94b0 con 0x7fdc280b5fd0 2024-09-10T08:36:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.163+0000 7fdc1ea00640 1 -- 172.21.15.52:0/3794614549 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7fdc14059640 con 0x7fdc280b5fd0 2024-09-10T08:36:43.163 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:36:43.163 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:36:43.163 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:36:43.163 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:36:43.164 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:36:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:36:43.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 msgr2=0x7fdc0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 0x7fdc0806e2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdc18034000 tx=0x7fdc1802e000 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 msgr2=0x7fdc281f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e7e0 tx=0x7fdc1400eca0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 shutdown_connections 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc0806be30 0x7fdc0806e2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc280b63b0 0x7fdc28160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc280b5fd0 0x7fdc281f4980 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 --2- 172.21.15.52:0/3794614549 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc28067950 0x7fdc280cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 >> 172.21.15.52:0/3794614549 conn(0x7fdc280d0fd0 msgr2=0x7fdc280b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 shutdown_connections 2024-09-10T08:36:43.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.165+0000 7fdc27e00640 1 -- 172.21.15.52:0/3794614549 wait complete. 2024-09-10T08:36:43.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:36:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.337+0000 7f4b0dc00640 1 Processor -- start 2024-09-10T08:36:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.338+0000 7f4b0dc00640 1 -- start start 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 0x7f4b080d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b0dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b080d1630 0x7f4b080b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b0dc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080d3d90 con 0x7f4b080cfba0 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b0dc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4b080d4070 con 0x7f4b080d1630 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b080d4350 con 0x7f4b0815e990 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b080d1630 0x7f4b080b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:43.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4b080d1630 0x7f4b080b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42212/0 (socket says 172.21.15.52:42212) 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 -- 172.21.15.52:0/1503530860 learned_addr learned my addr 172.21.15.52:0/1503530860 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4affe00640 1 --1- 172.21.15.52:0/1503530860 >> v1:172.21.15.52:6789/0 conn(0x7f4b080cfba0 0x7f4b080d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37748/0 (socket says 172.21.15.52:37748) 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b06a00640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 0x7f4b080d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 -- 172.21.15.52:0/1503530860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 msgr2=0x7f4b080d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 0x7f4b080d3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b07400640 1 -- 172.21.15.52:0/1503530860 >> v1:172.21.15.52:6789/0 conn(0x7f4b080cfba0 legacy=0x7f4b080d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.340+0000 7f4b07400640 1 -- 172.21.15.52:0/1503530860 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080b7c90 con 0x7f4b080d1630 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.339+0000 7f4b06000640 1 -- 172.21.15.52:0/1503530860 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243169686 0 0) 0x7f4b080d3d90 con 0x7f4b080cfba0 2024-09-10T08:36:43.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.340+0000 7f4b06a00640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 0x7f4b080d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.340+0000 7f4b07400640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b080d1630 0x7f4b080b81b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009e50 tx=0x7f4b0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaf45ad9b55b191 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b06000640 1 -- 172.21.15.52:0/1503530860 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00036070 con 0x7f4b080d1630 2024-09-10T08:36:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b06000640 1 -- 172.21.15.52:0/1503530860 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00031600 con 0x7f4b080d1630 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b06000640 1 -- 172.21.15.52:0/1503530860 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000319d0 con 0x7f4b080d1630 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 -- 172.21.15.52:0/1503530860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b080d1630 msgr2=0x7f4b080b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b080d1630 0x7f4b080b81b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009e50 tx=0x7f4b0002a710 comp rx=0 tx=0).stop 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 -- 172.21.15.52:0/1503530860 shutdown_connections 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b080d1630 0x7f4b080b81b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/1503530860 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0815e990 0x7f4b080d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 -- 172.21.15.52:0/1503530860 >> 172.21.15.52:0/1503530860 conn(0x7f4b0806c020 msgr2=0x7f4b0806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 -- 172.21.15.52:0/1503530860 shutdown_connections 2024-09-10T08:36:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.341+0000 7f4b0dc00640 1 -- 172.21.15.52:0/1503530860 wait complete. 2024-09-10T08:36:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.343+0000 7f4b0dc00640 1 Processor -- start 2024-09-10T08:36:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.343+0000 7f4b0dc00640 1 -- start start 2024-09-10T08:36:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 0x7f4b080cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080d1630 0x7f4b080cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080b7a30 con 0x7f4b0815e990 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080b78b0 con 0x7f4b080cfba0 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b0dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b080b86f0 con 0x7f4b080d1630 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b07400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b07400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42218/0 (socket says 172.21.15.52:42218) 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.344+0000 7f4b07400640 1 -- 172.21.15.52:0/2935273991 learned_addr learned my addr 172.21.15.52:0/2935273991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b06a00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 0x7f4b080cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 -- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080d1630 msgr2=0x7f4b080cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080d1630 0x7f4b080cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 -- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 msgr2=0x7f4b080cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 0x7f4b080cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 -- 172.21.15.52:0/2935273991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080cc420 con 0x7f4b0815e990 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b06a00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 0x7f4b080cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b07400640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f4b00034040 tx=0x7f4b00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0003f020 con 0x7f4b0815e990 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00037040 con 0x7f4b0815e990 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00036070 con 0x7f4b0815e990 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b080cc700 con 0x7f4b0815e990 2024-09-10T08:36:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.345+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b080cccc0 con 0x7f4b0815e990 2024-09-10T08:36:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.346+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b080b81b0 con 0x7f4b0815e990 2024-09-10T08:36:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.347+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b00042020 con 0x7f4b0815e990 2024-09-10T08:36:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.349+0000 7f4afea00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 0x7f4ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.349+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f4b000ab390 con 0x7f4b0815e990 2024-09-10T08:36:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.349+0000 7f4b06a00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 0x7f4ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.350+0000 7f4b06a00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 0x7f4ae406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4af8006fd0 tx=0x7f4af8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.353+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b00049030 con 0x7f4b0815e990 2024-09-10T08:36:43.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.575+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b080d11f0 con 0x7f4b0815e990 2024-09-10T08:36:43.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.576+0000 7f4afea00640 1 -- 172.21.15.52:0/2935273991 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7f4b00079d40 con 0x7f4b0815e990 2024-09-10T08:36:43.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:36:43.577 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:36:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.578+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 msgr2=0x7f4ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.578+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 0x7f4ae406e2f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4af8006fd0 tx=0x7f4af8008040 comp rx=0 tx=0).stop 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.578+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 msgr2=0x7f4b08150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.578+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f4b00034040 tx=0x7f4b00004a40 comp rx=0 tx=0).stop 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 shutdown_connections 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae406be30 0x7f4ae406e2f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b0815e990 0x7f4b08150ce0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080d1630 0x7f4b080cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 --2- 172.21.15.52:0/2935273991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b080cfba0 0x7f4b080cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 >> 172.21.15.52:0/2935273991 conn(0x7f4b0806c020 msgr2=0x7f4b0806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 shutdown_connections 2024-09-10T08:36:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:43.579+0000 7f4b0dc00640 1 -- 172.21.15.52:0/2935273991 wait complete. 2024-09-10T08:36:43.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:36:37.504410+0000', 'modified': '2024-09-10T08:36:40.492151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7450}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7450': {'gid': 7450, 'name': 'c', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/3294209549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 3294209549}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 3294209549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7450, 'qdb_cluster': [7450]} 2024-09-10T08:36:43.997 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:36:43.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:36:44.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.160+0000 7fa552800640 1 Processor -- start 2024-09-10T08:36:44.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.161+0000 7fa552800640 1 -- start start 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa552800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c06c320 0x7fa54c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa552800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa54c13eb20 0x7fa54c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa552800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c071180 con 0x7fa54c0b2d40 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa552800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa54c071ab0 con 0x7fa54c13eb20 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa552800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c071460 con 0x7fa54c06c320 2024-09-10T08:36:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa54b400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa54c0b2d40 0x7fa54c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38918/0 (socket says 172.21.15.52:38918) 2024-09-10T08:36:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa54b400640 1 -- 172.21.15.52:0/1757084322 learned_addr learned my addr 172.21.15.52:0/1757084322 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:36:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa54be00640 1 --2- 172.21.15.52:0/1757084322 >> v2:172.21.15.176:3300/0 conn(0x7fa54c13eb20 0x7fa54c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa543e00640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c06c320 0x7fa54c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.162+0000 7fa54aa00640 1 -- 172.21.15.52:0/1757084322 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292667442 0 0) 0x7fa54c071180 con 0x7fa54c0b2d40 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.163+0000 7fa54aa00640 1 -- 172.21.15.52:0/1757084322 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa530003520 con 0x7fa54c0b2d40 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.163+0000 7fa54be00640 1 -- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c06c320 msgr2=0x7fa54c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.163+0000 7fa54be00640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c06c320 0x7fa54c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.163+0000 7fa54be00640 1 -- 172.21.15.52:0/1757084322 >> v1:172.21.15.52:6789/0 conn(0x7fa54c0b2d40 legacy=0x7fa54c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.163+0000 7fa54be00640 1 -- 172.21.15.52:0/1757084322 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c071740 con 0x7fa54c13eb20 2024-09-10T08:36:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.164+0000 7fa54be00640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c13eb20 0x7fa54c15c230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa544009d90 tx=0x7fa54402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6a0ea0dc26f91d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.167+0000 7fa54aa00640 1 -- 172.21.15.52:0/1757084322 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544007740 con 0x7fa54c13eb20 2024-09-10T08:36:44.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.167+0000 7fa54aa00640 1 -- 172.21.15.52:0/1757084322 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5440078e0 con 0x7fa54c13eb20 2024-09-10T08:36:44.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.167+0000 7fa54aa00640 1 -- 172.21.15.52:0/1757084322 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544007cb0 con 0x7fa54c13eb20 2024-09-10T08:36:44.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 -- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c13eb20 msgr2=0x7fa54c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c13eb20 0x7fa54c15c230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa544009d90 tx=0x7fa54402a660 comp rx=0 tx=0).stop 2024-09-10T08:36:44.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 -- 172.21.15.52:0/1757084322 shutdown_connections 2024-09-10T08:36:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c13eb20 0x7fa54c15c230 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 --2- 172.21.15.52:0/1757084322 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c06c320 0x7fa54c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 -- 172.21.15.52:0/1757084322 >> 172.21.15.52:0/1757084322 conn(0x7fa54c0ccec0 msgr2=0x7fa54c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 -- 172.21.15.52:0/1757084322 shutdown_connections 2024-09-10T08:36:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.168+0000 7fa552800640 1 -- 172.21.15.52:0/1757084322 wait complete. 2024-09-10T08:36:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.170+0000 7fa552800640 1 Processor -- start 2024-09-10T08:36:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.170+0000 7fa552800640 1 -- start start 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 0x7fa54c135a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c13eb20 0x7fa54c1373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c0720c0 con 0x7fa54c06c320 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c071f40 con 0x7fa54c0b2d40 2024-09-10T08:36:44.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa552800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c072240 con 0x7fa54c13eb20 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54170/0 (socket says 172.21.15.52:54170) 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 -- 172.21.15.52:0/143108128 learned_addr learned my addr 172.21.15.52:0/143108128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa543e00640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 0x7fa54c135a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54be00640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c13eb20 0x7fa54c1373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 -- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c13eb20 msgr2=0x7fa54c1373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c13eb20 0x7fa54c1373b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 -- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 msgr2=0x7fa54c135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 0x7fa54c135a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa54b400640 1 -- 172.21.15.52:0/143108128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c153990 con 0x7fa54c06c320 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.171+0000 7fa543e00640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 0x7fa54c135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa54b400640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c460 tx=0x7fa53c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa543400640 1 -- 172.21.15.52:0/143108128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c017070 con 0x7fa54c06c320 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa543400640 1 -- 172.21.15.52:0/143108128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c005ce0 con 0x7fa54c06c320 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa543400640 1 -- 172.21.15.52:0/143108128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0072f0 con 0x7fa54c06c320 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c153c70 con 0x7fa54c06c320 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.172+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54c154230 con 0x7fa54c06c320 2024-09-10T08:36:44.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.174+0000 7fa543400640 1 -- 172.21.15.52:0/143108128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa53c01a070 con 0x7fa54c06c320 2024-09-10T08:36:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.175+0000 7fa543400640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 0x7fa52806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.175+0000 7fa543400640 1 -- 172.21.15.52:0/143108128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa53c08a2f0 con 0x7fa54c06c320 2024-09-10T08:36:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.175+0000 7fa543e00640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 0x7fa52806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.176+0000 7fa555690740 1 Processor -- start 2024-09-10T08:36:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.176+0000 7fa555690740 1 -- start start 2024-09-10T08:36:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.176+0000 7fa543e00640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 0x7fa52806e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b6730 tx=0x7fa534008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb682cf0 0x5637fb6c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb67d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5637fb5e13b0 con 0x5637fb6804b0 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5637fb5e6410 con 0x5637fb682cf0 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5637fb58e620 con 0x5637fb684480 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54172/0 (socket says 172.21.15.52:54172) 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa543e00640 1 -- 172.21.15.52:0/3206591567 learned_addr learned my addr 172.21.15.52:0/3206591567 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa54b400640 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb682cf0 0x5637fb6c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.177+0000 7fa54be00640 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb67d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 -- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 msgr2=0x5637fb67d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb67d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 -- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb682cf0 msgr2=0x5637fb6c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb682cf0 0x5637fb6c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 -- 172.21.15.52:0/3206591567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fb2f92d0 con 0x5637fb6804b0 2024-09-10T08:36:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa543e00640 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa534011e60 tx=0x7fa534014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c175b97fa9f73449 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa53be00640 1 -- 172.21.15.52:0/3206591567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534015e50 con 0x5637fb6804b0 2024-09-10T08:36:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa53be00640 1 -- 172.21.15.52:0/3206591567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa534026070 con 0x5637fb6804b0 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.178+0000 7fa53be00640 1 -- 172.21.15.52:0/3206591567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534021640 con 0x5637fb6804b0 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 -- 172.21.15.52:0/3206591567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 msgr2=0x5637fb6830d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa534011e60 tx=0x7fa534014000 comp rx=0 tx=0).stop 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 -- 172.21.15.52:0/3206591567 shutdown_connections 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb67d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb6804b0 0x5637fb6830d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 --2- 172.21.15.52:0/3206591567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb682cf0 0x5637fb6c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 -- 172.21.15.52:0/3206591567 >> 172.21.15.52:0/3206591567 conn(0x5637fb67f740 msgr2=0x5637fb6c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 -- 172.21.15.52:0/3206591567 shutdown_connections 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.179+0000 7fa555690740 1 -- 172.21.15.52:0/3206591567 wait complete. 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.180+0000 7fa555690740 1 -- start start 2024-09-10T08:36:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.180+0000 7fa555690740 1 Processor -- start 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb6a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb681150 0x5637fb6815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5637fb5a1780 con 0x5637fb682cf0 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5637fb5e23d0 con 0x5637fb681150 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5637fb67ebe0 con 0x5637fb684480 2024-09-10T08:36:44.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa555690740 10 client.0 _ll_register_callbacks cb 0x5637fb5df5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54178/0 (socket says 172.21.15.52:54178) 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa54b400640 1 -- 172.21.15.52:0/290925899 learned_addr learned my addr 172.21.15.52:0/290925899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa54be00640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb681150 0x5637fb6815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.181+0000 7fa543e00640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb6a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 -- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 msgr2=0x5637fb6a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb6a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 -- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb681150 msgr2=0x5637fb6815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb681150 0x5637fb6815d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 -- 172.21.15.52:0/290925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fb3c36b0 con 0x5637fb682cf0 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa543e00640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb6a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa54b400640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0549f0 tx=0x7fa53c058590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e3c8091b36be61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa538c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c070060 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa53c088ba0 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa534026070 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fa53c088050 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa555690740 10 client.8061 fetch_fsmap learned FSMap version 93 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.182+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5637fb6abe20 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa534026070 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fa53c007490 con 0x5637fb682cf0 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 10 client.8061 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 10 client.8061 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 20 client.8061 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6a2520 0x5637fb6a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 4 client.8061 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:36:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637fb5f3b40 con 0x5637fb6a2520 2024-09-10T08:36:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.183+0000 7fa543e00640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6a2520 0x5637fb6a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.184+0000 7fa543e00640 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6a2520 0x5637fb6a2900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3554ae00bf85894b server_cookie=d0df04beffe882f3 in_seq=0 out_seq=0 2024-09-10T08:36:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.184+0000 7fa538c00640 10 client.8061 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.184+0000 7fa538c00640 1 -- 172.21.15.52:0/290925899 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637fb5f3b40 con 0x5637fb6a2520 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.184+0000 7fa538c00640 10 client.8061 handle_command_reply: tid=0 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 client.8061 shutdown 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 msgr2=0x5637fb6a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0549f0 tx=0x7fa53c058590 comp rx=0 tx=0).stop 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 shutdown_connections 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6a2520 0x5637fb6a2900 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb681150 0x5637fb6815d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb684480 0x5637fb6a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 --2- 172.21.15.52:0/290925899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6a1850 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa538c00640 0 client.8061 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:36:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 >> 172.21.15.52:0/290925899 conn(0x5637fb6804b0 msgr2=0x5637fb6c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 shutdown_connections 2024-09-10T08:36:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 1 -- 172.21.15.52:0/290925899 wait complete. 2024-09-10T08:36:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.185+0000 7fa555690740 20 client.8061 trim_cache size 0 max 16384 2024-09-10T08:36:44.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.204+0000 7fa555690740 1 Processor -- start 2024-09-10T08:36:44.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.204+0000 7fa555690740 1 -- start start 2024-09-10T08:36:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb682cf0 0x5637fb6c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c200aa0 con 0x5637fb681150 2024-09-10T08:36:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c1ffae0 con 0x5637fb684480 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c1fee70 con 0x5637fb682cf0 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54180/0 (socket says 172.21.15.52:54180) 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 -- 172.21.15.52:0/820250124 learned_addr learned my addr 172.21.15.52:0/820250124 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 -- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb682cf0 msgr2=0x5637fb6c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb682cf0 0x5637fb6c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 -- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 msgr2=0x5637fb6c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.205+0000 7fa54b400640 1 -- 172.21.15.52:0/820250124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637fb6ac990 con 0x5637fb681150 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa54b400640 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0584d0 tx=0x7fa53c06d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a609df2b0c103aef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa53b400640 1 -- 172.21.15.52:0/820250124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c083020 con 0x5637fb681150 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa53b400640 1 -- 172.21.15.52:0/820250124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c08a0d0 con 0x5637fb681150 2024-09-10T08:36:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa53b400640 1 -- 172.21.15.52:0/820250124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c007490 con 0x5637fb681150 2024-09-10T08:36:44.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 -- 172.21.15.52:0/820250124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 msgr2=0x5637fb6a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0584d0 tx=0x7fa53c06d000 comp rx=0 tx=0).stop 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 -- 172.21.15.52:0/820250124 shutdown_connections 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb682cf0 0x5637fb6c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 --2- 172.21.15.52:0/820250124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb681150 0x5637fb6a17a0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.206+0000 7fa555690740 1 -- 172.21.15.52:0/820250124 >> 172.21.15.52:0/820250124 conn(0x5637fb6804b0 msgr2=0x5637fb682560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.207+0000 7fa555690740 1 -- 172.21.15.52:0/820250124 shutdown_connections 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.207+0000 7fa555690740 1 -- 172.21.15.52:0/820250124 wait complete. 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.207+0000 7fa555690740 1 -- start start 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.207+0000 7fa555690740 1 Processor -- start 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb681150 0x5637fb749ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6ebbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5637fb6ac3e0 con 0x5637fb682cf0 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c1ff490 con 0x5637fb684480 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5637fb67d310 con 0x5637fb681150 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.208+0000 7fa555690740 10 client.0 _ll_register_callbacks cb 0x7fa53c057fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54194/0 (socket says 172.21.15.52:54194) 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa54b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb681150 0x5637fb749ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 -- 172.21.15.52:0/3156652012 learned_addr learned my addr 172.21.15.52:0/3156652012 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa54be00640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6ebbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 -- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb681150 msgr2=0x5637fb749ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb681150 0x5637fb749ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 -- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 msgr2=0x5637fb6ebbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6ebbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 -- 172.21.15.52:0/3156652012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637fb6a8ef0 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa543e00640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fa534023040 tx=0x7fa534009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0f06bd60cc525b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.209+0000 7fa538c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534011a30 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa5340373c0 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53c08a0d0 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fa5340375e0 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 10 client.8067 fetch_fsmap learned FSMap version 93 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5637fb69ee10 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c08a0d0 con 0x5637fb682cf0 2024-09-10T08:36:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fa53404a020 con 0x5637fb682cf0 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 10 client.8067 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 10 client.8067 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 20 client.8067 populate_metadata read hostname 'smithi052' 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6eafa0 0x5637fb746f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 4 client.8067 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.210+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "status"}) -- 0x5637fb5ede90 con 0x5637fb6eafa0 2024-09-10T08:36:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa54b400640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6eafa0 0x5637fb746f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa54b400640 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6eafa0 0x5637fb746f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3396fc612d05c72 server_cookie=2a2db69d95aa1097 in_seq=0 out_seq=0 2024-09-10T08:36:44.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa538c00640 10 client.8067 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:36:44.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa538c00640 1 -- 172.21.15.52:0/3156652012 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5637fb5ede90 con 0x5637fb6eafa0 2024-09-10T08:36:44.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa538c00640 10 client.8067 handle_command_reply: tid=0 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa555690740 1 client.8067 shutdown 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 msgr2=0x5637fb6eb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.211+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fa534023040 tx=0x7fa534009190 comp rx=0 tx=0).stop 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 shutdown_connections 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5637fb6eafa0 0x5637fb746f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5637fb684480 0x5637fb6ebbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5637fb682cf0 0x5637fb6eb680 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 --2- 172.21.15.52:0/3156652012 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5637fb681150 0x5637fb749ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa538c00640 0 client.8067 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 >> 172.21.15.52:0/3156652012 conn(0x5637fb6804b0 msgr2=0x5637fb6c9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 shutdown_connections 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 1 -- 172.21.15.52:0/3156652012 wait complete. 2024-09-10T08:36:44.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa555690740 20 client.8067 trim_cache size 0 max 16384 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 7450, 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1526085220000004, 2024-09-10T08:36:44.217 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 93, 2024-09-10T08:36:44.218 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 124, 2024-09-10T08:36:44.218 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 124, 2024-09-10T08:36:44.218 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.854050622000001 2024-09-10T08:36:44.218 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 msgr2=0x7fa52806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 0x7fa52806e2f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b6730 tx=0x7fa534008040 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 msgr2=0x7fa54c15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c460 tx=0x7fa53c00c920 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 shutdown_connections 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa52806be30 0x7fa52806e2f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa54c13eb20 0x7fa54c1373b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa54c0b2d40 0x7fa54c135a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 --2- 172.21.15.52:0/143108128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c06c320 0x7fa54c15e4e0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.212+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 >> 172.21.15.52:0/143108128 conn(0x7fa54c0ccec0 msgr2=0x7fa54c156310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.213+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 shutdown_connections 2024-09-10T08:36:44.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.213+0000 7fa552800640 1 -- 172.21.15.52:0/143108128 wait complete. 2024-09-10T08:36:44.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:36:44.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.384+0000 7f4388800640 1 Processor -- start 2024-09-10T08:36:44.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.384+0000 7f4388800640 1 -- start start 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f438015eab0 0x7f438015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 0x7f43800d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 0x7f43800b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f43800b7040 con 0x7f438015eab0 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f438015f570 con 0x7f4380162490 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4388800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f438015f850 con 0x7f43800b66b0 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4385e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f438015eab0 0x7f438015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4385e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f438015eab0 0x7f438015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54196/0 (socket says 172.21.15.52:54196) 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.385+0000 7f4385e00640 1 -- 172.21.15.52:0/3397881770 learned_addr learned my addr 172.21.15.52:0/3397881770 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4386800640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 0x7f43800b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385400640 1 --2- 172.21.15.52:0/3397881770 >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 0x7f43800d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385e00640 1 -- 172.21.15.52:0/3397881770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 msgr2=0x7f43800b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385e00640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 0x7f43800b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385e00640 1 -- 172.21.15.52:0/3397881770 >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 msgr2=0x7f43800d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385e00640 1 --2- 172.21.15.52:0/3397881770 >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 0x7f43800d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385e00640 1 -- 172.21.15.52:0/3397881770 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438015fb30 con 0x7f438015eab0 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4386800640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 0x7f43800b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.386+0000 7f4385400640 1 --2- 172.21.15.52:0/3397881770 >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 0x7f43800d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.387+0000 7f4385e00640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f438015eab0 0x7f438015ee90 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4380068890 tx=0x7f437402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a5ea69c0edcaa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.387+0000 7f4384a00640 1 -- 172.21.15.52:0/3397881770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374037070 con 0x7f438015eab0 2024-09-10T08:36:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.387+0000 7f4384a00640 1 -- 172.21.15.52:0/3397881770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4374032440 con 0x7f438015eab0 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.387+0000 7f4384a00640 1 -- 172.21.15.52:0/3397881770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374032810 con 0x7f438015eab0 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 -- 172.21.15.52:0/3397881770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f438015eab0 msgr2=0x7f438015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f438015eab0 0x7f438015ee90 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4380068890 tx=0x7f437402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 -- 172.21.15.52:0/3397881770 shutdown_connections 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 --2- 172.21.15.52:0/3397881770 >> v2:172.21.15.176:3300/0 conn(0x7f4380162490 0x7f43800d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f43800b66b0 0x7f43800b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 --2- 172.21.15.52:0/3397881770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f438015eab0 0x7f438015ee90 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 -- 172.21.15.52:0/3397881770 >> 172.21.15.52:0/3397881770 conn(0x7f43800d16d0 msgr2=0x7f43800d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 -- 172.21.15.52:0/3397881770 shutdown_connections 2024-09-10T08:36:44.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.388+0000 7f4388800640 1 -- 172.21.15.52:0/3397881770 wait complete. 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.390+0000 7f4388800640 1 Processor -- start 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.390+0000 7f4388800640 1 -- start start 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.390+0000 7f4388800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b66b0 0x7f4380153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.390+0000 7f4388800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 0x7f43800ce170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4388800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4388800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43800d3170 con 0x7f4380162490 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4388800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f43800cef20 con 0x7f43800b66b0 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4388800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f43800d4460 con 0x7f438015eab0 2024-09-10T08:36:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54200/0 (socket says 172.21.15.52:54200) 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 -- 172.21.15.52:0/2866168736 learned_addr learned my addr 172.21.15.52:0/2866168736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4385e00640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b66b0 0x7f4380153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4385400640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 0x7f43800ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 -- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 msgr2=0x7f43800ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 0x7f43800ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 -- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b66b0 msgr2=0x7f4380153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b66b0 0x7f4380153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4386800640 1 -- 172.21.15.52:0/2866168736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43800cc560 con 0x7f4380162490 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.391+0000 7f4385400640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 0x7f43800ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f4386800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f437c007e10 tx=0x7f437c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c01a070 con 0x7f4380162490 2024-09-10T08:36:44.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f437c003b90 con 0x7f4380162490 2024-09-10T08:36:44.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43800cc840 con 0x7f4380162490 2024-09-10T08:36:44.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c00de20 con 0x7f4380162490 2024-09-10T08:36:44.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.392+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43800cce00 con 0x7f4380162490 2024-09-10T08:36:44.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.393+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43800b6b00 con 0x7f4380162490 2024-09-10T08:36:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.394+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f437c01d070 con 0x7f4380162490 2024-09-10T08:36:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.395+0000 7f437a000640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 0x7f436406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:36:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.395+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f437c08aff0 con 0x7f4380162490 2024-09-10T08:36:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.395+0000 7f4385e00640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 0x7f436406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:36:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.396+0000 7f4385e00640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 0x7f436406e320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4374034000 tx=0x7f437402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:36:44.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.399+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f437c010070 con 0x7f4380162490 2024-09-10T08:36:44.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.619+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43800d2500 con 0x7f4380162490 2024-09-10T08:36:44.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.620+0000 7f437a000640 1 -- 172.21.15.52:0/2866168736 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) ==== 53+0+73 (secure 0 0 0) 0x7f437c0592f0 con 0x7f4380162490 2024-09-10T08:36:44.620 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 msgr2=0x7f436406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 0x7f436406e320 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4374034000 tx=0x7f437402e000 comp rx=0 tx=0).stop 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 msgr2=0x7f43800b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f437c007e10 tx=0x7f437c00d4a0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 shutdown_connections 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f436406be60 0x7f436406e320 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4380162490 0x7f43800b4a40 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f438015eab0 0x7f43800ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 --2- 172.21.15.52:0/2866168736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f43800b66b0 0x7f4380153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:36:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.622+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 >> 172.21.15.52:0/2866168736 conn(0x7f43800d16d0 msgr2=0x7f43800b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:36:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.623+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 shutdown_connections 2024-09-10T08:36:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44.623+0000 7f4388800640 1 -- 172.21.15.52:0/2866168736 wait complete. 2024-09-10T08:36:44.639 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:36:44.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:36:44.640 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:36:44.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:44.640 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:36:44.677 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:36:44.678 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:36:44.679 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:36:44.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:44.680 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:36:44.774 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:36:44.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:44.777 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:36:44.813 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:36:44.814 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:44.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:36:45.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:45.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:45.011 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:36:45.047 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:36:45.047 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:36:45.047 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:36:45.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:45.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:36:45.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:36:45.144 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:36:45.179 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:36:45.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:36:45.180 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:36:45.255 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:36:45.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:45.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:36:45.383 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:36:45.383 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:36:45.413 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:36:45.413 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:36:45.414 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:36:45.414 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:36:45.414 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:36:45.415 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:36:45.415 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:36:45.415 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:36:45.415 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:36:45.415 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:36:45.418 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:36:45.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:36:45.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:36:45.475 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:36:45.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:45.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:45.571 INFO:teuthology.orchestra.run.smithi052.stdout:client6830 2024-09-10T08:36:45.571 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:36:45.571 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:45.608 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:45.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184408 s, 56.9 MB/s 2024-09-10T08:36:45.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.778 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146426 s, 71.6 MB/s 2024-09-10T08:36:45.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.798 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170967 s, 61.3 MB/s 2024-09-10T08:36:45.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164891 s, 63.6 MB/s 2024-09-10T08:36:45.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187406 s, 56.0 MB/s 2024-09-10T08:36:45.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.858 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155015 s, 67.6 MB/s 2024-09-10T08:36:45.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145353 s, 72.1 MB/s 2024-09-10T08:36:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.892 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138537 s, 75.7 MB/s 2024-09-10T08:36:45.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138914 s, 75.5 MB/s 2024-09-10T08:36:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176169 s, 59.5 MB/s 2024-09-10T08:36:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151799 s, 69.1 MB/s 2024-09-10T08:36:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165476 s, 63.4 MB/s 2024-09-10T08:36:45.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:45.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:45.983 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131932 s, 79.5 MB/s 2024-09-10T08:36:46.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178065 s, 58.9 MB/s 2024-09-10T08:36:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156834 s, 66.9 MB/s 2024-09-10T08:36:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187565 s, 55.9 MB/s 2024-09-10T08:36:46.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.061 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131799 s, 79.6 MB/s 2024-09-10T08:36:46.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.084 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199975 s, 52.4 MB/s 2024-09-10T08:36:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129425 s, 81.0 MB/s 2024-09-10T08:36:46.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138588 s, 75.7 MB/s 2024-09-10T08:36:46.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176257 s, 59.5 MB/s 2024-09-10T08:36:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137936 s, 76.0 MB/s 2024-09-10T08:36:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138671 s, 75.6 MB/s 2024-09-10T08:36:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131967 s, 79.5 MB/s 2024-09-10T08:36:46.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.210 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174571 s, 60.1 MB/s 2024-09-10T08:36:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.227 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142838 s, 73.4 MB/s 2024-09-10T08:36:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.244 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131122 s, 80.0 MB/s 2024-09-10T08:36:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137648 s, 76.2 MB/s 2024-09-10T08:36:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167633 s, 62.6 MB/s 2024-09-10T08:36:46.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.299 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141307 s, 74.2 MB/s 2024-09-10T08:36:46.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.317 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146223 s, 71.7 MB/s 2024-09-10T08:36:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171145 s, 61.3 MB/s 2024-09-10T08:36:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:46.346 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:46.346 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:46.347 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T08:36:46.347 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:46.347 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:46.347 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:46.347 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:46.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:46.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.451 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175316 s, 59.8 MB/s 2024-09-10T08:36:46.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.470 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157926 s, 66.4 MB/s 2024-09-10T08:36:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149462 s, 70.2 MB/s 2024-09-10T08:36:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143456 s, 73.1 MB/s 2024-09-10T08:36:46.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127668 s, 82.1 MB/s 2024-09-10T08:36:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132658 s, 79.0 MB/s 2024-09-10T08:36:46.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.558 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168765 s, 62.1 MB/s 2024-09-10T08:36:46.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.577 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159448 s, 65.8 MB/s 2024-09-10T08:36:46.597 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.597 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.597 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169616 s, 61.8 MB/s 2024-09-10T08:36:46.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.613 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013603 s, 77.1 MB/s 2024-09-10T08:36:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130974 s, 80.1 MB/s 2024-09-10T08:36:46.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.647 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142484 s, 73.6 MB/s 2024-09-10T08:36:46.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142685 s, 73.5 MB/s 2024-09-10T08:36:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.680 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133425 s, 78.6 MB/s 2024-09-10T08:36:46.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.701 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175328 s, 59.8 MB/s 2024-09-10T08:36:46.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118565 s, 88.4 MB/s 2024-09-10T08:36:46.732 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.732 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.733 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135858 s, 77.2 MB/s 2024-09-10T08:36:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156507 s, 67.0 MB/s 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138816 s, 75.5 MB/s 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143273 s, 73.2 MB/s 2024-09-10T08:36:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.801 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129119 s, 81.2 MB/s 2024-09-10T08:36:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138079 s, 75.9 MB/s 2024-09-10T08:36:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137521 s, 76.2 MB/s 2024-09-10T08:36:46.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167787 s, 62.5 MB/s 2024-09-10T08:36:46.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.870 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128732 s, 81.5 MB/s 2024-09-10T08:36:46.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.886 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012932 s, 81.1 MB/s 2024-09-10T08:36:46.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.902 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128001 s, 81.9 MB/s 2024-09-10T08:36:46.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173647 s, 60.4 MB/s 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123349 s, 85.0 MB/s 2024-09-10T08:36:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130313 s, 80.5 MB/s 2024-09-10T08:36:46.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131236 s, 79.9 MB/s 2024-09-10T08:36:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123606 s, 84.8 MB/s 2024-09-10T08:36:46.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:46.993 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:46.993 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:46.994 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T08:36:46.994 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:46.994 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:46.994 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:46.994 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:47.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:47.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.098 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177804 s, 59.0 MB/s 2024-09-10T08:36:47.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155046 s, 67.6 MB/s 2024-09-10T08:36:47.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013004 s, 80.6 MB/s 2024-09-10T08:36:47.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130327 s, 80.5 MB/s 2024-09-10T08:36:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161705 s, 64.8 MB/s 2024-09-10T08:36:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134399 s, 78.0 MB/s 2024-09-10T08:36:47.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145035 s, 72.3 MB/s 2024-09-10T08:36:47.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.218 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131387 s, 79.8 MB/s 2024-09-10T08:36:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168695 s, 62.2 MB/s 2024-09-10T08:36:47.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.256 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144884 s, 72.4 MB/s 2024-09-10T08:36:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134335 s, 78.1 MB/s 2024-09-10T08:36:47.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.288 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127156 s, 82.5 MB/s 2024-09-10T08:36:47.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.308 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168026 s, 62.4 MB/s 2024-09-10T08:36:47.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136832 s, 76.6 MB/s 2024-09-10T08:36:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140426 s, 74.7 MB/s 2024-09-10T08:36:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163554 s, 64.1 MB/s 2024-09-10T08:36:47.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.381 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159381 s, 65.8 MB/s 2024-09-10T08:36:47.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161423 s, 65.0 MB/s 2024-09-10T08:36:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184017 s, 57.0 MB/s 2024-09-10T08:36:47.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127166 s, 82.5 MB/s 2024-09-10T08:36:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.454 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139737 s, 75.0 MB/s 2024-09-10T08:36:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.470 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128505 s, 81.6 MB/s 2024-09-10T08:36:47.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122363 s, 85.7 MB/s 2024-09-10T08:36:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145099 s, 72.3 MB/s 2024-09-10T08:36:47.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.519 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136173 s, 77.0 MB/s 2024-09-10T08:36:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132549 s, 79.1 MB/s 2024-09-10T08:36:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127743 s, 82.1 MB/s 2024-09-10T08:36:47.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159374 s, 65.8 MB/s 2024-09-10T08:36:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013441 s, 78.0 MB/s 2024-09-10T08:36:47.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162871 s, 64.4 MB/s 2024-09-10T08:36:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124971 s, 83.9 MB/s 2024-09-10T08:36:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015682 s, 66.9 MB/s 2024-09-10T08:36:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:47.650 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:47.650 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:47.650 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T08:36:47.651 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:47.651 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:47.651 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:47.651 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:47.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178733 s, 58.7 MB/s 2024-09-10T08:36:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137035 s, 76.5 MB/s 2024-09-10T08:36:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128088 s, 81.9 MB/s 2024-09-10T08:36:47.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138651 s, 75.6 MB/s 2024-09-10T08:36:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122569 s, 85.6 MB/s 2024-09-10T08:36:47.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146678 s, 71.5 MB/s 2024-09-10T08:36:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133593 s, 78.5 MB/s 2024-09-10T08:36:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142954 s, 73.4 MB/s 2024-09-10T08:36:47.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129867 s, 80.7 MB/s 2024-09-10T08:36:47.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.903 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126405 s, 83.0 MB/s 2024-09-10T08:36:47.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130475 s, 80.4 MB/s 2024-09-10T08:36:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176876 s, 59.3 MB/s 2024-09-10T08:36:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132089 s, 79.4 MB/s 2024-09-10T08:36:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137966 s, 76.0 MB/s 2024-09-10T08:36:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015498 s, 67.7 MB/s 2024-09-10T08:36:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161617 s, 64.9 MB/s 2024-09-10T08:36:48.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.027 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137101 s, 76.5 MB/s 2024-09-10T08:36:48.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.044 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138866 s, 75.5 MB/s 2024-09-10T08:36:48.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.060 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128632 s, 81.5 MB/s 2024-09-10T08:36:48.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.077 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132799 s, 79.0 MB/s 2024-09-10T08:36:48.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.093 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012778 s, 82.1 MB/s 2024-09-10T08:36:48.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142597 s, 73.5 MB/s 2024-09-10T08:36:48.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.128 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136784 s, 76.7 MB/s 2024-09-10T08:36:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131848 s, 79.5 MB/s 2024-09-10T08:36:48.160 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.161 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.161 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134323 s, 78.1 MB/s 2024-09-10T08:36:48.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.177 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131215 s, 79.9 MB/s 2024-09-10T08:36:48.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.193 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128874 s, 81.4 MB/s 2024-09-10T08:36:48.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129392 s, 81.0 MB/s 2024-09-10T08:36:48.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.224 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130634 s, 80.3 MB/s 2024-09-10T08:36:48.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127494 s, 82.2 MB/s 2024-09-10T08:36:48.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.258 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142728 s, 73.5 MB/s 2024-09-10T08:36:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158284 s, 66.2 MB/s 2024-09-10T08:36:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:48.285 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:48.285 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:48.286 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T08:36:48.286 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:48.286 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:48.286 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:48.286 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:48.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135206 s, 77.6 MB/s 2024-09-10T08:36:48.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156856 s, 66.8 MB/s 2024-09-10T08:36:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139552 s, 75.1 MB/s 2024-09-10T08:36:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174972 s, 59.9 MB/s 2024-09-10T08:36:48.458 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.458 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.458 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124383 s, 84.3 MB/s 2024-09-10T08:36:48.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134961 s, 77.7 MB/s 2024-09-10T08:36:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.490 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125954 s, 83.3 MB/s 2024-09-10T08:36:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137982 s, 76.0 MB/s 2024-09-10T08:36:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146216 s, 71.7 MB/s 2024-09-10T08:36:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01336 s, 78.5 MB/s 2024-09-10T08:36:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125883 s, 83.3 MB/s 2024-09-10T08:36:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127929 s, 82.0 MB/s 2024-09-10T08:36:48.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.591 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155899 s, 67.3 MB/s 2024-09-10T08:36:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116759 s, 89.8 MB/s 2024-09-10T08:36:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136985 s, 76.5 MB/s 2024-09-10T08:36:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136729 s, 76.7 MB/s 2024-09-10T08:36:48.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135874 s, 77.2 MB/s 2024-09-10T08:36:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.672 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133041 s, 78.8 MB/s 2024-09-10T08:36:48.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.689 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135707 s, 77.3 MB/s 2024-09-10T08:36:48.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173553 s, 60.4 MB/s 2024-09-10T08:36:48.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136261 s, 77.0 MB/s 2024-09-10T08:36:48.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125323 s, 83.7 MB/s 2024-09-10T08:36:48.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131638 s, 79.7 MB/s 2024-09-10T08:36:48.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.775 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134305 s, 78.1 MB/s 2024-09-10T08:36:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156066 s, 67.2 MB/s 2024-09-10T08:36:48.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.813 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166536 s, 63.0 MB/s 2024-09-10T08:36:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138279 s, 75.8 MB/s 2024-09-10T08:36:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131553 s, 79.7 MB/s 2024-09-10T08:36:48.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173889 s, 60.3 MB/s 2024-09-10T08:36:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135563 s, 77.3 MB/s 2024-09-10T08:36:48.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.899 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134685 s, 77.9 MB/s 2024-09-10T08:36:48.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:48.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:48.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129297 s, 81.1 MB/s 2024-09-10T08:36:48.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:48.924 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:49.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:49.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148317 s, 70.7 MB/s 2024-09-10T08:36:49.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.040 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133156 s, 78.7 MB/s 2024-09-10T08:36:49.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127889 s, 82.0 MB/s 2024-09-10T08:36:49.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.074 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153983 s, 68.1 MB/s 2024-09-10T08:36:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.091 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130189 s, 80.5 MB/s 2024-09-10T08:36:49.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134076 s, 78.2 MB/s 2024-09-10T08:36:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126172 s, 83.1 MB/s 2024-09-10T08:36:49.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.139 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.139 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116939 s, 89.7 MB/s 2024-09-10T08:36:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168187 s, 62.3 MB/s 2024-09-10T08:36:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145491 s, 72.1 MB/s 2024-09-10T08:36:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136184 s, 77.0 MB/s 2024-09-10T08:36:49.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126495 s, 82.9 MB/s 2024-09-10T08:36:49.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132096 s, 79.4 MB/s 2024-09-10T08:36:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131897 s, 79.5 MB/s 2024-09-10T08:36:49.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.260 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156747 s, 66.9 MB/s 2024-09-10T08:36:49.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.276 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013067 s, 80.2 MB/s 2024-09-10T08:36:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.292 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128714 s, 81.5 MB/s 2024-09-10T08:36:49.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.308 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129999 s, 80.7 MB/s 2024-09-10T08:36:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134156 s, 78.2 MB/s 2024-09-10T08:36:49.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.344 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016212 s, 64.7 MB/s 2024-09-10T08:36:49.360 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.361 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130842 s, 80.1 MB/s 2024-09-10T08:36:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127467 s, 82.3 MB/s 2024-09-10T08:36:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129054 s, 81.3 MB/s 2024-09-10T08:36:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139088 s, 75.4 MB/s 2024-09-10T08:36:49.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132639 s, 79.1 MB/s 2024-09-10T08:36:49.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138959 s, 75.5 MB/s 2024-09-10T08:36:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160957 s, 65.1 MB/s 2024-09-10T08:36:49.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140043 s, 74.9 MB/s 2024-09-10T08:36:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169476 s, 61.9 MB/s 2024-09-10T08:36:49.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133303 s, 78.7 MB/s 2024-09-10T08:36:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140236 s, 74.8 MB/s 2024-09-10T08:36:49.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161922 s, 64.8 MB/s 2024-09-10T08:36:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:49.560 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:49.560 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:49.561 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T08:36:49.561 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:49.561 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:49.561 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:49.561 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:49.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.660 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127554 s, 82.2 MB/s 2024-09-10T08:36:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161083 s, 65.1 MB/s 2024-09-10T08:36:49.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.695 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.695 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128941 s, 81.3 MB/s 2024-09-10T08:36:49.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140081 s, 74.9 MB/s 2024-09-10T08:36:49.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.729 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.729 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139019 s, 75.4 MB/s 2024-09-10T08:36:49.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.748 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160038 s, 65.5 MB/s 2024-09-10T08:36:49.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.764 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129857 s, 80.7 MB/s 2024-09-10T08:36:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155798 s, 67.3 MB/s 2024-09-10T08:36:49.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.799 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.799 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129558 s, 80.9 MB/s 2024-09-10T08:36:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144986 s, 72.3 MB/s 2024-09-10T08:36:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.833 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139265 s, 75.3 MB/s 2024-09-10T08:36:49.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.849 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129913 s, 80.7 MB/s 2024-09-10T08:36:49.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131011 s, 80.0 MB/s 2024-09-10T08:36:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.885 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165428 s, 63.4 MB/s 2024-09-10T08:36:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129804 s, 80.8 MB/s 2024-09-10T08:36:49.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131004 s, 80.0 MB/s 2024-09-10T08:36:49.932 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126814 s, 82.7 MB/s 2024-09-10T08:36:49.948 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.948 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.948 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123562 s, 84.9 MB/s 2024-09-10T08:36:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128641 s, 81.5 MB/s 2024-09-10T08:36:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.980 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126604 s, 82.8 MB/s 2024-09-10T08:36:49.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:49.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:49.999 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165338 s, 63.4 MB/s 2024-09-10T08:36:50.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178404 s, 58.8 MB/s 2024-09-10T08:36:50.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130401 s, 80.4 MB/s 2024-09-10T08:36:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.055 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157754 s, 66.5 MB/s 2024-09-10T08:36:50.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167089 s, 62.8 MB/s 2024-09-10T08:36:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114505 s, 91.6 MB/s 2024-09-10T08:36:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012673 s, 82.7 MB/s 2024-09-10T08:36:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130404 s, 80.4 MB/s 2024-09-10T08:36:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013706 s, 76.5 MB/s 2024-09-10T08:36:50.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.157 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.157 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155597 s, 67.4 MB/s 2024-09-10T08:36:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163483 s, 64.1 MB/s 2024-09-10T08:36:50.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128347 s, 81.7 MB/s 2024-09-10T08:36:50.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:50.201 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:50.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.304 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177791 s, 59.0 MB/s 2024-09-10T08:36:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150298 s, 69.8 MB/s 2024-09-10T08:36:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132575 s, 79.1 MB/s 2024-09-10T08:36:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149883 s, 70.0 MB/s 2024-09-10T08:36:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135498 s, 77.4 MB/s 2024-09-10T08:36:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133612 s, 78.5 MB/s 2024-09-10T08:36:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127811 s, 82.0 MB/s 2024-09-10T08:36:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139827 s, 75.0 MB/s 2024-09-10T08:36:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131761 s, 79.6 MB/s 2024-09-10T08:36:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129794 s, 80.8 MB/s 2024-09-10T08:36:50.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.472 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137235 s, 76.4 MB/s 2024-09-10T08:36:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133116 s, 78.8 MB/s 2024-09-10T08:36:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012811 s, 81.8 MB/s 2024-09-10T08:36:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138045 s, 76.0 MB/s 2024-09-10T08:36:50.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130113 s, 80.6 MB/s 2024-09-10T08:36:50.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.558 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169364 s, 61.9 MB/s 2024-09-10T08:36:50.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012898 s, 81.3 MB/s 2024-09-10T08:36:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160769 s, 65.2 MB/s 2024-09-10T08:36:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161493 s, 64.9 MB/s 2024-09-10T08:36:50.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013371 s, 78.4 MB/s 2024-09-10T08:36:50.645 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.645 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.645 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01331 s, 78.8 MB/s 2024-09-10T08:36:50.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132526 s, 79.1 MB/s 2024-09-10T08:36:50.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.678 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131274 s, 79.9 MB/s 2024-09-10T08:36:50.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168684 s, 62.2 MB/s 2024-09-10T08:36:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.714 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013174 s, 79.6 MB/s 2024-09-10T08:36:50.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011553 s, 90.8 MB/s 2024-09-10T08:36:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133281 s, 78.7 MB/s 2024-09-10T08:36:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133191 s, 78.7 MB/s 2024-09-10T08:36:50.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.778 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132782 s, 79.0 MB/s 2024-09-10T08:36:50.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137182 s, 76.4 MB/s 2024-09-10T08:36:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163203 s, 64.2 MB/s 2024-09-10T08:36:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.830 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133256 s, 78.7 MB/s 2024-09-10T08:36:50.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:50.839 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:50.840 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:50.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:50.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.939 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136655 s, 76.7 MB/s 2024-09-10T08:36:50.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131959 s, 79.5 MB/s 2024-09-10T08:36:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125658 s, 83.4 MB/s 2024-09-10T08:36:50.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:50.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:50.988 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140162 s, 74.8 MB/s 2024-09-10T08:36:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164376 s, 63.8 MB/s 2024-09-10T08:36:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172564 s, 60.8 MB/s 2024-09-10T08:36:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117677 s, 89.1 MB/s 2024-09-10T08:36:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168052 s, 62.4 MB/s 2024-09-10T08:36:51.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138782 s, 75.6 MB/s 2024-09-10T08:36:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132402 s, 79.2 MB/s 2024-09-10T08:36:51.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128693 s, 81.5 MB/s 2024-09-10T08:36:51.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.131 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157863 s, 66.4 MB/s 2024-09-10T08:36:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.147 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129668 s, 80.9 MB/s 2024-09-10T08:36:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134666 s, 77.9 MB/s 2024-09-10T08:36:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126118 s, 83.1 MB/s 2024-09-10T08:36:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.195 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131705 s, 79.6 MB/s 2024-09-10T08:36:51.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.212 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134041 s, 78.2 MB/s 2024-09-10T08:36:51.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.227 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01251 s, 83.8 MB/s 2024-09-10T08:36:51.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.244 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133291 s, 78.7 MB/s 2024-09-10T08:36:51.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2024-09-10T08:36:51.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.278 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129646 s, 80.9 MB/s 2024-09-10T08:36:51.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165965 s, 63.2 MB/s 2024-09-10T08:36:51.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157969 s, 66.4 MB/s 2024-09-10T08:36:51.332 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.332 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.332 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128953 s, 81.3 MB/s 2024-09-10T08:36:51.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.348 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128173 s, 81.8 MB/s 2024-09-10T08:36:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140012 s, 74.9 MB/s 2024-09-10T08:36:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.381 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131212 s, 79.9 MB/s 2024-09-10T08:36:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127431 s, 82.3 MB/s 2024-09-10T08:36:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127423 s, 82.3 MB/s 2024-09-10T08:36:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129412 s, 81.0 MB/s 2024-09-10T08:36:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135856 s, 77.2 MB/s 2024-09-10T08:36:51.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132033 s, 79.4 MB/s 2024-09-10T08:36:51.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:51.470 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:51.471 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:51.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125405 s, 83.6 MB/s 2024-09-10T08:36:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135728 s, 77.3 MB/s 2024-09-10T08:36:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139142 s, 75.4 MB/s 2024-09-10T08:36:51.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.623 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168694 s, 62.2 MB/s 2024-09-10T08:36:51.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013906 s, 75.4 MB/s 2024-09-10T08:36:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132604 s, 79.1 MB/s 2024-09-10T08:36:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129163 s, 81.2 MB/s 2024-09-10T08:36:51.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.689 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129454 s, 81.0 MB/s 2024-09-10T08:36:51.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.706 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135562 s, 77.4 MB/s 2024-09-10T08:36:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142678 s, 73.5 MB/s 2024-09-10T08:36:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.741 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144405 s, 72.6 MB/s 2024-09-10T08:36:51.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119847 s, 87.5 MB/s 2024-09-10T08:36:51.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126642 s, 82.8 MB/s 2024-09-10T08:36:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139496 s, 75.2 MB/s 2024-09-10T08:36:51.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130456 s, 80.4 MB/s 2024-09-10T08:36:51.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.824 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162542 s, 64.5 MB/s 2024-09-10T08:36:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.840 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129535 s, 80.9 MB/s 2024-09-10T08:36:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.856 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129504 s, 81.0 MB/s 2024-09-10T08:36:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012246 s, 85.6 MB/s 2024-09-10T08:36:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.888 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132382 s, 79.2 MB/s 2024-09-10T08:36:51.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136156 s, 77.0 MB/s 2024-09-10T08:36:51.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165316 s, 63.4 MB/s 2024-09-10T08:36:51.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137049 s, 76.5 MB/s 2024-09-10T08:36:51.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112711 s, 93.0 MB/s 2024-09-10T08:36:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127576 s, 82.2 MB/s 2024-09-10T08:36:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:51.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161197 s, 65.0 MB/s 2024-09-10T08:36:52.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125712 s, 83.4 MB/s 2024-09-10T08:36:52.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012668 s, 82.8 MB/s 2024-09-10T08:36:52.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137946 s, 76.0 MB/s 2024-09-10T08:36:52.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124256 s, 84.4 MB/s 2024-09-10T08:36:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137547 s, 76.2 MB/s 2024-09-10T08:36:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012577 s, 83.4 MB/s 2024-09-10T08:36:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:52.096 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:52.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:52.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.195 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130134 s, 80.6 MB/s 2024-09-10T08:36:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.211 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136397 s, 76.9 MB/s 2024-09-10T08:36:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141988 s, 73.8 MB/s 2024-09-10T08:36:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.245 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130022 s, 80.6 MB/s 2024-09-10T08:36:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144792 s, 72.4 MB/s 2024-09-10T08:36:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.282 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167857 s, 62.5 MB/s 2024-09-10T08:36:52.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.299 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138666 s, 75.6 MB/s 2024-09-10T08:36:52.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137065 s, 76.5 MB/s 2024-09-10T08:36:52.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170215 s, 61.6 MB/s 2024-09-10T08:36:52.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167191 s, 62.7 MB/s 2024-09-10T08:36:52.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015745 s, 66.6 MB/s 2024-09-10T08:36:52.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124892 s, 84.0 MB/s 2024-09-10T08:36:52.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013675 s, 76.7 MB/s 2024-09-10T08:36:52.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.427 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157367 s, 66.6 MB/s 2024-09-10T08:36:52.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129129 s, 81.2 MB/s 2024-09-10T08:36:52.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141569 s, 74.1 MB/s 2024-09-10T08:36:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132513 s, 79.1 MB/s 2024-09-10T08:36:52.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129726 s, 80.8 MB/s 2024-09-10T08:36:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.510 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158988 s, 66.0 MB/s 2024-09-10T08:36:52.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163095 s, 64.3 MB/s 2024-09-10T08:36:52.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158797 s, 66.0 MB/s 2024-09-10T08:36:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133393 s, 78.6 MB/s 2024-09-10T08:36:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174863 s, 60.0 MB/s 2024-09-10T08:36:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130779 s, 80.2 MB/s 2024-09-10T08:36:52.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127559 s, 82.2 MB/s 2024-09-10T08:36:52.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139772 s, 75.0 MB/s 2024-09-10T08:36:52.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.655 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160669 s, 65.3 MB/s 2024-09-10T08:36:52.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163187 s, 64.3 MB/s 2024-09-10T08:36:52.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.696 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177903 s, 58.9 MB/s 2024-09-10T08:36:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134302 s, 78.1 MB/s 2024-09-10T08:36:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139922 s, 74.9 MB/s 2024-09-10T08:36:52.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136604 s, 76.8 MB/s 2024-09-10T08:36:52.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:52.754 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:52.754 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:52.755 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T08:36:52.755 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:52.755 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:52.755 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:52.755 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:52.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:52.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.856 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154506 s, 67.9 MB/s 2024-09-10T08:36:52.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134875 s, 77.7 MB/s 2024-09-10T08:36:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175499 s, 59.7 MB/s 2024-09-10T08:36:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131798 s, 79.6 MB/s 2024-09-10T08:36:52.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127854 s, 82.0 MB/s 2024-09-10T08:36:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136965 s, 76.6 MB/s 2024-09-10T08:36:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133844 s, 78.3 MB/s 2024-09-10T08:36:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127877 s, 82.0 MB/s 2024-09-10T08:36:52.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:52.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:52.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129759 s, 80.8 MB/s 2024-09-10T08:36:53.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128569 s, 81.6 MB/s 2024-09-10T08:36:53.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140328 s, 74.7 MB/s 2024-09-10T08:36:53.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.040 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128911 s, 81.3 MB/s 2024-09-10T08:36:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140567 s, 74.6 MB/s 2024-09-10T08:36:53.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013239 s, 79.2 MB/s 2024-09-10T08:36:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012608 s, 83.2 MB/s 2024-09-10T08:36:53.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128729 s, 81.5 MB/s 2024-09-10T08:36:53.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126798 s, 82.7 MB/s 2024-09-10T08:36:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012405 s, 84.5 MB/s 2024-09-10T08:36:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013339 s, 78.6 MB/s 2024-09-10T08:36:53.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.171 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145985 s, 71.8 MB/s 2024-09-10T08:36:53.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.186 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126354 s, 83.0 MB/s 2024-09-10T08:36:53.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127529 s, 82.2 MB/s 2024-09-10T08:36:53.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149794 s, 70.0 MB/s 2024-09-10T08:36:53.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133015 s, 78.8 MB/s 2024-09-10T08:36:53.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164514 s, 63.7 MB/s 2024-09-10T08:36:53.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132658 s, 79.0 MB/s 2024-09-10T08:36:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.289 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128277 s, 81.7 MB/s 2024-09-10T08:36:53.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.305 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129598 s, 80.9 MB/s 2024-09-10T08:36:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132421 s, 79.2 MB/s 2024-09-10T08:36:53.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134801 s, 77.8 MB/s 2024-09-10T08:36:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137015 s, 76.5 MB/s 2024-09-10T08:36:53.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129872 s, 80.7 MB/s 2024-09-10T08:36:53.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:53.381 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:53.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:53.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.486 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137263 s, 76.4 MB/s 2024-09-10T08:36:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016353 s, 64.1 MB/s 2024-09-10T08:36:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144138 s, 72.7 MB/s 2024-09-10T08:36:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.542 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164868 s, 63.6 MB/s 2024-09-10T08:36:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131426 s, 79.8 MB/s 2024-09-10T08:36:53.574 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.574 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.574 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125975 s, 83.2 MB/s 2024-09-10T08:36:53.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.593 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158712 s, 66.1 MB/s 2024-09-10T08:36:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.610 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013089 s, 80.1 MB/s 2024-09-10T08:36:53.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01256 s, 83.5 MB/s 2024-09-10T08:36:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136594 s, 76.8 MB/s 2024-09-10T08:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133173 s, 78.7 MB/s 2024-09-10T08:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126273 s, 83.0 MB/s 2024-09-10T08:36:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137863 s, 76.1 MB/s 2024-09-10T08:36:53.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108668 s, 96.5 MB/s 2024-09-10T08:36:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133905 s, 78.3 MB/s 2024-09-10T08:36:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126106 s, 83.2 MB/s 2024-09-10T08:36:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138151 s, 75.9 MB/s 2024-09-10T08:36:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125751 s, 83.4 MB/s 2024-09-10T08:36:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133468 s, 78.6 MB/s 2024-09-10T08:36:53.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.806 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171693 s, 61.1 MB/s 2024-09-10T08:36:53.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118996 s, 88.1 MB/s 2024-09-10T08:36:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169862 s, 61.7 MB/s 2024-09-10T08:36:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.857 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129609 s, 80.9 MB/s 2024-09-10T08:36:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125245 s, 83.7 MB/s 2024-09-10T08:36:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140182 s, 74.8 MB/s 2024-09-10T08:36:53.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134654 s, 77.9 MB/s 2024-09-10T08:36:53.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152305 s, 68.8 MB/s 2024-09-10T08:36:53.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.942 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139814 s, 75.0 MB/s 2024-09-10T08:36:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132567 s, 79.1 MB/s 2024-09-10T08:36:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017016 s, 61.6 MB/s 2024-09-10T08:36:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:53.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132643 s, 79.1 MB/s 2024-09-10T08:36:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139495 s, 75.2 MB/s 2024-09-10T08:36:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:54.021 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:54.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.126 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171935 s, 61.0 MB/s 2024-09-10T08:36:54.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128863 s, 81.4 MB/s 2024-09-10T08:36:54.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128466 s, 81.6 MB/s 2024-09-10T08:36:54.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.174 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128851 s, 81.4 MB/s 2024-09-10T08:36:54.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.193 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155605 s, 67.4 MB/s 2024-09-10T08:36:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136961 s, 76.6 MB/s 2024-09-10T08:36:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.226 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133372 s, 78.6 MB/s 2024-09-10T08:36:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138808 s, 75.5 MB/s 2024-09-10T08:36:54.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151205 s, 69.3 MB/s 2024-09-10T08:36:54.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129125 s, 81.2 MB/s 2024-09-10T08:36:54.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164457 s, 63.8 MB/s 2024-09-10T08:36:54.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.315 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162501 s, 64.5 MB/s 2024-09-10T08:36:54.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.334 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155056 s, 67.6 MB/s 2024-09-10T08:36:54.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.349 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127616 s, 82.2 MB/s 2024-09-10T08:36:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.366 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01351 s, 77.6 MB/s 2024-09-10T08:36:54.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127889 s, 82.0 MB/s 2024-09-10T08:36:54.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.399 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136529 s, 76.8 MB/s 2024-09-10T08:36:54.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.414 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130014 s, 80.7 MB/s 2024-09-10T08:36:54.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.431 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136383 s, 76.9 MB/s 2024-09-10T08:36:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013087 s, 80.1 MB/s 2024-09-10T08:36:54.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.464 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131996 s, 79.4 MB/s 2024-09-10T08:36:54.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.484 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017151 s, 61.1 MB/s 2024-09-10T08:36:54.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128728 s, 81.5 MB/s 2024-09-10T08:36:54.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125805 s, 83.3 MB/s 2024-09-10T08:36:54.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135754 s, 77.2 MB/s 2024-09-10T08:36:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158768 s, 66.0 MB/s 2024-09-10T08:36:54.567 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.567 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.567 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132517 s, 79.1 MB/s 2024-09-10T08:36:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128808 s, 81.4 MB/s 2024-09-10T08:36:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128051 s, 81.9 MB/s 2024-09-10T08:36:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167402 s, 62.6 MB/s 2024-09-10T08:36:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129387 s, 81.0 MB/s 2024-09-10T08:36:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166777 s, 62.9 MB/s 2024-09-10T08:36:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:54.664 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:54.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:54.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.763 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013796 s, 76.0 MB/s 2024-09-10T08:36:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129639 s, 80.9 MB/s 2024-09-10T08:36:54.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132379 s, 79.2 MB/s 2024-09-10T08:36:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126929 s, 82.6 MB/s 2024-09-10T08:36:54.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.829 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140501 s, 74.6 MB/s 2024-09-10T08:36:54.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135554 s, 77.4 MB/s 2024-09-10T08:36:54.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.862 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136977 s, 76.6 MB/s 2024-09-10T08:36:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.876 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116419 s, 90.1 MB/s 2024-09-10T08:36:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140421 s, 74.7 MB/s 2024-09-10T08:36:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128167 s, 81.8 MB/s 2024-09-10T08:36:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138944 s, 75.5 MB/s 2024-09-10T08:36:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132423 s, 79.2 MB/s 2024-09-10T08:36:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012853 s, 81.6 MB/s 2024-09-10T08:36:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132564 s, 79.1 MB/s 2024-09-10T08:36:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134483 s, 78.0 MB/s 2024-09-10T08:36:55.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.011 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163184 s, 64.3 MB/s 2024-09-10T08:36:55.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.027 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126742 s, 82.7 MB/s 2024-09-10T08:36:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118712 s, 88.3 MB/s 2024-09-10T08:36:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130917 s, 80.1 MB/s 2024-09-10T08:36:55.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.074 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130712 s, 80.2 MB/s 2024-09-10T08:36:55.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.090 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012863 s, 81.5 MB/s 2024-09-10T08:36:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.106 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131156 s, 79.9 MB/s 2024-09-10T08:36:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140874 s, 74.4 MB/s 2024-09-10T08:36:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154088 s, 68.1 MB/s 2024-09-10T08:36:55.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134131 s, 78.2 MB/s 2024-09-10T08:36:55.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.175 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128869 s, 81.4 MB/s 2024-09-10T08:36:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013774 s, 76.1 MB/s 2024-09-10T08:36:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134016 s, 78.2 MB/s 2024-09-10T08:36:55.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163096 s, 64.3 MB/s 2024-09-10T08:36:55.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012287 s, 85.3 MB/s 2024-09-10T08:36:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011907 s, 88.1 MB/s 2024-09-10T08:36:55.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.274 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131878 s, 79.5 MB/s 2024-09-10T08:36:55.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:55.283 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:55.284 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:55.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:55.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.383 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139855 s, 75.0 MB/s 2024-09-10T08:36:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.400 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138116 s, 75.9 MB/s 2024-09-10T08:36:55.415 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129973 s, 80.7 MB/s 2024-09-10T08:36:55.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166621 s, 62.9 MB/s 2024-09-10T08:36:55.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.451 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012772 s, 82.1 MB/s 2024-09-10T08:36:55.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.467 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129005 s, 81.3 MB/s 2024-09-10T08:36:55.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.484 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142883 s, 73.4 MB/s 2024-09-10T08:36:55.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.501 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132153 s, 79.3 MB/s 2024-09-10T08:36:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128237 s, 81.8 MB/s 2024-09-10T08:36:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158338 s, 66.2 MB/s 2024-09-10T08:36:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159515 s, 65.7 MB/s 2024-09-10T08:36:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175325 s, 59.8 MB/s 2024-09-10T08:36:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175914 s, 59.6 MB/s 2024-09-10T08:36:55.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.617 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172092 s, 60.9 MB/s 2024-09-10T08:36:55.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.636 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167805 s, 62.5 MB/s 2024-09-10T08:36:55.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140773 s, 74.5 MB/s 2024-09-10T08:36:55.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.670 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128837 s, 81.4 MB/s 2024-09-10T08:36:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126209 s, 83.1 MB/s 2024-09-10T08:36:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142831 s, 73.4 MB/s 2024-09-10T08:36:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.722 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161224 s, 65.0 MB/s 2024-09-10T08:36:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141763 s, 74.0 MB/s 2024-09-10T08:36:55.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.755 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134253 s, 78.1 MB/s 2024-09-10T08:36:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134409 s, 78.0 MB/s 2024-09-10T08:36:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158503 s, 66.2 MB/s 2024-09-10T08:36:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157315 s, 66.7 MB/s 2024-09-10T08:36:55.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.826 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136864 s, 76.6 MB/s 2024-09-10T08:36:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164167 s, 63.9 MB/s 2024-09-10T08:36:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154691 s, 67.8 MB/s 2024-09-10T08:36:55.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126366 s, 83.0 MB/s 2024-09-10T08:36:55.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.896 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132989 s, 78.8 MB/s 2024-09-10T08:36:55.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.912 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128136 s, 81.8 MB/s 2024-09-10T08:36:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:55.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:55.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130229 s, 80.5 MB/s 2024-09-10T08:36:55.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:55.937 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:55.937 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:55.937 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T08:36:55.938 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:55.938 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:55.938 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:55.938 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:56.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141743 s, 74.0 MB/s 2024-09-10T08:36:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142113 s, 73.8 MB/s 2024-09-10T08:36:56.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134092 s, 78.2 MB/s 2024-09-10T08:36:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135201 s, 77.6 MB/s 2024-09-10T08:36:56.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.103 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127855 s, 82.0 MB/s 2024-09-10T08:36:56.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132489 s, 79.1 MB/s 2024-09-10T08:36:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137447 s, 76.3 MB/s 2024-09-10T08:36:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127577 s, 82.2 MB/s 2024-09-10T08:36:56.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.169 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134066 s, 78.2 MB/s 2024-09-10T08:36:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168432 s, 62.3 MB/s 2024-09-10T08:36:56.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140925 s, 74.4 MB/s 2024-09-10T08:36:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133939 s, 78.3 MB/s 2024-09-10T08:36:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163251 s, 64.2 MB/s 2024-09-10T08:36:56.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.256 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110344 s, 95.0 MB/s 2024-09-10T08:36:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155492 s, 67.4 MB/s 2024-09-10T08:36:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167959 s, 62.4 MB/s 2024-09-10T08:36:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.315 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173338 s, 60.5 MB/s 2024-09-10T08:36:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134661 s, 77.9 MB/s 2024-09-10T08:36:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164918 s, 63.6 MB/s 2024-09-10T08:36:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173238 s, 60.5 MB/s 2024-09-10T08:36:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.388 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138552 s, 75.7 MB/s 2024-09-10T08:36:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01288 s, 81.4 MB/s 2024-09-10T08:36:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153152 s, 68.5 MB/s 2024-09-10T08:36:56.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143079 s, 73.3 MB/s 2024-09-10T08:36:56.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170603 s, 61.5 MB/s 2024-09-10T08:36:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.476 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127349 s, 82.3 MB/s 2024-09-10T08:36:56.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133481 s, 78.6 MB/s 2024-09-10T08:36:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144831 s, 72.4 MB/s 2024-09-10T08:36:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158038 s, 66.3 MB/s 2024-09-10T08:36:56.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163338 s, 64.2 MB/s 2024-09-10T08:36:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013366 s, 78.5 MB/s 2024-09-10T08:36:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123608 s, 84.8 MB/s 2024-09-10T08:36:56.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:56.590 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133211 s, 78.7 MB/s 2024-09-10T08:36:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131785 s, 79.6 MB/s 2024-09-10T08:36:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136215 s, 77.0 MB/s 2024-09-10T08:36:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.738 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013599 s, 77.1 MB/s 2024-09-10T08:36:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.755 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139072 s, 75.4 MB/s 2024-09-10T08:36:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125214 s, 83.7 MB/s 2024-09-10T08:36:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.790 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162646 s, 64.5 MB/s 2024-09-10T08:36:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.807 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013484 s, 77.8 MB/s 2024-09-10T08:36:56.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117689 s, 89.1 MB/s 2024-09-10T08:36:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133873 s, 78.3 MB/s 2024-09-10T08:36:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129045 s, 81.3 MB/s 2024-09-10T08:36:56.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.874 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171696 s, 61.1 MB/s 2024-09-10T08:36:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172277 s, 60.9 MB/s 2024-09-10T08:36:56.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130236 s, 80.5 MB/s 2024-09-10T08:36:56.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013355 s, 78.5 MB/s 2024-09-10T08:36:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137071 s, 76.5 MB/s 2024-09-10T08:36:56.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129179 s, 81.2 MB/s 2024-09-10T08:36:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141046 s, 74.3 MB/s 2024-09-10T08:36:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171939 s, 61.0 MB/s 2024-09-10T08:36:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013342 s, 78.6 MB/s 2024-09-10T08:36:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135169 s, 77.6 MB/s 2024-09-10T08:36:57.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.049 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155732 s, 67.3 MB/s 2024-09-10T08:36:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136932 s, 76.6 MB/s 2024-09-10T08:36:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135137 s, 77.6 MB/s 2024-09-10T08:36:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141107 s, 74.3 MB/s 2024-09-10T08:36:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160859 s, 65.2 MB/s 2024-09-10T08:36:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160452 s, 65.4 MB/s 2024-09-10T08:36:57.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127003 s, 82.6 MB/s 2024-09-10T08:36:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.169 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131786 s, 79.6 MB/s 2024-09-10T08:36:57.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158372 s, 66.2 MB/s 2024-09-10T08:36:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162621 s, 64.5 MB/s 2024-09-10T08:36:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162643 s, 64.5 MB/s 2024-09-10T08:36:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:57.235 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:57.235 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:57.235 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T08:36:57.235 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:57.236 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:57.236 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:57.236 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:57.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:57.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.335 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135879 s, 77.2 MB/s 2024-09-10T08:36:57.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133282 s, 78.7 MB/s 2024-09-10T08:36:57.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156836 s, 66.9 MB/s 2024-09-10T08:36:57.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.387 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134745 s, 77.8 MB/s 2024-09-10T08:36:57.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116755 s, 89.8 MB/s 2024-09-10T08:36:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135112 s, 77.6 MB/s 2024-09-10T08:36:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136803 s, 76.6 MB/s 2024-09-10T08:36:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130717 s, 80.2 MB/s 2024-09-10T08:36:57.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.467 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131765 s, 79.6 MB/s 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.483 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134722 s, 77.8 MB/s 2024-09-10T08:36:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013304 s, 78.8 MB/s 2024-09-10T08:36:57.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.519 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161544 s, 64.9 MB/s 2024-09-10T08:36:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.535 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130852 s, 80.1 MB/s 2024-09-10T08:36:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.552 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133971 s, 78.3 MB/s 2024-09-10T08:36:57.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.568 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129146 s, 81.2 MB/s 2024-09-10T08:36:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129968 s, 80.7 MB/s 2024-09-10T08:36:57.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.603 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162009 s, 64.7 MB/s 2024-09-10T08:36:57.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.620 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133814 s, 78.4 MB/s 2024-09-10T08:36:57.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.636 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127611 s, 82.2 MB/s 2024-09-10T08:36:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165861 s, 63.2 MB/s 2024-09-10T08:36:57.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152741 s, 68.7 MB/s 2024-09-10T08:36:57.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157856 s, 66.4 MB/s 2024-09-10T08:36:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164387 s, 63.8 MB/s 2024-09-10T08:36:57.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130832 s, 80.1 MB/s 2024-09-10T08:36:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131685 s, 79.6 MB/s 2024-09-10T08:36:57.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125164 s, 83.8 MB/s 2024-09-10T08:36:57.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129853 s, 80.8 MB/s 2024-09-10T08:36:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164634 s, 63.7 MB/s 2024-09-10T08:36:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131345 s, 79.8 MB/s 2024-09-10T08:36:57.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012698 s, 82.6 MB/s 2024-09-10T08:36:57.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140651 s, 74.6 MB/s 2024-09-10T08:36:57.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170362 s, 61.5 MB/s 2024-09-10T08:36:57.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:57.874 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:57.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:57.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134248 s, 78.1 MB/s 2024-09-10T08:36:57.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:57.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:57.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134581 s, 77.9 MB/s 2024-09-10T08:36:58.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140034 s, 74.9 MB/s 2024-09-10T08:36:58.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.028 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170934 s, 61.3 MB/s 2024-09-10T08:36:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128057 s, 81.9 MB/s 2024-09-10T08:36:58.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128633 s, 81.5 MB/s 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.076 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141698 s, 74.0 MB/s 2024-09-10T08:36:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167927 s, 62.4 MB/s 2024-09-10T08:36:58.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.113 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128898 s, 81.3 MB/s 2024-09-10T08:36:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128084 s, 81.9 MB/s 2024-09-10T08:36:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163676 s, 64.1 MB/s 2024-09-10T08:36:58.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141814 s, 73.9 MB/s 2024-09-10T08:36:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163091 s, 64.3 MB/s 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158116 s, 66.3 MB/s 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136465 s, 76.8 MB/s 2024-09-10T08:36:58.236 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.236 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.236 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128672 s, 81.5 MB/s 2024-09-10T08:36:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131098 s, 80.0 MB/s 2024-09-10T08:36:58.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.272 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167189 s, 62.7 MB/s 2024-09-10T08:36:58.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.288 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013395 s, 78.3 MB/s 2024-09-10T08:36:58.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.304 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129112 s, 81.2 MB/s 2024-09-10T08:36:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111909 s, 93.7 MB/s 2024-09-10T08:36:58.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.335 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013648 s, 76.8 MB/s 2024-09-10T08:36:58.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.352 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013855 s, 75.7 MB/s 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139774 s, 75.0 MB/s 2024-09-10T08:36:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232212 s, 45.2 MB/s 2024-09-10T08:36:58.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.413 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013095 s, 80.1 MB/s 2024-09-10T08:36:58.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.430 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136195 s, 77.0 MB/s 2024-09-10T08:36:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160804 s, 65.2 MB/s 2024-09-10T08:36:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151405 s, 69.3 MB/s 2024-09-10T08:36:58.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138143 s, 75.9 MB/s 2024-09-10T08:36:58.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.502 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013335 s, 78.6 MB/s 2024-09-10T08:36:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130231 s, 80.5 MB/s 2024-09-10T08:36:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:58.527 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:58.527 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:58.527 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T08:36:58.528 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:58.528 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:58.528 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:58.528 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.628 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129896 s, 80.7 MB/s 2024-09-10T08:36:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.644 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013313 s, 78.8 MB/s 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013259 s, 79.1 MB/s 2024-09-10T08:36:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131363 s, 79.8 MB/s 2024-09-10T08:36:58.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.694 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135005 s, 77.7 MB/s 2024-09-10T08:36:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131565 s, 79.7 MB/s 2024-09-10T08:36:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130242 s, 80.5 MB/s 2024-09-10T08:36:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133361 s, 78.6 MB/s 2024-09-10T08:36:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134833 s, 77.8 MB/s 2024-09-10T08:36:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145499 s, 72.1 MB/s 2024-09-10T08:36:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127071 s, 82.5 MB/s 2024-09-10T08:36:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.808 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130344 s, 80.4 MB/s 2024-09-10T08:36:58.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.825 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133578 s, 78.5 MB/s 2024-09-10T08:36:58.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.842 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142781 s, 73.4 MB/s 2024-09-10T08:36:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.858 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132244 s, 79.3 MB/s 2024-09-10T08:36:58.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136957 s, 76.6 MB/s 2024-09-10T08:36:58.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012763 s, 82.2 MB/s 2024-09-10T08:36:58.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125612 s, 83.5 MB/s 2024-09-10T08:36:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133884 s, 78.3 MB/s 2024-09-10T08:36:58.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110929 s, 94.5 MB/s 2024-09-10T08:36:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.952 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129546 s, 80.9 MB/s 2024-09-10T08:36:58.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.972 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164989 s, 63.6 MB/s 2024-09-10T08:36:58.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159834 s, 65.6 MB/s 2024-09-10T08:36:59.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132883 s, 78.9 MB/s 2024-09-10T08:36:59.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.025 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152921 s, 68.6 MB/s 2024-09-10T08:36:59.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131518 s, 79.7 MB/s 2024-09-10T08:36:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127704 s, 82.1 MB/s 2024-09-10T08:36:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016731 s, 62.7 MB/s 2024-09-10T08:36:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136781 s, 76.7 MB/s 2024-09-10T08:36:59.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167877 s, 62.5 MB/s 2024-09-10T08:36:59.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124219 s, 84.4 MB/s 2024-09-10T08:36:59.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137169 s, 76.4 MB/s 2024-09-10T08:36:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:59.157 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:59.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133766 s, 78.4 MB/s 2024-09-10T08:36:59.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131384 s, 79.8 MB/s 2024-09-10T08:36:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169724 s, 61.8 MB/s 2024-09-10T08:36:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.311 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137922 s, 76.0 MB/s 2024-09-10T08:36:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135455 s, 77.4 MB/s 2024-09-10T08:36:59.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136426 s, 76.9 MB/s 2024-09-10T08:36:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126405 s, 83.0 MB/s 2024-09-10T08:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127386 s, 82.3 MB/s 2024-09-10T08:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128598 s, 81.5 MB/s 2024-09-10T08:36:59.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.411 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129566 s, 80.9 MB/s 2024-09-10T08:36:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132478 s, 79.2 MB/s 2024-09-10T08:36:59.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136786 s, 76.7 MB/s 2024-09-10T08:36:59.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128645 s, 81.5 MB/s 2024-09-10T08:36:59.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151406 s, 69.3 MB/s 2024-09-10T08:36:59.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126714 s, 82.8 MB/s 2024-09-10T08:36:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127854 s, 82.0 MB/s 2024-09-10T08:36:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013384 s, 78.3 MB/s 2024-09-10T08:36:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167479 s, 62.6 MB/s 2024-09-10T08:36:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126491 s, 82.9 MB/s 2024-09-10T08:36:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134257 s, 78.1 MB/s 2024-09-10T08:36:59.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130896 s, 80.1 MB/s 2024-09-10T08:36:59.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.616 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129199 s, 81.2 MB/s 2024-09-10T08:36:59.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.632 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012946 s, 81.0 MB/s 2024-09-10T08:36:59.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.649 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128343 s, 81.7 MB/s 2024-09-10T08:36:59.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.666 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134392 s, 78.0 MB/s 2024-09-10T08:36:59.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127567 s, 82.2 MB/s 2024-09-10T08:36:59.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127071 s, 82.5 MB/s 2024-09-10T08:36:59.714 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.714 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.715 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125291 s, 83.7 MB/s 2024-09-10T08:36:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.732 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135204 s, 77.6 MB/s 2024-09-10T08:36:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.748 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132331 s, 79.2 MB/s 2024-09-10T08:36:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118102 s, 88.8 MB/s 2024-09-10T08:36:59.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128831 s, 81.4 MB/s 2024-09-10T08:36:59.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:36:59.789 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:36:59.789 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:36:59.789 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T08:36:59.789 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:36:59.790 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:36:59.790 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:36:59.790 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:36:59.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:36:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:36:59.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.889 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127775 s, 82.1 MB/s 2024-09-10T08:36:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138835 s, 75.5 MB/s 2024-09-10T08:36:59.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01403 s, 74.7 MB/s 2024-09-10T08:36:59.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.940 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012682 s, 82.7 MB/s 2024-09-10T08:36:59.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013749 s, 76.3 MB/s 2024-09-10T08:36:59.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167676 s, 62.5 MB/s 2024-09-10T08:36:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:36:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:36:59.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134405 s, 78.0 MB/s 2024-09-10T08:37:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163415 s, 64.2 MB/s 2024-09-10T08:37:00.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.031 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130293 s, 80.5 MB/s 2024-09-10T08:37:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138695 s, 75.6 MB/s 2024-09-10T08:37:00.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012901 s, 81.3 MB/s 2024-09-10T08:37:00.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136804 s, 76.6 MB/s 2024-09-10T08:37:00.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.097 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.097 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131415 s, 79.8 MB/s 2024-09-10T08:37:00.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170297 s, 61.6 MB/s 2024-09-10T08:37:00.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133515 s, 78.5 MB/s 2024-09-10T08:37:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115138 s, 91.1 MB/s 2024-09-10T08:37:00.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.167 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164952 s, 63.6 MB/s 2024-09-10T08:37:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136253 s, 77.0 MB/s 2024-09-10T08:37:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151221 s, 69.3 MB/s 2024-09-10T08:37:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134342 s, 78.1 MB/s 2024-09-10T08:37:00.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.239 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169093 s, 62.0 MB/s 2024-09-10T08:37:00.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133307 s, 78.7 MB/s 2024-09-10T08:37:00.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.272 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133339 s, 78.6 MB/s 2024-09-10T08:37:00.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.288 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124996 s, 83.9 MB/s 2024-09-10T08:37:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.307 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162969 s, 64.3 MB/s 2024-09-10T08:37:00.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.323 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135494 s, 77.4 MB/s 2024-09-10T08:37:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012937 s, 81.1 MB/s 2024-09-10T08:37:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127832 s, 82.0 MB/s 2024-09-10T08:37:00.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132924 s, 78.9 MB/s 2024-09-10T08:37:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168777 s, 62.1 MB/s 2024-09-10T08:37:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135634 s, 77.3 MB/s 2024-09-10T08:37:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119069 s, 88.1 MB/s 2024-09-10T08:37:00.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:00.432 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:00.432 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:00.433 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:00.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.534 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148904 s, 70.4 MB/s 2024-09-10T08:37:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130793 s, 80.2 MB/s 2024-09-10T08:37:00.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013287 s, 78.9 MB/s 2024-09-10T08:37:00.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.587 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176433 s, 59.4 MB/s 2024-09-10T08:37:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.603 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126232 s, 83.1 MB/s 2024-09-10T08:37:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012724 s, 82.4 MB/s 2024-09-10T08:37:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.637 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145155 s, 72.2 MB/s 2024-09-10T08:37:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172157 s, 60.9 MB/s 2024-09-10T08:37:00.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166566 s, 63.0 MB/s 2024-09-10T08:37:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129325 s, 81.1 MB/s 2024-09-10T08:37:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151677 s, 69.1 MB/s 2024-09-10T08:37:00.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133194 s, 78.7 MB/s 2024-09-10T08:37:00.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139103 s, 75.4 MB/s 2024-09-10T08:37:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128786 s, 81.4 MB/s 2024-09-10T08:37:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.778 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143448 s, 73.1 MB/s 2024-09-10T08:37:00.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129849 s, 80.8 MB/s 2024-09-10T08:37:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123147 s, 85.1 MB/s 2024-09-10T08:37:00.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137166 s, 76.4 MB/s 2024-09-10T08:37:00.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131576 s, 79.7 MB/s 2024-09-10T08:37:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133138 s, 78.8 MB/s 2024-09-10T08:37:00.876 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136221 s, 77.0 MB/s 2024-09-10T08:37:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138019 s, 76.0 MB/s 2024-09-10T08:37:00.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.910 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130844 s, 80.1 MB/s 2024-09-10T08:37:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124841 s, 84.0 MB/s 2024-09-10T08:37:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012983 s, 80.8 MB/s 2024-09-10T08:37:00.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168374 s, 62.3 MB/s 2024-09-10T08:37:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134093 s, 78.2 MB/s 2024-09-10T08:37:00.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:00.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:00.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01378 s, 76.1 MB/s 2024-09-10T08:37:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134067 s, 78.2 MB/s 2024-09-10T08:37:01.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.028 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137708 s, 76.1 MB/s 2024-09-10T08:37:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134858 s, 77.8 MB/s 2024-09-10T08:37:01.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137459 s, 76.3 MB/s 2024-09-10T08:37:01.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:01.071 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:01.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167392 s, 62.6 MB/s 2024-09-10T08:37:01.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121282 s, 86.5 MB/s 2024-09-10T08:37:01.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107421 s, 97.6 MB/s 2024-09-10T08:37:01.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013979 s, 75.0 MB/s 2024-09-10T08:37:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.235 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01353 s, 77.5 MB/s 2024-09-10T08:37:01.251 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.251 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.251 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131264 s, 79.9 MB/s 2024-09-10T08:37:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.268 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130884 s, 80.1 MB/s 2024-09-10T08:37:01.283 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128869 s, 81.4 MB/s 2024-09-10T08:37:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159926 s, 65.6 MB/s 2024-09-10T08:37:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119355 s, 87.9 MB/s 2024-09-10T08:37:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132063 s, 79.4 MB/s 2024-09-10T08:37:01.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137728 s, 76.1 MB/s 2024-09-10T08:37:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166828 s, 62.9 MB/s 2024-09-10T08:37:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127493 s, 82.2 MB/s 2024-09-10T08:37:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129657 s, 80.9 MB/s 2024-09-10T08:37:01.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107245 s, 97.8 MB/s 2024-09-10T08:37:01.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.432 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131933 s, 79.5 MB/s 2024-09-10T08:37:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.448 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125189 s, 83.8 MB/s 2024-09-10T08:37:01.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.467 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015816 s, 66.3 MB/s 2024-09-10T08:37:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128911 s, 81.3 MB/s 2024-09-10T08:37:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141584 s, 74.1 MB/s 2024-09-10T08:37:01.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01155 s, 90.8 MB/s 2024-09-10T08:37:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018562 s, 56.5 MB/s 2024-09-10T08:37:01.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.553 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138466 s, 75.7 MB/s 2024-09-10T08:37:01.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129854 s, 80.8 MB/s 2024-09-10T08:37:01.585 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01388 s, 75.5 MB/s 2024-09-10T08:37:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131504 s, 79.7 MB/s 2024-09-10T08:37:01.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132803 s, 79.0 MB/s 2024-09-10T08:37:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01203 s, 87.2 MB/s 2024-09-10T08:37:01.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.650 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134205 s, 78.1 MB/s 2024-09-10T08:37:01.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.666 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134212 s, 78.1 MB/s 2024-09-10T08:37:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168365 s, 62.3 MB/s 2024-09-10T08:37:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:01.695 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:01.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130657 s, 80.3 MB/s 2024-09-10T08:37:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125662 s, 83.4 MB/s 2024-09-10T08:37:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.826 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131217 s, 79.9 MB/s 2024-09-10T08:37:01.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.842 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131556 s, 79.7 MB/s 2024-09-10T08:37:01.859 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.859 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.859 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138467 s, 75.7 MB/s 2024-09-10T08:37:01.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130095 s, 80.6 MB/s 2024-09-10T08:37:01.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129103 s, 81.2 MB/s 2024-09-10T08:37:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129618 s, 80.9 MB/s 2024-09-10T08:37:01.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.926 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163511 s, 64.1 MB/s 2024-09-10T08:37:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156851 s, 66.9 MB/s 2024-09-10T08:37:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134879 s, 77.7 MB/s 2024-09-10T08:37:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136358 s, 76.9 MB/s 2024-09-10T08:37:01.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:01.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:01.998 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160463 s, 65.3 MB/s 2024-09-10T08:37:02.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.014 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130346 s, 80.4 MB/s 2024-09-10T08:37:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.034 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166273 s, 63.1 MB/s 2024-09-10T08:37:02.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.049 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125856 s, 83.3 MB/s 2024-09-10T08:37:02.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.067 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150748 s, 69.6 MB/s 2024-09-10T08:37:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145462 s, 72.1 MB/s 2024-09-10T08:37:02.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.103 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141999 s, 73.8 MB/s 2024-09-10T08:37:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138062 s, 75.9 MB/s 2024-09-10T08:37:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170005 s, 61.7 MB/s 2024-09-10T08:37:02.157 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136859 s, 76.6 MB/s 2024-09-10T08:37:02.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113609 s, 92.3 MB/s 2024-09-10T08:37:02.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013372 s, 78.4 MB/s 2024-09-10T08:37:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127891 s, 82.0 MB/s 2024-09-10T08:37:02.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.222 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131863 s, 79.5 MB/s 2024-09-10T08:37:02.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.238 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130292 s, 80.5 MB/s 2024-09-10T08:37:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152933 s, 68.6 MB/s 2024-09-10T08:37:02.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126174 s, 83.1 MB/s 2024-09-10T08:37:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160041 s, 65.5 MB/s 2024-09-10T08:37:02.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013429 s, 78.1 MB/s 2024-09-10T08:37:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01348 s, 77.8 MB/s 2024-09-10T08:37:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:02.334 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:02.335 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:02.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:02.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151094 s, 69.4 MB/s 2024-09-10T08:37:02.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136653 s, 76.7 MB/s 2024-09-10T08:37:02.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161355 s, 65.0 MB/s 2024-09-10T08:37:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128131 s, 81.8 MB/s 2024-09-10T08:37:02.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01319 s, 79.5 MB/s 2024-09-10T08:37:02.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.525 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157849 s, 66.4 MB/s 2024-09-10T08:37:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133691 s, 78.4 MB/s 2024-09-10T08:37:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157538 s, 66.6 MB/s 2024-09-10T08:37:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148034 s, 70.8 MB/s 2024-09-10T08:37:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139837 s, 75.0 MB/s 2024-09-10T08:37:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.613 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141166 s, 74.3 MB/s 2024-09-10T08:37:02.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.630 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139064 s, 75.4 MB/s 2024-09-10T08:37:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124783 s, 84.0 MB/s 2024-09-10T08:37:02.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150922 s, 69.5 MB/s 2024-09-10T08:37:02.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164343 s, 63.8 MB/s 2024-09-10T08:37:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131597 s, 79.7 MB/s 2024-09-10T08:37:02.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137397 s, 76.3 MB/s 2024-09-10T08:37:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127899 s, 82.0 MB/s 2024-09-10T08:37:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135692 s, 77.3 MB/s 2024-09-10T08:37:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129529 s, 81.0 MB/s 2024-09-10T08:37:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136785 s, 76.7 MB/s 2024-09-10T08:37:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.806 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168968 s, 62.1 MB/s 2024-09-10T08:37:02.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131161 s, 79.9 MB/s 2024-09-10T08:37:02.840 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.840 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.840 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152216 s, 68.9 MB/s 2024-09-10T08:37:02.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167468 s, 62.6 MB/s 2024-09-10T08:37:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167037 s, 62.8 MB/s 2024-09-10T08:37:02.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.897 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134283 s, 78.1 MB/s 2024-09-10T08:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126322 s, 83.0 MB/s 2024-09-10T08:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137265 s, 76.4 MB/s 2024-09-10T08:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130249 s, 80.5 MB/s 2024-09-10T08:37:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012671 s, 82.8 MB/s 2024-09-10T08:37:02.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:02.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:02.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128756 s, 81.4 MB/s 2024-09-10T08:37:02.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:02.987 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:03.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129845 s, 80.8 MB/s 2024-09-10T08:37:03.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.109 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162904 s, 64.4 MB/s 2024-09-10T08:37:03.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136361 s, 76.9 MB/s 2024-09-10T08:37:03.139 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.140 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128817 s, 81.4 MB/s 2024-09-10T08:37:03.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126941 s, 82.6 MB/s 2024-09-10T08:37:03.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.177 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168289 s, 62.3 MB/s 2024-09-10T08:37:03.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.193 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133202 s, 78.7 MB/s 2024-09-10T08:37:03.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128042 s, 81.9 MB/s 2024-09-10T08:37:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.227 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160975 s, 65.1 MB/s 2024-09-10T08:37:03.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.244 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138325 s, 75.8 MB/s 2024-09-10T08:37:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.258 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111175 s, 94.3 MB/s 2024-09-10T08:37:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.274 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012836 s, 81.7 MB/s 2024-09-10T08:37:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166225 s, 63.1 MB/s 2024-09-10T08:37:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170735 s, 61.4 MB/s 2024-09-10T08:37:03.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135611 s, 77.3 MB/s 2024-09-10T08:37:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135466 s, 77.4 MB/s 2024-09-10T08:37:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137131 s, 76.5 MB/s 2024-09-10T08:37:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135704 s, 77.3 MB/s 2024-09-10T08:37:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198398 s, 52.9 MB/s 2024-09-10T08:37:03.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130436 s, 80.4 MB/s 2024-09-10T08:37:03.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191929 s, 54.6 MB/s 2024-09-10T08:37:03.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130838 s, 80.1 MB/s 2024-09-10T08:37:03.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166328 s, 63.0 MB/s 2024-09-10T08:37:03.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135253 s, 77.5 MB/s 2024-09-10T08:37:03.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.513 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128065 s, 81.9 MB/s 2024-09-10T08:37:03.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134519 s, 77.9 MB/s 2024-09-10T08:37:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128972 s, 81.3 MB/s 2024-09-10T08:37:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147197 s, 71.2 MB/s 2024-09-10T08:37:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131465 s, 79.8 MB/s 2024-09-10T08:37:03.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.595 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128148 s, 81.8 MB/s 2024-09-10T08:37:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132801 s, 79.0 MB/s 2024-09-10T08:37:03.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.627 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120059 s, 87.3 MB/s 2024-09-10T08:37:03.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:03.637 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128607 s, 81.5 MB/s 2024-09-10T08:37:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.754 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137544 s, 76.2 MB/s 2024-09-10T08:37:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136262 s, 77.0 MB/s 2024-09-10T08:37:03.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137605 s, 76.2 MB/s 2024-09-10T08:37:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131219 s, 79.9 MB/s 2024-09-10T08:37:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125724 s, 83.4 MB/s 2024-09-10T08:37:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131343 s, 79.8 MB/s 2024-09-10T08:37:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135989 s, 77.1 MB/s 2024-09-10T08:37:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.870 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126527 s, 82.9 MB/s 2024-09-10T08:37:03.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.886 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127771 s, 82.1 MB/s 2024-09-10T08:37:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109669 s, 95.6 MB/s 2024-09-10T08:37:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128451 s, 81.6 MB/s 2024-09-10T08:37:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138706 s, 75.6 MB/s 2024-09-10T08:37:03.949 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.949 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.949 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139239 s, 75.3 MB/s 2024-09-10T08:37:03.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.969 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168423 s, 62.3 MB/s 2024-09-10T08:37:03.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:03.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:03.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017249 s, 60.8 MB/s 2024-09-10T08:37:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154777 s, 67.7 MB/s 2024-09-10T08:37:04.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118691 s, 88.3 MB/s 2024-09-10T08:37:04.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.040 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013271 s, 79.0 MB/s 2024-09-10T08:37:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141086 s, 74.3 MB/s 2024-09-10T08:37:04.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135178 s, 77.6 MB/s 2024-09-10T08:37:04.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176368 s, 59.5 MB/s 2024-09-10T08:37:04.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.110 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129474 s, 81.0 MB/s 2024-09-10T08:37:04.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166761 s, 62.9 MB/s 2024-09-10T08:37:04.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.146 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134237 s, 78.1 MB/s 2024-09-10T08:37:04.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163489 s, 64.1 MB/s 2024-09-10T08:37:04.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.183 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134571 s, 77.9 MB/s 2024-09-10T08:37:04.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165757 s, 63.3 MB/s 2024-09-10T08:37:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.220 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-10T08:37:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012638 s, 83.0 MB/s 2024-09-10T08:37:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120308 s, 87.2 MB/s 2024-09-10T08:37:04.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125607 s, 83.5 MB/s 2024-09-10T08:37:04.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:04.274 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:04.274 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:04.274 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T08:37:04.274 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:04.274 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:04.275 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:04.275 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138834 s, 75.5 MB/s 2024-09-10T08:37:04.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137233 s, 76.4 MB/s 2024-09-10T08:37:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127044 s, 82.5 MB/s 2024-09-10T08:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140609 s, 74.6 MB/s 2024-09-10T08:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163927 s, 64.0 MB/s 2024-09-10T08:37:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.463 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161799 s, 64.8 MB/s 2024-09-10T08:37:04.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126712 s, 82.8 MB/s 2024-09-10T08:37:04.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132968 s, 78.9 MB/s 2024-09-10T08:37:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01696 s, 61.8 MB/s 2024-09-10T08:37:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.531 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126568 s, 82.8 MB/s 2024-09-10T08:37:04.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.548 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145319 s, 72.2 MB/s 2024-09-10T08:37:04.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.564 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125639 s, 83.5 MB/s 2024-09-10T08:37:04.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.580 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012738 s, 82.3 MB/s 2024-09-10T08:37:04.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161659 s, 64.9 MB/s 2024-09-10T08:37:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121448 s, 86.3 MB/s 2024-09-10T08:37:04.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.630 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133016 s, 78.8 MB/s 2024-09-10T08:37:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-10T08:37:04.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.666 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159827 s, 65.6 MB/s 2024-09-10T08:37:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160425 s, 65.4 MB/s 2024-09-10T08:37:04.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.703 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155394 s, 67.5 MB/s 2024-09-10T08:37:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161522 s, 64.9 MB/s 2024-09-10T08:37:04.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.738 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012507 s, 83.8 MB/s 2024-09-10T08:37:04.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163745 s, 64.0 MB/s 2024-09-10T08:37:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140722 s, 74.5 MB/s 2024-09-10T08:37:04.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167343 s, 62.7 MB/s 2024-09-10T08:37:04.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138049 s, 76.0 MB/s 2024-09-10T08:37:04.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131042 s, 80.0 MB/s 2024-09-10T08:37:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.843 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01295 s, 81.0 MB/s 2024-09-10T08:37:04.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.862 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163741 s, 64.0 MB/s 2024-09-10T08:37:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132396 s, 79.2 MB/s 2024-09-10T08:37:04.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.895 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132711 s, 79.0 MB/s 2024-09-10T08:37:04.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:04.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:04.911 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129831 s, 80.8 MB/s 2024-09-10T08:37:04.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:04.920 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:04.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:05.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.019 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130051 s, 80.6 MB/s 2024-09-10T08:37:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130115 s, 80.6 MB/s 2024-09-10T08:37:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142685 s, 73.5 MB/s 2024-09-10T08:37:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.070 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131109 s, 80.0 MB/s 2024-09-10T08:37:05.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.087 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131467 s, 79.8 MB/s 2024-09-10T08:37:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135595 s, 77.3 MB/s 2024-09-10T08:37:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130083 s, 80.6 MB/s 2024-09-10T08:37:05.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124776 s, 84.0 MB/s 2024-09-10T08:37:05.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.154 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.154 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128193 s, 81.8 MB/s 2024-09-10T08:37:05.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.170 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135023 s, 77.7 MB/s 2024-09-10T08:37:05.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107782 s, 97.3 MB/s 2024-09-10T08:37:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014332 s, 73.2 MB/s 2024-09-10T08:37:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161918 s, 64.8 MB/s 2024-09-10T08:37:05.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142738 s, 73.5 MB/s 2024-09-10T08:37:05.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.256 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126068 s, 83.2 MB/s 2024-09-10T08:37:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134826 s, 77.8 MB/s 2024-09-10T08:37:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166123 s, 63.1 MB/s 2024-09-10T08:37:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142744 s, 73.5 MB/s 2024-09-10T08:37:05.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.330 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157439 s, 66.6 MB/s 2024-09-10T08:37:05.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.350 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165098 s, 63.5 MB/s 2024-09-10T08:37:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130785 s, 80.2 MB/s 2024-09-10T08:37:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128894 s, 81.4 MB/s 2024-09-10T08:37:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.400 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134493 s, 78.0 MB/s 2024-09-10T08:37:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.417 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127857 s, 82.0 MB/s 2024-09-10T08:37:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.435 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153305 s, 68.4 MB/s 2024-09-10T08:37:05.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155679 s, 67.4 MB/s 2024-09-10T08:37:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131604 s, 79.7 MB/s 2024-09-10T08:37:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017249 s, 60.8 MB/s 2024-09-10T08:37:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.506 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106299 s, 98.6 MB/s 2024-09-10T08:37:05.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131086 s, 80.0 MB/s 2024-09-10T08:37:05.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138388 s, 75.8 MB/s 2024-09-10T08:37:05.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.555 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137013 s, 76.5 MB/s 2024-09-10T08:37:05.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:05.564 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:05.564 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:05.565 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T08:37:05.565 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:05.565 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:05.565 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:05.565 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:05.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130936 s, 80.1 MB/s 2024-09-10T08:37:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128453 s, 81.6 MB/s 2024-09-10T08:37:05.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144614 s, 72.5 MB/s 2024-09-10T08:37:05.713 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.713 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.713 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129835 s, 80.8 MB/s 2024-09-10T08:37:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.733 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167488 s, 62.6 MB/s 2024-09-10T08:37:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164765 s, 63.6 MB/s 2024-09-10T08:37:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130965 s, 80.1 MB/s 2024-09-10T08:37:05.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129767 s, 80.8 MB/s 2024-09-10T08:37:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142641 s, 73.5 MB/s 2024-09-10T08:37:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131389 s, 79.8 MB/s 2024-09-10T08:37:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160351 s, 65.4 MB/s 2024-09-10T08:37:05.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130386 s, 80.4 MB/s 2024-09-10T08:37:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137073 s, 76.5 MB/s 2024-09-10T08:37:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126421 s, 82.9 MB/s 2024-09-10T08:37:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130718 s, 80.2 MB/s 2024-09-10T08:37:05.918 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131919 s, 79.5 MB/s 2024-09-10T08:37:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130023 s, 80.6 MB/s 2024-09-10T08:37:05.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165967 s, 63.2 MB/s 2024-09-10T08:37:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133605 s, 78.5 MB/s 2024-09-10T08:37:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:05.987 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125156 s, 83.8 MB/s 2024-09-10T08:37:06.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.002 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119612 s, 87.7 MB/s 2024-09-10T08:37:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.018 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133315 s, 78.7 MB/s 2024-09-10T08:37:06.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.035 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.035 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130593 s, 80.3 MB/s 2024-09-10T08:37:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.052 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136526 s, 76.8 MB/s 2024-09-10T08:37:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133415 s, 78.6 MB/s 2024-09-10T08:37:06.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.083 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126612 s, 82.8 MB/s 2024-09-10T08:37:06.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170192 s, 61.6 MB/s 2024-09-10T08:37:06.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132493 s, 79.1 MB/s 2024-09-10T08:37:06.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131898 s, 79.5 MB/s 2024-09-10T08:37:06.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129468 s, 81.0 MB/s 2024-09-10T08:37:06.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134363 s, 78.0 MB/s 2024-09-10T08:37:06.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137218 s, 76.4 MB/s 2024-09-10T08:37:06.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:06.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:06.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-10T08:37:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.355+0000 7f3662000640 1 Processor -- start 2024-09-10T08:37:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.355+0000 7f3662000640 1 -- start start 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.356+0000 7f3662000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c0ae870 0x7f365c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.356+0000 7f3662000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f365c160550 0x7f365c1609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.356+0000 7f3662000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c0b5ef0 con 0x7f365c1480b0 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.356+0000 7f3662000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f365c148490 con 0x7f365c160550 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f3662000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f365c0af1f0 con 0x7f365c0ae870 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f365c160550 0x7f365c1609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f365c160550 0x7f365c1609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40452/0 (socket says 172.21.15.52:40452) 2024-09-10T08:37:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 -- 172.21.15.52:0/3788720120 learned_addr learned my addr 172.21.15.52:0/3788720120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f3653e00640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c0ae870 0x7f365c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 -- 172.21.15.52:0/3788720120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c0ae870 msgr2=0x7f365c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c0ae870 0x7f365c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 -- 172.21.15.52:0/3788720120 >> v1:172.21.15.176:6789/0 conn(0x7f365c1480b0 legacy=0x7f365c0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365be00640 1 -- 172.21.15.52:0/3788720120 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0b61d0 con 0x7f365c160550 2024-09-10T08:37:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.357+0000 7f365aa00640 1 -- 172.21.15.52:0/3788720120 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198035050 0 0) 0x7f365c0b5ef0 con 0x7f365c1480b0 2024-09-10T08:37:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.358+0000 7f365be00640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c160550 0x7f365c1609c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491c8608bad6698c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f365aa00640 1 -- 172.21.15.52:0/3788720120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654036070 con 0x7f365c160550 2024-09-10T08:37:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f365aa00640 1 -- 172.21.15.52:0/3788720120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654031600 con 0x7f365c160550 2024-09-10T08:37:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f365aa00640 1 -- 172.21.15.52:0/3788720120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540319d0 con 0x7f365c160550 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 -- 172.21.15.52:0/3788720120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c160550 msgr2=0x7f365c1609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c160550 0x7f365c1609c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365402a680 comp rx=0 tx=0).stop 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 -- 172.21.15.52:0/3788720120 shutdown_connections 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c160550 0x7f365c1609c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 --2- 172.21.15.52:0/3788720120 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c0ae870 0x7f365c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 -- 172.21.15.52:0/3788720120 >> 172.21.15.52:0/3788720120 conn(0x7f365c06c240 msgr2=0x7f365c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 -- 172.21.15.52:0/3788720120 shutdown_connections 2024-09-10T08:37:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.359+0000 7f3662000640 1 -- 172.21.15.52:0/3788720120 wait complete. 2024-09-10T08:37:06.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.361+0000 7f3662000640 1 Processor -- start 2024-09-10T08:37:06.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.361+0000 7f3662000640 1 -- start start 2024-09-10T08:37:06.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f365c1480b0 0x7f365c15dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c160550 0x7f365c143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f365c0b37a0 con 0x7f365c0ae870 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f365c160030 con 0x7f365c1480b0 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3662000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f365c0b3920 con 0x7f365c160550 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40466/0 (socket says 172.21.15.52:40466) 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f365b400640 1 -- 172.21.15.52:0/3677756847 learned_addr learned my addr 172.21.15.52:0/3677756847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f365be00640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c160550 0x7f365c143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.362+0000 7f3653e00640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f365c1480b0 0x7f365c15dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 -- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c160550 msgr2=0x7f365c143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c160550 0x7f365c143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 -- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f365c1480b0 msgr2=0x7f365c15dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f365c1480b0 0x7f365c15dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 -- 172.21.15.52:0/3677756847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c0c56f0 con 0x7f365c0ae870 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f365b400640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c490 tx=0x7f364c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f3653400640 1 -- 172.21.15.52:0/3677756847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c005480 con 0x7f365c0ae870 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f3653400640 1 -- 172.21.15.52:0/3677756847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c0035f0 con 0x7f365c0ae870 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f3653400640 1 -- 172.21.15.52:0/3677756847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c0039c0 con 0x7f365c0ae870 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.363+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c0c59d0 con 0x7f365c0ae870 2024-09-10T08:37:06.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.364+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c13f370 con 0x7f365c0ae870 2024-09-10T08:37:06.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.365+0000 7f3653400640 1 -- 172.21.15.52:0/3677756847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f364c003b60 con 0x7f365c0ae870 2024-09-10T08:37:06.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.366+0000 7f3653400640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 0x7f363806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.366+0000 7f3653400640 1 -- 172.21.15.52:0/3677756847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f364c08aa50 con 0x7f365c0ae870 2024-09-10T08:37:06.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.367+0000 7f3653e00640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 0x7f363806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.367+0000 7f366506f740 1 Processor -- start 2024-09-10T08:37:06.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.367+0000 7f366506f740 1 -- start start 2024-09-10T08:37:06.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f3653e00640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 0x7f363806e490 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f365c15e5f0 tx=0x7f3644009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a138770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55811a075a70 con 0x55811a155fb0 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55811a01d9d0 con 0x55811a156410 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55811a071a30 con 0x55811a1587f0 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f3653e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f3653e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40472/0 (socket says 172.21.15.52:40472) 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f3653e00640 1 -- 172.21.15.52:0/831978607 learned_addr learned my addr 172.21.15.52:0/831978607 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f365b400640 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.368+0000 7f365be00640 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 -- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 msgr2=0x55811a158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 -- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 msgr2=0x55811a138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 -- 172.21.15.52:0/831978607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558119e54ba0 con 0x55811a155fb0 2024-09-10T08:37:06.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f3653e00640 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3644006a90 tx=0x7f3644014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba55f6c3da59d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f364b400640 1 -- 172.21.15.52:0/831978607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364401b070 con 0x55811a155fb0 2024-09-10T08:37:06.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f364b400640 1 -- 172.21.15.52:0/831978607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644027070 con 0x55811a155fb0 2024-09-10T08:37:06.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.369+0000 7f364b400640 1 -- 172.21.15.52:0/831978607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644003a20 con 0x55811a155fb0 2024-09-10T08:37:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 -- 172.21.15.52:0/831978607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 msgr2=0x55811a157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3644006a90 tx=0x7f3644014000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 -- 172.21.15.52:0/831978607 shutdown_connections 2024-09-10T08:37:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a155fb0 0x55811a157b40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 --2- 172.21.15.52:0/831978607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 -- 172.21.15.52:0/831978607 >> 172.21.15.52:0/831978607 conn(0x55811a10e450 msgr2=0x55811a156860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 -- 172.21.15.52:0/831978607 shutdown_connections 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.370+0000 7f366506f740 1 -- 172.21.15.52:0/831978607 wait complete. 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.371+0000 7f366506f740 1 -- start start 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.371+0000 7f366506f740 1 Processor -- start 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a12fb70 0x55811a15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55811a154f10 con 0x55811a156410 2024-09-10T08:37:06.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55811a030bf0 con 0x55811a12fb70 2024-09-10T08:37:06.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55811a1551f0 con 0x55811a1587f0 2024-09-10T08:37:06.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f366506f740 10 client.0 _ll_register_callbacks cb 0x55811a0536b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40482/0 (socket says 172.21.15.52:40482) 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 -- 172.21.15.52:0/145019785 learned_addr learned my addr 172.21.15.52:0/145019785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f3653e00640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365be00640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a12fb70 0x55811a15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 -- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 msgr2=0x55811a15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a15a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 -- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a12fb70 msgr2=0x55811a15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a12fb70 0x55811a15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.372+0000 7f365b400640 1 -- 172.21.15.52:0/145019785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558119d48490 con 0x55811a156410 2024-09-10T08:37:06.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f365b400640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c460 tx=0x7f364c061980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0862a882ed5af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c086070 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f364c058360 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3644027070 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f364c05f210 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f366506f740 10 client.8085 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x558119eb5330 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644027070 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.373+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f364c05f3b0 con 0x55811a156410 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 10 client.8085 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 10 client.8085 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 20 client.8085 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a13ba20 0x55811a167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 4 client.8085 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55811a0831a0 con 0x55811a13ba20 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f3653e00640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a13ba20 0x55811a167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f3653e00640 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a13ba20 0x55811a167210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb031324a1e50c server_cookie=6402f62cecd59d31 in_seq=0 out_seq=0 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.374+0000 7f363fe00640 10 client.8085 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.375+0000 7f363fe00640 1 -- 172.21.15.52:0/145019785 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55811a0831a0 con 0x55811a13ba20 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.375+0000 7f363fe00640 10 client.8085 handle_command_reply: tid=0 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.375+0000 7f366506f740 1 client.8085 shutdown 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.375+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 msgr2=0x55811a111a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.375+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c460 tx=0x7f364c061980 comp rx=0 tx=0).stop 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 shutdown_connections 2024-09-10T08:37:06.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a13ba20 0x55811a167210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a12fb70 0x55811a15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a1587f0 0x55811a15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f363fe00640 0 client.8085 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 --2- 172.21.15.52:0/145019785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a156410 0x55811a111a20 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 >> 172.21.15.52:0/145019785 conn(0x55811a155fb0 msgr2=0x55811a138d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 shutdown_connections 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 1 -- 172.21.15.52:0/145019785 wait complete. 2024-09-10T08:37:06.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.376+0000 7f366506f740 20 client.8085 trim_cache size 0 max 16384 2024-09-10T08:37:06.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.394+0000 7f366506f740 1 Processor -- start 2024-09-10T08:37:06.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.394+0000 7f366506f740 1 -- start start 2024-09-10T08:37:06.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a12fb70 0x55811a1663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a1cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f365c200b10 con 0x55811a1587f0 2024-09-10T08:37:06.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1ffb30 con 0x55811a156410 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f365c1feec0 con 0x55811a12fb70 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f365be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f365be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40486/0 (socket says 172.21.15.52:40486) 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f365be00640 1 -- 172.21.15.52:0/641201369 learned_addr learned my addr 172.21.15.52:0/641201369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f365b400640 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a12fb70 0x55811a1663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.395+0000 7f3653e00640 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a1cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 -- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a12fb70 msgr2=0x55811a1663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a12fb70 0x55811a1663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 -- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 msgr2=0x55811a1cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a1cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 -- 172.21.15.52:0/641201369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558119d21550 con 0x55811a1587f0 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f365be00640 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927df6becdaf7205 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f364aa00640 1 -- 172.21.15.52:0/641201369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654036050 con 0x55811a1587f0 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f364aa00640 1 -- 172.21.15.52:0/641201369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654037040 con 0x55811a1587f0 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.396+0000 7f364aa00640 1 -- 172.21.15.52:0/641201369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654004040 con 0x55811a1587f0 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 -- 172.21.15.52:0/641201369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 msgr2=0x55811a1cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3654009e50 tx=0x7f365402e000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 -- 172.21.15.52:0/641201369 shutdown_connections 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a1587f0 0x55811a1cfd00 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a156410 0x55811a1cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 --2- 172.21.15.52:0/641201369 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a12fb70 0x55811a1663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 -- 172.21.15.52:0/641201369 >> 172.21.15.52:0/641201369 conn(0x55811a155fb0 msgr2=0x55811a14cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 -- 172.21.15.52:0/641201369 shutdown_connections 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.397+0000 7f366506f740 1 -- 172.21.15.52:0/641201369 wait complete. 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.398+0000 7f366506f740 1 -- start start 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.398+0000 7f366506f740 1 Processor -- start 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a156410 0x55811a1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a1587f0 0x55811a156d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55811a13a990 con 0x55811a12fb70 2024-09-10T08:37:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1ff4e0 con 0x55811a1587f0 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55811a158470 con 0x55811a156410 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f366506f740 10 client.0 _ll_register_callbacks cb 0x7f364c007f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40492/0 (socket says 172.21.15.52:40492) 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 -- 172.21.15.52:0/985884344 learned_addr learned my addr 172.21.15.52:0/985884344 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365be00640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a1587f0 0x55811a156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f3653e00640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a156410 0x55811a1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 -- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a156410 msgr2=0x55811a1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a156410 0x55811a1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 -- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a1587f0 msgr2=0x55811a156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.399+0000 7f365b400640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a1587f0 0x55811a156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f365b400640 1 -- 172.21.15.52:0/985884344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811a15da60 con 0x55811a12fb70 2024-09-10T08:37:06.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f365b400640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f364c055170 tx=0x7f364c06e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d824b6c3442b2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c066060 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f364c057dd0 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3654037040 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f364c06c050 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f366506f740 10 client.8091 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55811a15da60 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654037040 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.400+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f364c061a90 con 0x55811a12fb70 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 10 client.8091 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 10 client.8091 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 20 client.8091 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a136290 0x55811a1d81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 4 client.8091 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T08:37:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55811a158640 con 0x55811a136290 2024-09-10T08:37:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f3653e00640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a136290 0x55811a1d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f363fe00640 10 client.8091 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.401+0000 7f3653e00640 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a136290 0x55811a1d81f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0bea14c83ac98b server_cookie=ab14fdbf31ecd2e3 in_seq=0 out_seq=0 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f363fe00640 1 -- 172.21.15.52:0/985884344 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55811a158640 con 0x55811a136290 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f363fe00640 10 client.8091 handle_command_reply: tid=0 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 client.8091 shutdown 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 msgr2=0x55811a1d4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f364c055170 tx=0x7f364c06e000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 shutdown_connections 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x55811a136290 0x55811a1d81f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55811a1587f0 0x55811a156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55811a156410 0x55811a1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 --2- 172.21.15.52:0/985884344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55811a12fb70 0x55811a1d4610 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 >> 172.21.15.52:0/985884344 conn(0x55811a155fb0 msgr2=0x55811a153950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f363fe00640 0 client.8091 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 shutdown_connections 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.404+0000 7f366506f740 1 -- 172.21.15.52:0/985884344 wait complete. 2024-09-10T08:37:06.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f366506f740 20 client.8091 trim_cache size 0 max 16384 2024-09-10T08:37:06.408 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:06.408 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:37:06.408 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "a1bc718f-dbe4-4f47-8b61-65cabfd77142", 2024-09-10T08:37:06.408 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:37:06.408 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 msgr2=0x7f363806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 0x7f363806e490 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f365c15e5f0 tx=0x7f3644009190 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 msgr2=0x7f365c1419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c490 tx=0x7f364c00c950 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 shutdown_connections 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f363806bfd0 0x7f363806e490 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f365c160550 0x7f365c143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f365c1480b0 0x7f365c15dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 --2- 172.21.15.52:0/3677756847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f365c0ae870 0x7f365c1419e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.405+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 >> 172.21.15.52:0/3677756847 conn(0x7f365c06c240 msgr2=0x7f365c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.406+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 shutdown_connections 2024-09-10T08:37:06.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.406+0000 7f3662000640 1 -- 172.21.15.52:0/3677756847 wait complete. 2024-09-10T08:37:06.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:06.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-10T08:37:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.617+0000 7f0be7200640 1 Processor -- start 2024-09-10T08:37:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.617+0000 7f0be7200640 1 -- start start 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0be00b5fd0 0x7f0be00d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0be00b63b0 0x7f0be00cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be0067950 0x7f0be0067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0be00d3950 con 0x7f0be00b63b0 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0be00d3c30 con 0x7f0be00b5fd0 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0be00d3f10 con 0x7f0be0067950 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0be00b63b0 0x7f0be00cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0be00b63b0 0x7f0be00cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40496/0 (socket says 172.21.15.52:40496) 2024-09-10T08:37:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be5400640 1 -- 172.21.15.52:0/1998494185 learned_addr learned my addr 172.21.15.52:0/1998494185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be5e00640 1 --2- 172.21.15.52:0/1998494185 >> v2:172.21.15.176:3300/0 conn(0x7f0be00b5fd0 0x7f0be00d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.618+0000 7f0be6800640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be0067950 0x7f0be0067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.619+0000 7f0be5400640 1 -- 172.21.15.52:0/1998494185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be0067950 msgr2=0x7f0be0067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.619+0000 7f0be5400640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be0067950 0x7f0be0067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.619+0000 7f0be5400640 1 -- 172.21.15.52:0/1998494185 >> v2:172.21.15.176:3300/0 conn(0x7f0be00b5fd0 msgr2=0x7f0be00d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.619+0000 7f0be5400640 1 --2- 172.21.15.52:0/1998494185 >> v2:172.21.15.176:3300/0 conn(0x7f0be00b5fd0 0x7f0be00d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.619+0000 7f0be5400640 1 -- 172.21.15.52:0/1998494185 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be00d41f0 con 0x7f0be00b63b0 2024-09-10T08:37:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.620+0000 7f0be5400640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be00b63b0 0x7f0be00cf650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0be00d5620 tx=0x7f0bd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0458e87ec378b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.620+0000 7f0be4a00640 1 -- 172.21.15.52:0/1998494185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0037070 con 0x7f0be00b63b0 2024-09-10T08:37:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.620+0000 7f0be4a00640 1 -- 172.21.15.52:0/1998494185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd0032440 con 0x7f0be00b63b0 2024-09-10T08:37:06.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.620+0000 7f0be4a00640 1 -- 172.21.15.52:0/1998494185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0032810 con 0x7f0be00b63b0 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 -- 172.21.15.52:0/1998494185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be00b63b0 msgr2=0x7f0be00cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be00b63b0 0x7f0be00cf650 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0be00d5620 tx=0x7f0bd002a270 comp rx=0 tx=0).stop 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 -- 172.21.15.52:0/1998494185 shutdown_connections 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be0067950 0x7f0be0067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 --2- 172.21.15.52:0/1998494185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be00b63b0 0x7f0be00cf650 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 --2- 172.21.15.52:0/1998494185 >> v2:172.21.15.176:3300/0 conn(0x7f0be00b5fd0 0x7f0be00d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 -- 172.21.15.52:0/1998494185 >> 172.21.15.52:0/1998494185 conn(0x7f0be00d0fd0 msgr2=0x7f0be00d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 -- 172.21.15.52:0/1998494185 shutdown_connections 2024-09-10T08:37:06.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.621+0000 7f0be7200640 1 -- 172.21.15.52:0/1998494185 wait complete. 2024-09-10T08:37:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.622+0000 7f0be7200640 1 Processor -- start 2024-09-10T08:37:06.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.623+0000 7f0be7200640 1 -- start start 2024-09-10T08:37:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.623+0000 7f0be7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.623+0000 7f0be7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0be00b5fd0 0x7f0be0154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.623+0000 7f0be7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be00b63b0 0x7f0be015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0be00cfd10 con 0x7f0be0067950 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0be00cfb90 con 0x7f0be00b5fd0 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0be00b67d0 con 0x7f0be00b63b0 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0be00b5fd0 0x7f0be0154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40504/0 (socket says 172.21.15.52:40504) 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 -- 172.21.15.52:0/108694245 learned_addr learned my addr 172.21.15.52:0/108694245 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be6800640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be00b63b0 0x7f0be015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 -- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be00b63b0 msgr2=0x7f0be015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be00b63b0 0x7f0be015cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 -- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0be00b5fd0 msgr2=0x7f0be0154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0be00b5fd0 0x7f0be0154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 -- 172.21.15.52:0/108694245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be015a3c0 con 0x7f0be0067950 2024-09-10T08:37:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.624+0000 7f0be5e00640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400e9b0 tx=0x7f0bd400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.625+0000 7f0bda000640 1 -- 172.21.15.52:0/108694245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4017070 con 0x7f0be0067950 2024-09-10T08:37:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.625+0000 7f0bda000640 1 -- 172.21.15.52:0/108694245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd400c9a0 con 0x7f0be0067950 2024-09-10T08:37:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.625+0000 7f0bda000640 1 -- 172.21.15.52:0/108694245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400cd90 con 0x7f0be0067950 2024-09-10T08:37:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.625+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be01e8c70 con 0x7f0be0067950 2024-09-10T08:37:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.625+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01e9230 con 0x7f0be0067950 2024-09-10T08:37:06.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.627+0000 7f0bda000640 1 -- 172.21.15.52:0/108694245 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bd401a070 con 0x7f0be0067950 2024-09-10T08:37:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.628+0000 7f0bda000640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 0x7f0bc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.628+0000 7f0bda000640 1 -- 172.21.15.52:0/108694245 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f0bd408af40 con 0x7f0be0067950 2024-09-10T08:37:06.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.628+0000 7f0be5400640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 0x7f0bc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.628+0000 7f0beb5bf740 1 Processor -- start 2024-09-10T08:37:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.629+0000 7f0beb5bf740 1 -- start start 2024-09-10T08:37:06.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.629+0000 7f0be5400640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 0x7f0bc406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0034000 tx=0x7f0bd002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084179a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x56084174f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56084171bcf0 con 0x560841752410 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608416b77f0 con 0x560841754c50 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56084165f800 con 0x5608417563e0 2024-09-10T08:37:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40514/0 (socket says 172.21.15.52:40514) 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 -- 172.21.15.52:0/1944409930 learned_addr learned my addr 172.21.15.52:0/1944409930 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5e00640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084179a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be6800640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x56084174f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 -- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 msgr2=0x56084174f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x56084174f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 -- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 msgr2=0x56084179a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084179a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5400640 1 -- 172.21.15.52:0/1944409930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608414947d0 con 0x560841752410 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.630+0000 7f0be5e00640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084179a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0be5400640 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0bd002a860 tx=0x7f0bd002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778ab8f50ac098af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0bce600640 1 -- 172.21.15.52:0/1944409930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd004e070 con 0x560841752410 2024-09-10T08:37:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0bce600640 1 -- 172.21.15.52:0/1944409930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd0032a90 con 0x560841752410 2024-09-10T08:37:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0bce600640 1 -- 172.21.15.52:0/1944409930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0037040 con 0x560841752410 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0beb5bf740 1 -- 172.21.15.52:0/1944409930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 msgr2=0x560841755030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f0bd002a860 tx=0x7f0bd002c000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.631+0000 7f0beb5bf740 1 -- 172.21.15.52:0/1944409930 shutdown_connections 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x56084174f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560841752410 0x560841755030 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/1944409930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084179a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 -- 172.21.15.52:0/1944409930 >> 172.21.15.52:0/1944409930 conn(0x560841751410 msgr2=0x5608417998c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 -- 172.21.15.52:0/1944409930 shutdown_connections 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 -- 172.21.15.52:0/1944409930 wait complete. 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.632+0000 7f0beb5bf740 1 -- start start 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.633+0000 7f0beb5bf740 1 Processor -- start 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.633+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x5608417ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560841640750 con 0x56084179caf0 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608416b37b0 con 0x560841754c50 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5608417508b0 con 0x5608417563e0 2024-09-10T08:37:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0beb5bf740 10 client.0 _ll_register_callbacks cb 0x5608413c9be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40522/0 (socket says 172.21.15.52:40522) 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be6800640 1 -- 172.21.15.52:0/2321040674 learned_addr learned my addr 172.21.15.52:0/2321040674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x5608417ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:45890/0 (socket says 172.21.15.52:45890) 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 -- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 msgr2=0x5608417ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x5608417ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 -- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 msgr2=0x56084179cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be5e00640 1 -- 172.21.15.52:0/2321040674 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084138a0f0 con 0x560841754c50 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.634+0000 7f0be6800640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40893a0 tx=0x7f0bd40592c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bac7c26c3643650 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3300/0 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4021030 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mon.1 v2:172.21.15.176:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f0bd4058650 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd0032a90 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f0bd4071180 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 10 client.7579 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5608414f4f60 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mon.1 v2:172.21.15.176:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd0032a90 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mon.1 v2:172.21.15.176:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f0bd4024060 con 0x560841754c50 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 10 client.7579 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 10 client.7579 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 20 client.7579 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084177ebe0 0x56084177f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 4 client.7579 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:37:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.635+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608416c4f20 con 0x56084177ebe0 2024-09-10T08:37:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.636+0000 7f0be5400640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084177ebe0 0x56084177f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.636+0000 7f0be5400640 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084177ebe0 0x56084177f010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dd03a5dec1080e server_cookie=f7655a8660a2ce48 in_seq=0 out_seq=0 2024-09-10T08:37:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.636+0000 7f0bc2a00640 10 client.7579 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2321040674 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608416c4f20 con 0x56084177ebe0 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0bc2a00640 10 client.7579 handle_command_reply: tid=0 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 client.7579 shutdown 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 msgr2=0x560841773140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40893a0 tx=0x7f0bd40592c0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 shutdown_connections 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084177ebe0 0x56084177f010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56084179caf0 0x56084179cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608417563e0 0x5608417ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2321040674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x560841773140 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0bc2a00640 0 client.7579 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 >> 172.21.15.52:0/2321040674 conn(0x560841752410 msgr2=0x560841797940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.637+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 shutdown_connections 2024-09-10T08:37:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.638+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2321040674 wait complete. 2024-09-10T08:37:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.638+0000 7f0beb5bf740 20 client.7579 trim_cache size 0 max 16384 2024-09-10T08:37:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.656+0000 7f0beb5bf740 1 Processor -- start 2024-09-10T08:37:06.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.656+0000 7f0beb5bf740 1 -- start start 2024-09-10T08:37:06.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.656+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560841754c50 0x560841772bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.656+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.656+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56084179caf0 0x5608417a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0200c10 con 0x5608417563e0 2024-09-10T08:37:06.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0159110 con 0x56084179caf0 2024-09-10T08:37:06.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0be0158470 con 0x560841754c50 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40528/0 (socket says 172.21.15.52:40528) 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 -- 172.21.15.52:0/2086210035 learned_addr learned my addr 172.21.15.52:0/2086210035 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560841754c50 0x560841772bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be6800640 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56084179caf0 0x5608417a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 -- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560841754c50 msgr2=0x560841772bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560841754c50 0x560841772bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 -- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56084179caf0 msgr2=0x5608417a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56084179caf0 0x5608417a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 -- 172.21.15.52:0/2086210035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608413631b0 con 0x5608417563e0 2024-09-10T08:37:06.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.657+0000 7f0be5400640 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0bd002a2b0 tx=0x7f0bd003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1962fa487cafce26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0bcdc00640 1 -- 172.21.15.52:0/2086210035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0063070 con 0x5608417563e0 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0bcdc00640 1 -- 172.21.15.52:0/2086210035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd005a030 con 0x5608417563e0 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0bcdc00640 1 -- 172.21.15.52:0/2086210035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd004e040 con 0x5608417563e0 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2086210035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 msgr2=0x5608417730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0bd002a2b0 tx=0x7f0bd003c000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2086210035 shutdown_connections 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x56084179caf0 0x5608417a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417730f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2086210035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560841754c50 0x560841772bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2086210035 >> 172.21.15.52:0/2086210035 conn(0x560841752410 msgr2=0x56084177bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2086210035 shutdown_connections 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.658+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2086210035 wait complete. 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.659+0000 7f0beb5bf740 1 -- start start 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.659+0000 7f0beb5bf740 1 Processor -- start 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084177bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56084179caf0 0x5608417ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56084179b970 con 0x5608417563e0 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0158ac0 con 0x560841754c50 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5608417a8d10 con 0x56084179caf0 2024-09-10T08:37:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.660+0000 7f0beb5bf740 10 client.0 _ll_register_callbacks cb 0x7f0bdc0099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40540/0 (socket says 172.21.15.52:40540) 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 -- 172.21.15.52:0/2424626323 learned_addr learned my addr 172.21.15.52:0/2424626323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084177bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be6800640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56084179caf0 0x5608417ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 -- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56084179caf0 msgr2=0x5608417ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56084179caf0 0x5608417ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 -- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 msgr2=0x56084177bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084177bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 -- 172.21.15.52:0/2424626323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56084181a7b0 con 0x5608417563e0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0be5400640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0035040 tx=0x7f0bd002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e589d29f60a1fc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0bc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.661+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0063070 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f0bd003c440 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd005a030 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f0bd004e040 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 10 client.8109 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5608417bd6c0 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd006d070 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f0bd003c680 con 0x5608417563e0 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 10 client.8109 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 10 client.8109 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 20 client.8109 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084181b250 0x5608417ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 4 client.8109 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T08:37:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.662+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5608416bf270 con 0x56084181b250 2024-09-10T08:37:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084181b250 0x5608417ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0be5e00640 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084181b250 0x5608417ad5d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c176d8613d1785f9 server_cookie=c2c2d58aff9b3372 in_seq=0 out_seq=0 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0bc2a00640 10 client.8109 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0bc2a00640 1 -- 172.21.15.52:0/2424626323 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608416bf270 con 0x56084181b250 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0bc2a00640 10 client.8109 handle_command_reply: tid=0 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0beb5bf740 1 client.8109 shutdown 2024-09-10T08:37:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 msgr2=0x5608417fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.663+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0035040 tx=0x7f0bd002c070 comp rx=0 tx=0).stop 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 shutdown_connections 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x56084181b250 0x5608417ad5d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x56084179caf0 0x5608417ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608417563e0 0x5608417fcea0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 --2- 172.21.15.52:0/2424626323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560841754c50 0x56084177bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0bc2a00640 0 client.8109 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 >> 172.21.15.52:0/2424626323 conn(0x560841752410 msgr2=0x56084179d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 shutdown_connections 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 1 -- 172.21.15.52:0/2424626323 wait complete. 2024-09-10T08:37:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.664+0000 7f0beb5bf740 20 client.8109 trim_cache size 0 max 16384 2024-09-10T08:37:06.670 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:06.670 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:37:06.670 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:37:06.670 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 msgr2=0x7f0bc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 0x7f0bc406e2f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0034000 tx=0x7f0bd002e000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 msgr2=0x7f0be01e9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400e9b0 tx=0x7f0bd400ee70 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 shutdown_connections 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bc406be30 0x7f0bc406e2f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0be00b63b0 0x7f0be015cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0be00b5fd0 0x7f0be0154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 --2- 172.21.15.52:0/108694245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0be0067950 0x7f0be01e9750 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 >> 172.21.15.52:0/108694245 conn(0x7f0be00d0fd0 msgr2=0x7f0be00d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 shutdown_connections 2024-09-10T08:37:06.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.665+0000 7f0be7200640 1 -- 172.21.15.52:0/108694245 wait complete. 2024-09-10T08:37:06.680 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:37:06.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-10T08:37:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.838+0000 7fc906600640 1 Processor -- start 2024-09-10T08:37:06.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.838+0000 7fc906600640 1 -- start start 2024-09-10T08:37:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc906600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9000cce30 0x7fc9000cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc906600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc900071c70 0x7fc900072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc906600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9000714b0 con 0x7fc9000732e0 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc906600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc9000cd880 con 0x7fc9000cce30 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc906600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9000cdb60 con 0x7fc900071c70 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc8fea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9000cce30 0x7fc9000cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc8fea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9000cce30 0x7fc9000cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40554/0 (socket says 172.21.15.52:40554) 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.839+0000 7fc8fea00640 1 -- 172.21.15.52:0/3217515811 learned_addr learned my addr 172.21.15.52:0/3217515811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.840+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc900071c70 0x7fc900072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.840+0000 7fc8fea00640 1 -- 172.21.15.52:0/3217515811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc900071c70 msgr2=0x7fc900072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.840+0000 7fc8fea00640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc900071c70 0x7fc900072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.840+0000 7fc8fea00640 1 -- 172.21.15.52:0/3217515811 >> v1:172.21.15.52:6789/0 conn(0x7fc9000732e0 legacy=0x7fc9000736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.840+0000 7fc8fea00640 1 -- 172.21.15.52:0/3217515811 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9000cde40 con 0x7fc9000cce30 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.841+0000 7fc8fea00640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9000cce30 0x7fc9000cd2a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4290d3195b7ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.841+0000 7fc8fe000640 1 -- 172.21.15.52:0/3217515811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec037070 con 0x7fc9000cce30 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.841+0000 7fc8fe000640 1 -- 172.21.15.52:0/3217515811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec032440 con 0x7fc9000cce30 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.841+0000 7fc8fe000640 1 -- 172.21.15.52:0/3217515811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec032810 con 0x7fc9000cce30 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 -- 172.21.15.52:0/3217515811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9000cce30 msgr2=0x7fc9000cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9000cce30 0x7fc9000cd2a0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009870 tx=0x7fc8ec02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 -- 172.21.15.52:0/3217515811 shutdown_connections 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc900071c70 0x7fc900072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 --2- 172.21.15.52:0/3217515811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9000cce30 0x7fc9000cd2a0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 -- 172.21.15.52:0/3217515811 >> 172.21.15.52:0/3217515811 conn(0x7fc90006d0f0 msgr2=0x7fc90006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 -- 172.21.15.52:0/3217515811 shutdown_connections 2024-09-10T08:37:06.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.842+0000 7fc906600640 1 -- 172.21.15.52:0/3217515811 wait complete. 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.843+0000 7fc906600640 1 Processor -- start 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.843+0000 7fc906600640 1 -- start start 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 0x7fc900147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 0x7fc9001f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc90015ca50 con 0x7fc900071c70 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc90015c8d0 con 0x7fc9000cce30 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.844+0000 7fc906600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc90015cbd0 con 0x7fc9000732e0 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40566/0 (socket says 172.21.15.52:40566) 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 -- 172.21.15.52:0/1560383289 learned_addr learned my addr 172.21.15.52:0/1560383289 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 0x7fc9001f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8fea00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 0x7fc900147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 -- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 msgr2=0x7fc900147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 0x7fc900147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 -- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 msgr2=0x7fc9001f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 0x7fc9001f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 -- 172.21.15.52:0/1560383289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9001f7ca0 con 0x7fc900071c70 2024-09-10T08:37:06.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 0x7fc9001f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8fea00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 0x7fc900147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.845+0000 7fc8ff400640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c400 tx=0x7fc8f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.846+0000 7fc8f7400640 1 -- 172.21.15.52:0/1560383289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f00052d0 con 0x7fc900071c70 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.846+0000 7fc8f7400640 1 -- 172.21.15.52:0/1560383289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f0005490 con 0x7fc900071c70 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.846+0000 7fc8f7400640 1 -- 172.21.15.52:0/1560383289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0007260 con 0x7fc900071c70 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.846+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc900145390 con 0x7fc900071c70 2024-09-10T08:37:06.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.846+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc900148260 con 0x7fc900071c70 2024-09-10T08:37:06.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.848+0000 7fc8f7400640 1 -- 172.21.15.52:0/1560383289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8f0007400 con 0x7fc900071c70 2024-09-10T08:37:06.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.848+0000 7fc8f7400640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 0x7fc8e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.849+0000 7fc8f7400640 1 -- 172.21.15.52:0/1560383289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fc8f008a440 con 0x7fc900071c70 2024-09-10T08:37:06.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.849+0000 7fc8fea00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 0x7fc8e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.849+0000 7fc909604740 1 Processor -- start 2024-09-10T08:37:06.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.849+0000 7fc909604740 1 -- start start 2024-09-10T08:37:06.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc8fea00640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 0x7fc8e006e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec034000 tx=0x7fc8ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fd2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 0x556b51fd2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556b51eef660 con 0x556b51fa1420 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556b51e97680 con 0x556b51f87480 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.850+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556b51eeb620 con 0x556b51fa1800 2024-09-10T08:37:06.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40574/0 (socket says 172.21.15.52:40574) 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 -- 172.21.15.52:0/3589194718 learned_addr learned my addr 172.21.15.52:0/3589194718 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8fea00640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fd2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 0x556b51fd2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 -- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 msgr2=0x556b51fd2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fd2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 -- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 msgr2=0x556b51fd2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 0x556b51fd2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 -- 172.21.15.52:0/3589194718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b51ccc7d0 con 0x556b51fa1420 2024-09-10T08:37:06.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 0x556b51fd2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:06.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.851+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00585e0 tx=0x7fc8f000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6ffd8a7120ada server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc8ebe00640 1 -- 172.21.15.52:0/3589194718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0056950 con 0x556b51fa1420 2024-09-10T08:37:06.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc8ebe00640 1 -- 172.21.15.52:0/3589194718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f0054cc0 con 0x556b51fa1420 2024-09-10T08:37:06.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc8ebe00640 1 -- 172.21.15.52:0/3589194718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f005db90 con 0x556b51fa1420 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 -- 172.21.15.52:0/3589194718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 msgr2=0x556b51fd1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc8f00585e0 tx=0x7fc8f000a000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 -- 172.21.15.52:0/3589194718 shutdown_connections 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51f87480 0x556b51fd2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fd2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 --2- 172.21.15.52:0/3589194718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1420 0x556b51fd1c40 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 -- 172.21.15.52:0/3589194718 >> 172.21.15.52:0/3589194718 conn(0x556b51f88220 msgr2=0x556b51fd0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 -- 172.21.15.52:0/3589194718 shutdown_connections 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.852+0000 7fc909604740 1 -- 172.21.15.52:0/3589194718 wait complete. 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.853+0000 7fc909604740 1 -- start start 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.853+0000 7fc909604740 1 Processor -- start 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b51fb5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 0x556b51fcd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51fcde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556b51f863e0 con 0x556b51fa0410 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556b51e784c0 con 0x556b51fa1800 2024-09-10T08:37:06.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556b51f866c0 con 0x556b51fa1420 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc909604740 10 client.0 _ll_register_callbacks cb 0x556b51ee7e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc8ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51fcde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc8fea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 0x556b51fcd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b51fb5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc8fea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 0x556b51fcd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:45918/0 (socket says 172.21.15.52:45918) 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.854+0000 7fc8fea00640 1 -- 172.21.15.52:0/55542883 learned_addr learned my addr 172.21.15.52:0/55542883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 -- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 msgr2=0x556b51fcd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 0x556b51fcd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 -- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 msgr2=0x556b51fcde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51fcde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 -- 172.21.15.52:0/55542883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556b51c023f0 con 0x556b51fa1420 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51fcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:06.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8ff400640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b51fb5b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0060d00 tx=0x7fc8f0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4c48184cf272c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.176:3301/0 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f005db90 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mon.2 v2:172.21.15.176:3301/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fc8f005dd30 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.855+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f0054cc0 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc8f0076050 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 10 client.6878 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x556b51bc20f0 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mon.2 v2:172.21.15.176:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f0054cc0 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mon.2 v2:172.21.15.176:3301/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fc8f0057aa0 con 0x556b51fa1420 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 10 client.6878 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 10 client.6878 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 20 client.6878 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fe44d0 0x556b51fe48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 4 client.6878 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b51efcd90 con 0x556b51fe44d0 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.856+0000 7fc8fea00640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fe44d0 0x556b51fe48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.857+0000 7fc8fea00640 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fe44d0 0x556b51fe48b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c9e326a79b11d3 server_cookie=bbbd60c4ad4595b6 in_seq=0 out_seq=0 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.857+0000 7fc8e8c00640 10 client.6878 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.857+0000 7fc8e8c00640 1 -- 172.21.15.52:0/55542883 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b51efcd90 con 0x556b51fe44d0 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.857+0000 7fc8e8c00640 10 client.6878 handle_command_reply: tid=0 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 client.6878 shutdown 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 msgr2=0x556b51fb5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b51fb5b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0060d00 tx=0x7fc8f0000bc0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 shutdown_connections 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fe44d0 0x556b51fe48b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51fcde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1800 0x556b51fcd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc8e8c00640 0 client.6878 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 --2- 172.21.15.52:0/55542883 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b51fb5b10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 >> 172.21.15.52:0/55542883 conn(0x556b51f87480 msgr2=0x556b51f8b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 shutdown_connections 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 1 -- 172.21.15.52:0/55542883 wait complete. 2024-09-10T08:37:06.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.858+0000 7fc909604740 20 client.6878 trim_cache size 0 max 16384 2024-09-10T08:37:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 Processor -- start 2024-09-10T08:37:06.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 -- start start 2024-09-10T08:37:06.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1420 0x556b51fa0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fa0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc900200db0 con 0x556b51fa0410 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001f55c0 con 0x556b51fa1420 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.877+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9001f4900 con 0x556b51fa1800 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40592/0 (socket says 172.21.15.52:40592) 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 -- 172.21.15.52:0/3207579055 learned_addr learned my addr 172.21.15.52:0/3207579055 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8fea00640 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1420 0x556b51fa0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fa0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 -- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 msgr2=0x556b51fa0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fa0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 -- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1420 msgr2=0x556b51fa0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1420 0x556b51fa0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 -- 172.21.15.52:0/3207579055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b51fcab30 con 0x556b51fa0410 2024-09-10T08:37:06.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.878+0000 7fc8ff400640 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0058350 tx=0x7fc8f0014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2173057b873733f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc8eb400640 1 -- 172.21.15.52:0/3207579055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0054cc0 con 0x556b51fa0410 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc8eb400640 1 -- 172.21.15.52:0/3207579055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f008a0c0 con 0x556b51fa0410 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc8eb400640 1 -- 172.21.15.52:0/3207579055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0054e60 con 0x556b51fa0410 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 -- 172.21.15.52:0/3207579055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 msgr2=0x556b51f86bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0058350 tx=0x7fc8f0014070 comp rx=0 tx=0).stop 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 -- 172.21.15.52:0/3207579055 shutdown_connections 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1800 0x556b51fa0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa1420 0x556b51fa0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 --2- 172.21.15.52:0/3207579055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa0410 0x556b51f86bb0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 -- 172.21.15.52:0/3207579055 >> 172.21.15.52:0/3207579055 conn(0x556b51f87480 msgr2=0x556b51fcfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 -- 172.21.15.52:0/3207579055 shutdown_connections 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.879+0000 7fc909604740 1 -- 172.21.15.52:0/3207579055 wait complete. 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.880+0000 7fc909604740 1 -- start start 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.880+0000 7fc909604740 1 Processor -- start 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 0x556b51fcfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b5204dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9001f4f50 con 0x556b51fa1800 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556b51f8d9a0 con 0x556b51fa0410 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556b51ff4250 con 0x556b51fa1420 2024-09-10T08:37:06.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc909604740 10 client.0 _ll_register_callbacks cb 0x7fc8f0058d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc8ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc8ff400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 0x556b51fcfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc8fea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b5204dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc8ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40606/0 (socket says 172.21.15.52:40606) 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.881+0000 7fc8ffe00640 1 -- 172.21.15.52:0/64591918 learned_addr learned my addr 172.21.15.52:0/64591918 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 -- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 msgr2=0x556b5204dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b5204dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 -- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 msgr2=0x556b51fcfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 0x556b51fcfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 -- 172.21.15.52:0/64591918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b51fca5a0 con 0x556b51fa1800 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ff400640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 0x556b51fcfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8ffe00640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8007f20 tx=0x7fc8f80167d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315bc5243a691e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8018630 con 0x556b51fa1800 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fc8f80187d0 con 0x556b51fa1800 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.882+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8f008a0c0 con 0x556b51fa1800 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc8f802a050 con 0x556b51fa1800 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 10 client.8130 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:06.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x556b5204e110 con 0x556b51fa1800 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f008a0c0 con 0x556b51fa1800 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fc8f802d020 con 0x556b51fa1800 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 10 client.8130 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 10 client.8130 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 20 client.8130 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fc9bc0 0x556b51fa0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 4 client.8130 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b51ef70e0 con 0x556b51fc9bc0 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.883+0000 7fc8ff400640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fc9bc0 0x556b51fa0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:06.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc8ff400640 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fc9bc0 0x556b51fa0890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ee733259e08fbc server_cookie=963b2f05362dcdbc in_seq=0 out_seq=0 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc8e8c00640 10 client.8130 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc8e8c00640 1 -- 172.21.15.52:0/64591918 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x556b51ef70e0 con 0x556b51fc9bc0 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc8e8c00640 10 client.8130 handle_command_reply: tid=0 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 client.8130 shutdown 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 msgr2=0x556b51fcb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8007f20 tx=0x7fc8f80167d0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 shutdown_connections 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x556b51fc9bc0 0x556b51fa0890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556b51fa1800 0x556b51fcb7e0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556b51fa1420 0x556b5204dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 --2- 172.21.15.52:0/64591918 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556b51fa0410 0x556b51fcfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 >> 172.21.15.52:0/64591918 conn(0x556b51f87480 msgr2=0x556b51fcd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.884+0000 7fc8e8c00640 0 client.8130 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 shutdown_connections 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc909604740 1 -- 172.21.15.52:0/64591918 wait complete. 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc909604740 20 client.8130 trim_cache size 0 max 16384 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "a1bc718f-dbe4-4f47-8b61-65cabfd77142": { 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_control_test_path", 2024-09-10T08:37:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "a1bc718f-dbe4-4f47-8b61-65cabfd77142", 2024-09-10T08:37:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:37:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:06.891 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 msgr2=0x7fc8e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 0x7fc8e006e2f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec034000 tx=0x7fc8ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 msgr2=0x7fc900144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c400 tx=0x7fc8f000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 shutdown_connections 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc8e006be30 0x7fc8e006e2f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9000cce30 0x7fc9001f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9000732e0 0x7fc900147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 --2- 172.21.15.52:0/1560383289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc900071c70 0x7fc900144e50 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 >> 172.21.15.52:0/1560383289 conn(0x7fc90006d0f0 msgr2=0x7fc9000736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.885+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 shutdown_connections 2024-09-10T08:37:06.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:06.886+0000 7fc906600640 1 -- 172.21.15.52:0/1560383289 wait complete. 2024-09-10T08:37:07.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:07.138 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:11.902 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:37:11.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-10T08:37:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.071+0000 7f3129a00640 1 Processor -- start 2024-09-10T08:37:12.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.071+0000 7f3129a00640 1 -- start start 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.072+0000 7f3129a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f312415b7c0 0x7f31240b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f3129a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240cead0 0x7f3124071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f3129a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31240cf2e0 con 0x7f31240ccf30 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f3129a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3124070fe0 con 0x7f312415b7c0 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f3129a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31240712c0 con 0x7f31240cead0 2024-09-10T08:37:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f312415b7c0 0x7f31240b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f312415b7c0 0x7f31240b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40616/0 (socket says 172.21.15.52:40616) 2024-09-10T08:37:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 -- 172.21.15.52:0/214862470 learned_addr learned my addr 172.21.15.52:0/214862470 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f3123400640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240cead0 0x7f3124071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 -- 172.21.15.52:0/214862470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240cead0 msgr2=0x7f3124071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240cead0 0x7f3124071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 -- 172.21.15.52:0/214862470 >> v1:172.21.15.176:6789/0 conn(0x7f31240ccf30 legacy=0x7f31240cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.073+0000 7f311be00640 1 -- 172.21.15.52:0/214862470 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31240715a0 con 0x7f312415b7c0 2024-09-10T08:37:12.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.074+0000 7f311be00640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f312415b7c0 0x7f31240b2c50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a9c2a73fb1cc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3122000640 1 -- 172.21.15.52:0/214862470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c037070 con 0x7f312415b7c0 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3122000640 1 -- 172.21.15.52:0/214862470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c032440 con 0x7f312415b7c0 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3122000640 1 -- 172.21.15.52:0/214862470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c032810 con 0x7f312415b7c0 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 -- 172.21.15.52:0/214862470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f312415b7c0 msgr2=0x7f31240b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f312415b7c0 0x7f31240b2c50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 -- 172.21.15.52:0/214862470 shutdown_connections 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240cead0 0x7f3124071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 --2- 172.21.15.52:0/214862470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f312415b7c0 0x7f31240b2c50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 -- 172.21.15.52:0/214862470 >> 172.21.15.52:0/214862470 conn(0x7f312406d0f0 msgr2=0x7f312406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 -- 172.21.15.52:0/214862470 shutdown_connections 2024-09-10T08:37:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.075+0000 7f3129a00640 1 -- 172.21.15.52:0/214862470 wait complete. 2024-09-10T08:37:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.077+0000 7f3129a00640 1 Processor -- start 2024-09-10T08:37:12.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.077+0000 7f3129a00640 1 -- start start 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 0x7f31241f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 0x7f3124154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31240cf0c0 con 0x7f31240cead0 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31240cef40 con 0x7f312415b7c0 2024-09-10T08:37:12.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3129a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3124072000 con 0x7f31240ccf30 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f311be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f311be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40622/0 (socket says 172.21.15.52:40622) 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f311be00640 1 -- 172.21.15.52:0/2252928259 learned_addr learned my addr 172.21.15.52:0/2252928259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3122a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 0x7f31241f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.078+0000 7f3123400640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 0x7f3124154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 -- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 msgr2=0x7f31241f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 0x7f31241f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 -- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 msgr2=0x7f3124154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 0x7f3124154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 -- 172.21.15.52:0/2252928259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31241f56e0 con 0x7f31240cead0 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f3122a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 0x7f31241f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f3123400640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 0x7f3124154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:12.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311be00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f310c02a200 tx=0x7f310c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311aa00640 1 -- 172.21.15.52:0/2252928259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c041020 con 0x7f31240cead0 2024-09-10T08:37:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311aa00640 1 -- 172.21.15.52:0/2252928259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0306e0 con 0x7f31240cead0 2024-09-10T08:37:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f311aa00640 1 -- 172.21.15.52:0/2252928259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c037040 con 0x7f31240cead0 2024-09-10T08:37:12.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31240cc5c0 con 0x7f31240cead0 2024-09-10T08:37:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.079+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3124153a20 con 0x7f31240cead0 2024-09-10T08:37:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.081+0000 7f311aa00640 1 -- 172.21.15.52:0/2252928259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f310c044020 con 0x7f31240cead0 2024-09-10T08:37:12.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.082+0000 7f311aa00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.082+0000 7f311aa00640 1 -- 172.21.15.52:0/2252928259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f310c0ab6f0 con 0x7f31240cead0 2024-09-10T08:37:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.083+0000 7f3122a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.083+0000 7f312c8c2740 1 Processor -- start 2024-09-10T08:37:12.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.083+0000 7f312c8c2740 1 -- start start 2024-09-10T08:37:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.083+0000 7f3122a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f312415a2b0 tx=0x7f3114009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47b4480 0x5608e47ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608e471c660 con 0x5608e47ce800 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608e46c4680 con 0x5608e47ce420 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5608e4718620 con 0x5608e47b4480 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.084+0000 7f311be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40634/0 (socket says 172.21.15.52:40634) 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 -- 172.21.15.52:0/3020294089 learned_addr learned my addr 172.21.15.52:0/3020294089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f3122a00640 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f3123400640 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47b4480 0x5608e47ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 -- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47b4480 msgr2=0x5608e47ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47b4480 0x5608e47ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 -- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 msgr2=0x5608e47fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 -- 172.21.15.52:0/3020294089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e44f97d0 con 0x5608e47ce800 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f311be00640 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f310c0a9ac0 tx=0x7f310c079260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1601053361f5339c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f3113400640 1 -- 172.21.15.52:0/3020294089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c079900 con 0x5608e47ce800 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f3113400640 1 -- 172.21.15.52:0/3020294089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c07dcb0 con 0x5608e47ce800 2024-09-10T08:37:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.085+0000 7f3113400640 1 -- 172.21.15.52:0/3020294089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0824e0 con 0x5608e47ce800 2024-09-10T08:37:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 -- 172.21.15.52:0/3020294089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 msgr2=0x5608e47ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f310c0a9ac0 tx=0x7f310c079260 comp rx=0 tx=0).stop 2024-09-10T08:37:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 -- 172.21.15.52:0/3020294089 shutdown_connections 2024-09-10T08:37:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47b4480 0x5608e47ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce800 0x5608e47ff200 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 --2- 172.21.15.52:0/3020294089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 -- 172.21.15.52:0/3020294089 >> 172.21.15.52:0/3020294089 conn(0x5608e47b5220 msgr2=0x5608e47fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 -- 172.21.15.52:0/3020294089 shutdown_connections 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.086+0000 7f312c8c2740 1 -- 172.21.15.52:0/3020294089 wait complete. 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.087+0000 7f312c8c2740 1 -- start start 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.087+0000 7f312c8c2740 1 Processor -- start 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 0x5608e47e2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608e471c660 con 0x5608e47ce420 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5608e46a54c0 con 0x5608e47b2b50 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5608e47b33e0 con 0x5608e47ce800 2024-09-10T08:37:12.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f312c8c2740 10 client.0 _ll_register_callbacks cb 0x5608e4714e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40636/0 (socket says 172.21.15.52:40636) 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f3122a00640 1 -- 172.21.15.52:0/1951030832 learned_addr learned my addr 172.21.15.52:0/1951030832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f311be00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.088+0000 7f3123400640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 0x5608e47e2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 -- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 msgr2=0x5608e47b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 -- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 msgr2=0x5608e47e2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 0x5608e47e2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 -- 172.21.15.52:0/1951030832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e442f3f0 con 0x5608e47ce420 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3123400640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 0x5608e47e2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3122a00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f311400ea90 tx=0x7f3114000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4cd83d54debd7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3107e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114027060 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f3114010040 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.089+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c07dcb0 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3114001d30 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 10 client.8142 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5608e43ef0f0 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c07dcb0 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f3114022430 con 0x5608e47ce420 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 10 client.8142 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 10 client.8142 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 20 client.8142 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b7d80 0x5608e47b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 4 client.8142 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:37:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e4729d90 con 0x5608e47b7d80 2024-09-10T08:37:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.090+0000 7f311be00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b7d80 0x5608e47b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.091+0000 7f311be00640 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b7d80 0x5608e47b8190 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2343bf6adc897bc1 server_cookie=cb7e163c57d5ff5 in_seq=0 out_seq=0 2024-09-10T08:37:12.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.091+0000 7f3107e00640 10 client.8142 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.091+0000 7f3107e00640 1 -- 172.21.15.52:0/1951030832 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608e4729d90 con 0x5608e47b7d80 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.091+0000 7f3107e00640 10 client.8142 handle_command_reply: tid=0 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 client.8142 shutdown 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 msgr2=0x5608e47fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f311400ea90 tx=0x7f3114000bc0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 shutdown_connections 2024-09-10T08:37:12.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b7d80 0x5608e47b8190 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47b2b50 0x5608e47e2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f3107e00640 0 client.8142 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1951030832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47ce420 0x5608e47fb060 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 >> 172.21.15.52:0/1951030832 conn(0x5608e47b4480 msgr2=0x5608e47fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 shutdown_connections 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 1 -- 172.21.15.52:0/1951030832 wait complete. 2024-09-10T08:37:12.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.092+0000 7f312c8c2740 20 client.8142 trim_cache size 0 max 16384 2024-09-10T08:37:12.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.110+0000 7f312c8c2740 1 Processor -- start 2024-09-10T08:37:12.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.110+0000 7f312c8c2740 1 -- start start 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce420 0x5608e47cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 0x5608e47ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31241f8a00 con 0x5608e47b2b50 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31241eeb10 con 0x5608e47ce800 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.111+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f312415ca20 con 0x5608e47ce420 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40646/0 (socket says 172.21.15.52:40646) 2024-09-10T08:37:12.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 -- 172.21.15.52:0/1964073726 learned_addr learned my addr 172.21.15.52:0/1964073726 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f311be00640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce420 0x5608e47cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3123400640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 0x5608e47ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 -- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce420 msgr2=0x5608e47cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce420 0x5608e47cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 -- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 msgr2=0x5608e47ff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 0x5608e47ff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 -- 172.21.15.52:0/1964073726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e4800740 con 0x5608e47b2b50 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3123400640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 0x5608e47ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.112+0000 7f3122a00640 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f31140014a0 tx=0x7f311401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1494f3182ba9ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f3112a00640 1 -- 172.21.15.52:0/1964073726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114031020 con 0x5608e47b2b50 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f3112a00640 1 -- 172.21.15.52:0/1964073726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3114003d80 con 0x5608e47b2b50 2024-09-10T08:37:12.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f3112a00640 1 -- 172.21.15.52:0/1964073726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114022430 con 0x5608e47b2b50 2024-09-10T08:37:12.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 -- 172.21.15.52:0/1964073726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 msgr2=0x5608e47fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f31140014a0 tx=0x7f311401f000 comp rx=0 tx=0).stop 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 -- 172.21.15.52:0/1964073726 shutdown_connections 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce800 0x5608e47ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce420 0x5608e47cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 --2- 172.21.15.52:0/1964073726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e47fd9d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 -- 172.21.15.52:0/1964073726 >> 172.21.15.52:0/1964073726 conn(0x5608e47b4480 msgr2=0x5608e47cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 -- 172.21.15.52:0/1964073726 shutdown_connections 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.113+0000 7f312c8c2740 1 -- 172.21.15.52:0/1964073726 wait complete. 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.114+0000 7f312c8c2740 1 -- start start 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.114+0000 7f312c8c2740 1 Processor -- start 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608e47f7270 con 0x5608e47b2b50 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f31241ee4c0 con 0x5608e47ce420 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5608e47b4fd0 con 0x5608e47ce800 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f312c8c2740 10 client.0 _ll_register_callbacks cb 0x7f3114001c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f3122a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40660/0 (socket says 172.21.15.52:40660) 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f3122a00640 1 -- 172.21.15.52:0/2228698829 learned_addr learned my addr 172.21.15.52:0/2228698829 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f3123400640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.115+0000 7f311be00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 -- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 msgr2=0x5608e47b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 -- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 msgr2=0x5608e47fe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 -- 172.21.15.52:0/2228698829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e47cd090 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3123400640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3122a00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f311400e530 tx=0x7f3114005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd48a0e82160600 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3107e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311403c060 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3114003d80 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.116+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f3114022930 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3114042050 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 10 client.8148 fetch_fsmap learned FSMap version 93 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5608e47fff90 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3114003d80 con 0x5608e47b2b50 2024-09-10T08:37:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f3114045020 con 0x5608e47b2b50 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 10 client.8148 fetch_fsmap finished waiting for FSMap version 93 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 10 client.8148 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 20 client.8148 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b1ff0 0x5608e4820d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 4 client.8148 mds_command: new command op to 7450 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 --> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608e47240e0 con 0x5608e47b1ff0 2024-09-10T08:37:12.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.117+0000 7f311be00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b1ff0 0x5608e4820d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f311be00640 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b1ff0 0x5608e4820d10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ded9defde97310 server_cookie=7b6566dc8ef4580e in_seq=0 out_seq=0 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f3107e00640 10 client.8148 ms_handle_connect on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f3107e00640 1 -- 172.21.15.52:0/2228698829 <== mds.0 v2:172.21.15.52:6833/3294209549 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5608e47240e0 con 0x5608e47b1ff0 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f3107e00640 10 client.8148 handle_command_reply: tid=0 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 client.8148 shutdown 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 msgr2=0x5608e487bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f311400e530 tx=0x7f3114005000 comp rx=0 tx=0).stop 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 shutdown_connections 2024-09-10T08:37:12.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:6833/3294209549,v1:172.21.15.52:6835/3294209549] conn(0x5608e47b1ff0 0x5608e4820d10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5608e47ce800 0x5608e47b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5608e47ce420 0x5608e47fe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 --2- 172.21.15.52:0/2228698829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608e47b2b50 0x5608e487bd10 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f3107e00640 0 client.8148 ms_handle_reset on v2:172.21.15.52:6833/3294209549 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.118+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 >> 172.21.15.52:0/2228698829 conn(0x5608e47b4480 msgr2=0x5608e47ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 shutdown_connections 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f312c8c2740 1 -- 172.21.15.52:0/2228698829 wait complete. 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f312c8c2740 20 client.8148 trim_cache size 0 max 16384 2024-09-10T08:37:12.124 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:12.125 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:37:12.125 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:37:12.125 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:12.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 msgr2=0x7f310006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 0x7f310006e2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f312415a2b0 tx=0x7f3114009040 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 msgr2=0x7f312415e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f310c02a200 tx=0x7f310c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 shutdown_connections 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f310006be30 0x7f310006e2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f312415b7c0 0x7f3124154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31240cead0 0x7f312415e380 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 --2- 172.21.15.52:0/2252928259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f31240ccf30 0x7f31241f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 >> 172.21.15.52:0/2252928259 conn(0x7f312406d0f0 msgr2=0x7f31240ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 shutdown_connections 2024-09-10T08:37:12.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.119+0000 7f3129a00640 1 -- 172.21.15.52:0/2252928259 wait complete. 2024-09-10T08:37:12.135 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:37:12.135 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:12.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.290+0000 7fe556400640 1 Processor -- start 2024-09-10T08:37:12.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.290+0000 7fe556400640 1 -- start start 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.291+0000 7fe556400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe55006c320 0x7fe55015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.291+0000 7fe556400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe55015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.291+0000 7fe556400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe550071180 con 0x7fe5500b2d40 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.291+0000 7fe556400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe550071ab0 con 0x7fe55006c320 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.291+0000 7fe556400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe550071460 con 0x7fe55013eb20 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe5500b2d40 0x7fe55006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:49518/0 (socket says 172.21.15.52:49518) 2024-09-10T08:37:12.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54f400640 1 -- 172.21.15.52:0/3627439280 learned_addr learned my addr 172.21.15.52:0/3627439280 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:12.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe547e00640 1 --2- 172.21.15.52:0/3627439280 >> v2:172.21.15.176:3300/0 conn(0x7fe55006c320 0x7fe55015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54fe00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe55015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429716272 0 0) 0x7fe550071180 con 0x7fe5500b2d40 2024-09-10T08:37:12.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe534003520 con 0x7fe5500b2d40 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 8725020 0 0) 0x7fe534003520 con 0x7fe5500b2d40 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 msgr2=0x7fe55015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe55015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 >> v2:172.21.15.176:3300/0 conn(0x7fe55006c320 msgr2=0x7fe55015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.292+0000 7fe54ea00640 1 --2- 172.21.15.52:0/3627439280 >> v2:172.21.15.176:3300/0 conn(0x7fe55006c320 0x7fe55015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe550071740 con 0x7fe5500b2d40 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fe540001670 con 0x7fe5500b2d40 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 >> v1:172.21.15.52:6789/0 conn(0x7fe5500b2d40 legacy=0x7fe55006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5340039b0 0x7fe534003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534004800 0x7fe534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe5340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe550071ab0 con 0x7fe5340039b0 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe550071460 con 0x7fe534004800 2024-09-10T08:37:12.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe53400b9c0 con 0x7fe55013eb20 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5340039b0 0x7fe534003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe547e00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534004800 0x7fe534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54fe00640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe5340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 -- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 msgr2=0x7fe5340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe55013eb20 0x7fe5340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 -- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534004800 msgr2=0x7fe534004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe534004800 0x7fe534004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.293+0000 7fe54f400640 1 -- 172.21.15.52:0/3627439280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe534003520 con 0x7fe5340039b0 2024-09-10T08:37:12.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.294+0000 7fe54f400640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5340039b0 0x7fe534003dd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c240 tx=0x7fe534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e76620aa288a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54002e070 con 0x7fe5340039b0 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe540005ad0 con 0x7fe5340039b0 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe54ea00640 1 -- 172.21.15.52:0/3627439280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540007d30 con 0x7fe5340039b0 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe556400640 1 -- 172.21.15.52:0/3627439280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5340039b0 msgr2=0x7fe534003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe556400640 1 --2- 172.21.15.52:0/3627439280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5340039b0 0x7fe534003dd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c240 tx=0x7fe534005830 comp rx=0 tx=0).stop 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe54fe00640 1 -- 172.21.15.52:0/3627439280 reap_dead start 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe556400640 1 -- 172.21.15.52:0/3627439280 shutdown_connections 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.295+0000 7fe556400640 1 -- 172.21.15.52:0/3627439280 >> 172.21.15.52:0/3627439280 conn(0x7fe5500ccec0 msgr2=0x7fe5500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.296+0000 7fe556400640 1 -- 172.21.15.52:0/3627439280 shutdown_connections 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.296+0000 7fe556400640 1 -- 172.21.15.52:0/3627439280 wait complete. 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.297+0000 7fe556400640 1 Processor -- start 2024-09-10T08:37:12.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.297+0000 7fe556400640 1 -- start start 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5340039b0 0x7fe5501f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe55015cb10 0x7fe5501ee310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe55015c600 con 0x7fe5500c9f50 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe55015c480 con 0x7fe55015cb10 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe556400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe55015c780 con 0x7fe5340039b0 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe54fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40676/0 (socket says 172.21.15.52:40676) 2024-09-10T08:37:12.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.298+0000 7fe54fe00640 1 -- 172.21.15.52:0/3378506138 learned_addr learned my addr 172.21.15.52:0/3378506138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54f400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5340039b0 0x7fe5501f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe547e00640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe55015cb10 0x7fe5501ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 -- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5340039b0 msgr2=0x7fe5501f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5340039b0 0x7fe5501f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 -- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe55015cb10 msgr2=0x7fe5501ee310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe55015cb10 0x7fe5501ee310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 -- 172.21.15.52:0/3378506138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501ee850 con 0x7fe5500c9f50 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe54fe00640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe548011c80 tx=0x7fe54800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.299+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548011e90 con 0x7fe5500c9f50 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.300+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54801d070 con 0x7fe5500c9f50 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.300+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548015670 con 0x7fe5500c9f50 2024-09-10T08:37:12.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.300+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5500ccbc0 con 0x7fe5500c9f50 2024-09-10T08:37:12.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.300+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55015eab0 con 0x7fe5500c9f50 2024-09-10T08:37:12.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.301+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55015af40 con 0x7fe5500c9f50 2024-09-10T08:37:12.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.302+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe548015810 con 0x7fe5500c9f50 2024-09-10T08:37:12.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.302+0000 7fe547400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 0x7fe52c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.302+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fe54808b790 con 0x7fe5500c9f50 2024-09-10T08:37:12.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.303+0000 7fe54f400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 0x7fe52c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.304+0000 7fe54f400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 0x7fe52c06e490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe540033000 tx=0x7fe540009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.307+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5501ee850 con 0x7fe5500c9f50 2024-09-10T08:37:12.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.529+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe55006c9c0 con 0x7fe5500c9f50 2024-09-10T08:37:12.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.530+0000 7fe547400640 1 -- 172.21.15.52:0/3378506138 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7fe548010040 con 0x7fe5500c9f50 2024-09-10T08:37:12.530 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:12.530 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:12.530 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 msgr2=0x7fe52c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 0x7fe52c06e490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe540033000 tx=0x7fe540009030 comp rx=0 tx=0).stop 2024-09-10T08:37:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 msgr2=0x7fe55015f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe548011c80 tx=0x7fe54800f580 comp rx=0 tx=0).stop 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 shutdown_connections 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe52c06bfd0 0x7fe52c06e490 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5500c9f50 0x7fe55015f590 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe55015cb10 0x7fe5501ee310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 --2- 172.21.15.52:0/3378506138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5340039b0 0x7fe5501f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 >> 172.21.15.52:0/3378506138 conn(0x7fe5500ccec0 msgr2=0x7fe550157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 shutdown_connections 2024-09-10T08:37:12.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.532+0000 7fe556400640 1 -- 172.21.15.52:0/3378506138 wait complete. 2024-09-10T08:37:12.548 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:37:12.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:37:12.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.705+0000 7fab8ca00640 1 Processor -- start 2024-09-10T08:37:12.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.705+0000 7fab8ca00640 1 -- start start 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e5c0 0x7fab880d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab8ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab8815e9a0 0x7fab880cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab8ca00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab880d2610 con 0x7fab880cfce0 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab8ca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fab880d2d10 con 0x7fab8815e9a0 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab8ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fab880d2ff0 con 0x7fab8815e5c0 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab8815e9a0 0x7fab880cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fab8815e9a0 0x7fab880cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40678/0 (socket says 172.21.15.52:40678) 2024-09-10T08:37:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab85e00640 1 -- 172.21.15.52:0/3023455144 learned_addr learned my addr 172.21.15.52:0/3023455144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.706+0000 7fab86800640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e5c0 0x7fab880d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.707+0000 7fab85e00640 1 -- 172.21.15.52:0/3023455144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e5c0 msgr2=0x7fab880d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.707+0000 7fab85e00640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e5c0 0x7fab880d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.707+0000 7fab85e00640 1 -- 172.21.15.52:0/3023455144 >> v1:172.21.15.176:6789/0 conn(0x7fab880cfce0 legacy=0x7fab880d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.707+0000 7fab85e00640 1 -- 172.21.15.52:0/3023455144 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880d32d0 con 0x7fab8815e9a0 2024-09-10T08:37:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.708+0000 7fab85e00640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e9a0 0x7fab880cf7a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8f7794c9ada859 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.708+0000 7fab85400640 1 -- 172.21.15.52:0/3023455144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74037070 con 0x7fab8815e9a0 2024-09-10T08:37:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.708+0000 7fab85400640 1 -- 172.21.15.52:0/3023455144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74032440 con 0x7fab8815e9a0 2024-09-10T08:37:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.708+0000 7fab85400640 1 -- 172.21.15.52:0/3023455144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74032810 con 0x7fab8815e9a0 2024-09-10T08:37:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 -- 172.21.15.52:0/3023455144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e9a0 msgr2=0x7fab880cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e9a0 0x7fab880cf7a0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402a250 comp rx=0 tx=0).stop 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 -- 172.21.15.52:0/3023455144 shutdown_connections 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e9a0 0x7fab880cf7a0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 --2- 172.21.15.52:0/3023455144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e5c0 0x7fab880d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 -- 172.21.15.52:0/3023455144 >> 172.21.15.52:0/3023455144 conn(0x7fab8806c030 msgr2=0x7fab8806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 -- 172.21.15.52:0/3023455144 shutdown_connections 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.709+0000 7fab8ca00640 1 -- 172.21.15.52:0/3023455144 wait complete. 2024-09-10T08:37:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.710+0000 7fab8ca00640 1 Processor -- start 2024-09-10T08:37:12.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.710+0000 7fab8ca00640 1 -- start start 2024-09-10T08:37:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab880cfce0 0x7fab881580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e9a0 0x7fab880ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d42f0 con 0x7fab8815e5c0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d3890 con 0x7fab880cfce0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.711+0000 7fab8ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fab880cbcd0 con 0x7fab8815e9a0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40686/0 (socket says 172.21.15.52:40686) 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 -- 172.21.15.52:0/1959991229 learned_addr learned my addr 172.21.15.52:0/1959991229 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab86800640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab880cfce0 0x7fab881580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab87200640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e9a0 0x7fab880ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 -- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e9a0 msgr2=0x7fab880ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e9a0 0x7fab880ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 -- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab880cfce0 msgr2=0x7fab881580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab880cfce0 0x7fab881580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 -- 172.21.15.52:0/1959991229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cbfb0 con 0x7fab8815e5c0 2024-09-10T08:37:12.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.712+0000 7fab85e00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fab7402a290 tx=0x7fab740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.713+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74041020 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.713+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab740306e0 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.713+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74037040 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.713+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab880cc290 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.713+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8815bab0 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.714+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab880d3db0 con 0x7fab8815e5c0 2024-09-10T08:37:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.715+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab74044020 con 0x7fab8815e5c0 2024-09-10T08:37:12.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.716+0000 7fab7ea00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 0x7fab6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:12.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.716+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fab740ab610 con 0x7fab8815e5c0 2024-09-10T08:37:12.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.716+0000 7fab86800640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 0x7fab6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:12.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.717+0000 7fab86800640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 0x7fab6806e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab78006fd0 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:12.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.720+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab7404b030 con 0x7fab8815e5c0 2024-09-10T08:37:12.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.971+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fab880d19d0 con 0x7fab8815e5c0 2024-09-10T08:37:12.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.971+0000 7fab7ea00640 1 -- 172.21.15.52:0/1959991229 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1679 (secure 0 0 0) 0x7fab74079fb0 con 0x7fab8815e5c0 2024-09-10T08:37:12.972 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:12.972 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":532,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076570829,"bytes_used":2530369536,"bytes_avail":770563743744,"bytes_total":773094113280,"write_bytes_sec":47211097,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":7450}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-10T08:37:11.580862+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 msgr2=0x7fab6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 0x7fab6806e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab78006fd0 tx=0x7fab78008040 comp rx=0 tx=0).stop 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 msgr2=0x7fab8815b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fab7402a290 tx=0x7fab740046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 shutdown_connections 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab6806be30 0x7fab6806e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fab8815e9a0 0x7fab880ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8815e5c0 0x7fab8815b570 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 --2- 172.21.15.52:0/1959991229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab880cfce0 0x7fab881580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:12.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 >> 172.21.15.52:0/1959991229 conn(0x7fab8806c030 msgr2=0x7fab8815ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:12.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 shutdown_connections 2024-09-10T08:37:12.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:12.973+0000 7fab8ca00640 1 -- 172.21.15.52:0/1959991229 wait complete. 2024-09-10T08:37:12.989 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-10T08:37:13.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.158+0000 7efe3e400640 1 Processor -- start 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.158+0000 7efe3e400640 1 -- start start 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.159+0000 7efe3e400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe380b2d40 0x7efe3806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.159+0000 7efe3e400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe38071180 con 0x7efe3813eb20 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.159+0000 7efe3e400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe38071460 con 0x7efe3806c150 2024-09-10T08:37:14.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.159+0000 7efe3e400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efe38071ab0 con 0x7efe380b2d40 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe380b2d40 0x7efe3806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe380b2d40 0x7efe3806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56932/0 (socket says 172.21.15.52:56932) 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 -- 172.21.15.52:0/1071949428 learned_addr learned my addr 172.21.15.52:0/1071949428 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe2fe00640 1 --1- 172.21.15.52:0/1071949428 >> v1:172.21.15.52:6789/0 conn(0x7efe3813eb20 0x7efe3815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46630/0 (socket says 172.21.15.52:46630) 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 -- 172.21.15.52:0/1071949428 >> v1:172.21.15.176:6789/0 conn(0x7efe3806c150 legacy=0x7efe38071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 -- 172.21.15.52:0/1071949428 >> v1:172.21.15.52:6789/0 conn(0x7efe3813eb20 legacy=0x7efe3815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.160+0000 7efe37400640 1 -- 172.21.15.52:0/1071949428 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe38071740 con 0x7efe380b2d40 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.161+0000 7efe37400640 1 --2- 172.21.15.52:0/1071949428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3806bc10 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efe28009870 tx=0x7efe2802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579968f5d30f9990 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe36a00640 1 -- 172.21.15.52:0/1071949428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28037070 con 0x7efe380b2d40 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe36a00640 1 -- 172.21.15.52:0/1071949428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe28032440 con 0x7efe380b2d40 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe36a00640 1 -- 172.21.15.52:0/1071949428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28032810 con 0x7efe380b2d40 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 -- 172.21.15.52:0/1071949428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 msgr2=0x7efe3806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 --2- 172.21.15.52:0/1071949428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3806bc10 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7efe28009870 tx=0x7efe2802a2a0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 -- 172.21.15.52:0/1071949428 shutdown_connections 2024-09-10T08:37:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 --2- 172.21.15.52:0/1071949428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3806bc10 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 -- 172.21.15.52:0/1071949428 >> 172.21.15.52:0/1071949428 conn(0x7efe380ccec0 msgr2=0x7efe380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 -- 172.21.15.52:0/1071949428 shutdown_connections 2024-09-10T08:37:14.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.162+0000 7efe3e400640 1 -- 172.21.15.52:0/1071949428 wait complete. 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.164+0000 7efe3e400640 1 Processor -- start 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.164+0000 7efe3e400640 1 -- start start 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3806c150 0x7efe381f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe3813eb20 0x7efe3815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe3815c7d0 con 0x7efe380b2d40 2024-09-10T08:37:14.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe3815c650 con 0x7efe3813eb20 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe3e400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe38072650 con 0x7efe3806c150 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56940/0 (socket says 172.21.15.52:56940) 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe2fe00640 1 -- 172.21.15.52:0/831268683 learned_addr learned my addr 172.21.15.52:0/831268683 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe37e00640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe3813eb20 0x7efe3815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.165+0000 7efe37400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3806c150 0x7efe381f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 -- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3806c150 msgr2=0x7efe381f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3806c150 0x7efe381f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 -- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe3813eb20 msgr2=0x7efe3815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe3813eb20 0x7efe3815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 -- 172.21.15.52:0/831268683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe38141f00 con 0x7efe380b2d40 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2fe00640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c470 tx=0x7efe2000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200074e0 con 0x7efe380b2d40 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe20007680 con 0x7efe380b2d40 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe381421a0 con 0x7efe380b2d40 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20004a00 con 0x7efe380b2d40 2024-09-10T08:37:14.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.166+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe38142760 con 0x7efe380b2d40 2024-09-10T08:37:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.167+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3806bc10 con 0x7efe380b2d40 2024-09-10T08:37:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.168+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe2001a020 con 0x7efe380b2d40 2024-09-10T08:37:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.169+0000 7efe2f400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 0x7efe1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.169+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7efe2008a5c0 con 0x7efe380b2d40 2024-09-10T08:37:14.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.170+0000 7efe37400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 0x7efe1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.171+0000 7efe37400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 0x7efe1406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efe28034000 tx=0x7efe2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.174+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe20010300 con 0x7efe380b2d40 2024-09-10T08:37:14.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.393+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe3806c9c0 con 0x7efe380b2d40 2024-09-10T08:37:14.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.394+0000 7efe2f400640 1 -- 172.21.15.52:0/831268683 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7efe20058f60 con 0x7efe380b2d40 2024-09-10T08:37:14.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:14.395 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:14.395 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:14.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.396+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 msgr2=0x7efe1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 0x7efe1406e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efe28034000 tx=0x7efe2802e000 comp rx=0 tx=0).stop 2024-09-10T08:37:14.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 msgr2=0x7efe3815cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c470 tx=0x7efe2000c930 comp rx=0 tx=0).stop 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 shutdown_connections 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efe1406be30 0x7efe1406e2f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe3813eb20 0x7efe3815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe380b2d40 0x7efe3815cb50 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 --2- 172.21.15.52:0/831268683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe3806c150 0x7efe381f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 >> 172.21.15.52:0/831268683 conn(0x7efe380ccec0 msgr2=0x7efe3815a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 shutdown_connections 2024-09-10T08:37:14.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.397+0000 7efe3e400640 1 -- 172.21.15.52:0/831268683 wait complete. 2024-09-10T08:37:14.412 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:37:14.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:37:14.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.566+0000 7f17d5000640 1 Processor -- start 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.567+0000 7f17d5000640 1 -- start start 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17d5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17d5000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17d5000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17d0071180 con 0x7f17d00b2d40 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17d5000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f17d0071ab0 con 0x7f17d013eb20 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17d5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17d0071460 con 0x7f17d006c320 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17ce800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17c5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17ce800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:43170/0 (socket says 172.21.15.52:43170) 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17c5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:38482/0 (socket says 172.21.15.52:38482) 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17cde00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f17d00b2d40 0x7f17d006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47518/0 (socket says 172.21.15.52:47518) 2024-09-10T08:37:14.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.568+0000 7f17ce800640 1 -- 172.21.15.52:0/1231357216 learned_addr learned my addr 172.21.15.52:0/1231357216 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17cd400640 1 -- 172.21.15.52:0/1231357216 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2752756739 0 0) 0x7f17d0071180 con 0x7f17d00b2d40 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17cd400640 1 -- 172.21.15.52:0/1231357216 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17b4003520 con 0x7f17d00b2d40 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17c5400640 1 -- 172.21.15.52:0/1231357216 >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 msgr2=0x7f17d015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17c5400640 1 --2- 172.21.15.52:0/1231357216 >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17c5400640 1 -- 172.21.15.52:0/1231357216 >> v1:172.21.15.176:6789/0 conn(0x7f17d00b2d40 legacy=0x7f17d006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17c5400640 1 -- 172.21.15.52:0/1231357216 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d0071740 con 0x7f17d006c320 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.569+0000 7f17ce800640 1 --2- 172.21.15.52:0/1231357216 >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.570+0000 7f17c5400640 1 --2- 172.21.15.52:0/1231357216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097a0 tx=0x7f17b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df22d060d0b55469 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.570+0000 7f17cd400640 1 -- 172.21.15.52:0/1231357216 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8037070 con 0x7f17d006c320 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.570+0000 7f17cd400640 1 -- 172.21.15.52:0/1231357216 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b8032440 con 0x7f17d006c320 2024-09-10T08:37:14.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.570+0000 7f17cd400640 1 -- 172.21.15.52:0/1231357216 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8032810 con 0x7f17d006c320 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 -- 172.21.15.52:0/1231357216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 msgr2=0x7f17d015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 --2- 172.21.15.52:0/1231357216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097a0 tx=0x7f17b802a180 comp rx=0 tx=0).stop 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 -- 172.21.15.52:0/1231357216 shutdown_connections 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 --2- 172.21.15.52:0/1231357216 >> v2:172.21.15.176:3300/0 conn(0x7f17d013eb20 0x7f17d015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 --2- 172.21.15.52:0/1231357216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d006c320 0x7f17d015bcf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 -- 172.21.15.52:0/1231357216 >> 172.21.15.52:0/1231357216 conn(0x7f17d00ccec0 msgr2=0x7f17d00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 -- 172.21.15.52:0/1231357216 shutdown_connections 2024-09-10T08:37:14.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.571+0000 7f17d5000640 1 -- 172.21.15.52:0/1231357216 wait complete. 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.572+0000 7f17d5000640 1 Processor -- start 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.573+0000 7f17d5000640 1 -- start start 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.573+0000 7f17d5000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17d5000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d00b2d40 0x7f17d01e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17d5000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17d013eb20 0x7f17d01f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17d5000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00720c0 con 0x7f17d006c320 2024-09-10T08:37:14.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17d5000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f17d0071f40 con 0x7f17d013eb20 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17d5000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17d0072240 con 0x7f17d00b2d40 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56946/0 (socket says 172.21.15.52:56946) 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 -- 172.21.15.52:0/2479983943 learned_addr learned my addr 172.21.15.52:0/2479983943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17ce800640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17d013eb20 0x7f17d01f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17c5400640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d00b2d40 0x7f17d01e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 -- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d00b2d40 msgr2=0x7f17d01e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d00b2d40 0x7f17d01e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 -- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17d013eb20 msgr2=0x7f17d01f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17d013eb20 0x7f17d01f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.574+0000 7f17cde00640 1 -- 172.21.15.52:0/2479983943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d01e7340 con 0x7f17d006c320 2024-09-10T08:37:14.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17cde00640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c460 tx=0x7f17c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0018070 con 0x7f17d006c320 2024-09-10T08:37:14.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c00074a0 con 0x7f17d006c320 2024-09-10T08:37:14.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d01e75e0 con 0x7f17d006c320 2024-09-10T08:37:14.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0004a20 con 0x7f17d006c320 2024-09-10T08:37:14.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.575+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d01e7ba0 con 0x7f17d006c320 2024-09-10T08:37:14.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.576+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d006bc10 con 0x7f17d006c320 2024-09-10T08:37:14.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.577+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17c001b070 con 0x7f17d006c320 2024-09-10T08:37:14.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.578+0000 7f17c6a00640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 0x7f17ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:14.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.578+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f17c008a070 con 0x7f17d006c320 2024-09-10T08:37:14.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.578+0000 7f17c5400640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 0x7f17ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:14.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.579+0000 7f17c5400640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 0x7f17ac06e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f17b8034000 tx=0x7f17b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:14.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.582+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17c0007650 con 0x7f17d006c320 2024-09-10T08:37:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.833+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f17d006c9c0 con 0x7f17d006c320 2024-09-10T08:37:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.834+0000 7f17c6a00640 1 -- 172.21.15.52:0/2479983943 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1679 (secure 0 0 0) 0x7f17c0058480 con 0x7f17d006c320 2024-09-10T08:37:14.834 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:14.835 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":534,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076570829,"bytes_used":2530369536,"bytes_avail":770563743744,"bytes_total":773094113280,"write_bytes_sec":27855758,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":7450}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-10T08:37:11.580862+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 msgr2=0x7f17ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 0x7f17ac06e2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f17b8034000 tx=0x7f17b802e000 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 msgr2=0x7f17d015f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f17c000c460 tx=0x7f17c000c920 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 shutdown_connections 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17ac06be30 0x7f17ac06e2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17d013eb20 0x7f17d01f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17d00b2d40 0x7f17d01e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 --2- 172.21.15.52:0/2479983943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17d006c320 0x7f17d015f310 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 >> 172.21.15.52:0/2479983943 conn(0x7f17d00ccec0 msgr2=0x7f17d013f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 shutdown_connections 2024-09-10T08:37:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:14.836+0000 7f17d5000640 1 -- 172.21.15.52:0/2479983943 wait complete. 2024-09-10T08:37:14.853 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-10T08:37:15.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.020+0000 7fa42fe00640 1 Processor -- start 2024-09-10T08:37:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.020+0000 7fa42fe00640 1 -- start start 2024-09-10T08:37:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.021+0000 7fa42fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa42815eb60 0x7fa42815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.021+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4280b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.021+0000 7fa42fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42815f590 con 0x7fa4281624b0 2024-09-10T08:37:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.021+0000 7fa42fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa4280b7070 con 0x7fa42815eb60 2024-09-10T08:37:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.021+0000 7fa42fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa42815f870 con 0x7fa4280b66a0 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42d400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa42815eb60 0x7fa42815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4280b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42ca00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa4281624b0 0x7fa4280d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47526/0 (socket says 172.21.15.52:47526) 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42ca00640 1 -- 172.21.15.52:0/2101039856 learned_addr learned my addr 172.21.15.52:0/2101039856 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42de00640 1 -- 172.21.15.52:0/2101039856 >> v2:172.21.15.176:3300/0 conn(0x7fa42815eb60 msgr2=0x7fa42815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42de00640 1 --2- 172.21.15.52:0/2101039856 >> v2:172.21.15.176:3300/0 conn(0x7fa42815eb60 0x7fa42815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42de00640 1 -- 172.21.15.52:0/2101039856 >> v1:172.21.15.176:6789/0 conn(0x7fa4281624b0 legacy=0x7fa4280d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.022+0000 7fa42de00640 1 -- 172.21.15.52:0/2101039856 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42815fb50 con 0x7fa4280b66a0 2024-09-10T08:37:16.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.023+0000 7fa42de00640 1 --2- 172.21.15.52:0/2101039856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4280b6b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa420009d90 tx=0x7fa42002a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9dd01aa51fd124 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa427e00640 1 -- 172.21.15.52:0/2101039856 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420007740 con 0x7fa4280b66a0 2024-09-10T08:37:16.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa427e00640 1 -- 172.21.15.52:0/2101039856 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4200078e0 con 0x7fa4280b66a0 2024-09-10T08:37:16.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa427e00640 1 -- 172.21.15.52:0/2101039856 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420007cb0 con 0x7fa4280b66a0 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 -- 172.21.15.52:0/2101039856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 msgr2=0x7fa4280b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 --2- 172.21.15.52:0/2101039856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4280b6b30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa420009d90 tx=0x7fa42002a540 comp rx=0 tx=0).stop 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 -- 172.21.15.52:0/2101039856 shutdown_connections 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 --2- 172.21.15.52:0/2101039856 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4280b6b30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 --2- 172.21.15.52:0/2101039856 >> v2:172.21.15.176:3300/0 conn(0x7fa42815eb60 0x7fa42815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 -- 172.21.15.52:0/2101039856 >> 172.21.15.52:0/2101039856 conn(0x7fa4280d16f0 msgr2=0x7fa4280d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 -- 172.21.15.52:0/2101039856 shutdown_connections 2024-09-10T08:37:16.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.024+0000 7fa42fe00640 1 -- 172.21.15.52:0/2101039856 wait complete. 2024-09-10T08:37:16.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.026+0000 7fa42fe00640 1 Processor -- start 2024-09-10T08:37:16.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.026+0000 7fa42fe00640 1 -- start start 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4281f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4281624b0 0x7fa4280caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4280d4480 con 0x7fa42815eb60 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4280cef40 con 0x7fa4281624b0 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4280d4600 con 0x7fa4280b66a0 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56954/0 (socket says 172.21.15.52:56954) 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.027+0000 7fa42ca00640 1 -- 172.21.15.52:0/3921896927 learned_addr learned my addr 172.21.15.52:0/3921896927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:16.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42de00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4281624b0 0x7fa4280caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42d400640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4281f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 -- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 msgr2=0x7fa4281f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4281f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 -- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4281624b0 msgr2=0x7fa4280caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4281624b0 0x7fa4280caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 -- 172.21.15.52:0/3921896927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4280c88f0 con 0x7fa42815eb60 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa42ca00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c400 tx=0x7fa41400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414017070 con 0x7fa42815eb60 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa414005ce0 con 0x7fa42815eb60 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.028+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140072f0 con 0x7fa42815eb60 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.029+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4280c8bd0 con 0x7fa42815eb60 2024-09-10T08:37:16.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.029+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4280c9190 con 0x7fa42815eb60 2024-09-10T08:37:16.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.030+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4280b6b30 con 0x7fa42815eb60 2024-09-10T08:37:16.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.031+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa41401a070 con 0x7fa42815eb60 2024-09-10T08:37:16.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.031+0000 7fa425600640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 0x7fa40806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.032+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa41408a1b0 con 0x7fa42815eb60 2024-09-10T08:37:16.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.032+0000 7fa42d400640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 0x7fa40806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.033+0000 7fa42d400640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 0x7fa40806e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009aa0 tx=0x7fa41c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.036+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa414058510 con 0x7fa42815eb60 2024-09-10T08:37:16.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.255+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4280d2520 con 0x7fa42815eb60 2024-09-10T08:37:16.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.256+0000 7fa425600640 1 -- 172.21.15.52:0/3921896927 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7fa41405c810 con 0x7fa42815eb60 2024-09-10T08:37:16.256 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:16.256 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:16.257 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:16.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 msgr2=0x7fa40806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 0x7fa40806e2f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009aa0 tx=0x7fa41c009190 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 msgr2=0x7fa42815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa41400c400 tx=0x7fa41400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 shutdown_connections 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa40806be30 0x7fa40806e2f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4281624b0 0x7fa4280caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa42815eb60 0x7fa42815dbc0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 --2- 172.21.15.52:0/3921896927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4280b66a0 0x7fa4281f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 >> 172.21.15.52:0/3921896927 conn(0x7fa4280d16f0 msgr2=0x7fa4280d3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 shutdown_connections 2024-09-10T08:37:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.258+0000 7fa42fe00640 1 -- 172.21.15.52:0/3921896927 wait complete. 2024-09-10T08:37:16.274 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:37:16.274 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:37:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.429+0000 7f089da00640 1 Processor -- start 2024-09-10T08:37:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.429+0000 7f089da00640 1 -- start start 2024-09-10T08:37:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.430+0000 7f089da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08980b2d40 0x7f089806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.430+0000 7f089da00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f089806c150 0x7f089815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.430+0000 7f089da00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0898071180 con 0x7f089813eb20 2024-09-10T08:37:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.430+0000 7f089da00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0898071ab0 con 0x7f089806c150 2024-09-10T08:37:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.430+0000 7f089da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0898071460 con 0x7f08980b2d40 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0897400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f089806c150 0x7f089815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0896000640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f089813eb20 0x7f089815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47532/0 (socket says 172.21.15.52:47532) 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0896000640 1 -- 172.21.15.52:0/337184677 learned_addr learned my addr 172.21.15.52:0/337184677 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0896a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08980b2d40 0x7f089806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0897400640 1 -- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08980b2d40 msgr2=0x7f089806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0897400640 1 --2- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08980b2d40 0x7f089806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0897400640 1 -- 172.21.15.52:0/337184677 >> v1:172.21.15.176:6789/0 conn(0x7f089813eb20 legacy=0x7f089815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0897400640 1 -- 172.21.15.52:0/337184677 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0898071740 con 0x7f089806c150 2024-09-10T08:37:16.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.431+0000 7f0895600640 1 -- 172.21.15.52:0/337184677 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508426357 0 0) 0x7f0898071180 con 0x7f089813eb20 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.432+0000 7f0897400640 1 --2- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089806c150 0x7f089815c400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0898071c30 tx=0x7f089002c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76e3994355399a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f0895600640 1 -- 172.21.15.52:0/337184677 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890039070 con 0x7f089806c150 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f0895600640 1 -- 172.21.15.52:0/337184677 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0890009540 con 0x7f089806c150 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f0895600640 1 -- 172.21.15.52:0/337184677 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890009910 con 0x7f089806c150 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 -- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089806c150 msgr2=0x7f089815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 --2- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089806c150 0x7f089815c400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0898071c30 tx=0x7f089002c860 comp rx=0 tx=0).stop 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 -- 172.21.15.52:0/337184677 shutdown_connections 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 --2- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089806c150 0x7f089815c400 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 --2- 172.21.15.52:0/337184677 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08980b2d40 0x7f089806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 -- 172.21.15.52:0/337184677 >> 172.21.15.52:0/337184677 conn(0x7f08980ccec0 msgr2=0x7f08980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 -- 172.21.15.52:0/337184677 shutdown_connections 2024-09-10T08:37:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.433+0000 7f089da00640 1 -- 172.21.15.52:0/337184677 wait complete. 2024-09-10T08:37:16.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.435+0000 7f089da00640 1 Processor -- start 2024-09-10T08:37:16.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.435+0000 7f089da00640 1 -- start start 2024-09-10T08:37:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 0x7f08981f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089813eb20 0x7f089815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08980722d0 con 0x7f08980b2d40 2024-09-10T08:37:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0898072150 con 0x7f089813eb20 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f089da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0898072450 con 0x7f089806c150 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f0896000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f0896000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56966/0 (socket says 172.21.15.52:56966) 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f0896000640 1 -- 172.21.15.52:0/3015632425 learned_addr learned my addr 172.21.15.52:0/3015632425 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.436+0000 7f0896a00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 0x7f08981f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0897400640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089813eb20 0x7f089815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 -- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 msgr2=0x7f08981f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 0x7f08981f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 -- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089813eb20 msgr2=0x7f089815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089813eb20 0x7f089815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 -- 172.21.15.52:0/3015632425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089815c830 con 0x7f08980b2d40 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896a00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 0x7f08981f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f0896000640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f088400c3c0 tx=0x7f088400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840074e0 con 0x7f08980b2d40 2024-09-10T08:37:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840047e0 con 0x7f08980b2d40 2024-09-10T08:37:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08981f7b00 con 0x7f08980b2d40 2024-09-10T08:37:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.437+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884004bd0 con 0x7f08980b2d40 2024-09-10T08:37:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.438+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089815a6b0 con 0x7f08980b2d40 2024-09-10T08:37:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.439+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089806bc10 con 0x7f08980b2d40 2024-09-10T08:37:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.440+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0884011070 con 0x7f08980b2d40 2024-09-10T08:37:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.440+0000 7f088ea00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 0x7f087806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.440+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f088408a920 con 0x7f08980b2d40 2024-09-10T08:37:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.441+0000 7f0896a00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 0x7f087806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:16.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.442+0000 7f0896a00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 0x7f087806e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0888009f30 tx=0x7f0888009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.445+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0884058c70 con 0x7f08980b2d40 2024-09-10T08:37:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.697+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f08980cf770 con 0x7f08980b2d40 2024-09-10T08:37:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.698+0000 7f088ea00640 1 -- 172.21.15.52:0/3015632425 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1617 (secure 0 0 0) 0x7f088405cf70 con 0x7f08980b2d40 2024-09-10T08:37:16.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:16.699 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":536,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076575176,"bytes_used":2530377728,"bytes_avail":770563735552,"bytes_total":773094113280,"write_bytes_sec":27856863,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":7450}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-10T08:37:15.581987+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 msgr2=0x7f087806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 0x7f087806e2f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0888009f30 tx=0x7f0888009190 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 msgr2=0x7f089815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f088400c3c0 tx=0x7f088400c880 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 shutdown_connections 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087806be30 0x7f087806e2f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089813eb20 0x7f089815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08980b2d40 0x7f089815ec50 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 --2- 172.21.15.52:0/3015632425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f089806c150 0x7f08981f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 >> 172.21.15.52:0/3015632425 conn(0x7f08980ccec0 msgr2=0x7f08980ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 shutdown_connections 2024-09-10T08:37:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:16.700+0000 7f089da00640 1 -- 172.21.15.52:0/3015632425 wait complete. 2024-09-10T08:37:16.717 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:37:16.717 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:37:16.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:37:16.802 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:37:16.895 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:37:16.895 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:37:16.895 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:16.896 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:16.931 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:16.931 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:17.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:37:17.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.205+0000 7efc53200640 1 Processor -- start 2024-09-10T08:37:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.205+0000 7efc53200640 1 -- start start 2024-09-10T08:37:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc53200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efc5406c320 0x7efc540b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc53200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5415ef90 con 0x7efc540b4c80 2024-09-10T08:37:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc53200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5415f270 con 0x7efc5415ead0 2024-09-10T08:37:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc53200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efc5415f550 con 0x7efc5406c320 2024-09-10T08:37:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc51e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efc540b4c80 0x7efc54162ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46646/0 (socket says 172.21.15.52:46646) 2024-09-10T08:37:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc51e00640 1 -- 172.21.15.52:0/1794951486 learned_addr learned my addr 172.21.15.52:0/1794951486 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:17.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.206+0000 7efc52800640 1 --2- 172.21.15.52:0/1794951486 >> v2:172.21.15.176:3300/0 conn(0x7efc5406c320 0x7efc540b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:17.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305740899 0 0) 0x7efc5415ef90 con 0x7efc540b4c80 2024-09-10T08:37:17.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc38003520 con 0x7efc540b4c80 2024-09-10T08:37:17.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896954403 0 0) 0x7efc5415f270 con 0x7efc5415ead0 2024-09-10T08:37:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5415ef90 con 0x7efc5415ead0 2024-09-10T08:37:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948000319 0 0) 0x7efc38003520 con 0x7efc540b4c80 2024-09-10T08:37:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc52800640 1 -- 172.21.15.52:0/1794951486 >> v1:172.21.15.176:6789/0 conn(0x7efc5415ead0 legacy=0x7efc5406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc52800640 1 -- 172.21.15.52:0/1794951486 >> v1:172.21.15.52:6789/0 conn(0x7efc540b4c80 legacy=0x7efc54162ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.207+0000 7efc52800640 1 -- 172.21.15.52:0/1794951486 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5415f830 con 0x7efc5406c320 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.208+0000 7efc52800640 1 --2- 172.21.15.52:0/1794951486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc540b5060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d90 tx=0x7efc4c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd62b6cac2168dba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.208+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc44001670 con 0x7efc5406c320 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.208+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc4c007540 con 0x7efc5406c320 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.208+0000 7efc51400640 1 -- 172.21.15.52:0/1794951486 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c007910 con 0x7efc5406c320 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 -- 172.21.15.52:0/1794951486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 msgr2=0x7efc540b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 --2- 172.21.15.52:0/1794951486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc540b5060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009d90 tx=0x7efc4c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 -- 172.21.15.52:0/1794951486 shutdown_connections 2024-09-10T08:37:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 --2- 172.21.15.52:0/1794951486 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc540b5060 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 -- 172.21.15.52:0/1794951486 >> 172.21.15.52:0/1794951486 conn(0x7efc5406e2d0 msgr2=0x7efc5406e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 -- 172.21.15.52:0/1794951486 shutdown_connections 2024-09-10T08:37:17.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.209+0000 7efc53200640 1 -- 172.21.15.52:0/1794951486 wait complete. 2024-09-10T08:37:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.211+0000 7efc53200640 1 Processor -- start 2024-09-10T08:37:17.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.211+0000 7efc53200640 1 -- start start 2024-09-10T08:37:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc54157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5415ead0 0x7efc540cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efc540b4590 con 0x7efc540b4c80 2024-09-10T08:37:17.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc540b4410 con 0x7efc5406c320 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc53200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efc540b4710 con 0x7efc5415ead0 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56974/0 (socket says 172.21.15.52:56974) 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 -- 172.21.15.52:0/842399916 learned_addr learned my addr 172.21.15.52:0/842399916 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 -- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5415ead0 msgr2=0x7efc540cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5415ead0 0x7efc540cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 -- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 msgr2=0x7efc54157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc54157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.212+0000 7efc49400640 1 -- 172.21.15.52:0/842399916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc541584f0 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc49400640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c500 tx=0x7efc3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0052d0 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3c005490 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3c012870 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc541f4700 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.213+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc541f4cc0 con 0x7efc540b4c80 2024-09-10T08:37:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.214+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc541f78c0 con 0x7efc540b4c80 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.215+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc3c012a10 con 0x7efc540b4c80 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.216+0000 7efc4aa00640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 0x7efc3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.216+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7efc3c08ac40 con 0x7efc540b4c80 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.216+0000 7efc51e00640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 0x7efc3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.217+0000 7efc51e00640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 0x7efc3006e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc44005880 tx=0x7efc44001060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:17.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.220+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc3c059560 con 0x7efc540b4c80 2024-09-10T08:37:17.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.415+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efc540b5660 con 0x7efc540b4c80 2024-09-10T08:37:17.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.415+0000 7efc4aa00640 1 -- 172.21.15.52:0/842399916 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v124) ==== 80+0+0 (secure 0 0 0) 0x7efc3c058e60 con 0x7efc540b4c80 2024-09-10T08:37:17.416 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:37:17.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 msgr2=0x7efc3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 0x7efc3006e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc44005880 tx=0x7efc44001060 comp rx=0 tx=0).stop 2024-09-10T08:37:17.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 msgr2=0x7efc540caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7efc3c00c500 tx=0x7efc3c00c9c0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 shutdown_connections 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efc3006be30 0x7efc3006e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efc5415ead0 0x7efc540cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc540b4c80 0x7efc540caf40 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 --2- 172.21.15.52:0/842399916 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc5406c320 0x7efc54157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 >> 172.21.15.52:0/842399916 conn(0x7efc5406e2d0 msgr2=0x7efc5406e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 shutdown_connections 2024-09-10T08:37:17.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:17.418+0000 7efc53200640 1 -- 172.21.15.52:0/842399916 wait complete. 2024-09-10T08:37:17.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:37:17.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:17.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:18.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:37:18.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:18.219 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:37:18.259 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:37:18.259 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:37:18.259 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:18.297 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:37:18.297 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:37:18.298 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:18.298 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:18.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:37:18.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:37:18.334 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:37:18.335 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:18.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:37:18.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:18.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.530+0000 7fd10f800640 1 Processor -- start 2024-09-10T08:37:18.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.530+0000 7fd10f800640 1 -- start start 2024-09-10T08:37:18.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.531+0000 7fd10f800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1080b2d40 0x7fd10806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.531+0000 7fd10f800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd10813eb20 0x7fd10806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.531+0000 7fd10f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10815bcf0 0x7fd10815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10f800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd108071ab0 con 0x7fd1080b2d40 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10f800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd108071180 con 0x7fd10813eb20 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd108071460 con 0x7fd10815bcf0 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1080b2d40 0x7fd10806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1080b2d40 0x7fd10806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56988/0 (socket says 172.21.15.52:56988) 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 -- 172.21.15.52:0/2692007707 learned_addr learned my addr 172.21.15.52:0/2692007707 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd107e00640 1 --2- 172.21.15.52:0/2692007707 >> v2:172.21.15.176:3300/0 conn(0x7fd10813eb20 0x7fd10806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10d800640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10815bcf0 0x7fd10815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 -- 172.21.15.52:0/2692007707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10815bcf0 msgr2=0x7fd10815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10815bcf0 0x7fd10815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 -- 172.21.15.52:0/2692007707 >> v2:172.21.15.176:3300/0 conn(0x7fd10813eb20 msgr2=0x7fd10806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:18.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 --2- 172.21.15.52:0/2692007707 >> v2:172.21.15.176:3300/0 conn(0x7fd10813eb20 0x7fd10806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.532+0000 7fd10ce00640 1 -- 172.21.15.52:0/2692007707 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108071740 con 0x7fd1080b2d40 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.533+0000 7fd10ce00640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10806bc10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd1080d1500 tx=0x7fd0fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45befccee4940d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd107400640 1 -- 172.21.15.52:0/2692007707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc037070 con 0x7fd1080b2d40 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd107400640 1 -- 172.21.15.52:0/2692007707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc032440 con 0x7fd1080b2d40 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd107400640 1 -- 172.21.15.52:0/2692007707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc032810 con 0x7fd1080b2d40 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 -- 172.21.15.52:0/2692007707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 msgr2=0x7fd10806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10806bc10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd1080d1500 tx=0x7fd0fc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 -- 172.21.15.52:0/2692007707 shutdown_connections 2024-09-10T08:37:18.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 --2- 172.21.15.52:0/2692007707 >> v2:172.21.15.176:3300/0 conn(0x7fd10813eb20 0x7fd10806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10815bcf0 0x7fd10815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 --2- 172.21.15.52:0/2692007707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10806bc10 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 -- 172.21.15.52:0/2692007707 >> 172.21.15.52:0/2692007707 conn(0x7fd1080ccec0 msgr2=0x7fd1080cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:18.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 -- 172.21.15.52:0/2692007707 shutdown_connections 2024-09-10T08:37:18.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.534+0000 7fd10f800640 1 -- 172.21.15.52:0/2692007707 wait complete. 2024-09-10T08:37:18.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.536+0000 7fd10f800640 1 Processor -- start 2024-09-10T08:37:18.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.536+0000 7fd10f800640 1 -- start start 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10813eb20 0x7fd108155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd10815bcf0 0x7fd1080b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815f140 con 0x7fd1080b2d40 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd10815efc0 con 0x7fd10815bcf0 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd10815f2c0 con 0x7fd10813eb20 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56996/0 (socket says 172.21.15.52:56996) 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10ce00640 1 -- 172.21.15.52:0/474106614 learned_addr learned my addr 172.21.15.52:0/474106614 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:18.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd107e00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10813eb20 0x7fd108155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.537+0000 7fd10d800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd10815bcf0 0x7fd1080b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 -- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10813eb20 msgr2=0x7fd108155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10813eb20 0x7fd108155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 -- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd10815bcf0 msgr2=0x7fd1080b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd10815bcf0 0x7fd1080b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 -- 172.21.15.52:0/474106614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108129780 con 0x7fd1080b2d40 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10ce00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc041020 con 0x7fd1080b2d40 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0306c0 con 0x7fd1080b2d40 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc037040 con 0x7fd1080b2d40 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd108129a60 con 0x7fd1080b2d40 2024-09-10T08:37:18.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.538+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10812a020 con 0x7fd1080b2d40 2024-09-10T08:37:18.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.540+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10806c9c0 con 0x7fd1080b2d40 2024-09-10T08:37:18.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.540+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd0fc044020 con 0x7fd1080b2d40 2024-09-10T08:37:18.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.541+0000 7fd104c00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 0x7fd0e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.541+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fd0fc0ab490 con 0x7fd1080b2d40 2024-09-10T08:37:18.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.542+0000 7fd107e00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 0x7fd0e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.542+0000 7fd107e00640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 0x7fd0e806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fd0 tx=0x7fd0f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.545+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0fc04b030 con 0x7fd1080b2d40 2024-09-10T08:37:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.769+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd10815c180 con 0x7fd1080b2d40 2024-09-10T08:37:18.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.769+0000 7fd104c00640 1 -- 172.21.15.52:0/474106614 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7fd0fc079880 con 0x7fd1080b2d40 2024-09-10T08:37:18.770 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:18.770 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:18.770 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 msgr2=0x7fd0e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 0x7fd0e806e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fd0 tx=0x7fd0f4008040 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 msgr2=0x7fd10812d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc000c00 tx=0x7fd0fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 shutdown_connections 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd0e806be30 0x7fd0e806e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd10815bcf0 0x7fd1080b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd10813eb20 0x7fd108155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 --2- 172.21.15.52:0/474106614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1080b2d40 0x7fd10812d630 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 >> 172.21.15.52:0/474106614 conn(0x7fd1080ccec0 msgr2=0x7fd108155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:18.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 shutdown_connections 2024-09-10T08:37:18.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.771+0000 7fd10f800640 1 -- 172.21.15.52:0/474106614 wait complete. 2024-09-10T08:37:18.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:18.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.943+0000 7fb7bb200640 1 Processor -- start 2024-09-10T08:37:18.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.943+0000 7fb7bb200640 1 -- start start 2024-09-10T08:37:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.944+0000 7fb7bb200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb7b40b2d40 0x7fb7b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.944+0000 7fb7bb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.944+0000 7fb7bb200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b4071180 con 0x7fb7b413eb20 2024-09-10T08:37:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.944+0000 7fb7bb200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b4071ab0 con 0x7fb7b40b2d40 2024-09-10T08:37:18.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.944+0000 7fb7bb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b4071460 con 0x7fb7b406c150 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb7b40b2d40 0x7fb7b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:38538/0 (socket says 172.21.15.52:38538) 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 -- 172.21.15.52:0/3690619683 learned_addr learned my addr 172.21.15.52:0/3690619683 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 -- 172.21.15.52:0/3690619683 >> v2:172.21.15.176:3300/0 conn(0x7fb7b40b2d40 msgr2=0x7fb7b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:18.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 --2- 172.21.15.52:0/3690619683 >> v2:172.21.15.176:3300/0 conn(0x7fb7b40b2d40 0x7fb7b406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 -- 172.21.15.52:0/3690619683 >> v1:172.21.15.176:6789/0 conn(0x7fb7b413eb20 legacy=0x7fb7b415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.945+0000 7fb7b9200640 1 -- 172.21.15.52:0/3690619683 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b4071740 con 0x7fb7b406c150 2024-09-10T08:37:18.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7b9200640 1 --2- 172.21.15.52:0/3690619683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009e50 tx=0x7fb7ac02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f546099cbd2dec1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7b2a00640 1 -- 172.21.15.52:0/3690619683 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac036070 con 0x7fb7b406c150 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7b2a00640 1 -- 172.21.15.52:0/3690619683 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac031600 con 0x7fb7b406c150 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7b2a00640 1 -- 172.21.15.52:0/3690619683 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0319d0 con 0x7fb7b406c150 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7bb200640 1 -- 172.21.15.52:0/3690619683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 msgr2=0x7fb7b415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7bb200640 1 --2- 172.21.15.52:0/3690619683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009e50 tx=0x7fb7ac02a710 comp rx=0 tx=0).stop 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7bb200640 1 -- 172.21.15.52:0/3690619683 shutdown_connections 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.947+0000 7fb7bb200640 1 --2- 172.21.15.52:0/3690619683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b406c150 0x7fb7b415c400 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.948+0000 7fb7bb200640 1 --2- 172.21.15.52:0/3690619683 >> v2:172.21.15.176:3300/0 conn(0x7fb7b40b2d40 0x7fb7b406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.948+0000 7fb7bb200640 1 -- 172.21.15.52:0/3690619683 >> 172.21.15.52:0/3690619683 conn(0x7fb7b40ccec0 msgr2=0x7fb7b40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.948+0000 7fb7bb200640 1 -- 172.21.15.52:0/3690619683 shutdown_connections 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.948+0000 7fb7bb200640 1 -- 172.21.15.52:0/3690619683 wait complete. 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.949+0000 7fb7bb200640 1 Processor -- start 2024-09-10T08:37:18.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.949+0000 7fb7bb200640 1 -- start start 2024-09-10T08:37:18.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b40b2d40 0x7fb7b4158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b413eb20 0x7fb7b40b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b40722d0 con 0x7fb7b406c150 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b4072150 con 0x7fb7b40b2d40 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7bb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b4072450 con 0x7fb7b413eb20 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.950+0000 7fb7b3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57010/0 (socket says 172.21.15.52:57010) 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 -- 172.21.15.52:0/2922484415 learned_addr learned my addr 172.21.15.52:0/2922484415 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b9200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b413eb20 0x7fb7b40b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3400640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b40b2d40 0x7fb7b4158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 -- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b413eb20 msgr2=0x7fb7b40b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b413eb20 0x7fb7b40b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 -- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b40b2d40 msgr2=0x7fb7b4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b40b2d40 0x7fb7b4158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 -- 172.21.15.52:0/2922484415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b41f53a0 con 0x7fb7b406c150 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.951+0000 7fb7b3e00640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e9b0 tx=0x7fb7a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.952+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4017070 con 0x7fb7b406c150 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.952+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a400c9a0 con 0x7fb7b406c150 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.952+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a400cd90 con 0x7fb7b406c150 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.952+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b41f5680 con 0x7fb7b406c150 2024-09-10T08:37:18.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.952+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b41f5c40 con 0x7fb7b406c150 2024-09-10T08:37:18.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.953+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b406bc10 con 0x7fb7b406c150 2024-09-10T08:37:18.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.954+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7a401a070 con 0x7fb7b406c150 2024-09-10T08:37:18.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.955+0000 7fb7abe00640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:18.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.955+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fb7a408b1c0 con 0x7fb7b406c150 2024-09-10T08:37:18.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.955+0000 7fb7b3400640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:18.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.956+0000 7fb7b3400640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 0x7fb79406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4140040 tx=0x7fb7a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:18.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:18.959+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7a4059510 con 0x7fb7b406c150 2024-09-10T08:37:19.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.179+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7b406c9c0 con 0x7fb7b406c150 2024-09-10T08:37:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.180+0000 7fb7abe00640 1 -- 172.21.15.52:0/2922484415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7fb7a405d810 con 0x7fb7b406c150 2024-09-10T08:37:19.181 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:19.181 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:19.181 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.182+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 msgr2=0x7fb79406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.182+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 0x7fb79406e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4140040 tx=0x7fb7a0009040 comp rx=0 tx=0).stop 2024-09-10T08:37:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.182+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 msgr2=0x7fb7b413e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.182+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e9b0 tx=0x7fb7a400ee70 comp rx=0 tx=0).stop 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 shutdown_connections 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb79406be30 0x7fb79406e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7b413eb20 0x7fb7b40b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7b40b2d40 0x7fb7b4158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 --2- 172.21.15.52:0/2922484415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7b406c150 0x7fb7b413e180 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 >> 172.21.15.52:0/2922484415 conn(0x7fb7b40ccec0 msgr2=0x7fb7b40cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 shutdown_connections 2024-09-10T08:37:19.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.183+0000 7fb7bb200640 1 -- 172.21.15.52:0/2922484415 wait complete. 2024-09-10T08:37:19.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:19.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.357+0000 7fa73cc00640 1 Processor -- start 2024-09-10T08:37:19.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.357+0000 7fa73cc00640 1 -- start start 2024-09-10T08:37:19.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa73cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa73815e440 0x7fa7380d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa73cc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7380b6710 0x7fa7380b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa73cc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7380d3990 con 0x7fa7380cf450 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa73cc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa7380d3c70 con 0x7fa7380b6710 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa73cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7380d3f50 con 0x7fa73815e440 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa737e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7380b6710 0x7fa7380b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa737e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7380b6710 0x7fa7380b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57014/0 (socket says 172.21.15.52:57014) 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa737e00640 1 -- 172.21.15.52:0/1191155345 learned_addr learned my addr 172.21.15.52:0/1191155345 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.358+0000 7fa737400640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa73815e440 0x7fa7380d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.359+0000 7fa737e00640 1 -- 172.21.15.52:0/1191155345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa73815e440 msgr2=0x7fa7380d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.359+0000 7fa737e00640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa73815e440 0x7fa7380d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.359+0000 7fa737e00640 1 -- 172.21.15.52:0/1191155345 >> v1:172.21.15.176:6789/0 conn(0x7fa7380cf450 legacy=0x7fa7380b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.359+0000 7fa737e00640 1 -- 172.21.15.52:0/1191155345 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7380d4230 con 0x7fa7380b6710 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.360+0000 7fa737e00640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380b6710 0x7fa7380b7b60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa730009e50 tx=0x7fa73002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3075c6dc47922d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.360+0000 7fa736000640 1 -- 172.21.15.52:0/1191155345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730036070 con 0x7fa7380b6710 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.360+0000 7fa736000640 1 -- 172.21.15.52:0/1191155345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa730031600 con 0x7fa7380b6710 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.360+0000 7fa736000640 1 -- 172.21.15.52:0/1191155345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7300319d0 con 0x7fa7380b6710 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 -- 172.21.15.52:0/1191155345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380b6710 msgr2=0x7fa7380b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380b6710 0x7fa7380b7b60 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa730009e50 tx=0x7fa73002a7a0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 -- 172.21.15.52:0/1191155345 shutdown_connections 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380b6710 0x7fa7380b7b60 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1191155345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa73815e440 0x7fa7380d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 -- 172.21.15.52:0/1191155345 >> 172.21.15.52:0/1191155345 conn(0x7fa738067f80 msgr2=0x7fa7380d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:19.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 -- 172.21.15.52:0/1191155345 shutdown_connections 2024-09-10T08:37:19.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.361+0000 7fa73cc00640 1 -- 172.21.15.52:0/1191155345 wait complete. 2024-09-10T08:37:19.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.362+0000 7fa73cc00640 1 Processor -- start 2024-09-10T08:37:19.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 -- start start 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7380b6710 0x7fa7380cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa73815e440 0x7fa738156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7380b76c0 con 0x7fa7380cf450 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7380b7540 con 0x7fa73815e440 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.363+0000 7fa73cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7380b80a0 con 0x7fa7380b6710 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57030/0 (socket says 172.21.15.52:57030) 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 -- 172.21.15.52:0/1902858694 learned_addr learned my addr 172.21.15.52:0/1902858694 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:19.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa737400640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7380b6710 0x7fa7380cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa737e00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa73815e440 0x7fa738156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 -- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7380b6710 msgr2=0x7fa7380cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7380b6710 0x7fa7380cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 -- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa73815e440 msgr2=0x7fa738156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa73815e440 0x7fa738156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 -- 172.21.15.52:0/1902858694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7381585f0 con 0x7fa7380cf450 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.364+0000 7fa736a00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa72400c430 tx=0x7fa72400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.365+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7240052d0 con 0x7fa7380cf450 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.365+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa724005490 con 0x7fa7380cf450 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.365+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724007260 con 0x7fa7380cf450 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.365+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73815b5e0 con 0x7fa7380cf450 2024-09-10T08:37:19.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.365+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa738159540 con 0x7fa7380cf450 2024-09-10T08:37:19.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.366+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7380b30c0 con 0x7fa7380cf450 2024-09-10T08:37:19.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.367+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa724007400 con 0x7fa7380cf450 2024-09-10T08:37:19.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.367+0000 7fa72f400640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 0x7fa71806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.368+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7fa72408a370 con 0x7fa7380cf450 2024-09-10T08:37:19.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.368+0000 7fa737400640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 0x7fa71806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.369+0000 7fa737400640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 0x7fa71806e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa728009aa0 tx=0x7fa728009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.372+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7380b30c0 con 0x7fa7380cf450 2024-09-10T08:37:19.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.558+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7380d5270 con 0x7fa7380cf450 2024-09-10T08:37:19.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.559+0000 7fa72f400640 1 -- 172.21.15.52:0/1902858694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16755 (secure 0 0 0) 0x7fa724058630 con 0x7fa7380cf450 2024-09-10T08:37:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:19.560 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":124,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:39.053620+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:36:35.265667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T08:36:36.457296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.561+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 msgr2=0x7fa71806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 0x7fa71806e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa728009aa0 tx=0x7fa728009190 comp rx=0 tx=0).stop 2024-09-10T08:37:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 msgr2=0x7fa73815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa72400c430 tx=0x7fa72400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 shutdown_connections 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa71806be30 0x7fa71806e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa73815e440 0x7fa738156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7380cf450 0x7fa73815b0a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 --2- 172.21.15.52:0/1902858694 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7380b6710 0x7fa7380cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 >> 172.21.15.52:0/1902858694 conn(0x7fa738067f80 msgr2=0x7fa7380b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 shutdown_connections 2024-09-10T08:37:19.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.562+0000 7fa73cc00640 1 -- 172.21.15.52:0/1902858694 wait complete. 2024-09-10T08:37:19.578 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:37:19.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:19.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.736+0000 7f1fe5600640 1 Processor -- start 2024-09-10T08:37:19.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.736+0000 7f1fe5600640 1 -- start start 2024-09-10T08:37:19.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.737+0000 7f1fe5600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe00b2d40 0x7f1fe006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.737+0000 7f1fe5600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 0x7f1fe006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.737+0000 7f1fe5600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe0071180 con 0x7f1fe015bcf0 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.737+0000 7f1fe5600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe015c890 con 0x7f1fe00b2d40 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.737+0000 7f1fe5600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe0071ab0 con 0x7f1fe013eb20 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe00b2d40 0x7f1fe006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fe00b2d40 0x7f1fe006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57036/0 (socket says 172.21.15.52:57036) 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 -- 172.21.15.52:0/33471599 learned_addr learned my addr 172.21.15.52:0/33471599 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdf400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1fe015bcf0 0x7f1fe015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46660/0 (socket says 172.21.15.52:46660) 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fde000640 1 --2- 172.21.15.52:0/33471599 >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 0x7f1fe006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 -- 172.21.15.52:0/33471599 >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 msgr2=0x7f1fe006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 --2- 172.21.15.52:0/33471599 >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 0x7f1fe006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 -- 172.21.15.52:0/33471599 >> v1:172.21.15.52:6789/0 conn(0x7f1fe015bcf0 legacy=0x7f1fe015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdea00640 1 -- 172.21.15.52:0/33471599 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe0071460 con 0x7f1fe00b2d40 2024-09-10T08:37:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fde000640 1 --2- 172.21.15.52:0/33471599 >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 0x7f1fe006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:19.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.738+0000 7f1fdd600640 1 -- 172.21.15.52:0/33471599 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777487612 0 0) 0x7f1fe0071180 con 0x7f1fe015bcf0 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.739+0000 7f1fdea00640 1 --2- 172.21.15.52:0/33471599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe00b2d40 0x7f1fe006bc10 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00d1500 tx=0x7f1fd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10422f83917258d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.739+0000 7f1fdd600640 1 -- 172.21.15.52:0/33471599 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0037070 con 0x7f1fe00b2d40 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.739+0000 7f1fdd600640 1 -- 172.21.15.52:0/33471599 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd0032440 con 0x7f1fe00b2d40 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.739+0000 7f1fdd600640 1 -- 172.21.15.52:0/33471599 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0032810 con 0x7f1fe00b2d40 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 -- 172.21.15.52:0/33471599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe00b2d40 msgr2=0x7f1fe006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 --2- 172.21.15.52:0/33471599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe00b2d40 0x7f1fe006bc10 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00d1500 tx=0x7f1fd002a270 comp rx=0 tx=0).stop 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 -- 172.21.15.52:0/33471599 shutdown_connections 2024-09-10T08:37:19.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 --2- 172.21.15.52:0/33471599 >> v2:172.21.15.176:3300/0 conn(0x7f1fe013eb20 0x7f1fe006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 --2- 172.21.15.52:0/33471599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe00b2d40 0x7f1fe006bc10 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 -- 172.21.15.52:0/33471599 >> 172.21.15.52:0/33471599 conn(0x7f1fe00ccec0 msgr2=0x7f1fe00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 -- 172.21.15.52:0/33471599 shutdown_connections 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.740+0000 7f1fe5600640 1 -- 172.21.15.52:0/33471599 wait complete. 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.742+0000 7f1fe5600640 1 Processor -- start 2024-09-10T08:37:19.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.742+0000 7f1fe5600640 1 -- start start 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe00b2d40 0x7f1fe0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe013eb20 0x7f1fe0135d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe00720c0 con 0x7f1fe015bcf0 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0071f40 con 0x7f1fe00b2d40 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fe5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe0072240 con 0x7f1fe013eb20 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57040/0 (socket says 172.21.15.52:57040) 2024-09-10T08:37:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 -- 172.21.15.52:0/3941850786 learned_addr learned my addr 172.21.15.52:0/3941850786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdea00640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe00b2d40 0x7f1fe0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fde000640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe013eb20 0x7f1fe0135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 -- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe013eb20 msgr2=0x7f1fe0135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe013eb20 0x7f1fe0135d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 -- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe00b2d40 msgr2=0x7f1fe0154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe00b2d40 0x7f1fe0154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.743+0000 7f1fdf400640 1 -- 172.21.15.52:0/3941850786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe01396b0 con 0x7f1fe015bcf0 2024-09-10T08:37:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fdf400640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c730 tx=0x7f1fd800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8018070 con 0x7f1fe015bcf0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd800ce40 con 0x7f1fe015bcf0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe0139990 con 0x7f1fe015bcf0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800a820 con 0x7f1fe015bcf0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.744+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe0139f50 con 0x7f1fe015bcf0 2024-09-10T08:37:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.745+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe0154d10 con 0x7f1fe015bcf0 2024-09-10T08:37:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.746+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fd801b070 con 0x7f1fe015bcf0 2024-09-10T08:37:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.747+0000 7f1fd6a00640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.747+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f1fd808a320 con 0x7f1fe015bcf0 2024-09-10T08:37:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.747+0000 7f1fdea00640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.748+0000 7f1fdea00640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 0x7f1fc006e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034000 tx=0x7f1fd002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:19.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.751+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fd8058670 con 0x7f1fe015bcf0 2024-09-10T08:37:19.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.972+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fe015c180 con 0x7f1fe015bcf0 2024-09-10T08:37:19.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.973+0000 7f1fd6a00640 1 -- 172.21.15.52:0/3941850786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7f1fd805c970 con 0x7f1fe015bcf0 2024-09-10T08:37:19.973 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 msgr2=0x7f1fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 0x7f1fc006e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034000 tx=0x7f1fd002e000 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 msgr2=0x7f1fe013ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c730 tx=0x7f1fd800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 shutdown_connections 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe015bcf0 0x7f1fe013ce50 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fe013eb20 0x7f1fe0135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 --2- 172.21.15.52:0/3941850786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fe00b2d40 0x7f1fe0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:19.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 >> 172.21.15.52:0/3941850786 conn(0x7f1fe00ccec0 msgr2=0x7f1fe015b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:19.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 shutdown_connections 2024-09-10T08:37:19.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:19.975+0000 7f1fe5600640 1 -- 172.21.15.52:0/3941850786 wait complete. 2024-09-10T08:37:19.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:20.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.147+0000 7f836fe00640 1 Processor -- start 2024-09-10T08:37:20.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.147+0000 7f836fe00640 1 -- start start 2024-09-10T08:37:20.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.148+0000 7f836fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 0x7f836806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.148+0000 7f836fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836813eb20 0x7f836806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.148+0000 7f836fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f836815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8368071ab0 con 0x7f836813eb20 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8368071180 con 0x7f83680b2d40 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8368071460 con 0x7f836815bcf0 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836813eb20 0x7f836806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836813eb20 0x7f836806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57048/0 (socket says 172.21.15.52:57048) 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 -- 172.21.15.52:0/2910328583 learned_addr learned my addr 172.21.15.52:0/2910328583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836de00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f836815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836d400640 1 --2- 172.21.15.52:0/2910328583 >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 0x7f836806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 -- 172.21.15.52:0/2910328583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 msgr2=0x7f836815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:20.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f836815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 -- 172.21.15.52:0/2910328583 >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 msgr2=0x7f836806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 --2- 172.21.15.52:0/2910328583 >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 0x7f836806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836ca00640 1 -- 172.21.15.52:0/2910328583 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368071740 con 0x7f836813eb20 2024-09-10T08:37:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836de00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f836815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.149+0000 7f836d400640 1 --2- 172.21.15.52:0/2910328583 >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 0x7f836806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.150+0000 7f836ca00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f836806c150 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8368069be0 tx=0x7f835402c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eff654706a8f9bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.150+0000 7f8367e00640 1 -- 172.21.15.52:0/2910328583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354038070 con 0x7f836813eb20 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f8367e00640 1 -- 172.21.15.52:0/2910328583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8354031710 con 0x7f836813eb20 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f8367e00640 1 -- 172.21.15.52:0/2910328583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354031ae0 con 0x7f836813eb20 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 -- 172.21.15.52:0/2910328583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 msgr2=0x7f836806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f836806c150 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8368069be0 tx=0x7f835402c3e0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 -- 172.21.15.52:0/2910328583 shutdown_connections 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f836815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 --2- 172.21.15.52:0/2910328583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f836806c150 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 --2- 172.21.15.52:0/2910328583 >> v2:172.21.15.176:3300/0 conn(0x7f83680b2d40 0x7f836806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 -- 172.21.15.52:0/2910328583 >> 172.21.15.52:0/2910328583 conn(0x7f83680ccec0 msgr2=0x7f83680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 -- 172.21.15.52:0/2910328583 shutdown_connections 2024-09-10T08:37:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.151+0000 7f836fe00640 1 -- 172.21.15.52:0/2910328583 wait complete. 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.153+0000 7f836fe00640 1 Processor -- start 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.153+0000 7f836fe00640 1 -- start start 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83680b2d40 0x7f836813e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f83680b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f836815f140 con 0x7f836813eb20 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f836815efc0 con 0x7f83680b2d40 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f836815f2c0 con 0x7f836815bcf0 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57050/0 (socket says 172.21.15.52:57050) 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836ca00640 1 -- 172.21.15.52:0/2351658418 learned_addr learned my addr 172.21.15.52:0/2351658418 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836d400640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83680b2d40 0x7f836813e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.154+0000 7f836de00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f83680b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 -- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 msgr2=0x7f83680b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f83680b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 -- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83680b2d40 msgr2=0x7f836813e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83680b2d40 0x7f836813e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 -- 172.21.15.52:0/2351658418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368157940 con 0x7f836813eb20 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836de00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f83680b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836ca00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8354000c00 tx=0x7f83540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354038040 con 0x7f836813eb20 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8354033830 con 0x7f836813eb20 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354033c40 con 0x7f836813eb20 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8368157c20 con 0x7f836813eb20 2024-09-10T08:37:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.155+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83680b6290 con 0x7f836813eb20 2024-09-10T08:37:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.156+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836815c1a0 con 0x7f836813eb20 2024-09-10T08:37:20.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.158+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f835403e430 con 0x7f836813eb20 2024-09-10T08:37:20.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.159+0000 7f8365600640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 0x7f834806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.159+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f83540ab890 con 0x7f836813eb20 2024-09-10T08:37:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.159+0000 7f836d400640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 0x7f834806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.160+0000 7f836d400640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 0x7f834806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f835c009950 tx=0x7f835c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.163+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f835407a230 con 0x7f836813eb20 2024-09-10T08:37:20.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.385+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8368158140 con 0x7f836813eb20 2024-09-10T08:37:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.385+0000 7f8365600640 1 -- 172.21.15.52:0/2351658418 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5231 (secure 0 0 0) 0x7f8354079b30 con 0x7f836813eb20 2024-09-10T08:37:20.386 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:20.386 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":93,"btime":"2024-09-10T08:36:41:070345+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:36:37.504410+0000","modified":"2024-09-10T08:36:40.492151+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7450},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7450":{"gid":7450,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/3294209549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3294209549},{"type":"v1","addr":"172.21.15.52:6835","nonce":3294209549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7450,"qdb_cluster":[7450]},"id":8}]} 2024-09-10T08:37:20.386 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 93 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 msgr2=0x7f834806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 0x7f834806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f835c009950 tx=0x7f835c008040 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 msgr2=0x7f83680cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8354000c00 tx=0x7f83540046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 shutdown_connections 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f834806be30 0x7f834806e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f836815bcf0 0x7f83680b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f836813eb20 0x7f83680cc2c0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 --2- 172.21.15.52:0/2351658418 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83680b2d40 0x7f836813e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 >> 172.21.15.52:0/2351658418 conn(0x7f83680ccec0 msgr2=0x7f836815d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 shutdown_connections 2024-09-10T08:37:20.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.388+0000 7f836fe00640 1 -- 172.21.15.52:0/2351658418 wait complete. 2024-09-10T08:37:20.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.560+0000 7f8c4d000640 1 Processor -- start 2024-09-10T08:37:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.560+0000 7f8c4d000640 1 -- start start 2024-09-10T08:37:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c4d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c4806c320 0x7f8c4815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c4d000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8c4813eb20 0x7f8c4815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c4d000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c48071180 con 0x7f8c480b2d40 2024-09-10T08:37:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c4d000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8c48071ab0 con 0x7f8c4813eb20 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c4d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c48071460 con 0x7f8c4806c320 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c45e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8c480b2d40 0x7f8c4806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46672/0 (socket says 172.21.15.52:46672) 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.561+0000 7f8c45e00640 1 -- 172.21.15.52:0/943172815 learned_addr learned my addr 172.21.15.52:0/943172815 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c46800640 1 --2- 172.21.15.52:0/943172815 >> v2:172.21.15.176:3300/0 conn(0x7f8c4813eb20 0x7f8c4815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c45400640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c4806c320 0x7f8c4815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c44a00640 1 -- 172.21.15.52:0/943172815 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831006475 0 0) 0x7f8c48071180 con 0x7f8c480b2d40 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c44a00640 1 -- 172.21.15.52:0/943172815 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c2c005730 con 0x7f8c480b2d40 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c46800640 1 -- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c4806c320 msgr2=0x7f8c4815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c46800640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c4806c320 0x7f8c4815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c46800640 1 -- 172.21.15.52:0/943172815 >> v1:172.21.15.52:6789/0 conn(0x7f8c480b2d40 legacy=0x7f8c4806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.562+0000 7f8c46800640 1 -- 172.21.15.52:0/943172815 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48071740 con 0x7f8c4813eb20 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.563+0000 7f8c46800640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4813eb20 0x7f8c4815c230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d82835b30f2df68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c44a00640 1 -- 172.21.15.52:0/943172815 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40007740 con 0x7f8c4813eb20 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c44a00640 1 -- 172.21.15.52:0/943172815 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c400078e0 con 0x7f8c4813eb20 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c44a00640 1 -- 172.21.15.52:0/943172815 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40007c90 con 0x7f8c4813eb20 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 -- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4813eb20 msgr2=0x7f8c4815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4813eb20 0x7f8c4815c230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4002a660 comp rx=0 tx=0).stop 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 -- 172.21.15.52:0/943172815 shutdown_connections 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4813eb20 0x7f8c4815c230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 --2- 172.21.15.52:0/943172815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c4806c320 0x7f8c4815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 -- 172.21.15.52:0/943172815 >> 172.21.15.52:0/943172815 conn(0x7f8c480ccec0 msgr2=0x7f8c480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 -- 172.21.15.52:0/943172815 shutdown_connections 2024-09-10T08:37:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.564+0000 7f8c4d000640 1 -- 172.21.15.52:0/943172815 wait complete. 2024-09-10T08:37:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.566+0000 7f8c4d000640 1 Processor -- start 2024-09-10T08:37:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.566+0000 7f8c4d000640 1 -- start start 2024-09-10T08:37:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 0x7f8c4813e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c480b2d40 0x7f8c4815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480720c0 con 0x7f8c4813eb20 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48071f40 con 0x7f8c4806c320 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c4d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c48072240 con 0x7f8c480b2d40 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57052/0 (socket says 172.21.15.52:57052) 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c46800640 1 -- 172.21.15.52:0/4264139875 learned_addr learned my addr 172.21.15.52:0/4264139875 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.567+0000 7f8c45e00640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 0x7f8c4813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c45400640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c480b2d40 0x7f8c4815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 -- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c480b2d40 msgr2=0x7f8c4815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c480b2d40 0x7f8c4815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 -- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 msgr2=0x7f8c4813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 0x7f8c4813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 -- 172.21.15.52:0/4264139875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c481f4a90 con 0x7f8c4813eb20 2024-09-10T08:37:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c45e00640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 0x7f8c4813e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c46800640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009eb0 tx=0x7f8c40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4003f070 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c40031c60 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40009450 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.568+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c481f4d70 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.569+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f5330 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.570+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4806bc10 con 0x7f8c4813eb20 2024-09-10T08:37:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.571+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c4003b410 con 0x7f8c4813eb20 2024-09-10T08:37:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.572+0000 7f8c3e000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 0x7f8c2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.572+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f8c400ac0a0 con 0x7f8c4813eb20 2024-09-10T08:37:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.572+0000 7f8c45e00640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 0x7f8c2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.573+0000 7f8c45e00640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 0x7f8c2806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c38005880 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.577+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c400078a0 con 0x7f8c4813eb20 2024-09-10T08:37:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.763+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c480ce200 con 0x7f8c4813eb20 2024-09-10T08:37:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.765+0000 7f8c3e000640 1 -- 172.21.15.52:0/4264139875 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16755 (secure 0 0 0) 0x7f8c4007a400 con 0x7f8c4813eb20 2024-09-10T08:37:20.765 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:20.765 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":124,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:36:39.053620+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:36:35.265667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-10T08:36:36.457296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 msgr2=0x7f8c2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 0x7f8c2806e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c38005880 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 msgr2=0x7f8c4815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009eb0 tx=0x7f8c40004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 shutdown_connections 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c2806be30 0x7f8c2806e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c4813eb20 0x7f8c4815f400 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c480b2d40 0x7f8c4815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 --2- 172.21.15.52:0/4264139875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c4806c320 0x7f8c4813e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 >> 172.21.15.52:0/4264139875 conn(0x7f8c480ccec0 msgr2=0x7f8c481583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 shutdown_connections 2024-09-10T08:37:20.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.767+0000 7f8c4d000640 1 -- 172.21.15.52:0/4264139875 wait complete. 2024-09-10T08:37:20.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:37:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.941+0000 7f59e2200640 1 Processor -- start 2024-09-10T08:37:20.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.941+0000 7f59e2200640 1 -- start start 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59e2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59dc145ed0 0x7f59dc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59e2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0b4020 con 0x7f59dc0b5f90 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59e2200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0b42c0 con 0x7f59dc073180 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59e2200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc0b63d0 con 0x7f59dc145ed0 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59dc145ed0 0x7f59dc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59dc145ed0 0x7f59dc0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57062/0 (socket says 172.21.15.52:57062) 2024-09-10T08:37:20.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.942+0000 7f59db400640 1 -- 172.21.15.52:0/1373411130 learned_addr learned my addr 172.21.15.52:0/1373411130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.943+0000 7f59db400640 1 -- 172.21.15.52:0/1373411130 >> v1:172.21.15.176:6789/0 conn(0x7f59dc073180 legacy=0x7f59dc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.943+0000 7f59db400640 1 -- 172.21.15.52:0/1373411130 >> v1:172.21.15.52:6789/0 conn(0x7f59dc0b5f90 legacy=0x7f59dc15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.943+0000 7f59db400640 1 -- 172.21.15.52:0/1373411130 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0b45a0 con 0x7f59dc145ed0 2024-09-10T08:37:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.944+0000 7f59db400640 1 --2- 172.21.15.52:0/1373411130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc145ed0 0x7f59dc0b5080 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009870 tx=0x7f59cc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e8eeef559b5bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.944+0000 7f59da000640 1 -- 172.21.15.52:0/1373411130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc037070 con 0x7f59dc145ed0 2024-09-10T08:37:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.944+0000 7f59da000640 1 -- 172.21.15.52:0/1373411130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc032440 con 0x7f59dc145ed0 2024-09-10T08:37:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.944+0000 7f59da000640 1 -- 172.21.15.52:0/1373411130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc032810 con 0x7f59dc145ed0 2024-09-10T08:37:20.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 -- 172.21.15.52:0/1373411130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc145ed0 msgr2=0x7f59dc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 --2- 172.21.15.52:0/1373411130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc145ed0 0x7f59dc0b5080 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009870 tx=0x7f59cc02a2a0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 -- 172.21.15.52:0/1373411130 shutdown_connections 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 --2- 172.21.15.52:0/1373411130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc145ed0 0x7f59dc0b5080 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 -- 172.21.15.52:0/1373411130 >> 172.21.15.52:0/1373411130 conn(0x7f59dc0ccec0 msgr2=0x7f59dc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 -- 172.21.15.52:0/1373411130 shutdown_connections 2024-09-10T08:37:20.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.945+0000 7f59e2200640 1 -- 172.21.15.52:0/1373411130 wait complete. 2024-09-10T08:37:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.946+0000 7f59e2200640 1 Processor -- start 2024-09-10T08:37:20.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 -- start start 2024-09-10T08:37:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc073180 0x7f59dc143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59dc145ed0 0x7f59dc0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc1462b0 con 0x7f59dc0b5f90 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0b4b60 con 0x7f59dc073180 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.947+0000 7f59e2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc146430 con 0x7f59dc145ed0 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57076/0 (socket says 172.21.15.52:57076) 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 -- 172.21.15.52:0/2411793146 learned_addr learned my addr 172.21.15.52:0/2411793146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59dbe00640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59dc145ed0 0x7f59dc0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59db400640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc073180 0x7f59dc143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 -- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59dc145ed0 msgr2=0x7f59dc0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59dc145ed0 0x7f59dc0ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 -- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc073180 msgr2=0x7f59dc143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc073180 0x7f59dc143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:20.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 -- 172.21.15.52:0/2411793146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc143890 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.948+0000 7f59daa00640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f59c800b3f0 tx=0x7f59c800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.949+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8015020 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.949+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c8011830 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.949+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8011c20 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.949+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc143b60 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.949+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc144120 con 0x7f59dc0b5f90 2024-09-10T08:37:20.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.950+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc0b5080 con 0x7f59dc0b5f90 2024-09-10T08:37:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.951+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59c8018020 con 0x7f59dc0b5f90 2024-09-10T08:37:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.951+0000 7f59d3400640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 0x7f59bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.952+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f59c808a9d0 con 0x7f59dc0b5f90 2024-09-10T08:37:20.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.952+0000 7f59db400640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 0x7f59bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:20.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.953+0000 7f59db400640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 0x7f59bc06e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59cc034000 tx=0x7f59cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:20.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:20.956+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59c801f030 con 0x7f59dc0b5f90 2024-09-10T08:37:21.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.175+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f59dc0cd6b0 con 0x7f59dc0b5f90 2024-09-10T08:37:21.176 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:37:21.175+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:37:21.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.177+0000 7f59d3400640 1 -- 172.21.15.52:0/2411793146 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f59c8058c90 con 0x7f59dc0b5f90 2024-09-10T08:37:21.178 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:37:21.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 msgr2=0x7f59bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 0x7f59bc06e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f59cc034000 tx=0x7f59cc02e000 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 msgr2=0x7f59dc0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f59c800b3f0 tx=0x7f59c800b8b0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 shutdown_connections 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f59bc06be30 0x7f59bc06e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59dc145ed0 0x7f59dc0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59dc0b5f90 0x7f59dc0ce620 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 --2- 172.21.15.52:0/2411793146 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc073180 0x7f59dc143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.180+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 >> 172.21.15.52:0/2411793146 conn(0x7f59dc0ccec0 msgr2=0x7f59dc0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.181+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 shutdown_connections 2024-09-10T08:37:21.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.181+0000 7f59e2200640 1 -- 172.21.15.52:0/2411793146 wait complete. 2024-09-10T08:37:21.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:37:21.251 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:37:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.359+0000 7f8d03e00640 1 Processor -- start 2024-09-10T08:37:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.359+0000 7f8d03e00640 1 -- start start 2024-09-10T08:37:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.360+0000 7f8d03e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8d0415e620 0x7f8d040d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.360+0000 7f8d03e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d040d1670 0x7f8d040b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.360+0000 7f8d03e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d040d3250 con 0x7f8d040d2660 2024-09-10T08:37:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.360+0000 7f8d03e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8d040b7680 con 0x7f8d040d1670 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.360+0000 7f8d03e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8d040b78b0 con 0x7f8d0415e620 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d040d1670 0x7f8d040b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d040d1670 0x7f8d040b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57096/0 (socket says 172.21.15.52:57096) 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 -- 172.21.15.52:0/3313422811 learned_addr learned my addr 172.21.15.52:0/3313422811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d02a00640 1 --2- 172.21.15.52:0/3313422811 >> v2:172.21.15.176:3300/0 conn(0x7f8d0415e620 0x7f8d040d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 -- 172.21.15.52:0/3313422811 >> v2:172.21.15.176:3300/0 conn(0x7f8d0415e620 msgr2=0x7f8d040d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 --2- 172.21.15.52:0/3313422811 >> v2:172.21.15.176:3300/0 conn(0x7f8d0415e620 0x7f8d040d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 -- 172.21.15.52:0/3313422811 >> v1:172.21.15.176:6789/0 conn(0x7f8d040d2660 legacy=0x7f8d040d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.361+0000 7f8d03400640 1 -- 172.21.15.52:0/3313422811 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0415ea00 con 0x7f8d040d1670 2024-09-10T08:37:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.362+0000 7f8d03400640 1 --2- 172.21.15.52:0/3313422811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d1670 0x7f8d040b8070 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f8d040d5650 tx=0x7f8cfc02a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3f5f1cd5fead45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.362+0000 7f8d01600640 1 -- 172.21.15.52:0/3313422811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc036070 con 0x7f8d040d1670 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.362+0000 7f8d01600640 1 -- 172.21.15.52:0/3313422811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc031600 con 0x7f8d040d1670 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.362+0000 7f8d01600640 1 -- 172.21.15.52:0/3313422811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0319d0 con 0x7f8d040d1670 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 -- 172.21.15.52:0/3313422811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d1670 msgr2=0x7f8d040b8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 --2- 172.21.15.52:0/3313422811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d1670 0x7f8d040b8070 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f8d040d5650 tx=0x7f8cfc02a740 comp rx=0 tx=0).stop 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 -- 172.21.15.52:0/3313422811 shutdown_connections 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 --2- 172.21.15.52:0/3313422811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d1670 0x7f8d040b8070 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 --2- 172.21.15.52:0/3313422811 >> v2:172.21.15.176:3300/0 conn(0x7f8d0415e620 0x7f8d040d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 -- 172.21.15.52:0/3313422811 >> 172.21.15.52:0/3313422811 conn(0x7f8d04067950 msgr2=0x7f8d04067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 -- 172.21.15.52:0/3313422811 shutdown_connections 2024-09-10T08:37:21.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.363+0000 7f8d03e00640 1 -- 172.21.15.52:0/3313422811 wait complete. 2024-09-10T08:37:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.365+0000 7f8d03e00640 1 Processor -- start 2024-09-10T08:37:21.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.365+0000 7f8d03e00640 1 -- start start 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 0x7f8d04147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 0x7f8d0415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d040d40a0 con 0x7f8d040d2660 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d040d2f70 con 0x7f8d040d1670 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8d040b85b0 con 0x7f8d0415e620 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57104/0 (socket says 172.21.15.52:57104) 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 -- 172.21.15.52:0/730032468 learned_addr learned my addr 172.21.15.52:0/730032468 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02a00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 0x7f8d04147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03400640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 0x7f8d0415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 -- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 msgr2=0x7f8d0415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 0x7f8d0415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 -- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 msgr2=0x7f8d04147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 0x7f8d04147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02000640 1 -- 172.21.15.52:0/730032468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d04147670 con 0x7f8d040d2660 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d02a00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 0x7f8d04147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.366+0000 7f8d03400640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 0x7f8d0415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8d02000640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c400 tx=0x7f8cf000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf00052d0 con 0x7f8d040d2660 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0005490 con 0x7f8d040d2660 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0007260 con 0x7f8d040d2660 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d04155e20 con 0x7f8d040d2660 2024-09-10T08:37:21.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.367+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d041563e0 con 0x7f8d040d2660 2024-09-10T08:37:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.368+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d040b8070 con 0x7f8d040d2660 2024-09-10T08:37:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.369+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cf0007400 con 0x7f8d040d2660 2024-09-10T08:37:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.370+0000 7f8cfb400640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:21.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.370+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5795+0+0 (secure 0 0 0) 0x7f8cf008a530 con 0x7f8d040d2660 2024-09-10T08:37:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.370+0000 7f8d02a00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:21.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.371+0000 7f8d02a00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 0x7f8ce406e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009af0 tx=0x7f8cf4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:21.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.375+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cf0058d50 con 0x7f8d040d2660 2024-09-10T08:37:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:21.594+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8d0415d400 con 0x7f8d040d2660 2024-09-10T08:37:22.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.183+0000 7f8cfb400640 1 -- 172.21.15.52:0/730032468 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) ==== 104+0+0 (secure 0 0 0) 0x7f8cf0058650 con 0x7f8d040d2660 2024-09-10T08:37:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 msgr2=0x7f8ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 0x7f8ce406e2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009af0 tx=0x7f8cf4008040 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 msgr2=0x7f8d041f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f8cf000c400 tx=0x7f8cf000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 shutdown_connections 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8d0415e620 0x7f8d0415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d040d2660 0x7f8d041f3e50 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 --2- 172.21.15.52:0/730032468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d040d1670 0x7f8d04147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 >> 172.21.15.52:0/730032468 conn(0x7f8d04067950 msgr2=0x7f8d040ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 shutdown_connections 2024-09-10T08:37:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.186+0000 7f8d03e00640 1 -- 172.21.15.52:0/730032468 wait complete. 2024-09-10T08:37:22.204 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:37:22.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.366+0000 7f10a6400640 1 Processor -- start 2024-09-10T08:37:22.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.366+0000 7f10a6400640 1 -- start start 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.367+0000 7f10a6400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10a015c0e0 0x7f10a00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.367+0000 7f10a6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a00cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.367+0000 7f10a6400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a015f3d0 con 0x7f10a015ec60 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.367+0000 7f10a6400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00ce120 con 0x7f10a015c0e0 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.367+0000 7f10a6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10a015f6b0 con 0x7f10a00cd790 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10a015c0e0 0x7f10a00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f109fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f10a015ec60 0x7f10a015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46702/0 (socket says 172.21.15.52:46702) 2024-09-10T08:37:22.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f109fe00640 1 -- 172.21.15.52:0/2434990639 learned_addr learned my addr 172.21.15.52:0/2434990639 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:22.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5000640 1 -- 172.21.15.52:0/2434990639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 msgr2=0x7f10a00cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:22.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5a00640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a00cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5000640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a00cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5000640 1 -- 172.21.15.52:0/2434990639 >> v1:172.21.15.52:6789/0 conn(0x7f10a015ec60 legacy=0x7f10a015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5000640 1 -- 172.21.15.52:0/2434990639 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a015f990 con 0x7f10a015c0e0 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f109f400640 1 -- 172.21.15.52:0/2434990639 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757920725 0 0) 0x7f10a015f3d0 con 0x7f10a015ec60 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.368+0000 7f10a5a00640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a00cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.369+0000 7f10a5000640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a00b2f20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f10940097a0 tx=0x7f109402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f1caac149ceb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.369+0000 7f109f400640 1 -- 172.21.15.52:0/2434990639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094037070 con 0x7f10a015c0e0 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.369+0000 7f109f400640 1 -- 172.21.15.52:0/2434990639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1094032440 con 0x7f10a015c0e0 2024-09-10T08:37:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.369+0000 7f109f400640 1 -- 172.21.15.52:0/2434990639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094032810 con 0x7f10a015c0e0 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 -- 172.21.15.52:0/2434990639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 msgr2=0x7f10a00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a00b2f20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f10940097a0 tx=0x7f109402a180 comp rx=0 tx=0).stop 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 -- 172.21.15.52:0/2434990639 shutdown_connections 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a00cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 --2- 172.21.15.52:0/2434990639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a00b2f20 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 -- 172.21.15.52:0/2434990639 >> 172.21.15.52:0/2434990639 conn(0x7f10a006c240 msgr2=0x7f10a006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 -- 172.21.15.52:0/2434990639 shutdown_connections 2024-09-10T08:37:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.370+0000 7f10a6400640 1 -- 172.21.15.52:0/2434990639 wait complete. 2024-09-10T08:37:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.372+0000 7f10a6400640 1 Processor -- start 2024-09-10T08:37:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.372+0000 7f10a6400640 1 -- start start 2024-09-10T08:37:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a01f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 0x7f10a01f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0160530 con 0x7f10a015c0e0 2024-09-10T08:37:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f10a015f0f0 con 0x7f10a015ec60 2024-09-10T08:37:22.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10a015c4c0 con 0x7f10a00cd790 2024-09-10T08:37:22.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:22.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57126/0 (socket says 172.21.15.52:57126) 2024-09-10T08:37:22.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 -- 172.21.15.52:0/2649564650 learned_addr learned my addr 172.21.15.52:0/2649564650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a5a00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 0x7f10a01f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 -- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 msgr2=0x7f10a01f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a01f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 -- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 msgr2=0x7f10a01f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 0x7f10a01f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f109fe00640 1 -- 172.21.15.52:0/2649564650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01f4ff0 con 0x7f10a015c0e0 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.373+0000 7f10a5a00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 0x7f10a01f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f109fe00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c430 tx=0x7f108c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c0074e0 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c0047e0 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c004bd0 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a00ab9d0 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.374+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a00abf90 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.375+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a00cdbe0 con 0x7f10a015c0e0 2024-09-10T08:37:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.376+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f108c011070 con 0x7f10a015c0e0 2024-09-10T08:37:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.377+0000 7f109cc00640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 0x7f108006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.377+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5795+0+0 (secure 0 0 0) 0x7f108c08aad0 con 0x7f10a015c0e0 2024-09-10T08:37:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.378+0000 7f10a5000640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 0x7f108006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.378+0000 7f10a5000640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 0x7f108006e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1094034000 tx=0x7f109402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:22.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.381+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a01f4ff0 con 0x7f10a015c0e0 2024-09-10T08:37:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:22.565+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10a0072990 con 0x7f10a015c0e0 2024-09-10T08:37:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.185+0000 7f109cc00640 1 -- 172.21.15.52:0/2649564650 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v126) ==== 181+0+0 (secure 0 0 0) 0x7f108c059410 con 0x7f10a015c0e0 2024-09-10T08:37:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:37:23.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.189+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 msgr2=0x7f108006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 0x7f108006e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1094034000 tx=0x7f109402c000 comp rx=0 tx=0).stop 2024-09-10T08:37:23.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 msgr2=0x7f10a01f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c430 tx=0x7f108c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 shutdown_connections 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f108006be30 0x7f108006e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10a015ec60 0x7f10a01f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10a015c0e0 0x7f10a01f4ab0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 --2- 172.21.15.52:0/2649564650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10a00cd790 0x7f10a01f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.190+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 >> 172.21.15.52:0/2649564650 conn(0x7f10a006c240 msgr2=0x7f10a01619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:23.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.191+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 shutdown_connections 2024-09-10T08:37:23.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.191+0000 7f10a6400640 1 -- 172.21.15.52:0/2649564650 wait complete. 2024-09-10T08:37:23.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:37:23.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.376+0000 7f88af000640 1 Processor -- start 2024-09-10T08:37:23.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.376+0000 7f88af000640 1 -- start start 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88af000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a806f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88af000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a81592d0 con 0x7f88a8158ef0 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88af000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a81624a0 con 0x7f88a806f9f0 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88af000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88a8162740 con 0x7f88a806c320 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88a7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f88a8158ef0 0x7f88a806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46710/0 (socket says 172.21.15.52:46710) 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88a7e00640 1 -- 172.21.15.52:0/3748541411 learned_addr learned my addr 172.21.15.52:0/3748541411 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88a7400640 1 --2- 172.21.15.52:0/3748541411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a806f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142582816 0 0) 0x7f88a81592d0 con 0x7f88a8158ef0 2024-09-10T08:37:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.378+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f888c003520 con 0x7f88a8158ef0 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.379+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025330636 0 0) 0x7f88a81624a0 con 0x7f88a806f9f0 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.379+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a81592d0 con 0x7f88a806f9f0 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.379+0000 7f88a7400640 1 -- 172.21.15.52:0/3748541411 >> v1:172.21.15.176:6789/0 conn(0x7f88a806f9f0 legacy=0x7f88a80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.379+0000 7f88a7400640 1 -- 172.21.15.52:0/3748541411 >> v1:172.21.15.52:6789/0 conn(0x7f88a8158ef0 legacy=0x7f88a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.379+0000 7f88a7400640 1 -- 172.21.15.52:0/3748541411 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a8162a20 con 0x7f88a806c320 2024-09-10T08:37:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.380+0000 7f88a7400640 1 --2- 172.21.15.52:0/3748541411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a806f4b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88940097d0 tx=0x7f889402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26323f90c10dfbbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.380+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894037070 con 0x7f88a806c320 2024-09-10T08:37:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.380+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8894032440 con 0x7f88a806c320 2024-09-10T08:37:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.380+0000 7f88a6a00640 1 -- 172.21.15.52:0/3748541411 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894032810 con 0x7f88a806c320 2024-09-10T08:37:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 -- 172.21.15.52:0/3748541411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 msgr2=0x7f88a806f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 --2- 172.21.15.52:0/3748541411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a806f4b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f88940097d0 tx=0x7f889402a180 comp rx=0 tx=0).stop 2024-09-10T08:37:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 -- 172.21.15.52:0/3748541411 shutdown_connections 2024-09-10T08:37:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 --2- 172.21.15.52:0/3748541411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a806f4b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 -- 172.21.15.52:0/3748541411 >> 172.21.15.52:0/3748541411 conn(0x7f88a8067da0 msgr2=0x7f88a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 -- 172.21.15.52:0/3748541411 shutdown_connections 2024-09-10T08:37:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.381+0000 7f88af000640 1 -- 172.21.15.52:0/3748541411 wait complete. 2024-09-10T08:37:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.383+0000 7f88af000640 1 Processor -- start 2024-09-10T08:37:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.383+0000 7f88af000640 1 -- start start 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88a806f9f0 0x7f88a81e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88a806fe60 con 0x7f88a8158ef0 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8162fe0 con 0x7f88a806f9f0 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88af000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f88a806ffe0 con 0x7f88a806c320 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88ad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88ad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57132/0 (socket says 172.21.15.52:57132) 2024-09-10T08:37:23.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88ad000640 1 -- 172.21.15.52:0/1187162480 learned_addr learned my addr 172.21.15.52:0/1187162480 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88a7e00640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.384+0000 7f88a7400640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88a806f9f0 0x7f88a81e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 -- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 msgr2=0x7f88a80ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a80ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 -- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88a806f9f0 msgr2=0x7f88a81e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88a806f9f0 0x7f88a81e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:23.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 -- 172.21.15.52:0/1187162480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a81f50a0 con 0x7f88a8158ef0 2024-09-10T08:37:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88ad000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c790 tx=0x7f88a000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0003b70 con 0x7f88a8158ef0 2024-09-10T08:37:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a0003d10 con 0x7f88a8158ef0 2024-09-10T08:37:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a000aa50 con 0x7f88a8158ef0 2024-09-10T08:37:23.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a80aee50 con 0x7f88a8158ef0 2024-09-10T08:37:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.385+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a80af410 con 0x7f88a8158ef0 2024-09-10T08:37:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.387+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a806f4b0 con 0x7f88a8158ef0 2024-09-10T08:37:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.387+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88a000abf0 con 0x7f88a8158ef0 2024-09-10T08:37:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.388+0000 7f889fe00640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.388+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5357+0+0 (secure 0 0 0) 0x7f88a008ac20 con 0x7f88a8158ef0 2024-09-10T08:37:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.389+0000 7f88a7e00640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.390+0000 7f88a7e00640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 0x7f888806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8898005880 tx=0x7f8898009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.393+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88a81f50a0 con 0x7f88a8158ef0 2024-09-10T08:37:23.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:23.580+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88a80d1430 con 0x7f88a8158ef0 2024-09-10T08:37:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.192+0000 7f889fe00640 1 -- 172.21.15.52:0/1187162480 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v127) ==== 169+0+0 (secure 0 0 0) 0x7f88a0059040 con 0x7f88a8158ef0 2024-09-10T08:37:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:37:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.196+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 msgr2=0x7f888806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.196+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 0x7f888806e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8898005880 tx=0x7f8898009040 comp rx=0 tx=0).stop 2024-09-10T08:37:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 msgr2=0x7f88a81f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c790 tx=0x7f88a000cc50 comp rx=0 tx=0).stop 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 shutdown_connections 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f888806be30 0x7f888806e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a8158ef0 0x7f88a81f4b60 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88a806f9f0 0x7f88a81e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 --2- 172.21.15.52:0/1187162480 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88a806c320 0x7f88a80ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 >> 172.21.15.52:0/1187162480 conn(0x7f88a8067da0 msgr2=0x7f88a8160dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:24.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 shutdown_connections 2024-09-10T08:37:24.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.197+0000 7f88af000640 1 -- 172.21.15.52:0/1187162480 wait complete. 2024-09-10T08:37:24.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:37:24.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.389+0000 7f8408800640 1 Processor -- start 2024-09-10T08:37:24.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.390+0000 7f8408800640 1 -- start start 2024-09-10T08:37:24.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8408800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f84000736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8408800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f84000cce30 0x7f84000cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8408800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84000714b0 con 0x7f8400071c70 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8408800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8400073c00 con 0x7f84000cce30 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8408800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f84000cd880 con 0x7f84000732e0 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8406800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8400071c70 0x7f840015c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60040/0 (socket says 172.21.15.52:60040) 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8406800640 1 -- 172.21.15.52:0/906539697 learned_addr learned my addr 172.21.15.52:0/906539697 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8405400640 1 --2- 172.21.15.52:0/906539697 >> v2:172.21.15.52:3300/0 conn(0x7f84000cce30 0x7f84000cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.391+0000 7f8405e00640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f84000736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8405400640 1 -- 172.21.15.52:0/906539697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 msgr2=0x7f84000736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8405400640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f84000736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8405400640 1 -- 172.21.15.52:0/906539697 >> v1:172.21.15.52:6789/0 conn(0x7f8400071c70 legacy=0x7f840015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8405400640 1 -- 172.21.15.52:0/906539697 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84000cdb60 con 0x7f84000cce30 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8404a00640 1 -- 172.21.15.52:0/906539697 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105155542 0 0) 0x7f84000714b0 con 0x7f8400071c70 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.392+0000 7f8405e00640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f84000736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:24.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8405400640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84000cd270 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097a0 tx=0x7f83f002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08a4dbf4dc740ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8404a00640 1 -- 172.21.15.52:0/906539697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0037070 con 0x7f84000cce30 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8404a00640 1 -- 172.21.15.52:0/906539697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f002ae40 con 0x7f84000cce30 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8404a00640 1 -- 172.21.15.52:0/906539697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0032660 con 0x7f84000cce30 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 -- 172.21.15.52:0/906539697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 msgr2=0x7f84000cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84000cd270 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097a0 tx=0x7f83f002a0f0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 -- 172.21.15.52:0/906539697 shutdown_connections 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84000cd270 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 --2- 172.21.15.52:0/906539697 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f84000736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.393+0000 7f8408800640 1 -- 172.21.15.52:0/906539697 >> 172.21.15.52:0/906539697 conn(0x7f840006d0f0 msgr2=0x7f840006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.394+0000 7f8408800640 1 -- 172.21.15.52:0/906539697 shutdown_connections 2024-09-10T08:37:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.394+0000 7f8408800640 1 -- 172.21.15.52:0/906539697 wait complete. 2024-09-10T08:37:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.395+0000 7f8408800640 1 Processor -- start 2024-09-10T08:37:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.395+0000 7f8408800640 1 -- start start 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8400071c70 0x7f84001e57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f8400154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f840006bf70 con 0x7f84000cce30 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f840006bdf0 con 0x7f8400071c70 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8408800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8400072120 con 0x7f84000732e0 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8406800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8406800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41934/0 (socket says 172.21.15.52:41934) 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8406800640 1 -- 172.21.15.52:0/693770696 learned_addr learned my addr 172.21.15.52:0/693770696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.396+0000 7f8405400640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f8400154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8405e00640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8400071c70 0x7f84001e57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 -- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 msgr2=0x7f8400154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f8400154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 -- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8400071c70 msgr2=0x7f84001e57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8400071c70 0x7f84001e57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 -- 172.21.15.52:0/693770696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8400145760 con 0x7f84000cce30 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8405400640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f8400154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8406800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7a0 tx=0x7f83fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc018070 con 0x7f84000cce30 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83fc00a640 con 0x7f84000cce30 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00aab0 con 0x7f84000cce30 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8400157770 con 0x7f84000cce30 2024-09-10T08:37:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.397+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8400157d30 con 0x7f84000cce30 2024-09-10T08:37:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.399+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84000724b0 con 0x7f84000cce30 2024-09-10T08:37:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.399+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83fc01b070 con 0x7f84000cce30 2024-09-10T08:37:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.400+0000 7f83fa000640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 0x7f83e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.400+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7f83fc08a1b0 con 0x7f84000cce30 2024-09-10T08:37:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.401+0000 7f8405e00640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 0x7f83e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.401+0000 7f8405e00640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 0x7f83e406e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f83f400a990 tx=0x7f83f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.405+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83fc058e60 con 0x7f84000cce30 2024-09-10T08:37:24.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.588+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f840015f370 con 0x7f84000cce30 2024-09-10T08:37:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.592+0000 7f83fa000640 1 -- 172.21.15.52:0/693770696 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f83fc058760 con 0x7f84000cce30 2024-09-10T08:37:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 msgr2=0x7f83e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 0x7f83e406e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f83f400a990 tx=0x7f83f4008040 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 msgr2=0x7f84001547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7a0 tx=0x7f83fc00cc60 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 shutdown_connections 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f83e406be30 0x7f83e406e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84000cce30 0x7f84001547d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f84000732e0 0x7f8400154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 --2- 172.21.15.52:0/693770696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8400071c70 0x7f84001e57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 >> 172.21.15.52:0/693770696 conn(0x7f840006d0f0 msgr2=0x7f840015ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 shutdown_connections 2024-09-10T08:37:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.594+0000 7f8408800640 1 -- 172.21.15.52:0/693770696 wait complete. 2024-09-10T08:37:24.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-10T08:37:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.767+0000 7f8c0c600640 1 Processor -- start 2024-09-10T08:37:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.767+0000 7f8c0c600640 1 -- start start 2024-09-10T08:37:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.768+0000 7f8c0c600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8c04073890 0x7f8c040b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.768+0000 7f8c0c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.768+0000 7f8c0c600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c040b4020 con 0x7f8c04145ed0 2024-09-10T08:37:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.768+0000 7f8c0c600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8c040b42c0 con 0x7f8c04073890 2024-09-10T08:37:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.768+0000 7f8c0c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c040b45a0 con 0x7f8c040b5880 2024-09-10T08:37:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c09200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8c04073890 0x7f8c040b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57290/0 (socket says 172.21.15.52:57290) 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 -- 172.21.15.52:0/841342002 learned_addr learned my addr 172.21.15.52:0/841342002 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 -- 172.21.15.52:0/841342002 >> v2:172.21.15.176:3300/0 conn(0x7f8c04073890 msgr2=0x7f8c040b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 --2- 172.21.15.52:0/841342002 >> v2:172.21.15.176:3300/0 conn(0x7f8c04073890 0x7f8c040b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 -- 172.21.15.52:0/841342002 >> v1:172.21.15.176:6789/0 conn(0x7f8c04145ed0 legacy=0x7f8c04073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.769+0000 7f8c0a600640 1 -- 172.21.15.52:0/841342002 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c040b4880 con 0x7f8c040b5880 2024-09-10T08:37:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.770+0000 7f8c0a600640 1 --2- 172.21.15.52:0/841342002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009e50 tx=0x7f8bfc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6f44cd865faf72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.770+0000 7f8c03e00640 1 -- 172.21.15.52:0/841342002 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc036070 con 0x7f8c040b5880 2024-09-10T08:37:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.770+0000 7f8c03e00640 1 -- 172.21.15.52:0/841342002 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc031600 con 0x7f8c040b5880 2024-09-10T08:37:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.770+0000 7f8c03e00640 1 -- 172.21.15.52:0/841342002 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0319d0 con 0x7f8c040b5880 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 -- 172.21.15.52:0/841342002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 msgr2=0x7f8c040b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 --2- 172.21.15.52:0/841342002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009e50 tx=0x7f8bfc02a710 comp rx=0 tx=0).stop 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 -- 172.21.15.52:0/841342002 shutdown_connections 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 --2- 172.21.15.52:0/841342002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c040b5880 0x7f8c040b5d30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 --2- 172.21.15.52:0/841342002 >> v2:172.21.15.176:3300/0 conn(0x7f8c04073890 0x7f8c040b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 -- 172.21.15.52:0/841342002 >> 172.21.15.52:0/841342002 conn(0x7f8c040ccec0 msgr2=0x7f8c040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 -- 172.21.15.52:0/841342002 shutdown_connections 2024-09-10T08:37:24.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.771+0000 7f8c0c600640 1 -- 172.21.15.52:0/841342002 wait complete. 2024-09-10T08:37:24.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.773+0000 7f8c0c600640 1 Processor -- start 2024-09-10T08:37:24.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.773+0000 7f8c0c600640 1 -- start start 2024-09-10T08:37:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c04073890 0x7f8c0413cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 0x7f8c0413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c040b6270 con 0x7f8c040b5880 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041462b0 con 0x7f8c04145ed0 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c0413ca10 con 0x7f8c04073890 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c09200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c09200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41942/0 (socket says 172.21.15.52:41942) 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c09200640 1 -- 172.21.15.52:0/2117877678 learned_addr learned my addr 172.21.15.52:0/2117877678 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c0a600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 0x7f8c0413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.774+0000 7f8c09c00640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c04073890 0x7f8c0413cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 -- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c04073890 msgr2=0x7f8c0413cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c04073890 0x7f8c0413cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 -- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 msgr2=0x7f8c0413c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 0x7f8c0413c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 -- 172.21.15.52:0/2117877678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0413f570 con 0x7f8c040b5880 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c0a600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 0x7f8c0413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c09200640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000e9e0 tx=0x7f8bf000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0017070 con 0x7f8c040b5880 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf000c9d0 con 0x7f8c040b5880 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000cdc0 con 0x7f8c040b5880 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0413f830 con 0x7f8c040b5880 2024-09-10T08:37:24.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.775+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0413fdf0 con 0x7f8c040b5880 2024-09-10T08:37:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.776+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c040b5080 con 0x7f8c040b5880 2024-09-10T08:37:24.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.777+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf001a070 con 0x7f8c040b5880 2024-09-10T08:37:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.778+0000 7f8c01600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 0x7f8be406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.778+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7f8bf008ab40 con 0x7f8c040b5880 2024-09-10T08:37:24.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.779+0000 7f8c09c00640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 0x7f8be406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:24.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.780+0000 7f8c09c00640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 0x7f8be406e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c0413e6d0 tx=0x7f8bf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:24.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:24.783+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bf0059100 con 0x7f8c040b5880 2024-09-10T08:37:25.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.037+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f8c040cf590 con 0x7f8c040b5880 2024-09-10T08:37:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.194+0000 7f8c01600640 1 -- 172.21.15.52:0/2117877678 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v413) ==== 144+0+0 (secure 0 0 0) 0x7f8bf005d400 con 0x7f8c040b5880 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 msgr2=0x7f8be406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 0x7f8be406e2f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8c0413e6d0 tx=0x7f8bf8009040 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 msgr2=0x7f8c04145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000e9e0 tx=0x7f8bf000eea0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 shutdown_connections 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8be406be30 0x7f8be406e2f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c04145ed0 0x7f8c0413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c040b5880 0x7f8c04145200 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 --2- 172.21.15.52:0/2117877678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c04073890 0x7f8c0413cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 >> 172.21.15.52:0/2117877678 conn(0x7f8c040ccec0 msgr2=0x7f8c04141560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:25.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 shutdown_connections 2024-09-10T08:37:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.196+0000 7f8c0c600640 1 -- 172.21.15.52:0/2117877678 wait complete. 2024-09-10T08:37:25.213 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T08:37:25.213 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T08:37:25.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.369+0000 7fdb3aa00640 1 Processor -- start 2024-09-10T08:37:25.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.369+0000 7fdb3aa00640 1 -- start start 2024-09-10T08:37:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3413eb20 0x7fdb3406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 0x7fdb3415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb34071ab0 con 0x7fdb3413eb20 2024-09-10T08:37:25.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdb34071180 con 0x7fdb3415bcf0 2024-09-10T08:37:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb3aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb34071460 con 0x7fdb340b2d40 2024-09-10T08:37:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3413eb20 0x7fdb3406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb3413eb20 0x7fdb3406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41944/0 (socket says 172.21.15.52:41944) 2024-09-10T08:37:25.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 -- 172.21.15.52:0/895287300 learned_addr learned my addr 172.21.15.52:0/895287300 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb38a00640 1 --2- 172.21.15.52:0/895287300 >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 0x7fdb3415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 -- 172.21.15.52:0/895287300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 msgr2=0x7fdb3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb33e00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 -- 172.21.15.52:0/895287300 >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 msgr2=0x7fdb3415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 --2- 172.21.15.52:0/895287300 >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 0x7fdb3415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb2be00640 1 -- 172.21.15.52:0/895287300 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb34071740 con 0x7fdb3413eb20 2024-09-10T08:37:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb38a00640 1 --2- 172.21.15.52:0/895287300 >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 0x7fdb3415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.371+0000 7fdb33e00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.372+0000 7fdb2be00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb3406c150 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdb341595c0 tx=0x7fdb1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a53318f6e6a87b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb33400640 1 -- 172.21.15.52:0/895287300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c037070 con 0x7fdb3413eb20 2024-09-10T08:37:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb33400640 1 -- 172.21.15.52:0/895287300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c032440 con 0x7fdb3413eb20 2024-09-10T08:37:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb33400640 1 -- 172.21.15.52:0/895287300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c032810 con 0x7fdb3413eb20 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 -- 172.21.15.52:0/895287300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 msgr2=0x7fdb3406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb3406c150 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fdb341595c0 tx=0x7fdb1c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 -- 172.21.15.52:0/895287300 shutdown_connections 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/895287300 >> v2:172.21.15.176:3300/0 conn(0x7fdb3415bcf0 0x7fdb3415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb3406c150 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/895287300 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 -- 172.21.15.52:0/895287300 >> 172.21.15.52:0/895287300 conn(0x7fdb340ccec0 msgr2=0x7fdb340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 -- 172.21.15.52:0/895287300 shutdown_connections 2024-09-10T08:37:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.373+0000 7fdb3aa00640 1 -- 172.21.15.52:0/895287300 wait complete. 2024-09-10T08:37:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.375+0000 7fdb3aa00640 1 Processor -- start 2024-09-10T08:37:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.375+0000 7fdb3aa00640 1 -- start start 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb3415bcf0 0x7fdb34154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3415f140 con 0x7fdb3413eb20 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3415efc0 con 0x7fdb3415bcf0 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb3aa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3415f2c0 con 0x7fdb340b2d40 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41956/0 (socket says 172.21.15.52:41956) 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb2be00640 1 -- 172.21.15.52:0/2138023470 learned_addr learned my addr 172.21.15.52:0/2138023470 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb38a00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb3415bcf0 0x7fdb34154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.376+0000 7fdb33e00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 -- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 msgr2=0x7fdb3415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 -- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb3415bcf0 msgr2=0x7fdb34154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb3415bcf0 0x7fdb34154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 -- 172.21.15.52:0/2138023470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb340b3710 con 0x7fdb3413eb20 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb2be00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c02a220 tx=0x7fdb1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c037040 con 0x7fdb3413eb20 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c042070 con 0x7fdb3413eb20 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.377+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c030bb0 con 0x7fdb3413eb20 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.378+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb340b39f0 con 0x7fdb3413eb20 2024-09-10T08:37:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.378+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3415adc0 con 0x7fdb3413eb20 2024-09-10T08:37:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.379+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3415c1a0 con 0x7fdb3413eb20 2024-09-10T08:37:25.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.380+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb1c047460 con 0x7fdb3413eb20 2024-09-10T08:37:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.380+0000 7fdb30c00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 0x7fdb1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.380+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7fdb1c0ab610 con 0x7fdb3413eb20 2024-09-10T08:37:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.381+0000 7fdb33e00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 0x7fdb1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.381+0000 7fdb33e00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 0x7fdb1006e320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdb24006b10 tx=0x7fdb24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.385+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb1c079c60 con 0x7fdb3413eb20 2024-09-10T08:37:25.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.568+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb3406c9c0 con 0x7fdb3413eb20 2024-09-10T08:37:25.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.569+0000 7fdb30c00640 1 -- 172.21.15.52:0/2138023470 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+13054 (secure 0 0 0) 0x7fdb1c07df60 con 0x7fdb3413eb20 2024-09-10T08:37:25.570 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:25.570 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":127,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:24.187105+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/3294209549":"2024-09-11T08:37:21.176595+0000","172.21.15.52:6833/3294209549":"2024-09-11T08:37:21.176595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 msgr2=0x7fdb1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 0x7fdb1006e320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdb24006b10 tx=0x7fdb24008040 comp rx=0 tx=0).stop 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 msgr2=0x7fdb341543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c02a220 tx=0x7fdb1c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 shutdown_connections 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdb1006be60 0x7fdb1006e320 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdb3415bcf0 0x7fdb34154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb3413eb20 0x7fdb341543d0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 --2- 172.21.15.52:0/2138023470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdb340b2d40 0x7fdb3415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 >> 172.21.15.52:0/2138023470 conn(0x7fdb340ccec0 msgr2=0x7fdb34071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.571+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 shutdown_connections 2024-09-10T08:37:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.572+0000 7fdb3aa00640 1 -- 172.21.15.52:0/2138023470 wait complete. 2024-09-10T08:37:25.587 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:37:25.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:37:25.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.747+0000 7f0040a00640 1 Processor -- start 2024-09-10T08:37:25.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.747+0000 7f0040a00640 1 -- start start 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f0040a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f003c15e7d0 0x7f003c0d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f0040a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c0d3110 0x7f003c0b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f0040a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0d42b0 con 0x7f003c0d4a90 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f0040a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f003c0d4ee0 con 0x7f003c15e7d0 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f0040a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0d3730 con 0x7f003c0d3110 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f003aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f003c0d4a90 0x7f003c0d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60042/0 (socket says 172.21.15.52:60042) 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.748+0000 7f003aa00640 1 -- 172.21.15.52:0/2338733256 learned_addr learned my addr 172.21.15.52:0/2338733256 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003b400640 1 --2- 172.21.15.52:0/2338733256 >> v2:172.21.15.176:3300/0 conn(0x7f003c15e7d0 0x7f003c0d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003be00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c0d3110 0x7f003c0b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391338736 0 0) 0x7f003c0d42b0 con 0x7f003c0d4a90 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0020003520 con 0x7f003c0d4a90 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1535777203 0 0) 0x7f0020003520 con 0x7f003c0d4a90 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c0d3110 msgr2=0x7f003c0b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c0d3110 0x7f003c0b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 >> v2:172.21.15.176:3300/0 conn(0x7f003c15e7d0 msgr2=0x7f003c0d4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 --2- 172.21.15.52:0/2338733256 >> v2:172.21.15.176:3300/0 conn(0x7f003c15e7d0 0x7f003c0d4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0d3a10 con 0x7f003c0d4a90 2024-09-10T08:37:25.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f0028001670 con 0x7f003c0d4a90 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 >> v1:172.21.15.52:6789/0 conn(0x7f003c0d4a90 legacy=0x7f003c0d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00200039b0 0x7f0020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.749+0000 7f003a000640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f0020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003a000640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00200051c0 0x7f002000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d4ee0 con 0x7f0020004800 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d3730 con 0x7f00200039b0 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f002000bf00 con 0x7f00200051c0 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003be00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c0d3110 0x7f003c0b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003b400640 1 --2- 172.21.15.52:0/2338733256 >> v2:172.21.15.176:3300/0 conn(0x7f003c15e7d0 0x7f003c0d4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f0020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 -- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00200051c0 msgr2=0x7f002000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00200051c0 0x7f002000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003b400640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00200039b0 0x7f0020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 -- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00200039b0 msgr2=0x7f0020003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00200039b0 0x7f0020003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.750+0000 7f003aa00640 1 -- 172.21.15.52:0/2338733256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0020003520 con 0x7f0020004800 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.751+0000 7f003aa00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f0020004c80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f002800c210 tx=0x7f0020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29af1b20a7b4b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.751+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028007d50 con 0x7f0020004800 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.751+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0028005af0 con 0x7f0020004800 2024-09-10T08:37:25.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.751+0000 7f003a000640 1 -- 172.21.15.52:0/2338733256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028007070 con 0x7f0020004800 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 -- 172.21.15.52:0/2338733256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 msgr2=0x7f0020004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 --2- 172.21.15.52:0/2338733256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f0020004c80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f002800c210 tx=0x7f0020005830 comp rx=0 tx=0).stop 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f003be00640 1 -- 172.21.15.52:0/2338733256 reap_dead start 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 -- 172.21.15.52:0/2338733256 shutdown_connections 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 -- 172.21.15.52:0/2338733256 >> 172.21.15.52:0/2338733256 conn(0x7f003c067d40 msgr2=0x7f003c068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 -- 172.21.15.52:0/2338733256 shutdown_connections 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.752+0000 7f0040a00640 1 -- 172.21.15.52:0/2338733256 wait complete. 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.754+0000 7f0040a00640 1 Processor -- start 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.754+0000 7f0040a00640 1 -- start start 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c1ea8e0 0x7f003c1e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f003c1e7690 0x7f003c1e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0b7b40 con 0x7f0020004800 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0d3fd0 con 0x7f003c1e7690 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f0040a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0b7cc0 con 0x7f003c1ea8e0 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41974/0 (socket says 172.21.15.52:41974) 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 -- 172.21.15.52:0/2445730197 learned_addr learned my addr 172.21.15.52:0/2445730197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003be00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f003c1e7690 0x7f003c1e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 -- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c1ea8e0 msgr2=0x7f003c1e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c1ea8e0 0x7f003c1e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 -- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f003c1e7690 msgr2=0x7f003c1e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f003c1e7690 0x7f003c1e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.755+0000 7f003b400640 1 -- 172.21.15.52:0/2445730197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c1e6ed0 con 0x7f0020004800 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f003b400640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f002c010920 tx=0x7f002c010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c00f040 con 0x7f0020004800 2024-09-10T08:37:25.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c00ec20 con 0x7f0020004800 2024-09-10T08:37:25.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c01c400 con 0x7f0020004800 2024-09-10T08:37:25.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c0cdd30 con 0x7f0020004800 2024-09-10T08:37:25.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.756+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1e7170 con 0x7f0020004800 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.757+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c0b7860 con 0x7f0020004800 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.758+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f002c01c5a0 con 0x7f0020004800 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.759+0000 7f0033400640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 0x7f001c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.759+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7f002c08b370 con 0x7f0020004800 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.759+0000 7f003aa00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 0x7f001c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:25.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.760+0000 7f003aa00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 0x7f001c06e320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0028032000 tx=0x7f0028007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:25.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.764+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f003c0b7860 con 0x7f0020004800 2024-09-10T08:37:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.947+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f003c0685f0 con 0x7f0020004800 2024-09-10T08:37:25.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.947+0000 7f0033400640 1 -- 172.21.15.52:0/2445730197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) ==== 93+0+10 (secure 0 0 0) 0x7f002c018030 con 0x7f0020004800 2024-09-10T08:37:25.948 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:37:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.949+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 msgr2=0x7f001c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 0x7f001c06e320 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0028032000 tx=0x7f0028007000 comp rx=0 tx=0).stop 2024-09-10T08:37:25.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 msgr2=0x7f003c0cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f002c010920 tx=0x7f002c010de0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 shutdown_connections 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f001c06be60 0x7f001c06e320 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f003c1e7690 0x7f003c1e7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f003c1ea8e0 0x7f003c1e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 --2- 172.21.15.52:0/2445730197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0020004800 0x7f003c0cd4e0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 >> 172.21.15.52:0/2445730197 conn(0x7f003c067d40 msgr2=0x7f003c0b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 shutdown_connections 2024-09-10T08:37:25.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:25.950+0000 7f0040a00640 1 -- 172.21.15.52:0/2445730197 wait complete. 2024-09-10T08:37:25.967 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-10T08:37:26.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.145+0000 7ff441e00640 1 Processor -- start 2024-09-10T08:37:26.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.146+0000 7ff441e00640 1 -- start start 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff441e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff441e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff43c070a30 0x7ff43c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff441e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c06d920 con 0x7ff43c06d000 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff441e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c163160 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff441e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c162550 con 0x7ff43c070a30 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff432000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff432000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41978/0 (socket says 172.21.15.52:41978) 2024-09-10T08:37:26.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff432000640 1 -- 172.21.15.52:0/3839592538 learned_addr learned my addr 172.21.15.52:0/3839592538 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.147+0000 7ff43b400640 1 --2- 172.21.15.52:0/3839592538 >> v2:172.21.15.176:3300/0 conn(0x7ff43c070a30 0x7ff43c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.148+0000 7ff432000640 1 -- 172.21.15.52:0/3839592538 >> v2:172.21.15.176:3300/0 conn(0x7ff43c070a30 msgr2=0x7ff43c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.148+0000 7ff432000640 1 --2- 172.21.15.52:0/3839592538 >> v2:172.21.15.176:3300/0 conn(0x7ff43c070a30 0x7ff43c070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.148+0000 7ff432000640 1 -- 172.21.15.52:0/3839592538 >> v1:172.21.15.176:6789/0 conn(0x7ff43c06d000 legacy=0x7ff43c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:26.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.148+0000 7ff432000640 1 -- 172.21.15.52:0/3839592538 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c162830 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff432000640 1 --2- 172.21.15.52:0/3839592538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff43c063970 tx=0x7ff42402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fad9c9c1f714ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff43a000640 1 -- 172.21.15.52:0/3839592538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424037070 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff43a000640 1 -- 172.21.15.52:0/3839592538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff424032440 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff43a000640 1 -- 172.21.15.52:0/3839592538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424032810 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff441e00640 1 -- 172.21.15.52:0/3839592538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c0cc2a0 msgr2=0x7ff43c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.149+0000 7ff441e00640 1 --2- 172.21.15.52:0/3839592538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7ff43c063970 tx=0x7ff42402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 -- 172.21.15.52:0/3839592538 shutdown_connections 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 --2- 172.21.15.52:0/3839592538 >> v2:172.21.15.176:3300/0 conn(0x7ff43c070a30 0x7ff43c070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 --2- 172.21.15.52:0/3839592538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c06d3e0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 -- 172.21.15.52:0/3839592538 >> 172.21.15.52:0/3839592538 conn(0x7ff43c0b4300 msgr2=0x7ff43c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 -- 172.21.15.52:0/3839592538 shutdown_connections 2024-09-10T08:37:26.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.150+0000 7ff441e00640 1 -- 172.21.15.52:0/3839592538 wait complete. 2024-09-10T08:37:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.151+0000 7ff441e00640 1 Processor -- start 2024-09-10T08:37:26.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.151+0000 7ff441e00640 1 -- start start 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff43c070a30 0x7ff43c0b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c1e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0d03c0 con 0x7ff43c06d000 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c162df0 con 0x7ff43c0cc2a0 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff441e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c0d0540 con 0x7ff43c070a30 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff43aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff43aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41988/0 (socket says 172.21.15.52:41988) 2024-09-10T08:37:26.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.152+0000 7ff43aa00640 1 -- 172.21.15.52:0/3090348225 learned_addr learned my addr 172.21.15.52:0/3090348225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff432000640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff43c070a30 0x7ff43c0b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43b400640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c1e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 -- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff43c070a30 msgr2=0x7ff43c0b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff43c070a30 0x7ff43c0b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 -- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff43c0cc2a0 msgr2=0x7ff43c1e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c1e8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 -- 172.21.15.52:0/3090348225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0b70a0 con 0x7ff43c06d000 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff43aa00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c430 tx=0x7ff42c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.153+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c011790 con 0x7ff43c06d000 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.154+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c017070 con 0x7ff43c06d000 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.154+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c011bb0 con 0x7ff43c06d000 2024-09-10T08:37:26.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.154+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c0b7380 con 0x7ff43c06d000 2024-09-10T08:37:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.154+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c0b7940 con 0x7ff43c06d000 2024-09-10T08:37:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.155+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c15c720 con 0x7ff43c06d000 2024-09-10T08:37:26.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.156+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff42c01c460 con 0x7ff43c06d000 2024-09-10T08:37:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.157+0000 7ff433e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 0x7ff41806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.157+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7ff42c08a8c0 con 0x7ff43c06d000 2024-09-10T08:37:26.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.157+0000 7ff432000640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 0x7ff41806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:26.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.158+0000 7ff432000640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 0x7ff41806e320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff424034000 tx=0x7ff42402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:26.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.161+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff42c058e80 con 0x7ff43c06d000 2024-09-10T08:37:26.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:26.415+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7ff43c0b1f50 con 0x7ff43c06d000 2024-09-10T08:37:27.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.201+0000 7ff433e00640 1 -- 172.21.15.52:0/3090348225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v415) ==== 158+0+0 (secure 0 0 0) 0x7ff42c05d180 con 0x7ff43c06d000 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 msgr2=0x7ff41806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 0x7ff41806e320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff424034000 tx=0x7ff42402e000 comp rx=0 tx=0).stop 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 msgr2=0x7ff43c147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00c430 tx=0x7ff42c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 shutdown_connections 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff41806be60 0x7ff41806e320 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff43c0cc2a0 0x7ff43c1e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff43c070a30 0x7ff43c0b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 --2- 172.21.15.52:0/3090348225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff43c06d000 0x7ff43c147880 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 >> 172.21.15.52:0/3090348225 conn(0x7ff43c0b4300 msgr2=0x7ff43c160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:27.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 shutdown_connections 2024-09-10T08:37:27.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.204+0000 7ff441e00640 1 -- 172.21.15.52:0/3090348225 wait complete. 2024-09-10T08:37:27.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:37:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.387+0000 7f2b1a000640 1 Processor -- start 2024-09-10T08:37:27.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.387+0000 7f2b1a000640 1 -- start start 2024-09-10T08:37:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2b140b5fd0 0x7f2b140d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b63b0 0x7f2b140cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b14067950 0x7f2b14067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2b140d3950 con 0x7f2b14067950 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2b140d3c30 con 0x7f2b140b5fd0 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.388+0000 7f2b1a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b140d3f10 con 0x7f2b140b63b0 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b14067950 0x7f2b14067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2b14067950 0x7f2b14067e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41992/0 (socket says 172.21.15.52:41992) 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 -- 172.21.15.52:0/3278190414 learned_addr learned my addr 172.21.15.52:0/3278190414 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b18c00640 1 --2- 172.21.15.52:0/3278190414 >> v2:172.21.15.176:3300/0 conn(0x7f2b140b5fd0 0x7f2b140d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b13e00640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b63b0 0x7f2b140cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 -- 172.21.15.52:0/3278190414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b63b0 msgr2=0x7f2b140cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b63b0 0x7f2b140cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 -- 172.21.15.52:0/3278190414 >> v2:172.21.15.176:3300/0 conn(0x7f2b140b5fd0 msgr2=0x7f2b140d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 --2- 172.21.15.52:0/3278190414 >> v2:172.21.15.176:3300/0 conn(0x7f2b140b5fd0 0x7f2b140d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.389+0000 7f2b19600640 1 -- 172.21.15.52:0/3278190414 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b140d41f0 con 0x7f2b14067950 2024-09-10T08:37:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.390+0000 7f2b19600640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b14067950 0x7f2b14067e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2b140d5620 tx=0x7f2b0c02a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab42cfdab1cc188 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.390+0000 7f2b13400640 1 -- 172.21.15.52:0/3278190414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c036070 con 0x7f2b14067950 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.390+0000 7f2b13400640 1 -- 172.21.15.52:0/3278190414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c031600 con 0x7f2b14067950 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.390+0000 7f2b13400640 1 -- 172.21.15.52:0/3278190414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0319d0 con 0x7f2b14067950 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 -- 172.21.15.52:0/3278190414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b14067950 msgr2=0x7f2b14067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b14067950 0x7f2b14067e00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2b140d5620 tx=0x7f2b0c02a720 comp rx=0 tx=0).stop 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 -- 172.21.15.52:0/3278190414 shutdown_connections 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b14067950 0x7f2b14067e00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 --2- 172.21.15.52:0/3278190414 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b63b0 0x7f2b140cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 --2- 172.21.15.52:0/3278190414 >> v2:172.21.15.176:3300/0 conn(0x7f2b140b5fd0 0x7f2b140d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 -- 172.21.15.52:0/3278190414 >> 172.21.15.52:0/3278190414 conn(0x7f2b140d0fd0 msgr2=0x7f2b140d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 -- 172.21.15.52:0/3278190414 shutdown_connections 2024-09-10T08:37:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.391+0000 7f2b1a000640 1 -- 172.21.15.52:0/3278190414 wait complete. 2024-09-10T08:37:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.393+0000 7f2b1a000640 1 Processor -- start 2024-09-10T08:37:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.393+0000 7f2b1a000640 1 -- start start 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b14067950 0x7f2b14157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 0x7f2b140b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b140cfd10 con 0x7f2b140b63b0 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2b140cfb90 con 0x7f2b14067950 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b1a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2b140b67d0 con 0x7f2b140b5fd0 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41994/0 (socket says 172.21.15.52:41994) 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 -- 172.21.15.52:0/1450584027 learned_addr learned my addr 172.21.15.52:0/1450584027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b18c00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b14067950 0x7f2b14157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b13e00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 0x7f2b140b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 -- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 msgr2=0x7f2b140b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 0x7f2b140b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 -- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b14067950 msgr2=0x7f2b14157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b14067950 0x7f2b14157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b19600640 1 -- 172.21.15.52:0/1450584027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b140b9620 con 0x7f2b140b63b0 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.394+0000 7f2b13e00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 0x7f2b140b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b19600640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c034040 tx=0x7f2b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c036050 con 0x7f2b140b63b0 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0c042070 con 0x7f2b140b63b0 2024-09-10T08:37:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c009510 con 0x7f2b140b63b0 2024-09-10T08:37:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b140b9900 con 0x7f2b140b63b0 2024-09-10T08:37:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.395+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b140b9ec0 con 0x7f2b140b63b0 2024-09-10T08:37:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.396+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b140b3a80 con 0x7f2b140b63b0 2024-09-10T08:37:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.397+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b0c007bd0 con 0x7f2b140b63b0 2024-09-10T08:37:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.398+0000 7f2b10c00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 0x7f2af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.398+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7f2b0c0ab880 con 0x7f2b140b63b0 2024-09-10T08:37:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.398+0000 7f2b18c00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 0x7f2af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.399+0000 7f2b18c00640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 0x7f2af406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2b08006fd0 tx=0x7f2b08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:27.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.402+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b140b3a80 con 0x7f2b140b63b0 2024-09-10T08:37:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.588+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2b140b7890 con 0x7f2b140b63b0 2024-09-10T08:37:27.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.592+0000 7f2b10c00640 1 -- 172.21.15.52:0/1450584027 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f2b0c07a520 con 0x7f2b140b63b0 2024-09-10T08:37:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 msgr2=0x7f2af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 0x7f2af406e2f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2b08006fd0 tx=0x7f2b08008040 comp rx=0 tx=0).stop 2024-09-10T08:37:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 msgr2=0x7f2b140b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c034040 tx=0x7f2b0c004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 shutdown_connections 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2af406be30 0x7f2af406e2f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140b63b0 0x7f2b140b58f0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2b140b5fd0 0x7f2b140b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 --2- 172.21.15.52:0/1450584027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2b14067950 0x7f2b14157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.594+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 >> 172.21.15.52:0/1450584027 conn(0x7f2b140d0fd0 msgr2=0x7f2b140b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.595+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 shutdown_connections 2024-09-10T08:37:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:27.595+0000 7f2b1a000640 1 -- 172.21.15.52:0/1450584027 wait complete. 2024-09-10T08:37:27.611 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:37:27.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:37:27.699 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:37:27.805 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:37:27.805 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:27.805 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:27.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:37:27.841 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:37:27.841 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:27.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:37:27.878 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:27.878 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:27.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:37:27.916 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:37:27.916 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:27.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:37:27.954 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:37:27.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:28.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.111+0000 7ffb8ca00640 1 Processor -- start 2024-09-10T08:37:28.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.111+0000 7ffb8ca00640 1 -- start start 2024-09-10T08:37:28.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8815e440 0x7ffb880d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb880cf450 0x7ffb880b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 0x7ffb8806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb880b69b0 con 0x7ffb880cf450 2024-09-10T08:37:28.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ffb880d3990 con 0x7ffb880b6540 2024-09-10T08:37:28.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb8ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffb880d3c70 con 0x7ffb8815e440 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.112+0000 7ffb85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb880cf450 0x7ffb880b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb87200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 0x7ffb8806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb86800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8815e440 0x7ffb880d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb880cf450 0x7ffb880b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42004/0 (socket says 172.21.15.52:42004) 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb87200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 0x7ffb8806bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:59000/0 (socket says 172.21.15.52:59000) 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 -- 172.21.15.52:0/3858508963 learned_addr learned my addr 172.21.15.52:0/3858508963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 -- 172.21.15.52:0/3858508963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8815e440 msgr2=0x7ffb880d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:28.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 --2- 172.21.15.52:0/3858508963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8815e440 0x7ffb880d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 -- 172.21.15.52:0/3858508963 >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 msgr2=0x7ffb8806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:28.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 --2- 172.21.15.52:0/3858508963 >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 0x7ffb8806bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.113+0000 7ffb85e00640 1 -- 172.21.15.52:0/3858508963 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb880d3f50 con 0x7ffb880cf450 2024-09-10T08:37:28.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.114+0000 7ffb85e00640 1 --2- 172.21.15.52:0/3858508963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb880cf450 0x7ffb880b6000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ffb880d3ba0 tx=0x7ffb7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385e64bd18d692c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.114+0000 7ffb85400640 1 -- 172.21.15.52:0/3858508963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74037070 con 0x7ffb880cf450 2024-09-10T08:37:28.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.114+0000 7ffb85400640 1 -- 172.21.15.52:0/3858508963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb74032440 con 0x7ffb880cf450 2024-09-10T08:37:28.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.114+0000 7ffb85400640 1 -- 172.21.15.52:0/3858508963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74032810 con 0x7ffb880cf450 2024-09-10T08:37:28.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 -- 172.21.15.52:0/3858508963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb880cf450 msgr2=0x7ffb880b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/3858508963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb880cf450 0x7ffb880b6000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ffb880d3ba0 tx=0x7ffb7402a270 comp rx=0 tx=0).stop 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 -- 172.21.15.52:0/3858508963 shutdown_connections 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/3858508963 >> v2:172.21.15.176:3300/0 conn(0x7ffb880b6540 0x7ffb8806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/3858508963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb880cf450 0x7ffb880b6000 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/3858508963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb8815e440 0x7ffb880d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 -- 172.21.15.52:0/3858508963 >> 172.21.15.52:0/3858508963 conn(0x7ffb88067f80 msgr2=0x7ffb880d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 -- 172.21.15.52:0/3858508963 shutdown_connections 2024-09-10T08:37:28.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.115+0000 7ffb8ca00640 1 -- 172.21.15.52:0/3858508963 wait complete. 2024-09-10T08:37:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.117+0000 7ffb8ca00640 1 Processor -- start 2024-09-10T08:37:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.117+0000 7ffb8ca00640 1 -- start start 2024-09-10T08:37:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb880b6540 0x7ffb88158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb880cf450 0x7ffb88160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb880b7540 con 0x7ffb8815e440 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8815e820 con 0x7ffb880b6540 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb8ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffb880b76c0 con 0x7ffb880cf450 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42018/0 (socket says 172.21.15.52:42018) 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 -- 172.21.15.52:0/1864831850 learned_addr learned my addr 172.21.15.52:0/1864831850 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb85e00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb880cf450 0x7ffb88160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb86800640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb880b6540 0x7ffb88158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 -- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb880cf450 msgr2=0x7ffb88160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb880cf450 0x7ffb88160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 -- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb880b6540 msgr2=0x7ffb88158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb880b6540 0x7ffb88158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.118+0000 7ffb87200640 1 -- 172.21.15.52:0/1864831850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb881613f0 con 0x7ffb8815e440 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb87200640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000efc0 tx=0x7ffb8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80018020 con 0x7ffb8815e440 2024-09-10T08:37:28.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb80014480 con 0x7ffb8815e440 2024-09-10T08:37:28.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80014870 con 0x7ffb8815e440 2024-09-10T08:37:28.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb881f7960 con 0x7ffb8815e440 2024-09-10T08:37:28.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.119+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb881598d0 con 0x7ffb8815e440 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.120+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb880b6000 con 0x7ffb8815e440 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.121+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb80005d10 con 0x7ffb8815e440 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.122+0000 7ffb7ea00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 0x7ffb6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.122+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7ffb8008b4e0 con 0x7ffb8815e440 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.122+0000 7ffb86800640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 0x7ffb6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.123+0000 7ffb86800640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 0x7ffb6806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009a20 tx=0x7ffb78009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.126+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb80022070 con 0x7ffb8815e440 2024-09-10T08:37:28.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.346+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb880b4730 con 0x7ffb8815e440 2024-09-10T08:37:28.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.346+0000 7ffb7ea00640 1 -- 172.21.15.52:0/1864831850 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+3911 (secure 0 0 0) 0x7ffb80010040 con 0x7ffb8815e440 2024-09-10T08:37:28.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:28.347 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":95,"btime":"2024-09-10T08:37:22:179316+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1483439315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1483439315},{"type":"v1","addr":"172.21.15.52:6834","nonce":1483439315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7441,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/2586275676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":2586275676},{"type":"v1","addr":"172.21.15.176:6836","nonce":2586275676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7444,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3212015850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3212015850},{"type":"v1","addr":"172.21.15.176:6837","nonce":3212015850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/55970145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":55970145},{"type":"v1","addr":"172.21.15.52:6835","nonce":55970145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[]} 2024-09-10T08:37:28.347 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 95 2024-09-10T08:37:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.348+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 msgr2=0x7ffb6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 0x7ffb6806e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009a20 tx=0x7ffb78009190 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 msgr2=0x7ffb881f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000efc0 tx=0x7ffb8000c490 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 shutdown_connections 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ffb6806be30 0x7ffb6806e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb8815e440 0x7ffb881f7420 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffb880cf450 0x7ffb88160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 --2- 172.21.15.52:0/1864831850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb880b6540 0x7ffb88158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 >> 172.21.15.52:0/1864831850 conn(0x7ffb88067f80 msgr2=0x7ffb8806bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 shutdown_connections 2024-09-10T08:37:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.349+0000 7ffb8ca00640 1 -- 172.21.15.52:0/1864831850 wait complete. 2024-09-10T08:37:28.365 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:37:28.365 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:37:28.366 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:37:28.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:37:28.366 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:37:28.366 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:37:28.366 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:37:28.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:37:28.367 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:37:28.367 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:37:28.367 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:37:28.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:37:28.367 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:37:28.367 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:37:28.368 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:37:28.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:37:28.383 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:37:28.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:37:28.385 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:37:28.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:37:28.386 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:37:28.386 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:37:28.387 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:37:28.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:37:28.429 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:37:28.430 DEBUG:teuthology.parallel:result is None 2024-09-10T08:37:28.431 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:37:28.431 DEBUG:teuthology.parallel:result is None 2024-09-10T08:37:28.432 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:37:28.433 DEBUG:teuthology.parallel:result is None 2024-09-10T08:37:28.433 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:37:28.434 DEBUG:teuthology.parallel:result is None 2024-09-10T08:37:28.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:37:28.560 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:37:28.562 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:37:28.565 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:37:28.565 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:37:28.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.598+0000 7fa2a9200640 1 Processor -- start 2024-09-10T08:37:28.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.598+0000 7fa2a9200640 1 -- start start 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a9200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2a40b6970 0x7fa2a40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a9200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa2a40d23b0 0x7fa2a40b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a9200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40d0e70 con 0x7fa2a415ed20 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a9200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a40d41c0 con 0x7fa2a40b6970 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a9200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a40d35b0 con 0x7fa2a40d23b0 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa29be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2a40b6970 0x7fa2a40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a1e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa2a415ed20 0x7fa2a40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60060/0 (socket says 172.21.15.52:60060) 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a1e00640 1 -- 172.21.15.52:0/2442185050 learned_addr learned my addr 172.21.15.52:0/2442185050 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.599+0000 7fa2a2800640 1 --2- 172.21.15.52:0/2442185050 >> v2:172.21.15.176:3300/0 conn(0x7fa2a40d23b0 0x7fa2a40b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.600+0000 7fa29be00640 1 -- 172.21.15.52:0/2442185050 >> v2:172.21.15.176:3300/0 conn(0x7fa2a40d23b0 msgr2=0x7fa2a40b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:28.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.600+0000 7fa29be00640 1 --2- 172.21.15.52:0/2442185050 >> v2:172.21.15.176:3300/0 conn(0x7fa2a40d23b0 0x7fa2a40b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.600+0000 7fa29be00640 1 -- 172.21.15.52:0/2442185050 >> v1:172.21.15.52:6789/0 conn(0x7fa2a415ed20 legacy=0x7fa2a40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.600+0000 7fa29be00640 1 -- 172.21.15.52:0/2442185050 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40d3890 con 0x7fa2a40b6970 2024-09-10T08:37:28.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa29be00640 1 --2- 172.21.15.52:0/2442185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40b6970 0x7fa2a40b80d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d4130 tx=0x7fa28c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9adc91b9a4e35c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a1400640 1 -- 172.21.15.52:0/2442185050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c037070 con 0x7fa2a40b6970 2024-09-10T08:37:28.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a1400640 1 -- 172.21.15.52:0/2442185050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c032440 con 0x7fa2a40b6970 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a1400640 1 -- 172.21.15.52:0/2442185050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c02ae60 con 0x7fa2a40b6970 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a9200640 1 -- 172.21.15.52:0/2442185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40b6970 msgr2=0x7fa2a40b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a9200640 1 --2- 172.21.15.52:0/2442185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40b6970 0x7fa2a40b80d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d4130 tx=0x7fa28c02a110 comp rx=0 tx=0).stop 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.601+0000 7fa2a9200640 1 -- 172.21.15.52:0/2442185050 shutdown_connections 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.602+0000 7fa2a9200640 1 --2- 172.21.15.52:0/2442185050 >> v2:172.21.15.176:3300/0 conn(0x7fa2a40d23b0 0x7fa2a40b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.602+0000 7fa2a9200640 1 --2- 172.21.15.52:0/2442185050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40b6970 0x7fa2a40b80d0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.602+0000 7fa2a9200640 1 -- 172.21.15.52:0/2442185050 >> 172.21.15.52:0/2442185050 conn(0x7fa2a40d1260 msgr2=0x7fa2a40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.602+0000 7fa2a9200640 1 -- 172.21.15.52:0/2442185050 shutdown_connections 2024-09-10T08:37:28.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.602+0000 7fa2a9200640 1 -- 172.21.15.52:0/2442185050 wait complete. 2024-09-10T08:37:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.603+0000 7fa2a9200640 1 Processor -- start 2024-09-10T08:37:28.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.603+0000 7fa2a9200640 1 -- start start 2024-09-10T08:37:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 0x7fa2a40cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2a415ed20 0x7fa2a414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a40d32a0 con 0x7fa2a40d23b0 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a40d3e50 con 0x7fa2a40b6970 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.604+0000 7fa2a9200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a415f100 con 0x7fa2a415ed20 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa2a1e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 0x7fa2a40cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42096/0 (socket says 172.21.15.52:42096) 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 -- 172.21.15.52:0/67670214 learned_addr learned my addr 172.21.15.52:0/67670214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa2a2800640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2a415ed20 0x7fa2a414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 -- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2a415ed20 msgr2=0x7fa2a414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2a415ed20 0x7fa2a414bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 -- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 msgr2=0x7fa2a40cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 0x7fa2a40cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 -- 172.21.15.52:0/67670214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a414a740 con 0x7fa2a40d23b0 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa2a1e00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 0x7fa2a40cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.605+0000 7fa29be00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa28c000c00 tx=0x7fa28c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.606+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c037040 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.606+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c042070 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.606+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a414aa20 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.606+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c030960 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.606+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a414afe0 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.607+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a40b7010 con 0x7fa2a40d23b0 2024-09-10T08:37:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.608+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa28c030b00 con 0x7fa2a40d23b0 2024-09-10T08:37:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.609+0000 7fa29a000640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 0x7fa28006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.609+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4943+0+0 (secure 0 0 0) 0x7fa28c0ab3c0 con 0x7fa2a40d23b0 2024-09-10T08:37:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.609+0000 7fa2a1e00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 0x7fa28006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.610+0000 7fa2a1e00640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 0x7fa28006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa294007fd0 tx=0x7fa294007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.613+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa28c079a10 con 0x7fa2a40d23b0 2024-09-10T08:37:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:28.807+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa2a40b3f20 con 0x7fa2a40d23b0 2024-09-10T08:37:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.215+0000 7fa29a000640 1 -- 172.21.15.52:0/67670214 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v129) ==== 97+0+0 (secure 0 0 0) 0x7fa28c07dd10 con 0x7fa2a40d23b0 2024-09-10T08:37:29.216 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:37:29.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 msgr2=0x7fa28006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 0x7fa28006e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa294007fd0 tx=0x7fa294007e80 comp rx=0 tx=0).stop 2024-09-10T08:37:29.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 msgr2=0x7fa2a414dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa28c000c00 tx=0x7fa28c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 shutdown_connections 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa28006be30 0x7fa28006e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa2a415ed20 0x7fa2a414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a40d23b0 0x7fa2a414dc30 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 --2- 172.21.15.52:0/67670214 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa2a40b6970 0x7fa2a40cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.218+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 >> 172.21.15.52:0/67670214 conn(0x7fa2a40d1260 msgr2=0x7fa2a40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.219+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 shutdown_connections 2024-09-10T08:37:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.219+0000 7fa2a9200640 1 -- 172.21.15.52:0/67670214 wait complete. 2024-09-10T08:37:29.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:37:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.394+0000 7fdcee600640 1 Processor -- start 2024-09-10T08:37:29.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.394+0000 7fdcee600640 1 -- start start 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdcee600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 0x7fdce815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdcee600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdce813eb20 0x7fdce815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdcee600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce8071180 con 0x7fdce80b2d40 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdcee600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdce8071ab0 con 0x7fdce813eb20 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdcee600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdce8071460 con 0x7fdce806c320 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdce7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdce813eb20 0x7fdce815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdce7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdce813eb20 0x7fdce815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42110/0 (socket says 172.21.15.52:42110) 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdce7e00640 1 -- 172.21.15.52:0/1526604823 learned_addr learned my addr 172.21.15.52:0/1526604823 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:29.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdce6a00640 1 --2- 172.21.15.52:0/1526604823 >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 0x7fdce815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.396+0000 7fdce7e00640 1 -- 172.21.15.52:0/1526604823 >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 msgr2=0x7fdce815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.397+0000 7fdce7e00640 1 --2- 172.21.15.52:0/1526604823 >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 0x7fdce815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.397+0000 7fdce7e00640 1 -- 172.21.15.52:0/1526604823 >> v1:172.21.15.176:6789/0 conn(0x7fdce80b2d40 legacy=0x7fdce806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.397+0000 7fdce7e00640 1 -- 172.21.15.52:0/1526604823 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce8071740 con 0x7fdce813eb20 2024-09-10T08:37:29.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.397+0000 7fdce6a00640 1 --2- 172.21.15.52:0/1526604823 >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 0x7fdce815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:29.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.397+0000 7fdce7e00640 1 --2- 172.21.15.52:0/1526604823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce813eb20 0x7fdce815c230 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d1500 tx=0x7fdce002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0796d4e260b44c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdce6000640 1 -- 172.21.15.52:0/1526604823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce0036070 con 0x7fdce813eb20 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdce6000640 1 -- 172.21.15.52:0/1526604823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce0031600 con 0x7fdce813eb20 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdce6000640 1 -- 172.21.15.52:0/1526604823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce00319d0 con 0x7fdce813eb20 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 -- 172.21.15.52:0/1526604823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce813eb20 msgr2=0x7fdce815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 --2- 172.21.15.52:0/1526604823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce813eb20 0x7fdce815c230 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d1500 tx=0x7fdce002a730 comp rx=0 tx=0).stop 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 -- 172.21.15.52:0/1526604823 shutdown_connections 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 --2- 172.21.15.52:0/1526604823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce813eb20 0x7fdce815c230 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 --2- 172.21.15.52:0/1526604823 >> v2:172.21.15.176:3300/0 conn(0x7fdce806c320 0x7fdce815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 -- 172.21.15.52:0/1526604823 >> 172.21.15.52:0/1526604823 conn(0x7fdce80ccec0 msgr2=0x7fdce80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.398+0000 7fdcee600640 1 -- 172.21.15.52:0/1526604823 shutdown_connections 2024-09-10T08:37:29.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.399+0000 7fdcee600640 1 -- 172.21.15.52:0/1526604823 wait complete. 2024-09-10T08:37:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.400+0000 7fdcee600640 1 Processor -- start 2024-09-10T08:37:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.400+0000 7fdcee600640 1 -- start start 2024-09-10T08:37:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce806c320 0x7fdce80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce813eb20 0x7fdce813c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdce80720c0 con 0x7fdce80b2d40 2024-09-10T08:37:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdce8071f40 con 0x7fdce813eb20 2024-09-10T08:37:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdcee600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdce8072240 con 0x7fdce806c320 2024-09-10T08:37:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdce6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdce6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42114/0 (socket says 172.21.15.52:42114) 2024-09-10T08:37:29.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdce6a00640 1 -- 172.21.15.52:0/382885623 learned_addr learned my addr 172.21.15.52:0/382885623 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdce7e00640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce813eb20 0x7fdce813c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.401+0000 7fdce7400640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce806c320 0x7fdce80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 -- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce806c320 msgr2=0x7fdce80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce806c320 0x7fdce80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 -- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce813eb20 msgr2=0x7fdce813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce813eb20 0x7fdce813c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 -- 172.21.15.52:0/382885623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce80cac70 con 0x7fdce80b2d40 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdce6a00640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400bfd0 tx=0x7fdcd400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4004230 con 0x7fdce80b2d40 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40043d0 con 0x7fdce80b2d40 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400aba0 con 0x7fdce80b2d40 2024-09-10T08:37:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.402+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce80caf50 con 0x7fdce80b2d40 2024-09-10T08:37:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.403+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce80cb510 con 0x7fdce80b2d40 2024-09-10T08:37:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.404+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce806bc10 con 0x7fdce80b2d40 2024-09-10T08:37:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.404+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcd4003610 con 0x7fdce80b2d40 2024-09-10T08:37:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.406+0000 7fdcdf400640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 0x7fdcc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.406+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7fdcd408ada0 con 0x7fdce80b2d40 2024-09-10T08:37:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.406+0000 7fdce7400640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 0x7fdcc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.407+0000 7fdce7400640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 0x7fdcc806e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8001780 tx=0x7fdcd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.410+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcd4015070 con 0x7fdce80b2d40 2024-09-10T08:37:29.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.665+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdce806c9c0 con 0x7fdce80b2d40 2024-09-10T08:37:29.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.666+0000 7fdcdf400640 1 -- 172.21.15.52:0/382885623 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7fdcd4059440 con 0x7fdce80b2d40 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:37:29.668 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.669 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:37:29.670 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.671 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.672 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.673 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:37:29.674 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:37:29.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:37:29.677 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:37:29.678 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:37:29.680 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:37:29.681 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.668+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 msgr2=0x7fdcc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.668+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 0x7fdcc806e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8001780 tx=0x7fdcd8009040 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.668+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 msgr2=0x7fdce81f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.668+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400bfd0 tx=0x7fdcd400de60 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.668+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 shutdown_connections 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcc806be30 0x7fdcc806e2f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce813eb20 0x7fdce813c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce80b2d40 0x7fdce81f8850 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 --2- 172.21.15.52:0/382885623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce806c320 0x7fdce80cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 >> 172.21.15.52:0/382885623 conn(0x7fdce80ccec0 msgr2=0x7fdce8156500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 shutdown_connections 2024-09-10T08:37:29.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.669+0000 7fdcee600640 1 -- 172.21.15.52:0/382885623 wait complete. 2024-09-10T08:37:29.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:37:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.841+0000 7f9d18000640 1 Processor -- start 2024-09-10T08:37:29.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.841+0000 7f9d18000640 1 -- start start 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d18000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d1015c6b0 0x7f9d10073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d18000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9d100cf300 0x7f9d100713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d18000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d100d1770 con 0x7f9d10070fa0 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d18000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9d100cdec0 con 0x7f9d1015c6b0 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d18000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9d10071920 con 0x7f9d100cf300 2024-09-10T08:37:29.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d15600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d1015c6b0 0x7f9d10073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d15600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9d1015c6b0 0x7f9d10073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42116/0 (socket says 172.21.15.52:42116) 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.842+0000 7f9d15600640 1 -- 172.21.15.52:0/2812169888 learned_addr learned my addr 172.21.15.52:0/2812169888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.843+0000 7f9d16000640 1 --2- 172.21.15.52:0/2812169888 >> v2:172.21.15.176:3300/0 conn(0x7f9d100cf300 0x7f9d100713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.843+0000 7f9d15600640 1 -- 172.21.15.52:0/2812169888 >> v2:172.21.15.176:3300/0 conn(0x7f9d100cf300 msgr2=0x7f9d100713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.843+0000 7f9d15600640 1 --2- 172.21.15.52:0/2812169888 >> v2:172.21.15.176:3300/0 conn(0x7f9d100cf300 0x7f9d100713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.843+0000 7f9d15600640 1 -- 172.21.15.52:0/2812169888 >> v1:172.21.15.176:6789/0 conn(0x7f9d10070fa0 legacy=0x7f9d100d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:29.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.843+0000 7f9d15600640 1 -- 172.21.15.52:0/2812169888 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d100d1a50 con 0x7f9d1015c6b0 2024-09-10T08:37:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.844+0000 7f9d15600640 1 --2- 172.21.15.52:0/2812169888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d1015c6b0 0x7f9d10073b70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f9d10071aa0 tx=0x7f9d0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f9cb10391f916b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.844+0000 7f9d0fe00640 1 -- 172.21.15.52:0/2812169888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04037070 con 0x7f9d1015c6b0 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.844+0000 7f9d0fe00640 1 -- 172.21.15.52:0/2812169888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d04032440 con 0x7f9d1015c6b0 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.844+0000 7f9d0fe00640 1 -- 172.21.15.52:0/2812169888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04032810 con 0x7f9d1015c6b0 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 -- 172.21.15.52:0/2812169888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d1015c6b0 msgr2=0x7f9d10073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 --2- 172.21.15.52:0/2812169888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d1015c6b0 0x7f9d10073b70 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f9d10071aa0 tx=0x7f9d0402a270 comp rx=0 tx=0).stop 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 -- 172.21.15.52:0/2812169888 shutdown_connections 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 --2- 172.21.15.52:0/2812169888 >> v2:172.21.15.176:3300/0 conn(0x7f9d100cf300 0x7f9d100713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 --2- 172.21.15.52:0/2812169888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d1015c6b0 0x7f9d10073b70 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 -- 172.21.15.52:0/2812169888 >> 172.21.15.52:0/2812169888 conn(0x7f9d100b4300 msgr2=0x7f9d100b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:29.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 -- 172.21.15.52:0/2812169888 shutdown_connections 2024-09-10T08:37:29.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.845+0000 7f9d18000640 1 -- 172.21.15.52:0/2812169888 wait complete. 2024-09-10T08:37:29.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.847+0000 7f9d18000640 1 Processor -- start 2024-09-10T08:37:29.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.847+0000 7f9d18000640 1 -- start start 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d100cf300 0x7f9d100ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 0x7f9d101588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1015ca90 con 0x7f9d10070fa0 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d100d2010 con 0x7f9d1015c6b0 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d18000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100d22f0 con 0x7f9d100cf300 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42136/0 (socket says 172.21.15.52:42136) 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 -- 172.21.15.52:0/1623022125 learned_addr learned my addr 172.21.15.52:0/1623022125 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:29.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d16000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 0x7f9d101588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 -- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d100cf300 msgr2=0x7f9d100ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d100cf300 0x7f9d100ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 -- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 msgr2=0x7f9d101588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 0x7f9d101588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d15600640 1 -- 172.21.15.52:0/1623022125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d10157830 con 0x7f9d10070fa0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.848+0000 7f9d16000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 0x7f9d101588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d15600640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f9d0402a2b0 tx=0x7f9d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04041020 con 0x7f9d10070fa0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d040306c0 con 0x7f9d10070fa0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04037040 con 0x7f9d10070fa0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d10157b10 con 0x7f9d10070fa0 2024-09-10T08:37:29.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.849+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101580d0 con 0x7f9d10070fa0 2024-09-10T08:37:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.850+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d100d1400 con 0x7f9d10070fa0 2024-09-10T08:37:29.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.851+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d04044020 con 0x7f9d10070fa0 2024-09-10T08:37:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.852+0000 7f9d0d600640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.852+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7f9d040ab480 con 0x7f9d10070fa0 2024-09-10T08:37:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.853+0000 7f9d14c00640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:29.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.853+0000 7f9d14c00640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 0x7f9cf006e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000f60 tx=0x7f9cfc0079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:29.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:29.857+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d0404b030 con 0x7f9d10070fa0 2024-09-10T08:37:30.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.042+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9d1015fff0 con 0x7f9d10070fa0 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.042+0000 7f9d0d600640 1 -- 172.21.15.52:0/1623022125 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) ==== 84+0+65 (secure 0 0 0) 0x7f9d0407a050 con 0x7f9d10070fa0 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:37:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:37:30.044 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:37:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 msgr2=0x7f9cf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 0x7f9cf006e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000f60 tx=0x7f9cfc0079d0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 msgr2=0x7f9d10157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f9d0402a2b0 tx=0x7f9d040046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 shutdown_connections 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9cf006be30 0x7f9cf006e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1015c6b0 0x7f9d101588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9d100cf300 0x7f9d100ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 --2- 172.21.15.52:0/1623022125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d10070fa0 0x7f9d10157000 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 >> 172.21.15.52:0/1623022125 conn(0x7f9d100b4300 msgr2=0x7f9d100cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 shutdown_connections 2024-09-10T08:37:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.045+0000 7f9d18000640 1 -- 172.21.15.52:0/1623022125 wait complete. 2024-09-10T08:37:30.061 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:37:30.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:37:30.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.222+0000 7f9572a00640 1 Processor -- start 2024-09-10T08:37:30.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.222+0000 7f9572a00640 1 -- start start 2024-09-10T08:37:30.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.223+0000 7f9572a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c161c60 0x7f956c06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.223+0000 7f9572a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f956c0d3160 0x7f956c0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.223+0000 7f9572a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956c162040 con 0x7f956c06de00 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.223+0000 7f9572a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f956c06e240 con 0x7f956c0d3160 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.223+0000 7f9572a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f956c0d5040 con 0x7f956c161c60 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f956c0d3160 0x7f956c0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f956c0d3160 0x7f956c0b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42154/0 (socket says 172.21.15.52:42154) 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 -- 172.21.15.52:0/1433673939 learned_addr learned my addr 172.21.15.52:0/1433673939 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9571600640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c161c60 0x7f956c06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 -- 172.21.15.52:0/1433673939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c161c60 msgr2=0x7f956c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c161c60 0x7f956c06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 -- 172.21.15.52:0/1433673939 >> v1:172.21.15.176:6789/0 conn(0x7f956c06de00 legacy=0x7f956c0b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:30.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.224+0000 7f9572000640 1 -- 172.21.15.52:0/1433673939 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c0d5320 con 0x7f956c0d3160 2024-09-10T08:37:30.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.225+0000 7f9572000640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c0d3160 0x7f956c0b7dc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9564009e50 tx=0x7f956402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8100e7e0c2b29b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:30.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f956be00640 1 -- 172.21.15.52:0/1433673939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564036070 con 0x7f956c0d3160 2024-09-10T08:37:30.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f956be00640 1 -- 172.21.15.52:0/1433673939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9564031600 con 0x7f956c0d3160 2024-09-10T08:37:30.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f956be00640 1 -- 172.21.15.52:0/1433673939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95640319d0 con 0x7f956c0d3160 2024-09-10T08:37:30.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f9572a00640 1 -- 172.21.15.52:0/1433673939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c0d3160 msgr2=0x7f956c0b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:30.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f9572a00640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c0d3160 0x7f956c0b7dc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9564009e50 tx=0x7f956402a710 comp rx=0 tx=0).stop 2024-09-10T08:37:30.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f9572a00640 1 -- 172.21.15.52:0/1433673939 shutdown_connections 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f9572a00640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c0d3160 0x7f956c0b7dc0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.227+0000 7f9572a00640 1 --2- 172.21.15.52:0/1433673939 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c161c60 0x7f956c06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.228+0000 7f9572a00640 1 -- 172.21.15.52:0/1433673939 >> 172.21.15.52:0/1433673939 conn(0x7f956c0d1630 msgr2=0x7f956c0d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.228+0000 7f9572a00640 1 -- 172.21.15.52:0/1433673939 shutdown_connections 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.228+0000 7f9572a00640 1 -- 172.21.15.52:0/1433673939 wait complete. 2024-09-10T08:37:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.229+0000 7f9572a00640 1 Processor -- start 2024-09-10T08:37:30.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.229+0000 7f9572a00640 1 -- start start 2024-09-10T08:37:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f956c06de00 0x7f956c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 0x7f956c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0d42c0 con 0x7f956c161c60 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0cfc80 con 0x7f956c06de00 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.230+0000 7f9572a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f956c0b3920 con 0x7f956c0d3160 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42164/0 (socket says 172.21.15.52:42164) 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 -- 172.21.15.52:0/668898551 learned_addr learned my addr 172.21.15.52:0/668898551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9571600640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f956c06de00 0x7f956c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9570c00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 0x7f956c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 -- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 msgr2=0x7f956c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 0x7f956c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 -- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f956c06de00 msgr2=0x7f956c159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f956c06de00 0x7f956c159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 -- 172.21.15.52:0/668898551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c14eee0 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9570c00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 0x7f956c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.231+0000 7f9572000640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9564009e50 tx=0x7f9564004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.232+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564036050 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.232+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9564042070 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.232+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564009510 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.232+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c0c9d70 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.232+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c0ca330 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.233+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956c0d3640 con 0x7f956c161c60 2024-09-10T08:37:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.234+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9564007bd0 con 0x7f956c161c60 2024-09-10T08:37:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.235+0000 7f9569600640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 0x7f954c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.235+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4857+0+0 (secure 0 0 0) 0x7f95640ab8c0 con 0x7f956c161c60 2024-09-10T08:37:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.235+0000 7f9571600640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 0x7f954c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.236+0000 7f9571600640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 0x7f954c06e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f956c15b7f0 tx=0x7f9560008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.239+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f956407a5b0 con 0x7f956c161c60 2024-09-10T08:37:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:30.423+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f956c0b8400 con 0x7f956c161c60 2024-09-10T08:37:31.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.228+0000 7f9569600640 1 -- 172.21.15.52:0/668898551 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v132) ==== 138+0+0 (secure 0 0 0) 0x7f9564079eb0 con 0x7f956c161c60 2024-09-10T08:37:31.229 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:37:31.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.232+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 msgr2=0x7f954c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.232+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 0x7f954c06e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f956c15b7f0 tx=0x7f9560008040 comp rx=0 tx=0).stop 2024-09-10T08:37:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.232+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 msgr2=0x7f956c14e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.232+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9564009e50 tx=0x7f9564004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 shutdown_connections 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f954c06be30 0x7f954c06e2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f956c161c60 0x7f956c14e9a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f956c0d3160 0x7f956c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 --2- 172.21.15.52:0/668898551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f956c06de00 0x7f956c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 >> 172.21.15.52:0/668898551 conn(0x7f956c0d1630 msgr2=0x7f956c0cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 shutdown_connections 2024-09-10T08:37:31.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.233+0000 7f9572a00640 1 -- 172.21.15.52:0/668898551 wait complete. 2024-09-10T08:37:31.254 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:37:31.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.422+0000 7ff6d9200640 1 Processor -- start 2024-09-10T08:37:31.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.422+0000 7ff6d9200640 1 -- start start 2024-09-10T08:37:31.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6d9200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff6d40d1a80 0x7ff6d40cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6d9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 0x7ff6d415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6d9200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d40cef10 con 0x7ff6d40d1e60 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6d9200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d40d01d0 con 0x7ff6d40d1a80 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6d9200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d415fc10 con 0x7ff6d415c570 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6cbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff6d40d1e60 0x7ff6d415be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60066/0 (socket says 172.21.15.52:60066) 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.423+0000 7ff6cbe00640 1 -- 172.21.15.52:0/2351823327 learned_addr learned my addr 172.21.15.52:0/2351823327 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2351823327 >> v2:172.21.15.176:3300/0 conn(0x7ff6d40d1a80 0x7ff6d40cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d2800640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 0x7ff6d415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1400640 1 -- 172.21.15.52:0/2351823327 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130789944 0 0) 0x7ff6d40cef10 con 0x7ff6d40d1e60 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1400640 1 -- 172.21.15.52:0/2351823327 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6b8003520 con 0x7ff6d40d1e60 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 msgr2=0x7ff6d415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 0x7ff6d415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2351823327 >> v1:172.21.15.52:6789/0 conn(0x7ff6d40d1e60 legacy=0x7ff6d415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2351823327 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d40cf1d0 con 0x7ff6d40d1a80 2024-09-10T08:37:31.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.424+0000 7ff6d2800640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 0x7ff6d415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.425+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cfc90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40097d0 tx=0x7ff6c402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97420a9204822ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.426+0000 7ff6d1400640 1 -- 172.21.15.52:0/2351823327 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4037070 con 0x7ff6d40d1a80 2024-09-10T08:37:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.426+0000 7ff6d1400640 1 -- 172.21.15.52:0/2351823327 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c4032440 con 0x7ff6d40d1a80 2024-09-10T08:37:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.426+0000 7ff6d1400640 1 -- 172.21.15.52:0/2351823327 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4032810 con 0x7ff6d40d1a80 2024-09-10T08:37:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.426+0000 7ff6d9200640 1 -- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d40d1a80 msgr2=0x7ff6d40cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.426+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cfc90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40097d0 tx=0x7ff6c402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 -- 172.21.15.52:0/2351823327 shutdown_connections 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d415c570 0x7ff6d415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2351823327 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cfc90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 -- 172.21.15.52:0/2351823327 >> 172.21.15.52:0/2351823327 conn(0x7ff6d4067d70 msgr2=0x7ff6d4068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 -- 172.21.15.52:0/2351823327 shutdown_connections 2024-09-10T08:37:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.427+0000 7ff6d9200640 1 -- 172.21.15.52:0/2351823327 wait complete. 2024-09-10T08:37:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.428+0000 7ff6d9200640 1 Processor -- start 2024-09-10T08:37:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 -- start start 2024-09-10T08:37:31.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d40d1e60 0x7ff6d41f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d415c570 0x7ff6d4155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d415f420 con 0x7ff6d40d1a80 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d40cf790 con 0x7ff6d415c570 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.429+0000 7ff6d9200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d415f5a0 con 0x7ff6d40d1e60 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42180/0 (socket says 172.21.15.52:42180) 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2550301685 learned_addr learned my addr 172.21.15.52:0/2550301685 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d2800640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d415c570 0x7ff6d4155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6cbe00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d40d1e60 0x7ff6d41f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d40d1e60 msgr2=0x7ff6d41f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d40d1e60 0x7ff6d41f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d415c570 msgr2=0x7ff6d4155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d415c570 0x7ff6d4155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 -- 172.21.15.52:0/2550301685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d40ccdc0 con 0x7ff6d40d1a80 2024-09-10T08:37:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.430+0000 7ff6d1e00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4035040 tx=0x7ff6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.431+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4041030 con 0x7ff6d40d1a80 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.431+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c403d4e0 con 0x7ff6d40d1a80 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.431+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4037040 con 0x7ff6d40d1a80 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.431+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d40cd0a0 con 0x7ff6d40d1a80 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.431+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d41f5210 con 0x7ff6d40d1a80 2024-09-10T08:37:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.432+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d40cfc90 con 0x7ff6d40d1a80 2024-09-10T08:37:31.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.433+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6c4044070 con 0x7ff6d40d1a80 2024-09-10T08:37:31.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.434+0000 7ff6ca000640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 0x7ff6b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:31.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.434+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5227+0+0 (secure 0 0 0) 0x7ff6c40ab390 con 0x7ff6d40d1a80 2024-09-10T08:37:31.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.434+0000 7ff6cbe00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 0x7ff6b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:31.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.435+0000 7ff6cbe00640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 0x7ff6b006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff6d41574c0 tx=0x7ff6bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:31.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.439+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6c4079e90 con 0x7ff6d40d1a80 2024-09-10T08:37:31.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:31.623+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff6d40cecd0 con 0x7ff6d40d1a80 2024-09-10T08:37:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.235+0000 7ff6ca000640 1 -- 172.21.15.52:0/2550301685 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v133) ==== 170+0+0 (secure 0 0 0) 0x7ff6c40a9e20 con 0x7ff6d40d1a80 2024-09-10T08:37:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 msgr2=0x7ff6b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 0x7ff6b006e2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff6d41574c0 tx=0x7ff6bc009040 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 msgr2=0x7ff6d40cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4035040 tx=0x7ff6c40046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 shutdown_connections 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff6b006be30 0x7ff6b006e2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff6d415c570 0x7ff6d4155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff6d40d1e60 0x7ff6d41f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 --2- 172.21.15.52:0/2550301685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6d40d1a80 0x7ff6d40cc730 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 >> 172.21.15.52:0/2550301685 conn(0x7ff6d4067d70 msgr2=0x7ff6d4068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 shutdown_connections 2024-09-10T08:37:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.239+0000 7ff6d9200640 1 -- 172.21.15.52:0/2550301685 wait complete. 2024-09-10T08:37:32.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:37:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.432+0000 7f9cb0a00640 1 Processor -- start 2024-09-10T08:37:32.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.432+0000 7f9cb0a00640 1 -- start start 2024-09-10T08:37:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cb0a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9cac072240 0x7f9cac0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cb0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cb0a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cac071b10 con 0x7f9cac0d0730 2024-09-10T08:37:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cb0a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9cac072c10 con 0x7f9cac072240 2024-09-10T08:37:32.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cb0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac071df0 con 0x7f9cac070de0 2024-09-10T08:37:32.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cab200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cab200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57472/0 (socket says 172.21.15.52:57472) 2024-09-10T08:37:32.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9cab200640 1 -- 172.21.15.52:0/2666437235 learned_addr learned my addr 172.21.15.52:0/2666437235 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:32.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.434+0000 7f9ca3e00640 1 --2- 172.21.15.52:0/2666437235 >> v2:172.21.15.176:3300/0 conn(0x7f9cac072240 0x7f9cac0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.435+0000 7f9cab200640 1 -- 172.21.15.52:0/2666437235 >> v2:172.21.15.176:3300/0 conn(0x7f9cac072240 msgr2=0x7f9cac0726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.435+0000 7f9cab200640 1 --2- 172.21.15.52:0/2666437235 >> v2:172.21.15.176:3300/0 conn(0x7f9cac072240 0x7f9cac0726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.435+0000 7f9cab200640 1 -- 172.21.15.52:0/2666437235 >> v1:172.21.15.176:6789/0 conn(0x7f9cac0d0730 legacy=0x7f9cac15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.435+0000 7f9cab200640 1 -- 172.21.15.52:0/2666437235 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac0b3390 con 0x7f9cac070de0 2024-09-10T08:37:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.435+0000 7f9ca9e00640 1 -- 172.21.15.52:0/2666437235 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249483104 0 0) 0x7f9cac071b10 con 0x7f9cac0d0730 2024-09-10T08:37:32.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.436+0000 7f9cab200640 1 --2- 172.21.15.52:0/2666437235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e50 tx=0x7f9ca402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f5ab904fd257b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:32.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.436+0000 7f9ca9e00640 1 -- 172.21.15.52:0/2666437235 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4036070 con 0x7f9cac070de0 2024-09-10T08:37:32.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.436+0000 7f9ca9e00640 1 -- 172.21.15.52:0/2666437235 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4031600 con 0x7f9cac070de0 2024-09-10T08:37:32.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.436+0000 7f9ca9e00640 1 -- 172.21.15.52:0/2666437235 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40319d0 con 0x7f9cac070de0 2024-09-10T08:37:32.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 -- 172.21.15.52:0/2666437235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 msgr2=0x7f9cac071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/2666437235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e50 tx=0x7f9ca402a710 comp rx=0 tx=0).stop 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 -- 172.21.15.52:0/2666437235 shutdown_connections 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/2666437235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac070de0 0x7f9cac071230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/2666437235 >> v2:172.21.15.176:3300/0 conn(0x7f9cac072240 0x7f9cac0726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 -- 172.21.15.52:0/2666437235 >> 172.21.15.52:0/2666437235 conn(0x7f9cac06bc10 msgr2=0x7f9cac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 -- 172.21.15.52:0/2666437235 shutdown_connections 2024-09-10T08:37:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.437+0000 7f9cb0a00640 1 -- 172.21.15.52:0/2666437235 wait complete. 2024-09-10T08:37:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.438+0000 7f9cb0a00640 1 Processor -- start 2024-09-10T08:37:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.438+0000 7f9cb0a00640 1 -- start start 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 0x7f9cac1f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 0x7f9cac14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac071770 con 0x7f9cac0d0730 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac0d0b10 con 0x7f9cac070de0 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.439+0000 7f9cb0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac0718f0 con 0x7f9cac072240 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42190/0 (socket says 172.21.15.52:42190) 2024-09-10T08:37:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 -- 172.21.15.52:0/1092973205 learned_addr learned my addr 172.21.15.52:0/1092973205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9ca3e00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 0x7f9cac14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9caa800640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 0x7f9cac1f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 -- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 msgr2=0x7f9cac14bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 0x7f9cac14bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 -- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 msgr2=0x7f9cac1f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 0x7f9cac1f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 -- 172.21.15.52:0/1092973205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac1f83f0 con 0x7f9cac0d0730 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9ca3e00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 0x7f9cac14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9caa800640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 0x7f9cac1f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.440+0000 7f9cab200640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4034040 tx=0x7f9ca4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.441+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4041020 con 0x7f9cac0d0730 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.441+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4037040 con 0x7f9cac0d0730 2024-09-10T08:37:32.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.441+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4036050 con 0x7f9cac0d0730 2024-09-10T08:37:32.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.441+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac1e5b30 con 0x7f9cac0d0730 2024-09-10T08:37:32.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.441+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac1f5510 con 0x7f9cac0d0730 2024-09-10T08:37:32.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.442+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac15c010 con 0x7f9cac0d0730 2024-09-10T08:37:32.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.443+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ca4007c50 con 0x7f9cac0d0730 2024-09-10T08:37:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.444+0000 7f9ca2a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 0x7f9c8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.444+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5609+0+0 (secure 0 0 0) 0x7f9ca40ab560 con 0x7f9cac0d0730 2024-09-10T08:37:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.444+0000 7f9caa800640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 0x7f9c8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.445+0000 7f9caa800640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 0x7f9c8806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c000f60 tx=0x7f9c9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:32.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.448+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cac15c010 con 0x7f9cac0d0730 2024-09-10T08:37:32.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:32.671+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9cac071230 con 0x7f9cac0d0730 2024-09-10T08:37:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.238+0000 7f9ca2a00640 1 -- 172.21.15.52:0/1092973205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v98) ==== 174+0+0 (secure 0 0 0) 0x7f9ca404b060 con 0x7f9cac0d0730 2024-09-10T08:37:33.238 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 18 and data pool 19 2024-09-10T08:37:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 msgr2=0x7f9c8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 0x7f9c8806e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c000f60 tx=0x7f9c9c009040 comp rx=0 tx=0).stop 2024-09-10T08:37:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 msgr2=0x7f9cac0cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4034040 tx=0x7f9ca4004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:33.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 shutdown_connections 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c8806be30 0x7f9c8806e2f0 secure :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c000f60 tx=0x7f9c9c009040 comp rx=0 tx=0).stop 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9cac0d0730 0x7f9cac0cf0a0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9cac072240 0x7f9cac14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 --2- 172.21.15.52:0/1092973205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9cac070de0 0x7f9cac1f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.241+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 >> 172.21.15.52:0/1092973205 conn(0x7f9cac06bc10 msgr2=0x7f9cac0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.242+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 shutdown_connections 2024-09-10T08:37:33.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.243+0000 7f9cb0a00640 1 -- 172.21.15.52:0/1092973205 wait complete. 2024-09-10T08:37:33.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.443+0000 7f2c2de00640 1 Processor -- start 2024-09-10T08:37:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.443+0000 7f2c2de00640 1 -- start start 2024-09-10T08:37:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c2de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c2806c6a0 0x7f2c280720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c2de00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c28071010 con 0x7f2c2815af20 2024-09-10T08:37:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c2de00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c280712f0 con 0x7f2c2815ab40 2024-09-10T08:37:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c2de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2806cb10 con 0x7f2c2806c6a0 2024-09-10T08:37:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c1e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2c2806c6a0 0x7f2c280720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c27400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2c2815af20 0x7f2c2815b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60068/0 (socket says 172.21.15.52:60068) 2024-09-10T08:37:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c27400640 1 -- 172.21.15.52:0/2041250431 learned_addr learned my addr 172.21.15.52:0/2041250431 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:33.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.445+0000 7f2c1e000640 1 -- 172.21.15.52:0/2041250431 >> v1:172.21.15.176:6789/0 conn(0x7f2c2815ab40 legacy=0x7f2c28073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:33.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.446+0000 7f2c1e000640 1 -- 172.21.15.52:0/2041250431 >> v1:172.21.15.52:6789/0 conn(0x7f2c2815af20 legacy=0x7f2c2815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.446+0000 7f2c1e000640 1 -- 172.21.15.52:0/2041250431 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c280715d0 con 0x7f2c2806c6a0 2024-09-10T08:37:33.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.446+0000 7f2c26000640 1 -- 172.21.15.52:0/2041250431 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137168315 0 0) 0x7f2c28071010 con 0x7f2c2815af20 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c1e000640 1 --2- 172.21.15.52:0/2041250431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280720b0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2c100097a0 tx=0x7f2c1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca87359dbb8b4a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c26000640 1 -- 172.21.15.52:0/2041250431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10037070 con 0x7f2c2806c6a0 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c26000640 1 -- 172.21.15.52:0/2041250431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c10032440 con 0x7f2c2806c6a0 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c26000640 1 -- 172.21.15.52:0/2041250431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10032810 con 0x7f2c2806c6a0 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 -- 172.21.15.52:0/2041250431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 msgr2=0x7f2c280720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 --2- 172.21.15.52:0/2041250431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280720b0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2c100097a0 tx=0x7f2c1002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 -- 172.21.15.52:0/2041250431 shutdown_connections 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 --2- 172.21.15.52:0/2041250431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280720b0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 -- 172.21.15.52:0/2041250431 >> 172.21.15.52:0/2041250431 conn(0x7f2c280ccec0 msgr2=0x7f2c280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 -- 172.21.15.52:0/2041250431 shutdown_connections 2024-09-10T08:37:33.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.447+0000 7f2c2de00640 1 -- 172.21.15.52:0/2041250431 wait complete. 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.449+0000 7f2c2de00640 1 Processor -- start 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.449+0000 7f2c2de00640 1 -- start start 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c2815ab40 0x7f2c280aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c2815af20 0x7f2c281f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2806bc10 con 0x7f2c2806c6a0 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2815ba80 con 0x7f2c2815af20 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c2de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2806bd90 con 0x7f2c2815ab40 2024-09-10T08:37:33.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c26a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c26a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42214/0 (socket says 172.21.15.52:42214) 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c26a00640 1 -- 172.21.15.52:0/563554707 learned_addr learned my addr 172.21.15.52:0/563554707 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c1e000640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c2815ab40 0x7f2c280aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.450+0000 7f2c27400640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c2815af20 0x7f2c281f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 -- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c2815ab40 msgr2=0x7f2c280aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c2815ab40 0x7f2c280aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 -- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c2815af20 msgr2=0x7f2c281f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c2815af20 0x7f2c281f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 -- 172.21.15.52:0/563554707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c28157960 con 0x7f2c2806c6a0 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c26a00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c450 tx=0x7f2c1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c180052d0 con 0x7f2c2806c6a0 2024-09-10T08:37:33.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c18005470 con 0x7f2c2806c6a0 2024-09-10T08:37:33.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18012870 con 0x7f2c2806c6a0 2024-09-10T08:37:33.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c280ab420 con 0x7f2c2806c6a0 2024-09-10T08:37:33.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.451+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c28156ba0 con 0x7f2c2806c6a0 2024-09-10T08:37:33.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.452+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c28072980 con 0x7f2c2806c6a0 2024-09-10T08:37:33.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.453+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c18012a10 con 0x7f2c2806c6a0 2024-09-10T08:37:33.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.454+0000 7f2c1fe00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 0x7f2c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.454+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7f2c1808a920 con 0x7f2c2806c6a0 2024-09-10T08:37:33.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.455+0000 7f2c1e000640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 0x7f2c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.455+0000 7f2c1e000640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 0x7f2c0406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2c10034000 tx=0x7f2c1002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.458+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c28072980 con 0x7f2c2806c6a0 2024-09-10T08:37:33.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.648+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c2815a6a0 con 0x7f2c2806c6a0 2024-09-10T08:37:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.650+0000 7f2c1fe00640 1 -- 172.21.15.52:0/563554707 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16712 (secure 0 0 0) 0x7f2c2815a6a0 con 0x7f2c2806c6a0 2024-09-10T08:37:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:33.650 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":134,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:32.672595+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:37:30.466692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T08:37:31.666587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 msgr2=0x7f2c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 0x7f2c0406e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2c10034000 tx=0x7f2c1002e000 comp rx=0 tx=0).stop 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 msgr2=0x7f2c280aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c450 tx=0x7f2c1800c910 comp rx=0 tx=0).stop 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 shutdown_connections 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c0406be30 0x7f2c0406e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c2815af20 0x7f2c281f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c2815ab40 0x7f2c280aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 --2- 172.21.15.52:0/563554707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c2806c6a0 0x7f2c280aa460 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 >> 172.21.15.52:0/563554707 conn(0x7f2c280ccec0 msgr2=0x7f2c280b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 shutdown_connections 2024-09-10T08:37:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.652+0000 7f2c2de00640 1 -- 172.21.15.52:0/563554707 wait complete. 2024-09-10T08:37:33.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.825+0000 7ff2f3e00640 1 Processor -- start 2024-09-10T08:37:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.825+0000 7ff2f3e00640 1 -- start start 2024-09-10T08:37:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 0x7ff2f40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 0x7ff2f415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f415f3d0 con 0x7ff2f4160360 2024-09-10T08:37:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f415f6b0 con 0x7ff2f415c0e0 2024-09-10T08:37:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f415f990 con 0x7ff2f415ec60 2024-09-10T08:37:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2ea000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 0x7ff2f415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff2f4160360 0x7ff2f40cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:37758/0 (socket says 172.21.15.52:37758) 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f3400640 1 -- 172.21.15.52:0/2998164098 learned_addr learned my addr 172.21.15.52:0/2998164098 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.826+0000 7ff2f2a00640 1 --2- 172.21.15.52:0/2998164098 >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 0x7ff2f40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2f2000640 1 -- 172.21.15.52:0/2998164098 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398151296 0 0) 0x7ff2f415f3d0 con 0x7ff2f4160360 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2f2000640 1 -- 172.21.15.52:0/2998164098 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d8003520 con 0x7ff2f4160360 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2ea000640 1 -- 172.21.15.52:0/2998164098 >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 msgr2=0x7ff2f40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2ea000640 1 --2- 172.21.15.52:0/2998164098 >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 0x7ff2f40b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2ea000640 1 -- 172.21.15.52:0/2998164098 >> v1:172.21.15.176:6789/0 conn(0x7ff2f4160360 legacy=0x7ff2f40cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2ea000640 1 -- 172.21.15.52:0/2998164098 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40cd270 con 0x7ff2f415ec60 2024-09-10T08:37:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.827+0000 7ff2f2a00640 1 --2- 172.21.15.52:0/2998164098 >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 0x7ff2f40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:33.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.828+0000 7ff2ea000640 1 --2- 172.21.15.52:0/2998164098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 0x7ff2f415fe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0097a0 tx=0x7ff2dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0a246317908d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.828+0000 7ff2f2000640 1 -- 172.21.15.52:0/2998164098 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc037070 con 0x7ff2f415ec60 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.828+0000 7ff2f2000640 1 -- 172.21.15.52:0/2998164098 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc032440 con 0x7ff2f415ec60 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.828+0000 7ff2f2000640 1 -- 172.21.15.52:0/2998164098 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc032810 con 0x7ff2f415ec60 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 -- 172.21.15.52:0/2998164098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 msgr2=0x7ff2f415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/2998164098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 0x7ff2f415fe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0097a0 tx=0x7ff2dc02a180 comp rx=0 tx=0).stop 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 -- 172.21.15.52:0/2998164098 shutdown_connections 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/2998164098 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f415ec60 0x7ff2f415fe20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/2998164098 >> v2:172.21.15.176:3300/0 conn(0x7ff2f415c0e0 0x7ff2f40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 -- 172.21.15.52:0/2998164098 >> 172.21.15.52:0/2998164098 conn(0x7ff2f406c240 msgr2=0x7ff2f406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 -- 172.21.15.52:0/2998164098 shutdown_connections 2024-09-10T08:37:33.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.829+0000 7ff2f3e00640 1 -- 172.21.15.52:0/2998164098 wait complete. 2024-09-10T08:37:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.831+0000 7ff2f3e00640 1 Processor -- start 2024-09-10T08:37:33.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.831+0000 7ff2f3e00640 1 -- start start 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f415ec60 0x7ff2f4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f4160360 0x7ff2f4157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f415c640 con 0x7ff2f415c0e0 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f415c4c0 con 0x7ff2f415ec60 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40cdea0 con 0x7ff2f4160360 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42228/0 (socket says 172.21.15.52:42228) 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 -- 172.21.15.52:0/151263436 learned_addr learned my addr 172.21.15.52:0/151263436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2ea000640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f415ec60 0x7ff2f4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f3400640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f4160360 0x7ff2f4157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 -- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f4160360 msgr2=0x7ff2f4157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f4160360 0x7ff2f4157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 -- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f415ec60 msgr2=0x7ff2f4157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f415ec60 0x7ff2f4157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.832+0000 7ff2f2a00640 1 -- 172.21.15.52:0/151263436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4155260 con 0x7ff2f415c0e0 2024-09-10T08:37:33.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2f2a00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400ebe0 tx=0x7ff2e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4017070 con 0x7ff2f415c0e0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e400cc30 con 0x7ff2f415c0e0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4013470 con 0x7ff2f415c0e0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f4157eb0 con 0x7ff2f415c0e0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.833+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f41f79b0 con 0x7ff2f415c0e0 2024-09-10T08:37:33.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.834+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f40b2f20 con 0x7ff2f415c0e0 2024-09-10T08:37:33.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.835+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2e401a070 con 0x7ff2f415c0e0 2024-09-10T08:37:33.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.836+0000 7ff2eb400640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:33.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.836+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7ff2e408ae20 con 0x7ff2f415c0e0 2024-09-10T08:37:33.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.836+0000 7ff2ea000640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:33.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.837+0000 7ff2ea000640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 0x7ff2d006e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:33.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:33.841+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2e40597c0 con 0x7ff2f415c0e0 2024-09-10T08:37:34.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.025+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2f40b5590 con 0x7ff2f415c0e0 2024-09-10T08:37:34.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.027+0000 7ff2eb400640 1 -- 172.21.15.52:0/151263436 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+16712 (secure 0 0 0) 0x7ff2e40590c0 con 0x7ff2f415c0e0 2024-09-10T08:37:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:34.028 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":134,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:32.672595+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:37:30.466692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T08:37:31.666587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:34.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 msgr2=0x7ff2d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 0x7ff2d006e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc02e000 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 msgr2=0x7ff2f40cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400ebe0 tx=0x7ff2e400c520 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 shutdown_connections 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff2d006be30 0x7ff2d006e2f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2f4160360 0x7ff2f4157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2f415ec60 0x7ff2f4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 --2- 172.21.15.52:0/151263436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f415c0e0 0x7ff2f40cae30 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 >> 172.21.15.52:0/151263436 conn(0x7ff2f406c240 msgr2=0x7ff2f40b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 shutdown_connections 2024-09-10T08:37:34.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.030+0000 7ff2f3e00640 1 -- 172.21.15.52:0/151263436 wait complete. 2024-09-10T08:37:34.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:37:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.205+0000 7fe769800640 1 Processor -- start 2024-09-10T08:37:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.206+0000 7fe769800640 1 -- start start 2024-09-10T08:37:34.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe769800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7640b5fd0 0x7fe7640d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe769800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe7640b63b0 0x7fe7640cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe769800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7640d3950 con 0x7fe764067950 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe769800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe7640d3c30 con 0x7fe7640b5fd0 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe769800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe7640d3f10 con 0x7fe7640b63b0 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe768e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe764067950 0x7fe764067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60976/0 (socket says 172.21.15.52:60976) 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe768e00640 1 -- 172.21.15.52:0/2460931194 learned_addr learned my addr 172.21.15.52:0/2460931194 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe7640b5fd0 0x7fe7640d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe75be00640 1 --2- 172.21.15.52:0/2460931194 >> v2:172.21.15.176:3300/0 conn(0x7fe7640b63b0 0x7fe7640cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763e00640 1 -- 172.21.15.52:0/2460931194 >> v2:172.21.15.176:3300/0 conn(0x7fe7640b63b0 msgr2=0x7fe7640cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763e00640 1 --2- 172.21.15.52:0/2460931194 >> v2:172.21.15.176:3300/0 conn(0x7fe7640b63b0 0x7fe7640cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763e00640 1 -- 172.21.15.52:0/2460931194 >> v1:172.21.15.52:6789/0 conn(0x7fe764067950 legacy=0x7fe764067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763e00640 1 -- 172.21.15.52:0/2460931194 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7640d41f0 con 0x7fe7640b5fd0 2024-09-10T08:37:34.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.207+0000 7fe763400640 1 -- 172.21.15.52:0/2460931194 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281672958 0 0) 0x7fe7640d3950 con 0x7fe764067950 2024-09-10T08:37:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.208+0000 7fe763e00640 1 --2- 172.21.15.52:0/2460931194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe7640d32c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe764161fa0 tx=0x7fe75402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1811f58e27ddb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:34.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe763400640 1 -- 172.21.15.52:0/2460931194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754037070 con 0x7fe7640b5fd0 2024-09-10T08:37:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe763400640 1 -- 172.21.15.52:0/2460931194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754032440 con 0x7fe7640b5fd0 2024-09-10T08:37:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe763400640 1 -- 172.21.15.52:0/2460931194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754032810 con 0x7fe7640b5fd0 2024-09-10T08:37:34.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 -- 172.21.15.52:0/2460931194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 msgr2=0x7fe7640d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 --2- 172.21.15.52:0/2460931194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe7640d32c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe764161fa0 tx=0x7fe75402a230 comp rx=0 tx=0).stop 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 -- 172.21.15.52:0/2460931194 shutdown_connections 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 --2- 172.21.15.52:0/2460931194 >> v2:172.21.15.176:3300/0 conn(0x7fe7640b63b0 0x7fe7640cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 --2- 172.21.15.52:0/2460931194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe7640d32c0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 -- 172.21.15.52:0/2460931194 >> 172.21.15.52:0/2460931194 conn(0x7fe7640d0fd0 msgr2=0x7fe7640d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 -- 172.21.15.52:0/2460931194 shutdown_connections 2024-09-10T08:37:34.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.209+0000 7fe769800640 1 -- 172.21.15.52:0/2460931194 wait complete. 2024-09-10T08:37:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.211+0000 7fe769800640 1 Processor -- start 2024-09-10T08:37:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.211+0000 7fe769800640 1 -- start start 2024-09-10T08:37:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe764067950 0x7fe7640cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7640b63b0 0x7fe764154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640cfd10 con 0x7fe7640b5fd0 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640cfb90 con 0x7fe7640b63b0 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe769800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe7640b67d0 con 0x7fe764067950 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.212+0000 7fe75be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe763e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe764067950 0x7fe7640cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56842/0 (socket says 172.21.15.52:56842) 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 -- 172.21.15.52:0/2595332540 learned_addr learned my addr 172.21.15.52:0/2595332540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe768e00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7640b63b0 0x7fe764154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 -- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe764067950 msgr2=0x7fe7640cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe764067950 0x7fe7640cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 -- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7640b63b0 msgr2=0x7fe764154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7640b63b0 0x7fe764154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 -- 172.21.15.52:0/2595332540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7641f4b10 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe75be00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00e9b0 tx=0x7fe74c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.213+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c017070 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.214+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c00c9a0 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.214+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7640cb870 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.214+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00cd90 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.214+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7640cbe30 con 0x7fe7640b5fd0 2024-09-10T08:37:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.215+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76415e7f0 con 0x7fe7640b5fd0 2024-09-10T08:37:34.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.216+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe74c01a070 con 0x7fe7640b5fd0 2024-09-10T08:37:34.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.216+0000 7fe760c00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 0x7fe74006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.217+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5709+0+0 (secure 0 0 0) 0x7fe74c08b1c0 con 0x7fe7640b5fd0 2024-09-10T08:37:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.217+0000 7fe763e00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 0x7fe74006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.218+0000 7fe763e00640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 0x7fe74006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:34.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.221+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe74c059510 con 0x7fe7640b5fd0 2024-09-10T08:37:34.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:34.449+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe7640b9580 con 0x7fe7640b5fd0 2024-09-10T08:37:35.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.261+0000 7fe760c00640 1 -- 172.21.15.52:0/2595332540 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v101) ==== 118+0+0 (secure 0 0 0) 0x7fe74c05d810 con 0x7fe7640b5fd0 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 msgr2=0x7fe74006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 0x7fe74006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).stop 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 msgr2=0x7fe764160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00e9b0 tx=0x7fe74c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 shutdown_connections 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe74006be30 0x7fe74006e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7640b63b0 0x7fe764154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7640b5fd0 0x7fe764160e70 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 --2- 172.21.15.52:0/2595332540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe764067950 0x7fe7640cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.265+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 >> 172.21.15.52:0/2595332540 conn(0x7fe7640d0fd0 msgr2=0x7fe7640b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.266+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 shutdown_connections 2024-09-10T08:37:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.266+0000 7fe769800640 1 -- 172.21.15.52:0/2595332540 wait complete. 2024-09-10T08:37:35.285 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:37:35.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:37:35.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.449+0000 7f2217800640 1 Processor -- start 2024-09-10T08:37:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.449+0000 7f2217800640 1 -- start start 2024-09-10T08:37:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.450+0000 7f2217800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.450+0000 7f2217800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f22100cfcb0 0x7f2210071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.450+0000 7f2217800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221015f120 con 0x7f2210144340 2024-09-10T08:37:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.450+0000 7f2217800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2210141cd0 con 0x7f22100cfcb0 2024-09-10T08:37:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.450+0000 7f2217800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f221015f400 con 0x7f22100cf8d0 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:40126/0 (socket says 172.21.15.52:40126) 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 -- 172.21.15.52:0/3406295138 learned_addr learned my addr 172.21.15.52:0/3406295138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f220fe00640 1 --2- 172.21.15.52:0/3406295138 >> v2:172.21.15.176:3300/0 conn(0x7f22100cfcb0 0x7f2210071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 -- 172.21.15.52:0/3406295138 >> v2:172.21.15.176:3300/0 conn(0x7f22100cfcb0 msgr2=0x7f2210071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 --2- 172.21.15.52:0/3406295138 >> v2:172.21.15.176:3300/0 conn(0x7f22100cfcb0 0x7f2210071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 -- 172.21.15.52:0/3406295138 >> v1:172.21.15.176:6789/0 conn(0x7f2210144340 legacy=0x7f22101447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f2214e00640 1 -- 172.21.15.52:0/3406295138 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221015f6e0 con 0x7f22100cf8d0 2024-09-10T08:37:35.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.451+0000 7f220f400640 1 -- 172.21.15.52:0/3406295138 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703827193 0 0) 0x7f221015f120 con 0x7f2210144340 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.452+0000 7f2214e00640 1 --2- 172.21.15.52:0/3406295138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e36c75ad3d95466c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f220f400640 1 -- 172.21.15.52:0/3406295138 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204037070 con 0x7f22100cf8d0 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f220f400640 1 -- 172.21.15.52:0/3406295138 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2204032440 con 0x7f22100cf8d0 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f220f400640 1 -- 172.21.15.52:0/3406295138 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204032810 con 0x7f22100cf8d0 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 -- 172.21.15.52:0/3406295138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 msgr2=0x7f2210070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 --2- 172.21.15.52:0/3406295138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220402a250 comp rx=0 tx=0).stop 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 -- 172.21.15.52:0/3406295138 shutdown_connections 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 --2- 172.21.15.52:0/3406295138 >> v2:172.21.15.176:3300/0 conn(0x7f22100cfcb0 0x7f2210071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 --2- 172.21.15.52:0/3406295138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f22100cf8d0 0x7f2210070f40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 -- 172.21.15.52:0/3406295138 >> 172.21.15.52:0/3406295138 conn(0x7f221006d0f0 msgr2=0x7f221006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:35.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 -- 172.21.15.52:0/3406295138 shutdown_connections 2024-09-10T08:37:35.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.453+0000 7f2217800640 1 -- 172.21.15.52:0/3406295138 wait complete. 2024-09-10T08:37:35.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.455+0000 7f2217800640 1 Processor -- start 2024-09-10T08:37:35.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.455+0000 7f2217800640 1 -- start start 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 0x7f221013c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2210144340 0x7f22100caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f22100ce0f0 con 0x7f22100cfcb0 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f221015ee30 con 0x7f22100cf8d0 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2217800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f22100ce270 con 0x7f2210144340 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f220fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f220fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56850/0 (socket says 172.21.15.52:56850) 2024-09-10T08:37:35.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f220fe00640 1 -- 172.21.15.52:0/1993308555 learned_addr learned my addr 172.21.15.52:0/1993308555 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2214e00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 0x7f221013c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.456+0000 7f2215800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2210144340 0x7f22100caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 -- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2210144340 msgr2=0x7f22100caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2210144340 0x7f22100caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 -- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 msgr2=0x7f221013c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 0x7f221013c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 -- 172.21.15.52:0/1993308555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221013d970 con 0x7f22100cfcb0 2024-09-10T08:37:35.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f2214e00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 0x7f221013c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220fe00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00e9b0 tx=0x7f21fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc017070 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21fc00c9a0 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00cd90 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.457+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221013ca90 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.458+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221013d050 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.459+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22101447d0 con 0x7f22100cfcb0 2024-09-10T08:37:35.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.460+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21fc01a070 con 0x7f22100cfcb0 2024-09-10T08:37:35.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.460+0000 7f220cc00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:35.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.460+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f21fc08ae60 con 0x7f22100cfcb0 2024-09-10T08:37:35.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.461+0000 7f2214e00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:35.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.462+0000 7f2214e00640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 0x7f21f006e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2204034000 tx=0x7f220402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:35.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.465+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21fc059120 con 0x7f22100cfcb0 2024-09-10T08:37:35.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:35.686+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f221006f260 con 0x7f22100cfcb0 2024-09-10T08:37:36.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.263+0000 7f220cc00640 1 -- 172.21.15.52:0/1993308555 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v102) ==== 122+0+0 (secure 0 0 0) 0x7f21fc05d420 con 0x7f22100cfcb0 2024-09-10T08:37:36.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 msgr2=0x7f21f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 0x7f21f006e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2204034000 tx=0x7f220402e000 comp rx=0 tx=0).stop 2024-09-10T08:37:36.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 msgr2=0x7f22100ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00e9b0 tx=0x7f21fc00ee70 comp rx=0 tx=0).stop 2024-09-10T08:37:36.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 shutdown_connections 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21f006be30 0x7f21f006e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2210144340 0x7f22100caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22100cfcb0 0x7f22100ccf30 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 --2- 172.21.15.52:0/1993308555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f22100cf8d0 0x7f221013c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 >> 172.21.15.52:0/1993308555 conn(0x7f221006d0f0 msgr2=0x7f22100ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 shutdown_connections 2024-09-10T08:37:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.267+0000 7f2217800640 1 -- 172.21.15.52:0/1993308555 wait complete. 2024-09-10T08:37:36.287 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:37:36.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.446+0000 7f41f7200640 1 Processor -- start 2024-09-10T08:37:36.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.446+0000 7f41f7200640 1 -- start start 2024-09-10T08:37:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f7200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 0x7f41f00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f7200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00b4020 con 0x7f41f0073180 2024-09-10T08:37:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f7200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f41f0073b00 con 0x7f41f00b5f90 2024-09-10T08:37:36.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00b42c0 con 0x7f41f0145ed0 2024-09-10T08:37:36.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41efe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41efe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:40144/0 (socket says 172.21.15.52:40144) 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41efe00640 1 -- 172.21.15.52:0/2687941902 learned_addr learned my addr 172.21.15.52:0/2687941902 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41f5200640 1 --2- 172.21.15.52:0/2687941902 >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 0x7f41f00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.448+0000 7f41e7400640 1 --1- 172.21.15.52:0/2687941902 >> v1:172.21.15.176:6789/0 conn(0x7f41f0073180 0x7f41f00b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:47668/0 (socket says 172.21.15.52:47668) 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.449+0000 7f41efe00640 1 -- 172.21.15.52:0/2687941902 >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 msgr2=0x7f41f00735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.449+0000 7f41efe00640 1 --2- 172.21.15.52:0/2687941902 >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 0x7f41f00735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.449+0000 7f41efe00640 1 -- 172.21.15.52:0/2687941902 >> v1:172.21.15.176:6789/0 conn(0x7f41f0073180 legacy=0x7f41f00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.449+0000 7f41efe00640 1 -- 172.21.15.52:0/2687941902 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00b45a0 con 0x7f41f0145ed0 2024-09-10T08:37:36.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.449+0000 7f41f5200640 1 --2- 172.21.15.52:0/2687941902 >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 0x7f41f00735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:36.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.450+0000 7f41efe00640 1 --2- 172.21.15.52:0/2687941902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009870 tx=0x7f41e002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8976d2c50a36147e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.450+0000 7f41ef400640 1 -- 172.21.15.52:0/2687941902 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0037070 con 0x7f41f0145ed0 2024-09-10T08:37:36.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.450+0000 7f41ef400640 1 -- 172.21.15.52:0/2687941902 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0032440 con 0x7f41f0145ed0 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.450+0000 7f41ef400640 1 -- 172.21.15.52:0/2687941902 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0032810 con 0x7f41f0145ed0 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 -- 172.21.15.52:0/2687941902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 msgr2=0x7f41f00b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 --2- 172.21.15.52:0/2687941902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f41e0009870 tx=0x7f41e002a250 comp rx=0 tx=0).stop 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 -- 172.21.15.52:0/2687941902 shutdown_connections 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 --2- 172.21.15.52:0/2687941902 >> v2:172.21.15.176:3300/0 conn(0x7f41f00b5f90 0x7f41f00735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 --2- 172.21.15.52:0/2687941902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f0145ed0 0x7f41f00b5080 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 -- 172.21.15.52:0/2687941902 >> 172.21.15.52:0/2687941902 conn(0x7f41f00ccec0 msgr2=0x7f41f00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 -- 172.21.15.52:0/2687941902 shutdown_connections 2024-09-10T08:37:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.451+0000 7f41f7200640 1 -- 172.21.15.52:0/2687941902 wait complete. 2024-09-10T08:37:36.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.453+0000 7f41f7200640 1 Processor -- start 2024-09-10T08:37:36.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.453+0000 7f41f7200640 1 -- start start 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 0x7f41f00cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 0x7f41f00cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41f01462b0 con 0x7f41f0073180 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00b4b60 con 0x7f41f0145ed0 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41f0146430 con 0x7f41f00b5f90 2024-09-10T08:37:36.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56866/0 (socket says 172.21.15.52:56866) 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 -- 172.21.15.52:0/1268264943 learned_addr learned my addr 172.21.15.52:0/1268264943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41e7400640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 0x7f41f00cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41f5200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 0x7f41f00cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 -- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 msgr2=0x7f41f00cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 0x7f41f00cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 -- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 msgr2=0x7f41f00cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 0x7f41f00cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.454+0000 7f41efe00640 1 -- 172.21.15.52:0/1268264943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f01e1ae0 con 0x7f41f0073180 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41e7400640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 0x7f41f00cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41f5200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 0x7f41f00cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:36.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41efe00640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f41e00090b0 tx=0x7f41e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0043070 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e0038040 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0037050 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f01e1d80 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.455+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f01e2340 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.456+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f00c5db0 con 0x7f41f0073180 2024-09-10T08:37:36.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.457+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41e003cb90 con 0x7f41f0073180 2024-09-10T08:37:36.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.458+0000 7f41ecc00640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 0x7f41cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.458+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f41e00aaeb0 con 0x7f41f0073180 2024-09-10T08:37:36.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.459+0000 7f41e7400640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 0x7f41cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.459+0000 7f41e7400640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 0x7f41cc06e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f41f015b640 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.463+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41f00c5db0 con 0x7f41f0073180 2024-09-10T08:37:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.684+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41f00735c0 con 0x7f41f0073180 2024-09-10T08:37:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.685+0000 7f41ecc00640 1 -- 172.21.15.52:0/1268264943 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7f41e00797c0 con 0x7f41f0073180 2024-09-10T08:37:36.686 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:36.686 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:37:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 msgr2=0x7f41cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 0x7f41cc06e320 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f41f015b640 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 msgr2=0x7f41f013d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f41e00090b0 tx=0x7f41e00046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 shutdown_connections 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41cc06be60 0x7f41cc06e320 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41f0145ed0 0x7f41f00cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41f00b5f90 0x7f41f00cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 --2- 172.21.15.52:0/1268264943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41f0073180 0x7f41f013d000 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.687+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 >> 172.21.15.52:0/1268264943 conn(0x7f41f00ccec0 msgr2=0x7f41f0144610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.688+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 shutdown_connections 2024-09-10T08:37:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.688+0000 7f41f7200640 1 -- 172.21.15.52:0/1268264943 wait complete. 2024-09-10T08:37:36.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:37:36.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.859+0000 7f4ce0a00640 1 Processor -- start 2024-09-10T08:37:36.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.859+0000 7f4ce0a00640 1 -- start start 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc06c6a0 0x7f4cdc0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4ce0a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cdc071010 con 0x7f4cdc15af20 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4ce0a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cdc0712f0 con 0x7f4cdc15ab40 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4ce0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc06cb10 con 0x7f4cdc06c6a0 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4cda800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4cdc15af20 0x7f4cdc15b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60982/0 (socket says 172.21.15.52:60982) 2024-09-10T08:37:36.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4cda800640 1 -- 172.21.15.52:0/860274990 learned_addr learned my addr 172.21.15.52:0/860274990 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:36.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc06c6a0 0x7f4cdc0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184267814 0 0) 0x7f4cdc071010 con 0x7f4cdc15af20 2024-09-10T08:37:36.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.861+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc0003520 con 0x7f4cdc15af20 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374472734 0 0) 0x7f4cdc0712f0 con 0x7f4cdc15ab40 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cdc071010 con 0x7f4cdc15ab40 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2504163292 0 0) 0x7f4cc0003520 con 0x7f4cdc15af20 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc06c6a0 msgr2=0x7f4cdc0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc06c6a0 0x7f4cdc0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 >> v1:172.21.15.176:6789/0 conn(0x7f4cdc15ab40 legacy=0x7f4cdc073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc0715d0 con 0x7f4cdc15af20 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f4cd4001a10 con 0x7f4cdc15af20 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 >> v1:172.21.15.52:6789/0 conn(0x7f4cdc15af20 legacy=0x7f4cdc15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc0003b70 0x7f4cc0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc0004800 0x7f4cc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc00051c0 0x7f4cc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc000c000 con 0x7f4cc00051c0 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc000e3c0 con 0x7f4cc0004800 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc000e5c0 con 0x7f4cc0003b70 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cda800640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc00051c0 0x7f4cc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc0004800 0x7f4cc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.862+0000 7f4cd9e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc0003b70 0x7f4cc0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cd3e00640 1 -- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc0003b70 msgr2=0x7f4cc0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cc0003b70 0x7f4cc0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cd3e00640 1 -- 172.21.15.52:0/860274990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc00051c0 msgr2=0x7f4cc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc00051c0 0x7f4cc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cd3e00640 1 -- 172.21.15.52:0/860274990 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc0003520 con 0x7f4cc0004800 2024-09-10T08:37:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.863+0000 7f4cda800640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc00051c0 0x7f4cc000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.864+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc0004800 0x7f4cc0004c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400a940 tx=0x7f4cc0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaeb2a17be893cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.864+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4036070 con 0x7f4cc0004800 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.864+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc4031600 con 0x7f4cc0004800 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.864+0000 7f4cd9400640 1 -- 172.21.15.52:0/860274990 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400b040 con 0x7f4cc0004800 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 -- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc0004800 msgr2=0x7f4cc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/860274990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cc0004800 0x7f4cc0004c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400a940 tx=0x7f4cc0005830 comp rx=0 tx=0).stop 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4cda800640 1 -- 172.21.15.52:0/860274990 reap_dead start 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 -- 172.21.15.52:0/860274990 shutdown_connections 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 -- 172.21.15.52:0/860274990 >> 172.21.15.52:0/860274990 conn(0x7f4cdc0ccec0 msgr2=0x7f4cdc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 -- 172.21.15.52:0/860274990 shutdown_connections 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.865+0000 7f4ce0a00640 1 -- 172.21.15.52:0/860274990 wait complete. 2024-09-10T08:37:36.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.866+0000 7f4ce0a00640 1 Processor -- start 2024-09-10T08:37:36.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 -- start start 2024-09-10T08:37:36.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc152910 0x7f4cdc152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cdc1f3a80 0x7f4cdc1f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0720b0 con 0x7f4cc0004800 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc15baa0 con 0x7f4cdc1f3a80 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.867+0000 7f4ce0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc072230 con 0x7f4cdc152910 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56894/0 (socket says 172.21.15.52:56894) 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 -- 172.21.15.52:0/3042564448 learned_addr learned my addr 172.21.15.52:0/3042564448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cda800640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cdc1f3a80 0x7f4cdc1f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc152910 0x7f4cdc152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 -- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc152910 msgr2=0x7f4cdc152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc152910 0x7f4cdc152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 -- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cdc1f3a80 msgr2=0x7f4cdc1f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cdc1f3a80 0x7f4cdc1f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:36.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 -- 172.21.15.52:0/3042564448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1f0180 con 0x7f4cc0004800 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd9e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00f7a0 tx=0x7f4ccc00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.868+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc01a070 con 0x7f4cc0004800 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.869+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc00fe50 con 0x7f4cc0004800 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.869+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc007050 con 0x7f4cc0004800 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.869+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc1f0440 con 0x7f4cc0004800 2024-09-10T08:37:36.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.869+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc1f0a00 con 0x7f4cc0004800 2024-09-10T08:37:36.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.870+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc06f820 con 0x7f4cc0004800 2024-09-10T08:37:36.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.871+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ccc01d070 con 0x7f4cc0004800 2024-09-10T08:37:36.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.871+0000 7f4cd2000640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 0x7f4cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:36.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.872+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f4ccc08a660 con 0x7f4cc0004800 2024-09-10T08:37:36.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.872+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 0x7f4cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:36.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.873+0000 7f4cd3e00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 0x7f4cb806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4033000 tx=0x7f4cc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:36.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:36.876+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cdc06f820 con 0x7f4cc0004800 2024-09-10T08:37:37.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.060+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cdc072c90 con 0x7f4cc0004800 2024-09-10T08:37:37.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.061+0000 7f4cd2000640 1 -- 172.21.15.52:0/3042564448 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16699 (secure 0 0 0) 0x7f4ccc059000 con 0x7f4cc0004800 2024-09-10T08:37:37.062 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:37.062 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:34.250934+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:37:30.466692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T08:37:31.666587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:37:37.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 msgr2=0x7f4cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 0x7f4cb806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4033000 tx=0x7f4cc4008030 comp rx=0 tx=0).stop 2024-09-10T08:37:37.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 msgr2=0x7f4cdc155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00f7a0 tx=0x7f4ccc00fc60 comp rx=0 tx=0).stop 2024-09-10T08:37:37.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 shutdown_connections 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cb806be30 0x7f4cb806e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4cdc1f3a80 0x7f4cdc1f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4cdc152910 0x7f4cdc152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 --2- 172.21.15.52:0/3042564448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc0004800 0x7f4cdc155940 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.063+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 >> 172.21.15.52:0/3042564448 conn(0x7f4cdc0ccec0 msgr2=0x7f4cdc06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.064+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 shutdown_connections 2024-09-10T08:37:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.064+0000 7f4ce0a00640 1 -- 172.21.15.52:0/3042564448 wait complete. 2024-09-10T08:37:37.081 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:37:37.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:37:37.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.235+0000 7fcbb0800640 1 Processor -- start 2024-09-10T08:37:37.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.235+0000 7fcbb0800640 1 -- start start 2024-09-10T08:37:37.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.236+0000 7fcbb0800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcba80b2d40 0x7fcba806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.236+0000 7fcbb0800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 0x7fcba806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.236+0000 7fcbb0800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcba815bcf0 0x7fcba815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.236+0000 7fcbb0800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcba8071ab0 con 0x7fcba80b2d40 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbb0800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcba8071180 con 0x7fcba815bcf0 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbb0800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcba8071460 con 0x7fcba813eb20 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcba80b2d40 0x7fcba806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcba80b2d40 0x7fcba806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56910/0 (socket says 172.21.15.52:56910) 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 -- 172.21.15.52:0/1792871046 learned_addr learned my addr 172.21.15.52:0/1792871046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbae800640 1 --2- 172.21.15.52:0/1792871046 >> v2:172.21.15.176:3300/0 conn(0x7fcba815bcf0 0x7fcba815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbad400640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 0x7fcba806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 -- 172.21.15.52:0/1792871046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 msgr2=0x7fcba806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:37.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 0x7fcba806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 -- 172.21.15.52:0/1792871046 >> v2:172.21.15.176:3300/0 conn(0x7fcba815bcf0 msgr2=0x7fcba815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:37.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 --2- 172.21.15.52:0/1792871046 >> v2:172.21.15.176:3300/0 conn(0x7fcba815bcf0 0x7fcba815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbade00640 1 -- 172.21.15.52:0/1792871046 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba8071740 con 0x7fcba80b2d40 2024-09-10T08:37:37.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.237+0000 7fcbad400640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 0x7fcba806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.238+0000 7fcbade00640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba806bc10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fcba81595c0 tx=0x7fcb9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a46864c2f1c5438 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbaca00640 1 -- 172.21.15.52:0/1792871046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c037070 con 0x7fcba80b2d40 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbaca00640 1 -- 172.21.15.52:0/1792871046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c032440 con 0x7fcba80b2d40 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbaca00640 1 -- 172.21.15.52:0/1792871046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c032810 con 0x7fcba80b2d40 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 -- 172.21.15.52:0/1792871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 msgr2=0x7fcba806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba806bc10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fcba81595c0 tx=0x7fcb9c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 -- 172.21.15.52:0/1792871046 shutdown_connections 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1792871046 >> v2:172.21.15.176:3300/0 conn(0x7fcba815bcf0 0x7fcba815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba813eb20 0x7fcba806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1792871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba806bc10 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 -- 172.21.15.52:0/1792871046 >> 172.21.15.52:0/1792871046 conn(0x7fcba80ccec0 msgr2=0x7fcba80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 -- 172.21.15.52:0/1792871046 shutdown_connections 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.239+0000 7fcbb0800640 1 -- 172.21.15.52:0/1792871046 wait complete. 2024-09-10T08:37:37.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.241+0000 7fcbb0800640 1 Processor -- start 2024-09-10T08:37:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.241+0000 7fcbb0800640 1 -- start start 2024-09-10T08:37:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba813eb20 0x7fcba8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 0x7fcba8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcba815f140 con 0x7fcba80b2d40 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcba815efc0 con 0x7fcba813eb20 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbb0800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcba815f2c0 con 0x7fcba815bcf0 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbade00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbade00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56924/0 (socket says 172.21.15.52:56924) 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbade00640 1 -- 172.21.15.52:0/1837742621 learned_addr learned my addr 172.21.15.52:0/1837742621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbad400640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba813eb20 0x7fcba8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.242+0000 7fcbae800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 0x7fcba8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 -- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 msgr2=0x7fcba8156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 0x7fcba8156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 -- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba813eb20 msgr2=0x7fcba8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba813eb20 0x7fcba8155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 -- 172.21.15.52:0/1837742621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba80b5730 con 0x7fcba80b2d40 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbae800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 0x7fcba8156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbade00640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c037040 con 0x7fcba80b2d40 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c042070 con 0x7fcba80b2d40 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c030880 con 0x7fcba80b2d40 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba80ca210 con 0x7fcba80b2d40 2024-09-10T08:37:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.243+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba80c9f00 con 0x7fcba80b2d40 2024-09-10T08:37:37.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:37.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.244+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba815c1a0 con 0x7fcba80b2d40 2024-09-10T08:37:37.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.245+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb9c030a20 con 0x7fcba80b2d40 2024-09-10T08:37:37.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.246+0000 7fcba2000640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.246+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fcb9c0ab760 con 0x7fcba80b2d40 2024-09-10T08:37:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.246+0000 7fcbad400640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.247+0000 7fcbad400640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcb98006fd0 tx=0x7fcb98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.250 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:37:37.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.251+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb9c07a100 con 0x7fcba80b2d40 2024-09-10T08:37:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.434+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcba806c9c0 con 0x7fcb8c06be30 2024-09-10T08:37:37.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.442+0000 7fcba2000640 1 -- 172.21.15.52:0/1837742621 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252450 (secure 0 0 0) 0x7fcba806c9c0 con 0x7fcb8c06be30 2024-09-10T08:37:37.445 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:37.446 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 msgr2=0x7fcb8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcb98006fd0 tx=0x7fcb98008040 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 msgr2=0x7fcba8154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 shutdown_connections 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb8c06be30 0x7fcb8c06e2f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcba815bcf0 0x7fcba8156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcba813eb20 0x7fcba8155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 --2- 172.21.15.52:0/1837742621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcba80b2d40 0x7fcba8154e80 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 >> 172.21.15.52:0/1837742621 conn(0x7fcba80ccec0 msgr2=0x7fcba80cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:37.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 shutdown_connections 2024-09-10T08:37:37.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.445+0000 7fcbb0800640 1 -- 172.21.15.52:0/1837742621 wait complete. 2024-09-10T08:37:37.461 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-10T08:37:35.586512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397008,"kb_used_data":14240,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754577712,"statfs":{"total":773094113280,"available":772687577088,"internally_reserved":0,"allocated":14581760,"data_stored":7028284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":391761456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.356656"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260570+0000","last_change":"2024-09-10T08:37:33.254947+0000","last_active":"2024-09-10T08:37:33.260570+0000","last_peered":"2024-09-10T08:37:33.260570+0000","last_clean":"2024-09-10T08:37:33.260570+0000","last_became_active":"2024-09-10T08:37:33.254659+0000","last_became_peered":"2024-09-10T08:37:33.254659+0000","last_unstale":"2024-09-10T08:37:33.260570+0000","last_undegraded":"2024-09-10T08:37:33.260570+0000","last_fullsized":"2024-09-10T08:37:33.260570+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:30.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271548+0000","last_change":"2024-09-10T08:37:33.267706+0000","last_active":"2024-09-10T08:37:33.271548+0000","last_peered":"2024-09-10T08:37:33.271548+0000","last_clean":"2024-09-10T08:37:33.271548+0000","last_became_active":"2024-09-10T08:37:33.266676+0000","last_became_peered":"2024-09-10T08:37:33.266676+0000","last_unstale":"2024-09-10T08:37:33.271548+0000","last_undegraded":"2024-09-10T08:37:33.271548+0000","last_fullsized":"2024-09-10T08:37:33.271548+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:00.965250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259212+0000","last_change":"2024-09-10T08:37:33.280358+0000","last_active":"2024-09-10T08:37:34.259212+0000","last_peered":"2024-09-10T08:37:34.259212+0000","last_clean":"2024-09-10T08:37:34.259212+0000","last_became_active":"2024-09-10T08:37:33.279168+0000","last_became_peered":"2024-09-10T08:37:33.279168+0000","last_unstale":"2024-09-10T08:37:34.259212+0000","last_undegraded":"2024-09-10T08:37:34.259212+0000","last_fullsized":"2024-09-10T08:37:34.259212+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:04.779057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.280874+0000","last_change":"2024-09-10T08:37:33.280076+0000","last_active":"2024-09-10T08:37:33.280874+0000","last_peered":"2024-09-10T08:37:33.280874+0000","last_clean":"2024-09-10T08:37:33.280874+0000","last_became_active":"2024-09-10T08:37:33.279709+0000","last_became_peered":"2024-09-10T08:37:33.279709+0000","last_unstale":"2024-09-10T08:37:33.280874+0000","last_undegraded":"2024-09-10T08:37:33.280874+0000","last_fullsized":"2024-09-10T08:37:33.280874+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:27.028397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278997+0000","last_change":"2024-09-10T08:37:33.275430+0000","last_active":"2024-09-10T08:37:33.278997+0000","last_peered":"2024-09-10T08:37:33.278997+0000","last_clean":"2024-09-10T08:37:33.278997+0000","last_became_active":"2024-09-10T08:37:33.275180+0000","last_became_peered":"2024-09-10T08:37:33.275180+0000","last_unstale":"2024-09-10T08:37:33.278997+0000","last_undegraded":"2024-09-10T08:37:33.278997+0000","last_fullsized":"2024-09-10T08:37:33.278997+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:46.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258383+0000","last_change":"2024-09-10T08:37:33.254259+0000","last_active":"2024-09-10T08:37:34.258383+0000","last_peered":"2024-09-10T08:37:34.258383+0000","last_clean":"2024-09-10T08:37:34.258383+0000","last_became_active":"2024-09-10T08:37:33.253951+0000","last_became_peered":"2024-09-10T08:37:33.253951+0000","last_unstale":"2024-09-10T08:37:34.258383+0000","last_undegraded":"2024-09-10T08:37:34.258383+0000","last_fullsized":"2024-09-10T08:37:34.258383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:54.919079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.267329+0000","last_change":"2024-09-10T08:37:33.261050+0000","last_active":"2024-09-10T08:37:33.267329+0000","last_peered":"2024-09-10T08:37:33.267329+0000","last_clean":"2024-09-10T08:37:33.267329+0000","last_became_active":"2024-09-10T08:37:33.260781+0000","last_became_peered":"2024-09-10T08:37:33.260781+0000","last_unstale":"2024-09-10T08:37:33.267329+0000","last_undegraded":"2024-09-10T08:37:33.267329+0000","last_fullsized":"2024-09-10T08:37:33.267329+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:38.646358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278698+0000","last_change":"2024-09-10T08:37:33.272316+0000","last_active":"2024-09-10T08:37:33.278698+0000","last_peered":"2024-09-10T08:37:33.278698+0000","last_clean":"2024-09-10T08:37:33.278698+0000","last_became_active":"2024-09-10T08:37:33.272004+0000","last_became_peered":"2024-09-10T08:37:33.272004+0000","last_unstale":"2024-09-10T08:37:33.278698+0000","last_undegraded":"2024-09-10T08:37:33.278698+0000","last_fullsized":"2024-09-10T08:37:33.278698+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:08.206710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260313+0000","last_change":"2024-09-10T08:37:33.256835+0000","last_active":"2024-09-10T08:37:34.260313+0000","last_peered":"2024-09-10T08:37:34.260313+0000","last_clean":"2024-09-10T08:37:34.260313+0000","last_became_active":"2024-09-10T08:37:33.256476+0000","last_became_peered":"2024-09-10T08:37:33.256476+0000","last_unstale":"2024-09-10T08:37:34.260313+0000","last_undegraded":"2024-09-10T08:37:34.260313+0000","last_fullsized":"2024-09-10T08:37:34.260313+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:32.780942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260079+0000","last_change":"2024-09-10T08:37:33.255604+0000","last_active":"2024-09-10T08:37:33.260079+0000","last_peered":"2024-09-10T08:37:33.260079+0000","last_clean":"2024-09-10T08:37:33.260079+0000","last_became_active":"2024-09-10T08:37:33.254988+0000","last_became_peered":"2024-09-10T08:37:33.254988+0000","last_unstale":"2024-09-10T08:37:33.260079+0000","last_undegraded":"2024-09-10T08:37:33.260079+0000","last_fullsized":"2024-09-10T08:37:33.260079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:56.611017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.266959+0000","last_change":"2024-09-10T08:37:33.264734+0000","last_active":"2024-09-10T08:37:33.266959+0000","last_peered":"2024-09-10T08:37:33.266959+0000","last_clean":"2024-09-10T08:37:33.266959+0000","last_became_active":"2024-09-10T08:37:33.263370+0000","last_became_peered":"2024-09-10T08:37:33.263370+0000","last_unstale":"2024-09-10T08:37:33.266959+0000","last_undegraded":"2024-09-10T08:37:33.266959+0000","last_fullsized":"2024-09-10T08:37:33.266959+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:07.917331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259625+0000","last_change":"2024-09-10T08:37:33.282494+0000","last_active":"2024-09-10T08:37:34.259625+0000","last_peered":"2024-09-10T08:37:34.259625+0000","last_clean":"2024-09-10T08:37:34.259625+0000","last_became_active":"2024-09-10T08:37:33.277824+0000","last_became_peered":"2024-09-10T08:37:33.277824+0000","last_unstale":"2024-09-10T08:37:34.259625+0000","last_undegraded":"2024-09-10T08:37:34.259625+0000","last_fullsized":"2024-09-10T08:37:34.259625+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:40.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.275727+0000","last_change":"2024-09-10T08:37:33.275190+0000","last_active":"2024-09-10T08:37:33.275727+0000","last_peered":"2024-09-10T08:37:33.275727+0000","last_clean":"2024-09-10T08:37:33.275727+0000","last_became_active":"2024-09-10T08:37:33.274717+0000","last_became_peered":"2024-09-10T08:37:33.274717+0000","last_unstale":"2024-09-10T08:37:33.275727+0000","last_undegraded":"2024-09-10T08:37:33.275727+0000","last_fullsized":"2024-09-10T08:37:33.275727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:57.370409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590123+0000","last_change":"2024-09-10T08:37:33.274456+0000","last_active":"2024-09-10T08:37:34.590123+0000","last_peered":"2024-09-10T08:37:34.590123+0000","last_clean":"2024-09-10T08:37:34.590123+0000","last_became_active":"2024-09-10T08:37:33.274135+0000","last_became_peered":"2024-09-10T08:37:33.274135+0000","last_unstale":"2024-09-10T08:37:34.590123+0000","last_undegraded":"2024-09-10T08:37:34.590123+0000","last_fullsized":"2024-09-10T08:37:34.590123+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.764741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259447+0000","last_change":"2024-09-10T08:37:33.272363+0000","last_active":"2024-09-10T08:37:34.259447+0000","last_peered":"2024-09-10T08:37:34.259447+0000","last_clean":"2024-09-10T08:37:34.259447+0000","last_became_active":"2024-09-10T08:37:33.271666+0000","last_became_peered":"2024-09-10T08:37:33.271666+0000","last_unstale":"2024-09-10T08:37:34.259447+0000","last_undegraded":"2024-09-10T08:37:34.259447+0000","last_fullsized":"2024-09-10T08:37:34.259447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:29.381643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590184+0000","last_change":"2024-09-10T08:37:33.274907+0000","last_active":"2024-09-10T08:37:34.590184+0000","last_peered":"2024-09-10T08:37:34.590184+0000","last_clean":"2024-09-10T08:37:34.590184+0000","last_became_active":"2024-09-10T08:37:33.274602+0000","last_became_peered":"2024-09-10T08:37:33.274602+0000","last_unstale":"2024-09-10T08:37:34.590184+0000","last_undegraded":"2024-09-10T08:37:34.590184+0000","last_fullsized":"2024-09-10T08:37:34.590184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:01.591096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260474+0000","last_change":"2024-09-10T08:37:33.265056+0000","last_active":"2024-09-10T08:37:34.260474+0000","last_peered":"2024-09-10T08:37:34.260474+0000","last_clean":"2024-09-10T08:37:34.260474+0000","last_became_active":"2024-09-10T08:37:33.264348+0000","last_became_peered":"2024-09-10T08:37:33.264348+0000","last_unstale":"2024-09-10T08:37:34.260474+0000","last_undegraded":"2024-09-10T08:37:34.260474+0000","last_fullsized":"2024-09-10T08:37:34.260474+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:57.721764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259630+0000","last_change":"2024-09-10T08:37:33.261483+0000","last_active":"2024-09-10T08:37:34.259630+0000","last_peered":"2024-09-10T08:37:34.259630+0000","last_clean":"2024-09-10T08:37:34.259630+0000","last_became_active":"2024-09-10T08:37:33.261205+0000","last_became_peered":"2024-09-10T08:37:33.261205+0000","last_unstale":"2024-09-10T08:37:34.259630+0000","last_undegraded":"2024-09-10T08:37:34.259630+0000","last_fullsized":"2024-09-10T08:37:34.259630+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:38.874782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.266310+0000","last_change":"2024-09-10T08:37:33.262147+0000","last_active":"2024-09-10T08:37:33.266310+0000","last_peered":"2024-09-10T08:37:33.266310+0000","last_clean":"2024-09-10T08:37:33.266310+0000","last_became_active":"2024-09-10T08:37:33.261881+0000","last_became_peered":"2024-09-10T08:37:33.261881+0000","last_unstale":"2024-09-10T08:37:33.266310+0000","last_undegraded":"2024-09-10T08:37:33.266310+0000","last_fullsized":"2024-09-10T08:37:33.266310+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.256126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259993+0000","last_change":"2024-09-10T08:37:33.259069+0000","last_active":"2024-09-10T08:37:34.259993+0000","last_peered":"2024-09-10T08:37:34.259993+0000","last_clean":"2024-09-10T08:37:34.259993+0000","last_became_active":"2024-09-10T08:37:33.257960+0000","last_became_peered":"2024-09-10T08:37:33.257960+0000","last_unstale":"2024-09-10T08:37:34.259993+0000","last_undegraded":"2024-09-10T08:37:34.259993+0000","last_fullsized":"2024-09-10T08:37:34.259993+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:34.420728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258636+0000","last_change":"2024-09-10T08:37:33.263857+0000","last_active":"2024-09-10T08:37:34.258636+0000","last_peered":"2024-09-10T08:37:34.258636+0000","last_clean":"2024-09-10T08:37:34.258636+0000","last_became_active":"2024-09-10T08:37:33.262987+0000","last_became_peered":"2024-09-10T08:37:33.262987+0000","last_unstale":"2024-09-10T08:37:34.258636+0000","last_undegraded":"2024-09-10T08:37:34.258636+0000","last_fullsized":"2024-09-10T08:37:34.258636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:08.206710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.261855+0000","last_change":"2024-09-10T08:37:33.259252+0000","last_active":"2024-09-10T08:37:33.261855+0000","last_peered":"2024-09-10T08:37:33.261855+0000","last_clean":"2024-09-10T08:37:33.261855+0000","last_became_active":"2024-09-10T08:37:33.258938+0000","last_became_peered":"2024-09-10T08:37:33.258938+0000","last_unstale":"2024-09-10T08:37:33.261855+0000","last_undegraded":"2024-09-10T08:37:33.261855+0000","last_fullsized":"2024-09-10T08:37:33.261855+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:11.106144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.281925+0000","last_change":"2024-09-10T08:37:33.279934+0000","last_active":"2024-09-10T08:37:33.281925+0000","last_peered":"2024-09-10T08:37:33.281925+0000","last_clean":"2024-09-10T08:37:33.281925+0000","last_became_active":"2024-09-10T08:37:33.278908+0000","last_became_peered":"2024-09-10T08:37:33.278908+0000","last_unstale":"2024-09-10T08:37:33.281925+0000","last_undegraded":"2024-09-10T08:37:33.281925+0000","last_fullsized":"2024-09-10T08:37:33.281925+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:29.181117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259320+0000","last_change":"2024-09-10T08:37:33.259837+0000","last_active":"2024-09-10T08:37:34.259320+0000","last_peered":"2024-09-10T08:37:34.259320+0000","last_clean":"2024-09-10T08:37:34.259320+0000","last_became_active":"2024-09-10T08:37:33.254721+0000","last_became_peered":"2024-09-10T08:37:33.254721+0000","last_unstale":"2024-09-10T08:37:34.259320+0000","last_undegraded":"2024-09-10T08:37:34.259320+0000","last_fullsized":"2024-09-10T08:37:34.259320+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:36.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.280659+0000","last_change":"2024-09-10T08:37:33.279941+0000","last_active":"2024-09-10T08:37:33.280659+0000","last_peered":"2024-09-10T08:37:33.280659+0000","last_clean":"2024-09-10T08:37:33.280659+0000","last_became_active":"2024-09-10T08:37:33.279606+0000","last_became_peered":"2024-09-10T08:37:33.279606+0000","last_unstale":"2024-09-10T08:37:33.280659+0000","last_undegraded":"2024-09-10T08:37:33.280659+0000","last_fullsized":"2024-09-10T08:37:33.280659+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:39.949858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.264091+0000","last_change":"2024-09-10T08:37:33.261077+0000","last_active":"2024-09-10T08:37:33.264091+0000","last_peered":"2024-09-10T08:37:33.264091+0000","last_clean":"2024-09-10T08:37:33.264091+0000","last_became_active":"2024-09-10T08:37:33.258671+0000","last_became_peered":"2024-09-10T08:37:33.258671+0000","last_unstale":"2024-09-10T08:37:33.264091+0000","last_undegraded":"2024-09-10T08:37:33.264091+0000","last_fullsized":"2024-09-10T08:37:33.264091+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:35.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590460+0000","last_change":"2024-09-10T08:37:33.276160+0000","last_active":"2024-09-10T08:37:34.590460+0000","last_peered":"2024-09-10T08:37:34.590460+0000","last_clean":"2024-09-10T08:37:34.590460+0000","last_became_active":"2024-09-10T08:37:33.275802+0000","last_became_peered":"2024-09-10T08:37:33.275802+0000","last_unstale":"2024-09-10T08:37:34.590460+0000","last_undegraded":"2024-09-10T08:37:34.590460+0000","last_fullsized":"2024-09-10T08:37:34.590460+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:00.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279524+0000","last_change":"2024-09-10T08:37:33.274305+0000","last_active":"2024-09-10T08:37:33.279524+0000","last_peered":"2024-09-10T08:37:33.279524+0000","last_clean":"2024-09-10T08:37:33.279524+0000","last_became_active":"2024-09-10T08:37:33.272760+0000","last_became_peered":"2024-09-10T08:37:33.272760+0000","last_unstale":"2024-09-10T08:37:33.279524+0000","last_undegraded":"2024-09-10T08:37:33.279524+0000","last_fullsized":"2024-09-10T08:37:33.279524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:27.933674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.267833+0000","last_change":"2024-09-10T08:37:33.262159+0000","last_active":"2024-09-10T08:37:33.267833+0000","last_peered":"2024-09-10T08:37:33.267833+0000","last_clean":"2024-09-10T08:37:33.267833+0000","last_became_active":"2024-09-10T08:37:33.260932+0000","last_became_peered":"2024-09-10T08:37:33.260932+0000","last_unstale":"2024-09-10T08:37:33.267833+0000","last_undegraded":"2024-09-10T08:37:33.267833+0000","last_fullsized":"2024-09-10T08:37:33.267833+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:30.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271632+0000","last_change":"2024-09-10T08:37:33.268380+0000","last_active":"2024-09-10T08:37:33.271632+0000","last_peered":"2024-09-10T08:37:33.271632+0000","last_clean":"2024-09-10T08:37:33.271632+0000","last_became_active":"2024-09-10T08:37:33.266593+0000","last_became_peered":"2024-09-10T08:37:33.266593+0000","last_unstale":"2024-09-10T08:37:33.271632+0000","last_undegraded":"2024-09-10T08:37:33.271632+0000","last_fullsized":"2024-09-10T08:37:33.271632+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:48.958311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279736+0000","last_change":"2024-09-10T08:37:33.274344+0000","last_active":"2024-09-10T08:37:33.279736+0000","last_peered":"2024-09-10T08:37:33.279736+0000","last_clean":"2024-09-10T08:37:33.279736+0000","last_became_active":"2024-09-10T08:37:33.274050+0000","last_became_peered":"2024-09-10T08:37:33.274050+0000","last_unstale":"2024-09-10T08:37:33.279736+0000","last_undegraded":"2024-09-10T08:37:33.279736+0000","last_fullsized":"2024-09-10T08:37:33.279736+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:31.718569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260350+0000","last_change":"2024-09-10T08:37:33.259282+0000","last_active":"2024-09-10T08:37:34.260350+0000","last_peered":"2024-09-10T08:37:34.260350+0000","last_clean":"2024-09-10T08:37:34.260350+0000","last_became_active":"2024-09-10T08:37:33.256713+0000","last_became_peered":"2024-09-10T08:37:33.256713+0000","last_unstale":"2024-09-10T08:37:34.260350+0000","last_undegraded":"2024-09-10T08:37:34.260350+0000","last_fullsized":"2024-09-10T08:37:34.260350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:01.668636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590463+0000","last_change":"2024-09-10T08:37:33.273524+0000","last_active":"2024-09-10T08:37:34.590463+0000","last_peered":"2024-09-10T08:37:34.590463+0000","last_clean":"2024-09-10T08:37:34.590463+0000","last_became_active":"2024-09-10T08:37:33.269889+0000","last_became_peered":"2024-09-10T08:37:33.269889+0000","last_unstale":"2024-09-10T08:37:34.590463+0000","last_undegraded":"2024-09-10T08:37:34.590463+0000","last_fullsized":"2024-09-10T08:37:34.590463+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:23.654656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"134'4","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.277827+0000","last_change":"2024-09-10T08:37:32.256706+0000","last_active":"2024-09-10T08:37:33.277827+0000","last_peered":"2024-09-10T08:37:33.277827+0000","last_clean":"2024-09-10T08:37:33.277827+0000","last_became_active":"2024-09-10T08:37:32.256506+0000","last_became_peered":"2024-09-10T08:37:32.256506+0000","last_unstale":"2024-09-10T08:37:33.277827+0000","last_undegraded":"2024-09-10T08:37:33.277827+0000","last_fullsized":"2024-09-10T08:37:33.277827+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:58.444625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260416+0000","last_change":"2024-09-10T08:37:33.265295+0000","last_active":"2024-09-10T08:37:34.260416+0000","last_peered":"2024-09-10T08:37:34.260416+0000","last_clean":"2024-09-10T08:37:34.260416+0000","last_became_active":"2024-09-10T08:37:33.264746+0000","last_became_peered":"2024-09-10T08:37:33.264746+0000","last_unstale":"2024-09-10T08:37:34.260416+0000","last_undegraded":"2024-09-10T08:37:34.260416+0000","last_fullsized":"2024-09-10T08:37:34.260416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:27.698517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259263+0000","last_change":"2024-09-10T08:37:32.264530+0000","last_active":"2024-09-10T08:37:34.259263+0000","last_peered":"2024-09-10T08:37:34.259263+0000","last_clean":"2024-09-10T08:37:34.259263+0000","last_became_active":"2024-09-10T08:37:32.264023+0000","last_became_peered":"2024-09-10T08:37:32.264023+0000","last_unstale":"2024-09-10T08:37:34.259263+0000","last_undegraded":"2024-09-10T08:37:34.259263+0000","last_fullsized":"2024-09-10T08:37:34.259263+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:31.542153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259791+0000","last_change":"2024-09-10T08:37:33.274966+0000","last_active":"2024-09-10T08:37:34.259791+0000","last_peered":"2024-09-10T08:37:34.259791+0000","last_clean":"2024-09-10T08:37:34.259791+0000","last_became_active":"2024-09-10T08:37:33.274681+0000","last_became_peered":"2024-09-10T08:37:33.274681+0000","last_unstale":"2024-09-10T08:37:34.259791+0000","last_undegraded":"2024-09-10T08:37:34.259791+0000","last_fullsized":"2024-09-10T08:37:34.259791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:17.042645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.274497+0000","last_change":"2024-09-10T08:37:32.252856+0000","last_active":"2024-09-10T08:37:33.274497+0000","last_peered":"2024-09-10T08:37:33.274497+0000","last_clean":"2024-09-10T08:37:33.274497+0000","last_became_active":"2024-09-10T08:37:32.251958+0000","last_became_peered":"2024-09-10T08:37:32.251958+0000","last_unstale":"2024-09-10T08:37:33.274497+0000","last_undegraded":"2024-09-10T08:37:33.274497+0000","last_fullsized":"2024-09-10T08:37:33.274497+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:48.004839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260002+0000","last_change":"2024-09-10T08:37:33.262104+0000","last_active":"2024-09-10T08:37:34.260002+0000","last_peered":"2024-09-10T08:37:34.260002+0000","last_clean":"2024-09-10T08:37:34.260002+0000","last_became_active":"2024-09-10T08:37:33.261749+0000","last_became_peered":"2024-09-10T08:37:33.261749+0000","last_unstale":"2024-09-10T08:37:34.260002+0000","last_undegraded":"2024-09-10T08:37:34.260002+0000","last_fullsized":"2024-09-10T08:37:34.260002+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:36.249710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.277728+0000","last_change":"2024-09-10T08:37:32.256860+0000","last_active":"2024-09-10T08:37:33.277728+0000","last_peered":"2024-09-10T08:37:33.277728+0000","last_clean":"2024-09-10T08:37:33.277728+0000","last_became_active":"2024-09-10T08:37:32.256545+0000","last_became_peered":"2024-09-10T08:37:32.256545+0000","last_unstale":"2024-09-10T08:37:33.277728+0000","last_undegraded":"2024-09-10T08:37:33.277728+0000","last_fullsized":"2024-09-10T08:37:33.277728+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:12.950985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259543+0000","last_change":"2024-09-10T08:37:33.266099+0000","last_active":"2024-09-10T08:37:34.259543+0000","last_peered":"2024-09-10T08:37:34.259543+0000","last_clean":"2024-09-10T08:37:34.259543+0000","last_became_active":"2024-09-10T08:37:33.265844+0000","last_became_peered":"2024-09-10T08:37:33.265844+0000","last_unstale":"2024-09-10T08:37:34.259543+0000","last_undegraded":"2024-09-10T08:37:34.259543+0000","last_fullsized":"2024-09-10T08:37:34.259543+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:36.900533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279582+0000","last_change":"2024-09-10T08:37:32.254208+0000","last_active":"2024-09-10T08:37:33.279582+0000","last_peered":"2024-09-10T08:37:33.279582+0000","last_clean":"2024-09-10T08:37:33.279582+0000","last_became_active":"2024-09-10T08:37:32.253902+0000","last_became_peered":"2024-09-10T08:37:32.253902+0000","last_unstale":"2024-09-10T08:37:33.279582+0000","last_undegraded":"2024-09-10T08:37:33.279582+0000","last_fullsized":"2024-09-10T08:37:33.279582+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:24.492773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258747+0000","last_change":"2024-09-10T08:37:33.265849+0000","last_active":"2024-09-10T08:37:34.258747+0000","last_peered":"2024-09-10T08:37:34.258747+0000","last_clean":"2024-09-10T08:37:34.258747+0000","last_became_active":"2024-09-10T08:37:33.263325+0000","last_became_peered":"2024-09-10T08:37:33.263325+0000","last_unstale":"2024-09-10T08:37:34.258747+0000","last_undegraded":"2024-09-10T08:37:34.258747+0000","last_fullsized":"2024-09-10T08:37:34.258747+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:59.485873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259806+0000","last_change":"2024-09-10T08:37:32.259178+0000","last_active":"2024-09-10T08:37:34.259806+0000","last_peered":"2024-09-10T08:37:34.259806+0000","last_clean":"2024-09-10T08:37:34.259806+0000","last_became_active":"2024-09-10T08:37:32.258821+0000","last_became_peered":"2024-09-10T08:37:32.258821+0000","last_unstale":"2024-09-10T08:37:34.259806+0000","last_undegraded":"2024-09-10T08:37:34.259806+0000","last_fullsized":"2024-09-10T08:37:34.259806+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:12.545774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258383+0000","last_change":"2024-09-10T08:37:33.270961+0000","last_active":"2024-09-10T08:37:34.258383+0000","last_peered":"2024-09-10T08:37:34.258383+0000","last_clean":"2024-09-10T08:37:34.258383+0000","last_became_active":"2024-09-10T08:37:33.270511+0000","last_became_peered":"2024-09-10T08:37:33.270511+0000","last_unstale":"2024-09-10T08:37:34.258383+0000","last_undegraded":"2024-09-10T08:37:34.258383+0000","last_fullsized":"2024-09-10T08:37:34.258383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:43.690512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259165+0000","last_change":"2024-09-10T08:37:32.254841+0000","last_active":"2024-09-10T08:37:34.259165+0000","last_peered":"2024-09-10T08:37:34.259165+0000","last_clean":"2024-09-10T08:37:34.259165+0000","last_became_active":"2024-09-10T08:37:32.253231+0000","last_became_peered":"2024-09-10T08:37:32.253231+0000","last_unstale":"2024-09-10T08:37:34.259165+0000","last_undegraded":"2024-09-10T08:37:34.259165+0000","last_fullsized":"2024-09-10T08:37:34.259165+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:02.947892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.273029+0000","last_change":"2024-09-10T08:37:33.269361+0000","last_active":"2024-09-10T08:37:33.273029+0000","last_peered":"2024-09-10T08:37:33.273029+0000","last_clean":"2024-09-10T08:37:33.273029+0000","last_became_active":"2024-09-10T08:37:33.269097+0000","last_became_peered":"2024-09-10T08:37:33.269097+0000","last_unstale":"2024-09-10T08:37:33.273029+0000","last_undegraded":"2024-09-10T08:37:33.273029+0000","last_fullsized":"2024-09-10T08:37:33.273029+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:28.809197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.247530+0000","last_change":"2024-09-10T08:37:32.252841+0000","last_active":"2024-09-10T08:37:33.247530+0000","last_peered":"2024-09-10T08:37:33.247530+0000","last_clean":"2024-09-10T08:37:33.247530+0000","last_became_active":"2024-09-10T08:37:32.252545+0000","last_became_peered":"2024-09-10T08:37:32.252545+0000","last_unstale":"2024-09-10T08:37:33.247530+0000","last_undegraded":"2024-09-10T08:37:33.247530+0000","last_fullsized":"2024-09-10T08:37:33.247530+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:54.567220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.274498+0000","last_change":"2024-09-10T08:37:33.270140+0000","last_active":"2024-09-10T08:37:33.274498+0000","last_peered":"2024-09-10T08:37:33.274498+0000","last_clean":"2024-09-10T08:37:33.274498+0000","last_became_active":"2024-09-10T08:37:33.269876+0000","last_became_peered":"2024-09-10T08:37:33.269876+0000","last_unstale":"2024-09-10T08:37:33.274498+0000","last_undegraded":"2024-09-10T08:37:33.274498+0000","last_fullsized":"2024-09-10T08:37:33.274498+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:23.654656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259795+0000","last_change":"2024-09-10T08:37:32.259103+0000","last_active":"2024-09-10T08:37:34.259795+0000","last_peered":"2024-09-10T08:37:34.259795+0000","last_clean":"2024-09-10T08:37:34.259795+0000","last_became_active":"2024-09-10T08:37:32.258700+0000","last_became_peered":"2024-09-10T08:37:32.258700+0000","last_unstale":"2024-09-10T08:37:34.259795+0000","last_undegraded":"2024-09-10T08:37:34.259795+0000","last_fullsized":"2024-09-10T08:37:34.259795+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:52.488528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279974+0000","last_change":"2024-09-10T08:37:33.276892+0000","last_active":"2024-09-10T08:37:33.279974+0000","last_peered":"2024-09-10T08:37:33.279974+0000","last_clean":"2024-09-10T08:37:33.279974+0000","last_became_active":"2024-09-10T08:37:33.276583+0000","last_became_peered":"2024-09-10T08:37:33.276583+0000","last_unstale":"2024-09-10T08:37:33.279974+0000","last_undegraded":"2024-09-10T08:37:33.279974+0000","last_fullsized":"2024-09-10T08:37:33.279974+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:48.983989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259730+0000","last_change":"2024-09-10T08:37:32.257911+0000","last_active":"2024-09-10T08:37:34.259730+0000","last_peered":"2024-09-10T08:37:34.259730+0000","last_clean":"2024-09-10T08:37:34.259730+0000","last_became_active":"2024-09-10T08:37:32.256588+0000","last_became_peered":"2024-09-10T08:37:32.256588+0000","last_unstale":"2024-09-10T08:37:34.259730+0000","last_undegraded":"2024-09-10T08:37:34.259730+0000","last_fullsized":"2024-09-10T08:37:34.259730+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:15.196846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259727+0000","last_change":"2024-09-10T08:37:33.279073+0000","last_active":"2024-09-10T08:37:34.259727+0000","last_peered":"2024-09-10T08:37:34.259727+0000","last_clean":"2024-09-10T08:37:34.259727+0000","last_became_active":"2024-09-10T08:37:33.277476+0000","last_became_peered":"2024-09-10T08:37:33.277476+0000","last_unstale":"2024-09-10T08:37:34.259727+0000","last_undegraded":"2024-09-10T08:37:34.259727+0000","last_fullsized":"2024-09-10T08:37:34.259727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:37:30.621978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"134'3","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278095+0000","last_change":"2024-09-10T08:37:32.254995+0000","last_active":"2024-09-10T08:37:33.278095+0000","last_peered":"2024-09-10T08:37:33.278095+0000","last_clean":"2024-09-10T08:37:33.278095+0000","last_became_active":"2024-09-10T08:37:32.254723+0000","last_became_peered":"2024-09-10T08:37:32.254723+0000","last_unstale":"2024-09-10T08:37:33.278095+0000","last_undegraded":"2024-09-10T08:37:33.278095+0000","last_fullsized":"2024-09-10T08:37:33.278095+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:53.915909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.283331+0000","last_change":"2024-09-10T08:37:33.282505+0000","last_active":"2024-09-10T08:37:33.283331+0000","last_peered":"2024-09-10T08:37:33.283331+0000","last_clean":"2024-09-10T08:37:33.283331+0000","last_became_active":"2024-09-10T08:37:33.282207+0000","last_became_peered":"2024-09-10T08:37:33.282207+0000","last_unstale":"2024-09-10T08:37:33.283331+0000","last_undegraded":"2024-09-10T08:37:33.283331+0000","last_fullsized":"2024-09-10T08:37:33.283331+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:15.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"134'6","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.286114+0000","last_change":"2024-09-10T08:37:32.265133+0000","last_active":"2024-09-10T08:37:33.286114+0000","last_peered":"2024-09-10T08:37:33.286114+0000","last_clean":"2024-09-10T08:37:33.286114+0000","last_became_active":"2024-09-10T08:37:32.264709+0000","last_became_peered":"2024-09-10T08:37:32.264709+0000","last_unstale":"2024-09-10T08:37:33.286114+0000","last_undegraded":"2024-09-10T08:37:33.286114+0000","last_fullsized":"2024-09-10T08:37:33.286114+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:41.332574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590531+0000","last_change":"2024-09-10T08:37:33.265731+0000","last_active":"2024-09-10T08:37:34.590531+0000","last_peered":"2024-09-10T08:37:34.590531+0000","last_clean":"2024-09-10T08:37:34.590531+0000","last_became_active":"2024-09-10T08:37:33.265463+0000","last_became_peered":"2024-09-10T08:37:33.265463+0000","last_unstale":"2024-09-10T08:37:34.590531+0000","last_undegraded":"2024-09-10T08:37:34.590531+0000","last_fullsized":"2024-09-10T08:37:34.590531+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:52.978761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590098+0000","last_change":"2024-09-10T08:37:32.258146+0000","last_active":"2024-09-10T08:37:34.590098+0000","last_peered":"2024-09-10T08:37:34.590098+0000","last_clean":"2024-09-10T08:37:34.590098+0000","last_became_active":"2024-09-10T08:37:32.256674+0000","last_became_peered":"2024-09-10T08:37:32.256674+0000","last_unstale":"2024-09-10T08:37:34.590098+0000","last_undegraded":"2024-09-10T08:37:34.590098+0000","last_fullsized":"2024-09-10T08:37:34.590098+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:36.944614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590145+0000","last_change":"2024-09-10T08:37:33.267402+0000","last_active":"2024-09-10T08:37:34.590145+0000","last_peered":"2024-09-10T08:37:34.590145+0000","last_clean":"2024-09-10T08:37:34.590145+0000","last_became_active":"2024-09-10T08:37:33.267123+0000","last_became_peered":"2024-09-10T08:37:33.267123+0000","last_unstale":"2024-09-10T08:37:34.590145+0000","last_undegraded":"2024-09-10T08:37:34.590145+0000","last_fullsized":"2024-09-10T08:37:34.590145+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:51.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260279+0000","last_change":"2024-09-10T08:37:32.264213+0000","last_active":"2024-09-10T08:37:33.260279+0000","last_peered":"2024-09-10T08:37:33.260279+0000","last_clean":"2024-09-10T08:37:33.260279+0000","last_became_active":"2024-09-10T08:37:32.263871+0000","last_became_peered":"2024-09-10T08:37:32.263871+0000","last_unstale":"2024-09-10T08:37:33.260279+0000","last_undegraded":"2024-09-10T08:37:33.260279+0000","last_fullsized":"2024-09-10T08:37:33.260279+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:45.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258559+0000","last_change":"2024-09-10T08:37:33.275751+0000","last_active":"2024-09-10T08:37:34.258559+0000","last_peered":"2024-09-10T08:37:34.258559+0000","last_clean":"2024-09-10T08:37:34.258559+0000","last_became_active":"2024-09-10T08:37:33.275392+0000","last_became_peered":"2024-09-10T08:37:33.275392+0000","last_unstale":"2024-09-10T08:37:34.258559+0000","last_undegraded":"2024-09-10T08:37:34.258559+0000","last_fullsized":"2024-09-10T08:37:34.258559+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:38.646358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"134'8","reported_seq":22,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258336+0000","last_change":"2024-09-10T08:37:32.257286+0000","last_active":"2024-09-10T08:37:34.258336+0000","last_peered":"2024-09-10T08:37:34.258336+0000","last_clean":"2024-09-10T08:37:34.258336+0000","last_became_active":"2024-09-10T08:37:32.256962+0000","last_became_peered":"2024-09-10T08:37:32.256962+0000","last_unstale":"2024-09-10T08:37:34.258336+0000","last_undegraded":"2024-09-10T08:37:34.258336+0000","last_fullsized":"2024-09-10T08:37:34.258336+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:08.437185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.263098+0000","last_change":"2024-09-10T08:37:33.259871+0000","last_active":"2024-09-10T08:37:33.263098+0000","last_peered":"2024-09-10T08:37:33.263098+0000","last_clean":"2024-09-10T08:37:33.263098+0000","last_became_active":"2024-09-10T08:37:33.259615+0000","last_became_peered":"2024-09-10T08:37:33.259615+0000","last_unstale":"2024-09-10T08:37:33.263098+0000","last_undegraded":"2024-09-10T08:37:33.263098+0000","last_fullsized":"2024-09-10T08:37:33.263098+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:56.399218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259849+0000","last_change":"2024-09-10T08:37:32.259712+0000","last_active":"2024-09-10T08:37:34.259849+0000","last_peered":"2024-09-10T08:37:34.259849+0000","last_clean":"2024-09-10T08:37:34.259849+0000","last_became_active":"2024-09-10T08:37:32.259362+0000","last_became_peered":"2024-09-10T08:37:32.259362+0000","last_unstale":"2024-09-10T08:37:34.259849+0000","last_undegraded":"2024-09-10T08:37:34.259849+0000","last_fullsized":"2024-09-10T08:37:34.259849+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:35.704859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278737+0000","last_change":"2024-09-10T08:37:33.272685+0000","last_active":"2024-09-10T08:37:33.278737+0000","last_peered":"2024-09-10T08:37:33.278737+0000","last_clean":"2024-09-10T08:37:33.278737+0000","last_became_active":"2024-09-10T08:37:33.271470+0000","last_became_peered":"2024-09-10T08:37:33.271470+0000","last_unstale":"2024-09-10T08:37:33.278737+0000","last_undegraded":"2024-09-10T08:37:33.278737+0000","last_fullsized":"2024-09-10T08:37:33.278737+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:59.485873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279620+0000","last_change":"2024-09-10T08:37:32.257520+0000","last_active":"2024-09-10T08:37:33.279620+0000","last_peered":"2024-09-10T08:37:33.279620+0000","last_clean":"2024-09-10T08:37:33.279620+0000","last_became_active":"2024-09-10T08:37:32.257239+0000","last_became_peered":"2024-09-10T08:37:32.257239+0000","last_unstale":"2024-09-10T08:37:33.279620+0000","last_undegraded":"2024-09-10T08:37:33.279620+0000","last_fullsized":"2024-09-10T08:37:33.279620+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:19.072992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271935+0000","last_change":"2024-09-10T08:37:33.262093+0000","last_active":"2024-09-10T08:37:33.271935+0000","last_peered":"2024-09-10T08:37:33.271935+0000","last_clean":"2024-09-10T08:37:33.271935+0000","last_became_active":"2024-09-10T08:37:33.261804+0000","last_became_peered":"2024-09-10T08:37:33.261804+0000","last_unstale":"2024-09-10T08:37:33.271935+0000","last_undegraded":"2024-09-10T08:37:33.271935+0000","last_fullsized":"2024-09-10T08:37:33.271935+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.764741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259447+0000","last_change":"2024-09-10T08:37:32.259275+0000","last_active":"2024-09-10T08:37:34.259447+0000","last_peered":"2024-09-10T08:37:34.259447+0000","last_clean":"2024-09-10T08:37:34.259447+0000","last_became_active":"2024-09-10T08:37:32.257939+0000","last_became_peered":"2024-09-10T08:37:32.257939+0000","last_unstale":"2024-09-10T08:37:34.259447+0000","last_undegraded":"2024-09-10T08:37:34.259447+0000","last_fullsized":"2024-09-10T08:37:34.259447+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:45.773724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.275452+0000","last_change":"2024-09-10T08:37:33.270830+0000","last_active":"2024-09-10T08:37:33.275452+0000","last_peered":"2024-09-10T08:37:33.275452+0000","last_clean":"2024-09-10T08:37:33.275452+0000","last_became_active":"2024-09-10T08:37:33.270239+0000","last_became_peered":"2024-09-10T08:37:33.270239+0000","last_unstale":"2024-09-10T08:37:33.275452+0000","last_undegraded":"2024-09-10T08:37:33.275452+0000","last_fullsized":"2024-09-10T08:37:33.275452+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:00.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.257236+0000","last_change":"2024-09-10T08:37:32.250666+0000","last_active":"2024-09-10T08:37:33.257236+0000","last_peered":"2024-09-10T08:37:33.257236+0000","last_clean":"2024-09-10T08:37:33.257236+0000","last_became_active":"2024-09-10T08:37:32.248703+0000","last_became_peered":"2024-09-10T08:37:32.248703+0000","last_unstale":"2024-09-10T08:37:33.257236+0000","last_undegraded":"2024-09-10T08:37:33.257236+0000","last_fullsized":"2024-09-10T08:37:33.257236+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:29.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271613+0000","last_change":"2024-09-10T08:37:33.265960+0000","last_active":"2024-09-10T08:37:33.271613+0000","last_peered":"2024-09-10T08:37:33.271613+0000","last_clean":"2024-09-10T08:37:33.271613+0000","last_became_active":"2024-09-10T08:37:33.265615+0000","last_became_peered":"2024-09-10T08:37:33.265615+0000","last_unstale":"2024-09-10T08:37:33.271613+0000","last_undegraded":"2024-09-10T08:37:33.271613+0000","last_fullsized":"2024-09-10T08:37:33.271613+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:51.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259728+0000","last_change":"2024-09-10T08:37:32.261037+0000","last_active":"2024-09-10T08:37:34.259728+0000","last_peered":"2024-09-10T08:37:34.259728+0000","last_clean":"2024-09-10T08:37:34.259728+0000","last_became_active":"2024-09-10T08:37:32.260037+0000","last_became_peered":"2024-09-10T08:37:32.260037+0000","last_unstale":"2024-09-10T08:37:34.259728+0000","last_undegraded":"2024-09-10T08:37:34.259728+0000","last_fullsized":"2024-09-10T08:37:34.259728+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:40.238657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279237+0000","last_change":"2024-09-10T08:37:33.275584+0000","last_active":"2024-09-10T08:37:33.279237+0000","last_peered":"2024-09-10T08:37:33.279237+0000","last_clean":"2024-09-10T08:37:33.279237+0000","last_became_active":"2024-09-10T08:37:33.275347+0000","last_became_peered":"2024-09-10T08:37:33.275347+0000","last_unstale":"2024-09-10T08:37:33.279237+0000","last_undegraded":"2024-09-10T08:37:33.279237+0000","last_fullsized":"2024-09-10T08:37:33.279237+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:45.786384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259913+0000","last_change":"2024-09-10T08:37:32.263378+0000","last_active":"2024-09-10T08:37:34.259913+0000","last_peered":"2024-09-10T08:37:34.259913+0000","last_clean":"2024-09-10T08:37:34.259913+0000","last_became_active":"2024-09-10T08:37:32.263038+0000","last_became_peered":"2024-09-10T08:37:32.263038+0000","last_unstale":"2024-09-10T08:37:34.259913+0000","last_undegraded":"2024-09-10T08:37:34.259913+0000","last_fullsized":"2024-09-10T08:37:34.259913+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:44.000886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590378+0000","last_change":"2024-09-10T08:37:33.276224+0000","last_active":"2024-09-10T08:37:34.590378+0000","last_peered":"2024-09-10T08:37:34.590378+0000","last_clean":"2024-09-10T08:37:34.590378+0000","last_became_active":"2024-09-10T08:37:33.273041+0000","last_became_peered":"2024-09-10T08:37:33.273041+0000","last_unstale":"2024-09-10T08:37:34.590378+0000","last_undegraded":"2024-09-10T08:37:34.590378+0000","last_fullsized":"2024-09-10T08:37:34.590378+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:28.809197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590074+0000","last_change":"2024-09-10T08:37:32.264783+0000","last_active":"2024-09-10T08:37:34.590074+0000","last_peered":"2024-09-10T08:37:34.590074+0000","last_clean":"2024-09-10T08:37:34.590074+0000","last_became_active":"2024-09-10T08:37:32.264398+0000","last_became_peered":"2024-09-10T08:37:32.264398+0000","last_unstale":"2024-09-10T08:37:34.590074+0000","last_undegraded":"2024-09-10T08:37:34.590074+0000","last_fullsized":"2024-09-10T08:37:34.590074+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:52.576355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258522+0000","last_change":"2024-09-10T08:37:33.259385+0000","last_active":"2024-09-10T08:37:34.258522+0000","last_peered":"2024-09-10T08:37:34.258522+0000","last_clean":"2024-09-10T08:37:34.258522+0000","last_became_active":"2024-09-10T08:37:33.259111+0000","last_became_peered":"2024-09-10T08:37:33.259111+0000","last_unstale":"2024-09-10T08:37:34.258522+0000","last_undegraded":"2024-09-10T08:37:34.258522+0000","last_fullsized":"2024-09-10T08:37:34.258522+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:56.399218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260819+0000","last_change":"2024-09-10T08:37:32.255262+0000","last_active":"2024-09-10T08:37:33.260819+0000","last_peered":"2024-09-10T08:37:33.260819+0000","last_clean":"2024-09-10T08:37:33.260819+0000","last_became_active":"2024-09-10T08:37:32.254796+0000","last_became_peered":"2024-09-10T08:37:32.254796+0000","last_unstale":"2024-09-10T08:37:33.260819+0000","last_undegraded":"2024-09-10T08:37:33.260819+0000","last_fullsized":"2024-09-10T08:37:33.260819+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:57.833814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.283372+0000","last_change":"2024-09-10T08:37:33.282506+0000","last_active":"2024-09-10T08:37:33.283372+0000","last_peered":"2024-09-10T08:37:33.283372+0000","last_clean":"2024-09-10T08:37:33.283372+0000","last_became_active":"2024-09-10T08:37:33.282139+0000","last_became_peered":"2024-09-10T08:37:33.282139+0000","last_unstale":"2024-09-10T08:37:33.283372+0000","last_undegraded":"2024-09-10T08:37:33.283372+0000","last_fullsized":"2024-09-10T08:37:33.283372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:56.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259721+0000","last_change":"2024-09-10T08:37:32.257246+0000","last_active":"2024-09-10T08:37:34.259721+0000","last_peered":"2024-09-10T08:37:34.259721+0000","last_clean":"2024-09-10T08:37:34.259721+0000","last_became_active":"2024-09-10T08:37:32.256942+0000","last_became_peered":"2024-09-10T08:37:32.256942+0000","last_unstale":"2024-09-10T08:37:34.259721+0000","last_undegraded":"2024-09-10T08:37:34.259721+0000","last_fullsized":"2024-09-10T08:37:34.259721+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.492245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271276+0000","last_change":"2024-09-10T08:37:33.267469+0000","last_active":"2024-09-10T08:37:33.271276+0000","last_peered":"2024-09-10T08:37:33.271276+0000","last_clean":"2024-09-10T08:37:33.271276+0000","last_became_active":"2024-09-10T08:37:33.266800+0000","last_became_peered":"2024-09-10T08:37:33.266800+0000","last_unstale":"2024-09-10T08:37:33.271276+0000","last_undegraded":"2024-09-10T08:37:33.271276+0000","last_fullsized":"2024-09-10T08:37:33.271276+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:01.591096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.259027+0000","last_change":"2024-09-10T08:37:32.265995+0000","last_active":"2024-09-10T08:37:33.259027+0000","last_peered":"2024-09-10T08:37:33.259027+0000","last_clean":"2024-09-10T08:37:33.259027+0000","last_became_active":"2024-09-10T08:37:32.265047+0000","last_became_peered":"2024-09-10T08:37:32.265047+0000","last_unstale":"2024-09-10T08:37:33.259027+0000","last_undegraded":"2024-09-10T08:37:33.259027+0000","last_fullsized":"2024-09-10T08:37:33.259027+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:42.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590318+0000","last_change":"2024-09-10T08:37:33.272021+0000","last_active":"2024-09-10T08:37:34.590318+0000","last_peered":"2024-09-10T08:37:34.590318+0000","last_clean":"2024-09-10T08:37:34.590318+0000","last_became_active":"2024-09-10T08:37:33.271712+0000","last_became_peered":"2024-09-10T08:37:33.271712+0000","last_unstale":"2024-09-10T08:37:34.590318+0000","last_undegraded":"2024-09-10T08:37:34.590318+0000","last_fullsized":"2024-09-10T08:37:34.590318+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:48.958311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259742+0000","last_change":"2024-09-10T08:37:32.265367+0000","last_active":"2024-09-10T08:37:34.259742+0000","last_peered":"2024-09-10T08:37:34.259742+0000","last_clean":"2024-09-10T08:37:34.259742+0000","last_became_active":"2024-09-10T08:37:32.265086+0000","last_became_peered":"2024-09-10T08:37:32.265086+0000","last_unstale":"2024-09-10T08:37:34.259742+0000","last_undegraded":"2024-09-10T08:37:34.259742+0000","last_fullsized":"2024-09-10T08:37:34.259742+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:38.552310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259356+0000","last_change":"2024-09-10T08:37:33.281816+0000","last_active":"2024-09-10T08:37:34.259356+0000","last_peered":"2024-09-10T08:37:34.259356+0000","last_clean":"2024-09-10T08:37:34.259356+0000","last_became_active":"2024-09-10T08:37:33.278329+0000","last_became_peered":"2024-09-10T08:37:33.278329+0000","last_unstale":"2024-09-10T08:37:34.259356+0000","last_undegraded":"2024-09-10T08:37:34.259356+0000","last_fullsized":"2024-09-10T08:37:34.259356+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:11.860156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590495+0000","last_change":"2024-09-10T08:37:32.261196+0000","last_active":"2024-09-10T08:37:34.590495+0000","last_peered":"2024-09-10T08:37:34.590495+0000","last_clean":"2024-09-10T08:37:34.590495+0000","last_became_active":"2024-09-10T08:37:32.260946+0000","last_became_peered":"2024-09-10T08:37:32.260946+0000","last_unstale":"2024-09-10T08:37:34.590495+0000","last_undegraded":"2024-09-10T08:37:34.590495+0000","last_fullsized":"2024-09-10T08:37:34.590495+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:20.014419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259019+0000","last_change":"2024-09-10T08:37:33.266996+0000","last_active":"2024-09-10T08:37:34.259019+0000","last_peered":"2024-09-10T08:37:34.259019+0000","last_clean":"2024-09-10T08:37:34.259019+0000","last_became_active":"2024-09-10T08:37:33.265487+0000","last_became_peered":"2024-09-10T08:37:33.265487+0000","last_unstale":"2024-09-10T08:37:34.259019+0000","last_undegraded":"2024-09-10T08:37:34.259019+0000","last_fullsized":"2024-09-10T08:37:34.259019+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:48.983989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.249744+0000","last_change":"2024-09-10T08:37:32.249265+0000","last_active":"2024-09-10T08:37:33.249744+0000","last_peered":"2024-09-10T08:37:33.249744+0000","last_clean":"2024-09-10T08:37:33.249744+0000","last_became_active":"2024-09-10T08:37:32.248924+0000","last_became_peered":"2024-09-10T08:37:32.248924+0000","last_unstale":"2024-09-10T08:37:33.249744+0000","last_undegraded":"2024-09-10T08:37:33.249744+0000","last_fullsized":"2024-09-10T08:37:33.249744+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:51.049040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258830+0000","last_change":"2024-09-10T08:37:33.263588+0000","last_active":"2024-09-10T08:37:34.258830+0000","last_peered":"2024-09-10T08:37:34.258830+0000","last_clean":"2024-09-10T08:37:34.258830+0000","last_became_active":"2024-09-10T08:37:33.261952+0000","last_became_peered":"2024-09-10T08:37:33.261952+0000","last_unstale":"2024-09-10T08:37:34.258830+0000","last_undegraded":"2024-09-10T08:37:34.258830+0000","last_fullsized":"2024-09-10T08:37:34.258830+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:46.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258537+0000","last_change":"2024-09-10T08:37:32.263511+0000","last_active":"2024-09-10T08:37:34.258537+0000","last_peered":"2024-09-10T08:37:34.258537+0000","last_clean":"2024-09-10T08:37:34.258537+0000","last_became_active":"2024-09-10T08:37:32.263138+0000","last_became_peered":"2024-09-10T08:37:32.263138+0000","last_unstale":"2024-09-10T08:37:34.258537+0000","last_undegraded":"2024-09-10T08:37:34.258537+0000","last_fullsized":"2024-09-10T08:37:34.258537+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:48.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259973+0000","last_change":"2024-09-10T08:37:33.259983+0000","last_active":"2024-09-10T08:37:34.259973+0000","last_peered":"2024-09-10T08:37:34.259973+0000","last_clean":"2024-09-10T08:37:34.259973+0000","last_became_active":"2024-09-10T08:37:33.257219+0000","last_became_peered":"2024-09-10T08:37:33.257219+0000","last_unstale":"2024-09-10T08:37:34.259973+0000","last_undegraded":"2024-09-10T08:37:34.259973+0000","last_fullsized":"2024-09-10T08:37:34.259973+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:51.200525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260424+0000","last_change":"2024-09-10T08:37:32.264221+0000","last_active":"2024-09-10T08:37:33.260424+0000","last_peered":"2024-09-10T08:37:33.260424+0000","last_clean":"2024-09-10T08:37:33.260424+0000","last_became_active":"2024-09-10T08:37:32.263903+0000","last_became_peered":"2024-09-10T08:37:32.263903+0000","last_unstale":"2024-09-10T08:37:33.260424+0000","last_undegraded":"2024-09-10T08:37:33.260424+0000","last_fullsized":"2024-09-10T08:37:33.260424+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:05.076207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590207+0000","last_change":"2024-09-10T08:37:33.275450+0000","last_active":"2024-09-10T08:37:34.590207+0000","last_peered":"2024-09-10T08:37:34.590207+0000","last_clean":"2024-09-10T08:37:34.590207+0000","last_became_active":"2024-09-10T08:37:33.274577+0000","last_became_peered":"2024-09-10T08:37:33.274577+0000","last_unstale":"2024-09-10T08:37:34.590207+0000","last_undegraded":"2024-09-10T08:37:34.590207+0000","last_fullsized":"2024-09-10T08:37:34.590207+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:00.965250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590485+0000","last_change":"2024-09-10T08:37:32.259315+0000","last_active":"2024-09-10T08:37:34.590485+0000","last_peered":"2024-09-10T08:37:34.590485+0000","last_clean":"2024-09-10T08:37:34.590485+0000","last_became_active":"2024-09-10T08:37:32.258464+0000","last_became_peered":"2024-09-10T08:37:32.258464+0000","last_unstale":"2024-09-10T08:37:34.590485+0000","last_undegraded":"2024-09-10T08:37:34.590485+0000","last_fullsized":"2024-09-10T08:37:34.590485+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:29.787016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259486+0000","last_change":"2024-09-10T08:37:33.266560+0000","last_active":"2024-09-10T08:37:34.259486+0000","last_peered":"2024-09-10T08:37:34.259486+0000","last_clean":"2024-09-10T08:37:34.259486+0000","last_became_active":"2024-09-10T08:37:33.266205+0000","last_became_peered":"2024-09-10T08:37:33.266205+0000","last_unstale":"2024-09-10T08:37:34.259486+0000","last_undegraded":"2024-09-10T08:37:34.259486+0000","last_fullsized":"2024-09-10T08:37:34.259486+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:05.087901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258965+0000","last_change":"2024-09-10T08:37:32.261319+0000","last_active":"2024-09-10T08:37:34.258965+0000","last_peered":"2024-09-10T08:37:34.258965+0000","last_clean":"2024-09-10T08:37:34.258965+0000","last_became_active":"2024-09-10T08:37:32.258960+0000","last_became_peered":"2024-09-10T08:37:32.258960+0000","last_unstale":"2024-09-10T08:37:34.258965+0000","last_undegraded":"2024-09-10T08:37:34.258965+0000","last_fullsized":"2024-09-10T08:37:34.258965+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:49.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":372,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260445+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:37:33.260445+0000","last_peered":"2024-09-10T08:37:33.260445+0000","last_clean":"2024-09-10T08:37:33.260445+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:37:33.260445+0000","last_undegraded":"2024-09-10T08:37:33.260445+0000","last_fullsized":"2024-09-10T08:37:33.260445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45312,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326528,"statfs":{"total":96636764160,"available":96590364672,"internally_reserved":0,"allocated":1679360,"data_stored":735100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509551,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50864,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320976,"statfs":{"total":96636764160,"available":96584679424,"internally_reserved":0,"allocated":1662976,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50860,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320980,"statfs":{"total":96636764160,"available":96584683520,"internally_reserved":0,"allocated":1662976,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1667072,"data_stored":728836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55032,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316808,"statfs":{"total":96636764160,"available":96580411392,"internally_reserved":0,"allocated":1671168,"data_stored":729438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51456,"kb_used_data":2220,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320384,"statfs":{"total":96636764160,"available":96584073216,"internally_reserved":0,"allocated":2273280,"data_stored":1320768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1695744,"data_stored":736734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542254,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51452,"kb_used_data":2216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320388,"statfs":{"total":96636764160,"available":96584077312,"internally_reserved":0,"allocated":2269184,"data_stored":1319876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:37:37.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:37:37.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.658+0000 7f0649e00640 1 Processor -- start 2024-09-10T08:37:37.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.658+0000 7f0649e00640 1 -- start start 2024-09-10T08:37:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0649e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06440b6970 0x7f06440b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0649e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06440d23b0 0x7f06440b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0649e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06440d0e70 con 0x7f064415ed20 2024-09-10T08:37:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0649e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f06440d41c0 con 0x7f06440d23b0 2024-09-10T08:37:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0649e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f06440d35b0 con 0x7f06440b6970 2024-09-10T08:37:37.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06440d23b0 0x7f06440b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f06440d23b0 0x7f06440b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56934/0 (socket says 172.21.15.52:56934) 2024-09-10T08:37:37.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 -- 172.21.15.52:0/3376667361 learned_addr learned my addr 172.21.15.52:0/3376667361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:37.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f063be00640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06440b6970 0x7f06440b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 -- 172.21.15.52:0/3376667361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06440b6970 msgr2=0x7f06440b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:37.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06440b6970 0x7f06440b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 -- 172.21.15.52:0/3376667361 >> v1:172.21.15.176:6789/0 conn(0x7f064415ed20 legacy=0x7f06440b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.660+0000 7f0643400640 1 -- 172.21.15.52:0/3376667361 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06440d3890 con 0x7f06440d23b0 2024-09-10T08:37:37.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.661+0000 7f0643400640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440d23b0 0x7f06440b8610 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f063c009e50 tx=0x7f063c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d47d2e8b7b52fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0642000640 1 -- 172.21.15.52:0/3376667361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c036070 con 0x7f06440d23b0 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0642000640 1 -- 172.21.15.52:0/3376667361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c031600 con 0x7f06440d23b0 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0642000640 1 -- 172.21.15.52:0/3376667361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c0319d0 con 0x7f06440d23b0 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 -- 172.21.15.52:0/3376667361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440d23b0 msgr2=0x7f06440b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440d23b0 0x7f06440b8610 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f063c009e50 tx=0x7f063c02a680 comp rx=0 tx=0).stop 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 -- 172.21.15.52:0/3376667361 shutdown_connections 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440d23b0 0x7f06440b8610 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 --2- 172.21.15.52:0/3376667361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f06440b6970 0x7f06440b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 -- 172.21.15.52:0/3376667361 >> 172.21.15.52:0/3376667361 conn(0x7f06440d1260 msgr2=0x7f06440d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:37.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 -- 172.21.15.52:0/3376667361 shutdown_connections 2024-09-10T08:37:37.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.662+0000 7f0649e00640 1 -- 172.21.15.52:0/3376667361 wait complete. 2024-09-10T08:37:37.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.664+0000 7f0649e00640 1 Processor -- start 2024-09-10T08:37:37.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.664+0000 7f0649e00640 1 -- start start 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06440d23b0 0x7f0644159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f064415ed20 0x7f0644161e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06440d32a0 con 0x7f06440b6970 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06440d3e50 con 0x7f06440d23b0 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f064415f100 con 0x7f064415ed20 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56942/0 (socket says 172.21.15.52:56942) 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 -- 172.21.15.52:0/3694156449 learned_addr learned my addr 172.21.15.52:0/3694156449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0643400640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f064415ed20 0x7f0644161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f063be00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06440d23b0 0x7f0644159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 -- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f064415ed20 msgr2=0x7f0644161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f064415ed20 0x7f0644161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 -- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06440d23b0 msgr2=0x7f0644159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06440d23b0 0x7f0644159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 -- 172.21.15.52:0/3694156449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06440c94a0 con 0x7f06440b6970 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0642a00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f063400c400 tx=0x7f063400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634017070 con 0x7f06440b6970 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06340052d0 con 0x7f06440b6970 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06440c91c0 con 0x7f06440b6970 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.666+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634003830 con 0x7f06440b6970 2024-09-10T08:37:37.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.667+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064415f6e0 con 0x7f06440b6970 2024-09-10T08:37:37.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.667+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06440d0490 con 0x7f06440b6970 2024-09-10T08:37:37.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.668+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f063401a070 con 0x7f06440b6970 2024-09-10T08:37:37.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.670+0000 7f063b400640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 0x7f062006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:37.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.670+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f063408a0d0 con 0x7f06440b6970 2024-09-10T08:37:37.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.670+0000 7f063be00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 0x7f062006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:37.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.670+0000 7f063be00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 0x7f062006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f064415c850 tx=0x7f062c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:37.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.673+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06440d0490 con 0x7f06440b6970 2024-09-10T08:37:37.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.857+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0644068f40 con 0x7f062006be30 2024-09-10T08:37:37.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.865+0000 7f063b400640 1 -- 172.21.15.52:0/3694156449 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252450 (secure 0 0 0) 0x7f0644068f40 con 0x7f062006be30 2024-09-10T08:37:37.867 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 msgr2=0x7f062006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 0x7f062006e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f064415c850 tx=0x7f062c008040 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 msgr2=0x7f06440c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f063400c400 tx=0x7f063400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 shutdown_connections 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f062006be30 0x7f062006e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f064415ed20 0x7f0644161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06440d23b0 0x7f0644159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 --2- 172.21.15.52:0/3694156449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06440b6970 0x7f06440c8be0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 >> 172.21.15.52:0/3694156449 conn(0x7f06440d1260 msgr2=0x7f06440b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 shutdown_connections 2024-09-10T08:37:37.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:37.868+0000 7f0649e00640 1 -- 172.21.15.52:0/3694156449 wait complete. 2024-09-10T08:37:37.885 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-10T08:37:37.587205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397008,"kb_used_data":14240,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754577712,"statfs":{"total":773094113280,"available":772687577088,"internally_reserved":0,"allocated":14581760,"data_stored":7028284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":391761456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001615"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260570+0000","last_change":"2024-09-10T08:37:33.254947+0000","last_active":"2024-09-10T08:37:33.260570+0000","last_peered":"2024-09-10T08:37:33.260570+0000","last_clean":"2024-09-10T08:37:33.260570+0000","last_became_active":"2024-09-10T08:37:33.254659+0000","last_became_peered":"2024-09-10T08:37:33.254659+0000","last_unstale":"2024-09-10T08:37:33.260570+0000","last_undegraded":"2024-09-10T08:37:33.260570+0000","last_fullsized":"2024-09-10T08:37:33.260570+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:30.902828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271548+0000","last_change":"2024-09-10T08:37:33.267706+0000","last_active":"2024-09-10T08:37:33.271548+0000","last_peered":"2024-09-10T08:37:33.271548+0000","last_clean":"2024-09-10T08:37:33.271548+0000","last_became_active":"2024-09-10T08:37:33.266676+0000","last_became_peered":"2024-09-10T08:37:33.266676+0000","last_unstale":"2024-09-10T08:37:33.271548+0000","last_undegraded":"2024-09-10T08:37:33.271548+0000","last_fullsized":"2024-09-10T08:37:33.271548+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:00.965250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259212+0000","last_change":"2024-09-10T08:37:33.280358+0000","last_active":"2024-09-10T08:37:34.259212+0000","last_peered":"2024-09-10T08:37:34.259212+0000","last_clean":"2024-09-10T08:37:34.259212+0000","last_became_active":"2024-09-10T08:37:33.279168+0000","last_became_peered":"2024-09-10T08:37:33.279168+0000","last_unstale":"2024-09-10T08:37:34.259212+0000","last_undegraded":"2024-09-10T08:37:34.259212+0000","last_fullsized":"2024-09-10T08:37:34.259212+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:04.779057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.280874+0000","last_change":"2024-09-10T08:37:33.280076+0000","last_active":"2024-09-10T08:37:33.280874+0000","last_peered":"2024-09-10T08:37:33.280874+0000","last_clean":"2024-09-10T08:37:33.280874+0000","last_became_active":"2024-09-10T08:37:33.279709+0000","last_became_peered":"2024-09-10T08:37:33.279709+0000","last_unstale":"2024-09-10T08:37:33.280874+0000","last_undegraded":"2024-09-10T08:37:33.280874+0000","last_fullsized":"2024-09-10T08:37:33.280874+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:27.028397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278997+0000","last_change":"2024-09-10T08:37:33.275430+0000","last_active":"2024-09-10T08:37:33.278997+0000","last_peered":"2024-09-10T08:37:33.278997+0000","last_clean":"2024-09-10T08:37:33.278997+0000","last_became_active":"2024-09-10T08:37:33.275180+0000","last_became_peered":"2024-09-10T08:37:33.275180+0000","last_unstale":"2024-09-10T08:37:33.278997+0000","last_undegraded":"2024-09-10T08:37:33.278997+0000","last_fullsized":"2024-09-10T08:37:33.278997+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:46.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258383+0000","last_change":"2024-09-10T08:37:33.254259+0000","last_active":"2024-09-10T08:37:34.258383+0000","last_peered":"2024-09-10T08:37:34.258383+0000","last_clean":"2024-09-10T08:37:34.258383+0000","last_became_active":"2024-09-10T08:37:33.253951+0000","last_became_peered":"2024-09-10T08:37:33.253951+0000","last_unstale":"2024-09-10T08:37:34.258383+0000","last_undegraded":"2024-09-10T08:37:34.258383+0000","last_fullsized":"2024-09-10T08:37:34.258383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:54.919079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.267329+0000","last_change":"2024-09-10T08:37:33.261050+0000","last_active":"2024-09-10T08:37:33.267329+0000","last_peered":"2024-09-10T08:37:33.267329+0000","last_clean":"2024-09-10T08:37:33.267329+0000","last_became_active":"2024-09-10T08:37:33.260781+0000","last_became_peered":"2024-09-10T08:37:33.260781+0000","last_unstale":"2024-09-10T08:37:33.267329+0000","last_undegraded":"2024-09-10T08:37:33.267329+0000","last_fullsized":"2024-09-10T08:37:33.267329+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:38.646358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278698+0000","last_change":"2024-09-10T08:37:33.272316+0000","last_active":"2024-09-10T08:37:33.278698+0000","last_peered":"2024-09-10T08:37:33.278698+0000","last_clean":"2024-09-10T08:37:33.278698+0000","last_became_active":"2024-09-10T08:37:33.272004+0000","last_became_peered":"2024-09-10T08:37:33.272004+0000","last_unstale":"2024-09-10T08:37:33.278698+0000","last_undegraded":"2024-09-10T08:37:33.278698+0000","last_fullsized":"2024-09-10T08:37:33.278698+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:08.206710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260313+0000","last_change":"2024-09-10T08:37:33.256835+0000","last_active":"2024-09-10T08:37:34.260313+0000","last_peered":"2024-09-10T08:37:34.260313+0000","last_clean":"2024-09-10T08:37:34.260313+0000","last_became_active":"2024-09-10T08:37:33.256476+0000","last_became_peered":"2024-09-10T08:37:33.256476+0000","last_unstale":"2024-09-10T08:37:34.260313+0000","last_undegraded":"2024-09-10T08:37:34.260313+0000","last_fullsized":"2024-09-10T08:37:34.260313+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:32.780942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260079+0000","last_change":"2024-09-10T08:37:33.255604+0000","last_active":"2024-09-10T08:37:33.260079+0000","last_peered":"2024-09-10T08:37:33.260079+0000","last_clean":"2024-09-10T08:37:33.260079+0000","last_became_active":"2024-09-10T08:37:33.254988+0000","last_became_peered":"2024-09-10T08:37:33.254988+0000","last_unstale":"2024-09-10T08:37:33.260079+0000","last_undegraded":"2024-09-10T08:37:33.260079+0000","last_fullsized":"2024-09-10T08:37:33.260079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:14:56.611017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.266959+0000","last_change":"2024-09-10T08:37:33.264734+0000","last_active":"2024-09-10T08:37:33.266959+0000","last_peered":"2024-09-10T08:37:33.266959+0000","last_clean":"2024-09-10T08:37:33.266959+0000","last_became_active":"2024-09-10T08:37:33.263370+0000","last_became_peered":"2024-09-10T08:37:33.263370+0000","last_unstale":"2024-09-10T08:37:33.266959+0000","last_undegraded":"2024-09-10T08:37:33.266959+0000","last_fullsized":"2024-09-10T08:37:33.266959+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:07.917331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259625+0000","last_change":"2024-09-10T08:37:33.282494+0000","last_active":"2024-09-10T08:37:34.259625+0000","last_peered":"2024-09-10T08:37:34.259625+0000","last_clean":"2024-09-10T08:37:34.259625+0000","last_became_active":"2024-09-10T08:37:33.277824+0000","last_became_peered":"2024-09-10T08:37:33.277824+0000","last_unstale":"2024-09-10T08:37:34.259625+0000","last_undegraded":"2024-09-10T08:37:34.259625+0000","last_fullsized":"2024-09-10T08:37:34.259625+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:40.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.275727+0000","last_change":"2024-09-10T08:37:33.275190+0000","last_active":"2024-09-10T08:37:33.275727+0000","last_peered":"2024-09-10T08:37:33.275727+0000","last_clean":"2024-09-10T08:37:33.275727+0000","last_became_active":"2024-09-10T08:37:33.274717+0000","last_became_peered":"2024-09-10T08:37:33.274717+0000","last_unstale":"2024-09-10T08:37:33.275727+0000","last_undegraded":"2024-09-10T08:37:33.275727+0000","last_fullsized":"2024-09-10T08:37:33.275727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:48:57.370409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590123+0000","last_change":"2024-09-10T08:37:33.274456+0000","last_active":"2024-09-10T08:37:34.590123+0000","last_peered":"2024-09-10T08:37:34.590123+0000","last_clean":"2024-09-10T08:37:34.590123+0000","last_became_active":"2024-09-10T08:37:33.274135+0000","last_became_peered":"2024-09-10T08:37:33.274135+0000","last_unstale":"2024-09-10T08:37:34.590123+0000","last_undegraded":"2024-09-10T08:37:34.590123+0000","last_fullsized":"2024-09-10T08:37:34.590123+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.764741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259447+0000","last_change":"2024-09-10T08:37:33.272363+0000","last_active":"2024-09-10T08:37:34.259447+0000","last_peered":"2024-09-10T08:37:34.259447+0000","last_clean":"2024-09-10T08:37:34.259447+0000","last_became_active":"2024-09-10T08:37:33.271666+0000","last_became_peered":"2024-09-10T08:37:33.271666+0000","last_unstale":"2024-09-10T08:37:34.259447+0000","last_undegraded":"2024-09-10T08:37:34.259447+0000","last_fullsized":"2024-09-10T08:37:34.259447+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:29.381643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590184+0000","last_change":"2024-09-10T08:37:33.274907+0000","last_active":"2024-09-10T08:37:34.590184+0000","last_peered":"2024-09-10T08:37:34.590184+0000","last_clean":"2024-09-10T08:37:34.590184+0000","last_became_active":"2024-09-10T08:37:33.274602+0000","last_became_peered":"2024-09-10T08:37:33.274602+0000","last_unstale":"2024-09-10T08:37:34.590184+0000","last_undegraded":"2024-09-10T08:37:34.590184+0000","last_fullsized":"2024-09-10T08:37:34.590184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:01.591096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260474+0000","last_change":"2024-09-10T08:37:33.265056+0000","last_active":"2024-09-10T08:37:34.260474+0000","last_peered":"2024-09-10T08:37:34.260474+0000","last_clean":"2024-09-10T08:37:34.260474+0000","last_became_active":"2024-09-10T08:37:33.264348+0000","last_became_peered":"2024-09-10T08:37:33.264348+0000","last_unstale":"2024-09-10T08:37:34.260474+0000","last_undegraded":"2024-09-10T08:37:34.260474+0000","last_fullsized":"2024-09-10T08:37:34.260474+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:57.721764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259630+0000","last_change":"2024-09-10T08:37:33.261483+0000","last_active":"2024-09-10T08:37:34.259630+0000","last_peered":"2024-09-10T08:37:34.259630+0000","last_clean":"2024-09-10T08:37:34.259630+0000","last_became_active":"2024-09-10T08:37:33.261205+0000","last_became_peered":"2024-09-10T08:37:33.261205+0000","last_unstale":"2024-09-10T08:37:34.259630+0000","last_undegraded":"2024-09-10T08:37:34.259630+0000","last_fullsized":"2024-09-10T08:37:34.259630+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:38.874782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.266310+0000","last_change":"2024-09-10T08:37:33.262147+0000","last_active":"2024-09-10T08:37:33.266310+0000","last_peered":"2024-09-10T08:37:33.266310+0000","last_clean":"2024-09-10T08:37:33.266310+0000","last_became_active":"2024-09-10T08:37:33.261881+0000","last_became_peered":"2024-09-10T08:37:33.261881+0000","last_unstale":"2024-09-10T08:37:33.266310+0000","last_undegraded":"2024-09-10T08:37:33.266310+0000","last_fullsized":"2024-09-10T08:37:33.266310+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:27:03.256126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259993+0000","last_change":"2024-09-10T08:37:33.259069+0000","last_active":"2024-09-10T08:37:34.259993+0000","last_peered":"2024-09-10T08:37:34.259993+0000","last_clean":"2024-09-10T08:37:34.259993+0000","last_became_active":"2024-09-10T08:37:33.257960+0000","last_became_peered":"2024-09-10T08:37:33.257960+0000","last_unstale":"2024-09-10T08:37:34.259993+0000","last_undegraded":"2024-09-10T08:37:34.259993+0000","last_fullsized":"2024-09-10T08:37:34.259993+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:34.420728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258636+0000","last_change":"2024-09-10T08:37:33.263857+0000","last_active":"2024-09-10T08:37:34.258636+0000","last_peered":"2024-09-10T08:37:34.258636+0000","last_clean":"2024-09-10T08:37:34.258636+0000","last_became_active":"2024-09-10T08:37:33.262987+0000","last_became_peered":"2024-09-10T08:37:33.262987+0000","last_unstale":"2024-09-10T08:37:34.258636+0000","last_undegraded":"2024-09-10T08:37:34.258636+0000","last_fullsized":"2024-09-10T08:37:34.258636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:08.206710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.261855+0000","last_change":"2024-09-10T08:37:33.259252+0000","last_active":"2024-09-10T08:37:33.261855+0000","last_peered":"2024-09-10T08:37:33.261855+0000","last_clean":"2024-09-10T08:37:33.261855+0000","last_became_active":"2024-09-10T08:37:33.258938+0000","last_became_peered":"2024-09-10T08:37:33.258938+0000","last_unstale":"2024-09-10T08:37:33.261855+0000","last_undegraded":"2024-09-10T08:37:33.261855+0000","last_fullsized":"2024-09-10T08:37:33.261855+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:57:11.106144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.281925+0000","last_change":"2024-09-10T08:37:33.279934+0000","last_active":"2024-09-10T08:37:33.281925+0000","last_peered":"2024-09-10T08:37:33.281925+0000","last_clean":"2024-09-10T08:37:33.281925+0000","last_became_active":"2024-09-10T08:37:33.278908+0000","last_became_peered":"2024-09-10T08:37:33.278908+0000","last_unstale":"2024-09-10T08:37:33.281925+0000","last_undegraded":"2024-09-10T08:37:33.281925+0000","last_fullsized":"2024-09-10T08:37:33.281925+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:53:29.181117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259320+0000","last_change":"2024-09-10T08:37:33.259837+0000","last_active":"2024-09-10T08:37:34.259320+0000","last_peered":"2024-09-10T08:37:34.259320+0000","last_clean":"2024-09-10T08:37:34.259320+0000","last_became_active":"2024-09-10T08:37:33.254721+0000","last_became_peered":"2024-09-10T08:37:33.254721+0000","last_unstale":"2024-09-10T08:37:34.259320+0000","last_undegraded":"2024-09-10T08:37:34.259320+0000","last_fullsized":"2024-09-10T08:37:34.259320+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:36.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.280659+0000","last_change":"2024-09-10T08:37:33.279941+0000","last_active":"2024-09-10T08:37:33.280659+0000","last_peered":"2024-09-10T08:37:33.280659+0000","last_clean":"2024-09-10T08:37:33.280659+0000","last_became_active":"2024-09-10T08:37:33.279606+0000","last_became_peered":"2024-09-10T08:37:33.279606+0000","last_unstale":"2024-09-10T08:37:33.280659+0000","last_undegraded":"2024-09-10T08:37:33.280659+0000","last_fullsized":"2024-09-10T08:37:33.280659+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:39.949858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.264091+0000","last_change":"2024-09-10T08:37:33.261077+0000","last_active":"2024-09-10T08:37:33.264091+0000","last_peered":"2024-09-10T08:37:33.264091+0000","last_clean":"2024-09-10T08:37:33.264091+0000","last_became_active":"2024-09-10T08:37:33.258671+0000","last_became_peered":"2024-09-10T08:37:33.258671+0000","last_unstale":"2024-09-10T08:37:33.264091+0000","last_undegraded":"2024-09-10T08:37:33.264091+0000","last_fullsized":"2024-09-10T08:37:33.264091+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:35.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590460+0000","last_change":"2024-09-10T08:37:33.276160+0000","last_active":"2024-09-10T08:37:34.590460+0000","last_peered":"2024-09-10T08:37:34.590460+0000","last_clean":"2024-09-10T08:37:34.590460+0000","last_became_active":"2024-09-10T08:37:33.275802+0000","last_became_peered":"2024-09-10T08:37:33.275802+0000","last_unstale":"2024-09-10T08:37:34.590460+0000","last_undegraded":"2024-09-10T08:37:34.590460+0000","last_fullsized":"2024-09-10T08:37:34.590460+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:00.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279524+0000","last_change":"2024-09-10T08:37:33.274305+0000","last_active":"2024-09-10T08:37:33.279524+0000","last_peered":"2024-09-10T08:37:33.279524+0000","last_clean":"2024-09-10T08:37:33.279524+0000","last_became_active":"2024-09-10T08:37:33.272760+0000","last_became_peered":"2024-09-10T08:37:33.272760+0000","last_unstale":"2024-09-10T08:37:33.279524+0000","last_undegraded":"2024-09-10T08:37:33.279524+0000","last_fullsized":"2024-09-10T08:37:33.279524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:27.933674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.267833+0000","last_change":"2024-09-10T08:37:33.262159+0000","last_active":"2024-09-10T08:37:33.267833+0000","last_peered":"2024-09-10T08:37:33.267833+0000","last_clean":"2024-09-10T08:37:33.267833+0000","last_became_active":"2024-09-10T08:37:33.260932+0000","last_became_peered":"2024-09-10T08:37:33.260932+0000","last_unstale":"2024-09-10T08:37:33.267833+0000","last_undegraded":"2024-09-10T08:37:33.267833+0000","last_fullsized":"2024-09-10T08:37:33.267833+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:30.076995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271632+0000","last_change":"2024-09-10T08:37:33.268380+0000","last_active":"2024-09-10T08:37:33.271632+0000","last_peered":"2024-09-10T08:37:33.271632+0000","last_clean":"2024-09-10T08:37:33.271632+0000","last_became_active":"2024-09-10T08:37:33.266593+0000","last_became_peered":"2024-09-10T08:37:33.266593+0000","last_unstale":"2024-09-10T08:37:33.271632+0000","last_undegraded":"2024-09-10T08:37:33.271632+0000","last_fullsized":"2024-09-10T08:37:33.271632+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:48.958311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279736+0000","last_change":"2024-09-10T08:37:33.274344+0000","last_active":"2024-09-10T08:37:33.279736+0000","last_peered":"2024-09-10T08:37:33.279736+0000","last_clean":"2024-09-10T08:37:33.279736+0000","last_became_active":"2024-09-10T08:37:33.274050+0000","last_became_peered":"2024-09-10T08:37:33.274050+0000","last_unstale":"2024-09-10T08:37:33.279736+0000","last_undegraded":"2024-09-10T08:37:33.279736+0000","last_fullsized":"2024-09-10T08:37:33.279736+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:31.718569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260350+0000","last_change":"2024-09-10T08:37:33.259282+0000","last_active":"2024-09-10T08:37:34.260350+0000","last_peered":"2024-09-10T08:37:34.260350+0000","last_clean":"2024-09-10T08:37:34.260350+0000","last_became_active":"2024-09-10T08:37:33.256713+0000","last_became_peered":"2024-09-10T08:37:33.256713+0000","last_unstale":"2024-09-10T08:37:34.260350+0000","last_undegraded":"2024-09-10T08:37:34.260350+0000","last_fullsized":"2024-09-10T08:37:34.260350+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:01.668636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590463+0000","last_change":"2024-09-10T08:37:33.273524+0000","last_active":"2024-09-10T08:37:34.590463+0000","last_peered":"2024-09-10T08:37:34.590463+0000","last_clean":"2024-09-10T08:37:34.590463+0000","last_became_active":"2024-09-10T08:37:33.269889+0000","last_became_peered":"2024-09-10T08:37:33.269889+0000","last_unstale":"2024-09-10T08:37:34.590463+0000","last_undegraded":"2024-09-10T08:37:34.590463+0000","last_fullsized":"2024-09-10T08:37:34.590463+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:23.654656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"134'4","reported_seq":16,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.277827+0000","last_change":"2024-09-10T08:37:32.256706+0000","last_active":"2024-09-10T08:37:33.277827+0000","last_peered":"2024-09-10T08:37:33.277827+0000","last_clean":"2024-09-10T08:37:33.277827+0000","last_became_active":"2024-09-10T08:37:32.256506+0000","last_became_peered":"2024-09-10T08:37:32.256506+0000","last_unstale":"2024-09-10T08:37:33.277827+0000","last_undegraded":"2024-09-10T08:37:33.277827+0000","last_fullsized":"2024-09-10T08:37:33.277827+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:25:58.444625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260416+0000","last_change":"2024-09-10T08:37:33.265295+0000","last_active":"2024-09-10T08:37:34.260416+0000","last_peered":"2024-09-10T08:37:34.260416+0000","last_clean":"2024-09-10T08:37:34.260416+0000","last_became_active":"2024-09-10T08:37:33.264746+0000","last_became_peered":"2024-09-10T08:37:33.264746+0000","last_unstale":"2024-09-10T08:37:34.260416+0000","last_undegraded":"2024-09-10T08:37:34.260416+0000","last_fullsized":"2024-09-10T08:37:34.260416+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:27.698517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259263+0000","last_change":"2024-09-10T08:37:32.264530+0000","last_active":"2024-09-10T08:37:34.259263+0000","last_peered":"2024-09-10T08:37:34.259263+0000","last_clean":"2024-09-10T08:37:34.259263+0000","last_became_active":"2024-09-10T08:37:32.264023+0000","last_became_peered":"2024-09-10T08:37:32.264023+0000","last_unstale":"2024-09-10T08:37:34.259263+0000","last_undegraded":"2024-09-10T08:37:34.259263+0000","last_fullsized":"2024-09-10T08:37:34.259263+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:31.542153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259791+0000","last_change":"2024-09-10T08:37:33.274966+0000","last_active":"2024-09-10T08:37:34.259791+0000","last_peered":"2024-09-10T08:37:34.259791+0000","last_clean":"2024-09-10T08:37:34.259791+0000","last_became_active":"2024-09-10T08:37:33.274681+0000","last_became_peered":"2024-09-10T08:37:33.274681+0000","last_unstale":"2024-09-10T08:37:34.259791+0000","last_undegraded":"2024-09-10T08:37:34.259791+0000","last_fullsized":"2024-09-10T08:37:34.259791+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:17.042645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.274497+0000","last_change":"2024-09-10T08:37:32.252856+0000","last_active":"2024-09-10T08:37:33.274497+0000","last_peered":"2024-09-10T08:37:33.274497+0000","last_clean":"2024-09-10T08:37:33.274497+0000","last_became_active":"2024-09-10T08:37:32.251958+0000","last_became_peered":"2024-09-10T08:37:32.251958+0000","last_unstale":"2024-09-10T08:37:33.274497+0000","last_undegraded":"2024-09-10T08:37:33.274497+0000","last_fullsized":"2024-09-10T08:37:33.274497+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:59:48.004839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.260002+0000","last_change":"2024-09-10T08:37:33.262104+0000","last_active":"2024-09-10T08:37:34.260002+0000","last_peered":"2024-09-10T08:37:34.260002+0000","last_clean":"2024-09-10T08:37:34.260002+0000","last_became_active":"2024-09-10T08:37:33.261749+0000","last_became_peered":"2024-09-10T08:37:33.261749+0000","last_unstale":"2024-09-10T08:37:34.260002+0000","last_undegraded":"2024-09-10T08:37:34.260002+0000","last_fullsized":"2024-09-10T08:37:34.260002+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:36.249710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.277728+0000","last_change":"2024-09-10T08:37:32.256860+0000","last_active":"2024-09-10T08:37:33.277728+0000","last_peered":"2024-09-10T08:37:33.277728+0000","last_clean":"2024-09-10T08:37:33.277728+0000","last_became_active":"2024-09-10T08:37:32.256545+0000","last_became_peered":"2024-09-10T08:37:32.256545+0000","last_unstale":"2024-09-10T08:37:33.277728+0000","last_undegraded":"2024-09-10T08:37:33.277728+0000","last_fullsized":"2024-09-10T08:37:33.277728+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:18:12.950985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259543+0000","last_change":"2024-09-10T08:37:33.266099+0000","last_active":"2024-09-10T08:37:34.259543+0000","last_peered":"2024-09-10T08:37:34.259543+0000","last_clean":"2024-09-10T08:37:34.259543+0000","last_became_active":"2024-09-10T08:37:33.265844+0000","last_became_peered":"2024-09-10T08:37:33.265844+0000","last_unstale":"2024-09-10T08:37:34.259543+0000","last_undegraded":"2024-09-10T08:37:34.259543+0000","last_fullsized":"2024-09-10T08:37:34.259543+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:36.900533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"134'1","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279582+0000","last_change":"2024-09-10T08:37:32.254208+0000","last_active":"2024-09-10T08:37:33.279582+0000","last_peered":"2024-09-10T08:37:33.279582+0000","last_clean":"2024-09-10T08:37:33.279582+0000","last_became_active":"2024-09-10T08:37:32.253902+0000","last_became_peered":"2024-09-10T08:37:32.253902+0000","last_unstale":"2024-09-10T08:37:33.279582+0000","last_undegraded":"2024-09-10T08:37:33.279582+0000","last_fullsized":"2024-09-10T08:37:33.279582+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:24.492773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258747+0000","last_change":"2024-09-10T08:37:33.265849+0000","last_active":"2024-09-10T08:37:34.258747+0000","last_peered":"2024-09-10T08:37:34.258747+0000","last_clean":"2024-09-10T08:37:34.258747+0000","last_became_active":"2024-09-10T08:37:33.263325+0000","last_became_peered":"2024-09-10T08:37:33.263325+0000","last_unstale":"2024-09-10T08:37:34.258747+0000","last_undegraded":"2024-09-10T08:37:34.258747+0000","last_fullsized":"2024-09-10T08:37:34.258747+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:59.485873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259806+0000","last_change":"2024-09-10T08:37:32.259178+0000","last_active":"2024-09-10T08:37:34.259806+0000","last_peered":"2024-09-10T08:37:34.259806+0000","last_clean":"2024-09-10T08:37:34.259806+0000","last_became_active":"2024-09-10T08:37:32.258821+0000","last_became_peered":"2024-09-10T08:37:32.258821+0000","last_unstale":"2024-09-10T08:37:34.259806+0000","last_undegraded":"2024-09-10T08:37:34.259806+0000","last_fullsized":"2024-09-10T08:37:34.259806+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:12.545774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258383+0000","last_change":"2024-09-10T08:37:33.270961+0000","last_active":"2024-09-10T08:37:34.258383+0000","last_peered":"2024-09-10T08:37:34.258383+0000","last_clean":"2024-09-10T08:37:34.258383+0000","last_became_active":"2024-09-10T08:37:33.270511+0000","last_became_peered":"2024-09-10T08:37:33.270511+0000","last_unstale":"2024-09-10T08:37:34.258383+0000","last_undegraded":"2024-09-10T08:37:34.258383+0000","last_fullsized":"2024-09-10T08:37:34.258383+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:43.690512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259165+0000","last_change":"2024-09-10T08:37:32.254841+0000","last_active":"2024-09-10T08:37:34.259165+0000","last_peered":"2024-09-10T08:37:34.259165+0000","last_clean":"2024-09-10T08:37:34.259165+0000","last_became_active":"2024-09-10T08:37:32.253231+0000","last_became_peered":"2024-09-10T08:37:32.253231+0000","last_unstale":"2024-09-10T08:37:34.259165+0000","last_undegraded":"2024-09-10T08:37:34.259165+0000","last_fullsized":"2024-09-10T08:37:34.259165+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:02.947892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.273029+0000","last_change":"2024-09-10T08:37:33.269361+0000","last_active":"2024-09-10T08:37:33.273029+0000","last_peered":"2024-09-10T08:37:33.273029+0000","last_clean":"2024-09-10T08:37:33.273029+0000","last_became_active":"2024-09-10T08:37:33.269097+0000","last_became_peered":"2024-09-10T08:37:33.269097+0000","last_unstale":"2024-09-10T08:37:33.273029+0000","last_undegraded":"2024-09-10T08:37:33.273029+0000","last_fullsized":"2024-09-10T08:37:33.273029+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:28.809197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.247530+0000","last_change":"2024-09-10T08:37:32.252841+0000","last_active":"2024-09-10T08:37:33.247530+0000","last_peered":"2024-09-10T08:37:33.247530+0000","last_clean":"2024-09-10T08:37:33.247530+0000","last_became_active":"2024-09-10T08:37:32.252545+0000","last_became_peered":"2024-09-10T08:37:32.252545+0000","last_unstale":"2024-09-10T08:37:33.247530+0000","last_undegraded":"2024-09-10T08:37:33.247530+0000","last_fullsized":"2024-09-10T08:37:33.247530+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:54.567220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.274498+0000","last_change":"2024-09-10T08:37:33.270140+0000","last_active":"2024-09-10T08:37:33.274498+0000","last_peered":"2024-09-10T08:37:33.274498+0000","last_clean":"2024-09-10T08:37:33.274498+0000","last_became_active":"2024-09-10T08:37:33.269876+0000","last_became_peered":"2024-09-10T08:37:33.269876+0000","last_unstale":"2024-09-10T08:37:33.274498+0000","last_undegraded":"2024-09-10T08:37:33.274498+0000","last_fullsized":"2024-09-10T08:37:33.274498+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:52:23.654656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259795+0000","last_change":"2024-09-10T08:37:32.259103+0000","last_active":"2024-09-10T08:37:34.259795+0000","last_peered":"2024-09-10T08:37:34.259795+0000","last_clean":"2024-09-10T08:37:34.259795+0000","last_became_active":"2024-09-10T08:37:32.258700+0000","last_became_peered":"2024-09-10T08:37:32.258700+0000","last_unstale":"2024-09-10T08:37:34.259795+0000","last_undegraded":"2024-09-10T08:37:34.259795+0000","last_fullsized":"2024-09-10T08:37:34.259795+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:52.488528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279974+0000","last_change":"2024-09-10T08:37:33.276892+0000","last_active":"2024-09-10T08:37:33.279974+0000","last_peered":"2024-09-10T08:37:33.279974+0000","last_clean":"2024-09-10T08:37:33.279974+0000","last_became_active":"2024-09-10T08:37:33.276583+0000","last_became_peered":"2024-09-10T08:37:33.276583+0000","last_unstale":"2024-09-10T08:37:33.279974+0000","last_undegraded":"2024-09-10T08:37:33.279974+0000","last_fullsized":"2024-09-10T08:37:33.279974+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:48.983989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259730+0000","last_change":"2024-09-10T08:37:32.257911+0000","last_active":"2024-09-10T08:37:34.259730+0000","last_peered":"2024-09-10T08:37:34.259730+0000","last_clean":"2024-09-10T08:37:34.259730+0000","last_became_active":"2024-09-10T08:37:32.256588+0000","last_became_peered":"2024-09-10T08:37:32.256588+0000","last_unstale":"2024-09-10T08:37:34.259730+0000","last_undegraded":"2024-09-10T08:37:34.259730+0000","last_fullsized":"2024-09-10T08:37:34.259730+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:43:15.196846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259727+0000","last_change":"2024-09-10T08:37:33.279073+0000","last_active":"2024-09-10T08:37:34.259727+0000","last_peered":"2024-09-10T08:37:34.259727+0000","last_clean":"2024-09-10T08:37:34.259727+0000","last_became_active":"2024-09-10T08:37:33.277476+0000","last_became_peered":"2024-09-10T08:37:33.277476+0000","last_unstale":"2024-09-10T08:37:34.259727+0000","last_undegraded":"2024-09-10T08:37:34.259727+0000","last_fullsized":"2024-09-10T08:37:34.259727+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:37:30.621978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"134'3","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278095+0000","last_change":"2024-09-10T08:37:32.254995+0000","last_active":"2024-09-10T08:37:33.278095+0000","last_peered":"2024-09-10T08:37:33.278095+0000","last_clean":"2024-09-10T08:37:33.278095+0000","last_became_active":"2024-09-10T08:37:32.254723+0000","last_became_peered":"2024-09-10T08:37:32.254723+0000","last_unstale":"2024-09-10T08:37:33.278095+0000","last_undegraded":"2024-09-10T08:37:33.278095+0000","last_fullsized":"2024-09-10T08:37:33.278095+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:53.915909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.283331+0000","last_change":"2024-09-10T08:37:33.282505+0000","last_active":"2024-09-10T08:37:33.283331+0000","last_peered":"2024-09-10T08:37:33.283331+0000","last_clean":"2024-09-10T08:37:33.283331+0000","last_became_active":"2024-09-10T08:37:33.282207+0000","last_became_peered":"2024-09-10T08:37:33.282207+0000","last_unstale":"2024-09-10T08:37:33.283331+0000","last_undegraded":"2024-09-10T08:37:33.283331+0000","last_fullsized":"2024-09-10T08:37:33.283331+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:47:15.956953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"134'6","reported_seq":18,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.286114+0000","last_change":"2024-09-10T08:37:32.265133+0000","last_active":"2024-09-10T08:37:33.286114+0000","last_peered":"2024-09-10T08:37:33.286114+0000","last_clean":"2024-09-10T08:37:33.286114+0000","last_became_active":"2024-09-10T08:37:32.264709+0000","last_became_peered":"2024-09-10T08:37:32.264709+0000","last_unstale":"2024-09-10T08:37:33.286114+0000","last_undegraded":"2024-09-10T08:37:33.286114+0000","last_fullsized":"2024-09-10T08:37:33.286114+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:41.332574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590531+0000","last_change":"2024-09-10T08:37:33.265731+0000","last_active":"2024-09-10T08:37:34.590531+0000","last_peered":"2024-09-10T08:37:34.590531+0000","last_clean":"2024-09-10T08:37:34.590531+0000","last_became_active":"2024-09-10T08:37:33.265463+0000","last_became_peered":"2024-09-10T08:37:33.265463+0000","last_unstale":"2024-09-10T08:37:34.590531+0000","last_undegraded":"2024-09-10T08:37:34.590531+0000","last_fullsized":"2024-09-10T08:37:34.590531+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:52.978761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590098+0000","last_change":"2024-09-10T08:37:32.258146+0000","last_active":"2024-09-10T08:37:34.590098+0000","last_peered":"2024-09-10T08:37:34.590098+0000","last_clean":"2024-09-10T08:37:34.590098+0000","last_became_active":"2024-09-10T08:37:32.256674+0000","last_became_peered":"2024-09-10T08:37:32.256674+0000","last_unstale":"2024-09-10T08:37:34.590098+0000","last_undegraded":"2024-09-10T08:37:34.590098+0000","last_fullsized":"2024-09-10T08:37:34.590098+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:36.944614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590145+0000","last_change":"2024-09-10T08:37:33.267402+0000","last_active":"2024-09-10T08:37:34.590145+0000","last_peered":"2024-09-10T08:37:34.590145+0000","last_clean":"2024-09-10T08:37:34.590145+0000","last_became_active":"2024-09-10T08:37:33.267123+0000","last_became_peered":"2024-09-10T08:37:33.267123+0000","last_unstale":"2024-09-10T08:37:34.590145+0000","last_undegraded":"2024-09-10T08:37:34.590145+0000","last_fullsized":"2024-09-10T08:37:34.590145+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:51.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260279+0000","last_change":"2024-09-10T08:37:32.264213+0000","last_active":"2024-09-10T08:37:33.260279+0000","last_peered":"2024-09-10T08:37:33.260279+0000","last_clean":"2024-09-10T08:37:33.260279+0000","last_became_active":"2024-09-10T08:37:32.263871+0000","last_became_peered":"2024-09-10T08:37:32.263871+0000","last_unstale":"2024-09-10T08:37:33.260279+0000","last_undegraded":"2024-09-10T08:37:33.260279+0000","last_fullsized":"2024-09-10T08:37:33.260279+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:45.181055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258559+0000","last_change":"2024-09-10T08:37:33.275751+0000","last_active":"2024-09-10T08:37:34.258559+0000","last_peered":"2024-09-10T08:37:34.258559+0000","last_clean":"2024-09-10T08:37:34.258559+0000","last_became_active":"2024-09-10T08:37:33.275392+0000","last_became_peered":"2024-09-10T08:37:33.275392+0000","last_unstale":"2024-09-10T08:37:34.258559+0000","last_undegraded":"2024-09-10T08:37:34.258559+0000","last_fullsized":"2024-09-10T08:37:34.258559+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:38.646358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"134'8","reported_seq":22,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258336+0000","last_change":"2024-09-10T08:37:32.257286+0000","last_active":"2024-09-10T08:37:34.258336+0000","last_peered":"2024-09-10T08:37:34.258336+0000","last_clean":"2024-09-10T08:37:34.258336+0000","last_became_active":"2024-09-10T08:37:32.256962+0000","last_became_peered":"2024-09-10T08:37:32.256962+0000","last_unstale":"2024-09-10T08:37:34.258336+0000","last_undegraded":"2024-09-10T08:37:34.258336+0000","last_fullsized":"2024-09-10T08:37:34.258336+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:08.437185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.263098+0000","last_change":"2024-09-10T08:37:33.259871+0000","last_active":"2024-09-10T08:37:33.263098+0000","last_peered":"2024-09-10T08:37:33.263098+0000","last_clean":"2024-09-10T08:37:33.263098+0000","last_became_active":"2024-09-10T08:37:33.259615+0000","last_became_peered":"2024-09-10T08:37:33.259615+0000","last_unstale":"2024-09-10T08:37:33.263098+0000","last_undegraded":"2024-09-10T08:37:33.263098+0000","last_fullsized":"2024-09-10T08:37:33.263098+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:56.399218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259849+0000","last_change":"2024-09-10T08:37:32.259712+0000","last_active":"2024-09-10T08:37:34.259849+0000","last_peered":"2024-09-10T08:37:34.259849+0000","last_clean":"2024-09-10T08:37:34.259849+0000","last_became_active":"2024-09-10T08:37:32.259362+0000","last_became_peered":"2024-09-10T08:37:32.259362+0000","last_unstale":"2024-09-10T08:37:34.259849+0000","last_undegraded":"2024-09-10T08:37:34.259849+0000","last_fullsized":"2024-09-10T08:37:34.259849+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:35.704859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.278737+0000","last_change":"2024-09-10T08:37:33.272685+0000","last_active":"2024-09-10T08:37:33.278737+0000","last_peered":"2024-09-10T08:37:33.278737+0000","last_clean":"2024-09-10T08:37:33.278737+0000","last_became_active":"2024-09-10T08:37:33.271470+0000","last_became_peered":"2024-09-10T08:37:33.271470+0000","last_unstale":"2024-09-10T08:37:33.278737+0000","last_undegraded":"2024-09-10T08:37:33.278737+0000","last_fullsized":"2024-09-10T08:37:33.278737+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:59.485873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"134'2","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279620+0000","last_change":"2024-09-10T08:37:32.257520+0000","last_active":"2024-09-10T08:37:33.279620+0000","last_peered":"2024-09-10T08:37:33.279620+0000","last_clean":"2024-09-10T08:37:33.279620+0000","last_became_active":"2024-09-10T08:37:32.257239+0000","last_became_peered":"2024-09-10T08:37:32.257239+0000","last_unstale":"2024-09-10T08:37:33.279620+0000","last_undegraded":"2024-09-10T08:37:33.279620+0000","last_fullsized":"2024-09-10T08:37:33.279620+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:19.072992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271935+0000","last_change":"2024-09-10T08:37:33.262093+0000","last_active":"2024-09-10T08:37:33.271935+0000","last_peered":"2024-09-10T08:37:33.271935+0000","last_clean":"2024-09-10T08:37:33.271935+0000","last_became_active":"2024-09-10T08:37:33.261804+0000","last_became_peered":"2024-09-10T08:37:33.261804+0000","last_unstale":"2024-09-10T08:37:33.271935+0000","last_undegraded":"2024-09-10T08:37:33.271935+0000","last_fullsized":"2024-09-10T08:37:33.271935+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:37.764741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"134'1","reported_seq":15,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259447+0000","last_change":"2024-09-10T08:37:32.259275+0000","last_active":"2024-09-10T08:37:34.259447+0000","last_peered":"2024-09-10T08:37:34.259447+0000","last_clean":"2024-09-10T08:37:34.259447+0000","last_became_active":"2024-09-10T08:37:32.257939+0000","last_became_peered":"2024-09-10T08:37:32.257939+0000","last_unstale":"2024-09-10T08:37:34.259447+0000","last_undegraded":"2024-09-10T08:37:34.259447+0000","last_fullsized":"2024-09-10T08:37:34.259447+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:24:45.773724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.275452+0000","last_change":"2024-09-10T08:37:33.270830+0000","last_active":"2024-09-10T08:37:33.275452+0000","last_peered":"2024-09-10T08:37:33.275452+0000","last_clean":"2024-09-10T08:37:33.275452+0000","last_became_active":"2024-09-10T08:37:33.270239+0000","last_became_peered":"2024-09-10T08:37:33.270239+0000","last_unstale":"2024-09-10T08:37:33.275452+0000","last_undegraded":"2024-09-10T08:37:33.275452+0000","last_fullsized":"2024-09-10T08:37:33.275452+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:00.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.257236+0000","last_change":"2024-09-10T08:37:32.250666+0000","last_active":"2024-09-10T08:37:33.257236+0000","last_peered":"2024-09-10T08:37:33.257236+0000","last_clean":"2024-09-10T08:37:33.257236+0000","last_became_active":"2024-09-10T08:37:32.248703+0000","last_became_peered":"2024-09-10T08:37:32.248703+0000","last_unstale":"2024-09-10T08:37:33.257236+0000","last_undegraded":"2024-09-10T08:37:33.257236+0000","last_fullsized":"2024-09-10T08:37:33.257236+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:49:29.130632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271613+0000","last_change":"2024-09-10T08:37:33.265960+0000","last_active":"2024-09-10T08:37:33.271613+0000","last_peered":"2024-09-10T08:37:33.271613+0000","last_clean":"2024-09-10T08:37:33.271613+0000","last_became_active":"2024-09-10T08:37:33.265615+0000","last_became_peered":"2024-09-10T08:37:33.265615+0000","last_unstale":"2024-09-10T08:37:33.271613+0000","last_undegraded":"2024-09-10T08:37:33.271613+0000","last_fullsized":"2024-09-10T08:37:33.271613+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:51.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259728+0000","last_change":"2024-09-10T08:37:32.261037+0000","last_active":"2024-09-10T08:37:34.259728+0000","last_peered":"2024-09-10T08:37:34.259728+0000","last_clean":"2024-09-10T08:37:34.259728+0000","last_became_active":"2024-09-10T08:37:32.260037+0000","last_became_peered":"2024-09-10T08:37:32.260037+0000","last_unstale":"2024-09-10T08:37:34.259728+0000","last_undegraded":"2024-09-10T08:37:34.259728+0000","last_fullsized":"2024-09-10T08:37:34.259728+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:40.238657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.279237+0000","last_change":"2024-09-10T08:37:33.275584+0000","last_active":"2024-09-10T08:37:33.279237+0000","last_peered":"2024-09-10T08:37:33.279237+0000","last_clean":"2024-09-10T08:37:33.279237+0000","last_became_active":"2024-09-10T08:37:33.275347+0000","last_became_peered":"2024-09-10T08:37:33.275347+0000","last_unstale":"2024-09-10T08:37:33.279237+0000","last_undegraded":"2024-09-10T08:37:33.279237+0000","last_fullsized":"2024-09-10T08:37:33.279237+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:45.786384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259913+0000","last_change":"2024-09-10T08:37:32.263378+0000","last_active":"2024-09-10T08:37:34.259913+0000","last_peered":"2024-09-10T08:37:34.259913+0000","last_clean":"2024-09-10T08:37:34.259913+0000","last_became_active":"2024-09-10T08:37:32.263038+0000","last_became_peered":"2024-09-10T08:37:32.263038+0000","last_unstale":"2024-09-10T08:37:34.259913+0000","last_undegraded":"2024-09-10T08:37:34.259913+0000","last_fullsized":"2024-09-10T08:37:34.259913+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:49:44.000886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590378+0000","last_change":"2024-09-10T08:37:33.276224+0000","last_active":"2024-09-10T08:37:34.590378+0000","last_peered":"2024-09-10T08:37:34.590378+0000","last_clean":"2024-09-10T08:37:34.590378+0000","last_became_active":"2024-09-10T08:37:33.273041+0000","last_became_peered":"2024-09-10T08:37:33.273041+0000","last_unstale":"2024-09-10T08:37:34.590378+0000","last_undegraded":"2024-09-10T08:37:34.590378+0000","last_fullsized":"2024-09-10T08:37:34.590378+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:28.809197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590074+0000","last_change":"2024-09-10T08:37:32.264783+0000","last_active":"2024-09-10T08:37:34.590074+0000","last_peered":"2024-09-10T08:37:34.590074+0000","last_clean":"2024-09-10T08:37:34.590074+0000","last_became_active":"2024-09-10T08:37:32.264398+0000","last_became_peered":"2024-09-10T08:37:32.264398+0000","last_unstale":"2024-09-10T08:37:34.590074+0000","last_undegraded":"2024-09-10T08:37:34.590074+0000","last_fullsized":"2024-09-10T08:37:34.590074+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:44:52.576355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258522+0000","last_change":"2024-09-10T08:37:33.259385+0000","last_active":"2024-09-10T08:37:34.258522+0000","last_peered":"2024-09-10T08:37:34.258522+0000","last_clean":"2024-09-10T08:37:34.258522+0000","last_became_active":"2024-09-10T08:37:33.259111+0000","last_became_peered":"2024-09-10T08:37:33.259111+0000","last_unstale":"2024-09-10T08:37:34.258522+0000","last_undegraded":"2024-09-10T08:37:34.258522+0000","last_fullsized":"2024-09-10T08:37:34.258522+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:41:56.399218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260819+0000","last_change":"2024-09-10T08:37:32.255262+0000","last_active":"2024-09-10T08:37:33.260819+0000","last_peered":"2024-09-10T08:37:33.260819+0000","last_clean":"2024-09-10T08:37:33.260819+0000","last_became_active":"2024-09-10T08:37:32.254796+0000","last_became_peered":"2024-09-10T08:37:32.254796+0000","last_unstale":"2024-09-10T08:37:33.260819+0000","last_undegraded":"2024-09-10T08:37:33.260819+0000","last_fullsized":"2024-09-10T08:37:33.260819+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:57.833814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.283372+0000","last_change":"2024-09-10T08:37:33.282506+0000","last_active":"2024-09-10T08:37:33.283372+0000","last_peered":"2024-09-10T08:37:33.283372+0000","last_clean":"2024-09-10T08:37:33.283372+0000","last_became_active":"2024-09-10T08:37:33.282139+0000","last_became_peered":"2024-09-10T08:37:33.282139+0000","last_unstale":"2024-09-10T08:37:33.283372+0000","last_undegraded":"2024-09-10T08:37:33.283372+0000","last_fullsized":"2024-09-10T08:37:33.283372+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:56.745893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259721+0000","last_change":"2024-09-10T08:37:32.257246+0000","last_active":"2024-09-10T08:37:34.259721+0000","last_peered":"2024-09-10T08:37:34.259721+0000","last_clean":"2024-09-10T08:37:34.259721+0000","last_became_active":"2024-09-10T08:37:32.256942+0000","last_became_peered":"2024-09-10T08:37:32.256942+0000","last_unstale":"2024-09-10T08:37:34.259721+0000","last_undegraded":"2024-09-10T08:37:34.259721+0000","last_fullsized":"2024-09-10T08:37:34.259721+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.492245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.271276+0000","last_change":"2024-09-10T08:37:33.267469+0000","last_active":"2024-09-10T08:37:33.271276+0000","last_peered":"2024-09-10T08:37:33.271276+0000","last_clean":"2024-09-10T08:37:33.271276+0000","last_became_active":"2024-09-10T08:37:33.266800+0000","last_became_peered":"2024-09-10T08:37:33.266800+0000","last_unstale":"2024-09-10T08:37:33.271276+0000","last_undegraded":"2024-09-10T08:37:33.271276+0000","last_fullsized":"2024-09-10T08:37:33.271276+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:01.591096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.259027+0000","last_change":"2024-09-10T08:37:32.265995+0000","last_active":"2024-09-10T08:37:33.259027+0000","last_peered":"2024-09-10T08:37:33.259027+0000","last_clean":"2024-09-10T08:37:33.259027+0000","last_became_active":"2024-09-10T08:37:32.265047+0000","last_became_peered":"2024-09-10T08:37:32.265047+0000","last_unstale":"2024-09-10T08:37:33.259027+0000","last_undegraded":"2024-09-10T08:37:33.259027+0000","last_fullsized":"2024-09-10T08:37:33.259027+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:42.687342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590318+0000","last_change":"2024-09-10T08:37:33.272021+0000","last_active":"2024-09-10T08:37:34.590318+0000","last_peered":"2024-09-10T08:37:34.590318+0000","last_clean":"2024-09-10T08:37:34.590318+0000","last_became_active":"2024-09-10T08:37:33.271712+0000","last_became_peered":"2024-09-10T08:37:33.271712+0000","last_unstale":"2024-09-10T08:37:34.590318+0000","last_undegraded":"2024-09-10T08:37:34.590318+0000","last_fullsized":"2024-09-10T08:37:34.590318+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:48.958311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259742+0000","last_change":"2024-09-10T08:37:32.265367+0000","last_active":"2024-09-10T08:37:34.259742+0000","last_peered":"2024-09-10T08:37:34.259742+0000","last_clean":"2024-09-10T08:37:34.259742+0000","last_became_active":"2024-09-10T08:37:32.265086+0000","last_became_peered":"2024-09-10T08:37:32.265086+0000","last_unstale":"2024-09-10T08:37:34.259742+0000","last_undegraded":"2024-09-10T08:37:34.259742+0000","last_fullsized":"2024-09-10T08:37:34.259742+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:53:38.552310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259356+0000","last_change":"2024-09-10T08:37:33.281816+0000","last_active":"2024-09-10T08:37:34.259356+0000","last_peered":"2024-09-10T08:37:34.259356+0000","last_clean":"2024-09-10T08:37:34.259356+0000","last_became_active":"2024-09-10T08:37:33.278329+0000","last_became_peered":"2024-09-10T08:37:33.278329+0000","last_unstale":"2024-09-10T08:37:34.259356+0000","last_undegraded":"2024-09-10T08:37:34.259356+0000","last_fullsized":"2024-09-10T08:37:34.259356+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:11.860156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590495+0000","last_change":"2024-09-10T08:37:32.261196+0000","last_active":"2024-09-10T08:37:34.590495+0000","last_peered":"2024-09-10T08:37:34.590495+0000","last_clean":"2024-09-10T08:37:34.590495+0000","last_became_active":"2024-09-10T08:37:32.260946+0000","last_became_peered":"2024-09-10T08:37:32.260946+0000","last_unstale":"2024-09-10T08:37:34.590495+0000","last_undegraded":"2024-09-10T08:37:34.590495+0000","last_fullsized":"2024-09-10T08:37:34.590495+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:08:20.014419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259019+0000","last_change":"2024-09-10T08:37:33.266996+0000","last_active":"2024-09-10T08:37:34.259019+0000","last_peered":"2024-09-10T08:37:34.259019+0000","last_clean":"2024-09-10T08:37:34.259019+0000","last_became_active":"2024-09-10T08:37:33.265487+0000","last_became_peered":"2024-09-10T08:37:33.265487+0000","last_unstale":"2024-09-10T08:37:34.259019+0000","last_undegraded":"2024-09-10T08:37:34.259019+0000","last_fullsized":"2024-09-10T08:37:34.259019+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:48.983989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.249744+0000","last_change":"2024-09-10T08:37:32.249265+0000","last_active":"2024-09-10T08:37:33.249744+0000","last_peered":"2024-09-10T08:37:33.249744+0000","last_clean":"2024-09-10T08:37:33.249744+0000","last_became_active":"2024-09-10T08:37:32.248924+0000","last_became_peered":"2024-09-10T08:37:32.248924+0000","last_unstale":"2024-09-10T08:37:33.249744+0000","last_undegraded":"2024-09-10T08:37:33.249744+0000","last_fullsized":"2024-09-10T08:37:33.249744+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:27:51.049040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258830+0000","last_change":"2024-09-10T08:37:33.263588+0000","last_active":"2024-09-10T08:37:34.258830+0000","last_peered":"2024-09-10T08:37:34.258830+0000","last_clean":"2024-09-10T08:37:34.258830+0000","last_became_active":"2024-09-10T08:37:33.261952+0000","last_became_peered":"2024-09-10T08:37:33.261952+0000","last_unstale":"2024-09-10T08:37:34.258830+0000","last_undegraded":"2024-09-10T08:37:34.258830+0000","last_fullsized":"2024-09-10T08:37:34.258830+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:46.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258537+0000","last_change":"2024-09-10T08:37:32.263511+0000","last_active":"2024-09-10T08:37:34.258537+0000","last_peered":"2024-09-10T08:37:34.258537+0000","last_clean":"2024-09-10T08:37:34.258537+0000","last_became_active":"2024-09-10T08:37:32.263138+0000","last_became_peered":"2024-09-10T08:37:32.263138+0000","last_unstale":"2024-09-10T08:37:34.258537+0000","last_undegraded":"2024-09-10T08:37:34.258537+0000","last_fullsized":"2024-09-10T08:37:34.258537+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:48.849131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259973+0000","last_change":"2024-09-10T08:37:33.259983+0000","last_active":"2024-09-10T08:37:34.259973+0000","last_peered":"2024-09-10T08:37:34.259973+0000","last_clean":"2024-09-10T08:37:34.259973+0000","last_became_active":"2024-09-10T08:37:33.257219+0000","last_became_peered":"2024-09-10T08:37:33.257219+0000","last_unstale":"2024-09-10T08:37:34.259973+0000","last_undegraded":"2024-09-10T08:37:34.259973+0000","last_fullsized":"2024-09-10T08:37:34.259973+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:51.200525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260424+0000","last_change":"2024-09-10T08:37:32.264221+0000","last_active":"2024-09-10T08:37:33.260424+0000","last_peered":"2024-09-10T08:37:33.260424+0000","last_clean":"2024-09-10T08:37:33.260424+0000","last_became_active":"2024-09-10T08:37:32.263903+0000","last_became_peered":"2024-09-10T08:37:32.263903+0000","last_unstale":"2024-09-10T08:37:33.260424+0000","last_undegraded":"2024-09-10T08:37:33.260424+0000","last_fullsized":"2024-09-10T08:37:33.260424+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:46:05.076207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590207+0000","last_change":"2024-09-10T08:37:33.275450+0000","last_active":"2024-09-10T08:37:34.590207+0000","last_peered":"2024-09-10T08:37:34.590207+0000","last_clean":"2024-09-10T08:37:34.590207+0000","last_became_active":"2024-09-10T08:37:33.274577+0000","last_became_peered":"2024-09-10T08:37:33.274577+0000","last_unstale":"2024-09-10T08:37:34.590207+0000","last_undegraded":"2024-09-10T08:37:34.590207+0000","last_fullsized":"2024-09-10T08:37:34.590207+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:00.965250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.590485+0000","last_change":"2024-09-10T08:37:32.259315+0000","last_active":"2024-09-10T08:37:34.590485+0000","last_peered":"2024-09-10T08:37:34.590485+0000","last_clean":"2024-09-10T08:37:34.590485+0000","last_became_active":"2024-09-10T08:37:32.258464+0000","last_became_peered":"2024-09-10T08:37:32.258464+0000","last_unstale":"2024-09-10T08:37:34.590485+0000","last_undegraded":"2024-09-10T08:37:34.590485+0000","last_fullsized":"2024-09-10T08:37:34.590485+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:29.787016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.259486+0000","last_change":"2024-09-10T08:37:33.266560+0000","last_active":"2024-09-10T08:37:34.259486+0000","last_peered":"2024-09-10T08:37:34.259486+0000","last_clean":"2024-09-10T08:37:34.259486+0000","last_became_active":"2024-09-10T08:37:33.266205+0000","last_became_peered":"2024-09-10T08:37:33.266205+0000","last_unstale":"2024-09-10T08:37:34.259486+0000","last_undegraded":"2024-09-10T08:37:34.259486+0000","last_fullsized":"2024-09-10T08:37:34.259486+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:32.229674+0000","last_clean_scrub_stamp":"2024-09-10T08:37:32.229674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:05.087901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"134'2","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-10T08:37:34.258965+0000","last_change":"2024-09-10T08:37:32.261319+0000","last_active":"2024-09-10T08:37:34.258965+0000","last_peered":"2024-09-10T08:37:34.258965+0000","last_clean":"2024-09-10T08:37:34.258965+0000","last_became_active":"2024-09-10T08:37:32.258960+0000","last_became_peered":"2024-09-10T08:37:32.258960+0000","last_unstale":"2024-09-10T08:37:34.258965+0000","last_undegraded":"2024-09-10T08:37:34.258965+0000","last_fullsized":"2024-09-10T08:37:34.258965+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:37:31.226504+0000","last_clean_scrub_stamp":"2024-09-10T08:37:31.226504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:56:49.610269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":372,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-10T08:37:33.260445+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:37:33.260445+0000","last_peered":"2024-09-10T08:37:33.260445+0000","last_clean":"2024-09-10T08:37:33.260445+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:37:33.260445+0000","last_undegraded":"2024-09-10T08:37:33.260445+0000","last_fullsized":"2024-09-10T08:37:33.260445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45312,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326528,"statfs":{"total":96636764160,"available":96590364672,"internally_reserved":0,"allocated":1679360,"data_stored":735100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509551,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50864,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320976,"statfs":{"total":96636764160,"available":96584679424,"internally_reserved":0,"allocated":1662976,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50860,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320980,"statfs":{"total":96636764160,"available":96584683520,"internally_reserved":0,"allocated":1662976,"data_stored":728766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1667072,"data_stored":728836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55032,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316808,"statfs":{"total":96636764160,"available":96580411392,"internally_reserved":0,"allocated":1671168,"data_stored":729438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51456,"kb_used_data":2220,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320384,"statfs":{"total":96636764160,"available":96584073216,"internally_reserved":0,"allocated":2273280,"data_stored":1320768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1695744,"data_stored":736734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542254,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51452,"kb_used_data":2216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320388,"statfs":{"total":96636764160,"available":96584077312,"internally_reserved":0,"allocated":2269184,"data_stored":1319876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:37:37.889 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:37:37.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:37:38.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 Processor -- start 2024-09-10T08:37:38.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 -- start start 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 0x7f5e2815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e28162a00 0x7f5e28162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2815f2b0 con 0x7f5e280b5520 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2815f550 con 0x7f5e28162a00 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.089+0000 7f5e2fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2815f830 con 0x7f5e2815e990 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2ca00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e280b5520 0x7f5e2806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60984/0 (socket says 172.21.15.52:60984) 2024-09-10T08:37:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2ca00640 1 -- 172.21.15.52:0/2927634335 learned_addr learned my addr 172.21.15.52:0/2927634335 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:38.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 --2- 172.21.15.52:0/2927634335 >> v2:172.21.15.52:3300/0 conn(0x7f5e28162a00 0x7f5e28162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2d400640 1 --2- 172.21.15.52:0/2927634335 >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 0x7f5e2815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e27e00640 1 -- 172.21.15.52:0/2927634335 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28707746 0 0) 0x7f5e2815f2b0 con 0x7f5e280b5520 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e27e00640 1 -- 172.21.15.52:0/2927634335 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e10003520 con 0x7f5e280b5520 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 -- 172.21.15.52:0/2927634335 >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 msgr2=0x7f5e2815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 --2- 172.21.15.52:0/2927634335 >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 0x7f5e2815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 -- 172.21.15.52:0/2927634335 >> v1:172.21.15.52:6789/0 conn(0x7f5e280b5520 legacy=0x7f5e2806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 -- 172.21.15.52:0/2927634335 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2815fb10 con 0x7f5e28162a00 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2d400640 1 --2- 172.21.15.52:0/2927634335 >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 0x7f5e2815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e2de00640 1 --2- 172.21.15.52:0/2927634335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e28162e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f5e28068890 tx=0x7f5e2002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8855bd0148827cad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e27e00640 1 -- 172.21.15.52:0/2927634335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20007740 con 0x7f5e28162a00 2024-09-10T08:37:38.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e27e00640 1 -- 172.21.15.52:0/2927634335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200078e0 con 0x7f5e28162a00 2024-09-10T08:37:38.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.091+0000 7f5e27e00640 1 -- 172.21.15.52:0/2927634335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20007cb0 con 0x7f5e28162a00 2024-09-10T08:37:38.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 -- 172.21.15.52:0/2927634335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 msgr2=0x7f5e28162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/2927634335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e28162e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f5e28068890 tx=0x7f5e2002a680 comp rx=0 tx=0).stop 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 -- 172.21.15.52:0/2927634335 shutdown_connections 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/2927634335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e28162e70 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/2927634335 >> v2:172.21.15.176:3300/0 conn(0x7f5e2815e990 0x7f5e2815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 -- 172.21.15.52:0/2927634335 >> 172.21.15.52:0/2927634335 conn(0x7f5e280d25d0 msgr2=0x7f5e280d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 -- 172.21.15.52:0/2927634335 shutdown_connections 2024-09-10T08:37:38.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.092+0000 7f5e2fe00640 1 -- 172.21.15.52:0/2927634335 wait complete. 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.094+0000 7f5e2fe00640 1 Processor -- start 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.094+0000 7f5e2fe00640 1 -- start start 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e280b5520 0x7f5e280d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 0x7f5e281e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2806d430 con 0x7f5e28162a00 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280b6ff0 con 0x7f5e280b5520 2024-09-10T08:37:38.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5e28158840 con 0x7f5e2815e990 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56962/0 (socket says 172.21.15.52:56962) 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 -- 172.21.15.52:0/1407156487 learned_addr learned my addr 172.21.15.52:0/1407156487 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2d400640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e280b5520 0x7f5e280d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2ca00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 0x7f5e281e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 -- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 msgr2=0x7f5e281e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 0x7f5e281e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 -- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e280b5520 msgr2=0x7f5e280d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e280b5520 0x7f5e280d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 -- 172.21.15.52:0/1407156487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e281e82d0 con 0x7f5e28162a00 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2ca00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 0x7f5e281e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2de00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2003f070 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20031bf0 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009450 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e280d0ea0 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.096+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2815a430 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.097+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e28162e70 con 0x7f5e28162a00 2024-09-10T08:37:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.098+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e2003b410 con 0x7f5e28162a00 2024-09-10T08:37:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.100+0000 7f5e25600640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.100+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f5e200ac4f0 con 0x7f5e28162a00 2024-09-10T08:37:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.100+0000 7f5e2d400640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.101+0000 7f5e2d400640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 0x7f5e0806e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c006fd0 tx=0x7f5e1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.104+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e2007ae90 con 0x7f5e28162a00 2024-09-10T08:37:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.356+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5e280b1e70 con 0x7f5e28162a00 2024-09-10T08:37:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.359+0000 7f5e25600640 1 -- 172.21.15.52:0/1407156487 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f5e2007a790 con 0x7f5e28162a00 2024-09-10T08:37:38.359 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:37:38.359 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:37:38.360 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:37:38.360 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:37:38.360 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:37:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 msgr2=0x7f5e0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 0x7f5e0806e320 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c006fd0 tx=0x7f5e1c008040 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 msgr2=0x7f5e2815ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e20004a40 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 shutdown_connections 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e0806be60 0x7f5e0806e320 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e28162a00 0x7f5e2815ac60 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e2815e990 0x7f5e281e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 --2- 172.21.15.52:0/1407156487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e280b5520 0x7f5e280d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 >> 172.21.15.52:0/1407156487 conn(0x7f5e280d25d0 msgr2=0x7f5e28161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 shutdown_connections 2024-09-10T08:37:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.362+0000 7f5e2fe00640 1 -- 172.21.15.52:0/1407156487 wait complete. 2024-09-10T08:37:38.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:37:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.535+0000 7fb1f2400640 1 Processor -- start 2024-09-10T08:37:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.535+0000 7fb1f2400640 1 -- start start 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1f2400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 0x7fb1ec06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1f2400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 0x7fb1ec073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1f2400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ec072520 con 0x7fb1ec15af20 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1f2400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb1ec071010 con 0x7fb1ec15ab40 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1f2400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec0712f0 con 0x7fb1ec0720b0 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1ebe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb1ec15af20 0x7fb1ec15b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60996/0 (socket says 172.21.15.52:60996) 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1ebe00640 1 -- 172.21.15.52:0/1188054366 learned_addr learned my addr 172.21.15.52:0/1188054366 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1188054366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 0x7fb1ec073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eb400640 1 --2- 172.21.15.52:0/1188054366 >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 0x7fb1ec06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1ea000640 1 -- 172.21.15.52:0/1188054366 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667232061 0 0) 0x7fb1ec072520 con 0x7fb1ec15af20 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1ea000640 1 -- 172.21.15.52:0/1188054366 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d0005730 con 0x7fb1ec15af20 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1188054366 >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 msgr2=0x7fb1ec06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1188054366 >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 0x7fb1ec06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1188054366 >> v1:172.21.15.52:6789/0 conn(0x7fb1ec15af20 legacy=0x7fb1ec15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1188054366 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec0715d0 con 0x7fb1ec0720b0 2024-09-10T08:37:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.536+0000 7fb1eb400640 1 --2- 172.21.15.52:0/1188054366 >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 0x7fb1ec06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:37:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.537+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1188054366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 0x7fb1ec073990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80097a0 tx=0x7fb1d802a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d4fcc294ea4c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1ea000640 1 -- 172.21.15.52:0/1188054366 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8037070 con 0x7fb1ec0720b0 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1ea000640 1 -- 172.21.15.52:0/1188054366 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d802ae40 con 0x7fb1ec0720b0 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1ea000640 1 -- 172.21.15.52:0/1188054366 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8032660 con 0x7fb1ec0720b0 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 -- 172.21.15.52:0/1188054366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 msgr2=0x7fb1ec073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1188054366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 0x7fb1ec073990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80097a0 tx=0x7fb1d802a0f0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 -- 172.21.15.52:0/1188054366 shutdown_connections 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1188054366 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec0720b0 0x7fb1ec073990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1188054366 >> v2:172.21.15.176:3300/0 conn(0x7fb1ec15ab40 0x7fb1ec06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 -- 172.21.15.52:0/1188054366 >> 172.21.15.52:0/1188054366 conn(0x7fb1ec0ccec0 msgr2=0x7fb1ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 -- 172.21.15.52:0/1188054366 shutdown_connections 2024-09-10T08:37:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.538+0000 7fb1f2400640 1 -- 172.21.15.52:0/1188054366 wait complete. 2024-09-10T08:37:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.540+0000 7fb1f2400640 1 Processor -- start 2024-09-10T08:37:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.540+0000 7fb1f2400640 1 -- start start 2024-09-10T08:37:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ec0720b0 0x7fb1ec157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec15af20 0x7fb1ec0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec073ed0 con 0x7fb1ec15ab40 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec15baa0 con 0x7fb1ec0720b0 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1f2400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ec06bc10 con 0x7fb1ec15af20 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56968/0 (socket says 172.21.15.52:56968) 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1492474051 learned_addr learned my addr 172.21.15.52:0/1492474051 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1eb400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ec0720b0 0x7fb1ec157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.541+0000 7fb1ebe00640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec15af20 0x7fb1ec0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec15af20 msgr2=0x7fb1ec0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec15af20 0x7fb1ec0ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ec0720b0 msgr2=0x7fb1ec157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ec0720b0 0x7fb1ec157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 -- 172.21.15.52:0/1492474051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec0ab8e0 con 0x7fb1ec15ab40 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1eaa00640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fb1d802a6e0 tx=0x7fb1d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8042020 con 0x7fb1ec15ab40 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d803d470 con 0x7fb1ec15ab40 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8037040 con 0x7fb1ec15ab40 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.542+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec0abbc0 con 0x7fb1ec15ab40 2024-09-10T08:37:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.543+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec0ac180 con 0x7fb1ec15ab40 2024-09-10T08:37:38.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.543+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec06c070 con 0x7fb1ec15ab40 2024-09-10T08:37:38.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.544+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb1d8045020 con 0x7fb1ec15ab40 2024-09-10T08:37:38.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.545+0000 7fb1e3400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:38.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.545+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fb1d80ab2d0 con 0x7fb1ec15ab40 2024-09-10T08:37:38.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.546+0000 7fb1eb400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:38.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.547+0000 7fb1eb400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00a570 tx=0x7fb1dc00a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:38.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.549+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1d804c070 con 0x7fb1ec15ab40 2024-09-10T08:37:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.772+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1ec154970 con 0x7fb1ec15ab40 2024-09-10T08:37:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.773+0000 7fb1e3400640 1 -- 172.21.15.52:0/1492474051 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7fb1d8079590 con 0x7fb1ec15ab40 2024-09-10T08:37:38.773 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:37:38.773 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:37:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.775+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 msgr2=0x7fb1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.775+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00a570 tx=0x7fb1dc00a2a0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.775+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 msgr2=0x7fb1ec1503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.775+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fb1d802a6e0 tx=0x7fb1d80046c0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 shutdown_connections 2024-09-10T08:37:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1cc06be30 0x7fb1cc06e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb1ec15af20 0x7fb1ec0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1ec15ab40 0x7fb1ec1503f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 --2- 172.21.15.52:0/1492474051 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1ec0720b0 0x7fb1ec157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 >> 172.21.15.52:0/1492474051 conn(0x7fb1ec0ccec0 msgr2=0x7fb1ec153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 shutdown_connections 2024-09-10T08:37:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:38.776+0000 7fb1f2400640 1 -- 172.21.15.52:0/1492474051 wait complete. 2024-09-10T08:37:39.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:37:32.672925+0000', 'modified': '2024-09-10T08:37:35.687495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8316}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8316': {'gid': 8316, 'name': 'c', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/1386898992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 1386898992}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 1386898992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8316, 'qdb_cluster': [8316]} 2024-09-10T08:37:39.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:37:39.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:37:39.220 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:37:39.221+0000 7f6e57400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:37:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.352+0000 7f8f8ea00640 1 Processor -- start 2024-09-10T08:37:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.353+0000 7f8f8ea00640 1 -- start start 2024-09-10T08:37:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f880cf9a0 0x7f8f8815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8ea00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f880b4370 con 0x7f8f880cf5c0 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8ea00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f880b4dc0 con 0x7f8f880b3e00 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8ea00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8f880b4650 con 0x7f8f880cf9a0 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f880cf9a0 0x7f8f8815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8d600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8f880cf5c0 0x7f8f880b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:60998/0 (socket says 172.21.15.52:60998) 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.354+0000 7f8f8d600640 1 -- 172.21.15.52:0/3404904610 learned_addr learned my addr 172.21.15.52:0/3404904610 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.355+0000 7f8f8e000640 1 -- 172.21.15.52:0/3404904610 >> v1:172.21.15.176:6789/0 conn(0x7f8f880b3e00 legacy=0x7f8f8815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.355+0000 7f8f8e000640 1 -- 172.21.15.52:0/3404904610 >> v1:172.21.15.52:6789/0 conn(0x7f8f880cf5c0 legacy=0x7f8f880b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.355+0000 7f8f8e000640 1 -- 172.21.15.52:0/3404904610 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f880b50a0 con 0x7f8f880cf9a0 2024-09-10T08:37:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f8e000640 1 --2- 172.21.15.52:0/3404904610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880cf9a0 0x7f8f8815c6f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009d90 tx=0x7f8f8002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652f88209267aaee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f87e00640 1 -- 172.21.15.52:0/3404904610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80031600 con 0x7f8f880cf9a0 2024-09-10T08:37:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f87e00640 1 -- 172.21.15.52:0/3404904610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f800317a0 con 0x7f8f880cf9a0 2024-09-10T08:37:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f87e00640 1 -- 172.21.15.52:0/3404904610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80031b70 con 0x7f8f880cf9a0 2024-09-10T08:37:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f8ea00640 1 -- 172.21.15.52:0/3404904610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880cf9a0 msgr2=0x7f8f8815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.356+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/3404904610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880cf9a0 0x7f8f8815c6f0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009d90 tx=0x7f8f8002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.357+0000 7f8f8ea00640 1 -- 172.21.15.52:0/3404904610 shutdown_connections 2024-09-10T08:37:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.357+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/3404904610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880cf9a0 0x7f8f8815c6f0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.357+0000 7f8f8ea00640 1 -- 172.21.15.52:0/3404904610 >> 172.21.15.52:0/3404904610 conn(0x7f8f8806c240 msgr2=0x7f8f8806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.357+0000 7f8f8ea00640 1 -- 172.21.15.52:0/3404904610 shutdown_connections 2024-09-10T08:37:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.357+0000 7f8f8ea00640 1 -- 172.21.15.52:0/3404904610 wait complete. 2024-09-10T08:37:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.358+0000 7f8f8ea00640 1 Processor -- start 2024-09-10T08:37:39.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.358+0000 7f8f8ea00640 1 -- start start 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f880cf5c0 0x7f8f88141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 0x7f8f880c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8815cdb0 con 0x7f8f880b3e00 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8815cc30 con 0x7f8f880cf5c0 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.359+0000 7f8f8ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f88167230 con 0x7f8f880cf9a0 2024-09-10T08:37:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56990/0 (socket says 172.21.15.52:56990) 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 -- 172.21.15.52:0/4278407607 learned_addr learned my addr 172.21.15.52:0/4278407607 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f880cf5c0 0x7f8f88141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8e000640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 0x7f8f880c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 -- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 msgr2=0x7f8f880c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 0x7f8f880c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 -- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f880cf5c0 msgr2=0x7f8f88141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f880cf5c0 0x7f8f88141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 -- 172.21.15.52:0/4278407607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f88154ec0 con 0x7f8f880b3e00 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8e000640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 0x7f8f880c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.360+0000 7f8f8d600640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00c4a0 tx=0x7f8f7c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.361+0000 7f8f85600640 1 -- 172.21.15.52:0/4278407607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c017070 con 0x7f8f880b3e00 2024-09-10T08:37:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.361+0000 7f8f85600640 1 -- 172.21.15.52:0/4278407607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c005ce0 con 0x7f8f880b3e00 2024-09-10T08:37:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.361+0000 7f8f85600640 1 -- 172.21.15.52:0/4278407607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c007270 con 0x7f8f880b3e00 2024-09-10T08:37:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.361+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8815d280 con 0x7f8f880b3e00 2024-09-10T08:37:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.361+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8815d840 con 0x7f8f880b3e00 2024-09-10T08:37:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.363+0000 7f8f85600640 1 -- 172.21.15.52:0/4278407607 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f7c01a070 con 0x7f8f880b3e00 2024-09-10T08:37:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.364+0000 7f8f85600640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 0x7f8f6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.364+0000 7f8f85600640 1 -- 172.21.15.52:0/4278407607 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c08a100 con 0x7f8f880b3e00 2024-09-10T08:37:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.364+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 0x7f8f6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.364+0000 7f8f92ff8740 1 Processor -- start 2024-09-10T08:37:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.364+0000 7f8f92ff8740 1 -- start start 2024-09-10T08:37:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 0x7f8f6806e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8f8814c910 tx=0x7f8f74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848bea0 0x55aea84d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea8489660 0x55aea848c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55aea83ea3b0 con 0x55aea848d630 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55aea83ef410 con 0x55aea848bea0 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.365+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aea8397620 con 0x55aea8489660 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57006/0 (socket says 172.21.15.52:57006) 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea8489660 0x55aea848c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 -- 172.21.15.52:0/3959065271 learned_addr learned my addr 172.21.15.52:0/3959065271 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848bea0 0x55aea84d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 -- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea8489660 msgr2=0x55aea848c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea8489660 0x55aea848c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 -- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848bea0 msgr2=0x55aea84d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848bea0 0x55aea84d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 -- 172.21.15.52:0/3959065271 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea81022d0 con 0x55aea848d630 2024-09-10T08:37:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.366+0000 7f8f8e000640 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8f80031750 tx=0x7f8f8002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e209fa4671f7e43a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f79c00640 1 -- 172.21.15.52:0/3959065271 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80031b30 con 0x55aea848d630 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f79c00640 1 -- 172.21.15.52:0/3959065271 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80040070 con 0x55aea848d630 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f79c00640 1 -- 172.21.15.52:0/3959065271 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80045470 con 0x55aea848d630 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3959065271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 msgr2=0x55aea8486720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8f80031750 tx=0x7f8f8002f000 comp rx=0 tx=0).stop 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3959065271 shutdown_connections 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848d630 0x55aea8486720 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea8489660 0x55aea848c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3959065271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848bea0 0x55aea84d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3959065271 >> 172.21.15.52:0/3959065271 conn(0x55aea84888f0 msgr2=0x55aea84d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3959065271 shutdown_connections 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.367+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3959065271 wait complete. 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.368+0000 7f8f92ff8740 1 -- start start 2024-09-10T08:37:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.368+0000 7f8f92ff8740 1 Processor -- start 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 0x55aea84b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848a660 0x55aea84b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55aea83aa780 con 0x55aea848bea0 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55aea83eb3d0 con 0x55aea848a660 2024-09-10T08:37:39.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aea8487d90 con 0x55aea848d630 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.369+0000 7f8f92ff8740 10 client.0 _ll_register_callbacks cb 0x55aea83e85d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57016/0 (socket says 172.21.15.52:57016) 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 -- 172.21.15.52:0/3426173558 learned_addr learned my addr 172.21.15.52:0/3426173558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 0x55aea84b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8e000640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848a660 0x55aea84b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 -- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 msgr2=0x55aea84b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 0x55aea84b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 -- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848a660 msgr2=0x55aea84b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848a660 0x55aea84b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 -- 172.21.15.52:0/3426173558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea81cc6b0 con 0x55aea848bea0 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 0x55aea84b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:37:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c088590 tx=0x7f8f7c05c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc057f06a99b21ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c086060 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c060a60 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.370+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f80040070 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7f8f7c075050 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 10 client.8436 fetch_fsmap learned FSMap version 102 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x55aea84ab6b0 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f80040070 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7f8f7c057810 con 0x55aea848bea0 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 10 client.8436 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 10 client.8436 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 20 client.8436 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:39.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84aa7e0 0x55aea84e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 4 client.8436 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aea83fcb40 con 0x55aea84aa7e0 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.371+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84aa7e0 0x55aea84e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.372+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84aa7e0 0x55aea84e46d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9d02991bbad325 server_cookie=7c67dd299c3433ff in_seq=0 out_seq=0 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.372+0000 7f8f6e000640 10 client.8436 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f6e000640 1 -- 172.21.15.52:0/3426173558 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aea83fcb40 con 0x55aea84aa7e0 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f6e000640 10 client.8436 handle_command_reply: tid=0 2024-09-10T08:37:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 client.8436 shutdown 2024-09-10T08:37:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 msgr2=0x55aea84abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c088590 tx=0x7f8f7c05c780 comp rx=0 tx=0).stop 2024-09-10T08:37:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 shutdown_connections 2024-09-10T08:37:39.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84aa7e0 0x55aea84e46d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848a660 0x55aea84b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848d630 0x55aea84b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3426173558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84abe50 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 >> 172.21.15.52:0/3426173558 conn(0x55aea8489660 msgr2=0x55aea84ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f6e000640 0 client.8436 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 shutdown_connections 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.373+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3426173558 wait complete. 2024-09-10T08:37:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.374+0000 7f8f92ff8740 20 client.8436 trim_cache size 0 max 16384 2024-09-10T08:37:39.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.392+0000 7f8f92ff8740 1 Processor -- start 2024-09-10T08:37:39.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.392+0000 7f8f92ff8740 1 -- start start 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 0x55aea84f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881ffb50 con 0x55aea848bea0 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f881feee0 con 0x55aea848d630 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f881ff500 con 0x55aea848a660 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57018/0 (socket says 172.21.15.52:57018) 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.393+0000 7f8f8cc00640 1 -- 172.21.15.52:0/3003844242 learned_addr learned my addr 172.21.15.52:0/3003844242 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 0x55aea84f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 -- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 msgr2=0x55aea84f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 0x55aea84f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 -- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 msgr2=0x55aea84d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 -- 172.21.15.52:0/3003844242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea8482740 con 0x55aea848bea0 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8d600640 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 0x55aea84f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400fe90 tx=0x7f8f74012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1133250a24bff86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f79200640 1 -- 172.21.15.52:0/3003844242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74026030 con 0x55aea848bea0 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f79200640 1 -- 172.21.15.52:0/3003844242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7402c020 con 0x55aea848bea0 2024-09-10T08:37:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.394+0000 7f8f79200640 1 -- 172.21.15.52:0/3003844242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74007030 con 0x55aea848bea0 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3003844242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 msgr2=0x55aea84d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400fe90 tx=0x7f8f74012000 comp rx=0 tx=0).stop 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3003844242 shutdown_connections 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848bea0 0x55aea84d0a40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/3003844242 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848a660 0x55aea84f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3003844242 >> 172.21.15.52:0/3003844242 conn(0x55aea8489660 msgr2=0x55aea848b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3003844242 shutdown_connections 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.395+0000 7f8f92ff8740 1 -- 172.21.15.52:0/3003844242 wait complete. 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.396+0000 7f8f92ff8740 1 -- start start 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.396+0000 7f8f92ff8740 1 Processor -- start 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848bea0 0x55aea84f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55aea84aa660 con 0x55aea848a660 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55aea84b59c0 con 0x55aea848d630 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55aea84aac50 con 0x55aea848bea0 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f92ff8740 10 client.0 _ll_register_callbacks cb 0x7f8f7c0583c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:37:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57032/0 (socket says 172.21.15.52:57032) 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 -- 172.21.15.52:0/451873957 learned_addr learned my addr 172.21.15.52:0/451873957 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 -- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848bea0 msgr2=0x55aea84f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848bea0 0x55aea84f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 -- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 msgr2=0x55aea84d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.397+0000 7f8f8d600640 1 -- 172.21.15.52:0/451873957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea84f42a0 con 0x55aea848a660 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f8d600640 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c056670 tx=0x7f8f7c088460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f59990fe9543a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c086070 con 0x55aea848a660 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f8f7c060c60 con 0x55aea848a660 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f7402c020 con 0x55aea848a660 2024-09-10T08:37:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7f8f7c070070 con 0x55aea848a660 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 10 client.8442 fetch_fsmap learned FSMap version 102 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x55aea8539090 con 0x55aea848a660 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7402c020 con 0x55aea848a660 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7f8f7c007410 con 0x55aea848a660 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 10 client.8442 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 10 client.8442 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.398+0000 7f8f92ff8740 20 client.8442 populate_metadata read hostname 'smithi052' 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84acd20 0x55aea855af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f92ff8740 4 client.8442 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "status"}) -- 0x55aea83f6e90 con 0x55aea84acd20 2024-09-10T08:37:39.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84acd20 0x55aea855af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f8cc00640 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84acd20 0x55aea855af60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2acb11bfc8c8cf0c server_cookie=a5744b12560aa01b in_seq=0 out_seq=0 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.399+0000 7f8f6e000640 10 client.8442 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f6e000640 1 -- 172.21.15.52:0/451873957 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aea83f6e90 con 0x55aea84acd20 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f6e000640 10 client.8442 handle_command_reply: tid=0 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 client.8442 shutdown 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 msgr2=0x55aea8538b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c056670 tx=0x7f8f7c088460 comp rx=0 tx=0).stop 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 shutdown_connections 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55aea84acd20 0x55aea855af60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55aea848d630 0x55aea84d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55aea848bea0 0x55aea84f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 --2- 172.21.15.52:0/451873957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aea848a660 0x55aea8538b50 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f6e000640 0 client.8442 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 >> 172.21.15.52:0/451873957 conn(0x55aea8489660 msgr2=0x55aea84b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 shutdown_connections 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 1 -- 172.21.15.52:0/451873957 wait complete. 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.400+0000 7f8f92ff8740 20 client.8442 trim_cache size 0 max 16384 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:37:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 8316, 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.160048508, 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 102, 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 135, 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 135, 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.833274230000001 2024-09-10T08:37:39.405 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 msgr2=0x7f8f6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 0x7f8f6806e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8f8814c910 tx=0x7f8f74009040 comp rx=0 tx=0).stop 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 msgr2=0x7f8f88154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c00c4a0 tx=0x7f8f7c00c960 comp rx=0 tx=0).stop 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 shutdown_connections 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f6806be30 0x7f8f6806e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f880cf9a0 0x7f8f880c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f880cf5c0 0x7f8f88141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 --2- 172.21.15.52:0/4278407607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f880b3e00 0x7f8f88154980 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 >> 172.21.15.52:0/4278407607 conn(0x7f8f8806c240 msgr2=0x7f8f88071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 shutdown_connections 2024-09-10T08:37:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.401+0000 7f8f8ea00640 1 -- 172.21.15.52:0/4278407607 wait complete. 2024-09-10T08:37:39.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:37:39.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.613+0000 7f21ca000640 1 Processor -- start 2024-09-10T08:37:39.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.613+0000 7f21ca000640 1 -- start start 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21ca000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21c415e440 0x7f21c40d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21ca000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c40d3990 con 0x7f21c40b6710 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21ca000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c40d3c70 con 0x7f21c40cf450 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21ca000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f21c40d3f50 con 0x7f21c415e440 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21c8c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f21c415e440 0x7f21c40d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21c9600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f21c40b6710 0x7f21c40b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32776/0 (socket says 172.21.15.52:32776) 2024-09-10T08:37:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.614+0000 7f21c9600640 1 -- 172.21.15.52:0/2033858975 learned_addr learned my addr 172.21.15.52:0/2033858975 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:37:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.615+0000 7f21c8c00640 1 -- 172.21.15.52:0/2033858975 >> v1:172.21.15.176:6789/0 conn(0x7f21c40cf450 legacy=0x7f21c40b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.615+0000 7f21c8c00640 1 -- 172.21.15.52:0/2033858975 >> v1:172.21.15.52:6789/0 conn(0x7f21c40b6710 legacy=0x7f21c40b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.615+0000 7f21c8c00640 1 -- 172.21.15.52:0/2033858975 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c40d4230 con 0x7f21c415e440 2024-09-10T08:37:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.616+0000 7f21c8c00640 1 --2- 172.21.15.52:0/2033858975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40d3240 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f21b80097a0 tx=0x7f21b802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57824bd8f87b5816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.616+0000 7f21c3400640 1 -- 172.21.15.52:0/2033858975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8037070 con 0x7f21c415e440 2024-09-10T08:37:39.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.616+0000 7f21c3400640 1 -- 172.21.15.52:0/2033858975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b8032640 con 0x7f21c415e440 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.616+0000 7f21c3400640 1 -- 172.21.15.52:0/2033858975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8032a10 con 0x7f21c415e440 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 -- 172.21.15.52:0/2033858975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 msgr2=0x7f21c40d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 --2- 172.21.15.52:0/2033858975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40d3240 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f21b80097a0 tx=0x7f21b802a2c0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 -- 172.21.15.52:0/2033858975 shutdown_connections 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 --2- 172.21.15.52:0/2033858975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40d3240 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 -- 172.21.15.52:0/2033858975 >> 172.21.15.52:0/2033858975 conn(0x7f21c4067f80 msgr2=0x7f21c40d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 -- 172.21.15.52:0/2033858975 shutdown_connections 2024-09-10T08:37:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.617+0000 7f21ca000640 1 -- 172.21.15.52:0/2033858975 wait complete. 2024-09-10T08:37:39.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.618+0000 7f21ca000640 1 Processor -- start 2024-09-10T08:37:39.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.619+0000 7f21ca000640 1 -- start start 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.619+0000 7f21ca000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c40b6710 0x7f21c4160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21ca000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 0x7f21c40cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21ca000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21ca000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40b76c0 con 0x7f21c415e440 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21ca000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40b7540 con 0x7f21c40cf450 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21ca000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40b8270 con 0x7f21c40b6710 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57044/0 (socket says 172.21.15.52:57044) 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 -- 172.21.15.52:0/1273295434 learned_addr learned my addr 172.21.15.52:0/1273295434 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c8c00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c40b6710 0x7f21c4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 -- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c40b6710 msgr2=0x7f21c4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c3e00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 0x7f21c40cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c40b6710 0x7f21c4160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 -- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 msgr2=0x7f21c40cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 0x7f21c40cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c9600640 1 -- 172.21.15.52:0/1273295434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c4160840 con 0x7f21c415e440 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.620+0000 7f21c3e00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 0x7f21c40cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21c9600640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00caf0 tx=0x7f21bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc017070 con 0x7f21c415e440 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc00ac40 con 0x7f21c415e440 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c4160af0 con 0x7f21c415e440 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc012600 con 0x7f21c415e440 2024-09-10T08:37:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.621+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41610b0 con 0x7f21c415e440 2024-09-10T08:37:39.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.622+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c40b5700 con 0x7f21c415e440 2024-09-10T08:37:39.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.623+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21bc01a070 con 0x7f21c415e440 2024-09-10T08:37:39.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.624+0000 7f21c0c00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:37:39.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.624+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f21bc08aa10 con 0x7f21c415e440 2024-09-10T08:37:39.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.625+0000 7f21c8c00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:37:39.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.625+0000 7f21c8c00640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 0x7f21a406e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21b8034000 tx=0x7f21b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:37:39.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.628+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21c40b5700 con 0x7f21c415e440 2024-09-10T08:37:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.849+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f21c40d3020 con 0x7f21c415e440 2024-09-10T08:37:39.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.849+0000 7f21c0c00640 1 -- 172.21.15.52:0/1273295434 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) ==== 53+0+73 (secure 0 0 0) 0x7f21c40d3020 con 0x7f21c415e440 2024-09-10T08:37:39.849 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:37:39.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.851+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 msgr2=0x7f21a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.851+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 0x7f21a406e2f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21b8034000 tx=0x7f21b802e000 comp rx=0 tx=0).stop 2024-09-10T08:37:39.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.851+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 msgr2=0x7f21c40cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.851+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00caf0 tx=0x7f21bc00a060 comp rx=0 tx=0).stop 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 shutdown_connections 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21c415e440 0x7f21c40cc2d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21c40cf450 0x7f21c40cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 --2- 172.21.15.52:0/1273295434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f21c40b6710 0x7f21c4160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 >> 172.21.15.52:0/1273295434 conn(0x7f21c4067f80 msgr2=0x7f21c40b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 shutdown_connections 2024-09-10T08:37:39.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:39.852+0000 7f21ca000640 1 -- 172.21.15.52:0/1273295434 wait complete. 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:37:39.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:37:39.869 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:37:39.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:39.869 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:37:39.905 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42143sec preferred_lft 42143sec 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:37:39.906 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:37:39.907 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:37:39.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:39.908 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:37:39.998 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:37:40.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:40.002 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:37:40.038 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:37:40.038 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:37:40.038 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:37:40.038 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:37:40.038 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:37:40.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:40.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:40.236 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:37:40.273 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:37:40.273 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:37:40.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:40.273 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:37:40.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:37:40.370 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:40.406 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:37:40.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:37:40.407 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:40.482 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:37:40.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:40.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:37:40.611 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:37:40.611 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:37:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:37:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:37:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:37:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:37:40.637 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:37:40.640 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:37:40.640 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:37:40.640 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:37:40.640 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:37:40.640 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:37:40.643 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:37:40.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:37:40.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:40.699 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:37:40.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:40.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:40.795 INFO:teuthology.orchestra.run.smithi052.stdout:client8454 2024-09-10T08:37:40.796 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:37:40.796 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:37:40.831 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-10T08:37:40.832 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:40.832 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:40.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:40.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:40.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:40.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192799 s, 54.4 MB/s 2024-09-10T08:37:41.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142487 s, 73.6 MB/s 2024-09-10T08:37:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173609 s, 60.4 MB/s 2024-09-10T08:37:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171959 s, 61.0 MB/s 2024-09-10T08:37:41.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.061 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138715 s, 75.6 MB/s 2024-09-10T08:37:41.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.078 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134814 s, 77.8 MB/s 2024-09-10T08:37:41.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158805 s, 66.0 MB/s 2024-09-10T08:37:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.114 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145646 s, 72.0 MB/s 2024-09-10T08:37:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155374 s, 67.5 MB/s 2024-09-10T08:37:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143737 s, 73.0 MB/s 2024-09-10T08:37:41.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133129 s, 78.8 MB/s 2024-09-10T08:37:41.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.183 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133839 s, 78.3 MB/s 2024-09-10T08:37:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170693 s, 61.4 MB/s 2024-09-10T08:37:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155819 s, 67.3 MB/s 2024-09-10T08:37:41.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162678 s, 64.5 MB/s 2024-09-10T08:37:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164342 s, 63.8 MB/s 2024-09-10T08:37:41.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154315 s, 68.0 MB/s 2024-09-10T08:37:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138057 s, 76.0 MB/s 2024-09-10T08:37:41.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154898 s, 67.7 MB/s 2024-09-10T08:37:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139023 s, 75.4 MB/s 2024-09-10T08:37:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167314 s, 62.7 MB/s 2024-09-10T08:37:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143725 s, 73.0 MB/s 2024-09-10T08:37:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137882 s, 76.0 MB/s 2024-09-10T08:37:41.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156078 s, 67.2 MB/s 2024-09-10T08:37:41.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130538 s, 80.3 MB/s 2024-09-10T08:37:41.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126977 s, 82.6 MB/s 2024-09-10T08:37:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015091 s, 69.5 MB/s 2024-09-10T08:37:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146281 s, 71.7 MB/s 2024-09-10T08:37:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131545 s, 79.7 MB/s 2024-09-10T08:37:41.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131604 s, 79.7 MB/s 2024-09-10T08:37:41.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131071 s, 80.0 MB/s 2024-09-10T08:37:41.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142022 s, 73.8 MB/s 2024-09-10T08:37:41.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:41.548 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:41.548 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:41.548 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T08:37:41.549 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:41.549 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:41.549 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:41.549 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:41.652 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.652 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.652 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163132 s, 64.3 MB/s 2024-09-10T08:37:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146243 s, 71.7 MB/s 2024-09-10T08:37:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.688 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014309 s, 73.3 MB/s 2024-09-10T08:37:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139534 s, 75.1 MB/s 2024-09-10T08:37:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.722 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138213 s, 75.9 MB/s 2024-09-10T08:37:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141421 s, 74.1 MB/s 2024-09-10T08:37:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167524 s, 62.6 MB/s 2024-09-10T08:37:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134366 s, 78.0 MB/s 2024-09-10T08:37:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137456 s, 76.3 MB/s 2024-09-10T08:37:41.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.808 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130957 s, 80.1 MB/s 2024-09-10T08:37:41.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.826 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148775 s, 70.5 MB/s 2024-09-10T08:37:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.846 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169056 s, 62.0 MB/s 2024-09-10T08:37:41.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163964 s, 64.0 MB/s 2024-09-10T08:37:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.886 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169365 s, 61.9 MB/s 2024-09-10T08:37:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.904 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152425 s, 68.8 MB/s 2024-09-10T08:37:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139575 s, 75.1 MB/s 2024-09-10T08:37:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01373 s, 76.4 MB/s 2024-09-10T08:37:41.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148186 s, 70.8 MB/s 2024-09-10T08:37:41.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.972 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135386 s, 77.5 MB/s 2024-09-10T08:37:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136878 s, 76.6 MB/s 2024-09-10T08:37:42.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137467 s, 76.3 MB/s 2024-09-10T08:37:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165641 s, 63.3 MB/s 2024-09-10T08:37:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127649 s, 82.1 MB/s 2024-09-10T08:37:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156706 s, 66.9 MB/s 2024-09-10T08:37:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.077 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137624 s, 76.2 MB/s 2024-09-10T08:37:42.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137613 s, 76.2 MB/s 2024-09-10T08:37:42.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146987 s, 71.3 MB/s 2024-09-10T08:37:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146316 s, 71.7 MB/s 2024-09-10T08:37:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.146 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135274 s, 77.5 MB/s 2024-09-10T08:37:42.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.162 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130659 s, 80.3 MB/s 2024-09-10T08:37:42.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170396 s, 61.5 MB/s 2024-09-10T08:37:42.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.199 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138445 s, 75.7 MB/s 2024-09-10T08:37:42.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:42.209 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:42.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:42.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134381 s, 78.0 MB/s 2024-09-10T08:37:42.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132827 s, 78.9 MB/s 2024-09-10T08:37:42.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138488 s, 75.7 MB/s 2024-09-10T08:37:42.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.360 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.360 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141026 s, 74.4 MB/s 2024-09-10T08:37:42.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131758 s, 79.6 MB/s 2024-09-10T08:37:42.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.393 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013777 s, 76.1 MB/s 2024-09-10T08:37:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135425 s, 77.4 MB/s 2024-09-10T08:37:42.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.426 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138538 s, 75.7 MB/s 2024-09-10T08:37:42.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163332 s, 64.2 MB/s 2024-09-10T08:37:42.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131893 s, 79.5 MB/s 2024-09-10T08:37:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138393 s, 75.8 MB/s 2024-09-10T08:37:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139636 s, 75.1 MB/s 2024-09-10T08:37:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137324 s, 76.4 MB/s 2024-09-10T08:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129597 s, 80.9 MB/s 2024-09-10T08:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134246 s, 78.1 MB/s 2024-09-10T08:37:42.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.560 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127843 s, 82.0 MB/s 2024-09-10T08:37:42.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.575 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119344 s, 87.9 MB/s 2024-09-10T08:37:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013074 s, 80.2 MB/s 2024-09-10T08:37:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124692 s, 84.1 MB/s 2024-09-10T08:37:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151256 s, 69.3 MB/s 2024-09-10T08:37:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.647 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187621 s, 55.9 MB/s 2024-09-10T08:37:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136032 s, 77.1 MB/s 2024-09-10T08:37:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142229 s, 73.7 MB/s 2024-09-10T08:37:42.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138169 s, 75.9 MB/s 2024-09-10T08:37:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170013 s, 61.7 MB/s 2024-09-10T08:37:42.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.738 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168744 s, 62.1 MB/s 2024-09-10T08:37:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164333 s, 63.8 MB/s 2024-09-10T08:37:42.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161572 s, 64.9 MB/s 2024-09-10T08:37:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138568 s, 75.7 MB/s 2024-09-10T08:37:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141631 s, 74.0 MB/s 2024-09-10T08:37:42.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132327 s, 79.2 MB/s 2024-09-10T08:37:42.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135637 s, 77.3 MB/s 2024-09-10T08:37:42.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:42.854 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:42.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130074 s, 80.6 MB/s 2024-09-10T08:37:42.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013239 s, 79.2 MB/s 2024-09-10T08:37:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142554 s, 73.6 MB/s 2024-09-10T08:37:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129066 s, 81.2 MB/s 2024-09-10T08:37:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136465 s, 76.8 MB/s 2024-09-10T08:37:43.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139484 s, 75.2 MB/s 2024-09-10T08:37:43.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168522 s, 62.2 MB/s 2024-09-10T08:37:43.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130438 s, 80.4 MB/s 2024-09-10T08:37:43.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.093 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169272 s, 61.9 MB/s 2024-09-10T08:37:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.109 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133632 s, 78.5 MB/s 2024-09-10T08:37:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141356 s, 74.2 MB/s 2024-09-10T08:37:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174584 s, 60.1 MB/s 2024-09-10T08:37:43.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135698 s, 77.3 MB/s 2024-09-10T08:37:43.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.180 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138398 s, 75.8 MB/s 2024-09-10T08:37:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133266 s, 78.7 MB/s 2024-09-10T08:37:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136631 s, 76.7 MB/s 2024-09-10T08:37:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132117 s, 79.4 MB/s 2024-09-10T08:37:43.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.247 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135113 s, 77.6 MB/s 2024-09-10T08:37:43.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147224 s, 71.2 MB/s 2024-09-10T08:37:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166906 s, 62.8 MB/s 2024-09-10T08:37:43.300 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132573 s, 79.1 MB/s 2024-09-10T08:37:43.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.318 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135879 s, 77.2 MB/s 2024-09-10T08:37:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.334 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136895 s, 76.6 MB/s 2024-09-10T08:37:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132392 s, 79.2 MB/s 2024-09-10T08:37:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138511 s, 75.7 MB/s 2024-09-10T08:37:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013494 s, 77.7 MB/s 2024-09-10T08:37:43.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137595 s, 76.2 MB/s 2024-09-10T08:37:43.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169269 s, 61.9 MB/s 2024-09-10T08:37:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126815 s, 82.7 MB/s 2024-09-10T08:37:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127151 s, 82.5 MB/s 2024-09-10T08:37:43.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.468 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135739 s, 77.2 MB/s 2024-09-10T08:37:43.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.489 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171267 s, 61.2 MB/s 2024-09-10T08:37:43.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:43.498 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:43.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.603 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163062 s, 64.3 MB/s 2024-09-10T08:37:43.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.620 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137872 s, 76.1 MB/s 2024-09-10T08:37:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016903 s, 62.0 MB/s 2024-09-10T08:37:43.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017515 s, 59.9 MB/s 2024-09-10T08:37:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013138 s, 79.8 MB/s 2024-09-10T08:37:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165276 s, 63.4 MB/s 2024-09-10T08:37:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.715 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146967 s, 71.3 MB/s 2024-09-10T08:37:43.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.731 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129288 s, 81.1 MB/s 2024-09-10T08:37:43.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.747 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133192 s, 78.7 MB/s 2024-09-10T08:37:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128282 s, 81.7 MB/s 2024-09-10T08:37:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013335 s, 78.6 MB/s 2024-09-10T08:37:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013179 s, 79.6 MB/s 2024-09-10T08:37:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130284 s, 80.5 MB/s 2024-09-10T08:37:43.831 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.831 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.832 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169956 s, 61.7 MB/s 2024-09-10T08:37:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132553 s, 79.1 MB/s 2024-09-10T08:37:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131369 s, 79.8 MB/s 2024-09-10T08:37:43.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130571 s, 80.3 MB/s 2024-09-10T08:37:43.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143602 s, 73.0 MB/s 2024-09-10T08:37:43.914 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.914 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.914 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136377 s, 76.9 MB/s 2024-09-10T08:37:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130209 s, 80.5 MB/s 2024-09-10T08:37:43.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.947 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135531 s, 77.4 MB/s 2024-09-10T08:37:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133945 s, 78.3 MB/s 2024-09-10T08:37:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164669 s, 63.7 MB/s 2024-09-10T08:37:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169669 s, 61.8 MB/s 2024-09-10T08:37:44.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.019 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136328 s, 76.9 MB/s 2024-09-10T08:37:44.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.038 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155053 s, 67.6 MB/s 2024-09-10T08:37:44.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134455 s, 78.0 MB/s 2024-09-10T08:37:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136235 s, 77.0 MB/s 2024-09-10T08:37:44.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.087 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130106 s, 80.6 MB/s 2024-09-10T08:37:44.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162896 s, 64.4 MB/s 2024-09-10T08:37:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128416 s, 81.7 MB/s 2024-09-10T08:37:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113931 s, 92.0 MB/s 2024-09-10T08:37:44.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:44.146 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:44.147 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:44.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:44.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.246 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136714 s, 76.7 MB/s 2024-09-10T08:37:44.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.264 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146174 s, 71.7 MB/s 2024-09-10T08:37:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127967 s, 81.9 MB/s 2024-09-10T08:37:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135083 s, 77.6 MB/s 2024-09-10T08:37:44.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.313 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132354 s, 79.2 MB/s 2024-09-10T08:37:44.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133747 s, 78.4 MB/s 2024-09-10T08:37:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134338 s, 78.1 MB/s 2024-09-10T08:37:44.362 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.362 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.362 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133525 s, 78.5 MB/s 2024-09-10T08:37:44.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.378 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130562 s, 80.3 MB/s 2024-09-10T08:37:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141143 s, 74.3 MB/s 2024-09-10T08:37:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162708 s, 64.4 MB/s 2024-09-10T08:37:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127304 s, 82.4 MB/s 2024-09-10T08:37:44.446 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.446 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.446 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123863 s, 84.7 MB/s 2024-09-10T08:37:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139661 s, 75.1 MB/s 2024-09-10T08:37:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138076 s, 75.9 MB/s 2024-09-10T08:37:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128652 s, 81.5 MB/s 2024-09-10T08:37:44.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128564 s, 81.6 MB/s 2024-09-10T08:37:44.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129072 s, 81.2 MB/s 2024-09-10T08:37:44.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133631 s, 78.5 MB/s 2024-09-10T08:37:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.561 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141684 s, 74.0 MB/s 2024-09-10T08:37:44.581 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.581 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.581 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167134 s, 62.7 MB/s 2024-09-10T08:37:44.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.600 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157349 s, 66.6 MB/s 2024-09-10T08:37:44.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.616 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131096 s, 80.0 MB/s 2024-09-10T08:37:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013897 s, 75.5 MB/s 2024-09-10T08:37:44.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140329 s, 74.7 MB/s 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131314 s, 79.9 MB/s 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012754 s, 82.2 MB/s 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128422 s, 81.7 MB/s 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134376 s, 78.0 MB/s 2024-09-10T08:37:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.746 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133754 s, 78.4 MB/s 2024-09-10T08:37:44.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.748 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.748 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135973 s, 77.1 MB/s 2024-09-10T08:37:44.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.764 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129451 s, 81.0 MB/s 2024-09-10T08:37:44.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:44.773 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:44.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162256 s, 64.6 MB/s 2024-09-10T08:37:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137151 s, 76.5 MB/s 2024-09-10T08:37:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127941 s, 82.0 MB/s 2024-09-10T08:37:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158095 s, 66.3 MB/s 2024-09-10T08:37:44.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136865 s, 76.6 MB/s 2024-09-10T08:37:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137739 s, 76.1 MB/s 2024-09-10T08:37:44.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141427 s, 74.1 MB/s 2024-09-10T08:37:44.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:44.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:44.997 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160682 s, 65.3 MB/s 2024-09-10T08:37:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134074 s, 78.2 MB/s 2024-09-10T08:37:45.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013513 s, 77.6 MB/s 2024-09-10T08:37:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133672 s, 78.4 MB/s 2024-09-10T08:37:45.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136786 s, 76.7 MB/s 2024-09-10T08:37:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131391 s, 79.8 MB/s 2024-09-10T08:37:45.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.095 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125816 s, 83.3 MB/s 2024-09-10T08:37:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013726 s, 76.4 MB/s 2024-09-10T08:37:45.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.126 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116505 s, 90.0 MB/s 2024-09-10T08:37:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131954 s, 79.5 MB/s 2024-09-10T08:37:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129583 s, 80.9 MB/s 2024-09-10T08:37:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.177 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157202 s, 66.7 MB/s 2024-09-10T08:37:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131167 s, 79.9 MB/s 2024-09-10T08:37:45.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.210 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133311 s, 78.7 MB/s 2024-09-10T08:37:45.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122487 s, 85.6 MB/s 2024-09-10T08:37:45.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136352 s, 76.9 MB/s 2024-09-10T08:37:45.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137016 s, 76.5 MB/s 2024-09-10T08:37:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.274 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123721 s, 84.8 MB/s 2024-09-10T08:37:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176027 s, 59.6 MB/s 2024-09-10T08:37:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125065 s, 83.8 MB/s 2024-09-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.327 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132036 s, 79.4 MB/s 2024-09-10T08:37:45.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.343 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012866 s, 81.5 MB/s 2024-09-10T08:37:45.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.362 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015685 s, 66.9 MB/s 2024-09-10T08:37:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126478 s, 82.9 MB/s 2024-09-10T08:37:45.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.397 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170479 s, 61.5 MB/s 2024-09-10T08:37:45.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:45.406 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:45.407 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:45.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:45.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125538 s, 83.5 MB/s 2024-09-10T08:37:45.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131632 s, 79.7 MB/s 2024-09-10T08:37:45.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.537 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133722 s, 78.4 MB/s 2024-09-10T08:37:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130238 s, 80.5 MB/s 2024-09-10T08:37:45.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135951 s, 77.1 MB/s 2024-09-10T08:37:45.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.588 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145105 s, 72.3 MB/s 2024-09-10T08:37:45.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.605 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.605 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133653 s, 78.5 MB/s 2024-09-10T08:37:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013462 s, 77.9 MB/s 2024-09-10T08:37:45.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.636 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123056 s, 85.2 MB/s 2024-09-10T08:37:45.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138869 s, 75.5 MB/s 2024-09-10T08:37:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.669 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127998 s, 81.9 MB/s 2024-09-10T08:37:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128731 s, 81.5 MB/s 2024-09-10T08:37:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.704 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157877 s, 66.4 MB/s 2024-09-10T08:37:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.721 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135092 s, 77.6 MB/s 2024-09-10T08:37:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155633 s, 67.4 MB/s 2024-09-10T08:37:45.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140881 s, 74.4 MB/s 2024-09-10T08:37:45.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013183 s, 79.5 MB/s 2024-09-10T08:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134158 s, 78.2 MB/s 2024-09-10T08:37:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131112 s, 80.0 MB/s 2024-09-10T08:37:45.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126213 s, 83.1 MB/s 2024-09-10T08:37:45.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128717 s, 81.5 MB/s 2024-09-10T08:37:45.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142277 s, 73.7 MB/s 2024-09-10T08:37:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137589 s, 76.2 MB/s 2024-09-10T08:37:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.888 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139726 s, 75.0 MB/s 2024-09-10T08:37:45.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132589 s, 79.1 MB/s 2024-09-10T08:37:45.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126544 s, 82.9 MB/s 2024-09-10T08:37:45.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170618 s, 61.5 MB/s 2024-09-10T08:37:45.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.956 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126162 s, 83.1 MB/s 2024-09-10T08:37:45.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013243 s, 79.2 MB/s 2024-09-10T08:37:45.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:45.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:45.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148812 s, 70.5 MB/s 2024-09-10T08:37:46.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135688 s, 77.3 MB/s 2024-09-10T08:37:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162166 s, 64.7 MB/s 2024-09-10T08:37:46.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:46.035 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:46.035 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:46.036 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T08:37:46.036 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:46.036 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:46.036 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:46.036 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:46.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135807 s, 77.2 MB/s 2024-09-10T08:37:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139558 s, 75.1 MB/s 2024-09-10T08:37:46.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133271 s, 78.7 MB/s 2024-09-10T08:37:46.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134492 s, 78.0 MB/s 2024-09-10T08:37:46.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.200 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124989 s, 83.9 MB/s 2024-09-10T08:37:46.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.217 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013485 s, 77.8 MB/s 2024-09-10T08:37:46.233 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138071 s, 75.9 MB/s 2024-09-10T08:37:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153671 s, 68.2 MB/s 2024-09-10T08:37:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137278 s, 76.4 MB/s 2024-09-10T08:37:46.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140248 s, 74.8 MB/s 2024-09-10T08:37:46.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.302 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125409 s, 83.6 MB/s 2024-09-10T08:37:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168943 s, 62.1 MB/s 2024-09-10T08:37:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123508 s, 84.9 MB/s 2024-09-10T08:37:46.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127637 s, 82.2 MB/s 2024-09-10T08:37:46.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.372 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156914 s, 66.8 MB/s 2024-09-10T08:37:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.389 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139305 s, 75.3 MB/s 2024-09-10T08:37:46.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125697 s, 83.4 MB/s 2024-09-10T08:37:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128843 s, 81.4 MB/s 2024-09-10T08:37:46.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163458 s, 64.1 MB/s 2024-09-10T08:37:46.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.457 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132058 s, 79.4 MB/s 2024-09-10T08:37:46.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132769 s, 79.0 MB/s 2024-09-10T08:37:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165849 s, 63.2 MB/s 2024-09-10T08:37:46.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128019 s, 81.9 MB/s 2024-09-10T08:37:46.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.525 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133034 s, 78.8 MB/s 2024-09-10T08:37:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130295 s, 80.5 MB/s 2024-09-10T08:37:46.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.559 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148697 s, 70.5 MB/s 2024-09-10T08:37:46.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.576 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130332 s, 80.5 MB/s 2024-09-10T08:37:46.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.591 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121688 s, 86.2 MB/s 2024-09-10T08:37:46.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135819 s, 77.2 MB/s 2024-09-10T08:37:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138873 s, 75.5 MB/s 2024-09-10T08:37:46.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.643 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157686 s, 66.5 MB/s 2024-09-10T08:37:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135393 s, 77.4 MB/s 2024-09-10T08:37:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:46.670 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:46.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147866 s, 70.9 MB/s 2024-09-10T08:37:46.791 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.791 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.791 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168387 s, 62.3 MB/s 2024-09-10T08:37:46.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.807 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133254 s, 78.7 MB/s 2024-09-10T08:37:46.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169082 s, 62.0 MB/s 2024-09-10T08:37:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135841 s, 77.2 MB/s 2024-09-10T08:37:46.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126583 s, 82.8 MB/s 2024-09-10T08:37:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130888 s, 80.1 MB/s 2024-09-10T08:37:46.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.892 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130836 s, 80.1 MB/s 2024-09-10T08:37:46.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131669 s, 79.6 MB/s 2024-09-10T08:37:46.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166395 s, 63.0 MB/s 2024-09-10T08:37:46.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143639 s, 73.0 MB/s 2024-09-10T08:37:46.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141135 s, 74.3 MB/s 2024-09-10T08:37:46.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125053 s, 83.9 MB/s 2024-09-10T08:37:46.998 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:46.998 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:46.998 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163359 s, 64.2 MB/s 2024-09-10T08:37:47.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.014 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013069 s, 80.2 MB/s 2024-09-10T08:37:47.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.031 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137165 s, 76.4 MB/s 2024-09-10T08:37:47.050 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.051 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016517 s, 63.5 MB/s 2024-09-10T08:37:47.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.070 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163066 s, 64.3 MB/s 2024-09-10T08:37:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159712 s, 65.7 MB/s 2024-09-10T08:37:47.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157634 s, 66.5 MB/s 2024-09-10T08:37:47.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.127 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016484 s, 63.6 MB/s 2024-09-10T08:37:47.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.143 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133056 s, 78.8 MB/s 2024-09-10T08:37:47.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126651 s, 82.8 MB/s 2024-09-10T08:37:47.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137538 s, 76.2 MB/s 2024-09-10T08:37:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133718 s, 78.4 MB/s 2024-09-10T08:37:47.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130166 s, 80.6 MB/s 2024-09-10T08:37:47.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.224 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120161 s, 87.3 MB/s 2024-09-10T08:37:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016348 s, 64.1 MB/s 2024-09-10T08:37:47.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128482 s, 81.6 MB/s 2024-09-10T08:37:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167149 s, 62.7 MB/s 2024-09-10T08:37:47.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.295 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136729 s, 76.7 MB/s 2024-09-10T08:37:47.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.311 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131147 s, 80.0 MB/s 2024-09-10T08:37:47.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:47.320 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:47.320 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:47.321 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T08:37:47.321 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:47.321 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:47.321 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:47.321 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:47.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:47.419 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129422 s, 81.0 MB/s 2024-09-10T08:37:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171916 s, 61.0 MB/s 2024-09-10T08:37:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.457 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136503 s, 76.8 MB/s 2024-09-10T08:37:47.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137344 s, 76.3 MB/s 2024-09-10T08:37:47.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130873 s, 80.1 MB/s 2024-09-10T08:37:47.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126326 s, 83.0 MB/s 2024-09-10T08:37:47.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134839 s, 77.8 MB/s 2024-09-10T08:37:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162147 s, 64.7 MB/s 2024-09-10T08:37:47.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130766 s, 80.2 MB/s 2024-09-10T08:37:47.574 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.575 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145148 s, 72.2 MB/s 2024-09-10T08:37:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135706 s, 77.3 MB/s 2024-09-10T08:37:47.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.609 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145133 s, 72.2 MB/s 2024-09-10T08:37:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134738 s, 77.8 MB/s 2024-09-10T08:37:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125631 s, 83.5 MB/s 2024-09-10T08:37:47.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.663 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188365 s, 55.7 MB/s 2024-09-10T08:37:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126318 s, 83.0 MB/s 2024-09-10T08:37:47.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.696 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144007 s, 72.8 MB/s 2024-09-10T08:37:47.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169805 s, 61.8 MB/s 2024-09-10T08:37:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.736 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165625 s, 63.3 MB/s 2024-09-10T08:37:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128561 s, 81.6 MB/s 2024-09-10T08:37:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128823 s, 81.4 MB/s 2024-09-10T08:37:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123422 s, 85.0 MB/s 2024-09-10T08:37:47.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150642 s, 69.6 MB/s 2024-09-10T08:37:47.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130111 s, 80.6 MB/s 2024-09-10T08:37:47.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160121 s, 65.5 MB/s 2024-09-10T08:37:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137487 s, 76.3 MB/s 2024-09-10T08:37:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137341 s, 76.3 MB/s 2024-09-10T08:37:47.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.888 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01415 s, 74.1 MB/s 2024-09-10T08:37:47.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.904 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133936 s, 78.3 MB/s 2024-09-10T08:37:47.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014147 s, 74.1 MB/s 2024-09-10T08:37:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135214 s, 77.5 MB/s 2024-09-10T08:37:47.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135106 s, 77.6 MB/s 2024-09-10T08:37:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:47.964 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:48.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:48.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134249 s, 78.1 MB/s 2024-09-10T08:37:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014043 s, 74.7 MB/s 2024-09-10T08:37:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167909 s, 62.4 MB/s 2024-09-10T08:37:48.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.119 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161034 s, 65.1 MB/s 2024-09-10T08:37:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132655 s, 79.0 MB/s 2024-09-10T08:37:48.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145376 s, 72.1 MB/s 2024-09-10T08:37:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163821 s, 64.0 MB/s 2024-09-10T08:37:48.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136719 s, 76.7 MB/s 2024-09-10T08:37:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131606 s, 79.7 MB/s 2024-09-10T08:37:48.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187409 s, 56.0 MB/s 2024-09-10T08:37:48.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.245 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136145 s, 77.0 MB/s 2024-09-10T08:37:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168381 s, 62.3 MB/s 2024-09-10T08:37:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122013 s, 85.9 MB/s 2024-09-10T08:37:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128901 s, 81.3 MB/s 2024-09-10T08:37:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.314 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137578 s, 76.2 MB/s 2024-09-10T08:37:48.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135076 s, 77.6 MB/s 2024-09-10T08:37:48.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.348 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.348 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013038 s, 80.4 MB/s 2024-09-10T08:37:48.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.364 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134745 s, 77.8 MB/s 2024-09-10T08:37:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168745 s, 62.1 MB/s 2024-09-10T08:37:48.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.404 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151128 s, 69.4 MB/s 2024-09-10T08:37:48.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.420 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132465 s, 79.2 MB/s 2024-09-10T08:37:48.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135729 s, 77.3 MB/s 2024-09-10T08:37:48.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137715 s, 76.1 MB/s 2024-09-10T08:37:48.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013053 s, 80.3 MB/s 2024-09-10T08:37:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131403 s, 79.8 MB/s 2024-09-10T08:37:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169145 s, 62.0 MB/s 2024-09-10T08:37:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167522 s, 62.6 MB/s 2024-09-10T08:37:48.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129142 s, 81.2 MB/s 2024-09-10T08:37:48.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014226 s, 73.7 MB/s 2024-09-10T08:37:48.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160542 s, 65.3 MB/s 2024-09-10T08:37:48.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145387 s, 72.1 MB/s 2024-09-10T08:37:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147093 s, 71.3 MB/s 2024-09-10T08:37:48.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:48.627 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:48.628 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164343 s, 63.8 MB/s 2024-09-10T08:37:48.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139099 s, 75.4 MB/s 2024-09-10T08:37:48.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136657 s, 76.7 MB/s 2024-09-10T08:37:48.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01339 s, 78.3 MB/s 2024-09-10T08:37:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165878 s, 63.2 MB/s 2024-09-10T08:37:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130016 s, 80.6 MB/s 2024-09-10T08:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130327 s, 80.5 MB/s 2024-09-10T08:37:48.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128207 s, 81.8 MB/s 2024-09-10T08:37:48.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.869 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133621 s, 78.5 MB/s 2024-09-10T08:37:48.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.885 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013014 s, 80.6 MB/s 2024-09-10T08:37:48.902 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.902 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.902 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134401 s, 78.0 MB/s 2024-09-10T08:37:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01245 s, 84.2 MB/s 2024-09-10T08:37:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175678 s, 59.7 MB/s 2024-09-10T08:37:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134712 s, 77.8 MB/s 2024-09-10T08:37:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135525 s, 77.4 MB/s 2024-09-10T08:37:48.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:48.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:48.988 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134482 s, 78.0 MB/s 2024-09-10T08:37:49.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.005 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137142 s, 76.5 MB/s 2024-09-10T08:37:49.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118031 s, 88.8 MB/s 2024-09-10T08:37:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134611 s, 77.9 MB/s 2024-09-10T08:37:49.055 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164661 s, 63.7 MB/s 2024-09-10T08:37:49.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.072 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135433 s, 77.4 MB/s 2024-09-10T08:37:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138456 s, 75.7 MB/s 2024-09-10T08:37:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127272 s, 82.4 MB/s 2024-09-10T08:37:49.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131129 s, 80.0 MB/s 2024-09-10T08:37:49.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128442 s, 81.6 MB/s 2024-09-10T08:37:49.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158478 s, 66.2 MB/s 2024-09-10T08:37:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136206 s, 77.0 MB/s 2024-09-10T08:37:49.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138722 s, 75.6 MB/s 2024-09-10T08:37:49.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131519 s, 79.7 MB/s 2024-09-10T08:37:49.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.222 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127568 s, 82.2 MB/s 2024-09-10T08:37:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167872 s, 62.5 MB/s 2024-09-10T08:37:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143232 s, 73.2 MB/s 2024-09-10T08:37:49.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:49.268 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:49.269 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:49.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:49.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137854 s, 76.1 MB/s 2024-09-10T08:37:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160323 s, 65.4 MB/s 2024-09-10T08:37:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135169 s, 77.6 MB/s 2024-09-10T08:37:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132251 s, 79.3 MB/s 2024-09-10T08:37:49.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124986 s, 83.9 MB/s 2024-09-10T08:37:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.457 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140036 s, 74.9 MB/s 2024-09-10T08:37:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.477 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164851 s, 63.6 MB/s 2024-09-10T08:37:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163556 s, 64.1 MB/s 2024-09-10T08:37:49.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129392 s, 81.0 MB/s 2024-09-10T08:37:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169296 s, 61.9 MB/s 2024-09-10T08:37:49.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.551 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164416 s, 63.8 MB/s 2024-09-10T08:37:49.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164324 s, 63.8 MB/s 2024-09-10T08:37:49.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.587 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136342 s, 76.9 MB/s 2024-09-10T08:37:49.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016343 s, 64.2 MB/s 2024-09-10T08:37:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137724 s, 76.1 MB/s 2024-09-10T08:37:49.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128351 s, 81.7 MB/s 2024-09-10T08:37:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.659 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168657 s, 62.2 MB/s 2024-09-10T08:37:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137627 s, 76.2 MB/s 2024-09-10T08:37:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.694 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140988 s, 74.4 MB/s 2024-09-10T08:37:49.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131007 s, 80.0 MB/s 2024-09-10T08:37:49.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145891 s, 71.9 MB/s 2024-09-10T08:37:49.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.744 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134451 s, 78.0 MB/s 2024-09-10T08:37:49.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138812 s, 75.5 MB/s 2024-09-10T08:37:49.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134089 s, 78.2 MB/s 2024-09-10T08:37:49.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163774 s, 64.0 MB/s 2024-09-10T08:37:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.816 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166482 s, 63.0 MB/s 2024-09-10T08:37:49.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.834 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147322 s, 71.2 MB/s 2024-09-10T08:37:49.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.850 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129646 s, 80.9 MB/s 2024-09-10T08:37:49.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131044 s, 80.0 MB/s 2024-09-10T08:37:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176724 s, 59.3 MB/s 2024-09-10T08:37:49.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164681 s, 63.7 MB/s 2024-09-10T08:37:49.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:49.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:49.923 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133051 s, 78.8 MB/s 2024-09-10T08:37:49.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:49.932 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:50.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:50.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.032 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135123 s, 77.6 MB/s 2024-09-10T08:37:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.052 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170906 s, 61.4 MB/s 2024-09-10T08:37:50.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.068 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128339 s, 81.7 MB/s 2024-09-10T08:37:50.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174346 s, 60.1 MB/s 2024-09-10T08:37:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134093 s, 78.2 MB/s 2024-09-10T08:37:50.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130394 s, 80.4 MB/s 2024-09-10T08:37:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140587 s, 74.6 MB/s 2024-09-10T08:37:50.154 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.154 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.155 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013947 s, 75.2 MB/s 2024-09-10T08:37:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137651 s, 76.2 MB/s 2024-09-10T08:37:50.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136681 s, 76.7 MB/s 2024-09-10T08:37:50.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.205 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132601 s, 79.1 MB/s 2024-09-10T08:37:50.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136047 s, 77.1 MB/s 2024-09-10T08:37:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.238 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131509 s, 79.7 MB/s 2024-09-10T08:37:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.253 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125455 s, 83.6 MB/s 2024-09-10T08:37:50.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133841 s, 78.3 MB/s 2024-09-10T08:37:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134817 s, 77.8 MB/s 2024-09-10T08:37:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133976 s, 78.3 MB/s 2024-09-10T08:37:50.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158092 s, 66.3 MB/s 2024-09-10T08:37:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.338 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132709 s, 79.0 MB/s 2024-09-10T08:37:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128756 s, 81.4 MB/s 2024-09-10T08:37:50.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129181 s, 81.2 MB/s 2024-09-10T08:37:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127514 s, 82.2 MB/s 2024-09-10T08:37:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129229 s, 81.1 MB/s 2024-09-10T08:37:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127145 s, 82.5 MB/s 2024-09-10T08:37:50.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.439 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164777 s, 63.6 MB/s 2024-09-10T08:37:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129195 s, 81.2 MB/s 2024-09-10T08:37:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172239 s, 60.9 MB/s 2024-09-10T08:37:50.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016512 s, 63.5 MB/s 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136881 s, 76.6 MB/s 2024-09-10T08:37:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.531 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158823 s, 66.0 MB/s 2024-09-10T08:37:50.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.547 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126315 s, 83.0 MB/s 2024-09-10T08:37:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131661 s, 79.6 MB/s 2024-09-10T08:37:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:50.572 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:50.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:50.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014243 s, 73.6 MB/s 2024-09-10T08:37:50.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142841 s, 73.4 MB/s 2024-09-10T08:37:50.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139149 s, 75.4 MB/s 2024-09-10T08:37:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128603 s, 81.5 MB/s 2024-09-10T08:37:50.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.741 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130231 s, 80.5 MB/s 2024-09-10T08:37:50.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169148 s, 62.0 MB/s 2024-09-10T08:37:50.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131431 s, 79.8 MB/s 2024-09-10T08:37:50.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134335 s, 78.1 MB/s 2024-09-10T08:37:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.810 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137941 s, 76.0 MB/s 2024-09-10T08:37:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.826 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127901 s, 82.0 MB/s 2024-09-10T08:37:50.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.843 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135088 s, 77.6 MB/s 2024-09-10T08:37:50.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.861 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150383 s, 69.7 MB/s 2024-09-10T08:37:50.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.878 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139269 s, 75.3 MB/s 2024-09-10T08:37:50.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115718 s, 90.6 MB/s 2024-09-10T08:37:50.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166549 s, 63.0 MB/s 2024-09-10T08:37:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.929 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127033 s, 82.5 MB/s 2024-09-10T08:37:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142934 s, 73.4 MB/s 2024-09-10T08:37:50.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013022 s, 80.5 MB/s 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122723 s, 85.4 MB/s 2024-09-10T08:37:50.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:50.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:50.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132629 s, 79.1 MB/s 2024-09-10T08:37:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153673 s, 68.2 MB/s 2024-09-10T08:37:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126696 s, 82.8 MB/s 2024-09-10T08:37:51.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165982 s, 63.2 MB/s 2024-09-10T08:37:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126928 s, 82.6 MB/s 2024-09-10T08:37:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.081 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142388 s, 73.6 MB/s 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164152 s, 63.9 MB/s 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.119 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160104 s, 65.5 MB/s 2024-09-10T08:37:51.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136926 s, 76.6 MB/s 2024-09-10T08:37:51.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.151 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126585 s, 82.8 MB/s 2024-09-10T08:37:51.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134663 s, 77.9 MB/s 2024-09-10T08:37:51.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137131 s, 76.5 MB/s 2024-09-10T08:37:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128591 s, 81.5 MB/s 2024-09-10T08:37:51.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:51.209 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:51.210 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:51.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:51.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.311 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.311 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151347 s, 69.3 MB/s 2024-09-10T08:37:51.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169013 s, 62.0 MB/s 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165501 s, 63.4 MB/s 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125488 s, 83.6 MB/s 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160103 s, 65.5 MB/s 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132158 s, 79.3 MB/s 2024-09-10T08:37:51.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125928 s, 83.3 MB/s 2024-09-10T08:37:51.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.434 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127617 s, 82.2 MB/s 2024-09-10T08:37:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169453 s, 61.9 MB/s 2024-09-10T08:37:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130423 s, 80.4 MB/s 2024-09-10T08:37:51.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136625 s, 76.7 MB/s 2024-09-10T08:37:51.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.504 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137317 s, 76.4 MB/s 2024-09-10T08:37:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150688 s, 69.6 MB/s 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128709 s, 81.5 MB/s 2024-09-10T08:37:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121934 s, 86.0 MB/s 2024-09-10T08:37:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133034 s, 78.8 MB/s 2024-09-10T08:37:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133275 s, 78.7 MB/s 2024-09-10T08:37:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.603 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141517 s, 74.1 MB/s 2024-09-10T08:37:51.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.621 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138472 s, 75.7 MB/s 2024-09-10T08:37:51.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166848 s, 62.8 MB/s 2024-09-10T08:37:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173052 s, 60.6 MB/s 2024-09-10T08:37:51.678 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142202 s, 73.7 MB/s 2024-09-10T08:37:51.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145524 s, 72.1 MB/s 2024-09-10T08:37:51.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128937 s, 81.3 MB/s 2024-09-10T08:37:51.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105726 s, 99.2 MB/s 2024-09-10T08:37:51.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133532 s, 78.5 MB/s 2024-09-10T08:37:51.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121451 s, 86.3 MB/s 2024-09-10T08:37:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.774 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129909 s, 80.7 MB/s 2024-09-10T08:37:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.790 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127726 s, 82.1 MB/s 2024-09-10T08:37:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119201 s, 88.0 MB/s 2024-09-10T08:37:51.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129542 s, 80.9 MB/s 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125284 s, 83.7 MB/s 2024-09-10T08:37:51.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:51.846 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:51.846 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:51.846 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T08:37:51.847 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:51.847 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:51.847 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:51.847 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:51.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126796 s, 82.7 MB/s 2024-09-10T08:37:51.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129906 s, 80.7 MB/s 2024-09-10T08:37:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130793 s, 80.2 MB/s 2024-09-10T08:37:51.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:51.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:51.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130037 s, 80.6 MB/s 2024-09-10T08:37:52.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014982 s, 70.0 MB/s 2024-09-10T08:37:52.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.033 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167422 s, 62.6 MB/s 2024-09-10T08:37:52.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.049 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133592 s, 78.5 MB/s 2024-09-10T08:37:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.068 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162804 s, 64.4 MB/s 2024-09-10T08:37:52.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142469 s, 73.6 MB/s 2024-09-10T08:37:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166512 s, 63.0 MB/s 2024-09-10T08:37:52.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158904 s, 66.0 MB/s 2024-09-10T08:37:52.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134199 s, 78.1 MB/s 2024-09-10T08:37:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131433 s, 79.8 MB/s 2024-09-10T08:37:52.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.175 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137956 s, 76.0 MB/s 2024-09-10T08:37:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.191 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134892 s, 77.7 MB/s 2024-09-10T08:37:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.210 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152093 s, 68.9 MB/s 2024-09-10T08:37:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012478 s, 84.0 MB/s 2024-09-10T08:37:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139982 s, 74.9 MB/s 2024-09-10T08:37:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157253 s, 66.7 MB/s 2024-09-10T08:37:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146332 s, 71.7 MB/s 2024-09-10T08:37:52.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138856 s, 75.5 MB/s 2024-09-10T08:37:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.313 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129736 s, 80.8 MB/s 2024-09-10T08:37:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013399 s, 78.3 MB/s 2024-09-10T08:37:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129286 s, 81.1 MB/s 2024-09-10T08:37:52.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.364 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154124 s, 68.0 MB/s 2024-09-10T08:37:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137646 s, 76.2 MB/s 2024-09-10T08:37:52.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.397 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125277 s, 83.7 MB/s 2024-09-10T08:37:52.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.413 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122902 s, 85.3 MB/s 2024-09-10T08:37:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.429 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124661 s, 84.1 MB/s 2024-09-10T08:37:52.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125516 s, 83.5 MB/s 2024-09-10T08:37:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139295 s, 75.3 MB/s 2024-09-10T08:37:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128148 s, 81.8 MB/s 2024-09-10T08:37:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:52.487 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:52.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:52.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.591 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172001 s, 61.0 MB/s 2024-09-10T08:37:52.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135009 s, 77.7 MB/s 2024-09-10T08:37:52.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.624 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132727 s, 79.0 MB/s 2024-09-10T08:37:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137836 s, 76.1 MB/s 2024-09-10T08:37:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016805 s, 62.4 MB/s 2024-09-10T08:37:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.678 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124928 s, 83.9 MB/s 2024-09-10T08:37:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167352 s, 62.7 MB/s 2024-09-10T08:37:52.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174116 s, 60.2 MB/s 2024-09-10T08:37:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013149 s, 79.7 MB/s 2024-09-10T08:37:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132973 s, 78.9 MB/s 2024-09-10T08:37:52.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125973 s, 83.2 MB/s 2024-09-10T08:37:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131878 s, 79.5 MB/s 2024-09-10T08:37:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128524 s, 81.6 MB/s 2024-09-10T08:37:52.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133377 s, 78.6 MB/s 2024-09-10T08:37:52.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168605 s, 62.2 MB/s 2024-09-10T08:37:52.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131825 s, 79.5 MB/s 2024-09-10T08:37:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017462 s, 60.0 MB/s 2024-09-10T08:37:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129803 s, 80.8 MB/s 2024-09-10T08:37:52.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136895 s, 76.6 MB/s 2024-09-10T08:37:52.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162403 s, 64.6 MB/s 2024-09-10T08:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134203 s, 78.1 MB/s 2024-09-10T08:37:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133554 s, 78.5 MB/s 2024-09-10T08:37:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131997 s, 79.4 MB/s 2024-09-10T08:37:52.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133345 s, 78.6 MB/s 2024-09-10T08:37:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131883 s, 79.5 MB/s 2024-09-10T08:37:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138829 s, 75.5 MB/s 2024-09-10T08:37:53.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.047 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135382 s, 77.5 MB/s 2024-09-10T08:37:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137058 s, 76.5 MB/s 2024-09-10T08:37:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130602 s, 80.3 MB/s 2024-09-10T08:37:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151503 s, 69.2 MB/s 2024-09-10T08:37:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169432 s, 61.9 MB/s 2024-09-10T08:37:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132452 s, 79.2 MB/s 2024-09-10T08:37:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:53.145 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:53.146 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:53.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153894 s, 68.1 MB/s 2024-09-10T08:37:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.264 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139688 s, 75.1 MB/s 2024-09-10T08:37:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.282 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137547 s, 76.2 MB/s 2024-09-10T08:37:53.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.299 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136108 s, 77.0 MB/s 2024-09-10T08:37:53.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131941 s, 79.5 MB/s 2024-09-10T08:37:53.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127944 s, 82.0 MB/s 2024-09-10T08:37:53.348 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.348 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.349 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133154 s, 78.7 MB/s 2024-09-10T08:37:53.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.366 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136446 s, 76.8 MB/s 2024-09-10T08:37:53.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159458 s, 65.8 MB/s 2024-09-10T08:37:53.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129157 s, 81.2 MB/s 2024-09-10T08:37:53.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129551 s, 80.9 MB/s 2024-09-10T08:37:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160951 s, 65.1 MB/s 2024-09-10T08:37:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136521 s, 76.8 MB/s 2024-09-10T08:37:53.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127908 s, 82.0 MB/s 2024-09-10T08:37:53.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.489 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136377 s, 76.9 MB/s 2024-09-10T08:37:53.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127449 s, 82.3 MB/s 2024-09-10T08:37:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135851 s, 77.2 MB/s 2024-09-10T08:37:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130759 s, 80.2 MB/s 2024-09-10T08:37:53.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.555 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138945 s, 75.5 MB/s 2024-09-10T08:37:53.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.575 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161843 s, 64.8 MB/s 2024-09-10T08:37:53.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.592 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133908 s, 78.3 MB/s 2024-09-10T08:37:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179283 s, 58.5 MB/s 2024-09-10T08:37:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180615 s, 58.1 MB/s 2024-09-10T08:37:53.652 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116244 s, 90.2 MB/s 2024-09-10T08:37:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139625 s, 75.1 MB/s 2024-09-10T08:37:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162449 s, 64.5 MB/s 2024-09-10T08:37:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171469 s, 61.2 MB/s 2024-09-10T08:37:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132885 s, 78.9 MB/s 2024-09-10T08:37:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132625 s, 79.1 MB/s 2024-09-10T08:37:53.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127901 s, 82.0 MB/s 2024-09-10T08:37:53.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.775 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130732 s, 80.2 MB/s 2024-09-10T08:37:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114531 s, 91.6 MB/s 2024-09-10T08:37:53.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:53.798 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:53.799 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:53.799 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T08:37:53.799 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:53.799 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:53.800 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:53.800 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169991 s, 61.7 MB/s 2024-09-10T08:37:53.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015459 s, 67.8 MB/s 2024-09-10T08:37:53.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165024 s, 63.5 MB/s 2024-09-10T08:37:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143053 s, 73.3 MB/s 2024-09-10T08:37:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168743 s, 62.1 MB/s 2024-09-10T08:37:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:53.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130444 s, 80.4 MB/s 2024-09-10T08:37:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135267 s, 77.5 MB/s 2024-09-10T08:37:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159331 s, 65.8 MB/s 2024-09-10T08:37:54.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.046 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140562 s, 74.6 MB/s 2024-09-10T08:37:54.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.065 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156951 s, 66.8 MB/s 2024-09-10T08:37:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169036 s, 62.0 MB/s 2024-09-10T08:37:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.102 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139343 s, 75.3 MB/s 2024-09-10T08:37:54.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128607 s, 81.5 MB/s 2024-09-10T08:37:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.139 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174525 s, 60.1 MB/s 2024-09-10T08:37:54.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.155 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013491 s, 77.7 MB/s 2024-09-10T08:37:54.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.171 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132955 s, 78.9 MB/s 2024-09-10T08:37:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137631 s, 76.2 MB/s 2024-09-10T08:37:54.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.205 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132114 s, 79.4 MB/s 2024-09-10T08:37:54.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.220 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125284 s, 83.7 MB/s 2024-09-10T08:37:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156485 s, 67.0 MB/s 2024-09-10T08:37:54.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131523 s, 79.7 MB/s 2024-09-10T08:37:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143825 s, 72.9 MB/s 2024-09-10T08:37:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.289 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.290 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129429 s, 81.0 MB/s 2024-09-10T08:37:54.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.308 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015732 s, 66.7 MB/s 2024-09-10T08:37:54.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016864 s, 62.2 MB/s 2024-09-10T08:37:54.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.348 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.348 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165532 s, 63.3 MB/s 2024-09-10T08:37:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.363 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123713 s, 84.8 MB/s 2024-09-10T08:37:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.379 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128968 s, 81.3 MB/s 2024-09-10T08:37:54.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.395 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126894 s, 82.6 MB/s 2024-09-10T08:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134726 s, 77.8 MB/s 2024-09-10T08:37:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132595 s, 79.1 MB/s 2024-09-10T08:37:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165065 s, 63.5 MB/s 2024-09-10T08:37:54.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:54.457 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:54.458 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:54.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013076 s, 80.2 MB/s 2024-09-10T08:37:54.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.577 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.577 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170594 s, 61.5 MB/s 2024-09-10T08:37:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129113 s, 81.2 MB/s 2024-09-10T08:37:54.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.609 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012795 s, 82.0 MB/s 2024-09-10T08:37:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138409 s, 75.8 MB/s 2024-09-10T08:37:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134422 s, 78.0 MB/s 2024-09-10T08:37:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.660 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142599 s, 73.5 MB/s 2024-09-10T08:37:54.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139025 s, 75.4 MB/s 2024-09-10T08:37:54.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114198 s, 91.8 MB/s 2024-09-10T08:37:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.707 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131552 s, 79.7 MB/s 2024-09-10T08:37:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123397 s, 85.0 MB/s 2024-09-10T08:37:54.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168471 s, 62.2 MB/s 2024-09-10T08:37:54.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.759 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133504 s, 78.5 MB/s 2024-09-10T08:37:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013672 s, 76.7 MB/s 2024-09-10T08:37:54.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167263 s, 62.7 MB/s 2024-09-10T08:37:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125019 s, 83.9 MB/s 2024-09-10T08:37:54.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013498 s, 77.7 MB/s 2024-09-10T08:37:54.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172373 s, 60.8 MB/s 2024-09-10T08:37:54.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.868 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166083 s, 63.1 MB/s 2024-09-10T08:37:54.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.885 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137418 s, 76.3 MB/s 2024-09-10T08:37:54.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.901 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133229 s, 78.7 MB/s 2024-09-10T08:37:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116783 s, 89.8 MB/s 2024-09-10T08:37:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.936 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170938 s, 61.3 MB/s 2024-09-10T08:37:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013877 s, 75.6 MB/s 2024-09-10T08:37:54.968 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.969 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124445 s, 84.3 MB/s 2024-09-10T08:37:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131702 s, 79.6 MB/s 2024-09-10T08:37:55.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.001 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132347 s, 79.2 MB/s 2024-09-10T08:37:55.017 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.018 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134833 s, 77.8 MB/s 2024-09-10T08:37:55.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157713 s, 66.5 MB/s 2024-09-10T08:37:55.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.053 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132498 s, 79.1 MB/s 2024-09-10T08:37:55.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.070 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135389 s, 77.4 MB/s 2024-09-10T08:37:55.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131471 s, 79.8 MB/s 2024-09-10T08:37:55.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:55.095 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:55.095 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:55.095 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T08:37:55.096 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:55.096 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:55.096 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:55.096 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:55.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127686 s, 82.1 MB/s 2024-09-10T08:37:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131244 s, 79.9 MB/s 2024-09-10T08:37:55.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135737 s, 77.3 MB/s 2024-09-10T08:37:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138171 s, 75.9 MB/s 2024-09-10T08:37:55.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129317 s, 81.1 MB/s 2024-09-10T08:37:55.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134464 s, 78.0 MB/s 2024-09-10T08:37:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133924 s, 78.3 MB/s 2024-09-10T08:37:55.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.324 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012887 s, 81.4 MB/s 2024-09-10T08:37:55.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.344 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161945 s, 64.7 MB/s 2024-09-10T08:37:55.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.359 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125381 s, 83.6 MB/s 2024-09-10T08:37:55.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127762 s, 82.1 MB/s 2024-09-10T08:37:55.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133671 s, 78.4 MB/s 2024-09-10T08:37:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132779 s, 79.0 MB/s 2024-09-10T08:37:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131455 s, 79.8 MB/s 2024-09-10T08:37:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130906 s, 80.1 MB/s 2024-09-10T08:37:55.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121265 s, 86.5 MB/s 2024-09-10T08:37:55.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138653 s, 75.6 MB/s 2024-09-10T08:37:55.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166753 s, 62.9 MB/s 2024-09-10T08:37:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130327 s, 80.5 MB/s 2024-09-10T08:37:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130407 s, 80.4 MB/s 2024-09-10T08:37:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136661 s, 76.7 MB/s 2024-09-10T08:37:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161301 s, 65.0 MB/s 2024-09-10T08:37:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141044 s, 74.3 MB/s 2024-09-10T08:37:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166865 s, 62.8 MB/s 2024-09-10T08:37:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130101 s, 80.6 MB/s 2024-09-10T08:37:55.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.630 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131801 s, 79.6 MB/s 2024-09-10T08:37:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013101 s, 80.0 MB/s 2024-09-10T08:37:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176174 s, 59.5 MB/s 2024-09-10T08:37:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177471 s, 59.1 MB/s 2024-09-10T08:37:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013009 s, 80.6 MB/s 2024-09-10T08:37:55.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175664 s, 59.7 MB/s 2024-09-10T08:37:55.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.741 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126818 s, 82.7 MB/s 2024-09-10T08:37:55.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:55.750 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:55.751 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:55.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.850 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132099 s, 79.4 MB/s 2024-09-10T08:37:55.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.869 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152132 s, 68.9 MB/s 2024-09-10T08:37:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01273 s, 82.4 MB/s 2024-09-10T08:37:55.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126911 s, 82.6 MB/s 2024-09-10T08:37:55.914 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118983 s, 88.1 MB/s 2024-09-10T08:37:55.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171095 s, 61.3 MB/s 2024-09-10T08:37:55.951 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.951 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.951 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01348 s, 77.8 MB/s 2024-09-10T08:37:55.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164293 s, 63.8 MB/s 2024-09-10T08:37:55.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:55.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:55.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159134 s, 65.9 MB/s 2024-09-10T08:37:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156872 s, 66.8 MB/s 2024-09-10T08:37:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158809 s, 66.0 MB/s 2024-09-10T08:37:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136046 s, 77.1 MB/s 2024-09-10T08:37:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130177 s, 80.5 MB/s 2024-09-10T08:37:56.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.076 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125818 s, 83.3 MB/s 2024-09-10T08:37:56.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128134 s, 81.8 MB/s 2024-09-10T08:37:56.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162854 s, 64.4 MB/s 2024-09-10T08:37:56.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.127 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130075 s, 80.6 MB/s 2024-09-10T08:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166746 s, 62.9 MB/s 2024-09-10T08:37:56.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145039 s, 72.3 MB/s 2024-09-10T08:37:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138094 s, 75.9 MB/s 2024-09-10T08:37:56.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.196 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.196 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115898 s, 90.5 MB/s 2024-09-10T08:37:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.212 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134985 s, 77.7 MB/s 2024-09-10T08:37:56.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.229 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134342 s, 78.1 MB/s 2024-09-10T08:37:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164808 s, 63.6 MB/s 2024-09-10T08:37:56.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.266 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148141 s, 70.8 MB/s 2024-09-10T08:37:56.282 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.282 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.282 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129626 s, 80.9 MB/s 2024-09-10T08:37:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.298 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128351 s, 81.7 MB/s 2024-09-10T08:37:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.314 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128872 s, 81.4 MB/s 2024-09-10T08:37:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.330 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130367 s, 80.4 MB/s 2024-09-10T08:37:56.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.350 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163315 s, 64.2 MB/s 2024-09-10T08:37:56.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137276 s, 76.4 MB/s 2024-09-10T08:37:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123727 s, 84.7 MB/s 2024-09-10T08:37:56.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:56.391 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:56.391 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:56.391 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T08:37:56.391 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:56.392 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:56.392 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:56.392 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:56.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:56.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.494 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158614 s, 66.1 MB/s 2024-09-10T08:37:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141179 s, 74.3 MB/s 2024-09-10T08:37:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.527 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133304 s, 78.7 MB/s 2024-09-10T08:37:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012903 s, 81.3 MB/s 2024-09-10T08:37:56.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.560 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137352 s, 76.3 MB/s 2024-09-10T08:37:56.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.576 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.576 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013241 s, 79.2 MB/s 2024-09-10T08:37:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165045 s, 63.5 MB/s 2024-09-10T08:37:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140355 s, 74.7 MB/s 2024-09-10T08:37:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138658 s, 75.6 MB/s 2024-09-10T08:37:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167126 s, 62.7 MB/s 2024-09-10T08:37:56.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132729 s, 79.0 MB/s 2024-09-10T08:37:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140463 s, 74.7 MB/s 2024-09-10T08:37:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122177 s, 85.8 MB/s 2024-09-10T08:37:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175641 s, 59.7 MB/s 2024-09-10T08:37:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128964 s, 81.3 MB/s 2024-09-10T08:37:56.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130063 s, 80.6 MB/s 2024-09-10T08:37:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.770 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158956 s, 66.0 MB/s 2024-09-10T08:37:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131605 s, 79.7 MB/s 2024-09-10T08:37:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131218 s, 79.9 MB/s 2024-09-10T08:37:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130879 s, 80.1 MB/s 2024-09-10T08:37:56.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136175 s, 77.0 MB/s 2024-09-10T08:37:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.852 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134003 s, 78.3 MB/s 2024-09-10T08:37:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126299 s, 83.0 MB/s 2024-09-10T08:37:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013421 s, 78.1 MB/s 2024-09-10T08:37:56.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131729 s, 79.6 MB/s 2024-09-10T08:37:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.920 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170638 s, 61.5 MB/s 2024-09-10T08:37:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146845 s, 71.4 MB/s 2024-09-10T08:37:56.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.954 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128697 s, 81.5 MB/s 2024-09-10T08:37:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131607 s, 79.7 MB/s 2024-09-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136838 s, 76.6 MB/s 2024-09-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013012 s, 80.6 MB/s 2024-09-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155051 s, 67.6 MB/s 2024-09-10T08:37:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:57.031 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:57.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013892 s, 75.5 MB/s 2024-09-10T08:37:57.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.145 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128442 s, 81.6 MB/s 2024-09-10T08:37:57.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.162 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135168 s, 77.6 MB/s 2024-09-10T08:37:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140109 s, 74.8 MB/s 2024-09-10T08:37:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.196 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134939 s, 77.7 MB/s 2024-09-10T08:37:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133423 s, 78.6 MB/s 2024-09-10T08:37:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137566 s, 76.2 MB/s 2024-09-10T08:37:57.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165319 s, 63.4 MB/s 2024-09-10T08:37:57.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175259 s, 59.8 MB/s 2024-09-10T08:37:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145282 s, 72.2 MB/s 2024-09-10T08:37:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.306 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160575 s, 65.3 MB/s 2024-09-10T08:37:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130758 s, 80.2 MB/s 2024-09-10T08:37:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131627 s, 79.7 MB/s 2024-09-10T08:37:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146178 s, 71.7 MB/s 2024-09-10T08:37:57.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166816 s, 62.9 MB/s 2024-09-10T08:37:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128551 s, 81.6 MB/s 2024-09-10T08:37:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116391 s, 90.1 MB/s 2024-09-10T08:37:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137299 s, 76.4 MB/s 2024-09-10T08:37:57.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128429 s, 81.6 MB/s 2024-09-10T08:37:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134991 s, 77.7 MB/s 2024-09-10T08:37:57.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137597 s, 76.2 MB/s 2024-09-10T08:37:57.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155861 s, 67.3 MB/s 2024-09-10T08:37:57.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.508 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129511 s, 81.0 MB/s 2024-09-10T08:37:57.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.523 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127299 s, 82.4 MB/s 2024-09-10T08:37:57.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.540 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130508 s, 80.3 MB/s 2024-09-10T08:37:57.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134974 s, 77.7 MB/s 2024-09-10T08:37:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131885 s, 79.5 MB/s 2024-09-10T08:37:57.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.590 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135696 s, 77.3 MB/s 2024-09-10T08:37:57.605 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.605 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.605 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127436 s, 82.3 MB/s 2024-09-10T08:37:57.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134657 s, 77.9 MB/s 2024-09-10T08:37:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.638 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133726 s, 78.4 MB/s 2024-09-10T08:37:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134296 s, 78.1 MB/s 2024-09-10T08:37:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:57.664 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:57.664 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:57.665 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T08:37:57.665 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:57.665 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:57.665 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:57.665 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163143 s, 64.3 MB/s 2024-09-10T08:37:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.784 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141013 s, 74.4 MB/s 2024-09-10T08:37:57.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151267 s, 69.3 MB/s 2024-09-10T08:37:57.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.819 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130286 s, 80.5 MB/s 2024-09-10T08:37:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132387 s, 79.2 MB/s 2024-09-10T08:37:57.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.851 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124922 s, 83.9 MB/s 2024-09-10T08:37:57.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.868 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136413 s, 76.9 MB/s 2024-09-10T08:37:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126912 s, 82.6 MB/s 2024-09-10T08:37:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128972 s, 81.3 MB/s 2024-09-10T08:37:57.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129711 s, 80.8 MB/s 2024-09-10T08:37:57.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121305 s, 86.4 MB/s 2024-09-10T08:37:57.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.948 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140259 s, 74.8 MB/s 2024-09-10T08:37:57.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130981 s, 80.1 MB/s 2024-09-10T08:37:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.981 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127873 s, 82.0 MB/s 2024-09-10T08:37:57.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:57.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:57.997 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136314 s, 76.9 MB/s 2024-09-10T08:37:58.016 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.016 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.016 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153804 s, 68.2 MB/s 2024-09-10T08:37:58.035 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.035 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.035 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148542 s, 70.6 MB/s 2024-09-10T08:37:58.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.053 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139184 s, 75.3 MB/s 2024-09-10T08:37:58.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.069 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123414 s, 85.0 MB/s 2024-09-10T08:37:58.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127292 s, 82.4 MB/s 2024-09-10T08:37:58.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.102 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131022 s, 80.0 MB/s 2024-09-10T08:37:58.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134373 s, 78.0 MB/s 2024-09-10T08:37:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122415 s, 85.7 MB/s 2024-09-10T08:37:58.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147017 s, 71.3 MB/s 2024-09-10T08:37:58.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.171 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152966 s, 68.5 MB/s 2024-09-10T08:37:58.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.191 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159355 s, 65.8 MB/s 2024-09-10T08:37:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129046 s, 81.3 MB/s 2024-09-10T08:37:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143517 s, 73.1 MB/s 2024-09-10T08:37:58.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131704 s, 79.6 MB/s 2024-09-10T08:37:58.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132585 s, 79.1 MB/s 2024-09-10T08:37:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138522 s, 75.7 MB/s 2024-09-10T08:37:58.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130468 s, 80.4 MB/s 2024-09-10T08:37:58.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:58.302 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:58.303 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129492 s, 81.0 MB/s 2024-09-10T08:37:58.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126337 s, 83.0 MB/s 2024-09-10T08:37:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.435 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136926 s, 76.6 MB/s 2024-09-10T08:37:58.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131399 s, 79.8 MB/s 2024-09-10T08:37:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013199 s, 79.4 MB/s 2024-09-10T08:37:58.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.484 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118277 s, 88.7 MB/s 2024-09-10T08:37:58.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.501 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137128 s, 76.5 MB/s 2024-09-10T08:37:58.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.519 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140603 s, 74.6 MB/s 2024-09-10T08:37:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136305 s, 76.9 MB/s 2024-09-10T08:37:58.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.552 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125533 s, 83.5 MB/s 2024-09-10T08:37:58.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136558 s, 76.8 MB/s 2024-09-10T08:37:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286193 s, 36.6 MB/s 2024-09-10T08:37:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144229 s, 72.7 MB/s 2024-09-10T08:37:58.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174851 s, 60.0 MB/s 2024-09-10T08:37:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151475 s, 69.2 MB/s 2024-09-10T08:37:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205984 s, 50.9 MB/s 2024-09-10T08:37:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.698 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128965 s, 81.3 MB/s 2024-09-10T08:37:58.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156742 s, 66.9 MB/s 2024-09-10T08:37:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158025 s, 66.4 MB/s 2024-09-10T08:37:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126835 s, 82.7 MB/s 2024-09-10T08:37:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169692 s, 61.8 MB/s 2024-09-10T08:37:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013174 s, 79.6 MB/s 2024-09-10T08:37:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129399 s, 81.0 MB/s 2024-09-10T08:37:58.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140026 s, 74.9 MB/s 2024-09-10T08:37:58.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163781 s, 64.0 MB/s 2024-09-10T08:37:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.857 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132529 s, 79.1 MB/s 2024-09-10T08:37:58.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132758 s, 79.0 MB/s 2024-09-10T08:37:58.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165208 s, 63.5 MB/s 2024-09-10T08:37:58.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.910 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013646 s, 76.8 MB/s 2024-09-10T08:37:58.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.926 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127493 s, 82.2 MB/s 2024-09-10T08:37:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01685 s, 62.2 MB/s 2024-09-10T08:37:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154639 s, 67.8 MB/s 2024-09-10T08:37:58.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:58.974 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:59.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136315 s, 76.9 MB/s 2024-09-10T08:37:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136078 s, 77.1 MB/s 2024-09-10T08:37:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124885 s, 84.0 MB/s 2024-09-10T08:37:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116096 s, 90.3 MB/s 2024-09-10T08:37:59.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129831 s, 80.8 MB/s 2024-09-10T08:37:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132948 s, 78.9 MB/s 2024-09-10T08:37:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140037 s, 74.9 MB/s 2024-09-10T08:37:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167019 s, 62.8 MB/s 2024-09-10T08:37:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013639 s, 76.9 MB/s 2024-09-10T08:37:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159125 s, 65.9 MB/s 2024-09-10T08:37:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136778 s, 76.7 MB/s 2024-09-10T08:37:59.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141117 s, 74.3 MB/s 2024-09-10T08:37:59.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.276 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134407 s, 78.0 MB/s 2024-09-10T08:37:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133418 s, 78.6 MB/s 2024-09-10T08:37:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013096 s, 80.1 MB/s 2024-09-10T08:37:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125848 s, 83.3 MB/s 2024-09-10T08:37:59.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.341 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.341 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114934 s, 91.2 MB/s 2024-09-10T08:37:59.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133267 s, 78.7 MB/s 2024-09-10T08:37:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129959 s, 80.7 MB/s 2024-09-10T08:37:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01317 s, 79.6 MB/s 2024-09-10T08:37:59.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138976 s, 75.5 MB/s 2024-09-10T08:37:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130519 s, 80.3 MB/s 2024-09-10T08:37:59.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.439 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012742 s, 82.3 MB/s 2024-09-10T08:37:59.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124686 s, 84.1 MB/s 2024-09-10T08:37:59.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127191 s, 82.4 MB/s 2024-09-10T08:37:59.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136534 s, 76.8 MB/s 2024-09-10T08:37:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.504 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133185 s, 78.7 MB/s 2024-09-10T08:37:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130702 s, 80.2 MB/s 2024-09-10T08:37:59.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.537 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129614 s, 80.9 MB/s 2024-09-10T08:37:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.553 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130725 s, 80.2 MB/s 2024-09-10T08:37:59.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135862 s, 77.2 MB/s 2024-09-10T08:37:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133731 s, 78.4 MB/s 2024-09-10T08:37:59.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:37:59.595 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:37:59.595 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:37:59.595 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T08:37:59.595 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:37:59.595 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:37:59.596 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:37:59.596 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:37:59.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:37:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:37:59.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.694 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120596 s, 86.9 MB/s 2024-09-10T08:37:59.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134476 s, 78.0 MB/s 2024-09-10T08:37:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159715 s, 65.7 MB/s 2024-09-10T08:37:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127374 s, 82.3 MB/s 2024-09-10T08:37:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131379 s, 79.8 MB/s 2024-09-10T08:37:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.778 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135753 s, 77.2 MB/s 2024-09-10T08:37:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152988 s, 68.5 MB/s 2024-09-10T08:37:59.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.815 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156999 s, 66.8 MB/s 2024-09-10T08:37:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.832 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141422 s, 74.1 MB/s 2024-09-10T08:37:59.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130066 s, 80.6 MB/s 2024-09-10T08:37:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148273 s, 70.7 MB/s 2024-09-10T08:37:59.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.885 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158779 s, 66.0 MB/s 2024-09-10T08:37:59.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.901 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130004 s, 80.7 MB/s 2024-09-10T08:37:59.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125314 s, 83.7 MB/s 2024-09-10T08:37:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.934 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142954 s, 73.4 MB/s 2024-09-10T08:37:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126742 s, 82.7 MB/s 2024-09-10T08:37:59.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142554 s, 73.6 MB/s 2024-09-10T08:37:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:37:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:37:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133231 s, 78.7 MB/s 2024-09-10T08:38:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.000 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137618 s, 76.2 MB/s 2024-09-10T08:38:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119296 s, 87.9 MB/s 2024-09-10T08:38:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135852 s, 77.2 MB/s 2024-09-10T08:38:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127331 s, 82.4 MB/s 2024-09-10T08:38:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140155 s, 74.8 MB/s 2024-09-10T08:38:00.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.081 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129881 s, 80.7 MB/s 2024-09-10T08:38:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.101 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164685 s, 63.7 MB/s 2024-09-10T08:38:00.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135929 s, 77.1 MB/s 2024-09-10T08:38:00.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130277 s, 80.5 MB/s 2024-09-10T08:38:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013197 s, 79.5 MB/s 2024-09-10T08:38:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013168 s, 79.6 MB/s 2024-09-10T08:38:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130475 s, 80.4 MB/s 2024-09-10T08:38:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164861 s, 63.6 MB/s 2024-09-10T08:38:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.218 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134082 s, 78.2 MB/s 2024-09-10T08:38:00.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:00.227 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:00.227 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:00.227 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T08:38:00.227 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:00.228 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:00.228 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:00.228 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:00.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132113 s, 79.4 MB/s 2024-09-10T08:38:00.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.343 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128822 s, 81.4 MB/s 2024-09-10T08:38:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.360 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130126 s, 80.6 MB/s 2024-09-10T08:38:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129143 s, 81.2 MB/s 2024-09-10T08:38:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131476 s, 79.8 MB/s 2024-09-10T08:38:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135298 s, 77.5 MB/s 2024-09-10T08:38:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.427 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165559 s, 63.3 MB/s 2024-09-10T08:38:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128559 s, 81.6 MB/s 2024-09-10T08:38:00.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130675 s, 80.2 MB/s 2024-09-10T08:38:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130029 s, 80.6 MB/s 2024-09-10T08:38:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161231 s, 65.0 MB/s 2024-09-10T08:38:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.511 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135545 s, 77.4 MB/s 2024-09-10T08:38:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138144 s, 75.9 MB/s 2024-09-10T08:38:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131115 s, 80.0 MB/s 2024-09-10T08:38:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.561 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129013 s, 81.3 MB/s 2024-09-10T08:38:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139329 s, 75.3 MB/s 2024-09-10T08:38:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016115 s, 65.1 MB/s 2024-09-10T08:38:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.611 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011105 s, 94.4 MB/s 2024-09-10T08:38:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136847 s, 76.6 MB/s 2024-09-10T08:38:00.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.644 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136871 s, 76.6 MB/s 2024-09-10T08:38:00.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164289 s, 63.8 MB/s 2024-09-10T08:38:00.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.680 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134454 s, 78.0 MB/s 2024-09-10T08:38:00.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.696 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130766 s, 80.2 MB/s 2024-09-10T08:38:00.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176211 s, 59.5 MB/s 2024-09-10T08:38:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.733 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127841 s, 82.0 MB/s 2024-09-10T08:38:00.749 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131794 s, 79.6 MB/s 2024-09-10T08:38:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.765 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122993 s, 85.3 MB/s 2024-09-10T08:38:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.781 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128994 s, 81.3 MB/s 2024-09-10T08:38:00.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.799 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145134 s, 72.2 MB/s 2024-09-10T08:38:00.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.815 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135532 s, 77.4 MB/s 2024-09-10T08:38:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165577 s, 63.3 MB/s 2024-09-10T08:38:00.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.851 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131971 s, 79.5 MB/s 2024-09-10T08:38:00.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:00.860 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:00.860 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:00.860 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T08:38:00.861 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:00.861 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:00.861 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:00.861 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:00.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:00.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133833 s, 78.3 MB/s 2024-09-10T08:38:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.976 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013666 s, 76.7 MB/s 2024-09-10T08:38:00.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:00.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:00.992 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129836 s, 80.8 MB/s 2024-09-10T08:38:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164872 s, 63.6 MB/s 2024-09-10T08:38:01.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.027 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.027 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127196 s, 82.4 MB/s 2024-09-10T08:38:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133117 s, 78.8 MB/s 2024-09-10T08:38:01.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167085 s, 62.8 MB/s 2024-09-10T08:38:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158906 s, 66.0 MB/s 2024-09-10T08:38:01.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.098 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130789 s, 80.2 MB/s 2024-09-10T08:38:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.114 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125557 s, 83.5 MB/s 2024-09-10T08:38:01.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.131 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139444 s, 75.2 MB/s 2024-09-10T08:38:01.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.148 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013298 s, 78.9 MB/s 2024-09-10T08:38:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013578 s, 77.2 MB/s 2024-09-10T08:38:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.181 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134942 s, 77.7 MB/s 2024-09-10T08:38:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.201 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164167 s, 63.9 MB/s 2024-09-10T08:38:01.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.217 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135555 s, 77.4 MB/s 2024-09-10T08:38:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134836 s, 77.8 MB/s 2024-09-10T08:38:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125891 s, 83.3 MB/s 2024-09-10T08:38:01.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.266 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013864 s, 75.6 MB/s 2024-09-10T08:38:01.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.285 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159174 s, 65.9 MB/s 2024-09-10T08:38:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167644 s, 62.5 MB/s 2024-09-10T08:38:01.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.324 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158868 s, 66.0 MB/s 2024-09-10T08:38:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015931 s, 65.8 MB/s 2024-09-10T08:38:01.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.360 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134334 s, 78.1 MB/s 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013473 s, 77.8 MB/s 2024-09-10T08:38:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136621 s, 76.8 MB/s 2024-09-10T08:38:01.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.410 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134663 s, 77.9 MB/s 2024-09-10T08:38:01.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153365 s, 68.4 MB/s 2024-09-10T08:38:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131856 s, 79.5 MB/s 2024-09-10T08:38:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.464 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163039 s, 64.3 MB/s 2024-09-10T08:38:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166785 s, 62.9 MB/s 2024-09-10T08:38:01.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129798 s, 80.8 MB/s 2024-09-10T08:38:01.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:01.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:01.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-10T08:38:01.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.670+0000 7fdb02800640 1 Processor -- start 2024-09-10T08:38:01.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.670+0000 7fdb02800640 1 -- start start 2024-09-10T08:38:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb02800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc0d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb02800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdafc0d2690 0x7fdafc0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb02800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc162040 con 0x7fdafc161c60 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb02800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdafc0d5040 con 0x7fdafc0d2690 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb02800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdafc0d5320 con 0x7fdafc06dfd0 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.671+0000 7fdb01400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdafc161c60 0x7fdafc06d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43544/0 (socket says 172.21.15.52:43544) 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb01400640 1 -- 172.21.15.52:0/2253860109 learned_addr learned my addr 172.21.15.52:0/2253860109 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb01e00640 1 --2- 172.21.15.52:0/2253860109 >> v2:172.21.15.52:3300/0 conn(0x7fdafc0d2690 0x7fdafc0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb00a00640 1 --2- 172.21.15.52:0/2253860109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc0d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdafbe00640 1 -- 172.21.15.52:0/2253860109 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370156994 0 0) 0x7fdafc162040 con 0x7fdafc161c60 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdafbe00640 1 -- 172.21.15.52:0/2253860109 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdae4003520 con 0x7fdafc161c60 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb00a00640 1 -- 172.21.15.52:0/2253860109 >> v2:172.21.15.52:3300/0 conn(0x7fdafc0d2690 msgr2=0x7fdafc0d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb00a00640 1 --2- 172.21.15.52:0/2253860109 >> v2:172.21.15.52:3300/0 conn(0x7fdafc0d2690 0x7fdafc0d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb00a00640 1 -- 172.21.15.52:0/2253860109 >> v1:172.21.15.52:6789/0 conn(0x7fdafc161c60 legacy=0x7fdafc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.672+0000 7fdb00a00640 1 -- 172.21.15.52:0/2253860109 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc0d3da0 con 0x7fdafc06dfd0 2024-09-10T08:38:01.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.673+0000 7fdb00a00640 1 --2- 172.21.15.52:0/2253860109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc0d2150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdae80097a0 tx=0x7fdae802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0db86125513affc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.673+0000 7fdafbe00640 1 -- 172.21.15.52:0/2253860109 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8037070 con 0x7fdafc06dfd0 2024-09-10T08:38:01.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.673+0000 7fdafbe00640 1 -- 172.21.15.52:0/2253860109 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae8032440 con 0x7fdafc06dfd0 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdafbe00640 1 -- 172.21.15.52:0/2253860109 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae80327f0 con 0x7fdafc06dfd0 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 -- 172.21.15.52:0/2253860109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 msgr2=0x7fdafc0d2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 --2- 172.21.15.52:0/2253860109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc0d2150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdae80097a0 tx=0x7fdae802a180 comp rx=0 tx=0).stop 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 -- 172.21.15.52:0/2253860109 shutdown_connections 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 --2- 172.21.15.52:0/2253860109 >> v2:172.21.15.52:3300/0 conn(0x7fdafc0d2690 0x7fdafc0d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 --2- 172.21.15.52:0/2253860109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc0d2150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 -- 172.21.15.52:0/2253860109 >> 172.21.15.52:0/2253860109 conn(0x7fdafc0d1630 msgr2=0x7fdafc0d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 -- 172.21.15.52:0/2253860109 shutdown_connections 2024-09-10T08:38:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.674+0000 7fdb02800640 1 -- 172.21.15.52:0/2253860109 wait complete. 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.676+0000 7fdb02800640 1 Processor -- start 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.676+0000 7fdb02800640 1 -- start start 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdafc0d2690 0x7fdafc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc0b86c0 con 0x7fdafc161c60 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc0d42c0 con 0x7fdafc0d2690 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb02800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdafc0b8840 con 0x7fdafc06dfd0 2024-09-10T08:38:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49634/0 (socket says 172.21.15.52:49634) 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb01e00640 1 -- 172.21.15.52:0/713538089 learned_addr learned my addr 172.21.15.52:0/713538089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb01400640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.677+0000 7fdb00a00640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdafc0d2690 0x7fdafc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 -- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 msgr2=0x7fdafc157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 -- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdafc0d2690 msgr2=0x7fdafc0b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdafc0d2690 0x7fdafc0b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 -- 172.21.15.52:0/713538089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc1f8720 con 0x7fdafc161c60 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01400640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:01.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb01e00640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400efc0 tx=0x7fdaf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdaf9600640 1 -- 172.21.15.52:0/713538089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4018020 con 0x7fdafc161c60 2024-09-10T08:38:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdaf9600640 1 -- 172.21.15.52:0/713538089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4014480 con 0x7fdafc161c60 2024-09-10T08:38:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdaf9600640 1 -- 172.21.15.52:0/713538089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4014870 con 0x7fdafc161c60 2024-09-10T08:38:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdafc1f8440 con 0x7fdafc161c60 2024-09-10T08:38:01.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.678+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdafc0c9ef0 con 0x7fdafc161c60 2024-09-10T08:38:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.680+0000 7fdaf9600640 1 -- 172.21.15.52:0/713538089 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdaf4005d10 con 0x7fdafc161c60 2024-09-10T08:38:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.681+0000 7fdaf9600640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 0x7fdadc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.681+0000 7fdaf9600640 1 -- 172.21.15.52:0/713538089 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdaf408b8d0 con 0x7fdafc161c60 2024-09-10T08:38:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.682+0000 7fdb06e2f740 1 Processor -- start 2024-09-10T08:38:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.682+0000 7fdb01400640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 0x7fdadc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.682+0000 7fdb06e2f740 1 -- start start 2024-09-10T08:38:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.682+0000 7fdb01400640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 0x7fdadc06e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x555699f98da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f78940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555699eb5a70 con 0x555699f989c0 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555699e5d9d0 con 0x555699f965e0 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555699eb1a30 con 0x555699f96180 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb01400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x555699f98da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb00a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb01400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x555699f98da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49640/0 (socket says 172.21.15.52:49640) 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f78940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb01400640 1 -- 172.21.15.52:0/3534449412 learned_addr learned my addr 172.21.15.52:0/3534449412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.683+0000 7fdb00a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42558/0 (socket says 172.21.15.52:42558) 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 -- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 msgr2=0x555699f97d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 -- 172.21.15.52:0/3534449412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 msgr2=0x555699f98da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x555699f98da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 -- 172.21.15.52:0/3534449412 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555699c94ba0 con 0x555699f965e0 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb00a00640 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdb01e00640 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f78940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4089df0 tx=0x7fdaf405a3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f30d618c1acca1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdaedc00640 1 -- 172.21.15.52:0/3534449412 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4071020 con 0x555699f965e0 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdaedc00640 1 -- 172.21.15.52:0/3534449412 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4062750 con 0x555699f965e0 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.684+0000 7fdaedc00640 1 -- 172.21.15.52:0/3534449412 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40561e0 con 0x555699f965e0 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 -- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 msgr2=0x555699f78940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f78940 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4089df0 tx=0x7fdaf405a3b0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 -- 172.21.15.52:0/3534449412 shutdown_connections 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f78940 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f96180 0x555699f97d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/3534449412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x555699f98da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 -- 172.21.15.52:0/3534449412 >> 172.21.15.52:0/3534449412 conn(0x555699f4e620 msgr2=0x555699f96a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 -- 172.21.15.52:0/3534449412 shutdown_connections 2024-09-10T08:38:01.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.685+0000 7fdb06e2f740 1 -- 172.21.15.52:0/3534449412 wait complete. 2024-09-10T08:38:01.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.686+0000 7fdb06e2f740 1 -- start start 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.686+0000 7fdb06e2f740 1 Processor -- start 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 0x555699f7b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f989c0 0x555699f756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555699f950e0 con 0x555699f7bb90 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x555699e70bf0 con 0x555699f989c0 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555699f953c0 con 0x555699f965e0 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb06e2f740 10 client.0 _ll_register_callbacks cb 0x555699e936b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.687+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49650/0 (socket says 172.21.15.52:49650) 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 -- 172.21.15.52:0/911922917 learned_addr learned my addr 172.21.15.52:0/911922917 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01400640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 0x555699f7b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb00a00640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f989c0 0x555699f756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 -- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 msgr2=0x555699f7b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 0x555699f7b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 -- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f989c0 msgr2=0x555699f756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f989c0 0x555699f756f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 -- 172.21.15.52:0/911922917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555699b88490 con 0x555699f7bb90 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01400640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 0x555699f7b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdb01e00640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055fd0 tx=0x7fdaf401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702b120ff6b323ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.688+0000 7fdae2000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4075070 con 0x555699f7bb90 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaf4062750 con 0x555699f7bb90 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdaf40624d0 con 0x555699f7bb90 2024-09-10T08:38:01.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7fdaf4080050 con 0x555699f7bb90 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 10 client.8469 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x555699cf5330 con 0x555699f7bb90 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf4062750 con 0x555699f7bb90 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7fdaf4083020 con 0x555699f7bb90 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 10 client.8469 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 10 client.8469 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 20 client.8469 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f76320 0x555699f508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 4 client.8469 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.689+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555699ec31a0 con 0x555699f76320 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.690+0000 7fdb01400640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f76320 0x555699f508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.690+0000 7fdb01400640 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f76320 0x555699f508b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb030e667f56d71 server_cookie=82ddadd2c4094820 in_seq=0 out_seq=0 2024-09-10T08:38:01.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.690+0000 7fdae2000640 10 client.8469 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdae2000640 1 -- 172.21.15.52:0/911922917 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555699ec31a0 con 0x555699f76320 2024-09-10T08:38:01.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdae2000640 10 client.8469 handle_command_reply: tid=0 2024-09-10T08:38:01.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 client.8469 shutdown 2024-09-10T08:38:01.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 msgr2=0x555699f75c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4055fd0 tx=0x7fdaf401f040 comp rx=0 tx=0).stop 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 shutdown_connections 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f76320 0x555699f508b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f75c30 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f989c0 0x555699f756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/911922917 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f965e0 0x555699f7b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 >> 172.21.15.52:0/911922917 conn(0x555699f96180 msgr2=0x555699f78f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdae2000640 0 client.8469 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 shutdown_connections 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.691+0000 7fdb06e2f740 1 -- 172.21.15.52:0/911922917 wait complete. 2024-09-10T08:38:01.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.692+0000 7fdb06e2f740 20 client.8469 trim_cache size 0 max 16384 2024-09-10T08:38:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.710+0000 7fdb06e2f740 1 Processor -- start 2024-09-10T08:38:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.710+0000 7fdb06e2f740 1 -- start start 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f75a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f989c0 0x555699f99f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc200900 con 0x555699f7bb90 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc159a70 con 0x555699f965e0 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdafc0c8a50 con 0x555699f989c0 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49662/0 (socket says 172.21.15.52:49662) 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 -- 172.21.15.52:0/1922565904 learned_addr learned my addr 172.21.15.52:0/1922565904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb00a00640 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f75a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01e00640 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f989c0 0x555699f99f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 -- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f989c0 msgr2=0x555699f99f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f989c0 0x555699f99f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 -- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 msgr2=0x555699f75a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f75a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.711+0000 7fdb01400640 1 -- 172.21.15.52:0/1922565904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555699b61550 con 0x555699f7bb90 2024-09-10T08:38:01.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdb01400640 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0005f80 tx=0x7fdaf0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ee616708c033e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdaed200640 1 -- 172.21.15.52:0/1922565904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00070d0 con 0x555699f7bb90 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdaed200640 1 -- 172.21.15.52:0/1922565904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf0007270 con 0x555699f7bb90 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdaed200640 1 -- 172.21.15.52:0/1922565904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0007420 con 0x555699f7bb90 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdb06e2f740 1 -- 172.21.15.52:0/1922565904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 msgr2=0x555699f754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.712+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0005f80 tx=0x7fdaf0011000 comp rx=0 tx=0).stop 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 -- 172.21.15.52:0/1922565904 shutdown_connections 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f989c0 0x555699f99f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x555699f75a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/1922565904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f7bb90 0x555699f754c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 -- 172.21.15.52:0/1922565904 >> 172.21.15.52:0/1922565904 conn(0x555699f96180 msgr2=0x555699f4c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 -- 172.21.15.52:0/1922565904 shutdown_connections 2024-09-10T08:38:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 -- 172.21.15.52:0/1922565904 wait complete. 2024-09-10T08:38:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.713+0000 7fdb06e2f740 1 -- start start 2024-09-10T08:38:01.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.714+0000 7fdb06e2f740 1 Processor -- start 2024-09-10T08:38:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.714+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f7bb90 0x555699f901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.714+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x55569a017a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb06e2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555699f99760 con 0x555699f989c0 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc159420 con 0x555699f965e0 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb06e2f740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x555699eb7f10 con 0x555699f7bb90 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb06e2f740 10 client.0 _ll_register_callbacks cb 0x7fdaf0001da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f7bb90 0x555699f901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49678/0 (socket says 172.21.15.52:49678) 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 -- 172.21.15.52:0/142355318 learned_addr learned my addr 172.21.15.52:0/142355318 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb00a00640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x55569a017a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 -- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f7bb90 msgr2=0x555699f901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f7bb90 0x555699f901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 -- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 msgr2=0x55569a017a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x55569a017a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 -- 172.21.15.52:0/142355318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555699f74090 con 0x555699f989c0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdb01e00640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4059870 tx=0x7fdaf406e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c0e99e41516459 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.715+0000 7fdae2000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4075040 con 0x555699f989c0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdaf4084e00 con 0x555699f989c0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaf0007270 con 0x555699f989c0 2024-09-10T08:38:01.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7fdaf4071040 con 0x555699f989c0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 10 client.8475 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x555699f74090 con 0x555699f989c0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf0007270 con 0x555699f989c0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7fdaf4083020 con 0x555699f989c0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 10 client.8475 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 10 client.8475 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 20 client.8475 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f93db0 0x55569a0188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 4 client.8475 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x555699ebd4f0 con 0x555699f93db0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.716+0000 7fdb01400640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f93db0 0x55569a0188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.717+0000 7fdb01400640 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f93db0 0x55569a0188a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b975acfed390e14 server_cookie=c5902e67636f79e9 in_seq=0 out_seq=0 2024-09-10T08:38:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.717+0000 7fdae2000640 10 client.8475 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdae2000640 1 -- 172.21.15.52:0/142355318 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555699ebd4f0 con 0x555699f93db0 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdae2000640 10 client.8475 handle_command_reply: tid=0 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 client.8475 shutdown 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 msgr2=0x55569a018360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4059870 tx=0x7fdaf406e000 comp rx=0 tx=0).stop 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 shutdown_connections 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x555699f93db0 0x55569a0188a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555699f989c0 0x55569a018360 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x555699f965e0 0x55569a017a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 --2- 172.21.15.52:0/142355318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x555699f7bb90 0x555699f901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 >> 172.21.15.52:0/142355318 conn(0x555699f96180 msgr2=0x555699f505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdae2000640 0 client.8475 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 shutdown_connections 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 1 -- 172.21.15.52:0/142355318 wait complete. 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.721+0000 7fdb06e2f740 20 client.8475 trim_cache size 0 max 16384 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:01.724 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:38:01.725 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "2031cb78-0506-4095-926e-d825809aaa4d", 2024-09-10T08:38:01.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:38:01.725 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 msgr2=0x7fdadc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 0x7fdadc06e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0009040 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 msgr2=0x7fdafc0b66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400efc0 tx=0x7fdaf400c490 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 shutdown_connections 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdadc06be30 0x7fdadc06e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdafc161c60 0x7fdafc0b66f0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdafc0d2690 0x7fdafc0b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 --2- 172.21.15.52:0/713538089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdafc06dfd0 0x7fdafc157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 >> 172.21.15.52:0/713538089 conn(0x7fdafc0d1630 msgr2=0x7fdafc0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 shutdown_connections 2024-09-10T08:38:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.722+0000 7fdb02800640 1 -- 172.21.15.52:0/713538089 wait complete. 2024-09-10T08:38:01.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:01.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-10T08:38:01.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.932+0000 7fa4bd800640 1 Processor -- start 2024-09-10T08:38:01.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.932+0000 7fa4bd800640 1 -- start start 2024-09-10T08:38:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4bd800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4b80732e0 0x7fa4b80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 0x7fa4b80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4bd800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80714b0 con 0x7fa4b8071c70 2024-09-10T08:38:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4bd800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b8073c00 con 0x7fa4b80732e0 2024-09-10T08:38:01.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4bd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80cd880 con 0x7fa4b80cce30 2024-09-10T08:38:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4b6a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa4b80732e0 0x7fa4b80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4b7400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fa4b8071c70 0x7fa4b815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:38726/0 (socket says 172.21.15.52:38726) 2024-09-10T08:38:01.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4b7400640 1 -- 172.21.15.52:0/2157275700 learned_addr learned my addr 172.21.15.52:0/2157275700 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.934+0000 7fa4afe00640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 0x7fa4b80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4b6a00640 1 -- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 msgr2=0x7fa4b80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 0x7fa4b80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4b6a00640 1 -- 172.21.15.52:0/2157275700 >> v1:172.21.15.176:6789/0 conn(0x7fa4b8071c70 legacy=0x7fa4b815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4b6000640 1 -- 172.21.15.52:0/2157275700 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343769291 0 0) 0x7fa4b80714b0 con 0x7fa4b8071c70 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4b6a00640 1 -- 172.21.15.52:0/2157275700 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80cdb60 con 0x7fa4b80732e0 2024-09-10T08:38:01.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.935+0000 7fa4afe00640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 0x7fa4b80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.936+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80732e0 0x7fa4b80736c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80097a0 tx=0x7fa4a802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88cc840632af9399 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.936+0000 7fa4b6000640 1 -- 172.21.15.52:0/2157275700 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8037070 con 0x7fa4b80732e0 2024-09-10T08:38:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.936+0000 7fa4b6000640 1 -- 172.21.15.52:0/2157275700 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a802ae50 con 0x7fa4b80732e0 2024-09-10T08:38:01.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.936+0000 7fa4b6000640 1 -- 172.21.15.52:0/2157275700 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8032660 con 0x7fa4b80732e0 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 -- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80732e0 msgr2=0x7fa4b80736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80732e0 0x7fa4b80736c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80097a0 tx=0x7fa4a802a100 comp rx=0 tx=0).stop 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 -- 172.21.15.52:0/2157275700 shutdown_connections 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80cce30 0x7fa4b80cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2157275700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b80732e0 0x7fa4b80736c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 -- 172.21.15.52:0/2157275700 >> 172.21.15.52:0/2157275700 conn(0x7fa4b806d0f0 msgr2=0x7fa4b806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 -- 172.21.15.52:0/2157275700 shutdown_connections 2024-09-10T08:38:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.937+0000 7fa4bd800640 1 -- 172.21.15.52:0/2157275700 wait complete. 2024-09-10T08:38:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.939+0000 7fa4bd800640 1 Processor -- start 2024-09-10T08:38:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.939+0000 7fa4bd800640 1 -- start start 2024-09-10T08:38:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8071c70 0x7fa4b8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80732e0 0x7fa4b8140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b806bf70 con 0x7fa4b80cce30 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b806bdf0 con 0x7fa4b8071c70 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4bd800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b8072120 con 0x7fa4b80732e0 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4b7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49684/0 (socket says 172.21.15.52:49684) 2024-09-10T08:38:01.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4b7400640 1 -- 172.21.15.52:0/2351923836 learned_addr learned my addr 172.21.15.52:0/2351923836 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4afe00640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80732e0 0x7fa4b8140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.940+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8071c70 0x7fa4b8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 -- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80732e0 msgr2=0x7fa4b8140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80732e0 0x7fa4b8140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 -- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8071c70 msgr2=0x7fa4b8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8071c70 0x7fa4b8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 -- 172.21.15.52:0/2351923836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b81419a0 con 0x7fa4b80cce30 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4b7400640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c7a0 tx=0x7fa4b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4aea00640 1 -- 172.21.15.52:0/2351923836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0018070 con 0x7fa4b80cce30 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4aea00640 1 -- 172.21.15.52:0/2351923836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b000a640 con 0x7fa4b80cce30 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4aea00640 1 -- 172.21.15.52:0/2351923836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000aab0 con 0x7fa4b80cce30 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b8141c80 con 0x7fa4b80cce30 2024-09-10T08:38:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.941+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b81562a0 con 0x7fa4b80cce30 2024-09-10T08:38:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.943+0000 7fa4aea00640 1 -- 172.21.15.52:0/2351923836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4b001b070 con 0x7fa4b80cce30 2024-09-10T08:38:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.945+0000 7fa4aea00640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 0x7fa49406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.945+0000 7fa4aea00640 1 -- 172.21.15.52:0/2351923836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fa4b008a490 con 0x7fa4b80cce30 2024-09-10T08:38:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.945+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 0x7fa49406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.945+0000 7fa4c069e740 1 Processor -- start 2024-09-10T08:38:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.945+0000 7fa4c069e740 1 -- start start 2024-09-10T08:38:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 0x7fa49406e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8034000 tx=0x7fa4a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 0x563ced5c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 0x563ced5c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563ced58ecf0 con 0x563ced5c7a80 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563ced52a7f0 con 0x563ced5c9210 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.946+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563ced4d2800 con 0x563ced5c5240 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49694/0 (socket says 172.21.15.52:49694) 2024-09-10T08:38:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 -- 172.21.15.52:0/3358775364 learned_addr learned my addr 172.21.15.52:0/3358775364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4afe00640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 0x563ced5c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b7400640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 0x563ced5c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 -- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 msgr2=0x563ced5c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 0x563ced5c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 -- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 msgr2=0x563ced5c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 0x563ced5c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 -- 172.21.15.52:0/3358775364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ced3077d0 con 0x563ced5c7a80 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4afe00640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 0x563ced5c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b7400640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 0x563ced5c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.947+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009890 tx=0x7fa4a802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469b7a697896ae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4a7400640 1 -- 172.21.15.52:0/3358775364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8037040 con 0x563ced5c7a80 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4a7400640 1 -- 172.21.15.52:0/3358775364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8032ba0 con 0x563ced5c7a80 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4a7400640 1 -- 172.21.15.52:0/3358775364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a803c440 con 0x563ced5c7a80 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 -- 172.21.15.52:0/3358775364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 msgr2=0x563ced60d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009890 tx=0x7fa4a802c000 comp rx=0 tx=0).stop 2024-09-10T08:38:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 -- 172.21.15.52:0/3358775364 shutdown_connections 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c9210 0x563ced5c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c5240 0x563ced5c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 --2- 172.21.15.52:0/3358775364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60d220 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.948+0000 7fa4c069e740 1 -- 172.21.15.52:0/3358775364 >> 172.21.15.52:0/3358775364 conn(0x563ced5c4240 msgr2=0x563ced60c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.949+0000 7fa4c069e740 1 -- 172.21.15.52:0/3358775364 shutdown_connections 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.949+0000 7fa4c069e740 1 -- 172.21.15.52:0/3358775364 wait complete. 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.949+0000 7fa4c069e740 1 -- start start 2024-09-10T08:38:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.949+0000 7fa4c069e740 1 Processor -- start 2024-09-10T08:38:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 0x563ced5c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563ced4b3750 con 0x563ced5c9210 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563ced5267b0 con 0x563ced5c7a80 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563ced5c36e0 con 0x563ced5f1bc0 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.950+0000 7fa4c069e740 10 client.0 _ll_register_callbacks cb 0x563ced23cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 0x563ced5c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:33760/0 (socket says 172.21.15.52:33760) 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49706/0 (socket says 172.21.15.52:49706) 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b6a00640 1 -- 172.21.15.52:0/1838163771 learned_addr learned my addr 172.21.15.52:0/1838163771 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 -- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 msgr2=0x563ced5c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 0x563ced5c2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 -- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 msgr2=0x563ced5e7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 -- 172.21.15.52:0/1838163771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ced1fd0f0 con 0x563ced5c9210 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b7400640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 0x563ced5c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:01.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8145560 tx=0x7fa4a0014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b4fd4732030cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.951+0000 7fa49be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0004030 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a00041d0 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a8032ba0 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7fa4a00043d0 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 10 client.8484 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x563ced367f60 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8032ba0 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7fa4a0026050 con 0x563ced5c9210 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 10 client.8484 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 10 client.8484 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 20 client.8484 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5ef580 0x563ced5ef960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 4 client.8484 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.952+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ced537f20 con 0x563ced5ef580 2024-09-10T08:38:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.953+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5ef580 0x563ced5ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.953+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5ef580 0x563ced5ef960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb1f9b6fc3da5b8 server_cookie=21bc78b7b2417172 in_seq=0 out_seq=0 2024-09-10T08:38:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.953+0000 7fa49be00640 10 client.8484 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa49be00640 1 -- 172.21.15.52:0/1838163771 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ced537f20 con 0x563ced5ef580 2024-09-10T08:38:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa49be00640 10 client.8484 handle_command_reply: tid=0 2024-09-10T08:38:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 client.8484 shutdown 2024-09-10T08:38:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 msgr2=0x563ced5f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8145560 tx=0x7fa4a0014a60 comp rx=0 tx=0).stop 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 shutdown_connections 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5ef580 0x563ced5ef960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5f1bc0 0x563ced5c2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced5f1680 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1838163771 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5c7a80 0x563ced5e7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa49be00640 0 client.8484 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 >> 172.21.15.52:0/1838163771 conn(0x563ced5c5240 msgr2=0x563ced60bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 shutdown_connections 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.954+0000 7fa4c069e740 1 -- 172.21.15.52:0/1838163771 wait complete. 2024-09-10T08:38:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.955+0000 7fa4c069e740 20 client.8484 trim_cache size 0 max 16384 2024-09-10T08:38:01.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.972+0000 7fa4c069e740 1 Processor -- start 2024-09-10T08:38:01.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.972+0000 7fa4c069e740 1 -- start start 2024-09-10T08:38:01.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c9210 0x563ced609970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced609eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b81fc810 con 0x563ced5c7a80 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80b6480 con 0x563ced5f1bc0 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80b57e0 con 0x563ced5c9210 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4b6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49712/0 (socket says 172.21.15.52:49712) 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.973+0000 7fa4b6a00640 1 -- 172.21.15.52:0/1981014218 learned_addr learned my addr 172.21.15.52:0/1981014218 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c9210 0x563ced609970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b7400640 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced609eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 -- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c9210 msgr2=0x563ced609970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c9210 0x563ced609970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 -- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 msgr2=0x563ced609eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced609eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 -- 172.21.15.52:0/1981014218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ced1d61b0 con 0x563ced5c7a80 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80098c0 tx=0x7fa4a803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0f8ab0dc7a09eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4a6a00640 1 -- 172.21.15.52:0/1981014218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a803cbb0 con 0x563ced5c7a80 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4a6a00640 1 -- 172.21.15.52:0/1981014218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a803cd50 con 0x563ced5c7a80 2024-09-10T08:38:01.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.974+0000 7fa4a6a00640 1 -- 172.21.15.52:0/1981014218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8047610 con 0x563ced5c7a80 2024-09-10T08:38:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- 172.21.15.52:0/1981014218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 msgr2=0x563ced60ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80098c0 tx=0x7fa4a803c000 comp rx=0 tx=0).stop 2024-09-10T08:38:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- 172.21.15.52:0/1981014218 shutdown_connections 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced609eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c9210 0x563ced609970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1981014218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c7a80 0x563ced60ad20 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- 172.21.15.52:0/1981014218 >> 172.21.15.52:0/1981014218 conn(0x563ced5c5240 msgr2=0x563ced60e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- 172.21.15.52:0/1981014218 shutdown_connections 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- 172.21.15.52:0/1981014218 wait complete. 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.975+0000 7fa4c069e740 1 -- start start 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.976+0000 7fa4c069e740 1 Processor -- start 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c7a80 0x563ced6102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced5c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563ced5e7960 con 0x563ced5c9210 2024-09-10T08:38:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80b5e30 con 0x563ced5f1bc0 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563ced5eff40 con 0x563ced5c7a80 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4c069e740 10 client.0 _ll_register_callbacks cb 0x7fa4a00094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49728/0 (socket says 172.21.15.52:49728) 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 -- 172.21.15.52:0/1288032867 learned_addr learned my addr 172.21.15.52:0/1288032867 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c7a80 0x563ced6102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4b7400640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced5c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 -- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c7a80 msgr2=0x563ced6102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c7a80 0x563ced6102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 -- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 msgr2=0x563ced5c1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced5c1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.977+0000 7fa4afe00640 1 -- 172.21.15.52:0/1288032867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ced5e9850 con 0x563ced5c9210 2024-09-10T08:38:01.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4afe00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0015000 tx=0x7fa4a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ff9bfc7cb70fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0028880 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a0032aa0 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4a803cd50 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7fa4a0032ca0 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 10 client.8490 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x563ced5f0bc0 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a803cd50 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7fa4a0026040 con 0x563ced5c9210 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 10 client.8490 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 10 client.8490 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 20 client.8490 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:01.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.978+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5f00f0 0x563ced5f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa4c069e740 4 client.8490 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x563ced532270 con 0x563ced5f00f0 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5f00f0 0x563ced5f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa4b6a00640 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5f00f0 0x563ced5f04d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc5929f8b24b1d4 server_cookie=cf3f8deb6e01eda6 in_seq=0 out_seq=0 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa49be00640 10 client.8490 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa49be00640 1 -- 172.21.15.52:0/1288032867 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ced532270 con 0x563ced5f00f0 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa49be00640 10 client.8490 handle_command_reply: tid=0 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.979+0000 7fa4c069e740 1 client.8490 shutdown 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 msgr2=0x563ced689900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0015000 tx=0x7fa4a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 shutdown_connections 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x563ced5f00f0 0x563ced5f04d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563ced5f1bc0 0x563ced5c1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563ced5c9210 0x563ced689900 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 --2- 172.21.15.52:0/1288032867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563ced5c7a80 0x563ced6102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 >> 172.21.15.52:0/1288032867 conn(0x563ced5c5240 msgr2=0x563ced61e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa49be00640 0 client.8490 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 shutdown_connections 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 1 -- 172.21.15.52:0/1288032867 wait complete. 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4c069e740 20 client.8490 trim_cache size 0 max 16384 2024-09-10T08:38:01.985 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:01.986 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:38:01.986 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:38:01.986 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 msgr2=0x7fa49406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 0x7fa49406e2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8034000 tx=0x7fa4a802e000 comp rx=0 tx=0).stop 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 msgr2=0x7fa4b8156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.980+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c7a0 tx=0x7fa4b000cc60 comp rx=0 tx=0).stop 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 shutdown_connections 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa49406be30 0x7fa49406e2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4b80cce30 0x7fa4b8156db0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4b80732e0 0x7fa4b8140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 --2- 172.21.15.52:0/2351923836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4b8071c70 0x7fa4b8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:01.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 >> 172.21.15.52:0/2351923836 conn(0x7fa4b806d0f0 msgr2=0x7fa4b80cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:01.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 shutdown_connections 2024-09-10T08:38:01.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:01.981+0000 7fa4bd800640 1 -- 172.21.15.52:0/2351923836 wait complete. 2024-09-10T08:38:01.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:01.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-10T08:38:02.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.154+0000 7eff1b200640 1 Processor -- start 2024-09-10T08:38:02.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.154+0000 7eff1b200640 1 -- start start 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.155+0000 7eff1b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7eff1c15c310 0x7eff1c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.155+0000 7eff1b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.155+0000 7eff1b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c072a10 con 0x7eff1c0725c0 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.155+0000 7eff1b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0afa10 con 0x7eff1c15c310 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.155+0000 7eff1b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c071220 con 0x7eff1c0d0880 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42646/0 (socket says 172.21.15.52:42646) 2024-09-10T08:38:02.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 -- 172.21.15.52:0/3456260144 learned_addr learned my addr 172.21.15.52:0/3456260144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff19400640 1 --1- 172.21.15.52:0/3456260144 >> v1:172.21.15.176:6789/0 conn(0x7eff1c0725c0 0x7eff1c0d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:38742/0 (socket says 172.21.15.52:38742) 2024-09-10T08:38:02.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff19e00640 1 --2- 172.21.15.52:0/3456260144 >> v2:172.21.15.176:3300/0 conn(0x7eff1c15c310 0x7eff1c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 -- 172.21.15.52:0/3456260144 >> v2:172.21.15.176:3300/0 conn(0x7eff1c15c310 msgr2=0x7eff1c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 --2- 172.21.15.52:0/3456260144 >> v2:172.21.15.176:3300/0 conn(0x7eff1c15c310 0x7eff1c071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 -- 172.21.15.52:0/3456260144 >> v1:172.21.15.176:6789/0 conn(0x7eff1c0725c0 legacy=0x7eff1c0d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff1a800640 1 -- 172.21.15.52:0/3456260144 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c071500 con 0x7eff1c0d0880 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.156+0000 7eff18a00640 1 -- 172.21.15.52:0/3456260144 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742684686 0 0) 0x7eff1c072a10 con 0x7eff1c0725c0 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.157+0000 7eff1a800640 1 --2- 172.21.15.52:0/3456260144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eef27d54283dfd84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.157+0000 7eff18a00640 1 -- 172.21.15.52:0/3456260144 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14036070 con 0x7eff1c0d0880 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.157+0000 7eff18a00640 1 -- 172.21.15.52:0/3456260144 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff14031600 con 0x7eff1c0d0880 2024-09-10T08:38:02.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.157+0000 7eff18a00640 1 -- 172.21.15.52:0/3456260144 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff140319d0 con 0x7eff1c0d0880 2024-09-10T08:38:02.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 -- 172.21.15.52:0/3456260144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 msgr2=0x7eff1c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 --2- 172.21.15.52:0/3456260144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff14009e50 tx=0x7eff1402a710 comp rx=0 tx=0).stop 2024-09-10T08:38:02.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 -- 172.21.15.52:0/3456260144 shutdown_connections 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 --2- 172.21.15.52:0/3456260144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c0d0880 0x7eff1c0cdf80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 --2- 172.21.15.52:0/3456260144 >> v2:172.21.15.176:3300/0 conn(0x7eff1c15c310 0x7eff1c071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 -- 172.21.15.52:0/3456260144 >> 172.21.15.52:0/3456260144 conn(0x7eff1c06bc10 msgr2=0x7eff1c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 -- 172.21.15.52:0/3456260144 shutdown_connections 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.158+0000 7eff1b200640 1 -- 172.21.15.52:0/3456260144 wait complete. 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.160+0000 7eff1b200640 1 Processor -- start 2024-09-10T08:38:02.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.160+0000 7eff1b200640 1 -- start start 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1c0725c0 0x7eff1c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c15c310 0x7eff1c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c073e30 con 0x7eff1c0d0880 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0af6c0 con 0x7eff1c0725c0 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c073fb0 con 0x7eff1c15c310 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff19400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff19400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49740/0 (socket says 172.21.15.52:49740) 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff19400640 1 -- 172.21.15.52:0/3023087224 learned_addr learned my addr 172.21.15.52:0/3023087224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff19e00640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1c0725c0 0x7eff1c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.161+0000 7eff1a800640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c15c310 0x7eff1c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 -- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c15c310 msgr2=0x7eff1c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c15c310 0x7eff1c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 -- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1c0725c0 msgr2=0x7eff1c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1c0725c0 0x7eff1c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 -- 172.21.15.52:0/3023087224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c150de0 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff19400640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c500 tx=0x7eff0800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff12000640 1 -- 172.21.15.52:0/3023087224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08018070 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff12000640 1 -- 172.21.15.52:0/3023087224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08007580 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1532f0 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff12000640 1 -- 172.21.15.52:0/3023087224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08004a20 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.162+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1538b0 con 0x7eff1c0d0880 2024-09-10T08:38:02.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.164+0000 7eff12000640 1 -- 172.21.15.52:0/3023087224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff0801b070 con 0x7eff1c0d0880 2024-09-10T08:38:02.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.165+0000 7eff12000640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.165+0000 7eff12000640 1 -- 172.21.15.52:0/3023087224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7eff0808a130 con 0x7eff1c0d0880 2024-09-10T08:38:02.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.165+0000 7eff24089740 1 Processor -- start 2024-09-10T08:38:02.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff19e00640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 -- start start 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff19e00640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009aa0 tx=0x7eff0c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 0x5556f91ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91ece10 0x5556f91ed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556f910a660 con 0x5556f91bc680 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5556f90b2680 con 0x5556f91ece10 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.166+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5556f9106620 con 0x5556f91bcdb0 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49754/0 (socket says 172.21.15.52:49754) 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 0x5556f91ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19e00640 1 -- 172.21.15.52:0/1172450986 learned_addr learned my addr 172.21.15.52:0/1172450986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff1a800640 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91ece10 0x5556f91ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 -- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91ece10 msgr2=0x5556f91ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91ece10 0x5556f91ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 -- 172.21.15.52:0/1172450986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 msgr2=0x5556f91eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 -- 172.21.15.52:0/1172450986 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f8ee77d0 con 0x5556f91bcdb0 2024-09-10T08:38:02.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19e00640 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.167+0000 7eff19400640 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 0x5556f91ed3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff08088620 tx=0x7eff0805c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56149ada6d33f18e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff06a00640 1 -- 172.21.15.52:0/1172450986 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08056780 con 0x5556f91bcdb0 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff06a00640 1 -- 172.21.15.52:0/1172450986 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08054af0 con 0x5556f91bcdb0 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff06a00640 1 -- 172.21.15.52:0/1172450986 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08004dc0 con 0x5556f91bcdb0 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 -- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 msgr2=0x5556f91ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 0x5556f91ed3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff08088620 tx=0x7eff0805c780 comp rx=0 tx=0).stop 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 -- 172.21.15.52:0/1172450986 shutdown_connections 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91ece10 0x5556f91ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91bcdb0 0x5556f91ed3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 --2- 172.21.15.52:0/1172450986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bc680 0x5556f91eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 -- 172.21.15.52:0/1172450986 >> 172.21.15.52:0/1172450986 conn(0x5556f91a3410 msgr2=0x5556f91eba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 -- 172.21.15.52:0/1172450986 shutdown_connections 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.168+0000 7eff24089740 1 -- 172.21.15.52:0/1172450986 wait complete. 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.169+0000 7eff24089740 1 -- start start 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.169+0000 7eff24089740 1 Processor -- start 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f91e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556f91ea0e0 con 0x5556f91bcdb0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5556f90934c0 con 0x5556f91d42d0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5556f91ea3c0 con 0x5556f91ece10 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.170+0000 7eff24089740 10 client.0 _ll_register_callbacks cb 0x5556f9102e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49766/0 (socket says 172.21.15.52:49766) 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 -- 172.21.15.52:0/1123571505 learned_addr learned my addr 172.21.15.52:0/1123571505 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19400640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff1a800640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f91e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 -- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 msgr2=0x5556f91e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 -- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 msgr2=0x5556f91e8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f91e8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 -- 172.21.15.52:0/1123571505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f8e1d3f0 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7eff19e00640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0038c0 tx=0x7eff0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef05c1ff0a4420 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.171+0000 7efefb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c027070 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff08054af0 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7eff0c014650 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7eff0c014850 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 10 client.8499 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x5556f8ddd0f0 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08054af0 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7eff0c035080 con 0x5556f91bcdb0 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 10 client.8499 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 10 client.8499 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:02.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 20 client.8499 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:02.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e7120 0x5556f91d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 4 client.8499 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:02.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.172+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f9117d90 con 0x5556f91e7120 2024-09-10T08:38:02.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.173+0000 7eff19400640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e7120 0x5556f91d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.173+0000 7eff19400640 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e7120 0x5556f91d1de0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3691c6e75eecb0b1 server_cookie=23c1760ad5542682 in_seq=0 out_seq=0 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.173+0000 7efefb400640 10 client.8499 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7efefb400640 1 -- 172.21.15.52:0/1123571505 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556f9117d90 con 0x5556f91e7120 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7efefb400640 10 client.8499 handle_command_reply: tid=0 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 client.8499 shutdown 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 msgr2=0x5556f91cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0038c0 tx=0x7eff0c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 shutdown_connections 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e7120 0x5556f91d1de0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f91e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 --2- 172.21.15.52:0/1123571505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f91cfef0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7efefb400640 0 client.8499 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 >> 172.21.15.52:0/1123571505 conn(0x5556f91bc680 msgr2=0x5556f91ef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 shutdown_connections 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.174+0000 7eff24089740 1 -- 172.21.15.52:0/1123571505 wait complete. 2024-09-10T08:38:02.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.175+0000 7eff24089740 20 client.8499 trim_cache size 0 max 16384 2024-09-10T08:38:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.193+0000 7eff24089740 1 Processor -- start 2024-09-10T08:38:02.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.193+0000 7eff24089740 1 -- start start 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91bcdb0 0x5556f9209940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c1fc660 con 0x5556f91d42d0 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0b4550 con 0x5556f91bcdb0 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c154eb0 con 0x5556f91ece10 2024-09-10T08:38:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49774/0 (socket says 172.21.15.52:49774) 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 -- 172.21.15.52:0/1001175950 learned_addr learned my addr 172.21.15.52:0/1001175950 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff1a800640 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19e00640 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91bcdb0 0x5556f9209940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 -- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 msgr2=0x5556f91eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 -- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91bcdb0 msgr2=0x5556f9209940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91bcdb0 0x5556f9209940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 -- 172.21.15.52:0/1001175950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f91a41a0 con 0x5556f91d42d0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.194+0000 7eff19400640 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7eff080548e0 tx=0x7eff08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a467e972328186c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff06000640 1 -- 172.21.15.52:0/1001175950 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08056780 con 0x5556f91d42d0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff06000640 1 -- 172.21.15.52:0/1001175950 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08088280 con 0x5556f91d42d0 2024-09-10T08:38:02.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff06000640 1 -- 172.21.15.52:0/1001175950 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08004de0 con 0x5556f91d42d0 2024-09-10T08:38:02.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 -- 172.21.15.52:0/1001175950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 msgr2=0x5556f9209e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7eff080548e0 tx=0x7eff08013000 comp rx=0 tx=0).stop 2024-09-10T08:38:02.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 -- 172.21.15.52:0/1001175950 shutdown_connections 2024-09-10T08:38:02.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91d42d0 0x5556f9209e80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 --2- 172.21.15.52:0/1001175950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91bcdb0 0x5556f9209940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 -- 172.21.15.52:0/1001175950 >> 172.21.15.52:0/1001175950 conn(0x5556f91bc680 msgr2=0x5556f919cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 -- 172.21.15.52:0/1001175950 shutdown_connections 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.195+0000 7eff24089740 1 -- 172.21.15.52:0/1001175950 wait complete. 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.196+0000 7eff24089740 1 -- start start 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.196+0000 7eff24089740 1 Processor -- start 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f926ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556f91e57d0 con 0x5556f91bcdb0 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c155500 con 0x5556f91d42d0 2024-09-10T08:38:02.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5556f91e5bc0 con 0x5556f91ece10 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff24089740 10 client.0 _ll_register_callbacks cb 0x7eff0c0040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff19e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49778/0 (socket says 172.21.15.52:49778) 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.197+0000 7eff19e00640 1 -- 172.21.15.52:0/3115567749 learned_addr learned my addr 172.21.15.52:0/3115567749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19400640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f926ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff1a800640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 -- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 msgr2=0x5556f91e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 -- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 msgr2=0x5556f926ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f926ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 -- 172.21.15.52:0/3115567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f91a2860 con 0x5556f91bcdb0 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff1a800640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff19e00640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02cb70 tx=0x7eff0c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2060105e84f531 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7efefb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c027040 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7eff0c02cd50 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.198+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff08088280 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7eff0c003d80 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 10 client.8505 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x5556f926b1a0 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08088280 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7eff0c035040 con 0x5556f91bcdb0 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 10 client.8505 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 10 client.8505 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:02.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 20 client.8505 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e86c0 0x5556f926d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 4 client.8505 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556f91120e0 con 0x5556f91e86c0 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.199+0000 7eff19400640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e86c0 0x5556f926d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff19400640 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e86c0 0x5556f926d900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2c0691da16b3f92 server_cookie=d789b120c374841e in_seq=0 out_seq=0 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7efefb400640 10 client.8505 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7efefb400640 1 -- 172.21.15.52:0/3115567749 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x5556f91120e0 con 0x5556f91e86c0 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7efefb400640 10 client.8505 handle_command_reply: tid=0 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 client.8505 shutdown 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 msgr2=0x5556f9202640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7eff0c02cb70 tx=0x7eff0c019000 comp rx=0 tx=0).stop 2024-09-10T08:38:02.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 shutdown_connections 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5556f91e86c0 0x5556f926d900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5556f91ece10 0x5556f91e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5556f91d42d0 0x5556f926ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7efefb400640 0 client.8505 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 --2- 172.21.15.52:0/3115567749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556f91bcdb0 0x5556f9202640 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.200+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 >> 172.21.15.52:0/3115567749 conn(0x5556f91bc680 msgr2=0x5556f919ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 shutdown_connections 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff24089740 1 -- 172.21.15.52:0/3115567749 wait complete. 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff24089740 20 client.8505 trim_cache size 0 max 16384 2024-09-10T08:38:02.206 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "2031cb78-0506-4095-926e-d825809aaa4d": { 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_control_test_path", 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "2031cb78-0506-4095-926e-d825809aaa4d", 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:02.207 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 msgr2=0x7efefc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009aa0 tx=0x7eff0c009190 comp rx=0 tx=0).stop 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 msgr2=0x7eff1c146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c500 tx=0x7eff0800c9c0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 shutdown_connections 2024-09-10T08:38:02.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efefc06be30 0x7efefc06e2f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7eff1c15c310 0x7eff1c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff1c0d0880 0x7eff1c146c00 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 --2- 172.21.15.52:0/3023087224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7eff1c0725c0 0x7eff1c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.201+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 >> 172.21.15.52:0/3023087224 conn(0x7eff1c06bc10 msgr2=0x7eff1c15f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.202+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 shutdown_connections 2024-09-10T08:38:02.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.202+0000 7eff1b200640 1 -- 172.21.15.52:0/3023087224 wait complete. 2024-09-10T08:38:02.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:02.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.372+0000 7f577a200640 1 Processor -- start 2024-09-10T08:38:02.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.372+0000 7f577a200640 1 -- start start 2024-09-10T08:38:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.373+0000 7f577a200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5774073890 0x7f57740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f577a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 0x7f57740b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f577a200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57740b4020 con 0x7f5774145ed0 2024-09-10T08:38:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f577a200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f57740b42c0 con 0x7f5774073890 2024-09-10T08:38:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f577a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57740b45a0 con 0x7f57740b5880 2024-09-10T08:38:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5774145ed0 0x7f5774073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43548/0 (socket says 172.21.15.52:43548) 2024-09-10T08:38:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773400640 1 -- 172.21.15.52:0/2875034902 learned_addr learned my addr 172.21.15.52:0/2875034902 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773e00640 1 --2- 172.21.15.52:0/2875034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 0x7f57740b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f576be00640 1 --2- 172.21.15.52:0/2875034902 >> v2:172.21.15.176:3300/0 conn(0x7f5774073890 0x7f57740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5772a00640 1 -- 172.21.15.52:0/2875034902 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857491265 0 0) 0x7f57740b4020 con 0x7f5774145ed0 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5772a00640 1 -- 172.21.15.52:0/2875034902 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5758003520 con 0x7f5774145ed0 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773e00640 1 -- 172.21.15.52:0/2875034902 >> v2:172.21.15.176:3300/0 conn(0x7f5774073890 msgr2=0x7f57740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773e00640 1 --2- 172.21.15.52:0/2875034902 >> v2:172.21.15.176:3300/0 conn(0x7f5774073890 0x7f57740b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.374+0000 7f5773e00640 1 -- 172.21.15.52:0/2875034902 >> v1:172.21.15.52:6789/0 conn(0x7f5774145ed0 legacy=0x7f5774073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.375+0000 7f5773e00640 1 -- 172.21.15.52:0/2875034902 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57740b4880 con 0x7f57740b5880 2024-09-10T08:38:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.375+0000 7f5773e00640 1 --2- 172.21.15.52:0/2875034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 0x7f57740b5d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f576c009d90 tx=0x7f576c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80d9af54a3a73bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f5772a00640 1 -- 172.21.15.52:0/2875034902 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c007740 con 0x7f57740b5880 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f5772a00640 1 -- 172.21.15.52:0/2875034902 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0078e0 con 0x7f57740b5880 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f5772a00640 1 -- 172.21.15.52:0/2875034902 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c007cb0 con 0x7f57740b5880 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 -- 172.21.15.52:0/2875034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 msgr2=0x7f57740b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 --2- 172.21.15.52:0/2875034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 0x7f57740b5d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f576c009d90 tx=0x7f576c02a660 comp rx=0 tx=0).stop 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 -- 172.21.15.52:0/2875034902 shutdown_connections 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 --2- 172.21.15.52:0/2875034902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57740b5880 0x7f57740b5d30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 --2- 172.21.15.52:0/2875034902 >> v2:172.21.15.176:3300/0 conn(0x7f5774073890 0x7f57740b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.376+0000 7f577a200640 1 -- 172.21.15.52:0/2875034902 >> 172.21.15.52:0/2875034902 conn(0x7f57740ccec0 msgr2=0x7f57740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.377+0000 7f577a200640 1 -- 172.21.15.52:0/2875034902 shutdown_connections 2024-09-10T08:38:02.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.377+0000 7f577a200640 1 -- 172.21.15.52:0/2875034902 wait complete. 2024-09-10T08:38:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.378+0000 7f577a200640 1 Processor -- start 2024-09-10T08:38:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.378+0000 7f577a200640 1 -- start start 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 0x7f5774144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 0x7f5774145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57740b6270 con 0x7f5774073890 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57741462b0 con 0x7f57740b5880 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f577a200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57740710a0 con 0x7f5774145ed0 2024-09-10T08:38:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f5773400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f5773400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49794/0 (socket says 172.21.15.52:49794) 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.379+0000 7f5773400640 1 -- 172.21.15.52:0/340244149 learned_addr learned my addr 172.21.15.52:0/340244149 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f576be00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 0x7f5774144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773e00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 0x7f5774145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 -- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 msgr2=0x7f5774145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 0x7f5774145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 -- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 msgr2=0x7f5774144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 0x7f5774144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 -- 172.21.15.52:0/340244149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577413cc50 con 0x7f5774073890 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f576be00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 0x7f5774144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773e00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 0x7f5774145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f5773400640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f576400c400 tx=0x7f576400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764017070 con 0x7f5774073890 2024-09-10T08:38:02.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5764005d00 con 0x7f5774073890 2024-09-10T08:38:02.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5774140360 con 0x7f5774073890 2024-09-10T08:38:02.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5764007310 con 0x7f5774073890 2024-09-10T08:38:02.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.380+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5774140920 con 0x7f5774073890 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.381+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57740b5080 con 0x7f5774073890 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.382+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f576401a070 con 0x7f5774073890 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.383+0000 7f576b400640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 0x7f575006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.383+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f576408a270 con 0x7f5774073890 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.384+0000 7f576be00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 0x7f575006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.384+0000 7f576be00640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 0x7f575006e320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57741e8a60 tx=0x7f575c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.388+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5764058b90 con 0x7f5774073890 2024-09-10T08:38:02.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.607+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5774140c60 con 0x7f5774073890 2024-09-10T08:38:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.608+0000 7f576b400640 1 -- 172.21.15.52:0/340244149 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7f5764058490 con 0x7f5774073890 2024-09-10T08:38:02.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:02.609 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:02.609 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 msgr2=0x7f575006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 0x7f575006e320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f57741e8a60 tx=0x7f575c008040 comp rx=0 tx=0).stop 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 msgr2=0x7f577413c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f576400c400 tx=0x7f576400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 shutdown_connections 2024-09-10T08:38:02.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f575006be60 0x7f575006e320 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5774145ed0 0x7f5774145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57740b5880 0x7f5774144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 --2- 172.21.15.52:0/340244149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5774073890 0x7f577413c710 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.610+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 >> 172.21.15.52:0/340244149 conn(0x7f57740ccec0 msgr2=0x7f57740ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.611+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 shutdown_connections 2024-09-10T08:38:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.611+0000 7f577a200640 1 -- 172.21.15.52:0/340244149 wait complete. 2024-09-10T08:38:02.627 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:38:02.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:02.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.783+0000 7f2ecf200640 1 Processor -- start 2024-09-10T08:38:02.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.783+0000 7f2ecf200640 1 -- start start 2024-09-10T08:38:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.784+0000 7f2ecf200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ec8073890 0x7f2ec80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ecf200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec80b4020 con 0x7f2ec80b5880 2024-09-10T08:38:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ecf200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec80b42c0 con 0x7f2ec8145ed0 2024-09-10T08:38:02.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ecf200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80b63f0 con 0x7f2ec8073890 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ecd200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2ec80b5880 0x7f2ec80b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:43556/0 (socket says 172.21.15.52:43556) 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ecd200640 1 -- 172.21.15.52:0/1301823535 learned_addr learned my addr 172.21.15.52:0/1301823535 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ebfe00640 1 --2- 172.21.15.52:0/1301823535 >> v2:172.21.15.176:3300/0 conn(0x7f2ec8073890 0x7f2ec80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933025506 0 0) 0x7f2ec80b4020 con 0x7f2ec80b5880 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.785+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eac003520 con 0x7f2ec80b5880 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.786+0000 7f2ebfe00640 1 -- 172.21.15.52:0/1301823535 >> v1:172.21.15.176:6789/0 conn(0x7f2ec8145ed0 legacy=0x7f2ec8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.786+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601614202 0 0) 0x7f2ec80b42c0 con 0x7f2ec8145ed0 2024-09-10T08:38:02.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.786+0000 7f2ebfe00640 1 -- 172.21.15.52:0/1301823535 >> v1:172.21.15.52:6789/0 conn(0x7f2ec80b5880 legacy=0x7f2ec80b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.786+0000 7f2ebfe00640 1 -- 172.21.15.52:0/1301823535 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec80b45a0 con 0x7f2ec8073890 2024-09-10T08:38:02.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.787+0000 7f2ebfe00640 1 --2- 172.21.15.52:0/1301823535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec8073890 0x7f2ec80b5080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097a0 tx=0x7f2eb002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3cc7c7e3d15fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.787+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0037070 con 0x7f2ec8073890 2024-09-10T08:38:02.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.787+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb0032440 con 0x7f2ec8073890 2024-09-10T08:38:02.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.787+0000 7f2ec7400640 1 -- 172.21.15.52:0/1301823535 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0032810 con 0x7f2ec8073890 2024-09-10T08:38:02.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 -- 172.21.15.52:0/1301823535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec8073890 msgr2=0x7f2ec80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 --2- 172.21.15.52:0/1301823535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec8073890 0x7f2ec80b5080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097a0 tx=0x7f2eb002a230 comp rx=0 tx=0).stop 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 -- 172.21.15.52:0/1301823535 shutdown_connections 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 --2- 172.21.15.52:0/1301823535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec8073890 0x7f2ec80b5080 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 -- 172.21.15.52:0/1301823535 >> 172.21.15.52:0/1301823535 conn(0x7f2ec80ccec0 msgr2=0x7f2ec80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 -- 172.21.15.52:0/1301823535 shutdown_connections 2024-09-10T08:38:02.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.788+0000 7f2ecf200640 1 -- 172.21.15.52:0/1301823535 wait complete. 2024-09-10T08:38:02.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.790+0000 7f2ecf200640 1 Processor -- start 2024-09-10T08:38:02.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.790+0000 7f2ecf200640 1 -- start start 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80b5880 0x7f2ec80c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec8145ed0 0x7f2ec80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec81462b0 con 0x7f2ec8073890 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec80b4b60 con 0x7f2ec80b5880 2024-09-10T08:38:02.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec8146430 con 0x7f2ec8145ed0 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49796/0 (socket says 172.21.15.52:49796) 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 -- 172.21.15.52:0/152729430 learned_addr learned my addr 172.21.15.52:0/152729430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ecd200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec8145ed0 0x7f2ec80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ebfe00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80b5880 0x7f2ec80c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 -- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec8145ed0 msgr2=0x7f2ec80ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec8145ed0 0x7f2ec80ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 -- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80b5880 msgr2=0x7f2ec80c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80b5880 0x7f2ec80c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.791+0000 7f2ec7e00640 1 -- 172.21.15.52:0/152729430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec8071e80 con 0x7f2ec8073890 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ec7e00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c410 tx=0x7f2eb800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8017070 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb80035f0 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80039e0 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec8072160 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.792+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec8072720 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.793+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec80d1550 con 0x7f2ec8073890 2024-09-10T08:38:02.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.794+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2eb801a070 con 0x7f2ec8073890 2024-09-10T08:38:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.795+0000 7f2ec4c00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 0x7f2ea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.795+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb808a2e0 con 0x7f2ec8073890 2024-09-10T08:38:02.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.795+0000 7f2ebfe00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 0x7f2ea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:02.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.796+0000 7f2ebfe00640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 0x7f2ea406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0034000 tx=0x7f2eb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:02.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:02.799+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ec80d1550 con 0x7f2ec8073890 2024-09-10T08:38:03.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.050+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2ec81448e0 con 0x7f2ec8073890 2024-09-10T08:38:03.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.051+0000 7f2ec4c00640 1 -- 172.21.15.52:0/152729430 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f2eb8058c90 con 0x7f2ec8073890 2024-09-10T08:38:03.051 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:03.051 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":582,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":967,"data_bytes":991326901,"bytes_used":2299748352,"bytes_avail":770794364928,"bytes_total":773094113280,"write_bytes_sec":64183007,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T08:37:21.583257+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 msgr2=0x7f2ea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 0x7f2ea406e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0034000 tx=0x7f2eb002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 msgr2=0x7f2ec8138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c410 tx=0x7f2eb800c8d0 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 shutdown_connections 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ea406be30 0x7f2ea406e2f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ec8145ed0 0x7f2ec80ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ec80b5880 0x7f2ec80c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 --2- 172.21.15.52:0/152729430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ec8073890 0x7f2ec8138040 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 >> 172.21.15.52:0/152729430 conn(0x7f2ec80ccec0 msgr2=0x7f2ec80cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 shutdown_connections 2024-09-10T08:38:03.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:03.053+0000 7f2ecf200640 1 -- 172.21.15.52:0/152729430 wait complete. 2024-09-10T08:38:03.069 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:38:04.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:04.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.237+0000 7fc1fb200640 1 Processor -- start 2024-09-10T08:38:04.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.237+0000 7fc1fb200640 1 -- start start 2024-09-10T08:38:04.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.238+0000 7fc1fb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f406c320 0x7fc1f415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.238+0000 7fc1fb200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1f413eb20 0x7fc1f415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1fb200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f4071180 con 0x7fc1f40b2d40 2024-09-10T08:38:04.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1fb200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f4071ab0 con 0x7fc1f413eb20 2024-09-10T08:38:04.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1fb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f4071460 con 0x7fc1f406c320 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc1f40b2d40 0x7fc1f406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54996/0 (socket says 172.21.15.52:54996) 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f3e00640 1 -- 172.21.15.52:0/3120245426 learned_addr learned my addr 172.21.15.52:0/3120245426 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f9200640 1 --2- 172.21.15.52:0/3120245426 >> v2:172.21.15.52:3300/0 conn(0x7fc1f413eb20 0x7fc1f415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1ebe00640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f406c320 0x7fc1f415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f3400640 1 -- 172.21.15.52:0/3120245426 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4190498149 0 0) 0x7fc1f4071180 con 0x7fc1f40b2d40 2024-09-10T08:38:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f3400640 1 -- 172.21.15.52:0/3120245426 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d8005730 con 0x7fc1f40b2d40 2024-09-10T08:38:04.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.239+0000 7fc1f9200640 1 -- 172.21.15.52:0/3120245426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f406c320 msgr2=0x7fc1f415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:04.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.240+0000 7fc1f9200640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f406c320 0x7fc1f415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.240+0000 7fc1f9200640 1 -- 172.21.15.52:0/3120245426 >> v1:172.21.15.52:6789/0 conn(0x7fc1f40b2d40 legacy=0x7fc1f406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.240+0000 7fc1f9200640 1 -- 172.21.15.52:0/3120245426 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f4071740 con 0x7fc1f413eb20 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.240+0000 7fc1f9200640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f413eb20 0x7fc1f415c230 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009d90 tx=0x7fc1ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1166f8b0bd019f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1f3400640 1 -- 172.21.15.52:0/3120245426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec007740 con 0x7fc1f413eb20 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1f3400640 1 -- 172.21.15.52:0/3120245426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0078e0 con 0x7fc1f413eb20 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1f3400640 1 -- 172.21.15.52:0/3120245426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec007c90 con 0x7fc1f413eb20 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 -- 172.21.15.52:0/3120245426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f413eb20 msgr2=0x7fc1f415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f413eb20 0x7fc1f415c230 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009d90 tx=0x7fc1ec02a660 comp rx=0 tx=0).stop 2024-09-10T08:38:04.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 -- 172.21.15.52:0/3120245426 shutdown_connections 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f413eb20 0x7fc1f415c230 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 --2- 172.21.15.52:0/3120245426 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f406c320 0x7fc1f415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 -- 172.21.15.52:0/3120245426 >> 172.21.15.52:0/3120245426 conn(0x7fc1f40ccec0 msgr2=0x7fc1f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 -- 172.21.15.52:0/3120245426 shutdown_connections 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.241+0000 7fc1fb200640 1 -- 172.21.15.52:0/3120245426 wait complete. 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.243+0000 7fc1fb200640 1 Processor -- start 2024-09-10T08:38:04.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.243+0000 7fc1fb200640 1 -- start start 2024-09-10T08:38:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f40b2d40 0x7fc1f413b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 0x7fc1f40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40720c0 con 0x7fc1f406c320 2024-09-10T08:38:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f4071f40 con 0x7fc1f413eb20 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1fb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f4072240 con 0x7fc1f40b2d40 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1f3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52788/0 (socket says 172.21.15.52:52788) 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.244+0000 7fc1f3e00640 1 -- 172.21.15.52:0/2997541841 learned_addr learned my addr 172.21.15.52:0/2997541841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1ebe00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f40b2d40 0x7fc1f413b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f9200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 0x7fc1f40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 -- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f40b2d40 msgr2=0x7fc1f413b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f40b2d40 0x7fc1f413b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 -- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 msgr2=0x7fc1f40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 0x7fc1f40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 -- 172.21.15.52:0/2997541841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f413beb0 con 0x7fc1f406c320 2024-09-10T08:38:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f9200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 0x7fc1f40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:04.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f3e00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c430 tx=0x7fc1e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4017070 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e4005ce0 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40072f0 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.245+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f40b3c00 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.246+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f415aa30 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.247+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f406bc10 con 0x7fc1f406c320 2024-09-10T08:38:04.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.247+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1e401a070 con 0x7fc1f406c320 2024-09-10T08:38:04.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.249+0000 7fc1f0c00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 0x7fc1d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.249+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fc1e408a320 con 0x7fc1f406c320 2024-09-10T08:38:04.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.249+0000 7fc1ebe00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 0x7fc1d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.250+0000 7fc1ebe00640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 0x7fc1d006e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc1f41f7990 tx=0x7fc1dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.254+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1e40585e0 con 0x7fc1f406c320 2024-09-10T08:38:04.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.475+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1f41581d0 con 0x7fc1f406c320 2024-09-10T08:38:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.475+0000 7fc1f0c00640 1 -- 172.21.15.52:0/2997541841 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7fc1e405c8e0 con 0x7fc1f406c320 2024-09-10T08:38:04.476 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:04.476 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:04.476 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:04.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.477+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 msgr2=0x7fc1d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.477+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 0x7fc1d006e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc1f41f7990 tx=0x7fc1dc009190 comp rx=0 tx=0).stop 2024-09-10T08:38:04.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.477+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 msgr2=0x7fc1f40b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.477+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c430 tx=0x7fc1e400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 shutdown_connections 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc1d006be30 0x7fc1d006e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1f413eb20 0x7fc1f40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc1f40b2d40 0x7fc1f413b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 --2- 172.21.15.52:0/2997541841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1f406c320 0x7fc1f40b3570 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 >> 172.21.15.52:0/2997541841 conn(0x7fc1f40ccec0 msgr2=0x7fc1f4156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 shutdown_connections 2024-09-10T08:38:04.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.478+0000 7fc1fb200640 1 -- 172.21.15.52:0/2997541841 wait complete. 2024-09-10T08:38:04.496 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:38:04.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:04.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.652+0000 7f4aaaa00640 1 Processor -- start 2024-09-10T08:38:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.652+0000 7f4aaaa00640 1 -- start start 2024-09-10T08:38:04.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aaaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4aa40b6db0 0x7f4aa415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aaaa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa415f590 con 0x7f4aa415eb60 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aaaa00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa415f870 con 0x7f4aa41624b0 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aaaa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4aa415fb50 con 0x7f4aa40b6db0 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aa8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4aa40b6db0 0x7f4aa415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aa3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4aa415eb60 0x7f4aa40d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55010/0 (socket says 172.21.15.52:55010) 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.653+0000 7f4aa3e00640 1 -- 172.21.15.52:0/2285747410 learned_addr learned my addr 172.21.15.52:0/2285747410 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.654+0000 7f4aa8a00640 1 -- 172.21.15.52:0/2285747410 >> v1:172.21.15.176:6789/0 conn(0x7f4aa41624b0 legacy=0x7f4aa40b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.654+0000 7f4aa8a00640 1 -- 172.21.15.52:0/2285747410 >> v1:172.21.15.52:6789/0 conn(0x7f4aa415eb60 legacy=0x7f4aa40d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.654+0000 7f4aa8a00640 1 -- 172.21.15.52:0/2285747410 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa415fe30 con 0x7f4aa40b6db0 2024-09-10T08:38:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.655+0000 7f4aa8a00640 1 --2- 172.21.15.52:0/2285747410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415ef40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009d90 tx=0x7f4a9c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54341a03009958d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.655+0000 7f4aa2a00640 1 -- 172.21.15.52:0/2285747410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c031600 con 0x7f4aa40b6db0 2024-09-10T08:38:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.655+0000 7f4aa2a00640 1 -- 172.21.15.52:0/2285747410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c0317a0 con 0x7f4aa40b6db0 2024-09-10T08:38:04.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.655+0000 7f4aa2a00640 1 -- 172.21.15.52:0/2285747410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c031b70 con 0x7f4aa40b6db0 2024-09-10T08:38:04.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 -- 172.21.15.52:0/2285747410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa40b6db0 msgr2=0x7f4aa415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/2285747410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415ef40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c009d90 tx=0x7f4a9c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 -- 172.21.15.52:0/2285747410 shutdown_connections 2024-09-10T08:38:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/2285747410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415ef40 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 -- 172.21.15.52:0/2285747410 >> 172.21.15.52:0/2285747410 conn(0x7f4aa40d16f0 msgr2=0x7f4aa40d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 -- 172.21.15.52:0/2285747410 shutdown_connections 2024-09-10T08:38:04.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.656+0000 7f4aaaa00640 1 -- 172.21.15.52:0/2285747410 wait complete. 2024-09-10T08:38:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.657+0000 7f4aaaa00640 1 Processor -- start 2024-09-10T08:38:04.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.658+0000 7f4aaaa00640 1 -- start start 2024-09-10T08:38:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.658+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa41624b0 0x7f4aa40b8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aaaa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40d4600 con 0x7f4aa415eb60 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aaaa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa40d4480 con 0x7f4aa40b6db0 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aaaa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa40d3600 con 0x7f4aa41624b0 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52808/0 (socket says 172.21.15.52:52808) 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 -- 172.21.15.52:0/1408493257 learned_addr learned my addr 172.21.15.52:0/1408493257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3e00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa8a00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa41624b0 0x7f4aa40b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 -- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa41624b0 msgr2=0x7f4aa40b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa41624b0 0x7f4aa40b8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 -- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 msgr2=0x7f4aa415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3400640 1 -- 172.21.15.52:0/1408493257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa40cccb0 con 0x7f4aa415eb60 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.659+0000 7f4aa3e00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4aa3400640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c3c0 tx=0x7f4a9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a900052d0 con 0x7f4aa415eb60 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90005490 con 0x7f4aa415eb60 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa40ccf90 con 0x7f4aa415eb60 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90007260 con 0x7f4aa415eb60 2024-09-10T08:38:04.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.660+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa40cd550 con 0x7f4aa415eb60 2024-09-10T08:38:04.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.661+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa415ef40 con 0x7f4aa415eb60 2024-09-10T08:38:04.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.662+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a90007400 con 0x7f4aa415eb60 2024-09-10T08:38:04.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.663+0000 7f4a9be00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 0x7f4a8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:04.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.663+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f4a9008a300 con 0x7f4aa415eb60 2024-09-10T08:38:04.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.664+0000 7f4aa3e00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 0x7f4a8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:04.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.665+0000 7f4aa3e00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 0x7f4a8406e320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4a94005880 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:04.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.668+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a90058ca0 con 0x7f4aa415eb60 2024-09-10T08:38:04.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.918+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4aa40d10b0 con 0x7f4aa415eb60 2024-09-10T08:38:04.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.919+0000 7f4a9be00640 1 -- 172.21.15.52:0/1408493257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f4a900585a0 con 0x7f4aa415eb60 2024-09-10T08:38:04.919 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:04.919 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":584,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":967,"data_bytes":991326901,"bytes_used":2299748352,"bytes_avail":770794364928,"bytes_total":773094113280,"write_bytes_sec":43690027,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-10T08:37:21.583257+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 msgr2=0x7f4a8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 0x7f4a8406e320 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4a94005880 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2024-09-10T08:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 msgr2=0x7f4aa40b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000c3c0 tx=0x7f4a9000c880 comp rx=0 tx=0).stop 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 shutdown_connections 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a8406be60 0x7f4a8406e320 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4aa41624b0 0x7f4aa40b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aa415eb60 0x7f4aa40b8230 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 --2- 172.21.15.52:0/1408493257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aa40b6db0 0x7f4aa415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 >> 172.21.15.52:0/1408493257 conn(0x7f4aa40d16f0 msgr2=0x7f4aa40b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 shutdown_connections 2024-09-10T08:38:04.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:04.921+0000 7f4aaaa00640 1 -- 172.21.15.52:0/1408493257 wait complete. 2024-09-10T08:38:04.936 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:38:05.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.105+0000 7f811e000640 1 Processor -- start 2024-09-10T08:38:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.105+0000 7f811e000640 1 -- start start 2024-09-10T08:38:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f811e000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f811815e440 0x7f81180d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f811e000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81180d3990 con 0x7f81180cf450 2024-09-10T08:38:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f811e000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81180d3c70 con 0x7f81180b6710 2024-09-10T08:38:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f811e000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f81180d3f50 con 0x7f811815e440 2024-09-10T08:38:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f8117e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f81180cf450 0x7f81180b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55016/0 (socket says 172.21.15.52:55016) 2024-09-10T08:38:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.106+0000 7f8117e00640 1 -- 172.21.15.52:0/3818331586 learned_addr learned my addr 172.21.15.52:0/3818331586 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f811cc00640 1 --2- 172.21.15.52:0/3818331586 >> v2:172.21.15.176:3300/0 conn(0x7f811815e440 0x7f81180d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647860349 0 0) 0x7f81180d3990 con 0x7f81180cf450 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8100003520 con 0x7f81180cf450 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320577511 0 0) 0x7f81180d3c70 con 0x7f81180b6710 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81180d3990 con 0x7f81180b6710 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f811cc00640 1 -- 172.21.15.52:0/3818331586 >> v1:172.21.15.176:6789/0 conn(0x7f81180b6710 legacy=0x7f81180b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f811cc00640 1 -- 172.21.15.52:0/3818331586 >> v1:172.21.15.52:6789/0 conn(0x7f81180cf450 legacy=0x7f81180b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.107+0000 7f811cc00640 1 -- 172.21.15.52:0/3818331586 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81180d4230 con 0x7f811815e440 2024-09-10T08:38:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.108+0000 7f811cc00640 1 --2- 172.21.15.52:0/3818331586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f811815e440 0x7f81180d3240 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff2b50aced05bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c037070 con 0x7f811815e440 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c032640 con 0x7f811815e440 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f8117400640 1 -- 172.21.15.52:0/3818331586 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c032a10 con 0x7f811815e440 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 -- 172.21.15.52:0/3818331586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f811815e440 msgr2=0x7f81180d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 --2- 172.21.15.52:0/3818331586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f811815e440 0x7f81180d3240 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02a2c0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 -- 172.21.15.52:0/3818331586 shutdown_connections 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 --2- 172.21.15.52:0/3818331586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f811815e440 0x7f81180d3240 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 -- 172.21.15.52:0/3818331586 >> 172.21.15.52:0/3818331586 conn(0x7f8118067f80 msgr2=0x7f81180d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.109+0000 7f811e000640 1 -- 172.21.15.52:0/3818331586 shutdown_connections 2024-09-10T08:38:06.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.110+0000 7f811e000640 1 -- 172.21.15.52:0/3818331586 wait complete. 2024-09-10T08:38:06.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.111+0000 7f811e000640 1 Processor -- start 2024-09-10T08:38:06.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.111+0000 7f811e000640 1 -- start start 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81180b6710 0x7f8118150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cf450 0x7f81181e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81180b76c0 con 0x7f811815e440 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81180b7540 con 0x7f81180cf450 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.112+0000 7f811e000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f81180b8270 con 0x7f81180b6710 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52810/0 (socket says 172.21.15.52:52810) 2024-09-10T08:38:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 -- 172.21.15.52:0/520033886 learned_addr learned my addr 172.21.15.52:0/520033886 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f8117e00640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cf450 0x7f81181e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811cc00640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81180b6710 0x7f8118150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 -- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81180b6710 msgr2=0x7f8118150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81180b6710 0x7f8118150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 -- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cf450 msgr2=0x7f81181e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cf450 0x7f81181e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 -- 172.21.15.52:0/520033886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8118150d80 con 0x7f811815e440 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.113+0000 7f811d600640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f811000c7a0 tx=0x7f811000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.114+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110003b70 con 0x7f811815e440 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.114+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8110003d10 con 0x7f811815e440 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.114+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811000aa90 con 0x7f811815e440 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.114+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81180cde00 con 0x7f811815e440 2024-09-10T08:38:06.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.114+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81180ce3c0 con 0x7f811815e440 2024-09-10T08:38:06.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.115+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81180d3240 con 0x7f811815e440 2024-09-10T08:38:06.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.116+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f811000ac30 con 0x7f811815e440 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.116+0000 7f8114c00640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 0x7f80f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.117+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f811008ad30 con 0x7f811815e440 2024-09-10T08:38:06.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.117+0000 7f811cc00640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 0x7f80f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.118+0000 7f811cc00640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 0x7f80f806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f810c034000 tx=0x7f810c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.121+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8110058ff0 con 0x7f811815e440 2024-09-10T08:38:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.343+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81180b90c0 con 0x7f811815e440 2024-09-10T08:38:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.343+0000 7f8114c00640 1 -- 172.21.15.52:0/520033886 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7f811005d2f0 con 0x7f811815e440 2024-09-10T08:38:06.344 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:06.344 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 msgr2=0x7f80f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 0x7f80f806e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f810c034000 tx=0x7f810c02e000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 msgr2=0x7f8118160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f811000c7a0 tx=0x7f811000cc60 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 shutdown_connections 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80f806be30 0x7f80f806e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f811815e440 0x7f8118160cd0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81180cf450 0x7f81181e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 --2- 172.21.15.52:0/520033886 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81180b6710 0x7f8118150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 >> 172.21.15.52:0/520033886 conn(0x7f8118067f80 msgr2=0x7f81180c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 shutdown_connections 2024-09-10T08:38:06.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.346+0000 7f811e000640 1 -- 172.21.15.52:0/520033886 wait complete. 2024-09-10T08:38:06.362 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:38:06.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.516+0000 7fc778a00640 1 Processor -- start 2024-09-10T08:38:06.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.516+0000 7fc778a00640 1 -- start start 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc778a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc77415e5c0 0x7fc7740d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc778a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7740cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc778a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7740d2610 con 0x7fc7740cfce0 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc778a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc7740d2d10 con 0x7fc77415e5c0 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc778a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740d2ff0 con 0x7fc77415e9a0 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc773200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc7740cfce0 0x7fc7740d46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55022/0 (socket says 172.21.15.52:55022) 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.517+0000 7fc773200640 1 -- 172.21.15.52:0/1907951280 learned_addr learned my addr 172.21.15.52:0/1907951280 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc772800640 1 --2- 172.21.15.52:0/1907951280 >> v2:172.21.15.176:3300/0 conn(0x7fc77415e5c0 0x7fc7740d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc771e00640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7740cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc771400640 1 -- 172.21.15.52:0/1907951280 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172808166 0 0) 0x7fc76c001490 con 0x7fc7740cfce0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc771400640 1 -- 172.21.15.52:0/1907951280 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc758003520 con 0x7fc7740cfce0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc772800640 1 -- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 msgr2=0x7fc7740cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc772800640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7740cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc772800640 1 -- 172.21.15.52:0/1907951280 >> v1:172.21.15.52:6789/0 conn(0x7fc7740cfce0 legacy=0x7fc7740d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc772800640 1 -- 172.21.15.52:0/1907951280 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7740d32d0 con 0x7fc77415e5c0 2024-09-10T08:38:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.518+0000 7fc771e00640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7740cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.519+0000 7fc772800640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc77415e5c0 0x7fc7740d3db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc7640097a0 tx=0x7fc76402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70585ff232a64d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc771400640 1 -- 172.21.15.52:0/1907951280 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764037070 con 0x7fc77415e5c0 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc771400640 1 -- 172.21.15.52:0/1907951280 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc764032440 con 0x7fc77415e5c0 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc771400640 1 -- 172.21.15.52:0/1907951280 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7640327f0 con 0x7fc77415e5c0 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 -- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc77415e5c0 msgr2=0x7fc7740d3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc77415e5c0 0x7fc7740d3db0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc7640097a0 tx=0x7fc76402a180 comp rx=0 tx=0).stop 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 -- 172.21.15.52:0/1907951280 shutdown_connections 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7740cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 --2- 172.21.15.52:0/1907951280 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc77415e5c0 0x7fc7740d3db0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 -- 172.21.15.52:0/1907951280 >> 172.21.15.52:0/1907951280 conn(0x7fc77406c030 msgr2=0x7fc77406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 -- 172.21.15.52:0/1907951280 shutdown_connections 2024-09-10T08:38:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.520+0000 7fc778a00640 1 -- 172.21.15.52:0/1907951280 wait complete. 2024-09-10T08:38:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.522+0000 7fc778a00640 1 Processor -- start 2024-09-10T08:38:06.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.522+0000 7fc778a00640 1 -- start start 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7740cfce0 0x7fc77415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7741587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7740d42f0 con 0x7fc77415e5c0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc7740d3890 con 0x7fc7740cfce0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc778a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc774159d70 con 0x7fc77415e9a0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc771e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc771e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52814/0 (socket says 172.21.15.52:52814) 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc771e00640 1 -- 172.21.15.52:0/2933481420 learned_addr learned my addr 172.21.15.52:0/2933481420 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc772800640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7740cfce0 0x7fc77415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.523+0000 7fc773200640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7741587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 -- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 msgr2=0x7fc7741587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7741587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 -- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7740cfce0 msgr2=0x7fc77415a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7740cfce0 0x7fc77415a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 -- 172.21.15.52:0/2933481420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc774159160 con 0x7fc77415e5c0 2024-09-10T08:38:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc771e00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fc76000ebe0 tx=0x7fc76000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760017070 con 0x7fc77415e5c0 2024-09-10T08:38:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76000cc30 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760013470 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc774159440 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.524+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc774159a00 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.525+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7740b8b20 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.526+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc76001a070 con 0x7fc77415e5c0 2024-09-10T08:38:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.528+0000 7fc76aa00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 0x7fc75406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.528+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fc76008b160 con 0x7fc77415e5c0 2024-09-10T08:38:06.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.528+0000 7fc772800640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 0x7fc75406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.529+0000 7fc772800640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 0x7fc75406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc764034000 tx=0x7fc76402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.532+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7740b8b20 con 0x7fc77415e5c0 2024-09-10T08:38:06.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.784+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc7740d3db0 con 0x7fc77415e5c0 2024-09-10T08:38:06.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.784+0000 7fc76aa00640 1 -- 172.21.15.52:0/2933481420 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fc760059b00 con 0x7fc77415e5c0 2024-09-10T08:38:06.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:06.785 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":586,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2545737728,"bytes_avail":770548375552,"bytes_total":773094113280,"write_bytes_sec":50793983,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T08:38:05.593823+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.786+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 msgr2=0x7fc75406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.786+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 0x7fc75406e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc764034000 tx=0x7fc76402e000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.786+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 msgr2=0x7fc7741579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.786+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fc76000ebe0 tx=0x7fc76000c520 comp rx=0 tx=0).stop 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 shutdown_connections 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc75406be30 0x7fc75406e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc77415e9a0 0x7fc7741587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc77415e5c0 0x7fc7741579e0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 --2- 172.21.15.52:0/2933481420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7740cfce0 0x7fc77415a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 >> 172.21.15.52:0/2933481420 conn(0x7fc77406c030 msgr2=0x7fc7741602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 shutdown_connections 2024-09-10T08:38:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.787+0000 7fc778a00640 1 -- 172.21.15.52:0/2933481420 wait complete. 2024-09-10T08:38:06.803 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-10T08:38:06.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:06.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-10T08:38:06.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.961+0000 7f0175800640 1 Processor -- start 2024-09-10T08:38:06.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.962+0000 7f0175800640 1 -- start start 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f0175800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700af5f0 0x7f017006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f0175800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01700b3810 0x7f01700b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f0175800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01700afe00 con 0x7f017015fb10 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f0175800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f01700afbb0 con 0x7f01700b3810 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f0175800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01700cf280 con 0x7f01700af5f0 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f016f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01700b3810 0x7f01700b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f016f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01700b3810 0x7f01700b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52830/0 (socket says 172.21.15.52:52830) 2024-09-10T08:38:06.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f016f400640 1 -- 172.21.15.52:0/2050622753 learned_addr learned my addr 172.21.15.52:0/2050622753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.963+0000 7f016f400640 1 -- 172.21.15.52:0/2050622753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700af5f0 msgr2=0x7f017006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.964+0000 7f016f400640 1 --2- 172.21.15.52:0/2050622753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700af5f0 0x7f017006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.964+0000 7f016f400640 1 -- 172.21.15.52:0/2050622753 >> v1:172.21.15.176:6789/0 conn(0x7f017015fb10 legacy=0x7f017006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.964+0000 7f016f400640 1 -- 172.21.15.52:0/2050622753 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700cf560 con 0x7f01700b3810 2024-09-10T08:38:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f016f400640 1 --2- 172.21.15.52:0/2050622753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f01700b3ca0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0168009e50 tx=0x7f016802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc061ae7799eca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f016e000640 1 -- 172.21.15.52:0/2050622753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168036070 con 0x7f01700b3810 2024-09-10T08:38:06.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f016e000640 1 -- 172.21.15.52:0/2050622753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0168031600 con 0x7f01700b3810 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f016e000640 1 -- 172.21.15.52:0/2050622753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680319d0 con 0x7f01700b3810 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 -- 172.21.15.52:0/2050622753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 msgr2=0x7f01700b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 --2- 172.21.15.52:0/2050622753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f01700b3ca0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0168009e50 tx=0x7f016802a640 comp rx=0 tx=0).stop 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 -- 172.21.15.52:0/2050622753 shutdown_connections 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 --2- 172.21.15.52:0/2050622753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f01700b3ca0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 --2- 172.21.15.52:0/2050622753 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700af5f0 0x7f017006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 -- 172.21.15.52:0/2050622753 >> 172.21.15.52:0/2050622753 conn(0x7f01700b2510 msgr2=0x7f01700b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.965+0000 7f0175800640 1 -- 172.21.15.52:0/2050622753 shutdown_connections 2024-09-10T08:38:06.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.966+0000 7f0175800640 1 -- 172.21.15.52:0/2050622753 wait complete. 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.967+0000 7f0175800640 1 Processor -- start 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.967+0000 7f0175800640 1 -- start start 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01700af5f0 0x7f017015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f017015fb10 0x7f0170156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01700d0040 con 0x7f01700b3810 2024-09-10T08:38:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cfb20 con 0x7f01700af5f0 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0175800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01700d01c0 con 0x7f017015fb10 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52838/0 (socket says 172.21.15.52:52838) 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.968+0000 7f0166000640 1 -- 172.21.15.52:0/3633099496 learned_addr learned my addr 172.21.15.52:0/3633099496 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f016f400640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f017015fb10 0x7f0170156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f016ea00640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01700af5f0 0x7f017015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 -- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f017015fb10 msgr2=0x7f0170156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f017015fb10 0x7f0170156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 -- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01700af5f0 msgr2=0x7f017015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01700af5f0 0x7f017015ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 -- 172.21.15.52:0/3633099496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017015b7f0 con 0x7f01700b3810 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0166000640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f015800b4a0 tx=0x7f015800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0167400640 1 -- 172.21.15.52:0/3633099496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158014070 con 0x7f01700b3810 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0167400640 1 -- 172.21.15.52:0/3633099496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158010610 con 0x7f01700b3810 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0167400640 1 -- 172.21.15.52:0/3633099496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158010a00 con 0x7f01700b3810 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.969+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017015bad0 con 0x7f01700b3810 2024-09-10T08:38:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.970+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017015c090 con 0x7f01700b3810 2024-09-10T08:38:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.972+0000 7f0167400640 1 -- 172.21.15.52:0/3633099496 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0158017070 con 0x7f01700b3810 2024-09-10T08:38:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.973+0000 7f0167400640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.973+0000 7f0167400640 1 -- 172.21.15.52:0/3633099496 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f015808a840 con 0x7f01700b3810 2024-09-10T08:38:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.973+0000 7f017864d740 1 Processor -- start 2024-09-10T08:38:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.973+0000 7f017864d740 1 -- start start 2024-09-10T08:38:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.973+0000 7f016ea00640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f016ea00640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f01701f58f0 tx=0x7f0160009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 0x5555d5d52af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 0x5555d5d37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d5c9c660 con 0x5555d5d830c0 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5555d5c44680 con 0x5555d5d38bb0 2024-09-10T08:38:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.974+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5555d5c98620 con 0x5555d5d52710 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52854/0 (socket says 172.21.15.52:52854) 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 -- 172.21.15.52:0/765944562 learned_addr learned my addr 172.21.15.52:0/765944562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016ea00640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 0x5555d5d52af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 -- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 msgr2=0x5555d5d52af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 0x5555d5d52af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 -- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 msgr2=0x5555d5d37410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f0166000640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 0x5555d5d37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 0x5555d5d37410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 -- 172.21.15.52:0/765944562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d5a797d0 con 0x5555d5d830c0 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016ea00640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 0x5555d5d52af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f0166000640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 0x5555d5d37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.975+0000 7f016f400640 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f016802a680 tx=0x7f016802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4515a4a18b8188a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f015f400640 1 -- 172.21.15.52:0/765944562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168036040 con 0x5555d5d830c0 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f015f400640 1 -- 172.21.15.52:0/765944562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01680318f0 con 0x5555d5d830c0 2024-09-10T08:38:06.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f015f400640 1 -- 172.21.15.52:0/765944562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168031ca0 con 0x5555d5d830c0 2024-09-10T08:38:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 -- 172.21.15.52:0/765944562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 msgr2=0x5555d5d83610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f016802a680 tx=0x7f016802e000 comp rx=0 tx=0).stop 2024-09-10T08:38:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 -- 172.21.15.52:0/765944562 shutdown_connections 2024-09-10T08:38:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d830c0 0x5555d5d83610 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d38bb0 0x5555d5d37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 --2- 172.21.15.52:0/765944562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d52710 0x5555d5d52af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 -- 172.21.15.52:0/765944562 >> 172.21.15.52:0/765944562 conn(0x5555d5d39630 msgr2=0x5555d5d81c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 -- 172.21.15.52:0/765944562 shutdown_connections 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.976+0000 7f017864d740 1 -- 172.21.15.52:0/765944562 wait complete. 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.977+0000 7f017864d740 1 -- start start 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.977+0000 7f017864d740 1 Processor -- start 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d830c0 0x5555d5d671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d7dbe0 0x5555d5d7e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d5d37b10 con 0x5555d5d52710 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5555d5c254c0 con 0x5555d5d830c0 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5555d5d37df0 con 0x5555d5d7dbe0 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.978+0000 7f017864d740 10 client.0 _ll_register_callbacks cb 0x5555d5c94e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52862/0 (socket says 172.21.15.52:52862) 2024-09-10T08:38:06.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 -- 172.21.15.52:0/4289577938 learned_addr learned my addr 172.21.15.52:0/4289577938 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f0166000640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d830c0 0x5555d5d671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016f400640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d7dbe0 0x5555d5d7e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 -- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d7dbe0 msgr2=0x5555d5d7e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d7dbe0 0x5555d5d7e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 -- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d830c0 msgr2=0x5555d5d671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d830c0 0x5555d5d671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 -- 172.21.15.52:0/4289577938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d59af3f0 con 0x5555d5d52710 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f016ea00640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f0160015730 tx=0x7f0160004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7e3d8d49fe8a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.979+0000 7f0153e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160013820 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f01600139c0 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01680318f0 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7f016002e050 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f017864d740 10 client.8559 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x5555d596f0f0 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01680318f0 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7f0160031020 con 0x5555d5d52710 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.980+0000 7f017864d740 10 client.8559 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f017864d740 10 client.8559 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f017864d740 20 client.8559 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d79d60 0x5555d5d956e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f017864d740 4 client.8559 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d5ca9d90 con 0x5555d5d79d60 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f0166000640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d79d60 0x5555d5d956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f0166000640 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d79d60 0x5555d5d956e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36aedf834aeda1e7 server_cookie=fbc33ff5b02f337e in_seq=0 out_seq=0 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.981+0000 7f0153e00640 10 client.8559 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f0153e00640 1 -- 172.21.15.52:0/4289577938 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555d5ca9d90 con 0x5555d5d79d60 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f0153e00640 10 client.8559 handle_command_reply: tid=0 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 client.8559 shutdown 2024-09-10T08:38:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 msgr2=0x5555d5d7b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f0160015730 tx=0x7f0160004680 comp rx=0 tx=0).stop 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 shutdown_connections 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d79d60 0x5555d5d956e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d7dbe0 0x5555d5d7e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d830c0 0x5555d5d671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 --2- 172.21.15.52:0/4289577938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d52710 0x5555d5d7b6e0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f0153e00640 0 client.8559 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 >> 172.21.15.52:0/4289577938 conn(0x5555d5d38bb0 msgr2=0x5555d5d85160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 shutdown_connections 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.982+0000 7f017864d740 1 -- 172.21.15.52:0/4289577938 wait complete. 2024-09-10T08:38:06.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:06.983+0000 7f017864d740 20 client.8559 trim_cache size 0 max 16384 2024-09-10T08:38:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.000+0000 7f017864d740 1 Processor -- start 2024-09-10T08:38:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 -- start start 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5d834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d7bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01701fc9d0 con 0x5555d5d7dbe0 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0170072650 con 0x5555d5d52710 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.001+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0170151160 con 0x5555d5d830c0 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52878/0 (socket says 172.21.15.52:52878) 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 -- 172.21.15.52:0/4033733829 learned_addr learned my addr 172.21.15.52:0/4033733829 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f016ea00640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5d834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f016f400640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d7bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 -- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 msgr2=0x5555d5d7bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d7bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 -- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 msgr2=0x5555d5d834a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5d834a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 -- 172.21.15.52:0/4033733829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d5d391e0 con 0x5555d5d7dbe0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f016f400640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d7bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.002+0000 7f0166000640 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f0158058b30 tx=0x7f0158000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa09a30d953bc602 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f015ea00640 1 -- 172.21.15.52:0/4033733829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015801e040 con 0x5555d5d7dbe0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f015ea00640 1 -- 172.21.15.52:0/4033733829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158087070 con 0x5555d5d7dbe0 2024-09-10T08:38:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f015ea00640 1 -- 172.21.15.52:0/4033733829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158010ba0 con 0x5555d5d7dbe0 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 -- 172.21.15.52:0/4033733829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 msgr2=0x5555d5d85160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f0158058b30 tx=0x7f0158000bc0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 -- 172.21.15.52:0/4033733829 shutdown_connections 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d7bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85160 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 --2- 172.21.15.52:0/4033733829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5d834a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 -- 172.21.15.52:0/4033733829 >> 172.21.15.52:0/4033733829 conn(0x5555d5d38bb0 msgr2=0x5555d5d840e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 -- 172.21.15.52:0/4033733829 shutdown_connections 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.003+0000 7f017864d740 1 -- 172.21.15.52:0/4033733829 wait complete. 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.004+0000 7f017864d740 1 -- start start 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.004+0000 7f017864d740 1 Processor -- start 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5de3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d51660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d5d2eb50 con 0x5555d5d7dbe0 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01701517b0 con 0x5555d5d52710 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5555d5d2dbc0 con 0x5555d5d830c0 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f017864d740 10 client.0 _ll_register_callbacks cb 0x7f0160009350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f0166000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52880/0 (socket says 172.21.15.52:52880) 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f0166000640 1 -- 172.21.15.52:0/4153318621 learned_addr learned my addr 172.21.15.52:0/4153318621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f016ea00640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5de3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.005+0000 7f016f400640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d51660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 -- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 msgr2=0x5555d5d51660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d51660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 -- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 msgr2=0x5555d5de3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5de3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 -- 172.21.15.52:0/4153318621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d5d3d670 con 0x5555d5d7dbe0 2024-09-10T08:38:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f016f400640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d51660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0166000640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f015800be60 tx=0x7f015800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff61a4e9c9a141bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0153e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015801e040 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0158087070 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f0158010da0 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7f0158057ff0 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f017864d740 10 client.8565 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x5555d5d85a90 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.006+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158087070 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7f0158058190 con 0x5555d5d7dbe0 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 10 client.8565 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 10 client.8565 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 20 client.8565 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d95670 0x5555d5d51ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 4 client.8565 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5555d5ca40e0 con 0x5555d5d95670 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f016ea00640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d95670 0x5555d5d51ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f016ea00640 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d95670 0x5555d5d51ba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bab3c553f710fd server_cookie=62826b49369b0b64 in_seq=0 out_seq=0 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.007+0000 7f0153e00640 10 client.8565 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f0153e00640 1 -- 172.21.15.52:0/4153318621 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5555d5ca40e0 con 0x5555d5d95670 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f0153e00640 10 client.8565 handle_command_reply: tid=0 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 client.8565 shutdown 2024-09-10T08:38:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 msgr2=0x5555d5d85350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f015800be60 tx=0x7f015800bf90 comp rx=0 tx=0).stop 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 shutdown_connections 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x5555d5d95670 0x5555d5d51ba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5555d5d830c0 0x5555d5d51660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d5d7dbe0 0x5555d5d85350 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 --2- 172.21.15.52:0/4153318621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5555d5d52710 0x5555d5de3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f0153e00640 0 client.8565 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 >> 172.21.15.52:0/4153318621 conn(0x5555d5d38bb0 msgr2=0x5555d5d834a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 shutdown_connections 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 1 -- 172.21.15.52:0/4153318621 wait complete. 2024-09-10T08:38:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.008+0000 7f017864d740 20 client.8565 trim_cache size 0 max 16384 2024-09-10T08:38:07.016 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:07.016 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:38:07.016 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 msgr2=0x7f014c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f01701f58f0 tx=0x7f0160009060 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 msgr2=0x7f017015b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f015800b4a0 tx=0x7f015800b960 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 shutdown_connections 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f017015fb10 0x7f0170156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01700b3810 0x7f017015b0d0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 --2- 172.21.15.52:0/3633099496 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01700af5f0 0x7f017015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 >> 172.21.15.52:0/3633099496 conn(0x7f01700b2510 msgr2=0x7f017015e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 shutdown_connections 2024-09-10T08:38:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.009+0000 7f0175800640 1 -- 172.21.15.52:0/3633099496 wait complete. 2024-09-10T08:38:07.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:07.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-10T08:38:07.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.185+0000 7ff574c00640 1 Processor -- start 2024-09-10T08:38:07.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.185+0000 7ff574c00640 1 -- start start 2024-09-10T08:38:07.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff574c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff57006c320 0x7ff57006f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff574c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5700b5e60 con 0x7ff5700705f0 2024-09-10T08:38:07.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff574c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5700b6140 con 0x7ff5700b00f0 2024-09-10T08:38:07.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff574c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff5700b6420 con 0x7ff57006c320 2024-09-10T08:38:07.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff56f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff5700705f0 0x7ff57006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55028/0 (socket says 172.21.15.52:55028) 2024-09-10T08:38:07.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.186+0000 7ff56f400640 1 -- 172.21.15.52:0/184684155 learned_addr learned my addr 172.21.15.52:0/184684155 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff567e00640 1 --2- 172.21.15.52:0/184684155 >> v2:172.21.15.176:3300/0 conn(0x7ff57006c320 0x7ff57006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411487844 0 0) 0x7ff5700b5e60 con 0x7ff5700705f0 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff554003520 con 0x7ff5700705f0 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1636985051 0 0) 0x7ff554003520 con 0x7ff5700705f0 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 >> v2:172.21.15.176:3300/0 conn(0x7ff57006c320 msgr2=0x7ff57006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 --2- 172.21.15.52:0/184684155 >> v2:172.21.15.176:3300/0 conn(0x7ff57006c320 0x7ff57006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 >> v1:172.21.15.176:6789/0 conn(0x7ff5700b00f0 legacy=0x7ff5700b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5700b5aa0 con 0x7ff5700705f0 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7ff560001670 con 0x7ff5700705f0 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 >> v1:172.21.15.52:6789/0 conn(0x7ff5700705f0 legacy=0x7ff57006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554003a00 0x7ff554003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff554004800 0x7ff554004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 0x7ff55400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5700b6420 con 0x7ff554005210 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff55400c160 con 0x7ff554003a00 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff55400c360 con 0x7ff554004800 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff567e00640 1 --2- 172.21.15.52:0/184684155 >> v2:172.21.15.176:3300/0 conn(0x7ff57006c320 0x7ff57006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.187+0000 7ff56fe00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 0x7ff55400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56f400640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554003a00 0x7ff554003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff567e00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff554004800 0x7ff554004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56fe00640 1 -- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff554004800 msgr2=0x7ff554004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56fe00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff554004800 0x7ff554004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56fe00640 1 -- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554003a00 msgr2=0x7ff554003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56fe00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554003a00 0x7ff554003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.188+0000 7ff56fe00640 1 -- 172.21.15.52:0/184684155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff554003520 con 0x7ff554005210 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.189+0000 7ff56fe00640 1 -- 172.21.15.52:0/184684155 reap_dead start 2024-09-10T08:38:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.189+0000 7ff56fe00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 0x7ff55400b9c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff568001e20 tx=0x7ff554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040a04004b0cde3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.189+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568001a70 con 0x7ff554005210 2024-09-10T08:38:07.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.189+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56802ae10 con 0x7ff554005210 2024-09-10T08:38:07.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.189+0000 7ff56ea00640 1 -- 172.21.15.52:0/184684155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568003b90 con 0x7ff554005210 2024-09-10T08:38:07.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 -- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 msgr2=0x7ff55400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 0x7ff55400b9c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff568001e20 tx=0x7ff554005830 comp rx=0 tx=0).stop 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 -- 172.21.15.52:0/184684155 shutdown_connections 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 --2- 172.21.15.52:0/184684155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff554005210 0x7ff55400b9c0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 -- 172.21.15.52:0/184684155 >> 172.21.15.52:0/184684155 conn(0x7ff5700d12e0 msgr2=0x7ff5700d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 -- 172.21.15.52:0/184684155 shutdown_connections 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.190+0000 7ff574c00640 1 -- 172.21.15.52:0/184684155 wait complete. 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.191+0000 7ff574c00640 1 Processor -- start 2024-09-10T08:38:07.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.191+0000 7ff574c00640 1 -- start start 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554005210 0x7ff570143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5701f7a40 0x7ff5701554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff57006f910 con 0x7ff5700af1a0 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff57006f790 con 0x7ff554005210 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.192+0000 7ff574c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff57006bc10 con 0x7ff5701f7a40 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52892/0 (socket says 172.21.15.52:52892) 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 -- 172.21.15.52:0/1904902261 learned_addr learned my addr 172.21.15.52:0/1904902261 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff56f400640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554005210 0x7ff570143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff56fe00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5701f7a40 0x7ff5701554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 -- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5701f7a40 msgr2=0x7ff5701554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5701f7a40 0x7ff5701554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 -- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554005210 msgr2=0x7ff570143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554005210 0x7ff570143300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 -- 172.21.15.52:0/1904902261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5701f7f10 con 0x7ff5700af1a0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567e00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff5580116f0 tx=0x7ff558011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.193+0000 7ff567400640 1 -- 172.21.15.52:0/1904902261 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55800f8e0 con 0x7ff5700af1a0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.194+0000 7ff567400640 1 -- 172.21.15.52:0/1904902261 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff55800fa80 con 0x7ff5700af1a0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.194+0000 7ff567400640 1 -- 172.21.15.52:0/1904902261 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55800fe30 con 0x7ff5700af1a0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.194+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5701f81f0 con 0x7ff5700af1a0 2024-09-10T08:38:07.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.194+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff570143840 con 0x7ff5700af1a0 2024-09-10T08:38:07.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.197+0000 7ff567400640 1 -- 172.21.15.52:0/1904902261 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff558015460 con 0x7ff5700af1a0 2024-09-10T08:38:07.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.197+0000 7ff567400640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 0x7ff54c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.197+0000 7ff567400640 1 -- 172.21.15.52:0/1904902261 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff55808b730 con 0x7ff5700af1a0 2024-09-10T08:38:07.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.198+0000 7ff579252740 1 Processor -- start 2024-09-10T08:38:07.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.198+0000 7ff56f400640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 0x7ff54c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.198+0000 7ff579252740 1 -- start start 2024-09-10T08:38:07.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff56f400640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 0x7ff54c06e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff560001c00 tx=0x7ff560001b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f5ff9e0 0x55ee7f5fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f64a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee7f567660 con 0x55ee7f6194f0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ee7f50f680 con 0x55ee7f649ea0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ee7f563620 con 0x55ee7f5ff9e0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.199+0000 7ff56f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52900/0 (socket says 172.21.15.52:52900) 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 -- 172.21.15.52:0/1178959297 learned_addr learned my addr 172.21.15.52:0/1178959297 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff567e00640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f5ff9e0 0x55ee7f5fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56fe00640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f64a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 -- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f5ff9e0 msgr2=0x55ee7f5fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f5ff9e0 0x55ee7f5fe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 -- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 msgr2=0x55ee7f64a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f64a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 -- 172.21.15.52:0/1178959297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7f3447d0 con 0x55ee7f6194f0 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56fe00640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f64a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff56f400640 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff560007820 tx=0x7ff56000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b5b2b34ef7d52e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff55f400640 1 -- 172.21.15.52:0/1178959297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560028070 con 0x55ee7f6194f0 2024-09-10T08:38:07.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff55f400640 1 -- 172.21.15.52:0/1178959297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5600159c0 con 0x55ee7f6194f0 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.200+0000 7ff55f400640 1 -- 172.21.15.52:0/1178959297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560015d70 con 0x55ee7f6194f0 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 -- 172.21.15.52:0/1178959297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 msgr2=0x55ee7f6198d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff560007820 tx=0x7ff56000c000 comp rx=0 tx=0).stop 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 -- 172.21.15.52:0/1178959297 shutdown_connections 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f64a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f5ff9e0 0x55ee7f5fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 --2- 172.21.15.52:0/1178959297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6198d0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 -- 172.21.15.52:0/1178959297 >> 172.21.15.52:0/1178959297 conn(0x55ee7f600410 msgr2=0x55ee7f648a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 -- 172.21.15.52:0/1178959297 shutdown_connections 2024-09-10T08:38:07.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.201+0000 7ff579252740 1 -- 172.21.15.52:0/1178959297 wait complete. 2024-09-10T08:38:07.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.202+0000 7ff579252740 1 -- start start 2024-09-10T08:38:07.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.202+0000 7ff579252740 1 Processor -- start 2024-09-10T08:38:07.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f641f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f63f2e0 0x55ee7f65ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee7f5fe940 con 0x55ee7f649ea0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ee7f4f04c0 con 0x55ee7f63f2e0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ee7f5fec20 con 0x55ee7f6194f0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff579252740 10 client.0 _ll_register_callbacks cb 0x55ee7f55fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52910/0 (socket says 172.21.15.52:52910) 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff567e00640 1 -- 172.21.15.52:0/424555166 learned_addr learned my addr 172.21.15.52:0/424555166 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff56f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f641f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.203+0000 7ff56fe00640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f63f2e0 0x55ee7f65ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 -- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 msgr2=0x55ee7f641f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f641f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 -- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f63f2e0 msgr2=0x55ee7f65ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f63f2e0 0x55ee7f65ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 -- 172.21.15.52:0/424555166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7f27a3f0 con 0x55ee7f649ea0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff567e00640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff5580116c0 tx=0x7ff558062670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94126e443bea4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff553e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558088060 con 0x55ee7f649ea0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5600159c0 con 0x55ee7f649ea0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff5580898b0 con 0x55ee7f649ea0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7ff558071070 con 0x55ee7f649ea0 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff579252740 10 client.8577 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:07.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.204+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x55ee7f23a0f0 con 0x55ee7f649ea0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5600159c0 con 0x55ee7f649ea0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7ff558062120 con 0x55ee7f649ea0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 10 client.8577 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 10 client.8577 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 20 client.8577 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f65bc00 0x55ee7f6032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 4 client.8577 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee7f574d90 con 0x55ee7f65bc00 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.205+0000 7ff56f400640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f65bc00 0x55ee7f6032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.206+0000 7ff56f400640 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f65bc00 0x55ee7f6032d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0188c4017198e0 server_cookie=ccdc80f88dbfd3f5 in_seq=0 out_seq=0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.206+0000 7ff553e00640 10 client.8577 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.206+0000 7ff553e00640 1 -- 172.21.15.52:0/424555166 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee7f574d90 con 0x55ee7f65bc00 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.206+0000 7ff553e00640 10 client.8577 handle_command_reply: tid=0 2024-09-10T08:38:07.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.206+0000 7ff579252740 1 client.8577 shutdown 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 msgr2=0x55ee7f65c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff5580116c0 tx=0x7ff558062670 comp rx=0 tx=0).stop 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 shutdown_connections 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f65bc00 0x55ee7f6032d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f63f2e0 0x55ee7f65ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f649ea0 0x55ee7f65c4f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 --2- 172.21.15.52:0/424555166 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f641f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff553e00640 0 client.8577 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 >> 172.21.15.52:0/424555166 conn(0x55ee7f5ff9e0 msgr2=0x55ee7f5fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 shutdown_connections 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 1 -- 172.21.15.52:0/424555166 wait complete. 2024-09-10T08:38:07.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.207+0000 7ff579252740 20 client.8577 trim_cache size 0 max 16384 2024-09-10T08:38:07.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.225+0000 7ff579252740 1 Processor -- start 2024-09-10T08:38:07.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.225+0000 7ff579252740 1 -- start start 2024-09-10T08:38:07.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f619970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f5fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff570201150 con 0x55ee7f63f2e0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff570200190 con 0x55ee7f649ea0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5701ff690 con 0x55ee7f6194f0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff567e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52922/0 (socket says 172.21.15.52:52922) 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff567e00640 1 -- 172.21.15.52:0/688447197 learned_addr learned my addr 172.21.15.52:0/688447197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff56f400640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f619970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.226+0000 7ff56fe00640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f5fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 -- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 msgr2=0x55ee7f619970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f619970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 -- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 msgr2=0x55ee7f5fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f5fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 -- 172.21.15.52:0/688447197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7f63c270 con 0x55ee7f63f2e0 2024-09-10T08:38:07.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff56f400640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f619970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:07.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff567e00640 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff558009760 tx=0x7ff55806e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97164138100a9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff55ea00640 1 -- 172.21.15.52:0/688447197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55807d070 con 0x55ee7f63f2e0 2024-09-10T08:38:07.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff55ea00640 1 -- 172.21.15.52:0/688447197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff558062120 con 0x55ee7f63f2e0 2024-09-10T08:38:07.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.227+0000 7ff55ea00640 1 -- 172.21.15.52:0/688447197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff558088050 con 0x55ee7f63f2e0 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- 172.21.15.52:0/688447197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 msgr2=0x55ee7f5fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff558009760 tx=0x7ff55806e000 comp rx=0 tx=0).stop 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- 172.21.15.52:0/688447197 shutdown_connections 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f5fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f63f2e0 0x55ee7f5fd140 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 --2- 172.21.15.52:0/688447197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f6194f0 0x55ee7f619970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- 172.21.15.52:0/688447197 >> 172.21.15.52:0/688447197 conn(0x55ee7f5ff9e0 msgr2=0x55ee7f641de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- 172.21.15.52:0/688447197 shutdown_connections 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- 172.21.15.52:0/688447197 wait complete. 2024-09-10T08:38:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 -- start start 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.228+0000 7ff579252740 1 Processor -- start 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f63f2e0 0x55ee7f618980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f6550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee7f602750 con 0x55ee7f6194f0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701ffb40 con 0x55ee7f649ea0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ee7f64b400 con 0x55ee7f63f2e0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.229+0000 7ff579252740 10 client.0 _ll_register_callbacks cb 0x7ff558059b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52932/0 (socket says 172.21.15.52:52932) 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 -- 172.21.15.52:0/3274865335 learned_addr learned my addr 172.21.15.52:0/3274865335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff567e00640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f63f2e0 0x55ee7f618980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56fe00640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f6550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 -- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f63f2e0 msgr2=0x55ee7f618980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f63f2e0 0x55ee7f618980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 -- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 msgr2=0x55ee7f6550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f6550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 -- 172.21.15.52:0/3274865335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7f6c80d0 con 0x55ee7f6194f0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56fe00640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f6550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff56f400640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff560022000 tx=0x7ff560001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2146dc94e184a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.230+0000 7ff553e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56003e060 con 0x55ee7f6194f0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff560015d10 con 0x55ee7f6194f0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff558062120 con 0x55ee7f6194f0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) ==== 24+0+0 (secure 0 0 0) 0x7ff560044050 con 0x55ee7f6194f0 2024-09-10T08:38:07.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 10 client.8583 fetch_fsmap learned FSMap version 102 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) -- 0x55ee7f6c7380 con 0x55ee7f6194f0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff558062120 con 0x55ee7f6194f0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 102) ==== 3502+0+0 (secure 0 0 0) 0x7ff560047020 con 0x55ee7f6194f0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 10 client.8583 fetch_fsmap finished waiting for FSMap version 102 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 10 client.8583 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 20 client.8583 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f6555f0 0x55ee7f644fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 4 client.8583 mds_command: new command op to 8316 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.231+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 --> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee7f56f0e0 con 0x55ee7f6555f0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff567e00640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f6555f0 0x55ee7f644fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff567e00640 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f6555f0 0x55ee7f644fc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b786cbbb073a5e7f server_cookie=6d958181ae7e6c95 in_seq=0 out_seq=0 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff553e00640 10 client.8583 ms_handle_connect on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff553e00640 1 -- 172.21.15.52:0/3274865335 <== mds.0 v2:172.21.15.52:6832/1386898992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ee7f56f0e0 con 0x55ee7f6555f0 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff553e00640 10 client.8583 handle_command_reply: tid=0 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 client.8583 shutdown 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 msgr2=0x55ee7f6c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff560022000 tx=0x7ff560001970 comp rx=0 tx=0).stop 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 shutdown_connections 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:6832/1386898992,v1:172.21.15.52:6834/1386898992] conn(0x55ee7f6555f0 0x55ee7f644fc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.232+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ee7f649ea0 0x55ee7f6550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ee7f63f2e0 0x55ee7f618980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff553e00640 0 client.8583 ms_handle_reset on v2:172.21.15.52:6832/1386898992 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 1 --2- 172.21.15.52:0/3274865335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee7f6194f0 0x55ee7f6c6e40 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 >> 172.21.15.52:0/3274865335 conn(0x55ee7f5ff9e0 msgr2=0x55ee7f64a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 shutdown_connections 2024-09-10T08:38:07.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 1 -- 172.21.15.52:0/3274865335 wait complete. 2024-09-10T08:38:07.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff579252740 20 client.8583 trim_cache size 0 max 16384 2024-09-10T08:38:07.239 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:07.239 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:38:07.239 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:38:07.239 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 msgr2=0x7ff54c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 0x7ff54c06e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff560001c00 tx=0x7ff560001b90 comp rx=0 tx=0).stop 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 msgr2=0x7ff5701f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff5580116f0 tx=0x7ff558011bb0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 shutdown_connections 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff54c06be60 0x7ff54c06e320 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5701f7a40 0x7ff5701554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5700af1a0 0x7ff5701f7500 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 --2- 172.21.15.52:0/1904902261 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff554005210 0x7ff570143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.233+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 >> 172.21.15.52:0/1904902261 conn(0x7ff5700d12e0 msgr2=0x7ff57015c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.234+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 shutdown_connections 2024-09-10T08:38:07.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.234+0000 7ff574c00640 1 -- 172.21.15.52:0/1904902261 wait complete. 2024-09-10T08:38:07.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:07.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:07.348 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:07.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.407+0000 7fe224a00640 1 Processor -- start 2024-09-10T08:38:07.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.407+0000 7fe224a00640 1 -- start start 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe224a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe2200d23b0 0x7fe2200b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe224a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2200d0e70 con 0x7fe2200b6970 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe224a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2200d41c0 con 0x7fe22015ed20 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe224a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe2200d35b0 con 0x7fe2200d23b0 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe217e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe2200b6970 0x7fe2200b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55034/0 (socket says 172.21.15.52:55034) 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe217e00640 1 -- 172.21.15.52:0/3838049055 learned_addr learned my addr 172.21.15.52:0/3838049055 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:07.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.408+0000 7fe21e800640 1 --2- 172.21.15.52:0/3838049055 >> v2:172.21.15.176:3300/0 conn(0x7fe2200d23b0 0x7fe2200b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071921792 0 0) 0x7fe208001110 con 0x7fe2200b6970 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe204003520 con 0x7fe2200b6970 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665965478 0 0) 0x7fe2200d41c0 con 0x7fe22015ed20 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe208001110 con 0x7fe22015ed20 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21e800640 1 -- 172.21.15.52:0/3838049055 >> v1:172.21.15.176:6789/0 conn(0x7fe22015ed20 legacy=0x7fe2200b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21e800640 1 -- 172.21.15.52:0/3838049055 >> v1:172.21.15.52:6789/0 conn(0x7fe2200b6970 legacy=0x7fe2200b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1568808997 0 0) 0x7fe204003520 con 0x7fe2200b6970 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.409+0000 7fe21e800640 1 -- 172.21.15.52:0/3838049055 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2200d3890 con 0x7fe2200d23b0 2024-09-10T08:38:07.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.410+0000 7fe21e800640 1 --2- 172.21.15.52:0/3838049055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2200d23b0 0x7fe2200b87e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe218009d90 tx=0x7fe21802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2af3f78943e444 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.410+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208001840 con 0x7fe2200d23b0 2024-09-10T08:38:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.410+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe218007540 con 0x7fe2200d23b0 2024-09-10T08:38:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.410+0000 7fe21d400640 1 -- 172.21.15.52:0/3838049055 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2180078f0 con 0x7fe2200d23b0 2024-09-10T08:38:07.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 -- 172.21.15.52:0/3838049055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2200d23b0 msgr2=0x7fe2200b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 --2- 172.21.15.52:0/3838049055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2200d23b0 0x7fe2200b87e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe218009d90 tx=0x7fe21802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 -- 172.21.15.52:0/3838049055 shutdown_connections 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 --2- 172.21.15.52:0/3838049055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2200d23b0 0x7fe2200b87e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 -- 172.21.15.52:0/3838049055 >> 172.21.15.52:0/3838049055 conn(0x7fe2200d1260 msgr2=0x7fe2200d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 -- 172.21.15.52:0/3838049055 shutdown_connections 2024-09-10T08:38:07.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.411+0000 7fe224a00640 1 -- 172.21.15.52:0/3838049055 wait complete. 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.413+0000 7fe224a00640 1 Processor -- start 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.413+0000 7fe224a00640 1 -- start start 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2200d23b0 0x7fe220161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22015ed20 0x7fe220154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200d32a0 con 0x7fe2200b6970 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2200d3e50 con 0x7fe22015ed20 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe224a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe22015f100 con 0x7fe2200d23b0 2024-09-10T08:38:07.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52938/0 (socket says 172.21.15.52:52938) 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 -- 172.21.15.52:0/2910626463 learned_addr learned my addr 172.21.15.52:0/2910626463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21e800640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22015ed20 0x7fe220154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe217e00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2200d23b0 0x7fe220161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 -- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2200d23b0 msgr2=0x7fe220161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2200d23b0 0x7fe220161ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 -- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22015ed20 msgr2=0x7fe220154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22015ed20 0x7fe220154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.414+0000 7fe21de00640 1 -- 172.21.15.52:0/2910626463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22015f2e0 con 0x7fe2200b6970 2024-09-10T08:38:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe21de00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c530 tx=0x7fe21000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2100052d0 con 0x7fe2200b6970 2024-09-10T08:38:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210005490 con 0x7fe2200b6970 2024-09-10T08:38:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210012870 con 0x7fe2200b6970 2024-09-10T08:38:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2200ce000 con 0x7fe2200b6970 2024-09-10T08:38:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.415+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22015f860 con 0x7fe2200b6970 2024-09-10T08:38:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.416+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2200b7010 con 0x7fe2200b6970 2024-09-10T08:38:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.417+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe210012a10 con 0x7fe2200b6970 2024-09-10T08:38:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.418+0000 7fe216000640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 0x7fe1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.418+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fe21008a9e0 con 0x7fe2200b6970 2024-09-10T08:38:07.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.418+0000 7fe217e00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 0x7fe1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.419+0000 7fe217e00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 0x7fe1fc06e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe208001b90 tx=0x7fe208001b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.422+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe210058cb0 con 0x7fe2200b6970 2024-09-10T08:38:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.642+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2200b3f20 con 0x7fe2200b6970 2024-09-10T08:38:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.643+0000 7fe216000640 1 -- 172.21.15.52:0/2910626463 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7fe21005cfb0 con 0x7fe2200b6970 2024-09-10T08:38:07.644 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:07.644 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:07.644 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 msgr2=0x7fe1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 0x7fe1fc06e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe208001b90 tx=0x7fe208001b20 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 msgr2=0x7fe2200cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c530 tx=0x7fe21000c9f0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 shutdown_connections 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1fc06be30 0x7fe1fc06e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22015ed20 0x7fe220154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2200d23b0 0x7fe220161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 --2- 172.21.15.52:0/2910626463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2200b6970 0x7fe2200cd700 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 >> 172.21.15.52:0/2910626463 conn(0x7fe2200d1260 msgr2=0x7fe2200b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 shutdown_connections 2024-09-10T08:38:07.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.645+0000 7fe224a00640 1 -- 172.21.15.52:0/2910626463 wait complete. 2024-09-10T08:38:07.661 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:38:07.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:07.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.817+0000 7f63e9c00640 1 Processor -- start 2024-09-10T08:38:07.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.818+0000 7f63e9c00640 1 -- start start 2024-09-10T08:38:07.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e9c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f63e4162490 0x7f63e415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e9c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e415f570 con 0x7f63e40b66b0 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e9c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e415f850 con 0x7f63e415eab0 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e9c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f63e415fb30 con 0x7f63e4162490 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f63e40b66b0 0x7f63e40b6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55042/0 (socket says 172.21.15.52:55042) 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63e3400640 1 -- 172.21.15.52:0/1768413089 learned_addr learned my addr 172.21.15.52:0/1768413089 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:07.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.819+0000 7f63da000640 1 --2- 172.21.15.52:0/1768413089 >> v2:172.21.15.176:3300/0 conn(0x7f63e4162490 0x7f63e415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346484326 0 0) 0x7f63e415f570 con 0x7f63e40b66b0 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c8003520 con 0x7f63e40b66b0 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618835747 0 0) 0x7f63e415f850 con 0x7f63e415eab0 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e415f570 con 0x7f63e415eab0 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63da000640 1 -- 172.21.15.52:0/1768413089 >> v1:172.21.15.176:6789/0 conn(0x7f63e415eab0 legacy=0x7f63e40d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63da000640 1 -- 172.21.15.52:0/1768413089 >> v1:172.21.15.52:6789/0 conn(0x7f63e40b66b0 legacy=0x7f63e40b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.820+0000 7f63da000640 1 -- 172.21.15.52:0/1768413089 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e415fe10 con 0x7f63e4162490 2024-09-10T08:38:07.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.821+0000 7f63da000640 1 --2- 172.21.15.52:0/1768413089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e4162490 0x7f63e415ee90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0097a0 tx=0x7f63cc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=896c824240090de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.821+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc037070 con 0x7f63e4162490 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.821+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc032440 con 0x7f63e4162490 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.821+0000 7f63e2000640 1 -- 172.21.15.52:0/1768413089 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc032810 con 0x7f63e4162490 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 -- 172.21.15.52:0/1768413089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e4162490 msgr2=0x7f63e415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 --2- 172.21.15.52:0/1768413089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e4162490 0x7f63e415ee90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0097a0 tx=0x7f63cc02a230 comp rx=0 tx=0).stop 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 -- 172.21.15.52:0/1768413089 shutdown_connections 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 --2- 172.21.15.52:0/1768413089 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e4162490 0x7f63e415ee90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 -- 172.21.15.52:0/1768413089 >> 172.21.15.52:0/1768413089 conn(0x7f63e40d16d0 msgr2=0x7f63e40d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 -- 172.21.15.52:0/1768413089 shutdown_connections 2024-09-10T08:38:07.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.822+0000 7f63e9c00640 1 -- 172.21.15.52:0/1768413089 wait complete. 2024-09-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.824+0000 7f63e9c00640 1 Processor -- start 2024-09-10T08:38:07.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.824+0000 7f63e9c00640 1 -- start start 2024-09-10T08:38:07.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 0x7f63e414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e4162490 0x7f63e40cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40d45e0 con 0x7f63e415eab0 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40d4460 con 0x7f63e40b66b0 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e9c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40d35e0 con 0x7f63e4162490 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52948/0 (socket says 172.21.15.52:52948) 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 -- 172.21.15.52:0/2811666971 learned_addr learned my addr 172.21.15.52:0/2811666971 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e2a00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 0x7f63e414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 -- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e4162490 msgr2=0x7f63e40cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e4162490 0x7f63e40cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 -- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 msgr2=0x7f63e414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 0x7f63e414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63da000640 1 -- 172.21.15.52:0/2811666971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e414ac80 con 0x7f63e415eab0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.825+0000 7f63e2a00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 0x7f63e414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63da000640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f63cc035040 tx=0x7f63cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc037040 con 0x7f63e415eab0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc042070 con 0x7f63e415eab0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e40ce400 con 0x7f63e415eab0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc03b930 con 0x7f63e415eab0 2024-09-10T08:38:07.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.826+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e40ce9c0 con 0x7f63e415eab0 2024-09-10T08:38:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.827+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e415f850 con 0x7f63e415eab0 2024-09-10T08:38:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.828+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63cc03bad0 con 0x7f63e415eab0 2024-09-10T08:38:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.829+0000 7f63db400640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:07.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.829+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f63cc0ab7b0 con 0x7f63e415eab0 2024-09-10T08:38:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.829+0000 7f63e2a00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:07.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.830+0000 7f63e2a00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63d40011e0 tx=0x7f63d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:07.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:07.833+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63cc07a0c0 con 0x7f63e415eab0 2024-09-10T08:38:08.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.082+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f63e40d2500 con 0x7f63e415eab0 2024-09-10T08:38:08.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.083+0000 7f63db400640 1 -- 172.21.15.52:0/2811666971 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f63cc0799c0 con 0x7f63e415eab0 2024-09-10T08:38:08.084 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:08.084 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2545737728,"bytes_avail":770548375552,"bytes_total":773094113280,"write_bytes_sec":29167754,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-10T08:38:05.593823+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 msgr2=0x7f63c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f63d40011e0 tx=0x7f63d4009040 comp rx=0 tx=0).stop 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 msgr2=0x7f63e40cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f63cc035040 tx=0x7f63cc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 shutdown_connections 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:08.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63e4162490 0x7f63e40cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:08.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e415eab0 0x7f63e40cd880 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:08.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 --2- 172.21.15.52:0/2811666971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63e40b66b0 0x7f63e414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:08.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 >> 172.21.15.52:0/2811666971 conn(0x7f63e40d16d0 msgr2=0x7f63e40b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:08.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 shutdown_connections 2024-09-10T08:38:08.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:08.085+0000 7f63e9c00640 1 -- 172.21.15.52:0/2811666971 wait complete. 2024-09-10T08:38:08.101 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-10T08:38:09.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:09.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.270+0000 7f2ae0200640 1 Processor -- start 2024-09-10T08:38:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.270+0000 7f2ae0200640 1 -- start start 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.271+0000 7f2ae0200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ad815e790 0x7f2ad8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.271+0000 7f2ae0200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad81631c0 con 0x7f2ad806f730 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ae0200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad80ae9a0 con 0x7f2ad8162c60 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ae0200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad815eb70 con 0x7f2ad815e790 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ade200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2ad806f730 0x7f2ad806fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55048/0 (socket says 172.21.15.52:55048) 2024-09-10T08:38:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ade200640 1 -- 172.21.15.52:0/778647776 learned_addr learned my addr 172.21.15.52:0/778647776 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:09.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2add800640 1 --2- 172.21.15.52:0/778647776 >> v2:172.21.15.176:3300/0 conn(0x7f2ad815e790 0x7f2ad8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377105816 0 0) 0x7f2ad81631c0 con 0x7f2ad806f730 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac0003520 con 0x7f2ad806f730 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978421569 0 0) 0x7f2ad80ae9a0 con 0x7f2ad8162c60 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.272+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad81631c0 con 0x7f2ad8162c60 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.273+0000 7f2add800640 1 -- 172.21.15.52:0/778647776 >> v1:172.21.15.176:6789/0 conn(0x7f2ad8162c60 legacy=0x7f2ad80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.273+0000 7f2add800640 1 -- 172.21.15.52:0/778647776 >> v1:172.21.15.52:6789/0 conn(0x7f2ad806f730 legacy=0x7f2ad806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.273+0000 7f2add800640 1 -- 172.21.15.52:0/778647776 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad80aec40 con 0x7f2ad815e790 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2add800640 1 --2- 172.21.15.52:0/778647776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad815e790 0x7f2ad8073a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80aeb70 tx=0x7f2acc02a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a700d44fb6c4f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc037070 con 0x7f2ad815e790 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc02ae40 con 0x7f2ad815e790 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2ad7e00640 1 -- 172.21.15.52:0/778647776 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc032660 con 0x7f2ad815e790 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2ae0200640 1 -- 172.21.15.52:0/778647776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad815e790 msgr2=0x7f2ad8073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.274+0000 7f2ae0200640 1 --2- 172.21.15.52:0/778647776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad815e790 0x7f2ad8073a40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80aeb70 tx=0x7f2acc02a0f0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.275+0000 7f2ae0200640 1 -- 172.21.15.52:0/778647776 shutdown_connections 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.275+0000 7f2ae0200640 1 --2- 172.21.15.52:0/778647776 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad815e790 0x7f2ad8073a40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.275+0000 7f2ae0200640 1 -- 172.21.15.52:0/778647776 >> 172.21.15.52:0/778647776 conn(0x7f2ad80b0a80 msgr2=0x7f2ad80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.275+0000 7f2ae0200640 1 -- 172.21.15.52:0/778647776 shutdown_connections 2024-09-10T08:38:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.275+0000 7f2ae0200640 1 -- 172.21.15.52:0/778647776 wait complete. 2024-09-10T08:38:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.276+0000 7f2ae0200640 1 Processor -- start 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.276+0000 7f2ae0200640 1 -- start start 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 0x7f2ad80ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 0x7f2ad81f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad80b5b40 con 0x7f2ad806f730 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad80af200 con 0x7f2ad8162c60 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2ae0200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad806f430 con 0x7f2ad815e790 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.277+0000 7f2add800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52964/0 (socket says 172.21.15.52:52964) 2024-09-10T08:38:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 -- 172.21.15.52:0/2372696367 learned_addr learned my addr 172.21.15.52:0/2372696367 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2adce00640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 0x7f2ad80ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2ade200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 0x7f2ad81f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 -- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 msgr2=0x7f2ad80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 0x7f2ad80ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 -- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 msgr2=0x7f2ad81f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 0x7f2ad81f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 -- 172.21.15.52:0/2372696367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad814e650 con 0x7f2ad806f730 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2adce00640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 0x7f2ad80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2ade200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 0x7f2ad81f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2add800640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009890 tx=0x7f2acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.278+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc041020 con 0x7f2ad806f730 2024-09-10T08:38:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.279+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc03c670 con 0x7f2ad806f730 2024-09-10T08:38:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.279+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad814edb0 con 0x7f2ad806f730 2024-09-10T08:38:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.279+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc037040 con 0x7f2ad806f730 2024-09-10T08:38:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.279+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad814db30 con 0x7f2ad806f730 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.280+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad8073a40 con 0x7f2ad806f730 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.281+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2acc044020 con 0x7f2ad806f730 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.281+0000 7f2ad5600640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.281+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f2acc0ab640 con 0x7f2ad806f730 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.282+0000 7f2adce00640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.283+0000 7f2adce00640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 0x7f2ab806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8150560 tx=0x7f2ac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.286+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2acc04b030 con 0x7f2ad806f730 2024-09-10T08:38:09.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.505+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ad815ed00 con 0x7f2ad806f730 2024-09-10T08:38:09.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.506+0000 7f2ad5600640 1 -- 172.21.15.52:0/2372696367 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7f2acc07ee20 con 0x7f2ad806f730 2024-09-10T08:38:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:09.507 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.508+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 msgr2=0x7f2ab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.508+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 0x7f2ab806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8150560 tx=0x7f2ac4009040 comp rx=0 tx=0).stop 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.508+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 msgr2=0x7f2ad80ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.508+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009890 tx=0x7f2acc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 shutdown_connections 2024-09-10T08:38:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ab806be30 0x7f2ab806e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ad8162c60 0x7f2ad81f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ad815e790 0x7f2ad80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 --2- 172.21.15.52:0/2372696367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ad806f730 0x7f2ad80ce490 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 >> 172.21.15.52:0/2372696367 conn(0x7f2ad80b0a80 msgr2=0x7f2ad80717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 shutdown_connections 2024-09-10T08:38:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.509+0000 7f2ae0200640 1 -- 172.21.15.52:0/2372696367 wait complete. 2024-09-10T08:38:09.525 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:38:09.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.681+0000 7fdc3fe00640 1 Processor -- start 2024-09-10T08:38:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.681+0000 7fdc3fe00640 1 -- start start 2024-09-10T08:38:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.682+0000 7fdc3fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc4015e5c0 0x7fdc400d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.682+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.682+0000 7fdc3fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc400d2610 con 0x7fdc4015e9a0 2024-09-10T08:38:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.682+0000 7fdc3fe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdc400d5080 con 0x7fdc4015e5c0 2024-09-10T08:38:09.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.682+0000 7fdc3fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc400d2d10 con 0x7fdc400d46d0 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdc4015e5c0 0x7fdc400d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc37e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fdc4015e9a0 0x7fdc400cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52210/0 (socket says 172.21.15.52:52210) 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc37e00640 1 -- 172.21.15.52:0/3695916865 learned_addr learned my addr 172.21.15.52:0/3695916865 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3f400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42324/0 (socket says 172.21.15.52:42324) 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3ea00640 1 -- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 msgr2=0x7fdc400d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3ea00640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3ea00640 1 -- 172.21.15.52:0/3695916865 >> v1:172.21.15.176:6789/0 conn(0x7fdc4015e9a0 legacy=0x7fdc400cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3ea00640 1 -- 172.21.15.52:0/3695916865 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc400d2ff0 con 0x7fdc4015e5c0 2024-09-10T08:38:09.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.683+0000 7fdc3f400640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.684+0000 7fdc3ea00640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400d3db0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097a0 tx=0x7fdc3002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4861e77905f5f87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3e000640 1 -- 172.21.15.52:0/3695916865 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30037070 con 0x7fdc4015e5c0 2024-09-10T08:38:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3e000640 1 -- 172.21.15.52:0/3695916865 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc30032440 con 0x7fdc4015e5c0 2024-09-10T08:38:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3e000640 1 -- 172.21.15.52:0/3695916865 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30032810 con 0x7fdc4015e5c0 2024-09-10T08:38:09.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 -- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 msgr2=0x7fdc400d3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400d3db0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdc300097a0 tx=0x7fdc3002a180 comp rx=0 tx=0).stop 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 -- 172.21.15.52:0/3695916865 shutdown_connections 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc400d46d0 0x7fdc400d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/3695916865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400d3db0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 -- 172.21.15.52:0/3695916865 >> 172.21.15.52:0/3695916865 conn(0x7fdc4006c030 msgr2=0x7fdc4006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 -- 172.21.15.52:0/3695916865 shutdown_connections 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.685+0000 7fdc3fe00640 1 -- 172.21.15.52:0/3695916865 wait complete. 2024-09-10T08:38:09.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.687+0000 7fdc3fe00640 1 Processor -- start 2024-09-10T08:38:09.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.687+0000 7fdc3fe00640 1 -- start start 2024-09-10T08:38:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc4015e9a0 0x7fdc4015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc400d3890 con 0x7fdc400d46d0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc400d35b0 con 0x7fdc4015e5c0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdc400d42f0 con 0x7fdc4015e9a0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52970/0 (socket says 172.21.15.52:52970) 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3ea00640 1 -- 172.21.15.52:0/12686504 learned_addr learned my addr 172.21.15.52:0/12686504 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc37e00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.688+0000 7fdc3f400640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc4015e9a0 0x7fdc4015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 -- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc4015e9a0 msgr2=0x7fdc4015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc4015e9a0 0x7fdc4015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 -- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 msgr2=0x7fdc400b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 -- 172.21.15.52:0/12686504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc401587f0 con 0x7fdc400d46d0 2024-09-10T08:38:09.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3ea00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fdc30035040 tx=0x7fdc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30037040 con 0x7fdc400d46d0 2024-09-10T08:38:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc30030500 con 0x7fdc400d46d0 2024-09-10T08:38:09.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30030910 con 0x7fdc400d46d0 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc40158ad0 con 0x7fdc400d46d0 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.689+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc40159090 con 0x7fdc400d46d0 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.690+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc400d4b40 con 0x7fdc400d46d0 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.691+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc30044020 con 0x7fdc400d46d0 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.692+0000 7fdc36a00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 0x7fdc1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.692+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fdc300ab120 con 0x7fdc400d46d0 2024-09-10T08:38:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.693+0000 7fdc37e00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 0x7fdc1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:09.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.694+0000 7fdc37e00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 0x7fdc1c06e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc40158370 tx=0x7fdc28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:09.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.696+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc30079a30 con 0x7fdc400d46d0 2024-09-10T08:38:09.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.950+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdc40160010 con 0x7fdc400d46d0 2024-09-10T08:38:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.950+0000 7fdc36a00640 1 -- 172.21.15.52:0/12686504 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fdc30079330 con 0x7fdc400d46d0 2024-09-10T08:38:09.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:09.951 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":589,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":135,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2545737728,"bytes_avail":770548375552,"bytes_total":773094113280,"write_bytes_sec":29167907,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-10T08:38:09.594616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:09.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 msgr2=0x7fdc1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 0x7fdc1c06e320 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdc40158370 tx=0x7fdc28009040 comp rx=0 tx=0).stop 2024-09-10T08:38:09.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 msgr2=0x7fdc4015a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fdc30035040 tx=0x7fdc300046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 shutdown_connections 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdc1c06be60 0x7fdc1c06e320 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdc4015e9a0 0x7fdc4015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc4015e5c0 0x7fdc400b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 --2- 172.21.15.52:0/12686504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc400d46d0 0x7fdc4015a640 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 >> 172.21.15.52:0/12686504 conn(0x7fdc4006c030 msgr2=0x7fdc40068170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 shutdown_connections 2024-09-10T08:38:09.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:09.953+0000 7fdc3fe00640 1 -- 172.21.15.52:0/12686504 wait complete. 2024-09-10T08:38:09.969 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:38:09.970 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:38:09.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:38:10.058 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:38:10.151 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:38:10.152 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:38:10.152 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:10.152 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:10.187 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:10.187 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:10.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:38:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.459+0000 7f427b200640 1 Processor -- start 2024-09-10T08:38:10.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.459+0000 7f427b200640 1 -- start start 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f427b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f42740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f427b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4274073180 0x7f42740735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f427b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42740b4020 con 0x7f42740b5880 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f427b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4274073b00 con 0x7f4274073180 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f427b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42740b42c0 con 0x7f4274145ed0 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4274073180 0x7f42740735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4274073180 0x7f42740735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52980/0 (socket says 172.21.15.52:52980) 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 -- 172.21.15.52:0/3072078343 learned_addr learned my addr 172.21.15.52:0/3072078343 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:10.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f4273e00640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f42740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 -- 172.21.15.52:0/3072078343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 msgr2=0x7f42740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f42740b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 -- 172.21.15.52:0/3072078343 >> v1:172.21.15.176:6789/0 conn(0x7f42740b5880 legacy=0x7f42740b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.461+0000 7f426b400640 1 -- 172.21.15.52:0/3072078343 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740b45a0 con 0x7f4274073180 2024-09-10T08:38:10.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.462+0000 7f426b400640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4274073180 0x7f42740735c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515ad8c401304eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:10.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f4273400640 1 -- 172.21.15.52:0/3072078343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c037070 con 0x7f4274073180 2024-09-10T08:38:10.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f4273400640 1 -- 172.21.15.52:0/3072078343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c032440 con 0x7f4274073180 2024-09-10T08:38:10.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f4273400640 1 -- 172.21.15.52:0/3072078343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c032810 con 0x7f4274073180 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 -- 172.21.15.52:0/3072078343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4274073180 msgr2=0x7f42740735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4274073180 0x7f42740735c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c02a270 comp rx=0 tx=0).stop 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 -- 172.21.15.52:0/3072078343 shutdown_connections 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4274073180 0x7f42740735c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 --2- 172.21.15.52:0/3072078343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f42740b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 -- 172.21.15.52:0/3072078343 >> 172.21.15.52:0/3072078343 conn(0x7f42740ccec0 msgr2=0x7f42740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 -- 172.21.15.52:0/3072078343 shutdown_connections 2024-09-10T08:38:10.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.463+0000 7f427b200640 1 -- 172.21.15.52:0/3072078343 wait complete. 2024-09-10T08:38:10.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.465+0000 7f427b200640 1 Processor -- start 2024-09-10T08:38:10.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.465+0000 7f427b200640 1 -- start start 2024-09-10T08:38:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 0x7f4274157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f427413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42741462b0 con 0x7f42740b5880 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42740b4b60 con 0x7f4274073180 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f427b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4274146430 con 0x7f4274145ed0 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f426b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f426b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52984/0 (socket says 172.21.15.52:52984) 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.466+0000 7f426b400640 1 -- 172.21.15.52:0/3944538701 learned_addr learned my addr 172.21.15.52:0/3944538701 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f4273e00640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 0x7f4274157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f4279200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f427413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 -- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 msgr2=0x7f427413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f427413ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 -- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 msgr2=0x7f4274157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 0x7f4274157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 -- 172.21.15.52:0/3944538701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4274157590 con 0x7f42740b5880 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f4273e00640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 0x7f4274157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.467+0000 7f426b400640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.468+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c041020 con 0x7f42740b5880 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.468+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c0306c0 con 0x7f42740b5880 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.468+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c037040 con 0x7f42740b5880 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.468+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427413e3b0 con 0x7f42740b5880 2024-09-10T08:38:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.468+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427413e970 con 0x7f42740b5880 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.469+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427406f1d0 con 0x7f42740b5880 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.470+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f425c044020 con 0x7f42740b5880 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.471+0000 7f4270c00640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 0x7f425006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.471+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f425c0ab660 con 0x7f42740b5880 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.471+0000 7f4273e00640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 0x7f425006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.472+0000 7f4273e00640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 0x7f425006e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4264006fd0 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:10.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.475+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f427406f1d0 con 0x7f42740b5880 2024-09-10T08:38:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.671+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f42740b5eb0 con 0x7f42740b5880 2024-09-10T08:38:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.672+0000 7f4270c00640 1 -- 172.21.15.52:0/3944538701 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v135) ==== 80+0+0 (secure 0 0 0) 0x7f425c04b030 con 0x7f42740b5880 2024-09-10T08:38:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 msgr2=0x7f425006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 0x7f425006e320 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4264006fd0 tx=0x7f4264008040 comp rx=0 tx=0).stop 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 msgr2=0x7f427413d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f425c009870 tx=0x7f425c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 shutdown_connections 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f425006be60 0x7f425006e320 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4274145ed0 0x7f427413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42740b5880 0x7f427413d9d0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 --2- 172.21.15.52:0/3944538701 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4274073180 0x7f4274157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.674+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 >> 172.21.15.52:0/3944538701 conn(0x7f42740ccec0 msgr2=0x7f42740cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.675+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 shutdown_connections 2024-09-10T08:38:10.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:10.675+0000 7f427b200640 1 -- 172.21.15.52:0/3944538701 wait complete. 2024-09-10T08:38:10.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:38:10.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:10.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:38:11.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:38:11.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:11.480 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:38:11.521 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:38:11.522 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:38:11.522 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:11.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:38:11.559 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:38:11.560 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:11.560 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:11.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:38:11.598 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:38:11.598 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:38:11.598 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:11.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:38:11.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:11.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.796+0000 7fbe53000640 1 Processor -- start 2024-09-10T08:38:11.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.796+0000 7fbe53000640 1 -- start start 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b63f0 0x7fbe4c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbe4c0b67d0 0x7fbe4c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c0d27f0 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c0cfb40 con 0x7fbe4c0b67d0 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe53000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c0cfe20 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe51200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe51200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52994/0 (socket says 172.21.15.52:52994) 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe51200640 1 -- 172.21.15.52:0/2068010543 learned_addr learned my addr 172.21.15.52:0/2068010543 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe51c00640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b63f0 0x7fbe4c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.797+0000 7fbe52600640 1 --2- 172.21.15.52:0/2068010543 >> v2:172.21.15.176:3300/0 conn(0x7fbe4c0b67d0 0x7fbe4c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.798+0000 7fbe51200640 1 -- 172.21.15.52:0/2068010543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b63f0 msgr2=0x7fbe4c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.798+0000 7fbe51200640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b63f0 0x7fbe4c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.798+0000 7fbe51200640 1 -- 172.21.15.52:0/2068010543 >> v2:172.21.15.176:3300/0 conn(0x7fbe4c0b67d0 msgr2=0x7fbe4c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.798+0000 7fbe51200640 1 --2- 172.21.15.52:0/2068010543 >> v2:172.21.15.176:3300/0 conn(0x7fbe4c0b67d0 0x7fbe4c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.798+0000 7fbe51200640 1 -- 172.21.15.52:0/2068010543 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0d2e00 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe51200640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0d0d80 tx=0x7fbe3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a64a211001adf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:11.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe4be00640 1 -- 172.21.15.52:0/2068010543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38037070 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe4be00640 1 -- 172.21.15.52:0/2068010543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe38032440 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe4be00640 1 -- 172.21.15.52:0/2068010543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38032810 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe53000640 1 -- 172.21.15.52:0/2068010543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b7a30 msgr2=0x7fbe4c0cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.799+0000 7fbe53000640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0d0d80 tx=0x7fbe3802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 -- 172.21.15.52:0/2068010543 shutdown_connections 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 --2- 172.21.15.52:0/2068010543 >> v2:172.21.15.176:3300/0 conn(0x7fbe4c0b67d0 0x7fbe4c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cf4a0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 --2- 172.21.15.52:0/2068010543 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b63f0 0x7fbe4c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 -- 172.21.15.52:0/2068010543 >> 172.21.15.52:0/2068010543 conn(0x7fbe4c0d1360 msgr2=0x7fbe4c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 -- 172.21.15.52:0/2068010543 shutdown_connections 2024-09-10T08:38:11.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.800+0000 7fbe53000640 1 -- 172.21.15.52:0/2068010543 wait complete. 2024-09-10T08:38:11.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.801+0000 7fbe53000640 1 Processor -- start 2024-09-10T08:38:11.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.801+0000 7fbe53000640 1 -- start start 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 0x7fbe4c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c15e640 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c15e4c0 con 0x7fbe4c0b7a30 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe53000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c15e7c0 con 0x7fbe4c0b67d0 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.802+0000 7fbe51c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53008/0 (socket says 172.21.15.52:53008) 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 0x7fbe4c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 -- 172.21.15.52:0/2865993181 learned_addr learned my addr 172.21.15.52:0/2865993181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe52600640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 -- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 msgr2=0x7fbe4c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 0x7fbe4c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 -- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe4c0b7a30 msgr2=0x7fbe4c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 -- 172.21.15.52:0/2865993181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c161b40 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51200640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 0x7fbe4c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe51c00640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d800 tx=0x7fbe4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.803+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40018020 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.804+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe400096a0 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.804+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c14b120 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.804+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40009a70 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.804+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c161580 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.805+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c15df80 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.806+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe4001b020 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.807+0000 7fbe49600640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 0x7fbe2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:11.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.807+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fbe4008af50 con 0x7fbe4c0b63f0 2024-09-10T08:38:11.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.807+0000 7fbe51200640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 0x7fbe2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:11.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.808+0000 7fbe51200640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 0x7fbe2c06e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbe38034000 tx=0x7fbe3802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:11.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:11.812+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe40022030 con 0x7fbe4c0b63f0 2024-09-10T08:38:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.031+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe4c0d4e10 con 0x7fbe4c0b63f0 2024-09-10T08:38:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.032+0000 7fbe49600640 1 -- 172.21.15.52:0/2865993181 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7fbe400592a0 con 0x7fbe4c0b63f0 2024-09-10T08:38:12.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:12.033 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 msgr2=0x7fbe2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 0x7fbe2c06e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbe38034000 tx=0x7fbe3802e000 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 msgr2=0x7fbe4c14abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000d800 tx=0x7fbe4000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 shutdown_connections 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbe2c06be30 0x7fbe2c06e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe4c0b7a30 0x7fbe4c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbe4c0b67d0 0x7fbe4c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 --2- 172.21.15.52:0/2865993181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe4c0b63f0 0x7fbe4c14abe0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 >> 172.21.15.52:0/2865993181 conn(0x7fbe4c0d1360 msgr2=0x7fbe4c15f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:12.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 shutdown_connections 2024-09-10T08:38:12.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.034+0000 7fbe53000640 1 -- 172.21.15.52:0/2865993181 wait complete. 2024-09-10T08:38:12.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:12.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.208+0000 7f2313600640 1 Processor -- start 2024-09-10T08:38:12.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.208+0000 7f2313600640 1 -- start start 2024-09-10T08:38:12.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2313600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f230c06c320 0x7f230c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2313600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f230c071180 con 0x7f230c13eb20 2024-09-10T08:38:12.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2313600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f230c071460 con 0x7f230c0b2d40 2024-09-10T08:38:12.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2313600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f230c071ab0 con 0x7f230c06c320 2024-09-10T08:38:12.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2311600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f230c13eb20 0x7f230c15c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55054/0 (socket says 172.21.15.52:55054) 2024-09-10T08:38:12.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f2311600640 1 -- 172.21.15.52:0/2581682241 learned_addr learned my addr 172.21.15.52:0/2581682241 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:12.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.209+0000 7f230be00640 1 --2- 172.21.15.52:0/2581682241 >> v2:172.21.15.176:3300/0 conn(0x7f230c06c320 0x7f230c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214572879 0 0) 0x7f230c071180 con 0x7f230c13eb20 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f4005730 con 0x7f230c13eb20 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810315605 0 0) 0x7f230c071460 con 0x7f230c0b2d40 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f230c071180 con 0x7f230c0b2d40 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230be00640 1 -- 172.21.15.52:0/2581682241 >> v1:172.21.15.176:6789/0 conn(0x7f230c0b2d40 legacy=0x7f230c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230be00640 1 -- 172.21.15.52:0/2581682241 >> v1:172.21.15.52:6789/0 conn(0x7f230c13eb20 legacy=0x7f230c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.210+0000 7f230be00640 1 -- 172.21.15.52:0/2581682241 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c071740 con 0x7f230c06c320 2024-09-10T08:38:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.211+0000 7f230be00640 1 --2- 172.21.15.52:0/2581682241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c06c320 0x7f230c15bcf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f22f80097a0 tx=0x7f22f802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e982e0d378e9970 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.211+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8037070 con 0x7f230c06c320 2024-09-10T08:38:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f8032440 con 0x7f230c06c320 2024-09-10T08:38:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f230b400640 1 -- 172.21.15.52:0/2581682241 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8032810 con 0x7f230c06c320 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 -- 172.21.15.52:0/2581682241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c06c320 msgr2=0x7f230c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 --2- 172.21.15.52:0/2581682241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c06c320 0x7f230c15bcf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f22f80097a0 tx=0x7f22f802a230 comp rx=0 tx=0).stop 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 -- 172.21.15.52:0/2581682241 shutdown_connections 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 --2- 172.21.15.52:0/2581682241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c06c320 0x7f230c15bcf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 -- 172.21.15.52:0/2581682241 >> 172.21.15.52:0/2581682241 conn(0x7f230c0ccec0 msgr2=0x7f230c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 -- 172.21.15.52:0/2581682241 shutdown_connections 2024-09-10T08:38:12.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.212+0000 7f2313600640 1 -- 172.21.15.52:0/2581682241 wait complete. 2024-09-10T08:38:12.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.214+0000 7f2313600640 1 Processor -- start 2024-09-10T08:38:12.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.214+0000 7f2313600640 1 -- start start 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 0x7f230c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c0b2d40 0x7f230c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0b3980 con 0x7f230c13eb20 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0b3800 con 0x7f230c0b2d40 2024-09-10T08:38:12.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2313600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f230c0b3b00 con 0x7f230c06c320 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2311600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2311600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53014/0 (socket says 172.21.15.52:53014) 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2311600640 1 -- 172.21.15.52:0/4257103922 learned_addr learned my addr 172.21.15.52:0/4257103922 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f230be00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c0b2d40 0x7f230c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.215+0000 7f2310c00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 0x7f230c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 -- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 msgr2=0x7f230c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 0x7f230c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 -- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c0b2d40 msgr2=0x7f230c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c0b2d40 0x7f230c15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 -- 172.21.15.52:0/4257103922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c0cb220 con 0x7f230c13eb20 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2310c00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 0x7f230c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2311600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f230400cb20 tx=0x7f230400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304017070 con 0x7f230c13eb20 2024-09-10T08:38:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230400aca0 con 0x7f230c13eb20 2024-09-10T08:38:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304012600 con 0x7f230c13eb20 2024-09-10T08:38:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230c0cb500 con 0x7f230c13eb20 2024-09-10T08:38:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.216+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230c0cbac0 con 0x7f230c13eb20 2024-09-10T08:38:12.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.217+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230c06bc10 con 0x7f230c13eb20 2024-09-10T08:38:12.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.218+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f230401a070 con 0x7f230c13eb20 2024-09-10T08:38:12.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.219+0000 7f2308c00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 0x7f22ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.219+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f230408ab10 con 0x7f230c13eb20 2024-09-10T08:38:12.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.220+0000 7f2310c00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 0x7f22ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.220+0000 7f2310c00640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 0x7f22ec06e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f23000011e0 tx=0x7f2300009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.223+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2304058e60 con 0x7f230c13eb20 2024-09-10T08:38:12.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.445+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f230c06c9c0 con 0x7f230c13eb20 2024-09-10T08:38:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.446+0000 7f2308c00640 1 -- 172.21.15.52:0/4257103922 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7f230405d160 con 0x7f230c13eb20 2024-09-10T08:38:12.446 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:12.446 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 msgr2=0x7f22ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 0x7f22ec06e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f23000011e0 tx=0x7f2300009040 comp rx=0 tx=0).stop 2024-09-10T08:38:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 msgr2=0x7f230c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f230400cb20 tx=0x7f230400a060 comp rx=0 tx=0).stop 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 shutdown_connections 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f22ec06be60 0x7f22ec06e320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f230c13eb20 0x7f230c15cac0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f230c0b2d40 0x7f230c15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 --2- 172.21.15.52:0/4257103922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f230c06c320 0x7f230c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 >> 172.21.15.52:0/4257103922 conn(0x7f230c0ccec0 msgr2=0x7f230c140420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 shutdown_connections 2024-09-10T08:38:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.448+0000 7f2313600640 1 -- 172.21.15.52:0/4257103922 wait complete. 2024-09-10T08:38:12.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:12.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.620+0000 7f5b99400640 1 Processor -- start 2024-09-10T08:38:12.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.620+0000 7f5b99400640 1 -- start start 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b99400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 0x7f5b9415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b99400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5b9413eb20 0x7f5b9415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b99400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b94071180 con 0x7f5b940b2d40 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b99400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5b94071ab0 con 0x7f5b9413eb20 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b99400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b94071460 con 0x7f5b9406c320 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b92800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5b940b2d40 0x7f5b9406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55060/0 (socket says 172.21.15.52:55060) 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b92800640 1 -- 172.21.15.52:0/2823201372 learned_addr learned my addr 172.21.15.52:0/2823201372 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b8be00640 1 --2- 172.21.15.52:0/2823201372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 0x7f5b9415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b93200640 1 --2- 172.21.15.52:0/2823201372 >> v2:172.21.15.176:3300/0 conn(0x7f5b9413eb20 0x7f5b9415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.622+0000 7f5b91e00640 1 -- 172.21.15.52:0/2823201372 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973396839 0 0) 0x7f5b94071180 con 0x7f5b940b2d40 2024-09-10T08:38:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.623+0000 7f5b91e00640 1 -- 172.21.15.52:0/2823201372 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b78003520 con 0x7f5b940b2d40 2024-09-10T08:38:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.623+0000 7f5b8be00640 1 -- 172.21.15.52:0/2823201372 >> v2:172.21.15.176:3300/0 conn(0x7f5b9413eb20 msgr2=0x7f5b9415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.623+0000 7f5b8be00640 1 --2- 172.21.15.52:0/2823201372 >> v2:172.21.15.176:3300/0 conn(0x7f5b9413eb20 0x7f5b9415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.623+0000 7f5b8be00640 1 -- 172.21.15.52:0/2823201372 >> v1:172.21.15.52:6789/0 conn(0x7f5b940b2d40 legacy=0x7f5b9406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.623+0000 7f5b8be00640 1 -- 172.21.15.52:0/2823201372 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94071740 con 0x7f5b9406c320 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.624+0000 7f5b8be00640 1 --2- 172.21.15.52:0/2823201372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 0x7f5b9415bcf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097a0 tx=0x7f5b7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c020099dee31b596 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.624+0000 7f5b91e00640 1 -- 172.21.15.52:0/2823201372 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c037070 con 0x7f5b9406c320 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.624+0000 7f5b91e00640 1 -- 172.21.15.52:0/2823201372 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c032440 con 0x7f5b9406c320 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.624+0000 7f5b91e00640 1 -- 172.21.15.52:0/2823201372 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0327f0 con 0x7f5b9406c320 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 -- 172.21.15.52:0/2823201372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 msgr2=0x7f5b9415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 --2- 172.21.15.52:0/2823201372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 0x7f5b9415bcf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097a0 tx=0x7f5b7c02a180 comp rx=0 tx=0).stop 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 -- 172.21.15.52:0/2823201372 shutdown_connections 2024-09-10T08:38:12.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 --2- 172.21.15.52:0/2823201372 >> v2:172.21.15.176:3300/0 conn(0x7f5b9413eb20 0x7f5b9415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 --2- 172.21.15.52:0/2823201372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b9406c320 0x7f5b9415bcf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 -- 172.21.15.52:0/2823201372 >> 172.21.15.52:0/2823201372 conn(0x7f5b940ccec0 msgr2=0x7f5b940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 -- 172.21.15.52:0/2823201372 shutdown_connections 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.625+0000 7f5b99400640 1 -- 172.21.15.52:0/2823201372 wait complete. 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.626+0000 7f5b99400640 1 Processor -- start 2024-09-10T08:38:12.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.626+0000 7f5b99400640 1 -- start start 2024-09-10T08:38:12.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 0x7f5b94154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 0x7f5b940b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940720c0 con 0x7f5b9413eb20 2024-09-10T08:38:12.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b94071f40 con 0x7f5b9406c320 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.627+0000 7f5b99400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5b94072240 con 0x7f5b940b2d40 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53024/0 (socket says 172.21.15.52:53024) 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 -- 172.21.15.52:0/2243484539 learned_addr learned my addr 172.21.15.52:0/2243484539 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b8be00640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 0x7f5b940b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b92800640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 0x7f5b94154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 -- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 msgr2=0x7f5b940b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 0x7f5b940b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 -- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 msgr2=0x7f5b94154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 0x7f5b94154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 -- 172.21.15.52:0/2243484539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94155030 con 0x7f5b9413eb20 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b8be00640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 0x7f5b940b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:12.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b92800640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 0x7f5b94154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:12.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.628+0000 7f5b93200640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00efc0 tx=0x7f5b8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.629+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c018020 con 0x7f5b9413eb20 2024-09-10T08:38:12.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.629+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c014480 con 0x7f5b9413eb20 2024-09-10T08:38:12.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.629+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b940b4880 con 0x7f5b9413eb20 2024-09-10T08:38:12.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.629+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c009e60 con 0x7f5b9413eb20 2024-09-10T08:38:12.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.629+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b940b52f0 con 0x7f5b9413eb20 2024-09-10T08:38:12.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.630+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9406bc10 con 0x7f5b9413eb20 2024-09-10T08:38:12.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.631+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b8c005d10 con 0x7f5b9413eb20 2024-09-10T08:38:12.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.631+0000 7f5b8aa00640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 0x7f5b7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:12.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.632+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f5b8c08bbc0 con 0x7f5b9413eb20 2024-09-10T08:38:12.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.632+0000 7f5b92800640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 0x7f5b7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:12.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.633+0000 7f5b92800640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 0x7f5b7006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007fd0 tx=0x7f5b84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:12.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.636+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b8c022030 con 0x7f5b9413eb20 2024-09-10T08:38:12.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.826+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b9406c9c0 con 0x7f5b9413eb20 2024-09-10T08:38:12.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.827+0000 7f5b8aa00640 1 -- 172.21.15.52:0/2243484539 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16699 (secure 0 0 0) 0x7f5b8c010040 con 0x7f5b9413eb20 2024-09-10T08:38:12.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:12.828 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:34.250934+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:37:30.466692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T08:37:31.666587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:12.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 msgr2=0x7f5b7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 0x7f5b7006e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007fd0 tx=0x7f5b84009040 comp rx=0 tx=0).stop 2024-09-10T08:38:12.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 msgr2=0x7f5b9415ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:12.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00efc0 tx=0x7f5b8c00c490 comp rx=0 tx=0).stop 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 shutdown_connections 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5b7006be30 0x7f5b7006e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b9413eb20 0x7f5b9415ab90 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b940b2d40 0x7f5b940b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 --2- 172.21.15.52:0/2243484539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b9406c320 0x7f5b94154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 >> 172.21.15.52:0/2243484539 conn(0x7f5b940ccec0 msgr2=0x7f5b94156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 shutdown_connections 2024-09-10T08:38:12.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:12.830+0000 7f5b99400640 1 -- 172.21.15.52:0/2243484539 wait complete. 2024-09-10T08:38:12.846 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:38:12.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.002+0000 7fb5fb600640 1 Processor -- start 2024-09-10T08:38:13.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.002+0000 7fb5fb600640 1 -- start start 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.003+0000 7fb5fb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5f40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.003+0000 7fb5fb600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5f40b5880 0x7fb5f40b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.003+0000 7fb5fb600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f40b4020 con 0x7fb5f4145ed0 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5fb600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f40b42c0 con 0x7fb5f40b5880 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5fb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f40b45a0 con 0x7fb5f4073890 2024-09-10T08:38:13.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f8c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb5f4145ed0 0x7fb5f4073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55074/0 (socket says 172.21.15.52:55074) 2024-09-10T08:38:13.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f8c00640 1 -- 172.21.15.52:0/1014997402 learned_addr learned my addr 172.21.15.52:0/1014997402 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3e00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5f40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f9600640 1 --2- 172.21.15.52:0/1014997402 >> v2:172.21.15.176:3300/0 conn(0x7fb5f40b5880 0x7fb5f40b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452325319 0 0) 0x7fb5f40b4020 con 0x7fb5f4145ed0 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5dc003520 con 0x7fb5f4145ed0 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3697125052 0 0) 0x7fb5dc003520 con 0x7fb5f4145ed0 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 msgr2=0x7fb5f40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:13.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5f40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 >> v2:172.21.15.176:3300/0 conn(0x7fb5f40b5880 msgr2=0x7fb5f40b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 --2- 172.21.15.52:0/1014997402 >> v2:172.21.15.176:3300/0 conn(0x7fb5f40b5880 0x7fb5f40b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.004+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f40b4880 con 0x7fb5f4145ed0 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fb5e8001670 con 0x7fb5f4145ed0 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 >> v1:172.21.15.52:6789/0 conn(0x7fb5f4145ed0 legacy=0x7fb5f4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc004800 0x7fb5dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f40b42c0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f40b45a0 con 0x7fb5dc004800 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5dc00b9c0 con 0x7fb5f4073890 2024-09-10T08:38:13.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f3e00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc004800 0x7fb5dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f9600640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 -- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 msgr2=0x7fb5dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 -- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc004800 msgr2=0x7fb5dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5dc004800 0x7fb5dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f8c00640 1 -- 172.21.15.52:0/1014997402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc003520 con 0x7fb5dc0039b0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.005+0000 7fb5f9600640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f4073890 0x7fb5dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.006+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c240 tx=0x7fb5dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6f49078a8c4e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e802e070 con 0x7fb5dc0039b0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8005af0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5f3400640 1 -- 172.21.15.52:0/1014997402 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8007d30 con 0x7fb5dc0039b0 2024-09-10T08:38:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 -- 172.21.15.52:0/1014997402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 msgr2=0x7fb5dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 --2- 172.21.15.52:0/1014997402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5dc003dd0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800c240 tx=0x7fb5dc005830 comp rx=0 tx=0).stop 2024-09-10T08:38:13.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5f9600640 1 -- 172.21.15.52:0/1014997402 reap_dead start 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 -- 172.21.15.52:0/1014997402 shutdown_connections 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 -- 172.21.15.52:0/1014997402 >> 172.21.15.52:0/1014997402 conn(0x7fb5f40ccec0 msgr2=0x7fb5f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 -- 172.21.15.52:0/1014997402 shutdown_connections 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.007+0000 7fb5fb600640 1 -- 172.21.15.52:0/1014997402 wait complete. 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.009+0000 7fb5fb600640 1 Processor -- start 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.009+0000 7fb5fb600640 1 -- start start 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f415abf0 0x7fb5f40c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f40c8cf0 0x7fb5f41f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f40b6270 con 0x7fb5dc0039b0 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f41462b0 con 0x7fb5f40c8cf0 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5fb600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f40c74c0 con 0x7fb5f415abf0 2024-09-10T08:38:13.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5f8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5f8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53052/0 (socket says 172.21.15.52:53052) 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.010+0000 7fb5f8c00640 1 -- 172.21.15.52:0/3819373743 learned_addr learned my addr 172.21.15.52:0/3819373743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f9600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f40c8cf0 0x7fb5f41f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f3e00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f415abf0 0x7fb5f40c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 -- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f415abf0 msgr2=0x7fb5f40c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f415abf0 0x7fb5f40c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 -- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f40c8cf0 msgr2=0x7fb5f41f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f40c8cf0 0x7fb5f41f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 -- 172.21.15.52:0/3819373743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f40c7710 con 0x7fb5dc0039b0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.011+0000 7fb5f8c00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8034040 tx=0x7fb5f40c6400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.012+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8042070 con 0x7fb5dc0039b0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.012+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8007480 con 0x7fb5dc0039b0 2024-09-10T08:38:13.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.012+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f40c79f0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.012+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8001c70 con 0x7fb5dc0039b0 2024-09-10T08:38:13.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.012+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f40c7fb0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.013+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f40b5d30 con 0x7fb5dc0039b0 2024-09-10T08:38:13.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.014+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e8045070 con 0x7fb5dc0039b0 2024-09-10T08:38:13.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.014+0000 7fb5f0c00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 0x7fb5d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.015+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e80ab880 con 0x7fb5dc0039b0 2024-09-10T08:38:13.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.015+0000 7fb5f3e00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 0x7fb5d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.016+0000 7fb5f3e00640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 0x7fb5d406e320 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40b3750 tx=0x7fb5e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.019+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e8005ac0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.241+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5f40686b0 con 0x7fb5dc0039b0 2024-09-10T08:38:13.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.242+0000 7fb5f0c00640 1 -- 172.21.15.52:0/3819373743 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7fb5e807a340 con 0x7fb5dc0039b0 2024-09-10T08:38:13.243 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:13.243 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:13.243 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.244+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 msgr2=0x7fb5d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.244+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 0x7fb5d406e320 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40b3750 tx=0x7fb5e0008040 comp rx=0 tx=0).stop 2024-09-10T08:38:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 msgr2=0x7fb5f415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8034040 tx=0x7fb5f40c6400 comp rx=0 tx=0).stop 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 shutdown_connections 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb5d406be60 0x7fb5d406e320 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f40c8cf0 0x7fb5f41f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f415abf0 0x7fb5f40c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 --2- 172.21.15.52:0/3819373743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5dc0039b0 0x7fb5f415a340 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 >> 172.21.15.52:0/3819373743 conn(0x7fb5f40ccec0 msgr2=0x7fb5f40cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 shutdown_connections 2024-09-10T08:38:13.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.245+0000 7fb5fb600640 1 -- 172.21.15.52:0/3819373743 wait complete. 2024-09-10T08:38:13.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:13.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.418+0000 7ff8c4200640 1 Processor -- start 2024-09-10T08:38:13.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.418+0000 7ff8c4200640 1 -- start start 2024-09-10T08:38:13.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.419+0000 7ff8c4200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff8bc147e80 0x7ff8bc070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.419+0000 7ff8c4200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8bc06c320 0x7ff8bc0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.419+0000 7ff8c4200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8bc071b30 con 0x7ff8bc148260 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.419+0000 7ff8c4200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc074200 con 0x7ff8bc06c320 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.419+0000 7ff8c4200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc0b3e40 con 0x7ff8bc147e80 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8bc06c320 0x7ff8bc0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8bc06c320 0x7ff8bc0714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53054/0 (socket says 172.21.15.52:53054) 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 -- 172.21.15.52:0/3685981970 learned_addr learned my addr 172.21.15.52:0/3685981970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c1800640 1 --2- 172.21.15.52:0/3685981970 >> v2:172.21.15.176:3300/0 conn(0x7ff8bc147e80 0x7ff8bc070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 -- 172.21.15.52:0/3685981970 >> v2:172.21.15.176:3300/0 conn(0x7ff8bc147e80 msgr2=0x7ff8bc070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 --2- 172.21.15.52:0/3685981970 >> v2:172.21.15.176:3300/0 conn(0x7ff8bc147e80 0x7ff8bc070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 -- 172.21.15.52:0/3685981970 >> v1:172.21.15.176:6789/0 conn(0x7ff8bc148260 legacy=0x7ff8bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.420+0000 7ff8c2200640 1 -- 172.21.15.52:0/3685981970 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0b3510 con 0x7ff8bc06c320 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.421+0000 7ff8c2200640 1 --2- 172.21.15.52:0/3685981970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0714b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0d1500 tx=0x7ff8b402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc5d5bf2d923e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8bbe00640 1 -- 172.21.15.52:0/3685981970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4036070 con 0x7ff8bc06c320 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8bbe00640 1 -- 172.21.15.52:0/3685981970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b4031600 con 0x7ff8bc06c320 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8bbe00640 1 -- 172.21.15.52:0/3685981970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40319d0 con 0x7ff8bc06c320 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 -- 172.21.15.52:0/3685981970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 msgr2=0x7ff8bc0714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 --2- 172.21.15.52:0/3685981970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0714b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0d1500 tx=0x7ff8b402a730 comp rx=0 tx=0).stop 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 -- 172.21.15.52:0/3685981970 shutdown_connections 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 --2- 172.21.15.52:0/3685981970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0714b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 --2- 172.21.15.52:0/3685981970 >> v2:172.21.15.176:3300/0 conn(0x7ff8bc147e80 0x7ff8bc070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 -- 172.21.15.52:0/3685981970 >> 172.21.15.52:0/3685981970 conn(0x7ff8bc0ccec0 msgr2=0x7ff8bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 -- 172.21.15.52:0/3685981970 shutdown_connections 2024-09-10T08:38:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.422+0000 7ff8c4200640 1 -- 172.21.15.52:0/3685981970 wait complete. 2024-09-10T08:38:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.424+0000 7ff8c4200640 1 Processor -- start 2024-09-10T08:38:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.424+0000 7ff8c4200640 1 -- start start 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 0x7ff8bc13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 0x7ff8bc0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc0b42d0 con 0x7ff8bc06c320 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc0b3ad0 con 0x7ff8bc147e80 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c4200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc0b4450 con 0x7ff8bc148260 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53066/0 (socket says 172.21.15.52:53066) 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c1800640 1 -- 172.21.15.52:0/2103824088 learned_addr learned my addr 172.21.15.52:0/2103824088 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c0e00640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 0x7ff8bc13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.425+0000 7ff8c2200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 0x7ff8bc0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 -- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 msgr2=0x7ff8bc0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 0x7ff8bc0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 -- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 msgr2=0x7ff8bc13f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 0x7ff8bc13f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 -- 172.21.15.52:0/2103824088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0aa460 con 0x7ff8bc06c320 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c0e00640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 0x7ff8bc13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c2200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 0x7ff8bc0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c1800640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e9b0 tx=0x7ff8b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0017070 con 0x7ff8bc06c320 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b000c9a0 con 0x7ff8bc06c320 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000cd90 con 0x7ff8bc06c320 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc0aa740 con 0x7ff8bc06c320 2024-09-10T08:38:13.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.426+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc0ab030 con 0x7ff8bc06c320 2024-09-10T08:38:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.427+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc0aab70 con 0x7ff8bc06c320 2024-09-10T08:38:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.428+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8b001a070 con 0x7ff8bc06c320 2024-09-10T08:38:13.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.429+0000 7ff8b9600640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 0x7ff89c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.429+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7ff8b008b300 con 0x7ff8bc06c320 2024-09-10T08:38:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.430+0000 7ff8c0e00640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 0x7ff89c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.430+0000 7ff8c0e00640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 0x7ff89c06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0acb40 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.434+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8bc0aab70 con 0x7ff8bc06c320 2024-09-10T08:38:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.652+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8bc145680 con 0x7ff8bc06c320 2024-09-10T08:38:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.653+0000 7ff8b9600640 1 -- 172.21.15.52:0/2103824088 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5230 (secure 0 0 0) 0x7ff8b0059c10 con 0x7ff8bc06c320 2024-09-10T08:38:13.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:13.654 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":102,"btime":"2024-09-10T08:37:36:262657+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:37:32.672925+0000","modified":"2024-09-10T08:37:35.687495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8316":{"gid":8316,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1386898992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1386898992},{"type":"v1","addr":"172.21.15.52:6834","nonce":1386898992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8316,"qdb_cluster":[8316]},"id":9}]} 2024-09-10T08:38:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 102 2024-09-10T08:38:13.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 msgr2=0x7ff89c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 0x7ff89c06e2f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0acb40 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2024-09-10T08:38:13.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 msgr2=0x7ff8bc0ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e9b0 tx=0x7ff8b000ee70 comp rx=0 tx=0).stop 2024-09-10T08:38:13.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 shutdown_connections 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff89c06be30 0x7ff89c06e2f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8bc148260 0x7ff8bc0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.655+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8bc147e80 0x7ff8bc13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.656+0000 7ff8c4200640 1 --2- 172.21.15.52:0/2103824088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc06c320 0x7ff8bc0ab830 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.656+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 >> 172.21.15.52:0/2103824088 conn(0x7ff8bc0ccec0 msgr2=0x7ff8bc0b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.656+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 shutdown_connections 2024-09-10T08:38:13.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.656+0000 7ff8c4200640 1 -- 172.21.15.52:0/2103824088 wait complete. 2024-09-10T08:38:13.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.829+0000 7fb03fe00640 1 Processor -- start 2024-09-10T08:38:13.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.829+0000 7fb03fe00640 1 -- start start 2024-09-10T08:38:13.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.830+0000 7fb03fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb038073890 0x7fb0380b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.830+0000 7fb03fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380b4020 con 0x7fb0380b5880 2024-09-10T08:38:13.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.830+0000 7fb03fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0380b42c0 con 0x7fb038145ed0 2024-09-10T08:38:13.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.830+0000 7fb03fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb0380b63f0 con 0x7fb038073890 2024-09-10T08:38:13.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb0380b5880 0x7fb0380b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55086/0 (socket says 172.21.15.52:55086) 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03de00640 1 -- 172.21.15.52:0/322812987 learned_addr learned my addr 172.21.15.52:0/322812987 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03ca00640 1 --2- 172.21.15.52:0/322812987 >> v2:172.21.15.52:3300/0 conn(0x7fb038073890 0x7fb0380b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03ca00640 1 -- 172.21.15.52:0/322812987 >> v1:172.21.15.176:6789/0 conn(0x7fb038145ed0 legacy=0x7fb038073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03ca00640 1 -- 172.21.15.52:0/322812987 >> v1:172.21.15.52:6789/0 conn(0x7fb0380b5880 legacy=0x7fb0380b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb03ca00640 1 -- 172.21.15.52:0/322812987 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380b45a0 con 0x7fb038073890 2024-09-10T08:38:13.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.831+0000 7fb037e00640 1 -- 172.21.15.52:0/322812987 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282317989 0 0) 0x7fb0380b4020 con 0x7fb0380b5880 2024-09-10T08:38:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.832+0000 7fb03ca00640 1 --2- 172.21.15.52:0/322812987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380b5080 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb0240097a0 tx=0x7fb02402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60cabea9ba67fce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.832+0000 7fb037e00640 1 -- 172.21.15.52:0/322812987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024037070 con 0x7fb038073890 2024-09-10T08:38:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.832+0000 7fb037e00640 1 -- 172.21.15.52:0/322812987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb024032440 con 0x7fb038073890 2024-09-10T08:38:13.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.832+0000 7fb037e00640 1 -- 172.21.15.52:0/322812987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024032810 con 0x7fb038073890 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 -- 172.21.15.52:0/322812987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 msgr2=0x7fb0380b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 --2- 172.21.15.52:0/322812987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380b5080 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb0240097a0 tx=0x7fb02402a230 comp rx=0 tx=0).stop 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 -- 172.21.15.52:0/322812987 shutdown_connections 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 --2- 172.21.15.52:0/322812987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380b5080 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 -- 172.21.15.52:0/322812987 >> 172.21.15.52:0/322812987 conn(0x7fb0380ccec0 msgr2=0x7fb0380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 -- 172.21.15.52:0/322812987 shutdown_connections 2024-09-10T08:38:13.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.833+0000 7fb03fe00640 1 -- 172.21.15.52:0/322812987 wait complete. 2024-09-10T08:38:13.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.835+0000 7fb03fe00640 1 Processor -- start 2024-09-10T08:38:13.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.835+0000 7fb03fe00640 1 -- start start 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0380b5880 0x7fb038158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb038145ed0 0x7fb0380cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381462b0 con 0x7fb038073890 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380b4b60 con 0x7fb038145ed0 2024-09-10T08:38:13.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb038146430 con 0x7fb0380b5880 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53074/0 (socket says 172.21.15.52:53074) 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03d400640 1 -- 172.21.15.52:0/3258256989 learned_addr learned my addr 172.21.15.52:0/3258256989 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03ca00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0380b5880 0x7fb038158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.836+0000 7fb03de00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb038145ed0 0x7fb0380cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 -- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0380b5880 msgr2=0x7fb038158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0380b5880 0x7fb038158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 -- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb038145ed0 msgr2=0x7fb0380cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb038145ed0 0x7fb0380cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 -- 172.21.15.52:0/3258256989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03813ffb0 con 0x7fb038073890 2024-09-10T08:38:13.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03d400640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c400 tx=0x7fb02c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c017070 con 0x7fb038073890 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02c0052d0 con 0x7fb038073890 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003830 con 0x7fb038073890 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb038158c40 con 0x7fb038073890 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.837+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0380c76e0 con 0x7fb038073890 2024-09-10T08:38:13.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.838+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0380b5080 con 0x7fb038073890 2024-09-10T08:38:13.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.839+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb02c01a070 con 0x7fb038073890 2024-09-10T08:38:13.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.840+0000 7fb035600640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 0x7fb01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:13.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.840+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fb02c08a1c0 con 0x7fb038073890 2024-09-10T08:38:13.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.841+0000 7fb03ca00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 0x7fb01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:13.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.841+0000 7fb03ca00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 0x7fb01806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb024034000 tx=0x7fb02402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:13.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:13.844+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb03813ffb0 con 0x7fb038073890 2024-09-10T08:38:14.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.029+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0380cd9b0 con 0x7fb038073890 2024-09-10T08:38:14.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.030+0000 7fb035600640 1 -- 172.21.15.52:0/3258256989 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16699 (secure 0 0 0) 0x7fb02c058480 con 0x7fb038073890 2024-09-10T08:38:14.031 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:14.031 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:37:34.250934+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:37:30.466692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-10T08:37:31.666587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 msgr2=0x7fb01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 0x7fb01806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb024034000 tx=0x7fb02402e000 comp rx=0 tx=0).stop 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 msgr2=0x7fb0380c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00c400 tx=0x7fb02c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 shutdown_connections 2024-09-10T08:38:14.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb01806be30 0x7fb01806e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb038145ed0 0x7fb0380cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0380b5880 0x7fb038158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 --2- 172.21.15.52:0/3258256989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb038073890 0x7fb0380c81c0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 >> 172.21.15.52:0/3258256989 conn(0x7fb0380ccec0 msgr2=0x7fb0380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.032+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 shutdown_connections 2024-09-10T08:38:14.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.033+0000 7fb03fe00640 1 -- 172.21.15.52:0/3258256989 wait complete. 2024-09-10T08:38:14.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:38:14.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.206+0000 7fae35800640 1 Processor -- start 2024-09-10T08:38:14.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.206+0000 7fae35800640 1 -- start start 2024-09-10T08:38:14.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae35800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 0x7fae300d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae35800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae300cf450 0x7fae300b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae35800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae300d3990 con 0x7fae3015e440 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae35800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fae300d3c70 con 0x7fae300cf450 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae35800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fae300d3f50 con 0x7fae300b6710 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae34e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae300cf450 0x7fae300b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae2fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fae3015e440 0x7fae300b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53080/0 (socket says 172.21.15.52:53080) 2024-09-10T08:38:14.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.207+0000 7fae2fe00640 1 -- 172.21.15.52:0/611466709 learned_addr learned my addr 172.21.15.52:0/611466709 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae27e00640 1 --2- 172.21.15.52:0/611466709 >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 0x7fae300d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae34e00640 1 -- 172.21.15.52:0/611466709 >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 msgr2=0x7fae300d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae34e00640 1 --2- 172.21.15.52:0/611466709 >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 0x7fae300d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae34e00640 1 -- 172.21.15.52:0/611466709 >> v1:172.21.15.52:6789/0 conn(0x7fae3015e440 legacy=0x7fae300b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae34e00640 1 -- 172.21.15.52:0/611466709 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae300d4230 con 0x7fae300cf450 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae27e00640 1 --2- 172.21.15.52:0/611466709 >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 0x7fae300d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:14.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.208+0000 7fae2f400640 1 -- 172.21.15.52:0/611466709 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414087473 0 0) 0x7fae300d3990 con 0x7fae3015e440 2024-09-10T08:38:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.209+0000 7fae34e00640 1 --2- 172.21.15.52:0/611466709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300b7b60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fae300d2480 tx=0x7fae2802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7779d11be08186 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.209+0000 7fae2f400640 1 -- 172.21.15.52:0/611466709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28007740 con 0x7fae300cf450 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.209+0000 7fae2f400640 1 -- 172.21.15.52:0/611466709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae280078e0 con 0x7fae300cf450 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.209+0000 7fae2f400640 1 -- 172.21.15.52:0/611466709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28007cb0 con 0x7fae300cf450 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 -- 172.21.15.52:0/611466709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 msgr2=0x7fae300b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 --2- 172.21.15.52:0/611466709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300b7b60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fae300d2480 tx=0x7fae2802a710 comp rx=0 tx=0).stop 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 -- 172.21.15.52:0/611466709 shutdown_connections 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 --2- 172.21.15.52:0/611466709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300b7b60 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 --2- 172.21.15.52:0/611466709 >> v2:172.21.15.176:3300/0 conn(0x7fae300b6710 0x7fae300d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 -- 172.21.15.52:0/611466709 >> 172.21.15.52:0/611466709 conn(0x7fae30067f80 msgr2=0x7fae300d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 -- 172.21.15.52:0/611466709 shutdown_connections 2024-09-10T08:38:14.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.210+0000 7fae35800640 1 -- 172.21.15.52:0/611466709 wait complete. 2024-09-10T08:38:14.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.211+0000 7fae35800640 1 Processor -- start 2024-09-10T08:38:14.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.211+0000 7fae35800640 1 -- start start 2024-09-10T08:38:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae300b6710 0x7fae30159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 0x7fae301f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fae300b76c0 con 0x7fae300cf450 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae300b7540 con 0x7fae300b6710 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.212+0000 7fae35800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae300b80a0 con 0x7fae3015e440 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53068/0 (socket says 172.21.15.52:53068) 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 -- 172.21.15.52:0/234995712 learned_addr learned my addr 172.21.15.52:0/234995712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae2fe00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae300b6710 0x7fae30159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae34e00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 0x7fae301f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 -- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 msgr2=0x7fae301f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 0x7fae301f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 -- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae300b6710 msgr2=0x7fae30159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae300b6710 0x7fae30159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 -- 172.21.15.52:0/234995712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae301f4d50 con 0x7fae300cf450 2024-09-10T08:38:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae34e00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 0x7fae301f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.213+0000 7fae27e00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fae1800e760 tx=0x7fae1800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.214+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1800f040 con 0x7fae300cf450 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.214+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae18004230 con 0x7fae300cf450 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.214+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1800ee70 con 0x7fae300cf450 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.214+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae301f5030 con 0x7fae300cf450 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.214+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae300ccd00 con 0x7fae300cf450 2024-09-10T08:38:14.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.215+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae301f5200 con 0x7fae300cf450 2024-09-10T08:38:14.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.216+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae1800c6d0 con 0x7fae300cf450 2024-09-10T08:38:14.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.217+0000 7fae2cc00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 0x7fae0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.217+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7fae1808ab80 con 0x7fae300cf450 2024-09-10T08:38:14.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.217+0000 7fae2fe00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 0x7fae0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.218+0000 7fae2fe00640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 0x7fae0c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fae20007fd0 tx=0x7fae20007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.221+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae18017020 con 0x7fae300cf450 2024-09-10T08:38:14.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.440+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fae300b7b60 con 0x7fae300cf450 2024-09-10T08:38:14.441 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:38:14.441+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:38:14.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.443+0000 7fae2cc00640 1 -- 172.21.15.52:0/234995712 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v103) ==== 161+0+0 (secure 0 0 0) 0x7fae18058e40 con 0x7fae300cf450 2024-09-10T08:38:14.443 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 msgr2=0x7fae0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 0x7fae0c06e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fae20007fd0 tx=0x7fae20007de0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 msgr2=0x7fae300cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fae1800e760 tx=0x7fae1800ec20 comp rx=0 tx=0).stop 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 shutdown_connections 2024-09-10T08:38:14.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fae0c06be30 0x7fae0c06e2f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae3015e440 0x7fae301f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae300cf450 0x7fae300cd220 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 --2- 172.21.15.52:0/234995712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae300b6710 0x7fae30159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 >> 172.21.15.52:0/234995712 conn(0x7fae30067f80 msgr2=0x7fae300b9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 shutdown_connections 2024-09-10T08:38:14.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.446+0000 7fae35800640 1 -- 172.21.15.52:0/234995712 wait complete. 2024-09-10T08:38:14.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:38:14.515 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:38:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.623+0000 7fabac800640 1 Processor -- start 2024-09-10T08:38:14.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.623+0000 7fabac800640 1 -- start start 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabac800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faba40732e0 0x7faba40736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabac800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba40cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabac800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40714b0 con 0x7faba4071c70 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabac800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faba4073c00 con 0x7faba40732e0 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabac800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faba40cd880 con 0x7faba40cce30 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7faba9e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faba40732e0 0x7faba40736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabaa800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faba4071c70 0x7faba415c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53098/0 (socket says 172.21.15.52:53098) 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7fabaa800640 1 -- 172.21.15.52:0/195511762 learned_addr learned my addr 172.21.15.52:0/195511762 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.624+0000 7faba9400640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba40cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.625+0000 7faba9e00640 1 -- 172.21.15.52:0/195511762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 msgr2=0x7faba40cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.625+0000 7faba9e00640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba40cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.625+0000 7faba9e00640 1 -- 172.21.15.52:0/195511762 >> v1:172.21.15.52:6789/0 conn(0x7faba4071c70 legacy=0x7faba415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.625+0000 7faba9e00640 1 -- 172.21.15.52:0/195511762 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40cdb60 con 0x7faba40732e0 2024-09-10T08:38:14.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7faba9e00640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba40736c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fab980097a0 tx=0x7fab9802a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8205cffe8f22bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7faba8a00640 1 -- 172.21.15.52:0/195511762 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98037070 con 0x7faba40732e0 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7faba8a00640 1 -- 172.21.15.52:0/195511762 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9802ae40 con 0x7faba40732e0 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7faba8a00640 1 -- 172.21.15.52:0/195511762 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98032660 con 0x7faba40732e0 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7fabac800640 1 -- 172.21.15.52:0/195511762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 msgr2=0x7faba40736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.626+0000 7fabac800640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba40736c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fab980097a0 tx=0x7fab9802a0f0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 -- 172.21.15.52:0/195511762 shutdown_connections 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba40cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 --2- 172.21.15.52:0/195511762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba40736c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 -- 172.21.15.52:0/195511762 >> 172.21.15.52:0/195511762 conn(0x7faba406d0f0 msgr2=0x7faba406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:14.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 -- 172.21.15.52:0/195511762 shutdown_connections 2024-09-10T08:38:14.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.627+0000 7fabac800640 1 -- 172.21.15.52:0/195511762 wait complete. 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.628+0000 7fabac800640 1 Processor -- start 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.628+0000 7fabac800640 1 -- start start 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba4071c70 0x7faba41448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba41f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faba406bf70 con 0x7faba40732e0 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faba406bdf0 con 0x7faba4071c70 2024-09-10T08:38:14.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.629+0000 7fabac800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faba4072120 con 0x7faba40cce30 2024-09-10T08:38:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53098/0 (socket says 172.21.15.52:53098) 2024-09-10T08:38:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 -- 172.21.15.52:0/2498217837 learned_addr learned my addr 172.21.15.52:0/2498217837 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7fabaa800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba41f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9e00640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba4071c70 0x7faba41448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 -- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 msgr2=0x7faba41f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba41f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 -- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba4071c70 msgr2=0x7faba41448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:14.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba4071c70 0x7faba41448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 -- 172.21.15.52:0/2498217837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba414b860 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.630+0000 7faba9400640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e840 tx=0x7fab9400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.631+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94017070 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.631+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9400c940 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.631+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9400cd10 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.631+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba4159f50 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.631+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba415a510 con 0x7faba40732e0 2024-09-10T08:38:14.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.632+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba40724b0 con 0x7faba40732e0 2024-09-10T08:38:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.633+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab9401a070 con 0x7faba40732e0 2024-09-10T08:38:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.633+0000 7fab9e000640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 0x7fab8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.634+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5795+0+0 (secure 0 0 0) 0x7fab9408aca0 con 0x7faba40732e0 2024-09-10T08:38:14.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.634+0000 7faba9e00640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 0x7fab8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:14.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.635+0000 7faba9e00640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 0x7fab8806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fab98034000 tx=0x7fab9802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:14.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.638+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab94058f90 con 0x7faba40732e0 2024-09-10T08:38:14.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:14.859+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7faba40711f0 con 0x7faba40732e0 2024-09-10T08:38:15.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.445+0000 7fab9e000640 1 -- 172.21.15.52:0/2498217837 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v104) ==== 104+0+0 (secure 0 0 0) 0x7fab9405d290 con 0x7faba40732e0 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 msgr2=0x7fab8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 0x7fab8806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fab98034000 tx=0x7fab9802e000 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 msgr2=0x7faba4144df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fab9400e840 tx=0x7fab9400ed00 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 shutdown_connections 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fab8806be30 0x7fab8806e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faba40cce30 0x7faba41f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faba40732e0 0x7faba4144df0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 --2- 172.21.15.52:0/2498217837 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba4071c70 0x7faba41448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 >> 172.21.15.52:0/2498217837 conn(0x7faba406d0f0 msgr2=0x7faba415eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 shutdown_connections 2024-09-10T08:38:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.449+0000 7fabac800640 1 -- 172.21.15.52:0/2498217837 wait complete. 2024-09-10T08:38:15.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:38:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.635+0000 7f8daae00640 1 Processor -- start 2024-09-10T08:38:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.635+0000 7f8daae00640 1 -- start start 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8daae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8da4155b20 0x7f8da40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8daae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8daae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da40b0680 con 0x7f8da40cf960 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8daae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8da40b2600 con 0x7f8da4155b20 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8daae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8da40b01e0 con 0x7f8da40b21a0 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.636+0000 7f8da3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8da4155b20 0x7f8da40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8da4155b20 0x7f8da40b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53100/0 (socket says 172.21.15.52:53100) 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 -- 172.21.15.52:0/878041360 learned_addr learned my addr 172.21.15.52:0/878041360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3400640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 -- 172.21.15.52:0/878041360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 msgr2=0x7f8da40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da40cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 -- 172.21.15.52:0/878041360 >> v1:172.21.15.176:6789/0 conn(0x7f8da40cf960 legacy=0x7f8da415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.637+0000 7f8da3e00640 1 -- 172.21.15.52:0/878041360 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da40ccf70 con 0x7f8da4155b20 2024-09-10T08:38:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.638+0000 7f8da3e00640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da4155b20 0x7f8da40b1c60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098a0 tx=0x7f8d9402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1cbeb91feb816b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.638+0000 7f8da2a00640 1 -- 172.21.15.52:0/878041360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94037070 con 0x7f8da4155b20 2024-09-10T08:38:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.638+0000 7f8da2a00640 1 -- 172.21.15.52:0/878041360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d94032440 con 0x7f8da4155b20 2024-09-10T08:38:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.638+0000 7f8da2a00640 1 -- 172.21.15.52:0/878041360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94032810 con 0x7f8da4155b20 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 -- 172.21.15.52:0/878041360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da4155b20 msgr2=0x7f8da40b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da4155b20 0x7f8da40b1c60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098a0 tx=0x7f8d9402a290 comp rx=0 tx=0).stop 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 -- 172.21.15.52:0/878041360 shutdown_connections 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da40cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 --2- 172.21.15.52:0/878041360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da4155b20 0x7f8da40b1c60 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 -- 172.21.15.52:0/878041360 >> 172.21.15.52:0/878041360 conn(0x7f8da406c240 msgr2=0x7f8da406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 -- 172.21.15.52:0/878041360 shutdown_connections 2024-09-10T08:38:15.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.639+0000 7f8daae00640 1 -- 172.21.15.52:0/878041360 wait complete. 2024-09-10T08:38:15.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.640+0000 7f8daae00640 1 Processor -- start 2024-09-10T08:38:15.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 -- start start 2024-09-10T08:38:15.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 0x7f8da41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8da40cef00 con 0x7f8da40cf960 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8da40cec20 con 0x7f8da4155b20 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.641+0000 7f8daae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8da40cfdb0 con 0x7f8da40b21a0 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53112/0 (socket says 172.21.15.52:53112) 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 -- 172.21.15.52:0/1933800379 learned_addr learned my addr 172.21.15.52:0/1933800379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3e00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da8e00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 0x7f8da41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 -- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 msgr2=0x7f8da415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 -- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 msgr2=0x7f8da41539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 0x7f8da41539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 -- 172.21.15.52:0/1933800379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da4156370 con 0x7f8da40cf960 2024-09-10T08:38:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da8e00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 0x7f8da41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:15.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.642+0000 7f8da3400640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e8a0 tx=0x7f8d9000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.643+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90017070 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.643+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9000c940 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.643+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000cd30 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.643+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da4156650 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.643+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da4156c10 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.644+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da40ce610 con 0x7f8da40cf960 2024-09-10T08:38:15.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.645+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d9001a070 con 0x7f8da40cf960 2024-09-10T08:38:15.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.645+0000 7f8d9be00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 0x7f8d8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:15.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.646+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5795+0+0 (secure 0 0 0) 0x7f8d9008b100 con 0x7f8da40cf960 2024-09-10T08:38:15.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.646+0000 7f8da3e00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 0x7f8d8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:15.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.647+0000 7f8da3e00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 0x7f8d8406e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8d94034000 tx=0x7f8d9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:15.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.650+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d90059360 con 0x7f8da40cf960 2024-09-10T08:38:15.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:15.834+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8da4151eb0 con 0x7f8da40cf960 2024-09-10T08:38:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.730+0000 7f8d9be00640 1 -- 172.21.15.52:0/1933800379 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) ==== 181+0+0 (secure 0 0 0) 0x7f8d9005d660 con 0x7f8da40cf960 2024-09-10T08:38:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:38:16.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 msgr2=0x7f8d8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 0x7f8d8406e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8d94034000 tx=0x7f8d9402e000 comp rx=0 tx=0).stop 2024-09-10T08:38:16.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 msgr2=0x7f8da414e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000e8a0 tx=0x7f8d9000ed60 comp rx=0 tx=0).stop 2024-09-10T08:38:16.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 shutdown_connections 2024-09-10T08:38:16.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8d8406be30 0x7f8d8406e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8da4155b20 0x7f8da41539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8da40cf960 0x7f8da414e280 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 --2- 172.21.15.52:0/1933800379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8da40b21a0 0x7f8da415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.735+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 >> 172.21.15.52:0/1933800379 conn(0x7f8da406c240 msgr2=0x7f8da41e4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.736+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 shutdown_connections 2024-09-10T08:38:16.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.736+0000 7f8daae00640 1 -- 172.21.15.52:0/1933800379 wait complete. 2024-09-10T08:38:16.760 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:38:16.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.922+0000 7f72e0a00640 1 Processor -- start 2024-09-10T08:38:16.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.922+0000 7f72e0a00640 1 -- start start 2024-09-10T08:38:16.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72e0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72dc06f2f0 0x7f72dc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72e0a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f72dc073f40 0x7f72dc0735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72e0a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc0d0d10 con 0x7f72dc15e870 2024-09-10T08:38:16.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72e0a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0718b0 con 0x7f72dc06f2f0 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72e0a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc0d0fd0 con 0x7f72dc073f40 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72daa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f72dc15e870 0x7f72dc06f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53114/0 (socket says 172.21.15.52:53114) 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72daa00640 1 -- 172.21.15.52:0/1349375320 learned_addr learned my addr 172.21.15.52:0/1349375320 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.923+0000 7f72db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72dc06f2f0 0x7f72dc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.924+0000 7f72dbe00640 1 --2- 172.21.15.52:0/1349375320 >> v2:172.21.15.176:3300/0 conn(0x7f72dc073f40 0x7f72dc0735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.924+0000 7f72db400640 1 -- 172.21.15.52:0/1349375320 >> v2:172.21.15.176:3300/0 conn(0x7f72dc073f40 msgr2=0x7f72dc0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.924+0000 7f72db400640 1 --2- 172.21.15.52:0/1349375320 >> v2:172.21.15.176:3300/0 conn(0x7f72dc073f40 0x7f72dc0735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.924+0000 7f72db400640 1 -- 172.21.15.52:0/1349375320 >> v1:172.21.15.52:6789/0 conn(0x7f72dc15e870 legacy=0x7f72dc06f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.924+0000 7f72db400640 1 -- 172.21.15.52:0/1349375320 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc0d12b0 con 0x7f72dc06f2f0 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.925+0000 7f72db400640 1 --2- 172.21.15.52:0/1349375320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc06f2f0 0x7f72dc0b1a00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b4140 tx=0x7f72cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61ea83ab4f547ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.925+0000 7f72da000640 1 -- 172.21.15.52:0/1349375320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc037070 con 0x7f72dc06f2f0 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.925+0000 7f72da000640 1 -- 172.21.15.52:0/1349375320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc032440 con 0x7f72dc06f2f0 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.925+0000 7f72da000640 1 -- 172.21.15.52:0/1349375320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc032810 con 0x7f72dc06f2f0 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 -- 172.21.15.52:0/1349375320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc06f2f0 msgr2=0x7f72dc0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 --2- 172.21.15.52:0/1349375320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc06f2f0 0x7f72dc0b1a00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0b4140 tx=0x7f72cc02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 -- 172.21.15.52:0/1349375320 shutdown_connections 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 --2- 172.21.15.52:0/1349375320 >> v2:172.21.15.176:3300/0 conn(0x7f72dc073f40 0x7f72dc0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 --2- 172.21.15.52:0/1349375320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc06f2f0 0x7f72dc0b1a00 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 -- 172.21.15.52:0/1349375320 >> 172.21.15.52:0/1349375320 conn(0x7f72dc0b41b0 msgr2=0x7f72dc0b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 -- 172.21.15.52:0/1349375320 shutdown_connections 2024-09-10T08:38:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.926+0000 7f72e0a00640 1 -- 172.21.15.52:0/1349375320 wait complete. 2024-09-10T08:38:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.927+0000 7f72e0a00640 1 Processor -- start 2024-09-10T08:38:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.928+0000 7f72e0a00640 1 -- start start 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.928+0000 7f72e0a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 0x7f72dc157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72e0a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc073f40 0x7f72dc153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72e0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72e0a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc06d3b0 con 0x7f72dc0b5de0 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72e0a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc06d230 con 0x7f72dc06f2f0 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72e0a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc06d530 con 0x7f72dc073f40 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72db400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 0x7f72dc157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53122/0 (socket says 172.21.15.52:53122) 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72daa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc073f40 0x7f72dc153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 -- 172.21.15.52:0/4121913228 learned_addr learned my addr 172.21.15.52:0/4121913228 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72db400640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 0x7f72dc157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:51424/0 (socket says 172.21.15.52:51424) 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 -- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc073f40 msgr2=0x7f72dc153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc073f40 0x7f72dc153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 -- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 msgr2=0x7f72dc157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 0x7f72dc157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.929+0000 7f72dbe00640 1 -- 172.21.15.52:0/4121913228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc15d680 con 0x7f72dc0b5de0 2024-09-10T08:38:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72dbe00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007e30 tx=0x7f72d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4014620 con 0x7f72dc0b5de0 2024-09-10T08:38:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d4019070 con 0x7f72dc0b5de0 2024-09-10T08:38:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4014a00 con 0x7f72dc0b5de0 2024-09-10T08:38:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc15d960 con 0x7f72dc0b5de0 2024-09-10T08:38:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.930+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc15df20 con 0x7f72dc0b5de0 2024-09-10T08:38:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.931+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0b1a00 con 0x7f72dc0b5de0 2024-09-10T08:38:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.932+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72d4014ba0 con 0x7f72dc0b5de0 2024-09-10T08:38:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.933+0000 7f72d3400640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 0x7f72bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.933+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5357+0+0 (secure 0 0 0) 0x7f72d408b540 con 0x7f72dc0b5de0 2024-09-10T08:38:16.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.934+0000 7f72db400640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 0x7f72bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:16.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.935+0000 7f72db400640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 0x7f72bc06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f72cc034000 tx=0x7f72cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:16.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:16.938+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72d4059960 con 0x7f72dc0b5de0 2024-09-10T08:38:17.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.125+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72dc0b6ef0 con 0x7f72dc0b5de0 2024-09-10T08:38:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.736+0000 7f72d3400640 1 -- 172.21.15.52:0/4121913228 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) ==== 169+0+0 (secure 0 0 0) 0x7f72d405dc60 con 0x7f72dc0b5de0 2024-09-10T08:38:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:38:17.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 msgr2=0x7f72bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 0x7f72bc06e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f72cc034000 tx=0x7f72cc02e000 comp rx=0 tx=0).stop 2024-09-10T08:38:17.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 msgr2=0x7f72dc0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007e30 tx=0x7f72d400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 shutdown_connections 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f72bc06be30 0x7f72bc06e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72dc0b5de0 0x7f72dc0b6290 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72dc073f40 0x7f72dc153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 --2- 172.21.15.52:0/4121913228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72dc06f2f0 0x7f72dc157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.740+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 >> 172.21.15.52:0/4121913228 conn(0x7f72dc0b41b0 msgr2=0x7f72dc1620b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.741+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 shutdown_connections 2024-09-10T08:38:17.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.741+0000 7f72e0a00640 1 -- 172.21.15.52:0/4121913228 wait complete. 2024-09-10T08:38:17.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:38:17.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.928+0000 7f613ec00640 1 Processor -- start 2024-09-10T08:38:17.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.928+0000 7f613ec00640 1 -- start start 2024-09-10T08:38:17.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ec00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61380b8b50 0x7f61380d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ec00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61380d42b0 con 0x7f61380d4c60 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ec00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61380d3730 con 0x7f613815e7d0 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ec00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f61380d3a10 con 0x7f61380b8b50 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ce00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f61380d4c60 0x7f61380d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53128/0 (socket says 172.21.15.52:53128) 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613e200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61380b8b50 0x7f61380d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.929+0000 7f613ce00640 1 -- 172.21.15.52:0/666130420 learned_addr learned my addr 172.21.15.52:0/666130420 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.930+0000 7f613e200640 1 -- 172.21.15.52:0/666130420 >> v1:172.21.15.176:6789/0 conn(0x7f613815e7d0 legacy=0x7f61380d4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.930+0000 7f613e200640 1 -- 172.21.15.52:0/666130420 >> v1:172.21.15.52:6789/0 conn(0x7f61380d4c60 legacy=0x7f61380d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.930+0000 7f6137e00640 1 -- 172.21.15.52:0/666130420 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557256099 0 0) 0x7f61380d42b0 con 0x7f61380d4c60 2024-09-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.930+0000 7f613e200640 1 -- 172.21.15.52:0/666130420 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61380d3cf0 con 0x7f61380b8b50 2024-09-10T08:38:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.931+0000 7f613e200640 1 --2- 172.21.15.52:0/666130420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61380b8b50 0x7f61380d3110 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6130009d90 tx=0x7f613002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c7423bb07ee0be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:17.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.931+0000 7f6137e00640 1 -- 172.21.15.52:0/666130420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037070 con 0x7f61380b8b50 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.931+0000 7f6137e00640 1 -- 172.21.15.52:0/666130420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130007740 con 0x7f61380b8b50 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.931+0000 7f6137e00640 1 -- 172.21.15.52:0/666130420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130007b10 con 0x7f61380b8b50 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.931+0000 7f613ec00640 1 -- 172.21.15.52:0/666130420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61380b8b50 msgr2=0x7f61380d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 --2- 172.21.15.52:0/666130420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61380b8b50 0x7f61380d3110 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6130009d90 tx=0x7f613002a780 comp rx=0 tx=0).stop 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 -- 172.21.15.52:0/666130420 shutdown_connections 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 --2- 172.21.15.52:0/666130420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61380b8b50 0x7f61380d3110 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 -- 172.21.15.52:0/666130420 >> 172.21.15.52:0/666130420 conn(0x7f6138067d40 msgr2=0x7f6138068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 -- 172.21.15.52:0/666130420 shutdown_connections 2024-09-10T08:38:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.932+0000 7f613ec00640 1 -- 172.21.15.52:0/666130420 wait complete. 2024-09-10T08:38:17.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.933+0000 7f613ec00640 1 Processor -- start 2024-09-10T08:38:17.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.933+0000 7f613ec00640 1 -- start start 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61380b8b50 0x7f6138155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61380d4c60 0x7f61380c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6138169350 con 0x7f613815e7d0 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61381691d0 con 0x7f61380b8b50 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.934+0000 7f613ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61381694d0 con 0x7f61380d4c60 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53140/0 (socket says 172.21.15.52:53140) 2024-09-10T08:38:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 -- 172.21.15.52:0/945330202 learned_addr learned my addr 172.21.15.52:0/945330202 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613d800640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61380b8b50 0x7f6138155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613ce00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61380d4c60 0x7f61380c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 -- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61380d4c60 msgr2=0x7f61380c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61380d4c60 0x7f61380c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 -- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61380b8b50 msgr2=0x7f6138155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61380b8b50 0x7f6138155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 -- 172.21.15.52:0/945330202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61381562a0 con 0x7f613815e7d0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.935+0000 7f613e200640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6130035040 tx=0x7f6130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.936+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130042070 con 0x7f613815e7d0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.936+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130003bb0 con 0x7f613815e7d0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.936+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037040 con 0x7f613815e7d0 2024-09-10T08:38:17.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.936+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61380caa20 con 0x7f613815e7d0 2024-09-10T08:38:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.936+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61380cafe0 con 0x7f613815e7d0 2024-09-10T08:38:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.937+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61380b4e00 con 0x7f613815e7d0 2024-09-10T08:38:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.938+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6130007600 con 0x7f613815e7d0 2024-09-10T08:38:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.939+0000 7f6135600640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.939+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f61300abac0 con 0x7f613815e7d0 2024-09-10T08:38:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.939+0000 7f613d800640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.940+0000 7f613d800640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 0x7f611806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f612c000f60 tx=0x7f612c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:17.943+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f613004c020 con 0x7f613815e7d0 2024-09-10T08:38:18.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.159+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f613815a780 con 0x7f613815e7d0 2024-09-10T08:38:18.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.163+0000 7f6135600640 1 -- 172.21.15.52:0/945330202 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f613007a110 con 0x7f613815e7d0 2024-09-10T08:38:18.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 msgr2=0x7f611806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 0x7f611806e2f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f612c000f60 tx=0x7f612c009040 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 msgr2=0x7f61380ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6130035040 tx=0x7f6130004a40 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 shutdown_connections 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611806be30 0x7f611806e2f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613815e7d0 0x7f61380ca2c0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61380d4c60 0x7f61380c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 --2- 172.21.15.52:0/945330202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61380b8b50 0x7f6138155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 >> 172.21.15.52:0/945330202 conn(0x7f6138067d40 msgr2=0x7f6138159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 shutdown_connections 2024-09-10T08:38:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.165+0000 7f613ec00640 1 -- 172.21.15.52:0/945330202 wait complete. 2024-09-10T08:38:18.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-10T08:38:18.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.336+0000 7fca3b600640 1 Processor -- start 2024-09-10T08:38:18.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.337+0000 7fca3b600640 1 -- start start 2024-09-10T08:38:18.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca3b600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fca34148260 0x7fca3406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca3b600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fca34071680 0x7fca3406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca3b600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca34071b30 con 0x7fca34147e80 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca3b600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fca34074200 con 0x7fca34071680 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca3b600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fca340b3e40 con 0x7fca34148260 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca38c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fca34147e80 0x7fca34070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53142/0 (socket says 172.21.15.52:53142) 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca38c00640 1 -- 172.21.15.52:0/1802114356 learned_addr learned my addr 172.21.15.52:0/1802114356 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca39600640 1 --2- 172.21.15.52:0/1802114356 >> v2:172.21.15.52:3300/0 conn(0x7fca34071680 0x7fca3406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.338+0000 7fca33e00640 1 --2- 172.21.15.52:0/1802114356 >> v2:172.21.15.176:3300/0 conn(0x7fca34148260 0x7fca3406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.339+0000 7fca39600640 1 -- 172.21.15.52:0/1802114356 >> v2:172.21.15.176:3300/0 conn(0x7fca34148260 msgr2=0x7fca3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.339+0000 7fca39600640 1 --2- 172.21.15.52:0/1802114356 >> v2:172.21.15.176:3300/0 conn(0x7fca34148260 0x7fca3406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.339+0000 7fca39600640 1 -- 172.21.15.52:0/1802114356 >> v1:172.21.15.52:6789/0 conn(0x7fca34147e80 legacy=0x7fca34070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.339+0000 7fca39600640 1 -- 172.21.15.52:0/1802114356 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340b3510 con 0x7fca34071680 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.339+0000 7fca33400640 1 -- 172.21.15.52:0/1802114356 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519547794 0 0) 0x7fca34071b30 con 0x7fca34147e80 2024-09-10T08:38:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca39600640 1 --2- 172.21.15.52:0/1802114356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca3406c150 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fca340cce90 tx=0x7fca2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f72b12d47d1e190 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca33400640 1 -- 172.21.15.52:0/1802114356 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c007740 con 0x7fca34071680 2024-09-10T08:38:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca33400640 1 -- 172.21.15.52:0/1802114356 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c0078e0 con 0x7fca34071680 2024-09-10T08:38:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca33400640 1 -- 172.21.15.52:0/1802114356 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c007cb0 con 0x7fca34071680 2024-09-10T08:38:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca3b600640 1 -- 172.21.15.52:0/1802114356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 msgr2=0x7fca3406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.340+0000 7fca3b600640 1 --2- 172.21.15.52:0/1802114356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca3406c150 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fca340cce90 tx=0x7fca2c02a680 comp rx=0 tx=0).stop 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 -- 172.21.15.52:0/1802114356 shutdown_connections 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 --2- 172.21.15.52:0/1802114356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca3406c150 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 --2- 172.21.15.52:0/1802114356 >> v2:172.21.15.176:3300/0 conn(0x7fca34148260 0x7fca3406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 -- 172.21.15.52:0/1802114356 >> 172.21.15.52:0/1802114356 conn(0x7fca340ccec0 msgr2=0x7fca340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 -- 172.21.15.52:0/1802114356 shutdown_connections 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.341+0000 7fca3b600640 1 -- 172.21.15.52:0/1802114356 wait complete. 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.342+0000 7fca3b600640 1 Processor -- start 2024-09-10T08:38:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.342+0000 7fca3b600640 1 -- start start 2024-09-10T08:38:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 0x7fca341e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca34148260 0x7fca3415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b42d0 con 0x7fca34071680 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b3ad0 con 0x7fca34147e80 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.343+0000 7fca3b600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fca340b4450 con 0x7fca34148260 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53162/0 (socket says 172.21.15.52:53162) 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 -- 172.21.15.52:0/2285014682 learned_addr learned my addr 172.21.15.52:0/2285014682 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca33e00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 0x7fca341e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca39600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca34148260 0x7fca3415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 -- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca34148260 msgr2=0x7fca3415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca34148260 0x7fca3415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 -- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 msgr2=0x7fca341e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 0x7fca341e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 -- 172.21.15.52:0/2285014682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca341e7b90 con 0x7fca34071680 2024-09-10T08:38:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca33e00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 0x7fca341e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.344+0000 7fca38c00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c4d0 tx=0x7fca2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.345+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28018070 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.345+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28007500 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.345+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca341e7e70 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.345+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28004a20 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.345+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca341e8430 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.346+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca340ce5a0 con 0x7fca34071680 2024-09-10T08:38:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.347+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca2801b070 con 0x7fca34071680 2024-09-10T08:38:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.348+0000 7fca30c00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.348+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7fca28089ff0 con 0x7fca34071680 2024-09-10T08:38:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.348+0000 7fca33e00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.349+0000 7fca33e00640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 0x7fca1406e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fca341449f0 tx=0x7fca20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.352+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca28058b90 con 0x7fca34071680 2024-09-10T08:38:18.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.604+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fca3415eac0 con 0x7fca34071680 2024-09-10T08:38:18.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.738+0000 7fca30c00640 1 -- 172.21.15.52:0/2285014682 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v455) ==== 155+0+0 (secure 0 0 0) 0x7fca28058490 con 0x7fca34071680 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 msgr2=0x7fca1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 0x7fca1406e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fca341449f0 tx=0x7fca20008040 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 msgr2=0x7fca341e8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c4d0 tx=0x7fca2800c990 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 shutdown_connections 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fca1406be30 0x7fca1406e2f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca34148260 0x7fca3415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca34147e80 0x7fca341e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 --2- 172.21.15.52:0/2285014682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca34071680 0x7fca341e8c30 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 >> 172.21.15.52:0/2285014682 conn(0x7fca340ccec0 msgr2=0x7fca340730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:18.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 shutdown_connections 2024-09-10T08:38:18.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.740+0000 7fca3b600640 1 -- 172.21.15.52:0/2285014682 wait complete. 2024-09-10T08:38:18.757 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T08:38:18.758 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T08:38:18.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:18.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.913+0000 7f9044600640 1 Processor -- start 2024-09-10T08:38:18.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.913+0000 7f9044600640 1 -- start start 2024-09-10T08:38:18.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.914+0000 7f9044600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c0b2d40 0x7f903c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9044600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f903c13eb20 0x7f903c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9044600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c071180 con 0x7f903c15bcf0 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9044600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f903c071ab0 con 0x7f903c13eb20 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9044600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f903c071460 con 0x7f903c0b2d40 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9041200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f903c13eb20 0x7f903c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9042600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f903c15bcf0 0x7f903c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53158/0 (socket says 172.21.15.52:53158) 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9042600640 1 -- 172.21.15.52:0/1814810380 learned_addr learned my addr 172.21.15.52:0/1814810380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9041c00640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c0b2d40 0x7f903c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9041200640 1 -- 172.21.15.52:0/1814810380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c0b2d40 msgr2=0x7f903c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9041200640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c0b2d40 0x7f903c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f9041200640 1 -- 172.21.15.52:0/1814810380 >> v1:172.21.15.52:6789/0 conn(0x7f903c15bcf0 legacy=0x7f903c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.916+0000 7f9041200640 1 -- 172.21.15.52:0/1814810380 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c071740 con 0x7f903c13eb20 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.915+0000 7f903be00640 1 -- 172.21.15.52:0/1814810380 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208047198 0 0) 0x7f903c071180 con 0x7f903c15bcf0 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9041200640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c06c150 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f903c071c30 tx=0x7f902802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad76f80807b0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f903be00640 1 -- 172.21.15.52:0/1814810380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028037070 con 0x7f903c13eb20 2024-09-10T08:38:18.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f903be00640 1 -- 172.21.15.52:0/1814810380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028032440 con 0x7f903c13eb20 2024-09-10T08:38:18.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f903be00640 1 -- 172.21.15.52:0/1814810380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028032810 con 0x7f903c13eb20 2024-09-10T08:38:18.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 -- 172.21.15.52:0/1814810380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 msgr2=0x7f903c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c06c150 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f903c071c30 tx=0x7f902802a180 comp rx=0 tx=0).stop 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 -- 172.21.15.52:0/1814810380 shutdown_connections 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c06c150 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 --2- 172.21.15.52:0/1814810380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c0b2d40 0x7f903c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.917+0000 7f9044600640 1 -- 172.21.15.52:0/1814810380 >> 172.21.15.52:0/1814810380 conn(0x7f903c0ccec0 msgr2=0x7f903c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.918+0000 7f9044600640 1 -- 172.21.15.52:0/1814810380 shutdown_connections 2024-09-10T08:38:18.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.918+0000 7f9044600640 1 -- 172.21.15.52:0/1814810380 wait complete. 2024-09-10T08:38:18.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.919+0000 7f9044600640 1 Processor -- start 2024-09-10T08:38:18.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.919+0000 7f9044600640 1 -- start start 2024-09-10T08:38:18.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 0x7f903c1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 0x7f903c1396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0722d0 con 0x7f903c13eb20 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f903c072150 con 0x7f903c0b2d40 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9044600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f903c072450 con 0x7f903c15bcf0 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9041200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9041200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53178/0 (socket says 172.21.15.52:53178) 2024-09-10T08:38:18.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.920+0000 7f9041200640 1 -- 172.21.15.52:0/2415412462 learned_addr learned my addr 172.21.15.52:0/2415412462 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:18.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041c00640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 0x7f903c1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9042600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 0x7f903c1396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 -- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 msgr2=0x7f903c1396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 0x7f903c1396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 -- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 msgr2=0x7f903c1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 0x7f903c1541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 -- 172.21.15.52:0/2415412462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c157c20 con 0x7f903c13eb20 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041c00640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 0x7f903c1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9042600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 0x7f903c1396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9041200640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f9028000c00 tx=0x7f90280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028037040 con 0x7f903c13eb20 2024-09-10T08:38:18.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9028042070 con 0x7f903c13eb20 2024-09-10T08:38:18.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028030960 con 0x7f903c13eb20 2024-09-10T08:38:18.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.921+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c157ea0 con 0x7f903c13eb20 2024-09-10T08:38:18.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.922+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c15f6a0 con 0x7f903c13eb20 2024-09-10T08:38:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.923+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c0728e0 con 0x7f903c13eb20 2024-09-10T08:38:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.924+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9028030b00 con 0x7f903c13eb20 2024-09-10T08:38:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.924+0000 7f9039600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 0x7f901c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.924+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f90280ab500 con 0x7f903c13eb20 2024-09-10T08:38:18.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.925+0000 7f9041c00640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 0x7f901c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:18.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.925+0000 7f9041c00640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 0x7f901c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9030009ac0 tx=0x7f9030008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:18.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:18.929+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f903c157c20 con 0x7f903c13eb20 2024-09-10T08:38:19.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.114+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f903c06c9c0 con 0x7f903c13eb20 2024-09-10T08:38:19.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.115+0000 7f9039600640 1 -- 172.21.15.52:0/2415412462 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+13054 (secure 0 0 0) 0x7f9028045360 con 0x7f903c13eb20 2024-09-10T08:38:19.115 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:19.115 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":138,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:17.732117+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6834/1386898992":"2024-09-11T08:38:14.442250+0000","172.21.15.52:6832/1386898992":"2024-09-11T08:38:14.442250+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 msgr2=0x7f901c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 0x7f901c06e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9030009ac0 tx=0x7f9030008040 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 msgr2=0x7f903c13a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f9028000c00 tx=0x7f90280046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 shutdown_connections 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f901c06be30 0x7f901c06e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f903c15bcf0 0x7f903c1396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f903c13eb20 0x7f903c13a1a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 --2- 172.21.15.52:0/2415412462 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f903c0b2d40 0x7f903c1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 >> 172.21.15.52:0/2415412462 conn(0x7f903c0ccec0 msgr2=0x7f903c0cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 shutdown_connections 2024-09-10T08:38:19.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.117+0000 7f9044600640 1 -- 172.21.15.52:0/2415412462 wait complete. 2024-09-10T08:38:19.134 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:38:19.134 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:38:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.293+0000 7f410f200640 1 Processor -- start 2024-09-10T08:38:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.293+0000 7f410f200640 1 -- start start 2024-09-10T08:38:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.294+0000 7f410f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f411015e650 0x7f4110073a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.294+0000 7f410f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4110073fa0 0x7f41100ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.294+0000 7f410f200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411015f650 con 0x7f41100cf1e0 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.294+0000 7f410f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f41100cf650 con 0x7f411015e650 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.294+0000 7f410f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f41100735d0 con 0x7f4110073fa0 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f411015e650 0x7f4110073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410e800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f41100cf1e0 0x7f411015ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53160/0 (socket says 172.21.15.52:53160) 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410e800640 1 -- 172.21.15.52:0/1101192827 learned_addr learned my addr 172.21.15.52:0/1101192827 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f4105400640 1 --2- 172.21.15.52:0/1101192827 >> v2:172.21.15.176:3300/0 conn(0x7f4110073fa0 0x7f41100ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410de00640 1 -- 172.21.15.52:0/1101192827 >> v2:172.21.15.176:3300/0 conn(0x7f4110073fa0 msgr2=0x7f41100ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410de00640 1 --2- 172.21.15.52:0/1101192827 >> v2:172.21.15.176:3300/0 conn(0x7f4110073fa0 0x7f41100ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410de00640 1 -- 172.21.15.52:0/1101192827 >> v1:172.21.15.52:6789/0 conn(0x7f41100cf1e0 legacy=0x7f411015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410d400640 1 -- 172.21.15.52:0/1101192827 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153816830 0 0) 0x7f411015f650 con 0x7f41100cf1e0 2024-09-10T08:38:19.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.295+0000 7f410de00640 1 -- 172.21.15.52:0/1101192827 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411015f930 con 0x7f411015e650 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.296+0000 7f410de00640 1 --2- 172.21.15.52:0/1101192827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411015e650 0x7f4110073a60 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f41000097a0 tx=0x7f410002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b32fc0a33e14a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410d400640 1 -- 172.21.15.52:0/1101192827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100037070 con 0x7f411015e650 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410d400640 1 -- 172.21.15.52:0/1101192827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410002ae50 con 0x7f411015e650 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410d400640 1 -- 172.21.15.52:0/1101192827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4100032660 con 0x7f411015e650 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 -- 172.21.15.52:0/1101192827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411015e650 msgr2=0x7f4110073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 --2- 172.21.15.52:0/1101192827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411015e650 0x7f4110073a60 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f41000097a0 tx=0x7f410002a140 comp rx=0 tx=0).stop 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 -- 172.21.15.52:0/1101192827 shutdown_connections 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 --2- 172.21.15.52:0/1101192827 >> v2:172.21.15.176:3300/0 conn(0x7f4110073fa0 0x7f41100ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 --2- 172.21.15.52:0/1101192827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411015e650 0x7f4110073a60 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 -- 172.21.15.52:0/1101192827 >> 172.21.15.52:0/1101192827 conn(0x7f41100b40d0 msgr2=0x7f41100b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 -- 172.21.15.52:0/1101192827 shutdown_connections 2024-09-10T08:38:19.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.297+0000 7f410f200640 1 -- 172.21.15.52:0/1101192827 wait complete. 2024-09-10T08:38:19.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.299+0000 7f410f200640 1 Processor -- start 2024-09-10T08:38:19.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.299+0000 7f410f200640 1 -- start start 2024-09-10T08:38:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 0x7f4110155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411015e650 0x7f41100b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f411006f400 con 0x7f41100b5d00 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4110073260 con 0x7f41100cf1e0 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f411015f140 con 0x7f411015e650 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53186/0 (socket says 172.21.15.52:53186) 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 -- 172.21.15.52:0/2862561015 learned_addr learned my addr 172.21.15.52:0/2862561015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410de00640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 0x7f4110155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f4105400640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411015e650 0x7f41100b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 -- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411015e650 msgr2=0x7f41100b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411015e650 0x7f41100b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 -- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 msgr2=0x7f4110155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 0x7f4110155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410e800640 1 -- 172.21.15.52:0/2862561015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411015c650 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.300+0000 7f410de00640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 0x7f4110155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f410e800640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f410800c7d0 tx=0x7f410800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108018070 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410800a640 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410800aa70 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411015c930 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.301+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411015cef0 con 0x7f41100b5d00 2024-09-10T08:38:19.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.302+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411015d0f0 con 0x7f41100b5d00 2024-09-10T08:38:19.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.303+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f410801b070 con 0x7f41100b5d00 2024-09-10T08:38:19.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.304+0000 7f4106a00640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.304+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f410808a1a0 con 0x7f41100b5d00 2024-09-10T08:38:19.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.304+0000 7f410de00640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.305+0000 7f410de00640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 0x7f40ec06e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4100034000 tx=0x7f410002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.308+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f411015d0f0 con 0x7f41100b5d00 2024-09-10T08:38:19.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.490+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41100ceca0 con 0x7f41100b5d00 2024-09-10T08:38:19.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.491+0000 7f4106a00640 1 -- 172.21.15.52:0/2862561015 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v138) ==== 93+0+10 (secure 0 0 0) 0x7f4108058e40 con 0x7f41100b5d00 2024-09-10T08:38:19.491 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 msgr2=0x7f40ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 0x7f40ec06e2f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4100034000 tx=0x7f410002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 msgr2=0x7f41100b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f410800c7d0 tx=0x7f410800cc90 comp rx=0 tx=0).stop 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 shutdown_connections 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f40ec06be30 0x7f40ec06e2f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41100b5d00 0x7f41100b61b0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411015e650 0x7f41100b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 --2- 172.21.15.52:0/2862561015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41100cf1e0 0x7f4110155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 >> 172.21.15.52:0/2862561015 conn(0x7f41100b40d0 msgr2=0x7f41100ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:19.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 shutdown_connections 2024-09-10T08:38:19.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.493+0000 7f410f200640 1 -- 172.21.15.52:0/2862561015 wait complete. 2024-09-10T08:38:19.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-10T08:38:19.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.666+0000 7f2da7400640 1 Processor -- start 2024-09-10T08:38:19.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.667+0000 7f2da7400640 1 -- start start 2024-09-10T08:38:19.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2da7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2da00b2d40 0x7f2da006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2da7400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da0071180 con 0x7f2da013eb20 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2da7400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da0071460 con 0x7f2da006c150 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2da7400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2da0071ab0 con 0x7f2da00b2d40 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2d97e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2da013eb20 0x7f2da015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53162/0 (socket says 172.21.15.52:53162) 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2d97e00640 1 -- 172.21.15.52:0/1955789430 learned_addr learned my addr 172.21.15.52:0/1955789430 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:19.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.668+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1955789430 >> v2:172.21.15.176:3300/0 conn(0x7f2da00b2d40 0x7f2da006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.669+0000 7f2d9fe00640 1 -- 172.21.15.52:0/1955789430 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361460484 0 0) 0x7f2da0071180 con 0x7f2da013eb20 2024-09-10T08:38:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.669+0000 7f2d9fe00640 1 -- 172.21.15.52:0/1955789430 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d84003520 con 0x7f2da013eb20 2024-09-10T08:38:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.669+0000 7f2da4a00640 1 -- 172.21.15.52:0/1955789430 >> v1:172.21.15.176:6789/0 conn(0x7f2da006c150 legacy=0x7f2da0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.669+0000 7f2da4a00640 1 -- 172.21.15.52:0/1955789430 >> v1:172.21.15.52:6789/0 conn(0x7f2da013eb20 legacy=0x7f2da015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.669+0000 7f2da4a00640 1 -- 172.21.15.52:0/1955789430 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da0071740 con 0x7f2da00b2d40 2024-09-10T08:38:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.670+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1955789430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da00b2d40 0x7f2da006bc10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097a0 tx=0x7f2d9002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecdd33922958634d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.670+0000 7f2d9fe00640 1 -- 172.21.15.52:0/1955789430 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90037070 con 0x7f2da00b2d40 2024-09-10T08:38:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.670+0000 7f2d9fe00640 1 -- 172.21.15.52:0/1955789430 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d90032440 con 0x7f2da00b2d40 2024-09-10T08:38:19.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.670+0000 7f2d9fe00640 1 -- 172.21.15.52:0/1955789430 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d900327f0 con 0x7f2da00b2d40 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 -- 172.21.15.52:0/1955789430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da00b2d40 msgr2=0x7f2da006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 --2- 172.21.15.52:0/1955789430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da00b2d40 0x7f2da006bc10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097a0 tx=0x7f2d9002a230 comp rx=0 tx=0).stop 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 -- 172.21.15.52:0/1955789430 shutdown_connections 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 --2- 172.21.15.52:0/1955789430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da00b2d40 0x7f2da006bc10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 -- 172.21.15.52:0/1955789430 >> 172.21.15.52:0/1955789430 conn(0x7f2da00ccec0 msgr2=0x7f2da00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 -- 172.21.15.52:0/1955789430 shutdown_connections 2024-09-10T08:38:19.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.671+0000 7f2da7400640 1 -- 172.21.15.52:0/1955789430 wait complete. 2024-09-10T08:38:19.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.673+0000 7f2da7400640 1 Processor -- start 2024-09-10T08:38:19.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.673+0000 7f2da7400640 1 -- start start 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 0x7f2da013e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 0x7f2da00cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2da015c7d0 con 0x7f2da00b2d40 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2da015c650 con 0x7f2da013eb20 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da7400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2da0072650 con 0x7f2da006c150 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53188/0 (socket says 172.21.15.52:53188) 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 -- 172.21.15.52:0/1106999144 learned_addr learned my addr 172.21.15.52:0/1106999144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:19.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 0x7f2da013e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da5400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 0x7f2da00cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 -- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 msgr2=0x7f2da013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 0x7f2da013e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 -- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 msgr2=0x7f2da00cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 0x7f2da00cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2d97e00640 1 -- 172.21.15.52:0/1106999144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da013e5c0 con 0x7f2da00b2d40 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 0x7f2da013e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.674+0000 7f2da5400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 0x7f2da00cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2d97e00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c3e0 tx=0x7f2d8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d88017070 con 0x7f2da00b2d40 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d88005ce0 con 0x7f2da00b2d40 2024-09-10T08:38:19.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d880072d0 con 0x7f2da00b2d40 2024-09-10T08:38:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da0156550 con 0x7f2da00b2d40 2024-09-10T08:38:19.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.675+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da0156b10 con 0x7f2da00b2d40 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.676+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da006bc10 con 0x7f2da00b2d40 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.677+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d8801a070 con 0x7f2da00b2d40 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.678+0000 7f2d9d600640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 0x7f2d7c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.678+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f2d88089ea0 con 0x7f2da00b2d40 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.679+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 0x7f2d7c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.679+0000 7f2da4a00640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 0x7f2d7c06e320 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d90034000 tx=0x7f2d9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:19.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.682+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2da013e5c0 con 0x7f2da00b2d40 2024-09-10T08:38:19.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:19.941+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f2da015b360 con 0x7f2da00b2d40 2024-09-10T08:38:20.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.744+0000 7f2d9d600640 1 -- 172.21.15.52:0/1106999144 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v457) ==== 169+0+0 (secure 0 0 0) 0x7f2d88058470 con 0x7f2da00b2d40 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 msgr2=0x7f2d7c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 0x7f2d7c06e320 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d90034000 tx=0x7f2d9002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 msgr2=0x7f2da0143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800c3e0 tx=0x7f2d8800c8a0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 shutdown_connections 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d7c06be60 0x7f2d7c06e320 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2da013eb20 0x7f2da00cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2da00b2d40 0x7f2da0143c60 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 --2- 172.21.15.52:0/1106999144 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2da006c150 0x7f2da013e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 >> 172.21.15.52:0/1106999144 conn(0x7f2da00ccec0 msgr2=0x7f2da00ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 shutdown_connections 2024-09-10T08:38:20.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.747+0000 7f2da7400640 1 -- 172.21.15.52:0/1106999144 wait complete. 2024-09-10T08:38:20.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:38:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.924+0000 7f8c57600640 1 Processor -- start 2024-09-10T08:38:20.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.924+0000 7f8c57600640 1 -- start start 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c57600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8c500cce30 0x7f8c500cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c57600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c50071c70 0x7f8c500720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c57600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c500714b0 con 0x7f8c500732e0 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c57600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8c500cd880 con 0x7f8c50071c70 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c57600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8c500cdb60 con 0x7f8c500cce30 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c50071c70 0x7f8c500720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8c50071c70 0x7f8c500720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53198/0 (socket says 172.21.15.52:53198) 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 -- 172.21.15.52:0/262859988 learned_addr learned my addr 172.21.15.52:0/262859988 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c4fe00640 1 --2- 172.21.15.52:0/262859988 >> v2:172.21.15.176:3300/0 conn(0x7f8c500cce30 0x7f8c500cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 -- 172.21.15.52:0/262859988 >> v2:172.21.15.176:3300/0 conn(0x7f8c500cce30 msgr2=0x7f8c500cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 --2- 172.21.15.52:0/262859988 >> v2:172.21.15.176:3300/0 conn(0x7f8c500cce30 0x7f8c500cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 -- 172.21.15.52:0/262859988 >> v1:172.21.15.176:6789/0 conn(0x7f8c500732e0 legacy=0x7f8c500736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:20.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.926+0000 7f8c55600640 1 -- 172.21.15.52:0/262859988 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c500cde40 con 0x7f8c50071c70 2024-09-10T08:38:20.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.927+0000 7f8c55600640 1 --2- 172.21.15.52:0/262859988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c50071c70 0x7f8c500720c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f8c500c57f0 tx=0x7f8c4802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c44be95b9938b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c4f400640 1 -- 172.21.15.52:0/262859988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48036070 con 0x7f8c50071c70 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c4f400640 1 -- 172.21.15.52:0/262859988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48031600 con 0x7f8c50071c70 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c4f400640 1 -- 172.21.15.52:0/262859988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480319d0 con 0x7f8c50071c70 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 -- 172.21.15.52:0/262859988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c50071c70 msgr2=0x7f8c500720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 --2- 172.21.15.52:0/262859988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c50071c70 0x7f8c500720c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f8c500c57f0 tx=0x7f8c4802a660 comp rx=0 tx=0).stop 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 -- 172.21.15.52:0/262859988 shutdown_connections 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 --2- 172.21.15.52:0/262859988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c50071c70 0x7f8c500720c0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 --2- 172.21.15.52:0/262859988 >> v2:172.21.15.176:3300/0 conn(0x7f8c500cce30 0x7f8c500cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 -- 172.21.15.52:0/262859988 >> 172.21.15.52:0/262859988 conn(0x7f8c5006d0f0 msgr2=0x7f8c5006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:20.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.928+0000 7f8c57600640 1 -- 172.21.15.52:0/262859988 shutdown_connections 2024-09-10T08:38:20.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.929+0000 7f8c57600640 1 -- 172.21.15.52:0/262859988 wait complete. 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.930+0000 7f8c57600640 1 Processor -- start 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.930+0000 7f8c57600640 1 -- start start 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c50071c70 0x7f8c500ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c500cce30 0x7f8c500cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5015ca50 con 0x7f8c500732e0 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5015c8d0 con 0x7f8c50071c70 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c57600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5015cbd0 con 0x7f8c500cce30 2024-09-10T08:38:20.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c4fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c4fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53208/0 (socket says 172.21.15.52:53208) 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.931+0000 7f8c4fe00640 1 -- 172.21.15.52:0/840290241 learned_addr learned my addr 172.21.15.52:0/840290241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 -- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c500cce30 msgr2=0x7f8c500cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c500cce30 0x7f8c500cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 -- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c50071c70 msgr2=0x7f8c500ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c50071c70 0x7f8c500ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 -- 172.21.15.52:0/840290241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c500caf10 con 0x7f8c500732e0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4fe00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d620 tx=0x7f8c3c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00b620 con 0x7f8c500732e0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c019070 con 0x7f8c500732e0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c00ba00 con 0x7f8c500732e0 2024-09-10T08:38:20.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c50159c60 con 0x7f8c500732e0 2024-09-10T08:38:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.932+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c500cff90 con 0x7f8c500732e0 2024-09-10T08:38:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.933+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5015a180 con 0x7f8c500732e0 2024-09-10T08:38:20.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.934+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c3c00bba0 con 0x7f8c500732e0 2024-09-10T08:38:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.935+0000 7f8c4cc00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 0x7f8c3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.935+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f8c3c08af40 con 0x7f8c500732e0 2024-09-10T08:38:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.936+0000 7f8c54c00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 0x7f8c3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:20.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.936+0000 7f8c54c00640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 0x7f8c3006e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c44003cc0 tx=0x7f8c440079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:20.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:20.940+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c5015a180 con 0x7f8c500732e0 2024-09-10T08:38:21.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.145+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8c500cd2a0 con 0x7f8c500732e0 2024-09-10T08:38:21.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.149+0000 7f8c4cc00640 1 -- 172.21.15.52:0/840290241 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f8c3c059be0 con 0x7f8c500732e0 2024-09-10T08:38:21.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 msgr2=0x7f8c3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 0x7f8c3006e2f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c44003cc0 tx=0x7f8c440079b0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 msgr2=0x7f8c500cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00d620 tx=0x7f8c3c00dae0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 shutdown_connections 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8c3006be30 0x7f8c3006e2f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c500cce30 0x7f8c500cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c500732e0 0x7f8c500cf510 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.151+0000 7f8c57600640 1 --2- 172.21.15.52:0/840290241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c50071c70 0x7f8c500ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.152+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 >> 172.21.15.52:0/840290241 conn(0x7f8c5006d0f0 msgr2=0x7f8c5015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.152+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 shutdown_connections 2024-09-10T08:38:21.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.152+0000 7f8c57600640 1 -- 172.21.15.52:0/840290241 wait complete. 2024-09-10T08:38:21.169 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:38:21.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:38:21.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:38:21.348 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:38:21.349 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:21.349 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:21.385 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:38:21.386 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:38:21.386 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:21.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:38:21.423 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:21.423 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:21.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:38:21.464 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:38:21.464 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:21.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:38:21.502 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:38:21.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:21.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.659+0000 7f2485400640 1 Processor -- start 2024-09-10T08:38:21.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.659+0000 7f2485400640 1 -- start start 2024-09-10T08:38:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.660+0000 7f2485400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 0x7f24800b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.660+0000 7f2485400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24800b5f90 0x7f24800735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.660+0000 7f2485400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24800b4020 con 0x7f2480073180 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.660+0000 7f2485400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2480073b00 con 0x7f24800b5f90 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.660+0000 7f2485400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f24800b42c0 con 0x7f2480145ed0 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24800b5f90 0x7f24800735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f2477e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2480073180 0x7f24800b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53176/0 (socket says 172.21.15.52:53176) 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f2477e00640 1 -- 172.21.15.52:0/3985666945 learned_addr learned my addr 172.21.15.52:0/3985666945 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247e800640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 0x7f24800b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247f200640 1 -- 172.21.15.52:0/3985666945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 msgr2=0x7f24800b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247f200640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 0x7f24800b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247f200640 1 -- 172.21.15.52:0/3985666945 >> v1:172.21.15.52:6789/0 conn(0x7f2480073180 legacy=0x7f24800b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247f200640 1 -- 172.21.15.52:0/3985666945 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800b45a0 con 0x7f24800b5f90 2024-09-10T08:38:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.661+0000 7f247e800640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 0x7f24800b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.662+0000 7f247f200640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24800735c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d90 tx=0x7f247802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f44c29bd976c8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.662+0000 7f247de00640 1 -- 172.21.15.52:0/3985666945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478007740 con 0x7f24800b5f90 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.662+0000 7f247de00640 1 -- 172.21.15.52:0/3985666945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24780078e0 con 0x7f24800b5f90 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.662+0000 7f247de00640 1 -- 172.21.15.52:0/3985666945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478007cb0 con 0x7f24800b5f90 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 -- 172.21.15.52:0/3985666945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 msgr2=0x7f24800735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24800735c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d90 tx=0x7f247802a660 comp rx=0 tx=0).stop 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 -- 172.21.15.52:0/3985666945 shutdown_connections 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24800735c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 --2- 172.21.15.52:0/3985666945 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480145ed0 0x7f24800b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 -- 172.21.15.52:0/3985666945 >> 172.21.15.52:0/3985666945 conn(0x7f24800ccec0 msgr2=0x7f24800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 -- 172.21.15.52:0/3985666945 shutdown_connections 2024-09-10T08:38:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.663+0000 7f2485400640 1 -- 172.21.15.52:0/3985666945 wait complete. 2024-09-10T08:38:21.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.665+0000 7f2485400640 1 Processor -- start 2024-09-10T08:38:21.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.665+0000 7f2485400640 1 -- start start 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480073180 0x7f24800caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2480145ed0 0x7f24801f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24801462b0 con 0x7f24800b5f90 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24800b4b60 con 0x7f2480145ed0 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2485400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2480146430 con 0x7f2480073180 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53238/0 (socket says 172.21.15.52:53238) 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 -- 172.21.15.52:0/201812364 learned_addr learned my addr 172.21.15.52:0/201812364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f247e800640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480073180 0x7f24800caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f247f200640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2480145ed0 0x7f24801f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 -- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480073180 msgr2=0x7f24800caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480073180 0x7f24800caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 -- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2480145ed0 msgr2=0x7f24801f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2480145ed0 0x7f24801f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.666+0000 7f2477e00640 1 -- 172.21.15.52:0/201812364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800c9a20 con 0x7f24800b5f90 2024-09-10T08:38:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2477e00640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f246800c440 tx=0x7f2468001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468017070 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468005ce0 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24800c9d00 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24680072f0 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.667+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24800ca2c0 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.668+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248006f910 con 0x7f24800b5f90 2024-09-10T08:38:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.669+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f246801a070 con 0x7f24800b5f90 2024-09-10T08:38:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.670+0000 7f2476a00640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 0x7f245c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.670+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4943+0+0 (secure 0 0 0) 0x7f2468089f40 con 0x7f24800b5f90 2024-09-10T08:38:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.671+0000 7f247e800640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 0x7f245c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.672+0000 7f247e800640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 0x7f245c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2470006fd0 tx=0x7f2470008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.674+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f248006f910 con 0x7f24800b5f90 2024-09-10T08:38:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.896+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24800735c0 con 0x7f24800b5f90 2024-09-10T08:38:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.896+0000 7f2476a00640 1 -- 172.21.15.52:0/201812364 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+3916 (secure 0 0 0) 0x7f2468058500 con 0x7f24800b5f90 2024-09-10T08:38:21.897 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:21.897 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":104,"btime":"2024-09-10T08:38:15:444290+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7780,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3851969916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3851969916},{"type":"v1","addr":"172.21.15.52:6835","nonce":3851969916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3690584415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3690584415},{"type":"v1","addr":"172.21.15.176:6836","nonce":3690584415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/528963076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":528963076},{"type":"v1","addr":"172.21.15.176:6837","nonce":528963076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2972927755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2972927755},{"type":"v1","addr":"172.21.15.52:6834","nonce":2972927755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[]} 2024-09-10T08:38:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 104 2024-09-10T08:38:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 msgr2=0x7f245c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 0x7f245c06e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2470006fd0 tx=0x7f2470008040 comp rx=0 tx=0).stop 2024-09-10T08:38:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 msgr2=0x7f24801f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:21.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f246800c440 tx=0x7f2468001e70 comp rx=0 tx=0).stop 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 shutdown_connections 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f245c06be30 0x7f245c06e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2480145ed0 0x7f24801f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b5f90 0x7f24801f5c70 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.898+0000 7f2485400640 1 --2- 172.21.15.52:0/201812364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2480073180 0x7f24800caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.899+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 >> 172.21.15.52:0/201812364 conn(0x7f24800ccec0 msgr2=0x7f24800cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.899+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 shutdown_connections 2024-09-10T08:38:21.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:21.899+0000 7f2485400640 1 -- 172.21.15.52:0/201812364 wait complete. 2024-09-10T08:38:21.916 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:38:21.916 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:38:21.916 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:38:21.916 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:38:21.916 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:38:21.916 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:38:21.917 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:38:21.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:38:21.917 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:38:21.917 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:38:21.917 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:38:21.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:38:21.917 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:38:21.918 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:38:21.918 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:38:21.918 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:38:21.930 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:38:21.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:38:21.931 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:38:21.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:38:21.933 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:38:21.933 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:38:21.933 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:38:21.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:38:21.975 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:38:21.976 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:21.977 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:38:21.978 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:21.978 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:38:21.978 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:21.980 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:38:21.980 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:21.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:38:22.108 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:38:22.108 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:38:22.109 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:38:22.109 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:38:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.146+0000 7f7b41c00640 1 Processor -- start 2024-09-10T08:38:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.147+0000 7f7b41c00640 1 -- start start 2024-09-10T08:38:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b41c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7b3c0b6db0 0x7f7b3c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b41c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3c15f590 con 0x7f7b3c1624b0 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b41c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b3c15f870 con 0x7f7b3c15eb60 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b41c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3c15fb50 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b33e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7b3c1624b0 0x7f7b3c0b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:53214/0 (socket says 172.21.15.52:53214) 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b33e00640 1 -- 172.21.15.52:0/3612051921 learned_addr learned my addr 172.21.15.52:0/3612051921 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.148+0000 7f7b3b400640 1 --2- 172.21.15.52:0/3612051921 >> v2:172.21.15.52:3300/0 conn(0x7f7b3c0b6db0 0x7f7b3c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.149+0000 7f7b3b400640 1 -- 172.21.15.52:0/3612051921 >> v1:172.21.15.176:6789/0 conn(0x7f7b3c15eb60 legacy=0x7f7b3c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.149+0000 7f7b3b400640 1 -- 172.21.15.52:0/3612051921 >> v1:172.21.15.52:6789/0 conn(0x7f7b3c1624b0 legacy=0x7f7b3c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.149+0000 7f7b3b400640 1 -- 172.21.15.52:0/3612051921 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c15fe30 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.150+0000 7f7b3b400640 1 --2- 172.21.15.52:0/3612051921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c15ef40 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009d90 tx=0x7f7b3402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71e916a9342514f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.152+0000 7f7b3a000640 1 -- 172.21.15.52:0/3612051921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34031600 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.152+0000 7f7b3a000640 1 -- 172.21.15.52:0/3612051921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b340317a0 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.152+0000 7f7b3a000640 1 -- 172.21.15.52:0/3612051921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34031b70 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.152+0000 7f7b41c00640 1 -- 172.21.15.52:0/3612051921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c0b6db0 msgr2=0x7f7b3c15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.152+0000 7f7b41c00640 1 --2- 172.21.15.52:0/3612051921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c15ef40 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009d90 tx=0x7f7b3402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.153+0000 7f7b41c00640 1 -- 172.21.15.52:0/3612051921 shutdown_connections 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.153+0000 7f7b41c00640 1 --2- 172.21.15.52:0/3612051921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c15ef40 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.153+0000 7f7b41c00640 1 -- 172.21.15.52:0/3612051921 >> 172.21.15.52:0/3612051921 conn(0x7f7b3c0d16f0 msgr2=0x7f7b3c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.153+0000 7f7b41c00640 1 -- 172.21.15.52:0/3612051921 shutdown_connections 2024-09-10T08:38:22.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.153+0000 7f7b41c00640 1 -- 172.21.15.52:0/3612051921 wait complete. 2024-09-10T08:38:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.154+0000 7f7b41c00640 1 Processor -- start 2024-09-10T08:38:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.155+0000 7f7b41c00640 1 -- start start 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.155+0000 7f7b41c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c1f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b41c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b41c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c1624b0 0x7f7b3c155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b41c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0d4600 con 0x7f7b3c15eb60 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b41c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c0d4480 con 0x7f7b3c0b6db0 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b41c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3c0d3600 con 0x7f7b3c1624b0 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:22.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b3aa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c1f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53282/0 (socket says 172.21.15.52:53282) 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 -- 172.21.15.52:0/1831270085 learned_addr learned my addr 172.21.15.52:0/1831270085 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b3b400640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c1624b0 0x7f7b3c155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 -- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c1624b0 msgr2=0x7f7b3c155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c1624b0 0x7f7b3c155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 -- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 msgr2=0x7f7b3c1f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c1f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b33e00640 1 -- 172.21.15.52:0/1831270085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c1e9df0 con 0x7f7b3c15eb60 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.156+0000 7f7b3aa00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c1f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:22.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.157+0000 7f7b33e00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c3c0 tx=0x7f7b2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.159+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24017070 con 0x7f7b3c15eb60 2024-09-10T08:38:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.160+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3c1e8810 con 0x7f7b3c15eb60 2024-09-10T08:38:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.160+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b24005ce0 con 0x7f7b3c15eb60 2024-09-10T08:38:22.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.160+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b240072f0 con 0x7f7b3c15eb60 2024-09-10T08:38:22.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.161+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3c1e8dd0 con 0x7f7b3c15eb60 2024-09-10T08:38:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.162+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b2401a070 con 0x7f7b3c15eb60 2024-09-10T08:38:22.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.162+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3c0b4370 con 0x7f7b3c15eb60 2024-09-10T08:38:22.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.163+0000 7f7b32a00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:22.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.163+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 4943+0+0 (secure 0 0 0) 0x7f7b24092350 con 0x7f7b3c15eb60 2024-09-10T08:38:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.163+0000 7f7b3aa00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:22.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.164+0000 7f7b3aa00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:22.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.168+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b3c0b4370 con 0x7f7b3c15eb60 2024-09-10T08:38:22.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:22.366+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7b3c15ef40 con 0x7f7b3c15eb60 2024-09-10T08:38:23.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.174+0000 7f7b32a00640 1 -- 172.21.15.52:0/1831270085 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v143) ==== 97+0+0 (secure 0 0 0) 0x7f7b240581e0 con 0x7f7b3c15eb60 2024-09-10T08:38:23.175 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 msgr2=0x7f7b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 0x7f7b1806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c009040 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 msgr2=0x7f7b3c1e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400c3c0 tx=0x7f7b2400c880 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 shutdown_connections 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7b1806be30 0x7f7b1806e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7b3c1624b0 0x7f7b3c155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b3c15eb60 0x7f7b3c1e98b0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 --2- 172.21.15.52:0/1831270085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7b3c0b6db0 0x7f7b3c1f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.177+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 >> 172.21.15.52:0/1831270085 conn(0x7f7b3c0d16f0 msgr2=0x7f7b3c0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.178+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 shutdown_connections 2024-09-10T08:38:23.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.178+0000 7f7b41c00640 1 -- 172.21.15.52:0/1831270085 wait complete. 2024-09-10T08:38:23.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:38:23.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.358+0000 7fcfc9800640 1 Processor -- start 2024-09-10T08:38:23.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.358+0000 7fcfc9800640 1 -- start start 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.359+0000 7fcfc9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfc40b2d40 0x7fcfc406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.359+0000 7fcfc9800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcfc406c150 0x7fcfc415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.359+0000 7fcfc9800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc4071180 con 0x7fcfc413eb20 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.359+0000 7fcfc9800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc4071ab0 con 0x7fcfc40b2d40 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.359+0000 7fcfc9800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc4071460 con 0x7fcfc406c150 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfc40b2d40 0x7fcfc406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcfc40b2d40 0x7fcfc406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53294/0 (socket says 172.21.15.52:53294) 2024-09-10T08:38:23.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 -- 172.21.15.52:0/1938969079 learned_addr learned my addr 172.21.15.52:0/1938969079 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:23.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc3400640 1 --2- 172.21.15.52:0/1938969079 >> v2:172.21.15.176:3300/0 conn(0x7fcfc406c150 0x7fcfc415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 -- 172.21.15.52:0/1938969079 >> v2:172.21.15.176:3300/0 conn(0x7fcfc406c150 msgr2=0x7fcfc415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:23.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 --2- 172.21.15.52:0/1938969079 >> v2:172.21.15.176:3300/0 conn(0x7fcfc406c150 0x7fcfc415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 -- 172.21.15.52:0/1938969079 >> v1:172.21.15.176:6789/0 conn(0x7fcfc413eb20 legacy=0x7fcfc415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.360+0000 7fcfc2a00640 1 -- 172.21.15.52:0/1938969079 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc4071740 con 0x7fcfc40b2d40 2024-09-10T08:38:23.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.361+0000 7fcfc2a00640 1 --2- 172.21.15.52:0/1938969079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc40b2d40 0x7fcfc406bc10 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4070d30 tx=0x7fcfb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2821efc7f7835447 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc1600640 1 -- 172.21.15.52:0/1938969079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4037070 con 0x7fcfc40b2d40 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc1600640 1 -- 172.21.15.52:0/1938969079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4032440 con 0x7fcfc40b2d40 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc1600640 1 -- 172.21.15.52:0/1938969079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4032810 con 0x7fcfc40b2d40 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 -- 172.21.15.52:0/1938969079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc40b2d40 msgr2=0x7fcfc406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 --2- 172.21.15.52:0/1938969079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc40b2d40 0x7fcfc406bc10 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4070d30 tx=0x7fcfb402a270 comp rx=0 tx=0).stop 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 -- 172.21.15.52:0/1938969079 shutdown_connections 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 --2- 172.21.15.52:0/1938969079 >> v2:172.21.15.176:3300/0 conn(0x7fcfc406c150 0x7fcfc415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 --2- 172.21.15.52:0/1938969079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc40b2d40 0x7fcfc406bc10 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 -- 172.21.15.52:0/1938969079 >> 172.21.15.52:0/1938969079 conn(0x7fcfc40ccec0 msgr2=0x7fcfc40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 -- 172.21.15.52:0/1938969079 shutdown_connections 2024-09-10T08:38:23.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.362+0000 7fcfc9800640 1 -- 172.21.15.52:0/1938969079 wait complete. 2024-09-10T08:38:23.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.364+0000 7fcfc9800640 1 Processor -- start 2024-09-10T08:38:23.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.364+0000 7fcfc9800640 1 -- start start 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfc406c150 0x7fcfc4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfc40b2d40 0x7fcfc413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc40722d0 con 0x7fcfc413eb20 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4072150 con 0x7fcfc406c150 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc9800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc4072450 con 0x7fcfc40b2d40 2024-09-10T08:38:23.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53296/0 (socket says 172.21.15.52:53296) 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc3400640 1 -- 172.21.15.52:0/2550580876 learned_addr learned my addr 172.21.15.52:0/2550580876 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc2a00640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfc406c150 0x7fcfc4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.365+0000 7fcfc2000640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfc40b2d40 0x7fcfc413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 -- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfc40b2d40 msgr2=0x7fcfc413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfc40b2d40 0x7fcfc413efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 -- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfc406c150 msgr2=0x7fcfc4154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfc406c150 0x7fcfc4154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 -- 172.21.15.52:0/2550580876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc413fa60 con 0x7fcfc413eb20 2024-09-10T08:38:23.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc3400640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00efc0 tx=0x7fcfbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc018020 con 0x7fcfc413eb20 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc014480 con 0x7fcfc413eb20 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc014870 con 0x7fcfc413eb20 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc413fd40 con 0x7fcfc413eb20 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.366+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc4140300 con 0x7fcfc413eb20 2024-09-10T08:38:23.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.367+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc406bc10 con 0x7fcfc413eb20 2024-09-10T08:38:23.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.368+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfbc01b020 con 0x7fcfc413eb20 2024-09-10T08:38:23.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.369+0000 7fcfbaa00640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.369+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7fcfbc08b8b0 con 0x7fcfc413eb20 2024-09-10T08:38:23.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.370+0000 7fcfc2a00640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.370+0000 7fcfc2a00640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 0x7fcfa406e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4034000 tx=0x7fcfb402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.374+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfbc022020 con 0x7fcfc413eb20 2024-09-10T08:38:23.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.625+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcfc406c9c0 con 0x7fcfc413eb20 2024-09-10T08:38:23.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.626+0000 7fcfbaa00640 1 -- 172.21.15.52:0/2550580876 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fcfbc010040 con 0x7fcfc413eb20 2024-09-10T08:38:23.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:23.626 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:23.626 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:38:23.626 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:38:23.627 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.628 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:38:23.629 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:38:23.630 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.631 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.632 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.633 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.634 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.635 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:38:23.636 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.637 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:38:23.638 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:38:23.639 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:23.640 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:38:23.641 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:23.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 msgr2=0x7fcfa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 0x7fcfa406e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4034000 tx=0x7fcfb402e000 comp rx=0 tx=0).stop 2024-09-10T08:38:23.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 msgr2=0x7fcfc415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00efc0 tx=0x7fcfbc00c490 comp rx=0 tx=0).stop 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 shutdown_connections 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfc413eb20 0x7fcfc415cac0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfc40b2d40 0x7fcfc413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 --2- 172.21.15.52:0/2550580876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfc406c150 0x7fcfc4154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 >> 172.21.15.52:0/2550580876 conn(0x7fcfc40ccec0 msgr2=0x7fcfc40cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 shutdown_connections 2024-09-10T08:38:23.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.628+0000 7fcfc9800640 1 -- 172.21.15.52:0/2550580876 wait complete. 2024-09-10T08:38:23.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:38:23.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.802+0000 7fd3dde00640 1 Processor -- start 2024-09-10T08:38:23.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.802+0000 7fd3dde00640 1 -- start start 2024-09-10T08:38:23.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 0x7fd3d815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3d8073160 0x7fd3d80735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d8163160 con 0x7fd3d8073160 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d815fe10 con 0x7fd3d806d000 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.803+0000 7fd3dde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d806d920 con 0x7fd3d80cc2a0 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3d8073160 0x7fd3d80735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd3d8073160 0x7fd3d80735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53312/0 (socket says 172.21.15.52:53312) 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 -- 172.21.15.52:0/1811445401 learned_addr learned my addr 172.21.15.52:0/1811445401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d6a00640 1 --2- 172.21.15.52:0/1811445401 >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 0x7fd3d815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d6000640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 -- 172.21.15.52:0/1811445401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 msgr2=0x7fd3d806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 -- 172.21.15.52:0/1811445401 >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 msgr2=0x7fd3d815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:23.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 --2- 172.21.15.52:0/1811445401 >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 0x7fd3d815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d7400640 1 -- 172.21.15.52:0/1811445401 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d8162550 con 0x7fd3d8073160 2024-09-10T08:38:23.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d6000640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:23.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.804+0000 7fd3d6a00640 1 --2- 172.21.15.52:0/1811445401 >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 0x7fd3d815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.805+0000 7fd3d7400640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80735f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd3d806f050 tx=0x7fd3d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125972ad138a017b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.805+0000 7fd3d5600640 1 -- 172.21.15.52:0/1811445401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0036070 con 0x7fd3d8073160 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.805+0000 7fd3d5600640 1 -- 172.21.15.52:0/1811445401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0031600 con 0x7fd3d8073160 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.805+0000 7fd3d5600640 1 -- 172.21.15.52:0/1811445401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00319d0 con 0x7fd3d8073160 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 -- 172.21.15.52:0/1811445401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 msgr2=0x7fd3d80735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80735f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd3d806f050 tx=0x7fd3d002a6a0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 -- 172.21.15.52:0/1811445401 shutdown_connections 2024-09-10T08:38:23.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80735f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 --2- 172.21.15.52:0/1811445401 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 --2- 172.21.15.52:0/1811445401 >> v2:172.21.15.176:3300/0 conn(0x7fd3d806d000 0x7fd3d815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 -- 172.21.15.52:0/1811445401 >> 172.21.15.52:0/1811445401 conn(0x7fd3d80b4300 msgr2=0x7fd3d80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 -- 172.21.15.52:0/1811445401 shutdown_connections 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.806+0000 7fd3dde00640 1 -- 172.21.15.52:0/1811445401 wait complete. 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.808+0000 7fd3dde00640 1 Processor -- start 2024-09-10T08:38:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.808+0000 7fd3dde00640 1 -- start start 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3d806d000 0x7fd3d80b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8162df0 con 0x7fd3d8073160 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8162b10 con 0x7fd3d806d000 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3dde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d80d03c0 con 0x7fd3d80cc2a0 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3d6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53316/0 (socket says 172.21.15.52:53316) 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3d6000640 1 -- 172.21.15.52:0/2803030831 learned_addr learned my addr 172.21.15.52:0/2803030831 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:23.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3d6a00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3d806d000 0x7fd3d80b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.809+0000 7fd3d7400640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 -- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 msgr2=0x7fd3d80ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d80ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 -- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3d806d000 msgr2=0x7fd3d80b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3d806d000 0x7fd3d80b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 -- 172.21.15.52:0/2803030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d80b7fa0 con 0x7fd3d8073160 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3d6000640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400d800 tx=0x7fd3c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40096a0 con 0x7fd3d8073160 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c4019070 con 0x7fd3d8073160 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4009a80 con 0x7fd3d8073160 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d80b69c0 con 0x7fd3d8073160 2024-09-10T08:38:23.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.810+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d80b6f80 con 0x7fd3d8073160 2024-09-10T08:38:23.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.811+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d815c720 con 0x7fd3d8073160 2024-09-10T08:38:23.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.812+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3c4009c20 con 0x7fd3d8073160 2024-09-10T08:38:23.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.813+0000 7fd3cf400640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:23.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.813+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7fd3c408ae70 con 0x7fd3d8073160 2024-09-10T08:38:23.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.814+0000 7fd3d6a00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:23.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.814+0000 7fd3d6a00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 0x7fd3b806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80b3610 tx=0x7fd3c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:23.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:23.817+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3c4059480 con 0x7fd3d8073160 2024-09-10T08:38:24.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.001+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3d80b1f50 con 0x7fd3d8073160 2024-09-10T08:38:24.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.002+0000 7fd3cf400640 1 -- 172.21.15.52:0/2803030831 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v143) ==== 84+0+65 (secure 0 0 0) 0x7fd3c405d780 con 0x7fd3d8073160 2024-09-10T08:38:24.002 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:24.003 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 msgr2=0x7fd3b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 0x7fd3b806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80b3610 tx=0x7fd3c8008040 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 msgr2=0x7fd3d80cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400d800 tx=0x7fd3c400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 shutdown_connections 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3b806be30 0x7fd3b806e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3d80cc2a0 0x7fd3d80ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3d8073160 0x7fd3d80cf630 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 --2- 172.21.15.52:0/2803030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3d806d000 0x7fd3d80b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 >> 172.21.15.52:0/2803030831 conn(0x7fd3d80b4300 msgr2=0x7fd3d80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:24.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 shutdown_connections 2024-09-10T08:38:24.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.004+0000 7fd3dde00640 1 -- 172.21.15.52:0/2803030831 wait complete. 2024-09-10T08:38:24.020 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:38:24.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:38:24.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.182+0000 7f6dd3600640 1 Processor -- start 2024-09-10T08:38:24.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.182+0000 7f6dd3600640 1 -- start start 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.183+0000 7f6dd3600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.183+0000 7f6dd3600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 0x7f6dcc0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd3600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc0aedb0 0x7f6dcc15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd3600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6dcc0af220 con 0x7f6dcc1480b0 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd3600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6dcc148490 con 0x7f6dcc0b58e0 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd3600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc0b5ef0 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47320/0 (socket says 172.21.15.52:47320) 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2026082269 learned_addr learned my addr 172.21.15.52:0/2026082269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2026082269 >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 0x7f6dcc0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd1600640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc0aedb0 0x7f6dcc15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2026082269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc0aedb0 msgr2=0x7f6dcc15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc0aedb0 0x7f6dcc15ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2026082269 >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 msgr2=0x7f6dcc0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2026082269 >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 0x7f6dcc0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2026082269 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc0b61d0 con 0x7f6dcc1480b0 2024-09-10T08:38:24.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.184+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2026082269 >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 0x7f6dcc0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:24.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.185+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0b6100 tx=0x7f6dc002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3804cb8ea5b4bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:24.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dcb400640 1 -- 172.21.15.52:0/2026082269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0037070 con 0x7f6dcc1480b0 2024-09-10T08:38:24.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dcb400640 1 -- 172.21.15.52:0/2026082269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0032440 con 0x7f6dcc1480b0 2024-09-10T08:38:24.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dcb400640 1 -- 172.21.15.52:0/2026082269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0032810 con 0x7f6dcc1480b0 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 -- 172.21.15.52:0/2026082269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc1480b0 msgr2=0x7f6dcc0b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0b6100 tx=0x7f6dc002a130 comp rx=0 tx=0).stop 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 -- 172.21.15.52:0/2026082269 shutdown_connections 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2026082269 >> v2:172.21.15.176:3300/0 conn(0x7f6dcc0b58e0 0x7f6dcc0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc0aedb0 0x7f6dcc15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2026082269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc1480b0 0x7f6dcc0b53a0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 -- 172.21.15.52:0/2026082269 >> 172.21.15.52:0/2026082269 conn(0x7f6dcc06c240 msgr2=0x7f6dcc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 -- 172.21.15.52:0/2026082269 shutdown_connections 2024-09-10T08:38:24.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.186+0000 7f6dd3600640 1 -- 172.21.15.52:0/2026082269 wait complete. 2024-09-10T08:38:24.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.188+0000 7f6dd3600640 1 Processor -- start 2024-09-10T08:38:24.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.188+0000 7f6dd3600640 1 -- start start 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 0x7f6dcc160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 0x7f6dcc1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0b37a0 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc160030 con 0x7f6dcc0b58e0 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd3600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc0b3920 con 0x7f6dcc1480b0 2024-09-10T08:38:24.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47332/0 (socket says 172.21.15.52:47332) 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2946673396 learned_addr learned my addr 172.21.15.52:0/2946673396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dd1600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 0x7f6dcc1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.189+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 0x7f6dcc160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 msgr2=0x7f6dcc1423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 0x7f6dcc1423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 msgr2=0x7f6dcc160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 0x7f6dcc160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 -- 172.21.15.52:0/2946673396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc140700 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd1600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 0x7f6dcc1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 0x7f6dcc160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd0c00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000c00 tx=0x7f6dc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:24.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0041020 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc00306c0 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0037040 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc141350 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.190+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc141910 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.192+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc0ae870 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.192+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6dc0044020 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.193+0000 7f6dc8c00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 0x7f6dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.193+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f6dc00ab380 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.194+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 0x7f6dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:24.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.194+0000 7f6dcbe00640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 0x7f6dac06e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0b25e0 tx=0x7f6db8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:24.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.197+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dc004b030 con 0x7f6dcc0aedb0 2024-09-10T08:38:24.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:24.381+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6dcc06e360 con 0x7f6dcc0aedb0 2024-09-10T08:38:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.178+0000 7f6dc8c00640 1 -- 172.21.15.52:0/2946673396 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v144) ==== 138+0+0 (secure 0 0 0) 0x7f6dc007a070 con 0x7f6dcc0aedb0 2024-09-10T08:38:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:38:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.182+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 msgr2=0x7f6dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.182+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 0x7f6dac06e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0b25e0 tx=0x7f6db8008040 comp rx=0 tx=0).stop 2024-09-10T08:38:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.182+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 msgr2=0x7f6dcc1401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.182+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0000c00 tx=0x7f6dc00046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 shutdown_connections 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6dac06be30 0x7f6dac06e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6dcc1480b0 0x7f6dcc1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dcc0b58e0 0x7f6dcc160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 --2- 172.21.15.52:0/2946673396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dcc0aedb0 0x7f6dcc1401c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.183+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 >> 172.21.15.52:0/2946673396 conn(0x7f6dcc06c240 msgr2=0x7f6dcc0b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.184+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 shutdown_connections 2024-09-10T08:38:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.184+0000 7f6dd3600640 1 -- 172.21.15.52:0/2946673396 wait complete. 2024-09-10T08:38:25.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:38:25.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.373+0000 7f3833200640 1 Processor -- start 2024-09-10T08:38:25.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.373+0000 7f3833200640 1 -- start start 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.374+0000 7f3833200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 0x7f3834147870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.374+0000 7f3833200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38340b4b60 0x7f3834147db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.374+0000 7f3833200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3834162d80 con 0x7f3834162070 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.374+0000 7f3833200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f38340b31f0 con 0x7f38340b4b60 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.374+0000 7f3833200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f38340b34d0 con 0x7f38340b4780 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38340b4b60 0x7f3834147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f38340b4b60 0x7f3834147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47342/0 (socket says 172.21.15.52:47342) 2024-09-10T08:38:25.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 -- 172.21.15.52:0/3501592662 learned_addr learned my addr 172.21.15.52:0/3501592662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831e00640 1 --2- 172.21.15.52:0/3501592662 >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 0x7f3834147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 -- 172.21.15.52:0/3501592662 >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 msgr2=0x7f3834147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 --2- 172.21.15.52:0/3501592662 >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 0x7f3834147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 -- 172.21.15.52:0/3501592662 >> v1:172.21.15.176:6789/0 conn(0x7f3834162070 legacy=0x7f3834162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831400640 1 -- 172.21.15.52:0/3501592662 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38340b37b0 con 0x7f38340b4b60 2024-09-10T08:38:25.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.375+0000 7f3831e00640 1 --2- 172.21.15.52:0/3501592662 >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 0x7f3834147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:25.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.376+0000 7f3831400640 1 --2- 172.21.15.52:0/3501592662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4b60 0x7f3834147db0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f383406de90 tx=0x7f382002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d6a65eaf5be0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.376+0000 7f3830a00640 1 -- 172.21.15.52:0/3501592662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820037070 con 0x7f38340b4b60 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.376+0000 7f3830a00640 1 -- 172.21.15.52:0/3501592662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820032440 con 0x7f38340b4b60 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3830a00640 1 -- 172.21.15.52:0/3501592662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820032810 con 0x7f38340b4b60 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 -- 172.21.15.52:0/3501592662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4b60 msgr2=0x7f3834147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 --2- 172.21.15.52:0/3501592662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4b60 0x7f3834147db0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f383406de90 tx=0x7f382002a270 comp rx=0 tx=0).stop 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 -- 172.21.15.52:0/3501592662 shutdown_connections 2024-09-10T08:38:25.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 --2- 172.21.15.52:0/3501592662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4b60 0x7f3834147db0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 --2- 172.21.15.52:0/3501592662 >> v2:172.21.15.176:3300/0 conn(0x7f38340b4780 0x7f3834147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 -- 172.21.15.52:0/3501592662 >> 172.21.15.52:0/3501592662 conn(0x7f383406bc10 msgr2=0x7f383406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 -- 172.21.15.52:0/3501592662 shutdown_connections 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.377+0000 7f3833200640 1 -- 172.21.15.52:0/3501592662 wait complete. 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.379+0000 7f3833200640 1 Processor -- start 2024-09-10T08:38:25.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.379+0000 7f3833200640 1 -- start start 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38340b4b60 0x7f38340737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 0x7f38341f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38340b4130 con 0x7f38340b4780 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f38340b3fb0 con 0x7f38340b4b60 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3833200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f38340ae870 con 0x7f3834162070 2024-09-10T08:38:25.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3831e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3831e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47348/0 (socket says 172.21.15.52:47348) 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3831e00640 1 -- 172.21.15.52:0/2329923236 learned_addr learned my addr 172.21.15.52:0/2329923236 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3831400640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38340b4b60 0x7f38340737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.380+0000 7f3832800640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 0x7f38341f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 -- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 msgr2=0x7f38341f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 0x7f38341f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 -- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38340b4b60 msgr2=0x7f38340737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38340b4b60 0x7f38340737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 -- 172.21.15.52:0/2329923236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38341f7c50 con 0x7f38340b4780 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3832800640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 0x7f38341f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:25.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3831e00640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f382400e760 tx=0x7f382400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382400f040 con 0x7f38340b4780 2024-09-10T08:38:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3824004230 con 0x7f38340b4780 2024-09-10T08:38:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382400ee70 con 0x7f38340b4780 2024-09-10T08:38:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38341f7ef0 con 0x7f38340b4780 2024-09-10T08:38:25.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.381+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38341f4450 con 0x7f38340b4780 2024-09-10T08:38:25.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.382+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3834162500 con 0x7f38340b4780 2024-09-10T08:38:25.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.384+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f382400c6d0 con 0x7f38340b4780 2024-09-10T08:38:25.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.384+0000 7f382a000640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 0x7f381406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:25.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.385+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5227+0+0 (secure 0 0 0) 0x7f382408a930 con 0x7f38340b4780 2024-09-10T08:38:25.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.385+0000 7f3831400640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 0x7f381406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:25.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.386+0000 7f3831400640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 0x7f381406e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3820034000 tx=0x7f382002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:25.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.389+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3824017020 con 0x7f38340b4780 2024-09-10T08:38:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:25.573+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f38340aee40 con 0x7f38340b4780 2024-09-10T08:38:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.185+0000 7f382a000640 1 -- 172.21.15.52:0/2329923236 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v145) ==== 170+0+0 (secure 0 0 0) 0x7f38240594b0 con 0x7f38340b4780 2024-09-10T08:38:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:38:26.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 msgr2=0x7f381406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 0x7f381406e320 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3820034000 tx=0x7f382002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:26.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 msgr2=0x7f38341f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f382400e760 tx=0x7f382400ec20 comp rx=0 tx=0).stop 2024-09-10T08:38:26.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 shutdown_connections 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f381406be60 0x7f381406e320 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.188+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3834162070 0x7f38341f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.189+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f38340b4b60 0x7f38340737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.189+0000 7f3833200640 1 --2- 172.21.15.52:0/2329923236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38340b4780 0x7f38341f7710 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.189+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 >> 172.21.15.52:0/2329923236 conn(0x7f383406bc10 msgr2=0x7f3834072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.189+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 shutdown_connections 2024-09-10T08:38:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.189+0000 7f3833200640 1 -- 172.21.15.52:0/2329923236 wait complete. 2024-09-10T08:38:26.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:38:26.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.383+0000 7f6f53000640 1 Processor -- start 2024-09-10T08:38:26.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.383+0000 7f6f53000640 1 -- start start 2024-09-10T08:38:26.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.384+0000 7f6f53000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f4c0b5fd0 0x7f6f4c0d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.384+0000 7f6f53000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c0b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.384+0000 7f6f53000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c0d3950 con 0x7f6f4c0b63b0 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.384+0000 7f6f53000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c0d3c30 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.384+0000 7f6f53000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c0d3f10 con 0x7f6f4c0b7c10 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f51c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6f4c0b5fd0 0x7f6f4c0d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f52600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c0b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f51200640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6f4c0b63b0 0x7f6f4c0cf650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:43772/0 (socket says 172.21.15.52:43772) 2024-09-10T08:38:26.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f51200640 1 -- 172.21.15.52:0/2554582606 learned_addr learned my addr 172.21.15.52:0/2554582606 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:26.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f4be00640 1 -- 172.21.15.52:0/2554582606 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560879692 0 0) 0x7f6f4c0d3950 con 0x7f6f4c0b63b0 2024-09-10T08:38:26.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.385+0000 7f6f4be00640 1 -- 172.21.15.52:0/2554582606 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f34003520 con 0x7f6f4c0b63b0 2024-09-10T08:38:26.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.386+0000 7f6f51c00640 1 -- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 msgr2=0x7f6f4c0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:26.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.386+0000 7f6f51c00640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c0b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.386+0000 7f6f51c00640 1 -- 172.21.15.52:0/2554582606 >> v1:172.21.15.176:6789/0 conn(0x7f6f4c0b63b0 legacy=0x7f6f4c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.386+0000 7f6f51c00640 1 -- 172.21.15.52:0/2554582606 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c0d41f0 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.386+0000 7f6f52600640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f51c00640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c0d32c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097a0 tx=0x7f6f4002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fddfe9fef79353e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f4be00640 1 -- 172.21.15.52:0/2554582606 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40037070 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f4be00640 1 -- 172.21.15.52:0/2554582606 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40032440 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f4be00640 1 -- 172.21.15.52:0/2554582606 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40032810 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 -- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b5fd0 msgr2=0x7f6f4c0d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c0d32c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097a0 tx=0x7f6f4002a210 comp rx=0 tx=0).stop 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 -- 172.21.15.52:0/2554582606 shutdown_connections 2024-09-10T08:38:26.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 --2- 172.21.15.52:0/2554582606 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c0d32c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.387+0000 7f6f53000640 1 -- 172.21.15.52:0/2554582606 >> 172.21.15.52:0/2554582606 conn(0x7f6f4c0d0fd0 msgr2=0x7f6f4c0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.388+0000 7f6f53000640 1 -- 172.21.15.52:0/2554582606 shutdown_connections 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.388+0000 7f6f53000640 1 -- 172.21.15.52:0/2554582606 wait complete. 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.389+0000 7f6f53000640 1 Processor -- start 2024-09-10T08:38:26.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.389+0000 7f6f53000640 1 -- start start 2024-09-10T08:38:26.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 0x7f6f4c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c0b6950 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c0b67d0 con 0x7f6f4c0b63b0 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f53000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c15e7f0 con 0x7f6f4c0b7c10 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f51c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f51200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 0x7f6f4c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f51c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47362/0 (socket says 172.21.15.52:47362) 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.390+0000 7f6f51c00640 1 -- 172.21.15.52:0/1650983461 learned_addr learned my addr 172.21.15.52:0/1650983461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f52600640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 -- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 msgr2=0x7f6f4c14b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c14b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 -- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 msgr2=0x7f6f4c0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 0x7f6f4c0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 -- 172.21.15.52:0/1650983461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c14bd30 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51200640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 0x7f6f4c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.391+0000 7f6f51c00640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6f40035040 tx=0x7f6f400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.392+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40041030 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.392+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4003d420 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.392+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40037040 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.392+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c15f120 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.392+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c15f6e0 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.393+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4c0d32c0 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.394+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f40044070 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.395+0000 7f6f49600640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:26.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.395+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5609+0+0 (secure 0 0 0) 0x7f6f400ab390 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.395+0000 7f6f51200640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:26.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.396+0000 7f6f51200640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c1f7c20 tx=0x7f6f38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:26.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.400+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f4c14bd30 con 0x7f6f4c0b5fd0 2024-09-10T08:38:26.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:26.621+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6f4c0b4470 con 0x7f6f4c0b5fd0 2024-09-10T08:38:27.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.188+0000 7f6f49600640 1 -- 172.21.15.52:0/1650983461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v106) ==== 174+0+0 (secure 0 0 0) 0x7f6f40079d10 con 0x7f6f4c0b5fd0 2024-09-10T08:38:27.188 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 20 and data pool 21 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 msgr2=0x7f6f2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c1f7c20 tx=0x7f6f38009040 comp rx=0 tx=0).stop 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 msgr2=0x7f6f4c15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6f40035040 tx=0x7f6f400046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 shutdown_connections 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6f2c06be30 0x7f6f2c06e2f0 secure :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c1f7c20 tx=0x7f6f38009040 comp rx=0 tx=0).stop 2024-09-10T08:38:27.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6f4c0b7c10 0x7f6f4c14b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f4c0b63b0 0x7f6f4c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 --2- 172.21.15.52:0/1650983461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f4c0b5fd0 0x7f6f4c15eb40 secure :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6f40035040 tx=0x7f6f400046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.191+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 >> 172.21.15.52:0/1650983461 conn(0x7f6f4c0d0fd0 msgr2=0x7f6f4c0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.192+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 shutdown_connections 2024-09-10T08:38:27.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.192+0000 7f6f53000640 1 -- 172.21.15.52:0/1650983461 wait complete. 2024-09-10T08:38:27.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:27.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.390+0000 7f7752a00640 1 Processor -- start 2024-09-10T08:38:27.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.390+0000 7f7752a00640 1 -- start start 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7752a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 0x7f774c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7752a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f774c0b5880 0x7f774c0b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7752a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774c0b4020 con 0x7f774c145ed0 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7752a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f774c0b42c0 con 0x7f774c0b5880 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7752a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f774c0b45a0 con 0x7f774c073890 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.391+0000 7f7750a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f774c0b5880 0x7f774c0b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f774c0b5880 0x7f774c0b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47364/0 (socket says 172.21.15.52:47364) 2024-09-10T08:38:27.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 -- 172.21.15.52:0/3820767574 learned_addr learned my addr 172.21.15.52:0/3820767574 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 -- 172.21.15.52:0/3820767574 >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 msgr2=0x7f774c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f774b400640 1 --2- 172.21.15.52:0/3820767574 >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 0x7f774c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 --2- 172.21.15.52:0/3820767574 >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 0x7f774c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 -- 172.21.15.52:0/3820767574 >> v1:172.21.15.176:6789/0 conn(0x7f774c145ed0 legacy=0x7f774c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f7750a00640 1 -- 172.21.15.52:0/3820767574 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c0b4880 con 0x7f774c0b5880 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.392+0000 7f774b400640 1 --2- 172.21.15.52:0/3820767574 >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 0x7f774c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.393+0000 7f7750a00640 1 --2- 172.21.15.52:0/3820767574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c0b5880 0x7f774c0b5ce0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f774c070080 tx=0x7f774402a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3caca4a1e250c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.393+0000 7f774aa00640 1 -- 172.21.15.52:0/3820767574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744036070 con 0x7f774c0b5880 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.393+0000 7f774aa00640 1 -- 172.21.15.52:0/3820767574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744031600 con 0x7f774c0b5880 2024-09-10T08:38:27.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.393+0000 7f774aa00640 1 -- 172.21.15.52:0/3820767574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77440319d0 con 0x7f774c0b5880 2024-09-10T08:38:27.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 -- 172.21.15.52:0/3820767574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c0b5880 msgr2=0x7f774c0b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 --2- 172.21.15.52:0/3820767574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c0b5880 0x7f774c0b5ce0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f774c070080 tx=0x7f774402a6b0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 -- 172.21.15.52:0/3820767574 shutdown_connections 2024-09-10T08:38:27.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 --2- 172.21.15.52:0/3820767574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c0b5880 0x7f774c0b5ce0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 --2- 172.21.15.52:0/3820767574 >> v2:172.21.15.176:3300/0 conn(0x7f774c073890 0x7f774c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 -- 172.21.15.52:0/3820767574 >> 172.21.15.52:0/3820767574 conn(0x7f774c0ccec0 msgr2=0x7f774c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 -- 172.21.15.52:0/3820767574 shutdown_connections 2024-09-10T08:38:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.394+0000 7f7752a00640 1 -- 172.21.15.52:0/3820767574 wait complete. 2024-09-10T08:38:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.395+0000 7f7752a00640 1 Processor -- start 2024-09-10T08:38:27.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 -- start start 2024-09-10T08:38:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774c073890 0x7f774c143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774c0b5880 0x7f774c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f774c0b63a0 con 0x7f774c145ed0 2024-09-10T08:38:27.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f774c0b6220 con 0x7f774c073890 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.396+0000 7f7752a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f774c1462b0 con 0x7f774c0b5880 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47368/0 (socket says 172.21.15.52:47368) 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 -- 172.21.15.52:0/1279200444 learned_addr learned my addr 172.21.15.52:0/1279200444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f774be00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774c073890 0x7f774c143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f774b400640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774c0b5880 0x7f774c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 -- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774c0b5880 msgr2=0x7f774c158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774c0b5880 0x7f774c158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 -- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774c073890 msgr2=0x7f774c143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774c073890 0x7f774c143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.397+0000 7f7750a00640 1 -- 172.21.15.52:0/1279200444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c144140 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7750a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7744009f10 tx=0x7f7744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744036050 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7744042070 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744009510 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774c15c000 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.398+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774c15ba40 con 0x7f774c145ed0 2024-09-10T08:38:27.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.399+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774c0b5080 con 0x7f774c145ed0 2024-09-10T08:38:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.400+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7744007bd0 con 0x7f774c145ed0 2024-09-10T08:38:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.401+0000 7f7743e00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 0x7f772c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.401+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7f77440abca0 con 0x7f774c145ed0 2024-09-10T08:38:27.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.401+0000 7f774be00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 0x7f772c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.402+0000 7f774be00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 0x7f772c06e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.406+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f774c144140 con 0x7f774c145ed0 2024-09-10T08:38:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.590+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f774c0cd3d0 con 0x7f774c145ed0 2024-09-10T08:38:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.591+0000 7f7743e00640 1 -- 172.21.15.52:0/1279200444 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16764 (secure 0 0 0) 0x7f7744079ff0 con 0x7f774c145ed0 2024-09-10T08:38:27.592 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:27.592 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":146,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:26.622897+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:38:24.423839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T08:38:25.616439+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 msgr2=0x7f772c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 0x7f772c06e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f773c006fd0 tx=0x7f773c009060 comp rx=0 tx=0).stop 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 msgr2=0x7f774c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7744009f10 tx=0x7f7744004a40 comp rx=0 tx=0).stop 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 shutdown_connections 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f772c06be30 0x7f772c06e2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f774c145ed0 0x7f774c1591d0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f774c0b5880 0x7f774c158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 --2- 172.21.15.52:0/1279200444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f774c073890 0x7f774c143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 >> 172.21.15.52:0/1279200444 conn(0x7f774c0ccec0 msgr2=0x7f774c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 shutdown_connections 2024-09-10T08:38:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.594+0000 7f7752a00640 1 -- 172.21.15.52:0/1279200444 wait complete. 2024-09-10T08:38:27.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:27.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.765+0000 7fe8ed400640 1 Processor -- start 2024-09-10T08:38:27.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.765+0000 7fe8ed400640 1 -- start start 2024-09-10T08:38:27.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8ed400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 0x7fe8e815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8ed400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e8071180 con 0x7fe8e80b2d40 2024-09-10T08:38:27.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8ed400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e8071ab0 con 0x7fe8e813eb20 2024-09-10T08:38:27.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8ed400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e8071460 con 0x7fe8e806c320 2024-09-10T08:38:27.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8dfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8e7200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 0x7fe8e815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8dfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36792/0 (socket says 172.21.15.52:36792) 2024-09-10T08:38:27.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8dfe00640 1 -- 172.21.15.52:0/169463884 learned_addr learned my addr 172.21.15.52:0/169463884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:27.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.767+0000 7fe8e6800640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe8e80b2d40 0x7fe8e806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:43792/0 (socket says 172.21.15.52:43792) 2024-09-10T08:38:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.768+0000 7fe8dfe00640 1 -- 172.21.15.52:0/169463884 >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 msgr2=0x7fe8e815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.768+0000 7fe8dfe00640 1 --2- 172.21.15.52:0/169463884 >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 0x7fe8e815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.768+0000 7fe8dfe00640 1 -- 172.21.15.52:0/169463884 >> v1:172.21.15.176:6789/0 conn(0x7fe8e80b2d40 legacy=0x7fe8e806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.768+0000 7fe8dfe00640 1 -- 172.21.15.52:0/169463884 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e8071740 con 0x7fe8e806c320 2024-09-10T08:38:27.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.768+0000 7fe8e7200640 1 --2- 172.21.15.52:0/169463884 >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 0x7fe8e815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8dfe00640 1 --2- 172.21.15.52:0/169463884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009870 tx=0x7fe8d002c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd817f380bae1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8e5e00640 1 -- 172.21.15.52:0/169463884 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0038070 con 0x7fe8e806c320 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8e5e00640 1 -- 172.21.15.52:0/169463884 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d0031710 con 0x7fe8e806c320 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8e5e00640 1 -- 172.21.15.52:0/169463884 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0031ae0 con 0x7fe8e806c320 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8ed400640 1 -- 172.21.15.52:0/169463884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 msgr2=0x7fe8e815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.769+0000 7fe8ed400640 1 --2- 172.21.15.52:0/169463884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009870 tx=0x7fe8d002c480 comp rx=0 tx=0).stop 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 -- 172.21.15.52:0/169463884 shutdown_connections 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 --2- 172.21.15.52:0/169463884 >> v2:172.21.15.176:3300/0 conn(0x7fe8e813eb20 0x7fe8e815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 --2- 172.21.15.52:0/169463884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e806c320 0x7fe8e815bcf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 -- 172.21.15.52:0/169463884 >> 172.21.15.52:0/169463884 conn(0x7fe8e80ccec0 msgr2=0x7fe8e80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 -- 172.21.15.52:0/169463884 shutdown_connections 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.770+0000 7fe8ed400640 1 -- 172.21.15.52:0/169463884 wait complete. 2024-09-10T08:38:27.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.771+0000 7fe8ed400640 1 Processor -- start 2024-09-10T08:38:27.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.771+0000 7fe8ed400640 1 -- start start 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 0x7fe8e81f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e80b2d40 0x7fe8e80ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80720c0 con 0x7fe8e813eb20 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8071f40 con 0x7fe8e806c320 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.772+0000 7fe8ed400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e8072240 con 0x7fe8e80b2d40 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47370/0 (socket says 172.21.15.52:47370) 2024-09-10T08:38:27.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 0x7fe8e81f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 -- 172.21.15.52:0/2440850968 learned_addr learned my addr 172.21.15.52:0/2440850968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8dfe00640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e80b2d40 0x7fe8e80ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 -- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e80b2d40 msgr2=0x7fe8e80ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e80b2d40 0x7fe8e80ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 -- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 msgr2=0x7fe8e81f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 0x7fe8e81f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 -- 172.21.15.52:0/2440850968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e80c9920 con 0x7fe8e813eb20 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e6800640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 0x7fe8e81f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.773+0000 7fe8e7200640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000efc0 tx=0x7fe8e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.774+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0018020 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.774+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0014480 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.774+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e80c9c00 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.774+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0014870 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.774+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e80ca1c0 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.775+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e806bc10 con 0x7fe8e813eb20 2024-09-10T08:38:27.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.776+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8e0005d10 con 0x7fe8e813eb20 2024-09-10T08:38:27.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.777+0000 7fe8dea00640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 0x7fe8c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:27.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.777+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7fe8e008baa0 con 0x7fe8e813eb20 2024-09-10T08:38:27.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.777+0000 7fe8e6800640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 0x7fe8c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:27.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.778+0000 7fe8e6800640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 0x7fe8c406e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cbd30 tx=0x7fe8d8007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:27.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.781+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8e0022030 con 0x7fe8e813eb20 2024-09-10T08:38:27.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.965+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8e80cc940 con 0x7fe8e813eb20 2024-09-10T08:38:27.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.966+0000 7fe8dea00640 1 -- 172.21.15.52:0/2440850968 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16764 (secure 0 0 0) 0x7fe8e0010040 con 0x7fe8e813eb20 2024-09-10T08:38:27.967 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:27.967 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":146,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:26.622897+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:38:24.423839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T08:38:25.616439+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 msgr2=0x7fe8c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 0x7fe8c406e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cbd30 tx=0x7fe8d8007e80 comp rx=0 tx=0).stop 2024-09-10T08:38:27.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 msgr2=0x7fe8e80caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000efc0 tx=0x7fe8e000c490 comp rx=0 tx=0).stop 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 shutdown_connections 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.968+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe8c406be30 0x7fe8c406e2f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8e813eb20 0x7fe8e80caf00 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8e80b2d40 0x7fe8e80ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 --2- 172.21.15.52:0/2440850968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8e806c320 0x7fe8e81f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 >> 172.21.15.52:0/2440850968 conn(0x7fe8e80ccec0 msgr2=0x7fe8e80cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 shutdown_connections 2024-09-10T08:38:27.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:27.969+0000 7fe8ed400640 1 -- 172.21.15.52:0/2440850968 wait complete. 2024-09-10T08:38:27.985 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:38:28.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.144+0000 7fe031800640 1 Processor -- start 2024-09-10T08:38:28.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.144+0000 7fe031800640 1 -- start start 2024-09-10T08:38:28.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe031800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe02c0cce30 0x7fe02c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe031800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe031800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02c0714b0 con 0x7fe02c0732e0 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe031800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0cd880 con 0x7fe02c0cce30 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe031800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c0cdb60 con 0x7fe02c071c70 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe02aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe02c0732e0 0x7fe02c0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33628/0 (socket says 172.21.15.52:33628) 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe02aa00640 1 -- 172.21.15.52:0/58436089 learned_addr learned my addr 172.21.15.52:0/58436089 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe023e00640 1 --2- 172.21.15.52:0/58436089 >> v2:172.21.15.52:3300/0 conn(0x7fe02c0cce30 0x7fe02c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.145+0000 7fe02b400640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe02a000640 1 -- 172.21.15.52:0/58436089 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809124960 0 0) 0x7fe02c0714b0 con 0x7fe02c0732e0 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe02a000640 1 -- 172.21.15.52:0/58436089 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe010003520 con 0x7fe02c0732e0 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe023e00640 1 -- 172.21.15.52:0/58436089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 msgr2=0x7fe02c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:28.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe023e00640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:28.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe023e00640 1 -- 172.21.15.52:0/58436089 >> v1:172.21.15.52:6789/0 conn(0x7fe02c0732e0 legacy=0x7fe02c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:28.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.146+0000 7fe023e00640 1 -- 172.21.15.52:0/58436089 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0cde40 con 0x7fe02c0cce30 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe023e00640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0cd2a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe0140097a0 tx=0x7fe01402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474174e497be073d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe02a000640 1 -- 172.21.15.52:0/58436089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014037070 con 0x7fe02c0cce30 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe02a000640 1 -- 172.21.15.52:0/58436089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01402ae50 con 0x7fe02c0cce30 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe02a000640 1 -- 172.21.15.52:0/58436089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014032660 con 0x7fe02c0cce30 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe031800640 1 -- 172.21.15.52:0/58436089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 msgr2=0x7fe02c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.147+0000 7fe031800640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0cd2a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fe0140097a0 tx=0x7fe01402a100 comp rx=0 tx=0).stop 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 -- 172.21.15.52:0/58436089 shutdown_connections 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 --2- 172.21.15.52:0/58436089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0cd2a0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:28.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 -- 172.21.15.52:0/58436089 >> 172.21.15.52:0/58436089 conn(0x7fe02c06d0f0 msgr2=0x7fe02c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:28.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 -- 172.21.15.52:0/58436089 shutdown_connections 2024-09-10T08:38:28.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.148+0000 7fe031800640 1 -- 172.21.15.52:0/58436089 wait complete. 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.149+0000 7fe031800640 1 Processor -- start 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.149+0000 7fe031800640 1 -- start start 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c0732e0 0x7fe02c14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c15ca50 con 0x7fe02c0cce30 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c15c8d0 con 0x7fe02c0732e0 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe031800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c15cbd0 con 0x7fe02c071c70 2024-09-10T08:38:28.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.150+0000 7fe02b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47382/0 (socket says 172.21.15.52:47382) 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 -- 172.21.15.52:0/1170387382 learned_addr learned my addr 172.21.15.52:0/1170387382 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02aa00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe023e00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c0732e0 0x7fe02c14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 -- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 msgr2=0x7fe02c153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 -- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c0732e0 msgr2=0x7fe02c14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c0732e0 0x7fe02c14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 -- 172.21.15.52:0/1170387382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c1544a0 con 0x7fe02c0cce30 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02aa00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe02b400640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe024007e70 tx=0x7fe02400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024014620 con 0x7fe02c0cce30 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024019070 con 0x7fe02c0cce30 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024014a20 con 0x7fe02c0cce30 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.151+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c154780 con 0x7fe02c0cce30 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.152+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c154d40 con 0x7fe02c0cce30 2024-09-10T08:38:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.153+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c0cd2a0 con 0x7fe02c0cce30 2024-09-10T08:38:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.154+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe024014bc0 con 0x7fe02c0cce30 2024-09-10T08:38:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.154+0000 7fe022a00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 0x7fe00806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.154+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7fe02408b840 con 0x7fe02c0cce30 2024-09-10T08:38:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.155+0000 7fe02aa00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 0x7fe00806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.155+0000 7fe02aa00640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 0x7fe00806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0011e0 tx=0x7fe01c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:28.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.159+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe02405a1e0 con 0x7fe02c0cce30 2024-09-10T08:38:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:28.384+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe02c073a40 con 0x7fe02c0cce30 2024-09-10T08:38:29.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.223+0000 7fe022a00640 1 -- 172.21.15.52:0/1170387382 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v109) ==== 118+0+0 (secure 0 0 0) 0x7fe024059ae0 con 0x7fe02c0cce30 2024-09-10T08:38:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.225+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 msgr2=0x7fe00806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 0x7fe00806e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0011e0 tx=0x7fe01c009040 comp rx=0 tx=0).stop 2024-09-10T08:38:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 msgr2=0x7fe02c0c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe024007e70 tx=0x7fe02400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 shutdown_connections 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe00806be30 0x7fe00806e2f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02c0cce30 0x7fe02c0c7de0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c0732e0 0x7fe02c14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 --2- 172.21.15.52:0/1170387382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe02c071c70 0x7fe02c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 >> 172.21.15.52:0/1170387382 conn(0x7fe02c06d0f0 msgr2=0x7fe02c15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 shutdown_connections 2024-09-10T08:38:29.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.226+0000 7fe031800640 1 -- 172.21.15.52:0/1170387382 wait complete. 2024-09-10T08:38:29.246 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:38:29.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.411+0000 7fe00f800640 1 Processor -- start 2024-09-10T08:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.411+0000 7fe00f800640 1 -- start start 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00f800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe0080b6620 0x7fe0080b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00f800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe0080b7af0 0x7fe0080b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00f800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0080d4560 con 0x7fe00815ea80 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00f800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe0080b6fb0 con 0x7fe0080b6620 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00f800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe0080d2c80 con 0x7fe0080b7af0 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00ce00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe00815ea80 0x7fe0080d3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33632/0 (socket says 172.21.15.52:33632) 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe00ce00640 1 -- 172.21.15.52:0/2931187686 learned_addr learned my addr 172.21.15.52:0/2931187686 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.412+0000 7fe007e00640 1 --2- 172.21.15.52:0/2931187686 >> v2:172.21.15.52:3300/0 conn(0x7fe0080b6620 0x7fe0080b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe00d800640 1 --2- 172.21.15.52:0/2931187686 >> v2:172.21.15.176:3300/0 conn(0x7fe0080b7af0 0x7fe0080b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe007e00640 1 -- 172.21.15.52:0/2931187686 >> v2:172.21.15.176:3300/0 conn(0x7fe0080b7af0 msgr2=0x7fe0080b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:29.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe007e00640 1 --2- 172.21.15.52:0/2931187686 >> v2:172.21.15.176:3300/0 conn(0x7fe0080b7af0 0x7fe0080b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe007e00640 1 -- 172.21.15.52:0/2931187686 >> v1:172.21.15.52:6789/0 conn(0x7fe00815ea80 legacy=0x7fe0080d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe007e00640 1 -- 172.21.15.52:0/2931187686 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0080d2f60 con 0x7fe0080b6620 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.413+0000 7fe007400640 1 -- 172.21.15.52:0/2931187686 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926375801 0 0) 0x7fe0080d4560 con 0x7fe00815ea80 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.414+0000 7fe007e00640 1 --2- 172.21.15.52:0/2931187686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0080b6620 0x7fe0080b6a70 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe0080b72f0 tx=0x7fdff402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79e834f3107739d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.414+0000 7fe007400640 1 -- 172.21.15.52:0/2931187686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4037070 con 0x7fe0080b6620 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.414+0000 7fe007400640 1 -- 172.21.15.52:0/2931187686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff4032440 con 0x7fe0080b6620 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.414+0000 7fe007400640 1 -- 172.21.15.52:0/2931187686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4032810 con 0x7fe0080b6620 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 -- 172.21.15.52:0/2931187686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0080b6620 msgr2=0x7fe0080b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 --2- 172.21.15.52:0/2931187686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0080b6620 0x7fe0080b6a70 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fe0080b72f0 tx=0x7fdff402a230 comp rx=0 tx=0).stop 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 -- 172.21.15.52:0/2931187686 shutdown_connections 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 --2- 172.21.15.52:0/2931187686 >> v2:172.21.15.176:3300/0 conn(0x7fe0080b7af0 0x7fe0080b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 --2- 172.21.15.52:0/2931187686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0080b6620 0x7fe0080b6a70 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 -- 172.21.15.52:0/2931187686 >> 172.21.15.52:0/2931187686 conn(0x7fe0080d1620 msgr2=0x7fe0080d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:29.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 -- 172.21.15.52:0/2931187686 shutdown_connections 2024-09-10T08:38:29.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.415+0000 7fe00f800640 1 -- 172.21.15.52:0/2931187686 wait complete. 2024-09-10T08:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.416+0000 7fe00f800640 1 Processor -- start 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 -- start start 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0080b6620 0x7fe00815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0080b7af0 0x7fe0080cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0080d3800 con 0x7fe00815ea80 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe0080d3520 con 0x7fe0080b7af0 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.417+0000 7fe00f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe00815ee60 con 0x7fe0080b6620 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47396/0 (socket says 172.21.15.52:47396) 2024-09-10T08:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 -- 172.21.15.52:0/1250877748 learned_addr learned my addr 172.21.15.52:0/1250877748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00ce00640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0080b6620 0x7fe00815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe007e00640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0080b7af0 0x7fe0080cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 -- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0080b6620 msgr2=0x7fe00815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0080b6620 0x7fe00815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 -- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0080b7af0 msgr2=0x7fe0080cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0080b7af0 0x7fe0080cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 -- 172.21.15.52:0/1250877748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe008159f40 con 0x7fe00815ea80 2024-09-10T08:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.418+0000 7fe00d800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe00000efc0 tx=0x7fe00000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.419+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000018020 con 0x7fe00815ea80 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.419+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe000014480 con 0x7fe00815ea80 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.419+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000014870 con 0x7fe00815ea80 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.419+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00815a220 con 0x7fe00815ea80 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.419+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00815a7e0 con 0x7fe00815ea80 2024-09-10T08:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.420+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0080d2810 con 0x7fe00815ea80 2024-09-10T08:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.421+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe000005d10 con 0x7fe00815ea80 2024-09-10T08:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.422+0000 7fe004c00640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 0x7fdfe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.422+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fe00008bc40 con 0x7fe00815ea80 2024-09-10T08:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.422+0000 7fe00ce00640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 0x7fdfe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.423+0000 7fe00ce00640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 0x7fdfe806e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdffc007fd0 tx=0x7fdffc007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.426+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe000022030 con 0x7fe00815ea80 2024-09-10T08:38:29.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:29.649+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe0080b9740 con 0x7fe00815ea80 2024-09-10T08:38:30.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.228+0000 7fe004c00640 1 -- 172.21.15.52:0/1250877748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v110) ==== 122+0+0 (secure 0 0 0) 0x7fe000010040 con 0x7fe00815ea80 2024-09-10T08:38:30.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 msgr2=0x7fdfe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 0x7fdfe806e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdffc007fd0 tx=0x7fdffc007de0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 msgr2=0x7fe0081519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe00000efc0 tx=0x7fe00000c490 comp rx=0 tx=0).stop 2024-09-10T08:38:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 shutdown_connections 2024-09-10T08:38:30.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdfe806be30 0x7fdfe806e2f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe00815ea80 0x7fe0081519f0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe0080b7af0 0x7fe0080cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 --2- 172.21.15.52:0/1250877748 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe0080b6620 0x7fe00815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.231+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 >> 172.21.15.52:0/1250877748 conn(0x7fe0080d1620 msgr2=0x7fe0080cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.232+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 shutdown_connections 2024-09-10T08:38:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.232+0000 7fe00f800640 1 -- 172.21.15.52:0/1250877748 wait complete. 2024-09-10T08:38:30.250 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:38:30.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.409+0000 7f643c600640 1 Processor -- start 2024-09-10T08:38:30.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.409+0000 7f643c600640 1 -- start start 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643c600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643c600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64340d0e70 con 0x7f64340d23b0 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643c600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64340d41c0 con 0x7f643415ed20 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643c600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f64340d35b0 con 0x7f64340b6970 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643a600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f64340d23b0 0x7f64340b8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33646/0 (socket says 172.21.15.52:33646) 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.410+0000 7f643a600640 1 -- 172.21.15.52:0/1065560968 learned_addr learned my addr 172.21.15.52:0/1065560968 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6439200640 1 --2- 172.21.15.52:0/1065560968 >> v2:172.21.15.176:3300/0 conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6433e00640 1 -- 172.21.15.52:0/1065560968 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748508522 0 0) 0x7f642c001490 con 0x7f64340d23b0 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6433e00640 1 -- 172.21.15.52:0/1065560968 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f641c003520 con 0x7f64340d23b0 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6439200640 1 -- 172.21.15.52:0/1065560968 >> v1:172.21.15.176:6789/0 conn(0x7f643415ed20 legacy=0x7f64340b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6439200640 1 -- 172.21.15.52:0/1065560968 >> v1:172.21.15.52:6789/0 conn(0x7f64340d23b0 legacy=0x7f64340b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.411+0000 7f6439200640 1 -- 172.21.15.52:0/1065560968 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64340d3890 con 0x7f64340b6970 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.412+0000 7f6439200640 1 --2- 172.21.15.52:0/1065560968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f64200097a0 tx=0x7f642002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28cbf5aa29abae49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.412+0000 7f6433e00640 1 -- 172.21.15.52:0/1065560968 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420037070 con 0x7f64340b6970 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f6433e00640 1 -- 172.21.15.52:0/1065560968 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420032440 con 0x7f64340b6970 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f6433e00640 1 -- 172.21.15.52:0/1065560968 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420032810 con 0x7f64340b6970 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 -- 172.21.15.52:0/1065560968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64340b6970 msgr2=0x7f64340b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 --2- 172.21.15.52:0/1065560968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f64200097a0 tx=0x7f642002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 -- 172.21.15.52:0/1065560968 shutdown_connections 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 --2- 172.21.15.52:0/1065560968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 -- 172.21.15.52:0/1065560968 >> 172.21.15.52:0/1065560968 conn(0x7f64340d1260 msgr2=0x7f64340d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:30.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 -- 172.21.15.52:0/1065560968 shutdown_connections 2024-09-10T08:38:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.413+0000 7f643c600640 1 -- 172.21.15.52:0/1065560968 wait complete. 2024-09-10T08:38:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.415+0000 7f643c600640 1 Processor -- start 2024-09-10T08:38:30.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.415+0000 7f643c600640 1 -- start start 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 0x7f64340acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 0x7f64340ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f64340d32a0 con 0x7f64340d23b0 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f64340d3e50 con 0x7f643415ed20 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643c600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f643415f100 con 0x7f64340b6970 2024-09-10T08:38:30.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47410/0 (socket says 172.21.15.52:47410) 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 -- 172.21.15.52:0/70611084 learned_addr learned my addr 172.21.15.52:0/70611084 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643a600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 0x7f64340ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 -- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 msgr2=0x7f64340acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439c00640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 0x7f64340acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 0x7f64340acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 -- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 msgr2=0x7f64340ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 0x7f64340ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f6439200640 1 -- 172.21.15.52:0/70611084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64340abb00 con 0x7f64340d23b0 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.416+0000 7f643a600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 0x7f64340ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f6439c00640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 0x7f64340acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:30.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f6439200640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f6420035040 tx=0x7f64200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420037040 con 0x7f64340d23b0 2024-09-10T08:38:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6420030500 con 0x7f64340d23b0 2024-09-10T08:38:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420030910 con 0x7f64340d23b0 2024-09-10T08:38:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64340abde0 con 0x7f64340d23b0 2024-09-10T08:38:30.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.417+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64340ac3a0 con 0x7f64340d23b0 2024-09-10T08:38:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.418+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64340b7010 con 0x7f64340d23b0 2024-09-10T08:38:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.420+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6420044020 con 0x7f64340d23b0 2024-09-10T08:38:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.420+0000 7f6431600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 0x7f641406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.420+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f64200ab170 con 0x7f64340d23b0 2024-09-10T08:38:30.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.421+0000 7f6439c00640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 0x7f641406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.422+0000 7f6439c00640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 0x7f641406e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6428001680 tx=0x7f6428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.425+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6420079b10 con 0x7f64340d23b0 2024-09-10T08:38:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.645+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64340d0a90 con 0x7f64340d23b0 2024-09-10T08:38:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.646+0000 7f6431600640 1 -- 172.21.15.52:0/70611084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f6420079410 con 0x7f64340d23b0 2024-09-10T08:38:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:30.647 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:38:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:38:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 msgr2=0x7f641406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 0x7f641406e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6428001680 tx=0x7f6428009040 comp rx=0 tx=0).stop 2024-09-10T08:38:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 msgr2=0x7f64340ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f6420035040 tx=0x7f64200046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 shutdown_connections 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f641406be30 0x7f641406e2f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.648+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643415ed20 0x7f64340ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.649+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64340d23b0 0x7f64340ad380 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.649+0000 7f643c600640 1 --2- 172.21.15.52:0/70611084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f64340b6970 0x7f64340acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.649+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 >> 172.21.15.52:0/70611084 conn(0x7f64340d1260 msgr2=0x7f643415d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.649+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 shutdown_connections 2024-09-10T08:38:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.649+0000 7f643c600640 1 -- 172.21.15.52:0/70611084 wait complete. 2024-09-10T08:38:30.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:38:30.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.821+0000 7f781ce00640 1 Processor -- start 2024-09-10T08:38:30.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.821+0000 7f781ce00640 1 -- start start 2024-09-10T08:38:30.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f781ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7818147e80 0x7f7818070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f781ce00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7818071b30 con 0x7f7818148260 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f781ce00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78180b3510 con 0x7f781806c320 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f781ce00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7818074200 con 0x7f7818147e80 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f7815e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7818147e80 0x7f7818070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f7815e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7818147e80 0x7f7818070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47414/0 (socket says 172.21.15.52:47414) 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f7815e00640 1 -- 172.21.15.52:0/263508475 learned_addr learned my addr 172.21.15.52:0/263508475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:30.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.822+0000 7f780fe00640 1 --1- 172.21.15.52:0/263508475 >> v1:172.21.15.52:6789/0 conn(0x7f7818148260 0x7f781806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33650/0 (socket says 172.21.15.52:33650) 2024-09-10T08:38:30.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.823+0000 7f7815e00640 1 -- 172.21.15.52:0/263508475 >> v1:172.21.15.176:6789/0 conn(0x7f781806c320 legacy=0x7f78180b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.823+0000 7f7815e00640 1 -- 172.21.15.52:0/263508475 >> v1:172.21.15.52:6789/0 conn(0x7f7818148260 legacy=0x7f781806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.823+0000 7f7815e00640 1 -- 172.21.15.52:0/263508475 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78180b37f0 con 0x7f7818147e80 2024-09-10T08:38:30.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f7815e00640 1 --2- 172.21.15.52:0/263508475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7818147e80 0x7f7818070f70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7808009870 tx=0x7f780802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10651838789e3c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f7815400640 1 -- 172.21.15.52:0/263508475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808037070 con 0x7f7818147e80 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f7815400640 1 -- 172.21.15.52:0/263508475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780802ae50 con 0x7f7818147e80 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f7815400640 1 -- 172.21.15.52:0/263508475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808032860 con 0x7f7818147e80 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f781ce00640 1 -- 172.21.15.52:0/263508475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7818147e80 msgr2=0x7f7818070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.824+0000 7f781ce00640 1 --2- 172.21.15.52:0/263508475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7818147e80 0x7f7818070f70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f7808009870 tx=0x7f780802a300 comp rx=0 tx=0).stop 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.825+0000 7f781ce00640 1 -- 172.21.15.52:0/263508475 shutdown_connections 2024-09-10T08:38:30.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.825+0000 7f781ce00640 1 --2- 172.21.15.52:0/263508475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7818147e80 0x7f7818070f70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.825+0000 7f781ce00640 1 -- 172.21.15.52:0/263508475 >> 172.21.15.52:0/263508475 conn(0x7f78180ccec0 msgr2=0x7f78180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:30.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.825+0000 7f781ce00640 1 -- 172.21.15.52:0/263508475 shutdown_connections 2024-09-10T08:38:30.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.825+0000 7f781ce00640 1 -- 172.21.15.52:0/263508475 wait complete. 2024-09-10T08:38:30.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.826+0000 7f781ce00640 1 Processor -- start 2024-09-10T08:38:30.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.826+0000 7f781ce00640 1 -- start start 2024-09-10T08:38:30.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7818147e80 0x7f78181e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7818148260 0x7f78181e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78180714b0 con 0x7f781806c320 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78180b3e40 con 0x7f7818148260 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.827+0000 7f781ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7818071630 con 0x7f7818147e80 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47426/0 (socket says 172.21.15.52:47426) 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 -- 172.21.15.52:0/2953799879 learned_addr learned my addr 172.21.15.52:0/2953799879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f780fe00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7818147e80 0x7f78181e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7816800640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7818148260 0x7f78181e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 -- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7818147e80 msgr2=0x7f78181e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7818147e80 0x7f78181e5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 -- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7818148260 msgr2=0x7f78181e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:30.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7818148260 0x7f78181e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:30.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 -- 172.21.15.52:0/2953799879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7818145fa0 con 0x7f781806c320 2024-09-10T08:38:30.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.828+0000 7f7815e00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f7808000c00 tx=0x7f78080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.829+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808041070 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.829+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780803c890 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.829+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808037040 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.829+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7818146280 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.829+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7818146840 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.830+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7818070f70 con 0x7f781806c320 2024-09-10T08:38:30.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.831+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7808044070 con 0x7f781806c320 2024-09-10T08:38:30.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.832+0000 7f780e000640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 0x7f77f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:30.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.832+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f78080ab930 con 0x7f781806c320 2024-09-10T08:38:30.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.832+0000 7f780fe00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 0x7f77f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:30.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.833+0000 7f780fe00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 0x7f77f406e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f78180cffb0 tx=0x7f7800007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:30.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:30.836+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f780807a3f0 con 0x7f781806c320 2024-09-10T08:38:31.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.022+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f781806c9c0 con 0x7f781806c320 2024-09-10T08:38:31.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.023+0000 7f780e000640 1 -- 172.21.15.52:0/2953799879 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16751 (secure 0 0 0) 0x7f7808079cf0 con 0x7f781806c320 2024-09-10T08:38:31.024 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:31.024 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":147,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:28.188803+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:38:24.423839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T08:38:25.616439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 msgr2=0x7f77f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 0x7f77f406e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f78180cffb0 tx=0x7f7800007c80 comp rx=0 tx=0).stop 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 msgr2=0x7f781815e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f7808000c00 tx=0x7f78080046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 shutdown_connections 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f77f406be30 0x7f77f406e2f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7818148260 0x7f78181e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7818147e80 0x7f78181e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 --2- 172.21.15.52:0/2953799879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f781806c320 0x7f781815e1a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.025+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 >> 172.21.15.52:0/2953799879 conn(0x7f78180ccec0 msgr2=0x7f781812d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.026+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 shutdown_connections 2024-09-10T08:38:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.026+0000 7f781ce00640 1 -- 172.21.15.52:0/2953799879 wait complete. 2024-09-10T08:38:31.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:38:31.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:38:31.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.198+0000 7f97cc200640 1 Processor -- start 2024-09-10T08:38:31.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.198+0000 7f97cc200640 1 -- start start 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.199+0000 7f97cc200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97c4073890 0x7f97c40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.199+0000 7f97cc200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40b4020 con 0x7f97c4145ed0 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.199+0000 7f97cc200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97c40b42c0 con 0x7f97c40b5880 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.199+0000 7f97cc200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f97c40b63f0 con 0x7f97c4073890 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c9800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97c4145ed0 0x7f97c4073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33662/0 (socket says 172.21.15.52:33662) 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c9800640 1 -- 172.21.15.52:0/3411309635 learned_addr learned my addr 172.21.15.52:0/3411309635 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:31.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c8e00640 1 --2- 172.21.15.52:0/3411309635 >> v2:172.21.15.52:3300/0 conn(0x7f97c4073890 0x7f97c40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c3e00640 1 -- 172.21.15.52:0/3411309635 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412554339 0 0) 0x7f97c40b4020 con 0x7f97c4145ed0 2024-09-10T08:38:31.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c8e00640 1 -- 172.21.15.52:0/3411309635 >> v1:172.21.15.176:6789/0 conn(0x7f97c40b5880 legacy=0x7f97c40b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:31.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c8e00640 1 -- 172.21.15.52:0/3411309635 >> v1:172.21.15.52:6789/0 conn(0x7f97c4145ed0 legacy=0x7f97c4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.200+0000 7f97c8e00640 1 -- 172.21.15.52:0/3411309635 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c40b45a0 con 0x7f97c4073890 2024-09-10T08:38:31.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.201+0000 7f97c8e00640 1 --2- 172.21.15.52:0/3411309635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c40b5080 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f97b00097a0 tx=0x7f97b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f0390c66a44561 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97c3e00640 1 -- 172.21.15.52:0/3411309635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0037070 con 0x7f97c4073890 2024-09-10T08:38:31.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97c3e00640 1 -- 172.21.15.52:0/3411309635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b0032440 con 0x7f97c4073890 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97c3e00640 1 -- 172.21.15.52:0/3411309635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0032810 con 0x7f97c4073890 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 -- 172.21.15.52:0/3411309635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 msgr2=0x7f97c40b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 --2- 172.21.15.52:0/3411309635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c40b5080 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f97b00097a0 tx=0x7f97b002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 -- 172.21.15.52:0/3411309635 shutdown_connections 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 --2- 172.21.15.52:0/3411309635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c40b5080 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 -- 172.21.15.52:0/3411309635 >> 172.21.15.52:0/3411309635 conn(0x7f97c40ccec0 msgr2=0x7f97c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:31.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 -- 172.21.15.52:0/3411309635 shutdown_connections 2024-09-10T08:38:31.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.202+0000 7f97cc200640 1 -- 172.21.15.52:0/3411309635 wait complete. 2024-09-10T08:38:31.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.204+0000 7f97cc200640 1 Processor -- start 2024-09-10T08:38:31.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.204+0000 7f97cc200640 1 -- start start 2024-09-10T08:38:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 0x7f97c40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c4145ed0 0x7f97c40d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41462b0 con 0x7f97c4073890 2024-09-10T08:38:31.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97c40b4b60 con 0x7f97c4145ed0 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97cc200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f97c4146430 con 0x7f97c40b5880 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97c9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97c9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47452/0 (socket says 172.21.15.52:47452) 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97c9800640 1 -- 172.21.15.52:0/607140199 learned_addr learned my addr 172.21.15.52:0/607140199 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97c8e00640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 0x7f97c40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.205+0000 7f97ca200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c4145ed0 0x7f97c40d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 -- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 msgr2=0x7f97c40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 0x7f97c40cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 -- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c4145ed0 msgr2=0x7f97c40d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c4145ed0 0x7f97c40d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 -- 172.21.15.52:0/607140199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c4140730 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c8e00640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 0x7f97c40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c9800640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c430 tx=0x7f97b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8017070 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b8005ce0 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8007310 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c4140a10 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.206+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c41565e0 con 0x7f97c4073890 2024-09-10T08:38:31.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.207+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c40b5080 con 0x7f97c4073890 2024-09-10T08:38:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.208+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97b801a070 con 0x7f97c4073890 2024-09-10T08:38:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.209+0000 7f97c1600640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.209+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f97b808a2b0 con 0x7f97c4073890 2024-09-10T08:38:31.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.209+0000 7f97c8e00640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.210+0000 7f97c8e00640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.213+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97b8058c50 con 0x7f97c4073890 2024-09-10T08:38:31.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.393+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97c41448e0 con 0x7f97a406be30 2024-09-10T08:38:31.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.401+0000 7f97c1600640 1 -- 172.21.15.52:0/607140199 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238952 (secure 0 0 0) 0x7f97c41448e0 con 0x7f97a406be30 2024-09-10T08:38:31.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:31.407 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 msgr2=0x7f97a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 0x7f97a406e2f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f97b0034000 tx=0x7f97b002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 msgr2=0x7f97c41400c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f97b800c430 tx=0x7f97b800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 shutdown_connections 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f97a406be30 0x7f97a406e2f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c4145ed0 0x7f97c40d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c40b5880 0x7f97c40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 --2- 172.21.15.52:0/607140199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97c4073890 0x7f97c41400c0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.404+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 >> 172.21.15.52:0/607140199 conn(0x7f97c40ccec0 msgr2=0x7f97c4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:31.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.405+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 shutdown_connections 2024-09-10T08:38:31.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.405+0000 7f97cc200640 1 -- 172.21.15.52:0/607140199 wait complete. 2024-09-10T08:38:31.422 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-09-10T08:38:29.599387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":22,"acting":22,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":389612,"kb_used_data":15140,"kb_used_omap":12,"kb_used_meta":374259,"kb_avail":754585108,"statfs":{"total":773094113280,"available":772695150592,"internally_reserved":0,"allocated":15503360,"data_stored":7428721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":383241776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.419046"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801403+0000","last_change":"2024-09-10T08:38:27.204641+0000","last_active":"2024-09-10T08:38:28.801403+0000","last_peered":"2024-09-10T08:38:28.801403+0000","last_clean":"2024-09-10T08:38:28.801403+0000","last_became_active":"2024-09-10T08:38:27.204363+0000","last_became_peered":"2024-09-10T08:38:27.204363+0000","last_unstale":"2024-09-10T08:38:28.801403+0000","last_undegraded":"2024-09-10T08:38:28.801403+0000","last_fullsized":"2024-09-10T08:38:28.801403+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:52.130681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801404+0000","last_change":"2024-09-10T08:38:27.209537+0000","last_active":"2024-09-10T08:38:28.801404+0000","last_peered":"2024-09-10T08:38:28.801404+0000","last_clean":"2024-09-10T08:38:28.801404+0000","last_became_active":"2024-09-10T08:38:27.209137+0000","last_became_peered":"2024-09-10T08:38:27.209137+0000","last_unstale":"2024-09-10T08:38:28.801404+0000","last_undegraded":"2024-09-10T08:38:28.801404+0000","last_fullsized":"2024-09-10T08:38:28.801404+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:16.468638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802546+0000","last_change":"2024-09-10T08:38:27.210600+0000","last_active":"2024-09-10T08:38:28.802546+0000","last_peered":"2024-09-10T08:38:28.802546+0000","last_clean":"2024-09-10T08:38:28.802546+0000","last_became_active":"2024-09-10T08:38:27.210349+0000","last_became_peered":"2024-09-10T08:38:27.210349+0000","last_unstale":"2024-09-10T08:38:28.802546+0000","last_undegraded":"2024-09-10T08:38:28.802546+0000","last_fullsized":"2024-09-10T08:38:28.802546+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:49.890901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802656+0000","last_change":"2024-09-10T08:38:27.209424+0000","last_active":"2024-09-10T08:38:28.802656+0000","last_peered":"2024-09-10T08:38:28.802656+0000","last_clean":"2024-09-10T08:38:28.802656+0000","last_became_active":"2024-09-10T08:38:27.209106+0000","last_became_peered":"2024-09-10T08:38:27.209106+0000","last_unstale":"2024-09-10T08:38:28.802656+0000","last_undegraded":"2024-09-10T08:38:28.802656+0000","last_fullsized":"2024-09-10T08:38:28.802656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:56.349099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"146'6","reported_seq":20,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802031+0000","last_change":"2024-09-10T08:38:26.205200+0000","last_active":"2024-09-10T08:38:28.802031+0000","last_peered":"2024-09-10T08:38:28.802031+0000","last_clean":"2024-09-10T08:38:28.802031+0000","last_became_active":"2024-09-10T08:38:26.204925+0000","last_became_peered":"2024-09-10T08:38:26.204925+0000","last_unstale":"2024-09-10T08:38:28.802031+0000","last_undegraded":"2024-09-10T08:38:28.802031+0000","last_fullsized":"2024-09-10T08:38:28.802031+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:51.242403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802418+0000","last_change":"2024-09-10T08:38:26.207678+0000","last_active":"2024-09-10T08:38:28.802418+0000","last_peered":"2024-09-10T08:38:28.802418+0000","last_clean":"2024-09-10T08:38:28.802418+0000","last_became_active":"2024-09-10T08:38:26.207385+0000","last_became_peered":"2024-09-10T08:38:26.207385+0000","last_unstale":"2024-09-10T08:38:28.802418+0000","last_undegraded":"2024-09-10T08:38:28.802418+0000","last_fullsized":"2024-09-10T08:38:28.802418+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:42.066301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802524+0000","last_change":"2024-09-10T08:38:26.204512+0000","last_active":"2024-09-10T08:38:28.802524+0000","last_peered":"2024-09-10T08:38:28.802524+0000","last_clean":"2024-09-10T08:38:28.802524+0000","last_became_active":"2024-09-10T08:38:26.204185+0000","last_became_peered":"2024-09-10T08:38:26.204185+0000","last_unstale":"2024-09-10T08:38:28.802524+0000","last_undegraded":"2024-09-10T08:38:28.802524+0000","last_fullsized":"2024-09-10T08:38:28.802524+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:59.844270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802060+0000","last_change":"2024-09-10T08:38:26.210291+0000","last_active":"2024-09-10T08:38:28.802060+0000","last_peered":"2024-09-10T08:38:28.802060+0000","last_clean":"2024-09-10T08:38:28.802060+0000","last_became_active":"2024-09-10T08:38:26.210018+0000","last_became_peered":"2024-09-10T08:38:26.210018+0000","last_unstale":"2024-09-10T08:38:28.802060+0000","last_undegraded":"2024-09-10T08:38:28.802060+0000","last_fullsized":"2024-09-10T08:38:28.802060+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:17.753978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801855+0000","last_change":"2024-09-10T08:38:27.209105+0000","last_active":"2024-09-10T08:38:28.801855+0000","last_peered":"2024-09-10T08:38:28.801855+0000","last_clean":"2024-09-10T08:38:28.801855+0000","last_became_active":"2024-09-10T08:38:27.208756+0000","last_became_peered":"2024-09-10T08:38:27.208756+0000","last_unstale":"2024-09-10T08:38:28.801855+0000","last_undegraded":"2024-09-10T08:38:28.801855+0000","last_fullsized":"2024-09-10T08:38:28.801855+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:21.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:26.180090+0000","last_change":"2024-09-10T08:38:26.180090+0000","last_active":"2024-09-10T08:38:26.180090+0000","last_peered":"2024-09-10T08:38:26.180090+0000","last_clean":"2024-09-10T08:38:26.180090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:26.180090+0000","last_undegraded":"2024-09-10T08:38:26.180090+0000","last_fullsized":"2024-09-10T08:38:26.180090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801963+0000","last_change":"2024-09-10T08:38:27.224116+0000","last_active":"2024-09-10T08:38:28.801963+0000","last_peered":"2024-09-10T08:38:28.801963+0000","last_clean":"2024-09-10T08:38:28.801963+0000","last_became_active":"2024-09-10T08:38:27.223814+0000","last_became_peered":"2024-09-10T08:38:27.223814+0000","last_unstale":"2024-09-10T08:38:28.801963+0000","last_undegraded":"2024-09-10T08:38:28.801963+0000","last_fullsized":"2024-09-10T08:38:28.801963+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:51.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-10T08:38:25.176861+0000","last_change":"2024-09-10T08:38:25.176861+0000","last_active":"2024-09-10T08:38:25.176861+0000","last_peered":"2024-09-10T08:38:25.176861+0000","last_clean":"2024-09-10T08:38:25.176861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:38:25.176861+0000","last_undegraded":"2024-09-10T08:38:25.176861+0000","last_fullsized":"2024-09-10T08:38:25.176861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":388,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-10T08:38:23.500040+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:38:23.500040+0000","last_peered":"2024-09-10T08:38:23.500040+0000","last_clean":"2024-09-10T08:38:23.500040+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:38:23.500040+0000","last_undegraded":"2024-09-10T08:38:23.500040+0000","last_fullsized":"2024-09-10T08:38:23.500040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28776,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343064,"statfs":{"total":96636764160,"available":96607297536,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50976,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320864,"statfs":{"total":96636764160,"available":96584564736,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55148,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316692,"statfs":{"total":96636764160,"available":96580292608,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59296,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312544,"statfs":{"total":96636764160,"available":96576045056,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55136,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316704,"statfs":{"total":96636764160,"available":96580304896,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509561,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2375680,"data_stored":1368782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509563,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32940,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1781760,"data_stored":778414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542265,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55776,"kb_used_data":2380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316064,"statfs":{"total":96636764160,"available":96579649536,"internally_reserved":0,"allocated":2437120,"data_stored":1389455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:38:31.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:38:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.618+0000 7f5336600640 1 Processor -- start 2024-09-10T08:38:31.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.618+0000 7f5336600640 1 -- start start 2024-09-10T08:38:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5336600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53300b63f0 0x7f53300cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5336600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 0x7f53300cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5336600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53300cfb40 con 0x7f53300b7a30 2024-09-10T08:38:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5336600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f53300d27f0 con 0x7f53300b63f0 2024-09-10T08:38:31.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5336600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f53300cfe20 con 0x7f53300b67d0 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5335200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53300b63f0 0x7f53300cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5335200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53300b63f0 0x7f53300cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47466/0 (socket says 172.21.15.52:47466) 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5335200640 1 -- 172.21.15.52:0/2321331544 learned_addr learned my addr 172.21.15.52:0/2321331544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.619+0000 7f5335c00640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 0x7f53300cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.620+0000 7f5335200640 1 -- 172.21.15.52:0/2321331544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 msgr2=0x7f53300cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.620+0000 7f5335200640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 0x7f53300cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.620+0000 7f5335200640 1 -- 172.21.15.52:0/2321331544 >> v1:172.21.15.52:6789/0 conn(0x7f53300b7a30 legacy=0x7f533015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.620+0000 7f5335200640 1 -- 172.21.15.52:0/2321331544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300d2e00 con 0x7f53300b63f0 2024-09-10T08:38:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.620+0000 7f5335c00640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 0x7f53300cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.621+0000 7f5335200640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300cef60 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f532402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a425101769f52135 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.621+0000 7f532f400640 1 -- 172.21.15.52:0/2321331544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324036070 con 0x7f53300b63f0 2024-09-10T08:38:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.621+0000 7f532f400640 1 -- 172.21.15.52:0/2321331544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5324031600 con 0x7f53300b63f0 2024-09-10T08:38:31.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.621+0000 7f532f400640 1 -- 172.21.15.52:0/2321331544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240319d0 con 0x7f53300b63f0 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 -- 172.21.15.52:0/2321331544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 msgr2=0x7f53300cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300cef60 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5324009e50 tx=0x7f532402a710 comp rx=0 tx=0).stop 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 -- 172.21.15.52:0/2321331544 shutdown_connections 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b67d0 0x7f53300cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 --2- 172.21.15.52:0/2321331544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300cef60 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 -- 172.21.15.52:0/2321331544 >> 172.21.15.52:0/2321331544 conn(0x7f53300d1360 msgr2=0x7f53300d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:31.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 -- 172.21.15.52:0/2321331544 shutdown_connections 2024-09-10T08:38:31.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.622+0000 7f5336600640 1 -- 172.21.15.52:0/2321331544 wait complete. 2024-09-10T08:38:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.623+0000 7f5336600640 1 Processor -- start 2024-09-10T08:38:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 -- start start 2024-09-10T08:38:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53300b67d0 0x7f533015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b7a30 0x7f533015a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f533015e810 con 0x7f53300b63f0 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f533015e690 con 0x7f53300b67d0 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.624+0000 7f5336600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f533015e990 con 0x7f53300b7a30 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47470/0 (socket says 172.21.15.52:47470) 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 -- 172.21.15.52:0/1534169422 learned_addr learned my addr 172.21.15.52:0/1534169422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335c00640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b7a30 0x7f533015a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f532fe00640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53300b67d0 0x7f533015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 -- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b7a30 msgr2=0x7f533015a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b7a30 0x7f533015a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 -- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53300b67d0 msgr2=0x7f533015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53300b67d0 0x7f533015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.625+0000 7f5335200640 1 -- 172.21.15.52:0/1534169422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5330154020 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f5335200640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5324034040 tx=0x7f5324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324036050 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5324042070 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324009510 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300c9570 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.626+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53300c9b30 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.627+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533015df80 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.628+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5324007c50 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.629+0000 7f532cc00640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 0x7f531006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.629+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f53240abcc0 con 0x7f53300b63f0 2024-09-10T08:38:31.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.629+0000 7f532fe00640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 0x7f531006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:31.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.630+0000 7f532fe00640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 0x7f531006e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5330154280 tx=0x7f531c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:31.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.633+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53240b2080 con 0x7f53300b63f0 2024-09-10T08:38:31.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.815+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53300b91b0 con 0x7f531006be30 2024-09-10T08:38:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.822+0000 7f532cc00640 1 -- 172.21.15.52:0/1534169422 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7f53300b91b0 con 0x7f531006be30 2024-09-10T08:38:31.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:31.827 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 msgr2=0x7f531006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 0x7f531006e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5330154280 tx=0x7f531c009040 comp rx=0 tx=0).stop 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 msgr2=0x7f53300ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5324034040 tx=0x7f5324004a40 comp rx=0 tx=0).stop 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 shutdown_connections 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f531006be30 0x7f531006e2f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f53300b7a30 0x7f533015a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f53300b67d0 0x7f533015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 --2- 172.21.15.52:0/1534169422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53300b63f0 0x7f53300ca610 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 >> 172.21.15.52:0/1534169422 conn(0x7f53300d1360 msgr2=0x7f533015efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.826+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 shutdown_connections 2024-09-10T08:38:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:31.827+0000 7f5336600640 1 -- 172.21.15.52:0/1534169422 wait complete. 2024-09-10T08:38:31.844 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-09-10T08:38:31.599912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":408024,"kb_used_data":15516,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754566696,"statfs":{"total":773094113280,"available":772676296704,"internally_reserved":0,"allocated":15888384,"data_stored":7607904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001622"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.195021+0000","last_change":"2024-09-10T08:38:27.203913+0000","last_active":"2024-09-10T08:38:28.195021+0000","last_peered":"2024-09-10T08:38:28.195021+0000","last_clean":"2024-09-10T08:38:28.195021+0000","last_became_active":"2024-09-10T08:38:27.203216+0000","last_became_peered":"2024-09-10T08:38:27.203216+0000","last_unstale":"2024-09-10T08:38:28.195021+0000","last_undegraded":"2024-09-10T08:38:28.195021+0000","last_fullsized":"2024-09-10T08:38:28.195021+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:37.655388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802341+0000","last_change":"2024-09-10T08:38:27.217926+0000","last_active":"2024-09-10T08:38:28.802341+0000","last_peered":"2024-09-10T08:38:28.802341+0000","last_clean":"2024-09-10T08:38:28.802341+0000","last_became_active":"2024-09-10T08:38:27.217634+0000","last_became_peered":"2024-09-10T08:38:27.217634+0000","last_unstale":"2024-09-10T08:38:28.802341+0000","last_undegraded":"2024-09-10T08:38:28.802341+0000","last_fullsized":"2024-09-10T08:38:28.802341+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:51.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500800+0000","last_change":"2024-09-10T08:38:27.227980+0000","last_active":"2024-09-10T08:38:28.500800+0000","last_peered":"2024-09-10T08:38:28.500800+0000","last_clean":"2024-09-10T08:38:28.500800+0000","last_became_active":"2024-09-10T08:38:27.227688+0000","last_became_peered":"2024-09-10T08:38:27.227688+0000","last_unstale":"2024-09-10T08:38:28.500800+0000","last_undegraded":"2024-09-10T08:38:28.500800+0000","last_fullsized":"2024-09-10T08:38:28.500800+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:07.663899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801052+0000","last_change":"2024-09-10T08:38:27.231491+0000","last_active":"2024-09-10T08:38:28.801052+0000","last_peered":"2024-09-10T08:38:28.801052+0000","last_clean":"2024-09-10T08:38:28.801052+0000","last_became_active":"2024-09-10T08:38:27.228788+0000","last_became_peered":"2024-09-10T08:38:27.228788+0000","last_unstale":"2024-09-10T08:38:28.801052+0000","last_undegraded":"2024-09-10T08:38:28.801052+0000","last_fullsized":"2024-09-10T08:38:28.801052+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:33.454626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194581+0000","last_change":"2024-09-10T08:38:27.231418+0000","last_active":"2024-09-10T08:38:28.194581+0000","last_peered":"2024-09-10T08:38:28.194581+0000","last_clean":"2024-09-10T08:38:28.194581+0000","last_became_active":"2024-09-10T08:38:27.229686+0000","last_became_peered":"2024-09-10T08:38:27.229686+0000","last_unstale":"2024-09-10T08:38:28.194581+0000","last_undegraded":"2024-09-10T08:38:28.194581+0000","last_fullsized":"2024-09-10T08:38:28.194581+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:07.904571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.398854+0000","last_change":"2024-09-10T08:38:27.228512+0000","last_active":"2024-09-10T08:38:28.398854+0000","last_peered":"2024-09-10T08:38:28.398854+0000","last_clean":"2024-09-10T08:38:28.398854+0000","last_became_active":"2024-09-10T08:38:27.228120+0000","last_became_peered":"2024-09-10T08:38:27.228120+0000","last_unstale":"2024-09-10T08:38:28.398854+0000","last_undegraded":"2024-09-10T08:38:28.398854+0000","last_fullsized":"2024-09-10T08:38:28.398854+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:01.644081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801403+0000","last_change":"2024-09-10T08:38:27.204641+0000","last_active":"2024-09-10T08:38:28.801403+0000","last_peered":"2024-09-10T08:38:28.801403+0000","last_clean":"2024-09-10T08:38:28.801403+0000","last_became_active":"2024-09-10T08:38:27.204363+0000","last_became_peered":"2024-09-10T08:38:27.204363+0000","last_unstale":"2024-09-10T08:38:28.801403+0000","last_undegraded":"2024-09-10T08:38:28.801403+0000","last_fullsized":"2024-09-10T08:38:28.801403+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:51:52.130681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194219+0000","last_change":"2024-09-10T08:38:27.204837+0000","last_active":"2024-09-10T08:38:28.194219+0000","last_peered":"2024-09-10T08:38:28.194219+0000","last_clean":"2024-09-10T08:38:28.194219+0000","last_became_active":"2024-09-10T08:38:27.202911+0000","last_became_peered":"2024-09-10T08:38:27.202911+0000","last_unstale":"2024-09-10T08:38:28.194219+0000","last_undegraded":"2024-09-10T08:38:28.194219+0000","last_fullsized":"2024-09-10T08:38:28.194219+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:06.354290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399163+0000","last_change":"2024-09-10T08:38:27.223177+0000","last_active":"2024-09-10T08:38:28.399163+0000","last_peered":"2024-09-10T08:38:28.399163+0000","last_clean":"2024-09-10T08:38:28.399163+0000","last_became_active":"2024-09-10T08:38:27.222405+0000","last_became_peered":"2024-09-10T08:38:27.222405+0000","last_unstale":"2024-09-10T08:38:28.399163+0000","last_undegraded":"2024-09-10T08:38:28.399163+0000","last_fullsized":"2024-09-10T08:38:28.399163+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:05.810572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500960+0000","last_change":"2024-09-10T08:38:27.227190+0000","last_active":"2024-09-10T08:38:28.500960+0000","last_peered":"2024-09-10T08:38:28.500960+0000","last_clean":"2024-09-10T08:38:28.500960+0000","last_became_active":"2024-09-10T08:38:27.225755+0000","last_became_peered":"2024-09-10T08:38:27.225755+0000","last_unstale":"2024-09-10T08:38:28.500960+0000","last_undegraded":"2024-09-10T08:38:28.500960+0000","last_fullsized":"2024-09-10T08:38:28.500960+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:15.845469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399114+0000","last_change":"2024-09-10T08:38:27.232117+0000","last_active":"2024-09-10T08:38:28.399114+0000","last_peered":"2024-09-10T08:38:28.399114+0000","last_clean":"2024-09-10T08:38:28.399114+0000","last_became_active":"2024-09-10T08:38:27.231845+0000","last_became_peered":"2024-09-10T08:38:27.231845+0000","last_unstale":"2024-09-10T08:38:28.399114+0000","last_undegraded":"2024-09-10T08:38:28.399114+0000","last_fullsized":"2024-09-10T08:38:28.399114+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:58.729473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193719+0000","last_change":"2024-09-10T08:38:27.199697+0000","last_active":"2024-09-10T08:38:28.193719+0000","last_peered":"2024-09-10T08:38:28.193719+0000","last_clean":"2024-09-10T08:38:28.193719+0000","last_became_active":"2024-09-10T08:38:27.199237+0000","last_became_peered":"2024-09-10T08:38:27.199237+0000","last_unstale":"2024-09-10T08:38:28.193719+0000","last_undegraded":"2024-09-10T08:38:28.193719+0000","last_fullsized":"2024-09-10T08:38:28.193719+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:42.671168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194366+0000","last_change":"2024-09-10T08:38:27.229906+0000","last_active":"2024-09-10T08:38:28.194366+0000","last_peered":"2024-09-10T08:38:28.194366+0000","last_clean":"2024-09-10T08:38:28.194366+0000","last_became_active":"2024-09-10T08:38:27.229010+0000","last_became_peered":"2024-09-10T08:38:27.229010+0000","last_unstale":"2024-09-10T08:38:28.194366+0000","last_undegraded":"2024-09-10T08:38:28.194366+0000","last_fullsized":"2024-09-10T08:38:28.194366+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:59:49.520807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193627+0000","last_change":"2024-09-10T08:38:27.222257+0000","last_active":"2024-09-10T08:38:28.193627+0000","last_peered":"2024-09-10T08:38:28.193627+0000","last_clean":"2024-09-10T08:38:28.193627+0000","last_became_active":"2024-09-10T08:38:27.221957+0000","last_became_peered":"2024-09-10T08:38:27.221957+0000","last_unstale":"2024-09-10T08:38:28.193627+0000","last_undegraded":"2024-09-10T08:38:28.193627+0000","last_fullsized":"2024-09-10T08:38:28.193627+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194121+0000","last_change":"2024-09-10T08:38:27.224329+0000","last_active":"2024-09-10T08:38:28.194121+0000","last_peered":"2024-09-10T08:38:28.194121+0000","last_clean":"2024-09-10T08:38:28.194121+0000","last_became_active":"2024-09-10T08:38:27.224049+0000","last_became_peered":"2024-09-10T08:38:27.224049+0000","last_unstale":"2024-09-10T08:38:28.194121+0000","last_undegraded":"2024-09-10T08:38:28.194121+0000","last_fullsized":"2024-09-10T08:38:28.194121+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:14.968005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801404+0000","last_change":"2024-09-10T08:38:27.209537+0000","last_active":"2024-09-10T08:38:28.801404+0000","last_peered":"2024-09-10T08:38:28.801404+0000","last_clean":"2024-09-10T08:38:28.801404+0000","last_became_active":"2024-09-10T08:38:27.209137+0000","last_became_peered":"2024-09-10T08:38:27.209137+0000","last_unstale":"2024-09-10T08:38:28.801404+0000","last_undegraded":"2024-09-10T08:38:28.801404+0000","last_fullsized":"2024-09-10T08:38:28.801404+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:16.468638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.501010+0000","last_change":"2024-09-10T08:38:27.232129+0000","last_active":"2024-09-10T08:38:28.501010+0000","last_peered":"2024-09-10T08:38:28.501010+0000","last_clean":"2024-09-10T08:38:28.501010+0000","last_became_active":"2024-09-10T08:38:27.231497+0000","last_became_peered":"2024-09-10T08:38:27.231497+0000","last_unstale":"2024-09-10T08:38:28.501010+0000","last_undegraded":"2024-09-10T08:38:28.501010+0000","last_fullsized":"2024-09-10T08:38:28.501010+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:43.165456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194466+0000","last_change":"2024-09-10T08:38:27.223717+0000","last_active":"2024-09-10T08:38:28.194466+0000","last_peered":"2024-09-10T08:38:28.194466+0000","last_clean":"2024-09-10T08:38:28.194466+0000","last_became_active":"2024-09-10T08:38:27.223193+0000","last_became_peered":"2024-09-10T08:38:27.223193+0000","last_unstale":"2024-09-10T08:38:28.194466+0000","last_undegraded":"2024-09-10T08:38:28.194466+0000","last_fullsized":"2024-09-10T08:38:28.194466+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:19.446359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194956+0000","last_change":"2024-09-10T08:38:27.225739+0000","last_active":"2024-09-10T08:38:28.194956+0000","last_peered":"2024-09-10T08:38:28.194956+0000","last_clean":"2024-09-10T08:38:28.194956+0000","last_became_active":"2024-09-10T08:38:27.225367+0000","last_became_peered":"2024-09-10T08:38:27.225367+0000","last_unstale":"2024-09-10T08:38:28.194956+0000","last_undegraded":"2024-09-10T08:38:28.194956+0000","last_fullsized":"2024-09-10T08:38:28.194956+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:27.076195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194736+0000","last_change":"2024-09-10T08:38:27.211672+0000","last_active":"2024-09-10T08:38:28.194736+0000","last_peered":"2024-09-10T08:38:28.194736+0000","last_clean":"2024-09-10T08:38:28.194736+0000","last_became_active":"2024-09-10T08:38:27.211422+0000","last_became_peered":"2024-09-10T08:38:27.211422+0000","last_unstale":"2024-09-10T08:38:28.194736+0000","last_undegraded":"2024-09-10T08:38:28.194736+0000","last_fullsized":"2024-09-10T08:38:28.194736+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:07.049226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500711+0000","last_change":"2024-09-10T08:38:27.215422+0000","last_active":"2024-09-10T08:38:28.500711+0000","last_peered":"2024-09-10T08:38:28.500711+0000","last_clean":"2024-09-10T08:38:28.500711+0000","last_became_active":"2024-09-10T08:38:27.215133+0000","last_became_peered":"2024-09-10T08:38:27.215133+0000","last_unstale":"2024-09-10T08:38:28.500711+0000","last_undegraded":"2024-09-10T08:38:28.500711+0000","last_fullsized":"2024-09-10T08:38:28.500711+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:56.949644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193691+0000","last_change":"2024-09-10T08:38:27.212770+0000","last_active":"2024-09-10T08:38:28.193691+0000","last_peered":"2024-09-10T08:38:28.193691+0000","last_clean":"2024-09-10T08:38:28.193691+0000","last_became_active":"2024-09-10T08:38:27.212099+0000","last_became_peered":"2024-09-10T08:38:27.212099+0000","last_unstale":"2024-09-10T08:38:28.193691+0000","last_undegraded":"2024-09-10T08:38:28.193691+0000","last_fullsized":"2024-09-10T08:38:28.193691+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:39.908827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.800860+0000","last_change":"2024-09-10T08:38:27.222322+0000","last_active":"2024-09-10T08:38:28.800860+0000","last_peered":"2024-09-10T08:38:28.800860+0000","last_clean":"2024-09-10T08:38:28.800860+0000","last_became_active":"2024-09-10T08:38:27.221765+0000","last_became_peered":"2024-09-10T08:38:27.221765+0000","last_unstale":"2024-09-10T08:38:28.800860+0000","last_undegraded":"2024-09-10T08:38:28.800860+0000","last_fullsized":"2024-09-10T08:38:28.800860+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:40.727310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194018+0000","last_change":"2024-09-10T08:38:27.219275+0000","last_active":"2024-09-10T08:38:28.194018+0000","last_peered":"2024-09-10T08:38:28.194018+0000","last_clean":"2024-09-10T08:38:28.194018+0000","last_became_active":"2024-09-10T08:38:27.218829+0000","last_became_peered":"2024-09-10T08:38:27.218829+0000","last_unstale":"2024-09-10T08:38:28.194018+0000","last_undegraded":"2024-09-10T08:38:28.194018+0000","last_fullsized":"2024-09-10T08:38:28.194018+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:31.898200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802125+0000","last_change":"2024-09-10T08:38:27.214265+0000","last_active":"2024-09-10T08:38:28.802125+0000","last_peered":"2024-09-10T08:38:28.802125+0000","last_clean":"2024-09-10T08:38:28.802125+0000","last_became_active":"2024-09-10T08:38:27.213882+0000","last_became_peered":"2024-09-10T08:38:27.213882+0000","last_unstale":"2024-09-10T08:38:28.802125+0000","last_undegraded":"2024-09-10T08:38:28.802125+0000","last_fullsized":"2024-09-10T08:38:28.802125+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:47.100897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194962+0000","last_change":"2024-09-10T08:38:27.212070+0000","last_active":"2024-09-10T08:38:28.194962+0000","last_peered":"2024-09-10T08:38:28.194962+0000","last_clean":"2024-09-10T08:38:28.194962+0000","last_became_active":"2024-09-10T08:38:27.210175+0000","last_became_peered":"2024-09-10T08:38:27.210175+0000","last_unstale":"2024-09-10T08:38:28.194962+0000","last_undegraded":"2024-09-10T08:38:28.194962+0000","last_fullsized":"2024-09-10T08:38:28.194962+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:19:38.770615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802080+0000","last_change":"2024-09-10T08:38:27.210968+0000","last_active":"2024-09-10T08:38:28.802080+0000","last_peered":"2024-09-10T08:38:28.802080+0000","last_clean":"2024-09-10T08:38:28.802080+0000","last_became_active":"2024-09-10T08:38:27.210661+0000","last_became_peered":"2024-09-10T08:38:27.210661+0000","last_unstale":"2024-09-10T08:38:28.802080+0000","last_undegraded":"2024-09-10T08:38:28.802080+0000","last_fullsized":"2024-09-10T08:38:28.802080+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:38.443678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801901+0000","last_change":"2024-09-10T08:38:27.219453+0000","last_active":"2024-09-10T08:38:28.801901+0000","last_peered":"2024-09-10T08:38:28.801901+0000","last_clean":"2024-09-10T08:38:28.801901+0000","last_became_active":"2024-09-10T08:38:27.219142+0000","last_became_peered":"2024-09-10T08:38:27.219142+0000","last_unstale":"2024-09-10T08:38:28.801901+0000","last_undegraded":"2024-09-10T08:38:28.801901+0000","last_fullsized":"2024-09-10T08:38:28.801901+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:14.185356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194603+0000","last_change":"2024-09-10T08:38:27.203615+0000","last_active":"2024-09-10T08:38:28.194603+0000","last_peered":"2024-09-10T08:38:28.194603+0000","last_clean":"2024-09-10T08:38:28.194603+0000","last_became_active":"2024-09-10T08:38:27.203318+0000","last_became_peered":"2024-09-10T08:38:27.203318+0000","last_unstale":"2024-09-10T08:38:28.194603+0000","last_undegraded":"2024-09-10T08:38:28.194603+0000","last_fullsized":"2024-09-10T08:38:28.194603+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:07:18.064062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193786+0000","last_change":"2024-09-10T08:38:27.212524+0000","last_active":"2024-09-10T08:38:28.193786+0000","last_peered":"2024-09-10T08:38:28.193786+0000","last_clean":"2024-09-10T08:38:28.193786+0000","last_became_active":"2024-09-10T08:38:27.211647+0000","last_became_peered":"2024-09-10T08:38:27.211647+0000","last_unstale":"2024-09-10T08:38:28.193786+0000","last_undegraded":"2024-09-10T08:38:28.193786+0000","last_fullsized":"2024-09-10T08:38:28.193786+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:05.894788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801742+0000","last_change":"2024-09-10T08:38:27.226784+0000","last_active":"2024-09-10T08:38:28.801742+0000","last_peered":"2024-09-10T08:38:28.801742+0000","last_clean":"2024-09-10T08:38:28.801742+0000","last_became_active":"2024-09-10T08:38:27.225775+0000","last_became_peered":"2024-09-10T08:38:27.225775+0000","last_unstale":"2024-09-10T08:38:28.801742+0000","last_undegraded":"2024-09-10T08:38:28.801742+0000","last_fullsized":"2024-09-10T08:38:28.801742+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:24.021736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802541+0000","last_change":"2024-09-10T08:38:27.216030+0000","last_active":"2024-09-10T08:38:28.802541+0000","last_peered":"2024-09-10T08:38:28.802541+0000","last_clean":"2024-09-10T08:38:28.802541+0000","last_became_active":"2024-09-10T08:38:27.215413+0000","last_became_peered":"2024-09-10T08:38:27.215413+0000","last_unstale":"2024-09-10T08:38:28.802541+0000","last_undegraded":"2024-09-10T08:38:28.802541+0000","last_fullsized":"2024-09-10T08:38:28.802541+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:42.554072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194510+0000","last_change":"2024-09-10T08:38:27.234562+0000","last_active":"2024-09-10T08:38:28.194510+0000","last_peered":"2024-09-10T08:38:28.194510+0000","last_clean":"2024-09-10T08:38:28.194510+0000","last_became_active":"2024-09-10T08:38:27.233683+0000","last_became_peered":"2024-09-10T08:38:27.233683+0000","last_unstale":"2024-09-10T08:38:28.194510+0000","last_undegraded":"2024-09-10T08:38:28.194510+0000","last_fullsized":"2024-09-10T08:38:28.194510+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.002626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"146'4","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.501041+0000","last_change":"2024-09-10T08:38:26.208169+0000","last_active":"2024-09-10T08:38:28.501041+0000","last_peered":"2024-09-10T08:38:28.501041+0000","last_clean":"2024-09-10T08:38:28.501041+0000","last_became_active":"2024-09-10T08:38:26.205620+0000","last_became_peered":"2024-09-10T08:38:26.205620+0000","last_unstale":"2024-09-10T08:38:28.501041+0000","last_undegraded":"2024-09-10T08:38:28.501041+0000","last_fullsized":"2024-09-10T08:38:28.501041+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:42:11.441895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802546+0000","last_change":"2024-09-10T08:38:27.210600+0000","last_active":"2024-09-10T08:38:28.802546+0000","last_peered":"2024-09-10T08:38:28.802546+0000","last_clean":"2024-09-10T08:38:28.802546+0000","last_became_active":"2024-09-10T08:38:27.210349+0000","last_became_peered":"2024-09-10T08:38:27.210349+0000","last_unstale":"2024-09-10T08:38:28.802546+0000","last_undegraded":"2024-09-10T08:38:28.802546+0000","last_fullsized":"2024-09-10T08:38:28.802546+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:49.890901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399099+0000","last_change":"2024-09-10T08:38:26.214039+0000","last_active":"2024-09-10T08:38:28.399099+0000","last_peered":"2024-09-10T08:38:28.399099+0000","last_clean":"2024-09-10T08:38:28.399099+0000","last_became_active":"2024-09-10T08:38:26.213746+0000","last_became_peered":"2024-09-10T08:38:26.213746+0000","last_unstale":"2024-09-10T08:38:28.399099+0000","last_undegraded":"2024-09-10T08:38:28.399099+0000","last_fullsized":"2024-09-10T08:38:28.399099+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:23.339811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399100+0000","last_change":"2024-09-10T08:38:27.225079+0000","last_active":"2024-09-10T08:38:28.399100+0000","last_peered":"2024-09-10T08:38:28.399100+0000","last_clean":"2024-09-10T08:38:28.399100+0000","last_became_active":"2024-09-10T08:38:27.224552+0000","last_became_peered":"2024-09-10T08:38:27.224552+0000","last_unstale":"2024-09-10T08:38:28.399100+0000","last_undegraded":"2024-09-10T08:38:28.399100+0000","last_fullsized":"2024-09-10T08:38:28.399100+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:11.033051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500862+0000","last_change":"2024-09-10T08:38:26.210781+0000","last_active":"2024-09-10T08:38:28.500862+0000","last_peered":"2024-09-10T08:38:28.500862+0000","last_clean":"2024-09-10T08:38:28.500862+0000","last_became_active":"2024-09-10T08:38:26.210454+0000","last_became_peered":"2024-09-10T08:38:26.210454+0000","last_unstale":"2024-09-10T08:38:28.500862+0000","last_undegraded":"2024-09-10T08:38:28.500862+0000","last_fullsized":"2024-09-10T08:38:28.500862+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:51.233478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801391+0000","last_change":"2024-09-10T08:38:27.232383+0000","last_active":"2024-09-10T08:38:28.801391+0000","last_peered":"2024-09-10T08:38:28.801391+0000","last_clean":"2024-09-10T08:38:28.801391+0000","last_became_active":"2024-09-10T08:38:27.230226+0000","last_became_peered":"2024-09-10T08:38:27.230226+0000","last_unstale":"2024-09-10T08:38:28.801391+0000","last_undegraded":"2024-09-10T08:38:28.801391+0000","last_fullsized":"2024-09-10T08:38:28.801391+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.038317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500773+0000","last_change":"2024-09-10T08:38:26.215048+0000","last_active":"2024-09-10T08:38:28.500773+0000","last_peered":"2024-09-10T08:38:28.500773+0000","last_clean":"2024-09-10T08:38:28.500773+0000","last_became_active":"2024-09-10T08:38:26.214746+0000","last_became_peered":"2024-09-10T08:38:26.214746+0000","last_unstale":"2024-09-10T08:38:28.500773+0000","last_undegraded":"2024-09-10T08:38:28.500773+0000","last_fullsized":"2024-09-10T08:38:28.500773+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:45.991633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801705+0000","last_change":"2024-09-10T08:38:27.212784+0000","last_active":"2024-09-10T08:38:28.801705+0000","last_peered":"2024-09-10T08:38:28.801705+0000","last_clean":"2024-09-10T08:38:28.801705+0000","last_became_active":"2024-09-10T08:38:27.212474+0000","last_became_peered":"2024-09-10T08:38:27.212474+0000","last_unstale":"2024-09-10T08:38:28.801705+0000","last_undegraded":"2024-09-10T08:38:28.801705+0000","last_fullsized":"2024-09-10T08:38:28.801705+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:46.929177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194537+0000","last_change":"2024-09-10T08:38:26.211867+0000","last_active":"2024-09-10T08:38:28.194537+0000","last_peered":"2024-09-10T08:38:28.194537+0000","last_clean":"2024-09-10T08:38:28.194537+0000","last_became_active":"2024-09-10T08:38:26.211574+0000","last_became_peered":"2024-09-10T08:38:26.211574+0000","last_unstale":"2024-09-10T08:38:28.194537+0000","last_undegraded":"2024-09-10T08:38:28.194537+0000","last_fullsized":"2024-09-10T08:38:28.194537+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:58.035088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801283+0000","last_change":"2024-09-10T08:38:27.227494+0000","last_active":"2024-09-10T08:38:28.801283+0000","last_peered":"2024-09-10T08:38:28.801283+0000","last_clean":"2024-09-10T08:38:28.801283+0000","last_became_active":"2024-09-10T08:38:27.227178+0000","last_became_peered":"2024-09-10T08:38:27.227178+0000","last_unstale":"2024-09-10T08:38:28.801283+0000","last_undegraded":"2024-09-10T08:38:28.801283+0000","last_fullsized":"2024-09-10T08:38:28.801283+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:11.033051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194098+0000","last_change":"2024-09-10T08:38:26.211583+0000","last_active":"2024-09-10T08:38:28.194098+0000","last_peered":"2024-09-10T08:38:28.194098+0000","last_clean":"2024-09-10T08:38:28.194098+0000","last_became_active":"2024-09-10T08:38:26.211032+0000","last_became_peered":"2024-09-10T08:38:26.211032+0000","last_unstale":"2024-09-10T08:38:28.194098+0000","last_undegraded":"2024-09-10T08:38:28.194098+0000","last_fullsized":"2024-09-10T08:38:28.194098+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:36.637699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801859+0000","last_change":"2024-09-10T08:38:27.216245+0000","last_active":"2024-09-10T08:38:28.801859+0000","last_peered":"2024-09-10T08:38:28.801859+0000","last_clean":"2024-09-10T08:38:28.801859+0000","last_became_active":"2024-09-10T08:38:27.215769+0000","last_became_peered":"2024-09-10T08:38:27.215769+0000","last_unstale":"2024-09-10T08:38:28.801859+0000","last_undegraded":"2024-09-10T08:38:28.801859+0000","last_fullsized":"2024-09-10T08:38:28.801859+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:30.346582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399136+0000","last_change":"2024-09-10T08:38:26.210354+0000","last_active":"2024-09-10T08:38:28.399136+0000","last_peered":"2024-09-10T08:38:28.399136+0000","last_clean":"2024-09-10T08:38:28.399136+0000","last_became_active":"2024-09-10T08:38:26.209973+0000","last_became_peered":"2024-09-10T08:38:26.209973+0000","last_unstale":"2024-09-10T08:38:28.399136+0000","last_undegraded":"2024-09-10T08:38:28.399136+0000","last_fullsized":"2024-09-10T08:38:28.399136+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:56.898249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.800933+0000","last_change":"2024-09-10T08:38:27.203655+0000","last_active":"2024-09-10T08:38:28.800933+0000","last_peered":"2024-09-10T08:38:28.800933+0000","last_clean":"2024-09-10T08:38:28.800933+0000","last_became_active":"2024-09-10T08:38:27.203364+0000","last_became_peered":"2024-09-10T08:38:27.203364+0000","last_unstale":"2024-09-10T08:38:28.800933+0000","last_undegraded":"2024-09-10T08:38:28.800933+0000","last_fullsized":"2024-09-10T08:38:28.800933+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:53.704482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500543+0000","last_change":"2024-09-10T08:38:26.206615+0000","last_active":"2024-09-10T08:38:28.500543+0000","last_peered":"2024-09-10T08:38:28.500543+0000","last_clean":"2024-09-10T08:38:28.500543+0000","last_became_active":"2024-09-10T08:38:26.206360+0000","last_became_peered":"2024-09-10T08:38:26.206360+0000","last_unstale":"2024-09-10T08:38:28.500543+0000","last_undegraded":"2024-09-10T08:38:28.500543+0000","last_fullsized":"2024-09-10T08:38:28.500543+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:45:13.133386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801333+0000","last_change":"2024-09-10T08:38:27.226234+0000","last_active":"2024-09-10T08:38:28.801333+0000","last_peered":"2024-09-10T08:38:28.801333+0000","last_clean":"2024-09-10T08:38:28.801333+0000","last_became_active":"2024-09-10T08:38:27.225830+0000","last_became_peered":"2024-09-10T08:38:27.225830+0000","last_unstale":"2024-09-10T08:38:28.801333+0000","last_undegraded":"2024-09-10T08:38:28.801333+0000","last_fullsized":"2024-09-10T08:38:28.801333+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:19:58.729473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399064+0000","last_change":"2024-09-10T08:38:26.212596+0000","last_active":"2024-09-10T08:38:28.399064+0000","last_peered":"2024-09-10T08:38:28.399064+0000","last_clean":"2024-09-10T08:38:28.399064+0000","last_became_active":"2024-09-10T08:38:26.211357+0000","last_became_peered":"2024-09-10T08:38:26.211357+0000","last_unstale":"2024-09-10T08:38:28.399064+0000","last_undegraded":"2024-09-10T08:38:28.399064+0000","last_fullsized":"2024-09-10T08:38:28.399064+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:25:39.724081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193526+0000","last_change":"2024-09-10T08:38:27.218047+0000","last_active":"2024-09-10T08:38:28.193526+0000","last_peered":"2024-09-10T08:38:28.193526+0000","last_clean":"2024-09-10T08:38:28.193526+0000","last_became_active":"2024-09-10T08:38:27.217745+0000","last_became_peered":"2024-09-10T08:38:27.217745+0000","last_unstale":"2024-09-10T08:38:28.193526+0000","last_undegraded":"2024-09-10T08:38:28.193526+0000","last_fullsized":"2024-09-10T08:38:28.193526+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:51.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194566+0000","last_change":"2024-09-10T08:38:26.212374+0000","last_active":"2024-09-10T08:38:28.194566+0000","last_peered":"2024-09-10T08:38:28.194566+0000","last_clean":"2024-09-10T08:38:28.194566+0000","last_became_active":"2024-09-10T08:38:26.212101+0000","last_became_peered":"2024-09-10T08:38:26.212101+0000","last_unstale":"2024-09-10T08:38:28.194566+0000","last_undegraded":"2024-09-10T08:38:28.194566+0000","last_fullsized":"2024-09-10T08:38:28.194566+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:31.593545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802656+0000","last_change":"2024-09-10T08:38:27.209424+0000","last_active":"2024-09-10T08:38:28.802656+0000","last_peered":"2024-09-10T08:38:28.802656+0000","last_clean":"2024-09-10T08:38:28.802656+0000","last_became_active":"2024-09-10T08:38:27.209106+0000","last_became_peered":"2024-09-10T08:38:27.209106+0000","last_unstale":"2024-09-10T08:38:28.802656+0000","last_undegraded":"2024-09-10T08:38:28.802656+0000","last_fullsized":"2024-09-10T08:38:28.802656+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:56.349099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"146'6","reported_seq":20,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802031+0000","last_change":"2024-09-10T08:38:26.205200+0000","last_active":"2024-09-10T08:38:28.802031+0000","last_peered":"2024-09-10T08:38:28.802031+0000","last_clean":"2024-09-10T08:38:28.802031+0000","last_became_active":"2024-09-10T08:38:26.204925+0000","last_became_peered":"2024-09-10T08:38:26.204925+0000","last_unstale":"2024-09-10T08:38:28.802031+0000","last_undegraded":"2024-09-10T08:38:28.802031+0000","last_fullsized":"2024-09-10T08:38:28.802031+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:51.242403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801174+0000","last_change":"2024-09-10T08:38:27.202579+0000","last_active":"2024-09-10T08:38:28.801174+0000","last_peered":"2024-09-10T08:38:28.801174+0000","last_clean":"2024-09-10T08:38:28.801174+0000","last_became_active":"2024-09-10T08:38:27.201982+0000","last_became_peered":"2024-09-10T08:38:27.201982+0000","last_unstale":"2024-09-10T08:38:28.801174+0000","last_undegraded":"2024-09-10T08:38:28.801174+0000","last_fullsized":"2024-09-10T08:38:28.801174+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:03:50.283985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500714+0000","last_change":"2024-09-10T08:38:26.205297+0000","last_active":"2024-09-10T08:38:28.500714+0000","last_peered":"2024-09-10T08:38:28.500714+0000","last_clean":"2024-09-10T08:38:28.500714+0000","last_became_active":"2024-09-10T08:38:26.205008+0000","last_became_peered":"2024-09-10T08:38:26.205008+0000","last_unstale":"2024-09-10T08:38:28.500714+0000","last_undegraded":"2024-09-10T08:38:28.500714+0000","last_fullsized":"2024-09-10T08:38:28.500714+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:20:50.682230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194367+0000","last_change":"2024-09-10T08:38:27.203366+0000","last_active":"2024-09-10T08:38:28.194367+0000","last_peered":"2024-09-10T08:38:28.194367+0000","last_clean":"2024-09-10T08:38:28.194367+0000","last_became_active":"2024-09-10T08:38:27.203077+0000","last_became_peered":"2024-09-10T08:38:27.203077+0000","last_unstale":"2024-09-10T08:38:28.194367+0000","last_undegraded":"2024-09-10T08:38:28.194367+0000","last_fullsized":"2024-09-10T08:38:28.194367+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:02:39.176810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193883+0000","last_change":"2024-09-10T08:38:26.207851+0000","last_active":"2024-09-10T08:38:28.193883+0000","last_peered":"2024-09-10T08:38:28.193883+0000","last_clean":"2024-09-10T08:38:28.193883+0000","last_became_active":"2024-09-10T08:38:26.205894+0000","last_became_peered":"2024-09-10T08:38:26.205894+0000","last_unstale":"2024-09-10T08:38:28.193883+0000","last_undegraded":"2024-09-10T08:38:28.193883+0000","last_fullsized":"2024-09-10T08:38:28.193883+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:53.366336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.800862+0000","last_change":"2024-09-10T08:38:27.227800+0000","last_active":"2024-09-10T08:38:28.800862+0000","last_peered":"2024-09-10T08:38:28.800862+0000","last_clean":"2024-09-10T08:38:28.800862+0000","last_became_active":"2024-09-10T08:38:27.226979+0000","last_became_peered":"2024-09-10T08:38:27.226979+0000","last_unstale":"2024-09-10T08:38:28.800862+0000","last_undegraded":"2024-09-10T08:38:28.800862+0000","last_fullsized":"2024-09-10T08:38:28.800862+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:16.725988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802407+0000","last_change":"2024-09-10T08:38:26.216207+0000","last_active":"2024-09-10T08:38:28.802407+0000","last_peered":"2024-09-10T08:38:28.802407+0000","last_clean":"2024-09-10T08:38:28.802407+0000","last_became_active":"2024-09-10T08:38:26.215922+0000","last_became_peered":"2024-09-10T08:38:26.215922+0000","last_unstale":"2024-09-10T08:38:28.802407+0000","last_undegraded":"2024-09-10T08:38:28.802407+0000","last_fullsized":"2024-09-10T08:38:28.802407+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:06.901342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801216+0000","last_change":"2024-09-10T08:38:27.222100+0000","last_active":"2024-09-10T08:38:28.801216+0000","last_peered":"2024-09-10T08:38:28.801216+0000","last_clean":"2024-09-10T08:38:28.801216+0000","last_became_active":"2024-09-10T08:38:27.221419+0000","last_became_peered":"2024-09-10T08:38:27.221419+0000","last_unstale":"2024-09-10T08:38:28.801216+0000","last_undegraded":"2024-09-10T08:38:28.801216+0000","last_fullsized":"2024-09-10T08:38:28.801216+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:17:09.462886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"146'8","reported_seq":22,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194237+0000","last_change":"2024-09-10T08:38:26.204717+0000","last_active":"2024-09-10T08:38:28.194237+0000","last_peered":"2024-09-10T08:38:28.194237+0000","last_clean":"2024-09-10T08:38:28.194237+0000","last_became_active":"2024-09-10T08:38:26.204429+0000","last_became_peered":"2024-09-10T08:38:26.204429+0000","last_unstale":"2024-09-10T08:38:28.194237+0000","last_undegraded":"2024-09-10T08:38:28.194237+0000","last_fullsized":"2024-09-10T08:38:28.194237+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:04.807343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194556+0000","last_change":"2024-09-10T08:38:27.223491+0000","last_active":"2024-09-10T08:38:28.194556+0000","last_peered":"2024-09-10T08:38:28.194556+0000","last_clean":"2024-09-10T08:38:28.194556+0000","last_became_active":"2024-09-10T08:38:27.222790+0000","last_became_peered":"2024-09-10T08:38:27.222790+0000","last_unstale":"2024-09-10T08:38:28.194556+0000","last_undegraded":"2024-09-10T08:38:28.194556+0000","last_fullsized":"2024-09-10T08:38:28.194556+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:24.853245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801256+0000","last_change":"2024-09-10T08:38:26.206793+0000","last_active":"2024-09-10T08:38:28.801256+0000","last_peered":"2024-09-10T08:38:28.801256+0000","last_clean":"2024-09-10T08:38:28.801256+0000","last_became_active":"2024-09-10T08:38:26.206488+0000","last_became_peered":"2024-09-10T08:38:26.206488+0000","last_unstale":"2024-09-10T08:38:28.801256+0000","last_undegraded":"2024-09-10T08:38:28.801256+0000","last_fullsized":"2024-09-10T08:38:28.801256+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:37.440449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802279+0000","last_change":"2024-09-10T08:38:27.230619+0000","last_active":"2024-09-10T08:38:28.802279+0000","last_peered":"2024-09-10T08:38:28.802279+0000","last_clean":"2024-09-10T08:38:28.802279+0000","last_became_active":"2024-09-10T08:38:27.230319+0000","last_became_peered":"2024-09-10T08:38:27.230319+0000","last_unstale":"2024-09-10T08:38:28.802279+0000","last_undegraded":"2024-09-10T08:38:28.802279+0000","last_fullsized":"2024-09-10T08:38:28.802279+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:36.835982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.195062+0000","last_change":"2024-09-10T08:38:26.209532+0000","last_active":"2024-09-10T08:38:28.195062+0000","last_peered":"2024-09-10T08:38:28.195062+0000","last_clean":"2024-09-10T08:38:28.195062+0000","last_became_active":"2024-09-10T08:38:26.206717+0000","last_became_peered":"2024-09-10T08:38:26.206717+0000","last_unstale":"2024-09-10T08:38:28.195062+0000","last_undegraded":"2024-09-10T08:38:28.195062+0000","last_fullsized":"2024-09-10T08:38:28.195062+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:09.989832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194349+0000","last_change":"2024-09-10T08:38:27.225250+0000","last_active":"2024-09-10T08:38:28.194349+0000","last_peered":"2024-09-10T08:38:28.194349+0000","last_clean":"2024-09-10T08:38:28.194349+0000","last_became_active":"2024-09-10T08:38:27.224924+0000","last_became_peered":"2024-09-10T08:38:27.224924+0000","last_unstale":"2024-09-10T08:38:28.194349+0000","last_undegraded":"2024-09-10T08:38:28.194349+0000","last_fullsized":"2024-09-10T08:38:28.194349+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:14:24.740602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"146'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802418+0000","last_change":"2024-09-10T08:38:26.207678+0000","last_active":"2024-09-10T08:38:28.802418+0000","last_peered":"2024-09-10T08:38:28.802418+0000","last_clean":"2024-09-10T08:38:28.802418+0000","last_became_active":"2024-09-10T08:38:26.207385+0000","last_became_peered":"2024-09-10T08:38:26.207385+0000","last_unstale":"2024-09-10T08:38:28.802418+0000","last_undegraded":"2024-09-10T08:38:28.802418+0000","last_fullsized":"2024-09-10T08:38:28.802418+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:42.066301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.399194+0000","last_change":"2024-09-10T08:38:27.228631+0000","last_active":"2024-09-10T08:38:28.399194+0000","last_peered":"2024-09-10T08:38:28.399194+0000","last_clean":"2024-09-10T08:38:28.399194+0000","last_became_active":"2024-09-10T08:38:27.228054+0000","last_became_peered":"2024-09-10T08:38:27.228054+0000","last_unstale":"2024-09-10T08:38:28.399194+0000","last_undegraded":"2024-09-10T08:38:28.399194+0000","last_fullsized":"2024-09-10T08:38:28.399194+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:59.038317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802095+0000","last_change":"2024-09-10T08:38:26.217293+0000","last_active":"2024-09-10T08:38:28.802095+0000","last_peered":"2024-09-10T08:38:28.802095+0000","last_clean":"2024-09-10T08:38:28.802095+0000","last_became_active":"2024-09-10T08:38:26.216833+0000","last_became_peered":"2024-09-10T08:38:26.216833+0000","last_unstale":"2024-09-10T08:38:28.802095+0000","last_undegraded":"2024-09-10T08:38:28.802095+0000","last_fullsized":"2024-09-10T08:38:28.802095+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:49.558204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193797+0000","last_change":"2024-09-10T08:38:27.203964+0000","last_active":"2024-09-10T08:38:28.193797+0000","last_peered":"2024-09-10T08:38:28.193797+0000","last_clean":"2024-09-10T08:38:28.193797+0000","last_became_active":"2024-09-10T08:38:27.203385+0000","last_became_peered":"2024-09-10T08:38:27.203385+0000","last_unstale":"2024-09-10T08:38:28.193797+0000","last_undegraded":"2024-09-10T08:38:28.193797+0000","last_fullsized":"2024-09-10T08:38:28.193797+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:33.175076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.398815+0000","last_change":"2024-09-10T08:38:26.214212+0000","last_active":"2024-09-10T08:38:28.398815+0000","last_peered":"2024-09-10T08:38:28.398815+0000","last_clean":"2024-09-10T08:38:28.398815+0000","last_became_active":"2024-09-10T08:38:26.213244+0000","last_became_peered":"2024-09-10T08:38:26.213244+0000","last_unstale":"2024-09-10T08:38:28.398815+0000","last_undegraded":"2024-09-10T08:38:28.398815+0000","last_fullsized":"2024-09-10T08:38:28.398815+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:42:34.189014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802342+0000","last_change":"2024-09-10T08:38:27.230548+0000","last_active":"2024-09-10T08:38:28.802342+0000","last_peered":"2024-09-10T08:38:28.802342+0000","last_clean":"2024-09-10T08:38:28.802342+0000","last_became_active":"2024-09-10T08:38:27.230250+0000","last_became_peered":"2024-09-10T08:38:27.230250+0000","last_unstale":"2024-09-10T08:38:28.802342+0000","last_undegraded":"2024-09-10T08:38:28.802342+0000","last_fullsized":"2024-09-10T08:38:28.802342+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:44.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.800890+0000","last_change":"2024-09-10T08:38:26.204073+0000","last_active":"2024-09-10T08:38:28.800890+0000","last_peered":"2024-09-10T08:38:28.800890+0000","last_clean":"2024-09-10T08:38:28.800890+0000","last_became_active":"2024-09-10T08:38:26.202441+0000","last_became_peered":"2024-09-10T08:38:26.202441+0000","last_unstale":"2024-09-10T08:38:28.800890+0000","last_undegraded":"2024-09-10T08:38:28.800890+0000","last_fullsized":"2024-09-10T08:38:28.800890+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:35.832753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193576+0000","last_change":"2024-09-10T08:38:27.220967+0000","last_active":"2024-09-10T08:38:28.193576+0000","last_peered":"2024-09-10T08:38:28.193576+0000","last_clean":"2024-09-10T08:38:28.193576+0000","last_became_active":"2024-09-10T08:38:27.220013+0000","last_became_peered":"2024-09-10T08:38:27.220013+0000","last_unstale":"2024-09-10T08:38:28.193576+0000","last_undegraded":"2024-09-10T08:38:28.193576+0000","last_fullsized":"2024-09-10T08:38:28.193576+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:10:44.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801079+0000","last_change":"2024-09-10T08:38:26.207524+0000","last_active":"2024-09-10T08:38:28.801079+0000","last_peered":"2024-09-10T08:38:28.801079+0000","last_clean":"2024-09-10T08:38:28.801079+0000","last_became_active":"2024-09-10T08:38:26.206649+0000","last_became_peered":"2024-09-10T08:38:26.206649+0000","last_unstale":"2024-09-10T08:38:28.801079+0000","last_undegraded":"2024-09-10T08:38:28.801079+0000","last_fullsized":"2024-09-10T08:38:28.801079+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:21.757576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802260+0000","last_change":"2024-09-10T08:38:27.227405+0000","last_active":"2024-09-10T08:38:28.802260+0000","last_peered":"2024-09-10T08:38:28.802260+0000","last_clean":"2024-09-10T08:38:28.802260+0000","last_became_active":"2024-09-10T08:38:27.226933+0000","last_became_peered":"2024-09-10T08:38:27.226933+0000","last_unstale":"2024-09-10T08:38:28.802260+0000","last_undegraded":"2024-09-10T08:38:28.802260+0000","last_fullsized":"2024-09-10T08:38:28.802260+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:22.760805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.800973+0000","last_change":"2024-09-10T08:38:26.203388+0000","last_active":"2024-09-10T08:38:28.800973+0000","last_peered":"2024-09-10T08:38:28.800973+0000","last_clean":"2024-09-10T08:38:28.800973+0000","last_became_active":"2024-09-10T08:38:26.202489+0000","last_became_peered":"2024-09-10T08:38:26.202489+0000","last_unstale":"2024-09-10T08:38:28.800973+0000","last_undegraded":"2024-09-10T08:38:28.800973+0000","last_fullsized":"2024-09-10T08:38:28.800973+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:46.097667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801523+0000","last_change":"2024-09-10T08:38:27.228216+0000","last_active":"2024-09-10T08:38:28.801523+0000","last_peered":"2024-09-10T08:38:28.801523+0000","last_clean":"2024-09-10T08:38:28.801523+0000","last_became_active":"2024-09-10T08:38:27.226758+0000","last_became_peered":"2024-09-10T08:38:27.226758+0000","last_unstale":"2024-09-10T08:38:28.801523+0000","last_undegraded":"2024-09-10T08:38:28.801523+0000","last_fullsized":"2024-09-10T08:38:28.801523+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:10.993061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"146'2","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801379+0000","last_change":"2024-09-10T08:38:26.212049+0000","last_active":"2024-09-10T08:38:28.801379+0000","last_peered":"2024-09-10T08:38:28.801379+0000","last_clean":"2024-09-10T08:38:28.801379+0000","last_became_active":"2024-09-10T08:38:26.211775+0000","last_became_peered":"2024-09-10T08:38:26.211775+0000","last_unstale":"2024-09-10T08:38:28.801379+0000","last_undegraded":"2024-09-10T08:38:28.801379+0000","last_fullsized":"2024-09-10T08:38:28.801379+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:38:50.117683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801211+0000","last_change":"2024-09-10T08:38:27.212362+0000","last_active":"2024-09-10T08:38:28.801211+0000","last_peered":"2024-09-10T08:38:28.801211+0000","last_clean":"2024-09-10T08:38:28.801211+0000","last_became_active":"2024-09-10T08:38:27.212059+0000","last_became_peered":"2024-09-10T08:38:27.212059+0000","last_unstale":"2024-09-10T08:38:28.801211+0000","last_undegraded":"2024-09-10T08:38:28.801211+0000","last_fullsized":"2024-09-10T08:38:28.801211+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:00.887848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"147'1","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:29.199856+0000","last_change":"2024-09-10T08:38:26.217009+0000","last_active":"2024-09-10T08:38:29.199856+0000","last_peered":"2024-09-10T08:38:29.199856+0000","last_clean":"2024-09-10T08:38:29.199856+0000","last_became_active":"2024-09-10T08:38:26.216370+0000","last_became_peered":"2024-09-10T08:38:26.216370+0000","last_unstale":"2024-09-10T08:38:29.199856+0000","last_undegraded":"2024-09-10T08:38:29.199856+0000","last_fullsized":"2024-09-10T08:38:29.199856+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:58:04.053331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.195196+0000","last_change":"2024-09-10T08:38:27.211901+0000","last_active":"2024-09-10T08:38:28.195196+0000","last_peered":"2024-09-10T08:38:28.195196+0000","last_clean":"2024-09-10T08:38:28.195196+0000","last_became_active":"2024-09-10T08:38:27.211282+0000","last_became_peered":"2024-09-10T08:38:27.211282+0000","last_unstale":"2024-09-10T08:38:28.195196+0000","last_undegraded":"2024-09-10T08:38:28.195196+0000","last_fullsized":"2024-09-10T08:38:28.195196+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:41.623414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802524+0000","last_change":"2024-09-10T08:38:26.204512+0000","last_active":"2024-09-10T08:38:28.802524+0000","last_peered":"2024-09-10T08:38:28.802524+0000","last_clean":"2024-09-10T08:38:28.802524+0000","last_became_active":"2024-09-10T08:38:26.204185+0000","last_became_peered":"2024-09-10T08:38:26.204185+0000","last_unstale":"2024-09-10T08:38:28.802524+0000","last_undegraded":"2024-09-10T08:38:28.802524+0000","last_fullsized":"2024-09-10T08:38:28.802524+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:59.844270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.194774+0000","last_change":"2024-09-10T08:38:27.202297+0000","last_active":"2024-09-10T08:38:28.194774+0000","last_peered":"2024-09-10T08:38:28.194774+0000","last_clean":"2024-09-10T08:38:28.194774+0000","last_became_active":"2024-09-10T08:38:27.201997+0000","last_became_peered":"2024-09-10T08:38:27.201997+0000","last_unstale":"2024-09-10T08:38:28.194774+0000","last_undegraded":"2024-09-10T08:38:28.194774+0000","last_fullsized":"2024-09-10T08:38:28.194774+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:39.492458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802060+0000","last_change":"2024-09-10T08:38:26.210291+0000","last_active":"2024-09-10T08:38:28.802060+0000","last_peered":"2024-09-10T08:38:28.802060+0000","last_clean":"2024-09-10T08:38:28.802060+0000","last_became_active":"2024-09-10T08:38:26.210018+0000","last_became_peered":"2024-09-10T08:38:26.210018+0000","last_unstale":"2024-09-10T08:38:28.802060+0000","last_undegraded":"2024-09-10T08:38:28.802060+0000","last_fullsized":"2024-09-10T08:38:28.802060+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:07:17.753978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801855+0000","last_change":"2024-09-10T08:38:27.209105+0000","last_active":"2024-09-10T08:38:28.801855+0000","last_peered":"2024-09-10T08:38:28.801855+0000","last_clean":"2024-09-10T08:38:28.801855+0000","last_became_active":"2024-09-10T08:38:27.208756+0000","last_became_peered":"2024-09-10T08:38:27.208756+0000","last_unstale":"2024-09-10T08:38:28.801855+0000","last_undegraded":"2024-09-10T08:38:28.801855+0000","last_fullsized":"2024-09-10T08:38:28.801855+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:21.091795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.802012+0000","last_change":"2024-09-10T08:38:26.214386+0000","last_active":"2024-09-10T08:38:28.802012+0000","last_peered":"2024-09-10T08:38:28.802012+0000","last_clean":"2024-09-10T08:38:28.802012+0000","last_became_active":"2024-09-10T08:38:26.214101+0000","last_became_peered":"2024-09-10T08:38:26.214101+0000","last_unstale":"2024-09-10T08:38:28.802012+0000","last_undegraded":"2024-09-10T08:38:28.802012+0000","last_fullsized":"2024-09-10T08:38:28.802012+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:23.850015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801259+0000","last_change":"2024-09-10T08:38:27.209846+0000","last_active":"2024-09-10T08:38:28.801259+0000","last_peered":"2024-09-10T08:38:28.801259+0000","last_clean":"2024-09-10T08:38:28.801259+0000","last_became_active":"2024-09-10T08:38:27.208400+0000","last_became_peered":"2024-09-10T08:38:27.208400+0000","last_unstale":"2024-09-10T08:38:28.801259+0000","last_undegraded":"2024-09-10T08:38:28.801259+0000","last_fullsized":"2024-09-10T08:38:28.801259+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:01.644081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500669+0000","last_change":"2024-09-10T08:38:26.205186+0000","last_active":"2024-09-10T08:38:28.500669+0000","last_peered":"2024-09-10T08:38:28.500669+0000","last_clean":"2024-09-10T08:38:28.500669+0000","last_became_active":"2024-09-10T08:38:26.204794+0000","last_became_peered":"2024-09-10T08:38:26.204794+0000","last_unstale":"2024-09-10T08:38:28.500669+0000","last_undegraded":"2024-09-10T08:38:28.500669+0000","last_fullsized":"2024-09-10T08:38:28.500669+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:11.051748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801355+0000","last_change":"2024-09-10T08:38:27.204239+0000","last_active":"2024-09-10T08:38:28.801355+0000","last_peered":"2024-09-10T08:38:28.801355+0000","last_clean":"2024-09-10T08:38:28.801355+0000","last_became_active":"2024-09-10T08:38:27.203951+0000","last_became_peered":"2024-09-10T08:38:27.203951+0000","last_unstale":"2024-09-10T08:38:28.801355+0000","last_undegraded":"2024-09-10T08:38:28.801355+0000","last_fullsized":"2024-09-10T08:38:28.801355+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:05.810572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193395+0000","last_change":"2024-09-10T08:38:26.207123+0000","last_active":"2024-09-10T08:38:28.193395+0000","last_peered":"2024-09-10T08:38:28.193395+0000","last_clean":"2024-09-10T08:38:28.193395+0000","last_became_active":"2024-09-10T08:38:26.204891+0000","last_became_peered":"2024-09-10T08:38:26.204891+0000","last_unstale":"2024-09-10T08:38:28.193395+0000","last_undegraded":"2024-09-10T08:38:28.193395+0000","last_fullsized":"2024-09-10T08:38:28.193395+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:53:16.601843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.500558+0000","last_change":"2024-09-10T08:38:27.218704+0000","last_active":"2024-09-10T08:38:28.500558+0000","last_peered":"2024-09-10T08:38:28.500558+0000","last_clean":"2024-09-10T08:38:28.500558+0000","last_became_active":"2024-09-10T08:38:27.218020+0000","last_became_peered":"2024-09-10T08:38:27.218020+0000","last_unstale":"2024-09-10T08:38:28.500558+0000","last_undegraded":"2024-09-10T08:38:28.500558+0000","last_fullsized":"2024-09-10T08:38:28.500558+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:24.287948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.398685+0000","last_change":"2024-09-10T08:38:26.210926+0000","last_active":"2024-09-10T08:38:28.398685+0000","last_peered":"2024-09-10T08:38:28.398685+0000","last_clean":"2024-09-10T08:38:28.398685+0000","last_became_active":"2024-09-10T08:38:26.209685+0000","last_became_peered":"2024-09-10T08:38:26.209685+0000","last_unstale":"2024-09-10T08:38:28.398685+0000","last_undegraded":"2024-09-10T08:38:28.398685+0000","last_fullsized":"2024-09-10T08:38:28.398685+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:58:25.492510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.801963+0000","last_change":"2024-09-10T08:38:27.224116+0000","last_active":"2024-09-10T08:38:28.801963+0000","last_peered":"2024-09-10T08:38:28.801963+0000","last_clean":"2024-09-10T08:38:28.801963+0000","last_became_active":"2024-09-10T08:38:27.223814+0000","last_became_peered":"2024-09-10T08:38:27.223814+0000","last_unstale":"2024-09-10T08:38:28.801963+0000","last_undegraded":"2024-09-10T08:38:28.801963+0000","last_fullsized":"2024-09-10T08:38:28.801963+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:26.180090+0000","last_clean_scrub_stamp":"2024-09-10T08:38:26.180090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:51.999984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"146'3","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193584+0000","last_change":"2024-09-10T08:38:26.202942+0000","last_active":"2024-09-10T08:38:28.193584+0000","last_peered":"2024-09-10T08:38:28.193584+0000","last_clean":"2024-09-10T08:38:28.193584+0000","last_became_active":"2024-09-10T08:38:26.202539+0000","last_became_peered":"2024-09-10T08:38:26.202539+0000","last_unstale":"2024-09-10T08:38:28.193584+0000","last_undegraded":"2024-09-10T08:38:28.193584+0000","last_fullsized":"2024-09-10T08:38:28.193584+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:38:25.176861+0000","last_clean_scrub_stamp":"2024-09-10T08:38:25.176861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:45.925948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":396,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-10T08:38:28.193933+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:38:28.193933+0000","last_peered":"2024-09-10T08:38:28.193933+0000","last_clean":"2024-09-10T08:38:28.193933+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:38:28.193933+0000","last_undegraded":"2024-09-10T08:38:28.193933+0000","last_fullsized":"2024-09-10T08:38:28.193933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28820,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343020,"statfs":{"total":96636764160,"available":96607252480,"internally_reserved":0,"allocated":1830912,"data_stored":803581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509562,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51032,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320808,"statfs":{"total":96636764160,"available":96584507392,"internally_reserved":0,"allocated":1830912,"data_stored":803581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55208,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316632,"statfs":{"total":96636764160,"available":96580231168,"internally_reserved":0,"allocated":1851392,"data_stored":805797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509562,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59360,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312480,"statfs":{"total":96636764160,"available":96575979520,"internally_reserved":0,"allocated":1839104,"data_stored":804197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509563,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55188,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316652,"statfs":{"total":96636764160,"available":96580251648,"internally_reserved":0,"allocated":1835008,"data_stored":803603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2428928,"data_stored":1394019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509564,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1835008,"data_stored":803671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542265,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55776,"kb_used_data":2380,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316064,"statfs":{"total":96636764160,"available":96579649536,"internally_reserved":0,"allocated":2437120,"data_stored":1389455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:38:31.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:38:31.849 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:38:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.048+0000 7f8978a00640 1 Processor -- start 2024-09-10T08:38:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.048+0000 7f8978a00640 1 -- start start 2024-09-10T08:38:32.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.049+0000 7f8978a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8974147f80 0x7f8974162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.049+0000 7f8978a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f89740b4b60 0x7f89741625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.049+0000 7f8978a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8974162af0 con 0x7f89740b4780 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.049+0000 7f8978a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8974162d80 con 0x7f8974147f80 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.049+0000 7f8978a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f89740b31f0 con 0x7f89740b4b60 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8974147f80 0x7f8974162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8974147f80 0x7f8974162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47482/0 (socket says 172.21.15.52:47482) 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 -- 172.21.15.52:0/189552681 learned_addr learned my addr 172.21.15.52:0/189552681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f8973e00640 1 --2- 172.21.15.52:0/189552681 >> v2:172.21.15.176:3300/0 conn(0x7f89740b4b60 0x7f89741625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 -- 172.21.15.52:0/189552681 >> v2:172.21.15.176:3300/0 conn(0x7f89740b4b60 msgr2=0x7f89741625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 --2- 172.21.15.52:0/189552681 >> v2:172.21.15.176:3300/0 conn(0x7f89740b4b60 0x7f89741625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 -- 172.21.15.52:0/189552681 >> v1:172.21.15.176:6789/0 conn(0x7f89740b4780 legacy=0x7f8974147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.050+0000 7f896be00640 1 -- 172.21.15.52:0/189552681 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740b34d0 con 0x7f8974147f80 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.051+0000 7f896be00640 1 --2- 172.21.15.52:0/189552681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8974147f80 0x7f8974162070 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f89740715f0 tx=0x7f895c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c209fe8d342d2db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.051+0000 7f8972a00640 1 -- 172.21.15.52:0/189552681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037070 con 0x7f8974147f80 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8972a00640 1 -- 172.21.15.52:0/189552681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c032440 con 0x7f8974147f80 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8972a00640 1 -- 172.21.15.52:0/189552681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c032810 con 0x7f8974147f80 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 -- 172.21.15.52:0/189552681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8974147f80 msgr2=0x7f8974162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 --2- 172.21.15.52:0/189552681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8974147f80 0x7f8974162070 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f89740715f0 tx=0x7f895c02a270 comp rx=0 tx=0).stop 2024-09-10T08:38:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 -- 172.21.15.52:0/189552681 shutdown_connections 2024-09-10T08:38:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 --2- 172.21.15.52:0/189552681 >> v2:172.21.15.176:3300/0 conn(0x7f89740b4b60 0x7f89741625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 --2- 172.21.15.52:0/189552681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8974147f80 0x7f8974162070 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 -- 172.21.15.52:0/189552681 >> 172.21.15.52:0/189552681 conn(0x7f897406bc10 msgr2=0x7f897406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 -- 172.21.15.52:0/189552681 shutdown_connections 2024-09-10T08:38:32.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.052+0000 7f8978a00640 1 -- 172.21.15.52:0/189552681 wait complete. 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.054+0000 7f8978a00640 1 Processor -- start 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.054+0000 7f8978a00640 1 -- start start 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 0x7f89741313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8974147f80 0x7f89740b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89740b3fb0 con 0x7f89740b4b60 2024-09-10T08:38:32.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89740b3a90 con 0x7f89740b4780 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8978a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89740b4130 con 0x7f8974147f80 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47484/0 (socket says 172.21.15.52:47484) 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 -- 172.21.15.52:0/1205599639 learned_addr learned my addr 172.21.15.52:0/1205599639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 -- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8974147f80 msgr2=0x7f89740b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8974147f80 0x7f89740b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 -- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 msgr2=0x7f89741313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8973400640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 0x7f89741313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 0x7f89741313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f896be00640 1 -- 172.21.15.52:0/1205599639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89741318e0 con 0x7f89740b4b60 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.055+0000 7f8973400640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 0x7f89741313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f896be00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f895c02a2b0 tx=0x7f895c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c041020 con 0x7f89740b4b60 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c0306c0 con 0x7f89740b4b60 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8974130300 con 0x7f89740b4b60 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c037040 con 0x7f89740b4b60 2024-09-10T08:38:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.056+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89741308c0 con 0x7f89740b4b60 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.057+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8974147870 con 0x7f89740b4b60 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.058+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f895c044020 con 0x7f89740b4b60 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.059+0000 7f896b400640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.059+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f895c0ab750 con 0x7f89740b4b60 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.059+0000 7f8973400640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.060+0000 7f8973400640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 0x7f895006e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8964001680 tx=0x7f8964009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.063+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f895c04b030 con 0x7f89740b4b60 2024-09-10T08:38:32.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.325+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8974146090 con 0x7f89740b4b60 2024-09-10T08:38:32.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.328+0000 7f896b400640 1 -- 172.21.15.52:0/1205599639 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f895c07a060 con 0x7f89740b4b60 2024-09-10T08:38:32.328 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:38:32.328 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:38:32.328 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:38:32.328 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:38:32.329 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:38:32.329 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 msgr2=0x7f895006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 0x7f895006e2f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8964001680 tx=0x7f8964009040 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 msgr2=0x7f897412fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f895c02a2b0 tx=0x7f895c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 shutdown_connections 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f895006be30 0x7f895006e2f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8974147f80 0x7f89740b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89740b4b60 0x7f897412fab0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 --2- 172.21.15.52:0/1205599639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89740b4780 0x7f89741313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 >> 172.21.15.52:0/1205599639 conn(0x7f897406bc10 msgr2=0x7f8974161ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 shutdown_connections 2024-09-10T08:38:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.330+0000 7f8978a00640 1 -- 172.21.15.52:0/1205599639 wait complete. 2024-09-10T08:38:32.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.502+0000 7fe20ae00640 1 Processor -- start 2024-09-10T08:38:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.502+0000 7fe20ae00640 1 -- start start 2024-09-10T08:38:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe20ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 0x7fe204070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe20ae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe204148260 0x7fe2040714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe20ae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe204071b30 con 0x7fe20406bc10 2024-09-10T08:38:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe20ae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe204074200 con 0x7fe204148260 2024-09-10T08:38:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe20ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2040b3e40 con 0x7fe204147e80 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe1fbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe204148260 0x7fe2040714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe1fbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe204148260 0x7fe2040714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47500/0 (socket says 172.21.15.52:47500) 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe1fbe00640 1 -- 172.21.15.52:0/2959645779 learned_addr learned my addr 172.21.15.52:0/2959645779 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe203e00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 0x7fe204070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.504+0000 7fe1fbe00640 1 -- 172.21.15.52:0/2959645779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 msgr2=0x7fe204070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.505+0000 7fe1fbe00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 0x7fe204070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.505+0000 7fe1fbe00640 1 -- 172.21.15.52:0/2959645779 >> v1:172.21.15.176:6789/0 conn(0x7fe20406bc10 legacy=0x7fe2041623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.505+0000 7fe1fbe00640 1 -- 172.21.15.52:0/2959645779 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2040b3510 con 0x7fe204148260 2024-09-10T08:38:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.505+0000 7fe203e00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 0x7fe204070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe1fbe00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040714b0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009870 tx=0x7fe1ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c43ff219740953 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe203400640 1 -- 172.21.15.52:0/2959645779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec037070 con 0x7fe204148260 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe203400640 1 -- 172.21.15.52:0/2959645779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec032440 con 0x7fe204148260 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe203400640 1 -- 172.21.15.52:0/2959645779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec032810 con 0x7fe204148260 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe20ae00640 1 -- 172.21.15.52:0/2959645779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 msgr2=0x7fe2040714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe20ae00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040714b0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009870 tx=0x7fe1ec02a210 comp rx=0 tx=0).stop 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe20ae00640 1 -- 172.21.15.52:0/2959645779 shutdown_connections 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.506+0000 7fe20ae00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040714b0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.507+0000 7fe20ae00640 1 --2- 172.21.15.52:0/2959645779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe204147e80 0x7fe204070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.507+0000 7fe20ae00640 1 -- 172.21.15.52:0/2959645779 >> 172.21.15.52:0/2959645779 conn(0x7fe2040ccec0 msgr2=0x7fe2040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.507+0000 7fe20ae00640 1 -- 172.21.15.52:0/2959645779 shutdown_connections 2024-09-10T08:38:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.507+0000 7fe20ae00640 1 -- 172.21.15.52:0/2959645779 wait complete. 2024-09-10T08:38:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.508+0000 7fe20ae00640 1 Processor -- start 2024-09-10T08:38:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.508+0000 7fe20ae00640 1 -- start start 2024-09-10T08:38:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 0x7fe2041f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe204147e80 0x7fe2041f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040b52e0 con 0x7fe204148260 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040b3ad0 con 0x7fe204147e80 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.509+0000 7fe20ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2040b5460 con 0x7fe20406bc10 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe203e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 0x7fe2041f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe1fbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe204147e80 0x7fe2041f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe203e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 0x7fe2041f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36896/0 (socket says 172.21.15.52:36896) 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe203e00640 1 -- 172.21.15.52:0/4108682679 learned_addr learned my addr 172.21.15.52:0/4108682679 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47502/0 (socket says 172.21.15.52:47502) 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 -- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 msgr2=0x7fe2041f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 0x7fe2041f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 -- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe204147e80 msgr2=0x7fe2041f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe204147e80 0x7fe2041f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 -- 172.21.15.52:0/4108682679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2041406e0 con 0x7fe204148260 2024-09-10T08:38:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.510+0000 7fe208e00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00be00 tx=0x7fe1fc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.511+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc003970 con 0x7fe204148260 2024-09-10T08:38:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.511+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc003b10 con 0x7fe204148260 2024-09-10T08:38:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.511+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc004020 con 0x7fe204148260 2024-09-10T08:38:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.511+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2041f7e60 con 0x7fe204148260 2024-09-10T08:38:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.511+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe204140980 con 0x7fe204148260 2024-09-10T08:38:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.512+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20406c070 con 0x7fe204148260 2024-09-10T08:38:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.513+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1fc0041c0 con 0x7fe204148260 2024-09-10T08:38:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.514+0000 7fe200c00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 0x7fe1e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.514+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc08ae60 con 0x7fe204148260 2024-09-10T08:38:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.514+0000 7fe203e00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 0x7fe1e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.515+0000 7fe203e00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 0x7fe1e006e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400ac20 tx=0x7fe1f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:32.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.518+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1fc0591b0 con 0x7fe204148260 2024-09-10T08:38:32.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.739+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2040cf5d0 con 0x7fe204148260 2024-09-10T08:38:32.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.740+0000 7fe200c00640 1 -- 172.21.15.52:0/4108682679 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7fe1fc05d4b0 con 0x7fe204148260 2024-09-10T08:38:32.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:32.741 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:38:32.741 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 msgr2=0x7fe1e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 0x7fe1e006e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400ac20 tx=0x7fe1f4008040 comp rx=0 tx=0).stop 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 msgr2=0x7fe2040cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00be00 tx=0x7fe1fc00bef0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 shutdown_connections 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe1e006be30 0x7fe1e006e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe204148260 0x7fe2040cbf60 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe204147e80 0x7fe2041f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 --2- 172.21.15.52:0/4108682679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe20406bc10 0x7fe2041f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:32.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 >> 172.21.15.52:0/4108682679 conn(0x7fe2040ccec0 msgr2=0x7fe2040c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:32.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 shutdown_connections 2024-09-10T08:38:32.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:32.742+0000 7fe20ae00640 1 -- 172.21.15.52:0/4108682679 wait complete. 2024-09-10T08:38:32.757 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-10T08:38:32.757+0000 7f2303c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:38:33.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:38:26.623253+0000', 'modified': '2024-09-10T08:38:29.650710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8182}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8182': {'gid': 8182, 'name': 'd', 'rank': 0, 'incarnation': 106, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/2632927131', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6835', 'nonce': 2632927131}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 2632927131}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8182, 'qdb_cluster': [8182]} 2024-09-10T08:38:33.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:38:33.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T08:38:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.322+0000 7f95aa200640 1 Processor -- start 2024-09-10T08:38:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.322+0000 7f95aa200640 1 -- start start 2024-09-10T08:38:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a41522d0 0x7f95a40b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f95a40b60e0 0x7f95a415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95a415f400 0x7f95a415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f95a415ca90 con 0x7f95a415f400 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f95a40b6660 con 0x7f95a40b60e0 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95aa200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95a415cce0 con 0x7f95a41522d0 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95a9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95a415f400 0x7f95a415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95a9800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f95a415f400 0x7f95a415b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47508/0 (socket says 172.21.15.52:47508) 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.323+0000 7f95a9800640 1 -- 172.21.15.52:0/3781127341 learned_addr learned my addr 172.21.15.52:0/3781127341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a8e00640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a41522d0 0x7f95a40b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a3e00640 1 --2- 172.21.15.52:0/3781127341 >> v2:172.21.15.176:3300/0 conn(0x7f95a40b60e0 0x7f95a415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a9800640 1 -- 172.21.15.52:0/3781127341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a41522d0 msgr2=0x7f95a40b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a9800640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a41522d0 0x7f95a40b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a9800640 1 -- 172.21.15.52:0/3781127341 >> v2:172.21.15.176:3300/0 conn(0x7f95a40b60e0 msgr2=0x7f95a415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a9800640 1 --2- 172.21.15.52:0/3781127341 >> v2:172.21.15.176:3300/0 conn(0x7f95a40b60e0 0x7f95a415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.324+0000 7f95a9800640 1 -- 172.21.15.52:0/3781127341 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a415cfc0 con 0x7f95a415f400 2024-09-10T08:38:33.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.325+0000 7f95a9800640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a415b8d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f95a406c7e0 tx=0x7f959c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0be87bd568c9be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.325+0000 7f95a3400640 1 -- 172.21.15.52:0/3781127341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c037070 con 0x7f95a415f400 2024-09-10T08:38:33.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.325+0000 7f95a3400640 1 -- 172.21.15.52:0/3781127341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c032440 con 0x7f95a415f400 2024-09-10T08:38:33.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.325+0000 7f95a3400640 1 -- 172.21.15.52:0/3781127341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c032810 con 0x7f95a415f400 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 -- 172.21.15.52:0/3781127341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 msgr2=0x7f95a415b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a415b8d0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f95a406c7e0 tx=0x7f959c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 -- 172.21.15.52:0/3781127341 shutdown_connections 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 --2- 172.21.15.52:0/3781127341 >> v2:172.21.15.176:3300/0 conn(0x7f95a40b60e0 0x7f95a415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a415b8d0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 --2- 172.21.15.52:0/3781127341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a41522d0 0x7f95a40b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 -- 172.21.15.52:0/3781127341 >> 172.21.15.52:0/3781127341 conn(0x7f95a406c240 msgr2=0x7f95a406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 -- 172.21.15.52:0/3781127341 shutdown_connections 2024-09-10T08:38:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.326+0000 7f95aa200640 1 -- 172.21.15.52:0/3781127341 wait complete. 2024-09-10T08:38:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.327+0000 7f95aa200640 1 Processor -- start 2024-09-10T08:38:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.328+0000 7f95aa200640 1 -- start start 2024-09-10T08:38:33.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.328+0000 7f95aa200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 0x7f95a4154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.328+0000 7f95aa200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a41522d0 0x7f95a4146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.328+0000 7f95aa200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.328+0000 7f95aa200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95a41526b0 con 0x7f95a415f400 2024-09-10T08:38:33.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95aa200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95a415fc80 con 0x7f95a41522d0 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95aa200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95a4152830 con 0x7f95a40b60e0 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 0x7f95a4154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a8e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 0x7f95a4154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36906/0 (socket says 172.21.15.52:36906) 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47516/0 (socket says 172.21.15.52:47516) 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a8e00640 1 -- 172.21.15.52:0/527300926 learned_addr learned my addr 172.21.15.52:0/527300926 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a3e00640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a41522d0 0x7f95a4146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 -- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 msgr2=0x7f95a4154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 0x7f95a4154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 -- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a41522d0 msgr2=0x7f95a4146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a41522d0 0x7f95a4146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.329+0000 7f95a9800640 1 -- 172.21.15.52:0/527300926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a4159280 con 0x7f95a415f400 2024-09-10T08:38:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95a9800640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f959c031000 tx=0x7f959c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95a0c00640 1 -- 172.21.15.52:0/527300926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c041020 con 0x7f95a415f400 2024-09-10T08:38:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95a0c00640 1 -- 172.21.15.52:0/527300926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c0306e0 con 0x7f95a415f400 2024-09-10T08:38:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95a0c00640 1 -- 172.21.15.52:0/527300926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c037040 con 0x7f95a415f400 2024-09-10T08:38:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a41474b0 con 0x7f95a415f400 2024-09-10T08:38:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.330+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a4152e30 con 0x7f95a415f400 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.332+0000 7f95a0c00640 1 -- 172.21.15.52:0/527300926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f959c044020 con 0x7f95a415f400 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.333+0000 7f95a0c00640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 0x7f958406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.333+0000 7f95a0c00640 1 -- 172.21.15.52:0/527300926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f959c0ab4c0 con 0x7f95a415f400 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.334+0000 7f95ae7e5740 1 Processor -- start 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.334+0000 7f95a8e00640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 0x7f958406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.334+0000 7f95ae7e5740 1 -- start start 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.334+0000 7f95a8e00640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 0x7f958406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9598003bc0 tx=0x7f9598009970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f24a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 0x55cd1f205280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1633b0 con 0x55cd1f206630 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f168410 con 0x55cd1f204ea0 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55cd1f110620 con 0x55cd1f202660 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47526/0 (socket says 172.21.15.52:47526) 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 -- 172.21.15.52:0/927971248 learned_addr learned my addr 172.21.15.52:0/927971248 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a8e00640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f24a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a3e00640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 0x55cd1f205280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 -- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 msgr2=0x55cd1f205280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 0x55cd1f205280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 -- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 msgr2=0x55cd1f24a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f24a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a9800640 1 -- 172.21.15.52:0/927971248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1ee7b2d0 con 0x55cd1f206630 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.335+0000 7f95a3e00640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 0x55cd1f205280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f95a9800640 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f959c0a9890 tx=0x7f959c075b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f365763546f9c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f9595600640 1 -- 172.21.15.52:0/927971248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c07da80 con 0x55cd1f206630 2024-09-10T08:38:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f9595600640 1 -- 172.21.15.52:0/927971248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c0822b0 con 0x55cd1f206630 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f9595600640 1 -- 172.21.15.52:0/927971248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c075df0 con 0x55cd1f206630 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f95ae7e5740 1 -- 172.21.15.52:0/927971248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 msgr2=0x55cd1f1ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.336+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f959c0a9890 tx=0x7f959c075b50 comp rx=0 tx=0).stop 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 -- 172.21.15.52:0/927971248 shutdown_connections 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f1ff720 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f202660 0x55cd1f205280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/927971248 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f24a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 -- 172.21.15.52:0/927971248 >> 172.21.15.52:0/927971248 conn(0x55cd1f2018f0 msgr2=0x55cd1f249b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 -- 172.21.15.52:0/927971248 shutdown_connections 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 -- 172.21.15.52:0/927971248 wait complete. 2024-09-10T08:38:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.337+0000 7f95ae7e5740 1 -- start start 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.338+0000 7f95ae7e5740 1 Processor -- start 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f22f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f224b20 0x55cd1f2032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f123780 con 0x55cd1f206630 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1643d0 con 0x55cd1f224b20 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55cd1f168410 con 0x55cd1f204ea0 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95ae7e5740 10 client.0 _ll_register_callbacks cb 0x55cd1f1615d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47538/0 (socket says 172.21.15.52:47538) 2024-09-10T08:38:33.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 -- 172.21.15.52:0/2216888575 learned_addr learned my addr 172.21.15.52:0/2216888575 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a9800640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f224b20 0x55cd1f2032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a8e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f22f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 -- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 msgr2=0x55cd1f22f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f22f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 -- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f224b20 msgr2=0x55cd1f2032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f224b20 0x55cd1f2032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a3e00640 1 -- 172.21.15.52:0/2216888575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1ef456b0 con 0x55cd1f206630 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.339+0000 7f95a8e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f22f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f95a3e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f9590003ce0 tx=0x7f959000b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548a054310982bae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590019070 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9590015660 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f959c0822b0 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f9590015860 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f95ae7e5740 10 client.8889 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55cd1f225750 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c0822b0 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.340+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f9590027080 con 0x55cd1f206630 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 10 client.8889 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 10 client.8889 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 20 client.8889 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f22e090 0x55cd1f1ff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 4 client.8889 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd1f175b40 con 0x55cd1f22e090 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.341+0000 7f95a8e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f22e090 0x55cd1f1ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.342+0000 7f95a8e00640 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f22e090 0x55cd1f1ff140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966d16dbce3d9570 server_cookie=9f688c77941c71bf in_seq=0 out_seq=0 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.342+0000 7f958a000640 10 client.8889 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f958a000640 1 -- 172.21.15.52:0/2216888575 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd1f175b40 con 0x55cd1f22e090 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f958a000640 10 client.8889 handle_command_reply: tid=0 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 client.8889 shutdown 2024-09-10T08:38:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 msgr2=0x55cd1f2239e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f9590003ce0 tx=0x7f959000b9d0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 shutdown_connections 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f22e090 0x55cd1f1ff140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f224b20 0x55cd1f2032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f206630 0x55cd1f2239e0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/2216888575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f22f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 >> 172.21.15.52:0/2216888575 conn(0x55cd1f202660 msgr2=0x55cd1f247b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.343+0000 7f958a000640 0 client.8889 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.344+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 shutdown_connections 2024-09-10T08:38:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.344+0000 7f95ae7e5740 1 -- 172.21.15.52:0/2216888575 wait complete. 2024-09-10T08:38:33.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.344+0000 7f95ae7e5740 20 client.8889 trim_cache size 0 max 16384 2024-09-10T08:38:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.363+0000 7f95ae7e5740 1 Processor -- start 2024-09-10T08:38:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.363+0000 7f95ae7e5740 1 -- start start 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f24ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 0x55cd1f263540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95a41f54e0 con 0x55cd1f224b20 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4156b30 con 0x55cd1f206630 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f95a41f4e90 con 0x55cd1f204ea0 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47552/0 (socket says 172.21.15.52:47552) 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 -- 172.21.15.52:0/917640953 learned_addr learned my addr 172.21.15.52:0/917640953 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 -- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 msgr2=0x55cd1f24ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a8e00640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f24ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a3e00640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 0x55cd1f263540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f24ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.364+0000 7f95a9800640 1 -- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 msgr2=0x55cd1f263540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f95a9800640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 0x55cd1f263540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f95a9800640 1 -- 172.21.15.52:0/917640953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1f201690 con 0x55cd1f224b20 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f95a8e00640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f24ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:33.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f95a3e00640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 0x55cd1f263540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f95a9800640 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f959c079db0 tx=0x7f959c0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6230c79f5841bdec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f9594c00640 1 -- 172.21.15.52:0/917640953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c0822b0 con 0x55cd1f224b20 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f9594c00640 1 -- 172.21.15.52:0/917640953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c077a80 con 0x55cd1f224b20 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.365+0000 7f9594c00640 1 -- 172.21.15.52:0/917640953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c081e20 con 0x55cd1f224b20 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- 172.21.15.52:0/917640953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 msgr2=0x55cd1f1ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f959c079db0 tx=0x7f959c0aa000 comp rx=0 tx=0).stop 2024-09-10T08:38:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- 172.21.15.52:0/917640953 shutdown_connections 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff140 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f206630 0x55cd1f263540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/917640953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f204ea0 0x55cd1f24ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- 172.21.15.52:0/917640953 >> 172.21.15.52:0/917640953 conn(0x55cd1f202660 msgr2=0x55cd1f224070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- 172.21.15.52:0/917640953 shutdown_connections 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- 172.21.15.52:0/917640953 wait complete. 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.366+0000 7f95ae7e5740 1 -- start start 2024-09-10T08:38:33.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.367+0000 7f95ae7e5740 1 Processor -- start 2024-09-10T08:38:33.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f247b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 0x55cd1f2be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1ffc70 con 0x55cd1f224b20 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55cd1f1633b0 con 0x55cd1f204ea0 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55cd1f22e500 con 0x55cd1f206630 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95ae7e5740 10 client.0 _ll_register_callbacks cb 0x7f9590006dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47558/0 (socket says 172.21.15.52:47558) 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 -- 172.21.15.52:0/799825630 learned_addr learned my addr 172.21.15.52:0/799825630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 -- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 msgr2=0x55cd1f2be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a8e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f247b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a3e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 0x55cd1f2be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 0x55cd1f2be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 -- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 msgr2=0x55cd1f247b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f247b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a9800640 1 -- 172.21.15.52:0/799825630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1f202da0 con 0x55cd1f224b20 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a8e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f247b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.368+0000 7f95a3e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 0x55cd1f2be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95a9800640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f959c0a9950 tx=0x7f959c080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d646af401c27864 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c079550 con 0x55cd1f224b20 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f959c082020 con 0x55cd1f224b20 2024-09-10T08:38:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f959c077a80 con 0x55cd1f224b20 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f959c0ab2c0 con 0x55cd1f224b20 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 10 client.8895 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55cd1f26c810 con 0x55cd1f224b20 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c077a80 con 0x55cd1f224b20 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f959c03a030 con 0x55cd1f224b20 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 10 client.8895 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 10 client.8895 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 20 client.8895 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f2c80d0 0x55cd1f2c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 4 client.8895 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.369+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "status"}) -- 0x55cd1f16fe90 con 0x55cd1f2c80d0 2024-09-10T08:38:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.370+0000 7f95a8e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f2c80d0 0x55cd1f2c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.370+0000 7f95a8e00640 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f2c80d0 0x55cd1f2c84b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adab438c57152b72 server_cookie=b6149462a9e45594 in_seq=0 out_seq=0 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.370+0000 7f958a000640 10 client.8895 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f958a000640 1 -- 172.21.15.52:0/799825630 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55cd1f16fe90 con 0x55cd1f2c80d0 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f958a000640 10 client.8895 handle_command_reply: tid=0 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 client.8895 shutdown 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 msgr2=0x55cd1f1ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f959c0a9950 tx=0x7f959c080040 comp rx=0 tx=0).stop 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 shutdown_connections 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55cd1f2c80d0 0x55cd1f2c84b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd1f224b20 0x55cd1f1ff0a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55cd1f206630 0x55cd1f2be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 --2- 172.21.15.52:0/799825630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55cd1f204ea0 0x55cd1f247b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f958a000640 0 client.8895 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 >> 172.21.15.52:0/799825630 conn(0x55cd1f202660 msgr2=0x55cd1f263540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 shutdown_connections 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 1 -- 172.21.15.52:0/799825630 wait complete. 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.371+0000 7f95ae7e5740 20 client.8895 trim_cache size 0 max 16384 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 8182, 2024-09-10T08:38:33.379 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1816226089999997, 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 110, 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 147, 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 147, 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 11.258965230999999 2024-09-10T08:38:33.380 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 msgr2=0x7f958406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 0x7f958406e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9598003bc0 tx=0x7f9598009970 comp rx=0 tx=0).stop 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 msgr2=0x7f95a4150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f959c031000 tx=0x7f959c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 shutdown_connections 2024-09-10T08:38:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f958406be30 0x7f958406e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a415f400 0x7f95a4150910 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a41522d0 0x7f95a4146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 --2- 172.21.15.52:0/527300926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f95a40b60e0 0x7f95a4154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 >> 172.21.15.52:0/527300926 conn(0x7f95a406c240 msgr2=0x7f95a4159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 shutdown_connections 2024-09-10T08:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.372+0000 7f95aa200640 1 -- 172.21.15.52:0/527300926 wait complete. 2024-09-10T08:38:33.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:38:33.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.544+0000 7f449dc00640 1 Processor -- start 2024-09-10T08:38:33.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.545+0000 7f449dc00640 1 -- start start 2024-09-10T08:38:33.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f449dc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4498145ed0 0x7f44980b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f449dc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44980b4020 con 0x7f4498073180 2024-09-10T08:38:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f449dc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44980b42c0 con 0x7f44980b5f90 2024-09-10T08:38:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f449dc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f44980b63d0 con 0x7f4498145ed0 2024-09-10T08:38:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f448fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4498073180 0x7f44980b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:33676/0 (socket says 172.21.15.52:33676) 2024-09-10T08:38:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f448fe00640 1 -- 172.21.15.52:0/3191289697 learned_addr learned my addr 172.21.15.52:0/3191289697 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.546+0000 7f4496a00640 1 --2- 172.21.15.52:0/3191289697 >> v2:172.21.15.176:3300/0 conn(0x7f4498145ed0 0x7f44980b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984522717 0 0) 0x7f44980b4020 con 0x7f4498073180 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f447c003520 con 0x7f4498073180 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937603687 0 0) 0x7f44980b42c0 con 0x7f44980b5f90 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44980b4020 con 0x7f44980b5f90 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496a00640 1 -- 172.21.15.52:0/3191289697 >> v1:172.21.15.176:6789/0 conn(0x7f44980b5f90 legacy=0x7f449815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496a00640 1 -- 172.21.15.52:0/3191289697 >> v1:172.21.15.52:6789/0 conn(0x7f4498073180 legacy=0x7f44980b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.547+0000 7f4496a00640 1 -- 172.21.15.52:0/3191289697 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44980b45a0 con 0x7f4498145ed0 2024-09-10T08:38:33.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.548+0000 7f4496a00640 1 --2- 172.21.15.52:0/3191289697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498145ed0 0x7f44980b5080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f44880097a0 tx=0x7f448802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e32db0ec0d1c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.548+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488037070 con 0x7f4498145ed0 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.548+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488032440 con 0x7f4498145ed0 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.548+0000 7f4496000640 1 -- 172.21.15.52:0/3191289697 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880327f0 con 0x7f4498145ed0 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 -- 172.21.15.52:0/3191289697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498145ed0 msgr2=0x7f44980b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 --2- 172.21.15.52:0/3191289697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498145ed0 0x7f44980b5080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f44880097a0 tx=0x7f448802a230 comp rx=0 tx=0).stop 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 -- 172.21.15.52:0/3191289697 shutdown_connections 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 --2- 172.21.15.52:0/3191289697 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498145ed0 0x7f44980b5080 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 -- 172.21.15.52:0/3191289697 >> 172.21.15.52:0/3191289697 conn(0x7f44980ccec0 msgr2=0x7f44980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 -- 172.21.15.52:0/3191289697 shutdown_connections 2024-09-10T08:38:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.549+0000 7f449dc00640 1 -- 172.21.15.52:0/3191289697 wait complete. 2024-09-10T08:38:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.550+0000 7f449dc00640 1 Processor -- start 2024-09-10T08:38:33.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 -- start start 2024-09-10T08:38:33.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498073180 0x7f449815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44980b5f90 0x7f4498135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44981462b0 con 0x7f4498145ed0 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f44980b4b60 con 0x7f4498073180 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.551+0000 7f449dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4498146430 con 0x7f44980b5f90 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47564/0 (socket says 172.21.15.52:47564) 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 -- 172.21.15.52:0/1352248575 learned_addr learned my addr 172.21.15.52:0/1352248575 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f448fe00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44980b5f90 0x7f4498135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4496a00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498073180 0x7f449815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 -- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44980b5f90 msgr2=0x7f4498135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44980b5f90 0x7f4498135a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 -- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498073180 msgr2=0x7f449815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498073180 0x7f449815c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.552+0000 7f4497400640 1 -- 172.21.15.52:0/1352248575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449815c8c0 con 0x7f4498145ed0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f4497400640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f449000c790 tx=0x7f449000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490003b70 con 0x7f4498145ed0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44980caf50 con 0x7f4498145ed0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4490003d10 con 0x7f4498145ed0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000aa50 con 0x7f4498145ed0 2024-09-10T08:38:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.553+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44980cb510 con 0x7f4498145ed0 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.554+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44980b5080 con 0x7f4498145ed0 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.555+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f449000abf0 con 0x7f4498145ed0 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.556+0000 7f448ea00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 0x7f447406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.556+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f449008ad60 con 0x7f4498145ed0 2024-09-10T08:38:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.556+0000 7f4496a00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 0x7f447406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.557+0000 7f4496a00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 0x7f447406e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4488034000 tx=0x7f448802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.560+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f449815c8c0 con 0x7f4498145ed0 2024-09-10T08:38:33.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.781+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4498145490 con 0x7f4498145ed0 2024-09-10T08:38:33.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.781+0000 7f448ea00640 1 -- 172.21.15.52:0/1352248575 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v110) ==== 53+0+73 (secure 0 0 0) 0x7f4490059030 con 0x7f4498145ed0 2024-09-10T08:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 msgr2=0x7f447406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 0x7f447406e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4488034000 tx=0x7f448802e000 comp rx=0 tx=0).stop 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 msgr2=0x7f44981e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f449000c790 tx=0x7f449000cc50 comp rx=0 tx=0).stop 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 shutdown_connections 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f447406be30 0x7f447406e2f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4498145ed0 0x7f44981e6110 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44980b5f90 0x7f4498135a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 --2- 172.21.15.52:0/1352248575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4498073180 0x7f449815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 >> 172.21.15.52:0/1352248575 conn(0x7f44980ccec0 msgr2=0x7f44980d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.783+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 shutdown_connections 2024-09-10T08:38:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:33.784+0000 7f449dc00640 1 -- 172.21.15.52:0/1352248575 wait complete. 2024-09-10T08:38:33.799 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:38:33.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:38:33.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:38:33.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:33.800 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42089sec preferred_lft 42089sec 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:38:33.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:33.840 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:38:33.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:33.933 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:38:33.970 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:38:33.970 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:33.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:38:33.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:38:33.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:38:33.971 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:38:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:34.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:34.167 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:38:34.203 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:38:34.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:34.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:38:34.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:38:34.301 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:38:34.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:38:34.337 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:38:34.412 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:38:34.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:34.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:38:34.574 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:38:34.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:34.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:38:34.631 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:38:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout:client8904 2024-09-10T08:38:34.730 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:38:34.730 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:34.766 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:34.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:34.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:34.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:34.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191316 s, 54.8 MB/s 2024-09-10T08:38:34.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:34.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:34.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166556 s, 63.0 MB/s 2024-09-10T08:38:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190284 s, 55.1 MB/s 2024-09-10T08:38:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:34.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162542 s, 64.5 MB/s 2024-09-10T08:38:35.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148829 s, 70.5 MB/s 2024-09-10T08:38:35.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149124 s, 70.3 MB/s 2024-09-10T08:38:35.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160196 s, 65.5 MB/s 2024-09-10T08:38:35.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.060 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139476 s, 75.2 MB/s 2024-09-10T08:38:35.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123134 s, 85.2 MB/s 2024-09-10T08:38:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.097 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185298 s, 56.6 MB/s 2024-09-10T08:38:35.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.114 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.114 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013554 s, 77.4 MB/s 2024-09-10T08:38:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.132 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014106 s, 74.3 MB/s 2024-09-10T08:38:35.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.148 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012473 s, 84.1 MB/s 2024-09-10T08:38:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126919 s, 82.6 MB/s 2024-09-10T08:38:35.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013734 s, 76.3 MB/s 2024-09-10T08:38:35.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184031 s, 57.0 MB/s 2024-09-10T08:38:35.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141719 s, 74.0 MB/s 2024-09-10T08:38:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.238 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135515 s, 77.4 MB/s 2024-09-10T08:38:35.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140257 s, 74.8 MB/s 2024-09-10T08:38:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174439 s, 60.1 MB/s 2024-09-10T08:38:35.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161859 s, 64.8 MB/s 2024-09-10T08:38:35.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.313 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137261 s, 76.4 MB/s 2024-09-10T08:38:35.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133836 s, 78.3 MB/s 2024-09-10T08:38:35.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.350 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176828 s, 59.3 MB/s 2024-09-10T08:38:35.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173706 s, 60.4 MB/s 2024-09-10T08:38:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.393 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183637 s, 57.1 MB/s 2024-09-10T08:38:35.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.413 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160814 s, 65.2 MB/s 2024-09-10T08:38:35.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.433 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016684 s, 62.8 MB/s 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142992 s, 73.3 MB/s 2024-09-10T08:38:35.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.467 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.467 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133901 s, 78.3 MB/s 2024-09-10T08:38:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160821 s, 65.2 MB/s 2024-09-10T08:38:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152514 s, 68.8 MB/s 2024-09-10T08:38:35.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:35.515 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:35.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159665 s, 65.7 MB/s 2024-09-10T08:38:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133767 s, 78.4 MB/s 2024-09-10T08:38:35.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184733 s, 56.8 MB/s 2024-09-10T08:38:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013132 s, 79.8 MB/s 2024-09-10T08:38:35.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.690 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013329 s, 78.7 MB/s 2024-09-10T08:38:35.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157059 s, 66.8 MB/s 2024-09-10T08:38:35.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137054 s, 76.5 MB/s 2024-09-10T08:38:35.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146219 s, 71.7 MB/s 2024-09-10T08:38:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129832 s, 80.8 MB/s 2024-09-10T08:38:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130662 s, 80.3 MB/s 2024-09-10T08:38:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167857 s, 62.5 MB/s 2024-09-10T08:38:35.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.815 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153409 s, 68.4 MB/s 2024-09-10T08:38:35.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.831 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.831 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128426 s, 81.6 MB/s 2024-09-10T08:38:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140205 s, 74.8 MB/s 2024-09-10T08:38:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.869 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177889 s, 58.9 MB/s 2024-09-10T08:38:35.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170182 s, 61.6 MB/s 2024-09-10T08:38:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135528 s, 77.4 MB/s 2024-09-10T08:38:35.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122115 s, 85.9 MB/s 2024-09-10T08:38:35.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160071 s, 65.5 MB/s 2024-09-10T08:38:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131332 s, 79.8 MB/s 2024-09-10T08:38:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134875 s, 77.7 MB/s 2024-09-10T08:38:35.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:35.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:35.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128464 s, 81.6 MB/s 2024-09-10T08:38:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126091 s, 83.2 MB/s 2024-09-10T08:38:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141858 s, 73.9 MB/s 2024-09-10T08:38:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133861 s, 78.3 MB/s 2024-09-10T08:38:36.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.061 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017057 s, 61.5 MB/s 2024-09-10T08:38:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138677 s, 75.6 MB/s 2024-09-10T08:38:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149121 s, 70.3 MB/s 2024-09-10T08:38:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127449 s, 82.3 MB/s 2024-09-10T08:38:36.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.132 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162764 s, 64.4 MB/s 2024-09-10T08:38:36.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.151 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015297 s, 68.5 MB/s 2024-09-10T08:38:36.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125481 s, 83.6 MB/s 2024-09-10T08:38:36.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:36.176 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:36.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114933 s, 91.2 MB/s 2024-09-10T08:38:36.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143642 s, 73.0 MB/s 2024-09-10T08:38:36.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.308 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133023 s, 78.8 MB/s 2024-09-10T08:38:36.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144925 s, 72.4 MB/s 2024-09-10T08:38:36.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134035 s, 78.2 MB/s 2024-09-10T08:38:36.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.361 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156851 s, 66.9 MB/s 2024-09-10T08:38:36.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.378 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134131 s, 78.2 MB/s 2024-09-10T08:38:36.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.394 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133398 s, 78.6 MB/s 2024-09-10T08:38:36.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.414 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163822 s, 64.0 MB/s 2024-09-10T08:38:36.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.432 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147105 s, 71.3 MB/s 2024-09-10T08:38:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167964 s, 62.4 MB/s 2024-09-10T08:38:36.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.472 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162769 s, 64.4 MB/s 2024-09-10T08:38:36.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117222 s, 89.5 MB/s 2024-09-10T08:38:36.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.506 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161991 s, 64.7 MB/s 2024-09-10T08:38:36.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125267 s, 83.7 MB/s 2024-09-10T08:38:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131924 s, 79.5 MB/s 2024-09-10T08:38:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.555 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128858 s, 81.4 MB/s 2024-09-10T08:38:36.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131861 s, 79.5 MB/s 2024-09-10T08:38:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131999 s, 79.4 MB/s 2024-09-10T08:38:36.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.605 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128437 s, 81.6 MB/s 2024-09-10T08:38:36.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.621 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133652 s, 78.5 MB/s 2024-09-10T08:38:36.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154601 s, 67.8 MB/s 2024-09-10T08:38:36.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132282 s, 79.3 MB/s 2024-09-10T08:38:36.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130393 s, 80.4 MB/s 2024-09-10T08:38:36.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.690 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133909 s, 78.3 MB/s 2024-09-10T08:38:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140791 s, 74.5 MB/s 2024-09-10T08:38:36.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126004 s, 83.2 MB/s 2024-09-10T08:38:36.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.740 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135583 s, 77.3 MB/s 2024-09-10T08:38:36.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166635 s, 62.9 MB/s 2024-09-10T08:38:36.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132158 s, 79.3 MB/s 2024-09-10T08:38:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129094 s, 81.2 MB/s 2024-09-10T08:38:36.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.809 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131797 s, 79.6 MB/s 2024-09-10T08:38:36.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:36.819 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:36.820 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138537 s, 75.7 MB/s 2024-09-10T08:38:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121402 s, 86.4 MB/s 2024-09-10T08:38:36.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.952 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134021 s, 78.2 MB/s 2024-09-10T08:38:36.968 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.968 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.968 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131643 s, 79.7 MB/s 2024-09-10T08:38:36.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:36.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:36.985 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013701 s, 76.5 MB/s 2024-09-10T08:38:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.001 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127468 s, 82.3 MB/s 2024-09-10T08:38:37.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153636 s, 68.3 MB/s 2024-09-10T08:38:37.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132402 s, 79.2 MB/s 2024-09-10T08:38:37.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.053 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136877 s, 76.6 MB/s 2024-09-10T08:38:37.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.069 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123968 s, 84.6 MB/s 2024-09-10T08:38:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.086 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132365 s, 79.2 MB/s 2024-09-10T08:38:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125839 s, 83.3 MB/s 2024-09-10T08:38:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143029 s, 73.3 MB/s 2024-09-10T08:38:37.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158751 s, 66.1 MB/s 2024-09-10T08:38:37.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137747 s, 76.1 MB/s 2024-09-10T08:38:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174622 s, 60.0 MB/s 2024-09-10T08:38:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147225 s, 71.2 MB/s 2024-09-10T08:38:37.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.210 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126007 s, 83.2 MB/s 2024-09-10T08:38:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013015 s, 80.6 MB/s 2024-09-10T08:38:37.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128843 s, 81.4 MB/s 2024-09-10T08:38:37.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.260 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138559 s, 75.7 MB/s 2024-09-10T08:38:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162827 s, 64.4 MB/s 2024-09-10T08:38:37.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.295 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01285 s, 81.6 MB/s 2024-09-10T08:38:37.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.315 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161849 s, 64.8 MB/s 2024-09-10T08:38:37.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131524 s, 79.7 MB/s 2024-09-10T08:38:37.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168979 s, 62.1 MB/s 2024-09-10T08:38:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139708 s, 75.1 MB/s 2024-09-10T08:38:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129554 s, 80.9 MB/s 2024-09-10T08:38:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141249 s, 74.2 MB/s 2024-09-10T08:38:37.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.419 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131077 s, 80.0 MB/s 2024-09-10T08:38:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142945 s, 73.4 MB/s 2024-09-10T08:38:37.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:37.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:38:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133847 s, 78.3 MB/s 2024-09-10T08:38:37.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:37.462 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:37.462 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:37.463 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T08:38:37.463 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:37.463 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:37.463 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:37.463 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:37.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.604 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141074 s, 74.3 MB/s 2024-09-10T08:38:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015416 s, 68.0 MB/s 2024-09-10T08:38:37.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163073 s, 64.3 MB/s 2024-09-10T08:38:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.660 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148376 s, 70.7 MB/s 2024-09-10T08:38:37.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.675 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121104 s, 86.6 MB/s 2024-09-10T08:38:37.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124367 s, 84.3 MB/s 2024-09-10T08:38:37.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.707 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125056 s, 83.8 MB/s 2024-09-10T08:38:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136296 s, 76.9 MB/s 2024-09-10T08:38:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013916 s, 75.4 MB/s 2024-09-10T08:38:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013121 s, 79.9 MB/s 2024-09-10T08:38:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148926 s, 70.4 MB/s 2024-09-10T08:38:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017233 s, 60.8 MB/s 2024-09-10T08:38:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.812 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012943 s, 81.0 MB/s 2024-09-10T08:38:37.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126344 s, 83.0 MB/s 2024-09-10T08:38:37.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127124 s, 82.5 MB/s 2024-09-10T08:38:37.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134482 s, 78.0 MB/s 2024-09-10T08:38:37.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132689 s, 79.0 MB/s 2024-09-10T08:38:37.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.894 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134069 s, 78.2 MB/s 2024-09-10T08:38:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126533 s, 82.9 MB/s 2024-09-10T08:38:37.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139187 s, 75.3 MB/s 2024-09-10T08:38:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131374 s, 79.8 MB/s 2024-09-10T08:38:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130661 s, 80.3 MB/s 2024-09-10T08:38:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125903 s, 83.3 MB/s 2024-09-10T08:38:37.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:37.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:37.992 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127773 s, 82.1 MB/s 2024-09-10T08:38:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160236 s, 65.4 MB/s 2024-09-10T08:38:38.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140461 s, 74.7 MB/s 2024-09-10T08:38:38.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.049 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171398 s, 61.2 MB/s 2024-09-10T08:38:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.065 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128099 s, 81.9 MB/s 2024-09-10T08:38:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.083 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141298 s, 74.2 MB/s 2024-09-10T08:38:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134544 s, 77.9 MB/s 2024-09-10T08:38:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130988 s, 80.1 MB/s 2024-09-10T08:38:38.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142827 s, 73.4 MB/s 2024-09-10T08:38:38.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:38.143 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:38.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:38.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130901 s, 80.1 MB/s 2024-09-10T08:38:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131884 s, 79.5 MB/s 2024-09-10T08:38:38.274 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126006 s, 83.2 MB/s 2024-09-10T08:38:38.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133045 s, 78.8 MB/s 2024-09-10T08:38:38.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.310 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154462 s, 67.9 MB/s 2024-09-10T08:38:38.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141424 s, 74.1 MB/s 2024-09-10T08:38:38.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.343 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127874 s, 82.0 MB/s 2024-09-10T08:38:38.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.360 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130271 s, 80.5 MB/s 2024-09-10T08:38:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127666 s, 82.1 MB/s 2024-09-10T08:38:38.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127874 s, 82.0 MB/s 2024-09-10T08:38:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128432 s, 81.6 MB/s 2024-09-10T08:38:38.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.426 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144686 s, 72.5 MB/s 2024-09-10T08:38:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153519 s, 68.3 MB/s 2024-09-10T08:38:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134158 s, 78.2 MB/s 2024-09-10T08:38:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128926 s, 81.3 MB/s 2024-09-10T08:38:38.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.498 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165444 s, 63.4 MB/s 2024-09-10T08:38:38.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.514 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125225 s, 83.7 MB/s 2024-09-10T08:38:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129611 s, 80.9 MB/s 2024-09-10T08:38:38.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.547 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137795 s, 76.1 MB/s 2024-09-10T08:38:38.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.564 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135809 s, 77.2 MB/s 2024-09-10T08:38:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156122 s, 67.2 MB/s 2024-09-10T08:38:38.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.600 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136181 s, 77.0 MB/s 2024-09-10T08:38:38.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.615 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126114 s, 83.1 MB/s 2024-09-10T08:38:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132931 s, 78.9 MB/s 2024-09-10T08:38:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.648 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129681 s, 80.9 MB/s 2024-09-10T08:38:38.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124838 s, 84.0 MB/s 2024-09-10T08:38:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127043 s, 82.5 MB/s 2024-09-10T08:38:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012032 s, 87.1 MB/s 2024-09-10T08:38:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136565 s, 76.8 MB/s 2024-09-10T08:38:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126902 s, 82.6 MB/s 2024-09-10T08:38:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013554 s, 77.4 MB/s 2024-09-10T08:38:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012414 s, 84.5 MB/s 2024-09-10T08:38:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:38.770 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:38.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146301 s, 71.7 MB/s 2024-09-10T08:38:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135334 s, 77.5 MB/s 2024-09-10T08:38:38.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156042 s, 67.2 MB/s 2024-09-10T08:38:38.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147541 s, 71.1 MB/s 2024-09-10T08:38:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118842 s, 88.2 MB/s 2024-09-10T08:38:38.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131551 s, 79.7 MB/s 2024-09-10T08:38:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128709 s, 81.5 MB/s 2024-09-10T08:38:38.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:38.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:38.992 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157294 s, 66.7 MB/s 2024-09-10T08:38:39.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129579 s, 80.9 MB/s 2024-09-10T08:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.025 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137698 s, 76.2 MB/s 2024-09-10T08:38:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013684 s, 76.6 MB/s 2024-09-10T08:38:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134214 s, 78.1 MB/s 2024-09-10T08:38:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134783 s, 77.8 MB/s 2024-09-10T08:38:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164397 s, 63.8 MB/s 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.115 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167183 s, 62.7 MB/s 2024-09-10T08:38:39.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.131 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.132 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133086 s, 78.8 MB/s 2024-09-10T08:38:39.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131294 s, 79.9 MB/s 2024-09-10T08:38:39.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128599 s, 81.5 MB/s 2024-09-10T08:38:39.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150025 s, 69.9 MB/s 2024-09-10T08:38:39.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.199 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134942 s, 77.7 MB/s 2024-09-10T08:38:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123703 s, 84.8 MB/s 2024-09-10T08:38:39.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.233 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144077 s, 72.8 MB/s 2024-09-10T08:38:39.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131762 s, 79.6 MB/s 2024-09-10T08:38:39.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.268 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154158 s, 68.0 MB/s 2024-09-10T08:38:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126872 s, 82.6 MB/s 2024-09-10T08:38:39.300 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130719 s, 80.2 MB/s 2024-09-10T08:38:39.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.321 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169275 s, 61.9 MB/s 2024-09-10T08:38:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131407 s, 79.8 MB/s 2024-09-10T08:38:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132631 s, 79.1 MB/s 2024-09-10T08:38:39.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130202 s, 80.5 MB/s 2024-09-10T08:38:39.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128221 s, 81.8 MB/s 2024-09-10T08:38:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157458 s, 66.6 MB/s 2024-09-10T08:38:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:39.414 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:39.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169187 s, 62.0 MB/s 2024-09-10T08:38:39.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172334 s, 60.8 MB/s 2024-09-10T08:38:39.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128671 s, 81.5 MB/s 2024-09-10T08:38:39.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.571 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130621 s, 80.3 MB/s 2024-09-10T08:38:39.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.587 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133801 s, 78.4 MB/s 2024-09-10T08:38:39.603 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.604 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129933 s, 80.7 MB/s 2024-09-10T08:38:39.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.620 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131088 s, 80.0 MB/s 2024-09-10T08:38:39.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.636 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127338 s, 82.3 MB/s 2024-09-10T08:38:39.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138706 s, 75.6 MB/s 2024-09-10T08:38:39.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172821 s, 60.7 MB/s 2024-09-10T08:38:39.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158359 s, 66.2 MB/s 2024-09-10T08:38:39.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129777 s, 80.8 MB/s 2024-09-10T08:38:39.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129233 s, 81.1 MB/s 2024-09-10T08:38:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129366 s, 81.1 MB/s 2024-09-10T08:38:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150145 s, 69.8 MB/s 2024-09-10T08:38:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130299 s, 80.5 MB/s 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134203 s, 78.1 MB/s 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175092 s, 59.9 MB/s 2024-09-10T08:38:39.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.832 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138146 s, 75.9 MB/s 2024-09-10T08:38:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.849 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132214 s, 79.3 MB/s 2024-09-10T08:38:39.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012183 s, 86.1 MB/s 2024-09-10T08:38:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127372 s, 82.3 MB/s 2024-09-10T08:38:39.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.894 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107218 s, 97.8 MB/s 2024-09-10T08:38:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013536 s, 77.5 MB/s 2024-09-10T08:38:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012745 s, 82.3 MB/s 2024-09-10T08:38:39.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162317 s, 64.6 MB/s 2024-09-10T08:38:39.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124379 s, 84.3 MB/s 2024-09-10T08:38:39.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137882 s, 76.0 MB/s 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133496 s, 78.5 MB/s 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.011 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129414 s, 81.0 MB/s 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.033 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169981 s, 61.7 MB/s 2024-09-10T08:38:40.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119711 s, 87.6 MB/s 2024-09-10T08:38:40.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:40.057 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:40.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138745 s, 75.6 MB/s 2024-09-10T08:38:40.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.178 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166865 s, 62.8 MB/s 2024-09-10T08:38:40.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.195 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131316 s, 79.9 MB/s 2024-09-10T08:38:40.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.212 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130343 s, 80.4 MB/s 2024-09-10T08:38:40.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127964 s, 81.9 MB/s 2024-09-10T08:38:40.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.248 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165681 s, 63.3 MB/s 2024-09-10T08:38:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128732 s, 81.5 MB/s 2024-09-10T08:38:40.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120041 s, 87.4 MB/s 2024-09-10T08:38:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141622 s, 74.0 MB/s 2024-09-10T08:38:40.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.314 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133267 s, 78.7 MB/s 2024-09-10T08:38:40.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142471 s, 73.6 MB/s 2024-09-10T08:38:40.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.347 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129157 s, 81.2 MB/s 2024-09-10T08:38:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125912 s, 83.3 MB/s 2024-09-10T08:38:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131081 s, 80.0 MB/s 2024-09-10T08:38:40.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131113 s, 80.0 MB/s 2024-09-10T08:38:40.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.412 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124883 s, 84.0 MB/s 2024-09-10T08:38:40.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.431 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162401 s, 64.6 MB/s 2024-09-10T08:38:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167156 s, 62.7 MB/s 2024-09-10T08:38:40.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.472 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170648 s, 61.4 MB/s 2024-09-10T08:38:40.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.491 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151076 s, 69.4 MB/s 2024-09-10T08:38:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.506 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012271 s, 85.5 MB/s 2024-09-10T08:38:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126045 s, 83.2 MB/s 2024-09-10T08:38:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127135 s, 82.5 MB/s 2024-09-10T08:38:40.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.558 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168236 s, 62.3 MB/s 2024-09-10T08:38:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130096 s, 80.6 MB/s 2024-09-10T08:38:40.594 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.594 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.594 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170371 s, 61.5 MB/s 2024-09-10T08:38:40.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.611 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131476 s, 79.8 MB/s 2024-09-10T08:38:40.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.631 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161466 s, 64.9 MB/s 2024-09-10T08:38:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.647 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133462 s, 78.6 MB/s 2024-09-10T08:38:40.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.667 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172895 s, 60.6 MB/s 2024-09-10T08:38:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012762 s, 82.2 MB/s 2024-09-10T08:38:40.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128179 s, 81.8 MB/s 2024-09-10T08:38:40.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:40.709 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:40.709 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:40.709 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T08:38:40.710 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:40.710 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:40.710 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:40.710 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:40.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:40.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138717 s, 75.6 MB/s 2024-09-10T08:38:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01339 s, 78.3 MB/s 2024-09-10T08:38:40.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141481 s, 74.1 MB/s 2024-09-10T08:38:40.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156488 s, 67.0 MB/s 2024-09-10T08:38:40.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130779 s, 80.2 MB/s 2024-09-10T08:38:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.898 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131687 s, 79.6 MB/s 2024-09-10T08:38:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118694 s, 88.3 MB/s 2024-09-10T08:38:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125414 s, 83.6 MB/s 2024-09-10T08:38:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127939 s, 82.0 MB/s 2024-09-10T08:38:40.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161734 s, 64.8 MB/s 2024-09-10T08:38:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:40.981 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137596 s, 76.2 MB/s 2024-09-10T08:38:41.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.001 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164074 s, 63.9 MB/s 2024-09-10T08:38:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.017 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130571 s, 80.3 MB/s 2024-09-10T08:38:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170408 s, 61.5 MB/s 2024-09-10T08:38:41.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136002 s, 77.1 MB/s 2024-09-10T08:38:41.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136531 s, 76.8 MB/s 2024-09-10T08:38:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117383 s, 89.3 MB/s 2024-09-10T08:38:41.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.106 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169222 s, 62.0 MB/s 2024-09-10T08:38:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.122 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129052 s, 81.3 MB/s 2024-09-10T08:38:41.139 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.140 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014164 s, 74.0 MB/s 2024-09-10T08:38:41.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132604 s, 79.1 MB/s 2024-09-10T08:38:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139589 s, 75.1 MB/s 2024-09-10T08:38:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136738 s, 76.7 MB/s 2024-09-10T08:38:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133143 s, 78.8 MB/s 2024-09-10T08:38:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139204 s, 75.3 MB/s 2024-09-10T08:38:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012894 s, 81.3 MB/s 2024-09-10T08:38:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133553 s, 78.5 MB/s 2024-09-10T08:38:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166172 s, 63.1 MB/s 2024-09-10T08:38:41.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131066 s, 80.0 MB/s 2024-09-10T08:38:41.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.310 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132131 s, 79.4 MB/s 2024-09-10T08:38:41.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128338 s, 81.7 MB/s 2024-09-10T08:38:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132883 s, 78.9 MB/s 2024-09-10T08:38:41.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:41.351 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:41.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.454 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166467 s, 63.0 MB/s 2024-09-10T08:38:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137271 s, 76.4 MB/s 2024-09-10T08:38:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133938 s, 78.3 MB/s 2024-09-10T08:38:41.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.503 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125719 s, 83.4 MB/s 2024-09-10T08:38:41.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.520 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013045 s, 80.4 MB/s 2024-09-10T08:38:41.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146136 s, 71.8 MB/s 2024-09-10T08:38:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125114 s, 83.8 MB/s 2024-09-10T08:38:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134393 s, 78.0 MB/s 2024-09-10T08:38:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013204 s, 79.4 MB/s 2024-09-10T08:38:41.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.604 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137779 s, 76.1 MB/s 2024-09-10T08:38:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164922 s, 63.6 MB/s 2024-09-10T08:38:41.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134807 s, 77.8 MB/s 2024-09-10T08:38:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135386 s, 77.5 MB/s 2024-09-10T08:38:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.677 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169209 s, 62.0 MB/s 2024-09-10T08:38:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168929 s, 62.1 MB/s 2024-09-10T08:38:41.713 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.713 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.713 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127912 s, 82.0 MB/s 2024-09-10T08:38:41.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.730 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137172 s, 76.4 MB/s 2024-09-10T08:38:41.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.747 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136689 s, 76.7 MB/s 2024-09-10T08:38:41.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.764 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132685 s, 79.0 MB/s 2024-09-10T08:38:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.780 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133304 s, 78.7 MB/s 2024-09-10T08:38:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138561 s, 75.7 MB/s 2024-09-10T08:38:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133429 s, 78.6 MB/s 2024-09-10T08:38:41.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.831 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.831 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133949 s, 78.3 MB/s 2024-09-10T08:38:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139458 s, 75.2 MB/s 2024-09-10T08:38:41.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133689 s, 78.4 MB/s 2024-09-10T08:38:41.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154086 s, 68.1 MB/s 2024-09-10T08:38:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128448 s, 81.6 MB/s 2024-09-10T08:38:41.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136687 s, 76.7 MB/s 2024-09-10T08:38:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165177 s, 63.5 MB/s 2024-09-10T08:38:41.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131522 s, 79.7 MB/s 2024-09-10T08:38:41.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013334 s, 78.6 MB/s 2024-09-10T08:38:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:41.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127487 s, 82.2 MB/s 2024-09-10T08:38:41.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:41.994 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:41.995 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:42.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.095 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143538 s, 73.1 MB/s 2024-09-10T08:38:42.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133877 s, 78.3 MB/s 2024-09-10T08:38:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148466 s, 70.6 MB/s 2024-09-10T08:38:42.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012919 s, 81.2 MB/s 2024-09-10T08:38:42.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161401 s, 65.0 MB/s 2024-09-10T08:38:42.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.183 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144473 s, 72.6 MB/s 2024-09-10T08:38:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.201 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141908 s, 73.9 MB/s 2024-09-10T08:38:42.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139878 s, 75.0 MB/s 2024-09-10T08:38:42.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153292 s, 68.4 MB/s 2024-09-10T08:38:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135181 s, 77.6 MB/s 2024-09-10T08:38:42.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124268 s, 84.4 MB/s 2024-09-10T08:38:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146669 s, 71.5 MB/s 2024-09-10T08:38:42.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.304 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013445 s, 78.0 MB/s 2024-09-10T08:38:42.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.324 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165793 s, 63.2 MB/s 2024-09-10T08:38:42.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.340 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013049 s, 80.4 MB/s 2024-09-10T08:38:42.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134739 s, 77.8 MB/s 2024-09-10T08:38:42.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.377 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164235 s, 63.8 MB/s 2024-09-10T08:38:42.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.393 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132082 s, 79.4 MB/s 2024-09-10T08:38:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129137 s, 81.2 MB/s 2024-09-10T08:38:42.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128159 s, 81.8 MB/s 2024-09-10T08:38:42.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129524 s, 81.0 MB/s 2024-09-10T08:38:42.458 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.458 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.458 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130474 s, 80.4 MB/s 2024-09-10T08:38:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.474 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013189 s, 79.5 MB/s 2024-09-10T08:38:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133101 s, 78.8 MB/s 2024-09-10T08:38:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126767 s, 82.7 MB/s 2024-09-10T08:38:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162648 s, 64.5 MB/s 2024-09-10T08:38:42.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131319 s, 79.8 MB/s 2024-09-10T08:38:42.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.559 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013122 s, 79.9 MB/s 2024-09-10T08:38:42.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.576 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134319 s, 78.1 MB/s 2024-09-10T08:38:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.592 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130156 s, 80.6 MB/s 2024-09-10T08:38:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124494 s, 84.2 MB/s 2024-09-10T08:38:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127413 s, 82.3 MB/s 2024-09-10T08:38:42.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:42.634 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:42.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:42.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013512 s, 77.6 MB/s 2024-09-10T08:38:42.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.750 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127176 s, 82.5 MB/s 2024-09-10T08:38:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125158 s, 83.8 MB/s 2024-09-10T08:38:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120011 s, 87.4 MB/s 2024-09-10T08:38:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129303 s, 81.1 MB/s 2024-09-10T08:38:42.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128162 s, 81.8 MB/s 2024-09-10T08:38:42.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.832 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146016 s, 71.8 MB/s 2024-09-10T08:38:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013115 s, 80.0 MB/s 2024-09-10T08:38:42.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.862 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106946 s, 98.0 MB/s 2024-09-10T08:38:42.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.878 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128265 s, 81.8 MB/s 2024-09-10T08:38:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.897 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015185 s, 69.1 MB/s 2024-09-10T08:38:42.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.912 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113714 s, 92.2 MB/s 2024-09-10T08:38:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151445 s, 69.2 MB/s 2024-09-10T08:38:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167097 s, 62.8 MB/s 2024-09-10T08:38:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.966 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131011 s, 80.0 MB/s 2024-09-10T08:38:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136532 s, 76.8 MB/s 2024-09-10T08:38:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012576 s, 83.4 MB/s 2024-09-10T08:38:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126822 s, 82.7 MB/s 2024-09-10T08:38:43.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.031 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131454 s, 79.8 MB/s 2024-09-10T08:38:43.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135024 s, 77.7 MB/s 2024-09-10T08:38:43.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126164 s, 83.1 MB/s 2024-09-10T08:38:43.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.081 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132628 s, 79.1 MB/s 2024-09-10T08:38:43.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.101 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172593 s, 60.8 MB/s 2024-09-10T08:38:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126851 s, 82.7 MB/s 2024-09-10T08:38:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129734 s, 80.8 MB/s 2024-09-10T08:38:43.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126853 s, 82.7 MB/s 2024-09-10T08:38:43.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.170 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171249 s, 61.2 MB/s 2024-09-10T08:38:43.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128775 s, 81.4 MB/s 2024-09-10T08:38:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131461 s, 79.8 MB/s 2024-09-10T08:38:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141542 s, 74.1 MB/s 2024-09-10T08:38:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143141 s, 73.3 MB/s 2024-09-10T08:38:43.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131127 s, 80.0 MB/s 2024-09-10T08:38:43.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:43.264 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:43.264 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:43.264 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T08:38:43.264 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:43.264 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:43.265 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:43.265 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166837 s, 62.9 MB/s 2024-09-10T08:38:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136902 s, 76.6 MB/s 2024-09-10T08:38:43.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.400 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126115 s, 83.1 MB/s 2024-09-10T08:38:43.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151287 s, 69.3 MB/s 2024-09-10T08:38:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160921 s, 65.2 MB/s 2024-09-10T08:38:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.457 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160886 s, 65.2 MB/s 2024-09-10T08:38:43.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.477 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161204 s, 65.0 MB/s 2024-09-10T08:38:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164828 s, 63.6 MB/s 2024-09-10T08:38:43.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.511 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115564 s, 90.7 MB/s 2024-09-10T08:38:43.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137921 s, 76.0 MB/s 2024-09-10T08:38:43.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144449 s, 72.6 MB/s 2024-09-10T08:38:43.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131726 s, 79.6 MB/s 2024-09-10T08:38:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160542 s, 65.3 MB/s 2024-09-10T08:38:43.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128896 s, 81.4 MB/s 2024-09-10T08:38:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130244 s, 80.5 MB/s 2024-09-10T08:38:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136786 s, 76.7 MB/s 2024-09-10T08:38:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.648 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013582 s, 77.2 MB/s 2024-09-10T08:38:43.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133873 s, 78.3 MB/s 2024-09-10T08:38:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.680 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123302 s, 85.0 MB/s 2024-09-10T08:38:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132789 s, 79.0 MB/s 2024-09-10T08:38:43.713 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.714 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.714 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137568 s, 76.2 MB/s 2024-09-10T08:38:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017506 s, 59.9 MB/s 2024-09-10T08:38:43.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132346 s, 79.2 MB/s 2024-09-10T08:38:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014875 s, 70.5 MB/s 2024-09-10T08:38:43.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157056 s, 66.8 MB/s 2024-09-10T08:38:43.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.804 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126084 s, 83.2 MB/s 2024-09-10T08:38:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169822 s, 61.7 MB/s 2024-09-10T08:38:43.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133555 s, 78.5 MB/s 2024-09-10T08:38:43.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.858 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134953 s, 77.7 MB/s 2024-09-10T08:38:43.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.879 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017352 s, 60.4 MB/s 2024-09-10T08:38:43.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017459 s, 60.1 MB/s 2024-09-10T08:38:43.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:43.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:43.916 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133729 s, 78.4 MB/s 2024-09-10T08:38:43.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:43.925 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:43.925 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:43.925 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T08:38:43.925 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:43.925 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:43.926 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:43.926 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:44.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137804 s, 76.1 MB/s 2024-09-10T08:38:44.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131047 s, 80.0 MB/s 2024-09-10T08:38:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136615 s, 76.8 MB/s 2024-09-10T08:38:44.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013018 s, 80.5 MB/s 2024-09-10T08:38:44.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.093 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145133 s, 72.2 MB/s 2024-09-10T08:38:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.110 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136731 s, 76.7 MB/s 2024-09-10T08:38:44.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.126 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130213 s, 80.5 MB/s 2024-09-10T08:38:44.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.146 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168974 s, 62.1 MB/s 2024-09-10T08:38:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134827 s, 77.8 MB/s 2024-09-10T08:38:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113472 s, 92.4 MB/s 2024-09-10T08:38:44.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.198 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166639 s, 62.9 MB/s 2024-09-10T08:38:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.215 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132409 s, 79.2 MB/s 2024-09-10T08:38:44.231 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.231 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.231 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132825 s, 78.9 MB/s 2024-09-10T08:38:44.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.247 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131707 s, 79.6 MB/s 2024-09-10T08:38:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126649 s, 82.8 MB/s 2024-09-10T08:38:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128123 s, 81.8 MB/s 2024-09-10T08:38:44.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.299 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159418 s, 65.8 MB/s 2024-09-10T08:38:44.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168164 s, 62.4 MB/s 2024-09-10T08:38:44.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141593 s, 74.1 MB/s 2024-09-10T08:38:44.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.352 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129172 s, 81.2 MB/s 2024-09-10T08:38:44.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.368 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125331 s, 83.7 MB/s 2024-09-10T08:38:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170968 s, 61.3 MB/s 2024-09-10T08:38:44.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164035 s, 63.9 MB/s 2024-09-10T08:38:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132684 s, 79.0 MB/s 2024-09-10T08:38:44.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164076 s, 63.9 MB/s 2024-09-10T08:38:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143716 s, 73.0 MB/s 2024-09-10T08:38:44.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130072 s, 80.6 MB/s 2024-09-10T08:38:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132868 s, 78.9 MB/s 2024-09-10T08:38:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.513 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014376 s, 72.9 MB/s 2024-09-10T08:38:44.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169592 s, 61.8 MB/s 2024-09-10T08:38:44.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173097 s, 60.6 MB/s 2024-09-10T08:38:44.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.571 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129815 s, 80.8 MB/s 2024-09-10T08:38:44.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:44.580 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131964 s, 79.5 MB/s 2024-09-10T08:38:44.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.696 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137472 s, 76.3 MB/s 2024-09-10T08:38:44.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128512 s, 81.6 MB/s 2024-09-10T08:38:44.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.730 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01458 s, 71.9 MB/s 2024-09-10T08:38:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170055 s, 61.7 MB/s 2024-09-10T08:38:44.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.767 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137437 s, 76.3 MB/s 2024-09-10T08:38:44.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.784 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135215 s, 77.5 MB/s 2024-09-10T08:38:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.806 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171093 s, 61.3 MB/s 2024-09-10T08:38:44.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131994 s, 79.4 MB/s 2024-09-10T08:38:44.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136386 s, 76.9 MB/s 2024-09-10T08:38:44.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130179 s, 80.5 MB/s 2024-09-10T08:38:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160942 s, 65.2 MB/s 2024-09-10T08:38:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116559 s, 90.0 MB/s 2024-09-10T08:38:44.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129403 s, 81.0 MB/s 2024-09-10T08:38:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136745 s, 76.7 MB/s 2024-09-10T08:38:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013324 s, 78.7 MB/s 2024-09-10T08:38:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139458 s, 75.2 MB/s 2024-09-10T08:38:44.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168342 s, 62.3 MB/s 2024-09-10T08:38:44.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:44.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:44.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141191 s, 74.3 MB/s 2024-09-10T08:38:45.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116784 s, 89.8 MB/s 2024-09-10T08:38:45.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.025 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127662 s, 82.1 MB/s 2024-09-10T08:38:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165784 s, 63.2 MB/s 2024-09-10T08:38:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151094 s, 69.4 MB/s 2024-09-10T08:38:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171764 s, 61.0 MB/s 2024-09-10T08:38:45.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.102 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.102 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144732 s, 72.4 MB/s 2024-09-10T08:38:45.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.119 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136201 s, 77.0 MB/s 2024-09-10T08:38:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137419 s, 76.3 MB/s 2024-09-10T08:38:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160867 s, 65.2 MB/s 2024-09-10T08:38:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135833 s, 77.2 MB/s 2024-09-10T08:38:45.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133336 s, 78.6 MB/s 2024-09-10T08:38:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138997 s, 75.4 MB/s 2024-09-10T08:38:45.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134721 s, 77.8 MB/s 2024-09-10T08:38:45.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:45.232 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:45.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.331 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.331 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126928 s, 82.6 MB/s 2024-09-10T08:38:45.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.347 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127294 s, 82.4 MB/s 2024-09-10T08:38:45.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135918 s, 77.1 MB/s 2024-09-10T08:38:45.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.381 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.381 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134217 s, 78.1 MB/s 2024-09-10T08:38:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172125 s, 60.9 MB/s 2024-09-10T08:38:45.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127609 s, 82.2 MB/s 2024-09-10T08:38:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.435 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131958 s, 79.5 MB/s 2024-09-10T08:38:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128035 s, 81.9 MB/s 2024-09-10T08:38:45.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.469 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161121 s, 65.1 MB/s 2024-09-10T08:38:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150189 s, 69.8 MB/s 2024-09-10T08:38:45.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.506 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.507 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160442 s, 65.4 MB/s 2024-09-10T08:38:45.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.523 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127806 s, 82.0 MB/s 2024-09-10T08:38:45.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128738 s, 81.5 MB/s 2024-09-10T08:38:45.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111868 s, 93.7 MB/s 2024-09-10T08:38:45.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125292 s, 83.7 MB/s 2024-09-10T08:38:45.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133049 s, 78.8 MB/s 2024-09-10T08:38:45.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166827 s, 62.9 MB/s 2024-09-10T08:38:45.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133336 s, 78.6 MB/s 2024-09-10T08:38:45.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153619 s, 68.3 MB/s 2024-09-10T08:38:45.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.658 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130632 s, 80.3 MB/s 2024-09-10T08:38:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.676 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149152 s, 70.3 MB/s 2024-09-10T08:38:45.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138573 s, 75.7 MB/s 2024-09-10T08:38:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128176 s, 81.8 MB/s 2024-09-10T08:38:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.726 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013458 s, 77.9 MB/s 2024-09-10T08:38:45.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013378 s, 78.4 MB/s 2024-09-10T08:38:45.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.759 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.759 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133756 s, 78.4 MB/s 2024-09-10T08:38:45.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.776 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128182 s, 81.8 MB/s 2024-09-10T08:38:45.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.792 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130783 s, 80.2 MB/s 2024-09-10T08:38:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.812 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165337 s, 63.4 MB/s 2024-09-10T08:38:45.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132287 s, 79.3 MB/s 2024-09-10T08:38:45.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.846 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142481 s, 73.6 MB/s 2024-09-10T08:38:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.863 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138203 s, 75.9 MB/s 2024-09-10T08:38:45.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:45.872 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:45.872 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:45.872 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T08:38:45.873 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:45.873 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:45.873 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:45.873 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:45.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.976 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165985 s, 63.2 MB/s 2024-09-10T08:38:45.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:45.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:45.993 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141909 s, 73.9 MB/s 2024-09-10T08:38:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.009 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126025 s, 83.2 MB/s 2024-09-10T08:38:46.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170008 s, 61.7 MB/s 2024-09-10T08:38:46.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.047 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.047 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139014 s, 75.4 MB/s 2024-09-10T08:38:46.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129382 s, 81.0 MB/s 2024-09-10T08:38:46.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.078 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121192 s, 86.5 MB/s 2024-09-10T08:38:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148781 s, 70.5 MB/s 2024-09-10T08:38:46.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.116 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166697 s, 62.9 MB/s 2024-09-10T08:38:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014507 s, 72.3 MB/s 2024-09-10T08:38:46.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.151 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129317 s, 81.1 MB/s 2024-09-10T08:38:46.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.167 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137754 s, 76.1 MB/s 2024-09-10T08:38:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141987 s, 73.9 MB/s 2024-09-10T08:38:46.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142527 s, 73.6 MB/s 2024-09-10T08:38:46.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012933 s, 81.1 MB/s 2024-09-10T08:38:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012804 s, 81.9 MB/s 2024-09-10T08:38:46.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167076 s, 62.8 MB/s 2024-09-10T08:38:46.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118107 s, 88.8 MB/s 2024-09-10T08:38:46.289 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.290 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164776 s, 63.6 MB/s 2024-09-10T08:38:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162347 s, 64.6 MB/s 2024-09-10T08:38:46.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.327 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140285 s, 74.7 MB/s 2024-09-10T08:38:46.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159243 s, 65.8 MB/s 2024-09-10T08:38:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130229 s, 80.5 MB/s 2024-09-10T08:38:46.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163597 s, 64.1 MB/s 2024-09-10T08:38:46.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.398 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133013 s, 78.8 MB/s 2024-09-10T08:38:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157248 s, 66.7 MB/s 2024-09-10T08:38:46.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.435 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135906 s, 77.2 MB/s 2024-09-10T08:38:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.454 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159991 s, 65.5 MB/s 2024-09-10T08:38:46.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.470 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131982 s, 79.4 MB/s 2024-09-10T08:38:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127756 s, 82.1 MB/s 2024-09-10T08:38:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.503 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133475 s, 78.6 MB/s 2024-09-10T08:38:46.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.519 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126049 s, 83.2 MB/s 2024-09-10T08:38:46.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:46.528 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:46.528 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:46.528 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T08:38:46.528 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:46.528 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:46.529 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:46.529 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:46.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:46.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133479 s, 78.6 MB/s 2024-09-10T08:38:46.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.644 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.644 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127801 s, 82.0 MB/s 2024-09-10T08:38:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.660 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126382 s, 83.0 MB/s 2024-09-10T08:38:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153548 s, 68.3 MB/s 2024-09-10T08:38:46.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.696 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.696 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139031 s, 75.4 MB/s 2024-09-10T08:38:46.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125254 s, 83.7 MB/s 2024-09-10T08:38:46.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128659 s, 81.5 MB/s 2024-09-10T08:38:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131105 s, 80.0 MB/s 2024-09-10T08:38:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121415 s, 86.4 MB/s 2024-09-10T08:38:46.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.781 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176676 s, 59.4 MB/s 2024-09-10T08:38:46.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.798 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138011 s, 76.0 MB/s 2024-09-10T08:38:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151651 s, 69.1 MB/s 2024-09-10T08:38:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.834 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139156 s, 75.4 MB/s 2024-09-10T08:38:46.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.850 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131098 s, 80.0 MB/s 2024-09-10T08:38:46.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123124 s, 85.2 MB/s 2024-09-10T08:38:46.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.885 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.885 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164483 s, 63.7 MB/s 2024-09-10T08:38:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.904 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154218 s, 68.0 MB/s 2024-09-10T08:38:46.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128794 s, 81.4 MB/s 2024-09-10T08:38:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132678 s, 79.0 MB/s 2024-09-10T08:38:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151277 s, 69.3 MB/s 2024-09-10T08:38:46.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.972 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129817 s, 80.8 MB/s 2024-09-10T08:38:46.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:46.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:46.993 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017561 s, 59.7 MB/s 2024-09-10T08:38:47.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.009 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128825 s, 81.4 MB/s 2024-09-10T08:38:47.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131255 s, 79.9 MB/s 2024-09-10T08:38:47.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127092 s, 82.5 MB/s 2024-09-10T08:38:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016912 s, 62.0 MB/s 2024-09-10T08:38:47.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134544 s, 77.9 MB/s 2024-09-10T08:38:47.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135731 s, 77.3 MB/s 2024-09-10T08:38:47.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129052 s, 81.3 MB/s 2024-09-10T08:38:47.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131737 s, 79.6 MB/s 2024-09-10T08:38:47.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.147 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152042 s, 69.0 MB/s 2024-09-10T08:38:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179378 s, 58.5 MB/s 2024-09-10T08:38:47.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:47.177 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:47.177 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:47.178 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T08:38:47.178 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:47.178 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:47.178 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:47.178 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123766 s, 84.7 MB/s 2024-09-10T08:38:47.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136899 s, 76.6 MB/s 2024-09-10T08:38:47.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171196 s, 61.3 MB/s 2024-09-10T08:38:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.333 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013439 s, 78.0 MB/s 2024-09-10T08:38:47.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163657 s, 64.1 MB/s 2024-09-10T08:38:47.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.406 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135994 s, 77.1 MB/s 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137621 s, 76.2 MB/s 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166376 s, 63.0 MB/s 2024-09-10T08:38:47.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134102 s, 78.2 MB/s 2024-09-10T08:38:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131324 s, 79.8 MB/s 2024-09-10T08:38:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131158 s, 79.9 MB/s 2024-09-10T08:38:47.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158142 s, 66.3 MB/s 2024-09-10T08:38:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144031 s, 72.8 MB/s 2024-09-10T08:38:47.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137694 s, 76.2 MB/s 2024-09-10T08:38:47.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.526 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.526 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129525 s, 81.0 MB/s 2024-09-10T08:38:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124767 s, 84.0 MB/s 2024-09-10T08:38:47.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.558 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.558 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133891 s, 78.3 MB/s 2024-09-10T08:38:47.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.575 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137673 s, 76.2 MB/s 2024-09-10T08:38:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.591 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130559 s, 80.3 MB/s 2024-09-10T08:38:47.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.609 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139593 s, 75.1 MB/s 2024-09-10T08:38:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137656 s, 76.2 MB/s 2024-09-10T08:38:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128564 s, 81.6 MB/s 2024-09-10T08:38:47.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.658 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012805 s, 81.9 MB/s 2024-09-10T08:38:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.675 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137459 s, 76.3 MB/s 2024-09-10T08:38:47.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.690 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011992 s, 87.4 MB/s 2024-09-10T08:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165505 s, 63.4 MB/s 2024-09-10T08:38:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.727 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012941 s, 81.0 MB/s 2024-09-10T08:38:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144235 s, 72.7 MB/s 2024-09-10T08:38:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134208 s, 78.1 MB/s 2024-09-10T08:38:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129917 s, 80.7 MB/s 2024-09-10T08:38:47.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.793 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129348 s, 81.1 MB/s 2024-09-10T08:38:47.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173117 s, 60.6 MB/s 2024-09-10T08:38:47.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:47.823 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:47.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:47.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126353 s, 83.0 MB/s 2024-09-10T08:38:47.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.942 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.942 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165699 s, 63.3 MB/s 2024-09-10T08:38:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135045 s, 77.6 MB/s 2024-09-10T08:38:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132552 s, 79.1 MB/s 2024-09-10T08:38:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125838 s, 83.3 MB/s 2024-09-10T08:38:48.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141823 s, 73.9 MB/s 2024-09-10T08:38:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173503 s, 60.4 MB/s 2024-09-10T08:38:48.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129545 s, 80.9 MB/s 2024-09-10T08:38:48.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.061 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130003 s, 80.7 MB/s 2024-09-10T08:38:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015521 s, 67.6 MB/s 2024-09-10T08:38:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142643 s, 73.5 MB/s 2024-09-10T08:38:48.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171774 s, 61.0 MB/s 2024-09-10T08:38:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134935 s, 77.7 MB/s 2024-09-10T08:38:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128984 s, 81.3 MB/s 2024-09-10T08:38:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132534 s, 79.1 MB/s 2024-09-10T08:38:48.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169909 s, 61.7 MB/s 2024-09-10T08:38:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.204 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129714 s, 80.8 MB/s 2024-09-10T08:38:48.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161071 s, 65.1 MB/s 2024-09-10T08:38:48.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170207 s, 61.6 MB/s 2024-09-10T08:38:48.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.260 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134571 s, 77.9 MB/s 2024-09-10T08:38:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159727 s, 65.6 MB/s 2024-09-10T08:38:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135228 s, 77.5 MB/s 2024-09-10T08:38:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168116 s, 62.4 MB/s 2024-09-10T08:38:48.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.335 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159859 s, 65.6 MB/s 2024-09-10T08:38:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168404 s, 62.3 MB/s 2024-09-10T08:38:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134294 s, 78.1 MB/s 2024-09-10T08:38:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.390 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151203 s, 69.3 MB/s 2024-09-10T08:38:48.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.406 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.406 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127717 s, 82.1 MB/s 2024-09-10T08:38:48.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157877 s, 66.4 MB/s 2024-09-10T08:38:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157589 s, 66.5 MB/s 2024-09-10T08:38:48.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141343 s, 74.2 MB/s 2024-09-10T08:38:48.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126705 s, 82.8 MB/s 2024-09-10T08:38:48.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:48.487 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:48.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:48.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.587 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.587 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127784 s, 82.1 MB/s 2024-09-10T08:38:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.604 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133882 s, 78.3 MB/s 2024-09-10T08:38:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.621 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143762 s, 72.9 MB/s 2024-09-10T08:38:48.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.637 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116232 s, 90.2 MB/s 2024-09-10T08:38:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131609 s, 79.7 MB/s 2024-09-10T08:38:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.669 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012985 s, 80.8 MB/s 2024-09-10T08:38:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109411 s, 95.8 MB/s 2024-09-10T08:38:48.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.703 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156713 s, 66.9 MB/s 2024-09-10T08:38:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125491 s, 83.6 MB/s 2024-09-10T08:38:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131472 s, 79.8 MB/s 2024-09-10T08:38:48.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.753 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148162 s, 70.8 MB/s 2024-09-10T08:38:48.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.770 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133626 s, 78.5 MB/s 2024-09-10T08:38:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126567 s, 82.8 MB/s 2024-09-10T08:38:48.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.803 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135391 s, 77.4 MB/s 2024-09-10T08:38:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157697 s, 66.5 MB/s 2024-09-10T08:38:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139955 s, 74.9 MB/s 2024-09-10T08:38:48.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133169 s, 78.7 MB/s 2024-09-10T08:38:48.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.872 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133363 s, 78.6 MB/s 2024-09-10T08:38:48.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.888 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132102 s, 79.4 MB/s 2024-09-10T08:38:48.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135176 s, 77.6 MB/s 2024-09-10T08:38:48.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013169 s, 79.6 MB/s 2024-09-10T08:38:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114033 s, 92.0 MB/s 2024-09-10T08:38:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127966 s, 81.9 MB/s 2024-09-10T08:38:48.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.969 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013261 s, 79.1 MB/s 2024-09-10T08:38:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126215 s, 83.1 MB/s 2024-09-10T08:38:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129809 s, 80.8 MB/s 2024-09-10T08:38:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176066 s, 59.6 MB/s 2024-09-10T08:38:49.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132434 s, 79.2 MB/s 2024-09-10T08:38:49.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.054 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126725 s, 82.7 MB/s 2024-09-10T08:38:49.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.070 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127548 s, 82.2 MB/s 2024-09-10T08:38:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138685 s, 75.6 MB/s 2024-09-10T08:38:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126548 s, 82.9 MB/s 2024-09-10T08:38:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:49.113 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:49.114 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:49.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.217 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171572 s, 61.1 MB/s 2024-09-10T08:38:49.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.233 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.233 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130095 s, 80.6 MB/s 2024-09-10T08:38:49.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.248 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012203 s, 85.9 MB/s 2024-09-10T08:38:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114163 s, 91.8 MB/s 2024-09-10T08:38:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012706 s, 82.5 MB/s 2024-09-10T08:38:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141946 s, 73.9 MB/s 2024-09-10T08:38:49.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.313 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130324 s, 80.5 MB/s 2024-09-10T08:38:49.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132201 s, 79.3 MB/s 2024-09-10T08:38:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126623 s, 82.8 MB/s 2024-09-10T08:38:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169131 s, 62.0 MB/s 2024-09-10T08:38:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129881 s, 80.7 MB/s 2024-09-10T08:38:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135136 s, 77.6 MB/s 2024-09-10T08:38:49.415 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135428 s, 77.4 MB/s 2024-09-10T08:38:49.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.432 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126852 s, 82.7 MB/s 2024-09-10T08:38:49.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126445 s, 82.9 MB/s 2024-09-10T08:38:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134043 s, 78.2 MB/s 2024-09-10T08:38:49.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127206 s, 82.4 MB/s 2024-09-10T08:38:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126338 s, 83.0 MB/s 2024-09-10T08:38:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163056 s, 64.3 MB/s 2024-09-10T08:38:49.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128563 s, 81.6 MB/s 2024-09-10T08:38:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142292 s, 73.7 MB/s 2024-09-10T08:38:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162088 s, 64.7 MB/s 2024-09-10T08:38:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124888 s, 84.0 MB/s 2024-09-10T08:38:49.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152474 s, 68.8 MB/s 2024-09-10T08:38:49.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132776 s, 79.0 MB/s 2024-09-10T08:38:49.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.636 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.636 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138414 s, 75.8 MB/s 2024-09-10T08:38:49.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166343 s, 63.0 MB/s 2024-09-10T08:38:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129556 s, 80.9 MB/s 2024-09-10T08:38:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160299 s, 65.4 MB/s 2024-09-10T08:38:49.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137181 s, 76.4 MB/s 2024-09-10T08:38:49.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.727 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132262 s, 79.3 MB/s 2024-09-10T08:38:49.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.744 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132433 s, 79.2 MB/s 2024-09-10T08:38:49.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:49.753 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:49.753 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:49.753 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T08:38:49.753 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:49.754 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:49.754 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:49.754 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:49.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162049 s, 64.7 MB/s 2024-09-10T08:38:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131816 s, 79.5 MB/s 2024-09-10T08:38:49.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.894 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166388 s, 63.0 MB/s 2024-09-10T08:38:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137846 s, 76.1 MB/s 2024-09-10T08:38:49.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131153 s, 80.0 MB/s 2024-09-10T08:38:49.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128874 s, 81.4 MB/s 2024-09-10T08:38:49.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134699 s, 77.8 MB/s 2024-09-10T08:38:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128956 s, 81.3 MB/s 2024-09-10T08:38:49.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:49.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:49.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127669 s, 82.1 MB/s 2024-09-10T08:38:50.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139432 s, 75.2 MB/s 2024-09-10T08:38:50.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134064 s, 78.2 MB/s 2024-09-10T08:38:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131826 s, 79.5 MB/s 2024-09-10T08:38:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129898 s, 80.7 MB/s 2024-09-10T08:38:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127953 s, 81.9 MB/s 2024-09-10T08:38:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.097 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132036 s, 79.4 MB/s 2024-09-10T08:38:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.113 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011607 s, 90.3 MB/s 2024-09-10T08:38:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.128 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126749 s, 82.7 MB/s 2024-09-10T08:38:50.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.145 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132641 s, 79.1 MB/s 2024-09-10T08:38:50.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.162 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127274 s, 82.4 MB/s 2024-09-10T08:38:50.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133854 s, 78.3 MB/s 2024-09-10T08:38:50.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.199 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167272 s, 62.7 MB/s 2024-09-10T08:38:50.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.216 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134954 s, 77.7 MB/s 2024-09-10T08:38:50.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125944 s, 83.3 MB/s 2024-09-10T08:38:50.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130727 s, 80.2 MB/s 2024-09-10T08:38:50.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.266 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132021 s, 79.4 MB/s 2024-09-10T08:38:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.283 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132124 s, 79.4 MB/s 2024-09-10T08:38:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147435 s, 71.1 MB/s 2024-09-10T08:38:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.317 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129188 s, 81.2 MB/s 2024-09-10T08:38:50.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.334 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129532 s, 81.0 MB/s 2024-09-10T08:38:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135368 s, 77.5 MB/s 2024-09-10T08:38:50.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.366 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128581 s, 81.6 MB/s 2024-09-10T08:38:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136178 s, 77.0 MB/s 2024-09-10T08:38:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:50.392 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:50.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:50.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.494 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158453 s, 66.2 MB/s 2024-09-10T08:38:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128082 s, 81.9 MB/s 2024-09-10T08:38:50.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013752 s, 76.2 MB/s 2024-09-10T08:38:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156187 s, 67.1 MB/s 2024-09-10T08:38:50.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128495 s, 81.6 MB/s 2024-09-10T08:38:50.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.580 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133167 s, 78.7 MB/s 2024-09-10T08:38:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154661 s, 67.8 MB/s 2024-09-10T08:38:50.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126093 s, 83.2 MB/s 2024-09-10T08:38:50.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.634 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165904 s, 63.2 MB/s 2024-09-10T08:38:50.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156873 s, 66.8 MB/s 2024-09-10T08:38:50.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170069 s, 61.7 MB/s 2024-09-10T08:38:50.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.694 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.694 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167158 s, 62.7 MB/s 2024-09-10T08:38:50.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126032 s, 83.2 MB/s 2024-09-10T08:38:50.729 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.729 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.729 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160734 s, 65.2 MB/s 2024-09-10T08:38:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130706 s, 80.2 MB/s 2024-09-10T08:38:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.762 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135024 s, 77.7 MB/s 2024-09-10T08:38:50.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.778 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127921 s, 82.0 MB/s 2024-09-10T08:38:50.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131101 s, 80.0 MB/s 2024-09-10T08:38:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.813 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015236 s, 68.8 MB/s 2024-09-10T08:38:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.829 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129165 s, 81.2 MB/s 2024-09-10T08:38:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137616 s, 76.2 MB/s 2024-09-10T08:38:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130221 s, 80.5 MB/s 2024-09-10T08:38:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.879 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126022 s, 83.2 MB/s 2024-09-10T08:38:50.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017331 s, 60.5 MB/s 2024-09-10T08:38:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122678 s, 85.5 MB/s 2024-09-10T08:38:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167598 s, 62.6 MB/s 2024-09-10T08:38:50.951 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.952 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135987 s, 77.1 MB/s 2024-09-10T08:38:50.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122789 s, 85.4 MB/s 2024-09-10T08:38:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:50.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153254 s, 68.4 MB/s 2024-09-10T08:38:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161763 s, 64.8 MB/s 2024-09-10T08:38:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127628 s, 82.2 MB/s 2024-09-10T08:38:51.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139397 s, 75.2 MB/s 2024-09-10T08:38:51.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:51.047 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:51.048 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:51.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:51.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150583 s, 69.6 MB/s 2024-09-10T08:38:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167921 s, 62.4 MB/s 2024-09-10T08:38:51.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.186 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.187 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131664 s, 79.6 MB/s 2024-09-10T08:38:51.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130738 s, 80.2 MB/s 2024-09-10T08:38:51.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143369 s, 73.1 MB/s 2024-09-10T08:38:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.239 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150858 s, 69.5 MB/s 2024-09-10T08:38:51.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.255 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126914 s, 82.6 MB/s 2024-09-10T08:38:51.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.271 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130371 s, 80.4 MB/s 2024-09-10T08:38:51.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.288 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134336 s, 78.1 MB/s 2024-09-10T08:38:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.304 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127474 s, 82.3 MB/s 2024-09-10T08:38:51.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.320 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128857 s, 81.4 MB/s 2024-09-10T08:38:51.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123843 s, 84.7 MB/s 2024-09-10T08:38:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.352 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126319 s, 83.0 MB/s 2024-09-10T08:38:51.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.368 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133256 s, 78.7 MB/s 2024-09-10T08:38:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016783 s, 62.5 MB/s 2024-09-10T08:38:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134773 s, 77.8 MB/s 2024-09-10T08:38:51.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126871 s, 82.6 MB/s 2024-09-10T08:38:51.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135823 s, 77.2 MB/s 2024-09-10T08:38:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130293 s, 80.5 MB/s 2024-09-10T08:38:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162044 s, 64.7 MB/s 2024-09-10T08:38:51.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.490 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130246 s, 80.5 MB/s 2024-09-10T08:38:51.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.510 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168148 s, 62.4 MB/s 2024-09-10T08:38:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162692 s, 64.5 MB/s 2024-09-10T08:38:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.547 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140632 s, 74.6 MB/s 2024-09-10T08:38:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145314 s, 72.2 MB/s 2024-09-10T08:38:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.585 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160065 s, 65.5 MB/s 2024-09-10T08:38:51.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138878 s, 75.5 MB/s 2024-09-10T08:38:51.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134674 s, 77.9 MB/s 2024-09-10T08:38:51.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.634 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130899 s, 80.1 MB/s 2024-09-10T08:38:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163029 s, 64.3 MB/s 2024-09-10T08:38:51.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.671 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139245 s, 75.3 MB/s 2024-09-10T08:38:51.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.688 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132618 s, 79.1 MB/s 2024-09-10T08:38:51.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:51.697 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:51.697 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:51.697 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T08:38:51.698 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:51.698 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:51.698 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:51.698 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:51.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:51.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.801 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174365 s, 60.1 MB/s 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.819 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132841 s, 78.9 MB/s 2024-09-10T08:38:51.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172231 s, 60.9 MB/s 2024-09-10T08:38:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133435 s, 78.6 MB/s 2024-09-10T08:38:51.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153288 s, 68.4 MB/s 2024-09-10T08:38:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137895 s, 76.0 MB/s 2024-09-10T08:38:51.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179802 s, 58.3 MB/s 2024-09-10T08:38:51.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127519 s, 82.2 MB/s 2024-09-10T08:38:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138785 s, 75.6 MB/s 2024-09-10T08:38:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.962 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.962 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126953 s, 82.6 MB/s 2024-09-10T08:38:51.982 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:51.982 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:51.982 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170483 s, 61.5 MB/s 2024-09-10T08:38:52.001 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162452 s, 64.5 MB/s 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.018 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132712 s, 79.0 MB/s 2024-09-10T08:38:52.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.034 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127197 s, 82.4 MB/s 2024-09-10T08:38:52.050 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.051 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132714 s, 79.0 MB/s 2024-09-10T08:38:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.072 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184075 s, 57.0 MB/s 2024-09-10T08:38:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167031 s, 62.8 MB/s 2024-09-10T08:38:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168939 s, 62.1 MB/s 2024-09-10T08:38:52.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.132 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016553 s, 63.3 MB/s 2024-09-10T08:38:52.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.151 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151009 s, 69.4 MB/s 2024-09-10T08:38:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145232 s, 72.2 MB/s 2024-09-10T08:38:52.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128782 s, 81.4 MB/s 2024-09-10T08:38:52.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01674 s, 62.6 MB/s 2024-09-10T08:38:52.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.222 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.222 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129337 s, 81.1 MB/s 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134274 s, 78.1 MB/s 2024-09-10T08:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136839 s, 76.6 MB/s 2024-09-10T08:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.272 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128915 s, 81.3 MB/s 2024-09-10T08:38:52.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.292 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162623 s, 64.5 MB/s 2024-09-10T08:38:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132908 s, 78.9 MB/s 2024-09-10T08:38:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173816 s, 60.3 MB/s 2024-09-10T08:38:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128233 s, 81.8 MB/s 2024-09-10T08:38:52.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.363 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129842 s, 80.8 MB/s 2024-09-10T08:38:52.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:52.372 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:52.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129875 s, 80.7 MB/s 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132216 s, 79.3 MB/s 2024-09-10T08:38:52.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129747 s, 80.8 MB/s 2024-09-10T08:38:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137523 s, 76.2 MB/s 2024-09-10T08:38:52.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129135 s, 81.2 MB/s 2024-09-10T08:38:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123935 s, 84.6 MB/s 2024-09-10T08:38:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133657 s, 78.5 MB/s 2024-09-10T08:38:52.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.591 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.592 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159963 s, 65.6 MB/s 2024-09-10T08:38:52.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170281 s, 61.6 MB/s 2024-09-10T08:38:52.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.632 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016817 s, 62.4 MB/s 2024-09-10T08:38:52.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.649 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132923 s, 78.9 MB/s 2024-09-10T08:38:52.668 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.668 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.669 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015632 s, 67.1 MB/s 2024-09-10T08:38:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012828 s, 81.7 MB/s 2024-09-10T08:38:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164767 s, 63.6 MB/s 2024-09-10T08:38:52.722 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013881 s, 75.5 MB/s 2024-09-10T08:38:52.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012518 s, 83.8 MB/s 2024-09-10T08:38:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130441 s, 80.4 MB/s 2024-09-10T08:38:52.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01273 s, 82.4 MB/s 2024-09-10T08:38:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169156 s, 62.0 MB/s 2024-09-10T08:38:52.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.807 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124861 s, 84.0 MB/s 2024-09-10T08:38:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017447 s, 60.1 MB/s 2024-09-10T08:38:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123594 s, 84.8 MB/s 2024-09-10T08:38:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131406 s, 79.8 MB/s 2024-09-10T08:38:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143882 s, 72.9 MB/s 2024-09-10T08:38:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122225 s, 85.8 MB/s 2024-09-10T08:38:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131882 s, 79.5 MB/s 2024-09-10T08:38:52.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173272 s, 60.5 MB/s 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131875 s, 79.5 MB/s 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129361 s, 81.1 MB/s 2024-09-10T08:38:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124148 s, 84.5 MB/s 2024-09-10T08:38:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131989 s, 79.4 MB/s 2024-09-10T08:38:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135688 s, 77.3 MB/s 2024-09-10T08:38:53.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:53.021 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:53.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.122 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143829 s, 72.9 MB/s 2024-09-10T08:38:53.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126996 s, 82.6 MB/s 2024-09-10T08:38:53.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164295 s, 63.8 MB/s 2024-09-10T08:38:53.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.174 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131441 s, 79.8 MB/s 2024-09-10T08:38:53.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.190 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125601 s, 83.5 MB/s 2024-09-10T08:38:53.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014191 s, 73.9 MB/s 2024-09-10T08:38:53.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138409 s, 75.8 MB/s 2024-09-10T08:38:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131437 s, 79.8 MB/s 2024-09-10T08:38:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132191 s, 79.3 MB/s 2024-09-10T08:38:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133139 s, 78.8 MB/s 2024-09-10T08:38:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130285 s, 80.5 MB/s 2024-09-10T08:38:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.307 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130418 s, 80.4 MB/s 2024-09-10T08:38:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161445 s, 64.9 MB/s 2024-09-10T08:38:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157238 s, 66.7 MB/s 2024-09-10T08:38:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127983 s, 81.9 MB/s 2024-09-10T08:38:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.377 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122699 s, 85.5 MB/s 2024-09-10T08:38:53.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.393 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.393 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131941 s, 79.5 MB/s 2024-09-10T08:38:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128556 s, 81.6 MB/s 2024-09-10T08:38:53.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.429 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158515 s, 66.2 MB/s 2024-09-10T08:38:53.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135473 s, 77.4 MB/s 2024-09-10T08:38:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013519 s, 77.6 MB/s 2024-09-10T08:38:53.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132884 s, 78.9 MB/s 2024-09-10T08:38:53.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130401 s, 80.4 MB/s 2024-09-10T08:38:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126825 s, 82.7 MB/s 2024-09-10T08:38:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161901 s, 64.8 MB/s 2024-09-10T08:38:53.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.548 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158416 s, 66.2 MB/s 2024-09-10T08:38:53.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135347 s, 77.5 MB/s 2024-09-10T08:38:53.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137199 s, 76.4 MB/s 2024-09-10T08:38:53.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129274 s, 81.1 MB/s 2024-09-10T08:38:53.617 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.617 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.617 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160367 s, 65.4 MB/s 2024-09-10T08:38:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.637 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163684 s, 64.1 MB/s 2024-09-10T08:38:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136611 s, 76.8 MB/s 2024-09-10T08:38:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:53.663 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:53.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.766 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150439 s, 69.7 MB/s 2024-09-10T08:38:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.782 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134842 s, 77.8 MB/s 2024-09-10T08:38:53.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.801 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159522 s, 65.7 MB/s 2024-09-10T08:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135081 s, 77.6 MB/s 2024-09-10T08:38:53.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135627 s, 77.3 MB/s 2024-09-10T08:38:53.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.851 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.851 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131804 s, 79.6 MB/s 2024-09-10T08:38:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159423 s, 65.8 MB/s 2024-09-10T08:38:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130919 s, 80.1 MB/s 2024-09-10T08:38:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126121 s, 83.1 MB/s 2024-09-10T08:38:53.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127646 s, 82.1 MB/s 2024-09-10T08:38:53.934 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.935 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124831 s, 84.0 MB/s 2024-09-10T08:38:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144189 s, 72.7 MB/s 2024-09-10T08:38:53.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138628 s, 75.6 MB/s 2024-09-10T08:38:53.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:53.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:53.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162727 s, 64.4 MB/s 2024-09-10T08:38:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132645 s, 79.1 MB/s 2024-09-10T08:38:54.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136882 s, 76.6 MB/s 2024-09-10T08:38:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138051 s, 76.0 MB/s 2024-09-10T08:38:54.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137777 s, 76.1 MB/s 2024-09-10T08:38:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012862 s, 81.5 MB/s 2024-09-10T08:38:54.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013232 s, 79.2 MB/s 2024-09-10T08:38:54.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.105 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125205 s, 83.7 MB/s 2024-09-10T08:38:54.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.123 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141734 s, 74.0 MB/s 2024-09-10T08:38:54.139 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.139 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.139 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126846 s, 82.7 MB/s 2024-09-10T08:38:54.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137857 s, 76.1 MB/s 2024-09-10T08:38:54.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130543 s, 80.3 MB/s 2024-09-10T08:38:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.188 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126943 s, 82.6 MB/s 2024-09-10T08:38:54.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.205 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135947 s, 77.1 MB/s 2024-09-10T08:38:54.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129492 s, 81.0 MB/s 2024-09-10T08:38:54.236 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012158 s, 86.2 MB/s 2024-09-10T08:38:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124961 s, 83.9 MB/s 2024-09-10T08:38:54.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013304 s, 78.8 MB/s 2024-09-10T08:38:54.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137298 s, 76.4 MB/s 2024-09-10T08:38:54.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:54.295 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:54.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:54.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.394 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132674 s, 79.0 MB/s 2024-09-10T08:38:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121419 s, 86.4 MB/s 2024-09-10T08:38:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151695 s, 69.1 MB/s 2024-09-10T08:38:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133359 s, 78.6 MB/s 2024-09-10T08:38:54.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141595 s, 74.1 MB/s 2024-09-10T08:38:54.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142074 s, 73.8 MB/s 2024-09-10T08:38:54.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136513 s, 76.8 MB/s 2024-09-10T08:38:54.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.513 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131276 s, 79.9 MB/s 2024-09-10T08:38:54.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129618 s, 80.9 MB/s 2024-09-10T08:38:54.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012832 s, 81.7 MB/s 2024-09-10T08:38:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132649 s, 79.0 MB/s 2024-09-10T08:38:54.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168045 s, 62.4 MB/s 2024-09-10T08:38:54.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162922 s, 64.4 MB/s 2024-09-10T08:38:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132673 s, 79.0 MB/s 2024-09-10T08:38:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137059 s, 76.5 MB/s 2024-09-10T08:38:54.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.649 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108813 s, 96.4 MB/s 2024-09-10T08:38:54.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132996 s, 78.8 MB/s 2024-09-10T08:38:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016961 s, 61.8 MB/s 2024-09-10T08:38:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.704 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159572 s, 65.7 MB/s 2024-09-10T08:38:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172944 s, 60.6 MB/s 2024-09-10T08:38:54.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.740 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127905 s, 82.0 MB/s 2024-09-10T08:38:54.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.757 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135882 s, 77.2 MB/s 2024-09-10T08:38:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127403 s, 82.3 MB/s 2024-09-10T08:38:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129498 s, 81.0 MB/s 2024-09-10T08:38:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126165 s, 83.1 MB/s 2024-09-10T08:38:54.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141794 s, 74.0 MB/s 2024-09-10T08:38:54.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.840 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140434 s, 74.7 MB/s 2024-09-10T08:38:54.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.856 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131995 s, 79.4 MB/s 2024-09-10T08:38:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159126 s, 65.9 MB/s 2024-09-10T08:38:54.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143841 s, 72.9 MB/s 2024-09-10T08:38:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137844 s, 76.1 MB/s 2024-09-10T08:38:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167595 s, 62.6 MB/s 2024-09-10T08:38:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:38:54.939 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:38:55.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:38:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164262 s, 63.8 MB/s 2024-09-10T08:38:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128647 s, 81.5 MB/s 2024-09-10T08:38:55.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135198 s, 77.6 MB/s 2024-09-10T08:38:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132757 s, 79.0 MB/s 2024-09-10T08:38:55.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.110 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146204 s, 71.7 MB/s 2024-09-10T08:38:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165843 s, 63.2 MB/s 2024-09-10T08:38:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162778 s, 64.4 MB/s 2024-09-10T08:38:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160813 s, 65.2 MB/s 2024-09-10T08:38:55.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128491 s, 81.6 MB/s 2024-09-10T08:38:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159705 s, 65.7 MB/s 2024-09-10T08:38:55.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.220 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.220 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136473 s, 76.8 MB/s 2024-09-10T08:38:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138224 s, 75.9 MB/s 2024-09-10T08:38:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134144 s, 78.2 MB/s 2024-09-10T08:38:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136376 s, 76.9 MB/s 2024-09-10T08:38:55.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.291 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165139 s, 63.5 MB/s 2024-09-10T08:38:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131859 s, 79.5 MB/s 2024-09-10T08:38:55.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.323 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126375 s, 83.0 MB/s 2024-09-10T08:38:55.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.340 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136523 s, 76.8 MB/s 2024-09-10T08:38:55.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137957 s, 76.0 MB/s 2024-09-10T08:38:55.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138704 s, 75.6 MB/s 2024-09-10T08:38:55.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131801 s, 79.6 MB/s 2024-09-10T08:38:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.407 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131477 s, 79.8 MB/s 2024-09-10T08:38:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133782 s, 78.4 MB/s 2024-09-10T08:38:55.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164148 s, 63.9 MB/s 2024-09-10T08:38:55.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013247 s, 79.2 MB/s 2024-09-10T08:38:55.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140042 s, 74.9 MB/s 2024-09-10T08:38:55.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167533 s, 62.6 MB/s 2024-09-10T08:38:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138577 s, 75.7 MB/s 2024-09-10T08:38:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156293 s, 67.1 MB/s 2024-09-10T08:38:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133316 s, 78.7 MB/s 2024-09-10T08:38:55.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.567 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.567 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129507 s, 81.0 MB/s 2024-09-10T08:38:55.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:38:55.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:38:55.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130959 s, 80.1 MB/s 2024-09-10T08:38:55.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:38:55.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:55.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-10T08:38:55.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.754+0000 7f165da00640 1 Processor -- start 2024-09-10T08:38:55.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.755+0000 7f165da00640 1 -- start start 2024-09-10T08:38:55.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165da00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f165806bc10 0x7f165806c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165da00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1658148470 con 0x7f165806f730 2024-09-10T08:38:55.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165da00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f16581622d0 con 0x7f165806bc10 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1658163130 con 0x7f1658148090 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f1657e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165d000640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f165806f730 0x7f165806fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:38894/0 (socket says 172.21.15.52:38894) 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f165d000640 1 -- 172.21.15.52:0/1500103896 learned_addr learned my addr 172.21.15.52:0/1500103896 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f1657e00640 1 --2- 172.21.15.52:0/1500103896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:44378/0 (socket says 172.21.15.52:44378) 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.756+0000 7f164fe00640 1 --2- 172.21.15.52:0/1500103896 >> v2:172.21.15.176:3300/0 conn(0x7f165806bc10 0x7f165806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.757+0000 7f1657400640 1 -- 172.21.15.52:0/1500103896 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812694488 0 0) 0x7f1658148470 con 0x7f165806f730 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.757+0000 7f1657e00640 1 -- 172.21.15.52:0/1500103896 >> v2:172.21.15.176:3300/0 conn(0x7f165806bc10 msgr2=0x7f165806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.757+0000 7f1657e00640 1 --2- 172.21.15.52:0/1500103896 >> v2:172.21.15.176:3300/0 conn(0x7f165806bc10 0x7f165806c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.757+0000 7f1657e00640 1 -- 172.21.15.52:0/1500103896 >> v1:172.21.15.176:6789/0 conn(0x7f165806f730 legacy=0x7f165806fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.757+0000 7f1657e00640 1 -- 172.21.15.52:0/1500103896 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1658162520 con 0x7f1658148090 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.758+0000 7f1657e00640 1 --2- 172.21.15.52:0/1500103896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596a140b20ed1024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.758+0000 7f1657400640 1 -- 172.21.15.52:0/1500103896 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648037070 con 0x7f1658148090 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.758+0000 7f1657400640 1 -- 172.21.15.52:0/1500103896 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648032440 con 0x7f1658148090 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.758+0000 7f1657400640 1 -- 172.21.15.52:0/1500103896 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648032810 con 0x7f1658148090 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 -- 172.21.15.52:0/1500103896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 msgr2=0x7f16580b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 --2- 172.21.15.52:0/1500103896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802a180 comp rx=0 tx=0).stop 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 -- 172.21.15.52:0/1500103896 shutdown_connections 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 --2- 172.21.15.52:0/1500103896 >> v2:172.21.15.176:3300/0 conn(0x7f165806bc10 0x7f165806c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 --2- 172.21.15.52:0/1500103896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1658148090 0x7f16580b4b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 -- 172.21.15.52:0/1500103896 >> 172.21.15.52:0/1500103896 conn(0x7f165806cd20 msgr2=0x7f165806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 -- 172.21.15.52:0/1500103896 shutdown_connections 2024-09-10T08:38:55.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.759+0000 7f165da00640 1 -- 172.21.15.52:0/1500103896 wait complete. 2024-09-10T08:38:55.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.761+0000 7f165da00640 1 Processor -- start 2024-09-10T08:38:55.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.761+0000 7f165da00640 1 -- start start 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165806f730 0x7f1658146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1658148090 0x7f1658146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1658162ae0 con 0x7f165806bc10 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f165806c590 con 0x7f1658148090 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165da00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1658162dc0 con 0x7f165806f730 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52026/0 (socket says 172.21.15.52:52026) 2024-09-10T08:38:55.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 -- 172.21.15.52:0/706575355 learned_addr learned my addr 172.21.15.52:0/706575355 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f164fe00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165806f730 0x7f1658146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f165d000640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1658148090 0x7f1658146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 -- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165806f730 msgr2=0x7f1658146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165806f730 0x7f1658146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 -- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1658148090 msgr2=0x7f1658146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1658148090 0x7f1658146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.762+0000 7f1657e00640 1 -- 172.21.15.52:0/706575355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165815dec0 con 0x7f165806bc10 2024-09-10T08:38:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f1657e00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f16480098c0 tx=0x7f16480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f1654c00640 1 -- 172.21.15.52:0/706575355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648037040 con 0x7f165806bc10 2024-09-10T08:38:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f1654c00640 1 -- 172.21.15.52:0/706575355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648030500 con 0x7f165806bc10 2024-09-10T08:38:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f1654c00640 1 -- 172.21.15.52:0/706575355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16480308d0 con 0x7f165806bc10 2024-09-10T08:38:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1658147340 con 0x7f165806bc10 2024-09-10T08:38:55.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.763+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16580cfac0 con 0x7f165806bc10 2024-09-10T08:38:55.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.766+0000 7f1654c00640 1 -- 172.21.15.52:0/706575355 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1648044020 con 0x7f165806bc10 2024-09-10T08:38:55.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.767+0000 7f1654c00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 0x7f163406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.767+0000 7f1654c00640 1 -- 172.21.15.52:0/706575355 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f16480ab070 con 0x7f165806bc10 2024-09-10T08:38:55.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.767+0000 7f166200c740 1 Processor -- start 2024-09-10T08:38:55.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.767+0000 7f164fe00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 0x7f163406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.767+0000 7f166200c740 1 -- start start 2024-09-10T08:38:55.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f164fe00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 0x7f163406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16580b2910 tx=0x7f1640009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304069c0 0x562830406da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562830404180 0x562830405d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562830323a70 con 0x5628304045e0 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5628302cb9d0 con 0x562830404180 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x56283031fa30 con 0x5628304069c0 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.768+0000 7f165d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52036/0 (socket says 172.21.15.52:52036) 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 -- 172.21.15.52:0/3483463637 learned_addr learned my addr 172.21.15.52:0/3483463637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f164fe00640 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562830404180 0x562830405d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f1657e00640 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304069c0 0x562830406da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 -- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304069c0 msgr2=0x562830406da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304069c0 0x562830406da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 -- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562830404180 msgr2=0x562830405d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562830404180 0x562830405d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 -- 172.21.15.52:0/3483463637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562830102ba0 con 0x5628304045e0 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f165d000640 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1650001ff0 tx=0x7f1650007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be0854f53209281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f164cc00640 1 -- 172.21.15.52:0/3483463637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16500133f0 con 0x5628304045e0 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f164cc00640 1 -- 172.21.15.52:0/3483463637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1650018070 con 0x5628304045e0 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.769+0000 7f164cc00640 1 -- 172.21.15.52:0/3483463637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650013790 con 0x5628304045e0 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 -- 172.21.15.52:0/3483463637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 msgr2=0x5628303e6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1650001ff0 tx=0x7f1650007410 comp rx=0 tx=0).stop 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 -- 172.21.15.52:0/3483463637 shutdown_connections 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303e6940 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x562830404180 0x562830405d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 --2- 172.21.15.52:0/3483463637 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304069c0 0x562830406da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 -- 172.21.15.52:0/3483463637 >> 172.21.15.52:0/3483463637 conn(0x5628303bc620 msgr2=0x562830404a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 -- 172.21.15.52:0/3483463637 shutdown_connections 2024-09-10T08:38:55.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.770+0000 7f166200c740 1 -- 172.21.15.52:0/3483463637 wait complete. 2024-09-10T08:38:55.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.771+0000 7f166200c740 1 -- start start 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.771+0000 7f166200c740 1 Processor -- start 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x5628303e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5628304030e0 con 0x5628303ea250 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5628302debf0 con 0x5628304069c0 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5628304033c0 con 0x5628304045e0 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f166200c740 10 client.0 _ll_register_callbacks cb 0x5628303016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f165d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f165d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52046/0 (socket says 172.21.15.52:52046) 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f165d000640 1 -- 172.21.15.52:0/3174858571 learned_addr learned my addr 172.21.15.52:0/3174858571 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f1657e00640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x5628303e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.772+0000 7f164fe00640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 -- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 msgr2=0x5628303e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x5628303e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 -- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 msgr2=0x5628303e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 -- 172.21.15.52:0/3174858571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282fff6490 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f165d000640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1650007c40 tx=0x7f16500019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b83719917227be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f1645600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650006810 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f16500069b0 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1650018070 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f165002e050 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f166200c740 10 client.8913 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.773+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x562830163330 con 0x5628303ea250 2024-09-10T08:38:55.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1650018070 con 0x5628303ea250 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f1650031020 con 0x5628303ea250 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 10 client.8913 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 10 client.8913 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 20 client.8913 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303fc820 0x562830418240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 4 client.8913 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628303311a0 con 0x5628303fc820 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.774+0000 7f1657e00640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303fc820 0x562830418240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.775+0000 7f1657e00640 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303fc820 0x562830418240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce74db9d7a35720 server_cookie=f389339c1b158b09 in_seq=0 out_seq=0 2024-09-10T08:38:55.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.775+0000 7f1645600640 10 client.8913 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f1645600640 1 -- 172.21.15.52:0/3174858571 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628303311a0 con 0x5628303fc820 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f1645600640 10 client.8913 handle_command_reply: tid=0 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 client.8913 shutdown 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 msgr2=0x5628303fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1650007c40 tx=0x7f16500019f0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 shutdown_connections 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303fc820 0x562830418240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x5628303fc2e0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 --2- 172.21.15.52:0/3174858571 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x5628303e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 >> 172.21.15.52:0/3174858571 conn(0x562830404180 msgr2=0x5628303e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f1645600640 0 client.8913 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:55.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 shutdown_connections 2024-09-10T08:38:55.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.776+0000 7f166200c740 1 -- 172.21.15.52:0/3174858571 wait complete. 2024-09-10T08:38:55.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.777+0000 7f166200c740 20 client.8913 trim_cache size 0 max 16384 2024-09-10T08:38:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.795+0000 7f166200c740 1 Processor -- start 2024-09-10T08:38:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.795+0000 7f166200c740 1 -- start start 2024-09-10T08:38:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628303ea250 0x562830415350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1658200920 con 0x5628304045e0 2024-09-10T08:38:55.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16580d0f60 con 0x5628304069c0 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f16580d02c0 con 0x5628303ea250 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52060/0 (socket says 172.21.15.52:52060) 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 -- 172.21.15.52:0/2474887363 learned_addr learned my addr 172.21.15.52:0/2474887363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f165d000640 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f1657e00640 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628303ea250 0x562830415350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 -- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628303ea250 msgr2=0x562830415350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628303ea250 0x562830415350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 -- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 msgr2=0x5628303bba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303bba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.796+0000 7f164fe00640 1 -- 172.21.15.52:0/2474887363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282ffcf550 con 0x5628304045e0 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f164fe00640 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1640011f60 tx=0x7f1640014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25092048e02917be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f1647e00640 1 -- 172.21.15.52:0/2474887363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1640014e10 con 0x5628304045e0 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f1647e00640 1 -- 172.21.15.52:0/2474887363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164001b050 con 0x5628304045e0 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f1647e00640 1 -- 172.21.15.52:0/2474887363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164002c6a0 con 0x5628304045e0 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f166200c740 1 -- 172.21.15.52:0/2474887363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 msgr2=0x5628303bb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.797+0000 7f166200c740 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1640011f60 tx=0x7f1640014000 comp rx=0 tx=0).stop 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 -- 172.21.15.52:0/2474887363 shutdown_connections 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x5628303bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628304045e0 0x5628303bb510 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 --2- 172.21.15.52:0/2474887363 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628303ea250 0x562830415350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 -- 172.21.15.52:0/2474887363 >> 172.21.15.52:0/2474887363 conn(0x562830404180 msgr2=0x5628303e9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 -- 172.21.15.52:0/2474887363 shutdown_connections 2024-09-10T08:38:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 -- 172.21.15.52:0/2474887363 wait complete. 2024-09-10T08:38:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.798+0000 7f166200c740 1 -- start start 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 Processor -- start 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x562830405680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x562830405bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5628304030e0 con 0x5628303ea250 2024-09-10T08:38:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16580d0910 con 0x5628304069c0 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.799+0000 7f166200c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5628303c0790 con 0x5628304045e0 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f166200c740 10 client.0 _ll_register_callbacks cb 0x7f1640009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52070/0 (socket says 172.21.15.52:52070) 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 -- 172.21.15.52:0/2156873760 learned_addr learned my addr 172.21.15.52:0/2156873760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f164fe00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x562830405680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 -- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 msgr2=0x562830405680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x562830405680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 -- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 msgr2=0x562830405bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x562830405bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 -- 172.21.15.52:0/2156873760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562830483790 con 0x5628303ea250 2024-09-10T08:38:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1657e00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f16480a9500 tx=0x7f1648008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d064d53fda2f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.800+0000 7f1645600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648096060 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f1648077630 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f164001b050 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f164809d050 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 10 client.8919 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x562830484d00 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164001b050 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f164803a070 con 0x5628303ea250 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 10 client.8919 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 10 client.8919 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 20 client.8919 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:55.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303e7490 0x5628303b9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 4 client.8919 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T08:38:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.801+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5628303ff880 con 0x5628303e7490 2024-09-10T08:38:55.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.803+0000 7f164fe00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303e7490 0x5628303b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.808+0000 7f164fe00640 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303e7490 0x5628303b9360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8874cb32b5bfeb9c server_cookie=c93da596b7913fea in_seq=0 out_seq=0 2024-09-10T08:38:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.808+0000 7f1645600640 10 client.8919 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f1645600640 1 -- 172.21.15.52:0/2156873760 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628303ff880 con 0x5628303e7490 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f1645600640 10 client.8919 handle_command_reply: tid=0 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 client.8919 shutdown 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 msgr2=0x562830483250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f16480a9500 tx=0x7f1648008040 comp rx=0 tx=0).stop 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 shutdown_connections 2024-09-10T08:38:55.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5628303e7490 0x5628303b9360 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5628304069c0 0x562830405bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5628304045e0 0x562830405680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 --2- 172.21.15.52:0/2156873760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5628303ea250 0x562830483250 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f1645600640 0 client.8919 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.810+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 >> 172.21.15.52:0/2156873760 conn(0x562830404180 msgr2=0x562830407f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 shutdown_connections 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f166200c740 1 -- 172.21.15.52:0/2156873760 wait complete. 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f166200c740 20 client.8919 trim_cache size 0 max 16384 2024-09-10T08:38:55.811 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:55.812 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:38:55.812 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "c3f242be-069b-41f5-9ada-28a27f61b57e", 2024-09-10T08:38:55.812 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:38:55.812 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 msgr2=0x7f163406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 0x7f163406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16580b2910 tx=0x7f1640009190 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 msgr2=0x7f165815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f16480098c0 tx=0x7f16480046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 shutdown_connections 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f163406be30 0x7f163406e2f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1658148090 0x7f1658146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f165806f730 0x7f1658146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 --2- 172.21.15.52:0/706575355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806bc10 0x7f165815d980 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.811+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 >> 172.21.15.52:0/706575355 conn(0x7f165806cd20 msgr2=0x7f165806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.812+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 shutdown_connections 2024-09-10T08:38:55.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:55.812+0000 7f165da00640 1 -- 172.21.15.52:0/706575355 wait complete. 2024-09-10T08:38:55.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:55.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-10T08:38:56.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.001+0000 7fb31cc00640 1 Processor -- start 2024-09-10T08:38:56.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.001+0000 7fb31cc00640 1 -- start start 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.002+0000 7fb31cc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb318158920 0x7fb318073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.002+0000 7fb31cc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3180ce0f0 con 0x7fb31806bc10 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.002+0000 7fb31cc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb318071500 con 0x7fb318070f40 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.002+0000 7fb31cc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb318072130 con 0x7fb318158920 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.003+0000 7fb316800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb31806bc10 0x7fb318165a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56958/0 (socket says 172.21.15.52:56958) 2024-09-10T08:38:56.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.003+0000 7fb316800640 1 -- 172.21.15.52:0/1488720566 learned_addr learned my addr 172.21.15.52:0/1488720566 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.003+0000 7fb30fe00640 1 --2- 172.21.15.52:0/1488720566 >> v2:172.21.15.176:3300/0 conn(0x7fb318158920 0x7fb318073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.003+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874980233 0 0) 0x7fb3180ce0f0 con 0x7fb31806bc10 2024-09-10T08:38:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.003+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2fc003520 con 0x7fb31806bc10 2024-09-10T08:38:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.004+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473963789 0 0) 0x7fb2fc003520 con 0x7fb31806bc10 2024-09-10T08:38:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.004+0000 7fb30fe00640 1 -- 172.21.15.52:0/1488720566 >> v1:172.21.15.176:6789/0 conn(0x7fb318070f40 legacy=0x7fb3180ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.004+0000 7fb30fe00640 1 -- 172.21.15.52:0/1488720566 >> v1:172.21.15.52:6789/0 conn(0x7fb31806bc10 legacy=0x7fb318165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.004+0000 7fb30fe00640 1 -- 172.21.15.52:0/1488720566 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb318071ae0 con 0x7fb318158920 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb30fe00640 1 --2- 172.21.15.52:0/1488720566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318158920 0x7fb318073ac0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fedf6d69019632ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300039070 con 0x7fb318158920 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30002cc50 con 0x7fb318158920 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb315400640 1 -- 172.21.15.52:0/1488720566 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100019f0 con 0x7fb318158920 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb31cc00640 1 -- 172.21.15.52:0/1488720566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318158920 msgr2=0x7fb318073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb31cc00640 1 --2- 172.21.15.52:0/1488720566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318158920 0x7fb318073ac0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097a0 tx=0x7fb30002c1c0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb31cc00640 1 -- 172.21.15.52:0/1488720566 shutdown_connections 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb31cc00640 1 --2- 172.21.15.52:0/1488720566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318158920 0x7fb318073ac0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.005+0000 7fb31cc00640 1 -- 172.21.15.52:0/1488720566 >> 172.21.15.52:0/1488720566 conn(0x7fb31806d0f0 msgr2=0x7fb31806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.006+0000 7fb31cc00640 1 -- 172.21.15.52:0/1488720566 shutdown_connections 2024-09-10T08:38:56.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.006+0000 7fb31cc00640 1 -- 172.21.15.52:0/1488720566 wait complete. 2024-09-10T08:38:56.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.007+0000 7fb31cc00640 1 Processor -- start 2024-09-10T08:38:56.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.007+0000 7fb31cc00640 1 -- start start 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 0x7fb3180b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb318158920 0x7fb3180b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb31806cc30 con 0x7fb31806bc10 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3180cd670 con 0x7fb318070f40 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb31cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb3180725c0 con 0x7fb318158920 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 0x7fb3180b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb316800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb318158920 0x7fb3180b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.008+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52082/0 (socket says 172.21.15.52:52082) 2024-09-10T08:38:56.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 -- 172.21.15.52:0/852916724 learned_addr learned my addr 172.21.15.52:0/852916724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 -- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb318158920 msgr2=0x7fb3180b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb318158920 0x7fb3180b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 -- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 msgr2=0x7fb3180b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 0x7fb3180b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 -- 172.21.15.52:0/852916724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31814db10 con 0x7fb31806bc10 2024-09-10T08:38:56.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb30fe00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 0x7fb3180b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.009+0000 7fb315e00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c7b0 tx=0x7fb30800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.010+0000 7fb30e000640 1 -- 172.21.15.52:0/852916724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3080052d0 con 0x7fb31806bc10 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.010+0000 7fb30e000640 1 -- 172.21.15.52:0/852916724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308005490 con 0x7fb31806bc10 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.010+0000 7fb30e000640 1 -- 172.21.15.52:0/852916724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30800a880 con 0x7fb31806bc10 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.010+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb318155920 con 0x7fb31806bc10 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.010+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb318155ee0 con 0x7fb31806bc10 2024-09-10T08:38:56.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.012+0000 7fb30e000640 1 -- 172.21.15.52:0/852916724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb30800aa20 con 0x7fb31806bc10 2024-09-10T08:38:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.013+0000 7fb30e000640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 0x7fb2f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.013+0000 7fb30e000640 1 -- 172.21.15.52:0/852916724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fb30808ab50 con 0x7fb31806bc10 2024-09-10T08:38:56.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.013+0000 7fb30fe00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 0x7fb2f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.013+0000 7fb31fbc2740 1 Processor -- start 2024-09-10T08:38:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.014+0000 7fb31fbc2740 1 -- start start 2024-09-10T08:38:56.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.014+0000 7fb30fe00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 0x7fb2f406e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb300030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.014+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426c240 0x563bc426ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4270210 0x563bc4269070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563bc4235cf0 con 0x563bc426ea80 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563bc41d17f0 con 0x563bc426c240 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563bc4179800 con 0x563bc4270210 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52092/0 (socket says 172.21.15.52:52092) 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 -- 172.21.15.52:0/605228814 learned_addr learned my addr 172.21.15.52:0/605228814 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb30fe00640 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426c240 0x563bc426ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb316800640 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4270210 0x563bc4269070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 -- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4270210 msgr2=0x563bc4269070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4270210 0x563bc4269070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 -- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426c240 msgr2=0x563bc426ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426c240 0x563bc426ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.015+0000 7fb315e00640 1 -- 172.21.15.52:0/605228814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc3fae7d0 con 0x563bc426ea80 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb315e00640 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb308088f20 tx=0x7fb308058e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a0e924b9d4bc3d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb306600640 1 -- 172.21.15.52:0/605228814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308061940 con 0x563bc426ea80 2024-09-10T08:38:56.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb306600640 1 -- 172.21.15.52:0/605228814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308087070 con 0x563bc426ea80 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb306600640 1 -- 172.21.15.52:0/605228814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30800ad10 con 0x563bc426ea80 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 -- 172.21.15.52:0/605228814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 msgr2=0x563bc42b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb308088f20 tx=0x7fb308058e10 comp rx=0 tx=0).stop 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 -- 172.21.15.52:0/605228814 shutdown_connections 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4270210 0x563bc4269070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426c240 0x563bc426ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/605228814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc42b4220 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.016+0000 7fb31fbc2740 1 -- 172.21.15.52:0/605228814 >> 172.21.15.52:0/605228814 conn(0x563bc426b240 msgr2=0x563bc42b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.017+0000 7fb31fbc2740 1 -- 172.21.15.52:0/605228814 shutdown_connections 2024-09-10T08:38:56.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.017+0000 7fb31fbc2740 1 -- 172.21.15.52:0/605228814 wait complete. 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.017+0000 7fb31fbc2740 1 -- start start 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.017+0000 7fb31fbc2740 1 Processor -- start 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4270210 0x563bc428f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc4298cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563bc415a750 con 0x563bc426ea80 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563bc41cd7b0 con 0x563bc4270210 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563bc426a6e0 con 0x563bc4298840 2024-09-10T08:38:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.018+0000 7fb31fbc2740 10 client.0 _ll_register_callbacks cb 0x563bc3ee3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52104/0 (socket says 172.21.15.52:52104) 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 -- 172.21.15.52:0/1058660473 learned_addr learned my addr 172.21.15.52:0/1058660473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb316800640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc4298cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb30fe00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4270210 0x563bc428f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 -- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 msgr2=0x563bc4298cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc4298cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 -- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4270210 msgr2=0x563bc428f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4270210 0x563bc428f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 -- 172.21.15.52:0/1058660473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc3ea40f0 con 0x563bc426ea80 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb315e00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb308055270 tx=0x7fb308000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6168d2a4cc18bd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb2faa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:56.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30800ad10 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fb308055480 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.019+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb308087070 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fb308058260 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 10 client.8931 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x563bc400ef60 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308087070 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fb308058400 con 0x563bc426ea80 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 10 client.8931 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 10 client.8931 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 20 client.8931 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42c7250 0x563bc42c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 4 client.8931 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bc41def20 con 0x563bc42c7250 2024-09-10T08:38:56.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.020+0000 7fb30fe00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42c7250 0x563bc42c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.021+0000 7fb30fe00640 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42c7250 0x563bc42c7630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d149e0ca4d660134 server_cookie=cabd5ce181479e22 in_seq=0 out_seq=0 2024-09-10T08:38:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.021+0000 7fb2faa00640 10 client.8931 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.022+0000 7fb2faa00640 1 -- 172.21.15.52:0/1058660473 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bc41def20 con 0x563bc42c7250 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.022+0000 7fb2faa00640 10 client.8931 handle_command_reply: tid=0 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.022+0000 7fb31fbc2740 1 client.8931 shutdown 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 msgr2=0x563bc4290cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb308055270 tx=0x7fb308000ed0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 shutdown_connections 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42c7250 0x563bc42c7630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc4298cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4270210 0x563bc428f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb2faa00640 0 client.8931 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/1058660473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc426ea80 0x563bc4290cb0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 >> 172.21.15.52:0/1058660473 conn(0x563bc426c240 msgr2=0x563bc42b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 shutdown_connections 2024-09-10T08:38:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 1 -- 172.21.15.52:0/1058660473 wait complete. 2024-09-10T08:38:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.023+0000 7fb31fbc2740 20 client.8931 trim_cache size 0 max 16384 2024-09-10T08:38:56.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 Processor -- start 2024-09-10T08:38:56.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 -- start start 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc426ea80 0x563bc42b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4298840 0x563bc42b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb318200ae0 con 0x563bc4270210 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3181ffb00 con 0x563bc4298840 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.041+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb31814ba20 con 0x563bc426ea80 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52118/0 (socket says 172.21.15.52:52118) 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 -- 172.21.15.52:0/467800894 learned_addr learned my addr 172.21.15.52:0/467800894 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 -- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc426ea80 msgr2=0x563bc42b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc426ea80 0x563bc42b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 -- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4298840 msgr2=0x563bc42b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4298840 0x563bc42b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 -- 172.21.15.52:0/467800894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc42b1e50 con 0x563bc4270210 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.042+0000 7fb30fe00640 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fb300034d80 tx=0x7fb30002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd8b372787adc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb305c00640 1 -- 172.21.15.52:0/467800894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300043030 con 0x563bc4270210 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb305c00640 1 -- 172.21.15.52:0/467800894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30003a040 con 0x563bc4270210 2024-09-10T08:38:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb305c00640 1 -- 172.21.15.52:0/467800894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300039040 con 0x563bc4270210 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 -- 172.21.15.52:0/467800894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 msgr2=0x563bc42c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fb300034d80 tx=0x7fb30002e000 comp rx=0 tx=0).stop 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 -- 172.21.15.52:0/467800894 shutdown_connections 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc4298840 0x563bc42b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc42c31e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/467800894 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc426ea80 0x563bc42b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 -- 172.21.15.52:0/467800894 >> 172.21.15.52:0/467800894 conn(0x563bc426c240 msgr2=0x563bc42ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 -- 172.21.15.52:0/467800894 shutdown_connections 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.043+0000 7fb31fbc2740 1 -- 172.21.15.52:0/467800894 wait complete. 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.044+0000 7fb31fbc2740 1 -- start start 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.044+0000 7fb31fbc2740 1 Processor -- start 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426ea80 0x563bc4319f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc42970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563bc4294880 con 0x563bc4270210 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x563bc42b3640 con 0x563bc426ea80 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x563bc42ae090 con 0x563bc4298840 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb31fbc2740 10 client.0 _ll_register_callbacks cb 0x7fb2fc0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb30fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52128/0 (socket says 172.21.15.52:52128) 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.045+0000 7fb30fe00640 1 -- 172.21.15.52:0/3651501006 learned_addr learned my addr 172.21.15.52:0/3651501006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 -- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 msgr2=0x563bc42970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc42970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 -- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426ea80 msgr2=0x563bc4319f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426ea80 0x563bc4319f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 -- 172.21.15.52:0/3651501006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc3e7d1b0 con 0x563bc4270210 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb30fe00640 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb300034d80 tx=0x7fb300004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d350468aa950acc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb2faa00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300039040 con 0x563bc4270210 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fb30004fb20 con 0x563bc4270210 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb30003a040 con 0x563bc4270210 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fb3000552e0 con 0x563bc4270210 2024-09-10T08:38:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb31fbc2740 10 client.8937 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.046+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x563bc4290c00 con 0x563bc4270210 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30003a040 con 0x563bc4270210 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fb300055480 con 0x563bc4270210 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 10 client.8937 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 10 client.8937 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 20 client.8937 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42699c0 0x563bc4267f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 4 client.8937 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x563bc41d9270 con 0x563bc42699c0 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb315e00640 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42699c0 0x563bc4267f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb315e00640 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42699c0 0x563bc4267f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5e28f2362cb0df server_cookie=c6e50f8b352dfbaf in_seq=0 out_seq=0 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.047+0000 7fb2faa00640 10 client.8937 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb2faa00640 1 -- 172.21.15.52:0/3651501006 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bc41d9270 con 0x563bc42699c0 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb2faa00640 10 client.8937 handle_command_reply: tid=0 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 client.8937 shutdown 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 msgr2=0x563bc4296b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb300034d80 tx=0x7fb300004730 comp rx=0 tx=0).stop 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 shutdown_connections 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x563bc42699c0 0x563bc4267f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x563bc4298840 0x563bc42970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bc4270210 0x563bc4296b90 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 --2- 172.21.15.52:0/3651501006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x563bc426ea80 0x563bc4319f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb2faa00640 0 client.8937 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 >> 172.21.15.52:0/3651501006 conn(0x563bc426c240 msgr2=0x563bc42d7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 shutdown_connections 2024-09-10T08:38:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 1 -- 172.21.15.52:0/3651501006 wait complete. 2024-09-10T08:38:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.048+0000 7fb31fbc2740 20 client.8937 trim_cache size 0 max 16384 2024-09-10T08:38:56.053 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:56.053 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:38:56.054 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:38:56.054 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 msgr2=0x7fb2f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 0x7fb2f406e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb300030000 comp rx=0 tx=0).stop 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 msgr2=0x7fb31814d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c7b0 tx=0x7fb30800cc70 comp rx=0 tx=0).stop 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 shutdown_connections 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb2f406be30 0x7fb2f406e2f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb318158920 0x7fb3180b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318070f40 0x7fb3180b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 --2- 172.21.15.52:0/852916724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806bc10 0x7fb31814d5d0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 >> 172.21.15.52:0/852916724 conn(0x7fb31806d0f0 msgr2=0x7fb3180b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 shutdown_connections 2024-09-10T08:38:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.049+0000 7fb31cc00640 1 -- 172.21.15.52:0/852916724 wait complete. 2024-09-10T08:38:56.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:38:56.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T08:38:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.222+0000 7ffa21a00640 1 Processor -- start 2024-09-10T08:38:56.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.222+0000 7ffa21a00640 1 -- start start 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1c15e620 0x7ffa1c0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ffa1c0d14a0 0x7ffa1c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c0b7680 con 0x7ffa1c15e620 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c0d3250 con 0x7ffa1c0d14a0 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.223+0000 7ffa21a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0b78b0 con 0x7ffa1c0d2660 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1c15e620 0x7ffa1c0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffa1c15e620 0x7ffa1c0d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52144/0 (socket says 172.21.15.52:52144) 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 -- 172.21.15.52:0/2569876474 learned_addr learned my addr 172.21.15.52:0/2569876474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa21000640 1 --2- 172.21.15.52:0/2569876474 >> v2:172.21.15.176:3300/0 conn(0x7ffa1c0d14a0 0x7ffa1c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa13e00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 -- 172.21.15.52:0/2569876474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 msgr2=0x7ffa1c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c0d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 -- 172.21.15.52:0/2569876474 >> v2:172.21.15.176:3300/0 conn(0x7ffa1c0d14a0 msgr2=0x7ffa1c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2569876474 >> v2:172.21.15.176:3300/0 conn(0x7ffa1c0d14a0 0x7ffa1c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.224+0000 7ffa1be00640 1 -- 172.21.15.52:0/2569876474 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c15ea00 con 0x7ffa1c15e620 2024-09-10T08:38:56.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.225+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c0d2120 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c162030 tx=0x7ffa0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf1d5e29e5c628e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.225+0000 7ffa1b400640 1 -- 172.21.15.52:0/2569876474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037070 con 0x7ffa1c15e620 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.225+0000 7ffa1b400640 1 -- 172.21.15.52:0/2569876474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c032440 con 0x7ffa1c15e620 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.225+0000 7ffa1b400640 1 -- 172.21.15.52:0/2569876474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c032810 con 0x7ffa1c15e620 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 -- 172.21.15.52:0/2569876474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 msgr2=0x7ffa1c0d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c0d2120 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c162030 tx=0x7ffa0c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 -- 172.21.15.52:0/2569876474 shutdown_connections 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 --2- 172.21.15.52:0/2569876474 >> v2:172.21.15.176:3300/0 conn(0x7ffa1c0d14a0 0x7ffa1c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c0d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 --2- 172.21.15.52:0/2569876474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c0d2120 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 -- 172.21.15.52:0/2569876474 >> 172.21.15.52:0/2569876474 conn(0x7ffa1c067950 msgr2=0x7ffa1c067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 -- 172.21.15.52:0/2569876474 shutdown_connections 2024-09-10T08:38:56.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.226+0000 7ffa21a00640 1 -- 172.21.15.52:0/2569876474 wait complete. 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.228+0000 7ffa21a00640 1 Processor -- start 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.228+0000 7ffa21a00640 1 -- start start 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 0x7ffa1c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d40a0 con 0x7ffa1c15e620 2024-09-10T08:38:56.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d2f70 con 0x7ffa1c0d14a0 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0b6510 con 0x7ffa1c0d2660 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52154/0 (socket says 172.21.15.52:52154) 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa21000640 1 -- 172.21.15.52:0/1026436725 learned_addr learned my addr 172.21.15.52:0/1026436725 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 0x7ffa1c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.229+0000 7ffa13e00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 -- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 msgr2=0x7ffa1c160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 -- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 msgr2=0x7ffa1c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 0x7ffa1c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 -- 172.21.15.52:0/1026436725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c1611d0 con 0x7ffa1c15e620 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 0x7ffa1c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21000640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ef00 tx=0x7ffa1400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa18c00640 1 -- 172.21.15.52:0/1026436725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14018020 con 0x7ffa1c15e620 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa18c00640 1 -- 172.21.15.52:0/1026436725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14014400 con 0x7ffa1c15e620 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa18c00640 1 -- 172.21.15.52:0/1026436725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa140147f0 con 0x7ffa1c15e620 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c1614b0 con 0x7ffa1c15e620 2024-09-10T08:38:56.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.230+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c148930 con 0x7ffa1c15e620 2024-09-10T08:38:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.232+0000 7ffa18c00640 1 -- 172.21.15.52:0/1026436725 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa14005d10 con 0x7ffa1c15e620 2024-09-10T08:38:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.233+0000 7ffa18c00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.233+0000 7ffa18c00640 1 -- 172.21.15.52:0/1026436725 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ffa1408b4b0 con 0x7ffa1c15e620 2024-09-10T08:38:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.234+0000 7ffa25dce740 1 Processor -- start 2024-09-10T08:38:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.234+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.234+0000 7ffa25dce740 1 -- start start 2024-09-10T08:38:56.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c034000 tx=0x7ffa0c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176824f0 0x55b9176828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b9175d0660 con 0x55b9176689e0 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b917578680 con 0x55b9176824f0 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b9175cc620 con 0x55b9176b2ea0 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52156/0 (socket says 172.21.15.52:52156) 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa13e00640 1 -- 172.21.15.52:0/221615955 learned_addr learned my addr 172.21.15.52:0/221615955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa1be00640 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176824f0 0x55b9176828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.235+0000 7ffa21000640 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 -- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 msgr2=0x55b9176b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 -- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176824f0 msgr2=0x55b9176828d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176824f0 0x55b9176828d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 -- 172.21.15.52:0/221615955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9173ad7d0 con 0x55b9176689e0 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa13e00640 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009c30 tx=0x7ffa04011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643f3123506acc30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa10c00640 1 -- 172.21.15.52:0/221615955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04004030 con 0x55b9176689e0 2024-09-10T08:38:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa10c00640 1 -- 172.21.15.52:0/221615955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040041d0 con 0x55b9176689e0 2024-09-10T08:38:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.236+0000 7ffa10c00640 1 -- 172.21.15.52:0/221615955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003610 con 0x55b9176689e0 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 -- 172.21.15.52:0/221615955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 msgr2=0x55b917667240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009c30 tx=0x7ffa04011690 comp rx=0 tx=0).stop 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 -- 172.21.15.52:0/221615955 shutdown_connections 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176689e0 0x55b917667240 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 --2- 172.21.15.52:0/221615955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176824f0 0x55b9176828d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 -- 172.21.15.52:0/221615955 >> 172.21.15.52:0/221615955 conn(0x55b917669410 msgr2=0x55b9176b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 -- 172.21.15.52:0/221615955 shutdown_connections 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.237+0000 7ffa25dce740 1 -- 172.21.15.52:0/221615955 wait complete. 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.238+0000 7ffa25dce740 1 -- start start 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.238+0000 7ffa25dce740 1 Processor -- start 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b91769a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b917667940 con 0x55b9176824f0 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b9175594c0 con 0x55b9176c1e60 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b917667c20 con 0x55b9176b2ea0 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa25dce740 10 client.0 _ll_register_callbacks cb 0x55b9175c8e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52160/0 (socket says 172.21.15.52:52160) 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 -- 172.21.15.52:0/2702534732 learned_addr learned my addr 172.21.15.52:0/2702534732 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa13e00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa21000640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b91769a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 -- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 msgr2=0x55b9176c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 -- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 msgr2=0x55b91769a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b91769a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa1be00640 1 -- 172.21.15.52:0/2702534732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9172e33f0 con 0x55b9176824f0 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa13e00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.239+0000 7ffa21000640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b91769a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa1be00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0090b0 tx=0x7ffa0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34c558903d92d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa09600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037040 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ffa0c03c9d0 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa040041d0 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7ffa0c03cbd0 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa25dce740 10 client.8949 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.240+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55b9172a30f0 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040041d0 con 0x55b9176824f0 2024-09-10T08:38:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7ffa0c04a420 con 0x55b9176824f0 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 10 client.8949 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 10 client.8949 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 20 client.8949 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b9176982f0 0x55b917698710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 4 client.8949 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9175ddd90 con 0x55b9176982f0 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.241+0000 7ffa13e00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b9176982f0 0x55b917698710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.242+0000 7ffa13e00640 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b9176982f0 0x55b917698710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec239955f9c51937 server_cookie=a2f8c835ea5ff452 in_seq=0 out_seq=0 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.242+0000 7ffa09600640 10 client.8949 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa09600640 1 -- 172.21.15.52:0/2702534732 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9175ddd90 con 0x55b9176982f0 2024-09-10T08:38:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa09600640 10 client.8949 handle_command_reply: tid=0 2024-09-10T08:38:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 client.8949 shutdown 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 msgr2=0x55b9176abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0090b0 tx=0x7ffa0c004730 comp rx=0 tx=0).stop 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 shutdown_connections 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b9176982f0 0x55b917698710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b91769a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b9176c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 --2- 172.21.15.52:0/2702534732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176abc30 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa09600640 0 client.8949 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 >> 172.21.15.52:0/2702534732 conn(0x55b9176689e0 msgr2=0x55b9176b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 shutdown_connections 2024-09-10T08:38:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 1 -- 172.21.15.52:0/2702534732 wait complete. 2024-09-10T08:38:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.243+0000 7ffa25dce740 20 client.8949 trim_cache size 0 max 16384 2024-09-10T08:38:56.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.261+0000 7ffa25dce740 1 Processor -- start 2024-09-10T08:38:56.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 -- start start 2024-09-10T08:38:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b91769b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917698f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c200b30 con 0x55b9176824f0 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c1ffb10 con 0x55b9176c1e60 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.262+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c1feea0 con 0x55b9176b2ea0 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52168/0 (socket says 172.21.15.52:52168) 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 -- 172.21.15.52:0/3692245509 learned_addr learned my addr 172.21.15.52:0/3692245509 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 -- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 msgr2=0x55b91769b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b91769b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 -- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 msgr2=0x55b917698f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917698f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 -- 172.21.15.52:0/3692245509 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b91766e3e0 con 0x55b9176824f0 2024-09-10T08:38:56.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.263+0000 7ffa1be00640 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c032d30 tx=0x7ffa0c046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f559a028c8e114a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa0be00640 1 -- 172.21.15.52:0/3692245509 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c037070 con 0x55b9176824f0 2024-09-10T08:38:56.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa0be00640 1 -- 172.21.15.52:0/3692245509 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c04f070 con 0x55b9176824f0 2024-09-10T08:38:56.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa0be00640 1 -- 172.21.15.52:0/3692245509 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c03c7d0 con 0x55b9176824f0 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 -- 172.21.15.52:0/3692245509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 msgr2=0x55b9176b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c032d30 tx=0x7ffa0c046000 comp rx=0 tx=0).stop 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 -- 172.21.15.52:0/3692245509 shutdown_connections 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917698f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176b2ea0 0x55b91769b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 --2- 172.21.15.52:0/3692245509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176824f0 0x55b9176b0e80 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 -- 172.21.15.52:0/3692245509 >> 172.21.15.52:0/3692245509 conn(0x55b9176689e0 msgr2=0x55b917697240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 -- 172.21.15.52:0/3692245509 shutdown_connections 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.264+0000 7ffa25dce740 1 -- 172.21.15.52:0/3692245509 wait complete. 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.265+0000 7ffa25dce740 1 -- start start 2024-09-10T08:38:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.265+0000 7ffa25dce740 1 Processor -- start 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176824f0 0x55b917730030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917718400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b91766a1a0 con 0x55b9176b2ea0 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c1ff4c0 con 0x55b9176c1e60 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b9176ad6c0 con 0x55b9176824f0 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa25dce740 10 client.0 _ll_register_callbacks cb 0x7ffa04009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa13e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52172/0 (socket says 172.21.15.52:52172) 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa13e00640 1 -- 172.21.15.52:0/1312655118 learned_addr learned my addr 172.21.15.52:0/1312655118 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176824f0 0x55b917730030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.266+0000 7ffa21000640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917718400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 -- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176824f0 msgr2=0x55b917730030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176824f0 0x55b917730030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 -- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 msgr2=0x55b917718400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917718400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 -- 172.21.15.52:0/1312655118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9176d4be0 con 0x55b9176b2ea0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa13e00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009c00 tx=0x7ffa040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4129506efa7f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa09600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003610 con 0x55b9176b2ea0 2024-09-10T08:38:56.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ffa04033ac0 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa0c04f070 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7ffa0403a050 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa25dce740 10 client.8955 fetch_fsmap learned FSMap version 110 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.267+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55b917730680 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c04f070 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7ffa0403d020 con 0x55b9176b2ea0 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 10 client.8955 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 10 client.8955 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 20 client.8955 populate_metadata read hostname 'smithi052' 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b917698f10 0x55b9176992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 4 client.8955 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:38:56.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b9175d80e0 con 0x55b917698f10 2024-09-10T08:38:56.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.268+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b917698f10 0x55b9176992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa1be00640 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b917698f10 0x55b9176992f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea1fe3ddff0fed6 server_cookie=77a74ca6b2976041 in_seq=0 out_seq=0 2024-09-10T08:38:56.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa09600640 10 client.8955 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa09600640 1 -- 172.21.15.52:0/1312655118 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55b9175d80e0 con 0x55b917698f10 2024-09-10T08:38:56.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa09600640 10 client.8955 handle_command_reply: tid=0 2024-09-10T08:38:56.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 client.8955 shutdown 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 msgr2=0x55b9176c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009c00 tx=0x7ffa040046c0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 shutdown_connections 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55b917698f10 0x55b9176992f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b9176c1e60 0x55b917718400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b9176b2ea0 0x55b9176c4580 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 --2- 172.21.15.52:0/1312655118 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b9176824f0 0x55b917730030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa09600640 0 client.8955 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 >> 172.21.15.52:0/1312655118 conn(0x55b9176689e0 msgr2=0x55b9176ab610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 shutdown_connections 2024-09-10T08:38:56.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.269+0000 7ffa25dce740 1 -- 172.21.15.52:0/1312655118 wait complete. 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa25dce740 20 client.8955 trim_cache size 0 max 16384 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "c3f242be-069b-41f5-9ada-28a27f61b57e": { 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_control_test_path", 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "c3f242be-069b-41f5-9ada-28a27f61b57e", 2024-09-10T08:38:56.275 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:38:56.276 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:56.276 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:38:56.276 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 msgr2=0x7ff9f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c034000 tx=0x7ffa0c02e000 comp rx=0 tx=0).stop 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 msgr2=0x7ffa1c160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400ef00 tx=0x7ffa1400b480 comp rx=0 tx=0).stop 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 shutdown_connections 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9f806be30 0x7ff9f806e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa1c15e620 0x7ffa1c160bc0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ffa1c0d2660 0x7ffa1c160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 --2- 172.21.15.52:0/1026436725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa1c0d14a0 0x7ffa1c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 >> 172.21.15.52:0/1026436725 conn(0x7ffa1c067950 msgr2=0x7ffa1c0c9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 shutdown_connections 2024-09-10T08:38:56.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.270+0000 7ffa21a00640 1 -- 172.21.15.52:0/1026436725 wait complete. 2024-09-10T08:38:56.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.441+0000 7f14c8000640 1 Processor -- start 2024-09-10T08:38:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.441+0000 7f14c8000640 1 -- start start 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c8000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f14c015eab0 0x7f14c015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c8000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14c0162490 0x7f14c00d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c8000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c015f570 con 0x7f14c00b66b0 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c8000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f14c015f850 con 0x7f14c0162490 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c8000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f14c015fb30 con 0x7f14c015eab0 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f14c0162490 0x7f14c00d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c6000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f14c00b66b0 0x7f14c00b6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56974/0 (socket says 172.21.15.52:56974) 2024-09-10T08:38:56.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c6000640 1 -- 172.21.15.52:0/3023573005 learned_addr learned my addr 172.21.15.52:0/3023573005 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c5600640 1 --2- 172.21.15.52:0/3023573005 >> v2:172.21.15.176:3300/0 conn(0x7f14c015eab0 0x7f14c015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c4c00640 1 -- 172.21.15.52:0/3023573005 >> v2:172.21.15.176:3300/0 conn(0x7f14c015eab0 msgr2=0x7f14c015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c4c00640 1 --2- 172.21.15.52:0/3023573005 >> v2:172.21.15.176:3300/0 conn(0x7f14c015eab0 0x7f14c015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14c4c00640 1 -- 172.21.15.52:0/3023573005 >> v1:172.21.15.52:6789/0 conn(0x7f14c00b66b0 legacy=0x7f14c00b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.443+0000 7f14bfe00640 1 -- 172.21.15.52:0/3023573005 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008175752 0 0) 0x7f14c015f570 con 0x7f14c00b66b0 2024-09-10T08:38:56.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.444+0000 7f14c4c00640 1 -- 172.21.15.52:0/3023573005 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c015fe10 con 0x7f14c0162490 2024-09-10T08:38:56.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.444+0000 7f14c4c00640 1 --2- 172.21.15.52:0/3023573005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00d2c30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f14c00cb8b0 tx=0x7f14ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c97c5182dbc4aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14bfe00640 1 -- 172.21.15.52:0/3023573005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac037070 con 0x7f14c0162490 2024-09-10T08:38:56.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14bfe00640 1 -- 172.21.15.52:0/3023573005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ac032440 con 0x7f14c0162490 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14bfe00640 1 -- 172.21.15.52:0/3023573005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac032810 con 0x7f14c0162490 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 -- 172.21.15.52:0/3023573005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 msgr2=0x7f14c00d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 --2- 172.21.15.52:0/3023573005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00d2c30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f14c00cb8b0 tx=0x7f14ac02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 -- 172.21.15.52:0/3023573005 shutdown_connections 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 --2- 172.21.15.52:0/3023573005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00d2c30 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 --2- 172.21.15.52:0/3023573005 >> v2:172.21.15.176:3300/0 conn(0x7f14c015eab0 0x7f14c015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 -- 172.21.15.52:0/3023573005 >> 172.21.15.52:0/3023573005 conn(0x7f14c00d16d0 msgr2=0x7f14c00d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.445+0000 7f14c8000640 1 -- 172.21.15.52:0/3023573005 shutdown_connections 2024-09-10T08:38:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.446+0000 7f14c8000640 1 -- 172.21.15.52:0/3023573005 wait complete. 2024-09-10T08:38:56.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.447+0000 7f14c8000640 1 Processor -- start 2024-09-10T08:38:56.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.447+0000 7f14c8000640 1 -- start start 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 0x7f14c00c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c015eab0 0x7f14c00ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00d4460 con 0x7f14c0162490 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f14c00d3170 con 0x7f14c015eab0 2024-09-10T08:38:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c8000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f14c00d45e0 con 0x7f14c00b66b0 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52192/0 (socket says 172.21.15.52:52192) 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.448+0000 7f14c6000640 1 -- 172.21.15.52:0/2339893630 learned_addr learned my addr 172.21.15.52:0/2339893630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c5600640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 0x7f14c00c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c4c00640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c015eab0 0x7f14c00ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 -- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 msgr2=0x7f14c00c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 0x7f14c00c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 -- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c015eab0 msgr2=0x7f14c00ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c015eab0 0x7f14c00ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 -- 172.21.15.52:0/2339893630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c014da80 con 0x7f14c0162490 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c5600640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 0x7f14c00c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14c6000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c700 tx=0x7f14b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.449+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8018070 con 0x7f14c0162490 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.450+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b800ce10 con 0x7f14c0162490 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.450+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b800a860 con 0x7f14c0162490 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.450+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c00ab6d0 con 0x7f14c0162490 2024-09-10T08:38:56.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.450+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c014dd20 con 0x7f14c0162490 2024-09-10T08:38:56.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.451+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c00d2500 con 0x7f14c0162490 2024-09-10T08:38:56.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.452+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14b800aa00 con 0x7f14c0162490 2024-09-10T08:38:56.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.452+0000 7f14bd600640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 0x7f14a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.452+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f14b808a230 con 0x7f14c0162490 2024-09-10T08:38:56.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.453+0000 7f14c5600640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 0x7f14a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.453+0000 7f14c5600640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 0x7f14a006e320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f14b4007d90 tx=0x7f14b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.457+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14b8058580 con 0x7f14c0162490 2024-09-10T08:38:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.682+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14c0162960 con 0x7f14c0162490 2024-09-10T08:38:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.683+0000 7f14bd600640 1 -- 172.21.15.52:0/2339893630 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f14b805c880 con 0x7f14c0162490 2024-09-10T08:38:56.682 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:56.682 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:38:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 msgr2=0x7f14a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 0x7f14a006e320 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f14b4007d90 tx=0x7f14b4008040 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 msgr2=0x7f14c00ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c700 tx=0x7f14b800cbc0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 shutdown_connections 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f14a006be60 0x7f14a006e320 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14c0162490 0x7f14c00ce1c0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f14c015eab0 0x7f14c00ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 --2- 172.21.15.52:0/2339893630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f14c00b66b0 0x7f14c00c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 >> 172.21.15.52:0/2339893630 conn(0x7f14c00d16d0 msgr2=0x7f14c00d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 shutdown_connections 2024-09-10T08:38:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.685+0000 7f14c8000640 1 -- 172.21.15.52:0/2339893630 wait complete. 2024-09-10T08:38:56.700 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:38:56.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.857+0000 7fbbeaa00640 1 Processor -- start 2024-09-10T08:38:56.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.858+0000 7fbbeaa00640 1 -- start start 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4073750 0x7fbbe4073b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbeaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbe4164650 0x7fbbe4164b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbeaa00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe40712a0 con 0x7fbbe414c480 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbeaa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe40732c0 con 0x7fbbe4164650 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe4072c70 con 0x7fbbe4073750 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbe8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbe4164650 0x7fbbe4164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbe8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbbe4164650 0x7fbbe4164b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52196/0 (socket says 172.21.15.52:52196) 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbe8a00640 1 -- 172.21.15.52:0/3767794340 learned_addr learned my addr 172.21.15.52:0/3767794340 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbdb400640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4073750 0x7fbbe4073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbe8a00640 1 -- 172.21.15.52:0/3767794340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4073750 msgr2=0x7fbbe4073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.859+0000 7fbbe8a00640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4073750 0x7fbbe4073b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.860+0000 7fbbe8a00640 1 -- 172.21.15.52:0/3767794340 >> v1:172.21.15.176:6789/0 conn(0x7fbbe414c480 legacy=0x7fbbe4163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.860+0000 7fbbe8a00640 1 -- 172.21.15.52:0/3767794340 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe4072f50 con 0x7fbbe4164650 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.860+0000 7fbbe8a00640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4164650 0x7fbbe4164b00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009e50 tx=0x7fbbdc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3e11f9d9247cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbe3400640 1 -- 172.21.15.52:0/3767794340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc036070 con 0x7fbbe4164650 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbe3400640 1 -- 172.21.15.52:0/3767794340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc031600 con 0x7fbbe4164650 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbe3400640 1 -- 172.21.15.52:0/3767794340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0319d0 con 0x7fbbe4164650 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 -- 172.21.15.52:0/3767794340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4164650 msgr2=0x7fbbe4164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4164650 0x7fbbe4164b00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009e50 tx=0x7fbbdc02a710 comp rx=0 tx=0).stop 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 -- 172.21.15.52:0/3767794340 shutdown_connections 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4164650 0x7fbbe4164b00 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/3767794340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4073750 0x7fbbe4073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 -- 172.21.15.52:0/3767794340 >> 172.21.15.52:0/3767794340 conn(0x7fbbe40ccec0 msgr2=0x7fbbe40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:56.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 -- 172.21.15.52:0/3767794340 shutdown_connections 2024-09-10T08:38:56.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.861+0000 7fbbeaa00640 1 -- 172.21.15.52:0/3767794340 wait complete. 2024-09-10T08:38:56.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.863+0000 7fbbeaa00640 1 Processor -- start 2024-09-10T08:38:56.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.863+0000 7fbbeaa00640 1 -- start start 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 0x7fbbe414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4164650 0x7fbbe414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe40b6350 con 0x7fbbe4073750 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4071580 con 0x7fbbe414c480 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbeaa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe40b64d0 con 0x7fbbe4164650 2024-09-10T08:38:56.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.864+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52206/0 (socket says 172.21.15.52:52206) 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 -- 172.21.15.52:0/2470975037 learned_addr learned my addr 172.21.15.52:0/2470975037 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbdb400640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 0x7fbbe414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe8a00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4164650 0x7fbbe414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 -- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4164650 msgr2=0x7fbbe414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4164650 0x7fbbe414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 -- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 msgr2=0x7fbbe414a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 0x7fbbe414a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 -- 172.21.15.52:0/2470975037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe4140d00 con 0x7fbbe4073750 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbdb400640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 0x7fbbe414a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe3e00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c430 tx=0x7fbbd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.865+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40052d0 con 0x7fbbe4073750 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.866+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd4005490 con 0x7fbbe4073750 2024-09-10T08:38:56.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.866+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe4140fe0 con 0x7fbbe4073750 2024-09-10T08:38:56.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.866+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4007260 con 0x7fbbe4073750 2024-09-10T08:38:56.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.866+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41415a0 con 0x7fbbe4073750 2024-09-10T08:38:56.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.867+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe4164e60 con 0x7fbbe4073750 2024-09-10T08:38:56.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.868+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbd4007400 con 0x7fbbe4073750 2024-09-10T08:38:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.868+0000 7fbbe0c00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 0x7fbbc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.868+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fbbd408a2d0 con 0x7fbbe4073750 2024-09-10T08:38:56.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.869+0000 7fbbdb400640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 0x7fbbc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:56.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.870+0000 7fbbdb400640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 0x7fbbc006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbbe41fca70 tx=0x7fbbcc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:56.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:56.873+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbe4164e60 con 0x7fbbe4073750 2024-09-10T08:38:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.124+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbbe4167000 con 0x7fbbe4073750 2024-09-10T08:38:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.125+0000 7fbbe0c00640 1 -- 172.21.15.52:0/2470975037 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fbbe4167000 con 0x7fbbe4073750 2024-09-10T08:38:57.124 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:57.124 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":636,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1012,"data_bytes":1038458255,"bytes_used":2445393920,"bytes_avail":770648719360,"bytes_total":773094113280,"write_bytes_sec":64704135,"read_op_per_sec":0,"write_op_per_sec":65},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-10T08:38:09.594616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 msgr2=0x7fbbc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 0x7fbbc006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbbe41fca70 tx=0x7fbbcc009190 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 msgr2=0x7fbbe413d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c430 tx=0x7fbbd400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 shutdown_connections 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbbc006be30 0x7fbbc006e2f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbe4164650 0x7fbbe414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbe414c480 0x7fbbe414a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 --2- 172.21.15.52:0/2470975037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbe4073750 0x7fbbe413d950 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 >> 172.21.15.52:0/2470975037 conn(0x7fbbe40ccec0 msgr2=0x7fbbe40cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 shutdown_connections 2024-09-10T08:38:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:57.127+0000 7fbbeaa00640 1 -- 172.21.15.52:0/2470975037 wait complete. 2024-09-10T08:38:57.143 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:38:58.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:38:58.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.313+0000 7f04b1a00640 1 Processor -- start 2024-09-10T08:38:58.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.314+0000 7f04b1a00640 1 -- start start 2024-09-10T08:38:58.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04b1a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f04ac15e870 0x7f04ac0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04b1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04ac072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04b1a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04ac15f6e0 con 0x7f04ac0b2170 2024-09-10T08:38:58.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04b1a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac071c00 con 0x7f04ac15e870 2024-09-10T08:38:58.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04b1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac15f9c0 con 0x7f04ac0733e0 2024-09-10T08:38:58.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04a3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f04ac0b2170 0x7f04ac072cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56990/0 (socket says 172.21.15.52:56990) 2024-09-10T08:38:58.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.315+0000 7f04a3400640 1 -- 172.21.15.52:0/701542344 learned_addr learned my addr 172.21.15.52:0/701542344 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:58.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04b1000640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04ac072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04abe00640 1 --2- 172.21.15.52:0/701542344 >> v2:172.21.15.176:3300/0 conn(0x7f04ac15e870 0x7f04ac0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2881841876 0 0) 0x7f04ac15f6e0 con 0x7f04ac0b2170 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0490003520 con 0x7f04ac0b2170 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 802147084 0 0) 0x7f0490003520 con 0x7f04ac0b2170 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 msgr2=0x7f04ac072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04ac072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 >> v2:172.21.15.176:3300/0 conn(0x7f04ac15e870 msgr2=0x7f04ac0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 --2- 172.21.15.52:0/701542344 >> v2:172.21.15.176:3300/0 conn(0x7f04ac15e870 0x7f04ac0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac071890 con 0x7f04ac0b2170 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f0494001690 con 0x7f04ac0b2170 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 >> v1:172.21.15.52:6789/0 conn(0x7f04ac0b2170 legacy=0x7f04ac072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0490003f80 0x7f0490004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490004d40 0x7f04900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac071c00 con 0x7f0490003f80 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac15f9c0 con 0x7f0490004d40 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.316+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f049000baf0 con 0x7f04ac0733e0 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0490003f80 0x7f0490004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04abe00640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04b1000640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490004d40 0x7f04900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 -- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 msgr2=0x7f04900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0733e0 0x7f04900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 -- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490004d40 msgr2=0x7f04900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490004d40 0x7f04900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04a3400640 1 -- 172.21.15.52:0/701542344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0490003520 con 0x7f0490003f80 2024-09-10T08:38:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.317+0000 7f04b1000640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490004d40 0x7f04900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:58.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.318+0000 7f04a3400640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0490003f80 0x7f0490004800 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f049400c160 tx=0x7f0490005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772f60b832322155 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.318+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007c80 con 0x7f0490003f80 2024-09-10T08:38:58.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.318+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494005ad0 con 0x7f0490003f80 2024-09-10T08:38:58.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.318+0000 7f04ab400640 1 -- 172.21.15.52:0/701542344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007070 con 0x7f0490003f80 2024-09-10T08:38:58.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 -- 172.21.15.52:0/701542344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0490003f80 msgr2=0x7f0490004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 --2- 172.21.15.52:0/701542344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0490003f80 0x7f0490004800 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f049400c160 tx=0x7f0490005830 comp rx=0 tx=0).stop 2024-09-10T08:38:58.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1000640 1 -- 172.21.15.52:0/701542344 reap_dead start 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 -- 172.21.15.52:0/701542344 shutdown_connections 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 -- 172.21.15.52:0/701542344 >> 172.21.15.52:0/701542344 conn(0x7f04ac0b0640 msgr2=0x7f04ac0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 -- 172.21.15.52:0/701542344 shutdown_connections 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.319+0000 7f04b1a00640 1 -- 172.21.15.52:0/701542344 wait complete. 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.321+0000 7f04b1a00640 1 Processor -- start 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.321+0000 7f04b1a00640 1 -- start start 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490003f80 0x7f04ac1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 0x7f04ac0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac0aedb0 con 0x7f04ac161da0 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac068030 con 0x7f0490003f80 2024-09-10T08:38:58.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac0aef30 con 0x7f04ac0b10a0 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52226/0 (socket says 172.21.15.52:52226) 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 -- 172.21.15.52:0/2776920399 learned_addr learned my addr 172.21.15.52:0/2776920399 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04abe00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490003f80 0x7f04ac1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1000640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 0x7f04ac0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 -- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 msgr2=0x7f04ac0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 0x7f04ac0b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 -- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490003f80 msgr2=0x7f04ac1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490003f80 0x7f04ac1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04a3400640 1 -- 172.21.15.52:0/2776920399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac162910 con 0x7f04ac161da0 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.322+0000 7f04b1000640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 0x7f04ac0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:38:58.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04a3400640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f049402ad30 tx=0x7f04ac071b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494041020 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494001450 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac156b30 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007070 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.323+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac1605b0 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.324+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac06f2a0 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.325+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0494044020 con 0x7f04ac161da0 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.326+0000 7f04a8c00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 0x7f048806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.326+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f04940ab100 con 0x7f04ac161da0 2024-09-10T08:38:58.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.327+0000 7f04abe00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 0x7f048806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.327+0000 7f04abe00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 0x7f048806e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f04ac1e94e0 tx=0x7f049c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.330+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0494079b30 con 0x7f04ac161da0 2024-09-10T08:38:58.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.551+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04ac0b0b80 con 0x7f04ac161da0 2024-09-10T08:38:58.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.552+0000 7f04a8c00640 1 -- 172.21.15.52:0/2776920399 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f0494079430 con 0x7f04ac161da0 2024-09-10T08:38:58.551 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:58.551 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:38:58.551 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 msgr2=0x7f048806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 0x7f048806e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f04ac1e94e0 tx=0x7f049c009190 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 msgr2=0x7f04ac162220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f049402ad30 tx=0x7f04ac071b70 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 shutdown_connections 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f048806be30 0x7f048806e2f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04ac0b10a0 0x7f04ac0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ac161da0 0x7f04ac162220 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 --2- 172.21.15.52:0/2776920399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0490003f80 0x7f04ac1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 >> 172.21.15.52:0/2776920399 conn(0x7f04ac0b0640 msgr2=0x7f04ac0b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:58.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 shutdown_connections 2024-09-10T08:38:58.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.554+0000 7f04b1a00640 1 -- 172.21.15.52:0/2776920399 wait complete. 2024-09-10T08:38:58.569 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:38:58.569 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:38:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.725+0000 7f7e1ca00640 1 Processor -- start 2024-09-10T08:38:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.725+0000 7f7e1ca00640 1 -- start start 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.726+0000 7f7e1ca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7e1806d730 0x7f7e180ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.726+0000 7f7e1ca00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e180ce5f0 con 0x7f7e18071430 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.726+0000 7f7e1ca00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e180ce8b0 con 0x7f7e180733f0 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.726+0000 7f7e1ca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1806db70 con 0x7f7e1806d730 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e17e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7e18071430 0x7f7e18071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56992/0 (socket says 172.21.15.52:56992) 2024-09-10T08:38:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e17e00640 1 -- 172.21.15.52:0/2843376988 learned_addr learned my addr 172.21.15.52:0/2843376988 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e0fe00640 1 --2- 172.21.15.52:0/2843376988 >> v2:172.21.15.176:3300/0 conn(0x7f7e1806d730 0x7f7e180ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 317019527 0 0) 0x7f7e180ce5f0 con 0x7f7e18071430 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dfc003520 con 0x7f7e18071430 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696592168 0 0) 0x7f7dfc003520 con 0x7f7e18071430 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e0fe00640 1 -- 172.21.15.52:0/2843376988 >> v1:172.21.15.176:6789/0 conn(0x7f7e180733f0 legacy=0x7f7e180737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e0fe00640 1 -- 172.21.15.52:0/2843376988 >> v1:172.21.15.52:6789/0 conn(0x7f7e18071430 legacy=0x7f7e18071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.727+0000 7f7e0fe00640 1 -- 172.21.15.52:0/2843376988 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e180ceb90 con 0x7f7e1806d730 2024-09-10T08:38:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.728+0000 7f7e0fe00640 1 --2- 172.21.15.52:0/2843376988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e180ce0b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7e1806dcf0 tx=0x7f7e0002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=531af70752359a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00037070 con 0x7f7e1806d730 2024-09-10T08:38:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0002ac30 con 0x7f7e1806d730 2024-09-10T08:38:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e16a00640 1 -- 172.21.15.52:0/2843376988 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e100019f0 con 0x7f7e1806d730 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 -- 172.21.15.52:0/2843376988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 msgr2=0x7f7e180ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/2843376988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e180ce0b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7e1806dcf0 tx=0x7f7e0002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 -- 172.21.15.52:0/2843376988 shutdown_connections 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/2843376988 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e180ce0b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 -- 172.21.15.52:0/2843376988 >> 172.21.15.52:0/2843376988 conn(0x7f7e1806bc10 msgr2=0x7f7e1806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 -- 172.21.15.52:0/2843376988 shutdown_connections 2024-09-10T08:38:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.729+0000 7f7e1ca00640 1 -- 172.21.15.52:0/2843376988 wait complete. 2024-09-10T08:38:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.731+0000 7f7e1ca00640 1 Processor -- start 2024-09-10T08:38:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.731+0000 7f7e1ca00640 1 -- start start 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e1813b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e18071430 0x7f7e18156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e180cf430 con 0x7f7e180733f0 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e180cf150 con 0x7f7e1806d730 2024-09-10T08:38:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e1ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7e18146060 con 0x7f7e18071430 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e17e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52242/0 (socket says 172.21.15.52:52242) 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.732+0000 7f7e17e00640 1 -- 172.21.15.52:0/3973802259 learned_addr learned my addr 172.21.15.52:0/3973802259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e0fe00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e18071430 0x7f7e18156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17400640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e1813b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 -- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e18071430 msgr2=0x7f7e18156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e18071430 0x7f7e18156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 -- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 msgr2=0x7f7e1813b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e1813b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 -- 172.21.15.52:0/3973802259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1813bc60 con 0x7f7e180733f0 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17400640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e1813b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:38:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e17e00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7e10001b60 tx=0x7f7e1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10017070 con 0x7f7e180733f0 2024-09-10T08:38:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e10012400 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e100127b0 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1813bf40 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.733+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1813c500 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.734+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e180ce0b0 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.735+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e1001a070 con 0x7f7e180733f0 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.736+0000 7f7e0f400640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 0x7f7df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:38:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.736+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7e1008ace0 con 0x7f7e180733f0 2024-09-10T08:38:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.737+0000 7f7e17400640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 0x7f7df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:38:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.737+0000 7f7e17400640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 0x7f7df406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000f60 tx=0x7f7e08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:38:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.740+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e10059030 con 0x7f7e180733f0 2024-09-10T08:38:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.994+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7e181451e0 con 0x7f7e180733f0 2024-09-10T08:38:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.995+0000 7f7e0f400640 1 -- 172.21.15.52:0/3973802259 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f7e1005d330 con 0x7f7e180733f0 2024-09-10T08:38:58.994 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:38:58.995 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":638,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1012,"data_bytes":1038458255,"bytes_used":2445393920,"bytes_avail":770648719360,"bytes_total":773094113280,"write_bytes_sec":43338633,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-10T08:38:09.594616+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 msgr2=0x7f7df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 0x7f7df406e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000f60 tx=0x7f7e08009040 comp rx=0 tx=0).stop 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 msgr2=0x7f7e1813ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f7e10001b60 tx=0x7f7e1000a430 comp rx=0 tx=0).stop 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 shutdown_connections 2024-09-10T08:38:58.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7df406be30 0x7f7df406e2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e180733f0 0x7f7e1813ad20 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7e18071430 0x7f7e18156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 --2- 172.21.15.52:0/3973802259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e1806d730 0x7f7e1813b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.997+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 >> 172.21.15.52:0/3973802259 conn(0x7f7e1806bc10 msgr2=0x7f7e180cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.998+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 shutdown_connections 2024-09-10T08:38:58.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:38:58.998+0000 7f7e1ca00640 1 -- 172.21.15.52:0/3973802259 wait complete. 2024-09-10T08:38:59.013 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:39:00.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.175+0000 7f965c200640 1 Processor -- start 2024-09-10T08:39:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.175+0000 7f965c200640 1 -- start start 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.176+0000 7f965c200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f96540b2d40 0x7f965406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.176+0000 7f965c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f965406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f965c200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9654071180 con 0x7f965415bcf0 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f965c200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9654071ab0 con 0x7f96540b2d40 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f965c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9654071460 con 0x7f965413eb20 2024-09-10T08:39:00.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f965a200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f965415bcf0 0x7f965415c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57008/0 (socket says 172.21.15.52:57008) 2024-09-10T08:39:00.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f965a200640 1 -- 172.21.15.52:0/2638043876 learned_addr learned my addr 172.21.15.52:0/2638043876 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:00.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f9659800640 1 --2- 172.21.15.52:0/2638043876 >> v2:172.21.15.176:3300/0 conn(0x7f96540b2d40 0x7f965406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579038440 0 0) 0x7f9654071180 con 0x7f965415bcf0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f9658e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f965406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.177+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f963c005730 con 0x7f965415bcf0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3432548114 0 0) 0x7f963c005730 con 0x7f965415bcf0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 msgr2=0x7f965406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f965406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 >> v2:172.21.15.176:3300/0 conn(0x7f96540b2d40 msgr2=0x7f965406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 --2- 172.21.15.52:0/2638043876 >> v2:172.21.15.176:3300/0 conn(0x7f96540b2d40 0x7f965406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9654071740 con 0x7f965415bcf0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f964c0019f0 con 0x7f965415bcf0 2024-09-10T08:39:00.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 >> v1:172.21.15.52:6789/0 conn(0x7f965415bcf0 legacy=0x7f965415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f963c005bc0 0x7f963c006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f963c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f963c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9654071ab0 con 0x7f963c006f50 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9654071460 con 0x7f963c005bc0 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f963c00dbd0 con 0x7f965413eb20 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f965a200640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f963c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9658e00640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f963c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.178+0000 7f9659800640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f963c005bc0 0x7f963c006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.179+0000 7f965a200640 1 -- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 msgr2=0x7f963c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.179+0000 7f965a200640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f965413eb20 0x7f963c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.179+0000 7f965a200640 1 -- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f963c005bc0 msgr2=0x7f963c006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.179+0000 7f965a200640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f963c005bc0 0x7f963c006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.179+0000 7f965a200640 1 -- 172.21.15.52:0/2638043876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c005730 con 0x7f963c006f50 2024-09-10T08:39:00.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965a200640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f963c0073d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f964c00a7b0 tx=0x7f963c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eff016a13c4fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c00a3d0 con 0x7f963c006f50 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c02f070 con 0x7f963c006f50 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f9653e00640 1 -- 172.21.15.52:0/2638043876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c02bc20 con 0x7f963c006f50 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 -- 172.21.15.52:0/2638043876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 msgr2=0x7f963c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 --2- 172.21.15.52:0/2638043876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f963c0073d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f964c00a7b0 tx=0x7f963c007a40 comp rx=0 tx=0).stop 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965a200640 1 -- 172.21.15.52:0/2638043876 reap_dead start 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 -- 172.21.15.52:0/2638043876 shutdown_connections 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 -- 172.21.15.52:0/2638043876 >> 172.21.15.52:0/2638043876 conn(0x7f96540ccec0 msgr2=0x7f96540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 -- 172.21.15.52:0/2638043876 shutdown_connections 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.180+0000 7f965c200640 1 -- 172.21.15.52:0/2638043876 wait complete. 2024-09-10T08:39:00.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.182+0000 7f965c200640 1 Processor -- start 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.182+0000 7f965c200640 1 -- start start 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96541f4020 0x7f96541f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96540cef40 0x7f965413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f965406c4e0 con 0x7f963c006f50 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f965406c360 con 0x7f96541f4020 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f965c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9654071f40 con 0x7f96540cef40 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f9659800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f9659800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52258/0 (socket says 172.21.15.52:52258) 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.183+0000 7f9659800640 1 -- 172.21.15.52:0/2911949923 learned_addr learned my addr 172.21.15.52:0/2911949923 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f965a200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96540cef40 0x7f965413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9658e00640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96541f4020 0x7f96541f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 -- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96540cef40 msgr2=0x7f965413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96540cef40 0x7f965413dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 -- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96541f4020 msgr2=0x7f96541f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96541f4020 0x7f96541f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 -- 172.21.15.52:0/2911949923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96541f4480 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9659800640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f9648011960 tx=0x7f9648011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964800faf0 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964800fc90 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648014440 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.184+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965415f900 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.185+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541f06d0 con 0x7f963c006f50 2024-09-10T08:39:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.185+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965406bc10 con 0x7f963c006f50 2024-09-10T08:39:00.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.186+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9648012040 con 0x7f963c006f50 2024-09-10T08:39:00.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.187+0000 7f9651600640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 0x7f963406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.187+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f964808b600 con 0x7f963c006f50 2024-09-10T08:39:00.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.188+0000 7f9658e00640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 0x7f963406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.189+0000 7f9658e00640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 0x7f963406e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f96540b6420 tx=0x7f9640008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.192+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9648019030 con 0x7f963c006f50 2024-09-10T08:39:00.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.411+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96540cfdc0 con 0x7f963c006f50 2024-09-10T08:39:00.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.412+0000 7f9651600640 1 -- 172.21.15.52:0/2911949923 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f9648059f10 con 0x7f963c006f50 2024-09-10T08:39:00.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:00.413 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.414+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 msgr2=0x7f963406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.414+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 0x7f963406e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f96540b6420 tx=0x7f9640008040 comp rx=0 tx=0).stop 2024-09-10T08:39:00.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.414+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 msgr2=0x7f965415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.414+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f9648011960 tx=0x7f9648011e20 comp rx=0 tx=0).stop 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 shutdown_connections 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f963406be30 0x7f963406e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96540cef40 0x7f965413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96541f4020 0x7f96541f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 --2- 172.21.15.52:0/2911949923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f963c006f50 0x7f965415f220 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 >> 172.21.15.52:0/2911949923 conn(0x7f96540ccec0 msgr2=0x7f96540d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 shutdown_connections 2024-09-10T08:39:00.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.415+0000 7f965c200640 1 -- 172.21.15.52:0/2911949923 wait complete. 2024-09-10T08:39:00.431 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:00.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:00.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.586+0000 7f3832a00640 1 Processor -- start 2024-09-10T08:39:00.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.586+0000 7f3832a00640 1 -- start start 2024-09-10T08:39:00.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f382c147e80 0x7f382c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c148260 0x7f382c0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f382c06bc10 0x7f382c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f382c06c5b0 con 0x7f382c147e80 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f382c074200 con 0x7f382c06bc10 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f3832a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f382c0b3e40 con 0x7f382c148260 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.587+0000 7f382be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f382c147e80 0x7f382c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f382c147e80 0x7f382c070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52264/0 (socket says 172.21.15.52:52264) 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 -- 172.21.15.52:0/744830874 learned_addr learned my addr 172.21.15.52:0/744830874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f3830a00640 1 --2- 172.21.15.52:0/744830874 >> v2:172.21.15.176:3300/0 conn(0x7f382c06bc10 0x7f382c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382b400640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c148260 0x7f382c0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 -- 172.21.15.52:0/744830874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c148260 msgr2=0x7f382c0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c148260 0x7f382c0714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 -- 172.21.15.52:0/744830874 >> v2:172.21.15.176:3300/0 conn(0x7f382c06bc10 msgr2=0x7f382c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 --2- 172.21.15.52:0/744830874 >> v2:172.21.15.176:3300/0 conn(0x7f382c06bc10 0x7f382c06c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.588+0000 7f382be00640 1 -- 172.21.15.52:0/744830874 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c071b30 con 0x7f382c147e80 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.589+0000 7f382be00640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c147e80 0x7f382c070f70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f382c069ca0 tx=0x7f381c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255d8aa7aafe748b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.589+0000 7f382aa00640 1 -- 172.21.15.52:0/744830874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c037070 con 0x7f382c147e80 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.589+0000 7f382aa00640 1 -- 172.21.15.52:0/744830874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381c032440 con 0x7f382c147e80 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.589+0000 7f382aa00640 1 -- 172.21.15.52:0/744830874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c032810 con 0x7f382c147e80 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 -- 172.21.15.52:0/744830874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c147e80 msgr2=0x7f382c070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c147e80 0x7f382c070f70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f382c069ca0 tx=0x7f381c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 -- 172.21.15.52:0/744830874 shutdown_connections 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 --2- 172.21.15.52:0/744830874 >> v2:172.21.15.176:3300/0 conn(0x7f382c06bc10 0x7f382c06c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c148260 0x7f382c0714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 --2- 172.21.15.52:0/744830874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c147e80 0x7f382c070f70 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 -- 172.21.15.52:0/744830874 >> 172.21.15.52:0/744830874 conn(0x7f382c0ccec0 msgr2=0x7f382c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 -- 172.21.15.52:0/744830874 shutdown_connections 2024-09-10T08:39:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.590+0000 7f3832a00640 1 -- 172.21.15.52:0/744830874 wait complete. 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.592+0000 7f3832a00640 1 Processor -- start 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.592+0000 7f3832a00640 1 -- start start 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.592+0000 7f3832a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 0x7f382c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3832a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 0x7f382c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3832a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3832a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0b3ad0 con 0x7f382c148260 2024-09-10T08:39:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3832a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0b37f0 con 0x7f382c06bc10 2024-09-10T08:39:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3832a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f382c1623c0 con 0x7f382c147e80 2024-09-10T08:39:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52268/0 (socket says 172.21.15.52:52268) 2024-09-10T08:39:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 -- 172.21.15.52:0/564277598 learned_addr learned my addr 172.21.15.52:0/564277598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 -- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 msgr2=0x7f382c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f382b400640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 0x7f382c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f382be00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 0x7f382c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 0x7f382c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 -- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 msgr2=0x7f382c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 0x7f382c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f3830a00640 1 -- 172.21.15.52:0/564277598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c0c9970 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f382be00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 0x7f382c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.593+0000 7f382b400640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 0x7f382c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3830a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f382400eed0 tx=0x7f382400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824018020 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3824014400 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240147f0 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c0c9c50 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.594+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c0ca210 con 0x7f382c148260 2024-09-10T08:39:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.595+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c06c070 con 0x7f382c148260 2024-09-10T08:39:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.596+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3824005d10 con 0x7f382c148260 2024-09-10T08:39:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.597+0000 7f3823e00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.597+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f382408b8d0 con 0x7f382c148260 2024-09-10T08:39:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.597+0000 7f382be00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.598+0000 7f382be00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 0x7f380c06e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f381c034000 tx=0x7f381c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:00.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.601+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3824022030 con 0x7f382c148260 2024-09-10T08:39:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.857+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f382c15eaf0 con 0x7f382c148260 2024-09-10T08:39:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.857+0000 7f3823e00640 1 -- 172.21.15.52:0/564277598 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f382405a1e0 con 0x7f382c148260 2024-09-10T08:39:00.858 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:00.858 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":640,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1017,"data_bytes":1044067027,"bytes_used":2457292800,"bytes_avail":770636820480,"bytes_total":773094113280,"write_bytes_sec":43806831,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.859+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 msgr2=0x7f380c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.859+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 0x7f380c06e2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f381c034000 tx=0x7f381c02e000 comp rx=0 tx=0).stop 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.859+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 msgr2=0x7f382c13df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.859+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f382400eed0 tx=0x7f382400b480 comp rx=0 tx=0).stop 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 shutdown_connections 2024-09-10T08:39:00.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f380c06be30 0x7f380c06e2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f382c148260 0x7f382c13df20 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f382c147e80 0x7f382c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 --2- 172.21.15.52:0/564277598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f382c06bc10 0x7f382c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 >> 172.21.15.52:0/564277598 conn(0x7f382c0ccec0 msgr2=0x7f382c161b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 shutdown_connections 2024-09-10T08:39:00.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:00.860+0000 7f3832a00640 1 -- 172.21.15.52:0/564277598 wait complete. 2024-09-10T08:39:00.876 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:00.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:00.876 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-10T08:39:01.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.034+0000 7fc9c7200640 1 Processor -- start 2024-09-10T08:39:01.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.034+0000 7fc9c7200640 1 -- start start 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c7200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c7200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc9c00b7c10 0x7fc9c00b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c7200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c00d3950 con 0x7fc9c00b63b0 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c7200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c00d3c30 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c7200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c00d3f10 con 0x7fc9c00b7c10 2024-09-10T08:39:01.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c5e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c5e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52282/0 (socket says 172.21.15.52:52282) 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.035+0000 7fc9c5e00640 1 -- 172.21.15.52:0/554849303 learned_addr learned my addr 172.21.15.52:0/554849303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.036+0000 7fc9c6800640 1 --2- 172.21.15.52:0/554849303 >> v2:172.21.15.176:3300/0 conn(0x7fc9c00b7c10 0x7fc9c00b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.036+0000 7fc9c5e00640 1 -- 172.21.15.52:0/554849303 >> v2:172.21.15.176:3300/0 conn(0x7fc9c00b7c10 msgr2=0x7fc9c00b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.036+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/554849303 >> v2:172.21.15.176:3300/0 conn(0x7fc9c00b7c10 0x7fc9c00b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.036+0000 7fc9c5e00640 1 -- 172.21.15.52:0/554849303 >> v1:172.21.15.176:6789/0 conn(0x7fc9c00b63b0 legacy=0x7fc9c00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.036+0000 7fc9c5e00640 1 -- 172.21.15.52:0/554849303 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00d41f0 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.037+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/554849303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ceb30 tx=0x7fc9b402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f107222255d368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.037+0000 7fc9c4a00640 1 -- 172.21.15.52:0/554849303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4037070 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.037+0000 7fc9c4a00640 1 -- 172.21.15.52:0/554849303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b402ae50 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.037+0000 7fc9c4a00640 1 -- 172.21.15.52:0/554849303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4032860 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 -- 172.21.15.52:0/554849303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 msgr2=0x7fc9c00d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 --2- 172.21.15.52:0/554849303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ceb30 tx=0x7fc9b402a300 comp rx=0 tx=0).stop 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 -- 172.21.15.52:0/554849303 shutdown_connections 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 --2- 172.21.15.52:0/554849303 >> v2:172.21.15.176:3300/0 conn(0x7fc9c00b7c10 0x7fc9c00b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 --2- 172.21.15.52:0/554849303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00d32c0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 -- 172.21.15.52:0/554849303 >> 172.21.15.52:0/554849303 conn(0x7fc9c00d0fd0 msgr2=0x7fc9c00d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 -- 172.21.15.52:0/554849303 shutdown_connections 2024-09-10T08:39:01.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.038+0000 7fc9c7200640 1 -- 172.21.15.52:0/554849303 wait complete. 2024-09-10T08:39:01.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.039+0000 7fc9c7200640 1 Processor -- start 2024-09-10T08:39:01.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.040+0000 7fc9c7200640 1 -- start start 2024-09-10T08:39:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.040+0000 7fc9c7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.040+0000 7fc9c7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9c00b63b0 0x7fc9c015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.040+0000 7fc9c7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9c00b7c10 0x7fc9c00b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00b6950 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00b67d0 con 0x7fc9c00b63b0 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c015e7f0 con 0x7fc9c00b7c10 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52284/0 (socket says 172.21.15.52:52284) 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 -- 172.21.15.52:0/1829213636 learned_addr learned my addr 172.21.15.52:0/1829213636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 -- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9c00b7c10 msgr2=0x7fc9c00b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9c00b7c10 0x7fc9c00b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 -- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9c00b63b0 msgr2=0x7fc9c015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9c00b63b0 0x7fc9c015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 -- 172.21.15.52:0/1829213636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00cbd80 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.041+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.042+0000 7fc9ba000640 1 -- 172.21.15.52:0/1829213636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4041020 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.042+0000 7fc9ba000640 1 -- 172.21.15.52:0/1829213636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b403c670 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.042+0000 7fc9ba000640 1 -- 172.21.15.52:0/1829213636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4037040 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.042+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c00cc060 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.042+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c00cc620 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.044+0000 7fc9ba000640 1 -- 172.21.15.52:0/1829213636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9b4044020 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.045+0000 7fc9ba000640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 0x7fc9a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.045+0000 7fc9ba000640 1 -- 172.21.15.52:0/1829213636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b40ab540 con 0x7fc9c00b5fd0 2024-09-10T08:39:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.045+0000 7fc9c5400640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 0x7fc9a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.045+0000 7fc9cb69b740 1 Processor -- start 2024-09-10T08:39:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 -- start start 2024-09-10T08:39:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9c5400640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 0x7fc9a406e320 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000f60 tx=0x7fc9b00079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087ec50 0x564db08c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087c410 0x564db087f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564db0845cf0 con 0x564db08803e0 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564db07e17f0 con 0x564db087ec50 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.046+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564db0789800 con 0x564db087c410 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52288/0 (socket says 172.21.15.52:52288) 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 -- 172.21.15.52:0/3753290443 learned_addr learned my addr 172.21.15.52:0/3753290443 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c5400640 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087c410 0x564db087f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087ec50 0x564db08c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 -- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087c410 msgr2=0x564db087f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087c410 0x564db087f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 -- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087ec50 msgr2=0x564db08c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087ec50 0x564db08c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 -- 172.21.15.52:0/3753290443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db05be7d0 con 0x564db08803e0 2024-09-10T08:39:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.047+0000 7fc9c6800640 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007360 tx=0x7fc9bc007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8409150a506685de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9ae600640 1 -- 172.21.15.52:0/3753290443 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc019070 con 0x564db08803e0 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9ae600640 1 -- 172.21.15.52:0/3753290443 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc012710 con 0x564db08803e0 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9ae600640 1 -- 172.21.15.52:0/3753290443 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc012ae0 con 0x564db08803e0 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3753290443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 msgr2=0x564db0879240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc007360 tx=0x7fc9bc007820 comp rx=0 tx=0).stop 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3753290443 shutdown_connections 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db0879240 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087c410 0x564db087f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3753290443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087ec50 0x564db08c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3753290443 >> 172.21.15.52:0/3753290443 conn(0x564db087b410 msgr2=0x564db08c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3753290443 shutdown_connections 2024-09-10T08:39:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.048+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3753290443 wait complete. 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.049+0000 7fc9cb69b740 1 -- start start 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.049+0000 7fc9cb69b740 1 Processor -- start 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087ec50 0x564db089d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564db076a750 con 0x564db08803e0 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564db07dd7b0 con 0x564db087d6b0 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564db087a8b0 con 0x564db087ec50 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9cb69b740 10 client.0 _ll_register_callbacks cb 0x564db04f3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.050+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52302/0 (socket says 172.21.15.52:52302) 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 -- 172.21.15.52:0/3708198258 learned_addr learned my addr 172.21.15.52:0/3708198258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087ec50 0x564db089d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 -- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087ec50 msgr2=0x564db089d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087ec50 0x564db089d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 -- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 msgr2=0x564db089f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 -- 172.21.15.52:0/3708198258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db04b40f0 con 0x564db08803e0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c6800640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9c5400640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0013660 tx=0x7fc9b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd8a926d53298c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.051+0000 7fc9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00035f0 con 0x564db08803e0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9bc012710 con 0x564db08803e0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b0003790 con 0x564db08803e0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fc9b002a050 con 0x564db08803e0 2024-09-10T08:39:01.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 10 client.9006 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x564db061ef60 con 0x564db08803e0 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc012710 con 0x564db08803e0 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fc9b0003990 con 0x564db08803e0 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 10 client.9006 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 10 client.9006 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 20 client.9006 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a7ef0 0x564db08a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 4 client.9006 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.052+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564db07eef20 con 0x564db08a7ef0 2024-09-10T08:39:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.053+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a7ef0 0x564db08a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.054+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a7ef0 0x564db08a82d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958614e95577ecea server_cookie=be589efe5effd3b in_seq=0 out_seq=0 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.054+0000 7fc9a2a00640 10 client.9006 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9a2a00640 1 -- 172.21.15.52:0/3708198258 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564db07eef20 con 0x564db08a7ef0 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9a2a00640 10 client.9006 handle_command_reply: tid=0 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 client.9006 shutdown 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 msgr2=0x564db087d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0013660 tx=0x7fc9b0001120 comp rx=0 tx=0).stop 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 shutdown_connections 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a7ef0 0x564db08a82d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db08803e0 0x564db087d170 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/3708198258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db087ec50 0x564db089d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9a2a00640 0 client.9006 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 >> 172.21.15.52:0/3708198258 conn(0x564db087c410 msgr2=0x564db08c1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 shutdown_connections 2024-09-10T08:39:01.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 1 -- 172.21.15.52:0/3708198258 wait complete. 2024-09-10T08:39:01.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.055+0000 7fc9cb69b740 20 client.9006 trim_cache size 0 max 16384 2024-09-10T08:39:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.073+0000 7fc9cb69b740 1 Processor -- start 2024-09-10T08:39:01.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.073+0000 7fc9cb69b740 1 -- start start 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564db087f780 con 0x564db087ec50 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0200b80 con 0x564db087d6b0 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00ca800 con 0x564db08803e0 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52314/0 (socket says 172.21.15.52:52314) 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9c5400640 1 -- 172.21.15.52:0/1113425349 learned_addr learned my addr 172.21.15.52:0/1113425349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9c6800640 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.074+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 -- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 msgr2=0x564db08c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 -- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 msgr2=0x564db089f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 -- 172.21.15.52:0/1113425349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564db048d1b0 con 0x564db087ec50 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9c5400640 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001de0 tx=0x7fc9b0016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b8366c1f1b6663 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9adc00640 1 -- 172.21.15.52:0/1113425349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0033070 con 0x564db087ec50 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9adc00640 1 -- 172.21.15.52:0/1113425349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0027070 con 0x564db087ec50 2024-09-10T08:39:01.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.075+0000 7fc9adc00640 1 -- 172.21.15.52:0/1113425349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0003a10 con 0x564db087ec50 2024-09-10T08:39:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 -- 172.21.15.52:0/1113425349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 msgr2=0x564db08c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0001de0 tx=0x7fc9b0016070 comp rx=0 tx=0).stop 2024-09-10T08:39:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 -- 172.21.15.52:0/1113425349 shutdown_connections 2024-09-10T08:39:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08c1940 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/1113425349 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db089f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 -- 172.21.15.52:0/1113425349 >> 172.21.15.52:0/1113425349 conn(0x564db087c410 msgr2=0x564db089d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 -- 172.21.15.52:0/1113425349 shutdown_connections 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.076+0000 7fc9cb69b740 1 -- 172.21.15.52:0/1113425349 wait complete. 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.077+0000 7fc9cb69b740 1 -- start start 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.077+0000 7fc9cb69b740 1 Processor -- start 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db08e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00ca1b0 con 0x564db087ec50 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c01f8580 con 0x564db087d6b0 2024-09-10T08:39:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564db0942a50 con 0x564db08803e0 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9cb69b740 10 client.0 _ll_register_callbacks cb 0x7fc9b0014500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52322/0 (socket says 172.21.15.52:52322) 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 -- 172.21.15.52:0/2180144937 learned_addr learned my addr 172.21.15.52:0/2180144937 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db08e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c6800640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 -- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 msgr2=0x564db08c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 -- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 msgr2=0x564db08e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db08e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5400640 1 -- 172.21.15.52:0/2180144937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564db08c1020 con 0x564db087ec50 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db08e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:01.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.078+0000 7fc9c6800640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9c5400640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000fb0 tx=0x7fc9b0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401ae5f7cb756865 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0033040 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b00039a0 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b0027070 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fc9b0043050 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 10 client.9012 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x564db08dddf0 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0027070 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fc9b0046020 con 0x564db087ec50 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 10 client.9012 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 10 client.9012 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.079+0000 7fc9cb69b740 20 client.9012 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a09c0 0x564db08c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9cb69b740 4 client.9012 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T08:39:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x564db07e9270 con 0x564db08a09c0 2024-09-10T08:39:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a09c0 0x564db08c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9c5e00640 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a09c0 0x564db08c7310 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dd81966957c3c0 server_cookie=62283c89f69d892c in_seq=0 out_seq=0 2024-09-10T08:39:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.080+0000 7fc9a2a00640 10 client.9012 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9a2a00640 1 -- 172.21.15.52:0/2180144937 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564db07e9270 con 0x564db08a09c0 2024-09-10T08:39:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9a2a00640 10 client.9012 handle_command_reply: tid=0 2024-09-10T08:39:01.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 client.9012 shutdown 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 msgr2=0x564db08a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000fb0 tx=0x7fc9b0011000 comp rx=0 tx=0).stop 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 shutdown_connections 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x564db08a09c0 0x564db08c7310 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564db08803e0 0x564db08c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564db087ec50 0x564db08a0480 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 --2- 172.21.15.52:0/2180144937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564db087d6b0 0x564db08e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9a2a00640 0 client.9012 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 >> 172.21.15.52:0/2180144937 conn(0x564db087c410 msgr2=0x564db08c1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 shutdown_connections 2024-09-10T08:39:01.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 1 -- 172.21.15.52:0/2180144937 wait complete. 2024-09-10T08:39:01.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.081+0000 7fc9cb69b740 20 client.9012 trim_cache size 0 max 16384 2024-09-10T08:39:01.087 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:01.087 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:39:01.087 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:39:01.087 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 msgr2=0x7fc9a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 0x7fc9a406e320 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0000f60 tx=0x7fc9b00079d0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 msgr2=0x7fc9c00c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4000c00 tx=0x7fc9b40046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 shutdown_connections 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc9a406be60 0x7fc9a406e320 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc9c00b7c10 0x7fc9c00b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9c00b63b0 0x7fc9c015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 --2- 172.21.15.52:0/1829213636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9c00b5fd0 0x7fc9c00c8870 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 >> 172.21.15.52:0/1829213636 conn(0x7fc9c00d0fd0 msgr2=0x7fc9c00b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 shutdown_connections 2024-09-10T08:39:01.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.082+0000 7fc9c7200640 1 -- 172.21.15.52:0/1829213636 wait complete. 2024-09-10T08:39:01.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:01.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T08:39:01.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.255+0000 7fd207200640 1 Processor -- start 2024-09-10T08:39:01.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.255+0000 7fd207200640 1 -- start start 2024-09-10T08:39:01.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd207200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2080ceca0 0x7fd2080cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd207200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd207200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd20815f3a0 con 0x7fd20815e650 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd207200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd2080cf650 con 0x7fd2080ceca0 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd207200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2080735d0 con 0x7fd20815ea30 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd205e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd20815e650 0x7fd208073a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57024/0 (socket says 172.21.15.52:57024) 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd205e00640 1 -- 172.21.15.52:0/1942767711 learned_addr learned my addr 172.21.15.52:0/1942767711 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1942767711 >> v2:172.21.15.52:3300/0 conn(0x7fd2080ceca0 0x7fd2080cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.256+0000 7fd206800640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.257+0000 7fd205400640 1 -- 172.21.15.52:0/1942767711 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018782005 0 0) 0x7fd20815f3a0 con 0x7fd20815e650 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.257+0000 7fd1fd400640 1 -- 172.21.15.52:0/1942767711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 msgr2=0x7fd20815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.257+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.257+0000 7fd1fd400640 1 -- 172.21.15.52:0/1942767711 >> v1:172.21.15.52:6789/0 conn(0x7fd20815e650 legacy=0x7fd208073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.257+0000 7fd1fd400640 1 -- 172.21.15.52:0/1942767711 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd208074170 con 0x7fd2080ceca0 2024-09-10T08:39:01.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.258+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd2080cf110 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097a0 tx=0x7fd1f002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49e7a3aae5dfa75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.258+0000 7fd205400640 1 -- 172.21.15.52:0/1942767711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0037070 con 0x7fd2080ceca0 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.258+0000 7fd205400640 1 -- 172.21.15.52:0/1942767711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f002ae50 con 0x7fd2080ceca0 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.258+0000 7fd205400640 1 -- 172.21.15.52:0/1942767711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0032660 con 0x7fd2080ceca0 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 -- 172.21.15.52:0/1942767711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 msgr2=0x7fd2080cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd2080cf110 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00097a0 tx=0x7fd1f002a100 comp rx=0 tx=0).stop 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 -- 172.21.15.52:0/1942767711 shutdown_connections 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 --2- 172.21.15.52:0/1942767711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd2080cf110 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 -- 172.21.15.52:0/1942767711 >> 172.21.15.52:0/1942767711 conn(0x7fd2080b40d0 msgr2=0x7fd2080b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 -- 172.21.15.52:0/1942767711 shutdown_connections 2024-09-10T08:39:01.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.259+0000 7fd207200640 1 -- 172.21.15.52:0/1942767711 wait complete. 2024-09-10T08:39:01.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.260+0000 7fd207200640 1 Processor -- start 2024-09-10T08:39:01.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.260+0000 7fd207200640 1 -- start start 2024-09-10T08:39:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd20815e650 0x7fd2080b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd208072f80 con 0x7fd2080ceca0 2024-09-10T08:39:01.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd20815f930 con 0x7fd20815e650 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.261+0000 7fd207200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd208073260 con 0x7fd20815ea30 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52334/0 (socket says 172.21.15.52:52334) 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 -- 172.21.15.52:0/1999360855 learned_addr learned my addr 172.21.15.52:0/1999360855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd20815e650 0x7fd2080b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd206800640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 -- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 msgr2=0x7fd20815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 -- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd20815e650 msgr2=0x7fd2080b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd20815e650 0x7fd2080b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 -- 172.21.15.52:0/1999360855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20814e3b0 con 0x7fd2080ceca0 2024-09-10T08:39:01.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.262+0000 7fd205e00640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c4d0 tx=0x7fd1f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.263+0000 7fd1fea00640 1 -- 172.21.15.52:0/1999360855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8018070 con 0x7fd2080ceca0 2024-09-10T08:39:01.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.263+0000 7fd1fea00640 1 -- 172.21.15.52:0/1999360855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8007500 con 0x7fd2080ceca0 2024-09-10T08:39:01.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.263+0000 7fd1fea00640 1 -- 172.21.15.52:0/1999360855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8004a20 con 0x7fd2080ceca0 2024-09-10T08:39:01.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.263+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2080b5db0 con 0x7fd2080ceca0 2024-09-10T08:39:01.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.263+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2080b68e0 con 0x7fd2080ceca0 2024-09-10T08:39:01.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.265+0000 7fd1fea00640 1 -- 172.21.15.52:0/1999360855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1f801b070 con 0x7fd2080ceca0 2024-09-10T08:39:01.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.266+0000 7fd1fea00640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 0x7fd1e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.266+0000 7fd1fea00640 1 -- 172.21.15.52:0/1999360855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f808a1a0 con 0x7fd2080ceca0 2024-09-10T08:39:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.266+0000 7fd20feb0740 1 Processor -- start 2024-09-10T08:39:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.266+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 0x7fd1e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 -- start start 2024-09-10T08:39:01.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 0x7fd1e406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0034000 tx=0x7fd1f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c25a9e0 0x55628c259240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c2a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55628c1c2660 con 0x55628c2744f0 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55628c16a680 con 0x55628c2a4ea0 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.267+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55628c1be620 con 0x55628c25a9e0 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52338/0 (socket says 172.21.15.52:52338) 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 -- 172.21.15.52:0/2166676026 learned_addr learned my addr 172.21.15.52:0/2166676026 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 -- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c25a9e0 msgr2=0x55628c259240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c25a9e0 0x55628c259240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 -- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 msgr2=0x55628c2a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c2a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 -- 172.21.15.52:0/2166676026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55628bf9f7d0 con 0x55628c2744f0 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd205e00640 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8060a60 tx=0x7fd1f8058460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5305d135f9be775e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd1f6a00640 1 -- 172.21.15.52:0/2166676026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8060f90 con 0x55628c2744f0 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.268+0000 7fd1f6a00640 1 -- 172.21.15.52:0/2166676026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8056760 con 0x55628c2744f0 2024-09-10T08:39:01.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd1f6a00640 1 -- 172.21.15.52:0/2166676026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8070170 con 0x55628c2744f0 2024-09-10T08:39:01.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 -- 172.21.15.52:0/2166676026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 msgr2=0x55628c2748d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8060a60 tx=0x7fd1f8058460 comp rx=0 tx=0).stop 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 -- 172.21.15.52:0/2166676026 shutdown_connections 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c2a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c25a9e0 0x55628c259240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2166676026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2748d0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 -- 172.21.15.52:0/2166676026 >> 172.21.15.52:0/2166676026 conn(0x55628c25b410 msgr2=0x55628c2a3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 -- 172.21.15.52:0/2166676026 shutdown_connections 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.269+0000 7fd20feb0740 1 -- 172.21.15.52:0/2166676026 wait complete. 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.270+0000 7fd20feb0740 1 -- start start 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.270+0000 7fd20feb0740 1 Processor -- start 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c299f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c29feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55628c259940 con 0x55628c2a4ea0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55628c14b4c0 con 0x55628c29e900 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55628c259c20 con 0x55628c2744f0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd20feb0740 10 client.0 _ll_register_callbacks cb 0x55628c1bae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd1fd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd1fd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52348/0 (socket says 172.21.15.52:52348) 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd1fd400640 1 -- 172.21.15.52:0/3020061332 learned_addr learned my addr 172.21.15.52:0/3020061332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.271+0000 7fd206800640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c29feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd205e00640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c299f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 -- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 msgr2=0x55628c299f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c299f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 -- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 msgr2=0x55628c29feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c29feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 -- 172.21.15.52:0/3020061332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55628bed53f0 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd205e00640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c299f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1fd400640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098c0 tx=0x7fd1f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14cbf4d861a0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1eb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0037040 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f003e700 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.272+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f8056760 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fd1f003e900 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 10 client.9027 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55628be950f0 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8056760 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fd1f003eaa0 con 0x55628c2a4ea0 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 10 client.9027 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:01.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 10 client.9027 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:01.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 20 client.9027 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:01.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c2b7980 0x55628c2b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 4 client.9027 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:01.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.273+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55628c1cfd90 con 0x55628c2b7980 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.274+0000 7fd205e00640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c2b7980 0x55628c2b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.274+0000 7fd205e00640 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c2b7980 0x55628c2b7d60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64377c975d02904 server_cookie=cf086a2226c178ae in_seq=0 out_seq=0 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.274+0000 7fd1eb400640 10 client.9027 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd1eb400640 1 -- 172.21.15.52:0/3020061332 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55628c1cfd90 con 0x55628c2b7980 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd1eb400640 10 client.9027 handle_command_reply: tid=0 2024-09-10T08:39:01.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 client.9027 shutdown 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 msgr2=0x55628c29e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098c0 tx=0x7fd1f00046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 shutdown_connections 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c2b7980 0x55628c2b7d60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c29feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd1eb400640 0 client.9027 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2a4ea0 0x55628c29e3c0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 --2- 172.21.15.52:0/3020061332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c299f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.275+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 >> 172.21.15.52:0/3020061332 conn(0x55628c25a9e0 msgr2=0x55628c258140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.276+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 shutdown_connections 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.276+0000 7fd20feb0740 1 -- 172.21.15.52:0/3020061332 wait complete. 2024-09-10T08:39:01.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.276+0000 7fd20feb0740 20 client.9027 trim_cache size 0 max 16384 2024-09-10T08:39:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.294+0000 7fd20feb0740 1 Processor -- start 2024-09-10T08:39:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.294+0000 7fd20feb0740 1 -- start start 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.294+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.294+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c2c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 0x55628c2c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd20feb0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd208200990 con 0x55628c2744f0 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2081ffa10 con 0x55628c29e900 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2081fed70 con 0x55628c2a4ea0 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52352/0 (socket says 172.21.15.52:52352) 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 -- 172.21.15.52:0/2750903535 learned_addr learned my addr 172.21.15.52:0/2750903535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd1fd400640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c2c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd206800640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 0x55628c2c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 -- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 msgr2=0x55628c2c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 0x55628c2c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 -- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 msgr2=0x55628c2c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c2c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 -- 172.21.15.52:0/2750903535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55628c1f8b80 con 0x55628c2744f0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd206800640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 0x55628c2c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.295+0000 7fd205e00640 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8060a60 tx=0x7fd1f805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7cadeba90a7981 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd1f6000640 1 -- 172.21.15.52:0/2750903535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8070170 con 0x55628c2744f0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd1f6000640 1 -- 172.21.15.52:0/2750903535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8070310 con 0x55628c2744f0 2024-09-10T08:39:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd1f6000640 1 -- 172.21.15.52:0/2750903535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8004dc0 con 0x55628c2744f0 2024-09-10T08:39:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 -- 172.21.15.52:0/2750903535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 msgr2=0x55628c2998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8060a60 tx=0x7fd1f805c000 comp rx=0 tx=0).stop 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 -- 172.21.15.52:0/2750903535 shutdown_connections 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2a4ea0 0x55628c2c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c29e900 0x55628c2c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 --2- 172.21.15.52:0/2750903535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c2744f0 0x55628c2998e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 -- 172.21.15.52:0/2750903535 >> 172.21.15.52:0/2750903535 conn(0x55628c25a9e0 msgr2=0x55628c28a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 -- 172.21.15.52:0/2750903535 shutdown_connections 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.296+0000 7fd20feb0740 1 -- 172.21.15.52:0/2750903535 wait complete. 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.297+0000 7fd20feb0740 1 -- start start 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.297+0000 7fd20feb0740 1 Processor -- start 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c31c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c29bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55628c28b120 con 0x55628c29e900 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2081ff3c0 con 0x55628c2a4ea0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55628c3227f0 con 0x55628c2744f0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd20feb0740 10 client.0 _ll_register_callbacks cb 0x7fd2000095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd1fd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd1fd400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52362/0 (socket says 172.21.15.52:52362) 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd1fd400640 1 -- 172.21.15.52:0/1292556695 learned_addr learned my addr 172.21.15.52:0/1292556695 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd205e00640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c31c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.298+0000 7fd206800640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c29bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 -- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 msgr2=0x55628c31c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c31c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 -- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 msgr2=0x55628c29bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c29bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 -- 172.21.15.52:0/1292556695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55628c2a42c0 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1fd400640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd1f003c670 tx=0x7fd1f0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef4c2af128c402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1eb400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f003cc60 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f8070310 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.299+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f003ce00 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7fd1f0060050 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 10 client.9033 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55628c2a3150 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f8070310 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7fd1f0063020 con 0x55628c29e900 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 10 client.9033 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 10 client.9033 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 20 client.9033 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c322120 0x55628c2b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 4 client.9033 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:39:01.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.300+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55628c1ca0e0 con 0x55628c322120 2024-09-10T08:39:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd205e00640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c322120 0x55628c2b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd205e00640 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c322120 0x55628c2b5a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8cbedaaa594b3b6 server_cookie=43c494452eb3770e in_seq=0 out_seq=0 2024-09-10T08:39:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd1eb400640 10 client.9033 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd1eb400640 1 -- 172.21.15.52:0/1292556695 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x55628c1ca0e0 con 0x55628c322120 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd1eb400640 10 client.9033 handle_command_reply: tid=0 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.301+0000 7fd20feb0740 1 client.9033 shutdown 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 msgr2=0x55628c29b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fd1f003c670 tx=0x7fd1f0008030 comp rx=0 tx=0).stop 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 shutdown_connections 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55628c322120 0x55628c2b5a90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55628c2a4ea0 0x55628c29bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55628c29e900 0x55628c29b590 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd1eb400640 0 client.9033 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 --2- 172.21.15.52:0/1292556695 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55628c2744f0 0x55628c31c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 >> 172.21.15.52:0/1292556695 conn(0x55628c25a9e0 msgr2=0x55628c2998e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 shutdown_connections 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 1 -- 172.21.15.52:0/1292556695 wait complete. 2024-09-10T08:39:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd20feb0740 20 client.9033 trim_cache size 0 max 16384 2024-09-10T08:39:01.307 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:01.307 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T08:39:01.307 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:39:01.307 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 msgr2=0x7fd1e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 0x7fd1e406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0034000 tx=0x7fd1f002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.302+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 msgr2=0x7fd20814de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c4d0 tx=0x7fd1f800c990 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 shutdown_connections 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd1e406be30 0x7fd1e406e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd20815ea30 0x7fd20815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd20815e650 0x7fd2080b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 --2- 172.21.15.52:0/1999360855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2080ceca0 0x7fd20814de70 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 >> 172.21.15.52:0/1999360855 conn(0x7fd2080b40d0 msgr2=0x7fd2080d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 shutdown_connections 2024-09-10T08:39:01.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.303+0000 7fd207200640 1 -- 172.21.15.52:0/1999360855 wait complete. 2024-09-10T08:39:01.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.474+0000 7f2626e00640 1 Processor -- start 2024-09-10T08:39:01.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.474+0000 7f2626e00640 1 -- start start 2024-09-10T08:39:01.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2626e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f262015e440 0x7f26200d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2626e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26200b6710 0x7f26200b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2626e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26200d3990 con 0x7f26200cf450 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2626e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f26200d3c70 con 0x7f262015e440 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2626e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26200d3f50 con 0x7f26200b6710 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2625000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f26200cf450 0x7f26200b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57036/0 (socket says 172.21.15.52:57036) 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2625000640 1 -- 172.21.15.52:0/1440964568 learned_addr learned my addr 172.21.15.52:0/1440964568 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:01.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.475+0000 7f2625a00640 1 --2- 172.21.15.52:0/1440964568 >> v2:172.21.15.52:3300/0 conn(0x7f262015e440 0x7f26200d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f2626400640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26200b6710 0x7f26200b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f261fe00640 1 -- 172.21.15.52:0/1440964568 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054263528 0 0) 0x7f26200d3990 con 0x7f26200cf450 2024-09-10T08:39:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f2625a00640 1 -- 172.21.15.52:0/1440964568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26200b6710 msgr2=0x7f26200b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f2625a00640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26200b6710 0x7f26200b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f2625a00640 1 -- 172.21.15.52:0/1440964568 >> v1:172.21.15.52:6789/0 conn(0x7f26200cf450 legacy=0x7f26200b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.476+0000 7f2625a00640 1 -- 172.21.15.52:0/1440964568 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26200d4230 con 0x7f262015e440 2024-09-10T08:39:01.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.477+0000 7f2625a00640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262015e440 0x7f26200d3240 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f26140097a0 tx=0x7f261402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aceccc5529207ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.477+0000 7f261fe00640 1 -- 172.21.15.52:0/1440964568 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614037070 con 0x7f262015e440 2024-09-10T08:39:01.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.477+0000 7f261fe00640 1 -- 172.21.15.52:0/1440964568 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2614032440 con 0x7f262015e440 2024-09-10T08:39:01.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.477+0000 7f261fe00640 1 -- 172.21.15.52:0/1440964568 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614032810 con 0x7f262015e440 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 -- 172.21.15.52:0/1440964568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262015e440 msgr2=0x7f26200d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262015e440 0x7f26200d3240 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f26140097a0 tx=0x7f261402a210 comp rx=0 tx=0).stop 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 -- 172.21.15.52:0/1440964568 shutdown_connections 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26200b6710 0x7f26200b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 --2- 172.21.15.52:0/1440964568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f262015e440 0x7f26200d3240 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 -- 172.21.15.52:0/1440964568 >> 172.21.15.52:0/1440964568 conn(0x7f2620067f80 msgr2=0x7f26200d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 -- 172.21.15.52:0/1440964568 shutdown_connections 2024-09-10T08:39:01.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.478+0000 7f2626e00640 1 -- 172.21.15.52:0/1440964568 wait complete. 2024-09-10T08:39:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.479+0000 7f2626e00640 1 Processor -- start 2024-09-10T08:39:01.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.480+0000 7f2626e00640 1 -- start start 2024-09-10T08:39:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.480+0000 7f2626e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26200cf450 0x7f26200cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 0x7f26200c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26200b76c0 con 0x7f26200b6710 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26200b7540 con 0x7f26200cf450 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26200b80a0 con 0x7f262015e440 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52376/0 (socket says 172.21.15.52:52376) 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 -- 172.21.15.52:0/207860006 learned_addr learned my addr 172.21.15.52:0/207860006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626400640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 0x7f26200c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625000640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26200cf450 0x7f26200cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 -- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 msgr2=0x7f26200c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 0x7f26200c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 -- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26200cf450 msgr2=0x7f26200cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26200cf450 0x7f26200cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2625a00640 1 -- 172.21.15.52:0/207860006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26200cdf50 con 0x7f26200b6710 2024-09-10T08:39:01.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.481+0000 7f2626400640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 0x7f26200c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:01.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f2625a00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2614035040 tx=0x7f26140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614037050 con 0x7f26200b6710 2024-09-10T08:39:01.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2614038040 con 0x7f26200b6710 2024-09-10T08:39:01.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614004470 con 0x7f26200b6710 2024-09-10T08:39:01.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26200ce1f0 con 0x7f26200b6710 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.482+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26200ce7b0 con 0x7f26200b6710 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.483+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26200b7b60 con 0x7f26200b6710 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.484+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2614030900 con 0x7f26200b6710 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.485+0000 7f261d600640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 0x7f260006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.485+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f26140aba40 con 0x7f26200b6710 2024-09-10T08:39:01.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.486+0000 7f2625000640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 0x7f260006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.486+0000 7f2625000640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 0x7f260006e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f26200ba3f0 tx=0x7f260c007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.489+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f261407a3e0 con 0x7f26200b6710 2024-09-10T08:39:01.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.709+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26200abb60 con 0x7f26200b6710 2024-09-10T08:39:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.709+0000 7f261d600640 1 -- 172.21.15.52:0/207860006 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f2614079ce0 con 0x7f26200b6710 2024-09-10T08:39:01.710 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:01.710 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:01.711 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 msgr2=0x7f260006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 0x7f260006e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f26200ba3f0 tx=0x7f260c007b50 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 msgr2=0x7f262015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2614035040 tx=0x7f26140046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 shutdown_connections 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f260006be60 0x7f260006e320 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f262015e440 0x7f26200c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26200cf450 0x7f26200cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 --2- 172.21.15.52:0/207860006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26200b6710 0x7f262015dc40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 >> 172.21.15.52:0/207860006 conn(0x7f2620067f80 msgr2=0x7f26200b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 shutdown_connections 2024-09-10T08:39:01.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.712+0000 7f2626e00640 1 -- 172.21.15.52:0/207860006 wait complete. 2024-09-10T08:39:01.728 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:01.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:01.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.883+0000 7f9afde00640 1 Processor -- start 2024-09-10T08:39:01.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.883+0000 7f9afde00640 1 -- start start 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9afde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 0x7f9af80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9afde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9af80b5880 0x7f9af80b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9afde00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af80b4020 con 0x7f9af8145ed0 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9afde00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9af80b42c0 con 0x7f9af80b5880 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9afde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9af80b45a0 con 0x7f9af8073890 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9af80b5880 0x7f9af80b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9af80b5880 0x7f9af80b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52382/0 (socket says 172.21.15.52:52382) 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 -- 172.21.15.52:0/937415473 learned_addr learned my addr 172.21.15.52:0/937415473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9aefe00640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 0x7f9af80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 -- 172.21.15.52:0/937415473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 msgr2=0x7f9af80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 0x7f9af80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 -- 172.21.15.52:0/937415473 >> v1:172.21.15.176:6789/0 conn(0x7f9af8145ed0 legacy=0x7f9af8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:01.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9af7400640 1 -- 172.21.15.52:0/937415473 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af80b4880 con 0x7f9af80b5880 2024-09-10T08:39:01.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.885+0000 7f9aefe00640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 0x7f9af80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.886+0000 7f9af7400640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af80b5880 0x7f9af80b5d30 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009e50 tx=0x7f9af002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86154475242ffde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9af6000640 1 -- 172.21.15.52:0/937415473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0036070 con 0x7f9af80b5880 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9af6000640 1 -- 172.21.15.52:0/937415473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af0031600 con 0x7f9af80b5880 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9af6000640 1 -- 172.21.15.52:0/937415473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af00319d0 con 0x7f9af80b5880 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 -- 172.21.15.52:0/937415473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af80b5880 msgr2=0x7f9af80b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af80b5880 0x7f9af80b5d30 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009e50 tx=0x7f9af002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 -- 172.21.15.52:0/937415473 shutdown_connections 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af80b5880 0x7f9af80b5d30 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 --2- 172.21.15.52:0/937415473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af8073890 0x7f9af80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 -- 172.21.15.52:0/937415473 >> 172.21.15.52:0/937415473 conn(0x7f9af80ccec0 msgr2=0x7f9af80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 -- 172.21.15.52:0/937415473 shutdown_connections 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.887+0000 7f9afde00640 1 -- 172.21.15.52:0/937415473 wait complete. 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.889+0000 7f9afde00640 1 Processor -- start 2024-09-10T08:39:01.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.889+0000 7f9afde00640 1 -- start start 2024-09-10T08:39:01.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 0x7f9af81f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af8145ed0 0x7f9af8141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9af80b6270 con 0x7f9af8073890 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9af81462b0 con 0x7f9af8145ed0 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9afde00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9af81f2dd0 con 0x7f9af80b5880 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9af6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9af6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52392/0 (socket says 172.21.15.52:52392) 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9af6a00640 1 -- 172.21.15.52:0/3664308415 learned_addr learned my addr 172.21.15.52:0/3664308415 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9af7400640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af8145ed0 0x7f9af8141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.890+0000 7f9aefe00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 0x7f9af81f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 -- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 msgr2=0x7f9af81f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 0x7f9af81f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 -- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af8145ed0 msgr2=0x7f9af8141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af8145ed0 0x7f9af8141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 -- 172.21.15.52:0/3664308415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af81f2810 con 0x7f9af8073890 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9aefe00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 0x7f9af81f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9af6a00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800b3f0 tx=0x7f9ae800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8015020 con 0x7f9af8073890 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae8011830 con 0x7f9af8073890 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8011c20 con 0x7f9af8073890 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af81f2af0 con 0x7f9af8073890 2024-09-10T08:39:01.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.891+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af80cc010 con 0x7f9af8073890 2024-09-10T08:39:01.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.892+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af8144940 con 0x7f9af8073890 2024-09-10T08:39:01.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.893+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ae8018020 con 0x7f9af8073890 2024-09-10T08:39:01.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.894+0000 7f9aef400640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:01.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.894+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9ae808ab10 con 0x7f9af8073890 2024-09-10T08:39:01.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.895+0000 7f9aefe00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:01.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.895+0000 7f9aefe00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006fd0 tx=0x7f9ae0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:01.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:01.898+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ae801f030 con 0x7f9af8073890 2024-09-10T08:39:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.149+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9af80686b0 con 0x7f9af8073890 2024-09-10T08:39:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.150+0000 7f9aef400640 1 -- 172.21.15.52:0/3664308415 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f9ae80172c0 con 0x7f9af8073890 2024-09-10T08:39:02.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:02.150 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":641,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2578243584,"bytes_avail":770515869696,"bytes_total":773094113280,"write_bytes_sec":44811739,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:02.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 msgr2=0x7f9ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0006fd0 tx=0x7f9ae0008040 comp rx=0 tx=0).stop 2024-09-10T08:39:02.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 msgr2=0x7f9af81ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800b3f0 tx=0x7f9ae800b8b0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 shutdown_connections 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9af8145ed0 0x7f9af8141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9af80b5880 0x7f9af81f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 --2- 172.21.15.52:0/3664308415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9af8073890 0x7f9af81ef490 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 >> 172.21.15.52:0/3664308415 conn(0x7f9af80ccec0 msgr2=0x7f9af8144f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 shutdown_connections 2024-09-10T08:39:02.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.152+0000 7f9afde00640 1 -- 172.21.15.52:0/3664308415 wait complete. 2024-09-10T08:39:02.168 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:02.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:02.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-10T08:39:02.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.327+0000 7f660cc00640 1 Processor -- start 2024-09-10T08:39:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.327+0000 7f660cc00640 1 -- start start 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f660cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f66080cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f660cc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66080d36e0 con 0x7f66080b5fd0 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f660cc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66080d3950 con 0x7f66080b7c10 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f660cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66080d3c30 con 0x7f66080d32c0 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f6607400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f66080b5fd0 0x7f66080b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57038/0 (socket says 172.21.15.52:57038) 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.328+0000 7f6607400640 1 -- 172.21.15.52:0/1577378487 learned_addr learned my addr 172.21.15.52:0/1577378487 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606a00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f66080cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026076748 0 0) 0x7f66080d36e0 con 0x7f66080b5fd0 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65ec003520 con 0x7f66080b5fd0 2024-09-10T08:39:02.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109983106 0 0) 0x7f66080d3950 con 0x7f66080b7c10 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66080d36e0 con 0x7f66080b7c10 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2045014388 0 0) 0x7f65ec003520 con 0x7f66080b5fd0 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 msgr2=0x7f66080cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f66080cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 >> v1:172.21.15.176:6789/0 conn(0x7f66080b7c10 legacy=0x7f66080b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66080d3f10 con 0x7f66080b5fd0 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f65f8001670 con 0x7f66080b5fd0 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606a00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f66080cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 >> v1:172.21.15.52:6789/0 conn(0x7f66080b5fd0 legacy=0x7f66080b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f65ec003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65ec0040b0 0x7f65ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f66080d3c30 con 0x7f65ec004d40 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec00ba70 con 0x7f65ec0040b0 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.329+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec00bc70 con 0x7f66080d32c0 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607400640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f65ec003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6606a00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65ec0040b0 0x7f65ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 -- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 msgr2=0x7f65ec003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66080d32c0 0x7f65ec003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 -- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65ec0040b0 msgr2=0x7f65ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65ec0040b0 0x7f65ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.330+0000 7f6607e00640 1 -- 172.21.15.52:0/1577378487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec003520 con 0x7f65ec004d40 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.331+0000 7f6607e00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6600001fd0 tx=0x7f65ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a265ab1afaabee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.331+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600001bf0 con 0x7f65ec004d40 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.331+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600003b70 con 0x7f65ec004d40 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.331+0000 7f6606000640 1 -- 172.21.15.52:0/1577378487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000050d0 con 0x7f65ec004d40 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 -- 172.21.15.52:0/1577378487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65ec004d40 msgr2=0x7f65ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 --2- 172.21.15.52:0/1577378487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65ec004d40 0x7f65ec0051c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6600001fd0 tx=0x7f65ec005830 comp rx=0 tx=0).stop 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f6607e00640 1 -- 172.21.15.52:0/1577378487 reap_dead start 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 -- 172.21.15.52:0/1577378487 shutdown_connections 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 -- 172.21.15.52:0/1577378487 >> 172.21.15.52:0/1577378487 conn(0x7f66080d0fd0 msgr2=0x7f66080d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 -- 172.21.15.52:0/1577378487 shutdown_connections 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.332+0000 7f660cc00640 1 -- 172.21.15.52:0/1577378487 wait complete. 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.334+0000 7f660cc00640 1 Processor -- start 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.334+0000 7f660cc00640 1 -- start start 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 0x7f66081501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6608160710 0x7f6608160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f660815e7f0 con 0x7f660814fd10 2024-09-10T08:39:02.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66080b7680 con 0x7f660814f930 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f660cc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f660815e970 con 0x7f6608160710 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52406/0 (socket says 172.21.15.52:52406) 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 -- 172.21.15.52:0/3598696956 learned_addr learned my addr 172.21.15.52:0/3598696956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6607400640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 0x7f66081501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6607e00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6608160710 0x7f6608160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 -- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6608160710 msgr2=0x7f6608160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6608160710 0x7f6608160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 -- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 msgr2=0x7f66081501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 0x7f66081501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6606a00640 1 -- 172.21.15.52:0/3598696956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660815f6a0 con 0x7f660814fd10 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.335+0000 7f6607400640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 0x7f66081501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:02.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f6606a00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f65f40119a0 tx=0x7f65f4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f65ff400640 1 -- 172.21.15.52:0/3598696956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f400fa90 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f65ff400640 1 -- 172.21.15.52:0/3598696956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f400fc30 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f65ff400640 1 -- 172.21.15.52:0/3598696956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4014440 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660815f980 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.336+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66080c8f90 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.338+0000 7f65ff400640 1 -- 172.21.15.52:0/3598696956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65f4012040 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.339+0000 7f65ff400640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 0x7f65e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.339+0000 7f65ff400640 1 -- 172.21.15.52:0/3598696956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f65f408b510 con 0x7f660814fd10 2024-09-10T08:39:02.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.339+0000 7f6607400640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 0x7f65e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.340+0000 7f661106e740 1 Processor -- start 2024-09-10T08:39:02.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.340+0000 7f661106e740 1 -- start start 2024-09-10T08:39:02.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.340+0000 7f6607400640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 0x7f65e806e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65f8001050 tx=0x7f65f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa27f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 0x55dfa27d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dfa273e660 con 0x55dfa2820ea0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dfa26e6680 con 0x55dfa27d69e0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dfa273a620 con 0x55dfa27f04f0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f6607e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f6607e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52414/0 (socket says 172.21.15.52:52414) 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f6607e00640 1 -- 172.21.15.52:0/3310152294 learned_addr learned my addr 172.21.15.52:0/3310152294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f6606a00640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 0x55dfa27d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.341+0000 7f6607400640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa27f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 -- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 msgr2=0x55dfa27f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa27f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 -- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 msgr2=0x55dfa27d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 0x55dfa27d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 -- 172.21.15.52:0/3310152294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa251b7d0 con 0x55dfa2820ea0 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607400640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa27f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6606a00640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 0x55dfa27d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f6607e00640 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f660002aab0 tx=0x7f6600009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df55b700eb6fdedd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f65f3400640 1 -- 172.21.15.52:0/3310152294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600041030 con 0x55dfa2820ea0 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f65f3400640 1 -- 172.21.15.52:0/3310152294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600006b50 con 0x55dfa2820ea0 2024-09-10T08:39:02.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.342+0000 7f65f3400640 1 -- 172.21.15.52:0/3310152294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600006d00 con 0x55dfa2820ea0 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 -- 172.21.15.52:0/3310152294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 msgr2=0x55dfa28213f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f660002aab0 tx=0x7f6600009030 comp rx=0 tx=0).stop 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 -- 172.21.15.52:0/3310152294 shutdown_connections 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa28213f0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27d69e0 0x55dfa27d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 --2- 172.21.15.52:0/3310152294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa27f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 -- 172.21.15.52:0/3310152294 >> 172.21.15.52:0/3310152294 conn(0x55dfa27d7410 msgr2=0x55dfa281fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 -- 172.21.15.52:0/3310152294 shutdown_connections 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.343+0000 7f661106e740 1 -- 172.21.15.52:0/3310152294 wait complete. 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.344+0000 7f661106e740 1 -- start start 2024-09-10T08:39:02.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.344+0000 7f661106e740 1 Processor -- start 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa28167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27ef6b0 0x55dfa2817f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dfa27d5940 con 0x55dfa2820ea0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55dfa26c74c0 con 0x55dfa27ef6b0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dfa27d5c20 con 0x55dfa27f04f0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f661106e740 10 client.0 _ll_register_callbacks cb 0x55dfa2736e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f6606a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f6606a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52416/0 (socket says 172.21.15.52:52416) 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.345+0000 7f6606a00640 1 -- 172.21.15.52:0/190839184 learned_addr learned my addr 172.21.15.52:0/190839184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6607400640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa28167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6607e00640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27ef6b0 0x55dfa2817f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 -- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 msgr2=0x55dfa28167e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa28167e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 -- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27ef6b0 msgr2=0x55dfa2817f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27ef6b0 0x55dfa2817f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 -- 172.21.15.52:0/190839184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa24513f0 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f6606a00640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f65f4059250 tx=0x7f65f4060170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136c2c4cf7f08ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f65e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4022040 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f65f4055e20 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6600006b50 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f65f40597b0 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f661106e740 10 client.9060 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.346+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55dfa24110f0 con 0x55dfa2820ea0 2024-09-10T08:39:02.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6600006b50 con 0x55dfa2820ea0 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f65f4059a10 con 0x55dfa2820ea0 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 10 client.9060 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 10 client.9060 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 20 client.9060 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa27d9220 0x55dfa27d9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 4 client.9060 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfa274bd90 con 0x55dfa27d9220 2024-09-10T08:39:02.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.347+0000 7f6607400640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa27d9220 0x55dfa27d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.348+0000 7f6607400640 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa27d9220 0x55dfa27d9630 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59eec260ac7d35e3 server_cookie=173711f2e41ae2b5 in_seq=0 out_seq=0 2024-09-10T08:39:02.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.348+0000 7f65e7e00640 10 client.9060 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f65e7e00640 1 -- 172.21.15.52:0/190839184 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfa274bd90 con 0x55dfa27d9220 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f65e7e00640 10 client.9060 handle_command_reply: tid=0 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 client.9060 shutdown 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 msgr2=0x55dfa2819110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f65f4059250 tx=0x7f65f4060170 comp rx=0 tx=0).stop 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 shutdown_connections 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa27d9220 0x55dfa27d9630 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27ef6b0 0x55dfa2817f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2819110 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f65e7e00640 0 client.9060 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 --2- 172.21.15.52:0/190839184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27f04f0 0x55dfa28167e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 >> 172.21.15.52:0/190839184 conn(0x55dfa27d69e0 msgr2=0x55dfa27d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 shutdown_connections 2024-09-10T08:39:02.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 1 -- 172.21.15.52:0/190839184 wait complete. 2024-09-10T08:39:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.349+0000 7f661106e740 20 client.9060 trim_cache size 0 max 16384 2024-09-10T08:39:02.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.367+0000 7f661106e740 1 Processor -- start 2024-09-10T08:39:02.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.367+0000 7f661106e740 1 -- start start 2024-09-10T08:39:02.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27ef6b0 0x55dfa27ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27eca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6608201700 con 0x55dfa2820ea0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6608200720 con 0x55dfa27f04f0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66081ffab0 con 0x55dfa27ef6b0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52428/0 (socket says 172.21.15.52:52428) 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 -- 172.21.15.52:0/3441442598 learned_addr learned my addr 172.21.15.52:0/3441442598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607400640 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27ef6b0 0x55dfa27ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6606a00640 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 -- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27ef6b0 msgr2=0x55dfa27ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27ef6b0 0x55dfa27ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 -- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 msgr2=0x55dfa27eca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27eca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.368+0000 7f6607e00640 1 -- 172.21.15.52:0/3441442598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa27d99a0 con 0x55dfa2820ea0 2024-09-10T08:39:02.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.369+0000 7f6607e00640 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f6600001770 tx=0x7f6600030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdcce788b7bb690 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.369+0000 7f65f2a00640 1 -- 172.21.15.52:0/3441442598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600006b50 con 0x55dfa2820ea0 2024-09-10T08:39:02.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.369+0000 7f65f2a00640 1 -- 172.21.15.52:0/3441442598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660004a020 con 0x55dfa2820ea0 2024-09-10T08:39:02.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.369+0000 7f65f2a00640 1 -- 172.21.15.52:0/3441442598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600003970 con 0x55dfa2820ea0 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- 172.21.15.52:0/3441442598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 msgr2=0x55dfa2842ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f6600001770 tx=0x7f6600030000 comp rx=0 tx=0).stop 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- 172.21.15.52:0/3441442598 shutdown_connections 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa2820ea0 0x55dfa2842ba0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27eca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 --2- 172.21.15.52:0/3441442598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa27ef6b0 0x55dfa27ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- 172.21.15.52:0/3441442598 >> 172.21.15.52:0/3441442598 conn(0x55dfa27d69e0 msgr2=0x55dfa28188e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- 172.21.15.52:0/3441442598 shutdown_connections 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- 172.21.15.52:0/3441442598 wait complete. 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.370+0000 7f661106e740 1 -- start start 2024-09-10T08:39:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 Processor -- start 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa2820ea0 0x55dfa27eca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dfa2830330 con 0x55dfa27ef6b0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66082000d0 con 0x55dfa27f04f0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55dfa289f540 con 0x55dfa2820ea0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.371+0000 7f661106e740 10 client.0 _ll_register_callbacks cb 0x7f65f4006d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52438/0 (socket says 172.21.15.52:52438) 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 -- 172.21.15.52:0/2169470330 learned_addr learned my addr 172.21.15.52:0/2169470330 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607e00640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa2820ea0 0x55dfa27eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6606a00640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 -- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa2820ea0 msgr2=0x55dfa27eca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa2820ea0 0x55dfa27eca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 -- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 msgr2=0x55dfa27ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 -- 172.21.15.52:0/2169470330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa289dd30 con 0x55dfa27ef6b0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f6607400640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x55dfa27d9d60 tx=0x7f65f8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a855396945060d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f65e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.372+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8022810 con 0x55dfa27ef6b0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f65f80229b0 con 0x55dfa27ef6b0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f660004a020 con 0x55dfa27ef6b0 2024-09-10T08:39:02.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f65f8022bb0 con 0x55dfa27ef6b0 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 10 client.9066 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x55dfa289f280 con 0x55dfa27ef6b0 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660004a020 con 0x55dfa27ef6b0 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f65f8033440 con 0x55dfa27ef6b0 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 10 client.9066 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 10 client.9066 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 20 client.9066 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa2816a30 0x55dfa289e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 4 client.9066 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.373+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55dfa28171e0 con 0x55dfa2816a30 2024-09-10T08:39:02.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f6606a00640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa2816a30 0x55dfa289e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f6606a00640 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa2816a30 0x55dfa289e1e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee891fc61ee9480c server_cookie=6458eef003fb908d in_seq=0 out_seq=0 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f65e7e00640 10 client.9066 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f65e7e00640 1 -- 172.21.15.52:0/2169470330 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55dfa28171e0 con 0x55dfa2816a30 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f65e7e00640 10 client.9066 handle_command_reply: tid=0 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.374+0000 7f661106e740 1 client.9066 shutdown 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 msgr2=0x55dfa289d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x55dfa27d9d60 tx=0x7f65f8001a30 comp rx=0 tx=0).stop 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 shutdown_connections 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x55dfa2816a30 0x55dfa289e1e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55dfa2820ea0 0x55dfa27eca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55dfa27f04f0 0x55dfa27ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f65e7e00640 0 client.9066 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 --2- 172.21.15.52:0/2169470330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dfa27ef6b0 0x55dfa289d7f0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 >> 172.21.15.52:0/2169470330 conn(0x55dfa27d69e0 msgr2=0x55dfa27d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 shutdown_connections 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 1 -- 172.21.15.52:0/2169470330 wait complete. 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f661106e740 20 client.9066 trim_cache size 0 max 16384 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:02.380 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:39:02.381 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 msgr2=0x7f65e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 0x7f65e806e2f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65f8001050 tx=0x7f65f8009040 comp rx=0 tx=0).stop 2024-09-10T08:39:02.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 msgr2=0x7f66080cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.375+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f65f40119a0 tx=0x7f65f4011e60 comp rx=0 tx=0).stop 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 shutdown_connections 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f65e806be30 0x7f65e806e2f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6608160710 0x7f6608160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f660814fd10 0x7f66080cf6d0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 --2- 172.21.15.52:0/3598696956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f660814f930 0x7f66081501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 >> 172.21.15.52:0/3598696956 conn(0x7f66080d0fd0 msgr2=0x7f66080d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 shutdown_connections 2024-09-10T08:39:02.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.376+0000 7f660cc00640 1 -- 172.21.15.52:0/3598696956 wait complete. 2024-09-10T08:39:02.391 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-10T08:39:02.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-10T08:39:02.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.548+0000 7f9f09800640 1 Processor -- start 2024-09-10T08:39:02.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.548+0000 7f9f09800640 1 -- start start 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.549+0000 7f9f09800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f040cf8d0 0x7f9f04070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.549+0000 7f9f09800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 0x7f9f04071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.549+0000 7f9f09800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f0415f120 con 0x7f9f040cfcb0 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.549+0000 7f9f09800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9f04141cd0 con 0x7f9f040cf8d0 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.549+0000 7f9f09800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f04144e70 con 0x7f9f04144a50 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9f040cf8d0 0x7f9f04070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9efbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9f040cfcb0 0x7f9f04144340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57046/0 (socket says 172.21.15.52:57046) 2024-09-10T08:39:02.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9efbe00640 1 -- 172.21.15.52:0/3524617229 learned_addr learned my addr 172.21.15.52:0/3524617229 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:02.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f03400640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 0x7f9f04071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02a00640 1 -- 172.21.15.52:0/3524617229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 msgr2=0x7f9f04071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02a00640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 0x7f9f04071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02a00640 1 -- 172.21.15.52:0/3524617229 >> v1:172.21.15.52:6789/0 conn(0x7f9f040cfcb0 legacy=0x7f9f04144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02000640 1 -- 172.21.15.52:0/3524617229 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549962819 0 0) 0x7f9f0415f120 con 0x7f9f040cfcb0 2024-09-10T08:39:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f02a00640 1 -- 172.21.15.52:0/3524617229 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0415f400 con 0x7f9f040cf8d0 2024-09-10T08:39:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.550+0000 7f9f03400640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 0x7f9f04071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:02.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.551+0000 7f9f02a00640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f04070f40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40097a0 tx=0x7f9ef402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b581a2a9ceeb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.551+0000 7f9f02000640 1 -- 172.21.15.52:0/3524617229 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4037070 con 0x7f9f040cf8d0 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f02000640 1 -- 172.21.15.52:0/3524617229 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef4032440 con 0x7f9f040cf8d0 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f02000640 1 -- 172.21.15.52:0/3524617229 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4032810 con 0x7f9f040cf8d0 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 -- 172.21.15.52:0/3524617229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 msgr2=0x7f9f04070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f04070f40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40097a0 tx=0x7f9ef402a180 comp rx=0 tx=0).stop 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 -- 172.21.15.52:0/3524617229 shutdown_connections 2024-09-10T08:39:02.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f04144a50 0x7f9f04071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 --2- 172.21.15.52:0/3524617229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f04070f40 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 -- 172.21.15.52:0/3524617229 >> 172.21.15.52:0/3524617229 conn(0x7f9f0406d0f0 msgr2=0x7f9f0406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 -- 172.21.15.52:0/3524617229 shutdown_connections 2024-09-10T08:39:02.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.552+0000 7f9f09800640 1 -- 172.21.15.52:0/3524617229 wait complete. 2024-09-10T08:39:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.554+0000 7f9f09800640 1 Processor -- start 2024-09-10T08:39:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.554+0000 7f9f09800640 1 -- start start 2024-09-10T08:39:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 0x7f9f040b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 0x7f9f040b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0415ee30 con 0x7f9f040cf8d0 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0415f9c0 con 0x7f9f04144a50 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f09800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f040ce0f0 con 0x7f9f040cfcb0 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52456/0 (socket says 172.21.15.52:52456) 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.555+0000 7f9f02a00640 1 -- 172.21.15.52:0/1954830585 learned_addr learned my addr 172.21.15.52:0/1954830585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 0x7f9f040b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 -- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 msgr2=0x7f9f040b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f03400640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 0x7f9f040b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 0x7f9f040b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 -- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 msgr2=0x7f9f040b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 0x7f9f040b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 -- 172.21.15.52:0/1954830585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f04133c00 con 0x7f9f040cf8d0 2024-09-10T08:39:02.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 0x7f9f040b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:02.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f03400640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 0x7f9f040b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:02.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9efaa00640 1 -- 172.21.15.52:0/1954830585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4037040 con 0x7f9f040cf8d0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9efaa00640 1 -- 172.21.15.52:0/1954830585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef4042070 con 0x7f9f040cf8d0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f04133ea0 con 0x7f9f040cf8d0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9efaa00640 1 -- 172.21.15.52:0/1954830585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4030a70 con 0x7f9f040cf8d0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.556+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f04134460 con 0x7f9f040cf8d0 2024-09-10T08:39:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.558+0000 7f9efaa00640 1 -- 172.21.15.52:0/1954830585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ef4030c10 con 0x7f9f040cf8d0 2024-09-10T08:39:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.559+0000 7f9efaa00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 0x7f9ee006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.559+0000 7f9efaa00640 1 -- 172.21.15.52:0/1954830585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9ef40ab950 con 0x7f9f040cf8d0 2024-09-10T08:39:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.560+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 0x7f9ee006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.560+0000 7f9f0c61b740 1 Processor -- start 2024-09-10T08:39:02.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.560+0000 7f9f0c61b740 1 -- start start 2024-09-10T08:39:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.560+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 0x7f9ee006e320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9f04071370 tx=0x7f9eec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815420 0x5624f8845c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fb480 0x5624f8846740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5624f8763660 con 0x5624f8815800 2024-09-10T08:39:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5624f870b680 con 0x5624f8815420 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5624f875f620 con 0x5624f87fb480 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815420 0x5624f8845c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52460/0 (socket says 172.21.15.52:52460) 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.561+0000 7f9efbe00640 1 -- 172.21.15.52:0/3622935629 learned_addr learned my addr 172.21.15.52:0/3622935629 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9f03400640 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fb480 0x5624f8846740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 -- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fb480 msgr2=0x5624f8846740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fb480 0x5624f8846740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 -- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815420 msgr2=0x5624f8845c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815420 0x5624f8845c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 -- 172.21.15.52:0/3622935629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f85407d0 con 0x5624f8815800 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9f040d00e0 tx=0x7f9eec010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bf56b154af4c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9ef3400640 1 -- 172.21.15.52:0/3622935629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00d9a0 con 0x5624f8815800 2024-09-10T08:39:02.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9ef3400640 1 -- 172.21.15.52:0/3622935629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec00db40 con 0x5624f8815800 2024-09-10T08:39:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.562+0000 7f9ef3400640 1 -- 172.21.15.52:0/3622935629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec020450 con 0x5624f8815800 2024-09-10T08:39:02.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3622935629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 msgr2=0x5624f8846200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9f040d00e0 tx=0x7f9eec010000 comp rx=0 tx=0).stop 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3622935629 shutdown_connections 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fb480 0x5624f8846740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815800 0x5624f8846200 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3622935629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815420 0x5624f8845c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3622935629 >> 172.21.15.52:0/3622935629 conn(0x5624f87fc220 msgr2=0x5624f8844840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3622935629 shutdown_connections 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.563+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3622935629 wait complete. 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.564+0000 7f9f0c61b740 1 -- start start 2024-09-10T08:39:02.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.564+0000 7f9f0c61b740 1 Processor -- start 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f8853fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fe630 0x5624f8854500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5624f87fa3e0 con 0x5624f8815420 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5624f86ec4c0 con 0x5624f8815800 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5624f87fa6c0 con 0x5624f87fe630 2024-09-10T08:39:02.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f0c61b740 10 client.0 _ll_register_callbacks cb 0x5624f875be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52472/0 (socket says 172.21.15.52:52472) 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 -- 172.21.15.52:0/1950624979 learned_addr learned my addr 172.21.15.52:0/1950624979 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f03400640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fe630 0x5624f8854500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f8853fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 -- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fe630 msgr2=0x5624f8854500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fe630 0x5624f8854500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 -- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 msgr2=0x5624f8853fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f8853fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.565+0000 7f9f02a00640 1 -- 172.21.15.52:0/1950624979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f84763f0 con 0x5624f8815420 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f02a00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40a9e70 tx=0x7f9ef407a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd8947ca89a69a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:02.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40a8060 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9ef4079e50 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec00db40 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f9ef4096050 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 10 client.9081 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x5624f84360f0 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec00db40 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f9ef403a030 con 0x5624f8815420 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 10 client.9081 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 10 client.9081 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.566+0000 7f9f0c61b740 20 client.9081 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.567+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f88588c0 0x5624f8858cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.567+0000 7f9f0c61b740 4 client.9081 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:02.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.567+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f8770d90 con 0x5624f88588c0 2024-09-10T08:39:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.567+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f88588c0 0x5624f8858cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.568+0000 7f9efbe00640 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f88588c0 0x5624f8858cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2689df2fb1fc28 server_cookie=5b19ab697823ed0a in_seq=0 out_seq=0 2024-09-10T08:39:02.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.568+0000 7f9ee7e00640 10 client.9081 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.568+0000 7f9ee7e00640 1 -- 172.21.15.52:0/1950624979 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624f8770d90 con 0x5624f88588c0 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.568+0000 7f9ee7e00640 10 client.9081 handle_command_reply: tid=0 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 client.9081 shutdown 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 msgr2=0x5624f883a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40a9e70 tx=0x7f9ef407a2f0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 shutdown_connections 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f88588c0 0x5624f8858cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f87fe630 0x5624f8854500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f8853fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/1950624979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f883a470 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9ee7e00640 0 client.9081 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 >> 172.21.15.52:0/1950624979 conn(0x5624f87fb480 msgr2=0x5624f88446b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 shutdown_connections 2024-09-10T08:39:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 1 -- 172.21.15.52:0/1950624979 wait complete. 2024-09-10T08:39:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.569+0000 7f9f0c61b740 20 client.9081 trim_cache size 0 max 16384 2024-09-10T08:39:02.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.587+0000 7f9f0c61b740 1 Processor -- start 2024-09-10T08:39:02.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.587+0000 7f9f0c61b740 1 -- start start 2024-09-10T08:39:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f87fe630 0x5624f8819af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 0x5624f8868720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f042009b0 con 0x5624f8815420 2024-09-10T08:39:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f041364b0 con 0x5624f87fe630 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0415aad0 con 0x5624f8815800 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52480/0 (socket says 172.21.15.52:52480) 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.588+0000 7f9efbe00640 1 -- 172.21.15.52:0/344672015 learned_addr learned my addr 172.21.15.52:0/344672015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9f02a00640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f87fe630 0x5624f8819af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9f03400640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 0x5624f8868720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 -- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 msgr2=0x5624f8868720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 0x5624f8868720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 -- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f87fe630 msgr2=0x5624f8819af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f87fe630 0x5624f8819af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 -- 172.21.15.52:0/344672015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f8799b80 con 0x5624f8815420 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9f03400640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 0x5624f8868720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9efbe00640 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9eec001eb0 tx=0x7f9eec007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3663a694b70d2129 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9ef2a00640 1 -- 172.21.15.52:0/344672015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00d9a0 con 0x5624f8815420 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9ef2a00640 1 -- 172.21.15.52:0/344672015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec033070 con 0x5624f8815420 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.589+0000 7f9ef2a00640 1 -- 172.21.15.52:0/344672015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec020650 con 0x5624f8815420 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- 172.21.15.52:0/344672015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 msgr2=0x5624f881a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9eec001eb0 tx=0x7f9eec007000 comp rx=0 tx=0).stop 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- 172.21.15.52:0/344672015 shutdown_connections 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815800 0x5624f8868720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f8815420 0x5624f881a030 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/344672015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f87fe630 0x5624f8819af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- 172.21.15.52:0/344672015 >> 172.21.15.52:0/344672015 conn(0x5624f87fb480 msgr2=0x5624f87ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- 172.21.15.52:0/344672015 shutdown_connections 2024-09-10T08:39:02.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- 172.21.15.52:0/344672015 wait complete. 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.590+0000 7f9f0c61b740 1 -- start start 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.591+0000 7f9f0c61b740 1 Processor -- start 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.591+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815420 0x5624f8840e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f87f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5624f8845090 con 0x5624f87fe630 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f04135e60 con 0x5624f8815800 2024-09-10T08:39:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5624f8841900 con 0x5624f8815420 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f0c61b740 10 client.0 _ll_register_callbacks cb 0x7f9ef40799c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52482/0 (socket says 172.21.15.52:52482) 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 -- 172.21.15.52:0/3395170716 learned_addr learned my addr 172.21.15.52:0/3395170716 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f03400640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f87f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815420 0x5624f8840e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 -- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815420 msgr2=0x5624f8840e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815420 0x5624f8840e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 -- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 msgr2=0x5624f87f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f87f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.592+0000 7f9f02a00640 1 -- 172.21.15.52:0/3395170716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f883d560 con 0x5624f87fe630 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f02a00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4076050 tx=0x7f9ef407c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773af22420f42cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4075e90 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9ef4079040 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec033070 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f9ef4079730 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 10 client.9087 fetch_fsmap learned FSMap version 110 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x5624f88413c0 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec033070 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f9ef40a3340 con 0x5624f87fe630 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 10 client.9087 fetch_fsmap finished waiting for FSMap version 110 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 10 client.9087 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.d 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 20 client.9087 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f87f9980 0x5624f8845910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 4 client.9087 mds_command: new command op to 8182 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.593+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 --> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624f876b0e0 con 0x5624f87f9980 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f87f9980 0x5624f8845910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9efbe00640 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f87f9980 0x5624f8845910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f522973c0f6738ed server_cookie=969d0263e19e42f1 in_seq=0 out_seq=0 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9ee7e00640 10 client.9087 ms_handle_connect on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9ee7e00640 1 -- 172.21.15.52:0/3395170716 <== mds.0 v2:172.21.15.176:6835/2632927131 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5624f876b0e0 con 0x5624f87f9980 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9ee7e00640 10 client.9087 handle_command_reply: tid=0 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.594+0000 7f9f0c61b740 1 client.9087 shutdown 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 msgr2=0x5624f88c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4076050 tx=0x7f9ef407c070 comp rx=0 tx=0).stop 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 shutdown_connections 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:6835/2632927131,v1:172.21.15.176:6837/2632927131] conn(0x5624f87f9980 0x5624f8845910 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5624f8815800 0x5624f87f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5624f8815420 0x5624f8840e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 --2- 172.21.15.52:0/3395170716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624f87fe630 0x5624f88c2a50 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9ee7e00640 0 client.9087 ms_handle_reset on v2:172.21.15.176:6835/2632927131 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 >> 172.21.15.52:0/3395170716 conn(0x5624f87fb480 msgr2=0x5624f87ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 shutdown_connections 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 1 -- 172.21.15.52:0/3395170716 wait complete. 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f0c61b740 20 client.9087 trim_cache size 0 max 16384 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:02.600 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:39:02.601 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:39:02.601 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 msgr2=0x7f9ee006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 0x7f9ee006e320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9f04071370 tx=0x7f9eec009040 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 msgr2=0x7f9f0415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.595+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4000c00 tx=0x7f9ef40046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 shutdown_connections 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9ee006be60 0x7f9ee006e320 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f04144a50 0x7f9f040b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f040cfcb0 0x7f9f040b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 --2- 172.21.15.52:0/1954830585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f040cf8d0 0x7f9f0415c7f0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 >> 172.21.15.52:0/1954830585 conn(0x7f9f0406d0f0 msgr2=0x7f9f040b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 shutdown_connections 2024-09-10T08:39:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.596+0000 7f9f09800640 1 -- 172.21.15.52:0/1954830585 wait complete. 2024-09-10T08:39:02.610 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:39:02.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.767+0000 7f3c64400640 1 Processor -- start 2024-09-10T08:39:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.767+0000 7f3c64400640 1 -- start start 2024-09-10T08:39:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.768+0000 7f3c64400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c5c073890 0x7f3c5c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.768+0000 7f3c64400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.768+0000 7f3c64400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5c0b4020 con 0x7f3c5c145ed0 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.768+0000 7f3c64400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c0b42c0 con 0x7f3c5c073890 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.768+0000 7f3c64400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c0b45a0 con 0x7f3c5c0b5880 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c5c073890 0x7f3c5c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3c5c073890 0x7f3c5c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52498/0 (socket says 172.21.15.52:52498) 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 -- 172.21.15.52:0/3880737858 learned_addr learned my addr 172.21.15.52:0/3880737858 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c62400640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 -- 172.21.15.52:0/3880737858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 msgr2=0x7f3c5c0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c0b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 -- 172.21.15.52:0/3880737858 >> v1:172.21.15.176:6789/0 conn(0x7f3c5c145ed0 legacy=0x7f3c5c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.769+0000 7f3c61000640 1 -- 172.21.15.52:0/3880737858 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c0b4880 con 0x7f3c5c073890 2024-09-10T08:39:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.770+0000 7f3c61000640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c0b5080 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689351239d1c5246 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.770+0000 7f3c5be00640 1 -- 172.21.15.52:0/3880737858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48037070 con 0x7f3c5c073890 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c5be00640 1 -- 172.21.15.52:0/3880737858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c48032440 con 0x7f3c5c073890 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c5be00640 1 -- 172.21.15.52:0/3880737858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48032810 con 0x7f3c5c073890 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 -- 172.21.15.52:0/3880737858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 msgr2=0x7f3c5c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c0b5080 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4802a270 comp rx=0 tx=0).stop 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 -- 172.21.15.52:0/3880737858 shutdown_connections 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c0b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 --2- 172.21.15.52:0/3880737858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c0b5080 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 -- 172.21.15.52:0/3880737858 >> 172.21.15.52:0/3880737858 conn(0x7f3c5c0ccec0 msgr2=0x7f3c5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 -- 172.21.15.52:0/3880737858 shutdown_connections 2024-09-10T08:39:02.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.771+0000 7f3c64400640 1 -- 172.21.15.52:0/3880737858 wait complete. 2024-09-10T08:39:02.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.773+0000 7f3c64400640 1 Processor -- start 2024-09-10T08:39:02.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.773+0000 7f3c64400640 1 -- start start 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5c145ed0 0x7f3c5c072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0b6270 con 0x7f3c5c073890 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c1462b0 con 0x7f3c5c145ed0 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c64400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c13f440 con 0x7f3c5c0b5880 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52500/0 (socket says 172.21.15.52:52500) 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 -- 172.21.15.52:0/1129859476 learned_addr learned my addr 172.21.15.52:0/1129859476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c62400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5c145ed0 0x7f3c5c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61000640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 -- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 msgr2=0x7f3c5c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.774+0000 7f3c61a00640 1 -- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5c145ed0 msgr2=0x7f3c5c072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c61a00640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5c145ed0 0x7f3c5c072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:02.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c61a00640 1 -- 172.21.15.52:0/1129859476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c0aba30 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c61a00640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c340 tx=0x7f3c5000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50017070 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c500052d0 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c0abd10 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c50003850 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.775+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c13f970 con 0x7f3c5c073890 2024-09-10T08:39:02.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.776+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5c0b5080 con 0x7f3c5c073890 2024-09-10T08:39:02.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.778+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c5001a070 con 0x7f3c5c073890 2024-09-10T08:39:02.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.779+0000 7f3c59600640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 0x7f3c3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:02.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.779+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f3c5008a1b0 con 0x7f3c5c073890 2024-09-10T08:39:02.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.779+0000 7f3c61000640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 0x7f3c3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:02.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.780+0000 7f3c61000640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 0x7f3c3c06e2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c48034000 tx=0x7f3c4802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:02.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:02.783+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c50058470 con 0x7f3c5c073890 2024-09-10T08:39:03.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.004+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c5c0cfec0 con 0x7f3c5c073890 2024-09-10T08:39:03.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.005+0000 7f3c59600640 1 -- 172.21.15.52:0/1129859476 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f3c5005c770 con 0x7f3c5c073890 2024-09-10T08:39:03.005 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:03.005 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:03.006 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 msgr2=0x7f3c3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 0x7f3c3c06e2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c48034000 tx=0x7f3c4802e000 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 msgr2=0x7f3c5c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c340 tx=0x7f3c5000c800 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 shutdown_connections 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c3c06be30 0x7f3c3c06e2f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c5c145ed0 0x7f3c5c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c5c0b5880 0x7f3c5c071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 --2- 172.21.15.52:0/1129859476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c5c073890 0x7f3c5c15c160 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 >> 172.21.15.52:0/1129859476 conn(0x7f3c5c0ccec0 msgr2=0x7f3c5c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 shutdown_connections 2024-09-10T08:39:03.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.007+0000 7f3c64400640 1 -- 172.21.15.52:0/1129859476 wait complete. 2024-09-10T08:39:03.024 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:03.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:03.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.178+0000 7f62a3400640 1 Processor -- start 2024-09-10T08:39:03.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.178+0000 7f62a3400640 1 -- start start 2024-09-10T08:39:03.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.179+0000 7f62a3400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f629c145ed0 0x7f629c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f62a3400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629c0b4020 con 0x7f629c073180 2024-09-10T08:39:03.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f62a3400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629c0b42c0 con 0x7f629c0b5f90 2024-09-10T08:39:03.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f62a3400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f629c0b63d0 con 0x7f629c145ed0 2024-09-10T08:39:03.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f629be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f629c073180 0x7f629c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57048/0 (socket says 172.21.15.52:57048) 2024-09-10T08:39:03.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f629be00640 1 -- 172.21.15.52:0/3481518361 learned_addr learned my addr 172.21.15.52:0/3481518361 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:03.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3481518361 >> v2:172.21.15.176:3300/0 conn(0x7f629c145ed0 0x7f629c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:03.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984569085 0 0) 0x7f629c0b4020 con 0x7f629c073180 2024-09-10T08:39:03.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6284003520 con 0x7f629c073180 2024-09-10T08:39:03.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117915014 0 0) 0x7f629c0b42c0 con 0x7f629c0b5f90 2024-09-10T08:39:03.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.180+0000 7f62a0a00640 1 -- 172.21.15.52:0/3481518361 >> v1:172.21.15.176:6789/0 conn(0x7f629c0b5f90 legacy=0x7f629c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.181+0000 7f62a0a00640 1 -- 172.21.15.52:0/3481518361 >> v1:172.21.15.52:6789/0 conn(0x7f629c073180 legacy=0x7f629c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.181+0000 7f62a0a00640 1 -- 172.21.15.52:0/3481518361 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c0b45a0 con 0x7f629c145ed0 2024-09-10T08:39:03.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.182+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3481518361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c145ed0 0x7f629c0b5080 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f62900097a0 tx=0x7f629002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3ae9d0e2b0fddb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:03.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.182+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290037070 con 0x7f629c145ed0 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.182+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6290032440 con 0x7f629c145ed0 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.182+0000 7f629b400640 1 -- 172.21.15.52:0/3481518361 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290032810 con 0x7f629c145ed0 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 -- 172.21.15.52:0/3481518361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c145ed0 msgr2=0x7f629c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 --2- 172.21.15.52:0/3481518361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c145ed0 0x7f629c0b5080 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f62900097a0 tx=0x7f629002a230 comp rx=0 tx=0).stop 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 -- 172.21.15.52:0/3481518361 shutdown_connections 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 --2- 172.21.15.52:0/3481518361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c145ed0 0x7f629c0b5080 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 -- 172.21.15.52:0/3481518361 >> 172.21.15.52:0/3481518361 conn(0x7f629c0ccec0 msgr2=0x7f629c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 -- 172.21.15.52:0/3481518361 shutdown_connections 2024-09-10T08:39:03.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.183+0000 7f62a3400640 1 -- 172.21.15.52:0/3481518361 wait complete. 2024-09-10T08:39:03.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.184+0000 7f62a3400640 1 Processor -- start 2024-09-10T08:39:03.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.185+0000 7f62a3400640 1 -- start start 2024-09-10T08:39:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.185+0000 7f62a3400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 0x7f629c13cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.185+0000 7f62a3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.185+0000 7f62a3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f629c145ed0 0x7f629c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f62a3400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f629c1462b0 con 0x7f629c0b5f90 2024-09-10T08:39:03.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f62a3400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f629c0b4b60 con 0x7f629c073180 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f62a3400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f629c146430 con 0x7f629c145ed0 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52506/0 (socket says 172.21.15.52:52506) 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 -- 172.21.15.52:0/3392316482 learned_addr learned my addr 172.21.15.52:0/3392316482 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 0x7f629c13cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 -- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f629c145ed0 msgr2=0x7f629c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f629c145ed0 0x7f629c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 -- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 msgr2=0x7f629c13cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 0x7f629c13cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 -- 172.21.15.52:0/3392316482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629c072590 con 0x7f629c0b5f90 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 0x7f629c13cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.186+0000 7f629be00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f628800c400 tx=0x7f628800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.187+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288017070 con 0x7f629c0b5f90 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.187+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6288005ce0 con 0x7f629c0b5f90 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.187+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62880072d0 con 0x7f629c0b5f90 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.187+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629c072870 con 0x7f629c0b5f90 2024-09-10T08:39:03.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.187+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629c0713f0 con 0x7f629c0b5f90 2024-09-10T08:39:03.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.188+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f629c0b5080 con 0x7f629c0b5f90 2024-09-10T08:39:03.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.189+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f628801a070 con 0x7f629c0b5f90 2024-09-10T08:39:03.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.190+0000 7f6298c00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 0x7f627c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:03.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.190+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f628808a190 con 0x7f629c0b5f90 2024-09-10T08:39:03.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.190+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 0x7f627c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:03.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.191+0000 7f62a0a00640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 0x7f627c06e320 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6290034000 tx=0x7f629002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:03.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.194+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6288058450 con 0x7f629c0b5f90 2024-09-10T08:39:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.449+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f629c072a40 con 0x7f629c0b5f90 2024-09-10T08:39:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.449+0000 7f6298c00640 1 -- 172.21.15.52:0/3392316482 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f628805c750 con 0x7f629c0b5f90 2024-09-10T08:39:03.450 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:03.450 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2578243584,"bytes_avail":770515869696,"bytes_total":773094113280,"write_bytes_sec":44811739,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:03.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.451+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 msgr2=0x7f627c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.451+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 0x7f627c06e320 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6290034000 tx=0x7f629002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:03.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.451+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 msgr2=0x7f629c0cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.451+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f628800c400 tx=0x7f628800c8c0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 shutdown_connections 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627c06be60 0x7f627c06e320 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f629c145ed0 0x7f629c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f629c0b5f90 0x7f629c0cc2f0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 --2- 172.21.15.52:0/3392316482 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629c073180 0x7f629c13cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 >> 172.21.15.52:0/3392316482 conn(0x7f629c0ccec0 msgr2=0x7f629c143a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 shutdown_connections 2024-09-10T08:39:03.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:03.452+0000 7f62a3400640 1 -- 172.21.15.52:0/3392316482 wait complete. 2024-09-10T08:39:03.467 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:04.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:04.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.635+0000 7f3f3ba00640 1 Processor -- start 2024-09-10T08:39:04.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.635+0000 7f3f3ba00640 1 -- start start 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f3ba00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3f34162490 0x7f3f3415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f340b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f3ba00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3415f570 con 0x7f3f3415eab0 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f3ba00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3f340b7040 con 0x7f3f34162490 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3415f850 con 0x7f3f340b66b0 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f39000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3f3415eab0 0x7f3f340d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40478/0 (socket says 172.21.15.52:40478) 2024-09-10T08:39:04.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.636+0000 7f3f39000640 1 -- 172.21.15.52:0/2524398619 learned_addr learned my addr 172.21.15.52:0/2524398619 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33e00640 1 --2- 172.21.15.52:0/2524398619 >> v2:172.21.15.176:3300/0 conn(0x7f3f34162490 0x7f3f3415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f39a00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f340b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545564910 0 0) 0x7f3f3415f570 con 0x7f3f3415eab0 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f1c003520 con 0x7f3f3415eab0 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063954202 0 0) 0x7f3f1c003520 con 0x7f3f3415eab0 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 msgr2=0x7f3f340b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f340b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 >> v2:172.21.15.176:3300/0 conn(0x7f3f34162490 msgr2=0x7f3f3415ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 --2- 172.21.15.52:0/2524398619 >> v2:172.21.15.176:3300/0 conn(0x7f3f34162490 0x7f3f3415ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3415fb30 con 0x7f3f3415eab0 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3f28001670 con 0x7f3f3415eab0 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 >> v1:172.21.15.52:6789/0 conn(0x7f3f3415eab0 legacy=0x7f3f340d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f1c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.637+0000 7f3f33400640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1c003f30 0x7f3f1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33400640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c004d40 0x7f3f1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340b7040 con 0x7f3f1c003f30 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3415f850 con 0x7f3f1c004d40 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c00b9c0 con 0x7f3f340b66b0 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1c003f30 0x7f3f1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f39000640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f1c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f39a00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c004d40 0x7f3f1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 -- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 msgr2=0x7f3f1c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f340b66b0 0x7f3f1c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 -- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c004d40 msgr2=0x7f3f1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c004d40 0x7f3f1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.638+0000 7f3f33e00640 1 -- 172.21.15.52:0/2524398619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3415fb30 con 0x7f3f1c003f30 2024-09-10T08:39:04.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.639+0000 7f3f33e00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1c003f30 0x7f3f1c004800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009ac0 tx=0x7f3f1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b49a22d316d925 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:04.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20036070 con 0x7f3f1c003f30 2024-09-10T08:39:04.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f20031400 con 0x7f3f1c003f30 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f33400640 1 -- 172.21.15.52:0/2524398619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20009690 con 0x7f3f1c003f30 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 -- 172.21.15.52:0/2524398619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1c003f30 msgr2=0x7f3f1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/2524398619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f1c003f30 0x7f3f1c004800 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009ac0 tx=0x7f3f1c005830 comp rx=0 tx=0).stop 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f39a00640 1 -- 172.21.15.52:0/2524398619 reap_dead start 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 -- 172.21.15.52:0/2524398619 shutdown_connections 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 -- 172.21.15.52:0/2524398619 >> 172.21.15.52:0/2524398619 conn(0x7f3f340d16d0 msgr2=0x7f3f340d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 -- 172.21.15.52:0/2524398619 shutdown_connections 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.640+0000 7f3f3ba00640 1 -- 172.21.15.52:0/2524398619 wait complete. 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.642+0000 7f3f3ba00640 1 Processor -- start 2024-09-10T08:39:04.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.642+0000 7f3f3ba00640 1 -- start start 2024-09-10T08:39:04.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c003f30 0x7f3f340cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f3414dd80 0x7f3f340ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340d4460 con 0x7f3f3414f390 2024-09-10T08:39:04.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f340cef20 con 0x7f3f1c003f30 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f3ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3f340d45e0 con 0x7f3f3414dd80 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f39a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f39a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57674/0 (socket says 172.21.15.52:57674) 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f39a00640 1 -- 172.21.15.52:0/3114967833 learned_addr learned my addr 172.21.15.52:0/3114967833 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f39000640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c003f30 0x7f3f340cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.643+0000 7f3f33e00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f3414dd80 0x7f3f340ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 -- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f3414dd80 msgr2=0x7f3f340ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f3414dd80 0x7f3f340ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 -- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c003f30 msgr2=0x7f3f340cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c003f30 0x7f3f340cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 -- 172.21.15.52:0/3114967833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3414e2f0 con 0x7f3f3414f390 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f39a00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3f340d1010 tx=0x7f3f2c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:04.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00fe10 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c01d070 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c015670 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.644+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3414e5d0 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.645+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3414eb90 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.646+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3415f570 con 0x7f3f3414f390 2024-09-10T08:39:04.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.647+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f2c015810 con 0x7f3f3414f390 2024-09-10T08:39:04.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.648+0000 7f3f30c00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 0x7f3f1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:04.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.648+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f3f2c08b5c0 con 0x7f3f3414f390 2024-09-10T08:39:04.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.648+0000 7f3f39000640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 0x7f3f1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:04.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.649+0000 7f3f39000640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 0x7f3f1406e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3f28000fb0 tx=0x7f3f28007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:04.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.652+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f2c010040 con 0x7f3f3414f390 2024-09-10T08:39:04.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.873+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f340d2500 con 0x7f3f3414f390 2024-09-10T08:39:04.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.874+0000 7f3f30c00640 1 -- 172.21.15.52:0/3114967833 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f3f2c059880 con 0x7f3f3414f390 2024-09-10T08:39:04.874 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:04.874 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:04.875 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 msgr2=0x7f3f1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 0x7f3f1406e320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3f28000fb0 tx=0x7f3f28007970 comp rx=0 tx=0).stop 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 msgr2=0x7f3f3414f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3f340d1010 tx=0x7f3f2c00f580 comp rx=0 tx=0).stop 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 shutdown_connections 2024-09-10T08:39:04.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3f1406be60 0x7f3f1406e320 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f3414f390 0x7f3f3414f840 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3f3414dd80 0x7f3f340ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 --2- 172.21.15.52:0/3114967833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f1c003f30 0x7f3f340cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.876+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 >> 172.21.15.52:0/3114967833 conn(0x7f3f340d16d0 msgr2=0x7f3f340b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.877+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 shutdown_connections 2024-09-10T08:39:04.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:04.877+0000 7f3f3ba00640 1 -- 172.21.15.52:0/3114967833 wait complete. 2024-09-10T08:39:04.893 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:04.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.048+0000 7f2e88800640 1 Processor -- start 2024-09-10T08:39:05.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.048+0000 7f2e88800640 1 -- start start 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.049+0000 7f2e88800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e800b2d40 0x7f2e8006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.049+0000 7f2e88800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 0x7f2e8006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.049+0000 7f2e88800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e80071180 con 0x7f2e8015bcf0 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.049+0000 7f2e88800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2e80071ab0 con 0x7f2e800b2d40 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.049+0000 7f2e88800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e80071460 con 0x7f2e8013eb20 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e800b2d40 0x7f2e8006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e800b2d40 0x7f2e8006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57688/0 (socket says 172.21.15.52:57688) 2024-09-10T08:39:05.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 -- 172.21.15.52:0/345556582 learned_addr learned my addr 172.21.15.52:0/345556582 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85400640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 0x7f2e8006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 -- 172.21.15.52:0/345556582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 msgr2=0x7f2e8006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 0x7f2e8006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 -- 172.21.15.52:0/345556582 >> v1:172.21.15.176:6789/0 conn(0x7f2e8015bcf0 legacy=0x7f2e8015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:05.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85e00640 1 -- 172.21.15.52:0/345556582 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80071740 con 0x7f2e800b2d40 2024-09-10T08:39:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.050+0000 7f2e85400640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 0x7f2e8006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.051+0000 7f2e85e00640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e800b2d40 0x7f2e8006bc10 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2e80071c30 tx=0x7f2e7402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0388b469fa0bbf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.051+0000 7f2e84a00640 1 -- 172.21.15.52:0/345556582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74037070 con 0x7f2e800b2d40 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.051+0000 7f2e84a00640 1 -- 172.21.15.52:0/345556582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74032440 con 0x7f2e800b2d40 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.051+0000 7f2e84a00640 1 -- 172.21.15.52:0/345556582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74032810 con 0x7f2e800b2d40 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 -- 172.21.15.52:0/345556582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e800b2d40 msgr2=0x7f2e8006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e800b2d40 0x7f2e8006bc10 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f2e80071c30 tx=0x7f2e7402a200 comp rx=0 tx=0).stop 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 -- 172.21.15.52:0/345556582 shutdown_connections 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8013eb20 0x7f2e8006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 --2- 172.21.15.52:0/345556582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e800b2d40 0x7f2e8006bc10 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 -- 172.21.15.52:0/345556582 >> 172.21.15.52:0/345556582 conn(0x7f2e800ccec0 msgr2=0x7f2e800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 -- 172.21.15.52:0/345556582 shutdown_connections 2024-09-10T08:39:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.052+0000 7f2e88800640 1 -- 172.21.15.52:0/345556582 wait complete. 2024-09-10T08:39:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.053+0000 7f2e88800640 1 Processor -- start 2024-09-10T08:39:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.054+0000 7f2e88800640 1 -- start start 2024-09-10T08:39:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.054+0000 7f2e88800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e800b2d40 0x7f2e8013be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.054+0000 7f2e88800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.054+0000 7f2e88800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8015bcf0 0x7f2e800b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e88800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e800722d0 con 0x7f2e8013eb20 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e88800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80072150 con 0x7f2e800b2d40 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e88800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e80072450 con 0x7f2e8015bcf0 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57690/0 (socket says 172.21.15.52:57690) 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 -- 172.21.15.52:0/1456587749 learned_addr learned my addr 172.21.15.52:0/1456587749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85e00640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e800b2d40 0x7f2e8013be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e86800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8015bcf0 0x7f2e800b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 -- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8015bcf0 msgr2=0x7f2e800b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8015bcf0 0x7f2e800b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 -- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e800b2d40 msgr2=0x7f2e8013be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e800b2d40 0x7f2e8013be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.055+0000 7f2e85400640 1 -- 172.21.15.52:0/1456587749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80150cc0 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e85400640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000c7f0 tx=0x7f2e7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70004230 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e700043d0 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70007a10 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80150fa0 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.056+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80151560 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.057+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e800728e0 con 0x7f2e8013eb20 2024-09-10T08:39:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.058+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e70007bb0 con 0x7f2e8013eb20 2024-09-10T08:39:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.059+0000 7f2e7a000640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.059+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f2e7008aea0 con 0x7f2e8013eb20 2024-09-10T08:39:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.059+0000 7f2e85e00640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.060+0000 7f2e85e00640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2e74034000 tx=0x7f2e7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.063+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e70015020 con 0x7f2e8013eb20 2024-09-10T08:39:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.318+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2e8006c9c0 con 0x7f2e8013eb20 2024-09-10T08:39:05.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.319+0000 7f2e7a000640 1 -- 172.21.15.52:0/1456587749 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f2e70059160 con 0x7f2e8013eb20 2024-09-10T08:39:05.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:05.319 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":644,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076572883,"bytes_used":2578243584,"bytes_avail":770515869696,"bytes_total":773094113280,"write_bytes_sec":25065232,"read_op_per_sec":0,"write_op_per_sec":25},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:05.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 msgr2=0x7f2e6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:05.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2e74034000 tx=0x7f2e7402e000 comp rx=0 tx=0).stop 2024-09-10T08:39:05.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 msgr2=0x7f2e8015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:05.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000c7f0 tx=0x7f2e7000ccb0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 shutdown_connections 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e6406be30 0x7f2e6406e2f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e8015bcf0 0x7f2e800b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e8013eb20 0x7f2e8015cac0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 --2- 172.21.15.52:0/1456587749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e800b2d40 0x7f2e8013be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 >> 172.21.15.52:0/1456587749 conn(0x7f2e800ccec0 msgr2=0x7f2e80153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 shutdown_connections 2024-09-10T08:39:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:05.321+0000 7f2e88800640 1 -- 172.21.15.52:0/1456587749 wait complete. 2024-09-10T08:39:05.337 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:06.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:06.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.505+0000 7fafcdc00640 1 Processor -- start 2024-09-10T08:39:06.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.505+0000 7fafcdc00640 1 -- start start 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.506+0000 7fafcdc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fafc815eab0 0x7fafc815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.506+0000 7fafcdc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc815f570 con 0x7fafc80b66b0 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.506+0000 7fafcdc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc815f850 con 0x7fafc8162490 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.506+0000 7fafcdc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fafc815fb30 con 0x7fafc815eab0 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fafc80b66b0 0x7fafc80b6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40486/0 (socket says 172.21.15.52:40486) 2024-09-10T08:39:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc7400640 1 -- 172.21.15.52:0/3643062464 learned_addr learned my addr 172.21.15.52:0/3643062464 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3643062464 >> v2:172.21.15.176:3300/0 conn(0x7fafc815eab0 0x7fafc815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641463117 0 0) 0x7fafc815f570 con 0x7fafc80b66b0 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafac003520 con 0x7fafc80b66b0 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3547077728 0 0) 0x7fafac003520 con 0x7fafc80b66b0 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 >> v2:172.21.15.176:3300/0 conn(0x7fafc815eab0 msgr2=0x7fafc815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:06.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 --2- 172.21.15.52:0/3643062464 >> v2:172.21.15.176:3300/0 conn(0x7fafc815eab0 0x7fafc815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 >> v1:172.21.15.176:6789/0 conn(0x7fafc8162490 legacy=0x7fafc80d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc815fe10 con 0x7fafc80b66b0 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.507+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fafc00019f0 con 0x7fafc80b66b0 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 >> v1:172.21.15.52:6789/0 conn(0x7fafc80b66b0 legacy=0x7fafc80b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 0x7fafac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac004800 0x7fafac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafac0051c0 0x7fafac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fafc815fb30 con 0x7fafac0039b0 2024-09-10T08:39:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafac00c060 con 0x7fafac004800 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafac00c260 con 0x7fafac0051c0 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 0x7fafac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc7400640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafac0051c0 0x7fafac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafbfe00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac004800 0x7fafac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 -- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafac0051c0 msgr2=0x7fafac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafac0051c0 0x7fafac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 -- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac004800 msgr2=0x7fafac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac004800 0x7fafac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc6a00640 1 -- 172.21.15.52:0/3643062464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac003520 con 0x7fafac0039b0 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafbfe00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac004800 0x7fafac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:06.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.508+0000 7fafc7400640 1 -- 172.21.15.52:0/3643062464 reap_dead start 2024-09-10T08:39:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.509+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 0x7fafac003dd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009ac0 tx=0x7fafac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3020ef22c3e4bdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.509+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8036070 con 0x7fafac0039b0 2024-09-10T08:39:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.509+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb8031400 con 0x7fafac0039b0 2024-09-10T08:39:06.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.509+0000 7fafc6000640 1 -- 172.21.15.52:0/3643062464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8009690 con 0x7fafac0039b0 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 -- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 msgr2=0x7fafac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 0x7fafac003dd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009ac0 tx=0x7fafac005830 comp rx=0 tx=0).stop 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 -- 172.21.15.52:0/3643062464 shutdown_connections 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3643062464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafac0039b0 0x7fafac003dd0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 -- 172.21.15.52:0/3643062464 >> 172.21.15.52:0/3643062464 conn(0x7fafc80d16d0 msgr2=0x7fafc80d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 -- 172.21.15.52:0/3643062464 shutdown_connections 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.510+0000 7fafcdc00640 1 -- 172.21.15.52:0/3643062464 wait complete. 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.512+0000 7fafcdc00640 1 Processor -- start 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.512+0000 7fafcdc00640 1 -- start start 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 0x7fafc815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 0x7fafc80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80d45e0 con 0x7fafc81e91d0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80d4460 con 0x7fafac0039b0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafcdc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fafc815ee90 con 0x7fafc80cccd0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafc7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafc7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57708/0 (socket says 172.21.15.52:57708) 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafc7400640 1 -- 172.21.15.52:0/3335625811 learned_addr learned my addr 172.21.15.52:0/3335625811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafbfe00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 0x7fafc80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.513+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 0x7fafc815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 -- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 msgr2=0x7fafc80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 0x7fafc80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 -- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 msgr2=0x7fafc815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 0x7fafc815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 -- 172.21.15.52:0/3335625811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc81e9f70 con 0x7fafc81e91d0 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 0x7fafc815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:06.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafbfe00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 0x7fafc80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafc7400640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005fd0 tx=0x7fafc0007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc000ea10 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc000ebb0 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc000ed80 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc80c8db0 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.514+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc80c8a60 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.515+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc815f570 con 0x7fafc81e91d0 2024-09-10T08:39:06.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.516+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafc001a020 con 0x7fafc81e91d0 2024-09-10T08:39:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.518+0000 7fafbea00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 0x7fafa406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.518+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fafc008a7b0 con 0x7fafc81e91d0 2024-09-10T08:39:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.518+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 0x7fafa406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.519+0000 7fafc6a00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 0x7fafa406e320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fafb8033000 tx=0x7fafb8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.522+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafc0021020 con 0x7fafc81e91d0 2024-09-10T08:39:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.743+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafc80d2500 con 0x7fafc81e91d0 2024-09-10T08:39:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.744+0000 7fafbea00640 1 -- 172.21.15.52:0/3335625811 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7fafc00590c0 con 0x7fafc81e91d0 2024-09-10T08:39:06.744 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:06.744 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 msgr2=0x7fafa406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 0x7fafa406e320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fafb8033000 tx=0x7fafb8008030 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 msgr2=0x7fafc81e9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005fd0 tx=0x7fafc0007af0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 shutdown_connections 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafa406be60 0x7fafa406e320 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafc81e91d0 0x7fafc81e9650 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fafc80cccd0 0x7fafc80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 --2- 172.21.15.52:0/3335625811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fafac0039b0 0x7fafc815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 >> 172.21.15.52:0/3335625811 conn(0x7fafc80d16d0 msgr2=0x7fafc815cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 shutdown_connections 2024-09-10T08:39:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.746+0000 7fafcdc00640 1 -- 172.21.15.52:0/3335625811 wait complete. 2024-09-10T08:39:06.762 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:06.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:06.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.917+0000 7f4cede00640 1 Processor -- start 2024-09-10T08:39:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.917+0000 7f4cede00640 1 -- start start 2024-09-10T08:39:06.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4cede00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ce80d46d0 0x7f4ce80d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4cede00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce80d2610 con 0x7f4ce815e9a0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4cede00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce80d2d10 con 0x7f4ce815e5c0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4cede00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce80d5080 con 0x7f4ce80d46d0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4ce7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4ce815e9a0 0x7f4ce80cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40498/0 (socket says 172.21.15.52:40498) 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.918+0000 7f4ce7e00640 1 -- 172.21.15.52:0/2074752367 learned_addr learned my addr 172.21.15.52:0/2074752367 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ced400640 1 --2- 172.21.15.52:0/2074752367 >> v2:172.21.15.176:3300/0 conn(0x7f4ce80d46d0 0x7f4ce80d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 689761685 0 0) 0x7f4cd4001110 con 0x7f4ce815e9a0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd0003520 con 0x7f4ce815e9a0 2024-09-10T08:39:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741524547 0 0) 0x7f4ce80d2d10 con 0x7f4ce815e5c0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd4001110 con 0x7f4ce815e5c0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489170390 0 0) 0x7f4cd0003520 con 0x7f4ce815e9a0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ced400640 1 -- 172.21.15.52:0/2074752367 >> v1:172.21.15.176:6789/0 conn(0x7f4ce815e5c0 legacy=0x7f4ce80d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ced400640 1 -- 172.21.15.52:0/2074752367 >> v1:172.21.15.52:6789/0 conn(0x7f4ce815e9a0 legacy=0x7f4ce80cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.919+0000 7f4ced400640 1 -- 172.21.15.52:0/2074752367 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80d2ff0 con 0x7f4ce80d46d0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.920+0000 7f4ced400640 1 --2- 172.21.15.52:0/2074752367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80d4b40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009d90 tx=0x7f4ce002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c00b876f6af9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.920+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4001840 con 0x7f4ce80d46d0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce0007540 con 0x7f4ce80d46d0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4ce7400640 1 -- 172.21.15.52:0/2074752367 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00078f0 con 0x7f4ce80d46d0 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 -- 172.21.15.52:0/2074752367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 msgr2=0x7f4ce80d4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 --2- 172.21.15.52:0/2074752367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80d4b40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009d90 tx=0x7f4ce002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 -- 172.21.15.52:0/2074752367 shutdown_connections 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 --2- 172.21.15.52:0/2074752367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80d4b40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 -- 172.21.15.52:0/2074752367 >> 172.21.15.52:0/2074752367 conn(0x7f4ce806c030 msgr2=0x7f4ce806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 -- 172.21.15.52:0/2074752367 shutdown_connections 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.921+0000 7f4cede00640 1 -- 172.21.15.52:0/2074752367 wait complete. 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.923+0000 7f4cede00640 1 Processor -- start 2024-09-10T08:39:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.923+0000 7f4cede00640 1 -- start start 2024-09-10T08:39:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ce815e5c0 0x7f4ce8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80d3890 con 0x7f4ce815e9a0 2024-09-10T08:39:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80d35b0 con 0x7f4ce80d46d0 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4cede00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce80cfeb0 con 0x7f4ce815e5c0 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4ced400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4ced400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57714/0 (socket says 172.21.15.52:57714) 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4ced400640 1 -- 172.21.15.52:0/2498529191 learned_addr learned my addr 172.21.15.52:0/2498529191 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4ce7e00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ce815e5c0 0x7f4ce8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.924+0000 7f4ceca00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 -- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ce815e5c0 msgr2=0x7f4ce8154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ce815e5c0 0x7f4ce8154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 -- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 msgr2=0x7f4ce80c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:06.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 -- 172.21.15.52:0/2498529191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80b52a0 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ceca00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ced400640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4ce002abe0 tx=0x7f4ce0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce003f070 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce0031c40 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0009450 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce80cc670 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.925+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce80c9ce0 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.926+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce80d4b40 con 0x7f4ce815e9a0 2024-09-10T08:39:06.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.928+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce0043410 con 0x7f4ce815e9a0 2024-09-10T08:39:06.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.928+0000 7f4ce4c00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:06.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.928+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce00ac0d0 con 0x7f4ce815e9a0 2024-09-10T08:39:06.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.929+0000 7f4ceca00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:06.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.929+0000 7f4ceca00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 0x7f4cc806e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc001710 tx=0x7f4cdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:06.933+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce007aa70 con 0x7f4ce815e9a0 2024-09-10T08:39:07.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.185+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4ce80d19d0 con 0x7f4ce815e9a0 2024-09-10T08:39:07.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.185+0000 7f4ce4c00640 1 -- 172.21.15.52:0/2498529191 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f4ce007a370 con 0x7f4ce815e9a0 2024-09-10T08:39:07.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:07.186 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":646,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076577230,"bytes_used":2578251776,"bytes_avail":770515861504,"bytes_total":773094113280,"write_bytes_sec":25065924,"read_op_per_sec":0,"write_op_per_sec":25},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 msgr2=0x7f4cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 0x7f4cc806e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc001710 tx=0x7f4cdc009040 comp rx=0 tx=0).stop 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 msgr2=0x7f4ce8160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4ce002abe0 tx=0x7f4ce0004a40 comp rx=0 tx=0).stop 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 shutdown_connections 2024-09-10T08:39:07.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4cc806be30 0x7f4cc806e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce815e9a0 0x7f4ce8160c60 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ce815e5c0 0x7f4ce8154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 --2- 172.21.15.52:0/2498529191 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ce80d46d0 0x7f4ce80c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.187+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 >> 172.21.15.52:0/2498529191 conn(0x7f4ce806c030 msgr2=0x7f4ce80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.188+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 shutdown_connections 2024-09-10T08:39:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:07.188+0000 7f4cede00640 1 -- 172.21.15.52:0/2498529191 wait complete. 2024-09-10T08:39:07.205 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:07.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:07.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:08.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.369+0000 7f1aa2200640 1 Processor -- start 2024-09-10T08:39:08.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.369+0000 7f1aa2200640 1 -- start start 2024-09-10T08:39:08.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1aa2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a9c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1aa2200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1a9c1624b0 0x7f1a9c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1aa2200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a9c15f590 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1aa2200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9c15f870 con 0x7f1a9c1624b0 2024-09-10T08:39:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1aa2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c15fb50 con 0x7f1a9c15eb60 2024-09-10T08:39:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1a9be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a9c0b66a0 0x7f1a9c0d3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40500/0 (socket says 172.21.15.52:40500) 2024-09-10T08:39:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.370+0000 7f1a9be00640 1 -- 172.21.15.52:0/3756066998 learned_addr learned my addr 172.21.15.52:0/3756066998 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9aa00640 1 --2- 172.21.15.52:0/3756066998 >> v2:172.21.15.176:3300/0 conn(0x7f1a9c1624b0 0x7f1a9c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9b400640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a9c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131216327 0 0) 0x7f1a9c15f590 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a80003520 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2174775273 0 0) 0x7f1a80003520 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 msgr2=0x7f1a9c15ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a9c15ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 >> v2:172.21.15.176:3300/0 conn(0x7f1a9c1624b0 msgr2=0x7f1a9c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 --2- 172.21.15.52:0/3756066998 >> v2:172.21.15.176:3300/0 conn(0x7f1a9c1624b0 0x7f1a9c0d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c15fe30 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f1a940019f0 con 0x7f1a9c0b66a0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 >> v1:172.21.15.52:6789/0 conn(0x7f1a9c0b66a0 legacy=0x7f1a9c0d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a800039b0 0x7f1a80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c15f870 con 0x7f1a80004d40 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c15fb50 con 0x7f1a800039b0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.371+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8000ba90 con 0x7f1a9c15eb60 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9aa00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9b400640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a800039b0 0x7f1a80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 -- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 msgr2=0x7f1a80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 -- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a800039b0 msgr2=0x7f1a80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:08.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a800039b0 0x7f1a80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9be00640 1 -- 172.21.15.52:0/3756066998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a80003520 con 0x7f1a80004d40 2024-09-10T08:39:08.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.372+0000 7f1a9aa00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15eb60 0x7f1a80004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.373+0000 7f1a9be00640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a800051c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400a7d0 tx=0x7f1a80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2062cd77ebdf02e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.373+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400a3f0 con 0x7f1a80004d40 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.373+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9402f070 con 0x7f1a80004d40 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.373+0000 7f1a9a000640 1 -- 172.21.15.52:0/3756066998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9402bc50 con 0x7f1a80004d40 2024-09-10T08:39:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 -- 172.21.15.52:0/3756066998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 msgr2=0x7f1a800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 --2- 172.21.15.52:0/3756066998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a800051c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400a7d0 tx=0x7f1a80005830 comp rx=0 tx=0).stop 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1a9be00640 1 -- 172.21.15.52:0/3756066998 reap_dead start 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 -- 172.21.15.52:0/3756066998 shutdown_connections 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 -- 172.21.15.52:0/3756066998 >> 172.21.15.52:0/3756066998 conn(0x7f1a9c0d16f0 msgr2=0x7f1a9c0d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 -- 172.21.15.52:0/3756066998 shutdown_connections 2024-09-10T08:39:08.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.374+0000 7f1aa2200640 1 -- 172.21.15.52:0/3756066998 wait complete. 2024-09-10T08:39:08.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.376+0000 7f1aa2200640 1 Processor -- start 2024-09-10T08:39:08.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.376+0000 7f1aa2200640 1 -- start start 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15b9f0 0x7f1a9c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 0x7f1a9c0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c0d4480 con 0x7f1a80004d40 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9c0d3190 con 0x7f1a9c0c94c0 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1aa2200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9c0d4600 con 0x7f1a9c15b9f0 2024-09-10T08:39:08.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57736/0 (socket says 172.21.15.52:57736) 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 -- 172.21.15.52:0/1993746990 learned_addr learned my addr 172.21.15.52:0/1993746990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 -- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15b9f0 msgr2=0x7f1a9c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15b9f0 0x7f1a9c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9be00640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 0x7f1a9c0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 -- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 msgr2=0x7f1a9c0c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 0x7f1a9c0c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9b400640 1 -- 172.21.15.52:0/1993746990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c0c8420 con 0x7f1a80004d40 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.377+0000 7f1a9be00640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 0x7f1a9c0c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1a9b400640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0118e0 tx=0x7f1a8c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00fa90 con 0x7f1a80004d40 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00fc30 con 0x7f1a80004d40 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c014440 con 0x7f1a80004d40 2024-09-10T08:39:08.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9c0c8700 con 0x7f1a80004d40 2024-09-10T08:39:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.378+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9c0c8cc0 con 0x7f1a80004d40 2024-09-10T08:39:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.379+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9c15f590 con 0x7f1a80004d40 2024-09-10T08:39:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.380+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a8c012040 con 0x7f1a80004d40 2024-09-10T08:39:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.381+0000 7f1a93400640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 0x7f1a7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.381+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f1a8c08b570 con 0x7f1a80004d40 2024-09-10T08:39:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.382+0000 7f1a9aa00640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 0x7f1a7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.382+0000 7f1a9aa00640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 0x7f1a7c06e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1a88006a90 tx=0x7f1a88006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.386+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a8c019030 con 0x7f1a80004d40 2024-09-10T08:39:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.608+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a9c0d2520 con 0x7f1a80004d40 2024-09-10T08:39:08.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.609+0000 7f1a93400640 1 -- 172.21.15.52:0/1993746990 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f1a8c089e20 con 0x7f1a80004d40 2024-09-10T08:39:08.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:08.610 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:08.610 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:08.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 msgr2=0x7f1a7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 0x7f1a7c06e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1a88006a90 tx=0x7f1a88006a20 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 msgr2=0x7f1a9c1f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0118e0 tx=0x7f1a8c011da0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 shutdown_connections 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a7c06be30 0x7f1a7c06e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a9c0c94c0 0x7f1a9c0c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9c15b9f0 0x7f1a9c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 --2- 172.21.15.52:0/1993746990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a80004d40 0x7f1a9c1f3e40 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 >> 172.21.15.52:0/1993746990 conn(0x7f1a9c0d16f0 msgr2=0x7f1a9c0cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 shutdown_connections 2024-09-10T08:39:08.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.611+0000 7f1aa2200640 1 -- 172.21.15.52:0/1993746990 wait complete. 2024-09-10T08:39:08.627 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:08.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:08.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.782+0000 7fc233200640 1 Processor -- start 2024-09-10T08:39:08.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.782+0000 7fc233200640 1 -- start start 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.783+0000 7fc233200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc22c0b6dc0 0x7fc22c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.783+0000 7fc233200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c15f570 con 0x7fc22c15eab0 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.783+0000 7fc233200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22c15f850 con 0x7fc22c162490 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.783+0000 7fc233200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc22c15fb30 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc22be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc22c15eab0 0x7fc22c0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40516/0 (socket says 172.21.15.52:40516) 2024-09-10T08:39:08.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc22be00640 1 -- 172.21.15.52:0/2916502718 learned_addr learned my addr 172.21.15.52:0/2916502718 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc231200640 1 --2- 172.21.15.52:0/2916502718 >> v2:172.21.15.176:3300/0 conn(0x7fc22c0b6dc0 0x7fc22c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280400724 0 0) 0x7fc22c15f570 con 0x7fc22c15eab0 2024-09-10T08:39:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc210003520 con 0x7fc22c15eab0 2024-09-10T08:39:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631758199 0 0) 0x7fc22c15f850 con 0x7fc22c162490 2024-09-10T08:39:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc231200640 1 -- 172.21.15.52:0/2916502718 >> v1:172.21.15.176:6789/0 conn(0x7fc22c162490 legacy=0x7fc22c0b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc231200640 1 -- 172.21.15.52:0/2916502718 >> v1:172.21.15.52:6789/0 conn(0x7fc22c15eab0 legacy=0x7fc22c0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.784+0000 7fc231200640 1 -- 172.21.15.52:0/2916502718 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c15fe10 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.786+0000 7fc231200640 1 --2- 172.21.15.52:0/2916502718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ee90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e542bfbd704f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.786+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224035020 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.786+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc224007540 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.786+0000 7fc22b400640 1 -- 172.21.15.52:0/2916502718 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c001670 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 -- 172.21.15.52:0/2916502718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 msgr2=0x7fc22c15ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 --2- 172.21.15.52:0/2916502718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ee90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22402a660 comp rx=0 tx=0).stop 2024-09-10T08:39:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 -- 172.21.15.52:0/2916502718 shutdown_connections 2024-09-10T08:39:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 --2- 172.21.15.52:0/2916502718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ee90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 -- 172.21.15.52:0/2916502718 >> 172.21.15.52:0/2916502718 conn(0x7fc22c0d16d0 msgr2=0x7fc22c0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 -- 172.21.15.52:0/2916502718 shutdown_connections 2024-09-10T08:39:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.787+0000 7fc233200640 1 -- 172.21.15.52:0/2916502718 wait complete. 2024-09-10T08:39:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.788+0000 7fc233200640 1 Processor -- start 2024-09-10T08:39:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.789+0000 7fc233200640 1 -- start start 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 0x7fc22c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c0d45e0 con 0x7fc22c15eab0 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c0d4460 con 0x7fc22c0b6dc0 2024-09-10T08:39:08.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc233200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc22c0d35e0 con 0x7fc22c162490 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57740/0 (socket says 172.21.15.52:57740) 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 -- 172.21.15.52:0/871598105 learned_addr learned my addr 172.21.15.52:0/871598105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc22be00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc231200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 0x7fc22c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 -- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 msgr2=0x7fc22c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 0x7fc22c0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 -- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 msgr2=0x7fc22c15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc223e00640 1 -- 172.21.15.52:0/871598105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c0ca7f0 con 0x7fc22c15eab0 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.790+0000 7fc231200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 0x7fc22c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc223e00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c410 tx=0x7fc21400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214017070 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2140035f0 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2140039e0 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c0caad0 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.791+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c0cb090 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.792+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22c15f850 con 0x7fc22c15eab0 2024-09-10T08:39:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.793+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc21401a070 con 0x7fc22c15eab0 2024-09-10T08:39:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.794+0000 7fc228c00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 0x7fc20806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.794+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc21408a240 con 0x7fc22c15eab0 2024-09-10T08:39:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.794+0000 7fc22be00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 0x7fc20806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.795+0000 7fc22be00640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 0x7fc20806e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001600 tx=0x7fc21c001570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:08.798+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc214058590 con 0x7fc22c15eab0 2024-09-10T08:39:09.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.048+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc22c0ba7b0 con 0x7fc22c15eab0 2024-09-10T08:39:09.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.049+0000 7fc228c00640 1 -- 172.21.15.52:0/871598105 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1641 (secure 0 0 0) 0x7fc21405c890 con 0x7fc22c15eab0 2024-09-10T08:39:09.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:09.049 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":648,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076577230,"bytes_used":2578251776,"bytes_avail":770515861504,"bytes_total":773094113280,"write_bytes_sec":3177384,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-10T08:38:59.606880+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-10T08:39:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 msgr2=0x7fc20806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 0x7fc20806e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc21c001600 tx=0x7fc21c001570 comp rx=0 tx=0).stop 2024-09-10T08:39:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 msgr2=0x7fc22c06e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:09.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c410 tx=0x7fc21400c8d0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 shutdown_connections 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc20806be30 0x7fc20806e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc22c162490 0x7fc22c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc22c15eab0 0x7fc22c06e0f0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 --2- 172.21.15.52:0/871598105 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc22c0b6dc0 0x7fc22c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 >> 172.21.15.52:0/871598105 conn(0x7fc22c0d16d0 msgr2=0x7fc22c0b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 shutdown_connections 2024-09-10T08:39:09.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:09.051+0000 7fc233200640 1 -- 172.21.15.52:0/871598105 wait complete. 2024-09-10T08:39:09.066 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-10T08:39:10.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:10.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.235+0000 7fdcdf200640 1 Processor -- start 2024-09-10T08:39:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.235+0000 7fdcdf200640 1 -- start start 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 0x7fdce00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdf200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 0x7fdce00b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdf200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce00d3990 con 0x7fdce00cf450 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdf200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdce00d3c70 con 0x7fdce00b6710 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdce00d3f50 con 0x7fdce015e440 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.236+0000 7fdcdde00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 0x7fdce00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcde800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 0x7fdce00b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcde800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 0x7fdce00b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:49492/0 (socket says 172.21.15.52:49492) 2024-09-10T08:39:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcde800640 1 -- 172.21.15.52:0/3404630874 learned_addr learned my addr 172.21.15.52:0/3404630874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcdde00640 1 -- 172.21.15.52:0/3404630874 >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 msgr2=0x7fdce00b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:10.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcdde00640 1 --2- 172.21.15.52:0/3404630874 >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 0x7fdce00b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcdde00640 1 -- 172.21.15.52:0/3404630874 >> v1:172.21.15.176:6789/0 conn(0x7fdce00cf450 legacy=0x7fdce00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.237+0000 7fdcdde00640 1 -- 172.21.15.52:0/3404630874 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce00d4230 con 0x7fdce015e440 2024-09-10T08:39:10.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.238+0000 7fdcdde00640 1 --2- 172.21.15.52:0/3404630874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 0x7fdce00d3240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097a0 tx=0x7fdcd002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4221dbce717ca21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.238+0000 7fdcdd400640 1 -- 172.21.15.52:0/3404630874 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0037070 con 0x7fdce015e440 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdd400640 1 -- 172.21.15.52:0/3404630874 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd0032440 con 0x7fdce015e440 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdd400640 1 -- 172.21.15.52:0/3404630874 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0032810 con 0x7fdce015e440 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 -- 172.21.15.52:0/3404630874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 msgr2=0x7fdce00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 --2- 172.21.15.52:0/3404630874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 0x7fdce00d3240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097a0 tx=0x7fdcd002a210 comp rx=0 tx=0).stop 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 -- 172.21.15.52:0/3404630874 shutdown_connections 2024-09-10T08:39:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 --2- 172.21.15.52:0/3404630874 >> v2:172.21.15.176:3300/0 conn(0x7fdce00b6710 0x7fdce00b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 --2- 172.21.15.52:0/3404630874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce015e440 0x7fdce00d3240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 -- 172.21.15.52:0/3404630874 >> 172.21.15.52:0/3404630874 conn(0x7fdce0067f80 msgr2=0x7fdce00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 -- 172.21.15.52:0/3404630874 shutdown_connections 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.239+0000 7fdcdf200640 1 -- 172.21.15.52:0/3404630874 wait complete. 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.241+0000 7fdcdf200640 1 Processor -- start 2024-09-10T08:39:10.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.241+0000 7fdcdf200640 1 -- start start 2024-09-10T08:39:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce00cf450 0x7fdce0158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce015e440 0x7fdce01f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdce00b76c0 con 0x7fdce00b6710 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdce00b7540 con 0x7fdce015e440 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdce00b80a0 con 0x7fdce00cf450 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdde00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57744/0 (socket says 172.21.15.52:57744) 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcdde00640 1 -- 172.21.15.52:0/2608527608 learned_addr learned my addr 172.21.15.52:0/2608527608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcd7e00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce00cf450 0x7fdce0158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.242+0000 7fdcde800640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce015e440 0x7fdce01f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 -- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce00cf450 msgr2=0x7fdce0158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce00cf450 0x7fdce0158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 -- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce015e440 msgr2=0x7fdce01f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce015e440 0x7fdce01f70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 -- 172.21.15.52:0/2608527608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce0159660 con 0x7fdce00b6710 2024-09-10T08:39:10.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdde00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000c00 tx=0x7fdcd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0037040 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd0042070 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0030920 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.243+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce0159940 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.244+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0159f00 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.245+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce00b7b60 con 0x7fdce00b6710 2024-09-10T08:39:10.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.246+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcd0030ac0 con 0x7fdce00b6710 2024-09-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.246+0000 7fdcd6000640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 0x7fdcbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.247+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fdcd00ab640 con 0x7fdce00b6710 2024-09-10T08:39:10.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.247+0000 7fdcd7e00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 0x7fdcbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.248+0000 7fdcd7e00640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 0x7fdcbc06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdce01581b0 tx=0x7fdcc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.251+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcd0079990 con 0x7fdce00b6710 2024-09-10T08:39:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.469+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdce00b5e40 con 0x7fdce00b6710 2024-09-10T08:39:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.470+0000 7fdcd6000640 1 -- 172.21.15.52:0/2608527608 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7fdcd007ee20 con 0x7fdce00b6710 2024-09-10T08:39:10.471 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:10.471 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 msgr2=0x7fdcbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 0x7fdcbc06e2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fdce01581b0 tx=0x7fdcc8009040 comp rx=0 tx=0).stop 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 msgr2=0x7fdce0160cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000c00 tx=0x7fdcd00046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 shutdown_connections 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdcbc06be30 0x7fdcbc06e2f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdce015e440 0x7fdce01f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdce00cf450 0x7fdce0158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 --2- 172.21.15.52:0/2608527608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdce00b6710 0x7fdce0160cc0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 >> 172.21.15.52:0/2608527608 conn(0x7fdce0067f80 msgr2=0x7fdce00b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 shutdown_connections 2024-09-10T08:39:10.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.472+0000 7fdcdf200640 1 -- 172.21.15.52:0/2608527608 wait complete. 2024-09-10T08:39:10.489 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:10.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.644+0000 7fcdec600640 1 Processor -- start 2024-09-10T08:39:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.644+0000 7fcdec600640 1 -- start start 2024-09-10T08:39:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcdec600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcde40720b0 0x7fcde415b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcdec600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde4072500 con 0x7fcde415ab40 2024-09-10T08:39:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcdec600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde4071010 con 0x7fcde406c6a0 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcdec600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcde406cb10 con 0x7fcde40720b0 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcde9c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcde415ab40 0x7fcde4073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40522/0 (socket says 172.21.15.52:40522) 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcde9c00640 1 -- 172.21.15.52:0/2517614543 learned_addr learned my addr 172.21.15.52:0/2517614543 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcdea600640 1 --2- 172.21.15.52:0/2517614543 >> v2:172.21.15.176:3300/0 conn(0x7fcde40720b0 0x7fcde415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501401377 0 0) 0x7fcde4072500 con 0x7fcde415ab40 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdcc003520 con 0x7fcde415ab40 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.646+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021959671 0 0) 0x7fcde4071010 con 0x7fcde406c6a0 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.647+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde4072500 con 0x7fcde406c6a0 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.647+0000 7fcdea600640 1 -- 172.21.15.52:0/2517614543 >> v1:172.21.15.176:6789/0 conn(0x7fcde406c6a0 legacy=0x7fcde415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.647+0000 7fcdea600640 1 -- 172.21.15.52:0/2517614543 >> v1:172.21.15.52:6789/0 conn(0x7fcde415ab40 legacy=0x7fcde4073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.647+0000 7fcdea600640 1 -- 172.21.15.52:0/2517614543 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde40712f0 con 0x7fcde40720b0 2024-09-10T08:39:10.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcdea600640 1 --2- 172.21.15.52:0/2517614543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde40720b0 0x7fcde415b630 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00aea0 tx=0x7fcddc02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a8a2f2d821cc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc037070 con 0x7fcde40720b0 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcddc008640 con 0x7fcde40720b0 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcde3e00640 1 -- 172.21.15.52:0/2517614543 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0089f0 con 0x7fcde40720b0 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcdec600640 1 -- 172.21.15.52:0/2517614543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde40720b0 msgr2=0x7fcde415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.648+0000 7fcdec600640 1 --2- 172.21.15.52:0/2517614543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde40720b0 0x7fcde415b630 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00aea0 tx=0x7fcddc02b7b0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.649+0000 7fcdec600640 1 -- 172.21.15.52:0/2517614543 shutdown_connections 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.649+0000 7fcdec600640 1 --2- 172.21.15.52:0/2517614543 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde40720b0 0x7fcde415b630 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.649+0000 7fcdec600640 1 -- 172.21.15.52:0/2517614543 >> 172.21.15.52:0/2517614543 conn(0x7fcde40ccec0 msgr2=0x7fcde40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.649+0000 7fcdec600640 1 -- 172.21.15.52:0/2517614543 shutdown_connections 2024-09-10T08:39:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.649+0000 7fcdec600640 1 -- 172.21.15.52:0/2517614543 wait complete. 2024-09-10T08:39:10.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.650+0000 7fcdec600640 1 Processor -- start 2024-09-10T08:39:10.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.650+0000 7fcdec600640 1 -- start start 2024-09-10T08:39:10.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde40720b0 0x7fcde4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde415ab40 0x7fcde40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40718b0 con 0x7fcde406c6a0 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcde406bc10 con 0x7fcde415ab40 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.651+0000 7fcdec600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcde406bd90 con 0x7fcde40720b0 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57758/0 (socket says 172.21.15.52:57758) 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 -- 172.21.15.52:0/843498095 learned_addr learned my addr 172.21.15.52:0/843498095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9200640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde40720b0 0x7fcde4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcdea600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde415ab40 0x7fcde40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 -- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde40720b0 msgr2=0x7fcde4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde40720b0 0x7fcde4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 -- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde415ab40 msgr2=0x7fcde40cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde415ab40 0x7fcde40cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 -- 172.21.15.52:0/843498095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde40aba70 con 0x7fcde406c6a0 2024-09-10T08:39:10.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.652+0000 7fcde9c00640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c410 tx=0x7fcdd800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.653+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8017070 con 0x7fcde406c6a0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.653+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd8005ce0 con 0x7fcde406c6a0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.653+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80072d0 con 0x7fcde406c6a0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.653+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde40aa9d0 con 0x7fcde406c6a0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.653+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde40aaf90 con 0x7fcde406c6a0 2024-09-10T08:39:10.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.654+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde406c120 con 0x7fcde406c6a0 2024-09-10T08:39:10.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.655+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdd801a070 con 0x7fcde406c6a0 2024-09-10T08:39:10.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.656+0000 7fcde1600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:10.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.656+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fcdd808a220 con 0x7fcde406c6a0 2024-09-10T08:39:10.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.656+0000 7fcde9200640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:10.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.657+0000 7fcde9200640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 0x7fcdc406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0007fd0 tx=0x7fcdd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:10.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.661+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdd80584e0 con 0x7fcde406c6a0 2024-09-10T08:39:10.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.913+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcde4159070 con 0x7fcde406c6a0 2024-09-10T08:39:10.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.914+0000 7fcde1600640 1 -- 172.21.15.52:0/843498095 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fcdd805c7e0 con 0x7fcde406c6a0 2024-09-10T08:39:10.914 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:10.914 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":650,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076577230,"bytes_used":2578251776,"bytes_avail":770515861504,"bytes_total":773094113280,"write_bytes_sec":3177396,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":8182}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-10T08:39:09.609701+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 msgr2=0x7fcdc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 0x7fcdc406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0007fd0 tx=0x7fcdd0009040 comp rx=0 tx=0).stop 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 msgr2=0x7fcde414d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c410 tx=0x7fcdd800c8d0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 shutdown_connections 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcdc406be30 0x7fcdc406e2f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcde415ab40 0x7fcde40cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcde40720b0 0x7fcde4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 --2- 172.21.15.52:0/843498095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcde406c6a0 0x7fcde414d170 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 >> 172.21.15.52:0/843498095 conn(0x7fcde40ccec0 msgr2=0x7fcde4158960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 shutdown_connections 2024-09-10T08:39:10.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:10.916+0000 7fcdec600640 1 -- 172.21.15.52:0/843498095 wait complete. 2024-09-10T08:39:10.932 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:39:10.933 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:39:10.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:39:11.019 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:39:11.106 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:39:11.107 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:39:11.107 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:11.107 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:11.142 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:11.142 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:11.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:39:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.415+0000 7fcce4000640 1 Processor -- start 2024-09-10T08:39:11.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.416+0000 7fcce4000640 1 -- start start 2024-09-10T08:39:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce4000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fccdc145ed0 0x7fccdc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce4000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fccdc073180 0x7fccdc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce4000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc0b4020 con 0x7fccdc0b5880 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce4000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc073b00 con 0x7fccdc073180 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce4000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc0b63d0 con 0x7fccdc145ed0 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce2000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fccdc0b5880 0x7fccdc0b5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40524/0 (socket says 172.21.15.52:40524) 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce2000640 1 -- 172.21.15.52:0/1338002060 learned_addr learned my addr 172.21.15.52:0/1338002060 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce0c00640 1 --2- 172.21.15.52:0/1338002060 >> v2:172.21.15.52:3300/0 conn(0x7fccdc073180 0x7fccdc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.417+0000 7fcce1600640 1 --2- 172.21.15.52:0/1338002060 >> v2:172.21.15.176:3300/0 conn(0x7fccdc145ed0 0x7fccdc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.418+0000 7fcce0c00640 1 -- 172.21.15.52:0/1338002060 >> v2:172.21.15.176:3300/0 conn(0x7fccdc145ed0 msgr2=0x7fccdc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.418+0000 7fcce0c00640 1 --2- 172.21.15.52:0/1338002060 >> v2:172.21.15.176:3300/0 conn(0x7fccdc145ed0 0x7fccdc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.418+0000 7fcce0c00640 1 -- 172.21.15.52:0/1338002060 >> v1:172.21.15.52:6789/0 conn(0x7fccdc0b5880 legacy=0x7fccdc0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.418+0000 7fcce0c00640 1 -- 172.21.15.52:0/1338002060 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc0b42c0 con 0x7fccdc073180 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.418+0000 7fccdbe00640 1 -- 172.21.15.52:0/1338002060 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260464702 0 0) 0x7fccdc0b4020 con 0x7fccdc0b5880 2024-09-10T08:39:11.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.419+0000 7fcce0c00640 1 --2- 172.21.15.52:0/1338002060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc073180 0x7fccdc0735c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fccdc069cd0 tx=0x7fccc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f984ac7704a05e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.419+0000 7fccdbe00640 1 -- 172.21.15.52:0/1338002060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037070 con 0x7fccdc073180 2024-09-10T08:39:11.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.419+0000 7fccdbe00640 1 -- 172.21.15.52:0/1338002060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8032440 con 0x7fccdc073180 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.419+0000 7fccdbe00640 1 -- 172.21.15.52:0/1338002060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8032810 con 0x7fccdc073180 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 -- 172.21.15.52:0/1338002060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc073180 msgr2=0x7fccdc0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 --2- 172.21.15.52:0/1338002060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc073180 0x7fccdc0735c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fccdc069cd0 tx=0x7fccc802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 -- 172.21.15.52:0/1338002060 shutdown_connections 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 --2- 172.21.15.52:0/1338002060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc073180 0x7fccdc0735c0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 --2- 172.21.15.52:0/1338002060 >> v2:172.21.15.176:3300/0 conn(0x7fccdc145ed0 0x7fccdc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 -- 172.21.15.52:0/1338002060 >> 172.21.15.52:0/1338002060 conn(0x7fccdc0ccec0 msgr2=0x7fccdc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 -- 172.21.15.52:0/1338002060 shutdown_connections 2024-09-10T08:39:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.420+0000 7fcce4000640 1 -- 172.21.15.52:0/1338002060 wait complete. 2024-09-10T08:39:11.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.421+0000 7fcce4000640 1 Processor -- start 2024-09-10T08:39:11.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.422+0000 7fcce4000640 1 -- start start 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.422+0000 7fcce4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccdc073180 0x7fccdc142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce4000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccdc0b5880 0x7fccdc0ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce4000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce4000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc0b4b60 con 0x7fccdc145ed0 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce4000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc0b4880 con 0x7fccdc0b5880 2024-09-10T08:39:11.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce4000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc1462b0 con 0x7fccdc073180 2024-09-10T08:39:11.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57776/0 (socket says 172.21.15.52:57776) 2024-09-10T08:39:11.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 -- 172.21.15.52:0/188688569 learned_addr learned my addr 172.21.15.52:0/188688569 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce0c00640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccdc0b5880 0x7fccdc0ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce1600640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccdc073180 0x7fccdc142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 -- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccdc073180 msgr2=0x7fccdc142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccdc073180 0x7fccdc142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 -- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccdc0b5880 msgr2=0x7fccdc0ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccdc0b5880 0x7fccdc0ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.423+0000 7fcce2000640 1 -- 172.21.15.52:0/188688569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1431c0 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fcce2000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fccd400caf0 tx=0x7fccd400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd400aca0 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd400ae40 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4012620 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc1434a0 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.424+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc142ed0 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.425+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc145a80 con 0x7fccdc145ed0 2024-09-10T08:39:11.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.426+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccd4012880 con 0x7fccdc145ed0 2024-09-10T08:39:11.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.427+0000 7fccd9600640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:11.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.428+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fccd408b540 con 0x7fccdc145ed0 2024-09-10T08:39:11.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.428+0000 7fcce1600640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:11.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.429+0000 7fcce1600640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 0x7fccbc06e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009ad0 tx=0x7fccd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:11.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.432+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccdc145a80 con 0x7fccdc145ed0 2024-09-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.627+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fccdc0713f0 con 0x7fccdc145ed0 2024-09-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.627+0000 7fccd9600640 1 -- 172.21.15.52:0/188688569 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v147) ==== 80+0+0 (secure 0 0 0) 0x7fccd4059ee0 con 0x7fccdc145ed0 2024-09-10T08:39:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 msgr2=0x7fccbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 0x7fccbc06e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009ad0 tx=0x7fccd0008040 comp rx=0 tx=0).stop 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 msgr2=0x7fccdc0ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fccd400caf0 tx=0x7fccd400a060 comp rx=0 tx=0).stop 2024-09-10T08:39:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 shutdown_connections 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fccbc06be30 0x7fccbc06e2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccdc145ed0 0x7fccdc0ad020 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fccdc0b5880 0x7fccdc0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 --2- 172.21.15.52:0/188688569 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fccdc073180 0x7fccdc142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.629+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 >> 172.21.15.52:0/188688569 conn(0x7fccdc0ccec0 msgr2=0x7fccdc0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.630+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 shutdown_connections 2024-09-10T08:39:11.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:11.630+0000 7fcce4000640 1 -- 172.21.15.52:0/188688569 wait complete. 2024-09-10T08:39:11.646 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:39:11.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:11.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:39:12.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:39:12.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:12.481 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:39:12.523 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:39:12.524 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:39:12.524 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:12.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:39:12.560 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:39:12.560 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:12.560 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:12.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:39:12.600 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:39:12.600 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:39:12.600 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:12.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:39:12.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:12.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.795+0000 7f3789600640 1 Processor -- start 2024-09-10T08:39:12.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.795+0000 7f3789600640 1 -- start start 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3789600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378415e440 0x7f37840d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3789600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840d3990 con 0x7f37840b6710 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3789600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840d3c70 con 0x7f37840cf450 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3789600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f37840d3f50 con 0x7f378415e440 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3783e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378415e440 0x7f37840d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3783e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378415e440 0x7f37840d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57792/0 (socket says 172.21.15.52:57792) 2024-09-10T08:39:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.796+0000 7f3783e00640 1 -- 172.21.15.52:0/4270038919 learned_addr learned my addr 172.21.15.52:0/4270038919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.797+0000 7f3783e00640 1 -- 172.21.15.52:0/4270038919 >> v1:172.21.15.176:6789/0 conn(0x7f37840cf450 legacy=0x7f37840b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.797+0000 7f3783e00640 1 -- 172.21.15.52:0/4270038919 >> v1:172.21.15.52:6789/0 conn(0x7f37840b6710 legacy=0x7f37840b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.797+0000 7f3783e00640 1 -- 172.21.15.52:0/4270038919 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37840d4230 con 0x7f378415e440 2024-09-10T08:39:12.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3783e00640 1 --2- 172.21.15.52:0/4270038919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378415e440 0x7f37840d3240 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3774009870 tx=0x7f377402a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588b906d0340e7ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3782a00640 1 -- 172.21.15.52:0/4270038919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774037070 con 0x7f378415e440 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3782a00640 1 -- 172.21.15.52:0/4270038919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774032640 con 0x7f378415e440 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3782a00640 1 -- 172.21.15.52:0/4270038919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774032a10 con 0x7f378415e440 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3789600640 1 -- 172.21.15.52:0/4270038919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378415e440 msgr2=0x7f37840d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.798+0000 7f3789600640 1 --2- 172.21.15.52:0/4270038919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378415e440 0x7f37840d3240 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3774009870 tx=0x7f377402a3c0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.799+0000 7f3789600640 1 -- 172.21.15.52:0/4270038919 shutdown_connections 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.799+0000 7f3789600640 1 --2- 172.21.15.52:0/4270038919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378415e440 0x7f37840d3240 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.799+0000 7f3789600640 1 -- 172.21.15.52:0/4270038919 >> 172.21.15.52:0/4270038919 conn(0x7f3784067f80 msgr2=0x7f37840d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.799+0000 7f3789600640 1 -- 172.21.15.52:0/4270038919 shutdown_connections 2024-09-10T08:39:12.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.799+0000 7f3789600640 1 -- 172.21.15.52:0/4270038919 wait complete. 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.800+0000 7f3789600640 1 Processor -- start 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.800+0000 7f3789600640 1 -- start start 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 0x7f37840cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f378415e440 0x7f37840cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37840b76c0 con 0x7f37840b6710 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37840b7540 con 0x7f37840cf450 2024-09-10T08:39:12.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3789600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37840b8270 con 0x7f378415e440 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3783e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3783e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57794/0 (socket says 172.21.15.52:57794) 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.801+0000 7f3783e00640 1 -- 172.21.15.52:0/4052493066 learned_addr learned my addr 172.21.15.52:0/4052493066 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783400640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 0x7f37840cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3788c00640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f378415e440 0x7f37840cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 -- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f378415e440 msgr2=0x7f37840cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f378415e440 0x7f37840cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 -- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 msgr2=0x7f37840cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 0x7f37840cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 -- 172.21.15.52:0/4052493066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3784160840 con 0x7f37840b6710 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783400640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 0x7f37840cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f3783e00640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3774000c00 tx=0x7f37740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774037040 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.802+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774042070 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.803+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3784160af0 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.803+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774030bd0 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.803+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37841610b0 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.804+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37840b5700 con 0x7f37840b6710 2024-09-10T08:39:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.805+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3774032500 con 0x7f37840b6710 2024-09-10T08:39:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.805+0000 7f377be00640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.806+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f37740ab8f0 con 0x7f37840b6710 2024-09-10T08:39:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.806+0000 7f3783400640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:12.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.806+0000 7f3783400640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 0x7f376406e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3784161d10 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:12.810+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37840b5700 con 0x7f37840b6710 2024-09-10T08:39:13.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.031+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37840d3020 con 0x7f37840b6710 2024-09-10T08:39:13.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.032+0000 7f377be00640 1 -- 172.21.15.52:0/4052493066 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f37840d3020 con 0x7f37840b6710 2024-09-10T08:39:13.033 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:13.033 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:13.033 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 msgr2=0x7f376406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 0x7f376406e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3784161d10 tx=0x7f3770009040 comp rx=0 tx=0).stop 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 msgr2=0x7f3784160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3774000c00 tx=0x7f37740046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 shutdown_connections 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f376406be30 0x7f376406e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f378415e440 0x7f37840cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37840cf450 0x7f37840cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 --2- 172.21.15.52:0/4052493066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37840b6710 0x7f3784160300 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 >> 172.21.15.52:0/4052493066 conn(0x7f3784067f80 msgr2=0x7f37840b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.034+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 shutdown_connections 2024-09-10T08:39:13.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.035+0000 7f3789600640 1 -- 172.21.15.52:0/4052493066 wait complete. 2024-09-10T08:39:13.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.209+0000 7fd12fe00640 1 Processor -- start 2024-09-10T08:39:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.209+0000 7fd12fe00640 1 -- start start 2024-09-10T08:39:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.210+0000 7fd12fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1300b6710 0x7fd1300d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.210+0000 7fd12fe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1300d3990 con 0x7fd1300cf450 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.210+0000 7fd12fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1300d3c70 con 0x7fd13015e440 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.210+0000 7fd12fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd1300d3f50 con 0x7fd1300b6710 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1300b6710 0x7fd1300d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd1300b6710 0x7fd1300d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57798/0 (socket says 172.21.15.52:57798) 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12ea00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd13015e440 0x7fd1300b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:54420/0 (socket says 172.21.15.52:54420) 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 -- 172.21.15.52:0/499493224 learned_addr learned my addr 172.21.15.52:0/499493224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12f400640 1 --1- 172.21.15.52:0/499493224 >> v1:172.21.15.52:6789/0 conn(0x7fd1300cf450 0x7fd1300b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40534/0 (socket says 172.21.15.52:40534) 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 -- 172.21.15.52:0/499493224 >> v1:172.21.15.176:6789/0 conn(0x7fd13015e440 legacy=0x7fd1300b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 -- 172.21.15.52:0/499493224 >> v1:172.21.15.52:6789/0 conn(0x7fd1300cf450 legacy=0x7fd1300b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12d600640 1 -- 172.21.15.52:0/499493224 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153045672 0 0) 0x7fd1300d3c70 con 0x7fd13015e440 2024-09-10T08:39:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.211+0000 7fd12e000640 1 -- 172.21.15.52:0/499493224 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1300d4230 con 0x7fd1300b6710 2024-09-10T08:39:13.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.212+0000 7fd12e000640 1 --2- 172.21.15.52:0/499493224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300b6710 0x7fd1300d3240 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e46513ebbe9271b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.212+0000 7fd12d600640 1 -- 172.21.15.52:0/499493224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c037070 con 0x7fd1300b6710 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.212+0000 7fd12d600640 1 -- 172.21.15.52:0/499493224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c032440 con 0x7fd1300b6710 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.212+0000 7fd12d600640 1 -- 172.21.15.52:0/499493224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c032810 con 0x7fd1300b6710 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 -- 172.21.15.52:0/499493224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300b6710 msgr2=0x7fd1300d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 --2- 172.21.15.52:0/499493224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300b6710 0x7fd1300d3240 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009870 tx=0x7fd11c02a290 comp rx=0 tx=0).stop 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 -- 172.21.15.52:0/499493224 shutdown_connections 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 --2- 172.21.15.52:0/499493224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300b6710 0x7fd1300d3240 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 -- 172.21.15.52:0/499493224 >> 172.21.15.52:0/499493224 conn(0x7fd130067f80 msgr2=0x7fd1300d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 -- 172.21.15.52:0/499493224 shutdown_connections 2024-09-10T08:39:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.213+0000 7fd12fe00640 1 -- 172.21.15.52:0/499493224 wait complete. 2024-09-10T08:39:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.215+0000 7fd12fe00640 1 Processor -- start 2024-09-10T08:39:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.215+0000 7fd12fe00640 1 -- start start 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 0x7fd1300cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13015e440 0x7fd1300ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300b76c0 con 0x7fd1300cf450 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300b7540 con 0x7fd13015e440 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1300b8270 con 0x7fd1300b6710 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57814/0 (socket says 172.21.15.52:57814) 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 -- 172.21.15.52:0/1929949323 learned_addr learned my addr 172.21.15.52:0/1929949323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12f400640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13015e440 0x7fd1300ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12ea00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 0x7fd1300cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 -- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 msgr2=0x7fd1300cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 0x7fd1300cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 -- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13015e440 msgr2=0x7fd1300ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13015e440 0x7fd1300ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12e000640 1 -- 172.21.15.52:0/1929949323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1300cdcd0 con 0x7fd1300cf450 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.216+0000 7fd12ea00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 0x7fd1300cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd12e000640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0090b0 tx=0x7fd11c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c041070 con 0x7fd1300cf450 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c03c950 con 0x7fd1300cf450 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c037040 con 0x7fd1300cf450 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1300cdfb0 con 0x7fd1300cf450 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.217+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1300ce570 con 0x7fd1300cf450 2024-09-10T08:39:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.218+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1300d3240 con 0x7fd1300cf450 2024-09-10T08:39:13.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.219+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd11c044070 con 0x7fd1300cf450 2024-09-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.220+0000 7fd126a00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 0x7fd11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.220+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd11c0abc40 con 0x7fd1300cf450 2024-09-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.221+0000 7fd12ea00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 0x7fd11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.221+0000 7fd12ea00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 0x7fd11006e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd120000f60 tx=0x7fd120009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.225+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd11c07a700 con 0x7fd1300cf450 2024-09-10T08:39:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.447+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1300b4210 con 0x7fd1300cf450 2024-09-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.448+0000 7fd126a00640 1 -- 172.21.15.52:0/1929949323 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7fd11c07a000 con 0x7fd1300cf450 2024-09-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:13.448 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 msgr2=0x7fd11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 0x7fd11006e2f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd120000f60 tx=0x7fd120009040 comp rx=0 tx=0).stop 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 msgr2=0x7fd1300d4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0090b0 tx=0x7fd11c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 shutdown_connections 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd11006be30 0x7fd11006e2f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd13015e440 0x7fd1300ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1300cf450 0x7fd1300d4ea0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 --2- 172.21.15.52:0/1929949323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1300b6710 0x7fd1300cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 >> 172.21.15.52:0/1929949323 conn(0x7fd130067f80 msgr2=0x7fd1300b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:13.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 shutdown_connections 2024-09-10T08:39:13.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.450+0000 7fd12fe00640 1 -- 172.21.15.52:0/1929949323 wait complete. 2024-09-10T08:39:13.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.622+0000 7f87fd000640 1 Processor -- start 2024-09-10T08:39:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.622+0000 7f87fd000640 1 -- start start 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87fd000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87f8145ed0 0x7f87f80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87fd000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87f80b5f90 0x7f87f80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87fd000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f80b4020 con 0x7f87f8073180 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87fd000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f87f80b63d0 con 0x7f87f8145ed0 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87fd000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f87f8073b00 con 0x7f87f80b5f90 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87f8145ed0 0x7f87f80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f87f8145ed0 0x7f87f80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57822/0 (socket says 172.21.15.52:57822) 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 -- 172.21.15.52:0/4161977611 learned_addr learned my addr 172.21.15.52:0/4161977611 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f6800640 1 --2- 172.21.15.52:0/4161977611 >> v2:172.21.15.176:3300/0 conn(0x7f87f80b5f90 0x7f87f80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 -- 172.21.15.52:0/4161977611 >> v2:172.21.15.176:3300/0 conn(0x7f87f80b5f90 msgr2=0x7f87f80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:13.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 --2- 172.21.15.52:0/4161977611 >> v2:172.21.15.176:3300/0 conn(0x7f87f80b5f90 0x7f87f80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 -- 172.21.15.52:0/4161977611 >> v1:172.21.15.176:6789/0 conn(0x7f87f8073180 legacy=0x7f87f80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:13.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.624+0000 7f87f5e00640 1 -- 172.21.15.52:0/4161977611 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80b42c0 con 0x7f87f8145ed0 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.625+0000 7f87f5e00640 1 --2- 172.21.15.52:0/4161977611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8145ed0 0x7f87f80b5080 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f87f8069cd0 tx=0x7f87e802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917100bd5e0d9002 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87f5400640 1 -- 172.21.15.52:0/4161977611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8037070 con 0x7f87f8145ed0 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87f5400640 1 -- 172.21.15.52:0/4161977611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e8032440 con 0x7f87f8145ed0 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87f5400640 1 -- 172.21.15.52:0/4161977611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8032810 con 0x7f87f8145ed0 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 -- 172.21.15.52:0/4161977611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8145ed0 msgr2=0x7f87f80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 --2- 172.21.15.52:0/4161977611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8145ed0 0x7f87f80b5080 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f87f8069cd0 tx=0x7f87e802a200 comp rx=0 tx=0).stop 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 -- 172.21.15.52:0/4161977611 shutdown_connections 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 --2- 172.21.15.52:0/4161977611 >> v2:172.21.15.176:3300/0 conn(0x7f87f80b5f90 0x7f87f80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 --2- 172.21.15.52:0/4161977611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8145ed0 0x7f87f80b5080 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 -- 172.21.15.52:0/4161977611 >> 172.21.15.52:0/4161977611 conn(0x7f87f80ccec0 msgr2=0x7f87f80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.626+0000 7f87fd000640 1 -- 172.21.15.52:0/4161977611 shutdown_connections 2024-09-10T08:39:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.627+0000 7f87fd000640 1 -- 172.21.15.52:0/4161977611 wait complete. 2024-09-10T08:39:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.628+0000 7f87fd000640 1 Processor -- start 2024-09-10T08:39:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.628+0000 7f87fd000640 1 -- start start 2024-09-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f80b5f90 0x7f87f80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f8145ed0 0x7f87f80c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80b4b60 con 0x7f87f8073180 2024-09-10T08:39:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80b4880 con 0x7f87f8145ed0 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87fd000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87f81462b0 con 0x7f87f80b5f90 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57824/0 (socket says 172.21.15.52:57824) 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.629+0000 7f87f5e00640 1 -- 172.21.15.52:0/2130864955 learned_addr learned my addr 172.21.15.52:0/2130864955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f6800640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f8145ed0 0x7f87f80c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87ed400640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f80b5f90 0x7f87f80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 -- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f80b5f90 msgr2=0x7f87f80c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f80b5f90 0x7f87f80c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 -- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f8145ed0 msgr2=0x7f87f80c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f8145ed0 0x7f87f80c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 -- 172.21.15.52:0/2130864955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80c8dd0 con 0x7f87f8073180 2024-09-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.630+0000 7f87f5e00640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.631+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8041020 con 0x7f87f8073180 2024-09-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.631+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e80306c0 con 0x7f87f8073180 2024-09-10T08:39:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.631+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8037040 con 0x7f87f8073180 2024-09-10T08:39:13.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.631+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f80c90b0 con 0x7f87f8073180 2024-09-10T08:39:13.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.631+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f80ca780 con 0x7f87f8073180 2024-09-10T08:39:13.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.632+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f80735a0 con 0x7f87f8073180 2024-09-10T08:39:13.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.633+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87e8044020 con 0x7f87f8073180 2024-09-10T08:39:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.634+0000 7f87eea00640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 0x7f87d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.634+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f87e80ab620 con 0x7f87f8073180 2024-09-10T08:39:13.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.634+0000 7f87ed400640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 0x7f87d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:13.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.635+0000 7f87ed400640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 0x7f87d406e2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f87f815c010 tx=0x7f87e0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.639+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87e804b030 con 0x7f87f8073180 2024-09-10T08:39:13.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.824+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87f80ceed0 con 0x7f87f8073180 2024-09-10T08:39:13.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.825+0000 7f87eea00640 1 -- 172.21.15.52:0/2130864955 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16751 (secure 0 0 0) 0x7f87e80798e0 con 0x7f87f8073180 2024-09-10T08:39:13.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:13.826 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":147,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:28.188803+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:38:24.423839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T08:38:25.616439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:13.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 msgr2=0x7f87d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 0x7f87d406e2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f87f815c010 tx=0x7f87e0009060 comp rx=0 tx=0).stop 2024-09-10T08:39:13.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 msgr2=0x7f87f813dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f87e8000c00 tx=0x7f87e80046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 shutdown_connections 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f87d406be30 0x7f87d406e2f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87f8145ed0 0x7f87f80c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87f80b5f90 0x7f87f80c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 --2- 172.21.15.52:0/2130864955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87f8073180 0x7f87f813dc40 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 >> 172.21.15.52:0/2130864955 conn(0x7f87f80ccec0 msgr2=0x7f87f80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 shutdown_connections 2024-09-10T08:39:13.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:13.828+0000 7f87fd000640 1 -- 172.21.15.52:0/2130864955 wait complete. 2024-09-10T08:39:13.845 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:39:13.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.000+0000 7f73b1200640 1 Processor -- start 2024-09-10T08:39:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.000+0000 7f73b1200640 1 -- start start 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.001+0000 7f73b1200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 0x7f73ac15b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73b1200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac072500 con 0x7f73ac06c6a0 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73b1200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac071010 con 0x7f73ac15ab40 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73b1200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac06cb10 con 0x7f73ac0720b0 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73a3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f73ac06c6a0 0x7f73ac15af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40550/0 (socket says 172.21.15.52:40550) 2024-09-10T08:39:14.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73a3e00640 1 -- 172.21.15.52:0/508497688 learned_addr learned my addr 172.21.15.52:0/508497688 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:14.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73aa800640 1 --2- 172.21.15.52:0/508497688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 0x7f73ac15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053442418 0 0) 0x7f73ac072500 con 0x7f73ac06c6a0 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.002+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7390003440 con 0x7f73ac06c6a0 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602967790 0 0) 0x7f73ac071010 con 0x7f73ac15ab40 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73ac072500 con 0x7f73ac15ab40 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73aa800640 1 -- 172.21.15.52:0/508497688 >> v1:172.21.15.176:6789/0 conn(0x7f73ac15ab40 legacy=0x7f73ac073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73aa800640 1 -- 172.21.15.52:0/508497688 >> v1:172.21.15.52:6789/0 conn(0x7f73ac06c6a0 legacy=0x7f73ac15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753183853 0 0) 0x7f7390003440 con 0x7f73ac06c6a0 2024-09-10T08:39:14.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.003+0000 7f73aa800640 1 -- 172.21.15.52:0/508497688 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0712f0 con 0x7f73ac0720b0 2024-09-10T08:39:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.004+0000 7f73aa800640 1 --2- 172.21.15.52:0/508497688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 0x7f73ac15b630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009dc0 tx=0x7f73a402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d61a2bf349756a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.004+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394001690 con 0x7f73ac0720b0 2024-09-10T08:39:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.004+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a4007540 con 0x7f73ac0720b0 2024-09-10T08:39:14.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.004+0000 7f73a9400640 1 -- 172.21.15.52:0/508497688 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a40078f0 con 0x7f73ac0720b0 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 -- 172.21.15.52:0/508497688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 msgr2=0x7f73ac15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 --2- 172.21.15.52:0/508497688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 0x7f73ac15b630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009dc0 tx=0x7f73a402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 -- 172.21.15.52:0/508497688 shutdown_connections 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 --2- 172.21.15.52:0/508497688 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac0720b0 0x7f73ac15b630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 -- 172.21.15.52:0/508497688 >> 172.21.15.52:0/508497688 conn(0x7f73ac0ccec0 msgr2=0x7f73ac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 -- 172.21.15.52:0/508497688 shutdown_connections 2024-09-10T08:39:14.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.005+0000 7f73b1200640 1 -- 172.21.15.52:0/508497688 wait complete. 2024-09-10T08:39:14.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.007+0000 7f73b1200640 1 Processor -- start 2024-09-10T08:39:14.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.007+0000 7f73b1200640 1 -- start start 2024-09-10T08:39:14.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73ac0720b0 0x7f73ac1f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac15ab40 0x7f73ac0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0718b0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac06bc10 con 0x7f73ac0720b0 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73b1200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac06bd90 con 0x7f73ac15ab40 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57834/0 (socket says 172.21.15.52:57834) 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 -- 172.21.15.52:0/3336760733 learned_addr learned my addr 172.21.15.52:0/3336760733 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73aa800640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac15ab40 0x7f73ac0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a3e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73ac0720b0 0x7f73ac1f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 -- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac15ab40 msgr2=0x7f73ac0caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac15ab40 0x7f73ac0caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 -- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73ac0720b0 msgr2=0x7f73ac1f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73ac0720b0 0x7f73ac1f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.008+0000 7f73a9e00640 1 -- 172.21.15.52:0/3336760733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0c9990 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73a9e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c430 tx=0x7f739c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c017070 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c0052f0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c003830 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0c9c70 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.009+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac0ca230 con 0x7f73ac06c6a0 2024-09-10T08:39:14.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.010+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac06c1c0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.011+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f739c01a070 con 0x7f73ac06c6a0 2024-09-10T08:39:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.012+0000 7f73a2000640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 0x7f738806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.012+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f739c08a270 con 0x7f73ac06c6a0 2024-09-10T08:39:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.013+0000 7f73a3e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 0x7f738806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.014+0000 7f73a3e00640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 0x7f738806e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7394001eb0 tx=0x7f7394001770 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.017+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f739c0585c0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.240+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73ac1546e0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.240+0000 7f73a2000640 1 -- 172.21.15.52:0/3336760733 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7f739c05c8c0 con 0x7f73ac06c6a0 2024-09-10T08:39:14.241 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:14.241 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:14.241 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:14.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.242+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 msgr2=0x7f738806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 0x7f738806e2f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7394001eb0 tx=0x7f7394001770 comp rx=0 tx=0).stop 2024-09-10T08:39:14.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 msgr2=0x7f73ac150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c430 tx=0x7f739c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 shutdown_connections 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f738806be30 0x7f738806e2f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f73ac15ab40 0x7f73ac0caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f73ac0720b0 0x7f73ac1f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 --2- 172.21.15.52:0/3336760733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ac06c6a0 0x7f73ac150360 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 >> 172.21.15.52:0/3336760733 conn(0x7f73ac0ccec0 msgr2=0x7f73ac15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 shutdown_connections 2024-09-10T08:39:14.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.243+0000 7f73b1200640 1 -- 172.21.15.52:0/3336760733 wait complete. 2024-09-10T08:39:14.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:14.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.416+0000 7facc6800640 1 Processor -- start 2024-09-10T08:39:14.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.416+0000 7facc6800640 1 -- start start 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.417+0000 7facc6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7facc0073890 0x7facc00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.417+0000 7facc6800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00b4020 con 0x7facc00b5880 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.417+0000 7facc6800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc00b42c0 con 0x7facc0145ed0 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.417+0000 7facc6800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7facc00b63f0 con 0x7facc0073890 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7facc0073890 0x7facc00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbfe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7facc00b5880 0x7facc00b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42240/0 (socket says 172.21.15.52:42240) 2024-09-10T08:39:14.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbfe00640 1 -- 172.21.15.52:0/1139899450 learned_addr learned my addr 172.21.15.52:0/1139899450 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbea00640 1 -- 172.21.15.52:0/1139899450 >> v1:172.21.15.176:6789/0 conn(0x7facc0145ed0 legacy=0x7facc0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbea00640 1 -- 172.21.15.52:0/1139899450 >> v1:172.21.15.52:6789/0 conn(0x7facc00b5880 legacy=0x7facc00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.418+0000 7facbea00640 1 -- 172.21.15.52:0/1139899450 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00b45a0 con 0x7facc0073890 2024-09-10T08:39:14.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.419+0000 7facbea00640 1 --2- 172.21.15.52:0/1139899450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0073890 0x7facc00b5080 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7facac0097a0 tx=0x7facac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c58863b5e70d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.419+0000 7facbe000640 1 -- 172.21.15.52:0/1139899450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac037070 con 0x7facc0073890 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.419+0000 7facbe000640 1 -- 172.21.15.52:0/1139899450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facac032440 con 0x7facc0073890 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.419+0000 7facbe000640 1 -- 172.21.15.52:0/1139899450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac032810 con 0x7facc0073890 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 -- 172.21.15.52:0/1139899450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0073890 msgr2=0x7facc00b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 --2- 172.21.15.52:0/1139899450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0073890 0x7facc00b5080 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7facac0097a0 tx=0x7facac02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 -- 172.21.15.52:0/1139899450 shutdown_connections 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 --2- 172.21.15.52:0/1139899450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0073890 0x7facc00b5080 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 -- 172.21.15.52:0/1139899450 >> 172.21.15.52:0/1139899450 conn(0x7facc00ccec0 msgr2=0x7facc00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 -- 172.21.15.52:0/1139899450 shutdown_connections 2024-09-10T08:39:14.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.420+0000 7facc6800640 1 -- 172.21.15.52:0/1139899450 wait complete. 2024-09-10T08:39:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.422+0000 7facc6800640 1 Processor -- start 2024-09-10T08:39:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.422+0000 7facc6800640 1 -- start start 2024-09-10T08:39:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.422+0000 7facc6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc0073890 0x7facc0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facc6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc00b5880 0x7facc015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facc6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7facc01462b0 con 0x7facc0145ed0 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facc6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7facc00b4b60 con 0x7facc00b5880 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facc6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7facc0146430 con 0x7facc0073890 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52848/0 (socket says 172.21.15.52:52848) 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 -- 172.21.15.52:0/797540825 learned_addr learned my addr 172.21.15.52:0/797540825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbf400640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc0073890 0x7facc0070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbea00640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc00b5880 0x7facc015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 -- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc0073890 msgr2=0x7facc0070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc0073890 0x7facc0070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 -- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc00b5880 msgr2=0x7facc015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc00b5880 0x7facc015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.423+0000 7facbfe00640 1 -- 172.21.15.52:0/797540825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc00714b0 con 0x7facc0145ed0 2024-09-10T08:39:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facbfe00640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7facb800cb10 tx=0x7facb800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8017070 con 0x7facc0145ed0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb800ac10 con 0x7facc0145ed0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc0071750 con 0x7facc0145ed0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8012400 con 0x7facc0145ed0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.424+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc0071d10 con 0x7facc0145ed0 2024-09-10T08:39:14.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.425+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc00b5080 con 0x7facc0145ed0 2024-09-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.426+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7facb801a070 con 0x7facc0145ed0 2024-09-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.427+0000 7facb7400640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 0x7faca006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.427+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7facb808ac20 con 0x7facc0145ed0 2024-09-10T08:39:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.427+0000 7facbf400640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 0x7faca006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.428+0000 7facbf400640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 0x7faca006e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7facb0006fd0 tx=0x7facb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.431+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facb8059530 con 0x7facc0145ed0 2024-09-10T08:39:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.650+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facc0143d80 con 0x7facc0145ed0 2024-09-10T08:39:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.651+0000 7facb7400640 1 -- 172.21.15.52:0/797540825 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5239 (secure 0 0 0) 0x7facb8058e30 con 0x7facc0145ed0 2024-09-10T08:39:14.652 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:14.652 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":110,"btime":"2024-09-10T08:38:30:224338+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:38:26.623253+0000","modified":"2024-09-10T08:38:29.650710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8182":{"gid":8182,"name":"d","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/2632927131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":2632927131},{"type":"v1","addr":"172.21.15.176:6837","nonce":2632927131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8182,"qdb_cluster":[8182]},"id":10}]} 2024-09-10T08:39:14.652 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 110 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 msgr2=0x7faca006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 0x7faca006e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7facb0006fd0 tx=0x7facb0008040 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 msgr2=0x7facc00727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7facb800cb10 tx=0x7facb800a060 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 shutdown_connections 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faca006be30 0x7faca006e2f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc0145ed0 0x7facc00727f0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facc00b5880 0x7facc015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 --2- 172.21.15.52:0/797540825 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facc0073890 0x7facc0070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 >> 172.21.15.52:0/797540825 conn(0x7facc00ccec0 msgr2=0x7facc0142c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:14.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 shutdown_connections 2024-09-10T08:39:14.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.653+0000 7facc6800640 1 -- 172.21.15.52:0/797540825 wait complete. 2024-09-10T08:39:14.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.825+0000 7fbcda400640 1 Processor -- start 2024-09-10T08:39:14.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.825+0000 7fbcda400640 1 -- start start 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcda400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbcd40b2d40 0x7fbcd406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcda400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd4071180 con 0x7fbcd406c150 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcda400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd4071460 con 0x7fbcd413eb20 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcda400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd4071ab0 con 0x7fbcd40b2d40 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcd3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbcd406c150 0x7fbcd4071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42254/0 (socket says 172.21.15.52:42254) 2024-09-10T08:39:14.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcd3e00640 1 -- 172.21.15.52:0/3472045339 learned_addr learned my addr 172.21.15.52:0/3472045339 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcd3400640 1 --2- 172.21.15.52:0/3472045339 >> v2:172.21.15.176:3300/0 conn(0x7fbcd40b2d40 0x7fbcd406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.827+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294721516 0 0) 0x7fbcd4071180 con 0x7fbcd406c150 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb8003520 con 0x7fbcd406c150 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4120897472 0 0) 0x7fbcd4071460 con 0x7fbcd413eb20 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd4071180 con 0x7fbcd413eb20 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3943611298 0 0) 0x7fbcb8003520 con 0x7fbcd406c150 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 >> v2:172.21.15.176:3300/0 conn(0x7fbcd40b2d40 msgr2=0x7fbcd406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 --2- 172.21.15.52:0/3472045339 >> v2:172.21.15.176:3300/0 conn(0x7fbcd40b2d40 0x7fbcd406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 >> v1:172.21.15.176:6789/0 conn(0x7fbcd413eb20 legacy=0x7fbcd415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd4071740 con 0x7fbcd406c150 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fbccc0019f0 con 0x7fbcd406c150 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 >> v1:172.21.15.52:6789/0 conn(0x7fbcd406c150 legacy=0x7fbcd4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcb8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb8004800 0x7fbcb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb80051c0 0x7fbcb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4071ab0 con 0x7fbcb8003b90 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb800c090 con 0x7fbcb8004800 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb800c290 con 0x7fbcb80051c0 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.828+0000 7fbcd3400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcb8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3400640 1 -- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb80051c0 msgr2=0x7fbcb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcb80051c0 0x7fbcb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3400640 1 -- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb8004800 msgr2=0x7fbcb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:14.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbccbe00640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb8004800 0x7fbcb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb8004800 0x7fbcb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3400640 1 -- 172.21.15.52:0/3472045339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb8003520 con 0x7fbcb8003b90 2024-09-10T08:39:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbcd3e00640 1 -- 172.21.15.52:0/3472045339 reap_dead start 2024-09-10T08:39:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.829+0000 7fbccbe00640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcb8004800 0x7fbcb8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcd3400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcb8003f90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009ac0 tx=0x7fbcb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61974d84a2b341 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4036070 con 0x7fbcb8003b90 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4031400 con 0x7fbcb8003b90 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcd2a00640 1 -- 172.21.15.52:0/3472045339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4009690 con 0x7fbcb8003b90 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcda400640 1 -- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 msgr2=0x7fbcb8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcda400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcb8003f90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009ac0 tx=0x7fbcb8005830 comp rx=0 tx=0).stop 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcda400640 1 -- 172.21.15.52:0/3472045339 shutdown_connections 2024-09-10T08:39:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcda400640 1 --2- 172.21.15.52:0/3472045339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcb8003f90 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.830+0000 7fbcda400640 1 -- 172.21.15.52:0/3472045339 >> 172.21.15.52:0/3472045339 conn(0x7fbcd40ccec0 msgr2=0x7fbcd40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.831+0000 7fbcda400640 1 -- 172.21.15.52:0/3472045339 shutdown_connections 2024-09-10T08:39:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.831+0000 7fbcda400640 1 -- 172.21.15.52:0/3472045339 wait complete. 2024-09-10T08:39:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.832+0000 7fbcda400640 1 Processor -- start 2024-09-10T08:39:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.832+0000 7fbcda400640 1 -- start start 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 0x7fbcd40cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 0x7fbcd4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd406bfa0 con 0x7fbcb8003b90 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd406be20 con 0x7fbcd413bde0 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcda400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd415bcf0 con 0x7fbcd4156090 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcd3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcd3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52860/0 (socket says 172.21.15.52:52860) 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.833+0000 7fbcd3400640 1 -- 172.21.15.52:0/1587419542 learned_addr learned my addr 172.21.15.52:0/1587419542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 -- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 msgr2=0x7fbcd4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3e00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 0x7fbcd4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbccbe00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 0x7fbcd40cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 0x7fbcd4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 -- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 msgr2=0x7fbcd40cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 0x7fbcd40cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 -- 172.21.15.52:0/1587419542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd413c2e0 con 0x7fbcb8003b90 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbccbe00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 0x7fbcd40cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3e00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 0x7fbcd4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcd3400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009be0 tx=0x7fbcc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc403f020 con 0x7fbcb8003b90 2024-09-10T08:39:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4037040 con 0x7fbcb8003b90 2024-09-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4036070 con 0x7fbcb8003b90 2024-09-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.834+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd413c5c0 con 0x7fbcb8003b90 2024-09-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.835+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd413cb80 con 0x7fbcb8003b90 2024-09-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.835+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd415c080 con 0x7fbcb8003b90 2024-09-10T08:39:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.836+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcc4042020 con 0x7fbcb8003b90 2024-09-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.837+0000 7fbccb400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 0x7fbcb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.837+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fbcc40aaef0 con 0x7fbcb8003b90 2024-09-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.838+0000 7fbccbe00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 0x7fbcb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.838+0000 7fbccbe00640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 0x7fbcb006e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbcd41f82b0 tx=0x7fbcbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:14.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:14.841+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcc4049030 con 0x7fbcb8003b90 2024-09-10T08:39:15.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.027+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcd406c9c0 con 0x7fbcb8003b90 2024-09-10T08:39:15.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.028+0000 7fbccb400640 1 -- 172.21.15.52:0/1587419542 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16751 (secure 0 0 0) 0x7fbcc4079950 con 0x7fbcb8003b90 2024-09-10T08:39:15.029 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:15.029 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":147,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:38:28.188803+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:38:24.423839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-10T08:38:25.616439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 msgr2=0x7fbcb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 0x7fbcb006e320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbcd41f82b0 tx=0x7fbcbc009040 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 msgr2=0x7fbcd4158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009be0 tx=0x7fbcc4004730 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 shutdown_connections 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbcb006be60 0x7fbcb006e320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbcd4156090 0x7fbcd4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbcd413bde0 0x7fbcd40cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 --2- 172.21.15.52:0/1587419542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb8003b90 0x7fbcd4158ce0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 >> 172.21.15.52:0/1587419542 conn(0x7fbcd40ccec0 msgr2=0x7fbcd413efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 shutdown_connections 2024-09-10T08:39:15.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.031+0000 7fbcda400640 1 -- 172.21.15.52:0/1587419542 wait complete. 2024-09-10T08:39:15.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:39:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.205+0000 7f189f200640 1 Processor -- start 2024-09-10T08:39:15.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.205+0000 7f189f200640 1 -- start start 2024-09-10T08:39:15.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.206+0000 7f189f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f18a015e440 0x7f18a00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.206+0000 7f189f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.206+0000 7f189f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a00d3990 con 0x7f18a00b6540 2024-09-10T08:39:15.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.206+0000 7f189f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00b69b0 con 0x7f18a015e440 2024-09-10T08:39:15.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.206+0000 7f189f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00d3c70 con 0x7f18a00cf450 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:59086/0 (socket says 172.21.15.52:59086) 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 -- 172.21.15.52:0/4206840999 learned_addr learned my addr 172.21.15.52:0/4206840999 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189e800640 1 --1- 172.21.15.52:0/4206840999 >> v1:172.21.15.176:6789/0 conn(0x7f18a00b6540 0x7f18a006bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60388/0 (socket says 172.21.15.52:60388) 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189de00640 1 --2- 172.21.15.52:0/4206840999 >> v2:172.21.15.176:3300/0 conn(0x7f18a015e440 0x7f18a00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 -- 172.21.15.52:0/4206840999 >> v2:172.21.15.176:3300/0 conn(0x7f18a015e440 msgr2=0x7f18a00d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 --2- 172.21.15.52:0/4206840999 >> v2:172.21.15.176:3300/0 conn(0x7f18a015e440 0x7f18a00d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 -- 172.21.15.52:0/4206840999 >> v1:172.21.15.176:6789/0 conn(0x7f18a00b6540 legacy=0x7f18a006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189d400640 1 -- 172.21.15.52:0/4206840999 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00d3f50 con 0x7f18a00cf450 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.207+0000 7f189ca00640 1 -- 172.21.15.52:0/4206840999 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588604152 0 0) 0x7f18a00d3990 con 0x7f18a00b6540 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189d400640 1 --2- 172.21.15.52:0/4206840999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f188c009870 tx=0x7f188c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cf93f8d4b92db4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189ca00640 1 -- 172.21.15.52:0/4206840999 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c037070 con 0x7f18a00cf450 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189ca00640 1 -- 172.21.15.52:0/4206840999 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c02ae50 con 0x7f18a00cf450 2024-09-10T08:39:15.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189ca00640 1 -- 172.21.15.52:0/4206840999 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c032860 con 0x7f18a00cf450 2024-09-10T08:39:15.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189f200640 1 -- 172.21.15.52:0/4206840999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 msgr2=0x7f18a00b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.209+0000 7f189f200640 1 --2- 172.21.15.52:0/4206840999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f188c009870 tx=0x7f188c02a300 comp rx=0 tx=0).stop 2024-09-10T08:39:15.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 -- 172.21.15.52:0/4206840999 shutdown_connections 2024-09-10T08:39:15.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 --2- 172.21.15.52:0/4206840999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a00cf450 0x7f18a00b6000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 --2- 172.21.15.52:0/4206840999 >> v2:172.21.15.176:3300/0 conn(0x7f18a015e440 0x7f18a00d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 -- 172.21.15.52:0/4206840999 >> 172.21.15.52:0/4206840999 conn(0x7f18a0067f80 msgr2=0x7f18a00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:15.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 -- 172.21.15.52:0/4206840999 shutdown_connections 2024-09-10T08:39:15.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.210+0000 7f189f200640 1 -- 172.21.15.52:0/4206840999 wait complete. 2024-09-10T08:39:15.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.211+0000 7f189f200640 1 Processor -- start 2024-09-10T08:39:15.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.211+0000 7f189f200640 1 -- start start 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a00cf450 0x7f18a0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a015e440 0x7f18a015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00b7540 con 0x7f18a00b6540 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18a015e820 con 0x7f18a00cf450 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.212+0000 7f189f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00b76c0 con 0x7f18a015e440 2024-09-10T08:39:15.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52862/0 (socket says 172.21.15.52:52862) 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 -- 172.21.15.52:0/2589552796 learned_addr learned my addr 172.21.15.52:0/2589552796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189d400640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a00cf450 0x7f18a0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189e800640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a015e440 0x7f18a015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 -- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a015e440 msgr2=0x7f18a015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a015e440 0x7f18a015f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 -- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a00cf450 msgr2=0x7f18a0153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a00cf450 0x7f18a0153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 -- 172.21.15.52:0/2589552796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00c90d0 con 0x7f18a00b6540 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.213+0000 7f189de00640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f189000e8a0 tx=0x7f189000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.214+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890017070 con 0x7f18a00b6540 2024-09-10T08:39:15.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.214+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189000c940 con 0x7f18a00b6540 2024-09-10T08:39:15.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.214+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189000cd30 con 0x7f18a00b6540 2024-09-10T08:39:15.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.214+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a015fd20 con 0x7f18a00b6540 2024-09-10T08:39:15.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.214+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a00c9650 con 0x7f18a00b6540 2024-09-10T08:39:15.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.215+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a00b6000 con 0x7f18a00b6540 2024-09-10T08:39:15.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.216+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f189001a070 con 0x7f18a00b6540 2024-09-10T08:39:15.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.217+0000 7f1896000640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.217+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f189008acc0 con 0x7f18a00b6540 2024-09-10T08:39:15.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.218+0000 7f189d400640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.218+0000 7f189d400640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f188c034000 tx=0x7f188c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.222+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1890091080 con 0x7f18a00b6540 2024-09-10T08:39:15.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.443+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f18a00b49f0 con 0x7f18a00b6540 2024-09-10T08:39:15.444 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:39:15.444+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:39:15.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.446+0000 7f1896000640 1 -- 172.21.15.52:0/2589552796 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) ==== 161+0+0 (secure 0 0 0) 0x7f1890058f80 con 0x7f18a00b6540 2024-09-10T08:39:15.446 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:39:15.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 msgr2=0x7f188006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 0x7f188006e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f188c034000 tx=0x7f188c02e000 comp rx=0 tx=0).stop 2024-09-10T08:39:15.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 msgr2=0x7f18a0154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f189000e8a0 tx=0x7f189000ed60 comp rx=0 tx=0).stop 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 shutdown_connections 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f188006be30 0x7f188006e2f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18a015e440 0x7f18a015f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18a00cf450 0x7f18a0153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 --2- 172.21.15.52:0/2589552796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a00b6540 0x7f18a0154b60 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 >> 172.21.15.52:0/2589552796 conn(0x7f18a0067f80 msgr2=0x7f18a006bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:15.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 shutdown_connections 2024-09-10T08:39:15.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.449+0000 7f189f200640 1 -- 172.21.15.52:0/2589552796 wait complete. 2024-09-10T08:39:15.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:39:15.524 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:39:15.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.622+0000 7f9172600640 1 Processor -- start 2024-09-10T08:39:15.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.623+0000 7f9172600640 1 -- start start 2024-09-10T08:39:15.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9172600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 0x7f916c162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9172600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f916c0afb90 0x7f916c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9172600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f916c144090 con 0x7f916c06bc10 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9172600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f916c141a00 con 0x7f916c0afb90 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9172600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f916c072f10 con 0x7f916c158c80 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9163e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f916c0afb90 0x7f916c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9163e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f916c0afb90 0x7f916c0729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52872/0 (socket says 172.21.15.52:52872) 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f9163e00640 1 -- 172.21.15.52:0/3968665333 learned_addr learned my addr 172.21.15.52:0/3968665333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:15.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.624+0000 7f916b400640 1 --2- 172.21.15.52:0/3968665333 >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 0x7f916c162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.625+0000 7f9163e00640 1 -- 172.21.15.52:0/3968665333 >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 msgr2=0x7f916c162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.625+0000 7f9163e00640 1 --2- 172.21.15.52:0/3968665333 >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 0x7f916c162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.625+0000 7f9163e00640 1 -- 172.21.15.52:0/3968665333 >> v1:172.21.15.176:6789/0 conn(0x7f916c06bc10 legacy=0x7f916c15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.625+0000 7f9163e00640 1 -- 172.21.15.52:0/3968665333 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c144370 con 0x7f916c0afb90 2024-09-10T08:39:15.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.625+0000 7f916b400640 1 --2- 172.21.15.52:0/3968665333 >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 0x7f916c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:15.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f9163e00640 1 --2- 172.21.15.52:0/3968665333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c0afb90 0x7f916c0729d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f916c0757e0 tx=0x7f915402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c286c7ff3358d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f916aa00640 1 -- 172.21.15.52:0/3968665333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154037070 con 0x7f916c0afb90 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f916aa00640 1 -- 172.21.15.52:0/3968665333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154032440 con 0x7f916c0afb90 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f916aa00640 1 -- 172.21.15.52:0/3968665333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154032810 con 0x7f916c0afb90 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f9172600640 1 -- 172.21.15.52:0/3968665333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c0afb90 msgr2=0x7f916c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.626+0000 7f9172600640 1 --2- 172.21.15.52:0/3968665333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c0afb90 0x7f916c0729d0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f916c0757e0 tx=0x7f915402a270 comp rx=0 tx=0).stop 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 -- 172.21.15.52:0/3968665333 shutdown_connections 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 --2- 172.21.15.52:0/3968665333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c0afb90 0x7f916c0729d0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 --2- 172.21.15.52:0/3968665333 >> v2:172.21.15.176:3300/0 conn(0x7f916c158c80 0x7f916c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 -- 172.21.15.52:0/3968665333 >> 172.21.15.52:0/3968665333 conn(0x7f916c06cd20 msgr2=0x7f916c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 -- 172.21.15.52:0/3968665333 shutdown_connections 2024-09-10T08:39:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.627+0000 7f9172600640 1 -- 172.21.15.52:0/3968665333 wait complete. 2024-09-10T08:39:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.628+0000 7f9172600640 1 Processor -- start 2024-09-10T08:39:15.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.628+0000 7f9172600640 1 -- start start 2024-09-10T08:39:15.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f916c06bc10 0x7f916c140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 0x7f916c140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f916c144c10 con 0x7f916c158c80 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f916c144930 con 0x7f916c06bc10 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.629+0000 7f9172600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f916c159060 con 0x7f916c0afb90 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f916be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f916be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52880/0 (socket says 172.21.15.52:52880) 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f916be00640 1 -- 172.21.15.52:0/722599438 learned_addr learned my addr 172.21.15.52:0/722599438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 0x7f916c140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f916b400640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f916c06bc10 0x7f916c140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 -- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f916c06bc10 msgr2=0x7f916c140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f916c06bc10 0x7f916c140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 -- 172.21.15.52:0/722599438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 msgr2=0x7f916c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 -- 172.21.15.52:0/722599438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c161da0 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f916be00640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.630+0000 7f9163e00640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 0x7f916c140010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9154031000 tx=0x7f91540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.631+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154041020 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.631+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9154030700 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.631+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154037040 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.631+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c15bd00 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.631+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c140550 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.632+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c143d20 con 0x7f916c0afb90 2024-09-10T08:39:15.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.633+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9154044020 con 0x7f916c0afb90 2024-09-10T08:39:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.634+0000 7f9163400640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 0x7f914806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.634+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(148..148 src has 1..148) ==== 5795+0+0 (secure 0 0 0) 0x7f91540ab5d0 con 0x7f916c0afb90 2024-09-10T08:39:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.634+0000 7f916b400640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 0x7f914806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:15.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.635+0000 7f916b400640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 0x7f914806e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f915c006e80 tx=0x7f915c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:15.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.639+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f915404b030 con 0x7f916c0afb90 2024-09-10T08:39:15.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:15.862+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f916c0730a0 con 0x7f916c0afb90 2024-09-10T08:39:16.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.454+0000 7f9163400640 1 -- 172.21.15.52:0/722599438 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v112) ==== 104+0+0 (secure 0 0 0) 0x7f91540a9e20 con 0x7f916c0afb90 2024-09-10T08:39:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 msgr2=0x7f914806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 0x7f914806e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f915c006e80 tx=0x7f915c008040 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 msgr2=0x7f916c140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 0x7f916c140010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9154031000 tx=0x7f91540046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 shutdown_connections 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f914806be30 0x7f914806e2f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916c158c80 0x7f916c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f916c0afb90 0x7f916c140010 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 --2- 172.21.15.52:0/722599438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f916c06bc10 0x7f916c140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 >> 172.21.15.52:0/722599438 conn(0x7f916c06cd20 msgr2=0x7f916c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 shutdown_connections 2024-09-10T08:39:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.457+0000 7f9172600640 1 -- 172.21.15.52:0/722599438 wait complete. 2024-09-10T08:39:16.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:39:16.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.639+0000 7faff7200640 1 Processor -- start 2024-09-10T08:39:16.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.639+0000 7faff7200640 1 -- start start 2024-09-10T08:39:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 0x7faff00d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff7200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7faff006bff0 0x7faff006c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff7200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff00d2dc0 con 0x7faff015eb90 2024-09-10T08:39:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff7200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7faff006c9a0 con 0x7faff006bff0 2024-09-10T08:39:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faff00d39d0 con 0x7faff015e7b0 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff5400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faff015eb90 0x7faff00b9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42268/0 (socket says 172.21.15.52:42268) 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff5400640 1 -- 172.21.15.52:0/1828289801 learned_addr learned my addr 172.21.15.52:0/1828289801 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.640+0000 7faff6800640 1 --2- 172.21.15.52:0/1828289801 >> v2:172.21.15.52:3300/0 conn(0x7faff006bff0 0x7faff006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff5e00640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 0x7faff00d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff4a00640 1 -- 172.21.15.52:0/1828289801 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865271396 0 0) 0x7faff00d2dc0 con 0x7faff015eb90 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff4a00640 1 -- 172.21.15.52:0/1828289801 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd8003520 con 0x7faff015eb90 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff6800640 1 -- 172.21.15.52:0/1828289801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 msgr2=0x7faff00d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff6800640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 0x7faff00d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff6800640 1 -- 172.21.15.52:0/1828289801 >> v1:172.21.15.52:6789/0 conn(0x7faff015eb90 legacy=0x7faff00b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff6800640 1 -- 172.21.15.52:0/1828289801 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff00d30a0 con 0x7faff006bff0 2024-09-10T08:39:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.641+0000 7faff5e00640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 0x7faff00d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.642+0000 7faff6800640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff006c460 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557b84026a42ce81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.642+0000 7faff4a00640 1 -- 172.21.15.52:0/1828289801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec007740 con 0x7faff006bff0 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.642+0000 7faff4a00640 1 -- 172.21.15.52:0/1828289801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec0078e0 con 0x7faff006bff0 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.642+0000 7faff4a00640 1 -- 172.21.15.52:0/1828289801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec007c90 con 0x7faff006bff0 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 -- 172.21.15.52:0/1828289801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 msgr2=0x7faff006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff006c460 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec02a660 comp rx=0 tx=0).stop 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 -- 172.21.15.52:0/1828289801 shutdown_connections 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff006c460 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 --2- 172.21.15.52:0/1828289801 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015e7b0 0x7faff00d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 -- 172.21.15.52:0/1828289801 >> 172.21.15.52:0/1828289801 conn(0x7faff00b6320 msgr2=0x7faff00b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 -- 172.21.15.52:0/1828289801 shutdown_connections 2024-09-10T08:39:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.643+0000 7faff7200640 1 -- 172.21.15.52:0/1828289801 wait complete. 2024-09-10T08:39:16.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.644+0000 7faff7200640 1 Processor -- start 2024-09-10T08:39:16.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.645+0000 7faff7200640 1 -- start start 2024-09-10T08:39:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.645+0000 7faff7200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff7200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 0x7faff00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff7200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 0x7faff00ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff7200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faff00d43a0 con 0x7faff006bff0 2024-09-10T08:39:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff7200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faff00d3660 con 0x7faff015e7b0 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff7200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faff00d2950 con 0x7faff015eb90 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52888/0 (socket says 172.21.15.52:52888) 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 -- 172.21.15.52:0/1276560833 learned_addr learned my addr 172.21.15.52:0/1276560833 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5400640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 0x7faff00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff6800640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 0x7faff00ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 -- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 msgr2=0x7faff00ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 0x7faff00ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 -- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 msgr2=0x7faff00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 0x7faff00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5e00640 1 -- 172.21.15.52:0/1276560833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff00cc840 con 0x7faff006bff0 2024-09-10T08:39:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff6800640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 0x7faff00ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.646+0000 7faff5400640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 0x7faff00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7faff5e00640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e810 tx=0x7fafe400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe400f040 con 0x7faff006bff0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe4004030 con 0x7faff006bff0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4004400 con 0x7faff006bff0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff015fd20 con 0x7faff006bff0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.647+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff0160000 con 0x7faff006bff0 2024-09-10T08:39:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.648+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff006c460 con 0x7faff006bff0 2024-09-10T08:39:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.649+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafe400c670 con 0x7faff006bff0 2024-09-10T08:39:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.650+0000 7fafea000640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 0x7fafd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.650+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5795+0+0 (secure 0 0 0) 0x7fafe408ada0 con 0x7faff006bff0 2024-09-10T08:39:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.650+0000 7faff5400640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 0x7fafd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.651+0000 7faff5400640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 0x7fafd406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7faff00cad70 tx=0x7fafe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:16.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.654+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafe4017020 con 0x7faff006bff0 2024-09-10T08:39:16.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:16.839+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7faff00cf710 con 0x7faff006bff0 2024-09-10T08:39:17.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.454+0000 7fafea000640 1 -- 172.21.15.52:0/1276560833 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) ==== 181+0+0 (secure 0 0 0) 0x7fafe40595c0 con 0x7faff006bff0 2024-09-10T08:39:17.455 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:39:17.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 msgr2=0x7fafd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 0x7fafd406e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7faff00cad70 tx=0x7fafe0009040 comp rx=0 tx=0).stop 2024-09-10T08:39:17.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 msgr2=0x7faff015a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e810 tx=0x7fafe400ecd0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 shutdown_connections 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fafd406be30 0x7fafd406e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faff015eb90 0x7faff00ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faff015e7b0 0x7faff00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 --2- 172.21.15.52:0/1276560833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faff006bff0 0x7faff015a900 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.461+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 >> 172.21.15.52:0/1276560833 conn(0x7faff00b6320 msgr2=0x7faff00d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.462+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 shutdown_connections 2024-09-10T08:39:17.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.462+0000 7faff7200640 1 -- 172.21.15.52:0/1276560833 wait complete. 2024-09-10T08:39:17.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:39:17.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.645+0000 7fbf60400640 1 Processor -- start 2024-09-10T08:39:17.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.646+0000 7fbf60400640 1 -- start start 2024-09-10T08:39:17.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf60400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf581454b0 0x7fbf580b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf60400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf580b0e50 0x7fbf580b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf60400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf58146220 con 0x7fbf581459a0 2024-09-10T08:39:17.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf60400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbf580b1920 con 0x7fbf580b0e50 2024-09-10T08:39:17.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf60400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf580cf640 con 0x7fbf581454b0 2024-09-10T08:39:17.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf5d000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbf581459a0 0x7fbf580b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42278/0 (socket says 172.21.15.52:42278) 2024-09-10T08:39:17.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf5d000640 1 -- 172.21.15.52:0/3722768430 learned_addr learned my addr 172.21.15.52:0/3722768430 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf5e400640 1 --2- 172.21.15.52:0/3722768430 >> v2:172.21.15.176:3300/0 conn(0x7fbf580b0e50 0x7fbf580b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf5da00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf581454b0 0x7fbf580b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.647+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034761261 0 0) 0x7fbf44001110 con 0x7fbf581459a0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf40003520 con 0x7fbf581459a0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3176551269 0 0) 0x7fbf40003520 con 0x7fbf581459a0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf581454b0 msgr2=0x7fbf580b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf581454b0 0x7fbf580b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 >> v2:172.21.15.176:3300/0 conn(0x7fbf580b0e50 msgr2=0x7fbf580b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 --2- 172.21.15.52:0/3722768430 >> v2:172.21.15.176:3300/0 conn(0x7fbf580b0e50 0x7fbf580b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf580cf8e0 con 0x7fbf581459a0 2024-09-10T08:39:17.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fbf44001840 con 0x7fbf581459a0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 >> v1:172.21.15.52:6789/0 conn(0x7fbf581459a0 legacy=0x7fbf580b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf400039b0 0x7fbf40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf400043a0 0x7fbf40004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf40004ef0 0x7fbf4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf580b1920 con 0x7fbf400043a0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf580cf640 con 0x7fbf40004ef0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4000bf00 con 0x7fbf400039b0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf400043a0 0x7fbf40004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf5da00640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf400039b0 0x7fbf40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.648+0000 7fbf5e400640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf40004ef0 0x7fbf4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5d000640 1 -- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf400039b0 msgr2=0x7fbf40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf400039b0 0x7fbf40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5d000640 1 -- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf40004ef0 msgr2=0x7fbf4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:17.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf40004ef0 0x7fbf4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5d000640 1 -- 172.21.15.52:0/3722768430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf40003520 con 0x7fbf400043a0 2024-09-10T08:39:17.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.649+0000 7fbf5e400640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf40004ef0 0x7fbf4000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:17.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf400043a0 0x7fbf40004880 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c4c0 tx=0x7fbf40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e3a7fbf4c7eba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400c0e0 con 0x7fbf400043a0 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf44034070 con 0x7fbf400043a0 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf57e00640 1 -- 172.21.15.52:0/3722768430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44005d70 con 0x7fbf400043a0 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf60400640 1 -- 172.21.15.52:0/3722768430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf400043a0 msgr2=0x7fbf40004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf60400640 1 --2- 172.21.15.52:0/3722768430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf400043a0 0x7fbf40004880 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c4c0 tx=0x7fbf40005830 comp rx=0 tx=0).stop 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf5e400640 1 -- 172.21.15.52:0/3722768430 reap_dead start 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf60400640 1 -- 172.21.15.52:0/3722768430 shutdown_connections 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf60400640 1 -- 172.21.15.52:0/3722768430 >> 172.21.15.52:0/3722768430 conn(0x7fbf5806c240 msgr2=0x7fbf5806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:17.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.650+0000 7fbf60400640 1 -- 172.21.15.52:0/3722768430 shutdown_connections 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.651+0000 7fbf60400640 1 -- 172.21.15.52:0/3722768430 wait complete. 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.652+0000 7fbf60400640 1 Processor -- start 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.652+0000 7fbf60400640 1 -- start start 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf400043a0 0x7fbf5815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58137c30 0x7fbf581380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf580d0180 con 0x7fbf58141e70 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbf580cfea0 con 0x7fbf400043a0 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf60400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbf580b24c0 con 0x7fbf58137c30 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf5d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf5d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52910/0 (socket says 172.21.15.52:52910) 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf5d000640 1 -- 172.21.15.52:0/3213574759 learned_addr learned my addr 172.21.15.52:0/3213574759 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:17.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf5e400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58137c30 0x7fbf581380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.653+0000 7fbf5da00640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf400043a0 0x7fbf5815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 -- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58137c30 msgr2=0x7fbf581380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58137c30 0x7fbf581380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 -- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf400043a0 msgr2=0x7fbf5815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf400043a0 0x7fbf5815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 -- 172.21.15.52:0/3213574759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5815b8f0 con 0x7fbf58141e70 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.654+0000 7fbf5d000640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c5e0 tx=0x7fbf580cf590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.655+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44007270 con 0x7fbf58141e70 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.655+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf44007410 con 0x7fbf58141e70 2024-09-10T08:39:17.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.655+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf440077c0 con 0x7fbf58141e70 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.655+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5815bbd0 con 0x7fbf58141e70 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.655+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5815b5e0 con 0x7fbf58141e70 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.656+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5806ea50 con 0x7fbf58141e70 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.657+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf44039480 con 0x7fbf58141e70 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.658+0000 7fbf55600640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 0x7fbf3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.658+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5357+0+0 (secure 0 0 0) 0x7fbf440abb80 con 0x7fbf58141e70 2024-09-10T08:39:17.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.659+0000 7fbf5da00640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 0x7fbf3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:17.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.659+0000 7fbf5da00640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 0x7fbf3806e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbf581388e0 tx=0x7fbf4c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:17.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.663+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf5806ea50 con 0x7fbf58141e70 2024-09-10T08:39:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:17.846+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf580b1d90 con 0x7fbf58141e70 2024-09-10T08:39:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.460+0000 7fbf55600640 1 -- 172.21.15.52:0/3213574759 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v150) ==== 169+0+0 (secure 0 0 0) 0x7fbf58146220 con 0x7fbf58141e70 2024-09-10T08:39:18.460 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:39:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.466+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 msgr2=0x7fbf3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.466+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 0x7fbf3806e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbf581388e0 tx=0x7fbf4c009190 comp rx=0 tx=0).stop 2024-09-10T08:39:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.466+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 msgr2=0x7fbf581422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.466+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c5e0 tx=0x7fbf580cf590 comp rx=0 tx=0).stop 2024-09-10T08:39:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 shutdown_connections 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbf3806be60 0x7fbf3806e320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf58137c30 0x7fbf581380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf58141e70 0x7fbf581422f0 secure :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c5e0 tx=0x7fbf580cf590 comp rx=0 tx=0).stop 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 --2- 172.21.15.52:0/3213574759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf400043a0 0x7fbf5815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 >> 172.21.15.52:0/3213574759 conn(0x7fbf5806c240 msgr2=0x7fbf5806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.467+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 shutdown_connections 2024-09-10T08:39:18.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.468+0000 7fbf60400640 1 -- 172.21.15.52:0/3213574759 wait complete. 2024-09-10T08:39:18.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:39:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.667+0000 7fc624600640 1 Processor -- start 2024-09-10T08:39:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.668+0000 7fc624600640 1 -- start start 2024-09-10T08:39:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc624600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc61c0cce30 0x7fc61c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc624600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc624600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61c0714b0 con 0x7fc61c0732e0 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc624600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc61c0cd880 con 0x7fc61c0cce30 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc624600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c0cdb60 con 0x7fc61c071c70 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc621200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc61c0cce30 0x7fc61c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc621c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc61c0732e0 0x7fc61c0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42282/0 (socket says 172.21.15.52:42282) 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc621c00640 1 -- 172.21.15.52:0/1445558783 learned_addr learned my addr 172.21.15.52:0/1445558783 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.669+0000 7fc622600640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.670+0000 7fc621200640 1 -- 172.21.15.52:0/1445558783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 msgr2=0x7fc61c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.670+0000 7fc621200640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.670+0000 7fc621200640 1 -- 172.21.15.52:0/1445558783 >> v1:172.21.15.52:6789/0 conn(0x7fc61c0732e0 legacy=0x7fc61c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.670+0000 7fc621200640 1 -- 172.21.15.52:0/1445558783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c0cde40 con 0x7fc61c0cce30 2024-09-10T08:39:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc621200640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0cce30 0x7fc61c0cd2a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc6080097a0 tx=0x7fc60802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9881e7fe8f49c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:18.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc61be00640 1 -- 172.21.15.52:0/1445558783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608037070 con 0x7fc61c0cce30 2024-09-10T08:39:18.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc61be00640 1 -- 172.21.15.52:0/1445558783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60802ae50 con 0x7fc61c0cce30 2024-09-10T08:39:18.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc61be00640 1 -- 172.21.15.52:0/1445558783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608032660 con 0x7fc61c0cce30 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 -- 172.21.15.52:0/1445558783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0cce30 msgr2=0x7fc61c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0cce30 0x7fc61c0cd2a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fc6080097a0 tx=0x7fc60802a100 comp rx=0 tx=0).stop 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 -- 172.21.15.52:0/1445558783 shutdown_connections 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 --2- 172.21.15.52:0/1445558783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0cce30 0x7fc61c0cd2a0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.671+0000 7fc624600640 1 -- 172.21.15.52:0/1445558783 >> 172.21.15.52:0/1445558783 conn(0x7fc61c06d0f0 msgr2=0x7fc61c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.672+0000 7fc624600640 1 -- 172.21.15.52:0/1445558783 shutdown_connections 2024-09-10T08:39:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.672+0000 7fc624600640 1 -- 172.21.15.52:0/1445558783 wait complete. 2024-09-10T08:39:18.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.673+0000 7fc624600640 1 Processor -- start 2024-09-10T08:39:18.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.673+0000 7fc624600640 1 -- start start 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c0cce30 0x7fc61c146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c15ca50 con 0x7fc61c0732e0 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c15c8d0 con 0x7fc61c0cce30 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc624600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c15cbd0 con 0x7fc61c071c70 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc621200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc621200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52934/0 (socket says 172.21.15.52:52934) 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.674+0000 7fc621200640 1 -- 172.21.15.52:0/1007952540 learned_addr learned my addr 172.21.15.52:0/1007952540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc622600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c0cce30 0x7fc61c146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621c00640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 -- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 msgr2=0x7fc61c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 -- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c0cce30 msgr2=0x7fc61c146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c0cce30 0x7fc61c146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 -- 172.21.15.52:0/1007952540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c158200 con 0x7fc61c0732e0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc621200640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc6080096f0 tx=0x7fc6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.675+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608041020 con 0x7fc61c0732e0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.676+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60803c670 con 0x7fc61c0732e0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.676+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608037040 con 0x7fc61c0732e0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.676+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c1584e0 con 0x7fc61c0732e0 2024-09-10T08:39:18.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.676+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c158aa0 con 0x7fc61c0732e0 2024-09-10T08:39:18.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.677+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61c0cd2a0 con 0x7fc61c0732e0 2024-09-10T08:39:18.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.677+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc608044020 con 0x7fc61c0732e0 2024-09-10T08:39:18.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.679+0000 7fc619600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:18.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.679+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7fc6080ab2d0 con 0x7fc61c0732e0 2024-09-10T08:39:18.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.679+0000 7fc621c00640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:18.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.680+0000 7fc621c00640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc610000f60 tx=0x7fc610009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:18.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.683+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc60804b030 con 0x7fc61c0732e0 2024-09-10T08:39:18.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.866+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc61c0711f0 con 0x7fc61c0732e0 2024-09-10T08:39:18.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.870+0000 7fc619600640 1 -- 172.21.15.52:0/1007952540 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7fc608079ee0 con 0x7fc61c0732e0 2024-09-10T08:39:18.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 msgr2=0x7fc5fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc610000f60 tx=0x7fc610009040 comp rx=0 tx=0).stop 2024-09-10T08:39:18.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 msgr2=0x7fc61c1579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fc6080096f0 tx=0x7fc6080046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 shutdown_connections 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc5fc06be30 0x7fc5fc06e2f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc61c0cce30 0x7fc61c146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c0732e0 0x7fc61c1579f0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 --2- 172.21.15.52:0/1007952540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc61c071c70 0x7fc61c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.872+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 >> 172.21.15.52:0/1007952540 conn(0x7fc61c06d0f0 msgr2=0x7fc61c0736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.873+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 shutdown_connections 2024-09-10T08:39:18.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:18.873+0000 7fc624600640 1 -- 172.21.15.52:0/1007952540 wait complete. 2024-09-10T08:39:18.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-10T08:39:19.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.043+0000 7fb780600640 1 Processor -- start 2024-09-10T08:39:19.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.043+0000 7fb780600640 1 -- start start 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.044+0000 7fb780600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7780b2d40 0x7fb77806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.044+0000 7fb780600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb77813eb20 0x7fb77806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb780600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb778071180 con 0x7fb77815bcf0 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb780600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb77815c890 con 0x7fb7780b2d40 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb780600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb778071ab0 con 0x7fb77813eb20 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7780b2d40 0x7fb77806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb7780b2d40 0x7fb77806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52942/0 (socket says 172.21.15.52:52942) 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 -- 172.21.15.52:0/631615078 learned_addr learned my addr 172.21.15.52:0/631615078 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77d200640 1 --2- 172.21.15.52:0/631615078 >> v2:172.21.15.176:3300/0 conn(0x7fb77813eb20 0x7fb77806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 -- 172.21.15.52:0/631615078 >> v2:172.21.15.176:3300/0 conn(0x7fb77813eb20 msgr2=0x7fb77806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 --2- 172.21.15.52:0/631615078 >> v2:172.21.15.176:3300/0 conn(0x7fb77813eb20 0x7fb77806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 -- 172.21.15.52:0/631615078 >> v1:172.21.15.176:6789/0 conn(0x7fb77815bcf0 legacy=0x7fb77815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.045+0000 7fb77dc00640 1 -- 172.21.15.52:0/631615078 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb778071460 con 0x7fb7780b2d40 2024-09-10T08:39:19.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.046+0000 7fb77dc00640 1 --2- 172.21.15.52:0/631615078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7780b2d40 0x7fb77806bc10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fb7780d1500 tx=0x7fb76c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93681154dd1c9d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb777e00640 1 -- 172.21.15.52:0/631615078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c037070 con 0x7fb7780b2d40 2024-09-10T08:39:19.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb777e00640 1 -- 172.21.15.52:0/631615078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76c032440 con 0x7fb7780b2d40 2024-09-10T08:39:19.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb777e00640 1 -- 172.21.15.52:0/631615078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c032810 con 0x7fb7780b2d40 2024-09-10T08:39:19.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 -- 172.21.15.52:0/631615078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7780b2d40 msgr2=0x7fb77806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 --2- 172.21.15.52:0/631615078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7780b2d40 0x7fb77806bc10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fb7780d1500 tx=0x7fb76c02a270 comp rx=0 tx=0).stop 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 -- 172.21.15.52:0/631615078 shutdown_connections 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 --2- 172.21.15.52:0/631615078 >> v2:172.21.15.176:3300/0 conn(0x7fb77813eb20 0x7fb77806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 --2- 172.21.15.52:0/631615078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7780b2d40 0x7fb77806bc10 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 -- 172.21.15.52:0/631615078 >> 172.21.15.52:0/631615078 conn(0x7fb7780ccec0 msgr2=0x7fb7780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 -- 172.21.15.52:0/631615078 shutdown_connections 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.047+0000 7fb780600640 1 -- 172.21.15.52:0/631615078 wait complete. 2024-09-10T08:39:19.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.049+0000 7fb780600640 1 Processor -- start 2024-09-10T08:39:19.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.049+0000 7fb780600640 1 -- start start 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7780b2d40 0x7fb778152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb77813eb20 0x7fb77815d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7780720c0 con 0x7fb77815bcf0 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb778071f40 con 0x7fb77813eb20 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb780600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb778072240 con 0x7fb7780b2d40 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.050+0000 7fb77e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52948/0 (socket says 172.21.15.52:52948) 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 -- 172.21.15.52:0/37212367 learned_addr learned my addr 172.21.15.52:0/37212367 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77dc00640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7780b2d40 0x7fb778152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77d200640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb77813eb20 0x7fb77815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 -- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7780b2d40 msgr2=0x7fb778152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7780b2d40 0x7fb778152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 -- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb77813eb20 msgr2=0x7fb77815d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb77813eb20 0x7fb77815d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 -- 172.21.15.52:0/37212367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77815dfb0 con 0x7fb77815bcf0 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.051+0000 7fb77e600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c6b0 tx=0x7fb77000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.052+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770003b70 con 0x7fb77815bcf0 2024-09-10T08:39:19.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.052+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb770003d30 con 0x7fb77815bcf0 2024-09-10T08:39:19.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.052+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770005310 con 0x7fb77815bcf0 2024-09-10T08:39:19.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.052+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77815e290 con 0x7fb77815bcf0 2024-09-10T08:39:19.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.052+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77815e850 con 0x7fb77815bcf0 2024-09-10T08:39:19.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.053+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7780d1550 con 0x7fb77815bcf0 2024-09-10T08:39:19.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.054+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7700054b0 con 0x7fb77815bcf0 2024-09-10T08:39:19.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.055+0000 7fb775600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.055+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7fb77008a970 con 0x7fb77815bcf0 2024-09-10T08:39:19.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.055+0000 7fb77dc00640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.056+0000 7fb77dc00640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 0x7fb75806e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb76c034000 tx=0x7fb76c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.059+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7780d1550 con 0x7fb77815bcf0 2024-09-10T08:39:19.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.308+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fb77815c180 con 0x7fb77815bcf0 2024-09-10T08:39:19.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.462+0000 7fb775600640 1 -- 172.21.15.52:0/37212367 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v503) ==== 166+0+0 (secure 0 0 0) 0x7fb770058f30 con 0x7fb77815bcf0 2024-09-10T08:39:19.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 msgr2=0x7fb75806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 0x7fb75806e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb76c034000 tx=0x7fb76c02e000 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 msgr2=0x7fb77815d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c6b0 tx=0x7fb77000cb70 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 shutdown_connections 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb75806be30 0x7fb75806e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb77815bcf0 0x7fb77815d9b0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb77813eb20 0x7fb77815d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 --2- 172.21.15.52:0/37212367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7780b2d40 0x7fb778152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 >> 172.21.15.52:0/37212367 conn(0x7fb7780ccec0 msgr2=0x7fb778154b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 shutdown_connections 2024-09-10T08:39:19.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.465+0000 7fb780600640 1 -- 172.21.15.52:0/37212367 wait complete. 2024-09-10T08:39:19.481 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T08:39:19.481 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T08:39:19.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.638+0000 7f6d8b200640 1 Processor -- start 2024-09-10T08:39:19.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.638+0000 7f6d8b200640 1 -- start start 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d8b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d8c15e440 0x7f6d8c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d8b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 0x7f6d8c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d8b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8c0d3990 con 0x7f6d8c0cf450 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d8b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8c0d3c70 con 0x7f6d8c15e440 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d8b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c0d3f50 con 0x7f6d8c0b6710 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d89e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d8c15e440 0x7f6d8c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d89e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6d8c15e440 0x7f6d8c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52964/0 (socket says 172.21.15.52:52964) 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.639+0000 7f6d89e00640 1 -- 172.21.15.52:0/3427518265 learned_addr learned my addr 172.21.15.52:0/3427518265 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d8a800640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 0x7f6d8c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d89e00640 1 -- 172.21.15.52:0/3427518265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 msgr2=0x7f6d8c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d89e00640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 0x7f6d8c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d89e00640 1 -- 172.21.15.52:0/3427518265 >> v1:172.21.15.176:6789/0 conn(0x7f6d8c0cf450 legacy=0x7f6d8c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d89e00640 1 -- 172.21.15.52:0/3427518265 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c0d4230 con 0x7f6d8c15e440 2024-09-10T08:39:19.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.640+0000 7f6d8a800640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 0x7f6d8c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.641+0000 7f6d89e00640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0d3240 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009870 tx=0x7f6d7c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41de145baed6ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.641+0000 7f6d88a00640 1 -- 172.21.15.52:0/3427518265 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c037070 con 0x7f6d8c15e440 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.641+0000 7f6d88a00640 1 -- 172.21.15.52:0/3427518265 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c032440 con 0x7f6d8c15e440 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.641+0000 7f6d88a00640 1 -- 172.21.15.52:0/3427518265 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c032810 con 0x7f6d8c15e440 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.641+0000 7f6d8b200640 1 -- 172.21.15.52:0/3427518265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 msgr2=0x7f6d8c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0d3240 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009870 tx=0x7f6d7c02a2a0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 -- 172.21.15.52:0/3427518265 shutdown_connections 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0b6710 0x7f6d8c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 --2- 172.21.15.52:0/3427518265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0d3240 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 -- 172.21.15.52:0/3427518265 >> 172.21.15.52:0/3427518265 conn(0x7f6d8c067f80 msgr2=0x7f6d8c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 -- 172.21.15.52:0/3427518265 shutdown_connections 2024-09-10T08:39:19.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.642+0000 7f6d8b200640 1 -- 172.21.15.52:0/3427518265 wait complete. 2024-09-10T08:39:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.643+0000 7f6d8b200640 1 Processor -- start 2024-09-10T08:39:19.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.644+0000 7f6d8b200640 1 -- start start 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.644+0000 7f6d8b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b6710 0x7f6d8c1f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 0x7f6d8c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0b76c0 con 0x7f6d8c15e440 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0b7540 con 0x7f6d8c0b6710 2024-09-10T08:39:19.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c0b80a0 con 0x7f6d8c0cf450 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52980/0 (socket says 172.21.15.52:52980) 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 -- 172.21.15.52:0/1857575769 learned_addr learned my addr 172.21.15.52:0/1857575769 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d89e00640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b6710 0x7f6d8c1f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d89400640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 0x7f6d8c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 -- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 msgr2=0x7f6d8c157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 0x7f6d8c157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 -- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b6710 msgr2=0x7f6d8c1f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b6710 0x7f6d8c1f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d8a800640 1 -- 172.21.15.52:0/1857575769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c15b0e0 con 0x7f6d8c15e440 2024-09-10T08:39:19.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.645+0000 7f6d89400640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 0x7f6d8c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d8a800640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cef0 tx=0x7f6d8400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8401a070 con 0x7f6d8c15e440 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8400d860 con 0x7f6d8c15e440 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400dc50 con 0x7f6d8c15e440 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c15a560 con 0x7f6d8c15e440 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.646+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c15ab20 con 0x7f6d8c15e440 2024-09-10T08:39:19.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.647+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c0cfae0 con 0x7f6d8c15e440 2024-09-10T08:39:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.648+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d8401d070 con 0x7f6d8c15e440 2024-09-10T08:39:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.649+0000 7f6d82000640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 0x7f6d6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:19.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.649+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7f6d8408b430 con 0x7f6d8c15e440 2024-09-10T08:39:19.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.650+0000 7f6d89e00640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 0x7f6d6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:19.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.650+0000 7f6d89e00640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 0x7f6d6c06e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c034000 tx=0x7f6d7c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:19.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.653+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d8c0cfae0 con 0x7f6d8c15e440 2024-09-10T08:39:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.840+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d8c068dd0 con 0x7f6d8c15e440 2024-09-10T08:39:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.841+0000 7f6d82000640 1 -- 172.21.15.52:0/1857575769 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) ==== 74+0+13056 (secure 0 0 0) 0x7f6d8c068dd0 con 0x7f6d8c15e440 2024-09-10T08:39:19.841 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:19.841 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":150,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:39:18.455601+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6837/2632927131":"2024-09-11T08:39:15.445456+0000","172.21.15.176:6835/2632927131":"2024-09-11T08:39:15.445456+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 msgr2=0x7f6d6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 0x7f6d6c06e2f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c034000 tx=0x7f6d7c02e000 comp rx=0 tx=0).stop 2024-09-10T08:39:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 msgr2=0x7f6d8c0b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:19.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400cef0 tx=0x7f6d8400a710 comp rx=0 tx=0).stop 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 shutdown_connections 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d6c06be30 0x7f6d6c06e2f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d8c15e440 0x7f6d8c0b95e0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d8c0cf450 0x7f6d8c157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 --2- 172.21.15.52:0/1857575769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d8c0b6710 0x7f6d8c1f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 >> 172.21.15.52:0/1857575769 conn(0x7f6d8c067f80 msgr2=0x7f6d8c0ca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 shutdown_connections 2024-09-10T08:39:19.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:19.843+0000 7f6d8b200640 1 -- 172.21.15.52:0/1857575769 wait complete. 2024-09-10T08:39:19.860 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:39:19.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:39:20.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.019+0000 7fb4d1e00640 1 Processor -- start 2024-09-10T08:39:20.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.019+0000 7fb4d1e00640 1 -- start start 2024-09-10T08:39:20.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b63b0 0x7fb4cc0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 0x7fb4cc067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb4cc0d3950 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb4cc0d3c30 con 0x7fb4cc067950 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d1e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc0d3f10 con 0x7fb4cc0b63b0 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d0a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52986/0 (socket says 172.21.15.52:52986) 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.020+0000 7fb4d0a00640 1 -- 172.21.15.52:0/2626623443 learned_addr learned my addr 172.21.15.52:0/2626623443 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d0a00640 1 -- 172.21.15.52:0/2626623443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b63b0 msgr2=0x7fb4cc0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/2626623443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b63b0 0x7fb4cc0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d1400640 1 --2- 172.21.15.52:0/2626623443 >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 0x7fb4cc067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d0a00640 1 -- 172.21.15.52:0/2626623443 >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 msgr2=0x7fb4cc067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/2626623443 >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 0x7fb4cc067e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d0a00640 1 -- 172.21.15.52:0/2626623443 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc0d41f0 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.021+0000 7fb4d1400640 1 --2- 172.21.15.52:0/2626623443 >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 0x7fb4cc067e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.022+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/2626623443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc06d090 tx=0x7fb4c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4dec11a255e121 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.022+0000 7fb4cb400640 1 -- 172.21.15.52:0/2626623443 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0037070 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.022+0000 7fb4cb400640 1 -- 172.21.15.52:0/2626623443 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c0032440 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.022+0000 7fb4cb400640 1 -- 172.21.15.52:0/2626623443 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0032810 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 -- 172.21.15.52:0/2626623443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc0b5fd0 msgr2=0x7fb4cc0d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/2626623443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc06d090 tx=0x7fb4c002a270 comp rx=0 tx=0).stop 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 -- 172.21.15.52:0/2626623443 shutdown_connections 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/2626623443 >> v2:172.21.15.176:3300/0 conn(0x7fb4cc067950 0x7fb4cc067e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/2626623443 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b63b0 0x7fb4cc0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/2626623443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc0b5fd0 0x7fb4cc0d32c0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 -- 172.21.15.52:0/2626623443 >> 172.21.15.52:0/2626623443 conn(0x7fb4cc0d0fd0 msgr2=0x7fb4cc0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:20.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 -- 172.21.15.52:0/2626623443 shutdown_connections 2024-09-10T08:39:20.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.023+0000 7fb4d1e00640 1 -- 172.21.15.52:0/2626623443 wait complete. 2024-09-10T08:39:20.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.025+0000 7fb4d1e00640 1 Processor -- start 2024-09-10T08:39:20.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.025+0000 7fb4d1e00640 1 -- start start 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 0x7fb4cc1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 0x7fb4cc156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0cfd10 con 0x7fb4cc067950 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc0cfb90 con 0x7fb4cc0b63b0 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc0b67d0 con 0x7fb4cc0b5fd0 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53002/0 (socket says 172.21.15.52:53002) 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 -- 172.21.15.52:0/3958579745 learned_addr learned my addr 172.21.15.52:0/3958579745 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1400640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 0x7fb4cc156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4cbe00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 0x7fb4cc1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 -- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 msgr2=0x7fb4cc1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 0x7fb4cc1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 -- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 msgr2=0x7fb4cc156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 0x7fb4cc156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d0a00640 1 -- 172.21.15.52:0/3958579745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc1593c0 con 0x7fb4cc067950 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4d1400640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 0x7fb4cc156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.026+0000 7fb4cbe00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 0x7fb4cc1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4d0a00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb4c002a2b0 tx=0x7fb4c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0037040 con 0x7fb4cc067950 2024-09-10T08:39:20.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c0042070 con 0x7fb4cc067950 2024-09-10T08:39:20.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0030bb0 con 0x7fb4cc067950 2024-09-10T08:39:20.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc1596a0 con 0x7fb4cc067950 2024-09-10T08:39:20.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.027+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc159c60 con 0x7fb4cc067950 2024-09-10T08:39:20.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.028+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc15e7f0 con 0x7fb4cc067950 2024-09-10T08:39:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.029+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4c0047460 con 0x7fb4cc067950 2024-09-10T08:39:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.030+0000 7fb4c8c00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.030+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7fb4c00ab7c0 con 0x7fb4cc067950 2024-09-10T08:39:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.030+0000 7fb4cbe00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.031+0000 7fb4cbe00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8006fd0 tx=0x7fb4b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.035+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4c0045360 con 0x7fb4cc067950 2024-09-10T08:39:20.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.218+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb4cc0b9920 con 0x7fb4cc067950 2024-09-10T08:39:20.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.218+0000 7fb4c8c00640 1 -- 172.21.15.52:0/3958579745 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) ==== 93+0+10 (secure 0 0 0) 0x7fb4c007a460 con 0x7fb4cc067950 2024-09-10T08:39:20.219 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 msgr2=0x7fb4ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8006fd0 tx=0x7fb4b8008040 comp rx=0 tx=0).stop 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 msgr2=0x7fb4cc158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb4c002a2b0 tx=0x7fb4c00046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 shutdown_connections 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4ac06be30 0x7fb4ac06e2f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4cc0b63b0 0x7fb4cc156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4cc0b5fd0 0x7fb4cc1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 --2- 172.21.15.52:0/3958579745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4cc067950 0x7fb4cc158dc0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.220+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 >> 172.21.15.52:0/3958579745 conn(0x7fb4cc0d0fd0 msgr2=0x7fb4cc0b9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.221+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 shutdown_connections 2024-09-10T08:39:20.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.221+0000 7fb4d1e00640 1 -- 172.21.15.52:0/3958579745 wait complete. 2024-09-10T08:39:20.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-10T08:39:20.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.393+0000 7f8954e00640 1 Processor -- start 2024-09-10T08:39:20.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.393+0000 7f8954e00640 1 -- start start 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.394+0000 7f8954e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 0x7f89500d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.394+0000 7f8954e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500d3990 con 0x7f89500b6710 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.394+0000 7f8954e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500d3c70 con 0x7f895015e440 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.394+0000 7f8954e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89500d3f50 con 0x7f89500cf450 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f8946a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89500b6710 0x7f89500b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42292/0 (socket says 172.21.15.52:42292) 2024-09-10T08:39:20.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f8946a00640 1 -- 172.21.15.52:0/3716504452 learned_addr learned my addr 172.21.15.52:0/3716504452 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894fe00640 1 --2- 172.21.15.52:0/3716504452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 0x7f89500d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318939679 0 0) 0x7f89500d3990 con 0x7f89500b6710 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8934003520 con 0x7f89500b6710 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117538943 0 0) 0x7f89500d3c70 con 0x7f895015e440 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89500d3990 con 0x7f895015e440 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4155807013 0 0) 0x7f8934003520 con 0x7f89500b6710 2024-09-10T08:39:20.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894fe00640 1 -- 172.21.15.52:0/3716504452 >> v1:172.21.15.176:6789/0 conn(0x7f895015e440 legacy=0x7f89500b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894fe00640 1 -- 172.21.15.52:0/3716504452 >> v1:172.21.15.52:6789/0 conn(0x7f89500b6710 legacy=0x7f89500b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.395+0000 7f894fe00640 1 -- 172.21.15.52:0/3716504452 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89500d4230 con 0x7f89500cf450 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.396+0000 7f894fe00640 1 --2- 172.21.15.52:0/3716504452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 0x7f89500d3240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8948009dc0 tx=0x7f894802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b46fbdc75676357 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938001670 con 0x7f89500cf450 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894802ae50 con 0x7f89500cf450 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f894ea00640 1 -- 172.21.15.52:0/3716504452 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948007740 con 0x7f89500cf450 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 -- 172.21.15.52:0/3716504452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 msgr2=0x7f89500d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 --2- 172.21.15.52:0/3716504452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 0x7f89500d3240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8948009dc0 tx=0x7f894802a6f0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 -- 172.21.15.52:0/3716504452 shutdown_connections 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 --2- 172.21.15.52:0/3716504452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f89500cf450 0x7f89500d3240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 -- 172.21.15.52:0/3716504452 >> 172.21.15.52:0/3716504452 conn(0x7f8950067f80 msgr2=0x7f89500d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 -- 172.21.15.52:0/3716504452 shutdown_connections 2024-09-10T08:39:20.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.397+0000 7f8954e00640 1 -- 172.21.15.52:0/3716504452 wait complete. 2024-09-10T08:39:20.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.399+0000 7f8954e00640 1 Processor -- start 2024-09-10T08:39:20.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.399+0000 7f8954e00640 1 -- start start 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89500b6710 0x7f89500b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895015e440 0x7f89501f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89500b76c0 con 0x7f89500cf450 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89500b7540 con 0x7f89500b6710 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8954e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89500b8270 con 0x7f895015e440 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f8946a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.400+0000 7f894f400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89500b6710 0x7f89500b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53004/0 (socket says 172.21.15.52:53004) 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 -- 172.21.15.52:0/4016468974 learned_addr learned my addr 172.21.15.52:0/4016468974 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:20.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f894fe00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895015e440 0x7f89501f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 -- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895015e440 msgr2=0x7f89501f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895015e440 0x7f89501f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 -- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89500b6710 msgr2=0x7f89500b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89500b6710 0x7f89500b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 -- 172.21.15.52:0/4016468974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950159050 con 0x7f89500cf450 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8946a00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8938001eb0 tx=0x7f893800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.401+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938017070 con 0x7f89500cf450 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.402+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938005ad0 con 0x7f89500cf450 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.402+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938007070 con 0x7f89500cf450 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.402+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89500b2f30 con 0x7f89500cf450 2024-09-10T08:39:20.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.402+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89500ab4e0 con 0x7f89500cf450 2024-09-10T08:39:20.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.403+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89500d3240 con 0x7f89500cf450 2024-09-10T08:39:20.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.404+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f893801a070 con 0x7f89500cf450 2024-09-10T08:39:20.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.404+0000 7f8947e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 0x7f892c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:20.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.405+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7f893808a060 con 0x7f89500cf450 2024-09-10T08:39:20.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.405+0000 7f894f400640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 0x7f892c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:20.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.406+0000 7f894f400640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 0x7f892c06e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8940007fd0 tx=0x7f8940009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:20.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.409+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89380586b0 con 0x7f89500cf450 2024-09-10T08:39:20.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:20.665+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f89500b3fc0 con 0x7f89500cf450 2024-09-10T08:39:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.469+0000 7f8947e00640 1 -- 172.21.15.52:0/4016468974 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v505) ==== 169+0+0 (secure 0 0 0) 0x7f893805c9b0 con 0x7f89500cf450 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 msgr2=0x7f892c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 0x7f892c06e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8940007fd0 tx=0x7f8940009040 comp rx=0 tx=0).stop 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 msgr2=0x7f89501586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8938001eb0 tx=0x7f893800cbe0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 shutdown_connections 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f892c06be30 0x7f892c06e2f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f895015e440 0x7f89501f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89500cf450 0x7f89501586a0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 --2- 172.21.15.52:0/4016468974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89500b6710 0x7f89500b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 >> 172.21.15.52:0/4016468974 conn(0x7f8950067f80 msgr2=0x7f89500b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 shutdown_connections 2024-09-10T08:39:21.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.472+0000 7f8954e00640 1 -- 172.21.15.52:0/4016468974 wait complete. 2024-09-10T08:39:21.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:39:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.650+0000 7fb28c000640 1 Processor -- start 2024-09-10T08:39:21.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.650+0000 7fb28c000640 1 -- start start 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.651+0000 7fb28c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb2840cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.651+0000 7fb28c000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2840714b0 con 0x7fb284071c70 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.651+0000 7fb28c000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2840cd880 con 0x7fb2840732e0 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.651+0000 7fb28c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2840cdb60 con 0x7fb2840cce30 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb28a000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb284071c70 0x7fb28415c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42294/0 (socket says 172.21.15.52:42294) 2024-09-10T08:39:21.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb28a000640 1 -- 172.21.15.52:0/1503357149 learned_addr learned my addr 172.21.15.52:0/1503357149 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:21.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb288c00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb2840cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932571382 0 0) 0x7fb2840714b0 con 0x7fb284071c70 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb26c003520 con 0x7fb284071c70 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.652+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1861206712 0 0) 0x7fb26c003520 con 0x7fb284071c70 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 msgr2=0x7fb2840cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb2840cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 >> v1:172.21.15.176:6789/0 conn(0x7fb2840732e0 legacy=0x7fb2840736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840cde40 con 0x7fb284071c70 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fb27c0019f0 con 0x7fb284071c70 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 >> v1:172.21.15.52:6789/0 conn(0x7fb284071c70 legacy=0x7fb28415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c0039e0 0x7fb26c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb26c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb26c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840cdb60 con 0x7fb26c004d40 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c00ba70 con 0x7fb26c0039e0 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb26c00bc70 con 0x7fb2840cce30 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb26c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb289600640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c0039e0 0x7fb26c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb288c00640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb26c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 -- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 msgr2=0x7fb26c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2840cce30 0x7fb26c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 -- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c0039e0 msgr2=0x7fb26c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26c0039e0 0x7fb26c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.653+0000 7fb28a000640 1 -- 172.21.15.52:0/1503357149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c003520 con 0x7fb26c004d40 2024-09-10T08:39:21.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.654+0000 7fb28a000640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb26c0051c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00a920 tx=0x7fb26c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417ed037d335e052 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:21.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00a4c0 con 0x7fb26c004d40 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c02f070 con 0x7fb26c004d40 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb283e00640 1 -- 172.21.15.52:0/1503357149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c02bce0 con 0x7fb26c004d40 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 -- 172.21.15.52:0/1503357149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 msgr2=0x7fb26c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 --2- 172.21.15.52:0/1503357149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb26c0051c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00a920 tx=0x7fb26c005830 comp rx=0 tx=0).stop 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28a000640 1 -- 172.21.15.52:0/1503357149 reap_dead start 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 -- 172.21.15.52:0/1503357149 shutdown_connections 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 -- 172.21.15.52:0/1503357149 >> 172.21.15.52:0/1503357149 conn(0x7fb28406d0f0 msgr2=0x7fb28406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 -- 172.21.15.52:0/1503357149 shutdown_connections 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.655+0000 7fb28c000640 1 -- 172.21.15.52:0/1503357149 wait complete. 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.657+0000 7fb28c000640 1 Processor -- start 2024-09-10T08:39:21.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.657+0000 7fb28c000640 1 -- start start 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840b45f0 0x7fb2840b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 0x7fb284147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840cd3f0 con 0x7fb26c004d40 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840cd270 con 0x7fb2840b45f0 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2840cd570 con 0x7fb284147a80 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb289600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb289600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53020/0 (socket says 172.21.15.52:53020) 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb289600640 1 -- 172.21.15.52:0/357180152 learned_addr learned my addr 172.21.15.52:0/357180152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb288c00640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840b45f0 0x7fb2840b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.658+0000 7fb28a000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 0x7fb284147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 -- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 msgr2=0x7fb284147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 0x7fb284147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 -- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840b45f0 msgr2=0x7fb2840b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840b45f0 0x7fb2840b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 -- 172.21.15.52:0/357180152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb284145960 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb28a000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 0x7fb284147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb289600640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb27800f7c0 tx=0x7fb27800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2780052e0 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb278018070 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27800d910 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.659+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb284145c40 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.660+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb284148440 con 0x7fb26c004d40 2024-09-10T08:39:21.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.661+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2840b4fb0 con 0x7fb26c004d40 2024-09-10T08:39:21.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.661+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb27800dab0 con 0x7fb26c004d40 2024-09-10T08:39:21.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.662+0000 7fb281600640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 0x7fb26406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:21.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.662+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7fb27808a9d0 con 0x7fb26c004d40 2024-09-10T08:39:21.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.663+0000 7fb288c00640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 0x7fb26406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:21.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.664+0000 7fb288c00640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 0x7fb26406e320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2840cc760 tx=0x7fb270008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.667+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb278059670 con 0x7fb26c004d40 2024-09-10T08:39:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.849+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb284072120 con 0x7fb26c004d40 2024-09-10T08:39:21.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.853+0000 7fb281600640 1 -- 172.21.15.52:0/357180152 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fb278058f70 con 0x7fb26c004d40 2024-09-10T08:39:21.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 msgr2=0x7fb26406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 0x7fb26406e320 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2840cc760 tx=0x7fb270008040 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 msgr2=0x7fb284145070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fb27800f7c0 tx=0x7fb27800fc80 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 shutdown_connections 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.855+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb26406be60 0x7fb26406e320 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb284147a80 0x7fb284147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840b45f0 0x7fb2840b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 --2- 172.21.15.52:0/357180152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26c004d40 0x7fb284145070 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 >> 172.21.15.52:0/357180152 conn(0x7fb28406d0f0 msgr2=0x7fb2840d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 shutdown_connections 2024-09-10T08:39:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:21.856+0000 7fb28c000640 1 -- 172.21.15.52:0/357180152 wait complete. 2024-09-10T08:39:21.873 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:39:21.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:39:21.963 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:39:22.043 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:39:22.044 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:22.044 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:22.082 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:39:22.082 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:39:22.082 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:22.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:39:22.119 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:22.119 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:22.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:39:22.157 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:39:22.158 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:22.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:39:22.195 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:39:22.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.353+0000 7fc282600640 1 Processor -- start 2024-09-10T08:39:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.353+0000 7fc282600640 1 -- start start 2024-09-10T08:39:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc282600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc282600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc27c0cf9a0 0x7fc27c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc282600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc27c0b4370 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc282600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c0b4650 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc282600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c0b4dc0 con 0x7fc27c0b3e00 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc281c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc27c0cf9a0 0x7fc27c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc281c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc27c0cf9a0 0x7fc27c15c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53024/0 (socket says 172.21.15.52:53024) 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc281c00640 1 -- 172.21.15.52:0/3591394267 learned_addr learned my addr 172.21.15.52:0/3591394267 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.354+0000 7fc27be00640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.355+0000 7fc281c00640 1 -- 172.21.15.52:0/3591394267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 msgr2=0x7fc27c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.355+0000 7fc281c00640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.355+0000 7fc281c00640 1 -- 172.21.15.52:0/3591394267 >> v1:172.21.15.176:6789/0 conn(0x7fc27c0cf5c0 legacy=0x7fc27c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.355+0000 7fc281c00640 1 -- 172.21.15.52:0/3591394267 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c0b50a0 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.355+0000 7fc27be00640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.356+0000 7fc281c00640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c15c520 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a487c8fa0b1abc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.356+0000 7fc27b400640 1 -- 172.21.15.52:0/3591394267 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274036070 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.356+0000 7fc27b400640 1 -- 172.21.15.52:0/3591394267 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc274031600 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.356+0000 7fc27b400640 1 -- 172.21.15.52:0/3591394267 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2740319d0 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 -- 172.21.15.52:0/3591394267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf9a0 msgr2=0x7fc27c15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c15c520 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27402a610 comp rx=0 tx=0).stop 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 -- 172.21.15.52:0/3591394267 shutdown_connections 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c15c520 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 --2- 172.21.15.52:0/3591394267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 -- 172.21.15.52:0/3591394267 >> 172.21.15.52:0/3591394267 conn(0x7fc27c06c240 msgr2=0x7fc27c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 -- 172.21.15.52:0/3591394267 shutdown_connections 2024-09-10T08:39:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.357+0000 7fc282600640 1 -- 172.21.15.52:0/3591394267 wait complete. 2024-09-10T08:39:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.358+0000 7fc282600640 1 Processor -- start 2024-09-10T08:39:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.359+0000 7fc282600640 1 -- start start 2024-09-10T08:39:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c1482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c15cbe0 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c15ca60 con 0x7fc27c0cf9a0 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc282600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c15cd60 con 0x7fc27c0b3e00 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53034/0 (socket says 172.21.15.52:53034) 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 -- 172.21.15.52:0/431832361 learned_addr learned my addr 172.21.15.52:0/431832361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc281200640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c1482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc281c00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 -- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 msgr2=0x7fc27c1482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c1482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 -- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 msgr2=0x7fc27c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc27be00640 1 -- 172.21.15.52:0/431832361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c156c60 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.360+0000 7fc281c00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc27be00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e7e0 tx=0x7fc26800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26800f040 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc268004030 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268004400 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c154c40 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.361+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c155200 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.362+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c0b36f0 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.363+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc26800c6d0 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.364+0000 7fc278c00640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 0x7fc25c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.364+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7fc26808a9f0 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.365+0000 7fc281200640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 0x7fc25c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.365+0000 7fc281200640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 0x7fc25c06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc270001640 tx=0x7fc270009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.369+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc268017020 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.591+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc27c1584c0 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.592+0000 7fc278c00640 1 -- 172.21.15.52:0/431832361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+3919 (secure 0 0 0) 0x7fc268059600 con 0x7fc27c0cf5c0 2024-09-10T08:39:22.592 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:22.592 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":112,"btime":"2024-09-10T08:39:16:448059+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/1423333529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":1423333529},{"type":"v1","addr":"172.21.15.176:6836","nonce":1423333529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2671785021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2671785021},{"type":"v1","addr":"172.21.15.52:6834","nonce":2671785021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3002769820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3002769820},{"type":"v1","addr":"172.21.15.52:6835","nonce":3002769820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8563,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/539340910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":539340910},{"type":"v1","addr":"172.21.15.176:6837","nonce":539340910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":112}],"filesystems":[]} 2024-09-10T08:39:22.593 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 112 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 msgr2=0x7fc25c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 0x7fc25c06e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc270001640 tx=0x7fc270009040 comp rx=0 tx=0).stop 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 msgr2=0x7fc27c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc26800e7e0 tx=0x7fc26800eca0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 shutdown_connections 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc25c06be30 0x7fc25c06e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc27c0cf9a0 0x7fc27c152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc27c0cf5c0 0x7fc27c152610 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 --2- 172.21.15.52:0/431832361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc27c0b3e00 0x7fc27c1482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 >> 172.21.15.52:0/431832361 conn(0x7fc27c06c240 msgr2=0x7fc27c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 shutdown_connections 2024-09-10T08:39:22.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.594+0000 7fc282600640 1 -- 172.21.15.52:0/431832361 wait complete. 2024-09-10T08:39:22.612 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:39:22.612 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:39:22.613 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:39:22.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:39:22.613 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:39:22.613 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:39:22.613 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:39:22.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:39:22.613 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:39:22.614 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:39:22.614 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:39:22.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:39:22.614 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:39:22.614 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:39:22.614 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:39:22.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:39:22.627 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:39:22.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:39:22.629 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:39:22.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:39:22.630 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:39:22.630 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:39:22.631 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:39:22.631 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:39:22.673 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:39:22.674 DEBUG:teuthology.parallel:result is None 2024-09-10T08:39:22.676 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:39:22.676 DEBUG:teuthology.parallel:result is None 2024-09-10T08:39:22.678 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:39:22.678 DEBUG:teuthology.parallel:result is None 2024-09-10T08:39:22.680 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:39:22.680 DEBUG:teuthology.parallel:result is None 2024-09-10T08:39:22.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:39:22.807 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:39:22.810 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:39:22.810 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:39:22.810 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:39:22.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.848+0000 7f90afe00640 1 Processor -- start 2024-09-10T08:39:22.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.848+0000 7f90afe00640 1 -- start start 2024-09-10T08:39:22.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.849+0000 7f90afe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f90b015e440 0x7f90b00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.849+0000 7f90afe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f90b00cf450 0x7f90b00b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.849+0000 7f90afe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b00d3990 con 0x7f90b00b6540 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90afe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f90b00b6990 con 0x7f90b015e440 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90afe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f90b00d3c70 con 0x7f90b00cf450 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f90b015e440 0x7f90b00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f90b015e440 0x7f90b00d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53086/0 (socket says 172.21.15.52:53086) 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 -- 172.21.15.52:0/734815016 learned_addr learned my addr 172.21.15.52:0/734815016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90a7e00640 1 --2- 172.21.15.52:0/734815016 >> v2:172.21.15.176:3300/0 conn(0x7f90b00cf450 0x7f90b00b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 -- 172.21.15.52:0/734815016 >> v2:172.21.15.176:3300/0 conn(0x7f90b00cf450 msgr2=0x7f90b00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 --2- 172.21.15.52:0/734815016 >> v2:172.21.15.176:3300/0 conn(0x7f90b00cf450 0x7f90b00b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 -- 172.21.15.52:0/734815016 >> v1:172.21.15.176:6789/0 conn(0x7f90b00b6540 legacy=0x7f90b006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.850+0000 7f90aea00640 1 -- 172.21.15.52:0/734815016 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00d3f50 con 0x7f90b015e440 2024-09-10T08:39:22.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.851+0000 7f90aea00640 1 --2- 172.21.15.52:0/734815016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b015e440 0x7f90b00d3240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b3f90 tx=0x7f90a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3577e43ece74f15b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.851+0000 7f90ae000640 1 -- 172.21.15.52:0/734815016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0037070 con 0x7f90b015e440 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90ae000640 1 -- 172.21.15.52:0/734815016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a002ae50 con 0x7f90b015e440 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90ae000640 1 -- 172.21.15.52:0/734815016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0032860 con 0x7f90b015e440 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 -- 172.21.15.52:0/734815016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b015e440 msgr2=0x7f90b00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 --2- 172.21.15.52:0/734815016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b015e440 0x7f90b00d3240 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b3f90 tx=0x7f90a002a300 comp rx=0 tx=0).stop 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 -- 172.21.15.52:0/734815016 shutdown_connections 2024-09-10T08:39:22.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 --2- 172.21.15.52:0/734815016 >> v2:172.21.15.176:3300/0 conn(0x7f90b00cf450 0x7f90b00b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 --2- 172.21.15.52:0/734815016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b015e440 0x7f90b00d3240 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 -- 172.21.15.52:0/734815016 >> 172.21.15.52:0/734815016 conn(0x7f90b0067f80 msgr2=0x7f90b00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 -- 172.21.15.52:0/734815016 shutdown_connections 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.852+0000 7f90afe00640 1 -- 172.21.15.52:0/734815016 wait complete. 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.854+0000 7f90afe00640 1 Processor -- start 2024-09-10T08:39:22.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.854+0000 7f90afe00640 1 -- start start 2024-09-10T08:39:22.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b6540 0x7f90b0161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e440 0x7f90b00cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00b7540 con 0x7f90b00cf450 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90b015e820 con 0x7f90b00b6540 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90afe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00b76c0 con 0x7f90b015e440 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53088/0 (socket says 172.21.15.52:53088) 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90a7e00640 1 -- 172.21.15.52:0/2907538814 learned_addr learned my addr 172.21.15.52:0/2907538814 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90aea00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b6540 0x7f90b0161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.855+0000 7f90af400640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e440 0x7f90b00cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 -- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e440 msgr2=0x7f90b00cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e440 0x7f90b00cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 -- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b6540 msgr2=0x7f90b0161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b6540 0x7f90b0161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 -- 172.21.15.52:0/2907538814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00cc0a0 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a7e00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f909800d800 tx=0x7f909800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800b6c0 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9098019070 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800ba80 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b015ea30 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.856+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b015eff0 con 0x7f90b00cf450 2024-09-10T08:39:22.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.857+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b00b3240 con 0x7f90b00cf450 2024-09-10T08:39:22.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.858+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f909800bc20 con 0x7f90b00cf450 2024-09-10T08:39:22.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.859+0000 7f90a6a00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 0x7f908c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:22.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.859+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4943+0+0 (secure 0 0 0) 0x7f909808aec0 con 0x7f90b00cf450 2024-09-10T08:39:22.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.860+0000 7f90aea00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 0x7f908c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:22.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.860+0000 7f90aea00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 0x7f908c06e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f90a0034000 tx=0x7f90a002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:22.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:22.864+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9098059510 con 0x7f90b00cf450 2024-09-10T08:39:23.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.058+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f90b00d4e00 con 0x7f90b00cf450 2024-09-10T08:39:23.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.486+0000 7f90a6a00640 1 -- 172.21.15.52:0/2907538814 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) ==== 97+0+0 (secure 0 0 0) 0x7f909805d810 con 0x7f90b00cf450 2024-09-10T08:39:23.487 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:39:23.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 msgr2=0x7f908c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 0x7f908c06e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f90a0034000 tx=0x7f90a002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 msgr2=0x7f90b0157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f909800d800 tx=0x7f909800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 shutdown_connections 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f908c06be30 0x7f908c06e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f90b015e440 0x7f90b00cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90b00cf450 0x7f90b0157450 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 --2- 172.21.15.52:0/2907538814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f90b00b6540 0x7f90b0161630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 >> 172.21.15.52:0/2907538814 conn(0x7f90b0067f80 msgr2=0x7f90b00b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 shutdown_connections 2024-09-10T08:39:23.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.489+0000 7f90afe00640 1 -- 172.21.15.52:0/2907538814 wait complete. 2024-09-10T08:39:23.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:39:23.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.665+0000 7f0951400640 1 Processor -- start 2024-09-10T08:39:23.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.665+0000 7f0951400640 1 -- start start 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.666+0000 7f0951400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f094c06f390 0x7f094c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0951400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c15fab0 0x7f094c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0951400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094c0b4270 con 0x7f094c158d80 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0951400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f094c0b3f90 con 0x7f094c06f390 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0951400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f094c15efd0 con 0x7f094c15fab0 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f094a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f094c158d80 0x7f094c0b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42314/0 (socket says 172.21.15.52:42314) 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0941e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f094c06f390 0x7f094c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f094a800640 1 -- 172.21.15.52:0/26595008 learned_addr learned my addr 172.21.15.52:0/26595008 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f094b200640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c15fab0 0x7f094c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0941e00640 1 -- 172.21.15.52:0/26595008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c15fab0 msgr2=0x7f094c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:23.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0941e00640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c15fab0 0x7f094c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0941e00640 1 -- 172.21.15.52:0/26595008 >> v1:172.21.15.52:6789/0 conn(0x7f094c158d80 legacy=0x7f094c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0941e00640 1 -- 172.21.15.52:0/26595008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c15f2b0 con 0x7f094c06f390 2024-09-10T08:39:23.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.667+0000 7f0949e00640 1 -- 172.21.15.52:0/26595008 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345654174 0 0) 0x7f094c0b4270 con 0x7f094c158d80 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.668+0000 7f0941e00640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c06bc10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d9284726635727 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0949e00640 1 -- 172.21.15.52:0/26595008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934037070 con 0x7f094c06f390 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0949e00640 1 -- 172.21.15.52:0/26595008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093402ae50 con 0x7f094c06f390 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0949e00640 1 -- 172.21.15.52:0/26595008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934032660 con 0x7f094c06f390 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 -- 172.21.15.52:0/26595008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 msgr2=0x7f094c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c06bc10 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402a100 comp rx=0 tx=0).stop 2024-09-10T08:39:23.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 -- 172.21.15.52:0/26595008 shutdown_connections 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c15fab0 0x7f094c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 --2- 172.21.15.52:0/26595008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c06bc10 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 -- 172.21.15.52:0/26595008 >> 172.21.15.52:0/26595008 conn(0x7f094c06cd20 msgr2=0x7f094c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 -- 172.21.15.52:0/26595008 shutdown_connections 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.669+0000 7f0951400640 1 -- 172.21.15.52:0/26595008 wait complete. 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.671+0000 7f0951400640 1 Processor -- start 2024-09-10T08:39:23.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.671+0000 7f0951400640 1 -- start start 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c158d80 0x7f094c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 0x7f094c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1592e0 con 0x7f094c06f390 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f094c159160 con 0x7f094c15fab0 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f0951400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f094c06e170 con 0x7f094c158d80 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f094a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f094a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53104/0 (socket says 172.21.15.52:53104) 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.672+0000 7f094a800640 1 -- 172.21.15.52:0/3569791053 learned_addr learned my addr 172.21.15.52:0/3569791053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0941e00640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c158d80 0x7f094c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094b200640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 0x7f094c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 -- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c158d80 msgr2=0x7f094c0b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c158d80 0x7f094c0b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 -- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 msgr2=0x7f094c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 0x7f094c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 -- 172.21.15.52:0/3569791053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c0b5ff0 con 0x7f094c06f390 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094b200640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 0x7f094c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f094a800640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c4d0 tx=0x7f093c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c018070 con 0x7f094c06f390 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c007500 con 0x7f094c06f390 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093c004a20 con 0x7f094c06f390 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c0b62d0 con 0x7f094c06f390 2024-09-10T08:39:23.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.673+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c0b6890 con 0x7f094c06f390 2024-09-10T08:39:23.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.674+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094c0b3700 con 0x7f094c06f390 2024-09-10T08:39:23.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.675+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f093c01b070 con 0x7f094c06f390 2024-09-10T08:39:23.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.676+0000 7f0943400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 0x7f092806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:23.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.676+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4857+0+0 (secure 0 0 0) 0x7f093c089f30 con 0x7f094c06f390 2024-09-10T08:39:23.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.677+0000 7f0941e00640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 0x7f092806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:23.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.677+0000 7f0941e00640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 0x7f092806e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0934034000 tx=0x7f093402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:23.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.681+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f093c058b90 con 0x7f094c06f390 2024-09-10T08:39:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.936+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f094c0ceda0 con 0x7f094c06f390 2024-09-10T08:39:23.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.937+0000 7f0943400640 1 -- 172.21.15.52:0/3569791053 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f093c058490 con 0x7f094c06f390 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:39:23.938 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.939 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:39:23.940 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.941 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.942 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.943 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:39:23.945 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.946 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:39:23.947 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:39:23.949 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.950 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:39:23.951 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:39:23.952 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 msgr2=0x7f092806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 0x7f092806e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0934034000 tx=0x7f093402e000 comp rx=0 tx=0).stop 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 msgr2=0x7f094c15c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f093c00c4d0 tx=0x7f093c00c990 comp rx=0 tx=0).stop 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 shutdown_connections 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f092806be30 0x7f092806e2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f094c15fab0 0x7f094c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f094c158d80 0x7f094c0b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 --2- 172.21.15.52:0/3569791053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f094c06f390 0x7f094c15c240 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 >> 172.21.15.52:0/3569791053 conn(0x7f094c06cd20 msgr2=0x7f094c06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 shutdown_connections 2024-09-10T08:39:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:23.939+0000 7f0951400640 1 -- 172.21.15.52:0/3569791053 wait complete. 2024-09-10T08:39:23.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:39:24.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.111+0000 7fd3e8600640 1 Processor -- start 2024-09-10T08:39:24.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.111+0000 7fd3e8600640 1 -- start start 2024-09-10T08:39:24.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.112+0000 7fd3e8600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd3e00b2d40 0x7fd3e006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.112+0000 7fd3e8600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e0071180 con 0x7fd3e006c150 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.112+0000 7fd3e8600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e0071460 con 0x7fd3e013eb20 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.112+0000 7fd3e8600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e0071ab0 con 0x7fd3e00b2d40 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.113+0000 7fd3e6600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd3e006c150 0x7fd3e0071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41714/0 (socket says 172.21.15.52:41714) 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.113+0000 7fd3e6600640 1 -- 172.21.15.52:0/1089360724 learned_addr learned my addr 172.21.15.52:0/1089360724 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.113+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/1089360724 >> v2:172.21.15.176:3300/0 conn(0x7fd3e00b2d40 0x7fd3e006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.113+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264308259 0 0) 0x7fd3e0071180 con 0x7fd3e006c150 2024-09-10T08:39:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.113+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c8003520 con 0x7fd3e006c150 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827001505 0 0) 0x7fd3e0071460 con 0x7fd3e013eb20 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e0071180 con 0x7fd3e013eb20 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1129003072 0 0) 0x7fd3c8003520 con 0x7fd3e006c150 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 >> v2:172.21.15.176:3300/0 conn(0x7fd3e00b2d40 msgr2=0x7fd3e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 --2- 172.21.15.52:0/1089360724 >> v2:172.21.15.176:3300/0 conn(0x7fd3e00b2d40 0x7fd3e006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 >> v1:172.21.15.176:6789/0 conn(0x7fd3e013eb20 legacy=0x7fd3e015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0071740 con 0x7fd3e006c150 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fd3d80019f0 con 0x7fd3e006c150 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 >> v1:172.21.15.52:6789/0 conn(0x7fd3e006c150 legacy=0x7fd3e0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 0x7fd3c8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80051c0 0x7fd3c800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0071ab0 con 0x7fd3c80051c0 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c800e250 con 0x7fd3c8003b40 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c800e450 con 0x7fd3c8004800 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3e6600640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80051c0 0x7fd3c800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 0x7fd3c8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.114+0000 7fd3e5200640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e5c00640 1 -- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8004800 msgr2=0x7fd3c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8004800 0x7fd3c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e5c00640 1 -- 172.21.15.52:0/1089360724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80051c0 msgr2=0x7fd3c800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3c80051c0 0x7fd3c800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e5c00640 1 -- 172.21.15.52:0/1089360724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c8003520 con 0x7fd3c8003b40 2024-09-10T08:39:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.115+0000 7fd3e6600640 1 -- 172.21.15.52:0/1089360724 reap_dead start 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.116+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 0x7fd3c8003f40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009ac0 tx=0x7fd3c8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d59ca8fee9c6c250 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.116+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4036070 con 0x7fd3c8003b40 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.116+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d4031400 con 0x7fd3c8003b40 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.116+0000 7fd3dfe00640 1 -- 172.21.15.52:0/1089360724 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4009690 con 0x7fd3c8003b40 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 -- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 msgr2=0x7fd3c8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 0x7fd3c8003f40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009ac0 tx=0x7fd3c8005830 comp rx=0 tx=0).stop 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 -- 172.21.15.52:0/1089360724 shutdown_connections 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 --2- 172.21.15.52:0/1089360724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3c8003b40 0x7fd3c8003f40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 -- 172.21.15.52:0/1089360724 >> 172.21.15.52:0/1089360724 conn(0x7fd3e00ccec0 msgr2=0x7fd3e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:24.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 -- 172.21.15.52:0/1089360724 shutdown_connections 2024-09-10T08:39:24.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.117+0000 7fd3e8600640 1 -- 172.21.15.52:0/1089360724 wait complete. 2024-09-10T08:39:24.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.119+0000 7fd3e8600640 1 Processor -- start 2024-09-10T08:39:24.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.119+0000 7fd3e8600640 1 -- start start 2024-09-10T08:39:24.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.119+0000 7fd3e8600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8003b40 0x7fd3e00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e8600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e0142720 0x7fd3e00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e8600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e8600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e006bfa0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e8600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e006be20 con 0x7fd3e0142720 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e8600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e015bcf0 con 0x7fd3c8003b40 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54726/0 (socket says 172.21.15.52:54726) 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 -- 172.21.15.52:0/2454849068 learned_addr learned my addr 172.21.15.52:0/2454849068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e5200640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e0142720 0x7fd3e00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8003b40 0x7fd3e00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 -- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8003b40 msgr2=0x7fd3e00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8003b40 0x7fd3e00b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 -- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e0142720 msgr2=0x7fd3e00b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e0142720 0x7fd3e00b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.120+0000 7fd3e6600640 1 -- 172.21.15.52:0/2454849068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e0142cb0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3e6600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8001b60 tx=0x7fd3d8007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800aad0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d8018070 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80133f0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e0142f90 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.121+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e0143550 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.122+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e015c080 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.123+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3d8013590 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.124+0000 7fd3dd600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.124+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4857+0+0 (secure 0 0 0) 0x7fd3d808b040 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.124+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.125+0000 7fd3e5c00640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 0x7fd3c006e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4033000 tx=0x7fd3d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.128+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3d8059ca0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.315+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3e006c9c0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.316+0000 7fd3dd600640 1 -- 172.21.15.52:0/2454849068 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) ==== 84+0+65 (secure 0 0 0) 0x7fd3d80595a0 con 0x7fd3e00b3ab0 2024-09-10T08:39:24.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:24.316 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:39:24.317 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:39:24.317 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:39:24.317 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:39:24.317 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:24.317 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:39:24.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 msgr2=0x7fd3c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 0x7fd3c006e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4033000 tx=0x7fd3d4008030 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 msgr2=0x7fd3e00b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8001b60 tx=0x7fd3d8007b10 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 shutdown_connections 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3e00b3ab0 0x7fd3e00b3f30 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3e0142720 0x7fd3e00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 --2- 172.21.15.52:0/2454849068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd3c8003b40 0x7fd3e00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 >> 172.21.15.52:0/2454849068 conn(0x7fd3e00ccec0 msgr2=0x7fd3e015b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 shutdown_connections 2024-09-10T08:39:24.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.318+0000 7fd3e8600640 1 -- 172.21.15.52:0/2454849068 wait complete. 2024-09-10T08:39:24.334 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:39:24.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:39:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.495+0000 7f014f800640 1 Processor -- start 2024-09-10T08:39:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.495+0000 7f014f800640 1 -- start start 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.496+0000 7f014f800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f014815ea90 0x7f01480d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01480b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014f800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01480cf060 con 0x7f01480d40b0 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014f800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f01480d34c0 con 0x7f014815ea90 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01480cf340 con 0x7f01480d16e0 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f014815ea90 0x7f01480d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f014815ea90 0x7f01480d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54740/0 (socket says 172.21.15.52:54740) 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 -- 172.21.15.52:0/3463217907 learned_addr learned my addr 172.21.15.52:0/3463217907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f0147e00640 1 --1- 172.21.15.52:0/3463217907 >> v1:172.21.15.52:6789/0 conn(0x7f01480d40b0 0x7f01480d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41724/0 (socket says 172.21.15.52:41724) 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014d800640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01480b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 -- 172.21.15.52:0/3463217907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 msgr2=0x7f01480b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01480b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 -- 172.21.15.52:0/3463217907 >> v1:172.21.15.52:6789/0 conn(0x7f01480d40b0 legacy=0x7f01480d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.497+0000 7f014ce00640 1 -- 172.21.15.52:0/3463217907 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01480cf620 con 0x7f014815ea90 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.498+0000 7f014ce00640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f01480d2f80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f013c009870 tx=0x7f013c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3e619555fb8a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f0147400640 1 -- 172.21.15.52:0/3463217907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c037070 con 0x7f014815ea90 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f0147400640 1 -- 172.21.15.52:0/3463217907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c032440 con 0x7f014815ea90 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f0147400640 1 -- 172.21.15.52:0/3463217907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c032810 con 0x7f014815ea90 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 -- 172.21.15.52:0/3463217907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 msgr2=0x7f01480d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f01480d2f80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f013c009870 tx=0x7f013c02a250 comp rx=0 tx=0).stop 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 -- 172.21.15.52:0/3463217907 shutdown_connections 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01480b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 --2- 172.21.15.52:0/3463217907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f01480d2f80 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 -- 172.21.15.52:0/3463217907 >> 172.21.15.52:0/3463217907 conn(0x7f014806c0e0 msgr2=0x7f014806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.499+0000 7f014f800640 1 -- 172.21.15.52:0/3463217907 shutdown_connections 2024-09-10T08:39:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.500+0000 7f014f800640 1 -- 172.21.15.52:0/3463217907 wait complete. 2024-09-10T08:39:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.501+0000 7f014f800640 1 Processor -- start 2024-09-10T08:39:24.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.501+0000 7f014f800640 1 -- start start 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01481f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01480d40b0 0x7f0148156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f014815ee70 con 0x7f014815ea90 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01480cfbe0 con 0x7f01480d40b0 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014f800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01480b8000 con 0x7f01480d16e0 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f014d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54742/0 (socket says 172.21.15.52:54742) 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.502+0000 7f0147e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01480d40b0 0x7f0148156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 -- 172.21.15.52:0/2397158236 learned_addr learned my addr 172.21.15.52:0/2397158236 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014ce00640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01481f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 -- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 msgr2=0x7f01481f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01481f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 -- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01480d40b0 msgr2=0x7f0148156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01480d40b0 0x7f0148156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 -- 172.21.15.52:0/2397158236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0148159560 con 0x7f014815ea90 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014ce00640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01481f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f014d800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f014000efc0 tx=0x7f014000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.503+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140018020 con 0x7f014815ea90 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.504+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0140014480 con 0x7f014815ea90 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.504+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140014870 con 0x7f014815ea90 2024-09-10T08:39:24.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.504+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0148159840 con 0x7f014815ea90 2024-09-10T08:39:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.504+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01480cc8a0 con 0x7f014815ea90 2024-09-10T08:39:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.505+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01480ccaa0 con 0x7f014815ea90 2024-09-10T08:39:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.506+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0140005d10 con 0x7f014815ea90 2024-09-10T08:39:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.507+0000 7f0144c00640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.507+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 4857+0+0 (secure 0 0 0) 0x7f014008b8a0 con 0x7f014815ea90 2024-09-10T08:39:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.507+0000 7f014ce00640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.508+0000 7f014ce00640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 0x7f012806e2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f013c034000 tx=0x7f013c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:24.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.511+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01480ccaa0 con 0x7f014815ea90 2024-09-10T08:39:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:24.697+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0148162100 con 0x7f014815ea90 2024-09-10T08:39:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.498+0000 7f0144c00640 1 -- 172.21.15.52:0/2397158236 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) ==== 138+0+0 (secure 0 0 0) 0x7f0140022030 con 0x7f014815ea90 2024-09-10T08:39:25.499 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:39:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.502+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 msgr2=0x7f012806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.502+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 0x7f012806e2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f013c034000 tx=0x7f013c02e000 comp rx=0 tx=0).stop 2024-09-10T08:39:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.502+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 msgr2=0x7f0148156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.502+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f014000efc0 tx=0x7f014000c490 comp rx=0 tx=0).stop 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 shutdown_connections 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f012806be30 0x7f012806e2f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f014815ea90 0x7f0148156dd0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01480d40b0 0x7f0148156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 --2- 172.21.15.52:0/2397158236 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01480d16e0 0x7f01481f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 >> 172.21.15.52:0/2397158236 conn(0x7f014806c0e0 msgr2=0x7f01480b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.503+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 shutdown_connections 2024-09-10T08:39:25.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.504+0000 7f014f800640 1 -- 172.21.15.52:0/2397158236 wait complete. 2024-09-10T08:39:25.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:39:25.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.697+0000 7f57e1a00640 1 Processor -- start 2024-09-10T08:39:25.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.697+0000 7f57e1a00640 1 -- start start 2024-09-10T08:39:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57dc0d32c0 0x7f57dc0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 0x7f57dc0b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc0d36e0 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f57dc0d3950 con 0x7f57dc0d32c0 2024-09-10T08:39:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f57dc0d3c30 con 0x7f57dc0b7c10 2024-09-10T08:39:25.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57dc0d32c0 0x7f57dc0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f57dc0d32c0 0x7f57dc0cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54750/0 (socket says 172.21.15.52:54750) 2024-09-10T08:39:25.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 -- 172.21.15.52:0/1989047988 learned_addr learned my addr 172.21.15.52:0/1989047988 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:25.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57dbe00640 1 --1- 172.21.15.52:0/1989047988 >> v1:172.21.15.52:6789/0 conn(0x7f57dc0b5fd0 0x7f57dc0b63b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41738/0 (socket says 172.21.15.52:41738) 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 -- 172.21.15.52:0/1989047988 >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 msgr2=0x7f57dc0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1000640 1 --2- 172.21.15.52:0/1989047988 >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 0x7f57dc0b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57daa00640 1 -- 172.21.15.52:0/1989047988 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826965658 0 0) 0x7f57dc0d36e0 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 --2- 172.21.15.52:0/1989047988 >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 0x7f57dc0b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 -- 172.21.15.52:0/1989047988 >> v1:172.21.15.52:6789/0 conn(0x7f57dc0b5fd0 legacy=0x7f57dc0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57db400640 1 -- 172.21.15.52:0/1989047988 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc0d3f10 con 0x7f57dc0d32c0 2024-09-10T08:39:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.699+0000 7f57e1000640 1 --2- 172.21.15.52:0/1989047988 >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 0x7f57dc0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.700+0000 7f57db400640 1 --2- 172.21.15.52:0/1989047988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0d32c0 0x7f57dc0cf650 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0ceb30 tx=0x7f57c802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20e447e4530527e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57daa00640 1 -- 172.21.15.52:0/1989047988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8037070 con 0x7f57dc0d32c0 2024-09-10T08:39:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57daa00640 1 -- 172.21.15.52:0/1989047988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c802ae50 con 0x7f57dc0d32c0 2024-09-10T08:39:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57daa00640 1 -- 172.21.15.52:0/1989047988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8032860 con 0x7f57dc0d32c0 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 -- 172.21.15.52:0/1989047988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0d32c0 msgr2=0x7f57dc0cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 --2- 172.21.15.52:0/1989047988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0d32c0 0x7f57dc0cf650 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0ceb30 tx=0x7f57c802a300 comp rx=0 tx=0).stop 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 -- 172.21.15.52:0/1989047988 shutdown_connections 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 --2- 172.21.15.52:0/1989047988 >> v2:172.21.15.176:3300/0 conn(0x7f57dc0b7c10 0x7f57dc0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 --2- 172.21.15.52:0/1989047988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0d32c0 0x7f57dc0cf650 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 -- 172.21.15.52:0/1989047988 >> 172.21.15.52:0/1989047988 conn(0x7f57dc0d0fd0 msgr2=0x7f57dc0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 -- 172.21.15.52:0/1989047988 shutdown_connections 2024-09-10T08:39:25.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.701+0000 7f57e1a00640 1 -- 172.21.15.52:0/1989047988 wait complete. 2024-09-10T08:39:25.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.703+0000 7f57e1a00640 1 Processor -- start 2024-09-10T08:39:25.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.703+0000 7f57e1a00640 1 -- start start 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 0x7f57dc1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57dc0d32c0 0x7f57dc0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0cfb90 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0b7680 con 0x7f57dc0b7c10 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57e1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc0cfd10 con 0x7f57dc0d32c0 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57dbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54762/0 (socket says 172.21.15.52:54762) 2024-09-10T08:39:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.704+0000 7f57dbe00640 1 -- 172.21.15.52:0/693448112 learned_addr learned my addr 172.21.15.52:0/693448112 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57db400640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 0x7f57dc1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57e1000640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57dc0d32c0 0x7f57dc0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 -- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57dc0d32c0 msgr2=0x7f57dc0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57dc0d32c0 0x7f57dc0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 -- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 msgr2=0x7f57dc1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 0x7f57dc1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 -- 172.21.15.52:0/693448112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc15f0c0 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57db400640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 0x7f57dc1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57dbe00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c500 tx=0x7f57cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc018070 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57cc007580 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc004a20 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.705+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc15f3a0 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.706+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc0cb150 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.707+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc15e7f0 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.708+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f57cc01b360 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.709+0000 7f57d3e00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 0x7f57bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.709+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5227+0+0 (secure 0 0 0) 0x7f57cc08a260 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.709+0000 7f57db400640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 0x7f57bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.710+0000 7f57db400640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 0x7f57bc06e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f57c8034000 tx=0x7f57c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.713+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57cc058e60 con 0x7f57dc0b5fd0 2024-09-10T08:39:25.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:25.898+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f57dc0b59d0 con 0x7f57dc0b5fd0 2024-09-10T08:39:26.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.506+0000 7f57d3e00640 1 -- 172.21.15.52:0/693448112 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) ==== 170+0+0 (secure 0 0 0) 0x7f57cc058760 con 0x7f57dc0b5fd0 2024-09-10T08:39:26.507 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 msgr2=0x7f57bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 0x7f57bc06e2f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f57c8034000 tx=0x7f57c802e000 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 msgr2=0x7f57dc0ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c500 tx=0x7f57cc00c9c0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 shutdown_connections 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f57bc06be30 0x7f57bc06e2f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57dc0d32c0 0x7f57dc0c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57dc0b7c10 0x7f57dc1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 --2- 172.21.15.52:0/693448112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc0b5fd0 0x7f57dc0ccc70 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 >> 172.21.15.52:0/693448112 conn(0x7f57dc0d0fd0 msgr2=0x7f57dc0b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 shutdown_connections 2024-09-10T08:39:26.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.510+0000 7f57e1a00640 1 -- 172.21.15.52:0/693448112 wait complete. 2024-09-10T08:39:26.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:39:26.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.702+0000 7f6688800640 1 Processor -- start 2024-09-10T08:39:26.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.702+0000 7f6688800640 1 -- start start 2024-09-10T08:39:26.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6688800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66800ccf30 0x7f66800b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6688800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 0x7f6680071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6688800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66800cf2e0 con 0x7f668015b7c0 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6688800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6680070fe0 con 0x7f66800ccf30 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6688800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f66800712c0 con 0x7f66800cead0 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.703+0000 7f6685e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f66800ccf30 0x7f66800b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f668015b7c0 0x7f66800cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41744/0 (socket says 172.21.15.52:41744) 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685400640 1 -- 172.21.15.52:0/2339941294 learned_addr learned my addr 172.21.15.52:0/2339941294 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6686800640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 0x7f6680071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685e00640 1 -- 172.21.15.52:0/2339941294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 msgr2=0x7f6680071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:26.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685e00640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 0x7f6680071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685e00640 1 -- 172.21.15.52:0/2339941294 >> v1:172.21.15.52:6789/0 conn(0x7f668015b7c0 legacy=0x7f66800cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6685e00640 1 -- 172.21.15.52:0/2339941294 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66800715a0 con 0x7f66800ccf30 2024-09-10T08:39:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6684a00640 1 -- 172.21.15.52:0/2339941294 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212515094 0 0) 0x7f66800cf2e0 con 0x7f668015b7c0 2024-09-10T08:39:26.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.704+0000 7f6686800640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 0x7f6680071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:26.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.705+0000 7f6685e00640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800ccf30 0x7f66800b2c50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f66740097a0 tx=0x7f667402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e669c14d388005bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.705+0000 7f6684a00640 1 -- 172.21.15.52:0/2339941294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674037070 con 0x7f66800ccf30 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.705+0000 7f6684a00640 1 -- 172.21.15.52:0/2339941294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667402ae50 con 0x7f66800ccf30 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.705+0000 7f6684a00640 1 -- 172.21.15.52:0/2339941294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674032660 con 0x7f66800ccf30 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 -- 172.21.15.52:0/2339941294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800ccf30 msgr2=0x7f66800b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800ccf30 0x7f66800b2c50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f66740097a0 tx=0x7f667402a100 comp rx=0 tx=0).stop 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 -- 172.21.15.52:0/2339941294 shutdown_connections 2024-09-10T08:39:26.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800cead0 0x7f6680071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 --2- 172.21.15.52:0/2339941294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800ccf30 0x7f66800b2c50 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 -- 172.21.15.52:0/2339941294 >> 172.21.15.52:0/2339941294 conn(0x7f668006d0f0 msgr2=0x7f668006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 -- 172.21.15.52:0/2339941294 shutdown_connections 2024-09-10T08:39:26.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.706+0000 7f6688800640 1 -- 172.21.15.52:0/2339941294 wait complete. 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.708+0000 7f6688800640 1 Processor -- start 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.708+0000 7f6688800640 1 -- start start 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 0x7f668013b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f668015b7c0 0x7f668014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f66800cf060 con 0x7f66800cead0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66800ceee0 con 0x7f668015b7c0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6688800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6680072000 con 0x7f66800ccf30 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54774/0 (socket says 172.21.15.52:54774) 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 -- 172.21.15.52:0/1815701696 learned_addr learned my addr 172.21.15.52:0/1815701696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685e00640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 0x7f668013b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6686800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f668015b7c0 0x7f668014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 -- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 msgr2=0x7f668013b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 0x7f668013b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 -- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f668015b7c0 msgr2=0x7f668014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f668015b7c0 0x7f668014d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685400640 1 -- 172.21.15.52:0/1815701696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668014af90 con 0x7f66800cead0 2024-09-10T08:39:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.709+0000 7f6685e00640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 0x7f668013b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f6685400640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f667000c430 tx=0x7f667000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66700074e0 con 0x7f66800cead0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66700047e0 con 0x7f66800cead0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670004bd0 con 0x7f66800cead0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668014b270 con 0x7f66800cead0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.710+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668014ac80 con 0x7f66800cead0 2024-09-10T08:39:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.711+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66800b2c50 con 0x7f66800cead0 2024-09-10T08:39:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.712+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6670011070 con 0x7f66800cead0 2024-09-10T08:39:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.713+0000 7f667a000640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 0x7f666406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.713+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5609+0+0 (secure 0 0 0) 0x7f667008b130 con 0x7f66800cead0 2024-09-10T08:39:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.714+0000 7f6685e00640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 0x7f666406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:26.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.715+0000 7f6685e00640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 0x7f666406e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6674034000 tx=0x7f667402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:26.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.717+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f667000e280 con 0x7f66800cead0 2024-09-10T08:39:26.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:26.938+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f66800cc960 con 0x7f66800cead0 2024-09-10T08:39:27.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.508+0000 7f667a000640 1 -- 172.21.15.52:0/1815701696 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v115) ==== 174+0+0 (secure 0 0 0) 0x7f6670059b20 con 0x7f66800cead0 2024-09-10T08:39:27.509 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 22 and data pool 23 2024-09-10T08:39:27.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.512+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 msgr2=0x7f666406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.512+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 0x7f666406e2f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6674034000 tx=0x7f667402e000 comp rx=0 tx=0).stop 2024-09-10T08:39:27.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.512+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 msgr2=0x7f668014a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.512+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f667000c430 tx=0x7f667000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 shutdown_connections 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f666406be30 0x7f666406e2f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f668015b7c0 0x7f668014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66800cead0 0x7f668014a740 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 --2- 172.21.15.52:0/1815701696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f66800ccf30 0x7f668013b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 >> 172.21.15.52:0/1815701696 conn(0x7f668006d0f0 msgr2=0x7f66800cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.513+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 shutdown_connections 2024-09-10T08:39:27.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.514+0000 7f6688800640 1 -- 172.21.15.52:0/1815701696 wait complete. 2024-09-10T08:39:27.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.704+0000 7f3b76400640 1 Processor -- start 2024-09-10T08:39:27.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.704+0000 7f3b76400640 1 -- start start 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b76400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3b7013eb20 0x7f3b7015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b76400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b70071180 con 0x7f3b700b2d40 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b76400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b70071460 con 0x7f3b7006c320 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b76400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3b70071ab0 con 0x7f3b7013eb20 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b6f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b700b2d40 0x7f3b7006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41750/0 (socket says 172.21.15.52:41750) 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b6f400640 1 -- 172.21.15.52:0/1832499341 learned_addr learned my addr 172.21.15.52:0/1832499341 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b6fe00640 1 --2- 172.21.15.52:0/1832499341 >> v2:172.21.15.176:3300/0 conn(0x7f3b7013eb20 0x7f3b7015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344928028 0 0) 0x7f3b70071180 con 0x7f3b700b2d40 2024-09-10T08:39:27.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.706+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b54003520 con 0x7f3b700b2d40 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3472642736 0 0) 0x7f3b54003520 con 0x7f3b700b2d40 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 >> v2:172.21.15.176:3300/0 conn(0x7f3b7013eb20 msgr2=0x7f3b7015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 --2- 172.21.15.52:0/1832499341 >> v2:172.21.15.176:3300/0 conn(0x7f3b7013eb20 0x7f3b7015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 >> v1:172.21.15.176:6789/0 conn(0x7f3b7006c320 legacy=0x7f3b7015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b70071740 con 0x7f3b700b2d40 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3b60001670 con 0x7f3b700b2d40 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 >> v1:172.21.15.52:6789/0 conn(0x7f3b700b2d40 legacy=0x7f3b7006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b54003a00 0x7f3b54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 0x7f3b54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b540051c0 0x7f3b5400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70071ab0 con 0x7f3b54004800 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5400e2d0 con 0x7f3b54003a00 2024-09-10T08:39:27.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5400e4d0 con 0x7f3b540051c0 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 0x7f3b54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6f400640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b54003a00 0x7f3b54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6fe00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b540051c0 0x7f3b5400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 -- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b540051c0 msgr2=0x7f3b5400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b540051c0 0x7f3b5400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 -- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b54003a00 msgr2=0x7f3b54003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b54003a00 0x7f3b54003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b67e00640 1 -- 172.21.15.52:0/1832499341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b54003520 con 0x7f3b54004800 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.707+0000 7f3b6fe00640 1 -- 172.21.15.52:0/1832499341 reap_dead start 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.708+0000 7f3b67e00640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 0x7f3b54004c80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f3b58001750 tx=0x7f3b54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5177e51e66e8307b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58001370 con 0x7f3b54004800 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b580052d0 con 0x7f3b54004800 2024-09-10T08:39:27.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b6ea00640 1 -- 172.21.15.52:0/1832499341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5802abc0 con 0x7f3b54004800 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 -- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 msgr2=0x7f3b54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 0x7f3b54004c80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f3b58001750 tx=0x7f3b54005830 comp rx=0 tx=0).stop 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 -- 172.21.15.52:0/1832499341 shutdown_connections 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 --2- 172.21.15.52:0/1832499341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b54004800 0x7f3b54004c80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 -- 172.21.15.52:0/1832499341 >> 172.21.15.52:0/1832499341 conn(0x7f3b700ccec0 msgr2=0x7f3b700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 -- 172.21.15.52:0/1832499341 shutdown_connections 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.709+0000 7f3b76400640 1 -- 172.21.15.52:0/1832499341 wait complete. 2024-09-10T08:39:27.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.711+0000 7f3b76400640 1 Processor -- start 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.711+0000 7f3b76400640 1 -- start start 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b54004800 0x7f3b7013d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7013d9b0 0x7f3b701440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7006bfa0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7006be20 con 0x7f3b7013d9b0 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b76400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7006c120 con 0x7f3b54004800 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54802/0 (socket says 172.21.15.52:54802) 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b67e00640 1 -- 172.21.15.52:0/907178367 learned_addr learned my addr 172.21.15.52:0/907178367 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b6f400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b54004800 0x7f3b7013d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.712+0000 7f3b6fe00640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7013d9b0 0x7f3b701440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 -- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b54004800 msgr2=0x7f3b7013d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b54004800 0x7f3b7013d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 -- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7013d9b0 msgr2=0x7f3b701440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7013d9b0 0x7f3b701440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 -- 172.21.15.52:0/907178367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700ccba0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67e00640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3b5802a570 tx=0x7f3b58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5803f030 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58005480 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58037040 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.713+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b700c9c20 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.714+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b700cc8c0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.715+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70155de0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.715+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b58042070 con 0x7f3b7013dfe0 2024-09-10T08:39:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.716+0000 7f3b67400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 0x7f3b4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.716+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5709+0+0 (secure 0 0 0) 0x7f3b580aa7b0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.717+0000 7f3b6f400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 0x7f3b4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:27.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.718+0000 7f3b6f400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 0x7f3b4c06e320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b60001db0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:27.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.721+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b580790c0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.906+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b7006c9c0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.907+0000 7f3b67400640 1 -- 172.21.15.52:0/907178367 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16764 (secure 0 0 0) 0x7f3b580789c0 con 0x7f3b7013dfe0 2024-09-10T08:39:27.908 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:27.908 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":157,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:39:26.939967+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:39:24.739978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T08:39:25.941504+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:27.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 msgr2=0x7f3b4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 0x7f3b4c06e320 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b60001db0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 msgr2=0x7f3b700b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:27.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f3b5802a570 tx=0x7f3b58001120 comp rx=0 tx=0).stop 2024-09-10T08:39:27.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 shutdown_connections 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3b4c06be60 0x7f3b4c06e320 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b7013d9b0 0x7f3b701440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b7013dfe0 0x7f3b700b3f60 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.909+0000 7f3b76400640 1 --2- 172.21.15.52:0/907178367 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b54004800 0x7f3b7013d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.910+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 >> 172.21.15.52:0/907178367 conn(0x7f3b700ccec0 msgr2=0x7f3b7013ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.910+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 shutdown_connections 2024-09-10T08:39:27.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:27.910+0000 7f3b76400640 1 -- 172.21.15.52:0/907178367 wait complete. 2024-09-10T08:39:27.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:28.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.082+0000 7fae11800640 1 Processor -- start 2024-09-10T08:39:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.082+0000 7fae11800640 1 -- start start 2024-09-10T08:39:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae11800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fae0c15e440 0x7fae0c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae11800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae0c0b6710 0x7fae0c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae11800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0c0d3990 con 0x7fae0c0cf450 2024-09-10T08:39:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae11800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c0d3c70 con 0x7fae0c0b6710 2024-09-10T08:39:28.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae11800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c0d3f50 con 0x7fae0c15e440 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.083+0000 7fae10e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae0c0b6710 0x7fae0c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fae0c0b6710 0x7fae0c0b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54804/0 (socket says 172.21.15.52:54804) 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 -- 172.21.15.52:0/3492320665 learned_addr learned my addr 172.21.15.52:0/3492320665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae03e00640 1 --1- 172.21.15.52:0/3492320665 >> v1:172.21.15.52:6789/0 conn(0x7fae0c0cf450 0x7fae0c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41766/0 (socket says 172.21.15.52:41766) 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae0be00640 1 --2- 172.21.15.52:0/3492320665 >> v2:172.21.15.176:3300/0 conn(0x7fae0c15e440 0x7fae0c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 -- 172.21.15.52:0/3492320665 >> v2:172.21.15.176:3300/0 conn(0x7fae0c15e440 msgr2=0x7fae0c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 --2- 172.21.15.52:0/3492320665 >> v2:172.21.15.176:3300/0 conn(0x7fae0c15e440 0x7fae0c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 -- 172.21.15.52:0/3492320665 >> v1:172.21.15.52:6789/0 conn(0x7fae0c0cf450 legacy=0x7fae0c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.084+0000 7fae10e00640 1 -- 172.21.15.52:0/3492320665 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c0d4230 con 0x7fae0c0b6710 2024-09-10T08:39:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.085+0000 7fae10e00640 1 --2- 172.21.15.52:0/3492320665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c0b7b60 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fae0c068870 tx=0x7fae0402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e2501bca6adee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.085+0000 7fae0b400640 1 -- 172.21.15.52:0/3492320665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04036070 con 0x7fae0c0b6710 2024-09-10T08:39:28.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.085+0000 7fae0b400640 1 -- 172.21.15.52:0/3492320665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04031600 con 0x7fae0c0b6710 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.085+0000 7fae0b400640 1 -- 172.21.15.52:0/3492320665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae040319f0 con 0x7fae0c0b6710 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 -- 172.21.15.52:0/3492320665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 msgr2=0x7fae0c0b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 --2- 172.21.15.52:0/3492320665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c0b7b60 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fae0c068870 tx=0x7fae0402a7c0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 -- 172.21.15.52:0/3492320665 shutdown_connections 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 --2- 172.21.15.52:0/3492320665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c0b7b60 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 --2- 172.21.15.52:0/3492320665 >> v2:172.21.15.176:3300/0 conn(0x7fae0c15e440 0x7fae0c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 -- 172.21.15.52:0/3492320665 >> 172.21.15.52:0/3492320665 conn(0x7fae0c067f80 msgr2=0x7fae0c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 -- 172.21.15.52:0/3492320665 shutdown_connections 2024-09-10T08:39:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.086+0000 7fae11800640 1 -- 172.21.15.52:0/3492320665 wait complete. 2024-09-10T08:39:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.088+0000 7fae11800640 1 Processor -- start 2024-09-10T08:39:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.088+0000 7fae11800640 1 -- start start 2024-09-10T08:39:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c0cf450 0x7fae0c160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c15e440 0x7fae0c161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0b76c0 con 0x7fae0c0b6710 2024-09-10T08:39:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0b7540 con 0x7fae0c0cf450 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae11800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c0b80a0 con 0x7fae0c15e440 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54820/0 (socket says 172.21.15.52:54820) 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 -- 172.21.15.52:0/3408790553 learned_addr learned my addr 172.21.15.52:0/3408790553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 -- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c15e440 msgr2=0x7fae0c161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c15e440 0x7fae0c161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 -- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c0cf450 msgr2=0x7fae0c160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c0cf450 0x7fae0c160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 -- 172.21.15.52:0/3408790553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c150f00 con 0x7fae0c0b6710 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.089+0000 7fae0be00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d5f0 tx=0x7fadfc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.090+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0125f0 con 0x7fae0c0b6710 2024-09-10T08:39:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.090+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc019070 con 0x7fae0c0b6710 2024-09-10T08:39:28.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.090+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c0cdb80 con 0x7fae0c0b6710 2024-09-10T08:39:28.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.090+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0129d0 con 0x7fae0c0b6710 2024-09-10T08:39:28.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.090+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c0ce140 con 0x7fae0c0b6710 2024-09-10T08:39:28.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.091+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c0b7b60 con 0x7fae0c0b6710 2024-09-10T08:39:28.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.092+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadfc012b70 con 0x7fae0c0b6710 2024-09-10T08:39:28.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.093+0000 7fae08c00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 0x7fade806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.093+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5709+0+0 (secure 0 0 0) 0x7fadfc08b310 con 0x7fae0c0b6710 2024-09-10T08:39:28.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.093+0000 7fae03e00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 0x7fade806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.094+0000 7fae03e00640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 0x7fade806e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fadf4000f60 tx=0x7fadf4007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.097+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadfc059c20 con 0x7fae0c0b6710 2024-09-10T08:39:28.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.283+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae0c0ce800 con 0x7fae0c0b6710 2024-09-10T08:39:28.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.284+0000 7fae08c00640 1 -- 172.21.15.52:0/3408790553 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16764 (secure 0 0 0) 0x7fadfc059520 con 0x7fae0c0b6710 2024-09-10T08:39:28.285 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:28.285 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":157,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:39:26.939967+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:39:24.739978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T08:39:25.941504+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 msgr2=0x7fade806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 0x7fade806e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fadf4000f60 tx=0x7fadf4007a00 comp rx=0 tx=0).stop 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 msgr2=0x7fae0c1509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00d5f0 tx=0x7fadfc00dab0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 shutdown_connections 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fade806be30 0x7fade806e2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c15e440 0x7fae0c161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c0cf450 0x7fae0c160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 --2- 172.21.15.52:0/3408790553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae0c0b6710 0x7fae0c1509c0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 >> 172.21.15.52:0/3408790553 conn(0x7fae0c067f80 msgr2=0x7fae0c0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:28.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.286+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 shutdown_connections 2024-09-10T08:39:28.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.287+0000 7fae11800640 1 -- 172.21.15.52:0/3408790553 wait complete. 2024-09-10T08:39:28.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:39:28.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.461+0000 7fedd7e00640 1 Processor -- start 2024-09-10T08:39:28.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.461+0000 7fedd7e00640 1 -- start start 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd7e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fedd00cf8d0 0x7fedd0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd7e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd015f120 con 0x7fedd00cfcb0 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd7e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd015f400 con 0x7fedd0144a50 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd7e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fedd0141cd0 con 0x7fedd00cf8d0 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd4a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fedd00cfcb0 0x7fedd0144340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41776/0 (socket says 172.21.15.52:41776) 2024-09-10T08:39:28.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd4a00640 1 -- 172.21.15.52:0/1701420155 learned_addr learned my addr 172.21.15.52:0/1701420155 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:28.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedd5400640 1 --2- 172.21.15.52:0/1701420155 >> v2:172.21.15.176:3300/0 conn(0x7fedd00cf8d0 0x7fedd0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487020736 0 0) 0x7fedd015f120 con 0x7fedd00cfcb0 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.463+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb8003520 con 0x7fedd00cfcb0 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.464+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940889898 0 0) 0x7fedd015f400 con 0x7fedd0144a50 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.464+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd015f120 con 0x7fedd0144a50 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.464+0000 7fedd5400640 1 -- 172.21.15.52:0/1701420155 >> v1:172.21.15.176:6789/0 conn(0x7fedd0144a50 legacy=0x7fedd00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.464+0000 7fedd5400640 1 -- 172.21.15.52:0/1701420155 >> v1:172.21.15.52:6789/0 conn(0x7fedd00cfcb0 legacy=0x7fedd0144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.464+0000 7fedd5400640 1 -- 172.21.15.52:0/1701420155 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd015f6e0 con 0x7fedd00cf8d0 2024-09-10T08:39:28.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.465+0000 7fedd5400640 1 --2- 172.21.15.52:0/1701420155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cf8d0 0x7fedd0070f40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fedc40097a0 tx=0x7fedc402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc75efe0d3ed429 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.465+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4037070 con 0x7fedd00cf8d0 2024-09-10T08:39:28.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.465+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4032440 con 0x7fedd00cf8d0 2024-09-10T08:39:28.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.465+0000 7fedcfe00640 1 -- 172.21.15.52:0/1701420155 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4032810 con 0x7fedd00cf8d0 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 -- 172.21.15.52:0/1701420155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cf8d0 msgr2=0x7fedd0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 --2- 172.21.15.52:0/1701420155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cf8d0 0x7fedd0070f40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fedc40097a0 tx=0x7fedc402a230 comp rx=0 tx=0).stop 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 -- 172.21.15.52:0/1701420155 shutdown_connections 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 --2- 172.21.15.52:0/1701420155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cf8d0 0x7fedd0070f40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 -- 172.21.15.52:0/1701420155 >> 172.21.15.52:0/1701420155 conn(0x7fedd006d0f0 msgr2=0x7fedd006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 -- 172.21.15.52:0/1701420155 shutdown_connections 2024-09-10T08:39:28.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.466+0000 7fedd7e00640 1 -- 172.21.15.52:0/1701420155 wait complete. 2024-09-10T08:39:28.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.468+0000 7fedd7e00640 1 Processor -- start 2024-09-10T08:39:28.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.468+0000 7fedd7e00640 1 -- start start 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 0x7fedd013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 0x7fedd00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fedd00ce0f0 con 0x7fedd00cf8d0 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fedd015ee30 con 0x7fedd00cfcb0 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd7e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fedd00ce270 con 0x7fedd0144a50 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54826/0 (socket says 172.21.15.52:54826) 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 -- 172.21.15.52:0/254822812 learned_addr learned my addr 172.21.15.52:0/254822812 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd4a00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 0x7fedd013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 0x7fedd00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 -- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 msgr2=0x7fedd00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 0x7fedd00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 -- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 msgr2=0x7fedd013f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 0x7fedd013f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5400640 1 -- 172.21.15.52:0/254822812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd0144100 con 0x7fedd00cf8d0 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd4a00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 0x7fedd013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.469+0000 7fedd5e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 0x7fedd00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:28.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedd5400640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009890 tx=0x7fedc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4037050 con 0x7fedd00cf8d0 2024-09-10T08:39:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4043070 con 0x7fedd00cf8d0 2024-09-10T08:39:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd00cd170 con 0x7fedd00cf8d0 2024-09-10T08:39:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc403cb30 con 0x7fedd00cf8d0 2024-09-10T08:39:28.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.470+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd00cd730 con 0x7fedd00cf8d0 2024-09-10T08:39:28.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.471+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd00718c0 con 0x7fedd00cf8d0 2024-09-10T08:39:28.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.472+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedc403ccd0 con 0x7fedd00cf8d0 2024-09-10T08:39:28.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.473+0000 7fedcd600640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 0x7fedb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:28.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.473+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5709+0+0 (secure 0 0 0) 0x7fedc40abb30 con 0x7fedd00cf8d0 2024-09-10T08:39:28.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.474+0000 7fedd4a00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 0x7fedb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:28.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.474+0000 7fedd4a00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 0x7fedb006e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fedd01418c0 tx=0x7fedbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:28.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.478+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedc4046360 con 0x7fedd00cf8d0 2024-09-10T08:39:28.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:28.706+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fedd006f260 con 0x7fedd00cf8d0 2024-09-10T08:39:29.497 INFO:tasks.ceph.mds.d.smithi176.stderr:2024-09-10T08:39:29.497+0000 7f38c1600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:39:29.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.532+0000 7fedcd600640 1 -- 172.21.15.52:0/254822812 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v118) ==== 118+0+0 (secure 0 0 0) 0x7fedc407a440 con 0x7fedd00cf8d0 2024-09-10T08:39:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 msgr2=0x7fedb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 0x7fedb006e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fedd01418c0 tx=0x7fedbc009040 comp rx=0 tx=0).stop 2024-09-10T08:39:29.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 msgr2=0x7fedd013fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009890 tx=0x7fedc40046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 shutdown_connections 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fedb006be30 0x7fedb006e2f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd0144a50 0x7fedd00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd00cfcb0 0x7fedd013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 --2- 172.21.15.52:0/254822812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd00cf8d0 0x7fedd013fd90 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 >> 172.21.15.52:0/254822812 conn(0x7fedd006d0f0 msgr2=0x7fedd00ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 shutdown_connections 2024-09-10T08:39:29.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.536+0000 7fedd7e00640 1 -- 172.21.15.52:0/254822812 wait complete. 2024-09-10T08:39:29.555 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:39:29.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:39:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.719+0000 7f629d000640 1 Processor -- start 2024-09-10T08:39:29.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.719+0000 7f629d000640 1 -- start start 2024-09-10T08:39:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f629d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f62980d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f629d000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62980b38a0 0x7f62980d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f629d000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62980cf710 con 0x7f629806bfd0 2024-09-10T08:39:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f629d000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f62980b78a0 con 0x7f62980b38a0 2024-09-10T08:39:29.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f629d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f62980cffb0 con 0x7f62980b3350 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f6295e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f629806bfd0 0x7f629806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41778/0 (socket says 172.21.15.52:41778) 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f6295e00640 1 -- 172.21.15.52:0/52571188 learned_addr learned my addr 172.21.15.52:0/52571188 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f6296800640 1 --2- 172.21.15.52:0/52571188 >> v2:172.21.15.52:3300/0 conn(0x7f62980b38a0 0x7f62980d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.720+0000 7f6295400640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f62980d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6294a00640 1 -- 172.21.15.52:0/52571188 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674668311 0 0) 0x7f62980cf710 con 0x7f629806bfd0 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6294a00640 1 -- 172.21.15.52:0/52571188 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f627c003520 con 0x7f629806bfd0 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6296800640 1 -- 172.21.15.52:0/52571188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 msgr2=0x7f62980d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6296800640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f62980d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6296800640 1 -- 172.21.15.52:0/52571188 >> v1:172.21.15.52:6789/0 conn(0x7f629806bfd0 legacy=0x7f629806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6296800640 1 -- 172.21.15.52:0/52571188 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62980cf9f0 con 0x7f62980b38a0 2024-09-10T08:39:29.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.721+0000 7f6295400640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f62980d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:29.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.722+0000 7f6296800640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f62980d2e60 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f6290009dc0 tx=0x7f629002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a745e0ca9c3d52ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:29.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.722+0000 7f6294a00640 1 -- 172.21.15.52:0/52571188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290007740 con 0x7f62980b38a0 2024-09-10T08:39:29.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.722+0000 7f6294a00640 1 -- 172.21.15.52:0/52571188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62900078e0 con 0x7f62980b38a0 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.722+0000 7f6294a00640 1 -- 172.21.15.52:0/52571188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290007cb0 con 0x7f62980b38a0 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 -- 172.21.15.52:0/52571188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 msgr2=0x7f62980d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f62980d2e60 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f6290009dc0 tx=0x7f629002a710 comp rx=0 tx=0).stop 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 -- 172.21.15.52:0/52571188 shutdown_connections 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f62980d2e60 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 --2- 172.21.15.52:0/52571188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f62980d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 -- 172.21.15.52:0/52571188 >> 172.21.15.52:0/52571188 conn(0x7f62980d11c0 msgr2=0x7f62980d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 -- 172.21.15.52:0/52571188 shutdown_connections 2024-09-10T08:39:29.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.723+0000 7f629d000640 1 -- 172.21.15.52:0/52571188 wait complete. 2024-09-10T08:39:29.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.724+0000 7f629d000640 1 Processor -- start 2024-09-10T08:39:29.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.724+0000 7f629d000640 1 -- start start 2024-09-10T08:39:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629806bfd0 0x7f629815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f629815c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f629806cd50 con 0x7f62980b38a0 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62980d2400 con 0x7f629806bfd0 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.725+0000 7f629d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f629815eae0 con 0x7f62980b3350 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54842/0 (socket says 172.21.15.52:54842) 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 -- 172.21.15.52:0/1484577670 learned_addr learned my addr 172.21.15.52:0/1484577670 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6295400640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f629815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6295e00640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629806bfd0 0x7f629815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 -- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 msgr2=0x7f629815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f629815c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 -- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629806bfd0 msgr2=0x7f629815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629806bfd0 0x7f629815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:29.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 -- 172.21.15.52:0/1484577670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62980cb780 con 0x7f62980b38a0 2024-09-10T08:39:29.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.726+0000 7f6296800640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f629002ad00 tx=0x7f6290004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:29.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.727+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629003f070 con 0x7f62980b38a0 2024-09-10T08:39:29.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.727+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6290031b40 con 0x7f62980b38a0 2024-09-10T08:39:29.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.727+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290044460 con 0x7f62980b38a0 2024-09-10T08:39:29.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.727+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62980cba60 con 0x7f62980b38a0 2024-09-10T08:39:29.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.727+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62980cc020 con 0x7f62980b38a0 2024-09-10T08:39:29.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.728+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f629806c3b0 con 0x7f62980b38a0 2024-09-10T08:39:29.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.729+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f629003b410 con 0x7f62980b38a0 2024-09-10T08:39:29.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.729+0000 7f628e000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:29.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.730+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f62900ac470 con 0x7f62980b38a0 2024-09-10T08:39:29.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.730+0000 7f6295e00640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:29.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.731+0000 7f6295e00640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 0x7f627806e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6288005880 tx=0x7f6288009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:29.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.734+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f629007a7c0 con 0x7f62980b38a0 2024-09-10T08:39:29.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:29.956+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f62980ba3d0 con 0x7f62980b38a0 2024-09-10T08:39:30.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.538+0000 7f628e000640 1 -- 172.21.15.52:0/1484577670 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v119) ==== 122+0+0 (secure 0 0 0) 0x7f629007eac0 con 0x7f62980b38a0 2024-09-10T08:39:30.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.541+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 msgr2=0x7f627806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.541+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 0x7f627806e2f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6288005880 tx=0x7f6288009040 comp rx=0 tx=0).stop 2024-09-10T08:39:30.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.541+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 msgr2=0x7f629815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.541+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f629002ad00 tx=0x7f6290004a40 comp rx=0 tx=0).stop 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.541+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 shutdown_connections 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f627806be30 0x7f627806e2f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62980b38a0 0x7f629815c8c0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62980b3350 0x7f629815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 --2- 172.21.15.52:0/1484577670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f629806bfd0 0x7f629815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 >> 172.21.15.52:0/1484577670 conn(0x7f62980d11c0 msgr2=0x7f62980d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 shutdown_connections 2024-09-10T08:39:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.542+0000 7f629d000640 1 -- 172.21.15.52:0/1484577670 wait complete. 2024-09-10T08:39:30.562 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:39:30.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.722+0000 7f3357e00640 1 Processor -- start 2024-09-10T08:39:30.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.722+0000 7f3357e00640 1 -- start start 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3357e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 0x7f3350070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3357e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f335006c320 0x7f33500714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3357e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3350071b30 con 0x7f3350148260 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3357e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3350074200 con 0x7f335006c320 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3357e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f33500b3e40 con 0x7f3350147e80 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f335006c320 0x7f33500714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3354a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3350148260 0x7f335006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41780/0 (socket says 172.21.15.52:41780) 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3354a00640 1 -- 172.21.15.52:0/171730921 learned_addr learned my addr 172.21.15.52:0/171730921 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355400640 1 --2- 172.21.15.52:0/171730921 >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 0x7f3350070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355e00640 1 -- 172.21.15.52:0/171730921 >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 msgr2=0x7f3350070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355e00640 1 --2- 172.21.15.52:0/171730921 >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 0x7f3350070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355e00640 1 -- 172.21.15.52:0/171730921 >> v1:172.21.15.52:6789/0 conn(0x7f3350148260 legacy=0x7f335006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355e00640 1 -- 172.21.15.52:0/171730921 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33500b3510 con 0x7f335006c320 2024-09-10T08:39:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f334fe00640 1 -- 172.21.15.52:0/171730921 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538712894 0 0) 0x7f3350071b30 con 0x7f3350148260 2024-09-10T08:39:30.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.724+0000 7f3355400640 1 --2- 172.21.15.52:0/171730921 >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 0x7f3350070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.725+0000 7f3355e00640 1 --2- 172.21.15.52:0/171730921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500714b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f33500d1500 tx=0x7f334802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36e3f43a8418f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f334fe00640 1 -- 172.21.15.52:0/171730921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348007740 con 0x7f335006c320 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f334fe00640 1 -- 172.21.15.52:0/171730921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33480078e0 con 0x7f335006c320 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f334fe00640 1 -- 172.21.15.52:0/171730921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3348007cb0 con 0x7f335006c320 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 -- 172.21.15.52:0/171730921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 msgr2=0x7f33500714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 --2- 172.21.15.52:0/171730921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500714b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f33500d1500 tx=0x7f334802a680 comp rx=0 tx=0).stop 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 -- 172.21.15.52:0/171730921 shutdown_connections 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 --2- 172.21.15.52:0/171730921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500714b0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 --2- 172.21.15.52:0/171730921 >> v2:172.21.15.176:3300/0 conn(0x7f3350147e80 0x7f3350070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 -- 172.21.15.52:0/171730921 >> 172.21.15.52:0/171730921 conn(0x7f33500ccec0 msgr2=0x7f33500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 -- 172.21.15.52:0/171730921 shutdown_connections 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.726+0000 7f3357e00640 1 -- 172.21.15.52:0/171730921 wait complete. 2024-09-10T08:39:30.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.728+0000 7f3357e00640 1 Processor -- start 2024-09-10T08:39:30.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.728+0000 7f3357e00640 1 -- start start 2024-09-10T08:39:30.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3350147e80 0x7f33500ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 0x7f33500cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f33500b42d0 con 0x7f335006c320 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f33500b3ad0 con 0x7f3350148260 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3357e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f33500b4450 con 0x7f3350147e80 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3355400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3355400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54866/0 (socket says 172.21.15.52:54866) 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3355400640 1 -- 172.21.15.52:0/771854730 learned_addr learned my addr 172.21.15.52:0/771854730 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3355e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 0x7f33500cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.729+0000 7f3354a00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3350147e80 0x7f33500ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 -- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3350147e80 msgr2=0x7f33500ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3350147e80 0x7f33500ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 -- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 msgr2=0x7f33500cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 0x7f33500cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 -- 172.21.15.52:0/771854730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33500ad400 con 0x7f335006c320 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 0x7f33500cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3355400640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f334400e7e0 tx=0x7f334400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334400f040 con 0x7f335006c320 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3344004030 con 0x7f335006c320 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3344004400 con 0x7f335006c320 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33500ad6e0 con 0x7f335006c320 2024-09-10T08:39:30.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.730+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33500adca0 con 0x7f335006c320 2024-09-10T08:39:30.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.731+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335006bc10 con 0x7f335006c320 2024-09-10T08:39:30.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.732+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f334400c6d0 con 0x7f335006c320 2024-09-10T08:39:30.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.734+0000 7f334d600640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 0x7f333006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:30.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.734+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f334408ad30 con 0x7f335006c320 2024-09-10T08:39:30.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.734+0000 7f3354a00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 0x7f333006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:30.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.735+0000 7f3354a00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 0x7f333006e2f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f33500ccdd0 tx=0x7f333c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:30.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.738+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3344017020 con 0x7f335006c320 2024-09-10T08:39:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.959+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33500ce5c0 con 0x7f335006c320 2024-09-10T08:39:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.960+0000 7f334d600640 1 -- 172.21.15.52:0/771854730 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f3344059640 con 0x7f335006c320 2024-09-10T08:39:30.960 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:30.960 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:30.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.961+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 msgr2=0x7f333006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 0x7f333006e2f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f33500ccdd0 tx=0x7f333c007c00 comp rx=0 tx=0).stop 2024-09-10T08:39:30.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 msgr2=0x7f33500b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f334400e7e0 tx=0x7f334400eca0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 shutdown_connections 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f333006be30 0x7f333006e2f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3350148260 0x7f33500cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3350147e80 0x7f33500ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 --2- 172.21.15.52:0/771854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f335006c320 0x7f33500b1640 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 >> 172.21.15.52:0/771854730 conn(0x7f33500ccec0 msgr2=0x7f33500c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 shutdown_connections 2024-09-10T08:39:30.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:30.962+0000 7f3357e00640 1 -- 172.21.15.52:0/771854730 wait complete. 2024-09-10T08:39:30.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:39:31.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.134+0000 7f0c15400640 1 Processor -- start 2024-09-10T08:39:31.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.134+0000 7f0c15400640 1 -- start start 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c15400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c1015e440 0x7f0c100d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c15400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c100d3990 con 0x7f0c100cf450 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c15400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c100d3c70 con 0x7f0c100b6710 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c15400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0c100d3f50 con 0x7f0c1015e440 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c0fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c1015e440 0x7f0c100d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c0fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c1015e440 0x7f0c100d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54868/0 (socket says 172.21.15.52:54868) 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c0fe00640 1 -- 172.21.15.52:0/2725214269 learned_addr learned my addr 172.21.15.52:0/2725214269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.135+0000 7f0c07400640 1 --1- 172.21.15.52:0/2725214269 >> v1:172.21.15.52:6789/0 conn(0x7f0c100cf450 0x7f0c100b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41786/0 (socket says 172.21.15.52:41786) 2024-09-10T08:39:31.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.136+0000 7f0c0fe00640 1 -- 172.21.15.52:0/2725214269 >> v1:172.21.15.176:6789/0 conn(0x7f0c100b6710 legacy=0x7f0c100b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:31.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.136+0000 7f0c0fe00640 1 -- 172.21.15.52:0/2725214269 >> v1:172.21.15.52:6789/0 conn(0x7f0c100cf450 legacy=0x7f0c100b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.136+0000 7f0c0fe00640 1 -- 172.21.15.52:0/2725214269 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c100d4230 con 0x7f0c1015e440 2024-09-10T08:39:31.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.136+0000 7f0c0f400640 1 -- 172.21.15.52:0/2725214269 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629466551 0 0) 0x7f0c100d3990 con 0x7f0c100cf450 2024-09-10T08:39:31.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.137+0000 7f0c0fe00640 1 --2- 172.21.15.52:0/2725214269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c1015e440 0x7f0c100d3240 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009870 tx=0x7f0c0002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f1a20c1dc7b2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.137+0000 7f0c0f400640 1 -- 172.21.15.52:0/2725214269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00037070 con 0x7f0c1015e440 2024-09-10T08:39:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.137+0000 7f0c0f400640 1 -- 172.21.15.52:0/2725214269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c00032640 con 0x7f0c1015e440 2024-09-10T08:39:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.137+0000 7f0c0f400640 1 -- 172.21.15.52:0/2725214269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00032a10 con 0x7f0c1015e440 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 -- 172.21.15.52:0/2725214269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c1015e440 msgr2=0x7f0c100d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 --2- 172.21.15.52:0/2725214269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c1015e440 0x7f0c100d3240 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009870 tx=0x7f0c0002a330 comp rx=0 tx=0).stop 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 -- 172.21.15.52:0/2725214269 shutdown_connections 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 --2- 172.21.15.52:0/2725214269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c1015e440 0x7f0c100d3240 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 -- 172.21.15.52:0/2725214269 >> 172.21.15.52:0/2725214269 conn(0x7f0c10067f80 msgr2=0x7f0c100d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 -- 172.21.15.52:0/2725214269 shutdown_connections 2024-09-10T08:39:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.138+0000 7f0c15400640 1 -- 172.21.15.52:0/2725214269 wait complete. 2024-09-10T08:39:31.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.139+0000 7f0c15400640 1 Processor -- start 2024-09-10T08:39:31.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.140+0000 7f0c15400640 1 -- start start 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.140+0000 7f0c15400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.140+0000 7f0c15400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 0x7f0c1014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.140+0000 7f0c15400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e440 0x7f0c10158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c15400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0c100b76c0 con 0x7f0c100b6710 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c15400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0c100b7540 con 0x7f0c100cf450 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c15400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0c100b8270 con 0x7f0c1015e440 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54880/0 (socket says 172.21.15.52:54880) 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 -- 172.21.15.52:0/3149474624 learned_addr learned my addr 172.21.15.52:0/3149474624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c07400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 0x7f0c1014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c14a00640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e440 0x7f0c10158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 -- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e440 msgr2=0x7f0c10158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e440 0x7f0c10158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 -- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 msgr2=0x7f0c1014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 0x7f0c1014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 -- 172.21.15.52:0/3149474624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1015a2c0 con 0x7f0c100b6710 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c07400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 0x7f0c1014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.141+0000 7f0c0fe00640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009870 tx=0x7f0c000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.142+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00037040 con 0x7f0c100b6710 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.142+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c00004250 con 0x7f0c100b6710 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.142+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0003c730 con 0x7f0c100b6710 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.142+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c10158ce0 con 0x7f0c100b6710 2024-09-10T08:39:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.142+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c101592a0 con 0x7f0c100b6710 2024-09-10T08:39:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.143+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c100d3240 con 0x7f0c100b6710 2024-09-10T08:39:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.144+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c0003a070 con 0x7f0c100b6710 2024-09-10T08:39:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.145+0000 7f0c0cc00640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 0x7f0bec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.145+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f0c000ab7d0 con 0x7f0c100b6710 2024-09-10T08:39:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.146+0000 7f0c07400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 0x7f0bec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.146+0000 7f0c07400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 0x7f0bec06e320 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c100cad80 tx=0x7f0bf8007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.149+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c00041020 con 0x7f0c100b6710 2024-09-10T08:39:31.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.334+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c100b7f70 con 0x7f0c100b6710 2024-09-10T08:39:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.335+0000 7f0c0cc00640 1 -- 172.21.15.52:0/3149474624 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+16751 (secure 0 0 0) 0x7f0c0007a180 con 0x7f0c100b6710 2024-09-10T08:39:31.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:31.336 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":158,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:39:28.509117+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:39:24.739978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T08:39:25.941504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:39:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 msgr2=0x7f0bec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 0x7f0bec06e320 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0c100cad80 tx=0x7f0bf8007c10 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 msgr2=0x7f0c10159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009870 tx=0x7f0c000046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 shutdown_connections 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0bec06be60 0x7f0bec06e320 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0c1015e440 0x7f0c10158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0c100cf450 0x7f0c1014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 --2- 172.21.15.52:0/3149474624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c100b6710 0x7f0c10159d80 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 >> 172.21.15.52:0/3149474624 conn(0x7f0c10067f80 msgr2=0x7f0c100b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 shutdown_connections 2024-09-10T08:39:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.338+0000 7f0c15400640 1 -- 172.21.15.52:0/3149474624 wait complete. 2024-09-10T08:39:31.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:39:31.355 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:39:31.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.510+0000 7f9217400640 1 Processor -- start 2024-09-10T08:39:31.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.510+0000 7f9217400640 1 -- start start 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.511+0000 7f9217400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f921015e790 0x7f9210073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.511+0000 7f9217400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921006f730 0x7f921006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.511+0000 7f9217400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92101631c0 con 0x7f9210162c60 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9217400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f921015eb70 con 0x7f921015e790 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9217400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92100700c0 con 0x7f921006f730 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f921015e790 0x7f9210073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f921015e790 0x7f9210073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54890/0 (socket says 172.21.15.52:54890) 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 -- 172.21.15.52:0/3163907629 learned_addr learned my addr 172.21.15.52:0/3163907629 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9215400640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921006f730 0x7f921006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 -- 172.21.15.52:0/3163907629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921006f730 msgr2=0x7f921006fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:31.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921006f730 0x7f921006fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 -- 172.21.15.52:0/3163907629 >> v1:172.21.15.176:6789/0 conn(0x7f9210162c60 legacy=0x7f92100b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:31.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.512+0000 7f9214a00640 1 -- 172.21.15.52:0/3163907629 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92100ae9a0 con 0x7f921015e790 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.513+0000 7f9214a00640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f921015e790 0x7f9210073a40 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3956d3398130393c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.513+0000 7f920f400640 1 -- 172.21.15.52:0/3163907629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204037070 con 0x7f921015e790 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f920f400640 1 -- 172.21.15.52:0/3163907629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920402ae10 con 0x7f921015e790 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f920f400640 1 -- 172.21.15.52:0/3163907629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204032660 con 0x7f921015e790 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 -- 172.21.15.52:0/3163907629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f921015e790 msgr2=0x7f9210073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f921015e790 0x7f9210073a40 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9204009870 tx=0x7f920402a100 comp rx=0 tx=0).stop 2024-09-10T08:39:31.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 -- 172.21.15.52:0/3163907629 shutdown_connections 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921006f730 0x7f921006fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 --2- 172.21.15.52:0/3163907629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f921015e790 0x7f9210073a40 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 -- 172.21.15.52:0/3163907629 >> 172.21.15.52:0/3163907629 conn(0x7f92100b0a80 msgr2=0x7f92100b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 -- 172.21.15.52:0/3163907629 shutdown_connections 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.514+0000 7f9217400640 1 -- 172.21.15.52:0/3163907629 wait complete. 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.516+0000 7f9217400640 1 Processor -- start 2024-09-10T08:39:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.516+0000 7f9217400640 1 -- start start 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921015e790 0x7f9210072f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f92100af200 con 0x7f9210162c60 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f92100aef20 con 0x7f921006f730 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9217400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f92100b5b40 con 0x7f921015e790 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9215400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9214a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9214a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:41526/0 (socket says 172.21.15.52:41526) 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9215400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54896/0 (socket says 172.21.15.52:54896) 2024-09-10T08:39:31.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f9214a00640 1 -- 172.21.15.52:0/775297608 learned_addr learned my addr 172.21.15.52:0/775297608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.517+0000 7f920fe00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921015e790 0x7f9210072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 -- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921015e790 msgr2=0x7f9210072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921015e790 0x7f9210072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 -- 172.21.15.52:0/775297608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 msgr2=0x7f92100734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 -- 172.21.15.52:0/775297608 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921014aaf0 con 0x7f921006f730 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9215400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9214a00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f92040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204041070 con 0x7f921006f730 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920403c670 con 0x7f921006f730 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204037040 con 0x7f921006f730 2024-09-10T08:39:31.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92100cc140 con 0x7f921006f730 2024-09-10T08:39:31.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.518+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92100cc700 con 0x7f921006f730 2024-09-10T08:39:31.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.519+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92100ccdc0 con 0x7f921006f730 2024-09-10T08:39:31.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.521+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9204044070 con 0x7f921006f730 2024-09-10T08:39:31.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.521+0000 7f920cc00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.522+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f92040ab790 con 0x7f921006f730 2024-09-10T08:39:31.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.522+0000 7f920fe00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.523+0000 7f920fe00640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f92100d0440 tx=0x7f91fc007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.525+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92100ccdc0 con 0x7f921006f730 2024-09-10T08:39:31.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.706+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f921006f430 con 0x7f91f006be30 2024-09-10T08:39:31.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.713+0000 7f920cc00640 1 -- 172.21.15.52:0/775297608 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f921006f430 con 0x7f91f006be30 2024-09-10T08:39:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:31.718 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:39:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 msgr2=0x7f91f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 0x7f91f006e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f92100d0440 tx=0x7f91fc007e30 comp rx=0 tx=0).stop 2024-09-10T08:39:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 msgr2=0x7f921014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9204000c00 tx=0x7f92040046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 shutdown_connections 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f91f006be30 0x7f91f006e2f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9210162c60 0x7f92100734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f921015e790 0x7f9210072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 --2- 172.21.15.52:0/775297608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f921006f730 0x7f921014a5b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 >> 172.21.15.52:0/775297608 conn(0x7f92100b0a80 msgr2=0x7f921006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 shutdown_connections 2024-09-10T08:39:31.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.716+0000 7f9217400640 1 -- 172.21.15.52:0/775297608 wait complete. 2024-09-10T08:39:31.732 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2024-09-10T08:39:31.614686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":421632,"kb_used_data":16636,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754553088,"statfs":{"total":773094113280,"available":772662362112,"internally_reserved":0,"allocated":17035264,"data_stored":8113504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":414502448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001518"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513292+0000","last_change":"2024-09-10T08:39:27.524727+0000","last_active":"2024-09-10T08:39:28.513292+0000","last_peered":"2024-09-10T08:39:28.513292+0000","last_clean":"2024-09-10T08:39:28.513292+0000","last_became_active":"2024-09-10T08:39:27.524427+0000","last_became_peered":"2024-09-10T08:39:27.524427+0000","last_unstale":"2024-09-10T08:39:28.513292+0000","last_undegraded":"2024-09-10T08:39:28.513292+0000","last_fullsized":"2024-09-10T08:39:28.513292+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:41.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513617+0000","last_change":"2024-09-10T08:39:27.530646+0000","last_active":"2024-09-10T08:39:28.513617+0000","last_peered":"2024-09-10T08:39:28.513617+0000","last_clean":"2024-09-10T08:39:28.513617+0000","last_became_active":"2024-09-10T08:39:27.529677+0000","last_became_peered":"2024-09-10T08:39:27.529677+0000","last_unstale":"2024-09-10T08:39:28.513617+0000","last_undegraded":"2024-09-10T08:39:28.513617+0000","last_fullsized":"2024-09-10T08:39:28.513617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:44.754191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513288+0000","last_change":"2024-09-10T08:39:27.538783+0000","last_active":"2024-09-10T08:39:28.513288+0000","last_peered":"2024-09-10T08:39:28.513288+0000","last_clean":"2024-09-10T08:39:28.513288+0000","last_became_active":"2024-09-10T08:39:27.538252+0000","last_became_peered":"2024-09-10T08:39:27.538252+0000","last_unstale":"2024-09-10T08:39:28.513288+0000","last_undegraded":"2024-09-10T08:39:28.513288+0000","last_fullsized":"2024-09-10T08:39:28.513288+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:36.265564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514945+0000","last_change":"2024-09-10T08:39:27.545895+0000","last_active":"2024-09-10T08:39:28.514945+0000","last_peered":"2024-09-10T08:39:28.514945+0000","last_clean":"2024-09-10T08:39:28.514945+0000","last_became_active":"2024-09-10T08:39:27.545598+0000","last_became_peered":"2024-09-10T08:39:27.545598+0000","last_unstale":"2024-09-10T08:39:28.514945+0000","last_undegraded":"2024-09-10T08:39:28.514945+0000","last_fullsized":"2024-09-10T08:39:28.514945+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:55.165108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657582+0000","last_change":"2024-09-10T08:39:27.539372+0000","last_active":"2024-09-10T08:39:28.657582+0000","last_peered":"2024-09-10T08:39:28.657582+0000","last_clean":"2024-09-10T08:39:28.657582+0000","last_became_active":"2024-09-10T08:39:27.539121+0000","last_became_peered":"2024-09-10T08:39:27.539121+0000","last_unstale":"2024-09-10T08:39:28.657582+0000","last_undegraded":"2024-09-10T08:39:28.657582+0000","last_fullsized":"2024-09-10T08:39:28.657582+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:17.046039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658388+0000","last_change":"2024-09-10T08:39:27.544086+0000","last_active":"2024-09-10T08:39:28.658388+0000","last_peered":"2024-09-10T08:39:28.658388+0000","last_clean":"2024-09-10T08:39:28.658388+0000","last_became_active":"2024-09-10T08:39:27.543073+0000","last_became_peered":"2024-09-10T08:39:27.543073+0000","last_unstale":"2024-09-10T08:39:28.658388+0000","last_undegraded":"2024-09-10T08:39:28.658388+0000","last_fullsized":"2024-09-10T08:39:28.658388+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:39.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657857+0000","last_change":"2024-09-10T08:39:27.539012+0000","last_active":"2024-09-10T08:39:28.657857+0000","last_peered":"2024-09-10T08:39:28.657857+0000","last_clean":"2024-09-10T08:39:28.657857+0000","last_became_active":"2024-09-10T08:39:27.535453+0000","last_became_peered":"2024-09-10T08:39:27.535453+0000","last_unstale":"2024-09-10T08:39:28.657857+0000","last_undegraded":"2024-09-10T08:39:28.657857+0000","last_fullsized":"2024-09-10T08:39:28.657857+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:07.983950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657928+0000","last_change":"2024-09-10T08:39:27.518078+0000","last_active":"2024-09-10T08:39:28.657928+0000","last_peered":"2024-09-10T08:39:28.657928+0000","last_clean":"2024-09-10T08:39:28.657928+0000","last_became_active":"2024-09-10T08:39:27.517762+0000","last_became_peered":"2024-09-10T08:39:27.517762+0000","last_unstale":"2024-09-10T08:39:28.657928+0000","last_undegraded":"2024-09-10T08:39:28.657928+0000","last_fullsized":"2024-09-10T08:39:28.657928+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:12.715954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659415+0000","last_change":"2024-09-10T08:39:27.536138+0000","last_active":"2024-09-10T08:39:28.659415+0000","last_peered":"2024-09-10T08:39:28.659415+0000","last_clean":"2024-09-10T08:39:28.659415+0000","last_became_active":"2024-09-10T08:39:27.535874+0000","last_became_peered":"2024-09-10T08:39:27.535874+0000","last_unstale":"2024-09-10T08:39:28.659415+0000","last_undegraded":"2024-09-10T08:39:28.659415+0000","last_fullsized":"2024-09-10T08:39:28.659415+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:39.090666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659366+0000","last_change":"2024-09-10T08:39:27.520764+0000","last_active":"2024-09-10T08:39:28.659366+0000","last_peered":"2024-09-10T08:39:28.659366+0000","last_clean":"2024-09-10T08:39:28.659366+0000","last_became_active":"2024-09-10T08:39:27.520493+0000","last_became_peered":"2024-09-10T08:39:27.520493+0000","last_unstale":"2024-09-10T08:39:28.659366+0000","last_undegraded":"2024-09-10T08:39:28.659366+0000","last_fullsized":"2024-09-10T08:39:28.659366+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:27.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658320+0000","last_change":"2024-09-10T08:39:27.546872+0000","last_active":"2024-09-10T08:39:28.658320+0000","last_peered":"2024-09-10T08:39:28.658320+0000","last_clean":"2024-09-10T08:39:28.658320+0000","last_became_active":"2024-09-10T08:39:27.546595+0000","last_became_peered":"2024-09-10T08:39:27.546595+0000","last_unstale":"2024-09-10T08:39:28.658320+0000","last_undegraded":"2024-09-10T08:39:28.658320+0000","last_fullsized":"2024-09-10T08:39:28.658320+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:09.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658625+0000","last_change":"2024-09-10T08:39:27.532482+0000","last_active":"2024-09-10T08:39:28.658625+0000","last_peered":"2024-09-10T08:39:28.658625+0000","last_clean":"2024-09-10T08:39:28.658625+0000","last_became_active":"2024-09-10T08:39:27.532195+0000","last_became_peered":"2024-09-10T08:39:27.532195+0000","last_unstale":"2024-09-10T08:39:28.658625+0000","last_undegraded":"2024-09-10T08:39:28.658625+0000","last_fullsized":"2024-09-10T08:39:28.658625+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:54.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658622+0000","last_change":"2024-09-10T08:39:27.546940+0000","last_active":"2024-09-10T08:39:28.658622+0000","last_peered":"2024-09-10T08:39:28.658622+0000","last_clean":"2024-09-10T08:39:28.658622+0000","last_became_active":"2024-09-10T08:39:27.546688+0000","last_became_peered":"2024-09-10T08:39:27.546688+0000","last_unstale":"2024-09-10T08:39:28.658622+0000","last_undegraded":"2024-09-10T08:39:28.658622+0000","last_fullsized":"2024-09-10T08:39:28.658622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:54.185140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659104+0000","last_change":"2024-09-10T08:39:27.531753+0000","last_active":"2024-09-10T08:39:28.659104+0000","last_peered":"2024-09-10T08:39:28.659104+0000","last_clean":"2024-09-10T08:39:28.659104+0000","last_became_active":"2024-09-10T08:39:27.531465+0000","last_became_peered":"2024-09-10T08:39:27.531465+0000","last_unstale":"2024-09-10T08:39:28.659104+0000","last_undegraded":"2024-09-10T08:39:28.659104+0000","last_fullsized":"2024-09-10T08:39:28.659104+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:07.369278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658273+0000","last_change":"2024-09-10T08:39:27.531412+0000","last_active":"2024-09-10T08:39:28.658273+0000","last_peered":"2024-09-10T08:39:28.658273+0000","last_clean":"2024-09-10T08:39:28.658273+0000","last_became_active":"2024-09-10T08:39:27.531168+0000","last_became_peered":"2024-09-10T08:39:27.531168+0000","last_unstale":"2024-09-10T08:39:28.658273+0000","last_undegraded":"2024-09-10T08:39:28.658273+0000","last_fullsized":"2024-09-10T08:39:28.658273+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:06.674341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657538+0000","last_change":"2024-09-10T08:39:27.532312+0000","last_active":"2024-09-10T08:39:28.657538+0000","last_peered":"2024-09-10T08:39:28.657538+0000","last_clean":"2024-09-10T08:39:28.657538+0000","last_became_active":"2024-09-10T08:39:27.532014+0000","last_became_peered":"2024-09-10T08:39:27.532014+0000","last_unstale":"2024-09-10T08:39:28.657538+0000","last_undegraded":"2024-09-10T08:39:28.657538+0000","last_fullsized":"2024-09-10T08:39:28.657538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:16.753856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658776+0000","last_change":"2024-09-10T08:39:27.523914+0000","last_active":"2024-09-10T08:39:28.658776+0000","last_peered":"2024-09-10T08:39:28.658776+0000","last_clean":"2024-09-10T08:39:28.658776+0000","last_became_active":"2024-09-10T08:39:27.523587+0000","last_became_peered":"2024-09-10T08:39:27.523587+0000","last_unstale":"2024-09-10T08:39:28.658776+0000","last_undegraded":"2024-09-10T08:39:28.658776+0000","last_fullsized":"2024-09-10T08:39:28.658776+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:41.943466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515525+0000","last_change":"2024-09-10T08:39:27.541366+0000","last_active":"2024-09-10T08:39:28.515525+0000","last_peered":"2024-09-10T08:39:28.515525+0000","last_clean":"2024-09-10T08:39:28.515525+0000","last_became_active":"2024-09-10T08:39:27.540998+0000","last_became_peered":"2024-09-10T08:39:27.540998+0000","last_unstale":"2024-09-10T08:39:28.515525+0000","last_undegraded":"2024-09-10T08:39:28.515525+0000","last_fullsized":"2024-09-10T08:39:28.515525+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.851986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658032+0000","last_change":"2024-09-10T08:39:27.541441+0000","last_active":"2024-09-10T08:39:28.658032+0000","last_peered":"2024-09-10T08:39:28.658032+0000","last_clean":"2024-09-10T08:39:28.658032+0000","last_became_active":"2024-09-10T08:39:27.541149+0000","last_became_peered":"2024-09-10T08:39:27.541149+0000","last_unstale":"2024-09-10T08:39:28.658032+0000","last_undegraded":"2024-09-10T08:39:28.658032+0000","last_fullsized":"2024-09-10T08:39:28.658032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:29.162240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658780+0000","last_change":"2024-09-10T08:39:27.542641+0000","last_active":"2024-09-10T08:39:28.658780+0000","last_peered":"2024-09-10T08:39:28.658780+0000","last_clean":"2024-09-10T08:39:28.658780+0000","last_became_active":"2024-09-10T08:39:27.542384+0000","last_became_peered":"2024-09-10T08:39:27.542384+0000","last_unstale":"2024-09-10T08:39:28.658780+0000","last_undegraded":"2024-09-10T08:39:28.658780+0000","last_fullsized":"2024-09-10T08:39:28.658780+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:11.905587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658477+0000","last_change":"2024-09-10T08:39:27.530120+0000","last_active":"2024-09-10T08:39:28.658477+0000","last_peered":"2024-09-10T08:39:28.658477+0000","last_clean":"2024-09-10T08:39:28.658477+0000","last_became_active":"2024-09-10T08:39:27.529823+0000","last_became_peered":"2024-09-10T08:39:27.529823+0000","last_unstale":"2024-09-10T08:39:28.658477+0000","last_undegraded":"2024-09-10T08:39:28.658477+0000","last_fullsized":"2024-09-10T08:39:28.658477+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:07.369278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657617+0000","last_change":"2024-09-10T08:39:27.547129+0000","last_active":"2024-09-10T08:39:28.657617+0000","last_peered":"2024-09-10T08:39:28.657617+0000","last_clean":"2024-09-10T08:39:28.657617+0000","last_became_active":"2024-09-10T08:39:27.546568+0000","last_became_peered":"2024-09-10T08:39:27.546568+0000","last_unstale":"2024-09-10T08:39:28.657617+0000","last_undegraded":"2024-09-10T08:39:28.657617+0000","last_fullsized":"2024-09-10T08:39:28.657617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:54.024534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516400+0000","last_change":"2024-09-10T08:39:27.536187+0000","last_active":"2024-09-10T08:39:28.516400+0000","last_peered":"2024-09-10T08:39:28.516400+0000","last_clean":"2024-09-10T08:39:28.516400+0000","last_became_active":"2024-09-10T08:39:27.535420+0000","last_became_peered":"2024-09-10T08:39:27.535420+0000","last_unstale":"2024-09-10T08:39:28.516400+0000","last_undegraded":"2024-09-10T08:39:28.516400+0000","last_fullsized":"2024-09-10T08:39:28.516400+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:24.083418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657507+0000","last_change":"2024-09-10T08:39:27.539419+0000","last_active":"2024-09-10T08:39:28.657507+0000","last_peered":"2024-09-10T08:39:28.657507+0000","last_clean":"2024-09-10T08:39:28.657507+0000","last_became_active":"2024-09-10T08:39:27.539179+0000","last_became_peered":"2024-09-10T08:39:27.539179+0000","last_unstale":"2024-09-10T08:39:28.657507+0000","last_undegraded":"2024-09-10T08:39:28.657507+0000","last_fullsized":"2024-09-10T08:39:28.657507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.047361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658552+0000","last_change":"2024-09-10T08:39:27.538793+0000","last_active":"2024-09-10T08:39:28.658552+0000","last_peered":"2024-09-10T08:39:28.658552+0000","last_clean":"2024-09-10T08:39:28.658552+0000","last_became_active":"2024-09-10T08:39:27.538500+0000","last_became_peered":"2024-09-10T08:39:27.538500+0000","last_unstale":"2024-09-10T08:39:28.658552+0000","last_undegraded":"2024-09-10T08:39:28.658552+0000","last_fullsized":"2024-09-10T08:39:28.658552+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.604036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516360+0000","last_change":"2024-09-10T08:39:27.543695+0000","last_active":"2024-09-10T08:39:28.516360+0000","last_peered":"2024-09-10T08:39:28.516360+0000","last_clean":"2024-09-10T08:39:28.516360+0000","last_became_active":"2024-09-10T08:39:27.543345+0000","last_became_peered":"2024-09-10T08:39:27.543345+0000","last_unstale":"2024-09-10T08:39:28.516360+0000","last_undegraded":"2024-09-10T08:39:28.516360+0000","last_fullsized":"2024-09-10T08:39:28.516360+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:08.492774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658546+0000","last_change":"2024-09-10T08:39:27.542032+0000","last_active":"2024-09-10T08:39:28.658546+0000","last_peered":"2024-09-10T08:39:28.658546+0000","last_clean":"2024-09-10T08:39:28.658546+0000","last_became_active":"2024-09-10T08:39:27.541751+0000","last_became_peered":"2024-09-10T08:39:27.541751+0000","last_unstale":"2024-09-10T08:39:28.658546+0000","last_undegraded":"2024-09-10T08:39:28.658546+0000","last_fullsized":"2024-09-10T08:39:28.658546+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:33.774677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657930+0000","last_change":"2024-09-10T08:39:27.540269+0000","last_active":"2024-09-10T08:39:28.657930+0000","last_peered":"2024-09-10T08:39:28.657930+0000","last_clean":"2024-09-10T08:39:28.657930+0000","last_became_active":"2024-09-10T08:39:27.539751+0000","last_became_peered":"2024-09-10T08:39:27.539751+0000","last_unstale":"2024-09-10T08:39:28.657930+0000","last_undegraded":"2024-09-10T08:39:28.657930+0000","last_fullsized":"2024-09-10T08:39:28.657930+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:43.485508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513096+0000","last_change":"2024-09-10T08:39:27.538612+0000","last_active":"2024-09-10T08:39:28.513096+0000","last_peered":"2024-09-10T08:39:28.513096+0000","last_clean":"2024-09-10T08:39:28.513096+0000","last_became_active":"2024-09-10T08:39:27.537827+0000","last_became_peered":"2024-09-10T08:39:27.537827+0000","last_unstale":"2024-09-10T08:39:28.513096+0000","last_undegraded":"2024-09-10T08:39:28.513096+0000","last_fullsized":"2024-09-10T08:39:28.513096+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:42.474588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659098+0000","last_change":"2024-09-10T08:39:27.533308+0000","last_active":"2024-09-10T08:39:28.659098+0000","last_peered":"2024-09-10T08:39:28.659098+0000","last_clean":"2024-09-10T08:39:28.659098+0000","last_became_active":"2024-09-10T08:39:27.532977+0000","last_became_peered":"2024-09-10T08:39:27.532977+0000","last_unstale":"2024-09-10T08:39:28.659098+0000","last_undegraded":"2024-09-10T08:39:28.659098+0000","last_fullsized":"2024-09-10T08:39:28.659098+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:18.384113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513030+0000","last_change":"2024-09-10T08:39:27.533581+0000","last_active":"2024-09-10T08:39:28.513030+0000","last_peered":"2024-09-10T08:39:28.513030+0000","last_clean":"2024-09-10T08:39:28.513030+0000","last_became_active":"2024-09-10T08:39:27.533253+0000","last_became_peered":"2024-09-10T08:39:27.533253+0000","last_unstale":"2024-09-10T08:39:28.513030+0000","last_undegraded":"2024-09-10T08:39:28.513030+0000","last_fullsized":"2024-09-10T08:39:28.513030+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:35.369459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658431+0000","last_change":"2024-09-10T08:39:27.535032+0000","last_active":"2024-09-10T08:39:28.658431+0000","last_peered":"2024-09-10T08:39:28.658431+0000","last_clean":"2024-09-10T08:39:28.658431+0000","last_became_active":"2024-09-10T08:39:27.532524+0000","last_became_peered":"2024-09-10T08:39:27.532524+0000","last_unstale":"2024-09-10T08:39:28.658431+0000","last_undegraded":"2024-09-10T08:39:28.658431+0000","last_fullsized":"2024-09-10T08:39:28.658431+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:18.384113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515359+0000","last_change":"2024-09-10T08:39:27.543316+0000","last_active":"2024-09-10T08:39:28.515359+0000","last_peered":"2024-09-10T08:39:28.515359+0000","last_clean":"2024-09-10T08:39:28.515359+0000","last_became_active":"2024-09-10T08:39:27.542991+0000","last_became_peered":"2024-09-10T08:39:27.542991+0000","last_unstale":"2024-09-10T08:39:28.515359+0000","last_undegraded":"2024-09-10T08:39:28.515359+0000","last_fullsized":"2024-09-10T08:39:28.515359+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:24.009663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"157'4","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513412+0000","last_change":"2024-09-10T08:39:26.518091+0000","last_active":"2024-09-10T08:39:28.513412+0000","last_peered":"2024-09-10T08:39:28.513412+0000","last_clean":"2024-09-10T08:39:28.513412+0000","last_became_active":"2024-09-10T08:39:26.517808+0000","last_became_peered":"2024-09-10T08:39:26.517808+0000","last_unstale":"2024-09-10T08:39:28.513412+0000","last_undegraded":"2024-09-10T08:39:28.513412+0000","last_fullsized":"2024-09-10T08:39:28.513412+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:16.293257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513453+0000","last_change":"2024-09-10T08:39:27.536138+0000","last_active":"2024-09-10T08:39:28.513453+0000","last_peered":"2024-09-10T08:39:28.513453+0000","last_clean":"2024-09-10T08:39:28.513453+0000","last_became_active":"2024-09-10T08:39:27.535868+0000","last_became_peered":"2024-09-10T08:39:27.535868+0000","last_unstale":"2024-09-10T08:39:28.513453+0000","last_undegraded":"2024-09-10T08:39:28.513453+0000","last_fullsized":"2024-09-10T08:39:28.513453+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:51.708868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659335+0000","last_change":"2024-09-10T08:39:26.528870+0000","last_active":"2024-09-10T08:39:28.659335+0000","last_peered":"2024-09-10T08:39:28.659335+0000","last_clean":"2024-09-10T08:39:28.659335+0000","last_became_active":"2024-09-10T08:39:26.528591+0000","last_became_peered":"2024-09-10T08:39:26.528591+0000","last_unstale":"2024-09-10T08:39:28.659335+0000","last_undegraded":"2024-09-10T08:39:28.659335+0000","last_fullsized":"2024-09-10T08:39:28.659335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:10.310057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658622+0000","last_change":"2024-09-10T08:39:27.526966+0000","last_active":"2024-09-10T08:39:28.658622+0000","last_peered":"2024-09-10T08:39:28.658622+0000","last_clean":"2024-09-10T08:39:28.658622+0000","last_became_active":"2024-09-10T08:39:27.526685+0000","last_became_peered":"2024-09-10T08:39:27.526685+0000","last_unstale":"2024-09-10T08:39:28.658622+0000","last_undegraded":"2024-09-10T08:39:28.658622+0000","last_fullsized":"2024-09-10T08:39:28.658622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:39.812510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658466+0000","last_change":"2024-09-10T08:39:26.534357+0000","last_active":"2024-09-10T08:39:28.658466+0000","last_peered":"2024-09-10T08:39:28.658466+0000","last_clean":"2024-09-10T08:39:28.658466+0000","last_became_active":"2024-09-10T08:39:26.534105+0000","last_became_peered":"2024-09-10T08:39:26.534105+0000","last_unstale":"2024-09-10T08:39:28.658466+0000","last_undegraded":"2024-09-10T08:39:28.658466+0000","last_fullsized":"2024-09-10T08:39:28.658466+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:10.310057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659256+0000","last_change":"2024-09-10T08:39:27.534824+0000","last_active":"2024-09-10T08:39:28.659256+0000","last_peered":"2024-09-10T08:39:28.659256+0000","last_clean":"2024-09-10T08:39:28.659256+0000","last_became_active":"2024-09-10T08:39:27.534536+0000","last_became_peered":"2024-09-10T08:39:27.534536+0000","last_unstale":"2024-09-10T08:39:28.659256+0000","last_undegraded":"2024-09-10T08:39:28.659256+0000","last_fullsized":"2024-09-10T08:39:28.659256+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:39.812510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515959+0000","last_change":"2024-09-10T08:39:26.525822+0000","last_active":"2024-09-10T08:39:28.515959+0000","last_peered":"2024-09-10T08:39:28.515959+0000","last_clean":"2024-09-10T08:39:28.515959+0000","last_became_active":"2024-09-10T08:39:26.525429+0000","last_became_peered":"2024-09-10T08:39:26.525429+0000","last_unstale":"2024-09-10T08:39:28.515959+0000","last_undegraded":"2024-09-10T08:39:28.515959+0000","last_fullsized":"2024-09-10T08:39:28.515959+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:24.690263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515264+0000","last_change":"2024-09-10T08:39:27.543298+0000","last_active":"2024-09-10T08:39:28.515264+0000","last_peered":"2024-09-10T08:39:28.515264+0000","last_clean":"2024-09-10T08:39:28.515264+0000","last_became_active":"2024-09-10T08:39:27.543014+0000","last_became_peered":"2024-09-10T08:39:27.543014+0000","last_unstale":"2024-09-10T08:39:28.515264+0000","last_undegraded":"2024-09-10T08:39:28.515264+0000","last_fullsized":"2024-09-10T08:39:28.515264+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:41.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513572+0000","last_change":"2024-09-10T08:39:26.526770+0000","last_active":"2024-09-10T08:39:28.513572+0000","last_peered":"2024-09-10T08:39:28.513572+0000","last_clean":"2024-09-10T08:39:28.513572+0000","last_became_active":"2024-09-10T08:39:26.526400+0000","last_became_peered":"2024-09-10T08:39:26.526400+0000","last_unstale":"2024-09-10T08:39:28.513572+0000","last_undegraded":"2024-09-10T08:39:28.513572+0000","last_fullsized":"2024-09-10T08:39:28.513572+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:13.453611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658716+0000","last_change":"2024-09-10T08:39:27.530842+0000","last_active":"2024-09-10T08:39:28.658716+0000","last_peered":"2024-09-10T08:39:28.658716+0000","last_clean":"2024-09-10T08:39:28.658716+0000","last_became_active":"2024-09-10T08:39:27.530137+0000","last_became_peered":"2024-09-10T08:39:27.530137+0000","last_unstale":"2024-09-10T08:39:28.658716+0000","last_undegraded":"2024-09-10T08:39:28.658716+0000","last_fullsized":"2024-09-10T08:39:28.658716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:37.975439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515377+0000","last_change":"2024-09-10T08:39:26.530571+0000","last_active":"2024-09-10T08:39:28.515377+0000","last_peered":"2024-09-10T08:39:28.515377+0000","last_clean":"2024-09-10T08:39:28.515377+0000","last_became_active":"2024-09-10T08:39:26.530235+0000","last_became_peered":"2024-09-10T08:39:26.530235+0000","last_unstale":"2024-09-10T08:39:28.515377+0000","last_undegraded":"2024-09-10T08:39:28.515377+0000","last_fullsized":"2024-09-10T08:39:28.515377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:47.155094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514795+0000","last_change":"2024-09-10T08:39:27.535987+0000","last_active":"2024-09-10T08:39:28.514795+0000","last_peered":"2024-09-10T08:39:28.514795+0000","last_clean":"2024-09-10T08:39:28.514795+0000","last_became_active":"2024-09-10T08:39:27.535681+0000","last_became_peered":"2024-09-10T08:39:27.535681+0000","last_unstale":"2024-09-10T08:39:28.514795+0000","last_undegraded":"2024-09-10T08:39:28.514795+0000","last_fullsized":"2024-09-10T08:39:28.514795+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:44.535753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513149+0000","last_change":"2024-09-10T08:39:26.516772+0000","last_active":"2024-09-10T08:39:28.513149+0000","last_peered":"2024-09-10T08:39:28.513149+0000","last_clean":"2024-09-10T08:39:28.513149+0000","last_became_active":"2024-09-10T08:39:26.516511+0000","last_became_peered":"2024-09-10T08:39:26.516511+0000","last_unstale":"2024-09-10T08:39:28.513149+0000","last_undegraded":"2024-09-10T08:39:28.513149+0000","last_fullsized":"2024-09-10T08:39:28.513149+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:28.600670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515242+0000","last_change":"2024-09-10T08:39:27.544528+0000","last_active":"2024-09-10T08:39:28.515242+0000","last_peered":"2024-09-10T08:39:28.515242+0000","last_clean":"2024-09-10T08:39:28.515242+0000","last_became_active":"2024-09-10T08:39:27.543478+0000","last_became_peered":"2024-09-10T08:39:27.543478+0000","last_unstale":"2024-09-10T08:39:28.515242+0000","last_undegraded":"2024-09-10T08:39:28.515242+0000","last_fullsized":"2024-09-10T08:39:28.515242+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.868785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515040+0000","last_change":"2024-09-10T08:39:26.521773+0000","last_active":"2024-09-10T08:39:28.515040+0000","last_peered":"2024-09-10T08:39:28.515040+0000","last_clean":"2024-09-10T08:39:28.515040+0000","last_became_active":"2024-09-10T08:39:26.521471+0000","last_became_peered":"2024-09-10T08:39:26.521471+0000","last_unstale":"2024-09-10T08:39:28.515040+0000","last_undegraded":"2024-09-10T08:39:28.515040+0000","last_fullsized":"2024-09-10T08:39:28.515040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:34.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657919+0000","last_change":"2024-09-10T08:39:27.537243+0000","last_active":"2024-09-10T08:39:28.657919+0000","last_peered":"2024-09-10T08:39:28.657919+0000","last_clean":"2024-09-10T08:39:28.657919+0000","last_became_active":"2024-09-10T08:39:27.536972+0000","last_became_peered":"2024-09-10T08:39:27.536972+0000","last_unstale":"2024-09-10T08:39:28.657919+0000","last_undegraded":"2024-09-10T08:39:28.657919+0000","last_fullsized":"2024-09-10T08:39:28.657919+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:16.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658814+0000","last_change":"2024-09-10T08:39:26.532875+0000","last_active":"2024-09-10T08:39:28.658814+0000","last_peered":"2024-09-10T08:39:28.658814+0000","last_clean":"2024-09-10T08:39:28.658814+0000","last_became_active":"2024-09-10T08:39:26.532482+0000","last_became_peered":"2024-09-10T08:39:26.532482+0000","last_unstale":"2024-09-10T08:39:28.658814+0000","last_undegraded":"2024-09-10T08:39:28.658814+0000","last_fullsized":"2024-09-10T08:39:28.658814+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:26.048354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658024+0000","last_change":"2024-09-10T08:39:27.535782+0000","last_active":"2024-09-10T08:39:28.658024+0000","last_peered":"2024-09-10T08:39:28.658024+0000","last_clean":"2024-09-10T08:39:28.658024+0000","last_became_active":"2024-09-10T08:39:27.535494+0000","last_became_peered":"2024-09-10T08:39:27.535494+0000","last_unstale":"2024-09-10T08:39:28.658024+0000","last_undegraded":"2024-09-10T08:39:28.658024+0000","last_fullsized":"2024-09-10T08:39:28.658024+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:48.158149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"157'3","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516101+0000","last_change":"2024-09-10T08:39:26.529604+0000","last_active":"2024-09-10T08:39:28.516101+0000","last_peered":"2024-09-10T08:39:28.516101+0000","last_clean":"2024-09-10T08:39:28.516101+0000","last_became_active":"2024-09-10T08:39:26.529328+0000","last_became_peered":"2024-09-10T08:39:26.529328+0000","last_unstale":"2024-09-10T08:39:28.516101+0000","last_undegraded":"2024-09-10T08:39:28.516101+0000","last_fullsized":"2024-09-10T08:39:28.516101+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:43.508175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513315+0000","last_change":"2024-09-10T08:39:27.538509+0000","last_active":"2024-09-10T08:39:28.513315+0000","last_peered":"2024-09-10T08:39:28.513315+0000","last_clean":"2024-09-10T08:39:28.513315+0000","last_became_active":"2024-09-10T08:39:27.537890+0000","last_became_peered":"2024-09-10T08:39:27.537890+0000","last_unstale":"2024-09-10T08:39:28.513315+0000","last_undegraded":"2024-09-10T08:39:28.513315+0000","last_fullsized":"2024-09-10T08:39:28.513315+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:53.949906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"157'6","reported_seq":20,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658347+0000","last_change":"2024-09-10T08:39:26.529009+0000","last_active":"2024-09-10T08:39:28.658347+0000","last_peered":"2024-09-10T08:39:28.658347+0000","last_clean":"2024-09-10T08:39:28.658347+0000","last_became_active":"2024-09-10T08:39:26.528709+0000","last_became_peered":"2024-09-10T08:39:26.528709+0000","last_unstale":"2024-09-10T08:39:28.658347+0000","last_undegraded":"2024-09-10T08:39:28.658347+0000","last_fullsized":"2024-09-10T08:39:28.658347+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:32.492071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657558+0000","last_change":"2024-09-10T08:39:27.533804+0000","last_active":"2024-09-10T08:39:28.657558+0000","last_peered":"2024-09-10T08:39:28.657558+0000","last_clean":"2024-09-10T08:39:28.657558+0000","last_became_active":"2024-09-10T08:39:27.533528+0000","last_became_peered":"2024-09-10T08:39:27.533528+0000","last_unstale":"2024-09-10T08:39:28.657558+0000","last_undegraded":"2024-09-10T08:39:28.657558+0000","last_fullsized":"2024-09-10T08:39:28.657558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:12.765175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515243+0000","last_change":"2024-09-10T08:39:26.525912+0000","last_active":"2024-09-10T08:39:28.515243+0000","last_peered":"2024-09-10T08:39:28.515243+0000","last_clean":"2024-09-10T08:39:28.515243+0000","last_became_active":"2024-09-10T08:39:26.525586+0000","last_became_peered":"2024-09-10T08:39:26.525586+0000","last_unstale":"2024-09-10T08:39:28.515243+0000","last_undegraded":"2024-09-10T08:39:28.515243+0000","last_fullsized":"2024-09-10T08:39:28.515243+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.159184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515801+0000","last_change":"2024-09-10T08:39:27.540311+0000","last_active":"2024-09-10T08:39:28.515801+0000","last_peered":"2024-09-10T08:39:28.515801+0000","last_clean":"2024-09-10T08:39:28.515801+0000","last_became_active":"2024-09-10T08:39:27.539999+0000","last_became_peered":"2024-09-10T08:39:27.539999+0000","last_unstale":"2024-09-10T08:39:28.515801+0000","last_undegraded":"2024-09-10T08:39:28.515801+0000","last_fullsized":"2024-09-10T08:39:28.515801+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:28.388913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658542+0000","last_change":"2024-09-10T08:39:26.529841+0000","last_active":"2024-09-10T08:39:28.658542+0000","last_peered":"2024-09-10T08:39:28.658542+0000","last_clean":"2024-09-10T08:39:28.658542+0000","last_became_active":"2024-09-10T08:39:26.528567+0000","last_became_peered":"2024-09-10T08:39:26.528567+0000","last_unstale":"2024-09-10T08:39:28.658542+0000","last_undegraded":"2024-09-10T08:39:28.658542+0000","last_fullsized":"2024-09-10T08:39:28.658542+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:58.355313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658689+0000","last_change":"2024-09-10T08:39:27.525515+0000","last_active":"2024-09-10T08:39:28.658689+0000","last_peered":"2024-09-10T08:39:28.658689+0000","last_clean":"2024-09-10T08:39:28.658689+0000","last_became_active":"2024-09-10T08:39:27.525240+0000","last_became_peered":"2024-09-10T08:39:27.525240+0000","last_unstale":"2024-09-10T08:39:28.658689+0000","last_undegraded":"2024-09-10T08:39:28.658689+0000","last_fullsized":"2024-09-10T08:39:28.658689+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:27.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658065+0000","last_change":"2024-09-10T08:39:26.527007+0000","last_active":"2024-09-10T08:39:28.658065+0000","last_peered":"2024-09-10T08:39:28.658065+0000","last_clean":"2024-09-10T08:39:28.658065+0000","last_became_active":"2024-09-10T08:39:26.526734+0000","last_became_peered":"2024-09-10T08:39:26.526734+0000","last_unstale":"2024-09-10T08:39:28.658065+0000","last_undegraded":"2024-09-10T08:39:28.658065+0000","last_fullsized":"2024-09-10T08:39:28.658065+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:28.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659026+0000","last_change":"2024-09-10T08:39:27.535588+0000","last_active":"2024-09-10T08:39:28.659026+0000","last_peered":"2024-09-10T08:39:28.659026+0000","last_clean":"2024-09-10T08:39:28.659026+0000","last_became_active":"2024-09-10T08:39:27.535331+0000","last_became_peered":"2024-09-10T08:39:27.535331+0000","last_unstale":"2024-09-10T08:39:28.659026+0000","last_undegraded":"2024-09-10T08:39:28.659026+0000","last_fullsized":"2024-09-10T08:39:28.659026+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:39.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"157'8","reported_seq":22,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657501+0000","last_change":"2024-09-10T08:39:26.533753+0000","last_active":"2024-09-10T08:39:28.657501+0000","last_peered":"2024-09-10T08:39:28.657501+0000","last_clean":"2024-09-10T08:39:28.657501+0000","last_became_active":"2024-09-10T08:39:26.533494+0000","last_became_peered":"2024-09-10T08:39:26.533494+0000","last_unstale":"2024-09-10T08:39:28.657501+0000","last_undegraded":"2024-09-10T08:39:28.657501+0000","last_fullsized":"2024-09-10T08:39:28.657501+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:39.225823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657815+0000","last_change":"2024-09-10T08:39:27.547013+0000","last_active":"2024-09-10T08:39:28.657815+0000","last_peered":"2024-09-10T08:39:28.657815+0000","last_clean":"2024-09-10T08:39:28.657815+0000","last_became_active":"2024-09-10T08:39:27.546732+0000","last_became_peered":"2024-09-10T08:39:27.546732+0000","last_unstale":"2024-09-10T08:39:28.657815+0000","last_undegraded":"2024-09-10T08:39:28.657815+0000","last_fullsized":"2024-09-10T08:39:28.657815+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:57.269695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658741+0000","last_change":"2024-09-10T08:39:26.532174+0000","last_active":"2024-09-10T08:39:28.658741+0000","last_peered":"2024-09-10T08:39:28.658741+0000","last_clean":"2024-09-10T08:39:28.658741+0000","last_became_active":"2024-09-10T08:39:26.531527+0000","last_became_peered":"2024-09-10T08:39:26.531527+0000","last_unstale":"2024-09-10T08:39:28.658741+0000","last_undegraded":"2024-09-10T08:39:28.658741+0000","last_fullsized":"2024-09-10T08:39:28.658741+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:46.936285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516352+0000","last_change":"2024-09-10T08:39:27.542856+0000","last_active":"2024-09-10T08:39:28.516352+0000","last_peered":"2024-09-10T08:39:28.516352+0000","last_clean":"2024-09-10T08:39:28.516352+0000","last_became_active":"2024-09-10T08:39:27.541313+0000","last_became_peered":"2024-09-10T08:39:27.541313+0000","last_unstale":"2024-09-10T08:39:28.516352+0000","last_undegraded":"2024-09-10T08:39:28.516352+0000","last_fullsized":"2024-09-10T08:39:28.516352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.648177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659391+0000","last_change":"2024-09-10T08:39:26.527172+0000","last_active":"2024-09-10T08:39:28.659391+0000","last_peered":"2024-09-10T08:39:28.659391+0000","last_clean":"2024-09-10T08:39:28.659391+0000","last_became_active":"2024-09-10T08:39:26.526915+0000","last_became_peered":"2024-09-10T08:39:26.526915+0000","last_unstale":"2024-09-10T08:39:28.659391+0000","last_undegraded":"2024-09-10T08:39:28.659391+0000","last_fullsized":"2024-09-10T08:39:28.659391+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:26.048354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515593+0000","last_change":"2024-09-10T08:39:27.544468+0000","last_active":"2024-09-10T08:39:28.515593+0000","last_peered":"2024-09-10T08:39:28.515593+0000","last_clean":"2024-09-10T08:39:28.515593+0000","last_became_active":"2024-09-10T08:39:27.544029+0000","last_became_peered":"2024-09-10T08:39:27.544029+0000","last_unstale":"2024-09-10T08:39:28.515593+0000","last_undegraded":"2024-09-10T08:39:28.515593+0000","last_fullsized":"2024-09-10T08:39:28.515593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:06.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658783+0000","last_change":"2024-09-10T08:39:26.534265+0000","last_active":"2024-09-10T08:39:28.658783+0000","last_peered":"2024-09-10T08:39:28.658783+0000","last_clean":"2024-09-10T08:39:28.658783+0000","last_became_active":"2024-09-10T08:39:26.533953+0000","last_became_peered":"2024-09-10T08:39:26.533953+0000","last_unstale":"2024-09-10T08:39:28.658783+0000","last_undegraded":"2024-09-10T08:39:28.658783+0000","last_fullsized":"2024-09-10T08:39:28.658783+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:05.211784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516034+0000","last_change":"2024-09-10T08:39:27.538431+0000","last_active":"2024-09-10T08:39:28.516034+0000","last_peered":"2024-09-10T08:39:28.516034+0000","last_clean":"2024-09-10T08:39:28.516034+0000","last_became_active":"2024-09-10T08:39:27.538169+0000","last_became_peered":"2024-09-10T08:39:27.538169+0000","last_unstale":"2024-09-10T08:39:28.516034+0000","last_undegraded":"2024-09-10T08:39:28.516034+0000","last_fullsized":"2024-09-10T08:39:28.516034+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:06.996253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658902+0000","last_change":"2024-09-10T08:39:26.526866+0000","last_active":"2024-09-10T08:39:28.658902+0000","last_peered":"2024-09-10T08:39:28.658902+0000","last_clean":"2024-09-10T08:39:28.658902+0000","last_became_active":"2024-09-10T08:39:26.526521+0000","last_became_peered":"2024-09-10T08:39:26.526521+0000","last_unstale":"2024-09-10T08:39:28.658902+0000","last_undegraded":"2024-09-10T08:39:28.658902+0000","last_fullsized":"2024-09-10T08:39:28.658902+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:34.075074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513081+0000","last_change":"2024-09-10T08:39:27.535073+0000","last_active":"2024-09-10T08:39:28.513081+0000","last_peered":"2024-09-10T08:39:28.513081+0000","last_clean":"2024-09-10T08:39:28.513081+0000","last_became_active":"2024-09-10T08:39:27.534746+0000","last_became_peered":"2024-09-10T08:39:27.534746+0000","last_unstale":"2024-09-10T08:39:28.513081+0000","last_undegraded":"2024-09-10T08:39:28.513081+0000","last_fullsized":"2024-09-10T08:39:28.513081+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:29.027285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515996+0000","last_change":"2024-09-10T08:39:26.524857+0000","last_active":"2024-09-10T08:39:28.515996+0000","last_peered":"2024-09-10T08:39:28.515996+0000","last_clean":"2024-09-10T08:39:28.515996+0000","last_became_active":"2024-09-10T08:39:26.524524+0000","last_became_peered":"2024-09-10T08:39:26.524524+0000","last_unstale":"2024-09-10T08:39:28.515996+0000","last_undegraded":"2024-09-10T08:39:28.515996+0000","last_fullsized":"2024-09-10T08:39:28.515996+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:53.677623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515953+0000","last_change":"2024-09-10T08:39:27.540578+0000","last_active":"2024-09-10T08:39:28.515953+0000","last_peered":"2024-09-10T08:39:28.515953+0000","last_clean":"2024-09-10T08:39:28.515953+0000","last_became_active":"2024-09-10T08:39:27.540066+0000","last_became_peered":"2024-09-10T08:39:27.540066+0000","last_unstale":"2024-09-10T08:39:28.515953+0000","last_undegraded":"2024-09-10T08:39:28.515953+0000","last_fullsized":"2024-09-10T08:39:28.515953+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:01.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658876+0000","last_change":"2024-09-10T08:39:26.530765+0000","last_active":"2024-09-10T08:39:28.658876+0000","last_peered":"2024-09-10T08:39:28.658876+0000","last_clean":"2024-09-10T08:39:28.658876+0000","last_became_active":"2024-09-10T08:39:26.530426+0000","last_became_peered":"2024-09-10T08:39:26.530426+0000","last_unstale":"2024-09-10T08:39:28.658876+0000","last_undegraded":"2024-09-10T08:39:28.658876+0000","last_fullsized":"2024-09-10T08:39:28.658876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:31.598945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512868+0000","last_change":"2024-09-10T08:39:27.525021+0000","last_active":"2024-09-10T08:39:28.512868+0000","last_peered":"2024-09-10T08:39:28.512868+0000","last_clean":"2024-09-10T08:39:28.512868+0000","last_became_active":"2024-09-10T08:39:27.524415+0000","last_became_peered":"2024-09-10T08:39:27.524415+0000","last_unstale":"2024-09-10T08:39:28.512868+0000","last_undegraded":"2024-09-10T08:39:28.512868+0000","last_fullsized":"2024-09-10T08:39:28.512868+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:43.485508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514986+0000","last_change":"2024-09-10T08:39:26.532659+0000","last_active":"2024-09-10T08:39:28.514986+0000","last_peered":"2024-09-10T08:39:28.514986+0000","last_clean":"2024-09-10T08:39:28.514986+0000","last_became_active":"2024-09-10T08:39:26.532194+0000","last_became_peered":"2024-09-10T08:39:26.532194+0000","last_unstale":"2024-09-10T08:39:28.514986+0000","last_undegraded":"2024-09-10T08:39:28.514986+0000","last_fullsized":"2024-09-10T08:39:28.514986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:42.482452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657620+0000","last_change":"2024-09-10T08:39:27.545178+0000","last_active":"2024-09-10T08:39:28.657620+0000","last_peered":"2024-09-10T08:39:28.657620+0000","last_clean":"2024-09-10T08:39:28.657620+0000","last_became_active":"2024-09-10T08:39:27.544896+0000","last_became_peered":"2024-09-10T08:39:27.544896+0000","last_unstale":"2024-09-10T08:39:28.657620+0000","last_undegraded":"2024-09-10T08:39:28.657620+0000","last_fullsized":"2024-09-10T08:39:28.657620+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.048869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657868+0000","last_change":"2024-09-10T08:39:26.524836+0000","last_active":"2024-09-10T08:39:28.657868+0000","last_peered":"2024-09-10T08:39:28.657868+0000","last_clean":"2024-09-10T08:39:28.657868+0000","last_became_active":"2024-09-10T08:39:26.524568+0000","last_became_peered":"2024-09-10T08:39:26.524568+0000","last_unstale":"2024-09-10T08:39:28.657868+0000","last_undegraded":"2024-09-10T08:39:28.657868+0000","last_fullsized":"2024-09-10T08:39:28.657868+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:19.645121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516468+0000","last_change":"2024-09-10T08:39:27.543481+0000","last_active":"2024-09-10T08:39:28.516468+0000","last_peered":"2024-09-10T08:39:28.516468+0000","last_clean":"2024-09-10T08:39:28.516468+0000","last_became_active":"2024-09-10T08:39:27.543010+0000","last_became_peered":"2024-09-10T08:39:27.543010+0000","last_unstale":"2024-09-10T08:39:28.516468+0000","last_undegraded":"2024-09-10T08:39:28.516468+0000","last_fullsized":"2024-09-10T08:39:28.516468+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:32.739085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658807+0000","last_change":"2024-09-10T08:39:26.527899+0000","last_active":"2024-09-10T08:39:28.658807+0000","last_peered":"2024-09-10T08:39:28.658807+0000","last_clean":"2024-09-10T08:39:28.658807+0000","last_became_active":"2024-09-10T08:39:26.527493+0000","last_became_peered":"2024-09-10T08:39:26.527493+0000","last_unstale":"2024-09-10T08:39:28.658807+0000","last_undegraded":"2024-09-10T08:39:28.658807+0000","last_fullsized":"2024-09-10T08:39:28.658807+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.936048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516352+0000","last_change":"2024-09-10T08:39:27.532781+0000","last_active":"2024-09-10T08:39:28.516352+0000","last_peered":"2024-09-10T08:39:28.516352+0000","last_clean":"2024-09-10T08:39:28.516352+0000","last_became_active":"2024-09-10T08:39:27.532394+0000","last_became_peered":"2024-09-10T08:39:27.532394+0000","last_unstale":"2024-09-10T08:39:28.516352+0000","last_undegraded":"2024-09-10T08:39:28.516352+0000","last_fullsized":"2024-09-10T08:39:28.516352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:32.602001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"158'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:29.521546+0000","last_change":"2024-09-10T08:39:26.532409+0000","last_active":"2024-09-10T08:39:29.521546+0000","last_peered":"2024-09-10T08:39:29.521546+0000","last_clean":"2024-09-10T08:39:29.521546+0000","last_became_active":"2024-09-10T08:39:26.531746+0000","last_became_peered":"2024-09-10T08:39:26.531746+0000","last_unstale":"2024-09-10T08:39:29.521546+0000","last_undegraded":"2024-09-10T08:39:29.521546+0000","last_fullsized":"2024-09-10T08:39:29.521546+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:05.910155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515828+0000","last_change":"2024-09-10T08:39:27.541150+0000","last_active":"2024-09-10T08:39:28.515828+0000","last_peered":"2024-09-10T08:39:28.515828+0000","last_clean":"2024-09-10T08:39:28.515828+0000","last_became_active":"2024-09-10T08:39:27.540859+0000","last_became_peered":"2024-09-10T08:39:27.540859+0000","last_unstale":"2024-09-10T08:39:28.515828+0000","last_undegraded":"2024-09-10T08:39:28.515828+0000","last_fullsized":"2024-09-10T08:39:28.515828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:44.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513407+0000","last_change":"2024-09-10T08:39:26.528920+0000","last_active":"2024-09-10T08:39:28.513407+0000","last_peered":"2024-09-10T08:39:28.513407+0000","last_clean":"2024-09-10T08:39:28.513407+0000","last_became_active":"2024-09-10T08:39:26.527792+0000","last_became_peered":"2024-09-10T08:39:26.527792+0000","last_unstale":"2024-09-10T08:39:28.513407+0000","last_undegraded":"2024-09-10T08:39:28.513407+0000","last_fullsized":"2024-09-10T08:39:28.513407+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:46.311858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515108+0000","last_change":"2024-09-10T08:39:27.534872+0000","last_active":"2024-09-10T08:39:28.515108+0000","last_peered":"2024-09-10T08:39:28.515108+0000","last_clean":"2024-09-10T08:39:28.515108+0000","last_became_active":"2024-09-10T08:39:27.533287+0000","last_became_peered":"2024-09-10T08:39:27.533287+0000","last_unstale":"2024-09-10T08:39:28.515108+0000","last_undegraded":"2024-09-10T08:39:28.515108+0000","last_fullsized":"2024-09-10T08:39:28.515108+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:36.053139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516076+0000","last_change":"2024-09-10T08:39:26.525321+0000","last_active":"2024-09-10T08:39:28.516076+0000","last_peered":"2024-09-10T08:39:28.516076+0000","last_clean":"2024-09-10T08:39:28.516076+0000","last_became_active":"2024-09-10T08:39:26.522673+0000","last_became_peered":"2024-09-10T08:39:26.522673+0000","last_unstale":"2024-09-10T08:39:28.516076+0000","last_undegraded":"2024-09-10T08:39:28.516076+0000","last_fullsized":"2024-09-10T08:39:28.516076+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:38.419860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658713+0000","last_change":"2024-09-10T08:39:27.531679+0000","last_active":"2024-09-10T08:39:28.658713+0000","last_peered":"2024-09-10T08:39:28.658713+0000","last_clean":"2024-09-10T08:39:28.658713+0000","last_became_active":"2024-09-10T08:39:27.531393+0000","last_became_peered":"2024-09-10T08:39:27.531393+0000","last_unstale":"2024-09-10T08:39:28.658713+0000","last_undegraded":"2024-09-10T08:39:28.658713+0000","last_fullsized":"2024-09-10T08:39:28.658713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:39.090666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658220+0000","last_change":"2024-09-10T08:39:26.532828+0000","last_active":"2024-09-10T08:39:28.658220+0000","last_peered":"2024-09-10T08:39:28.658220+0000","last_clean":"2024-09-10T08:39:28.658220+0000","last_became_active":"2024-09-10T08:39:26.532547+0000","last_became_peered":"2024-09-10T08:39:26.532547+0000","last_unstale":"2024-09-10T08:39:28.658220+0000","last_undegraded":"2024-09-10T08:39:28.658220+0000","last_fullsized":"2024-09-10T08:39:28.658220+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:41.988164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512928+0000","last_change":"2024-09-10T08:39:27.540225+0000","last_active":"2024-09-10T08:39:28.512928+0000","last_peered":"2024-09-10T08:39:28.512928+0000","last_clean":"2024-09-10T08:39:28.512928+0000","last_became_active":"2024-09-10T08:39:27.539864+0000","last_became_peered":"2024-09-10T08:39:27.539864+0000","last_unstale":"2024-09-10T08:39:28.512928+0000","last_undegraded":"2024-09-10T08:39:28.512928+0000","last_fullsized":"2024-09-10T08:39:28.512928+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:29.162240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657662+0000","last_change":"2024-09-10T08:39:26.532581+0000","last_active":"2024-09-10T08:39:28.657662+0000","last_peered":"2024-09-10T08:39:28.657662+0000","last_clean":"2024-09-10T08:39:28.657662+0000","last_became_active":"2024-09-10T08:39:26.531911+0000","last_became_peered":"2024-09-10T08:39:26.531911+0000","last_unstale":"2024-09-10T08:39:28.657662+0000","last_undegraded":"2024-09-10T08:39:28.657662+0000","last_fullsized":"2024-09-10T08:39:28.657662+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:04.496755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657679+0000","last_change":"2024-09-10T08:39:27.537373+0000","last_active":"2024-09-10T08:39:28.657679+0000","last_peered":"2024-09-10T08:39:28.657679+0000","last_clean":"2024-09-10T08:39:28.657679+0000","last_became_active":"2024-09-10T08:39:27.537078+0000","last_became_peered":"2024-09-10T08:39:27.537078+0000","last_unstale":"2024-09-10T08:39:28.657679+0000","last_undegraded":"2024-09-10T08:39:28.657679+0000","last_fullsized":"2024-09-10T08:39:28.657679+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:04.123364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513244+0000","last_change":"2024-09-10T08:39:26.523231+0000","last_active":"2024-09-10T08:39:28.513244+0000","last_peered":"2024-09-10T08:39:28.513244+0000","last_clean":"2024-09-10T08:39:28.513244+0000","last_became_active":"2024-09-10T08:39:26.522323+0000","last_became_peered":"2024-09-10T08:39:26.522323+0000","last_unstale":"2024-09-10T08:39:28.513244+0000","last_undegraded":"2024-09-10T08:39:28.513244+0000","last_fullsized":"2024-09-10T08:39:28.513244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:58.930924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512876+0000","last_change":"2024-09-10T08:39:27.539919+0000","last_active":"2024-09-10T08:39:28.512876+0000","last_peered":"2024-09-10T08:39:28.512876+0000","last_clean":"2024-09-10T08:39:28.512876+0000","last_became_active":"2024-09-10T08:39:27.539563+0000","last_became_peered":"2024-09-10T08:39:27.539563+0000","last_unstale":"2024-09-10T08:39:28.512876+0000","last_undegraded":"2024-09-10T08:39:28.512876+0000","last_fullsized":"2024-09-10T08:39:28.512876+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:48.158149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512811+0000","last_change":"2024-09-10T08:39:26.525677+0000","last_active":"2024-09-10T08:39:28.512811+0000","last_peered":"2024-09-10T08:39:28.512811+0000","last_clean":"2024-09-10T08:39:28.512811+0000","last_became_active":"2024-09-10T08:39:26.525392+0000","last_became_peered":"2024-09-10T08:39:26.525392+0000","last_unstale":"2024-09-10T08:39:28.512811+0000","last_undegraded":"2024-09-10T08:39:28.512811+0000","last_fullsized":"2024-09-10T08:39:28.512811+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.371973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657780+0000","last_change":"2024-09-10T08:39:27.544214+0000","last_active":"2024-09-10T08:39:28.657780+0000","last_peered":"2024-09-10T08:39:28.657780+0000","last_clean":"2024-09-10T08:39:28.657780+0000","last_became_active":"2024-09-10T08:39:27.543911+0000","last_became_peered":"2024-09-10T08:39:27.543911+0000","last_unstale":"2024-09-10T08:39:28.657780+0000","last_undegraded":"2024-09-10T08:39:28.657780+0000","last_fullsized":"2024-09-10T08:39:28.657780+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:24.607999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658643+0000","last_change":"2024-09-10T08:39:26.532402+0000","last_active":"2024-09-10T08:39:28.658643+0000","last_peered":"2024-09-10T08:39:28.658643+0000","last_clean":"2024-09-10T08:39:28.658643+0000","last_became_active":"2024-09-10T08:39:26.531874+0000","last_became_peered":"2024-09-10T08:39:26.531874+0000","last_unstale":"2024-09-10T08:39:28.658643+0000","last_undegraded":"2024-09-10T08:39:28.658643+0000","last_fullsized":"2024-09-10T08:39:28.658643+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:01.810700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":417,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657566+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:39:28.657566+0000","last_peered":"2024-09-10T08:39:28.657566+0000","last_clean":"2024-09-10T08:39:28.657566+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:39:28.657566+0000","last_undegraded":"2024-09-10T08:39:28.657566+0000","last_fullsized":"2024-09-10T08:39:28.657566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28960,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342880,"statfs":{"total":96636764160,"available":96607109120,"internally_reserved":0,"allocated":1974272,"data_stored":866781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":1978368,"data_stored":866815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55332,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316508,"statfs":{"total":96636764160,"available":96580104192,"internally_reserved":0,"allocated":1978368,"data_stored":866815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59508,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312332,"statfs":{"total":96636764160,"available":96575827968,"internally_reserved":0,"allocated":1990656,"data_stored":868415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59496,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312344,"statfs":{"total":96636764160,"available":96575840256,"internally_reserved":0,"allocated":1978368,"data_stored":867363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55932,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315908,"statfs":{"total":96636764160,"available":96579489792,"internally_reserved":0,"allocated":2592768,"data_stored":1458943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51168,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320672,"statfs":{"total":96636764160,"available":96584368128,"internally_reserved":0,"allocated":1978368,"data_stored":866851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2564096,"data_stored":1451521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:39:31.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:39:31.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.929+0000 7fbedca00640 1 Processor -- start 2024-09-10T08:39:31.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.929+0000 7fbedca00640 1 -- start start 2024-09-10T08:39:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 0x7fbed80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 0x7fbed80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbed80b5880 0x7fbed80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbed8073b00 con 0x7fbed80b5880 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80b4020 con 0x7fbed8145ed0 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.930+0000 7fbedca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbed80b42c0 con 0x7fbed8073180 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbed80b5880 0x7fbed80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbed80b5880 0x7fbed80b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54910/0 (socket says 172.21.15.52:54910) 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 -- 172.21.15.52:0/2803295935 learned_addr learned my addr 172.21.15.52:0/2803295935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed5e00640 1 --2- 172.21.15.52:0/2803295935 >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 0x7fbed80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 -- 172.21.15.52:0/2803295935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 msgr2=0x7fbed80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed5400640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 0x7fbed80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 0x7fbed80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 -- 172.21.15.52:0/2803295935 >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 msgr2=0x7fbed80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 --2- 172.21.15.52:0/2803295935 >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 0x7fbed80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed6800640 1 -- 172.21.15.52:0/2803295935 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80b45a0 con 0x7fbed80b5880 2024-09-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed5e00640 1 --2- 172.21.15.52:0/2803295935 >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 0x7fbed80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.931+0000 7fbed5400640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 0x7fbed80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:31.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.932+0000 7fbed6800640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed80b5880 0x7fbed80b5d10 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fbed8069cd0 tx=0x7fbed002a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8688ad785448e23a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.932+0000 7fbed4a00640 1 -- 172.21.15.52:0/2803295935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0036070 con 0x7fbed80b5880 2024-09-10T08:39:31.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.932+0000 7fbed4a00640 1 -- 172.21.15.52:0/2803295935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0031600 con 0x7fbed80b5880 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.932+0000 7fbed4a00640 1 -- 172.21.15.52:0/2803295935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00319d0 con 0x7fbed80b5880 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 -- 172.21.15.52:0/2803295935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed80b5880 msgr2=0x7fbed80b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed80b5880 0x7fbed80b5d10 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fbed8069cd0 tx=0x7fbed002a690 comp rx=0 tx=0).stop 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 -- 172.21.15.52:0/2803295935 shutdown_connections 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed80b5880 0x7fbed80b5d10 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 --2- 172.21.15.52:0/2803295935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8073180 0x7fbed80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 --2- 172.21.15.52:0/2803295935 >> v2:172.21.15.176:3300/0 conn(0x7fbed8145ed0 0x7fbed80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 -- 172.21.15.52:0/2803295935 >> 172.21.15.52:0/2803295935 conn(0x7fbed80ccec0 msgr2=0x7fbed80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 -- 172.21.15.52:0/2803295935 shutdown_connections 2024-09-10T08:39:31.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.933+0000 7fbedca00640 1 -- 172.21.15.52:0/2803295935 wait complete. 2024-09-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.934+0000 7fbedca00640 1 Processor -- start 2024-09-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.935+0000 7fbedca00640 1 -- start start 2024-09-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.935+0000 7fbedca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.935+0000 7fbedca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed80b5880 0x7fbed80cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbedca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8145ed0 0x7fbed80cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbedca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80b6250 con 0x7fbed8073180 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbedca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80b4b60 con 0x7fbed80b5880 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbedca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fbed80b63d0 con 0x7fbed8145ed0 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54924/0 (socket says 172.21.15.52:54924) 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 -- 172.21.15.52:0/4046857072 learned_addr learned my addr 172.21.15.52:0/4046857072 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5400640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed80b5880 0x7fbed80cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed6800640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8145ed0 0x7fbed80cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 -- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8145ed0 msgr2=0x7fbed80cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8145ed0 0x7fbed80cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 -- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed80b5880 msgr2=0x7fbed80cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed80b5880 0x7fbed80cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.936+0000 7fbed5e00640 1 -- 172.21.15.52:0/4046857072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed81f4670 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbed5e00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c820 tx=0x7fbec800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8015070 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8007a30 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007de0 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed81f4950 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.937+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed81f76b0 con 0x7fbed8073180 2024-09-10T08:39:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.938+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed81462b0 con 0x7fbed8073180 2024-09-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.939+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec8018070 con 0x7fbed8073180 2024-09-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.940+0000 7fbece000640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.940+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fbec808ad90 con 0x7fbed8073180 2024-09-10T08:39:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.940+0000 7fbed5400640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.941+0000 7fbed5400640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 0x7fbeb806e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbed8068e10 tx=0x7fbec4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:31.944+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbec8059730 con 0x7fbed8073180 2024-09-10T08:39:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.127+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbed80d11f0 con 0x7fbeb806be30 2024-09-10T08:39:32.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.133+0000 7fbece000640 1 -- 172.21.15.52:0/4046857072 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7fbed80d11f0 con 0x7fbeb806be30 2024-09-10T08:39:32.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:32.138 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 msgr2=0x7fbeb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 0x7fbeb806e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbed8068e10 tx=0x7fbec4008040 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 msgr2=0x7fbed81f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c820 tx=0x7fbec800cce0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 shutdown_connections 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbed8145ed0 0x7fbed80cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbed80b5880 0x7fbed80cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 --2- 172.21.15.52:0/4046857072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbed8073180 0x7fbed81f7bd0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 >> 172.21.15.52:0/4046857072 conn(0x7fbed80ccec0 msgr2=0x7fbed8143100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:32.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 shutdown_connections 2024-09-10T08:39:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.137+0000 7fbedca00640 1 -- 172.21.15.52:0/4046857072 wait complete. 2024-09-10T08:39:32.153 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2024-09-10T08:39:31.614686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":421632,"kb_used_data":16636,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754553088,"statfs":{"total":773094113280,"available":772662362112,"internally_reserved":0,"allocated":17035264,"data_stored":8113504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":414502448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001518"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513292+0000","last_change":"2024-09-10T08:39:27.524727+0000","last_active":"2024-09-10T08:39:28.513292+0000","last_peered":"2024-09-10T08:39:28.513292+0000","last_clean":"2024-09-10T08:39:28.513292+0000","last_became_active":"2024-09-10T08:39:27.524427+0000","last_became_peered":"2024-09-10T08:39:27.524427+0000","last_unstale":"2024-09-10T08:39:28.513292+0000","last_undegraded":"2024-09-10T08:39:28.513292+0000","last_fullsized":"2024-09-10T08:39:28.513292+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:12:41.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513617+0000","last_change":"2024-09-10T08:39:27.530646+0000","last_active":"2024-09-10T08:39:28.513617+0000","last_peered":"2024-09-10T08:39:28.513617+0000","last_clean":"2024-09-10T08:39:28.513617+0000","last_became_active":"2024-09-10T08:39:27.529677+0000","last_became_peered":"2024-09-10T08:39:27.529677+0000","last_unstale":"2024-09-10T08:39:28.513617+0000","last_undegraded":"2024-09-10T08:39:28.513617+0000","last_fullsized":"2024-09-10T08:39:28.513617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:44.754191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513288+0000","last_change":"2024-09-10T08:39:27.538783+0000","last_active":"2024-09-10T08:39:28.513288+0000","last_peered":"2024-09-10T08:39:28.513288+0000","last_clean":"2024-09-10T08:39:28.513288+0000","last_became_active":"2024-09-10T08:39:27.538252+0000","last_became_peered":"2024-09-10T08:39:27.538252+0000","last_unstale":"2024-09-10T08:39:28.513288+0000","last_undegraded":"2024-09-10T08:39:28.513288+0000","last_fullsized":"2024-09-10T08:39:28.513288+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:36.265564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514945+0000","last_change":"2024-09-10T08:39:27.545895+0000","last_active":"2024-09-10T08:39:28.514945+0000","last_peered":"2024-09-10T08:39:28.514945+0000","last_clean":"2024-09-10T08:39:28.514945+0000","last_became_active":"2024-09-10T08:39:27.545598+0000","last_became_peered":"2024-09-10T08:39:27.545598+0000","last_unstale":"2024-09-10T08:39:28.514945+0000","last_undegraded":"2024-09-10T08:39:28.514945+0000","last_fullsized":"2024-09-10T08:39:28.514945+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:55.165108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657582+0000","last_change":"2024-09-10T08:39:27.539372+0000","last_active":"2024-09-10T08:39:28.657582+0000","last_peered":"2024-09-10T08:39:28.657582+0000","last_clean":"2024-09-10T08:39:28.657582+0000","last_became_active":"2024-09-10T08:39:27.539121+0000","last_became_peered":"2024-09-10T08:39:27.539121+0000","last_unstale":"2024-09-10T08:39:28.657582+0000","last_undegraded":"2024-09-10T08:39:28.657582+0000","last_fullsized":"2024-09-10T08:39:28.657582+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:17.046039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658388+0000","last_change":"2024-09-10T08:39:27.544086+0000","last_active":"2024-09-10T08:39:28.658388+0000","last_peered":"2024-09-10T08:39:28.658388+0000","last_clean":"2024-09-10T08:39:28.658388+0000","last_became_active":"2024-09-10T08:39:27.543073+0000","last_became_peered":"2024-09-10T08:39:27.543073+0000","last_unstale":"2024-09-10T08:39:28.658388+0000","last_undegraded":"2024-09-10T08:39:28.658388+0000","last_fullsized":"2024-09-10T08:39:28.658388+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:39.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657857+0000","last_change":"2024-09-10T08:39:27.539012+0000","last_active":"2024-09-10T08:39:28.657857+0000","last_peered":"2024-09-10T08:39:28.657857+0000","last_clean":"2024-09-10T08:39:28.657857+0000","last_became_active":"2024-09-10T08:39:27.535453+0000","last_became_peered":"2024-09-10T08:39:27.535453+0000","last_unstale":"2024-09-10T08:39:28.657857+0000","last_undegraded":"2024-09-10T08:39:28.657857+0000","last_fullsized":"2024-09-10T08:39:28.657857+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:36:07.983950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657928+0000","last_change":"2024-09-10T08:39:27.518078+0000","last_active":"2024-09-10T08:39:28.657928+0000","last_peered":"2024-09-10T08:39:28.657928+0000","last_clean":"2024-09-10T08:39:28.657928+0000","last_became_active":"2024-09-10T08:39:27.517762+0000","last_became_peered":"2024-09-10T08:39:27.517762+0000","last_unstale":"2024-09-10T08:39:28.657928+0000","last_undegraded":"2024-09-10T08:39:28.657928+0000","last_fullsized":"2024-09-10T08:39:28.657928+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:25:12.715954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659415+0000","last_change":"2024-09-10T08:39:27.536138+0000","last_active":"2024-09-10T08:39:28.659415+0000","last_peered":"2024-09-10T08:39:28.659415+0000","last_clean":"2024-09-10T08:39:28.659415+0000","last_became_active":"2024-09-10T08:39:27.535874+0000","last_became_peered":"2024-09-10T08:39:27.535874+0000","last_unstale":"2024-09-10T08:39:28.659415+0000","last_undegraded":"2024-09-10T08:39:28.659415+0000","last_fullsized":"2024-09-10T08:39:28.659415+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:39.090666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659366+0000","last_change":"2024-09-10T08:39:27.520764+0000","last_active":"2024-09-10T08:39:28.659366+0000","last_peered":"2024-09-10T08:39:28.659366+0000","last_clean":"2024-09-10T08:39:28.659366+0000","last_became_active":"2024-09-10T08:39:27.520493+0000","last_became_peered":"2024-09-10T08:39:27.520493+0000","last_unstale":"2024-09-10T08:39:28.659366+0000","last_undegraded":"2024-09-10T08:39:28.659366+0000","last_fullsized":"2024-09-10T08:39:28.659366+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:27.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658320+0000","last_change":"2024-09-10T08:39:27.546872+0000","last_active":"2024-09-10T08:39:28.658320+0000","last_peered":"2024-09-10T08:39:28.658320+0000","last_clean":"2024-09-10T08:39:28.658320+0000","last_became_active":"2024-09-10T08:39:27.546595+0000","last_became_peered":"2024-09-10T08:39:27.546595+0000","last_unstale":"2024-09-10T08:39:28.658320+0000","last_undegraded":"2024-09-10T08:39:28.658320+0000","last_fullsized":"2024-09-10T08:39:28.658320+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:09.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658625+0000","last_change":"2024-09-10T08:39:27.532482+0000","last_active":"2024-09-10T08:39:28.658625+0000","last_peered":"2024-09-10T08:39:28.658625+0000","last_clean":"2024-09-10T08:39:28.658625+0000","last_became_active":"2024-09-10T08:39:27.532195+0000","last_became_peered":"2024-09-10T08:39:27.532195+0000","last_unstale":"2024-09-10T08:39:28.658625+0000","last_undegraded":"2024-09-10T08:39:28.658625+0000","last_fullsized":"2024-09-10T08:39:28.658625+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:54.686447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658622+0000","last_change":"2024-09-10T08:39:27.546940+0000","last_active":"2024-09-10T08:39:28.658622+0000","last_peered":"2024-09-10T08:39:28.658622+0000","last_clean":"2024-09-10T08:39:28.658622+0000","last_became_active":"2024-09-10T08:39:27.546688+0000","last_became_peered":"2024-09-10T08:39:27.546688+0000","last_unstale":"2024-09-10T08:39:28.658622+0000","last_undegraded":"2024-09-10T08:39:28.658622+0000","last_fullsized":"2024-09-10T08:39:28.658622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:26:54.185140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659104+0000","last_change":"2024-09-10T08:39:27.531753+0000","last_active":"2024-09-10T08:39:28.659104+0000","last_peered":"2024-09-10T08:39:28.659104+0000","last_clean":"2024-09-10T08:39:28.659104+0000","last_became_active":"2024-09-10T08:39:27.531465+0000","last_became_peered":"2024-09-10T08:39:27.531465+0000","last_unstale":"2024-09-10T08:39:28.659104+0000","last_undegraded":"2024-09-10T08:39:28.659104+0000","last_fullsized":"2024-09-10T08:39:28.659104+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:07.369278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658273+0000","last_change":"2024-09-10T08:39:27.531412+0000","last_active":"2024-09-10T08:39:28.658273+0000","last_peered":"2024-09-10T08:39:28.658273+0000","last_clean":"2024-09-10T08:39:28.658273+0000","last_became_active":"2024-09-10T08:39:27.531168+0000","last_became_peered":"2024-09-10T08:39:27.531168+0000","last_unstale":"2024-09-10T08:39:28.658273+0000","last_undegraded":"2024-09-10T08:39:28.658273+0000","last_fullsized":"2024-09-10T08:39:28.658273+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:06.674341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657538+0000","last_change":"2024-09-10T08:39:27.532312+0000","last_active":"2024-09-10T08:39:28.657538+0000","last_peered":"2024-09-10T08:39:28.657538+0000","last_clean":"2024-09-10T08:39:28.657538+0000","last_became_active":"2024-09-10T08:39:27.532014+0000","last_became_peered":"2024-09-10T08:39:27.532014+0000","last_unstale":"2024-09-10T08:39:28.657538+0000","last_undegraded":"2024-09-10T08:39:28.657538+0000","last_fullsized":"2024-09-10T08:39:28.657538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:16.753856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658776+0000","last_change":"2024-09-10T08:39:27.523914+0000","last_active":"2024-09-10T08:39:28.658776+0000","last_peered":"2024-09-10T08:39:28.658776+0000","last_clean":"2024-09-10T08:39:28.658776+0000","last_became_active":"2024-09-10T08:39:27.523587+0000","last_became_peered":"2024-09-10T08:39:27.523587+0000","last_unstale":"2024-09-10T08:39:28.658776+0000","last_undegraded":"2024-09-10T08:39:28.658776+0000","last_fullsized":"2024-09-10T08:39:28.658776+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:59:41.943466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515525+0000","last_change":"2024-09-10T08:39:27.541366+0000","last_active":"2024-09-10T08:39:28.515525+0000","last_peered":"2024-09-10T08:39:28.515525+0000","last_clean":"2024-09-10T08:39:28.515525+0000","last_became_active":"2024-09-10T08:39:27.540998+0000","last_became_peered":"2024-09-10T08:39:27.540998+0000","last_unstale":"2024-09-10T08:39:28.515525+0000","last_undegraded":"2024-09-10T08:39:28.515525+0000","last_fullsized":"2024-09-10T08:39:28.515525+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:15:29.851986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658032+0000","last_change":"2024-09-10T08:39:27.541441+0000","last_active":"2024-09-10T08:39:28.658032+0000","last_peered":"2024-09-10T08:39:28.658032+0000","last_clean":"2024-09-10T08:39:28.658032+0000","last_became_active":"2024-09-10T08:39:27.541149+0000","last_became_peered":"2024-09-10T08:39:27.541149+0000","last_unstale":"2024-09-10T08:39:28.658032+0000","last_undegraded":"2024-09-10T08:39:28.658032+0000","last_fullsized":"2024-09-10T08:39:28.658032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:29.162240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658780+0000","last_change":"2024-09-10T08:39:27.542641+0000","last_active":"2024-09-10T08:39:28.658780+0000","last_peered":"2024-09-10T08:39:28.658780+0000","last_clean":"2024-09-10T08:39:28.658780+0000","last_became_active":"2024-09-10T08:39:27.542384+0000","last_became_peered":"2024-09-10T08:39:27.542384+0000","last_unstale":"2024-09-10T08:39:28.658780+0000","last_undegraded":"2024-09-10T08:39:28.658780+0000","last_fullsized":"2024-09-10T08:39:28.658780+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:11.905587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658477+0000","last_change":"2024-09-10T08:39:27.530120+0000","last_active":"2024-09-10T08:39:28.658477+0000","last_peered":"2024-09-10T08:39:28.658477+0000","last_clean":"2024-09-10T08:39:28.658477+0000","last_became_active":"2024-09-10T08:39:27.529823+0000","last_became_peered":"2024-09-10T08:39:27.529823+0000","last_unstale":"2024-09-10T08:39:28.658477+0000","last_undegraded":"2024-09-10T08:39:28.658477+0000","last_fullsized":"2024-09-10T08:39:28.658477+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:07.369278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657617+0000","last_change":"2024-09-10T08:39:27.547129+0000","last_active":"2024-09-10T08:39:28.657617+0000","last_peered":"2024-09-10T08:39:28.657617+0000","last_clean":"2024-09-10T08:39:28.657617+0000","last_became_active":"2024-09-10T08:39:27.546568+0000","last_became_peered":"2024-09-10T08:39:27.546568+0000","last_unstale":"2024-09-10T08:39:28.657617+0000","last_undegraded":"2024-09-10T08:39:28.657617+0000","last_fullsized":"2024-09-10T08:39:28.657617+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:54.024534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516400+0000","last_change":"2024-09-10T08:39:27.536187+0000","last_active":"2024-09-10T08:39:28.516400+0000","last_peered":"2024-09-10T08:39:28.516400+0000","last_clean":"2024-09-10T08:39:28.516400+0000","last_became_active":"2024-09-10T08:39:27.535420+0000","last_became_peered":"2024-09-10T08:39:27.535420+0000","last_unstale":"2024-09-10T08:39:28.516400+0000","last_undegraded":"2024-09-10T08:39:28.516400+0000","last_fullsized":"2024-09-10T08:39:28.516400+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:53:24.083418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657507+0000","last_change":"2024-09-10T08:39:27.539419+0000","last_active":"2024-09-10T08:39:28.657507+0000","last_peered":"2024-09-10T08:39:28.657507+0000","last_clean":"2024-09-10T08:39:28.657507+0000","last_became_active":"2024-09-10T08:39:27.539179+0000","last_became_peered":"2024-09-10T08:39:27.539179+0000","last_unstale":"2024-09-10T08:39:28.657507+0000","last_undegraded":"2024-09-10T08:39:28.657507+0000","last_fullsized":"2024-09-10T08:39:28.657507+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:41.047361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658552+0000","last_change":"2024-09-10T08:39:27.538793+0000","last_active":"2024-09-10T08:39:28.658552+0000","last_peered":"2024-09-10T08:39:28.658552+0000","last_clean":"2024-09-10T08:39:28.658552+0000","last_became_active":"2024-09-10T08:39:27.538500+0000","last_became_peered":"2024-09-10T08:39:27.538500+0000","last_unstale":"2024-09-10T08:39:28.658552+0000","last_undegraded":"2024-09-10T08:39:28.658552+0000","last_fullsized":"2024-09-10T08:39:28.658552+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:04:50.604036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516360+0000","last_change":"2024-09-10T08:39:27.543695+0000","last_active":"2024-09-10T08:39:28.516360+0000","last_peered":"2024-09-10T08:39:28.516360+0000","last_clean":"2024-09-10T08:39:28.516360+0000","last_became_active":"2024-09-10T08:39:27.543345+0000","last_became_peered":"2024-09-10T08:39:27.543345+0000","last_unstale":"2024-09-10T08:39:28.516360+0000","last_undegraded":"2024-09-10T08:39:28.516360+0000","last_fullsized":"2024-09-10T08:39:28.516360+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:14:08.492774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658546+0000","last_change":"2024-09-10T08:39:27.542032+0000","last_active":"2024-09-10T08:39:28.658546+0000","last_peered":"2024-09-10T08:39:28.658546+0000","last_clean":"2024-09-10T08:39:28.658546+0000","last_became_active":"2024-09-10T08:39:27.541751+0000","last_became_peered":"2024-09-10T08:39:27.541751+0000","last_unstale":"2024-09-10T08:39:28.658546+0000","last_undegraded":"2024-09-10T08:39:28.658546+0000","last_fullsized":"2024-09-10T08:39:28.658546+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:33.774677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657930+0000","last_change":"2024-09-10T08:39:27.540269+0000","last_active":"2024-09-10T08:39:28.657930+0000","last_peered":"2024-09-10T08:39:28.657930+0000","last_clean":"2024-09-10T08:39:28.657930+0000","last_became_active":"2024-09-10T08:39:27.539751+0000","last_became_peered":"2024-09-10T08:39:27.539751+0000","last_unstale":"2024-09-10T08:39:28.657930+0000","last_undegraded":"2024-09-10T08:39:28.657930+0000","last_fullsized":"2024-09-10T08:39:28.657930+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:43.485508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513096+0000","last_change":"2024-09-10T08:39:27.538612+0000","last_active":"2024-09-10T08:39:28.513096+0000","last_peered":"2024-09-10T08:39:28.513096+0000","last_clean":"2024-09-10T08:39:28.513096+0000","last_became_active":"2024-09-10T08:39:27.537827+0000","last_became_peered":"2024-09-10T08:39:27.537827+0000","last_unstale":"2024-09-10T08:39:28.513096+0000","last_undegraded":"2024-09-10T08:39:28.513096+0000","last_fullsized":"2024-09-10T08:39:28.513096+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:42.474588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659098+0000","last_change":"2024-09-10T08:39:27.533308+0000","last_active":"2024-09-10T08:39:28.659098+0000","last_peered":"2024-09-10T08:39:28.659098+0000","last_clean":"2024-09-10T08:39:28.659098+0000","last_became_active":"2024-09-10T08:39:27.532977+0000","last_became_peered":"2024-09-10T08:39:27.532977+0000","last_unstale":"2024-09-10T08:39:28.659098+0000","last_undegraded":"2024-09-10T08:39:28.659098+0000","last_fullsized":"2024-09-10T08:39:28.659098+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:18.384113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513030+0000","last_change":"2024-09-10T08:39:27.533581+0000","last_active":"2024-09-10T08:39:28.513030+0000","last_peered":"2024-09-10T08:39:28.513030+0000","last_clean":"2024-09-10T08:39:28.513030+0000","last_became_active":"2024-09-10T08:39:27.533253+0000","last_became_peered":"2024-09-10T08:39:27.533253+0000","last_unstale":"2024-09-10T08:39:28.513030+0000","last_undegraded":"2024-09-10T08:39:28.513030+0000","last_fullsized":"2024-09-10T08:39:28.513030+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:35.369459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658431+0000","last_change":"2024-09-10T08:39:27.535032+0000","last_active":"2024-09-10T08:39:28.658431+0000","last_peered":"2024-09-10T08:39:28.658431+0000","last_clean":"2024-09-10T08:39:28.658431+0000","last_became_active":"2024-09-10T08:39:27.532524+0000","last_became_peered":"2024-09-10T08:39:27.532524+0000","last_unstale":"2024-09-10T08:39:28.658431+0000","last_undegraded":"2024-09-10T08:39:28.658431+0000","last_fullsized":"2024-09-10T08:39:28.658431+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:18.384113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515359+0000","last_change":"2024-09-10T08:39:27.543316+0000","last_active":"2024-09-10T08:39:28.515359+0000","last_peered":"2024-09-10T08:39:28.515359+0000","last_clean":"2024-09-10T08:39:28.515359+0000","last_became_active":"2024-09-10T08:39:27.542991+0000","last_became_peered":"2024-09-10T08:39:27.542991+0000","last_unstale":"2024-09-10T08:39:28.515359+0000","last_undegraded":"2024-09-10T08:39:28.515359+0000","last_fullsized":"2024-09-10T08:39:28.515359+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:49:24.009663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"157'4","reported_seq":18,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513412+0000","last_change":"2024-09-10T08:39:26.518091+0000","last_active":"2024-09-10T08:39:28.513412+0000","last_peered":"2024-09-10T08:39:28.513412+0000","last_clean":"2024-09-10T08:39:28.513412+0000","last_became_active":"2024-09-10T08:39:26.517808+0000","last_became_peered":"2024-09-10T08:39:26.517808+0000","last_unstale":"2024-09-10T08:39:28.513412+0000","last_undegraded":"2024-09-10T08:39:28.513412+0000","last_fullsized":"2024-09-10T08:39:28.513412+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:16.293257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513453+0000","last_change":"2024-09-10T08:39:27.536138+0000","last_active":"2024-09-10T08:39:28.513453+0000","last_peered":"2024-09-10T08:39:28.513453+0000","last_clean":"2024-09-10T08:39:28.513453+0000","last_became_active":"2024-09-10T08:39:27.535868+0000","last_became_peered":"2024-09-10T08:39:27.535868+0000","last_unstale":"2024-09-10T08:39:28.513453+0000","last_undegraded":"2024-09-10T08:39:28.513453+0000","last_fullsized":"2024-09-10T08:39:28.513453+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:51.708868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659335+0000","last_change":"2024-09-10T08:39:26.528870+0000","last_active":"2024-09-10T08:39:28.659335+0000","last_peered":"2024-09-10T08:39:28.659335+0000","last_clean":"2024-09-10T08:39:28.659335+0000","last_became_active":"2024-09-10T08:39:26.528591+0000","last_became_peered":"2024-09-10T08:39:26.528591+0000","last_unstale":"2024-09-10T08:39:28.659335+0000","last_undegraded":"2024-09-10T08:39:28.659335+0000","last_fullsized":"2024-09-10T08:39:28.659335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:10.310057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658622+0000","last_change":"2024-09-10T08:39:27.526966+0000","last_active":"2024-09-10T08:39:28.658622+0000","last_peered":"2024-09-10T08:39:28.658622+0000","last_clean":"2024-09-10T08:39:28.658622+0000","last_became_active":"2024-09-10T08:39:27.526685+0000","last_became_peered":"2024-09-10T08:39:27.526685+0000","last_unstale":"2024-09-10T08:39:28.658622+0000","last_undegraded":"2024-09-10T08:39:28.658622+0000","last_fullsized":"2024-09-10T08:39:28.658622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:39.812510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658466+0000","last_change":"2024-09-10T08:39:26.534357+0000","last_active":"2024-09-10T08:39:28.658466+0000","last_peered":"2024-09-10T08:39:28.658466+0000","last_clean":"2024-09-10T08:39:28.658466+0000","last_became_active":"2024-09-10T08:39:26.534105+0000","last_became_peered":"2024-09-10T08:39:26.534105+0000","last_unstale":"2024-09-10T08:39:28.658466+0000","last_undegraded":"2024-09-10T08:39:28.658466+0000","last_fullsized":"2024-09-10T08:39:28.658466+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:03:10.310057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659256+0000","last_change":"2024-09-10T08:39:27.534824+0000","last_active":"2024-09-10T08:39:28.659256+0000","last_peered":"2024-09-10T08:39:28.659256+0000","last_clean":"2024-09-10T08:39:28.659256+0000","last_became_active":"2024-09-10T08:39:27.534536+0000","last_became_peered":"2024-09-10T08:39:27.534536+0000","last_unstale":"2024-09-10T08:39:28.659256+0000","last_undegraded":"2024-09-10T08:39:28.659256+0000","last_fullsized":"2024-09-10T08:39:28.659256+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:39.812510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515959+0000","last_change":"2024-09-10T08:39:26.525822+0000","last_active":"2024-09-10T08:39:28.515959+0000","last_peered":"2024-09-10T08:39:28.515959+0000","last_clean":"2024-09-10T08:39:28.515959+0000","last_became_active":"2024-09-10T08:39:26.525429+0000","last_became_peered":"2024-09-10T08:39:26.525429+0000","last_unstale":"2024-09-10T08:39:28.515959+0000","last_undegraded":"2024-09-10T08:39:28.515959+0000","last_fullsized":"2024-09-10T08:39:28.515959+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:01:24.690263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515264+0000","last_change":"2024-09-10T08:39:27.543298+0000","last_active":"2024-09-10T08:39:28.515264+0000","last_peered":"2024-09-10T08:39:28.515264+0000","last_clean":"2024-09-10T08:39:28.515264+0000","last_became_active":"2024-09-10T08:39:27.543014+0000","last_became_peered":"2024-09-10T08:39:27.543014+0000","last_unstale":"2024-09-10T08:39:28.515264+0000","last_undegraded":"2024-09-10T08:39:28.515264+0000","last_fullsized":"2024-09-10T08:39:28.515264+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:41.040015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513572+0000","last_change":"2024-09-10T08:39:26.526770+0000","last_active":"2024-09-10T08:39:28.513572+0000","last_peered":"2024-09-10T08:39:28.513572+0000","last_clean":"2024-09-10T08:39:28.513572+0000","last_became_active":"2024-09-10T08:39:26.526400+0000","last_became_peered":"2024-09-10T08:39:26.526400+0000","last_unstale":"2024-09-10T08:39:28.513572+0000","last_undegraded":"2024-09-10T08:39:28.513572+0000","last_fullsized":"2024-09-10T08:39:28.513572+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:13.453611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658716+0000","last_change":"2024-09-10T08:39:27.530842+0000","last_active":"2024-09-10T08:39:28.658716+0000","last_peered":"2024-09-10T08:39:28.658716+0000","last_clean":"2024-09-10T08:39:28.658716+0000","last_became_active":"2024-09-10T08:39:27.530137+0000","last_became_peered":"2024-09-10T08:39:27.530137+0000","last_unstale":"2024-09-10T08:39:28.658716+0000","last_undegraded":"2024-09-10T08:39:28.658716+0000","last_fullsized":"2024-09-10T08:39:28.658716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:37.975439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515377+0000","last_change":"2024-09-10T08:39:26.530571+0000","last_active":"2024-09-10T08:39:28.515377+0000","last_peered":"2024-09-10T08:39:28.515377+0000","last_clean":"2024-09-10T08:39:28.515377+0000","last_became_active":"2024-09-10T08:39:26.530235+0000","last_became_peered":"2024-09-10T08:39:26.530235+0000","last_unstale":"2024-09-10T08:39:28.515377+0000","last_undegraded":"2024-09-10T08:39:28.515377+0000","last_fullsized":"2024-09-10T08:39:28.515377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:47.155094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514795+0000","last_change":"2024-09-10T08:39:27.535987+0000","last_active":"2024-09-10T08:39:28.514795+0000","last_peered":"2024-09-10T08:39:28.514795+0000","last_clean":"2024-09-10T08:39:28.514795+0000","last_became_active":"2024-09-10T08:39:27.535681+0000","last_became_peered":"2024-09-10T08:39:27.535681+0000","last_unstale":"2024-09-10T08:39:28.514795+0000","last_undegraded":"2024-09-10T08:39:28.514795+0000","last_fullsized":"2024-09-10T08:39:28.514795+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:44.535753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513149+0000","last_change":"2024-09-10T08:39:26.516772+0000","last_active":"2024-09-10T08:39:28.513149+0000","last_peered":"2024-09-10T08:39:28.513149+0000","last_clean":"2024-09-10T08:39:28.513149+0000","last_became_active":"2024-09-10T08:39:26.516511+0000","last_became_peered":"2024-09-10T08:39:26.516511+0000","last_unstale":"2024-09-10T08:39:28.513149+0000","last_undegraded":"2024-09-10T08:39:28.513149+0000","last_fullsized":"2024-09-10T08:39:28.513149+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:28.600670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515242+0000","last_change":"2024-09-10T08:39:27.544528+0000","last_active":"2024-09-10T08:39:28.515242+0000","last_peered":"2024-09-10T08:39:28.515242+0000","last_clean":"2024-09-10T08:39:28.515242+0000","last_became_active":"2024-09-10T08:39:27.543478+0000","last_became_peered":"2024-09-10T08:39:27.543478+0000","last_unstale":"2024-09-10T08:39:28.515242+0000","last_undegraded":"2024-09-10T08:39:28.515242+0000","last_fullsized":"2024-09-10T08:39:28.515242+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:23.868785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515040+0000","last_change":"2024-09-10T08:39:26.521773+0000","last_active":"2024-09-10T08:39:28.515040+0000","last_peered":"2024-09-10T08:39:28.515040+0000","last_clean":"2024-09-10T08:39:28.515040+0000","last_became_active":"2024-09-10T08:39:26.521471+0000","last_became_peered":"2024-09-10T08:39:26.521471+0000","last_unstale":"2024-09-10T08:39:28.515040+0000","last_undegraded":"2024-09-10T08:39:28.515040+0000","last_fullsized":"2024-09-10T08:39:28.515040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:03:34.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657919+0000","last_change":"2024-09-10T08:39:27.537243+0000","last_active":"2024-09-10T08:39:28.657919+0000","last_peered":"2024-09-10T08:39:28.657919+0000","last_clean":"2024-09-10T08:39:28.657919+0000","last_became_active":"2024-09-10T08:39:27.536972+0000","last_became_peered":"2024-09-10T08:39:27.536972+0000","last_unstale":"2024-09-10T08:39:28.657919+0000","last_undegraded":"2024-09-10T08:39:28.657919+0000","last_fullsized":"2024-09-10T08:39:28.657919+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:16.165520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658814+0000","last_change":"2024-09-10T08:39:26.532875+0000","last_active":"2024-09-10T08:39:28.658814+0000","last_peered":"2024-09-10T08:39:28.658814+0000","last_clean":"2024-09-10T08:39:28.658814+0000","last_became_active":"2024-09-10T08:39:26.532482+0000","last_became_peered":"2024-09-10T08:39:26.532482+0000","last_unstale":"2024-09-10T08:39:28.658814+0000","last_undegraded":"2024-09-10T08:39:28.658814+0000","last_fullsized":"2024-09-10T08:39:28.658814+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:26.048354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658024+0000","last_change":"2024-09-10T08:39:27.535782+0000","last_active":"2024-09-10T08:39:28.658024+0000","last_peered":"2024-09-10T08:39:28.658024+0000","last_clean":"2024-09-10T08:39:28.658024+0000","last_became_active":"2024-09-10T08:39:27.535494+0000","last_became_peered":"2024-09-10T08:39:27.535494+0000","last_unstale":"2024-09-10T08:39:28.658024+0000","last_undegraded":"2024-09-10T08:39:28.658024+0000","last_fullsized":"2024-09-10T08:39:28.658024+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:48.158149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"157'3","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516101+0000","last_change":"2024-09-10T08:39:26.529604+0000","last_active":"2024-09-10T08:39:28.516101+0000","last_peered":"2024-09-10T08:39:28.516101+0000","last_clean":"2024-09-10T08:39:28.516101+0000","last_became_active":"2024-09-10T08:39:26.529328+0000","last_became_peered":"2024-09-10T08:39:26.529328+0000","last_unstale":"2024-09-10T08:39:28.516101+0000","last_undegraded":"2024-09-10T08:39:28.516101+0000","last_fullsized":"2024-09-10T08:39:28.516101+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:43.508175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513315+0000","last_change":"2024-09-10T08:39:27.538509+0000","last_active":"2024-09-10T08:39:28.513315+0000","last_peered":"2024-09-10T08:39:28.513315+0000","last_clean":"2024-09-10T08:39:28.513315+0000","last_became_active":"2024-09-10T08:39:27.537890+0000","last_became_peered":"2024-09-10T08:39:27.537890+0000","last_unstale":"2024-09-10T08:39:28.513315+0000","last_undegraded":"2024-09-10T08:39:28.513315+0000","last_fullsized":"2024-09-10T08:39:28.513315+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:53.949906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"157'6","reported_seq":20,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658347+0000","last_change":"2024-09-10T08:39:26.529009+0000","last_active":"2024-09-10T08:39:28.658347+0000","last_peered":"2024-09-10T08:39:28.658347+0000","last_clean":"2024-09-10T08:39:28.658347+0000","last_became_active":"2024-09-10T08:39:26.528709+0000","last_became_peered":"2024-09-10T08:39:26.528709+0000","last_unstale":"2024-09-10T08:39:28.658347+0000","last_undegraded":"2024-09-10T08:39:28.658347+0000","last_fullsized":"2024-09-10T08:39:28.658347+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:37:32.492071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657558+0000","last_change":"2024-09-10T08:39:27.533804+0000","last_active":"2024-09-10T08:39:28.657558+0000","last_peered":"2024-09-10T08:39:28.657558+0000","last_clean":"2024-09-10T08:39:28.657558+0000","last_became_active":"2024-09-10T08:39:27.533528+0000","last_became_peered":"2024-09-10T08:39:27.533528+0000","last_unstale":"2024-09-10T08:39:28.657558+0000","last_undegraded":"2024-09-10T08:39:28.657558+0000","last_fullsized":"2024-09-10T08:39:28.657558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:12.765175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515243+0000","last_change":"2024-09-10T08:39:26.525912+0000","last_active":"2024-09-10T08:39:28.515243+0000","last_peered":"2024-09-10T08:39:28.515243+0000","last_clean":"2024-09-10T08:39:28.515243+0000","last_became_active":"2024-09-10T08:39:26.525586+0000","last_became_peered":"2024-09-10T08:39:26.525586+0000","last_unstale":"2024-09-10T08:39:28.515243+0000","last_undegraded":"2024-09-10T08:39:28.515243+0000","last_fullsized":"2024-09-10T08:39:28.515243+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:28.159184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515801+0000","last_change":"2024-09-10T08:39:27.540311+0000","last_active":"2024-09-10T08:39:28.515801+0000","last_peered":"2024-09-10T08:39:28.515801+0000","last_clean":"2024-09-10T08:39:28.515801+0000","last_became_active":"2024-09-10T08:39:27.539999+0000","last_became_peered":"2024-09-10T08:39:27.539999+0000","last_unstale":"2024-09-10T08:39:28.515801+0000","last_undegraded":"2024-09-10T08:39:28.515801+0000","last_fullsized":"2024-09-10T08:39:28.515801+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:28.388913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658542+0000","last_change":"2024-09-10T08:39:26.529841+0000","last_active":"2024-09-10T08:39:28.658542+0000","last_peered":"2024-09-10T08:39:28.658542+0000","last_clean":"2024-09-10T08:39:28.658542+0000","last_became_active":"2024-09-10T08:39:26.528567+0000","last_became_peered":"2024-09-10T08:39:26.528567+0000","last_unstale":"2024-09-10T08:39:28.658542+0000","last_undegraded":"2024-09-10T08:39:28.658542+0000","last_fullsized":"2024-09-10T08:39:28.658542+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:58.355313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658689+0000","last_change":"2024-09-10T08:39:27.525515+0000","last_active":"2024-09-10T08:39:28.658689+0000","last_peered":"2024-09-10T08:39:28.658689+0000","last_clean":"2024-09-10T08:39:28.658689+0000","last_became_active":"2024-09-10T08:39:27.525240+0000","last_became_peered":"2024-09-10T08:39:27.525240+0000","last_unstale":"2024-09-10T08:39:28.658689+0000","last_undegraded":"2024-09-10T08:39:28.658689+0000","last_fullsized":"2024-09-10T08:39:28.658689+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:27.396246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658065+0000","last_change":"2024-09-10T08:39:26.527007+0000","last_active":"2024-09-10T08:39:28.658065+0000","last_peered":"2024-09-10T08:39:28.658065+0000","last_clean":"2024-09-10T08:39:28.658065+0000","last_became_active":"2024-09-10T08:39:26.526734+0000","last_became_peered":"2024-09-10T08:39:26.526734+0000","last_unstale":"2024-09-10T08:39:28.658065+0000","last_undegraded":"2024-09-10T08:39:28.658065+0000","last_fullsized":"2024-09-10T08:39:28.658065+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:28.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659026+0000","last_change":"2024-09-10T08:39:27.535588+0000","last_active":"2024-09-10T08:39:28.659026+0000","last_peered":"2024-09-10T08:39:28.659026+0000","last_clean":"2024-09-10T08:39:28.659026+0000","last_became_active":"2024-09-10T08:39:27.535331+0000","last_became_peered":"2024-09-10T08:39:27.535331+0000","last_unstale":"2024-09-10T08:39:28.659026+0000","last_undegraded":"2024-09-10T08:39:28.659026+0000","last_fullsized":"2024-09-10T08:39:28.659026+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:03:39.496861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"157'8","reported_seq":22,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657501+0000","last_change":"2024-09-10T08:39:26.533753+0000","last_active":"2024-09-10T08:39:28.657501+0000","last_peered":"2024-09-10T08:39:28.657501+0000","last_clean":"2024-09-10T08:39:28.657501+0000","last_became_active":"2024-09-10T08:39:26.533494+0000","last_became_peered":"2024-09-10T08:39:26.533494+0000","last_unstale":"2024-09-10T08:39:28.657501+0000","last_undegraded":"2024-09-10T08:39:28.657501+0000","last_fullsized":"2024-09-10T08:39:28.657501+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:39.225823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657815+0000","last_change":"2024-09-10T08:39:27.547013+0000","last_active":"2024-09-10T08:39:28.657815+0000","last_peered":"2024-09-10T08:39:28.657815+0000","last_clean":"2024-09-10T08:39:28.657815+0000","last_became_active":"2024-09-10T08:39:27.546732+0000","last_became_peered":"2024-09-10T08:39:27.546732+0000","last_unstale":"2024-09-10T08:39:28.657815+0000","last_undegraded":"2024-09-10T08:39:28.657815+0000","last_fullsized":"2024-09-10T08:39:28.657815+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:57.269695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658741+0000","last_change":"2024-09-10T08:39:26.532174+0000","last_active":"2024-09-10T08:39:28.658741+0000","last_peered":"2024-09-10T08:39:28.658741+0000","last_clean":"2024-09-10T08:39:28.658741+0000","last_became_active":"2024-09-10T08:39:26.531527+0000","last_became_peered":"2024-09-10T08:39:26.531527+0000","last_unstale":"2024-09-10T08:39:28.658741+0000","last_undegraded":"2024-09-10T08:39:28.658741+0000","last_fullsized":"2024-09-10T08:39:28.658741+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:46.936285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516352+0000","last_change":"2024-09-10T08:39:27.542856+0000","last_active":"2024-09-10T08:39:28.516352+0000","last_peered":"2024-09-10T08:39:28.516352+0000","last_clean":"2024-09-10T08:39:28.516352+0000","last_became_active":"2024-09-10T08:39:27.541313+0000","last_became_peered":"2024-09-10T08:39:27.541313+0000","last_unstale":"2024-09-10T08:39:28.516352+0000","last_undegraded":"2024-09-10T08:39:28.516352+0000","last_fullsized":"2024-09-10T08:39:28.516352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:20.648177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.659391+0000","last_change":"2024-09-10T08:39:26.527172+0000","last_active":"2024-09-10T08:39:28.659391+0000","last_peered":"2024-09-10T08:39:28.659391+0000","last_clean":"2024-09-10T08:39:28.659391+0000","last_became_active":"2024-09-10T08:39:26.526915+0000","last_became_peered":"2024-09-10T08:39:26.526915+0000","last_unstale":"2024-09-10T08:39:28.659391+0000","last_undegraded":"2024-09-10T08:39:28.659391+0000","last_fullsized":"2024-09-10T08:39:28.659391+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:26.048354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515593+0000","last_change":"2024-09-10T08:39:27.544468+0000","last_active":"2024-09-10T08:39:28.515593+0000","last_peered":"2024-09-10T08:39:28.515593+0000","last_clean":"2024-09-10T08:39:28.515593+0000","last_became_active":"2024-09-10T08:39:27.544029+0000","last_became_peered":"2024-09-10T08:39:27.544029+0000","last_unstale":"2024-09-10T08:39:28.515593+0000","last_undegraded":"2024-09-10T08:39:28.515593+0000","last_fullsized":"2024-09-10T08:39:28.515593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:06.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"157'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658783+0000","last_change":"2024-09-10T08:39:26.534265+0000","last_active":"2024-09-10T08:39:28.658783+0000","last_peered":"2024-09-10T08:39:28.658783+0000","last_clean":"2024-09-10T08:39:28.658783+0000","last_became_active":"2024-09-10T08:39:26.533953+0000","last_became_peered":"2024-09-10T08:39:26.533953+0000","last_unstale":"2024-09-10T08:39:28.658783+0000","last_undegraded":"2024-09-10T08:39:28.658783+0000","last_fullsized":"2024-09-10T08:39:28.658783+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:05.211784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516034+0000","last_change":"2024-09-10T08:39:27.538431+0000","last_active":"2024-09-10T08:39:28.516034+0000","last_peered":"2024-09-10T08:39:28.516034+0000","last_clean":"2024-09-10T08:39:28.516034+0000","last_became_active":"2024-09-10T08:39:27.538169+0000","last_became_peered":"2024-09-10T08:39:27.538169+0000","last_unstale":"2024-09-10T08:39:28.516034+0000","last_undegraded":"2024-09-10T08:39:28.516034+0000","last_fullsized":"2024-09-10T08:39:28.516034+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:06.996253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658902+0000","last_change":"2024-09-10T08:39:26.526866+0000","last_active":"2024-09-10T08:39:28.658902+0000","last_peered":"2024-09-10T08:39:28.658902+0000","last_clean":"2024-09-10T08:39:28.658902+0000","last_became_active":"2024-09-10T08:39:26.526521+0000","last_became_peered":"2024-09-10T08:39:26.526521+0000","last_unstale":"2024-09-10T08:39:28.658902+0000","last_undegraded":"2024-09-10T08:39:28.658902+0000","last_fullsized":"2024-09-10T08:39:28.658902+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:34.075074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513081+0000","last_change":"2024-09-10T08:39:27.535073+0000","last_active":"2024-09-10T08:39:28.513081+0000","last_peered":"2024-09-10T08:39:28.513081+0000","last_clean":"2024-09-10T08:39:28.513081+0000","last_became_active":"2024-09-10T08:39:27.534746+0000","last_became_peered":"2024-09-10T08:39:27.534746+0000","last_unstale":"2024-09-10T08:39:28.513081+0000","last_undegraded":"2024-09-10T08:39:28.513081+0000","last_fullsized":"2024-09-10T08:39:28.513081+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:31:29.027285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515996+0000","last_change":"2024-09-10T08:39:26.524857+0000","last_active":"2024-09-10T08:39:28.515996+0000","last_peered":"2024-09-10T08:39:28.515996+0000","last_clean":"2024-09-10T08:39:28.515996+0000","last_became_active":"2024-09-10T08:39:26.524524+0000","last_became_peered":"2024-09-10T08:39:26.524524+0000","last_unstale":"2024-09-10T08:39:28.515996+0000","last_undegraded":"2024-09-10T08:39:28.515996+0000","last_fullsized":"2024-09-10T08:39:28.515996+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:07:53.677623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515953+0000","last_change":"2024-09-10T08:39:27.540578+0000","last_active":"2024-09-10T08:39:28.515953+0000","last_peered":"2024-09-10T08:39:28.515953+0000","last_clean":"2024-09-10T08:39:28.515953+0000","last_became_active":"2024-09-10T08:39:27.540066+0000","last_became_peered":"2024-09-10T08:39:27.540066+0000","last_unstale":"2024-09-10T08:39:28.515953+0000","last_undegraded":"2024-09-10T08:39:28.515953+0000","last_fullsized":"2024-09-10T08:39:28.515953+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:01.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658876+0000","last_change":"2024-09-10T08:39:26.530765+0000","last_active":"2024-09-10T08:39:28.658876+0000","last_peered":"2024-09-10T08:39:28.658876+0000","last_clean":"2024-09-10T08:39:28.658876+0000","last_became_active":"2024-09-10T08:39:26.530426+0000","last_became_peered":"2024-09-10T08:39:26.530426+0000","last_unstale":"2024-09-10T08:39:28.658876+0000","last_undegraded":"2024-09-10T08:39:28.658876+0000","last_fullsized":"2024-09-10T08:39:28.658876+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:31.598945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512868+0000","last_change":"2024-09-10T08:39:27.525021+0000","last_active":"2024-09-10T08:39:28.512868+0000","last_peered":"2024-09-10T08:39:28.512868+0000","last_clean":"2024-09-10T08:39:28.512868+0000","last_became_active":"2024-09-10T08:39:27.524415+0000","last_became_peered":"2024-09-10T08:39:27.524415+0000","last_unstale":"2024-09-10T08:39:28.512868+0000","last_undegraded":"2024-09-10T08:39:28.512868+0000","last_fullsized":"2024-09-10T08:39:28.512868+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:43.485508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.514986+0000","last_change":"2024-09-10T08:39:26.532659+0000","last_active":"2024-09-10T08:39:28.514986+0000","last_peered":"2024-09-10T08:39:28.514986+0000","last_clean":"2024-09-10T08:39:28.514986+0000","last_became_active":"2024-09-10T08:39:26.532194+0000","last_became_peered":"2024-09-10T08:39:26.532194+0000","last_unstale":"2024-09-10T08:39:28.514986+0000","last_undegraded":"2024-09-10T08:39:28.514986+0000","last_fullsized":"2024-09-10T08:39:28.514986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:42.482452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657620+0000","last_change":"2024-09-10T08:39:27.545178+0000","last_active":"2024-09-10T08:39:28.657620+0000","last_peered":"2024-09-10T08:39:28.657620+0000","last_clean":"2024-09-10T08:39:28.657620+0000","last_became_active":"2024-09-10T08:39:27.544896+0000","last_became_peered":"2024-09-10T08:39:27.544896+0000","last_unstale":"2024-09-10T08:39:28.657620+0000","last_undegraded":"2024-09-10T08:39:28.657620+0000","last_fullsized":"2024-09-10T08:39:28.657620+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:54:18.048869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657868+0000","last_change":"2024-09-10T08:39:26.524836+0000","last_active":"2024-09-10T08:39:28.657868+0000","last_peered":"2024-09-10T08:39:28.657868+0000","last_clean":"2024-09-10T08:39:28.657868+0000","last_became_active":"2024-09-10T08:39:26.524568+0000","last_became_peered":"2024-09-10T08:39:26.524568+0000","last_unstale":"2024-09-10T08:39:28.657868+0000","last_undegraded":"2024-09-10T08:39:28.657868+0000","last_fullsized":"2024-09-10T08:39:28.657868+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:13:19.645121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516468+0000","last_change":"2024-09-10T08:39:27.543481+0000","last_active":"2024-09-10T08:39:28.516468+0000","last_peered":"2024-09-10T08:39:28.516468+0000","last_clean":"2024-09-10T08:39:28.516468+0000","last_became_active":"2024-09-10T08:39:27.543010+0000","last_became_peered":"2024-09-10T08:39:27.543010+0000","last_unstale":"2024-09-10T08:39:28.516468+0000","last_undegraded":"2024-09-10T08:39:28.516468+0000","last_fullsized":"2024-09-10T08:39:28.516468+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:32.739085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"157'2","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658807+0000","last_change":"2024-09-10T08:39:26.527899+0000","last_active":"2024-09-10T08:39:28.658807+0000","last_peered":"2024-09-10T08:39:28.658807+0000","last_clean":"2024-09-10T08:39:28.658807+0000","last_became_active":"2024-09-10T08:39:26.527493+0000","last_became_peered":"2024-09-10T08:39:26.527493+0000","last_unstale":"2024-09-10T08:39:28.658807+0000","last_undegraded":"2024-09-10T08:39:28.658807+0000","last_fullsized":"2024-09-10T08:39:28.658807+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:54.936048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516352+0000","last_change":"2024-09-10T08:39:27.532781+0000","last_active":"2024-09-10T08:39:28.516352+0000","last_peered":"2024-09-10T08:39:28.516352+0000","last_clean":"2024-09-10T08:39:28.516352+0000","last_became_active":"2024-09-10T08:39:27.532394+0000","last_became_peered":"2024-09-10T08:39:27.532394+0000","last_unstale":"2024-09-10T08:39:28.516352+0000","last_undegraded":"2024-09-10T08:39:28.516352+0000","last_fullsized":"2024-09-10T08:39:28.516352+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:32.602001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"158'1","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:29.521546+0000","last_change":"2024-09-10T08:39:26.532409+0000","last_active":"2024-09-10T08:39:29.521546+0000","last_peered":"2024-09-10T08:39:29.521546+0000","last_clean":"2024-09-10T08:39:29.521546+0000","last_became_active":"2024-09-10T08:39:26.531746+0000","last_became_peered":"2024-09-10T08:39:26.531746+0000","last_unstale":"2024-09-10T08:39:29.521546+0000","last_undegraded":"2024-09-10T08:39:29.521546+0000","last_fullsized":"2024-09-10T08:39:29.521546+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:05.910155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515828+0000","last_change":"2024-09-10T08:39:27.541150+0000","last_active":"2024-09-10T08:39:28.515828+0000","last_peered":"2024-09-10T08:39:28.515828+0000","last_clean":"2024-09-10T08:39:28.515828+0000","last_became_active":"2024-09-10T08:39:27.540859+0000","last_became_peered":"2024-09-10T08:39:27.540859+0000","last_unstale":"2024-09-10T08:39:28.515828+0000","last_undegraded":"2024-09-10T08:39:28.515828+0000","last_fullsized":"2024-09-10T08:39:28.515828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:31:44.824435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513407+0000","last_change":"2024-09-10T08:39:26.528920+0000","last_active":"2024-09-10T08:39:28.513407+0000","last_peered":"2024-09-10T08:39:28.513407+0000","last_clean":"2024-09-10T08:39:28.513407+0000","last_became_active":"2024-09-10T08:39:26.527792+0000","last_became_peered":"2024-09-10T08:39:26.527792+0000","last_unstale":"2024-09-10T08:39:28.513407+0000","last_undegraded":"2024-09-10T08:39:28.513407+0000","last_fullsized":"2024-09-10T08:39:28.513407+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:46.311858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.515108+0000","last_change":"2024-09-10T08:39:27.534872+0000","last_active":"2024-09-10T08:39:28.515108+0000","last_peered":"2024-09-10T08:39:28.515108+0000","last_clean":"2024-09-10T08:39:28.515108+0000","last_became_active":"2024-09-10T08:39:27.533287+0000","last_became_peered":"2024-09-10T08:39:27.533287+0000","last_unstale":"2024-09-10T08:39:28.515108+0000","last_undegraded":"2024-09-10T08:39:28.515108+0000","last_fullsized":"2024-09-10T08:39:28.515108+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:42:36.053139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.516076+0000","last_change":"2024-09-10T08:39:26.525321+0000","last_active":"2024-09-10T08:39:28.516076+0000","last_peered":"2024-09-10T08:39:28.516076+0000","last_clean":"2024-09-10T08:39:28.516076+0000","last_became_active":"2024-09-10T08:39:26.522673+0000","last_became_peered":"2024-09-10T08:39:26.522673+0000","last_unstale":"2024-09-10T08:39:28.516076+0000","last_undegraded":"2024-09-10T08:39:28.516076+0000","last_fullsized":"2024-09-10T08:39:28.516076+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:38.419860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658713+0000","last_change":"2024-09-10T08:39:27.531679+0000","last_active":"2024-09-10T08:39:28.658713+0000","last_peered":"2024-09-10T08:39:28.658713+0000","last_clean":"2024-09-10T08:39:28.658713+0000","last_became_active":"2024-09-10T08:39:27.531393+0000","last_became_peered":"2024-09-10T08:39:27.531393+0000","last_unstale":"2024-09-10T08:39:28.658713+0000","last_undegraded":"2024-09-10T08:39:28.658713+0000","last_fullsized":"2024-09-10T08:39:28.658713+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:20:39.090666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658220+0000","last_change":"2024-09-10T08:39:26.532828+0000","last_active":"2024-09-10T08:39:28.658220+0000","last_peered":"2024-09-10T08:39:28.658220+0000","last_clean":"2024-09-10T08:39:28.658220+0000","last_became_active":"2024-09-10T08:39:26.532547+0000","last_became_peered":"2024-09-10T08:39:26.532547+0000","last_unstale":"2024-09-10T08:39:28.658220+0000","last_undegraded":"2024-09-10T08:39:28.658220+0000","last_fullsized":"2024-09-10T08:39:28.658220+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:47:41.988164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512928+0000","last_change":"2024-09-10T08:39:27.540225+0000","last_active":"2024-09-10T08:39:28.512928+0000","last_peered":"2024-09-10T08:39:28.512928+0000","last_clean":"2024-09-10T08:39:28.512928+0000","last_became_active":"2024-09-10T08:39:27.539864+0000","last_became_peered":"2024-09-10T08:39:27.539864+0000","last_unstale":"2024-09-10T08:39:28.512928+0000","last_undegraded":"2024-09-10T08:39:28.512928+0000","last_fullsized":"2024-09-10T08:39:28.512928+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:29.162240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657662+0000","last_change":"2024-09-10T08:39:26.532581+0000","last_active":"2024-09-10T08:39:28.657662+0000","last_peered":"2024-09-10T08:39:28.657662+0000","last_clean":"2024-09-10T08:39:28.657662+0000","last_became_active":"2024-09-10T08:39:26.531911+0000","last_became_peered":"2024-09-10T08:39:26.531911+0000","last_unstale":"2024-09-10T08:39:28.657662+0000","last_undegraded":"2024-09-10T08:39:28.657662+0000","last_fullsized":"2024-09-10T08:39:28.657662+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:04.496755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657679+0000","last_change":"2024-09-10T08:39:27.537373+0000","last_active":"2024-09-10T08:39:28.657679+0000","last_peered":"2024-09-10T08:39:28.657679+0000","last_clean":"2024-09-10T08:39:28.657679+0000","last_became_active":"2024-09-10T08:39:27.537078+0000","last_became_peered":"2024-09-10T08:39:27.537078+0000","last_unstale":"2024-09-10T08:39:28.657679+0000","last_undegraded":"2024-09-10T08:39:28.657679+0000","last_fullsized":"2024-09-10T08:39:28.657679+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:04.123364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.513244+0000","last_change":"2024-09-10T08:39:26.523231+0000","last_active":"2024-09-10T08:39:28.513244+0000","last_peered":"2024-09-10T08:39:28.513244+0000","last_clean":"2024-09-10T08:39:28.513244+0000","last_became_active":"2024-09-10T08:39:26.522323+0000","last_became_peered":"2024-09-10T08:39:26.522323+0000","last_unstale":"2024-09-10T08:39:28.513244+0000","last_undegraded":"2024-09-10T08:39:28.513244+0000","last_fullsized":"2024-09-10T08:39:28.513244+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:58.930924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512876+0000","last_change":"2024-09-10T08:39:27.539919+0000","last_active":"2024-09-10T08:39:28.512876+0000","last_peered":"2024-09-10T08:39:28.512876+0000","last_clean":"2024-09-10T08:39:28.512876+0000","last_became_active":"2024-09-10T08:39:27.539563+0000","last_became_peered":"2024-09-10T08:39:27.539563+0000","last_unstale":"2024-09-10T08:39:28.512876+0000","last_undegraded":"2024-09-10T08:39:28.512876+0000","last_fullsized":"2024-09-10T08:39:28.512876+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:48.158149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.512811+0000","last_change":"2024-09-10T08:39:26.525677+0000","last_active":"2024-09-10T08:39:28.512811+0000","last_peered":"2024-09-10T08:39:28.512811+0000","last_clean":"2024-09-10T08:39:28.512811+0000","last_became_active":"2024-09-10T08:39:26.525392+0000","last_became_peered":"2024-09-10T08:39:26.525392+0000","last_unstale":"2024-09-10T08:39:28.512811+0000","last_undegraded":"2024-09-10T08:39:28.512811+0000","last_fullsized":"2024-09-10T08:39:28.512811+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:31:11.371973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657780+0000","last_change":"2024-09-10T08:39:27.544214+0000","last_active":"2024-09-10T08:39:28.657780+0000","last_peered":"2024-09-10T08:39:28.657780+0000","last_clean":"2024-09-10T08:39:28.657780+0000","last_became_active":"2024-09-10T08:39:27.543911+0000","last_became_peered":"2024-09-10T08:39:27.543911+0000","last_unstale":"2024-09-10T08:39:28.657780+0000","last_undegraded":"2024-09-10T08:39:28.657780+0000","last_fullsized":"2024-09-10T08:39:28.657780+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:26.500142+0000","last_clean_scrub_stamp":"2024-09-10T08:39:26.500142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:47:24.607999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.658643+0000","last_change":"2024-09-10T08:39:26.532402+0000","last_active":"2024-09-10T08:39:28.658643+0000","last_peered":"2024-09-10T08:39:28.658643+0000","last_clean":"2024-09-10T08:39:28.658643+0000","last_became_active":"2024-09-10T08:39:26.531874+0000","last_became_peered":"2024-09-10T08:39:26.531874+0000","last_unstale":"2024-09-10T08:39:28.658643+0000","last_undegraded":"2024-09-10T08:39:28.658643+0000","last_fullsized":"2024-09-10T08:39:28.658643+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:39:25.497086+0000","last_clean_scrub_stamp":"2024-09-10T08:39:25.497086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:01.810700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":417,"reported_epoch":158,"state":"active+clean","last_fresh":"2024-09-10T08:39:28.657566+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:39:28.657566+0000","last_peered":"2024-09-10T08:39:28.657566+0000","last_clean":"2024-09-10T08:39:28.657566+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:39:28.657566+0000","last_undegraded":"2024-09-10T08:39:28.657566+0000","last_fullsized":"2024-09-10T08:39:28.657566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28960,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342880,"statfs":{"total":96636764160,"available":96607109120,"internally_reserved":0,"allocated":1974272,"data_stored":866781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509574,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":1978368,"data_stored":866815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509573,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55332,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316508,"statfs":{"total":96636764160,"available":96580104192,"internally_reserved":0,"allocated":1978368,"data_stored":866815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509574,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59508,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312332,"statfs":{"total":96636764160,"available":96575827968,"internally_reserved":0,"allocated":1990656,"data_stored":868415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509575,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59496,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312344,"statfs":{"total":96636764160,"available":96575840256,"internally_reserved":0,"allocated":1978368,"data_stored":867363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509574,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55932,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315908,"statfs":{"total":96636764160,"available":96579489792,"internally_reserved":0,"allocated":2592768,"data_stored":1458943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51168,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320672,"statfs":{"total":96636764160,"available":96584368128,"internally_reserved":0,"allocated":1978368,"data_stored":866851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542277,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2564096,"data_stored":1451521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:39:32.157 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:39:32.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.356+0000 7efce2e00640 1 Processor -- start 2024-09-10T08:39:32.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.356+0000 7efce2e00640 1 -- start start 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.357+0000 7efce2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcdc15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.357+0000 7efce2e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efcdc0714f0 0x7efcdc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.357+0000 7efce2e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcdc15cf80 con 0x7efcdc072240 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.357+0000 7efce2e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efcdc072be0 con 0x7efcdc0714f0 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.357+0000 7efce2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efcdc071b10 con 0x7efcdc0d0730 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efce1000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efcdc072240 0x7efcdc070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41800/0 (socket says 172.21.15.52:41800) 2024-09-10T08:39:32.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efce1000640 1 -- 172.21.15.52:0/2743241027 learned_addr learned my addr 172.21.15.52:0/2743241027 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efce2400640 1 --2- 172.21.15.52:0/2743241027 >> v2:172.21.15.176:3300/0 conn(0x7efcdc0714f0 0x7efcdc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efce1a00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcdc15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438808233 0 0) 0x7efcdc15cf80 con 0x7efcdc072240 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc4003520 con 0x7efcdc072240 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3090908412 0 0) 0x7efcc4003520 con 0x7efcdc072240 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 msgr2=0x7efcdc15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcdc15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 >> v2:172.21.15.176:3300/0 conn(0x7efcdc0714f0 msgr2=0x7efcdc0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.358+0000 7efcdbe00640 1 --2- 172.21.15.52:0/2743241027 >> v2:172.21.15.176:3300/0 conn(0x7efcdc0714f0 0x7efcdc0726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc071df0 con 0x7efcdc072240 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7efcc8001690 con 0x7efcdc072240 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 >> v1:172.21.15.52:6789/0 conn(0x7efcdc072240 legacy=0x7efcdc070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcc40039b0 0x7efcc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc4004d40 0x7efcc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc072be0 con 0x7efcc40039b0 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc071b10 con 0x7efcc4004d40 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efcc400dbd0 con 0x7efcdc0d0730 2024-09-10T08:39:32.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcc40039b0 0x7efcc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1000640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce2400640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc4004d40 0x7efcc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 -- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 msgr2=0x7efcc4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0d0730 0x7efcc4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 -- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc4004d40 msgr2=0x7efcc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc4004d40 0x7efcc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.359+0000 7efce1a00640 1 -- 172.21.15.52:0/2743241027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc4003520 con 0x7efcc40039b0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.360+0000 7efce1a00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcc40039b0 0x7efcc4003dd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efcc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d07f91878c6f09b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.360+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0036070 con 0x7efcc40039b0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.360+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd0031400 con 0x7efcc40039b0 2024-09-10T08:39:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.360+0000 7efcdbe00640 1 -- 172.21.15.52:0/2743241027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0009690 con 0x7efcc40039b0 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 -- 172.21.15.52:0/2743241027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcc40039b0 msgr2=0x7efcc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 --2- 172.21.15.52:0/2743241027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcc40039b0 0x7efcc4003dd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efcc4005830 comp rx=0 tx=0).stop 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2400640 1 -- 172.21.15.52:0/2743241027 reap_dead start 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 -- 172.21.15.52:0/2743241027 shutdown_connections 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 -- 172.21.15.52:0/2743241027 >> 172.21.15.52:0/2743241027 conn(0x7efcdc06bc10 msgr2=0x7efcdc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 -- 172.21.15.52:0/2743241027 shutdown_connections 2024-09-10T08:39:32.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.361+0000 7efce2e00640 1 -- 172.21.15.52:0/2743241027 wait complete. 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.363+0000 7efce2e00640 1 Processor -- start 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.363+0000 7efce2e00640 1 -- start start 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc40039b0 0x7efcdc0c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0aeae0 0x7efcdc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0d0b10 con 0x7efcdc0c5160 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc0b3670 con 0x7efcc40039b0 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efcdc15ca40 con 0x7efcdc0aeae0 2024-09-10T08:39:32.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54942/0 (socket says 172.21.15.52:54942) 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce1000640 1 -- 172.21.15.52:0/1569572207 learned_addr learned my addr 172.21.15.52:0/1569572207 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce2400640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0aeae0 0x7efcdc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.364+0000 7efce1a00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc40039b0 0x7efcdc0c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 -- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0aeae0 msgr2=0x7efcdc156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0aeae0 0x7efcdc156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 -- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc40039b0 msgr2=0x7efcdc0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc40039b0 0x7efcdc0c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 -- 172.21.15.52:0/1569572207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc1f4cc0 con 0x7efcdc0c5160 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce1000640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e840 tx=0x7efcc800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800c8d0 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8018070 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcdc072980 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800ccd0 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.365+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc15a510 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.366+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcdc15ce50 con 0x7efcdc0c5160 2024-09-10T08:39:32.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.367+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcc8013420 con 0x7efcdc0c5160 2024-09-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.368+0000 7efcd9600640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 0x7efcbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.368+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7efcc808aab0 con 0x7efcdc0c5160 2024-09-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.369+0000 7efce1a00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 0x7efcbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.370+0000 7efce1a00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 0x7efcbc06e320 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efcd0033000 tx=0x7efcd0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.372+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcc8059450 con 0x7efcdc0c5160 2024-09-10T08:39:32.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.623+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efcdc0730a0 con 0x7efcdc0c5160 2024-09-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.626+0000 7efcd9600640 1 -- 172.21.15.52:0/1569572207 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7efcc8058d50 con 0x7efcdc0c5160 2024-09-10T08:39:32.626 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:39:32.627 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:39:32.627 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:39:32.627 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:39:32.627 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:39:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 msgr2=0x7efcbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 0x7efcbc06e320 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efcd0033000 tx=0x7efcd0008030 comp rx=0 tx=0).stop 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 msgr2=0x7efcdc1f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e840 tx=0x7efcc800ed00 comp rx=0 tx=0).stop 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 shutdown_connections 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efcbc06be60 0x7efcbc06e320 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efcdc0aeae0 0x7efcdc156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcdc0c5160 0x7efcdc1f4780 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 --2- 172.21.15.52:0/1569572207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcc40039b0 0x7efcdc0c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 >> 172.21.15.52:0/1569572207 conn(0x7efcdc06bc10 msgr2=0x7efcdc0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 shutdown_connections 2024-09-10T08:39:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.628+0000 7efce2e00640 1 -- 172.21.15.52:0/1569572207 wait complete. 2024-09-10T08:39:32.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.801+0000 7fb50a600640 1 Processor -- start 2024-09-10T08:39:32.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.801+0000 7fb50a600640 1 -- start start 2024-09-10T08:39:32.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.802+0000 7fb50a600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb50406c320 0x7fb50415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.802+0000 7fb50a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb50413eb20 0x7fb50415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.802+0000 7fb50a600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb504071180 con 0x7fb5040b2d40 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.802+0000 7fb50a600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb504071ab0 con 0x7fb50413eb20 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.802+0000 7fb50a600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb504071460 con 0x7fb50406c320 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb50413eb20 0x7fb50415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb50413eb20 0x7fb50415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54952/0 (socket says 172.21.15.52:54952) 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 -- 172.21.15.52:0/3811988419 learned_addr learned my addr 172.21.15.52:0/3811988419 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb4fbe00640 1 --2- 172.21.15.52:0/3811988419 >> v2:172.21.15.176:3300/0 conn(0x7fb50406c320 0x7fb50415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 -- 172.21.15.52:0/3811988419 >> v2:172.21.15.176:3300/0 conn(0x7fb50406c320 msgr2=0x7fb50415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 --2- 172.21.15.52:0/3811988419 >> v2:172.21.15.176:3300/0 conn(0x7fb50406c320 0x7fb50415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 -- 172.21.15.52:0/3811988419 >> v1:172.21.15.176:6789/0 conn(0x7fb5040b2d40 legacy=0x7fb50406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.803+0000 7fb503e00640 1 -- 172.21.15.52:0/3811988419 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb504071740 con 0x7fb50413eb20 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.804+0000 7fb503e00640 1 --2- 172.21.15.52:0/3811988419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb50413eb20 0x7fb50415c230 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb5040d1500 tx=0x7fb4fc02a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adde265aefdaea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.804+0000 7fb502a00640 1 -- 172.21.15.52:0/3811988419 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc036070 con 0x7fb50413eb20 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb502a00640 1 -- 172.21.15.52:0/3811988419 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc031600 con 0x7fb50413eb20 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb502a00640 1 -- 172.21.15.52:0/3811988419 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0319d0 con 0x7fb50413eb20 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 -- 172.21.15.52:0/3811988419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb50413eb20 msgr2=0x7fb50415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 --2- 172.21.15.52:0/3811988419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb50413eb20 0x7fb50415c230 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb5040d1500 tx=0x7fb4fc02a740 comp rx=0 tx=0).stop 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 -- 172.21.15.52:0/3811988419 shutdown_connections 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 --2- 172.21.15.52:0/3811988419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb50413eb20 0x7fb50415c230 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 --2- 172.21.15.52:0/3811988419 >> v2:172.21.15.176:3300/0 conn(0x7fb50406c320 0x7fb50415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 -- 172.21.15.52:0/3811988419 >> 172.21.15.52:0/3811988419 conn(0x7fb5040ccec0 msgr2=0x7fb5040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 -- 172.21.15.52:0/3811988419 shutdown_connections 2024-09-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.805+0000 7fb50a600640 1 -- 172.21.15.52:0/3811988419 wait complete. 2024-09-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.807+0000 7fb50a600640 1 Processor -- start 2024-09-10T08:39:32.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.807+0000 7fb50a600640 1 -- start start 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50406c320 0x7fb5041f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 0x7fb5040cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040720c0 con 0x7fb5040b2d40 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb504071f40 con 0x7fb50406c320 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb50a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb504072240 con 0x7fb50413eb20 2024-09-10T08:39:32.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb4fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb4fbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54956/0 (socket says 172.21.15.52:54956) 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb4fbe00640 1 -- 172.21.15.52:0/591447838 learned_addr learned my addr 172.21.15.52:0/591447838 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb503e00640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 0x7fb5040cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.808+0000 7fb503400640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50406c320 0x7fb5041f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 -- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 msgr2=0x7fb5040cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 0x7fb5040cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 -- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50406c320 msgr2=0x7fb5041f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50406c320 0x7fb5041f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 -- 172.21.15.52:0/591447838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50415c4f0 con 0x7fb5040b2d40 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb503e00640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 0x7fb5040cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fbe00640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00d800 tx=0x7fb4ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00b6c0 con 0x7fb5040b2d40 2024-09-10T08:39:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec019070 con 0x7fb5040b2d40 2024-09-10T08:39:32.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00ba80 con 0x7fb5040b2d40 2024-09-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50415b970 con 0x7fb5040b2d40 2024-09-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.809+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb50415bf30 con 0x7fb5040b2d40 2024-09-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.810+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50406bc10 con 0x7fb5040b2d40 2024-09-10T08:39:32.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.811+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4ec00bc20 con 0x7fb5040b2d40 2024-09-10T08:39:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.812+0000 7fb4fb400640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 0x7fb4e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.813+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fb4ec08b390 con 0x7fb5040b2d40 2024-09-10T08:39:32.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.813+0000 7fb503400640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 0x7fb4e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:32.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.814+0000 7fb503400640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 0x7fb4e006e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4001640 tx=0x7fb4f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:32.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:32.817+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4ec059ca0 con 0x7fb5040b2d40 2024-09-10T08:39:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.039+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb504155920 con 0x7fb5040b2d40 2024-09-10T08:39:33.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.040+0000 7fb4fb400640 1 -- 172.21.15.52:0/591447838 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7fb4ec0595a0 con 0x7fb5040b2d40 2024-09-10T08:39:33.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:33.040 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 msgr2=0x7fb4e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 0x7fb4e006e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4001640 tx=0x7fb4f4009040 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 msgr2=0x7fb504154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00d800 tx=0x7fb4ec00dcc0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 shutdown_connections 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e006be30 0x7fb4e006e2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50413eb20 0x7fb5040cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5040b2d40 0x7fb504154530 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 --2- 172.21.15.52:0/591447838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50406c320 0x7fb5041f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 >> 172.21.15.52:0/591447838 conn(0x7fb5040ccec0 msgr2=0x7fb5041403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 shutdown_connections 2024-09-10T08:39:33.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.042+0000 7fb50a600640 1 -- 172.21.15.52:0/591447838 wait complete. 2024-09-10T08:39:33.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 119, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:39:26.940424+0000', 'modified': '2024-09-10T08:39:29.958210+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9297': {'gid': 9297, 'name': 'd', 'rank': 0, 'incarnation': 115, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6836/3781623740', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6834', 'nonce': 3781623740}, {'type': 'v1', 'addr': '172.21.15.176:6836', 'nonce': 3781623740}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9297, 'qdb_cluster': [9297]} 2024-09-10T08:39:33.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:39:33.462 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T08:39:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.621+0000 7fe6ce800640 1 Processor -- start 2024-09-10T08:39:33.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.622+0000 7fe6ce800640 1 -- start start 2024-09-10T08:39:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6ce800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe6c806c320 0x7fe6c815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6ce800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c8071180 con 0x7fe6c80b2d40 2024-09-10T08:39:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6ce800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c8071460 con 0x7fe6c813eb20 2024-09-10T08:39:33.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6ce800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c8071ab0 con 0x7fe6c806c320 2024-09-10T08:39:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6c7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe6c80b2d40 0x7fe6c806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:41812/0 (socket says 172.21.15.52:41812) 2024-09-10T08:39:33.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6c7400640 1 -- 172.21.15.52:0/778903974 learned_addr learned my addr 172.21.15.52:0/778903974 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/778903974 >> v2:172.21.15.176:3300/0 conn(0x7fe6c806c320 0x7fe6c815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801230470 0 0) 0x7fe6c8071180 con 0x7fe6c80b2d40 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.623+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ac003520 con 0x7fe6c80b2d40 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1615295094 0 0) 0x7fe6ac003520 con 0x7fe6c80b2d40 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 >> v2:172.21.15.176:3300/0 conn(0x7fe6c806c320 msgr2=0x7fe6c815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 --2- 172.21.15.52:0/778903974 >> v2:172.21.15.176:3300/0 conn(0x7fe6c806c320 0x7fe6c815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 >> v1:172.21.15.176:6789/0 conn(0x7fe6c813eb20 legacy=0x7fe6c815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c8071740 con 0x7fe6c80b2d40 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fe6b8001670 con 0x7fe6c80b2d40 2024-09-10T08:39:33.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 >> v1:172.21.15.52:6789/0 conn(0x7fe6c80b2d40 legacy=0x7fe6c806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0039b0 0x7fe6ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 0x7fe6ac004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6ac005080 0x7fe6ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8071ab0 con 0x7fe6ac0043b0 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac00bfe0 con 0x7fe6ac0039b0 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac00c1e0 con 0x7fe6ac005080 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 0x7fe6ac004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c7400640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0039b0 0x7fe6ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.624+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6ac005080 0x7fe6ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6bfe00640 1 -- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6ac005080 msgr2=0x7fe6ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6ac005080 0x7fe6ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6bfe00640 1 -- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0039b0 msgr2=0x7fe6ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0039b0 0x7fe6ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6bfe00640 1 -- 172.21.15.52:0/778903974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac003520 con 0x7fe6ac0043b0 2024-09-10T08:39:33.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6c7400640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0039b0 0x7fe6ac003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:33.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.625+0000 7fe6c7e00640 1 -- 172.21.15.52:0/778903974 reap_dead start 2024-09-10T08:39:33.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 0x7fe6ac004880 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009ac0 tx=0x7fe6ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a218b43d7f7c2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0036070 con 0x7fe6ac0043b0 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0031400 con 0x7fe6ac0043b0 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6c6a00640 1 -- 172.21.15.52:0/778903974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0009690 con 0x7fe6ac0043b0 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 -- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 msgr2=0x7fe6ac004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 0x7fe6ac004880 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009ac0 tx=0x7fe6ac005830 comp rx=0 tx=0).stop 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 -- 172.21.15.52:0/778903974 shutdown_connections 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 --2- 172.21.15.52:0/778903974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6ac0043b0 0x7fe6ac004880 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 -- 172.21.15.52:0/778903974 >> 172.21.15.52:0/778903974 conn(0x7fe6c80ccec0 msgr2=0x7fe6c80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 -- 172.21.15.52:0/778903974 shutdown_connections 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.626+0000 7fe6ce800640 1 -- 172.21.15.52:0/778903974 wait complete. 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.628+0000 7fe6ce800640 1 Processor -- start 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.628+0000 7fe6ce800640 1 -- start start 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0043b0 0x7fe6c8142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c8136eb0 0x7fe6c81f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c806bfa0 con 0x7fe6c8144200 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c806be20 con 0x7fe6ac0043b0 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6ce800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c806c120 con 0x7fe6c8136eb0 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54964/0 (socket says 172.21.15.52:54964) 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3125093744 learned_addr learned my addr 172.21.15.52:0/3125093744 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.629+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c8136eb0 0x7fe6c81f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7400640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0043b0 0x7fe6c8142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c8136eb0 msgr2=0x7fe6c81f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c8136eb0 0x7fe6c81f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0043b0 msgr2=0x7fe6c8142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0043b0 0x7fe6c8142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3125093744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c8143160 con 0x7fe6c8144200 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80cdf80 tx=0x7fe6c000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6bf400640 1 -- 172.21.15.52:0/3125093744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0019070 con 0x7fe6c8144200 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6bf400640 1 -- 172.21.15.52:0/3125093744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c000ee50 con 0x7fe6c8144200 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c8143440 con 0x7fe6c8144200 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.630+0000 7fe6bf400640 1 -- 172.21.15.52:0/3125093744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0003970 con 0x7fe6c8144200 2024-09-10T08:39:33.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.631+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c8143a00 con 0x7fe6c8144200 2024-09-10T08:39:33.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.633+0000 7fe6bf400640 1 -- 172.21.15.52:0/3125093744 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6c001c070 con 0x7fe6c8144200 2024-09-10T08:39:33.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.633+0000 7fe6bf400640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.633+0000 7fe6bf400640 1 -- 172.21.15.52:0/3125093744 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c008a4c0 con 0x7fe6c8144200 2024-09-10T08:39:33.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.634+0000 7fe6c7400640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.634+0000 7fe6d16a4740 1 Processor -- start 2024-09-10T08:39:33.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.634+0000 7fe6d16a4740 1 -- start start 2024-09-10T08:39:33.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6c7400640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80017e0 tx=0x7fe6b8007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 0x55e5006eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5006e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e5006493b0 con 0x55e5006eacf0 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e50064e410 con 0x55e5006ec480 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.635+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e5005f6620 con 0x55e5006e84b0 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 0x55e5006eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 0x55e5006eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:48530/0 (socket says 172.21.15.52:48530) 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6bfe00640 1 -- 172.21.15.52:0/2596250809 learned_addr learned my addr 172.21.15.52:0/2596250809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54974/0 (socket says 172.21.15.52:54974) 2024-09-10T08:39:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5006e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 -- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 msgr2=0x55e5006eb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 0x55e5006eb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 -- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 msgr2=0x55e5006e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5006e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 -- 172.21.15.52:0/2596250809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5003612d0 con 0x55e5006eacf0 2024-09-10T08:39:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.636+0000 7fe6c7400640 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8011c10 tx=0x7fe6b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3e480214db8bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6b7e00640 1 -- 172.21.15.52:0/2596250809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8015c90 con 0x55e5006eacf0 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6b7e00640 1 -- 172.21.15.52:0/2596250809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8015e30 con 0x55e5006eacf0 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6b7e00640 1 -- 172.21.15.52:0/2596250809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8022610 con 0x55e5006eacf0 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 -- 172.21.15.52:0/2596250809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 msgr2=0x55e500730490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8011c10 tx=0x7fe6b8014000 comp rx=0 tx=0).stop 2024-09-10T08:39:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 -- 172.21.15.52:0/2596250809 shutdown_connections 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5006e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006e84b0 0x55e5006eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/2596250809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006eacf0 0x55e500730490 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 -- 172.21.15.52:0/2596250809 >> 172.21.15.52:0/2596250809 conn(0x55e5006e7740 msgr2=0x55e50072f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 -- 172.21.15.52:0/2596250809 shutdown_connections 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.637+0000 7fe6d16a4740 1 -- 172.21.15.52:0/2596250809 wait complete. 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.638+0000 7fe6d16a4740 1 -- start start 2024-09-10T08:39:33.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.638+0000 7fe6d16a4740 1 Processor -- start 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500714750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e500743980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e500609780 con 0x55e50072ce80 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e50064a3d0 con 0x55e5006ec480 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e5006e6be0 con 0x55e5006eacf0 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.639+0000 7fe6d16a4740 10 client.0 _ll_register_callbacks cb 0x55e5006475d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500714750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500714750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:48538/0 (socket says 172.21.15.52:48538) 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e500743980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7400640 1 -- 172.21.15.52:0/3172923091 learned_addr learned my addr 172.21.15.52:0/3172923091 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54984/0 (socket says 172.21.15.52:54984) 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 msgr2=0x55e500714750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500714750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 msgr2=0x55e500743980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e500743980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 -- 172.21.15.52:0/3172923091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50042b6b0 con 0x55e50072ce80 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00889c0 tx=0x7fe6c00588e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464f90f08a2c45bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c008a070 con 0x55e50072ce80 2024-09-10T08:39:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c008a210 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.640+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b8015e30 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7fe6c0057c70 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 10 client.9435 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55e5007003a0 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8015e30 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7fe6c0057e10 con 0x55e50072ce80 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 10 client.9435 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 10 client.9435 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 20 client.9435 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e50070da10 0x55e50070ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 4 client.9435 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.641+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e50065bb40 con 0x55e50070da10 2024-09-10T08:39:33.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.642+0000 7fe6c7400640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e50070da10 0x55e50070ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.642+0000 7fe6c7400640 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e50070da10 0x55e50070ddf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf5a68c233c0f342 server_cookie=c6ba94fdec3067c2 in_seq=0 out_seq=0 2024-09-10T08:39:33.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.642+0000 7fe6b4c00640 10 client.9435 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:33.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.643+0000 7fe6b4c00640 1 -- 172.21.15.52:0/3172923091 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e50065bb40 con 0x55e50070da10 2024-09-10T08:39:33.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.643+0000 7fe6b4c00640 10 client.9435 handle_command_reply: tid=0 2024-09-10T08:39:33.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.643+0000 7fe6d16a4740 1 client.9435 shutdown 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 msgr2=0x55e5007008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00889c0 tx=0x7fe6c00588e0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 shutdown_connections 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e50070da10 0x55e50070ddf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e5007008c0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e500743980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/3172923091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500714750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6b4c00640 0 client.9435 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 >> 172.21.15.52:0/3172923091 conn(0x55e5006e84b0 msgr2=0x55e50072ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 shutdown_connections 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 1 -- 172.21.15.52:0/3172923091 wait complete. 2024-09-10T08:39:33.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.644+0000 7fe6d16a4740 20 client.9435 trim_cache size 0 max 16384 2024-09-10T08:39:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.663+0000 7fe6d16a4740 1 Processor -- start 2024-09-10T08:39:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.663+0000 7fe6d16a4740 1 -- start start 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.663+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500743310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e50072ce80 0x55e50072df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8201050 con 0x55e5006ec480 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c82000b0 con 0x55e50072ce80 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c80cc7c0 con 0x55e5006eacf0 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54988/0 (socket says 172.21.15.52:54988) 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 -- 172.21.15.52:0/972153927 learned_addr learned my addr 172.21.15.52:0/972153927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6c7400640 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500743310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e50072ce80 0x55e50072df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 -- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 msgr2=0x55e500743310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500743310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 -- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e50072ce80 msgr2=0x55e50072df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e50072ce80 0x55e50072df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.664+0000 7fe6bfe00640 1 -- 172.21.15.52:0/972153927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5006d7350 con 0x55e5006ec480 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe6b002ab90 tx=0x7fe6b002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a5087233087a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6b7400640 1 -- 172.21.15.52:0/972153927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0036040 con 0x55e5006ec480 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6b7400640 1 -- 172.21.15.52:0/972153927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0037040 con 0x55e5006ec480 2024-09-10T08:39:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6b7400640 1 -- 172.21.15.52:0/972153927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0004500 con 0x55e5006ec480 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 -- 172.21.15.52:0/972153927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 msgr2=0x55e50072d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe6b002ab90 tx=0x7fe6b002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 -- 172.21.15.52:0/972153927 shutdown_connections 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e50072ce80 0x55e50072df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e5006ec480 0x55e50072d9e0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/972153927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e500743310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 -- 172.21.15.52:0/972153927 >> 172.21.15.52:0/972153927 conn(0x55e5006e84b0 msgr2=0x55e5006eb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 -- 172.21.15.52:0/972153927 shutdown_connections 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.665+0000 7fe6d16a4740 1 -- 172.21.15.52:0/972153927 wait complete. 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.666+0000 7fe6d16a4740 1 -- start start 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.666+0000 7fe6d16a4740 1 Processor -- start 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e50072f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5007adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e50070f4d0 con 0x55e50072ce80 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81ffa60 con 0x55e5006ec480 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e500714e30 con 0x55e5006eacf0 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6d16a4740 10 client.0 _ll_register_callbacks cb 0x7fe6c005f0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55002/0 (socket says 172.21.15.52:55002) 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.667+0000 7fe6c7e00640 1 -- 172.21.15.52:0/882900595 learned_addr learned my addr 172.21.15.52:0/882900595 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7400640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e50072f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5007adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 -- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 msgr2=0x55e50072f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e50072f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 -- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 msgr2=0x55e5007adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5007adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 -- 172.21.15.52:0/882900595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50070b0c0 con 0x55e50072ce80 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7400640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e50072f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6bfe00640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5007adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6c7e00640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0060e20 tx=0x7fe6c005b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaabea0c4e7887b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0054570 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fe6c0054710 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b0037040 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.668+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7fe6c0077b10 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 10 client.9441 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55e5007ae200 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0037040 con 0x55e50072ce80 2024-09-10T08:39:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7fe6c00576e0 con 0x55e50072ce80 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 10 client.9441 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 10 client.9441 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 20 client.9441 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e5007b1f20 0x55e500752e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 4 client.9441 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "status"}) -- 0x55e500655e90 con 0x55e5007b1f20 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.669+0000 7fe6c7400640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e5007b1f20 0x55e500752e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6c7400640 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e5007b1f20 0x55e500752e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f6de85033c1141 server_cookie=b07dc48edff2c090 in_seq=0 out_seq=0 2024-09-10T08:39:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6b4c00640 10 client.9441 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6b4c00640 1 -- 172.21.15.52:0/882900595 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55e500655e90 con 0x55e5007b1f20 2024-09-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6b4c00640 10 client.9441 handle_command_reply: tid=0 2024-09-10T08:39:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6d16a4740 1 client.9441 shutdown 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 msgr2=0x55e500700570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.670+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0060e20 tx=0x7fe6c005b070 comp rx=0 tx=0).stop 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 shutdown_connections 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55e5007b1f20 0x55e500752e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e50072ce80 0x55e500700570 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e5006ec480 0x55e5007adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 --2- 172.21.15.52:0/882900595 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e5006eacf0 0x55e50072f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6b4c00640 0 client.9441 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 >> 172.21.15.52:0/882900595 conn(0x55e5006e84b0 msgr2=0x55e500743a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 shutdown_connections 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 1 -- 172.21.15.52:0/882900595 wait complete. 2024-09-10T08:39:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6d16a4740 20 client.9441 trim_cache size 0 max 16384 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 9297, 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1611025039999996, 2024-09-10T08:39:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 119, 2024-09-10T08:39:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 158, 2024-09-10T08:39:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 158, 2024-09-10T08:39:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 10.858333879 2024-09-10T08:39:33.678 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:33.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 msgr2=0x7fe6a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 0x7fe6a406e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80017e0 tx=0x7fe6b8007040 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 msgr2=0x7fe6c81f82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80cdf80 tx=0x7fe6c000ec00 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 shutdown_connections 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe6a406be30 0x7fe6a406e2f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6c8144200 0x7fe6c81f82e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6c8136eb0 0x7fe6c81f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.671+0000 7fe6ce800640 1 --2- 172.21.15.52:0/3125093744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6ac0043b0 0x7fe6c8142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.672+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 >> 172.21.15.52:0/3125093744 conn(0x7fe6c80ccec0 msgr2=0x7fe6c8140820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.672+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 shutdown_connections 2024-09-10T08:39:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.672+0000 7fe6ce800640 1 -- 172.21.15.52:0/3125093744 wait complete. 2024-09-10T08:39:33.688 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:39:33.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.844+0000 7f039de00640 1 Processor -- start 2024-09-10T08:39:33.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.844+0000 7f039de00640 1 -- start start 2024-09-10T08:39:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f039de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f039815eab0 0x7f039815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f039de00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 0x7f03980b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f039de00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03980b7000 con 0x7f0398162490 2024-09-10T08:39:33.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f039de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f039815f570 con 0x7f039815eab0 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f039de00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f039815f850 con 0x7f03980b66b0 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.845+0000 7f0396a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f039815eab0 0x7f039815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f039815eab0 0x7f039815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55010/0 (socket says 172.21.15.52:55010) 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 -- 172.21.15.52:0/1696080811 learned_addr learned my addr 172.21.15.52:0/1696080811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0397400640 1 --2- 172.21.15.52:0/1696080811 >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 0x7f03980b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 -- 172.21.15.52:0/1696080811 >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 msgr2=0x7f03980b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 --2- 172.21.15.52:0/1696080811 >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 0x7f03980b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 -- 172.21.15.52:0/1696080811 >> v1:172.21.15.176:6789/0 conn(0x7f0398162490 legacy=0x7f03980d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0396a00640 1 -- 172.21.15.52:0/1696080811 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039815fb30 con 0x7f039815eab0 2024-09-10T08:39:33.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.846+0000 7f0397400640 1 --2- 172.21.15.52:0/1696080811 >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 0x7f03980b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.847+0000 7f0396a00640 1 --2- 172.21.15.52:0/1696080811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f039815ee90 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f039808d8c0 tx=0x7f038802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30f7a7f8e2b5bce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.847+0000 7f0396000640 1 -- 172.21.15.52:0/1696080811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388037070 con 0x7f039815eab0 2024-09-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.847+0000 7f0396000640 1 -- 172.21.15.52:0/1696080811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0388032440 con 0x7f039815eab0 2024-09-10T08:39:33.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.847+0000 7f0396000640 1 -- 172.21.15.52:0/1696080811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388032810 con 0x7f039815eab0 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 -- 172.21.15.52:0/1696080811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 msgr2=0x7f039815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 --2- 172.21.15.52:0/1696080811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f039815ee90 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f039808d8c0 tx=0x7f038802a230 comp rx=0 tx=0).stop 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 -- 172.21.15.52:0/1696080811 shutdown_connections 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 --2- 172.21.15.52:0/1696080811 >> v2:172.21.15.176:3300/0 conn(0x7f03980b66b0 0x7f03980b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 --2- 172.21.15.52:0/1696080811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f039815ee90 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 -- 172.21.15.52:0/1696080811 >> 172.21.15.52:0/1696080811 conn(0x7f03980d16d0 msgr2=0x7f03980d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 -- 172.21.15.52:0/1696080811 shutdown_connections 2024-09-10T08:39:33.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.848+0000 7f039de00640 1 -- 172.21.15.52:0/1696080811 wait complete. 2024-09-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.850+0000 7f039de00640 1 Processor -- start 2024-09-10T08:39:33.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.850+0000 7f039de00640 1 -- start start 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03980b66b0 0x7f0398160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0398162490 0x7f03980d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03980d4460 con 0x7f039815eab0 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f03980cef20 con 0x7f03980b66b0 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f039de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f03980d45e0 con 0x7f0398162490 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f0396a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03980b66b0 0x7f0398160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55014/0 (socket says 172.21.15.52:55014) 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 -- 172.21.15.52:0/232819522 learned_addr learned my addr 172.21.15.52:0/232819522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f0397400640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0398162490 0x7f03980d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 -- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0398162490 msgr2=0x7f03980d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0398162490 0x7f03980d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 -- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03980b66b0 msgr2=0x7f0398160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.851+0000 7f038fe00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03980b66b0 0x7f0398160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f038fe00640 1 -- 172.21.15.52:0/232819522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03981601d0 con 0x7f039815eab0 2024-09-10T08:39:33.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f038fe00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f038000c460 tx=0x7f038000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380016020 con 0x7f039815eab0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380012870 con 0x7f039815eab0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380012c60 con 0x7f039815eab0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03981604b0 con 0x7f039815eab0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.852+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0398157450 con 0x7f039815eab0 2024-09-10T08:39:33.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.853+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03980b6ac0 con 0x7f039815eab0 2024-09-10T08:39:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.854+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0380019020 con 0x7f039815eab0 2024-09-10T08:39:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.855+0000 7f038f400640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 0x7f037406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:33.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.855+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f038008a750 con 0x7f039815eab0 2024-09-10T08:39:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.856+0000 7f0396a00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 0x7f037406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:33.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.856+0000 7f0396a00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 0x7f037406e320 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0388034000 tx=0x7f038802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:33.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:33.859+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0380020070 con 0x7f039815eab0 2024-09-10T08:39:34.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.079+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f03980d4240 con 0x7f039815eab0 2024-09-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.080+0000 7f038f400640 1 -- 172.21.15.52:0/232819522 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) ==== 53+0+73 (secure 0 0 0) 0x7f0380058aa0 con 0x7f039815eab0 2024-09-10T08:39:34.080 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.081+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 msgr2=0x7f037406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.081+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 0x7f037406e320 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0388034000 tx=0x7f038802e000 comp rx=0 tx=0).stop 2024-09-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 msgr2=0x7f0398156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:34.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f038000c460 tx=0x7f038000c920 comp rx=0 tx=0).stop 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 shutdown_connections 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f037406be60 0x7f037406e320 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0398162490 0x7f03980d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f039815eab0 0x7f0398156f10 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 --2- 172.21.15.52:0/232819522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03980b66b0 0x7f0398160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 >> 172.21.15.52:0/232819522 conn(0x7f03980d16d0 msgr2=0x7f03980d2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 shutdown_connections 2024-09-10T08:39:34.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34.082+0000 7f039de00640 1 -- 172.21.15.52:0/232819522 wait complete. 2024-09-10T08:39:34.098 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:39:34.098 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:39:34.098 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:39:34.098 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:39:34.098 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:39:34.099 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:39:34.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:39:34.099 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:39:34.099 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:39:34.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.099 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.135 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:39:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42028sec preferred_lft 42028sec 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:39:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:39:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:39:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.139 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:39:34.229 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:39:34.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.232 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:39:34.267 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:39:34.268 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:39:34.268 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:39:34.268 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:39:34.268 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:39:34.268 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:39:34.268 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:34.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:39:34.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:39:34.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:39:34.269 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:34.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:39:34.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:34.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.465 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:39:34.500 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:39:34.500 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:39:34.501 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:39:34.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:39:34.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:39:34.598 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:39:34.632 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:39:34.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:39:34.633 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:39:34.706 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:39:34.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:39:34.834 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:39:34.834 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:39:34.860 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:39:34.860 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:39:34.860 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:39:34.860 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:39:34.861 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:39:34.862 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:39:34.862 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:39:34.862 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:39:34.862 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:39:34.862 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:39:34.865 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:39:34.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:34.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:39:34.922 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:39:35.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:35.023 INFO:teuthology.orchestra.run.smithi052.stdout:client9450 2024-09-10T08:39:35.024 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:39:35.024 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:39:35.059 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:35.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.255+0000 7fa17c800640 1 Processor -- start 2024-09-10T08:39:35.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.255+0000 7fa17c800640 1 -- start start 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa17c800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa17413eb20 0x7fa17415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa17c800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa174071180 con 0x7fa1740b2d40 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa17c800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa174071460 con 0x7fa17406c320 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa17c800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa174071ab0 con 0x7fa17413eb20 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa179e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa1740b2d40 0x7fa17406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51704/0 (socket says 172.21.15.52:51704) 2024-09-10T08:39:35.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.256+0000 7fa179e00640 1 -- 172.21.15.52:0/2491102400 learned_addr learned my addr 172.21.15.52:0/2491102400 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:35.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa17a800640 1 --2- 172.21.15.52:0/2491102400 >> v2:172.21.15.176:3300/0 conn(0x7fa17413eb20 0x7fa17415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437636205 0 0) 0x7fa174071180 con 0x7fa1740b2d40 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa15c003520 con 0x7fa1740b2d40 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 269336864 0 0) 0x7fa15c003520 con 0x7fa1740b2d40 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 >> v2:172.21.15.176:3300/0 conn(0x7fa17413eb20 msgr2=0x7fa17415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 --2- 172.21.15.52:0/2491102400 >> v2:172.21.15.176:3300/0 conn(0x7fa17413eb20 0x7fa17415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 >> v1:172.21.15.176:6789/0 conn(0x7fa17406c320 legacy=0x7fa17415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa174071740 con 0x7fa1740b2d40 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fa168001670 con 0x7fa1740b2d40 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 >> v1:172.21.15.52:6789/0 conn(0x7fa1740b2d40 legacy=0x7fa17406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa15c0039b0 0x7fa15c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c004800 0x7fa15c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 0x7fa15c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa174071ab0 con 0x7fa15c0051c0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c00c060 con 0x7fa15c0039b0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.257+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c00c260 con 0x7fa15c004800 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 0x7fa15c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa179e00640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa15c0039b0 0x7fa15c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa179400640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c004800 0x7fa15c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 -- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c004800 msgr2=0x7fa15c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c004800 0x7fa15c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 -- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa15c0039b0 msgr2=0x7fa15c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa15c0039b0 0x7fa15c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.258+0000 7fa17a800640 1 -- 172.21.15.52:0/2491102400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c003520 con 0x7fa15c0051c0 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.259+0000 7fa17a800640 1 -- 172.21.15.52:0/2491102400 reap_dead start 2024-09-10T08:39:35.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.259+0000 7fa17a800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 0x7fa15c00b9c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa170009fc0 tx=0x7fa15c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756fa07391613c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.259+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170035020 con 0x7fa15c0051c0 2024-09-10T08:39:35.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.259+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa170003b90 con 0x7fa15c0051c0 2024-09-10T08:39:35.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.259+0000 7fa178a00640 1 -- 172.21.15.52:0/2491102400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170009c10 con 0x7fa15c0051c0 2024-09-10T08:39:35.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 -- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 msgr2=0x7fa15c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 0x7fa15c00b9c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa170009fc0 tx=0x7fa15c005830 comp rx=0 tx=0).stop 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 -- 172.21.15.52:0/2491102400 shutdown_connections 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 --2- 172.21.15.52:0/2491102400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa15c0051c0 0x7fa15c00b9c0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 -- 172.21.15.52:0/2491102400 >> 172.21.15.52:0/2491102400 conn(0x7fa1740ccec0 msgr2=0x7fa1740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 -- 172.21.15.52:0/2491102400 shutdown_connections 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.260+0000 7fa17c800640 1 -- 172.21.15.52:0/2491102400 wait complete. 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.262+0000 7fa17c800640 1 Processor -- start 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.262+0000 7fa17c800640 1 -- start start 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c0051c0 0x7fa174072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1740c9860 0x7fa1740c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa17406bfa0 con 0x7fa174154a10 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa17406be20 con 0x7fa1740c9860 2024-09-10T08:39:35.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17c800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa17406c120 con 0x7fa15c0051c0 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35260/0 (socket says 172.21.15.52:35260) 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 -- 172.21.15.52:0/1929266941 learned_addr learned my addr 172.21.15.52:0/1929266941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa179e00640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c0051c0 0x7fa174072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa179400640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1740c9860 0x7fa1740c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 -- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c0051c0 msgr2=0x7fa174072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c0051c0 0x7fa174072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 -- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1740c9860 msgr2=0x7fa1740c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1740c9860 0x7fa1740c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.263+0000 7fa17a800640 1 -- 172.21.15.52:0/1929266941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1740ca320 con 0x7fa174154a10 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa17a800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e230 tx=0x7fa170009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17003f030 con 0x7fa174154a10 2024-09-10T08:39:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa170003990 con 0x7fa174154a10 2024-09-10T08:39:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1740ca600 con 0x7fa174154a10 2024-09-10T08:39:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170035070 con 0x7fa174154a10 2024-09-10T08:39:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.264+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1740cabc0 con 0x7fa174154a10 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.265+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17415af40 con 0x7fa174154a10 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.266+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa170042030 con 0x7fa174154a10 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.267+0000 7fa16e000640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 0x7fa15806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.267+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fa1700abae0 con 0x7fa174154a10 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.268+0000 7fa179e00640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 0x7fa15806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.268+0000 7fa179e00640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 0x7fa15806e320 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa168001050 tx=0x7fa1680078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.271+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa17415af40 con 0x7fa174154a10 2024-09-10T08:39:35.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.489+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa17415bcf0 con 0x7fa174154a10 2024-09-10T08:39:35.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.490+0000 7fa16e000640 1 -- 172.21.15.52:0/1929266941 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7fa170079da0 con 0x7fa174154a10 2024-09-10T08:39:35.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:35.490 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:35.490 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 msgr2=0x7fa15806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 0x7fa15806e320 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa168001050 tx=0x7fa1680078f0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 msgr2=0x7fa174154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e230 tx=0x7fa170009750 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 shutdown_connections 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa15806be60 0x7fa15806e320 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa174154a10 0x7fa174154ec0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa1740c9860 0x7fa1740c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 --2- 172.21.15.52:0/1929266941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa15c0051c0 0x7fa174072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 >> 172.21.15.52:0/1929266941 conn(0x7fa1740ccec0 msgr2=0x7fa174140610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 shutdown_connections 2024-09-10T08:39:35.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.492+0000 7fa17c800640 1 -- 172.21.15.52:0/1929266941 wait complete. 2024-09-10T08:39:35.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:35.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.668+0000 7f7bd2a00640 1 Processor -- start 2024-09-10T08:39:35.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.668+0000 7f7bd2a00640 1 -- start start 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7bcc145ed0 0x7f7bcc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7bcc073180 0x7f7bcc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc0b5880 0x7f7bcc0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc073b00 con 0x7f7bcc073180 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc0b4020 con 0x7f7bcc145ed0 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bd2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc0b42c0 con 0x7f7bcc0b5880 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.669+0000 7f7bcb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7bcc073180 0x7f7bcc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7bcc073180 0x7f7bcc0735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35262/0 (socket says 172.21.15.52:35262) 2024-09-10T08:39:35.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 -- 172.21.15.52:0/541168095 learned_addr learned my addr 172.21.15.52:0/541168095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:35.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bd0a00640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc0b5880 0x7f7bcc0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcbe00640 1 --2- 172.21.15.52:0/541168095 >> v2:172.21.15.176:3300/0 conn(0x7f7bcc145ed0 0x7f7bcc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 -- 172.21.15.52:0/541168095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc0b5880 msgr2=0x7f7bcc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc0b5880 0x7f7bcc0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 -- 172.21.15.52:0/541168095 >> v2:172.21.15.176:3300/0 conn(0x7f7bcc145ed0 msgr2=0x7f7bcc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 --2- 172.21.15.52:0/541168095 >> v2:172.21.15.176:3300/0 conn(0x7f7bcc145ed0 0x7f7bcc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.670+0000 7f7bcb400640 1 -- 172.21.15.52:0/541168095 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc0b45a0 con 0x7f7bcc073180 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.671+0000 7f7bcb400640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc0735c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc069cd0 tx=0x7f7bb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e909cb0a5fbed1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.671+0000 7f7bcaa00640 1 -- 172.21.15.52:0/541168095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8037070 con 0x7f7bcc073180 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.671+0000 7f7bcaa00640 1 -- 172.21.15.52:0/541168095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb8032440 con 0x7f7bcc073180 2024-09-10T08:39:35.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.671+0000 7f7bcaa00640 1 -- 172.21.15.52:0/541168095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8032810 con 0x7f7bcc073180 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 -- 172.21.15.52:0/541168095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 msgr2=0x7f7bcc0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc0735c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc069cd0 tx=0x7f7bb802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 -- 172.21.15.52:0/541168095 shutdown_connections 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc0b5880 0x7f7bcc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/541168095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc0735c0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/541168095 >> v2:172.21.15.176:3300/0 conn(0x7f7bcc145ed0 0x7f7bcc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 -- 172.21.15.52:0/541168095 >> 172.21.15.52:0/541168095 conn(0x7f7bcc0ccec0 msgr2=0x7f7bcc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:35.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 -- 172.21.15.52:0/541168095 shutdown_connections 2024-09-10T08:39:35.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.672+0000 7f7bd2a00640 1 -- 172.21.15.52:0/541168095 wait complete. 2024-09-10T08:39:35.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.674+0000 7f7bd2a00640 1 Processor -- start 2024-09-10T08:39:35.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.674+0000 7f7bd2a00640 1 -- start start 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.674+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bcc0b5880 0x7f7bcc143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd2a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc145ed0 0x7f7bcc141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd2a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0b6250 con 0x7f7bcc073180 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd2a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0b4b60 con 0x7f7bcc0b5880 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd2a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc0b63d0 con 0x7f7bcc145ed0 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35268/0 (socket says 172.21.15.52:35268) 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 -- 172.21.15.52:0/1052299259 learned_addr learned my addr 172.21.15.52:0/1052299259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bd0a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc145ed0 0x7f7bcc141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcb400640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bcc0b5880 0x7f7bcc143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 -- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc145ed0 msgr2=0x7f7bcc141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc145ed0 0x7f7bcc141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 -- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bcc0b5880 msgr2=0x7f7bcc143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bcc0b5880 0x7f7bcc143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.675+0000 7f7bcbe00640 1 -- 172.21.15.52:0/1052299259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc142970 con 0x7f7bcc073180 2024-09-10T08:39:35.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bcbe00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e870 tx=0x7f7bbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc017070 con 0x7f7bcc073180 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00c940 con 0x7f7bcc073180 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00cd30 con 0x7f7bcc073180 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc142c50 con 0x7f7bcc073180 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.676+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc143210 con 0x7f7bcc073180 2024-09-10T08:39:35.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.677+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc1462b0 con 0x7f7bcc073180 2024-09-10T08:39:35.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.678+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7bbc01a070 con 0x7f7bcc073180 2024-09-10T08:39:35.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.680+0000 7f7bc3e00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:35.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.680+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f7bbc08adb0 con 0x7f7bcc073180 2024-09-10T08:39:35.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.680+0000 7f7bcb400640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:35.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.681+0000 7f7bcb400640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 0x7f7bac06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:35.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.684+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bbc08f070 con 0x7f7bcc073180 2024-09-10T08:39:35.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.905+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bcc0cb3e0 con 0x7f7bcc073180 2024-09-10T08:39:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.906+0000 7f7bc3e00640 1 -- 172.21.15.52:0/1052299259 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f7bcc0cb3e0 con 0x7f7bcc073180 2024-09-10T08:39:35.907 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:35.907 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:35.907 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:35.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 msgr2=0x7f7bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 0x7f7bac06e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).stop 2024-09-10T08:39:35.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 msgr2=0x7f7bcc13cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:35.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e870 tx=0x7f7bbc00ed30 comp rx=0 tx=0).stop 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 shutdown_connections 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7bac06be30 0x7f7bac06e2f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7bcc145ed0 0x7f7bcc141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7bcc0b5880 0x7f7bcc143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 --2- 172.21.15.52:0/1052299259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7bcc073180 0x7f7bcc13cd60 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 >> 172.21.15.52:0/1052299259 conn(0x7f7bcc0ccec0 msgr2=0x7f7bcc15c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.908+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 shutdown_connections 2024-09-10T08:39:35.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:35.909+0000 7f7bd2a00640 1 -- 172.21.15.52:0/1052299259 wait complete. 2024-09-10T08:39:35.925 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:35.925 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:35.925 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T08:39:35.925 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:35.925 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:35.926 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:35.926 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:36.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:36.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162358 s, 64.6 MB/s 2024-09-10T08:39:36.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.060 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169396 s, 61.9 MB/s 2024-09-10T08:39:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156089 s, 67.2 MB/s 2024-09-10T08:39:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156247 s, 67.1 MB/s 2024-09-10T08:39:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150746 s, 69.6 MB/s 2024-09-10T08:39:36.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141139 s, 74.3 MB/s 2024-09-10T08:39:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144776 s, 72.4 MB/s 2024-09-10T08:39:36.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.170 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149289 s, 70.2 MB/s 2024-09-10T08:39:36.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156009 s, 67.2 MB/s 2024-09-10T08:39:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162111 s, 64.7 MB/s 2024-09-10T08:39:36.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.229 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169224 s, 62.0 MB/s 2024-09-10T08:39:36.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.247 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142323 s, 73.7 MB/s 2024-09-10T08:39:36.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.263 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013366 s, 78.5 MB/s 2024-09-10T08:39:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131139 s, 80.0 MB/s 2024-09-10T08:39:36.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175337 s, 59.8 MB/s 2024-09-10T08:39:36.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.317 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.317 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130953 s, 80.1 MB/s 2024-09-10T08:39:36.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.338 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171804 s, 61.0 MB/s 2024-09-10T08:39:36.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.355 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140747 s, 74.5 MB/s 2024-09-10T08:39:36.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.373 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141084 s, 74.3 MB/s 2024-09-10T08:39:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.392 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157972 s, 66.4 MB/s 2024-09-10T08:39:36.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.411 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157819 s, 66.4 MB/s 2024-09-10T08:39:36.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136338 s, 76.9 MB/s 2024-09-10T08:39:36.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133076 s, 78.8 MB/s 2024-09-10T08:39:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149548 s, 70.1 MB/s 2024-09-10T08:39:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133825 s, 78.4 MB/s 2024-09-10T08:39:36.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139691 s, 75.1 MB/s 2024-09-10T08:39:36.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.514 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148403 s, 70.7 MB/s 2024-09-10T08:39:36.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135144 s, 77.6 MB/s 2024-09-10T08:39:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138796 s, 75.5 MB/s 2024-09-10T08:39:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142524 s, 73.6 MB/s 2024-09-10T08:39:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157981 s, 66.4 MB/s 2024-09-10T08:39:36.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016276 s, 64.4 MB/s 2024-09-10T08:39:36.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:36.615 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:36.616 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:36.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135398 s, 77.4 MB/s 2024-09-10T08:39:36.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143266 s, 73.2 MB/s 2024-09-10T08:39:36.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125654 s, 83.4 MB/s 2024-09-10T08:39:36.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.770 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.770 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142575 s, 73.5 MB/s 2024-09-10T08:39:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130849 s, 80.1 MB/s 2024-09-10T08:39:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134755 s, 77.8 MB/s 2024-09-10T08:39:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172225 s, 60.9 MB/s 2024-09-10T08:39:36.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016243 s, 64.6 MB/s 2024-09-10T08:39:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166061 s, 63.1 MB/s 2024-09-10T08:39:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.883 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139245 s, 75.3 MB/s 2024-09-10T08:39:36.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.901 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.901 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145122 s, 72.3 MB/s 2024-09-10T08:39:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138192 s, 75.9 MB/s 2024-09-10T08:39:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135925 s, 77.1 MB/s 2024-09-10T08:39:36.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126145 s, 83.1 MB/s 2024-09-10T08:39:36.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138901 s, 75.5 MB/s 2024-09-10T08:39:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:36.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:36.988 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136573 s, 76.8 MB/s 2024-09-10T08:39:37.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.005 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141483 s, 74.1 MB/s 2024-09-10T08:39:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130616 s, 80.3 MB/s 2024-09-10T08:39:37.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131664 s, 79.6 MB/s 2024-09-10T08:39:37.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.053 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.054 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112922 s, 92.9 MB/s 2024-09-10T08:39:37.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.072 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147232 s, 71.2 MB/s 2024-09-10T08:39:37.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013785 s, 76.1 MB/s 2024-09-10T08:39:37.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137409 s, 76.3 MB/s 2024-09-10T08:39:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142185 s, 73.7 MB/s 2024-09-10T08:39:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133648 s, 78.5 MB/s 2024-09-10T08:39:37.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171265 s, 61.2 MB/s 2024-09-10T08:39:37.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016799 s, 62.4 MB/s 2024-09-10T08:39:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125495 s, 83.6 MB/s 2024-09-10T08:39:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.217 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129588 s, 80.9 MB/s 2024-09-10T08:39:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138196 s, 75.9 MB/s 2024-09-10T08:39:37.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.253 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151131 s, 69.4 MB/s 2024-09-10T08:39:37.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123714 s, 84.8 MB/s 2024-09-10T08:39:37.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:37.278 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:37.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:37.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.378 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.378 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134447 s, 78.0 MB/s 2024-09-10T08:39:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144422 s, 72.6 MB/s 2024-09-10T08:39:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140267 s, 74.8 MB/s 2024-09-10T08:39:37.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135369 s, 77.5 MB/s 2024-09-10T08:39:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138115 s, 75.9 MB/s 2024-09-10T08:39:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.465 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145909 s, 71.9 MB/s 2024-09-10T08:39:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121516 s, 86.3 MB/s 2024-09-10T08:39:37.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132884 s, 78.9 MB/s 2024-09-10T08:39:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01307 s, 80.2 MB/s 2024-09-10T08:39:37.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.533 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168944 s, 62.1 MB/s 2024-09-10T08:39:37.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.550 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136742 s, 76.7 MB/s 2024-09-10T08:39:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136154 s, 77.0 MB/s 2024-09-10T08:39:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.585 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136629 s, 76.7 MB/s 2024-09-10T08:39:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136393 s, 76.9 MB/s 2024-09-10T08:39:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133166 s, 78.7 MB/s 2024-09-10T08:39:37.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:37.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:39:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140106 s, 74.8 MB/s 2024-09-10T08:39:37.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160241 s, 65.4 MB/s 2024-09-10T08:39:37.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129907 s, 80.7 MB/s 2024-09-10T08:39:37.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014229 s, 73.7 MB/s 2024-09-10T08:39:37.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.708 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128746 s, 81.4 MB/s 2024-09-10T08:39:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120961 s, 86.7 MB/s 2024-09-10T08:39:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.741 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137662 s, 76.2 MB/s 2024-09-10T08:39:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130575 s, 80.3 MB/s 2024-09-10T08:39:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013919 s, 75.3 MB/s 2024-09-10T08:39:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169997 s, 61.7 MB/s 2024-09-10T08:39:37.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130644 s, 80.3 MB/s 2024-09-10T08:39:37.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.830 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137308 s, 76.4 MB/s 2024-09-10T08:39:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.847 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133705 s, 78.4 MB/s 2024-09-10T08:39:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171926 s, 61.0 MB/s 2024-09-10T08:39:37.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133009 s, 78.8 MB/s 2024-09-10T08:39:37.902 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.902 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.902 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143115 s, 73.3 MB/s 2024-09-10T08:39:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:37.918 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120159 s, 87.3 MB/s 2024-09-10T08:39:37.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:37.927 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:37.928 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:38.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:38.070 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157655 s, 66.5 MB/s 2024-09-10T08:39:38.087 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.088 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.088 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137489 s, 76.3 MB/s 2024-09-10T08:39:38.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.109 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168163 s, 62.4 MB/s 2024-09-10T08:39:38.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131838 s, 79.5 MB/s 2024-09-10T08:39:38.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.143 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144065 s, 72.8 MB/s 2024-09-10T08:39:38.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161464 s, 64.9 MB/s 2024-09-10T08:39:38.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.180 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130323 s, 80.5 MB/s 2024-09-10T08:39:38.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141262 s, 74.2 MB/s 2024-09-10T08:39:38.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128185 s, 81.8 MB/s 2024-09-10T08:39:38.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.230 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126284 s, 83.0 MB/s 2024-09-10T08:39:38.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.246 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132489 s, 79.1 MB/s 2024-09-10T08:39:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154921 s, 67.7 MB/s 2024-09-10T08:39:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.281 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125179 s, 83.8 MB/s 2024-09-10T08:39:38.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.302 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169395 s, 61.9 MB/s 2024-09-10T08:39:38.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.321 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016046 s, 65.3 MB/s 2024-09-10T08:39:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.338 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134331 s, 78.1 MB/s 2024-09-10T08:39:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137905 s, 76.0 MB/s 2024-09-10T08:39:38.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115218 s, 91.0 MB/s 2024-09-10T08:39:38.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.388 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013585 s, 77.2 MB/s 2024-09-10T08:39:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163058 s, 64.3 MB/s 2024-09-10T08:39:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.432 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.432 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200228 s, 52.4 MB/s 2024-09-10T08:39:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161072 s, 65.1 MB/s 2024-09-10T08:39:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.472 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140246 s, 74.8 MB/s 2024-09-10T08:39:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134526 s, 77.9 MB/s 2024-09-10T08:39:38.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.502 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124892 s, 84.0 MB/s 2024-09-10T08:39:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163125 s, 64.3 MB/s 2024-09-10T08:39:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161532 s, 64.9 MB/s 2024-09-10T08:39:38.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.559 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013214 s, 79.4 MB/s 2024-09-10T08:39:38.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.575 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127237 s, 82.4 MB/s 2024-09-10T08:39:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132231 s, 79.3 MB/s 2024-09-10T08:39:38.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.610 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136323 s, 76.9 MB/s 2024-09-10T08:39:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157367 s, 66.6 MB/s 2024-09-10T08:39:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:38.638 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:38.639 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135067 s, 77.6 MB/s 2024-09-10T08:39:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130972 s, 80.1 MB/s 2024-09-10T08:39:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141067 s, 74.3 MB/s 2024-09-10T08:39:38.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167761 s, 62.5 MB/s 2024-09-10T08:39:38.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131552 s, 79.7 MB/s 2024-09-10T08:39:38.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132385 s, 79.2 MB/s 2024-09-10T08:39:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127878 s, 82.0 MB/s 2024-09-10T08:39:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125239 s, 83.7 MB/s 2024-09-10T08:39:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113104 s, 92.7 MB/s 2024-09-10T08:39:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133077 s, 78.8 MB/s 2024-09-10T08:39:38.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.907 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127353 s, 82.3 MB/s 2024-09-10T08:39:38.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135457 s, 77.4 MB/s 2024-09-10T08:39:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122871 s, 85.3 MB/s 2024-09-10T08:39:38.956 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138204 s, 75.9 MB/s 2024-09-10T08:39:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131694 s, 79.6 MB/s 2024-09-10T08:39:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013089 s, 80.1 MB/s 2024-09-10T08:39:39.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.005 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.006 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129483 s, 81.0 MB/s 2024-09-10T08:39:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134448 s, 78.0 MB/s 2024-09-10T08:39:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016236 s, 64.6 MB/s 2024-09-10T08:39:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138579 s, 75.7 MB/s 2024-09-10T08:39:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130136 s, 80.6 MB/s 2024-09-10T08:39:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136528 s, 76.8 MB/s 2024-09-10T08:39:39.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.110 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139747 s, 75.0 MB/s 2024-09-10T08:39:39.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.127 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138094 s, 75.9 MB/s 2024-09-10T08:39:39.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.143 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125482 s, 83.6 MB/s 2024-09-10T08:39:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133694 s, 78.4 MB/s 2024-09-10T08:39:39.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.175 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131059 s, 80.0 MB/s 2024-09-10T08:39:39.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.194 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156962 s, 66.8 MB/s 2024-09-10T08:39:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01316 s, 79.7 MB/s 2024-09-10T08:39:39.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.226 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118199 s, 88.7 MB/s 2024-09-10T08:39:39.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.246 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017214 s, 60.9 MB/s 2024-09-10T08:39:39.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.262 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128313 s, 81.7 MB/s 2024-09-10T08:39:39.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:39.272 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:39.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013298 s, 78.9 MB/s 2024-09-10T08:39:39.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.387 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134781 s, 77.8 MB/s 2024-09-10T08:39:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014072 s, 74.5 MB/s 2024-09-10T08:39:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.422 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143249 s, 73.2 MB/s 2024-09-10T08:39:39.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.439 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137085 s, 76.5 MB/s 2024-09-10T08:39:39.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134894 s, 77.7 MB/s 2024-09-10T08:39:39.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137673 s, 76.2 MB/s 2024-09-10T08:39:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170843 s, 61.4 MB/s 2024-09-10T08:39:39.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.514 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167658 s, 62.5 MB/s 2024-09-10T08:39:39.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132416 s, 79.2 MB/s 2024-09-10T08:39:39.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015763 s, 66.5 MB/s 2024-09-10T08:39:39.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016946 s, 61.9 MB/s 2024-09-10T08:39:39.585 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.586 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.586 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131092 s, 80.0 MB/s 2024-09-10T08:39:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013187 s, 79.5 MB/s 2024-09-10T08:39:39.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.619 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135004 s, 77.7 MB/s 2024-09-10T08:39:39.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.638 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.638 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154549 s, 67.8 MB/s 2024-09-10T08:39:39.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142043 s, 73.8 MB/s 2024-09-10T08:39:39.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.672 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132244 s, 79.3 MB/s 2024-09-10T08:39:39.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.687 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011291 s, 92.9 MB/s 2024-09-10T08:39:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.704 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132068 s, 79.4 MB/s 2024-09-10T08:39:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138377 s, 75.8 MB/s 2024-09-10T08:39:39.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.737 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134447 s, 78.0 MB/s 2024-09-10T08:39:39.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.753 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013728 s, 76.4 MB/s 2024-09-10T08:39:39.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153915 s, 68.1 MB/s 2024-09-10T08:39:39.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150909 s, 69.5 MB/s 2024-09-10T08:39:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.810 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162854 s, 64.4 MB/s 2024-09-10T08:39:39.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132643 s, 79.1 MB/s 2024-09-10T08:39:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138281 s, 75.8 MB/s 2024-09-10T08:39:39.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.861 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013545 s, 77.4 MB/s 2024-09-10T08:39:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134765 s, 77.8 MB/s 2024-09-10T08:39:39.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127132 s, 82.5 MB/s 2024-09-10T08:39:39.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135539 s, 77.4 MB/s 2024-09-10T08:39:39.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:39.920 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:39.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:40.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142629 s, 73.5 MB/s 2024-09-10T08:39:40.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134017 s, 78.2 MB/s 2024-09-10T08:39:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.052 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125656 s, 83.4 MB/s 2024-09-10T08:39:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013234 s, 79.2 MB/s 2024-09-10T08:39:40.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168033 s, 62.4 MB/s 2024-09-10T08:39:40.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160374 s, 65.4 MB/s 2024-09-10T08:39:40.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123789 s, 84.7 MB/s 2024-09-10T08:39:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.140 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128041 s, 81.9 MB/s 2024-09-10T08:39:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134474 s, 78.0 MB/s 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129181 s, 81.2 MB/s 2024-09-10T08:39:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134226 s, 78.1 MB/s 2024-09-10T08:39:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164375 s, 63.8 MB/s 2024-09-10T08:39:40.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.226 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.226 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136036 s, 77.1 MB/s 2024-09-10T08:39:40.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.246 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166813 s, 62.9 MB/s 2024-09-10T08:39:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.266 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169527 s, 61.9 MB/s 2024-09-10T08:39:40.283 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.283 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.283 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137098 s, 76.5 MB/s 2024-09-10T08:39:40.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.299 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.299 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012645 s, 82.9 MB/s 2024-09-10T08:39:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.320 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016878 s, 62.1 MB/s 2024-09-10T08:39:40.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164451 s, 63.8 MB/s 2024-09-10T08:39:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135142 s, 77.6 MB/s 2024-09-10T08:39:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121368 s, 86.4 MB/s 2024-09-10T08:39:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167108 s, 62.7 MB/s 2024-09-10T08:39:40.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132303 s, 79.3 MB/s 2024-09-10T08:39:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130715 s, 80.2 MB/s 2024-09-10T08:39:40.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141312 s, 74.2 MB/s 2024-09-10T08:39:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.459 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133896 s, 78.3 MB/s 2024-09-10T08:39:40.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167367 s, 62.7 MB/s 2024-09-10T08:39:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.499 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163255 s, 64.2 MB/s 2024-09-10T08:39:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166117 s, 63.1 MB/s 2024-09-10T08:39:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159632 s, 65.7 MB/s 2024-09-10T08:39:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130318 s, 80.5 MB/s 2024-09-10T08:39:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135967 s, 77.1 MB/s 2024-09-10T08:39:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:40.580 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:40.580 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:40.580 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T08:39:40.580 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:40.580 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:40.581 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:40.581 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.681 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139436 s, 75.2 MB/s 2024-09-10T08:39:40.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.702 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017147 s, 61.2 MB/s 2024-09-10T08:39:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130385 s, 80.4 MB/s 2024-09-10T08:39:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135076 s, 77.6 MB/s 2024-09-10T08:39:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.750 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130744 s, 80.2 MB/s 2024-09-10T08:39:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161734 s, 64.8 MB/s 2024-09-10T08:39:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124147 s, 84.5 MB/s 2024-09-10T08:39:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130894 s, 80.1 MB/s 2024-09-10T08:39:40.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126494 s, 82.9 MB/s 2024-09-10T08:39:40.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017554 s, 59.7 MB/s 2024-09-10T08:39:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129291 s, 81.1 MB/s 2024-09-10T08:39:40.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.872 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139498 s, 75.2 MB/s 2024-09-10T08:39:40.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162823 s, 64.4 MB/s 2024-09-10T08:39:40.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.908 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127525 s, 82.2 MB/s 2024-09-10T08:39:40.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013433 s, 78.1 MB/s 2024-09-10T08:39:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171721 s, 61.1 MB/s 2024-09-10T08:39:40.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128697 s, 81.5 MB/s 2024-09-10T08:39:40.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134275 s, 78.1 MB/s 2024-09-10T08:39:40.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:40.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:40.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136667 s, 76.7 MB/s 2024-09-10T08:39:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.012 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141058 s, 74.3 MB/s 2024-09-10T08:39:41.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.028 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129564 s, 80.9 MB/s 2024-09-10T08:39:41.044 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130576 s, 80.3 MB/s 2024-09-10T08:39:41.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137249 s, 76.4 MB/s 2024-09-10T08:39:41.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135087 s, 77.6 MB/s 2024-09-10T08:39:41.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.095 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129024 s, 81.3 MB/s 2024-09-10T08:39:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141562 s, 74.1 MB/s 2024-09-10T08:39:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130129 s, 80.6 MB/s 2024-09-10T08:39:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.146 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133607 s, 78.5 MB/s 2024-09-10T08:39:41.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133105 s, 78.8 MB/s 2024-09-10T08:39:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133181 s, 78.7 MB/s 2024-09-10T08:39:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129781 s, 80.8 MB/s 2024-09-10T08:39:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158793 s, 66.0 MB/s 2024-09-10T08:39:41.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:41.223 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:41.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:41.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.323 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013774 s, 76.1 MB/s 2024-09-10T08:39:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013892 s, 75.5 MB/s 2024-09-10T08:39:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133349 s, 78.6 MB/s 2024-09-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.377 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162009 s, 64.7 MB/s 2024-09-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.397 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170388 s, 61.5 MB/s 2024-09-10T08:39:41.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.417 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162209 s, 64.6 MB/s 2024-09-10T08:39:41.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158155 s, 66.3 MB/s 2024-09-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.452 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137331 s, 76.4 MB/s 2024-09-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.469 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138686 s, 75.6 MB/s 2024-09-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127341 s, 82.3 MB/s 2024-09-10T08:39:41.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.503 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140252 s, 74.8 MB/s 2024-09-10T08:39:41.517 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.517 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.517 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112779 s, 93.0 MB/s 2024-09-10T08:39:41.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.533 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118901 s, 88.2 MB/s 2024-09-10T08:39:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.550 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139771 s, 75.0 MB/s 2024-09-10T08:39:41.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126927 s, 82.6 MB/s 2024-09-10T08:39:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129832 s, 80.8 MB/s 2024-09-10T08:39:41.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126837 s, 82.7 MB/s 2024-09-10T08:39:41.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.615 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136858 s, 76.6 MB/s 2024-09-10T08:39:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166604 s, 62.9 MB/s 2024-09-10T08:39:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167483 s, 62.6 MB/s 2024-09-10T08:39:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132979 s, 78.9 MB/s 2024-09-10T08:39:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173462 s, 60.4 MB/s 2024-09-10T08:39:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128182 s, 81.8 MB/s 2024-09-10T08:39:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115232 s, 91.0 MB/s 2024-09-10T08:39:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127064 s, 82.5 MB/s 2024-09-10T08:39:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130249 s, 80.5 MB/s 2024-09-10T08:39:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.775 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163718 s, 64.0 MB/s 2024-09-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160131 s, 65.5 MB/s 2024-09-10T08:39:41.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136273 s, 76.9 MB/s 2024-09-10T08:39:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139678 s, 75.1 MB/s 2024-09-10T08:39:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135612 s, 77.3 MB/s 2024-09-10T08:39:41.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132163 s, 79.3 MB/s 2024-09-10T08:39:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:41.870 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:41.871 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:41.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:41.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119301 s, 87.9 MB/s 2024-09-10T08:39:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014079 s, 74.5 MB/s 2024-09-10T08:39:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013019 s, 80.5 MB/s 2024-09-10T08:39:42.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167663 s, 62.5 MB/s 2024-09-10T08:39:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144234 s, 72.7 MB/s 2024-09-10T08:39:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142641 s, 73.5 MB/s 2024-09-10T08:39:42.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.074 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129128 s, 81.2 MB/s 2024-09-10T08:39:42.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.091 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133756 s, 78.4 MB/s 2024-09-10T08:39:42.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133221 s, 78.7 MB/s 2024-09-10T08:39:42.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.128 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016967 s, 61.8 MB/s 2024-09-10T08:39:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.144 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130473 s, 80.4 MB/s 2024-09-10T08:39:42.161 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.161 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.161 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135196 s, 77.6 MB/s 2024-09-10T08:39:42.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.178 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140509 s, 74.6 MB/s 2024-09-10T08:39:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.198 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168096 s, 62.4 MB/s 2024-09-10T08:39:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136527 s, 76.8 MB/s 2024-09-10T08:39:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136046 s, 77.1 MB/s 2024-09-10T08:39:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158108 s, 66.3 MB/s 2024-09-10T08:39:42.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.271 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.271 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165951 s, 63.2 MB/s 2024-09-10T08:39:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132032 s, 79.4 MB/s 2024-09-10T08:39:42.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124672 s, 84.1 MB/s 2024-09-10T08:39:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012641 s, 83.0 MB/s 2024-09-10T08:39:42.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137326 s, 76.4 MB/s 2024-09-10T08:39:42.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138432 s, 75.7 MB/s 2024-09-10T08:39:42.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.368 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118355 s, 88.6 MB/s 2024-09-10T08:39:42.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131857 s, 79.5 MB/s 2024-09-10T08:39:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.404 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161522 s, 64.9 MB/s 2024-09-10T08:39:42.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167255 s, 62.7 MB/s 2024-09-10T08:39:42.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132278 s, 79.3 MB/s 2024-09-10T08:39:42.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159875 s, 65.6 MB/s 2024-09-10T08:39:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.476 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134464 s, 78.0 MB/s 2024-09-10T08:39:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136807 s, 76.6 MB/s 2024-09-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129211 s, 81.2 MB/s 2024-09-10T08:39:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:42.518 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:42.519 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:42.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:42.619 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130406 s, 80.4 MB/s 2024-09-10T08:39:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.640 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165863 s, 63.2 MB/s 2024-09-10T08:39:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127338 s, 82.3 MB/s 2024-09-10T08:39:42.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.672 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013258 s, 79.1 MB/s 2024-09-10T08:39:42.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165817 s, 63.2 MB/s 2024-09-10T08:39:42.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.711 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015267 s, 68.7 MB/s 2024-09-10T08:39:42.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.731 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162491 s, 64.5 MB/s 2024-09-10T08:39:42.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.747 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135758 s, 77.2 MB/s 2024-09-10T08:39:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.766 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138241 s, 75.9 MB/s 2024-09-10T08:39:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.781 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130848 s, 80.1 MB/s 2024-09-10T08:39:42.800 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.800 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.800 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015976 s, 65.6 MB/s 2024-09-10T08:39:42.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134302 s, 78.1 MB/s 2024-09-10T08:39:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182844 s, 57.3 MB/s 2024-09-10T08:39:42.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130376 s, 80.4 MB/s 2024-09-10T08:39:42.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.872 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136464 s, 76.8 MB/s 2024-09-10T08:39:42.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140784 s, 74.5 MB/s 2024-09-10T08:39:42.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189055 s, 55.5 MB/s 2024-09-10T08:39:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137496 s, 76.3 MB/s 2024-09-10T08:39:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172968 s, 60.6 MB/s 2024-09-10T08:39:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141515 s, 74.1 MB/s 2024-09-10T08:39:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125888 s, 83.3 MB/s 2024-09-10T08:39:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136032 s, 77.1 MB/s 2024-09-10T08:39:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172385 s, 60.8 MB/s 2024-09-10T08:39:43.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016451 s, 63.7 MB/s 2024-09-10T08:39:43.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135158 s, 77.6 MB/s 2024-09-10T08:39:43.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.074 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126615 s, 82.8 MB/s 2024-09-10T08:39:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.090 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128892 s, 81.4 MB/s 2024-09-10T08:39:43.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135242 s, 77.5 MB/s 2024-09-10T08:39:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013056 s, 80.3 MB/s 2024-09-10T08:39:43.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.140 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138582 s, 75.7 MB/s 2024-09-10T08:39:43.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.157 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.157 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131707 s, 79.6 MB/s 2024-09-10T08:39:43.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131427 s, 79.8 MB/s 2024-09-10T08:39:43.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:43.182 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:43.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158983 s, 66.0 MB/s 2024-09-10T08:39:43.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015532 s, 67.5 MB/s 2024-09-10T08:39:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012517 s, 83.8 MB/s 2024-09-10T08:39:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.338 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163429 s, 64.2 MB/s 2024-09-10T08:39:43.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129721 s, 80.8 MB/s 2024-09-10T08:39:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115005 s, 91.2 MB/s 2024-09-10T08:39:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129241 s, 81.1 MB/s 2024-09-10T08:39:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126688 s, 82.8 MB/s 2024-09-10T08:39:43.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171859 s, 61.0 MB/s 2024-09-10T08:39:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130463 s, 80.4 MB/s 2024-09-10T08:39:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119961 s, 87.4 MB/s 2024-09-10T08:39:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.469 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131187 s, 79.9 MB/s 2024-09-10T08:39:43.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.489 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.489 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167024 s, 62.8 MB/s 2024-09-10T08:39:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.504 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114794 s, 91.3 MB/s 2024-09-10T08:39:43.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133806 s, 78.4 MB/s 2024-09-10T08:39:43.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.540 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159316 s, 65.8 MB/s 2024-09-10T08:39:43.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013898 s, 75.4 MB/s 2024-09-10T08:39:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124977 s, 83.9 MB/s 2024-09-10T08:39:43.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.590 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132097 s, 79.4 MB/s 2024-09-10T08:39:43.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137804 s, 76.1 MB/s 2024-09-10T08:39:43.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.626 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.626 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155134 s, 67.6 MB/s 2024-09-10T08:39:43.645 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163644 s, 64.1 MB/s 2024-09-10T08:39:43.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.662 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131427 s, 79.8 MB/s 2024-09-10T08:39:43.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.679 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.679 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134111 s, 78.2 MB/s 2024-09-10T08:39:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.699 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016633 s, 63.0 MB/s 2024-09-10T08:39:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133432 s, 78.6 MB/s 2024-09-10T08:39:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.736 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166484 s, 63.0 MB/s 2024-09-10T08:39:43.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167148 s, 62.7 MB/s 2024-09-10T08:39:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.775 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163223 s, 64.2 MB/s 2024-09-10T08:39:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016004 s, 65.5 MB/s 2024-09-10T08:39:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133028 s, 78.8 MB/s 2024-09-10T08:39:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126732 s, 82.7 MB/s 2024-09-10T08:39:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:43.837 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:43.837 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:43.837 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T08:39:43.837 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:43.838 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:43.838 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:43.838 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:43.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:43.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134057 s, 78.2 MB/s 2024-09-10T08:39:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176157 s, 59.5 MB/s 2024-09-10T08:39:43.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:43.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:43.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171365 s, 61.2 MB/s 2024-09-10T08:39:44.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.002 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163842 s, 64.0 MB/s 2024-09-10T08:39:44.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.018 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162335 s, 64.6 MB/s 2024-09-10T08:39:44.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.034 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131991 s, 79.4 MB/s 2024-09-10T08:39:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170608 s, 61.5 MB/s 2024-09-10T08:39:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.071 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01307 s, 80.2 MB/s 2024-09-10T08:39:44.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.090 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161236 s, 65.0 MB/s 2024-09-10T08:39:44.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134146 s, 78.2 MB/s 2024-09-10T08:39:44.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.127 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.127 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161089 s, 65.1 MB/s 2024-09-10T08:39:44.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126793 s, 82.7 MB/s 2024-09-10T08:39:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131859 s, 79.5 MB/s 2024-09-10T08:39:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176512 s, 59.4 MB/s 2024-09-10T08:39:44.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.194 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.194 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110077 s, 95.3 MB/s 2024-09-10T08:39:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.213 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159267 s, 65.8 MB/s 2024-09-10T08:39:44.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161886 s, 64.8 MB/s 2024-09-10T08:39:44.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132505 s, 79.1 MB/s 2024-09-10T08:39:44.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.265 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.265 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128547 s, 81.6 MB/s 2024-09-10T08:39:44.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162793 s, 64.4 MB/s 2024-09-10T08:39:44.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136678 s, 76.7 MB/s 2024-09-10T08:39:44.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142768 s, 73.4 MB/s 2024-09-10T08:39:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183465 s, 57.2 MB/s 2024-09-10T08:39:44.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.357 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.357 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130294 s, 80.5 MB/s 2024-09-10T08:39:44.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161723 s, 64.8 MB/s 2024-09-10T08:39:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160996 s, 65.1 MB/s 2024-09-10T08:39:44.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.412 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131863 s, 79.5 MB/s 2024-09-10T08:39:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136412 s, 76.9 MB/s 2024-09-10T08:39:44.448 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.448 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.449 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159185 s, 65.9 MB/s 2024-09-10T08:39:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137702 s, 76.1 MB/s 2024-09-10T08:39:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164051 s, 63.9 MB/s 2024-09-10T08:39:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165461 s, 63.4 MB/s 2024-09-10T08:39:44.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:44.514 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:44.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:44.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132183 s, 79.3 MB/s 2024-09-10T08:39:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128874 s, 81.4 MB/s 2024-09-10T08:39:44.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.650 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166354 s, 63.0 MB/s 2024-09-10T08:39:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130447 s, 80.4 MB/s 2024-09-10T08:39:44.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.683 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133426 s, 78.6 MB/s 2024-09-10T08:39:44.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137759 s, 76.1 MB/s 2024-09-10T08:39:44.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134184 s, 78.1 MB/s 2024-09-10T08:39:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.732 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122899 s, 85.3 MB/s 2024-09-10T08:39:44.749 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.749 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.749 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136162 s, 77.0 MB/s 2024-09-10T08:39:44.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.766 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136074 s, 77.1 MB/s 2024-09-10T08:39:44.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170458 s, 61.5 MB/s 2024-09-10T08:39:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129559 s, 80.9 MB/s 2024-09-10T08:39:44.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.819 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130732 s, 80.2 MB/s 2024-09-10T08:39:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131141 s, 80.0 MB/s 2024-09-10T08:39:44.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169515 s, 61.9 MB/s 2024-09-10T08:39:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.876 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168001 s, 62.4 MB/s 2024-09-10T08:39:44.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.892 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133934 s, 78.3 MB/s 2024-09-10T08:39:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.908 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130169 s, 80.6 MB/s 2024-09-10T08:39:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135321 s, 77.5 MB/s 2024-09-10T08:39:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164393 s, 63.8 MB/s 2024-09-10T08:39:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159624 s, 65.7 MB/s 2024-09-10T08:39:44.981 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.981 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.981 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142325 s, 73.7 MB/s 2024-09-10T08:39:44.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:44.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:44.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123601 s, 84.8 MB/s 2024-09-10T08:39:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132614 s, 79.1 MB/s 2024-09-10T08:39:45.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131315 s, 79.9 MB/s 2024-09-10T08:39:45.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.049 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161657 s, 64.9 MB/s 2024-09-10T08:39:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118349 s, 88.6 MB/s 2024-09-10T08:39:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130324 s, 80.5 MB/s 2024-09-10T08:39:45.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169916 s, 61.7 MB/s 2024-09-10T08:39:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.116 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126799 s, 82.7 MB/s 2024-09-10T08:39:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165575 s, 63.3 MB/s 2024-09-10T08:39:45.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130682 s, 80.2 MB/s 2024-09-10T08:39:45.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:45.162 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:45.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:45.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132421 s, 79.2 MB/s 2024-09-10T08:39:45.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146374 s, 71.6 MB/s 2024-09-10T08:39:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014016 s, 74.8 MB/s 2024-09-10T08:39:45.315 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159884 s, 65.6 MB/s 2024-09-10T08:39:45.332 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.333 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133616 s, 78.5 MB/s 2024-09-10T08:39:45.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.349 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130995 s, 80.0 MB/s 2024-09-10T08:39:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132221 s, 79.3 MB/s 2024-09-10T08:39:45.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.383 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138031 s, 76.0 MB/s 2024-09-10T08:39:45.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.399 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131394 s, 79.8 MB/s 2024-09-10T08:39:45.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.417 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139712 s, 75.1 MB/s 2024-09-10T08:39:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138329 s, 75.8 MB/s 2024-09-10T08:39:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129569 s, 80.9 MB/s 2024-09-10T08:39:45.466 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.466 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.467 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131758 s, 79.6 MB/s 2024-09-10T08:39:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136839 s, 76.6 MB/s 2024-09-10T08:39:45.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.499 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126852 s, 82.7 MB/s 2024-09-10T08:39:45.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.517 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133631 s, 78.5 MB/s 2024-09-10T08:39:45.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.533 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.533 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135383 s, 77.5 MB/s 2024-09-10T08:39:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136618 s, 76.8 MB/s 2024-09-10T08:39:45.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130103 s, 80.6 MB/s 2024-09-10T08:39:45.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130765 s, 80.2 MB/s 2024-09-10T08:39:45.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138921 s, 75.5 MB/s 2024-09-10T08:39:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.621 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016758 s, 62.6 MB/s 2024-09-10T08:39:45.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.637 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.637 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137191 s, 76.4 MB/s 2024-09-10T08:39:45.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135945 s, 77.1 MB/s 2024-09-10T08:39:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.670 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127018 s, 82.6 MB/s 2024-09-10T08:39:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126351 s, 83.0 MB/s 2024-09-10T08:39:45.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.703 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.703 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013277 s, 79.0 MB/s 2024-09-10T08:39:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.720 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135345 s, 77.5 MB/s 2024-09-10T08:39:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122935 s, 85.3 MB/s 2024-09-10T08:39:45.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129955 s, 80.7 MB/s 2024-09-10T08:39:45.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169939 s, 61.7 MB/s 2024-09-10T08:39:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131992 s, 79.4 MB/s 2024-09-10T08:39:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:45.797 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:45.797 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:45.798 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T08:39:45.798 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:45.798 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:45.798 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:45.798 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:45.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.898 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149182 s, 70.3 MB/s 2024-09-10T08:39:45.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157059 s, 66.8 MB/s 2024-09-10T08:39:45.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016417 s, 63.9 MB/s 2024-09-10T08:39:45.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175188 s, 59.9 MB/s 2024-09-10T08:39:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.975 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143381 s, 73.1 MB/s 2024-09-10T08:39:45.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:45.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:45.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133322 s, 78.7 MB/s 2024-09-10T08:39:46.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118525 s, 88.5 MB/s 2024-09-10T08:39:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109268 s, 96.0 MB/s 2024-09-10T08:39:46.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175871 s, 59.6 MB/s 2024-09-10T08:39:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132108 s, 79.4 MB/s 2024-09-10T08:39:46.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.078 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158083 s, 66.3 MB/s 2024-09-10T08:39:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133999 s, 78.3 MB/s 2024-09-10T08:39:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135167 s, 77.6 MB/s 2024-09-10T08:39:46.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.130 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.131 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162193 s, 64.7 MB/s 2024-09-10T08:39:46.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.149 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155938 s, 67.2 MB/s 2024-09-10T08:39:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125283 s, 83.7 MB/s 2024-09-10T08:39:46.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134083 s, 78.2 MB/s 2024-09-10T08:39:46.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.199 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013404 s, 78.2 MB/s 2024-09-10T08:39:46.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164802 s, 63.6 MB/s 2024-09-10T08:39:46.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.236 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133647 s, 78.5 MB/s 2024-09-10T08:39:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131556 s, 79.7 MB/s 2024-09-10T08:39:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135281 s, 77.5 MB/s 2024-09-10T08:39:46.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.285 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132029 s, 79.4 MB/s 2024-09-10T08:39:46.305 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.305 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.305 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166686 s, 62.9 MB/s 2024-09-10T08:39:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135279 s, 77.5 MB/s 2024-09-10T08:39:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171477 s, 61.1 MB/s 2024-09-10T08:39:46.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.359 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013436 s, 78.0 MB/s 2024-09-10T08:39:46.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.376 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.376 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137553 s, 76.2 MB/s 2024-09-10T08:39:46.395 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016572 s, 63.3 MB/s 2024-09-10T08:39:46.415 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.415 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164649 s, 63.7 MB/s 2024-09-10T08:39:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.430 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112445 s, 93.3 MB/s 2024-09-10T08:39:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136871 s, 76.6 MB/s 2024-09-10T08:39:46.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:46.456 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:46.457 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:46.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:46.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.556 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131394 s, 79.8 MB/s 2024-09-10T08:39:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129836 s, 80.8 MB/s 2024-09-10T08:39:46.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134186 s, 78.1 MB/s 2024-09-10T08:39:46.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136862 s, 76.6 MB/s 2024-09-10T08:39:46.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013249 s, 79.1 MB/s 2024-09-10T08:39:46.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169546 s, 61.8 MB/s 2024-09-10T08:39:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159507 s, 65.7 MB/s 2024-09-10T08:39:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.681 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167296 s, 62.7 MB/s 2024-09-10T08:39:46.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.699 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137816 s, 76.1 MB/s 2024-09-10T08:39:46.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.718 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160264 s, 65.4 MB/s 2024-09-10T08:39:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138758 s, 75.6 MB/s 2024-09-10T08:39:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135309 s, 77.5 MB/s 2024-09-10T08:39:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132674 s, 79.0 MB/s 2024-09-10T08:39:46.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.784 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131079 s, 80.0 MB/s 2024-09-10T08:39:46.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.803 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158445 s, 66.2 MB/s 2024-09-10T08:39:46.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.820 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134037 s, 78.2 MB/s 2024-09-10T08:39:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127588 s, 82.2 MB/s 2024-09-10T08:39:46.853 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.853 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.853 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131228 s, 79.9 MB/s 2024-09-10T08:39:46.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.869 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.869 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134793 s, 77.8 MB/s 2024-09-10T08:39:46.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.886 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138604 s, 75.7 MB/s 2024-09-10T08:39:46.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167296 s, 62.7 MB/s 2024-09-10T08:39:46.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.923 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.923 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137872 s, 76.1 MB/s 2024-09-10T08:39:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.940 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013561 s, 77.3 MB/s 2024-09-10T08:39:46.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171814 s, 61.0 MB/s 2024-09-10T08:39:46.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147836 s, 70.9 MB/s 2024-09-10T08:39:46.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:46.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:46.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138562 s, 75.7 MB/s 2024-09-10T08:39:47.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.014 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139818 s, 75.0 MB/s 2024-09-10T08:39:47.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133247 s, 78.7 MB/s 2024-09-10T08:39:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126204 s, 83.1 MB/s 2024-09-10T08:39:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133727 s, 78.4 MB/s 2024-09-10T08:39:47.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139869 s, 75.0 MB/s 2024-09-10T08:39:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131472 s, 79.8 MB/s 2024-09-10T08:39:47.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:47.105 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:47.106 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:47.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138457 s, 75.7 MB/s 2024-09-10T08:39:47.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132535 s, 79.1 MB/s 2024-09-10T08:39:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161104 s, 65.1 MB/s 2024-09-10T08:39:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135402 s, 77.4 MB/s 2024-09-10T08:39:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127235 s, 82.4 MB/s 2024-09-10T08:39:47.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143411 s, 73.1 MB/s 2024-09-10T08:39:47.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.310 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133314 s, 78.7 MB/s 2024-09-10T08:39:47.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131473 s, 79.8 MB/s 2024-09-10T08:39:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133067 s, 78.8 MB/s 2024-09-10T08:39:47.358 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.358 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.358 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130051 s, 80.6 MB/s 2024-09-10T08:39:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012993 s, 80.7 MB/s 2024-09-10T08:39:47.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.394 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163871 s, 64.0 MB/s 2024-09-10T08:39:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.412 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146723 s, 71.5 MB/s 2024-09-10T08:39:47.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.430 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141578 s, 74.1 MB/s 2024-09-10T08:39:47.446 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133728 s, 78.4 MB/s 2024-09-10T08:39:47.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.463 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128131 s, 81.8 MB/s 2024-09-10T08:39:47.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.479 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.479 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130629 s, 80.3 MB/s 2024-09-10T08:39:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170255 s, 61.6 MB/s 2024-09-10T08:39:47.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.515 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122384 s, 85.7 MB/s 2024-09-10T08:39:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141111 s, 74.3 MB/s 2024-09-10T08:39:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.548 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125447 s, 83.6 MB/s 2024-09-10T08:39:47.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120672 s, 86.9 MB/s 2024-09-10T08:39:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162017 s, 64.7 MB/s 2024-09-10T08:39:47.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135043 s, 77.6 MB/s 2024-09-10T08:39:47.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.616 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133866 s, 78.3 MB/s 2024-09-10T08:39:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136997 s, 76.5 MB/s 2024-09-10T08:39:47.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.650 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134751 s, 77.8 MB/s 2024-09-10T08:39:47.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.667 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135732 s, 77.3 MB/s 2024-09-10T08:39:47.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.683 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138171 s, 75.9 MB/s 2024-09-10T08:39:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130776 s, 80.2 MB/s 2024-09-10T08:39:47.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.720 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159639 s, 65.7 MB/s 2024-09-10T08:39:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160661 s, 65.3 MB/s 2024-09-10T08:39:47.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:47.749 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:47.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:47.852 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.852 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.852 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147895 s, 70.9 MB/s 2024-09-10T08:39:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153687 s, 68.2 MB/s 2024-09-10T08:39:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190141 s, 55.1 MB/s 2024-09-10T08:39:47.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.909 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.909 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133503 s, 78.5 MB/s 2024-09-10T08:39:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137065 s, 76.5 MB/s 2024-09-10T08:39:47.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136907 s, 76.6 MB/s 2024-09-10T08:39:47.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014399 s, 72.8 MB/s 2024-09-10T08:39:47.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131186 s, 79.9 MB/s 2024-09-10T08:39:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134966 s, 77.7 MB/s 2024-09-10T08:39:48.014 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.015 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170117 s, 61.6 MB/s 2024-09-10T08:39:48.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.031 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133653 s, 78.5 MB/s 2024-09-10T08:39:48.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131354 s, 79.8 MB/s 2024-09-10T08:39:48.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.064 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130394 s, 80.4 MB/s 2024-09-10T08:39:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.080 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135243 s, 77.5 MB/s 2024-09-10T08:39:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.100 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162838 s, 64.4 MB/s 2024-09-10T08:39:48.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.116 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133479 s, 78.6 MB/s 2024-09-10T08:39:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169357 s, 61.9 MB/s 2024-09-10T08:39:48.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128399 s, 81.7 MB/s 2024-09-10T08:39:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129309 s, 81.1 MB/s 2024-09-10T08:39:48.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139607 s, 75.1 MB/s 2024-09-10T08:39:48.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.202 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.202 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138389 s, 75.8 MB/s 2024-09-10T08:39:48.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.220 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139357 s, 75.2 MB/s 2024-09-10T08:39:48.233 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010864 s, 96.5 MB/s 2024-09-10T08:39:48.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.253 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155567 s, 67.4 MB/s 2024-09-10T08:39:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134421 s, 78.0 MB/s 2024-09-10T08:39:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160152 s, 65.5 MB/s 2024-09-10T08:39:48.305 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.306 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140399 s, 74.7 MB/s 2024-09-10T08:39:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.323 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139997 s, 74.9 MB/s 2024-09-10T08:39:48.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.340 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.340 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127804 s, 82.0 MB/s 2024-09-10T08:39:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121543 s, 86.3 MB/s 2024-09-10T08:39:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.372 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013398 s, 78.3 MB/s 2024-09-10T08:39:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155257 s, 67.5 MB/s 2024-09-10T08:39:48.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:48.401 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:48.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135949 s, 77.1 MB/s 2024-09-10T08:39:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.524 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165552 s, 63.3 MB/s 2024-09-10T08:39:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01347 s, 77.8 MB/s 2024-09-10T08:39:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.556 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136663 s, 76.7 MB/s 2024-09-10T08:39:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130644 s, 80.3 MB/s 2024-09-10T08:39:48.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134295 s, 78.1 MB/s 2024-09-10T08:39:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.606 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135092 s, 77.6 MB/s 2024-09-10T08:39:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132297 s, 79.3 MB/s 2024-09-10T08:39:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.638 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123522 s, 84.9 MB/s 2024-09-10T08:39:48.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012731 s, 82.4 MB/s 2024-09-10T08:39:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155826 s, 67.3 MB/s 2024-09-10T08:39:48.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141476 s, 74.1 MB/s 2024-09-10T08:39:48.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.711 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169444 s, 61.9 MB/s 2024-09-10T08:39:48.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139704 s, 75.1 MB/s 2024-09-10T08:39:48.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.745 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132563 s, 79.1 MB/s 2024-09-10T08:39:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133771 s, 78.4 MB/s 2024-09-10T08:39:48.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.779 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142499 s, 73.6 MB/s 2024-09-10T08:39:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133958 s, 78.3 MB/s 2024-09-10T08:39:48.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126636 s, 82.8 MB/s 2024-09-10T08:39:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119054 s, 88.1 MB/s 2024-09-10T08:39:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014512 s, 72.3 MB/s 2024-09-10T08:39:48.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165756 s, 63.3 MB/s 2024-09-10T08:39:48.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.881 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01349 s, 77.7 MB/s 2024-09-10T08:39:48.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.895 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108811 s, 96.4 MB/s 2024-09-10T08:39:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.911 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128177 s, 81.8 MB/s 2024-09-10T08:39:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131083 s, 80.0 MB/s 2024-09-10T08:39:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156164 s, 67.1 MB/s 2024-09-10T08:39:48.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142715 s, 73.5 MB/s 2024-09-10T08:39:48.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.978 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.978 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117344 s, 89.4 MB/s 2024-09-10T08:39:48.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:48.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127377 s, 82.3 MB/s 2024-09-10T08:39:49.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166106 s, 63.1 MB/s 2024-09-10T08:39:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.032 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158963 s, 66.0 MB/s 2024-09-10T08:39:49.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:49.042 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:49.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:49.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127393 s, 82.3 MB/s 2024-09-10T08:39:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123353 s, 85.0 MB/s 2024-09-10T08:39:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.173 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013019 s, 80.5 MB/s 2024-09-10T08:39:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158595 s, 66.1 MB/s 2024-09-10T08:39:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158406 s, 66.2 MB/s 2024-09-10T08:39:49.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.231 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159768 s, 65.6 MB/s 2024-09-10T08:39:49.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.245 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117152 s, 89.5 MB/s 2024-09-10T08:39:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108684 s, 96.5 MB/s 2024-09-10T08:39:49.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012833 s, 81.7 MB/s 2024-09-10T08:39:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143769 s, 72.9 MB/s 2024-09-10T08:39:49.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.312 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01589 s, 66.0 MB/s 2024-09-10T08:39:49.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.330 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.330 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151138 s, 69.4 MB/s 2024-09-10T08:39:49.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.347 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.347 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132756 s, 79.0 MB/s 2024-09-10T08:39:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152477 s, 68.8 MB/s 2024-09-10T08:39:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128354 s, 81.7 MB/s 2024-09-10T08:39:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134848 s, 77.8 MB/s 2024-09-10T08:39:49.415 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130699 s, 80.2 MB/s 2024-09-10T08:39:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.433 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134692 s, 77.9 MB/s 2024-09-10T08:39:49.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.450 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138893 s, 75.5 MB/s 2024-09-10T08:39:49.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.470 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163187 s, 64.3 MB/s 2024-09-10T08:39:49.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132877 s, 78.9 MB/s 2024-09-10T08:39:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.504 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131695 s, 79.6 MB/s 2024-09-10T08:39:49.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.521 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129639 s, 80.9 MB/s 2024-09-10T08:39:49.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.537 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126542 s, 82.9 MB/s 2024-09-10T08:39:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129046 s, 81.3 MB/s 2024-09-10T08:39:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120062 s, 87.3 MB/s 2024-09-10T08:39:49.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165547 s, 63.3 MB/s 2024-09-10T08:39:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.605 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133297 s, 78.7 MB/s 2024-09-10T08:39:49.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.623 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135441 s, 77.4 MB/s 2024-09-10T08:39:49.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.643 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168356 s, 62.3 MB/s 2024-09-10T08:39:49.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.662 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156371 s, 67.1 MB/s 2024-09-10T08:39:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171466 s, 61.2 MB/s 2024-09-10T08:39:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:49.691 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:49.691 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:49.691 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T08:39:49.691 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:49.692 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:49.692 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:49.692 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163209 s, 64.2 MB/s 2024-09-10T08:39:49.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016278 s, 64.4 MB/s 2024-09-10T08:39:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.831 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013752 s, 76.2 MB/s 2024-09-10T08:39:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125387 s, 83.6 MB/s 2024-09-10T08:39:49.862 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130372 s, 80.4 MB/s 2024-09-10T08:39:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138311 s, 75.8 MB/s 2024-09-10T08:39:49.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163118 s, 64.3 MB/s 2024-09-10T08:39:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133809 s, 78.4 MB/s 2024-09-10T08:39:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133322 s, 78.6 MB/s 2024-09-10T08:39:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.950 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135937 s, 77.1 MB/s 2024-09-10T08:39:49.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.967 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134113 s, 78.2 MB/s 2024-09-10T08:39:49.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:49.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:49.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163326 s, 64.2 MB/s 2024-09-10T08:39:50.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.002 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126505 s, 82.9 MB/s 2024-09-10T08:39:50.017 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.018 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125074 s, 83.8 MB/s 2024-09-10T08:39:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.038 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172582 s, 60.8 MB/s 2024-09-10T08:39:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167604 s, 62.6 MB/s 2024-09-10T08:39:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.072 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110886 s, 94.6 MB/s 2024-09-10T08:39:50.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.086 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.087 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115324 s, 90.9 MB/s 2024-09-10T08:39:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.103 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133387 s, 78.6 MB/s 2024-09-10T08:39:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141225 s, 74.2 MB/s 2024-09-10T08:39:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131677 s, 79.6 MB/s 2024-09-10T08:39:50.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.155 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.155 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142169 s, 73.8 MB/s 2024-09-10T08:39:50.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133307 s, 78.7 MB/s 2024-09-10T08:39:50.187 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.187 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.187 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124701 s, 84.1 MB/s 2024-09-10T08:39:50.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.204 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133474 s, 78.6 MB/s 2024-09-10T08:39:50.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156186 s, 67.1 MB/s 2024-09-10T08:39:50.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.238 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.238 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120554 s, 87.0 MB/s 2024-09-10T08:39:50.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.259 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169876 s, 61.7 MB/s 2024-09-10T08:39:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013354 s, 78.5 MB/s 2024-09-10T08:39:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.292 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138383 s, 75.8 MB/s 2024-09-10T08:39:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137826 s, 76.1 MB/s 2024-09-10T08:39:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.324 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121431 s, 86.4 MB/s 2024-09-10T08:39:50.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:50.334 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:50.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.434 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139576 s, 75.1 MB/s 2024-09-10T08:39:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160299 s, 65.4 MB/s 2024-09-10T08:39:50.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.471 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141243 s, 74.2 MB/s 2024-09-10T08:39:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131299 s, 79.9 MB/s 2024-09-10T08:39:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128606 s, 81.5 MB/s 2024-09-10T08:39:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017008 s, 61.7 MB/s 2024-09-10T08:39:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139761 s, 75.0 MB/s 2024-09-10T08:39:50.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.561 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165714 s, 63.3 MB/s 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.578 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128501 s, 81.6 MB/s 2024-09-10T08:39:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124751 s, 84.1 MB/s 2024-09-10T08:39:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158428 s, 66.2 MB/s 2024-09-10T08:39:50.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136326 s, 76.9 MB/s 2024-09-10T08:39:50.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013669 s, 76.7 MB/s 2024-09-10T08:39:50.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157966 s, 66.4 MB/s 2024-09-10T08:39:50.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139057 s, 75.4 MB/s 2024-09-10T08:39:50.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150894 s, 69.5 MB/s 2024-09-10T08:39:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136635 s, 76.7 MB/s 2024-09-10T08:39:50.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137993 s, 76.0 MB/s 2024-09-10T08:39:50.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.750 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127651 s, 82.1 MB/s 2024-09-10T08:39:50.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154187 s, 68.0 MB/s 2024-09-10T08:39:50.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.784 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109498 s, 95.8 MB/s 2024-09-10T08:39:50.800 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.800 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.800 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012921 s, 81.2 MB/s 2024-09-10T08:39:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012982 s, 80.8 MB/s 2024-09-10T08:39:50.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.833 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134577 s, 77.9 MB/s 2024-09-10T08:39:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011729 s, 89.4 MB/s 2024-09-10T08:39:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012873 s, 81.5 MB/s 2024-09-10T08:39:50.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.881 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136367 s, 76.9 MB/s 2024-09-10T08:39:50.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.897 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012723 s, 82.4 MB/s 2024-09-10T08:39:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131112 s, 80.0 MB/s 2024-09-10T08:39:50.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.930 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.930 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130234 s, 80.5 MB/s 2024-09-10T08:39:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.946 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130527 s, 80.3 MB/s 2024-09-10T08:39:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162473 s, 64.5 MB/s 2024-09-10T08:39:50.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:50.974 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:50.975 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:51.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132255 s, 79.3 MB/s 2024-09-10T08:39:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130894 s, 80.1 MB/s 2024-09-10T08:39:51.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.107 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130409 s, 80.4 MB/s 2024-09-10T08:39:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.126 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159737 s, 65.6 MB/s 2024-09-10T08:39:51.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.144 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134229 s, 78.1 MB/s 2024-09-10T08:39:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126788 s, 82.7 MB/s 2024-09-10T08:39:51.175 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133317 s, 78.7 MB/s 2024-09-10T08:39:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134155 s, 78.2 MB/s 2024-09-10T08:39:51.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134487 s, 78.0 MB/s 2024-09-10T08:39:51.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.224 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117118 s, 89.5 MB/s 2024-09-10T08:39:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126402 s, 83.0 MB/s 2024-09-10T08:39:51.256 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.257 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.257 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132446 s, 79.2 MB/s 2024-09-10T08:39:51.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173622 s, 60.4 MB/s 2024-09-10T08:39:51.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.294 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130065 s, 80.6 MB/s 2024-09-10T08:39:51.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.310 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136367 s, 76.9 MB/s 2024-09-10T08:39:51.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.327 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137778 s, 76.1 MB/s 2024-09-10T08:39:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.344 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134266 s, 78.1 MB/s 2024-09-10T08:39:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.363 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015689 s, 66.8 MB/s 2024-09-10T08:39:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.380 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137987 s, 76.0 MB/s 2024-09-10T08:39:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127833 s, 82.0 MB/s 2024-09-10T08:39:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149262 s, 70.3 MB/s 2024-09-10T08:39:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126907 s, 82.6 MB/s 2024-09-10T08:39:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131377 s, 79.8 MB/s 2024-09-10T08:39:51.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123547 s, 84.9 MB/s 2024-09-10T08:39:51.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.483 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.483 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167415 s, 62.6 MB/s 2024-09-10T08:39:51.499 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138521 s, 75.7 MB/s 2024-09-10T08:39:51.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.516 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126892 s, 82.6 MB/s 2024-09-10T08:39:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170246 s, 61.6 MB/s 2024-09-10T08:39:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.553 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134346 s, 78.1 MB/s 2024-09-10T08:39:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.570 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137216 s, 76.4 MB/s 2024-09-10T08:39:51.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159207 s, 65.9 MB/s 2024-09-10T08:39:51.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.609 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166175 s, 63.1 MB/s 2024-09-10T08:39:51.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:51.618 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:51.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:51.722 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170909 s, 61.4 MB/s 2024-09-10T08:39:51.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133112 s, 78.8 MB/s 2024-09-10T08:39:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138017 s, 76.0 MB/s 2024-09-10T08:39:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129488 s, 81.0 MB/s 2024-09-10T08:39:51.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134914 s, 77.7 MB/s 2024-09-10T08:39:51.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.815 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.815 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022377 s, 46.9 MB/s 2024-09-10T08:39:51.830 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.831 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.831 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130475 s, 80.4 MB/s 2024-09-10T08:39:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.847 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128869 s, 81.4 MB/s 2024-09-10T08:39:51.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013416 s, 78.2 MB/s 2024-09-10T08:39:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136253 s, 77.0 MB/s 2024-09-10T08:39:51.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165287 s, 63.4 MB/s 2024-09-10T08:39:51.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.917 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136362 s, 76.9 MB/s 2024-09-10T08:39:51.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158645 s, 66.1 MB/s 2024-09-10T08:39:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.954 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137023 s, 76.5 MB/s 2024-09-10T08:39:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133155 s, 78.7 MB/s 2024-09-10T08:39:51.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:51.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:51.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126412 s, 82.9 MB/s 2024-09-10T08:39:52.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137453 s, 76.3 MB/s 2024-09-10T08:39:52.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015686 s, 66.8 MB/s 2024-09-10T08:39:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170485 s, 61.5 MB/s 2024-09-10T08:39:52.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176017 s, 59.6 MB/s 2024-09-10T08:39:52.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.082 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154082 s, 68.1 MB/s 2024-09-10T08:39:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131208 s, 79.9 MB/s 2024-09-10T08:39:52.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145972 s, 71.8 MB/s 2024-09-10T08:39:52.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136939 s, 76.6 MB/s 2024-09-10T08:39:52.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126844 s, 82.7 MB/s 2024-09-10T08:39:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123102 s, 85.2 MB/s 2024-09-10T08:39:52.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.185 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.185 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161346 s, 65.0 MB/s 2024-09-10T08:39:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.204 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015815 s, 66.3 MB/s 2024-09-10T08:39:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.224 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168237 s, 62.3 MB/s 2024-09-10T08:39:52.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015749 s, 66.6 MB/s 2024-09-10T08:39:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134221 s, 78.1 MB/s 2024-09-10T08:39:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137546 s, 76.2 MB/s 2024-09-10T08:39:52.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:52.286 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:52.286 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:52.286 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T08:39:52.286 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:52.287 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:52.287 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:52.287 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:52.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:52.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137921 s, 76.0 MB/s 2024-09-10T08:39:52.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156477 s, 67.0 MB/s 2024-09-10T08:39:52.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015497 s, 67.7 MB/s 2024-09-10T08:39:52.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165587 s, 63.3 MB/s 2024-09-10T08:39:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134742 s, 77.8 MB/s 2024-09-10T08:39:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170514 s, 61.5 MB/s 2024-09-10T08:39:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.496 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119738 s, 87.6 MB/s 2024-09-10T08:39:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125571 s, 83.5 MB/s 2024-09-10T08:39:52.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132613 s, 79.1 MB/s 2024-09-10T08:39:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135763 s, 77.2 MB/s 2024-09-10T08:39:52.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135508 s, 77.4 MB/s 2024-09-10T08:39:52.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168446 s, 62.2 MB/s 2024-09-10T08:39:52.597 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124472 s, 84.2 MB/s 2024-09-10T08:39:52.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.615 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137188 s, 76.4 MB/s 2024-09-10T08:39:52.631 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.631 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.631 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013387 s, 78.3 MB/s 2024-09-10T08:39:52.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.651 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168587 s, 62.2 MB/s 2024-09-10T08:39:52.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.667 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127648 s, 82.1 MB/s 2024-09-10T08:39:52.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014032 s, 74.7 MB/s 2024-09-10T08:39:52.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171745 s, 61.1 MB/s 2024-09-10T08:39:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163713 s, 64.0 MB/s 2024-09-10T08:39:52.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.741 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136369 s, 76.9 MB/s 2024-09-10T08:39:52.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155942 s, 67.2 MB/s 2024-09-10T08:39:52.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.781 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171028 s, 61.3 MB/s 2024-09-10T08:39:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132645 s, 79.1 MB/s 2024-09-10T08:39:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134531 s, 77.9 MB/s 2024-09-10T08:39:52.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.836 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01872 s, 56.0 MB/s 2024-09-10T08:39:52.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.858 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176908 s, 59.3 MB/s 2024-09-10T08:39:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176554 s, 59.4 MB/s 2024-09-10T08:39:52.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.896 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139536 s, 75.1 MB/s 2024-09-10T08:39:52.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.916 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165703 s, 63.3 MB/s 2024-09-10T08:39:52.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181891 s, 57.6 MB/s 2024-09-10T08:39:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141398 s, 74.2 MB/s 2024-09-10T08:39:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:52.964 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:52.964 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:52.964 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T08:39:52.964 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:52.965 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:52.965 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:52.965 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:53.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158611 s, 66.1 MB/s 2024-09-10T08:39:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125698 s, 83.4 MB/s 2024-09-10T08:39:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173288 s, 60.5 MB/s 2024-09-10T08:39:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138653 s, 75.6 MB/s 2024-09-10T08:39:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136545 s, 76.8 MB/s 2024-09-10T08:39:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127825 s, 82.0 MB/s 2024-09-10T08:39:53.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.170 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132395 s, 79.2 MB/s 2024-09-10T08:39:53.187 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.187 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.187 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136074 s, 77.1 MB/s 2024-09-10T08:39:53.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.204 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.204 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133393 s, 78.6 MB/s 2024-09-10T08:39:53.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140416 s, 74.7 MB/s 2024-09-10T08:39:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.241 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171202 s, 61.2 MB/s 2024-09-10T08:39:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.258 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132136 s, 79.4 MB/s 2024-09-10T08:39:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.275 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137208 s, 76.4 MB/s 2024-09-10T08:39:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138312 s, 75.8 MB/s 2024-09-10T08:39:53.308 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.309 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013491 s, 77.7 MB/s 2024-09-10T08:39:53.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169636 s, 61.8 MB/s 2024-09-10T08:39:53.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.349 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.349 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168025 s, 62.4 MB/s 2024-09-10T08:39:53.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126121 s, 83.1 MB/s 2024-09-10T08:39:53.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.382 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.382 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136898 s, 76.6 MB/s 2024-09-10T08:39:53.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.399 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.399 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137979 s, 76.0 MB/s 2024-09-10T08:39:53.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.416 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139557 s, 75.1 MB/s 2024-09-10T08:39:53.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.433 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137029 s, 76.5 MB/s 2024-09-10T08:39:53.449 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132429 s, 79.2 MB/s 2024-09-10T08:39:53.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.465 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124917 s, 83.9 MB/s 2024-09-10T08:39:53.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158944 s, 66.0 MB/s 2024-09-10T08:39:53.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.501 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.501 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135629 s, 77.3 MB/s 2024-09-10T08:39:53.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.518 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.518 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134325 s, 78.1 MB/s 2024-09-10T08:39:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.535 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135942 s, 77.1 MB/s 2024-09-10T08:39:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.552 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137254 s, 76.4 MB/s 2024-09-10T08:39:53.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.569 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.569 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133735 s, 78.4 MB/s 2024-09-10T08:39:53.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167032 s, 62.8 MB/s 2024-09-10T08:39:53.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.604 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.605 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128093 s, 81.9 MB/s 2024-09-10T08:39:53.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:53.614 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:53.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165044 s, 63.5 MB/s 2024-09-10T08:39:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128367 s, 81.7 MB/s 2024-09-10T08:39:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163231 s, 64.2 MB/s 2024-09-10T08:39:53.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128201 s, 81.8 MB/s 2024-09-10T08:39:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115238 s, 91.0 MB/s 2024-09-10T08:39:53.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129528 s, 81.0 MB/s 2024-09-10T08:39:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118291 s, 88.6 MB/s 2024-09-10T08:39:53.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.834 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132053 s, 79.4 MB/s 2024-09-10T08:39:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132195 s, 79.3 MB/s 2024-09-10T08:39:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.867 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138689 s, 75.6 MB/s 2024-09-10T08:39:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012945 s, 81.0 MB/s 2024-09-10T08:39:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133742 s, 78.4 MB/s 2024-09-10T08:39:53.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.920 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166487 s, 63.0 MB/s 2024-09-10T08:39:53.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.936 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.936 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128341 s, 81.7 MB/s 2024-09-10T08:39:53.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132684 s, 79.0 MB/s 2024-09-10T08:39:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170619 s, 61.5 MB/s 2024-09-10T08:39:53.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:53.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:53.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130796 s, 80.2 MB/s 2024-09-10T08:39:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168927 s, 62.1 MB/s 2024-09-10T08:39:54.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129401 s, 81.0 MB/s 2024-09-10T08:39:54.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134193 s, 78.1 MB/s 2024-09-10T08:39:54.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135941 s, 77.1 MB/s 2024-09-10T08:39:54.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.076 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130696 s, 80.2 MB/s 2024-09-10T08:39:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128759 s, 81.4 MB/s 2024-09-10T08:39:54.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012908 s, 81.2 MB/s 2024-09-10T08:39:54.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131883 s, 79.5 MB/s 2024-09-10T08:39:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140434 s, 74.7 MB/s 2024-09-10T08:39:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155385 s, 67.5 MB/s 2024-09-10T08:39:54.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129427 s, 81.0 MB/s 2024-09-10T08:39:54.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.193 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.193 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134091 s, 78.2 MB/s 2024-09-10T08:39:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.209 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134705 s, 77.8 MB/s 2024-09-10T08:39:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012637 s, 83.0 MB/s 2024-09-10T08:39:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.243 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136739 s, 76.7 MB/s 2024-09-10T08:39:54.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:54.252 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:54.252 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:54.252 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T08:39:54.252 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:54.252 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:54.253 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:54.253 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:54.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:54.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138763 s, 75.6 MB/s 2024-09-10T08:39:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114503 s, 91.6 MB/s 2024-09-10T08:39:54.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.384 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130668 s, 80.2 MB/s 2024-09-10T08:39:54.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.403 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161065 s, 65.1 MB/s 2024-09-10T08:39:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134235 s, 78.1 MB/s 2024-09-10T08:39:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133212 s, 78.7 MB/s 2024-09-10T08:39:54.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154148 s, 68.0 MB/s 2024-09-10T08:39:54.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166838 s, 62.8 MB/s 2024-09-10T08:39:54.491 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.491 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.491 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129823 s, 80.8 MB/s 2024-09-10T08:39:54.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.508 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130437 s, 80.4 MB/s 2024-09-10T08:39:54.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.523 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126542 s, 82.9 MB/s 2024-09-10T08:39:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012863 s, 81.5 MB/s 2024-09-10T08:39:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.556 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129215 s, 81.1 MB/s 2024-09-10T08:39:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013528 s, 77.5 MB/s 2024-09-10T08:39:54.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130754 s, 80.2 MB/s 2024-09-10T08:39:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.606 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.607 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144518 s, 72.6 MB/s 2024-09-10T08:39:54.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.623 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.623 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130404 s, 80.4 MB/s 2024-09-10T08:39:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132885 s, 78.9 MB/s 2024-09-10T08:39:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115695 s, 90.6 MB/s 2024-09-10T08:39:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172318 s, 60.9 MB/s 2024-09-10T08:39:54.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132202 s, 79.3 MB/s 2024-09-10T08:39:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135559 s, 77.4 MB/s 2024-09-10T08:39:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134124 s, 78.2 MB/s 2024-09-10T08:39:54.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133679 s, 78.4 MB/s 2024-09-10T08:39:54.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.758 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.759 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129882 s, 80.7 MB/s 2024-09-10T08:39:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127385 s, 82.3 MB/s 2024-09-10T08:39:54.791 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.791 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.791 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132913 s, 78.9 MB/s 2024-09-10T08:39:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137707 s, 76.1 MB/s 2024-09-10T08:39:54.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159639 s, 65.7 MB/s 2024-09-10T08:39:54.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.844 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135948 s, 77.1 MB/s 2024-09-10T08:39:54.860 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.861 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137021 s, 76.5 MB/s 2024-09-10T08:39:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129529 s, 81.0 MB/s 2024-09-10T08:39:54.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:54.886 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:54.886 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:54.886 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T08:39:54.886 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:54.887 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:54.887 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:54.887 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:54.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149569 s, 70.1 MB/s 2024-09-10T08:39:55.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132286 s, 79.3 MB/s 2024-09-10T08:39:55.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.022 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.022 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143776 s, 72.9 MB/s 2024-09-10T08:39:55.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114278 s, 91.8 MB/s 2024-09-10T08:39:55.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.053 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127889 s, 82.0 MB/s 2024-09-10T08:39:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.068 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130433 s, 80.4 MB/s 2024-09-10T08:39:55.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.084 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125813 s, 83.3 MB/s 2024-09-10T08:39:55.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163141 s, 64.3 MB/s 2024-09-10T08:39:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.122 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015653 s, 67.0 MB/s 2024-09-10T08:39:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127868 s, 82.0 MB/s 2024-09-10T08:39:55.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168254 s, 62.3 MB/s 2024-09-10T08:39:55.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.174 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.174 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128108 s, 81.9 MB/s 2024-09-10T08:39:55.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.191 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133112 s, 78.8 MB/s 2024-09-10T08:39:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.207 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130976 s, 80.1 MB/s 2024-09-10T08:39:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.223 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129197 s, 81.2 MB/s 2024-09-10T08:39:55.239 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.240 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134944 s, 77.7 MB/s 2024-09-10T08:39:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125441 s, 83.6 MB/s 2024-09-10T08:39:55.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.272 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133032 s, 78.8 MB/s 2024-09-10T08:39:55.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.291 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156425 s, 67.0 MB/s 2024-09-10T08:39:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.307 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137355 s, 76.3 MB/s 2024-09-10T08:39:55.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.324 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137078 s, 76.5 MB/s 2024-09-10T08:39:55.341 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.341 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.341 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013025 s, 80.5 MB/s 2024-09-10T08:39:55.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.361 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.361 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164787 s, 63.6 MB/s 2024-09-10T08:39:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136197 s, 77.0 MB/s 2024-09-10T08:39:55.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.394 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135553 s, 77.4 MB/s 2024-09-10T08:39:55.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.414 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167838 s, 62.5 MB/s 2024-09-10T08:39:55.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.429 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.429 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116531 s, 90.0 MB/s 2024-09-10T08:39:55.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.445 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129155 s, 81.2 MB/s 2024-09-10T08:39:55.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.463 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.463 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148161 s, 70.8 MB/s 2024-09-10T08:39:55.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.480 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131656 s, 79.6 MB/s 2024-09-10T08:39:55.496 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133621 s, 78.5 MB/s 2024-09-10T08:39:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134874 s, 77.7 MB/s 2024-09-10T08:39:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:55.522 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:55.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:55.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133628 s, 78.5 MB/s 2024-09-10T08:39:55.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138815 s, 75.5 MB/s 2024-09-10T08:39:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133684 s, 78.4 MB/s 2024-09-10T08:39:55.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134562 s, 77.9 MB/s 2024-09-10T08:39:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016373 s, 64.0 MB/s 2024-09-10T08:39:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139978 s, 74.9 MB/s 2024-09-10T08:39:55.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136368 s, 76.9 MB/s 2024-09-10T08:39:55.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130227 s, 80.5 MB/s 2024-09-10T08:39:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.763 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167822 s, 62.5 MB/s 2024-09-10T08:39:55.783 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.783 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.783 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166089 s, 63.1 MB/s 2024-09-10T08:39:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143977 s, 72.8 MB/s 2024-09-10T08:39:55.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.820 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164611 s, 63.7 MB/s 2024-09-10T08:39:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127848 s, 82.0 MB/s 2024-09-10T08:39:55.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015735 s, 66.6 MB/s 2024-09-10T08:39:55.870 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124871 s, 84.0 MB/s 2024-09-10T08:39:55.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.888 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.888 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136374 s, 76.9 MB/s 2024-09-10T08:39:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138723 s, 75.6 MB/s 2024-09-10T08:39:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135608 s, 77.3 MB/s 2024-09-10T08:39:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127366 s, 82.3 MB/s 2024-09-10T08:39:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.954 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012942 s, 81.0 MB/s 2024-09-10T08:39:55.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.971 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.971 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129836 s, 80.8 MB/s 2024-09-10T08:39:55.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:55.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:55.987 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133097 s, 78.8 MB/s 2024-09-10T08:39:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138755 s, 75.6 MB/s 2024-09-10T08:39:56.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129773 s, 80.8 MB/s 2024-09-10T08:39:56.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126292 s, 83.0 MB/s 2024-09-10T08:39:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162235 s, 64.6 MB/s 2024-09-10T08:39:56.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133617 s, 78.5 MB/s 2024-09-10T08:39:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166762 s, 62.9 MB/s 2024-09-10T08:39:56.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.109 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.109 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134892 s, 77.7 MB/s 2024-09-10T08:39:56.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130746 s, 80.2 MB/s 2024-09-10T08:39:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126066 s, 83.2 MB/s 2024-09-10T08:39:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.158 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133957 s, 78.3 MB/s 2024-09-10T08:39:56.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:39:56.168 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:39:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:39:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138585 s, 75.7 MB/s 2024-09-10T08:39:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152372 s, 68.8 MB/s 2024-09-10T08:39:56.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.304 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129594 s, 80.9 MB/s 2024-09-10T08:39:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122396 s, 85.7 MB/s 2024-09-10T08:39:56.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01383 s, 75.8 MB/s 2024-09-10T08:39:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132029 s, 79.4 MB/s 2024-09-10T08:39:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.373 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016777 s, 62.5 MB/s 2024-09-10T08:39:56.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.390 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130382 s, 80.4 MB/s 2024-09-10T08:39:56.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152242 s, 68.9 MB/s 2024-09-10T08:39:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137421 s, 76.3 MB/s 2024-09-10T08:39:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124149 s, 84.5 MB/s 2024-09-10T08:39:56.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.462 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017176 s, 61.0 MB/s 2024-09-10T08:39:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.481 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165706 s, 63.3 MB/s 2024-09-10T08:39:56.498 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.498 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.498 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135717 s, 77.3 MB/s 2024-09-10T08:39:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140799 s, 74.5 MB/s 2024-09-10T08:39:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.532 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130441 s, 80.4 MB/s 2024-09-10T08:39:56.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131262 s, 79.9 MB/s 2024-09-10T08:39:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136049 s, 77.1 MB/s 2024-09-10T08:39:56.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.582 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.582 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013431 s, 78.1 MB/s 2024-09-10T08:39:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150086 s, 69.9 MB/s 2024-09-10T08:39:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132888 s, 78.9 MB/s 2024-09-10T08:39:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129419 s, 81.0 MB/s 2024-09-10T08:39:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157006 s, 66.8 MB/s 2024-09-10T08:39:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135699 s, 77.3 MB/s 2024-09-10T08:39:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104577 s, 100 MB/s 2024-09-10T08:39:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114542 s, 91.5 MB/s 2024-09-10T08:39:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162345 s, 64.6 MB/s 2024-09-10T08:39:56.732 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127031 s, 82.5 MB/s 2024-09-10T08:39:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.747 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109656 s, 95.6 MB/s 2024-09-10T08:39:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.762 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121483 s, 86.3 MB/s 2024-09-10T08:39:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162917 s, 64.4 MB/s 2024-09-10T08:39:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:39:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:39:56.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011914 s, 88.0 MB/s 2024-09-10T08:39:56.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:39:56.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:56.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-10T08:39:56.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.967+0000 7f3925400640 1 Processor -- start 2024-09-10T08:39:56.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.967+0000 7f3925400640 1 -- start start 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f3925400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f39200b2370 0x7f39200cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f3925400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 0x7f392015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f3925400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200b0680 con 0x7f3920155b20 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f3925400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f39200b01e0 con 0x7f39200b2370 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f3925400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39200ccf70 con 0x7f39200cf960 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f391e800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3920155b20 0x7f39200b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44004/0 (socket says 172.21.15.52:44004) 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.968+0000 7f391e800640 1 -- 172.21.15.52:0/4043942566 learned_addr learned my addr 172.21.15.52:0/4043942566 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391f200640 1 --2- 172.21.15.52:0/4043942566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 0x7f392015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391de00640 1 --2- 172.21.15.52:0/4043942566 >> v2:172.21.15.176:3300/0 conn(0x7f39200b2370 0x7f39200cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391d400640 1 -- 172.21.15.52:0/4043942566 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186476104 0 0) 0x7f39200b0680 con 0x7f3920155b20 2024-09-10T08:39:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391d400640 1 -- 172.21.15.52:0/4043942566 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3904003520 con 0x7f3920155b20 2024-09-10T08:39:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391f200640 1 -- 172.21.15.52:0/4043942566 >> v2:172.21.15.176:3300/0 conn(0x7f39200b2370 msgr2=0x7f39200cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391f200640 1 --2- 172.21.15.52:0/4043942566 >> v2:172.21.15.176:3300/0 conn(0x7f39200b2370 0x7f39200cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391f200640 1 -- 172.21.15.52:0/4043942566 >> v1:172.21.15.52:6789/0 conn(0x7f3920155b20 legacy=0x7f39200b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.969+0000 7f391f200640 1 -- 172.21.15.52:0/4043942566 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200ce940 con 0x7f39200cf960 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.970+0000 7f391f200640 1 --2- 172.21.15.52:0/4043942566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 0x7f392015c3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3918009d90 tx=0x7f391802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c374d07146caab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.970+0000 7f391d400640 1 -- 172.21.15.52:0/4043942566 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918007740 con 0x7f39200cf960 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.970+0000 7f391d400640 1 -- 172.21.15.52:0/4043942566 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39180078e0 con 0x7f39200cf960 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.970+0000 7f391d400640 1 -- 172.21.15.52:0/4043942566 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918007c90 con 0x7f39200cf960 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 -- 172.21.15.52:0/4043942566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 msgr2=0x7f392015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 --2- 172.21.15.52:0/4043942566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 0x7f392015c3b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3918009d90 tx=0x7f391802a660 comp rx=0 tx=0).stop 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 -- 172.21.15.52:0/4043942566 shutdown_connections 2024-09-10T08:39:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 --2- 172.21.15.52:0/4043942566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200cf960 0x7f392015c3b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 --2- 172.21.15.52:0/4043942566 >> v2:172.21.15.176:3300/0 conn(0x7f39200b2370 0x7f39200cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 -- 172.21.15.52:0/4043942566 >> 172.21.15.52:0/4043942566 conn(0x7f392006c240 msgr2=0x7f392006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 -- 172.21.15.52:0/4043942566 shutdown_connections 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.971+0000 7f3925400640 1 -- 172.21.15.52:0/4043942566 wait complete. 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.973+0000 7f3925400640 1 Processor -- start 2024-09-10T08:39:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.973+0000 7f3925400640 1 -- start start 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200b2370 0x7f392014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3920155b20 0x7f39200b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cfdf0 con 0x7f39200cf960 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cef00 con 0x7f3920155b20 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f3925400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39200ce610 con 0x7f39200b2370 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55958/0 (socket says 172.21.15.52:55958) 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f391de00640 1 -- 172.21.15.52:0/2692565375 learned_addr learned my addr 172.21.15.52:0/2692565375 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f391e800640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200b2370 0x7f392014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.974+0000 7f391f200640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3920155b20 0x7f39200b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 -- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200b2370 msgr2=0x7f392014d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200b2370 0x7f392014d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 -- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3920155b20 msgr2=0x7f39200b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3920155b20 0x7f39200b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 -- 172.21.15.52:0/2692565375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b5740 con 0x7f39200cf960 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f391de00640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e8a0 tx=0x7f390c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f3916a00640 1 -- 172.21.15.52:0/2692565375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c017070 con 0x7f39200cf960 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f3916a00640 1 -- 172.21.15.52:0/2692565375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c00c940 con 0x7f39200cf960 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f3916a00640 1 -- 172.21.15.52:0/2692565375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c00cd30 con 0x7f39200cf960 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200b5a20 con 0x7f39200cf960 2024-09-10T08:39:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.975+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39200ae870 con 0x7f39200cf960 2024-09-10T08:39:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.977+0000 7f3916a00640 1 -- 172.21.15.52:0/2692565375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f390c01a070 con 0x7f39200cf960 2024-09-10T08:39:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.978+0000 7f3916a00640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.978+0000 7f3916a00640 1 -- 172.21.15.52:0/2692565375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f390c08af90 con 0x7f39200cf960 2024-09-10T08:39:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.979+0000 7f391e800640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.979+0000 7f39281d9740 1 Processor -- start 2024-09-10T08:39:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 -- start start 2024-09-10T08:39:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f391e800640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3910005880 tx=0x7f3910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e6fb0 0x55668a9e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e7410 0x55668a9c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55668a906a70 con 0x55668a9e97f0 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55668a8ae9d0 con 0x55668a9e6fb0 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.980+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55668a902a30 con 0x55668a9e7410 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55968/0 (socket says 172.21.15.52:55968) 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 -- 172.21.15.52:0/3530532646 learned_addr learned my addr 172.21.15.52:0/3530532646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391f200640 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e7410 0x55668a9c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391de00640 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e6fb0 0x55668a9e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 -- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e7410 msgr2=0x55668a9c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e7410 0x55668a9c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 -- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e6fb0 msgr2=0x55668a9e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:56.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e6fb0 0x55668a9e8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.981+0000 7f391e800640 1 -- 172.21.15.52:0/3530532646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668a6e5ba0 con 0x55668a9e97f0 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.982+0000 7f391e800640 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f391000fab0 tx=0x7f3910000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c7fd5c0078bf72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.982+0000 7f390b000640 1 -- 172.21.15.52:0/3530532646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910025070 con 0x55668a9e97f0 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.982+0000 7f390b000640 1 -- 172.21.15.52:0/3530532646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3910015cb0 con 0x55668a9e97f0 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.982+0000 7f390b000640 1 -- 172.21.15.52:0/3530532646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910015e60 con 0x55668a9e97f0 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 -- 172.21.15.52:0/3530532646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 msgr2=0x55668a9e9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f391000fab0 tx=0x7f3910000ed0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 -- 172.21.15.52:0/3530532646 shutdown_connections 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e7410 0x55668a9c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e6fb0 0x55668a9e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 --2- 172.21.15.52:0/3530532646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9e9bd0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 -- 172.21.15.52:0/3530532646 >> 172.21.15.52:0/3530532646 conn(0x55668a99f450 msgr2=0x55668a9e7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 -- 172.21.15.52:0/3530532646 shutdown_connections 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.983+0000 7f39281d9740 1 -- 172.21.15.52:0/3530532646 wait complete. 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.984+0000 7f39281d9740 1 -- start start 2024-09-10T08:39:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.984+0000 7f39281d9740 1 Processor -- start 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e7410 0x55668a9c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55668a9e5f10 con 0x55668a9e97f0 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55668a8c1bf0 con 0x55668a9e7410 2024-09-10T08:39:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55668a9e61f0 con 0x55668a9cc6d0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f39281d9740 10 client.0 _ll_register_callbacks cb 0x55668a8e46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e7410 0x55668a9c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55976/0 (socket says 172.21.15.52:55976) 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 -- 172.21.15.52:0/3175037189 learned_addr learned my addr 172.21.15.52:0/3175037189 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391f200640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 -- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 msgr2=0x55668a9ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 -- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e7410 msgr2=0x55668a9c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e7410 0x55668a9c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.985+0000 7f391de00640 1 -- 172.21.15.52:0/3175037189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668a5d9490 con 0x55668a9e97f0 2024-09-10T08:39:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f391de00640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e870 tx=0x7f390c059360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fafe8d02cfd6685 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c087060 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f390c05d160 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3910015cb0 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f390c071070 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 10 client.9474 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55668a746330 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3910015cb0 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f390c0587b0 con 0x55668a9e97f0 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 10 client.9474 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 10 client.9474 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.986+0000 7f39281d9740 20 client.9474 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.987+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9cad10 0x55668a9cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.987+0000 7f39281d9740 4 client.9474 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.987+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55668a9141a0 con 0x55668a9cad10 2024-09-10T08:39:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.987+0000 7f391e800640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9cad10 0x55668a9cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.988+0000 7f391e800640 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9cad10 0x55668a9cb1a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25bfe91b9dc31e78 server_cookie=ece9971983db7f05 in_seq=0 out_seq=0 2024-09-10T08:39:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.988+0000 7f38ff400640 10 client.9474 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f38ff400640 1 -- 172.21.15.52:0/3175037189 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55668a9141a0 con 0x55668a9cad10 2024-09-10T08:39:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f38ff400640 10 client.9474 handle_command_reply: tid=0 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 client.9474 shutdown 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 msgr2=0x55668a9fb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e870 tx=0x7f390c059360 comp rx=0 tx=0).stop 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 shutdown_connections 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9cad10 0x55668a9cb1a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e97f0 0x55668a9fb210 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 --2- 172.21.15.52:0/3175037189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e7410 0x55668a9c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f38ff400640 0 client.9474 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 >> 172.21.15.52:0/3175037189 conn(0x55668a9e6fb0 msgr2=0x55668a9e7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 shutdown_connections 2024-09-10T08:39:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 1 -- 172.21.15.52:0/3175037189 wait complete. 2024-09-10T08:39:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:56.989+0000 7f39281d9740 20 client.9474 trim_cache size 0 max 16384 2024-09-10T08:39:57.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.008+0000 7f39281d9740 1 Processor -- start 2024-09-10T08:39:57.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.008+0000 7f39281d9740 1 -- start start 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.008+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f39281d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e97f0 0x55668a9a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f39281d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3920200bd0 con 0x55668a9e7410 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39201ffc10 con 0x55668a9e97f0 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f39201fefd0 con 0x55668a9cc6d0 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55988/0 (socket says 172.21.15.52:55988) 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 -- 172.21.15.52:0/1282226192 learned_addr learned my addr 172.21.15.52:0/1282226192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391e800640 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391f200640 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e97f0 0x55668a9a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 -- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 msgr2=0x55668a9ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 -- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e97f0 msgr2=0x55668a9a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e97f0 0x55668a9a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 -- 172.21.15.52:0/1282226192 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668a5b2550 con 0x55668a9e7410 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.009+0000 7f391de00640 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f390c009fd0 tx=0x7f390c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d93c02d280d35a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f390a600640 1 -- 172.21.15.52:0/1282226192 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c021040 con 0x55668a9e7410 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f390a600640 1 -- 172.21.15.52:0/1282226192 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c05d160 con 0x55668a9e7410 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f390a600640 1 -- 172.21.15.52:0/1282226192 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0550b0 con 0x55668a9e7410 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 -- 172.21.15.52:0/1282226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 msgr2=0x55668a9e77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f390c009fd0 tx=0x7f390c05c000 comp rx=0 tx=0).stop 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 -- 172.21.15.52:0/1282226192 shutdown_connections 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9e97f0 0x55668a9a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e77f0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 --2- 172.21.15.52:0/1282226192 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9cc6d0 0x55668a9ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 -- 172.21.15.52:0/1282226192 >> 172.21.15.52:0/1282226192 conn(0x55668a9e6fb0 msgr2=0x55668a9f71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 -- 172.21.15.52:0/1282226192 shutdown_connections 2024-09-10T08:39:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.010+0000 7f39281d9740 1 -- 172.21.15.52:0/1282226192 wait complete. 2024-09-10T08:39:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.011+0000 7f39281d9740 1 -- start start 2024-09-10T08:39:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.011+0000 7f39281d9740 1 Processor -- start 2024-09-10T08:39:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9cc6d0 0x55668aa4eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e97f0 0x55668a99e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55668a9e9620 con 0x55668a9e7410 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f39201ff5c0 con 0x55668a9cc6d0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55668a9e4770 con 0x55668a9e97f0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f39281d9740 10 client.0 _ll_register_callbacks cb 0x7f390c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f391de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55998/0 (socket says 172.21.15.52:55998) 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f391de00640 1 -- 172.21.15.52:0/857787870 learned_addr learned my addr 172.21.15.52:0/857787870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f391f200640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e97f0 0x55668a99e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.012+0000 7f391e800640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9cc6d0 0x55668aa4eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 -- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e97f0 msgr2=0x55668a99e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e97f0 0x55668a99e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 -- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9cc6d0 msgr2=0x55668aa4eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9cc6d0 0x55668aa4eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 -- 172.21.15.52:0/857787870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668a9a1380 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f391de00640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f390c059010 tx=0x7f390c089400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ec8cb100743e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f38ff400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c021070 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f390c079d00 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f390c05d160 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f390c087070 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f39281d9740 10 client.9480 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.013+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55668a9a1380 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c05d160 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f390c078040 con 0x55668a9e7410 2024-09-10T08:39:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 10 client.9480 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 10 client.9480 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 20 client.9480 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9e4240 0x55668a99e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 4 client.9480 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55668a90e4f0 con 0x55668a9e4240 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.014+0000 7f391e800640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9e4240 0x55668a99e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.015+0000 7f391e800640 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9e4240 0x55668a99e810 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875f63c271a1b420 server_cookie=5db6147e43200eca in_seq=0 out_seq=0 2024-09-10T08:39:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.015+0000 7f38ff400640 10 client.9480 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f38ff400640 1 -- 172.21.15.52:0/857787870 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55668a90e4f0 con 0x55668a9e4240 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f38ff400640 10 client.9480 handle_command_reply: tid=0 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 client.9480 shutdown 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 msgr2=0x55668a9e3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f390c059010 tx=0x7f390c089400 comp rx=0 tx=0).stop 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 shutdown_connections 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55668a9e4240 0x55668a99e810 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55668a9e97f0 0x55668a99e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55668a9e7410 0x55668a9e3d00 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.017+0000 7f39281d9740 1 --2- 172.21.15.52:0/857787870 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55668a9cc6d0 0x55668aa4eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f38ff400640 0 client.9480 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 >> 172.21.15.52:0/857787870 conn(0x55668a9e6fb0 msgr2=0x55668a9e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 shutdown_connections 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f39281d9740 1 -- 172.21.15.52:0/857787870 wait complete. 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f39281d9740 20 client.9480 trim_cache size 0 max 16384 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "7a70662f-c37a-408c-bf99-3a9f420c94b9", 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:39:57.023 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 msgr2=0x7f390006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3910005880 tx=0x7f3910009040 comp rx=0 tx=0).stop 2024-09-10T08:39:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 msgr2=0x7f392014ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.018+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e8a0 tx=0x7f390c00ed60 comp rx=0 tx=0).stop 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 shutdown_connections 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3920155b20 0x7f39200b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39200cf960 0x7f392014ca70 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 --2- 172.21.15.52:0/2692565375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f39200b2370 0x7f392014d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 >> 172.21.15.52:0/2692565375 conn(0x7f392006c240 msgr2=0x7f392006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 shutdown_connections 2024-09-10T08:39:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.019+0000 7f3925400640 1 -- 172.21.15.52:0/2692565375 wait complete. 2024-09-10T08:39:57.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:57.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-10T08:39:57.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.204+0000 7ff5ffc00640 1 Processor -- start 2024-09-10T08:39:57.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.204+0000 7ff5ffc00640 1 -- start start 2024-09-10T08:39:57.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5ffc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5f80cce30 0x7ff5f80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5ffc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f80714b0 con 0x7ff5f8071c70 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5ffc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f80cd880 con 0x7ff5f80732e0 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5ffc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f80cdb60 con 0x7ff5f80cce30 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5f80cce30 0x7ff5f80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff5f80cce30 0x7ff5f80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56010/0 (socket says 172.21.15.52:56010) 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 -- 172.21.15.52:0/3242973715 learned_addr learned my addr 172.21.15.52:0/3242973715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5fdc00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff5f8071c70 0x7ff5f815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44018/0 (socket says 172.21.15.52:44018) 2024-09-10T08:39:57.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 -- 172.21.15.52:0/3242973715 >> v1:172.21.15.176:6789/0 conn(0x7ff5f80732e0 legacy=0x7ff5f80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 -- 172.21.15.52:0/3242973715 >> v1:172.21.15.52:6789/0 conn(0x7ff5f8071c70 legacy=0x7ff5f815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.206+0000 7ff5f7e00640 1 -- 172.21.15.52:0/3242973715 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f80cde40 con 0x7ff5f80cce30 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.207+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/3242973715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80cce30 0x7ff5f80cd2a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009870 tx=0x7ff5e402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db808e5c3c1ab37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5f7400640 1 -- 172.21.15.52:0/3242973715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4037070 con 0x7ff5f80cce30 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5f7400640 1 -- 172.21.15.52:0/3242973715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e4032440 con 0x7ff5f80cce30 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5f7400640 1 -- 172.21.15.52:0/3242973715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4032810 con 0x7ff5f80cce30 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 -- 172.21.15.52:0/3242973715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80cce30 msgr2=0x7ff5f80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/3242973715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80cce30 0x7ff5f80cd2a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009870 tx=0x7ff5e402a280 comp rx=0 tx=0).stop 2024-09-10T08:39:57.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 -- 172.21.15.52:0/3242973715 shutdown_connections 2024-09-10T08:39:57.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/3242973715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80cce30 0x7ff5f80cd2a0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 -- 172.21.15.52:0/3242973715 >> 172.21.15.52:0/3242973715 conn(0x7ff5f806d0f0 msgr2=0x7ff5f806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 -- 172.21.15.52:0/3242973715 shutdown_connections 2024-09-10T08:39:57.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.208+0000 7ff5ffc00640 1 -- 172.21.15.52:0/3242973715 wait complete. 2024-09-10T08:39:57.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.210+0000 7ff5ffc00640 1 Processor -- start 2024-09-10T08:39:57.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.210+0000 7ff5ffc00640 1 -- start start 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f8071c70 0x7ff5f814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f80cce30 0x7ff5f814a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f815d160 con 0x7ff5f80732e0 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f815cfe0 con 0x7ff5f8071c70 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f815d2e0 con 0x7ff5f80cce30 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56018/0 (socket says 172.21.15.52:56018) 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5f7e00640 1 -- 172.21.15.52:0/1684092448 learned_addr learned my addr 172.21.15.52:0/1684092448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5fd200640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f8071c70 0x7ff5f814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.211+0000 7ff5fdc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f80cce30 0x7ff5f814a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 -- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f80cce30 msgr2=0x7ff5f814a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f80cce30 0x7ff5f814a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 -- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f8071c70 msgr2=0x7ff5f814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f8071c70 0x7ff5f814ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 -- 172.21.15.52:0/1684092448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f81e9be0 con 0x7ff5f80732e0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff5e402a2c0 tx=0x7ff5e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f4c00640 1 -- 172.21.15.52:0/1684092448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4037040 con 0x7ff5f80732e0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f4c00640 1 -- 172.21.15.52:0/1684092448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e4042070 con 0x7ff5f80732e0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5f4c00640 1 -- 172.21.15.52:0/1684092448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4030bb0 con 0x7ff5f80732e0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f814daa0 con 0x7ff5f80732e0 2024-09-10T08:39:57.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.212+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f81e5eb0 con 0x7ff5f80732e0 2024-09-10T08:39:57.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.214+0000 7ff5f4c00640 1 -- 172.21.15.52:0/1684092448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5e4047460 con 0x7ff5f80732e0 2024-09-10T08:39:57.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.215+0000 7ff5f4c00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 0x7ff5d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.215+0000 7ff5f4c00640 1 -- 172.21.15.52:0/1684092448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e40abb50 con 0x7ff5f80732e0 2024-09-10T08:39:57.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.216+0000 7ff5fd200640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 0x7ff5d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.216+0000 7ff602a73740 1 Processor -- start 2024-09-10T08:39:57.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.216+0000 7ff602a73740 1 -- start start 2024-09-10T08:39:57.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.216+0000 7ff5fd200640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 0x7ff5d806e2f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec007fd0 tx=0x7ff5ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf52aa80 0x55b5bf570220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf525070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5bf4f1cf0 con 0x55b5bf528240 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b5bf48d7f0 con 0x55b5bf52c210 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b5bf435800 con 0x55b5bf52aa80 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56034/0 (socket says 172.21.15.52:56034) 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff5f7e00640 1 -- 172.21.15.52:0/862013254 learned_addr learned my addr 172.21.15.52:0/862013254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff5fd200640 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf52aa80 0x55b5bf570220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.217+0000 7ff5fdc00640 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf525070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 -- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf52aa80 msgr2=0x55b5bf570220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf52aa80 0x55b5bf570220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 -- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 msgr2=0x55b5bf525070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf525070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 -- 172.21.15.52:0/862013254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5bf26a7d0 con 0x55b5bf528240 2024-09-10T08:39:57.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4079c60 tx=0x7ff5e4079780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4aea0aa96b4774f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5e9600640 1 -- 172.21.15.52:0/862013254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e40a8070 con 0x55b5bf528240 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5e9600640 1 -- 172.21.15.52:0/862013254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e4079d60 con 0x55b5bf528240 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.218+0000 7ff5e9600640 1 -- 172.21.15.52:0/862013254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e407e110 con 0x55b5bf528240 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 -- 172.21.15.52:0/862013254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 msgr2=0x55b5bf52ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4079c60 tx=0x7ff5e4079780 comp rx=0 tx=0).stop 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 -- 172.21.15.52:0/862013254 shutdown_connections 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf525070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf528240 0x55b5bf52ae60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 --2- 172.21.15.52:0/862013254 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf52aa80 0x55b5bf570220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 -- 172.21.15.52:0/862013254 >> 172.21.15.52:0/862013254 conn(0x55b5bf527240 msgr2=0x55b5bf56f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 -- 172.21.15.52:0/862013254 shutdown_connections 2024-09-10T08:39:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.219+0000 7ff602a73740 1 -- 172.21.15.52:0/862013254 wait complete. 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.220+0000 7ff602a73740 1 -- start start 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.220+0000 7ff602a73740 1 Processor -- start 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf554df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf574cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5bf416750 con 0x55b5bf52c210 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55b5bf4897b0 con 0x55b5bf52aa80 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b5bf5266e0 con 0x55b5bf54e4f0 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff602a73740 10 client.0 _ll_register_callbacks cb 0x55b5bf19fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56042/0 (socket says 172.21.15.52:56042) 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff5f7e00640 1 -- 172.21.15.52:0/4276557107 learned_addr learned my addr 172.21.15.52:0/4276557107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff5fdc00640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf574cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.221+0000 7ff5fd200640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf554df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 -- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 msgr2=0x55b5bf574cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf574cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 -- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 msgr2=0x55b5bf554df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf554df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 -- 172.21.15.52:0/4276557107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5bf1600f0 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4046000 tx=0x7ff5e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaab21bf67d9a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5de000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4095020 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e4079fc0 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5e4079d60 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7ff5e40a0050 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff602a73740 10 client.9495 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.222+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55b5bf2caf60 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e4079d60 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7ff5e40a3020 con 0x55b5bf52c210 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 10 client.9495 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:57.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 10 client.9495 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 20 client.9495 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf5756c0 0x55b5bf54c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 4 client.9495 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5bf49af20 con 0x55b5bf5756c0 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.223+0000 7ff5fd200640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf5756c0 0x55b5bf54c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.224+0000 7ff5fd200640 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf5756c0 0x55b5bf54c7f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6764b6cbeca8ed45 server_cookie=287d6f62e4428873 in_seq=0 out_seq=0 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.224+0000 7ff5de000640 10 client.9495 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.224+0000 7ff5de000640 1 -- 172.21.15.52:0/4276557107 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5bf49af20 con 0x55b5bf5756c0 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.224+0000 7ff5de000640 10 client.9495 handle_command_reply: tid=0 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 client.9495 shutdown 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 msgr2=0x55b5bf54dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4046000 tx=0x7ff5e4000bc0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 shutdown_connections 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf5756c0 0x55b5bf54c7f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf574cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf54dfb0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff5de000640 0 client.9495 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 --2- 172.21.15.52:0/4276557107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf554df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 >> 172.21.15.52:0/4276557107 conn(0x55b5bf528240 msgr2=0x55b5bf56d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 shutdown_connections 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 1 -- 172.21.15.52:0/4276557107 wait complete. 2024-09-10T08:39:57.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.225+0000 7ff602a73740 20 client.9495 trim_cache size 0 max 16384 2024-09-10T08:39:57.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.243+0000 7ff602a73740 1 Processor -- start 2024-09-10T08:39:57.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.243+0000 7ff602a73740 1 -- start start 2024-09-10T08:39:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf592680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf592bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8200e70 con 0x55b5bf52aa80 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ffe80 con 0x55b5bf52c210 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f81ff1e0 con 0x55b5bf54e4f0 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff5fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff5fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56058/0 (socket says 172.21.15.52:56058) 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff5fd200640 1 -- 172.21.15.52:0/2976657924 learned_addr learned my addr 172.21.15.52:0/2976657924 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.244+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf592680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fdc00640 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf592bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 -- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 msgr2=0x55b5bf592bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf592bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 -- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 msgr2=0x55b5bf592680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf592680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 -- 172.21.15.52:0/2976657924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5bf1391b0 con 0x55b5bf52aa80 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x55b5bf575bd0 tx=0x7ff5ec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd53bbf11380f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5e8c00640 1 -- 172.21.15.52:0/2976657924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec003880 con 0x55b5bf52aa80 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5e8c00640 1 -- 172.21.15.52:0/2976657924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec003a20 con 0x55b5bf52aa80 2024-09-10T08:39:57.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.245+0000 7ff5e8c00640 1 -- 172.21.15.52:0/2976657924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec003bd0 con 0x55b5bf52aa80 2024-09-10T08:39:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- 172.21.15.52:0/2976657924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 msgr2=0x55b5bf56d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x55b5bf575bd0 tx=0x7ff5ec011000 comp rx=0 tx=0).stop 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- 172.21.15.52:0/2976657924 shutdown_connections 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf592bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52c210 0x55b5bf592680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 --2- 172.21.15.52:0/2976657924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52aa80 0x55b5bf56d960 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- 172.21.15.52:0/2976657924 >> 172.21.15.52:0/2976657924 conn(0x55b5bf528240 msgr2=0x55b5bf551b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- 172.21.15.52:0/2976657924 shutdown_connections 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- 172.21.15.52:0/2976657924 wait complete. 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.246+0000 7ff602a73740 1 -- start start 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.247+0000 7ff602a73740 1 Processor -- start 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf5897a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf548f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5bf5260f0 con 0x55b5bf52c210 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f81ff830 con 0x55b5bf52aa80 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55b5bf4c6bb0 con 0x55b5bf54e4f0 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff602a73740 10 client.0 _ll_register_callbacks cb 0x7ff5e40a6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56068/0 (socket says 172.21.15.52:56068) 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 -- 172.21.15.52:0/2469486410 learned_addr learned my addr 172.21.15.52:0/2469486410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5fdc00640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf548f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf5897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 -- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 msgr2=0x55b5bf548f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf548f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 -- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 msgr2=0x55b5bf5897a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf5897a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.248+0000 7ff5f7e00640 1 -- 172.21.15.52:0/2469486410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5bf523f90 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5f7e00640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40766e0 tx=0x7ff5e4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7c40484ed1690f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4087060 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e4082b90 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec003a20 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7ff5e408d050 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 10 client.9501 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55b5bf523f90 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec003a20 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7ff5e40a3040 con 0x55b5bf52c210 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 10 client.9501 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 10 client.9501 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 20 client.9501 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf572c00 0x55b5bf573010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 4 client.9501 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.249+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55b5bf495270 con 0x55b5bf572c00 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.250+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf572c00 0x55b5bf573010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.250+0000 7ff5fd200640 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf572c00 0x55b5bf573010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e03611d07ada279 server_cookie=d83ec94aa32afefc in_seq=0 out_seq=0 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.250+0000 7ff5de000640 10 client.9501 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.250+0000 7ff5de000640 1 -- 172.21.15.52:0/2469486410 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5bf495270 con 0x55b5bf572c00 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff5de000640 10 client.9501 handle_command_reply: tid=0 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 client.9501 shutdown 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 msgr2=0x55b5bf5489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40766e0 tx=0x7ff5e4009240 comp rx=0 tx=0).stop 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 shutdown_connections 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x55b5bf572c00 0x55b5bf573010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55b5bf54e4f0 0x55b5bf548f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5bf52c210 0x55b5bf5489e0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff5de000640 0 client.9501 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 --2- 172.21.15.52:0/2469486410 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55b5bf52aa80 0x55b5bf5897a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 >> 172.21.15.52:0/2469486410 conn(0x55b5bf528240 msgr2=0x55b5bf54dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 shutdown_connections 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 1 -- 172.21.15.52:0/2469486410 wait complete. 2024-09-10T08:39:57.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.251+0000 7ff602a73740 20 client.9501 trim_cache size 0 max 16384 2024-09-10T08:39:57.257 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:57.257 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-10T08:39:57.257 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0 2024-09-10T08:39:57.257 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 msgr2=0x7ff5d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 0x7ff5d806e2f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec007fd0 tx=0x7ff5ec009040 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 msgr2=0x7ff5f81e96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff5e402a2c0 tx=0x7ff5e40046c0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 shutdown_connections 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5d806be30 0x7ff5d806e2f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5f80cce30 0x7ff5f814a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f80732e0 0x7ff5f81e96a0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 --2- 172.21.15.52:0/1684092448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5f8071c70 0x7ff5f814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 >> 172.21.15.52:0/1684092448 conn(0x7ff5f806d0f0 msgr2=0x7ff5f806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 shutdown_connections 2024-09-10T08:39:57.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.252+0000 7ff5ffc00640 1 -- 172.21.15.52:0/1684092448 wait complete. 2024-09-10T08:39:57.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:39:57.267 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-10T08:39:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.426+0000 7f1961800640 1 Processor -- start 2024-09-10T08:39:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.426+0000 7f1961800640 1 -- start start 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f1961800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f195c0b3350 0x7f195c0d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f1961800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c0cf710 con 0x7f195c06bfd0 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f1961800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c0cf9f0 con 0x7f195c0b38a0 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f1961800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f195c0b78a0 con 0x7f195c0b3350 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f195a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f195c0b3350 0x7f195c0d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.427+0000 7f195aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f195c06bfd0 0x7f195c06c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44024/0 (socket says 172.21.15.52:44024) 2024-09-10T08:39:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.428+0000 7f195aa00640 1 -- 172.21.15.52:0/3861178532 learned_addr learned my addr 172.21.15.52:0/3861178532 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:57.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.428+0000 7f195a000640 1 -- 172.21.15.52:0/3861178532 >> v1:172.21.15.176:6789/0 conn(0x7f195c0b38a0 legacy=0x7f195c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.428+0000 7f195a000640 1 -- 172.21.15.52:0/3861178532 >> v1:172.21.15.52:6789/0 conn(0x7f195c06bfd0 legacy=0x7f195c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.428+0000 7f195a000640 1 -- 172.21.15.52:0/3861178532 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c0cfcd0 con 0x7f195c0b3350 2024-09-10T08:39:57.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.428+0000 7f1959600640 1 -- 172.21.15.52:0/3861178532 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544468589 0 0) 0x7f195c0cf710 con 0x7f195c06bfd0 2024-09-10T08:39:57.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.429+0000 7f195a000640 1 --2- 172.21.15.52:0/3861178532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c0b3350 0x7f195c0d2920 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f19480097a0 tx=0x7f194802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1543b377ca9db57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.429+0000 7f1959600640 1 -- 172.21.15.52:0/3861178532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948037070 con 0x7f195c0b3350 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.429+0000 7f1959600640 1 -- 172.21.15.52:0/3861178532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1948032640 con 0x7f195c0b3350 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.429+0000 7f1959600640 1 -- 172.21.15.52:0/3861178532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948032a10 con 0x7f195c0b3350 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 -- 172.21.15.52:0/3861178532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c0b3350 msgr2=0x7f195c0d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 --2- 172.21.15.52:0/3861178532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c0b3350 0x7f195c0d2920 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f19480097a0 tx=0x7f194802a2c0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 -- 172.21.15.52:0/3861178532 shutdown_connections 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 --2- 172.21.15.52:0/3861178532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c0b3350 0x7f195c0d2920 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 -- 172.21.15.52:0/3861178532 >> 172.21.15.52:0/3861178532 conn(0x7f195c0d11c0 msgr2=0x7f195c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 -- 172.21.15.52:0/3861178532 shutdown_connections 2024-09-10T08:39:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.430+0000 7f1961800640 1 -- 172.21.15.52:0/3861178532 wait complete. 2024-09-10T08:39:57.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.432+0000 7f1961800640 1 Processor -- start 2024-09-10T08:39:57.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.432+0000 7f1961800640 1 -- start start 2024-09-10T08:39:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f195c0b3350 0x7f195c1f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 0x7f195c1f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f195c06cd50 con 0x7f195c06bfd0 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f195c0cffb0 con 0x7f195c0b38a0 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f1961800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f195c15eae0 con 0x7f195c0b3350 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56078/0 (socket says 172.21.15.52:56078) 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 -- 172.21.15.52:0/3558684382 learned_addr learned my addr 172.21.15.52:0/3558684382 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195a000640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f195c0b3350 0x7f195c1f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195b400640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 0x7f195c1f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 -- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f195c0b3350 msgr2=0x7f195c1f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f195c0b3350 0x7f195c1f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 -- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 msgr2=0x7f195c1f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 0x7f195c1f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195aa00640 1 -- 172.21.15.52:0/3558684382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c0cc180 con 0x7f195c06bfd0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.433+0000 7f195b400640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 0x7f195c1f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f195aa00640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c4a0 tx=0x7f194c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f1952a00640 1 -- 172.21.15.52:0/3558684382 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c018070 con 0x7f195c06bfd0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f1952a00640 1 -- 172.21.15.52:0/3558684382 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c0074e0 con 0x7f195c06bfd0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c0cc460 con 0x7f195c06bfd0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f1952a00640 1 -- 172.21.15.52:0/3558684382 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c004a20 con 0x7f195c06bfd0 2024-09-10T08:39:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.434+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c0cca20 con 0x7f195c06bfd0 2024-09-10T08:39:57.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.436+0000 7f1952a00640 1 -- 172.21.15.52:0/3558684382 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f194c01b070 con 0x7f195c06bfd0 2024-09-10T08:39:57.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.437+0000 7f1952a00640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 0x7f193c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.437+0000 7f1952a00640 1 -- 172.21.15.52:0/3558684382 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f194c08a1d0 con 0x7f195c06bfd0 2024-09-10T08:39:57.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.438+0000 7f195a000640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 0x7f193c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.438+0000 7f196469d740 1 Processor -- start 2024-09-10T08:39:57.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.438+0000 7f196469d740 1 -- start start 2024-09-10T08:39:57.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.438+0000 7f195a000640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 0x7f193c06e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f194802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b0739b480 0x564b073e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564b07303660 con 0x564b073b5420 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564b072ab680 con 0x564b073b5800 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564b072ff620 con 0x564b0739b480 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56094/0 (socket says 172.21.15.52:56094) 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.439+0000 7f195aa00640 1 -- 172.21.15.52:0/3750491468 learned_addr learned my addr 172.21.15.52:0/3750491468 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195a000640 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195b400640 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b0739b480 0x564b073e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 -- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b0739b480 msgr2=0x564b073e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b0739b480 0x564b073e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 -- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 msgr2=0x564b073e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 -- 172.21.15.52:0/3750491468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b070e07d0 con 0x564b073b5420 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f195aa00640 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f194c0885a0 tx=0x7f194c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0662f2487e3537 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f1947400640 1 -- 172.21.15.52:0/3750491468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c060fc0 con 0x564b073b5420 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f1947400640 1 -- 172.21.15.52:0/3750491468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c056790 con 0x564b073b5420 2024-09-10T08:39:57.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.440+0000 7f1947400640 1 -- 172.21.15.52:0/3750491468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c004bc0 con 0x564b073b5420 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 -- 172.21.15.52:0/3750491468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 msgr2=0x564b073e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f194c0885a0 tx=0x7f194c000ed0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 -- 172.21.15.52:0/3750491468 shutdown_connections 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b0739b480 0x564b073e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 --2- 172.21.15.52:0/3750491468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073e5c40 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 -- 172.21.15.52:0/3750491468 >> 172.21.15.52:0/3750491468 conn(0x564b0739c220 msgr2=0x564b073e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 -- 172.21.15.52:0/3750491468 shutdown_connections 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.441+0000 7f196469d740 1 -- 172.21.15.52:0/3750491468 wait complete. 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.442+0000 7f196469d740 1 -- start start 2024-09-10T08:39:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.442+0000 7f196469d740 1 Processor -- start 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564b0739a3e0 con 0x564b073b5420 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564b0728c4c0 con 0x564b073a3880 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564b0739a6c0 con 0x564b073b5800 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f196469d740 10 client.0 _ll_register_callbacks cb 0x564b072fbe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56096/0 (socket says 172.21.15.52:56096) 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 -- 172.21.15.52:0/3294736456 learned_addr learned my addr 172.21.15.52:0/3294736456 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195a000640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195b400640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 -- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 msgr2=0x564b073a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 -- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 msgr2=0x564b073f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195aa00640 1 -- 172.21.15.52:0/3294736456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b070163f0 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.443+0000 7f195b400640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f195aa00640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f194c05c950 tx=0x7f194c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f72b6acaad14bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c088220 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f194c070170 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194c056790 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f194c070370 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f196469d740 10 client.9516 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x564b06fd60f0 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194c056790 con 0x564b073b5420 2024-09-10T08:39:57.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.444+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f194c0771a0 con 0x564b073b5420 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 10 client.9516 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 10 client.9516 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 20 client.9516 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073dfb20 0x564b073dff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 4 client.9516 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b07310d90 con 0x564b073dfb20 2024-09-10T08:39:57.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.445+0000 7f195a000640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073dfb20 0x564b073dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.446+0000 7f195a000640 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073dfb20 0x564b073dff20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be38ccab0d29bc63 server_cookie=c80fc98d68b7091b in_seq=0 out_seq=0 2024-09-10T08:39:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.446+0000 7f193be00640 10 client.9516 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f193be00640 1 -- 172.21.15.52:0/3294736456 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b07310d90 con 0x564b073dfb20 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f193be00640 10 client.9516 handle_command_reply: tid=0 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 client.9516 shutdown 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 msgr2=0x564b073a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f194c05c950 tx=0x7f194c007f90 comp rx=0 tx=0).stop 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 shutdown_connections 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073dfb20 0x564b073dff20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 --2- 172.21.15.52:0/3294736456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073a18f0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f193be00640 0 client.9516 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 >> 172.21.15.52:0/3294736456 conn(0x564b0739b480 msgr2=0x564b073e2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 shutdown_connections 2024-09-10T08:39:57.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 1 -- 172.21.15.52:0/3294736456 wait complete. 2024-09-10T08:39:57.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.447+0000 7f196469d740 20 client.9516 trim_cache size 0 max 16384 2024-09-10T08:39:57.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.465+0000 7f196469d740 1 Processor -- start 2024-09-10T08:39:57.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 -- start start 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f195c200b20 con 0x564b073b5420 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1570d0 con 0x564b073a3880 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.466+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f195c156430 con 0x564b073b5800 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56102/0 (socket says 172.21.15.52:56102) 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 -- 172.21.15.52:0/3904401138 learned_addr learned my addr 172.21.15.52:0/3904401138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195aa00640 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195b400640 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 -- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 msgr2=0x564b073b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 -- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 msgr2=0x564b073f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 -- 172.21.15.52:0/3904401138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0739b990 con 0x564b073b5420 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f195a000640 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f1948000c00 tx=0x7f194802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a270f8a943e90faa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.467+0000 7f1946a00640 1 -- 172.21.15.52:0/3904401138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948058020 con 0x564b073b5420 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f1946a00640 1 -- 172.21.15.52:0/3904401138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1948053450 con 0x564b073b5420 2024-09-10T08:39:57.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f1946a00640 1 -- 172.21.15.52:0/3904401138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1948037040 con 0x564b073b5420 2024-09-10T08:39:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 -- 172.21.15.52:0/3904401138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 msgr2=0x564b073b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f1948000c00 tx=0x7f194802c000 comp rx=0 tx=0).stop 2024-09-10T08:39:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 -- 172.21.15.52:0/3904401138 shutdown_connections 2024-09-10T08:39:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 --2- 172.21.15.52:0/3904401138 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073a3880 0x564b073f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 -- 172.21.15.52:0/3904401138 >> 172.21.15.52:0/3904401138 conn(0x564b0739b480 msgr2=0x564b073e3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 -- 172.21.15.52:0/3904401138 shutdown_connections 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.468+0000 7f196469d740 1 -- 172.21.15.52:0/3904401138 wait complete. 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.469+0000 7f196469d740 1 -- start start 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.469+0000 7f196469d740 1 Processor -- start 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564b0739a3e0 con 0x564b073a3880 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f195c156a80 con 0x564b073b5800 2024-09-10T08:39:57.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564b073def10 con 0x564b073b5420 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f196469d740 10 client.0 _ll_register_callbacks cb 0x7f194c06f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f195aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56114/0 (socket says 172.21.15.52:56114) 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f195aa00640 1 -- 172.21.15.52:0/3891888513 learned_addr learned my addr 172.21.15.52:0/3891888513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f195a000640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.470+0000 7f195b400640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 -- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5420 msgr2=0x564b073b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 -- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 msgr2=0x564b073b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 -- 172.21.15.52:0/3891888513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b073df3a0 con 0x564b073a3880 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195b400640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:57.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f195aa00640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c470 tx=0x7f194c009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf4a044ccbc71f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f193be00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c056790 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f194c057af0 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1948053450 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f194c0541e0 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f196469d740 10 client.9522 fetch_fsmap learned FSMap version 119 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x564b074038c0 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.471+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1948053450 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f194c080020 con 0x564b073a3880 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 10 client.9522 fetch_fsmap finished waiting for FSMap version 119 2024-09-10T08:39:57.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 10 client.9522 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.d 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 20 client.9522 populate_metadata read hostname 'smithi052' 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073e0980 0x564b07406b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 4 client.9522 mds_command: new command op to 9297 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 --> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564b0730b0e0 con 0x564b073e0980 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f195a000640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073e0980 0x564b07406b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f195a000640 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073e0980 0x564b07406b70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa5027a55fa38ae server_cookie=cfb4b71183ee451a in_seq=0 out_seq=0 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.472+0000 7f193be00640 10 client.9522 ms_handle_connect on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f193be00640 1 -- 172.21.15.52:0/3891888513 <== mds.0 v2:172.21.15.176:6834/3781623740 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x564b0730b0e0 con 0x564b073e0980 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f193be00640 10 client.9522 handle_command_reply: tid=0 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 client.9522 shutdown 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 msgr2=0x564b07462500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c470 tx=0x7f194c009030 comp rx=0 tx=0).stop 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 shutdown_connections 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:6834/3781623740,v1:172.21.15.176:6836/3781623740] conn(0x564b073e0980 0x564b07406b70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564b073b5800 0x564b073b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564b073b5420 0x564b073b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 --2- 172.21.15.52:0/3891888513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564b073a3880 0x564b07462500 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f193be00640 0 client.9522 ms_handle_reset on v2:172.21.15.176:6834/3781623740 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 >> 172.21.15.52:0/3891888513 conn(0x564b0739b480 msgr2=0x564b073c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 shutdown_connections 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 1 -- 172.21.15.52:0/3891888513 wait complete. 2024-09-10T08:39:57.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.473+0000 7f196469d740 20 client.9522 trim_cache size 0 max 16384 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "7a70662f-c37a-408c-bf99-3a9f420c94b9": { 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/scrub_control_test_path", 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "7a70662f-c37a-408c-bf99-3a9f420c94b9", 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:39:57.480 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:39:57.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 msgr2=0x7f193c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 0x7f193c06e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f194802e000 comp rx=0 tx=0).stop 2024-09-10T08:39:57.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 msgr2=0x7f195c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f194c00c4a0 tx=0x7f194c00c960 comp rx=0 tx=0).stop 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 shutdown_connections 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f193c06be30 0x7f193c06e2f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f195c0b38a0 0x7f195c1f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f195c0b3350 0x7f195c1f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 --2- 172.21.15.52:0/3558684382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f195c06bfd0 0x7f195c0cb7c0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 >> 172.21.15.52:0/3558684382 conn(0x7f195c0d11c0 msgr2=0x7f195c0d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 shutdown_connections 2024-09-10T08:39:57.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.474+0000 7f1961800640 1 -- 172.21.15.52:0/3558684382 wait complete. 2024-09-10T08:39:57.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.646+0000 7f6daa200640 1 Processor -- start 2024-09-10T08:39:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.646+0000 7f6daa200640 1 -- start start 2024-09-10T08:39:57.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6daa200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6da4148260 0x7f6da406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6daa200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 0x7f6da406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6daa200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da4071b30 con 0x7f6da4147e80 2024-09-10T08:39:57.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6daa200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6da4074200 con 0x7f6da4148260 2024-09-10T08:39:57.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6daa200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6da40b3e40 con 0x7f6da4071680 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.647+0000 7f6da3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6da4147e80 0x7f6da4070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44030/0 (socket says 172.21.15.52:44030) 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3400640 1 -- 172.21.15.52:0/1916933383 learned_addr learned my addr 172.21.15.52:0/1916933383 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3e00640 1 --2- 172.21.15.52:0/1916933383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 0x7f6da406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da2a00640 1 --2- 172.21.15.52:0/1916933383 >> v2:172.21.15.176:3300/0 conn(0x7f6da4148260 0x7f6da406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3e00640 1 -- 172.21.15.52:0/1916933383 >> v2:172.21.15.176:3300/0 conn(0x7f6da4148260 msgr2=0x7f6da406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3e00640 1 --2- 172.21.15.52:0/1916933383 >> v2:172.21.15.176:3300/0 conn(0x7f6da4148260 0x7f6da406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3e00640 1 -- 172.21.15.52:0/1916933383 >> v1:172.21.15.52:6789/0 conn(0x7f6da4147e80 legacy=0x7f6da4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da2000640 1 -- 172.21.15.52:0/1916933383 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762104826 0 0) 0x7f6da4071b30 con 0x7f6da4147e80 2024-09-10T08:39:57.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.648+0000 7f6da3e00640 1 -- 172.21.15.52:0/1916933383 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da40b3510 con 0x7f6da4071680 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.649+0000 7f6da3e00640 1 --2- 172.21.15.52:0/1916933383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 0x7f6da406c150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009d90 tx=0x7f6d9c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2150fa4c917e2516 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.649+0000 7f6da2000640 1 -- 172.21.15.52:0/1916933383 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c007740 con 0x7f6da4071680 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.649+0000 7f6da2000640 1 -- 172.21.15.52:0/1916933383 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0078e0 con 0x7f6da4071680 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.649+0000 7f6da2000640 1 -- 172.21.15.52:0/1916933383 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c007cb0 con 0x7f6da4071680 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 -- 172.21.15.52:0/1916933383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 msgr2=0x7f6da406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 --2- 172.21.15.52:0/1916933383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 0x7f6da406c150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c009d90 tx=0x7f6d9c02a660 comp rx=0 tx=0).stop 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 -- 172.21.15.52:0/1916933383 shutdown_connections 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 --2- 172.21.15.52:0/1916933383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4071680 0x7f6da406c150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 --2- 172.21.15.52:0/1916933383 >> v2:172.21.15.176:3300/0 conn(0x7f6da4148260 0x7f6da406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 -- 172.21.15.52:0/1916933383 >> 172.21.15.52:0/1916933383 conn(0x7f6da40ccec0 msgr2=0x7f6da40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 -- 172.21.15.52:0/1916933383 shutdown_connections 2024-09-10T08:39:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.650+0000 7f6daa200640 1 -- 172.21.15.52:0/1916933383 wait complete. 2024-09-10T08:39:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.652+0000 7f6daa200640 1 Processor -- start 2024-09-10T08:39:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.652+0000 7f6daa200640 1 -- start start 2024-09-10T08:39:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6da4071680 0x7f6da41f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4148260 0x7f6da4144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40b42d0 con 0x7f6da4147e80 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40b3ad0 con 0x7f6da4071680 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6daa200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6da40b4450 con 0x7f6da4148260 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56130/0 (socket says 172.21.15.52:56130) 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 -- 172.21.15.52:0/378969643 learned_addr learned my addr 172.21.15.52:0/378969643 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da3e00640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4148260 0x7f6da4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da3400640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6da4071680 0x7f6da41f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 -- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4148260 msgr2=0x7f6da4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4148260 0x7f6da4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 -- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6da4071680 msgr2=0x7f6da41f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6da4071680 0x7f6da41f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.653+0000 7f6da2a00640 1 -- 172.21.15.52:0/378969643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da40abd00 con 0x7f6da4147e80 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6da2a00640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e870 tx=0x7f6d9000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d90017070 con 0x7f6da4147e80 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9000c940 con 0x7f6da4147e80 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9000cd30 con 0x7f6da4147e80 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da40abfe0 con 0x7f6da4147e80 2024-09-10T08:39:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.654+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da40ac5a0 con 0x7f6da4147e80 2024-09-10T08:39:57.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.655+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da4070f70 con 0x7f6da4147e80 2024-09-10T08:39:57.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.656+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d9001a070 con 0x7f6da4147e80 2024-09-10T08:39:57.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.657+0000 7f6d9b400640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 0x7f6d8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:57.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.657+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f6d9008b100 con 0x7f6da4147e80 2024-09-10T08:39:57.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.658+0000 7f6da3400640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 0x7f6d8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:57.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.658+0000 7f6da3400640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 0x7f6d8406e320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000f60 tx=0x7f6d94007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:57.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.662+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d90059330 con 0x7f6da4147e80 2024-09-10T08:39:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.896+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6da4146f10 con 0x7f6da4147e80 2024-09-10T08:39:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.896+0000 7f6d9b400640 1 -- 172.21.15.52:0/378969643 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f6d9005d630 con 0x7f6da4147e80 2024-09-10T08:39:57.897 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:57.897 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 msgr2=0x7f6d8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 0x7f6d8406e320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000f60 tx=0x7f6d94007d50 comp rx=0 tx=0).stop 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 msgr2=0x7f6da40ab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e870 tx=0x7f6d9000ed30 comp rx=0 tx=0).stop 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 shutdown_connections 2024-09-10T08:39:57.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d8406be60 0x7f6d8406e320 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6da4148260 0x7f6da4144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da4147e80 0x7f6da40ab4b0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 --2- 172.21.15.52:0/378969643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6da4071680 0x7f6da41f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.898+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 >> 172.21.15.52:0/378969643 conn(0x7f6da40ccec0 msgr2=0x7f6da40c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.899+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 shutdown_connections 2024-09-10T08:39:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:57.899+0000 7f6daa200640 1 -- 172.21.15.52:0/378969643 wait complete. 2024-09-10T08:39:57.915 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:57.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:58.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.069+0000 7ff5eb200640 1 Processor -- start 2024-09-10T08:39:58.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.069+0000 7ff5eb200640 1 -- start start 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5eb200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff5e406c320 0x7ff5e4072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5eb200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5e406e800 con 0x7ff5e406e170 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5eb200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5e406eae0 con 0x7ff5e415c6a0 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5eb200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e406e5e0 con 0x7ff5e406c320 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5e9200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff5e406e170 0x7ff5e415ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44046/0 (socket says 172.21.15.52:44046) 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.070+0000 7ff5e9200640 1 -- 172.21.15.52:0/598964369 learned_addr learned my addr 172.21.15.52:0/598964369 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:58.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e3400640 1 --2- 172.21.15.52:0/598964369 >> v2:172.21.15.176:3300/0 conn(0x7ff5e406c320 0x7ff5e4072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282214014 0 0) 0x7ff5e406e800 con 0x7ff5e406e170 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5c8003520 con 0x7ff5e406e170 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931266994 0 0) 0x7ff5e406eae0 con 0x7ff5e415c6a0 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e406e800 con 0x7ff5e415c6a0 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e3400640 1 -- 172.21.15.52:0/598964369 >> v1:172.21.15.176:6789/0 conn(0x7ff5e415c6a0 legacy=0x7ff5e406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e3400640 1 -- 172.21.15.52:0/598964369 >> v1:172.21.15.52:6789/0 conn(0x7ff5e406e170 legacy=0x7ff5e415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.071+0000 7ff5e3400640 1 -- 172.21.15.52:0/598964369 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e406edc0 con 0x7ff5e406c320 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.072+0000 7ff5e3400640 1 --2- 172.21.15.52:0/598964369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e406c320 0x7ff5e4072fe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00097a0 tx=0x7ff5d002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93338056e79200af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.072+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0037070 con 0x7ff5e406c320 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.072+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d0032440 con 0x7ff5e406c320 2024-09-10T08:39:58.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.072+0000 7ff5e2a00640 1 -- 172.21.15.52:0/598964369 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0032810 con 0x7ff5e406c320 2024-09-10T08:39:58.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 -- 172.21.15.52:0/598964369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e406c320 msgr2=0x7ff5e4072fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 --2- 172.21.15.52:0/598964369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e406c320 0x7ff5e4072fe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00097a0 tx=0x7ff5d002a230 comp rx=0 tx=0).stop 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 -- 172.21.15.52:0/598964369 shutdown_connections 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 --2- 172.21.15.52:0/598964369 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e406c320 0x7ff5e4072fe0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 -- 172.21.15.52:0/598964369 >> 172.21.15.52:0/598964369 conn(0x7ff5e406cd20 msgr2=0x7ff5e406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 -- 172.21.15.52:0/598964369 shutdown_connections 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.073+0000 7ff5eb200640 1 -- 172.21.15.52:0/598964369 wait complete. 2024-09-10T08:39:58.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.075+0000 7ff5eb200640 1 Processor -- start 2024-09-10T08:39:58.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.075+0000 7ff5eb200640 1 -- start start 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e406e170 0x7ff5e4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e415c6a0 0x7ff5e415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e406f410 con 0x7ff5e406c320 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e415d190 con 0x7ff5e415c6a0 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5eb200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e415d310 con 0x7ff5e406e170 2024-09-10T08:39:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56146/0 (socket says 172.21.15.52:56146) 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5e3e00640 1 -- 172.21.15.52:0/1096030831 learned_addr learned my addr 172.21.15.52:0/1096030831 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5e3400640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e406e170 0x7ff5e4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.076+0000 7ff5e9200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e415c6a0 0x7ff5e415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 -- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e406e170 msgr2=0x7ff5e4156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e406e170 0x7ff5e4156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 -- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e415c6a0 msgr2=0x7ff5e415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e415c6a0 0x7ff5e415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 -- 172.21.15.52:0/1096030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e414b930 con 0x7ff5e406c320 2024-09-10T08:39:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5e3e00640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c430 tx=0x7ff5d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4017070 con 0x7ff5e406c320 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d40052f0 con 0x7ff5e406c320 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4003830 con 0x7ff5e406c320 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e41552c0 con 0x7ff5e406c320 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.077+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e4155880 con 0x7ff5e406c320 2024-09-10T08:39:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.078+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e40008d0 con 0x7ff5e406c320 2024-09-10T08:39:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.079+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5d401a070 con 0x7ff5e406c320 2024-09-10T08:39:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.080+0000 7ff5dbe00640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 0x7ff5c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.080+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7ff5d408a180 con 0x7ff5e406c320 2024-09-10T08:39:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.080+0000 7ff5e3400640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 0x7ff5c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.081+0000 7ff5e3400640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 0x7ff5c406e320 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0034000 tx=0x7ff5d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:58.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.084+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5d40584d0 con 0x7ff5e406c320 2024-09-10T08:39:58.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.335+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff5e4072ed0 con 0x7ff5e406c320 2024-09-10T08:39:58.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.336+0000 7ff5dbe00640 1 -- 172.21.15.52:0/1096030831 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1360 (secure 0 0 0) 0x7ff5d405c7d0 con 0x7ff5e406c320 2024-09-10T08:39:58.336 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:58.336 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":697,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":944,"data_bytes":967100510,"bytes_used":2338234368,"bytes_avail":770755878912,"bytes_total":773094113280,"write_bytes_sec":42640731,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":9297}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-10T08:39:23.612836+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 msgr2=0x7ff5c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 0x7ff5c406e320 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0034000 tx=0x7ff5d002e000 comp rx=0 tx=0).stop 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 msgr2=0x7ff5e414b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c430 tx=0x7ff5d400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 shutdown_connections 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff5c406be60 0x7ff5c406e320 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e415c6a0 0x7ff5e415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff5e406e170 0x7ff5e4156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 --2- 172.21.15.52:0/1096030831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e406c320 0x7ff5e414b3f0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:58.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 >> 172.21.15.52:0/1096030831 conn(0x7ff5e406cd20 msgr2=0x7ff5e406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:58.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 shutdown_connections 2024-09-10T08:39:58.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:58.338+0000 7ff5eb200640 1 -- 172.21.15.52:0/1096030831 wait complete. 2024-09-10T08:39:58.354 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:39:59.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:39:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.522+0000 7f8786000640 1 Processor -- start 2024-09-10T08:39:59.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.522+0000 7f8786000640 1 -- start start 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f8786000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 0x7f8780162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f8786000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800cf5e0 con 0x7f87800b6790 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f8786000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800cf8c0 con 0x7f878015e4c0 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f8786000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f87800cf3b0 con 0x7f87800cef50 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f877fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f87800b6790 0x7f87800d3180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44052/0 (socket says 172.21.15.52:44052) 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f877fe00640 1 -- 172.21.15.52:0/957646375 learned_addr learned my addr 172.21.15.52:0/957646375 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:59.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.523+0000 7f8785600640 1 --2- 172.21.15.52:0/957646375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 0x7f8780162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259166221 0 0) 0x7f87800cf5e0 con 0x7f87800b6790 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8768003520 con 0x7f87800b6790 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991434326 0 0) 0x7f87800cf8c0 con 0x7f878015e4c0 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87800cf5e0 con 0x7f878015e4c0 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f8785600640 1 -- 172.21.15.52:0/957646375 >> v1:172.21.15.176:6789/0 conn(0x7f878015e4c0 legacy=0x7f87800b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f8785600640 1 -- 172.21.15.52:0/957646375 >> v1:172.21.15.52:6789/0 conn(0x7f87800b6790 legacy=0x7f87800d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.524+0000 7f8785600640 1 -- 172.21.15.52:0/957646375 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800d2980 con 0x7f87800cef50 2024-09-10T08:39:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.525+0000 7f8785600640 1 --2- 172.21.15.52:0/957646375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 0x7f8780162b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8778009dc0 tx=0x7f877802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d687a3a5ebf6ac87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778007740 con 0x7f87800cef50 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87780078e0 con 0x7f87800cef50 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f877f400640 1 -- 172.21.15.52:0/957646375 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778007c90 con 0x7f87800cef50 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 -- 172.21.15.52:0/957646375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 msgr2=0x7f8780162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 --2- 172.21.15.52:0/957646375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 0x7f8780162b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8778009dc0 tx=0x7f877802a6d0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 -- 172.21.15.52:0/957646375 shutdown_connections 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 --2- 172.21.15.52:0/957646375 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87800cef50 0x7f8780162b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 -- 172.21.15.52:0/957646375 >> 172.21.15.52:0/957646375 conn(0x7f87800d1080 msgr2=0x7f87800d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 -- 172.21.15.52:0/957646375 shutdown_connections 2024-09-10T08:39:59.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.526+0000 7f8786000640 1 -- 172.21.15.52:0/957646375 wait complete. 2024-09-10T08:39:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.528+0000 7f8786000640 1 Processor -- start 2024-09-10T08:39:59.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.528+0000 7f8786000640 1 -- start start 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87800cef50 0x7f878015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 0x7f8780160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87800cfba0 con 0x7f87800b6790 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87801630b0 con 0x7f87800cef50 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8786000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f878015e8a0 con 0x7f878015e4c0 2024-09-10T08:39:59.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8784c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8784c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56158/0 (socket says 172.21.15.52:56158) 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f8784c00640 1 -- 172.21.15.52:0/2522707868 learned_addr learned my addr 172.21.15.52:0/2522707868 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.529+0000 7f877fe00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87800cef50 0x7f878015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8785600640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 0x7f8780160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 -- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 msgr2=0x7f8780160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 0x7f8780160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 -- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87800cef50 msgr2=0x7f878015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87800cef50 0x7f878015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 -- 172.21.15.52:0/2522707868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800b53a0 con 0x7f87800b6790 2024-09-10T08:39:59.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8785600640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 0x7f8780160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:39:59.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f8784c00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f877400c460 tx=0x7f877400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.530+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774017070 con 0x7f87800b6790 2024-09-10T08:39:59.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.531+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87740052f0 con 0x7f87800b6790 2024-09-10T08:39:59.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.531+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800b5680 con 0x7f87800b6790 2024-09-10T08:39:59.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.531+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774003830 con 0x7f87800b6790 2024-09-10T08:39:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.531+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8780154710 con 0x7f87800b6790 2024-09-10T08:39:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.532+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8780162b70 con 0x7f87800b6790 2024-09-10T08:39:59.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.533+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f877401a070 con 0x7f87800b6790 2024-09-10T08:39:59.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.534+0000 7f877cc00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 0x7f876006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.534+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f877408a250 con 0x7f87800b6790 2024-09-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.534+0000 7f877fe00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 0x7f876006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.535+0000 7f877fe00640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 0x7f876006e2f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f87801626c0 tx=0x7f876c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.539+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8774058510 con 0x7f87800b6790 2024-09-10T08:39:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.764+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87800ba580 con 0x7f87800b6790 2024-09-10T08:39:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.764+0000 7f877cc00640 1 -- 172.21.15.52:0/2522707868 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f877405c810 con 0x7f87800b6790 2024-09-10T08:39:59.765 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:39:59.765 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:39:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:39:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.766+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 msgr2=0x7f876006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.766+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 0x7f876006e2f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f87801626c0 tx=0x7f876c007d30 comp rx=0 tx=0).stop 2024-09-10T08:39:59.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.766+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 msgr2=0x7f87800b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.766+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f877400c460 tx=0x7f877400c920 comp rx=0 tx=0).stop 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 shutdown_connections 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f876006be30 0x7f876006e2f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f878015e4c0 0x7f8780160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87800cef50 0x7f878015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 --2- 172.21.15.52:0/2522707868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87800b6790 0x7f87800b4b10 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 >> 172.21.15.52:0/2522707868 conn(0x7f87800d1080 msgr2=0x7f87800b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 shutdown_connections 2024-09-10T08:39:59.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.767+0000 7f8786000640 1 -- 172.21.15.52:0/2522707868 wait complete. 2024-09-10T08:39:59.783 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-10T08:39:59.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:39:59.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.938+0000 7fcd81400640 1 Processor -- start 2024-09-10T08:39:59.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.938+0000 7fcd81400640 1 -- start start 2024-09-10T08:39:59.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.939+0000 7fcd81400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcd7c148260 0x7fcd7c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.939+0000 7fcd81400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7c071b30 con 0x7fcd7c147e80 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.939+0000 7fcd81400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7c0b3510 con 0x7fcd7c071680 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.939+0000 7fcd81400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7c074200 con 0x7fcd7c148260 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd7a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcd7c147e80 0x7fcd7c070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44062/0 (socket says 172.21.15.52:44062) 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd7a800640 1 -- 172.21.15.52:0/13928665 learned_addr learned my addr 172.21.15.52:0/13928665 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd73e00640 1 --2- 172.21.15.52:0/13928665 >> v2:172.21.15.176:3300/0 conn(0x7fcd7c148260 0x7fcd7c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228417093 0 0) 0x7fcd7c071b30 con 0x7fcd7c147e80 2024-09-10T08:39:59.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd60003520 con 0x7fcd7c147e80 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642001910 0 0) 0x7fcd7c0b3510 con 0x7fcd7c071680 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd7c071b30 con 0x7fcd7c071680 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.940+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4222298346 0 0) 0x7fcd60003520 con 0x7fcd7c147e80 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 >> v2:172.21.15.176:3300/0 conn(0x7fcd7c148260 msgr2=0x7fcd7c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 --2- 172.21.15.52:0/13928665 >> v2:172.21.15.176:3300/0 conn(0x7fcd7c148260 0x7fcd7c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 >> v1:172.21.15.176:6789/0 conn(0x7fcd7c071680 legacy=0x7fcd7c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c0b37f0 con 0x7fcd7c147e80 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fcd6c0015f0 con 0x7fcd7c147e80 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 >> v1:172.21.15.52:6789/0 conn(0x7fcd7c147e80 legacy=0x7fcd7c070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd60003b90 0x7fcd60003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd60004800 0x7fcd60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 0x7fcd6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c074200 con 0x7fcd600051c0 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6000c090 con 0x7fcd60004800 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6000c290 con 0x7fcd60003b90 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 0x7fcd6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd73e00640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd60004800 0x7fcd60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7a800640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd60003b90 0x7fcd60003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 -- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd60003b90 msgr2=0x7fcd60003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd60003b90 0x7fcd60003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 -- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd60004800 msgr2=0x7fcd60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd60004800 0x7fcd60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.941+0000 7fcd7b200640 1 -- 172.21.15.52:0/13928665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd60003520 con 0x7fcd600051c0 2024-09-10T08:39:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.942+0000 7fcd7b200640 1 -- 172.21.15.52:0/13928665 reap_dead start 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.942+0000 7fcd7b200640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 0x7fcd6000b9c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fcd74001fa0 tx=0x7fcd60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2523473f49a87e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74001bf0 con 0x7fcd600051c0 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd74003b70 con 0x7fcd600051c0 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd79e00640 1 -- 172.21.15.52:0/13928665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740050d0 con 0x7fcd600051c0 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 -- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 msgr2=0x7fcd6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 0x7fcd6000b9c0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fcd74001fa0 tx=0x7fcd60005830 comp rx=0 tx=0).stop 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 -- 172.21.15.52:0/13928665 shutdown_connections 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 --2- 172.21.15.52:0/13928665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd600051c0 0x7fcd6000b9c0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 -- 172.21.15.52:0/13928665 >> 172.21.15.52:0/13928665 conn(0x7fcd7c0ccec0 msgr2=0x7fcd7c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 -- 172.21.15.52:0/13928665 shutdown_connections 2024-09-10T08:39:59.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.943+0000 7fcd81400640 1 -- 172.21.15.52:0/13928665 wait complete. 2024-09-10T08:39:59.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.945+0000 7fcd81400640 1 Processor -- start 2024-09-10T08:39:59.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.945+0000 7fcd81400640 1 -- start start 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd600051c0 0x7fcd7c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7c139c80 0x7fcd7c1f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c070f70 con 0x7fcd7c1f4560 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0b3e40 con 0x7fcd7c139c80 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd81400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c0710f0 con 0x7fcd600051c0 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd7b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd7b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56180/0 (socket says 172.21.15.52:56180) 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd7b200640 1 -- 172.21.15.52:0/3542202041 learned_addr learned my addr 172.21.15.52:0/3542202041 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd7a800640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd600051c0 0x7fcd7c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.946+0000 7fcd73e00640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7c139c80 0x7fcd7c1f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 -- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd600051c0 msgr2=0x7fcd7c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd600051c0 0x7fcd7c0b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 -- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7c139c80 msgr2=0x7fcd7c1f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7c139c80 0x7fcd7c1f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 -- 172.21.15.52:0/3542202041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c13a280 con 0x7fcd7c1f4560 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd7b200640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fcd74007ee0 tx=0x7fcd74001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74041070 con 0x7fcd7c1f4560 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd74003970 con 0x7fcd7c1f4560 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74005500 con 0x7fcd7c1f4560 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c13a560 con 0x7fcd7c1f4560 2024-09-10T08:39:59.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.947+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c13ab20 con 0x7fcd7c1f4560 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.948+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c06bc10 con 0x7fcd7c1f4560 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.949+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd74039070 con 0x7fcd7c1f4560 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.950+0000 7fcd72a00640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 0x7fcd5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.950+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fcd740aa0d0 con 0x7fcd7c1f4560 2024-09-10T08:39:59.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.951+0000 7fcd7a800640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 0x7fcd5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:39:59.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.951+0000 7fcd7a800640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 0x7fcd5806e2f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c00 tx=0x7fcd6c001cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:39:59.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:39:59.954+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd74078aa0 con 0x7fcd7c1f4560 2024-09-10T08:40:00.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.206+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcd7c147630 con 0x7fcd7c1f4560 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.206+0000 7fcd72a00640 1 -- 172.21.15.52:0/3542202041 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fcd740783a0 con 0x7fcd7c1f4560 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:00.207 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":699,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":963,"data_bytes":987023454,"bytes_used":2401148928,"bytes_avail":770692964352,"bytes_total":773094113280,"write_bytes_sec":44300874,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":9297}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-10T08:39:59.621755+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}}}}}},"progress_events":{}} 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 msgr2=0x7fcd5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 0x7fcd5806e2f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c000c00 tx=0x7fcd6c001cd0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 msgr2=0x7fcd7c0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fcd74007ee0 tx=0x7fcd74001650 comp rx=0 tx=0).stop 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 shutdown_connections 2024-09-10T08:40:00.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd5806be30 0x7fcd5806e2f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd7c1f4560 0x7fcd7c0b5000 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd7c139c80 0x7fcd7c1f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 --2- 172.21.15.52:0/3542202041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd600051c0 0x7fcd7c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 >> 172.21.15.52:0/3542202041 conn(0x7fcd7c0ccec0 msgr2=0x7fcd7c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.208+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 shutdown_connections 2024-09-10T08:40:00.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.209+0000 7fcd81400640 1 -- 172.21.15.52:0/3542202041 wait complete. 2024-09-10T08:40:00.225 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused paths [/scrub_control_test_path]'} 2024-09-10T08:40:00.226 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:40:00.226 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:40:00.246 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:40:00.246 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'c', 'a'} 2024-09-10T08:40:00.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-10T08:40:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-10T08:40:00.413 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-10T08:40:00.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:00.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.568+0000 7f8916600640 1 Processor -- start 2024-09-10T08:40:00.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.569+0000 7f8916600640 1 -- start start 2024-09-10T08:40:00.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f8916600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8910147e80 0x7f8910070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f8916600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8910148260 0x7f89100714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f8916600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8910071b30 con 0x7f891006bc10 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f8916600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8910074200 con 0x7f8910147e80 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f8916600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f89100b3e40 con 0x7f8910148260 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f890f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8910147e80 0x7f8910070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f890f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8910147e80 0x7f8910070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56192/0 (socket says 172.21.15.52:56192) 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.570+0000 7f890f400640 1 -- 172.21.15.52:0/1061391813 learned_addr learned my addr 172.21.15.52:0/1061391813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:00.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.571+0000 7f8907e00640 1 --2- 172.21.15.52:0/1061391813 >> v2:172.21.15.176:3300/0 conn(0x7f8910148260 0x7f89100714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.571+0000 7f890f400640 1 -- 172.21.15.52:0/1061391813 >> v2:172.21.15.176:3300/0 conn(0x7f8910148260 msgr2=0x7f89100714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.571+0000 7f890f400640 1 --2- 172.21.15.52:0/1061391813 >> v2:172.21.15.176:3300/0 conn(0x7f8910148260 0x7f89100714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.571+0000 7f890f400640 1 -- 172.21.15.52:0/1061391813 >> v1:172.21.15.176:6789/0 conn(0x7f891006bc10 legacy=0x7f89101623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.571+0000 7f890f400640 1 -- 172.21.15.52:0/1061391813 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89100b3510 con 0x7f8910147e80 2024-09-10T08:40:00.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.572+0000 7f890f400640 1 --2- 172.21.15.52:0/1061391813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910070f70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f89100cce90 tx=0x7f890002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175ee2a64f691141 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.572+0000 7f890ea00640 1 -- 172.21.15.52:0/1061391813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900037070 con 0x7f8910147e80 2024-09-10T08:40:00.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.572+0000 7f890ea00640 1 -- 172.21.15.52:0/1061391813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8900032440 con 0x7f8910147e80 2024-09-10T08:40:00.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.572+0000 7f890ea00640 1 -- 172.21.15.52:0/1061391813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900032810 con 0x7f8910147e80 2024-09-10T08:40:00.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 -- 172.21.15.52:0/1061391813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 msgr2=0x7f8910070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 --2- 172.21.15.52:0/1061391813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910070f70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f89100cce90 tx=0x7f890002a270 comp rx=0 tx=0).stop 2024-09-10T08:40:00.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 -- 172.21.15.52:0/1061391813 shutdown_connections 2024-09-10T08:40:00.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 --2- 172.21.15.52:0/1061391813 >> v2:172.21.15.176:3300/0 conn(0x7f8910148260 0x7f89100714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 --2- 172.21.15.52:0/1061391813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910070f70 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 -- 172.21.15.52:0/1061391813 >> 172.21.15.52:0/1061391813 conn(0x7f89100ccec0 msgr2=0x7f89100cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 -- 172.21.15.52:0/1061391813 shutdown_connections 2024-09-10T08:40:00.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.573+0000 7f8916600640 1 -- 172.21.15.52:0/1061391813 wait complete. 2024-09-10T08:40:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.575+0000 7f8916600640 1 Processor -- start 2024-09-10T08:40:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.575+0000 7f8916600640 1 -- start start 2024-09-10T08:40:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f891006bc10 0x7f8910144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8910148260 0x7f891015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89100b52e0 con 0x7f8910147e80 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89100b3ad0 con 0x7f8910148260 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8916600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f89100b5460 con 0x7f891006bc10 2024-09-10T08:40:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8907e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8907e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56198/0 (socket says 172.21.15.52:56198) 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f8907e00640 1 -- 172.21.15.52:0/2799037758 learned_addr learned my addr 172.21.15.52:0/2799037758 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f890f400640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f891006bc10 0x7f8910144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.576+0000 7f890fe00640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8910148260 0x7f891015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 -- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f891006bc10 msgr2=0x7f8910144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f891006bc10 0x7f8910144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 -- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8910148260 msgr2=0x7f891015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8910148260 0x7f891015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 -- 172.21.15.52:0/2799037758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89101e3d50 con 0x7f8910147e80 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907e00640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f88f800d800 tx=0x7f88f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f800b6c0 con 0x7f8910147e80 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f8019070 con 0x7f8910147e80 2024-09-10T08:40:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f800ba80 con 0x7f8910147e80 2024-09-10T08:40:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89101e4030 con 0x7f8910147e80 2024-09-10T08:40:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.577+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101e45f0 con 0x7f8910147e80 2024-09-10T08:40:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.578+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891006c080 con 0x7f8910147e80 2024-09-10T08:40:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.579+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88f800bc20 con 0x7f8910147e80 2024-09-10T08:40:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.580+0000 7f8907400640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.580+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f88f808b3a0 con 0x7f8910147e80 2024-09-10T08:40:00.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.581+0000 7f890f400640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:00.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.581+0000 7f890f400640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 0x7f88ec06e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8900034000 tx=0x7f890002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:00.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.585+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88f8059cb0 con 0x7f8910147e80 2024-09-10T08:40:00.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.804+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89101450c0 con 0x7f8910147e80 2024-09-10T08:40:00.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.805+0000 7f8907400640 1 -- 172.21.15.52:0/2799037758 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f88f80595b0 con 0x7f8910147e80 2024-09-10T08:40:00.808 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:00.808 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 msgr2=0x7f88ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 0x7f88ec06e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8900034000 tx=0x7f890002e000 comp rx=0 tx=0).stop 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 msgr2=0x7f8910143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f88f800d800 tx=0x7f88f800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 shutdown_connections 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f88ec06be30 0x7f88ec06e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8910148260 0x7f891015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8910147e80 0x7f8910143d70 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 --2- 172.21.15.52:0/2799037758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f891006bc10 0x7f8910144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 >> 172.21.15.52:0/2799037758 conn(0x7f89100ccec0 msgr2=0x7f89100cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 shutdown_connections 2024-09-10T08:40:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:00.807+0000 7f8916600640 1 -- 172.21.15.52:0/2799037758 wait complete. 2024-09-10T08:40:00.823 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T08:40:05.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:05.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.994+0000 7fdec2000640 1 Processor -- start 2024-09-10T08:40:05.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.994+0000 7fdec2000640 1 -- start start 2024-09-10T08:40:05.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdec2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:05.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdec2000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdebc15f570 con 0x7fdebc15eab0 2024-09-10T08:40:05.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdec2000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdebc15f850 con 0x7fdebc162490 2024-09-10T08:40:05.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdec2000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc15fb30 con 0x7fdebc0b6dc0 2024-09-10T08:40:05.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdebb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdebc15eab0 0x7fdebc0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52834/0 (socket says 172.21.15.52:52834) 2024-09-10T08:40:05.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.995+0000 7fdebb400640 1 -- 172.21.15.52:0/655764160 learned_addr learned my addr 172.21.15.52:0/655764160 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebbe00640 1 --2- 172.21.15.52:0/655764160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731688942 0 0) 0x7fdebc15f570 con 0x7fdebc15eab0 2024-09-10T08:40:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdea0003520 con 0x7fdebc15eab0 2024-09-10T08:40:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854566634 0 0) 0x7fdebc15f850 con 0x7fdebc162490 2024-09-10T08:40:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdebc15f570 con 0x7fdebc162490 2024-09-10T08:40:05.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3033712417 0 0) 0x7fdea0003520 con 0x7fdebc15eab0 2024-09-10T08:40:05.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebbe00640 1 -- 172.21.15.52:0/655764160 >> v1:172.21.15.176:6789/0 conn(0x7fdebc162490 legacy=0x7fdebc0b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:05.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebbe00640 1 -- 172.21.15.52:0/655764160 >> v1:172.21.15.52:6789/0 conn(0x7fdebc15eab0 legacy=0x7fdebc0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:05.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.996+0000 7fdebbe00640 1 -- 172.21.15.52:0/655764160 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc15fe10 con 0x7fdebc0b6dc0 2024-09-10T08:40:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.997+0000 7fdebbe00640 1 --2- 172.21.15.52:0/655764160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc15ee90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009dc0 tx=0x7fdeb402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a227c7753a98dea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac001670 con 0x7fdebc0b6dc0 2024-09-10T08:40:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb4007540 con 0x7fdebc0b6dc0 2024-09-10T08:40:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdebaa00640 1 -- 172.21.15.52:0/655764160 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4007910 con 0x7fdebc0b6dc0 2024-09-10T08:40:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 -- 172.21.15.52:0/655764160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 msgr2=0x7fdebc15ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 --2- 172.21.15.52:0/655764160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc15ee90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009dc0 tx=0x7fdeb402a660 comp rx=0 tx=0).stop 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 -- 172.21.15.52:0/655764160 shutdown_connections 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 --2- 172.21.15.52:0/655764160 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc15ee90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 -- 172.21.15.52:0/655764160 >> 172.21.15.52:0/655764160 conn(0x7fdebc0d16d0 msgr2=0x7fdebc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 -- 172.21.15.52:0/655764160 shutdown_connections 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:05.998+0000 7fdec2000640 1 -- 172.21.15.52:0/655764160 wait complete. 2024-09-10T08:40:06.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.000+0000 7fdec2000640 1 Processor -- start 2024-09-10T08:40:06.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.000+0000 7fdec2000640 1 -- start start 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdebc15eab0 0x7fdebc0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc0d45e0 con 0x7fdebc162490 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc0d4460 con 0x7fdebc15eab0 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdec2000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdebc0d35e0 con 0x7fdebc0b6dc0 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdebbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdebbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58352/0 (socket says 172.21.15.52:58352) 2024-09-10T08:40:06.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdebbe00640 1 -- 172.21.15.52:0/4057766299 learned_addr learned my addr 172.21.15.52:0/4057766299 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdebb400640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.001+0000 7fdeb3e00640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdebc15eab0 0x7fdebc0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 -- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 msgr2=0x7fdebc14f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc14f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 -- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdebc15eab0 msgr2=0x7fdebc0b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdebc15eab0 0x7fdebc0b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 -- 172.21.15.52:0/4057766299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc0b3350 con 0x7fdebc162490 2024-09-10T08:40:06.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdebbe00640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fdeb402ac50 tx=0x7fdeb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:06.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.002+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4040070 con 0x7fdebc162490 2024-09-10T08:40:06.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.003+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc0ce290 con 0x7fdebc162490 2024-09-10T08:40:06.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.003+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb4031b40 con 0x7fdebc162490 2024-09-10T08:40:06.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.003+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4007e70 con 0x7fdebc162490 2024-09-10T08:40:06.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.003+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc0c8640 con 0x7fdebc162490 2024-09-10T08:40:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.004+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc15f850 con 0x7fdebc162490 2024-09-10T08:40:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.005+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdeb4039040 con 0x7fdebc162490 2024-09-10T08:40:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.005+0000 7fdeb3400640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 0x7fde9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:06.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.006+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7fdeb40abe50 con 0x7fdebc162490 2024-09-10T08:40:06.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.006+0000 7fdebb400640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 0x7fde9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:06.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.007+0000 7fdebb400640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 0x7fde9806e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0017e0 tx=0x7fdeac001610 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:06.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.015+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdeb407a090 con 0x7fdebc162490 2024-09-10T08:40:06.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.237+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdebc0ba7b0 con 0x7fdebc162490 2024-09-10T08:40:06.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.238+0000 7fdeb3400640 1 -- 172.21.15.52:0/4057766299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7fdeb407e390 con 0x7fdebc162490 2024-09-10T08:40:06.240 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:06.240 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.240+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 msgr2=0x7fde9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.240+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 0x7fde9806e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0017e0 tx=0x7fdeac001610 comp rx=0 tx=0).stop 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.240+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 msgr2=0x7fdebc0b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.240+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fdeb402ac50 tx=0x7fdeb4004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:06.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 shutdown_connections 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fde9806be30 0x7fde9806e2f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdebc162490 0x7fdebc0b2e10 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdebc15eab0 0x7fdebc0b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 --2- 172.21.15.52:0/4057766299 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdebc0b6dc0 0x7fdebc14f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 >> 172.21.15.52:0/4057766299 conn(0x7fdebc0d16d0 msgr2=0x7fdebc0d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 shutdown_connections 2024-09-10T08:40:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:06.241+0000 7fdec2000640 1 -- 172.21.15.52:0/4057766299 wait complete. 2024-09-10T08:40:06.258 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T08:40:07.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:07.779 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:11.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:11.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.428+0000 7f3aae000640 1 Processor -- start 2024-09-10T08:40:11.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.428+0000 7f3aae000640 1 -- start start 2024-09-10T08:40:11.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3aa81522d0 0x7f3aa80b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3aa80b60e0 0x7f3aa815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa815f400 0x7f3aa815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa815f870 con 0x7f3aa80b60e0 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa815ca90 con 0x7f3aa81522d0 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aae000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80b6660 con 0x7f3aa815f400 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.429+0000 7f3aa7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3aa80b60e0 0x7f3aa815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3aa80b60e0 0x7f3aa815eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58364/0 (socket says 172.21.15.52:58364) 2024-09-10T08:40:11.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 -- 172.21.15.52:0/331699105 learned_addr learned my addr 172.21.15.52:0/331699105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aacc00640 1 --2- 172.21.15.52:0/331699105 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81522d0 0x7f3aa80b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aad600640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa815f400 0x7f3aa815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 -- 172.21.15.52:0/331699105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa815f400 msgr2=0x7f3aa815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa815f400 0x7f3aa815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 -- 172.21.15.52:0/331699105 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81522d0 msgr2=0x7f3aa80b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/331699105 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81522d0 0x7f3aa80b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.430+0000 7f3aa7e00640 1 -- 172.21.15.52:0/331699105 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa815cce0 con 0x7f3aa80b60e0 2024-09-10T08:40:11.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.431+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa80b60e0 0x7f3aa815eec0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806f210 tx=0x7f3a9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2650c46b67dc742d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.431+0000 7f3aa7400640 1 -- 172.21.15.52:0/331699105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94037070 con 0x7f3aa80b60e0 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.431+0000 7f3aa7400640 1 -- 172.21.15.52:0/331699105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94032440 con 0x7f3aa80b60e0 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.431+0000 7f3aa7400640 1 -- 172.21.15.52:0/331699105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94032810 con 0x7f3aa80b60e0 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 -- 172.21.15.52:0/331699105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa80b60e0 msgr2=0x7f3aa815eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa80b60e0 0x7f3aa815eec0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f3aa806f210 tx=0x7f3a9402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 -- 172.21.15.52:0/331699105 shutdown_connections 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa815f400 0x7f3aa815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 --2- 172.21.15.52:0/331699105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa80b60e0 0x7f3aa815eec0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 --2- 172.21.15.52:0/331699105 >> v2:172.21.15.176:3300/0 conn(0x7f3aa81522d0 0x7f3aa80b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 -- 172.21.15.52:0/331699105 >> 172.21.15.52:0/331699105 conn(0x7f3aa806c240 msgr2=0x7f3aa806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 -- 172.21.15.52:0/331699105 shutdown_connections 2024-09-10T08:40:11.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.432+0000 7f3aae000640 1 -- 172.21.15.52:0/331699105 wait complete. 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.434+0000 7f3aae000640 1 Processor -- start 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.434+0000 7f3aae000640 1 -- start start 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b60e0 0x7f3aa81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa815f400 0x7f3aa815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa815fc80 con 0x7f3aa81522d0 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa815d2a0 con 0x7f3aa815f400 2024-09-10T08:40:11.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aae000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa81526b0 con 0x7f3aa80b60e0 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58374/0 (socket says 172.21.15.52:58374) 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aa7e00640 1 -- 172.21.15.52:0/606578174 learned_addr learned my addr 172.21.15.52:0/606578174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aacc00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b60e0 0x7f3aa81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.435+0000 7f3aad600640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa815f400 0x7f3aa815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 -- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b60e0 msgr2=0x7f3aa81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b60e0 0x7f3aa81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 -- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa815f400 msgr2=0x7f3aa815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa815f400 0x7f3aa815a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 -- 172.21.15.52:0/606578174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa81f4f90 con 0x7f3aa81522d0 2024-09-10T08:40:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa7e00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3a9402a220 tx=0x7f3a940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94041020 con 0x7f3aa81522d0 2024-09-10T08:40:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9403d620 con 0x7f3aa81522d0 2024-09-10T08:40:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94037040 con 0x7f3aa81522d0 2024-09-10T08:40:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa81f5270 con 0x7f3aa81522d0 2024-09-10T08:40:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.436+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa81f5830 con 0x7f3aa81522d0 2024-09-10T08:40:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.437+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa815eec0 con 0x7f3aa81522d0 2024-09-10T08:40:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.438+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a94044020 con 0x7f3aa81522d0 2024-09-10T08:40:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.439+0000 7f3aa4c00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 0x7f3a8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.439+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5709+0+0 (secure 0 0 0) 0x7f3a940ab3d0 con 0x7f3aa81522d0 2024-09-10T08:40:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.440+0000 7f3aacc00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 0x7f3a8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.440+0000 7f3aacc00640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 0x7f3a8806e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009ac0 tx=0x7f3a9c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.444+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a9404b030 con 0x7f3aa81522d0 2024-09-10T08:40:11.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.664+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa80afeb0 con 0x7f3aa81522d0 2024-09-10T08:40:11.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.665+0000 7f3aa4c00640 1 -- 172.21.15.52:0/606578174 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5236 (secure 0 0 0) 0x7f3a94079720 con 0x7f3aa81522d0 2024-09-10T08:40:11.665 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:11.665 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":119,"btime":"2024-09-10T08:39:30:534225+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:39:29.958210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9297":{"gid":9297,"name":"d","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6836/3781623740","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3781623740},{"type":"v1","addr":"172.21.15.176:6836","nonce":3781623740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9297,"qdb_cluster":[9297]},"id":11}]} 2024-09-10T08:40:11.665 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 119 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 msgr2=0x7f3a8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 0x7f3a8806e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009ac0 tx=0x7f3a9c009190 comp rx=0 tx=0).stop 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 msgr2=0x7f3aa80b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3a9402a220 tx=0x7f3a940046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 shutdown_connections 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3a8806be30 0x7f3a8806e2f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3aa815f400 0x7f3aa815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3aa81522d0 0x7f3aa80b0b40 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 --2- 172.21.15.52:0/606578174 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3aa80b60e0 0x7f3aa81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 >> 172.21.15.52:0/606578174 conn(0x7f3aa806c240 msgr2=0x7f3aa81594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 shutdown_connections 2024-09-10T08:40:11.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:11.667+0000 7f3aae000640 1 -- 172.21.15.52:0/606578174 wait complete. 2024-09-10T08:40:11.683 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T08:40:16.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:16.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.853+0000 7f8bfbe00640 1 Processor -- start 2024-09-10T08:40:16.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.853+0000 7f8bfbe00640 1 -- start start 2024-09-10T08:40:16.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bfc0b6710 0x7f8bfc0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfbe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8bfc0cf450 0x7f8bfc0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfbe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0d3990 con 0x7f8bfc15e440 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfbe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0d3c70 con 0x7f8bfc0b6710 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfbe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0d3f50 con 0x7f8bfc0cf450 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfaa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8bfc15e440 0x7f8bfc0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40638/0 (socket says 172.21.15.52:40638) 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfaa00640 1 -- 172.21.15.52:0/740821088 learned_addr learned my addr 172.21.15.52:0/740821088 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:16.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.854+0000 7f8bfa000640 1 --2- 172.21.15.52:0/740821088 >> v2:172.21.15.52:3300/0 conn(0x7f8bfc0b6710 0x7f8bfc0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bfb400640 1 --2- 172.21.15.52:0/740821088 >> v2:172.21.15.176:3300/0 conn(0x7f8bfc0cf450 0x7f8bfc0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bfa000640 1 -- 172.21.15.52:0/740821088 >> v2:172.21.15.176:3300/0 conn(0x7f8bfc0cf450 msgr2=0x7f8bfc0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bfa000640 1 --2- 172.21.15.52:0/740821088 >> v2:172.21.15.176:3300/0 conn(0x7f8bfc0cf450 0x7f8bfc0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bfa000640 1 -- 172.21.15.52:0/740821088 >> v1:172.21.15.52:6789/0 conn(0x7f8bfc15e440 legacy=0x7f8bfc0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bfa000640 1 -- 172.21.15.52:0/740821088 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc0d4230 con 0x7f8bfc0b6710 2024-09-10T08:40:16.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.855+0000 7f8bf9600640 1 -- 172.21.15.52:0/740821088 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954898617 0 0) 0x7f8bfc0d3990 con 0x7f8bfc15e440 2024-09-10T08:40:16.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.856+0000 7f8bfa000640 1 --2- 172.21.15.52:0/740821088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc0b6710 0x7f8bfc0d3240 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0d4510 tx=0x7f8be802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00ee7b2c4e2f8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.856+0000 7f8bf9600640 1 -- 172.21.15.52:0/740821088 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8037070 con 0x7f8bfc0b6710 2024-09-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.856+0000 7f8bf9600640 1 -- 172.21.15.52:0/740821088 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be8032440 con 0x7f8bfc0b6710 2024-09-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.856+0000 7f8bf9600640 1 -- 172.21.15.52:0/740821088 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8032810 con 0x7f8bfc0b6710 2024-09-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 -- 172.21.15.52:0/740821088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc0b6710 msgr2=0x7f8bfc0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/740821088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc0b6710 0x7f8bfc0d3240 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0d4510 tx=0x7f8be802a230 comp rx=0 tx=0).stop 2024-09-10T08:40:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 -- 172.21.15.52:0/740821088 shutdown_connections 2024-09-10T08:40:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/740821088 >> v2:172.21.15.176:3300/0 conn(0x7f8bfc0cf450 0x7f8bfc0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/740821088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc0b6710 0x7f8bfc0d3240 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 -- 172.21.15.52:0/740821088 >> 172.21.15.52:0/740821088 conn(0x7f8bfc067f80 msgr2=0x7f8bfc0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:16.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 -- 172.21.15.52:0/740821088 shutdown_connections 2024-09-10T08:40:16.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.857+0000 7f8bfbe00640 1 -- 172.21.15.52:0/740821088 wait complete. 2024-09-10T08:40:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.859+0000 7f8bfbe00640 1 Processor -- start 2024-09-10T08:40:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.859+0000 7f8bfbe00640 1 -- start start 2024-09-10T08:40:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.859+0000 7f8bfbe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bfc0b6710 0x7f8bfc0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 0x7f8bfc0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfbe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b76c0 con 0x7f8bfc15e440 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfbe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b7540 con 0x7f8bfc0cf450 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfbe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc0b80a0 con 0x7f8bfc0b6710 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59480/0 (socket says 172.21.15.52:59480) 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 -- 172.21.15.52:0/3595894425 learned_addr learned my addr 172.21.15.52:0/3595894425 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfa000640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 0x7f8bfc0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfaa00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bfc0b6710 0x7f8bfc0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 -- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bfc0b6710 msgr2=0x7f8bfc0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bfc0b6710 0x7f8bfc0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 -- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 msgr2=0x7f8bfc0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 0x7f8bfc0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfb400640 1 -- 172.21.15.52:0/3595894425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc156b00 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.860+0000 7f8bfa000640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 0x7f8bfc0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bfb400640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007e70 tx=0x7f8bf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4014620 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf4019070 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4014a20 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc158330 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.861+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc1588f0 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.862+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc0b7b60 con 0x7f8bfc15e440 2024-09-10T08:40:16.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.863+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bf4014bc0 con 0x7f8bfc15e440 2024-09-10T08:40:16.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.864+0000 7f8bf2a00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 0x7f8bdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:16.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.864+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f8bf408b770 con 0x7f8bfc15e440 2024-09-10T08:40:16.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.865+0000 7f8bfaa00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 0x7f8bdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:16.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.865+0000 7f8bfaa00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 0x7f8bdc06e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8bec007fd0 tx=0x7f8bec007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:16.869+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bf40599d0 con 0x7f8bfc15e440 2024-09-10T08:40:17.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.089+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bfc0cade0 con 0x7f8bfc15e440 2024-09-10T08:40:17.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.090+0000 7f8bf2a00640 1 -- 172.21.15.52:0/3595894425 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) ==== 95+0+4406 (secure 0 0 0) 0x7f8bf405dcd0 con 0x7f8bfc15e440 2024-09-10T08:40:17.090 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:17.090 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":121,"btime":"2024-09-10T08:40:16:501812+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:15.605957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":11}]} 2024-09-10T08:40:17.091 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 121 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 msgr2=0x7f8bdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 0x7f8bdc06e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8bec007fd0 tx=0x7f8bec007de0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 msgr2=0x7f8bfc155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007e70 tx=0x7f8bf400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 shutdown_connections 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8bdc06be30 0x7f8bdc06e2f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc15e440 0x7f8bfc155dd0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8bfc0cf450 0x7f8bfc0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 --2- 172.21.15.52:0/3595894425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8bfc0b6710 0x7f8bfc0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 >> 172.21.15.52:0/3595894425 conn(0x7f8bfc067f80 msgr2=0x7f8bfc0b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:17.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 shutdown_connections 2024-09-10T08:40:17.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:17.092+0000 7f8bfbe00640 1 -- 172.21.15.52:0/3595894425 wait complete. 2024-09-10T08:40:17.108 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-10T08:40:22.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.276+0000 7efdd5200640 1 Processor -- start 2024-09-10T08:40:22.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.276+0000 7efdd5200640 1 -- start start 2024-09-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.277+0000 7efdd5200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efdd00b2d40 0x7efdd006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.277+0000 7efdd5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdd006c150 0x7efdd015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdd5200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd0071180 con 0x7efdd013eb20 2024-09-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdd5200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efdd0071ab0 con 0x7efdd006c150 2024-09-10T08:40:22.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdd5200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efdd0071460 con 0x7efdd00b2d40 2024-09-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdd006c150 0x7efdd015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efdd006c150 0x7efdd015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59486/0 (socket says 172.21.15.52:59486) 2024-09-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 -- 172.21.15.52:0/343320899 learned_addr learned my addr 172.21.15.52:0/343320899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:22.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdcde00640 1 --2- 172.21.15.52:0/343320899 >> v2:172.21.15.176:3300/0 conn(0x7efdd00b2d40 0x7efdd006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 -- 172.21.15.52:0/343320899 >> v2:172.21.15.176:3300/0 conn(0x7efdd00b2d40 msgr2=0x7efdd006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 --2- 172.21.15.52:0/343320899 >> v2:172.21.15.176:3300/0 conn(0x7efdd00b2d40 0x7efdd006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 -- 172.21.15.52:0/343320899 >> v1:172.21.15.176:6789/0 conn(0x7efdd013eb20 legacy=0x7efdd015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.278+0000 7efdce800640 1 -- 172.21.15.52:0/343320899 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd0071740 con 0x7efdd006c150 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.279+0000 7efdce800640 1 --2- 172.21.15.52:0/343320899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd006c150 0x7efdd015c400 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7efdd0069be0 tx=0x7efdc802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76f952fdf9c1d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdcd400640 1 -- 172.21.15.52:0/343320899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8036070 con 0x7efdd006c150 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdcd400640 1 -- 172.21.15.52:0/343320899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8031600 con 0x7efdd006c150 2024-09-10T08:40:22.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdcd400640 1 -- 172.21.15.52:0/343320899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80319d0 con 0x7efdd006c150 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 -- 172.21.15.52:0/343320899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd006c150 msgr2=0x7efdd015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 --2- 172.21.15.52:0/343320899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd006c150 0x7efdd015c400 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7efdd0069be0 tx=0x7efdc802a730 comp rx=0 tx=0).stop 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 -- 172.21.15.52:0/343320899 shutdown_connections 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 --2- 172.21.15.52:0/343320899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd006c150 0x7efdd015c400 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 --2- 172.21.15.52:0/343320899 >> v2:172.21.15.176:3300/0 conn(0x7efdd00b2d40 0x7efdd006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 -- 172.21.15.52:0/343320899 >> 172.21.15.52:0/343320899 conn(0x7efdd00ccec0 msgr2=0x7efdd00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 -- 172.21.15.52:0/343320899 shutdown_connections 2024-09-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.280+0000 7efdd5200640 1 -- 172.21.15.52:0/343320899 wait complete. 2024-09-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.282+0000 7efdd5200640 1 Processor -- start 2024-09-10T08:40:22.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.282+0000 7efdd5200640 1 -- start start 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 0x7efdd013dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 0x7efdd015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdd00722d0 con 0x7efdd013eb20 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0072150 con 0x7efdd00b2d40 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdd5200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efdd0072450 con 0x7efdd006c150 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59494/0 (socket says 172.21.15.52:59494) 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.283+0000 7efdce800640 1 -- 172.21.15.52:0/1990092323 learned_addr learned my addr 172.21.15.52:0/1990092323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdc7e00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 0x7efdd015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdcde00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 0x7efdd013dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 -- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 msgr2=0x7efdd013dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 0x7efdd013dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 -- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 msgr2=0x7efdd015e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 0x7efdd015e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 -- 172.21.15.52:0/1990092323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd015db70 con 0x7efdd013eb20 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdc7e00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 0x7efdd015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdcde00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 0x7efdd013dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdce800640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009f40 tx=0x7efdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8036050 con 0x7efdd013eb20 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8042070 con 0x7efdd013eb20 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8009510 con 0x7efdd013eb20 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.284+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd00cbf50 con 0x7efdd013eb20 2024-09-10T08:40:22.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.285+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd015e0d0 con 0x7efdd013eb20 2024-09-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.286+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd006bc10 con 0x7efdd013eb20 2024-09-10T08:40:22.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.286+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdc8007bf0 con 0x7efdd013eb20 2024-09-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.288+0000 7efdc6000640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.288+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7efdc80abd60 con 0x7efdd013eb20 2024-09-10T08:40:22.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.288+0000 7efdcde00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.289+0000 7efdcde00640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 0x7efdac06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efdc0006fd0 tx=0x7efdc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.292+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdd015db70 con 0x7efdd013eb20 2024-09-10T08:40:22.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.513+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdd006c9c0 con 0x7efdd013eb20 2024-09-10T08:40:22.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.514+0000 7efdc6000640 1 -- 172.21.15.52:0/1990092323 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7efdc807a610 con 0x7efdd013eb20 2024-09-10T08:40:22.515 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:22.515 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 msgr2=0x7efdac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 0x7efdac06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efdc0006fd0 tx=0x7efdc0008040 comp rx=0 tx=0).stop 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 msgr2=0x7efdd00cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009f40 tx=0x7efdc8004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 shutdown_connections 2024-09-10T08:40:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdac06be30 0x7efdac06e2f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdd013eb20 0x7efdd00cb5e0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd00b2d40 0x7efdd015e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 --2- 172.21.15.52:0/1990092323 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efdd006c150 0x7efdd013dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 >> 172.21.15.52:0/1990092323 conn(0x7efdd00ccec0 msgr2=0x7efdd013efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.516+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 shutdown_connections 2024-09-10T08:40:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.517+0000 7efdd5200640 1 -- 172.21.15.52:0/1990092323 wait complete. 2024-09-10T08:40:22.534 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-10T08:40:22.534 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:22.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.689+0000 7f1a96400640 1 Processor -- start 2024-09-10T08:40:22.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.689+0000 7f1a96400640 1 -- start start 2024-09-10T08:40:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a96400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a9006c320 0x7f1a9015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a96400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a90071180 con 0x7f1a900b2d40 2024-09-10T08:40:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a96400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a90071460 con 0x7f1a9013eb20 2024-09-10T08:40:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a96400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1a90071ab0 con 0x7f1a9006c320 2024-09-10T08:40:22.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a8f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a900b2d40 0x7f1a9006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40654/0 (socket says 172.21.15.52:40654) 2024-09-10T08:40:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a87e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a9006c320 0x7f1a9015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a8f400640 1 -- 172.21.15.52:0/1256890587 learned_addr learned my addr 172.21.15.52:0/1256890587 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a87e00640 1 -- 172.21.15.52:0/1256890587 >> v1:172.21.15.176:6789/0 conn(0x7f1a9013eb20 legacy=0x7f1a9015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a87e00640 1 -- 172.21.15.52:0/1256890587 >> v1:172.21.15.52:6789/0 conn(0x7f1a900b2d40 legacy=0x7f1a9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.691+0000 7f1a87e00640 1 -- 172.21.15.52:0/1256890587 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a90071740 con 0x7f1a9006c320 2024-09-10T08:40:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.692+0000 7f1a87e00640 1 --2- 172.21.15.52:0/1256890587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9006c320 0x7f1a9015bcf0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222675428d1f930d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a8ea00640 1 -- 172.21.15.52:0/1256890587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78039070 con 0x7f1a9006c320 2024-09-10T08:40:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a8ea00640 1 -- 172.21.15.52:0/1256890587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78034640 con 0x7f1a9006c320 2024-09-10T08:40:22.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a8ea00640 1 -- 172.21.15.52:0/1256890587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78034a10 con 0x7f1a9006c320 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 -- 172.21.15.52:0/1256890587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9006c320 msgr2=0x7f1a9015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 --2- 172.21.15.52:0/1256890587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9006c320 0x7f1a9015bcf0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802c3f0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 -- 172.21.15.52:0/1256890587 shutdown_connections 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 --2- 172.21.15.52:0/1256890587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9006c320 0x7f1a9015bcf0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 -- 172.21.15.52:0/1256890587 >> 172.21.15.52:0/1256890587 conn(0x7f1a900ccec0 msgr2=0x7f1a900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.693+0000 7f1a96400640 1 -- 172.21.15.52:0/1256890587 shutdown_connections 2024-09-10T08:40:22.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.694+0000 7f1a96400640 1 -- 172.21.15.52:0/1256890587 wait complete. 2024-09-10T08:40:22.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.695+0000 7f1a96400640 1 Processor -- start 2024-09-10T08:40:22.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.695+0000 7f1a96400640 1 -- start start 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9006c320 0x7f1a900ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a900b2d40 0x7f1a90158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900b3980 con 0x7f1a9013eb20 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a900b3800 con 0x7f1a900b2d40 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.696+0000 7f1a96400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a900b3b00 con 0x7f1a9006c320 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59514/0 (socket says 172.21.15.52:59514) 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 -- 172.21.15.52:0/3098451258 learned_addr learned my addr 172.21.15.52:0/3098451258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8f400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9006c320 0x7f1a900ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a87e00640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a900b2d40 0x7f1a90158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 -- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9006c320 msgr2=0x7f1a900ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9006c320 0x7f1a900ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 -- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a900b2d40 msgr2=0x7f1a90158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a900b2d40 0x7f1a90158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 -- 172.21.15.52:0/3098451258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a901f8140 con 0x7f1a9013eb20 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.697+0000 7f1a8fe00640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800b9a0 tx=0x7f1a8800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.698+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88019070 con 0x7f1a9013eb20 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.698+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8800cba0 con 0x7f1a9013eb20 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.698+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88014440 con 0x7f1a9013eb20 2024-09-10T08:40:22.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.698+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a901f8420 con 0x7f1a9013eb20 2024-09-10T08:40:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.698+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a901f89e0 con 0x7f1a9013eb20 2024-09-10T08:40:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.699+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a9006bc10 con 0x7f1a9013eb20 2024-09-10T08:40:22.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.700+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a8801c070 con 0x7f1a9013eb20 2024-09-10T08:40:22.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.701+0000 7f1a87400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 0x7f1a6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:22.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.701+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f1a8808ab10 con 0x7f1a9013eb20 2024-09-10T08:40:22.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.701+0000 7f1a8f400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 0x7f1a6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:22.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.702+0000 7f1a8f400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 0x7f1a6c06e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:22.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.705+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a88058d70 con 0x7f1a9013eb20 2024-09-10T08:40:22.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.932+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a9013f010 con 0x7f1a9013eb20 2024-09-10T08:40:22.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.932+0000 7f1a87400640 1 -- 172.21.15.52:0/3098451258 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7f1a8805d070 con 0x7f1a9013eb20 2024-09-10T08:40:22.934 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:22.934 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:22.934 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 msgr2=0x7f1a6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 0x7f1a6c06e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1a80007fd0 tx=0x7f1a80007e80 comp rx=0 tx=0).stop 2024-09-10T08:40:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 msgr2=0x7f1a9013caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800b9a0 tx=0x7f1a8800be60 comp rx=0 tx=0).stop 2024-09-10T08:40:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 shutdown_connections 2024-09-10T08:40:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a6c06be30 0x7f1a6c06e2f0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a9013eb20 0x7f1a9013caf0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a900b2d40 0x7f1a90158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 --2- 172.21.15.52:0/3098451258 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a9006c320 0x7f1a900ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 >> 172.21.15.52:0/3098451258 conn(0x7f1a900ccec0 msgr2=0x7f1a9013d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 shutdown_connections 2024-09-10T08:40:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:22.935+0000 7f1a96400640 1 -- 172.21.15.52:0/3098451258 wait complete. 2024-09-10T08:40:22.952 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-10T08:40:22.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.106+0000 7fa441800640 1 Processor -- start 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.106+0000 7fa441800640 1 -- start start 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa441800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa441800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa43c13eb20 0x7fa43c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa441800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa43c071180 con 0x7fa43c0b2d40 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa441800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa43c071ab0 con 0x7fa43c13eb20 2024-09-10T08:40:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa441800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c071460 con 0x7fa43c06c320 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa43aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa43c0b2d40 0x7fa43c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40670/0 (socket says 172.21.15.52:40670) 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.107+0000 7fa43aa00640 1 -- 172.21.15.52:0/1190138763 learned_addr learned my addr 172.21.15.52:0/1190138763 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43b400640 1 --2- 172.21.15.52:0/1190138763 >> v2:172.21.15.52:3300/0 conn(0x7fa43c13eb20 0x7fa43c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43a000640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa439600640 1 -- 172.21.15.52:0/1190138763 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917021570 0 0) 0x7fa43c071180 con 0x7fa43c0b2d40 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa439600640 1 -- 172.21.15.52:0/1190138763 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa420003520 con 0x7fa43c0b2d40 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43b400640 1 -- 172.21.15.52:0/1190138763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 msgr2=0x7fa43c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43b400640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43b400640 1 -- 172.21.15.52:0/1190138763 >> v1:172.21.15.52:6789/0 conn(0x7fa43c0b2d40 legacy=0x7fa43c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.108+0000 7fa43b400640 1 -- 172.21.15.52:0/1190138763 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c071740 con 0x7fa43c13eb20 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.109+0000 7fa43b400640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c13eb20 0x7fa43c15c230 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fa434009d90 tx=0x7fa43402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a5df6b3b499cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.109+0000 7fa439600640 1 -- 172.21.15.52:0/1190138763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434007740 con 0x7fa43c13eb20 2024-09-10T08:40:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.109+0000 7fa439600640 1 -- 172.21.15.52:0/1190138763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4340078e0 con 0x7fa43c13eb20 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.109+0000 7fa439600640 1 -- 172.21.15.52:0/1190138763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434007c90 con 0x7fa43c13eb20 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 -- 172.21.15.52:0/1190138763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c13eb20 msgr2=0x7fa43c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c13eb20 0x7fa43c15c230 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fa434009d90 tx=0x7fa43402a660 comp rx=0 tx=0).stop 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 -- 172.21.15.52:0/1190138763 shutdown_connections 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c13eb20 0x7fa43c15c230 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 --2- 172.21.15.52:0/1190138763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 -- 172.21.15.52:0/1190138763 >> 172.21.15.52:0/1190138763 conn(0x7fa43c0ccec0 msgr2=0x7fa43c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 -- 172.21.15.52:0/1190138763 shutdown_connections 2024-09-10T08:40:23.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.110+0000 7fa441800640 1 -- 172.21.15.52:0/1190138763 wait complete. 2024-09-10T08:40:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.112+0000 7fa441800640 1 Processor -- start 2024-09-10T08:40:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.112+0000 7fa441800640 1 -- start start 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 0x7fa43c0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c0720c0 con 0x7fa43c0b2d40 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c071f40 con 0x7fa43c13eb20 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa441800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c072240 con 0x7fa43c06c320 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59536/0 (socket says 172.21.15.52:59536) 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 -- 172.21.15.52:0/2792316392 learned_addr learned my addr 172.21.15.52:0/2792316392 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43aa00640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43b400640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 0x7fa43c0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 -- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 msgr2=0x7fa43c1f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c1f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 -- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 msgr2=0x7fa43c0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 0x7fa43c0b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43a000640 1 -- 172.21.15.52:0/2792316392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c15c110 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43b400640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 0x7fa43c0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.113+0000 7fa43aa00640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa43a000640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e9b0 tx=0x7fa42800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428017070 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42800c9a0 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800cd70 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c0b4b50 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.114+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c0b5110 con 0x7fa43c0b2d40 2024-09-10T08:40:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.115+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c06bc10 con 0x7fa43c0b2d40 2024-09-10T08:40:23.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.116+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa42801a070 con 0x7fa43c0b2d40 2024-09-10T08:40:23.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.117+0000 7fa432a00640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 0x7fa41c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.117+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7fa42808af50 con 0x7fa43c0b2d40 2024-09-10T08:40:23.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.117+0000 7fa43aa00640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 0x7fa41c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.118+0000 7fa43aa00640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 0x7fa41c06e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007fd0 tx=0x7fa42c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.121+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa428059800 con 0x7fa43c0b2d40 2024-09-10T08:40:23.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.376+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa43c155920 con 0x7fa43c0b2d40 2024-09-10T08:40:23.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.377+0000 7fa432a00640 1 -- 172.21.15.52:0/2792316392 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1514 (secure 0 0 0) 0x7fa428059100 con 0x7fa43c0b2d40 2024-09-10T08:40:23.377 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:23.377 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":722,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":159,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078898256,"bytes_used":2606379008,"bytes_avail":770487734272,"bytes_total":773094113280,"read_bytes_sec":237914,"write_bytes_sec":316946,"read_op_per_sec":6,"write_op_per_sec":102},"fsmap":{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-10T08:40:15.626371+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 msgr2=0x7fa41c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 0x7fa41c06e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007fd0 tx=0x7fa42c009040 comp rx=0 tx=0).stop 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 msgr2=0x7fa43c15b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fa42800e9b0 tx=0x7fa42800ee70 comp rx=0 tx=0).stop 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 shutdown_connections 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa41c06be30 0x7fa41c06e2f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa43c13eb20 0x7fa43c0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43c0b2d40 0x7fa43c15b9e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 --2- 172.21.15.52:0/2792316392 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa43c06c320 0x7fa43c1f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 >> 172.21.15.52:0/2792316392 conn(0x7fa43c0ccec0 msgr2=0x7fa43c156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 shutdown_connections 2024-09-10T08:40:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.379+0000 7fa441800640 1 -- 172.21.15.52:0/2792316392 wait complete. 2024-09-10T08:40:23.395 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-10T08:40:23.396 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:40:23.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:40:23.488 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:40:23.488+0000 7f91d9400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:40:23.494 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:40:23.590 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:40:23.590 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:40:23.590 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:23.590 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:23.626 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:23.627 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:23.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:40:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.899+0000 7f41d4e00640 1 Processor -- start 2024-09-10T08:40:23.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.899+0000 7f41d4e00640 1 -- start start 2024-09-10T08:40:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41d4e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f41d0162490 0x7f41d015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41d4e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d015f570 con 0x7f41d015eab0 2024-09-10T08:40:23.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41d4e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d015f850 con 0x7f41d00b66b0 2024-09-10T08:40:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41d4e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f41d015fb30 con 0x7f41d0162490 2024-09-10T08:40:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41cde00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f41d015eab0 0x7f41d00d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40672/0 (socket says 172.21.15.52:40672) 2024-09-10T08:40:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41cde00640 1 -- 172.21.15.52:0/3035270220 learned_addr learned my addr 172.21.15.52:0/3035270220 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.900+0000 7f41cd400640 1 --2- 172.21.15.52:0/3035270220 >> v2:172.21.15.52:3300/0 conn(0x7f41d0162490 0x7f41d015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.901+0000 7f41cca00640 1 -- 172.21.15.52:0/3035270220 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364355320 0 0) 0x7f41d015f570 con 0x7f41d015eab0 2024-09-10T08:40:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.901+0000 7f41cca00640 1 -- 172.21.15.52:0/3035270220 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b4003520 con 0x7f41d015eab0 2024-09-10T08:40:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.901+0000 7f41cd400640 1 -- 172.21.15.52:0/3035270220 >> v1:172.21.15.176:6789/0 conn(0x7f41d00b66b0 legacy=0x7f41d00b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.901+0000 7f41cd400640 1 -- 172.21.15.52:0/3035270220 >> v1:172.21.15.52:6789/0 conn(0x7f41d015eab0 legacy=0x7f41d00d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.901+0000 7f41cd400640 1 -- 172.21.15.52:0/3035270220 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d015fe10 con 0x7f41d0162490 2024-09-10T08:40:23.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.902+0000 7f41cd400640 1 --2- 172.21.15.52:0/3035270220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d015ee90 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0097a0 tx=0x7f41bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1e683d262360d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.902+0000 7f41cca00640 1 -- 172.21.15.52:0/3035270220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc037070 con 0x7f41d0162490 2024-09-10T08:40:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.902+0000 7f41cca00640 1 -- 172.21.15.52:0/3035270220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc032440 con 0x7f41d0162490 2024-09-10T08:40:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.902+0000 7f41cca00640 1 -- 172.21.15.52:0/3035270220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0327f0 con 0x7f41d0162490 2024-09-10T08:40:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 -- 172.21.15.52:0/3035270220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 msgr2=0x7f41d015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 --2- 172.21.15.52:0/3035270220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d015ee90 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0097a0 tx=0x7f41bc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 -- 172.21.15.52:0/3035270220 shutdown_connections 2024-09-10T08:40:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 --2- 172.21.15.52:0/3035270220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d015ee90 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 -- 172.21.15.52:0/3035270220 >> 172.21.15.52:0/3035270220 conn(0x7f41d00d16d0 msgr2=0x7f41d00d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 -- 172.21.15.52:0/3035270220 shutdown_connections 2024-09-10T08:40:23.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.903+0000 7f41d4e00640 1 -- 172.21.15.52:0/3035270220 wait complete. 2024-09-10T08:40:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.905+0000 7f41d4e00640 1 Processor -- start 2024-09-10T08:40:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.905+0000 7f41d4e00640 1 -- start start 2024-09-10T08:40:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.905+0000 7f41d4e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d00b66b0 0x7f41d00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41d4e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 0x7f41d00c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41d4e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41d4e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41d00d45e0 con 0x7f41d0162490 2024-09-10T08:40:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41d4e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f41d00d4460 con 0x7f41d015eab0 2024-09-10T08:40:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41d4e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f41d00d35e0 con 0x7f41d00b66b0 2024-09-10T08:40:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59550/0 (socket says 172.21.15.52:59550) 2024-09-10T08:40:23.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 -- 172.21.15.52:0/2572705940 learned_addr learned my addr 172.21.15.52:0/2572705940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:23.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41cd400640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 0x7f41d00c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 -- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d00b66b0 msgr2=0x7f41d00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d00b66b0 0x7f41d00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 -- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 msgr2=0x7f41d00c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:23.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 0x7f41d00c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:23.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41ce800640 1 -- 172.21.15.52:0/2572705940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d00c9e00 con 0x7f41d0162490 2024-09-10T08:40:23.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.906+0000 7f41cd400640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 0x7f41d00c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:23.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41ce800640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c7b0 tx=0x7f41c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c8004b60 con 0x7f41d0162490 2024-09-10T08:40:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c8004d00 con 0x7f41d0162490 2024-09-10T08:40:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c800aa90 con 0x7f41d0162490 2024-09-10T08:40:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d00ca0e0 con 0x7f41d0162490 2024-09-10T08:40:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.907+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d014cfa0 con 0x7f41d0162490 2024-09-10T08:40:23.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.908+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d015f570 con 0x7f41d0162490 2024-09-10T08:40:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.909+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41c800ac30 con 0x7f41d0162490 2024-09-10T08:40:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.910+0000 7f41c6000640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.910+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f41c808b190 con 0x7f41d0162490 2024-09-10T08:40:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.911+0000 7f41cde00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:23.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.911+0000 7f41cde00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 0x7f41b006e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000f60 tx=0x7f41c00078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:23.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:23.915+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41c8020070 con 0x7f41d0162490 2024-09-10T08:40:24.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.112+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41d00d2500 con 0x7f41d0162490 2024-09-10T08:40:24.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.113+0000 7f41c6000640 1 -- 172.21.15.52:0/2572705940 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v159) ==== 80+0+124 (secure 0 0 0) 0x7f41c8059ad0 con 0x7f41d0162490 2024-09-10T08:40:24.113 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.176:6836/3781623740 2024-09-11T08:40:15.498915+0000 2024-09-10T08:40:24.114 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.176:6834/3781623740 2024-09-11T08:40:15.498915+0000 2024-09-10T08:40:24.114 INFO:teuthology.orchestra.run.smithi052.stderr:listed 2 entries 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 msgr2=0x7f41b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 0x7f41b006e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000f60 tx=0x7f41c00078f0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 msgr2=0x7f41d00b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c7b0 tx=0x7f41c800cc70 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 shutdown_connections 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f41b006be30 0x7f41b006e2f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41d0162490 0x7f41d00b8ba0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41d015eab0 0x7f41d00c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 --2- 172.21.15.52:0/2572705940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f41d00b66b0 0x7f41d00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 >> 172.21.15.52:0/2572705940 conn(0x7f41d00d16d0 msgr2=0x7f41d00b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:24.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 shutdown_connections 2024-09-10T08:40:24.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.115+0000 7f41d4e00640 1 -- 172.21.15.52:0/2572705940 wait complete. 2024-09-10T08:40:24.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:40:24.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:24.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:40:24.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:40:24.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:24.194 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:40:24.230 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:40:24.230 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:40:24.230 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:24.270 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:40:24.271 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:40:24.271 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:24.271 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:24.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:40:24.306 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:40:24.306 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:40:24.306 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:24.348 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:40:24.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.503+0000 7f4a3f200640 1 Processor -- start 2024-09-10T08:40:24.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.504+0000 7f4a3f200640 1 -- start start 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 0x7f4a38070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a38148260 0x7f4a380714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3806c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3806c5c0 con 0x7f4a38148260 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4a38074200 con 0x7f4a38147e80 2024-09-10T08:40:24.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a3f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a380b3e40 con 0x7f4a3806bc10 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a2fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a38148260 0x7f4a380714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a2fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a38148260 0x7f4a380714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59586/0 (socket says 172.21.15.52:59586) 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.505+0000 7f4a2fe00640 1 -- 172.21.15.52:0/3167039744 learned_addr learned my addr 172.21.15.52:0/3167039744 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a3d200640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a37e00640 1 --2- 172.21.15.52:0/3167039744 >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 0x7f4a38070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a2fe00640 1 -- 172.21.15.52:0/3167039744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 msgr2=0x7f4a3806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a2fe00640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3806c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a2fe00640 1 -- 172.21.15.52:0/3167039744 >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 msgr2=0x7f4a38070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a2fe00640 1 --2- 172.21.15.52:0/3167039744 >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 0x7f4a38070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a2fe00640 1 -- 172.21.15.52:0/3167039744 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a38071b30 con 0x7f4a38148260 2024-09-10T08:40:24.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.506+0000 7f4a37e00640 1 --2- 172.21.15.52:0/3167039744 >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 0x7f4a38070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:24.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.507+0000 7f4a2fe00640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a380714b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4a380d1500 tx=0x7f4a2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66939dcf30a8f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.507+0000 7f4a37400640 1 -- 172.21.15.52:0/3167039744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20037070 con 0x7f4a38148260 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a37400640 1 -- 172.21.15.52:0/3167039744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a20032440 con 0x7f4a38148260 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a37400640 1 -- 172.21.15.52:0/3167039744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20032810 con 0x7f4a38148260 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 -- 172.21.15.52:0/3167039744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 msgr2=0x7f4a380714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a380714b0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4a380d1500 tx=0x7f4a2002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 -- 172.21.15.52:0/3167039744 shutdown_connections 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3806c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 --2- 172.21.15.52:0/3167039744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a380714b0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 --2- 172.21.15.52:0/3167039744 >> v2:172.21.15.176:3300/0 conn(0x7f4a38147e80 0x7f4a38070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 -- 172.21.15.52:0/3167039744 >> 172.21.15.52:0/3167039744 conn(0x7f4a380ccec0 msgr2=0x7f4a380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 -- 172.21.15.52:0/3167039744 shutdown_connections 2024-09-10T08:40:24.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.508+0000 7f4a3f200640 1 -- 172.21.15.52:0/3167039744 wait complete. 2024-09-10T08:40:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.510+0000 7f4a3f200640 1 Processor -- start 2024-09-10T08:40:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.510+0000 7f4a3f200640 1 -- start start 2024-09-10T08:40:24.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a38147e80 0x7f4a38140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a380b3ad0 con 0x7f4a38148260 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4a380b37f0 con 0x7f4a38147e80 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4a381623c0 con 0x7f4a3806bc10 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59592/0 (socket says 172.21.15.52:59592) 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a3d200640 1 -- 172.21.15.52:0/1938704398 learned_addr learned my addr 172.21.15.52:0/1938704398 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a37e00640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.511+0000 7f4a2fe00640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a38147e80 0x7f4a38140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 -- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 msgr2=0x7f4a3815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 -- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a38147e80 msgr2=0x7f4a38140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a38147e80 0x7f4a38140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 -- 172.21.15.52:0/1938704398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3813dfc0 con 0x7f4a38148260 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3d200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000ef00 tx=0x7f4a3000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30018020 con 0x7f4a38148260 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30014400 con 0x7f4a38148260 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3813e2a0 con 0x7f4a38148260 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300147f0 con 0x7f4a38148260 2024-09-10T08:40:24.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.512+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3813e860 con 0x7f4a38148260 2024-09-10T08:40:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.514+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3806c080 con 0x7f4a38148260 2024-09-10T08:40:24.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.514+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a30005d10 con 0x7f4a38148260 2024-09-10T08:40:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.515+0000 7f4a34c00640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.515+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f4a3008b480 con 0x7f4a38148260 2024-09-10T08:40:24.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.516+0000 7f4a37e00640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.516+0000 7f4a37e00640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 0x7f4a1406e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006fd0 tx=0x7f4a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.520+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a30022070 con 0x7f4a38148260 2024-09-10T08:40:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.742+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a380cf540 con 0x7f4a38148260 2024-09-10T08:40:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.742+0000 7f4a34c00640 1 -- 172.21.15.52:0/1938704398 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7f4a30059770 con 0x7f4a38148260 2024-09-10T08:40:24.743 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:24.743 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 msgr2=0x7f4a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 0x7f4a1406e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006fd0 tx=0x7f4a28008040 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 msgr2=0x7f4a38143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000ef00 tx=0x7f4a3000b480 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 shutdown_connections 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a38148260 0x7f4a38143a90 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4a38147e80 0x7f4a38140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 --2- 172.21.15.52:0/1938704398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4a3806bc10 0x7f4a3815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 >> 172.21.15.52:0/1938704398 conn(0x7f4a380ccec0 msgr2=0x7f4a380723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 shutdown_connections 2024-09-10T08:40:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.745+0000 7f4a3f200640 1 -- 172.21.15.52:0/1938704398 wait complete. 2024-09-10T08:40:24.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:24.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.918+0000 7fd964600640 1 Processor -- start 2024-09-10T08:40:24.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.918+0000 7fd964600640 1 -- start start 2024-09-10T08:40:24.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.919+0000 7fd964600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd95c06c320 0x7fd95c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.919+0000 7fd964600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 0x7fd95c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.919+0000 7fd964600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95c071180 con 0x7fd95c0b2d40 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd964600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd95c071ab0 con 0x7fd95c06c320 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd964600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c071460 con 0x7fd95c13eb20 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd961c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd95c0b2d40 0x7fd95c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38064/0 (socket says 172.21.15.52:38064) 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd961c00640 1 -- 172.21.15.52:0/4214391530 learned_addr learned my addr 172.21.15.52:0/4214391530 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd961200640 1 --2- 172.21.15.52:0/4214391530 >> v2:172.21.15.176:3300/0 conn(0x7fd95c06c320 0x7fd95c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd962600640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 0x7fd95c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd95be00640 1 -- 172.21.15.52:0/4214391530 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690971440 0 0) 0x7fd95c071180 con 0x7fd95c0b2d40 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.920+0000 7fd95be00640 1 -- 172.21.15.52:0/4214391530 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd944003520 con 0x7fd95c0b2d40 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.921+0000 7fd961200640 1 -- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 msgr2=0x7fd95c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.921+0000 7fd961200640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 0x7fd95c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.921+0000 7fd961200640 1 -- 172.21.15.52:0/4214391530 >> v1:172.21.15.52:6789/0 conn(0x7fd95c0b2d40 legacy=0x7fd95c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.921+0000 7fd961200640 1 -- 172.21.15.52:0/4214391530 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c071740 con 0x7fd95c06c320 2024-09-10T08:40:24.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.921+0000 7fd962600640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 0x7fd95c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd961200640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c06c320 0x7fd95c15bcf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097a0 tx=0x7fd94802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10202b7d1f8f23a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd95be00640 1 -- 172.21.15.52:0/4214391530 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948037070 con 0x7fd95c06c320 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd95be00640 1 -- 172.21.15.52:0/4214391530 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd948032440 con 0x7fd95c06c320 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd95be00640 1 -- 172.21.15.52:0/4214391530 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9480327f0 con 0x7fd95c06c320 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd964600640 1 -- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c06c320 msgr2=0x7fd95c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.922+0000 7fd964600640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c06c320 0x7fd95c15bcf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097a0 tx=0x7fd94802a180 comp rx=0 tx=0).stop 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 -- 172.21.15.52:0/4214391530 shutdown_connections 2024-09-10T08:40:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c13eb20 0x7fd95c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 --2- 172.21.15.52:0/4214391530 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c06c320 0x7fd95c15bcf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 -- 172.21.15.52:0/4214391530 >> 172.21.15.52:0/4214391530 conn(0x7fd95c0ccec0 msgr2=0x7fd95c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 -- 172.21.15.52:0/4214391530 shutdown_connections 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.923+0000 7fd964600640 1 -- 172.21.15.52:0/4214391530 wait complete. 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.924+0000 7fd964600640 1 Processor -- start 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.924+0000 7fd964600640 1 -- start start 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c06c320 0x7fd95c15fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 0x7fd95c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c0720c0 con 0x7fd95c13eb20 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c071f40 con 0x7fd95c0b2d40 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd964600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c072240 con 0x7fd95c06c320 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.925+0000 7fd962600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59608/0 (socket says 172.21.15.52:59608) 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 -- 172.21.15.52:0/1797071152 learned_addr learned my addr 172.21.15.52:0/1797071152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:24.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd961200640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 0x7fd95c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd961c00640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c06c320 0x7fd95c15fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 -- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c06c320 msgr2=0x7fd95c15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c06c320 0x7fd95c15fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 -- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 msgr2=0x7fd95c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 0x7fd95c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 -- 172.21.15.52:0/1797071152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c15e840 con 0x7fd95c13eb20 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd961200640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 0x7fd95c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:24.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd962600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd95400efc0 tx=0x7fd95400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.926+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954018030 con 0x7fd95c13eb20 2024-09-10T08:40:24.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.927+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95400cdf0 con 0x7fd95c13eb20 2024-09-10T08:40:24.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.927+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954003bb0 con 0x7fd95c13eb20 2024-09-10T08:40:24.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.927+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c15eae0 con 0x7fd95c13eb20 2024-09-10T08:40:24.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.927+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c0b6380 con 0x7fd95c13eb20 2024-09-10T08:40:24.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.928+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c06bc10 con 0x7fd95c13eb20 2024-09-10T08:40:24.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.929+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd95401b070 con 0x7fd95c13eb20 2024-09-10T08:40:24.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.929+0000 7fd959600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 0x7fd93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:24.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.930+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7fd95408b9a0 con 0x7fd95c13eb20 2024-09-10T08:40:24.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.930+0000 7fd961c00640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 0x7fd93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:24.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.931+0000 7fd961c00640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 0x7fd93c06e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd950005880 tx=0x7fd950009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:24.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:24.934+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd954010040 con 0x7fd95c13eb20 2024-09-10T08:40:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.153+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95c06c9c0 con 0x7fd95c13eb20 2024-09-10T08:40:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.154+0000 7fd959600640 1 -- 172.21.15.52:0/1797071152 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7fd95405a250 con 0x7fd95c13eb20 2024-09-10T08:40:25.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:25.155 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 msgr2=0x7fd93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 0x7fd93c06e2f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd950005880 tx=0x7fd950009040 comp rx=0 tx=0).stop 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 msgr2=0x7fd95c0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd95400efc0 tx=0x7fd95400c490 comp rx=0 tx=0).stop 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 shutdown_connections 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd93c06be30 0x7fd93c06e2f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd95c13eb20 0x7fd95c0b5e40 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd95c0b2d40 0x7fd95c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 --2- 172.21.15.52:0/1797071152 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd95c06c320 0x7fd95c15fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 >> 172.21.15.52:0/1797071152 conn(0x7fd95c0ccec0 msgr2=0x7fd95c156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 shutdown_connections 2024-09-10T08:40:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.156+0000 7fd964600640 1 -- 172.21.15.52:0/1797071152 wait complete. 2024-09-10T08:40:25.174 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:25.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.328+0000 7fd14ae00640 1 Processor -- start 2024-09-10T08:40:25.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.329+0000 7fd14ae00640 1 -- start start 2024-09-10T08:40:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd14ae00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd1440b5880 0x7fd1440b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd14ae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1440b4020 con 0x7fd144145ed0 2024-09-10T08:40:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd14ae00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd1440b42c0 con 0x7fd1440b5880 2024-09-10T08:40:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd14ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd1440b45a0 con 0x7fd144073890 2024-09-10T08:40:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd13b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd13b400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:57968/0 (socket says 172.21.15.52:57968) 2024-09-10T08:40:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd13b400640 1 -- 172.21.15.52:0/3088168733 learned_addr learned my addr 172.21.15.52:0/3088168733 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.330+0000 7fd148e00640 1 --2- 172.21.15.52:0/3088168733 >> v2:172.21.15.176:3300/0 conn(0x7fd1440b5880 0x7fd1440b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.331+0000 7fd13b400640 1 -- 172.21.15.52:0/3088168733 >> v2:172.21.15.176:3300/0 conn(0x7fd1440b5880 msgr2=0x7fd1440b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.331+0000 7fd13b400640 1 --2- 172.21.15.52:0/3088168733 >> v2:172.21.15.176:3300/0 conn(0x7fd1440b5880 0x7fd1440b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.331+0000 7fd13b400640 1 -- 172.21.15.52:0/3088168733 >> v1:172.21.15.176:6789/0 conn(0x7fd144145ed0 legacy=0x7fd144073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.331+0000 7fd13b400640 1 -- 172.21.15.52:0/3088168733 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1440b4880 con 0x7fd144073890 2024-09-10T08:40:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.331+0000 7fd143400640 1 -- 172.21.15.52:0/3088168733 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279254543 0 0) 0x7fd1440b4020 con 0x7fd144145ed0 2024-09-10T08:40:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.332+0000 7fd13b400640 1 --2- 172.21.15.52:0/3088168733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009870 tx=0x7fd12c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e594dc1c09adb1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.332+0000 7fd143400640 1 -- 172.21.15.52:0/3088168733 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c037070 con 0x7fd144073890 2024-09-10T08:40:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.332+0000 7fd143400640 1 -- 172.21.15.52:0/3088168733 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c032440 con 0x7fd144073890 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.332+0000 7fd143400640 1 -- 172.21.15.52:0/3088168733 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c032810 con 0x7fd144073890 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 -- 172.21.15.52:0/3088168733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 msgr2=0x7fd1440b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 --2- 172.21.15.52:0/3088168733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009870 tx=0x7fd12c02a270 comp rx=0 tx=0).stop 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 -- 172.21.15.52:0/3088168733 shutdown_connections 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 --2- 172.21.15.52:0/3088168733 >> v2:172.21.15.176:3300/0 conn(0x7fd1440b5880 0x7fd1440b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 --2- 172.21.15.52:0/3088168733 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd144073890 0x7fd1440b5080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 -- 172.21.15.52:0/3088168733 >> 172.21.15.52:0/3088168733 conn(0x7fd1440ccec0 msgr2=0x7fd1440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 -- 172.21.15.52:0/3088168733 shutdown_connections 2024-09-10T08:40:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.333+0000 7fd14ae00640 1 -- 172.21.15.52:0/3088168733 wait complete. 2024-09-10T08:40:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.334+0000 7fd14ae00640 1 Processor -- start 2024-09-10T08:40:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.335+0000 7fd14ae00640 1 -- start start 2024-09-10T08:40:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 0x7fd144158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 0x7fd14415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1440b6270 con 0x7fd144073890 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441462b0 con 0x7fd144145ed0 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd14ae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd144158740 con 0x7fd1440b5880 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59624/0 (socket says 172.21.15.52:59624) 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 -- 172.21.15.52:0/481630276 learned_addr learned my addr 172.21.15.52:0/481630276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd13b400640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 0x7fd144158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd148e00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 0x7fd14415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 -- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 msgr2=0x7fd144158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 0x7fd144158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 -- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 msgr2=0x7fd14415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 0x7fd14415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd143e00640 1 -- 172.21.15.52:0/481630276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14415a500 con 0x7fd144073890 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd13b400640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 0x7fd144158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.336+0000 7fd148e00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 0x7fd14415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd143e00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c440 tx=0x7fd13400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134017070 con 0x7fd144073890 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd134005480 con 0x7fd144073890 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134003830 con 0x7fd144073890 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd144159460 con 0x7fd144073890 2024-09-10T08:40:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.337+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd144159a20 con 0x7fd144073890 2024-09-10T08:40:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.338+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1440b5080 con 0x7fd144073890 2024-09-10T08:40:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.339+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd13401a070 con 0x7fd144073890 2024-09-10T08:40:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.340+0000 7fd140c00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 0x7fd12006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.341+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7fd13408a260 con 0x7fd144073890 2024-09-10T08:40:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.341+0000 7fd13b400640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 0x7fd12006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.342+0000 7fd13b400640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 0x7fd12006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd12c034000 tx=0x7fd12c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.345+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd134058b10 con 0x7fd144073890 2024-09-10T08:40:25.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.528+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd144145130 con 0x7fd144073890 2024-09-10T08:40:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.529+0000 7fd140c00640 1 -- 172.21.15.52:0/481630276 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16882 (secure 0 0 0) 0x7fd134058410 con 0x7fd144073890 2024-09-10T08:40:25.530 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:25.530 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":159,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:15.498984+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:39:24.739978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T08:39:25.941504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/3781623740":"2024-09-11T08:40:15.498915+0000","172.21.15.176:6834/3781623740":"2024-09-11T08:40:15.498915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:25.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 msgr2=0x7fd12006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 0x7fd12006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd12c034000 tx=0x7fd12c02e000 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 msgr2=0x7fd144158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c440 tx=0x7fd13400c900 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 shutdown_connections 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd12006be30 0x7fd12006e2f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd144145ed0 0x7fd14415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd1440b5880 0x7fd144158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 --2- 172.21.15.52:0/481630276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd144073890 0x7fd144158200 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 >> 172.21.15.52:0/481630276 conn(0x7fd1440ccec0 msgr2=0x7fd144142710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 shutdown_connections 2024-09-10T08:40:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.532+0000 7fd14ae00640 1 -- 172.21.15.52:0/481630276 wait complete. 2024-09-10T08:40:25.549 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:40:25.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.704+0000 7f12ba400640 1 Processor -- start 2024-09-10T08:40:25.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.704+0000 7f12ba400640 1 -- start start 2024-09-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12b415ed20 0x7f12b40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b40d23b0 0x7f12b40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12b40cf2d0 0x7f12b40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f12b40d0e70 con 0x7f12b40cf2d0 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f12b40d41c0 con 0x7f12b415ed20 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12ba400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12b40d35b0 con 0x7f12b40d23b0 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.705+0000 7f12b3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12b40cf2d0 0x7f12b40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f12b40cf2d0 0x7f12b40cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59638/0 (socket says 172.21.15.52:59638) 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 -- 172.21.15.52:0/2198628616 learned_addr learned my addr 172.21.15.52:0/2198628616 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3400640 1 --2- 172.21.15.52:0/2198628616 >> v2:172.21.15.176:3300/0 conn(0x7f12b415ed20 0x7f12b40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12abe00640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b40d23b0 0x7f12b40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 -- 172.21.15.52:0/2198628616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b40d23b0 msgr2=0x7f12b40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b40d23b0 0x7f12b40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 -- 172.21.15.52:0/2198628616 >> v2:172.21.15.176:3300/0 conn(0x7f12b415ed20 msgr2=0x7f12b40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 --2- 172.21.15.52:0/2198628616 >> v2:172.21.15.176:3300/0 conn(0x7f12b415ed20 0x7f12b40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.706+0000 7f12b3e00640 1 -- 172.21.15.52:0/2198628616 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40d3890 con 0x7f12b40cf2d0 2024-09-10T08:40:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.707+0000 7f12b3e00640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b40cf760 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f12b40d47b0 tx=0x7f12ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c8b453ce4bd19f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.707+0000 7f12b2a00640 1 -- 172.21.15.52:0/2198628616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac036070 con 0x7f12b40cf2d0 2024-09-10T08:40:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.707+0000 7f12b2a00640 1 -- 172.21.15.52:0/2198628616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ac031600 con 0x7f12b40cf2d0 2024-09-10T08:40:25.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.707+0000 7f12b2a00640 1 -- 172.21.15.52:0/2198628616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0319d0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 -- 172.21.15.52:0/2198628616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 msgr2=0x7f12b40cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b40cf760 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f12b40d47b0 tx=0x7f12ac02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 -- 172.21.15.52:0/2198628616 shutdown_connections 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b40cf760 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 --2- 172.21.15.52:0/2198628616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b40d23b0 0x7f12b40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 --2- 172.21.15.52:0/2198628616 >> v2:172.21.15.176:3300/0 conn(0x7f12b415ed20 0x7f12b40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 -- 172.21.15.52:0/2198628616 >> 172.21.15.52:0/2198628616 conn(0x7f12b40d1260 msgr2=0x7f12b40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 -- 172.21.15.52:0/2198628616 shutdown_connections 2024-09-10T08:40:25.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.708+0000 7f12ba400640 1 -- 172.21.15.52:0/2198628616 wait complete. 2024-09-10T08:40:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.709+0000 7f12ba400640 1 Processor -- start 2024-09-10T08:40:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 -- start start 2024-09-10T08:40:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b40d23b0 0x7f12b40cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b415ed20 0x7f12b40cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b40d32a0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f12b40d3e50 con 0x7f12b40d23b0 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.710+0000 7f12ba400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f12b415f100 con 0x7f12b415ed20 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59650/0 (socket says 172.21.15.52:59650) 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 -- 172.21.15.52:0/3973172197 learned_addr learned my addr 172.21.15.52:0/3973172197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12abe00640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b40d23b0 0x7f12b40cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3e00640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b415ed20 0x7f12b40cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 -- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b415ed20 msgr2=0x7f12b40cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b415ed20 0x7f12b40cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 -- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b40d23b0 msgr2=0x7f12b40cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b40d23b0 0x7f12b40cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 -- 172.21.15.52:0/3973172197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40cd560 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.711+0000 7f12b3400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d5f0 tx=0x7f12a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.712+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40125f0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.712+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a4019070 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.712+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b40cc420 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.712+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40129d0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.712+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b415f3e0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.713+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b40b7010 con 0x7f12b40cf2d0 2024-09-10T08:40:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.714+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12a4012b70 con 0x7f12b40cf2d0 2024-09-10T08:40:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.715+0000 7f12ab400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 0x7f129006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.715+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f12a408b2a0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.715+0000 7f12abe00640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 0x7f129006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.716+0000 7f12abe00640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 0x7f129006e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f12b40ccec0 tx=0x7f129c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.719+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12a4059be0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.938+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12b40b3f20 con 0x7f12b40cf2d0 2024-09-10T08:40:25.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.939+0000 7f12ab400640 1 -- 172.21.15.52:0/3973172197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7f12a40594e0 con 0x7f12b40cf2d0 2024-09-10T08:40:25.940 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:25.940 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:25.940 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 msgr2=0x7f129006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 0x7f129006e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f12b40ccec0 tx=0x7f129c008040 comp rx=0 tx=0).stop 2024-09-10T08:40:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 msgr2=0x7f12b414fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d5f0 tx=0x7f12a400dab0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 shutdown_connections 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f129006be60 0x7f129006e320 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12b415ed20 0x7f12b40cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f12b40d23b0 0x7f12b40cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 --2- 172.21.15.52:0/3973172197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b40cf2d0 0x7f12b414fa00 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 >> 172.21.15.52:0/3973172197 conn(0x7f12b40d1260 msgr2=0x7f12b40b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 shutdown_connections 2024-09-10T08:40:25.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:25.941+0000 7f12ba400640 1 -- 172.21.15.52:0/3973172197 wait complete. 2024-09-10T08:40:25.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.112+0000 7f7cc0e00640 1 Processor -- start 2024-09-10T08:40:26.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.113+0000 7f7cc0e00640 1 -- start start 2024-09-10T08:40:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cc0e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7cbc147e80 0x7f7cbc070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cc0e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cbc06c320 0x7f7cbc0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cc0e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cbc071b30 con 0x7f7cbc148260 2024-09-10T08:40:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cc0e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7cbc074200 con 0x7f7cbc06c320 2024-09-10T08:40:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cc0e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7cbc0b3e40 con 0x7f7cbc147e80 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cba800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cbc06c320 0x7f7cbc0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cb1400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7cbc148260 0x7f7cbc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38072/0 (socket says 172.21.15.52:38072) 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cb1400640 1 -- 172.21.15.52:0/2835925469 learned_addr learned my addr 172.21.15.52:0/2835925469 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.114+0000 7f7cb9e00640 1 --2- 172.21.15.52:0/2835925469 >> v2:172.21.15.176:3300/0 conn(0x7f7cbc147e80 0x7f7cbc070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.115+0000 7f7cba800640 1 -- 172.21.15.52:0/2835925469 >> v2:172.21.15.176:3300/0 conn(0x7f7cbc147e80 msgr2=0x7f7cbc070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:26.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.115+0000 7f7cba800640 1 --2- 172.21.15.52:0/2835925469 >> v2:172.21.15.176:3300/0 conn(0x7f7cbc147e80 0x7f7cbc070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.115+0000 7f7cba800640 1 -- 172.21.15.52:0/2835925469 >> v1:172.21.15.52:6789/0 conn(0x7f7cbc148260 legacy=0x7f7cbc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.115+0000 7f7cb9400640 1 -- 172.21.15.52:0/2835925469 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898321104 0 0) 0x7f7cbc071b30 con 0x7f7cbc148260 2024-09-10T08:40:26.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.115+0000 7f7cba800640 1 -- 172.21.15.52:0/2835925469 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc0b3510 con 0x7f7cbc06c320 2024-09-10T08:40:26.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cba800640 1 --2- 172.21.15.52:0/2835925469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc06c320 0x7f7cbc0714b0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0d1500 tx=0x7f7cb402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dff3834a5b16de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cb9400640 1 -- 172.21.15.52:0/2835925469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4007740 con 0x7f7cbc06c320 2024-09-10T08:40:26.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cb9400640 1 -- 172.21.15.52:0/2835925469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb40078e0 con 0x7f7cbc06c320 2024-09-10T08:40:26.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cb9400640 1 -- 172.21.15.52:0/2835925469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4007cb0 con 0x7f7cbc06c320 2024-09-10T08:40:26.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cc0e00640 1 -- 172.21.15.52:0/2835925469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc06c320 msgr2=0x7f7cbc0714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.116+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/2835925469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc06c320 0x7f7cbc0714b0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0d1500 tx=0x7f7cb402a680 comp rx=0 tx=0).stop 2024-09-10T08:40:26.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 -- 172.21.15.52:0/2835925469 shutdown_connections 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/2835925469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc06c320 0x7f7cbc0714b0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/2835925469 >> v2:172.21.15.176:3300/0 conn(0x7f7cbc147e80 0x7f7cbc070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 -- 172.21.15.52:0/2835925469 >> 172.21.15.52:0/2835925469 conn(0x7f7cbc0ccec0 msgr2=0x7f7cbc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 -- 172.21.15.52:0/2835925469 shutdown_connections 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.117+0000 7f7cc0e00640 1 -- 172.21.15.52:0/2835925469 wait complete. 2024-09-10T08:40:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.118+0000 7f7cc0e00640 1 Processor -- start 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.118+0000 7f7cc0e00640 1 -- start start 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cbc06c320 0x7f7cbc1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cbc147e80 0x7f7cbc146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc0b42d0 con 0x7f7cbc148260 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc0b3ad0 con 0x7f7cbc06c320 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cc0e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7cbc0b4450 con 0x7f7cbc147e80 2024-09-10T08:40:26.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.119+0000 7f7cba800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59668/0 (socket says 172.21.15.52:59668) 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 -- 172.21.15.52:0/983611403 learned_addr learned my addr 172.21.15.52:0/983611403 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cb1400640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cbc147e80 0x7f7cbc146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cb9e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cbc06c320 0x7f7cbc1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 -- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cbc147e80 msgr2=0x7f7cbc146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cbc147e80 0x7f7cbc146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 -- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cbc06c320 msgr2=0x7f7cbc1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cbc06c320 0x7f7cbc1f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 -- 172.21.15.52:0/983611403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc143270 con 0x7f7cbc148260 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cba800640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7cb402ac70 tx=0x7f7cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4040070 con 0x7f7cbc148260 2024-09-10T08:40:26.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb4031bc0 con 0x7f7cbc148260 2024-09-10T08:40:26.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.120+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4009450 con 0x7f7cbc148260 2024-09-10T08:40:26.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.121+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cbc132ac0 con 0x7f7cbc148260 2024-09-10T08:40:26.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.121+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cbc12fef0 con 0x7f7cbc148260 2024-09-10T08:40:26.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.122+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cbc06bc10 con 0x7f7cbc148260 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.123+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cb4039040 con 0x7f7cbc148260 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.123+0000 7f7cb2a00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.124+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f7cb40ac7a0 con 0x7f7cbc148260 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.124+0000 7f7cb9e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.125+0000 7f7cb9e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 0x7f7c9806e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009ad0 tx=0x7f7cac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.128+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cb407b050 con 0x7f7cbc148260 2024-09-10T08:40:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.345+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cbc145180 con 0x7f7cbc148260 2024-09-10T08:40:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.346+0000 7f7cb2a00640 1 -- 172.21.15.52:0/983611403 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+4410 (secure 0 0 0) 0x7f7cb407a950 con 0x7f7cbc148260 2024-09-10T08:40:26.346 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:26.346 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":123,"btime":"2024-09-10T08:40:18:511523+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:39:26.940424+0000","modified":"2024-09-10T08:40:18.511515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":159,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":120,"state":"up:active","state_seq":17,"addr":"172.21.15.52:6834/2604775057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2604775057},{"type":"v1","addr":"172.21.15.52:6834","nonce":2604775057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9294,"qdb_cluster":[9294]},"id":11}]} 2024-09-10T08:40:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 123 2024-09-10T08:40:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 msgr2=0x7f7c9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 0x7f7c9806e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009ad0 tx=0x7f7cac008040 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 msgr2=0x7f7cbc1468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7cb402ac70 tx=0x7f7cb4004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 shutdown_connections 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9806be30 0x7f7c9806e2f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cbc148260 0x7f7cbc1468c0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cbc147e80 0x7f7cbc146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 --2- 172.21.15.52:0/983611403 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cbc06c320 0x7f7cbc1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 >> 172.21.15.52:0/983611403 conn(0x7f7cbc0ccec0 msgr2=0x7f7cbc0c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 shutdown_connections 2024-09-10T08:40:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.348+0000 7f7cc0e00640 1 -- 172.21.15.52:0/983611403 wait complete. 2024-09-10T08:40:26.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:26.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.520+0000 7f7d42000640 1 Processor -- start 2024-09-10T08:40:26.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.520+0000 7f7d42000640 1 -- start start 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.521+0000 7f7d42000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7d3c15e790 0x7f7d3c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.521+0000 7f7d42000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c162c60 0x7f7d3c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.521+0000 7f7d42000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3c1631c0 con 0x7f7d3c0b5970 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.521+0000 7f7d42000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3c15eb70 con 0x7f7d3c15e790 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.521+0000 7f7d42000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c0ae9a0 con 0x7f7d3c162c60 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7d3c0b5970 0x7f7d3c06f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38074/0 (socket says 172.21.15.52:38074) 2024-09-10T08:40:26.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3be00640 1 -- 172.21.15.52:0/690126437 learned_addr learned my addr 172.21.15.52:0/690126437 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3b400640 1 --2- 172.21.15.52:0/690126437 >> v2:172.21.15.176:3300/0 conn(0x7f7d3c15e790 0x7f7d3c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3aa00640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c162c60 0x7f7d3c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089571920 0 0) 0x7f7d3c1631c0 con 0x7f7d3c0b5970 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d20003520 con 0x7f7d3c0b5970 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3b400640 1 -- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c162c60 msgr2=0x7f7d3c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3b400640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c162c60 0x7f7d3c0b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1742626151 0 0) 0x7f7d20003520 con 0x7f7d3c0b5970 2024-09-10T08:40:26.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3b400640 1 -- 172.21.15.52:0/690126437 >> v1:172.21.15.52:6789/0 conn(0x7f7d3c0b5970 legacy=0x7f7d3c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.522+0000 7f7d3b400640 1 -- 172.21.15.52:0/690126437 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c0aec40 con 0x7f7d3c15e790 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.523+0000 7f7d3b400640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c073a40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0097a0 tx=0x7f7d2c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee28a2cfa31304e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c037070 con 0x7f7d3c15e790 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c02ab10 con 0x7f7d3c15e790 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d3a000640 1 -- 172.21.15.52:0/690126437 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d340019f0 con 0x7f7d3c15e790 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 -- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 msgr2=0x7f7d3c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c073a40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0097a0 tx=0x7f7d2c02a080 comp rx=0 tx=0).stop 2024-09-10T08:40:26.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 -- 172.21.15.52:0/690126437 shutdown_connections 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c162c60 0x7f7d3c0b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 --2- 172.21.15.52:0/690126437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c073a40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 -- 172.21.15.52:0/690126437 >> 172.21.15.52:0/690126437 conn(0x7f7d3c0b0a80 msgr2=0x7f7d3c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 -- 172.21.15.52:0/690126437 shutdown_connections 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.524+0000 7f7d42000640 1 -- 172.21.15.52:0/690126437 wait complete. 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.526+0000 7f7d42000640 1 Processor -- start 2024-09-10T08:40:26.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.526+0000 7f7d42000640 1 -- start start 2024-09-10T08:40:26.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c0b5970 0x7f7d3c14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c06f430 con 0x7f7d3c162c60 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0af200 con 0x7f7d3c15e790 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d42000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c06fe40 con 0x7f7d3c0b5970 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d3be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d3be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59678/0 (socket says 172.21.15.52:59678) 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d3be00640 1 -- 172.21.15.52:0/1063988055 learned_addr learned my addr 172.21.15.52:0/1063988055 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d3b400640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c0b5970 0x7f7d3c14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.527+0000 7f7d3aa00640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 -- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c0b5970 msgr2=0x7f7d3c14d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c0b5970 0x7f7d3c14d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 -- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 msgr2=0x7f7d3c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 -- 172.21.15.52:0/1063988055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c151370 con 0x7f7d3c162c60 2024-09-10T08:40:26.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d3be00640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400cbf0 tx=0x7f7d3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34017070 con 0x7f7d3c162c60 2024-09-10T08:40:26.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3400ad50 con 0x7f7d3c162c60 2024-09-10T08:40:26.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c14eb00 con 0x7f7d3c162c60 2024-09-10T08:40:26.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.528+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34012640 con 0x7f7d3c162c60 2024-09-10T08:40:26.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.529+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c14f0c0 con 0x7f7d3c162c60 2024-09-10T08:40:26.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.530+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c073a40 con 0x7f7d3c162c60 2024-09-10T08:40:26.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.531+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d3401a070 con 0x7f7d3c162c60 2024-09-10T08:40:26.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.532+0000 7f7d33400640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 0x7f7d1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.532+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f7d3408ae10 con 0x7f7d3c162c60 2024-09-10T08:40:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.533+0000 7f7d3b400640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 0x7f7d1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.533+0000 7f7d3b400640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 0x7f7d1c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c034000 tx=0x7f7d2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.536+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d3408e030 con 0x7f7d3c162c60 2024-09-10T08:40:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.725+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d3c076060 con 0x7f7d3c162c60 2024-09-10T08:40:26.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.727+0000 7f7d33400640 1 -- 172.21.15.52:0/1063988055 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16882 (secure 0 0 0) 0x7f7d34058fe0 con 0x7f7d3c162c60 2024-09-10T08:40:26.728 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:26.728 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":159,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:15.498984+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:39:24.739978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-10T08:39:25.941504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6836/3781623740":"2024-09-11T08:40:15.498915+0000","172.21.15.176:6834/3781623740":"2024-09-11T08:40:15.498915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:26.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 msgr2=0x7f7d1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 0x7f7d1c06e2f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c034000 tx=0x7f7d2c02e000 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 msgr2=0x7f7d3c14cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400cbf0 tx=0x7f7d3400a430 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 shutdown_connections 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d1c06be30 0x7f7d1c06e2f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d3c162c60 0x7f7d3c14cce0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c15e790 0x7f7d3c150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 --2- 172.21.15.52:0/1063988055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c0b5970 0x7f7d3c14d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 >> 172.21.15.52:0/1063988055 conn(0x7f7d3c0b0a80 msgr2=0x7f7d3c072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 shutdown_connections 2024-09-10T08:40:26.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.730+0000 7f7d42000640 1 -- 172.21.15.52:0/1063988055 wait complete. 2024-09-10T08:40:26.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:40:26.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.903+0000 7f0981e00640 1 Processor -- start 2024-09-10T08:40:26.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.903+0000 7f0981e00640 1 -- start start 2024-09-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f097c15e440 0x7f097c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f097c0cf450 0x7f097c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f097c0d3990 con 0x7f097c0b6540 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f097c0b6990 con 0x7f097c0cf450 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f097c0d3c70 con 0x7f097c15e440 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f097be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f097c0cf450 0x7f097c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f097c0b6540 0x7f097c06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38088/0 (socket says 172.21.15.52:38088) 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.904+0000 7f0981400640 1 -- 172.21.15.52:0/3470586011 learned_addr learned my addr 172.21.15.52:0/3470586011 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f0980a00640 1 --2- 172.21.15.52:0/3470586011 >> v2:172.21.15.176:3300/0 conn(0x7f097c15e440 0x7f097c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f097be00640 1 -- 172.21.15.52:0/3470586011 >> v2:172.21.15.176:3300/0 conn(0x7f097c15e440 msgr2=0x7f097c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f097be00640 1 --2- 172.21.15.52:0/3470586011 >> v2:172.21.15.176:3300/0 conn(0x7f097c15e440 0x7f097c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f097be00640 1 -- 172.21.15.52:0/3470586011 >> v1:172.21.15.52:6789/0 conn(0x7f097c0b6540 legacy=0x7f097c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f097b400640 1 -- 172.21.15.52:0/3470586011 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744833151 0 0) 0x7f097c0d3990 con 0x7f097c0b6540 2024-09-10T08:40:26.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.905+0000 7f097be00640 1 -- 172.21.15.52:0/3470586011 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0d3f50 con 0x7f097c0cf450 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.906+0000 7f097be00640 1 --2- 172.21.15.52:0/3470586011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0cf450 0x7f097c0b6000 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f097c068870 tx=0x7f096802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4360d1ec0569bdee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.906+0000 7f097b400640 1 -- 172.21.15.52:0/3470586011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968037070 con 0x7f097c0cf450 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.906+0000 7f097b400640 1 -- 172.21.15.52:0/3470586011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0968032440 con 0x7f097c0cf450 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.906+0000 7f097b400640 1 -- 172.21.15.52:0/3470586011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968032810 con 0x7f097c0cf450 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 -- 172.21.15.52:0/3470586011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0cf450 msgr2=0x7f097c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 --2- 172.21.15.52:0/3470586011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0cf450 0x7f097c0b6000 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f097c068870 tx=0x7f096802a230 comp rx=0 tx=0).stop 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 -- 172.21.15.52:0/3470586011 shutdown_connections 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 --2- 172.21.15.52:0/3470586011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0cf450 0x7f097c0b6000 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 --2- 172.21.15.52:0/3470586011 >> v2:172.21.15.176:3300/0 conn(0x7f097c15e440 0x7f097c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 -- 172.21.15.52:0/3470586011 >> 172.21.15.52:0/3470586011 conn(0x7f097c067f80 msgr2=0x7f097c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:26.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 -- 172.21.15.52:0/3470586011 shutdown_connections 2024-09-10T08:40:26.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.907+0000 7f0981e00640 1 -- 172.21.15.52:0/3470586011 wait complete. 2024-09-10T08:40:26.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.908+0000 7f0981e00640 1 Processor -- start 2024-09-10T08:40:26.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.909+0000 7f0981e00640 1 -- start start 2024-09-10T08:40:26.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.909+0000 7f0981e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f097c0cf450 0x7f097c161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f097c15e440 0x7f097c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0b7540 con 0x7f097c0b6540 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f097c15e820 con 0x7f097c15e440 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f097c0b76c0 con 0x7f097c0cf450 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59698/0 (socket says 172.21.15.52:59698) 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 -- 172.21.15.52:0/1675926665 learned_addr learned my addr 172.21.15.52:0/1675926665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f097be00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f097c0cf450 0x7f097c161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0981400640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f097c15e440 0x7f097c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 -- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f097c0cf450 msgr2=0x7f097c161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f097c0cf450 0x7f097c161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 -- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f097c15e440 msgr2=0x7f097c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f097c15e440 0x7f097c156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.910+0000 7f0980a00640 1 -- 172.21.15.52:0/1675926665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c14cac0 con 0x7f097c0b6540 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0980a00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f097000d830 tx=0x7f097000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097000b6c0 con 0x7f097c0b6540 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0970019070 con 0x7f097c0b6540 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097000ba80 con 0x7f097c0b6540 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c15a020 con 0x7f097c0b6540 2024-09-10T08:40:26.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.911+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c15a5e0 con 0x7f097c0b6540 2024-09-10T08:40:26.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.912+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097c0b6000 con 0x7f097c0b6540 2024-09-10T08:40:26.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.913+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f097001e460 con 0x7f097c0b6540 2024-09-10T08:40:26.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.914+0000 7f0978c00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 0x7f095c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:26.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.914+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5795+0+0 (secure 0 0 0) 0x7f097008b5b0 con 0x7f097c0b6540 2024-09-10T08:40:26.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.914+0000 7f097be00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 0x7f095c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:26.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.915+0000 7f097be00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 0x7f095c06e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f096802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:26.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:26.918+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0970059ef0 con 0x7f097c0b6540 2024-09-10T08:40:27.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.140+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f097c0d2d40 con 0x7f097c0b6540 2024-09-10T08:40:27.141 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:40:27.141+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:40:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.143+0000 7f0978c00640 1 -- 172.21.15.52:0/1675926665 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v124) ==== 161+0+0 (secure 0 0 0) 0x7f09700597f0 con 0x7f097c0b6540 2024-09-10T08:40:27.143 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:40:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.146+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 msgr2=0x7f095c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.146+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 0x7f095c06e2f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f096802e000 comp rx=0 tx=0).stop 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.146+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 msgr2=0x7f097c1599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.146+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f097000d830 tx=0x7f097000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 shutdown_connections 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f095c06be30 0x7f095c06e2f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f097c15e440 0x7f097c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f097c0cf450 0x7f097c161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 --2- 172.21.15.52:0/1675926665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f097c0b6540 0x7f097c1599b0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 >> 172.21.15.52:0/1675926665 conn(0x7f097c067f80 msgr2=0x7f097c0b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 shutdown_connections 2024-09-10T08:40:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.147+0000 7f0981e00640 1 -- 172.21.15.52:0/1675926665 wait complete. 2024-09-10T08:40:27.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:40:27.172 INFO:tasks.ceph.mds.c.smithi052.stderr: -194> 2024-09-10T08:40:23.488+0000 7f91d9400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:40:27.217 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:40:27.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.325+0000 7f1d60000640 1 Processor -- start 2024-09-10T08:40:27.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.325+0000 7f1d60000640 1 -- start start 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.326+0000 7f1d60000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1d5815ea80 0x7f1d580d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.326+0000 7f1d60000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1d580d4390 0x7f1d580b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.326+0000 7f1d60000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d580d2c80 con 0x7f1d580b6b60 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.326+0000 7f1d60000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1d580b6f90 con 0x7f1d580d4390 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.326+0000 7f1d60000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1d580d2f60 con 0x7f1d5815ea80 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5e000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1d580b6b60 0x7f1d5806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38106/0 (socket says 172.21.15.52:38106) 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5e000640 1 -- 172.21.15.52:0/3686368487 learned_addr learned my addr 172.21.15.52:0/3686368487 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/3686368487 >> v2:172.21.15.52:3300/0 conn(0x7f1d580d4390 0x7f1d580b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5d600640 1 --2- 172.21.15.52:0/3686368487 >> v2:172.21.15.176:3300/0 conn(0x7f1d5815ea80 0x7f1d580d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5cc00640 1 -- 172.21.15.52:0/3686368487 >> v2:172.21.15.176:3300/0 conn(0x7f1d5815ea80 msgr2=0x7f1d580d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/3686368487 >> v2:172.21.15.176:3300/0 conn(0x7f1d5815ea80 0x7f1d580d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5cc00640 1 -- 172.21.15.52:0/3686368487 >> v1:172.21.15.52:6789/0 conn(0x7f1d580b6b60 legacy=0x7f1d5806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.327+0000 7f1d5cc00640 1 -- 172.21.15.52:0/3686368487 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d580d3240 con 0x7f1d580d4390 2024-09-10T08:40:27.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.328+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/3686368487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580d4390 0x7f1d580b6620 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1d5806d020 tx=0x7f1d4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def77b109786bb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.328+0000 7f1d57e00640 1 -- 172.21.15.52:0/3686368487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44037070 con 0x7f1d580d4390 2024-09-10T08:40:27.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.328+0000 7f1d57e00640 1 -- 172.21.15.52:0/3686368487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44032440 con 0x7f1d580d4390 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.328+0000 7f1d57e00640 1 -- 172.21.15.52:0/3686368487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44032810 con 0x7f1d580d4390 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 -- 172.21.15.52:0/3686368487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580d4390 msgr2=0x7f1d580b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 --2- 172.21.15.52:0/3686368487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580d4390 0x7f1d580b6620 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1d5806d020 tx=0x7f1d4402a230 comp rx=0 tx=0).stop 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 -- 172.21.15.52:0/3686368487 shutdown_connections 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 --2- 172.21.15.52:0/3686368487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580d4390 0x7f1d580b6620 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 --2- 172.21.15.52:0/3686368487 >> v2:172.21.15.176:3300/0 conn(0x7f1d5815ea80 0x7f1d580d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 -- 172.21.15.52:0/3686368487 >> 172.21.15.52:0/3686368487 conn(0x7f1d580d1620 msgr2=0x7f1d580d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 -- 172.21.15.52:0/3686368487 shutdown_connections 2024-09-10T08:40:27.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.329+0000 7f1d60000640 1 -- 172.21.15.52:0/3686368487 wait complete. 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.331+0000 7f1d60000640 1 Processor -- start 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.331+0000 7f1d60000640 1 -- start start 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d5815ea80 0x7f1d580abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d581f7850 0x7f1d581f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5815ee60 con 0x7f1d580b6b60 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d580d3800 con 0x7f1d581f7850 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d60000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1d580d2810 con 0x7f1d5815ea80 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59724/0 (socket says 172.21.15.52:59724) 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 -- 172.21.15.52:0/2518777966 learned_addr learned my addr 172.21.15.52:0/2518777966 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:27.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5e000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d581f7850 0x7f1d581f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d5815ea80 0x7f1d580abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 -- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d5815ea80 msgr2=0x7f1d580abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d5815ea80 0x7f1d580abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 -- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d581f7850 msgr2=0x7f1d581f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d581f7850 0x7f1d581f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.332+0000 7f1d5d600640 1 -- 172.21.15.52:0/2518777966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d580ac4a0 con 0x7f1d580b6b60 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d5d600640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00e9b0 tx=0x7f1d4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c017070 con 0x7f1d580b6b60 2024-09-10T08:40:27.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00c9a0 con 0x7f1d580b6b60 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00cd90 con 0x7f1d580b6b60 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d580ac740 con 0x7f1d580b6b60 2024-09-10T08:40:27.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.333+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d580acd00 con 0x7f1d580b6b60 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.334+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d580b6620 con 0x7f1d580b6b60 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.335+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d4c01a070 con 0x7f1d580b6b60 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.336+0000 7f1d55600640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 0x7f1d3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.336+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5881+0+0 (secure 0 0 0) 0x7f1d4c08afe0 con 0x7f1d580b6b60 2024-09-10T08:40:27.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.336+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 0x7f1d3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:27.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.337+0000 7f1d5cc00640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 0x7f1d3806e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1d44034000 tx=0x7f1d4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:27.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.340+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d4c059840 con 0x7f1d580b6b60 2024-09-10T08:40:27.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:27.562+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1d580ce3f0 con 0x7f1d580b6b60 2024-09-10T08:40:28.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.150+0000 7f1d55600640 1 -- 172.21.15.52:0/2518777966 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v125) ==== 104+0+0 (secure 0 0 0) 0x7f1d4c059140 con 0x7f1d580b6b60 2024-09-10T08:40:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.153+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 msgr2=0x7f1d3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.153+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 0x7f1d3806e2f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1d44034000 tx=0x7f1d4402e000 comp rx=0 tx=0).stop 2024-09-10T08:40:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.153+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 msgr2=0x7f1d5815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.153+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00e9b0 tx=0x7f1d4c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:40:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 shutdown_connections 2024-09-10T08:40:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1d3806be30 0x7f1d3806e2f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d581f7850 0x7f1d581f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1d5815ea80 0x7f1d580abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 --2- 172.21.15.52:0/2518777966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d580b6b60 0x7f1d5815db00 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 >> 172.21.15.52:0/2518777966 conn(0x7f1d580d1620 msgr2=0x7f1d580cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 shutdown_connections 2024-09-10T08:40:28.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.154+0000 7f1d60000640 1 -- 172.21.15.52:0/2518777966 wait complete. 2024-09-10T08:40:28.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:40:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.382+0000 7f1482c00640 1 Processor -- start 2024-09-10T08:40:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.382+0000 7f1482c00640 1 -- start start 2024-09-10T08:40:28.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.383+0000 7f1482c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f147c155b20 0x7f147c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.383+0000 7f1482c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0cfb30 0x7f147c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.383+0000 7f1482c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147c0b0680 con 0x7f147c0b21a0 2024-09-10T08:40:28.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.383+0000 7f1482c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0b01e0 con 0x7f147c155b20 2024-09-10T08:40:28.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.383+0000 7f1482c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f147c0ccf70 con 0x7f147c0cfb30 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f1480c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0cfb30 0x7f147c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147be00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f147c155b20 0x7f147c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147b400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f147c0b21a0 0x7f147c0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:46140/0 (socket says 172.21.15.52:46140) 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147b400640 1 -- 172.21.15.52:0/3154149128 learned_addr learned my addr 172.21.15.52:0/3154149128 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147be00640 1 -- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0cfb30 msgr2=0x7f147c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147be00640 1 --2- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0cfb30 0x7f147c15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147be00640 1 -- 172.21.15.52:0/3154149128 >> v1:172.21.15.176:6789/0 conn(0x7f147c0b21a0 legacy=0x7f147c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.384+0000 7f147be00640 1 -- 172.21.15.52:0/3154149128 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c0ce940 con 0x7f147c155b20 2024-09-10T08:40:28.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.385+0000 7f147be00640 1 --2- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c0b1c60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f146c0097d0 tx=0x7f146c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81906ca35b59208f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:28.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f147aa00640 1 -- 172.21.15.52:0/3154149128 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c037070 con 0x7f147c155b20 2024-09-10T08:40:28.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f147aa00640 1 -- 172.21.15.52:0/3154149128 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c032440 con 0x7f147c155b20 2024-09-10T08:40:28.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f147aa00640 1 -- 172.21.15.52:0/3154149128 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c032810 con 0x7f147c155b20 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 -- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 msgr2=0x7f147c0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 --2- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c0b1c60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f146c0097d0 tx=0x7f146c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 -- 172.21.15.52:0/3154149128 shutdown_connections 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 --2- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0cfb30 0x7f147c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 --2- 172.21.15.52:0/3154149128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c0b1c60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 -- 172.21.15.52:0/3154149128 >> 172.21.15.52:0/3154149128 conn(0x7f147c06c240 msgr2=0x7f147c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 -- 172.21.15.52:0/3154149128 shutdown_connections 2024-09-10T08:40:28.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.386+0000 7f1482c00640 1 -- 172.21.15.52:0/3154149128 wait complete. 2024-09-10T08:40:28.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.388+0000 7f1482c00640 1 Processor -- start 2024-09-10T08:40:28.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.388+0000 7f1482c00640 1 -- start start 2024-09-10T08:40:28.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b21a0 0x7f147c0b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0ce610 con 0x7f147c0cfb30 2024-09-10T08:40:28.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0cef00 con 0x7f147c155b20 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1482c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f147c0ccb20 con 0x7f147c0b21a0 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f147b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f147b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59728/0 (socket says 172.21.15.52:59728) 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f147b400640 1 -- 172.21.15.52:0/1674056428 learned_addr learned my addr 172.21.15.52:0/1674056428 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f147be00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b21a0 0x7f147c0b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.389+0000 7f1480c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 -- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b21a0 msgr2=0x7f147c0b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b21a0 0x7f147c0b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 -- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 msgr2=0x7f147c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 -- 172.21.15.52:0/1674056428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c15dd30 con 0x7f147c0cfb30 2024-09-10T08:40:28.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f1480c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:28.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f147b400640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f146800c3c0 tx=0x7f146800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:28.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468017070 con 0x7f147c0cfb30 2024-09-10T08:40:28.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1468005ce0 con 0x7f147c0cfb30 2024-09-10T08:40:28.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c14c260 con 0x7f147c0cfb30 2024-09-10T08:40:28.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.390+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14680072f0 con 0x7f147c0cfb30 2024-09-10T08:40:28.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.391+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c14cb00 con 0x7f147c0cfb30 2024-09-10T08:40:28.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.392+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c0cf420 con 0x7f147c0cfb30 2024-09-10T08:40:28.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.392+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f146801a070 con 0x7f147c0cfb30 2024-09-10T08:40:28.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.394+0000 7f1473e00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 0x7f145c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:28.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.394+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5910+0+0 (secure 0 0 0) 0x7f146808a1f0 con 0x7f147c0cfb30 2024-09-10T08:40:28.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.394+0000 7f147be00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 0x7f145c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:28.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.395+0000 7f147be00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 0x7f145c06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f146c034000 tx=0x7f146c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:28.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.398+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1468058470 con 0x7f147c0cfb30 2024-09-10T08:40:28.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:28.586+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f147c15ad80 con 0x7f147c0cfb30 2024-09-10T08:40:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.152+0000 7f1473e00640 1 -- 172.21.15.52:0/1674056428 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v162) ==== 181+0+0 (secure 0 0 0) 0x7f146805c770 con 0x7f147c0cfb30 2024-09-10T08:40:29.152 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:40:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 msgr2=0x7f145c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:29.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 0x7f145c06e2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f146c034000 tx=0x7f146c02e000 comp rx=0 tx=0).stop 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 msgr2=0x7f147c14d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f146800c3c0 tx=0x7f146800c880 comp rx=0 tx=0).stop 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 shutdown_connections 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f145c06be30 0x7f145c06e2f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f147c155b20 0x7f147c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f147c0cfb30 0x7f147c14d020 secure :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f146800c3c0 tx=0x7f146800c880 comp rx=0 tx=0).stop 2024-09-10T08:40:29.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 --2- 172.21.15.52:0/1674056428 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147c0b21a0 0x7f147c0b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.155+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 >> 172.21.15.52:0/1674056428 conn(0x7f147c06c240 msgr2=0x7f147c159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:29.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.156+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 shutdown_connections 2024-09-10T08:40:29.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.156+0000 7f1482c00640 1 -- 172.21.15.52:0/1674056428 wait complete. 2024-09-10T08:40:29.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:40:29.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.351+0000 7ff14e800640 1 Processor -- start 2024-09-10T08:40:29.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.351+0000 7ff14e800640 1 -- start start 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff14e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff148158ef0 0x7ff14806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff14e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff14806fbc0 0x7ff1480b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff14e800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14806fff0 con 0x7ff14806c150 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff14e800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff14806c5b0 con 0x7ff148158ef0 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff14e800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff1481592d0 con 0x7ff14806fbc0 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff147400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff148158ef0 0x7ff14806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff147400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff148158ef0 0x7ff14806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59734/0 (socket says 172.21.15.52:59734) 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.352+0000 7ff147400640 1 -- 172.21.15.52:0/4019734290 learned_addr learned my addr 172.21.15.52:0/4019734290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.353+0000 7ff147400640 1 -- 172.21.15.52:0/4019734290 >> v2:172.21.15.176:3300/0 conn(0x7ff14806fbc0 msgr2=0x7ff1480b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.353+0000 7ff147400640 1 --2- 172.21.15.52:0/4019734290 >> v2:172.21.15.176:3300/0 conn(0x7ff14806fbc0 0x7ff1480b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.353+0000 7ff147400640 1 -- 172.21.15.52:0/4019734290 >> v1:172.21.15.176:6789/0 conn(0x7ff14806c150 legacy=0x7ff14806f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.353+0000 7ff147400640 1 -- 172.21.15.52:0/4019734290 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1481624a0 con 0x7ff148158ef0 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.354+0000 7ff147400640 1 --2- 172.21.15.52:0/4019734290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff14806bc10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ff148162670 tx=0x7ff13802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74433517ffdabf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.354+0000 7ff146000640 1 -- 172.21.15.52:0/4019734290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138037070 con 0x7ff148158ef0 2024-09-10T08:40:29.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.354+0000 7ff146000640 1 -- 172.21.15.52:0/4019734290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138032440 con 0x7ff148158ef0 2024-09-10T08:40:29.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.354+0000 7ff146000640 1 -- 172.21.15.52:0/4019734290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138032810 con 0x7ff148158ef0 2024-09-10T08:40:29.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 -- 172.21.15.52:0/4019734290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 msgr2=0x7ff14806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 --2- 172.21.15.52:0/4019734290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff14806bc10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ff148162670 tx=0x7ff13802a180 comp rx=0 tx=0).stop 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 -- 172.21.15.52:0/4019734290 shutdown_connections 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 --2- 172.21.15.52:0/4019734290 >> v2:172.21.15.176:3300/0 conn(0x7ff14806fbc0 0x7ff1480b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 --2- 172.21.15.52:0/4019734290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff14806bc10 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 -- 172.21.15.52:0/4019734290 >> 172.21.15.52:0/4019734290 conn(0x7ff148067da0 msgr2=0x7ff14806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 -- 172.21.15.52:0/4019734290 shutdown_connections 2024-09-10T08:40:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.355+0000 7ff14e800640 1 -- 172.21.15.52:0/4019734290 wait complete. 2024-09-10T08:40:29.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.356+0000 7ff14e800640 1 Processor -- start 2024-09-10T08:40:29.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.356+0000 7ff14e800640 1 -- start start 2024-09-10T08:40:29.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14806c150 0x7ff14814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 0x7ff148157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff148162d00 con 0x7ff148158ef0 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff148162a20 con 0x7ff14806fbc0 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.357+0000 7ff14e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff148162fe0 con 0x7ff14806c150 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59746/0 (socket says 172.21.15.52:59746) 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 -- 172.21.15.52:0/2768172049 learned_addr learned my addr 172.21.15.52:0/2768172049 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff146a00640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 0x7ff148157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147400640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14806c150 0x7ff14814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 -- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14806c150 msgr2=0x7ff14814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:29.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14806c150 0x7ff14814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 -- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 msgr2=0x7ff148157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:29.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 0x7ff148157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:29.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 -- 172.21.15.52:0/2768172049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1480b22b0 con 0x7ff148158ef0 2024-09-10T08:40:29.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff146a00640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 0x7ff148157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:29.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.358+0000 7ff147e00640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ff14000b9a0 tx=0x7ff14000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.359+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140019070 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.359+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14000cbc0 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.359+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140014440 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.359+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1480b2590 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.359+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1480b2b50 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.360+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1480b2d50 con 0x7ff148158ef0 2024-09-10T08:40:29.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.361+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff14001c070 con 0x7ff148158ef0 2024-09-10T08:40:29.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.361+0000 7ff13f400640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 0x7ff12806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:29.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.362+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5472+0+0 (secure 0 0 0) 0x7ff14008aba0 con 0x7ff148158ef0 2024-09-10T08:40:29.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.362+0000 7ff147400640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 0x7ff12806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:29.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.363+0000 7ff147400640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 0x7ff12806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff138034000 tx=0x7ff13802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:29.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.366+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1480b2d50 con 0x7ff148158ef0 2024-09-10T08:40:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:29.552+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff14806bc10 con 0x7ff148158ef0 2024-09-10T08:40:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.157+0000 7ff13f400640 1 -- 172.21.15.52:0/2768172049 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v163) ==== 169+0+0 (secure 0 0 0) 0x7ff1400595c0 con 0x7ff148158ef0 2024-09-10T08:40:30.159 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:40:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.163+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 msgr2=0x7ff12806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.163+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 0x7ff12806e2f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff138034000 tx=0x7ff13802e000 comp rx=0 tx=0).stop 2024-09-10T08:40:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.163+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 msgr2=0x7ff1481594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.163+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ff14000b9a0 tx=0x7ff14000be60 comp rx=0 tx=0).stop 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 shutdown_connections 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff12806be30 0x7ff12806e2f0 secure :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff138034000 tx=0x7ff13802e000 comp rx=0 tx=0).stop 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148158ef0 0x7ff1481594b0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff14806fbc0 0x7ff148157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 --2- 172.21.15.52:0/2768172049 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff14806c150 0x7ff14814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.164+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 >> 172.21.15.52:0/2768172049 conn(0x7ff148067da0 msgr2=0x7ff1480b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.167+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 shutdown_connections 2024-09-10T08:40:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.167+0000 7ff14e800640 1 -- 172.21.15.52:0/2768172049 wait complete. 2024-09-10T08:40:30.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:40:30.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.358+0000 7f175ce00640 1 Processor -- start 2024-09-10T08:40:30.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.358+0000 7f175ce00640 1 -- start start 2024-09-10T08:40:30.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f175ce00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17580732e0 0x7f17580736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f175ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17580cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f175ce00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17580714b0 con 0x7f1758071c70 2024-09-10T08:40:30.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f175ce00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1758073c00 con 0x7f17580732e0 2024-09-10T08:40:30.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f175ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f17580cd880 con 0x7f17580cce30 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f1755e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17580732e0 0x7f17580736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f1755e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f17580732e0 0x7f17580736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59748/0 (socket says 172.21.15.52:59748) 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.359+0000 7f1755e00640 1 -- 172.21.15.52:0/345805207 learned_addr learned my addr 172.21.15.52:0/345805207 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.360+0000 7f174d400640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17580cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.360+0000 7f1755e00640 1 -- 172.21.15.52:0/345805207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 msgr2=0x7f17580cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.360+0000 7f1755e00640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17580cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.360+0000 7f1755e00640 1 -- 172.21.15.52:0/345805207 >> v1:172.21.15.176:6789/0 conn(0x7f1758071c70 legacy=0x7f175815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.360+0000 7f1755e00640 1 -- 172.21.15.52:0/345805207 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17580cdb60 con 0x7f17580732e0 2024-09-10T08:40:30.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.361+0000 7f1755e00640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580732e0 0x7f17580736c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1748009870 tx=0x7f174802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2dfa99b888b207 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.361+0000 7f1755400640 1 -- 172.21.15.52:0/345805207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748037070 con 0x7f17580732e0 2024-09-10T08:40:30.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.361+0000 7f1755400640 1 -- 172.21.15.52:0/345805207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1748032440 con 0x7f17580732e0 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.361+0000 7f1755400640 1 -- 172.21.15.52:0/345805207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748032810 con 0x7f17580732e0 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 -- 172.21.15.52:0/345805207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580732e0 msgr2=0x7f17580736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580732e0 0x7f17580736c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1748009870 tx=0x7f174802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 -- 172.21.15.52:0/345805207 shutdown_connections 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17580cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 --2- 172.21.15.52:0/345805207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f17580732e0 0x7f17580736c0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 -- 172.21.15.52:0/345805207 >> 172.21.15.52:0/345805207 conn(0x7f175806d0f0 msgr2=0x7f175806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 -- 172.21.15.52:0/345805207 shutdown_connections 2024-09-10T08:40:30.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.362+0000 7f175ce00640 1 -- 172.21.15.52:0/345805207 wait complete. 2024-09-10T08:40:30.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.363+0000 7f175ce00640 1 Processor -- start 2024-09-10T08:40:30.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 -- start start 2024-09-10T08:40:30.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17580732e0 0x7f1758144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17581f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f175806bf70 con 0x7f1758071c70 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f175806bdf0 con 0x7f17580732e0 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.364+0000 7f175ce00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1758072120 con 0x7f17580cce30 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59754/0 (socket says 172.21.15.52:59754) 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 -- 172.21.15.52:0/206909706 learned_addr learned my addr 172.21.15.52:0/206909706 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f174d400640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17580732e0 0x7f1758144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1756800640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17581f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 -- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 msgr2=0x7f17581f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17581f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 -- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17580732e0 msgr2=0x7f1758144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17580732e0 0x7f1758144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1755e00640 1 -- 172.21.15.52:0/206909706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175814b860 con 0x7f1758071c70 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.365+0000 7f1756800640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17581f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f1755e00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f17480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748041020 con 0x7f1758071c70 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17480306c0 con 0x7f1758071c70 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748037040 con 0x7f1758071c70 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1758159f50 con 0x7f1758071c70 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.366+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175815a510 con 0x7f1758071c70 2024-09-10T08:40:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.367+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1758145500 con 0x7f1758071c70 2024-09-10T08:40:30.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.368+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1748044020 con 0x7f1758071c70 2024-09-10T08:40:30.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.369+0000 7f174ea00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 0x7f173406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.369+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7f17480ab380 con 0x7f1758071c70 2024-09-10T08:40:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.370+0000 7f174d400640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 0x7f173406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.370+0000 7f174d400640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 0x7f173406e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f17580cfd10 tx=0x7f1740008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.374+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f174804b030 con 0x7f1758071c70 2024-09-10T08:40:30.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.583+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f17580724b0 con 0x7f1758071c70 2024-09-10T08:40:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.587+0000 7f174ea00640 1 -- 172.21.15.52:0/206909706 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f1748079fc0 con 0x7f1758071c70 2024-09-10T08:40:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 msgr2=0x7f173406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 0x7f173406e2f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f17580cfd10 tx=0x7f1740008040 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 msgr2=0x7f17581448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1748000c00 tx=0x7f17480046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 shutdown_connections 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f173406be30 0x7f173406e2f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17580cce30 0x7f17581f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17580732e0 0x7f1758144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 --2- 172.21.15.52:0/206909706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1758071c70 0x7f17581448b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 >> 172.21.15.52:0/206909706 conn(0x7f175806d0f0 msgr2=0x7f175815eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 shutdown_connections 2024-09-10T08:40:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.590+0000 7f175ce00640 1 -- 172.21.15.52:0/206909706 wait complete. 2024-09-10T08:40:30.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-10T08:40:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.761+0000 7f7d92600640 1 Processor -- start 2024-09-10T08:40:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.762+0000 7f7d92600640 1 -- start start 2024-09-10T08:40:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d92600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d8c145ed0 0x7f7d8c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d92600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c0b4020 con 0x7f7d8c073180 2024-09-10T08:40:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d92600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c0b42c0 con 0x7f7d8c0b5f90 2024-09-10T08:40:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d92600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0b63d0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d8b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d8c145ed0 0x7f7d8c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d83e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7d8c073180 0x7f7d8c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38114/0 (socket says 172.21.15.52:38114) 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d83e00640 1 -- 172.21.15.52:0/2646613585 learned_addr learned my addr 172.21.15.52:0/2646613585 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d8b400640 1 -- 172.21.15.52:0/2646613585 >> v1:172.21.15.176:6789/0 conn(0x7f7d8c0b5f90 legacy=0x7f7d8c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d8b400640 1 -- 172.21.15.52:0/2646613585 >> v1:172.21.15.52:6789/0 conn(0x7f7d8c073180 legacy=0x7f7d8c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.763+0000 7f7d8aa00640 1 -- 172.21.15.52:0/2646613585 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821090593 0 0) 0x7f7d8c0b4020 con 0x7f7d8c073180 2024-09-10T08:40:30.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.764+0000 7f7d8b400640 1 -- 172.21.15.52:0/2646613585 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0b45a0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.764+0000 7f7d8b400640 1 --2- 172.21.15.52:0/2646613585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c0b5080 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0097a0 tx=0x7f7d7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2fbe1192119fda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d8aa00640 1 -- 172.21.15.52:0/2646613585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c037070 con 0x7f7d8c145ed0 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d8aa00640 1 -- 172.21.15.52:0/2646613585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c032440 con 0x7f7d8c145ed0 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d8aa00640 1 -- 172.21.15.52:0/2646613585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c032810 con 0x7f7d8c145ed0 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 -- 172.21.15.52:0/2646613585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 msgr2=0x7f7d8c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 --2- 172.21.15.52:0/2646613585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c0b5080 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0097a0 tx=0x7f7d7c02a230 comp rx=0 tx=0).stop 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 -- 172.21.15.52:0/2646613585 shutdown_connections 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 --2- 172.21.15.52:0/2646613585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c0b5080 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 -- 172.21.15.52:0/2646613585 >> 172.21.15.52:0/2646613585 conn(0x7f7d8c0ccec0 msgr2=0x7f7d8c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.765+0000 7f7d92600640 1 -- 172.21.15.52:0/2646613585 shutdown_connections 2024-09-10T08:40:30.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.766+0000 7f7d92600640 1 -- 172.21.15.52:0/2646613585 wait complete. 2024-09-10T08:40:30.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.767+0000 7f7d92600640 1 Processor -- start 2024-09-10T08:40:30.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.767+0000 7f7d92600640 1 -- start start 2024-09-10T08:40:30.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c073180 0x7f7d8c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c0b5f90 0x7f7d8c1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c1462b0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0b4b60 con 0x7f7d8c0b5f90 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d92600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c146430 con 0x7f7d8c073180 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d8be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d8be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59774/0 (socket says 172.21.15.52:59774) 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.768+0000 7f7d8be00640 1 -- 172.21.15.52:0/88481589 learned_addr learned my addr 172.21.15.52:0/88481589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8b400640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c073180 0x7f7d8c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d83e00640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c0b5f90 0x7f7d8c1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 -- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c073180 msgr2=0x7f7d8c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c073180 0x7f7d8c159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 -- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c0b5f90 msgr2=0x7f7d8c1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c0b5f90 0x7f7d8c1408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:30.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 -- 172.21.15.52:0/88481589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c141150 con 0x7f7d8c145ed0 2024-09-10T08:40:30.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d8be00640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c7a0 tx=0x7f7d8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.769+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84003b70 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.770+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d84003d30 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.770+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c0c66e0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.770+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400aa90 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.770+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c0c6ca0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.771+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c0b5080 con 0x7f7d8c145ed0 2024-09-10T08:40:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.772+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d8400ac50 con 0x7f7d8c145ed0 2024-09-10T08:40:30.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.772+0000 7f7d83400640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 0x7f7d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:30.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.773+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7f7d8408a9c0 con 0x7f7d8c145ed0 2024-09-10T08:40:30.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.773+0000 7f7d8b400640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 0x7f7d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:30.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.774+0000 7f7d8b400640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 0x7f7d6806e2f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:30.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:30.777+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d84058fb0 con 0x7f7d8c145ed0 2024-09-10T08:40:31.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.027+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f7d8c0cd9b0 con 0x7f7d8c145ed0 2024-09-10T08:40:31.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.159+0000 7f7d83400640 1 -- 172.21.15.52:0/88481589 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v556) ==== 166+0+0 (secure 0 0 0) 0x7f7d8405d2b0 con 0x7f7d8c145ed0 2024-09-10T08:40:31.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 msgr2=0x7f7d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 0x7f7d6806e2f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c02e000 comp rx=0 tx=0).stop 2024-09-10T08:40:31.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 msgr2=0x7f7d8c1427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400c7a0 tx=0x7f7d8400cc60 comp rx=0 tx=0).stop 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 shutdown_connections 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7d6806be30 0x7f7d6806e2f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d8c145ed0 0x7f7d8c1427a0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d8c0b5f90 0x7f7d8c1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 --2- 172.21.15.52:0/88481589 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d8c073180 0x7f7d8c159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 >> 172.21.15.52:0/88481589 conn(0x7f7d8c0ccec0 msgr2=0x7f7d8c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 shutdown_connections 2024-09-10T08:40:31.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.163+0000 7f7d92600640 1 -- 172.21.15.52:0/88481589 wait complete. 2024-09-10T08:40:31.180 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T08:40:31.180 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-10T08:40:31.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.336+0000 7f7a77000640 1 Processor -- start 2024-09-10T08:40:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.336+0000 7f7a77000640 1 -- start start 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a77000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7a700cf670 0x7f7a7015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a77000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7a700b7a30 0x7f7a7015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a77000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a700cfb40 con 0x7f7a700b63f0 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a77000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7a700d27f0 con 0x7f7a700cf670 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a77000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7a700cfe20 con 0x7f7a700b7a30 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a75c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7a700b63f0 0x7f7a700cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38124/0 (socket says 172.21.15.52:38124) 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.337+0000 7f7a75c00640 1 -- 172.21.15.52:0/2946901075 learned_addr learned my addr 172.21.15.52:0/2946901075 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a75200640 1 --2- 172.21.15.52:0/2946901075 >> v2:172.21.15.52:3300/0 conn(0x7f7a700cf670 0x7f7a7015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a76600640 1 --2- 172.21.15.52:0/2946901075 >> v2:172.21.15.176:3300/0 conn(0x7f7a700b7a30 0x7f7a7015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a6fe00640 1 -- 172.21.15.52:0/2946901075 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 218758471 0 0) 0x7f7a700cfb40 con 0x7f7a700b63f0 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a6fe00640 1 -- 172.21.15.52:0/2946901075 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a58003520 con 0x7f7a700b63f0 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a75200640 1 -- 172.21.15.52:0/2946901075 >> v2:172.21.15.176:3300/0 conn(0x7f7a700b7a30 msgr2=0x7f7a7015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a75200640 1 --2- 172.21.15.52:0/2946901075 >> v2:172.21.15.176:3300/0 conn(0x7f7a700b7a30 0x7f7a7015e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a75200640 1 -- 172.21.15.52:0/2946901075 >> v1:172.21.15.52:6789/0 conn(0x7f7a700b63f0 legacy=0x7f7a700cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.338+0000 7f7a75200640 1 -- 172.21.15.52:0/2946901075 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a700d2e00 con 0x7f7a700cf670 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.339+0000 7f7a75200640 1 --2- 172.21.15.52:0/2946901075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700cf670 0x7f7a7015df80 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f7a700d0790 tx=0x7f7a5c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b100360b45ba4493 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.339+0000 7f7a6fe00640 1 -- 172.21.15.52:0/2946901075 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c037070 con 0x7f7a700cf670 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.339+0000 7f7a6fe00640 1 -- 172.21.15.52:0/2946901075 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c032440 con 0x7f7a700cf670 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.339+0000 7f7a6fe00640 1 -- 172.21.15.52:0/2946901075 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c02ae60 con 0x7f7a700cf670 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 -- 172.21.15.52:0/2946901075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700cf670 msgr2=0x7f7a7015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 --2- 172.21.15.52:0/2946901075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700cf670 0x7f7a7015df80 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f7a700d0790 tx=0x7f7a5c02a110 comp rx=0 tx=0).stop 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 -- 172.21.15.52:0/2946901075 shutdown_connections 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 --2- 172.21.15.52:0/2946901075 >> v2:172.21.15.176:3300/0 conn(0x7f7a700b7a30 0x7f7a7015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 --2- 172.21.15.52:0/2946901075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700cf670 0x7f7a7015df80 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 -- 172.21.15.52:0/2946901075 >> 172.21.15.52:0/2946901075 conn(0x7f7a700d1360 msgr2=0x7f7a700d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 -- 172.21.15.52:0/2946901075 shutdown_connections 2024-09-10T08:40:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.340+0000 7f7a77000640 1 -- 172.21.15.52:0/2946901075 wait complete. 2024-09-10T08:40:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.342+0000 7f7a77000640 1 Processor -- start 2024-09-10T08:40:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.342+0000 7f7a77000640 1 -- start start 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a700b7a30 0x7f7a70154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 0x7f7a70146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7015eb80 con 0x7f7a700b63f0 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7015ea00 con 0x7f7a700cf670 2024-09-10T08:40:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a77000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7a700b67d0 con 0x7f7a700b7a30 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59798/0 (socket says 172.21.15.52:59798) 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 -- 172.21.15.52:0/4263718855 learned_addr learned my addr 172.21.15.52:0/4263718855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a76600640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 0x7f7a70146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 -- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a700b7a30 msgr2=0x7f7a70154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75200640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a700b7a30 0x7f7a70154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a700b7a30 0x7f7a70154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 -- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 msgr2=0x7f7a70146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 0x7f7a70146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a75c00640 1 -- 172.21.15.52:0/4263718855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a701578e0 con 0x7f7a700b63f0 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.343+0000 7f7a76600640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 0x7f7a70146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a75c00640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c460 tx=0x7f7a6400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64017070 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64005ce0 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64007290 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a70156840 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.344+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a701570e0 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.345+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a700cef60 con 0x7f7a700b63f0 2024-09-10T08:40:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.346+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a6401a070 con 0x7f7a700b63f0 2024-09-10T08:40:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.347+0000 7f7a6d600640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 0x7f7a5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.347+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7f7a64089fc0 con 0x7f7a700b63f0 2024-09-10T08:40:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.348+0000 7f7a75200640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 0x7f7a5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.348+0000 7f7a75200640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 0x7f7a5006e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.352+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a701578e0 con 0x7f7a700b63f0 2024-09-10T08:40:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.537+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a700b7530 con 0x7f7a700b63f0 2024-09-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.538+0000 7f7a6d600640 1 -- 172.21.15.52:0/4263718855 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+13186 (secure 0 0 0) 0x7f7a64058b70 con 0x7f7a700b63f0 2024-09-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:31.539 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":163,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:30.153523+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6832/2604775057":"2024-09-11T08:40:27.142299+0000","172.21.15.176:6836/3781623740":"2024-09-11T08:40:15.498915+0000","172.21.15.52:6834/2604775057":"2024-09-11T08:40:27.142299+0000","172.21.15.176:6834/3781623740":"2024-09-11T08:40:15.498915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:31.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 msgr2=0x7f7a5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 0x7f7a5006e2f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c02e000 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 msgr2=0x7f7a70154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c460 tx=0x7f7a6400c920 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 shutdown_connections 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7a5006be30 0x7f7a5006e2f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a700cf670 0x7f7a70146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a700b7a30 0x7f7a70154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 --2- 172.21.15.52:0/4263718855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a700b63f0 0x7f7a70154560 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 >> 172.21.15.52:0/4263718855 conn(0x7f7a700d1360 msgr2=0x7f7a7015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 shutdown_connections 2024-09-10T08:40:31.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.541+0000 7f7a77000640 1 -- 172.21.15.52:0/4263718855 wait complete. 2024-09-10T08:40:31.559 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:40:31.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:40:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.718+0000 7fb7e1800640 1 Processor -- start 2024-09-10T08:40:31.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.718+0000 7fb7e1800640 1 -- start start 2024-09-10T08:40:31.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.719+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7dc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.719+0000 7fb7e1800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc0714b0 con 0x7fb7dc0cd270 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.719+0000 7fb7e1800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc073c00 con 0x7fb7dc0cce30 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.719+0000 7fb7e1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc0cd880 con 0x7fb7dc0732e0 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7db400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb7dc0cd270 0x7fb7dc15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38132/0 (socket says 172.21.15.52:38132) 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7db400640 1 -- 172.21.15.52:0/4249832244 learned_addr learned my addr 172.21.15.52:0/4249832244 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7daa00640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7dc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816914918 0 0) 0x7fb7dc0714b0 con 0x7fb7dc0cd270 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7c0003520 con 0x7fb7dc0cd270 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883208279 0 0) 0x7fb7dc073c00 con 0x7fb7dc0cce30 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc0714b0 con 0x7fb7dc0cce30 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 439542080 0 0) 0x7fb7c0003520 con 0x7fb7dc0cd270 2024-09-10T08:40:31.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 msgr2=0x7fb7dc0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:31.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7dc0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 >> v1:172.21.15.176:6789/0 conn(0x7fb7dc0cce30 legacy=0x7fb7dc071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc0cdb60 con 0x7fb7dc0cd270 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.720+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fb7d40019f0 con 0x7fb7dc0cd270 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 >> v1:172.21.15.52:6789/0 conn(0x7fb7dc0cd270 legacy=0x7fb7dc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7c0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7c0004120 0x7fb7c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c0004d40 0x7fb7c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc0cd880 con 0x7fb7c0004d40 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c000bb80 con 0x7fb7c0004120 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c000bd80 con 0x7fb7dc0732e0 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7c0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7d2000640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7c0004120 0x7fb7c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7db400640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c0004d40 0x7fb7c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 -- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7c0004120 msgr2=0x7fb7c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:31.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7c0004120 0x7fb7c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 -- 172.21.15.52:0/4249832244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c0004d40 msgr2=0x7fb7c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:31.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7c0004d40 0x7fb7c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.721+0000 7fb7daa00640 1 -- 172.21.15.52:0/4249832244 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c0003520 con 0x7fb7dc0732e0 2024-09-10T08:40:31.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.722+0000 7fb7daa00640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7c0003b70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009ac0 tx=0x7fb7c0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4546491afdbb4076 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc036070 con 0x7fb7dc0732e0 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc031400 con 0x7fb7dc0732e0 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7da000640 1 -- 172.21.15.52:0/4249832244 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc009690 con 0x7fb7dc0732e0 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 -- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 msgr2=0x7fb7c0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 --2- 172.21.15.52:0/4249832244 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc0732e0 0x7fb7c0003b70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009ac0 tx=0x7fb7c0005830 comp rx=0 tx=0).stop 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7db400640 1 -- 172.21.15.52:0/4249832244 reap_dead start 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 -- 172.21.15.52:0/4249832244 shutdown_connections 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 -- 172.21.15.52:0/4249832244 >> 172.21.15.52:0/4249832244 conn(0x7fb7dc06d0f0 msgr2=0x7fb7dc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 -- 172.21.15.52:0/4249832244 shutdown_connections 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.723+0000 7fb7e1800640 1 -- 172.21.15.52:0/4249832244 wait complete. 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.725+0000 7fb7e1800640 1 Processor -- start 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.725+0000 7fb7e1800640 1 -- start start 2024-09-10T08:40:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 0x7fb7dc156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7dc15ec80 0x7fb7dc147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc06bf70 con 0x7fb7dc0732e0 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc06bdf0 con 0x7fb7dc15ec80 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7e1800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc072380 con 0x7fb7dc158660 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.726+0000 7fb7daa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59804/0 (socket says 172.21.15.52:59804) 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 -- 172.21.15.52:0/1960171348 learned_addr learned my addr 172.21.15.52:0/1960171348 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7d2000640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 0x7fb7dc156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7db400640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7dc15ec80 0x7fb7dc147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 -- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 msgr2=0x7fb7dc156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 0x7fb7dc156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 -- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7dc15ec80 msgr2=0x7fb7dc147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7dc15ec80 0x7fb7dc147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 -- 172.21.15.52:0/1960171348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc156c70 con 0x7fb7dc0732e0 2024-09-10T08:40:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7d2000640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 0x7fb7dc156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7daa00640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.727+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc040020 con 0x7fb7dc0732e0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.728+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc003a40 con 0x7fb7dc0732e0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.728+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc036040 con 0x7fb7dc0732e0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.728+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc156f10 con 0x7fb7dc0732e0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.728+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1574d0 con 0x7fb7dc0732e0 2024-09-10T08:40:31.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.729+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc0d12f0 con 0x7fb7dc0732e0 2024-09-10T08:40:31.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.730+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7cc043020 con 0x7fb7dc0732e0 2024-09-10T08:40:31.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.730+0000 7fb7d3400640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 0x7fb7b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:31.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.731+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7fb7cc0aad70 con 0x7fb7dc0732e0 2024-09-10T08:40:31.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.731+0000 7fb7d2000640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 0x7fb7b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:31.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.731+0000 7fb7d2000640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 0x7fb7b806e320 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc15f740 tx=0x7fb7c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:31.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.735+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7dc0d12f0 con 0x7fb7dc0732e0 2024-09-10T08:40:31.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.919+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7dc0736c0 con 0x7fb7dc0732e0 2024-09-10T08:40:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.919+0000 7fb7d3400640 1 -- 172.21.15.52:0/1960171348 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) ==== 93+0+10 (secure 0 0 0) 0x7fb7cc04a070 con 0x7fb7dc0732e0 2024-09-10T08:40:31.920 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:40:31.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.921+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 msgr2=0x7fb7b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.921+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 0x7fb7b806e320 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc15f740 tx=0x7fb7c4009040 comp rx=0 tx=0).stop 2024-09-10T08:40:31.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 msgr2=0x7fb7dc157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc000c00 tx=0x7fb7cc004730 comp rx=0 tx=0).stop 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 shutdown_connections 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb7b806be60 0x7fb7b806e320 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7dc15ec80 0x7fb7dc147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7dc158660 0x7fb7dc156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 --2- 172.21.15.52:0/1960171348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7dc0732e0 0x7fb7dc157fb0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 >> 172.21.15.52:0/1960171348 conn(0x7fb7dc06d0f0 msgr2=0x7fb7dc0b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 shutdown_connections 2024-09-10T08:40:31.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:31.922+0000 7fb7e1800640 1 -- 172.21.15.52:0/1960171348 wait complete. 2024-09-10T08:40:31.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-10T08:40:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.095+0000 7f76a7600640 1 Processor -- start 2024-09-10T08:40:32.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.095+0000 7f76a7600640 1 -- start start 2024-09-10T08:40:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a7600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f76a00720b0 0x7f76a015b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a7600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a0072500 con 0x7f76a015ab40 2024-09-10T08:40:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a7600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a0071010 con 0x7f76a006c6a0 2024-09-10T08:40:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a7600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f76a006cb10 con 0x7f76a00720b0 2024-09-10T08:40:32.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a4c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f76a015ab40 0x7f76a0073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38136/0 (socket says 172.21.15.52:38136) 2024-09-10T08:40:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a4c00640 1 -- 172.21.15.52:0/214138055 learned_addr learned my addr 172.21.15.52:0/214138055 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158011657 0 0) 0x7f76a0072500 con 0x7f76a015ab40 2024-09-10T08:40:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f76a5600640 1 --2- 172.21.15.52:0/214138055 >> v2:172.21.15.176:3300/0 conn(0x7f76a00720b0 0x7f76a015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.097+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7688003440 con 0x7f76a015ab40 2024-09-10T08:40:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505023621 0 0) 0x7f76a0071010 con 0x7f76a006c6a0 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a0072500 con 0x7f76a006c6a0 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 270317890 0 0) 0x7f7688003440 con 0x7f76a015ab40 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 >> v2:172.21.15.176:3300/0 conn(0x7f76a00720b0 msgr2=0x7f76a015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 --2- 172.21.15.52:0/214138055 >> v2:172.21.15.176:3300/0 conn(0x7f76a00720b0 0x7f76a015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 >> v1:172.21.15.176:6789/0 conn(0x7f76a006c6a0 legacy=0x7f76a015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a00712f0 con 0x7f76a015ab40 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f7694001670 con 0x7f76a015ab40 2024-09-10T08:40:32.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 >> v1:172.21.15.52:6789/0 conn(0x7f76a015ab40 legacy=0x7f76a0073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f768800ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7688004080 0x7f768800d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f768800d7a0 0x7f768800fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7688010510 con 0x7f7688003c80 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76880106c0 con 0x7f7688004080 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76880108c0 con 0x7f768800d7a0 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f76a4c00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f768800ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f769fe00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7688004080 0x7f768800d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.098+0000 7f76a5600640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f768800d7a0 0x7f768800fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a4c00640 1 -- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f768800d7a0 msgr2=0x7f768800fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:32.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a4c00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f768800d7a0 0x7f768800fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a4c00640 1 -- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7688004080 msgr2=0x7f768800d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a4c00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7688004080 0x7f768800d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a4c00640 1 -- 172.21.15.52:0/214138055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7688003440 con 0x7f7688003c80 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f769fe00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7688004080 0x7f768800d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a5600640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f768800d7a0 0x7f768800fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.099+0000 7f76a5600640 1 -- 172.21.15.52:0/214138055 reap_dead start 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a4c00640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f768800ac50 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7694007fc0 tx=0x7f7688003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98c2129977d4222 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694007be0 con 0x7f7688003c80 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694005af0 con 0x7f7688003c80 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f769f400640 1 -- 172.21.15.52:0/214138055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694007070 con 0x7f7688003c80 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a7600640 1 -- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 msgr2=0x7f768800ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a7600640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f768800ac50 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7694007fc0 tx=0x7f7688003730 comp rx=0 tx=0).stop 2024-09-10T08:40:32.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a7600640 1 -- 172.21.15.52:0/214138055 shutdown_connections 2024-09-10T08:40:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a7600640 1 --2- 172.21.15.52:0/214138055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f768800ac50 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.100+0000 7f76a7600640 1 -- 172.21.15.52:0/214138055 >> 172.21.15.52:0/214138055 conn(0x7f76a00ccec0 msgr2=0x7f76a00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.101+0000 7f76a7600640 1 -- 172.21.15.52:0/214138055 shutdown_connections 2024-09-10T08:40:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.101+0000 7f76a7600640 1 -- 172.21.15.52:0/214138055 wait complete. 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.102+0000 7f76a7600640 1 Processor -- start 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.102+0000 7f76a7600640 1 -- start start 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a014f4e0 0x7f76a0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a01527d0 0x7f76a00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0073990 con 0x7f7688003c80 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76a00718b0 con 0x7f76a014f4e0 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a7600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76a0073b10 con 0x7f76a01527d0 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59814/0 (socket says 172.21.15.52:59814) 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.103+0000 7f76a4c00640 1 -- 172.21.15.52:0/616086057 learned_addr learned my addr 172.21.15.52:0/616086057 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a5600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a01527d0 0x7f76a00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f769fe00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a014f4e0 0x7f76a0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 -- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a01527d0 msgr2=0x7f76a00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a01527d0 0x7f76a00c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 -- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a014f4e0 msgr2=0x7f76a0152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a014f4e0 0x7f76a0152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 -- 172.21.15.52:0/616086057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a01551a0 con 0x7f7688003c80 2024-09-10T08:40:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.104+0000 7f76a4c00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f76a00714c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.105+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694037040 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.105+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7694041070 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.105+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a0155480 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.105+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694001b20 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.105+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a0155a40 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.106+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a0152be0 con 0x7f7688003c80 2024-09-10T08:40:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.107+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76940049e0 con 0x7f7688003c80 2024-09-10T08:40:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.108+0000 7f769cc00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 0x7f768006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.108+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7f76940aa320 con 0x7f7688003c80 2024-09-10T08:40:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.108+0000 7f769fe00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 0x7f768006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.109+0000 7f769fe00640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 0x7f768006e320 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f76a01530b0 tx=0x7f768c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.112+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76a0152be0 con 0x7f7688003c80 2024-09-10T08:40:32.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:32.366+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f76a0073ea0 con 0x7f7688003c80 2024-09-10T08:40:33.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.167+0000 7f769cc00640 1 -- 172.21.15.52:0/616086057 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v558) ==== 162+0+0 (secure 0 0 0) 0x7f769407f130 con 0x7f7688003c80 2024-09-10T08:40:33.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 msgr2=0x7f768006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 0x7f768006e320 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f76a01530b0 tx=0x7f768c009040 comp rx=0 tx=0).stop 2024-09-10T08:40:33.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 msgr2=0x7f76a00c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f7694000c00 tx=0x7f76a00714c0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 shutdown_connections 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f768006be60 0x7f768006e320 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76a01527d0 0x7f76a00c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76a014f4e0 0x7f76a0152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 --2- 172.21.15.52:0/616086057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7688003c80 0x7f76a00c7d40 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 >> 172.21.15.52:0/616086057 conn(0x7f76a00ccec0 msgr2=0x7f76a00cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 shutdown_connections 2024-09-10T08:40:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.170+0000 7f76a7600640 1 -- 172.21.15.52:0/616086057 wait complete. 2024-09-10T08:40:33.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:40:33.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.353+0000 7fcb4de00640 1 Processor -- start 2024-09-10T08:40:33.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.353+0000 7fcb4de00640 1 -- start start 2024-09-10T08:40:33.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.354+0000 7fcb4de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb480732e0 0x7fcb480736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480cce30 0x7fcb480cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb4de00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480714b0 con 0x7fcb48071c70 2024-09-10T08:40:33.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb4de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcb48073c00 con 0x7fcb480732e0 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb4de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480cd880 con 0x7fcb480cce30 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb480732e0 0x7fcb480736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb47400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcb48071c70 0x7fcb4815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38138/0 (socket says 172.21.15.52:38138) 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb47400640 1 -- 172.21.15.52:0/269791010 learned_addr learned my addr 172.21.15.52:0/269791010 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480cce30 0x7fcb480cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46000640 1 -- 172.21.15.52:0/269791010 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477915611 0 0) 0x7fcb480714b0 con 0x7fcb48071c70 2024-09-10T08:40:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46000640 1 -- 172.21.15.52:0/269791010 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb2c003520 con 0x7fcb48071c70 2024-09-10T08:40:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46a00640 1 -- 172.21.15.52:0/269791010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480cce30 msgr2=0x7fcb480cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46a00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480cce30 0x7fcb480cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.355+0000 7fcb46a00640 1 -- 172.21.15.52:0/269791010 >> v1:172.21.15.52:6789/0 conn(0x7fcb48071c70 legacy=0x7fcb4815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.356+0000 7fcb46a00640 1 -- 172.21.15.52:0/269791010 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480cdb60 con 0x7fcb480732e0 2024-09-10T08:40:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb46a00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480732e0 0x7fcb480736c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097a0 tx=0x7fcb3802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb91f862ea5049cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb46000640 1 -- 172.21.15.52:0/269791010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037070 con 0x7fcb480732e0 2024-09-10T08:40:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb46000640 1 -- 172.21.15.52:0/269791010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3802ae50 con 0x7fcb480732e0 2024-09-10T08:40:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb46000640 1 -- 172.21.15.52:0/269791010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38032660 con 0x7fcb480732e0 2024-09-10T08:40:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 -- 172.21.15.52:0/269791010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480732e0 msgr2=0x7fcb480736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480732e0 0x7fcb480736c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097a0 tx=0x7fcb3802a100 comp rx=0 tx=0).stop 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 -- 172.21.15.52:0/269791010 shutdown_connections 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480cce30 0x7fcb480cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 --2- 172.21.15.52:0/269791010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb480732e0 0x7fcb480736c0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.357+0000 7fcb4de00640 1 -- 172.21.15.52:0/269791010 >> 172.21.15.52:0/269791010 conn(0x7fcb4806d0f0 msgr2=0x7fcb4806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.358+0000 7fcb4de00640 1 -- 172.21.15.52:0/269791010 shutdown_connections 2024-09-10T08:40:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.358+0000 7fcb4de00640 1 -- 172.21.15.52:0/269791010 wait complete. 2024-09-10T08:40:33.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.359+0000 7fcb4de00640 1 Processor -- start 2024-09-10T08:40:33.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.359+0000 7fcb4de00640 1 -- start start 2024-09-10T08:40:33.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 0x7fcb480c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480cce30 0x7fcb481f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4806bf70 con 0x7fcb48071c70 2024-09-10T08:40:33.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4806bdf0 con 0x7fcb480cce30 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb4de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcb48072120 con 0x7fcb480732e0 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb46a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb46a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59834/0 (socket says 172.21.15.52:59834) 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.360+0000 7fcb46a00640 1 -- 172.21.15.52:0/554795586 learned_addr learned my addr 172.21.15.52:0/554795586 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 0x7fcb480c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb47400640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480cce30 0x7fcb481f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 -- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 msgr2=0x7fcb480c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 0x7fcb480c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 -- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480cce30 msgr2=0x7fcb481f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480cce30 0x7fcb481f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 -- 172.21.15.52:0/554795586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481527f0 con 0x7fcb48071c70 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 0x7fcb480c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:33.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb46a00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fcb38035040 tx=0x7fcb380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38041070 con 0x7fcb48071c70 2024-09-10T08:40:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3803c460 con 0x7fcb48071c70 2024-09-10T08:40:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037040 con 0x7fcb48071c70 2024-09-10T08:40:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb48155b10 con 0x7fcb48071c70 2024-09-10T08:40:33.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.361+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb48157600 con 0x7fcb48071c70 2024-09-10T08:40:33.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.363+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb480724b0 con 0x7fcb48071c70 2024-09-10T08:40:33.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.364+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcb3803a070 con 0x7fcb48071c70 2024-09-10T08:40:33.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.365+0000 7fcb3f400640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:33.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.365+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7fcb380aae60 con 0x7fcb48071c70 2024-09-10T08:40:33.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.365+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:33.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.366+0000 7fcb3fe00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 0x7fcb2406e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcb481f5c80 tx=0x7fcb30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:33.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.369+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb38079a10 con 0x7fcb48071c70 2024-09-10T08:40:33.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.552+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcb480711f0 con 0x7fcb48071c70 2024-09-10T08:40:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.556+0000 7fcb3f400640 1 -- 172.21.15.52:0/554795586 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fcb38079310 con 0x7fcb48071c70 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 msgr2=0x7fcb2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 0x7fcb2406e2f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcb481f5c80 tx=0x7fcb30008040 comp rx=0 tx=0).stop 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 msgr2=0x7fcb48155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fcb38035040 tx=0x7fcb380046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 shutdown_connections 2024-09-10T08:40:33.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcb2406be30 0x7fcb2406e2f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb480cce30 0x7fcb481f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb480732e0 0x7fcb480c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 --2- 172.21.15.52:0/554795586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb48071c70 0x7fcb48155450 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.558+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 >> 172.21.15.52:0/554795586 conn(0x7fcb4806d0f0 msgr2=0x7fcb4815c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.559+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 shutdown_connections 2024-09-10T08:40:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:33.559+0000 7fcb4de00640 1 -- 172.21.15.52:0/554795586 wait complete. 2024-09-10T08:40:33.575 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:40:33.576 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:40:33.667 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:40:33.754 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:40:33.754 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:33.754 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:33.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:40:33.791 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:40:33.791 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:33.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:40:33.829 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:33.829 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:33.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:40:33.868 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:40:33.868 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:33.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:40:33.905 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:40:33.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.062+0000 7ff0eaa00640 1 Processor -- start 2024-09-10T08:40:34.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.063+0000 7ff0eaa00640 1 -- start start 2024-09-10T08:40:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0eaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0e40b3e00 0x7ff0e415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0eaa00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0e40cf9a0 0x7ff0e415c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0eaa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e40b4370 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0eaa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e40b4650 con 0x7ff0e40b3e00 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0eaa00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e40b4dc0 con 0x7ff0e40cf9a0 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0e8c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff0e40b3e00 0x7ff0e415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0e9600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff0e40cf5c0 0x7ff0e40b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38142/0 (socket says 172.21.15.52:38142) 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0e9600640 1 -- 172.21.15.52:0/2849854730 learned_addr learned my addr 172.21.15.52:0/2849854730 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.064+0000 7ff0ea000640 1 --2- 172.21.15.52:0/2849854730 >> v2:172.21.15.176:3300/0 conn(0x7ff0e40cf9a0 0x7ff0e415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.065+0000 7ff0e8c00640 1 -- 172.21.15.52:0/2849854730 >> v2:172.21.15.176:3300/0 conn(0x7ff0e40cf9a0 msgr2=0x7ff0e415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.065+0000 7ff0e8c00640 1 --2- 172.21.15.52:0/2849854730 >> v2:172.21.15.176:3300/0 conn(0x7ff0e40cf9a0 0x7ff0e415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.065+0000 7ff0e8c00640 1 -- 172.21.15.52:0/2849854730 >> v1:172.21.15.52:6789/0 conn(0x7ff0e40cf5c0 legacy=0x7ff0e40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.065+0000 7ff0e8c00640 1 -- 172.21.15.52:0/2849854730 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e40b50a0 con 0x7ff0e40b3e00 2024-09-10T08:40:34.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.065+0000 7ff0e3e00640 1 -- 172.21.15.52:0/2849854730 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147736555 0 0) 0x7ff0e40b4370 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.066+0000 7ff0e8c00640 1 --2- 172.21.15.52:0/2849854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40b3e00 0x7ff0e415bfe0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40c66a0 tx=0x7ff0d002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f318a7e9e3111322 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.066+0000 7ff0e3e00640 1 -- 172.21.15.52:0/2849854730 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0037070 con 0x7ff0e40b3e00 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.066+0000 7ff0e3e00640 1 -- 172.21.15.52:0/2849854730 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d002add0 con 0x7ff0e40b3e00 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.066+0000 7ff0e3e00640 1 -- 172.21.15.52:0/2849854730 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0032660 con 0x7ff0e40b3e00 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 -- 172.21.15.52:0/2849854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40b3e00 msgr2=0x7ff0e415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/2849854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40b3e00 0x7ff0e415bfe0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40c66a0 tx=0x7ff0d002a080 comp rx=0 tx=0).stop 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 -- 172.21.15.52:0/2849854730 shutdown_connections 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/2849854730 >> v2:172.21.15.176:3300/0 conn(0x7ff0e40cf9a0 0x7ff0e415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/2849854730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40b3e00 0x7ff0e415bfe0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 -- 172.21.15.52:0/2849854730 >> 172.21.15.52:0/2849854730 conn(0x7ff0e406c240 msgr2=0x7ff0e406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 -- 172.21.15.52:0/2849854730 shutdown_connections 2024-09-10T08:40:34.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.067+0000 7ff0eaa00640 1 -- 172.21.15.52:0/2849854730 wait complete. 2024-09-10T08:40:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.068+0000 7ff0eaa00640 1 Processor -- start 2024-09-10T08:40:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.068+0000 7ff0eaa00640 1 -- start start 2024-09-10T08:40:34.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0e40b3e00 0x7ff0e415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 0x7ff0e4160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e415cbe0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e415ca60 con 0x7ff0e40cf9a0 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.069+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e415cd60 con 0x7ff0e40b3e00 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59852/0 (socket says 172.21.15.52:59852) 2024-09-10T08:40:34.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 -- 172.21.15.52:0/4207948654 learned_addr learned my addr 172.21.15.52:0/4207948654 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e9600640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0e40b3e00 0x7ff0e415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0ea000640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 0x7ff0e4160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 -- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0e40b3e00 msgr2=0x7ff0e415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0e40b3e00 0x7ff0e415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 -- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 msgr2=0x7ff0e4160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 0x7ff0e4160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 -- 172.21.15.52:0/4207948654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e415d8d0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0ea000640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 0x7ff0e4160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.070+0000 7ff0e8c00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c00 tx=0x7ff0d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.071+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0037040 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.071+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0042070 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.071+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d003d660 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.071+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e415dbb0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.071+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e415e450 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.072+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e40b36f0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.073+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0d003d800 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.073+0000 7ff0e1600640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 0x7ff0c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.074+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5029+0+0 (secure 0 0 0) 0x7ff0d00ab190 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.074+0000 7ff0e9600640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 0x7ff0c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.075+0000 7ff0e9600640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 0x7ff0c406e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000f60 tx=0x7ff0d8007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.078+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0d0079dd0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.298+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0e40ccb50 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.299+0000 7ff0e1600640 1 -- 172.21.15.52:0/4207948654 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+3090 (secure 0 0 0) 0x7ff0d00796d0 con 0x7ff0e40cf5c0 2024-09-10T08:40:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:34.300 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":125,"btime":"2024-09-10T08:40:28:145026+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/598941770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":598941770},{"type":"v1","addr":"172.21.15.176:6837","nonce":598941770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/3774316291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":3774316291},{"type":"v1","addr":"172.21.15.52:6835","nonce":3774316291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9657,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/2360638103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2360638103},{"type":"v1","addr":"172.21.15.52:6834","nonce":2360638103}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":125}],"filesystems":[]} 2024-09-10T08:40:34.300 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 125 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 msgr2=0x7ff0c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 0x7ff0c406e2f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8000f60 tx=0x7ff0d8007d50 comp rx=0 tx=0).stop 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 msgr2=0x7ff0e41606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c00 tx=0x7ff0d00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 shutdown_connections 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff0c406be30 0x7ff0c406e2f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0e40cf9a0 0x7ff0e4160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0e40cf5c0 0x7ff0e41606d0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 --2- 172.21.15.52:0/4207948654 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff0e40b3e00 0x7ff0e415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 >> 172.21.15.52:0/4207948654 conn(0x7ff0e406c240 msgr2=0x7ff0e4071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:34.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 shutdown_connections 2024-09-10T08:40:34.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.301+0000 7ff0eaa00640 1 -- 172.21.15.52:0/4207948654 wait complete. 2024-09-10T08:40:34.319 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:40:34.319 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:40:34.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:40:34.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:40:34.320 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:40:34.320 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:40:34.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:40:34.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:40:34.320 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:40:34.320 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:40:34.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:40:34.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:40:34.321 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:40:34.321 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:40:34.325 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:40:34.326 DEBUG:teuthology.parallel:result is None 2024-09-10T08:40:34.336 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:40:34.336 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:40:34.338 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:40:34.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:40:34.338 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:40:34.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:40:34.382 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:40:34.383 DEBUG:teuthology.parallel:result is None 2024-09-10T08:40:34.383 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:40:34.383 DEBUG:teuthology.parallel:result is None 2024-09-10T08:40:34.385 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:40:34.386 DEBUG:teuthology.parallel:result is None 2024-09-10T08:40:34.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:40:34.457 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:40:34.510 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:40:34.516 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:40:34.518 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:40:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.551+0000 7f18d3800640 1 Processor -- start 2024-09-10T08:40:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.551+0000 7f18d3800640 1 -- start start 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.552+0000 7f18d3800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.552+0000 7f18d3800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18cc0b5f90 0x7f18cc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.552+0000 7f18d3800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18cc0b4020 con 0x7f18cc073180 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.552+0000 7f18d3800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f18cc073b00 con 0x7f18cc0b5f90 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.552+0000 7f18d3800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc0b42c0 con 0x7f18cc145ed0 2024-09-10T08:40:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18cbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f18cc073180 0x7f18cc0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32878/0 (socket says 172.21.15.52:32878) 2024-09-10T08:40:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18cbe00640 1 -- 172.21.15.52:0/4186178141 learned_addr learned my addr 172.21.15.52:0/4186178141 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d1800640 1 --2- 172.21.15.52:0/4186178141 >> v2:172.21.15.52:3300/0 conn(0x7f18cc0b5f90 0x7f18cc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4186178141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18cb400640 1 -- 172.21.15.52:0/4186178141 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081556815 0 0) 0x7f18cc0b4020 con 0x7f18cc073180 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18cb400640 1 -- 172.21.15.52:0/4186178141 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18b4003520 con 0x7f18cc073180 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d0e00640 1 -- 172.21.15.52:0/4186178141 >> v2:172.21.15.52:3300/0 conn(0x7f18cc0b5f90 msgr2=0x7f18cc0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4186178141 >> v2:172.21.15.52:3300/0 conn(0x7f18cc0b5f90 0x7f18cc0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d0e00640 1 -- 172.21.15.52:0/4186178141 >> v1:172.21.15.52:6789/0 conn(0x7f18cc073180 legacy=0x7f18cc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.553+0000 7f18d0e00640 1 -- 172.21.15.52:0/4186178141 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc0b45a0 con 0x7f18cc145ed0 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.554+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4186178141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc0b5080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18c00097a0 tx=0x7f18c002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efde7496abfa7f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18cb400640 1 -- 172.21.15.52:0/4186178141 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0037070 con 0x7f18cc145ed0 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18cb400640 1 -- 172.21.15.52:0/4186178141 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c0032440 con 0x7f18cc145ed0 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18cb400640 1 -- 172.21.15.52:0/4186178141 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0032810 con 0x7f18cc145ed0 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 -- 172.21.15.52:0/4186178141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 msgr2=0x7f18cc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 --2- 172.21.15.52:0/4186178141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc0b5080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18c00097a0 tx=0x7f18c002a180 comp rx=0 tx=0).stop 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 -- 172.21.15.52:0/4186178141 shutdown_connections 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 --2- 172.21.15.52:0/4186178141 >> v2:172.21.15.52:3300/0 conn(0x7f18cc0b5f90 0x7f18cc0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 --2- 172.21.15.52:0/4186178141 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc0b5080 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 -- 172.21.15.52:0/4186178141 >> 172.21.15.52:0/4186178141 conn(0x7f18cc0ccec0 msgr2=0x7f18cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 -- 172.21.15.52:0/4186178141 shutdown_connections 2024-09-10T08:40:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.555+0000 7f18d3800640 1 -- 172.21.15.52:0/4186178141 wait complete. 2024-09-10T08:40:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.557+0000 7f18d3800640 1 Processor -- start 2024-09-10T08:40:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.557+0000 7f18d3800640 1 -- start start 2024-09-10T08:40:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 0x7f18cc1f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc1462b0 con 0x7f18cc073180 2024-09-10T08:40:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc0b4b60 con 0x7f18cc0b5f90 2024-09-10T08:40:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.558+0000 7f18d3800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc146430 con 0x7f18cc145ed0 2024-09-10T08:40:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18cbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 0x7f18cc1f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41958/0 (socket says 172.21.15.52:41958) 2024-09-10T08:40:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 -- 172.21.15.52:0/4094016689 learned_addr learned my addr 172.21.15.52:0/4094016689 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18cbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 0x7f18cc1f1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:51626/0 (socket says 172.21.15.52:51626) 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d1800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 -- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 msgr2=0x7f18cc158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 -- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 msgr2=0x7f18cc1f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:34.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 0x7f18cc1f1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.559+0000 7f18d0e00640 1 -- 172.21.15.52:0/4094016689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc1f40d0 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18d0e00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0041020 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc1f43b0 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c003d640 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0037040 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.560+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1f4970 con 0x7f18cc073180 2024-09-10T08:40:34.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.561+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc0735c0 con 0x7f18cc073180 2024-09-10T08:40:34.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.565+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18c0044020 con 0x7f18cc073180 2024-09-10T08:40:34.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.565+0000 7f18c8c00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 0x7f18ac06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:34.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.565+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5029+0+0 (secure 0 0 0) 0x7f18c003d7f0 con 0x7f18cc073180 2024-09-10T08:40:34.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.566+0000 7f18cbe00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 0x7f18ac06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:34.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.566+0000 7f18cbe00640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 0x7f18ac06e4f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0b64d0 tx=0x7f18b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.568+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18c004b030 con 0x7f18cc073180 2024-09-10T08:40:34.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:34.764+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f18cc1f7290 con 0x7f18cc073180 2024-09-10T08:40:35.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.571+0000 7f18c8c00640 1 -- 172.21.15.52:0/4094016689 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v167) ==== 97+0+0 (secure 0 0 0) 0x7f18c0079a40 con 0x7f18cc073180 2024-09-10T08:40:35.571 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:40:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 msgr2=0x7f18ac06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 0x7f18ac06e4f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0b64d0 tx=0x7f18b8009040 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 msgr2=0x7f18cc156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 shutdown_connections 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18ac06c030 0x7f18ac06e4f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f18cc145ed0 0x7f18cc158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18cc0b5f90 0x7f18cc1f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 --2- 172.21.15.52:0/4094016689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc073180 0x7f18cc156c20 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 >> 172.21.15.52:0/4094016689 conn(0x7f18cc0ccec0 msgr2=0x7f18cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 shutdown_connections 2024-09-10T08:40:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.574+0000 7f18d3800640 1 -- 172.21.15.52:0/4094016689 wait complete. 2024-09-10T08:40:35.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:40:35.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.754+0000 7fb265000640 1 Processor -- start 2024-09-10T08:40:35.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.754+0000 7fb265000640 1 -- start start 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb2600b2d40 0x7fb26006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb26006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb26015bcf0 0x7fb26015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb260071ab0 con 0x7fb26015bcf0 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb260071180 con 0x7fb2600b2d40 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb265000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb260071460 con 0x7fb26013eb20 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb26015bcf0 0x7fb26015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb26015bcf0 0x7fb26015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41972/0 (socket says 172.21.15.52:41972) 2024-09-10T08:40:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 -- 172.21.15.52:0/3116049613 learned_addr learned my addr 172.21.15.52:0/3116049613 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25de00640 1 --2- 172.21.15.52:0/3116049613 >> v2:172.21.15.176:3300/0 conn(0x7fb2600b2d40 0x7fb26006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb257e00640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb26006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 -- 172.21.15.52:0/3116049613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 msgr2=0x7fb26006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb26006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 -- 172.21.15.52:0/3116049613 >> v2:172.21.15.176:3300/0 conn(0x7fb2600b2d40 msgr2=0x7fb26006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 --2- 172.21.15.52:0/3116049613 >> v2:172.21.15.176:3300/0 conn(0x7fb2600b2d40 0x7fb26006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.756+0000 7fb25e800640 1 -- 172.21.15.52:0/3116049613 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb260071740 con 0x7fb26015bcf0 2024-09-10T08:40:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.757+0000 7fb25e800640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26015bcf0 0x7fb26015c1a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fb260069be0 tx=0x7fb25802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146a1e89b44dc87c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb25d400640 1 -- 172.21.15.52:0/3116049613 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258036070 con 0x7fb26015bcf0 2024-09-10T08:40:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb25d400640 1 -- 172.21.15.52:0/3116049613 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258031600 con 0x7fb26015bcf0 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb25d400640 1 -- 172.21.15.52:0/3116049613 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580319d0 con 0x7fb26015bcf0 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 -- 172.21.15.52:0/3116049613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26015bcf0 msgr2=0x7fb26015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26015bcf0 0x7fb26015c1a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fb260069be0 tx=0x7fb25802a6a0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 -- 172.21.15.52:0/3116049613 shutdown_connections 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb26015bcf0 0x7fb26015c1a0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 --2- 172.21.15.52:0/3116049613 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb26006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 --2- 172.21.15.52:0/3116049613 >> v2:172.21.15.176:3300/0 conn(0x7fb2600b2d40 0x7fb26006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 -- 172.21.15.52:0/3116049613 >> 172.21.15.52:0/3116049613 conn(0x7fb2600ccec0 msgr2=0x7fb2600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 -- 172.21.15.52:0/3116049613 shutdown_connections 2024-09-10T08:40:35.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.758+0000 7fb265000640 1 -- 172.21.15.52:0/3116049613 wait complete. 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.760+0000 7fb265000640 1 Processor -- start 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.760+0000 7fb265000640 1 -- start start 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb260155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26015bcf0 0x7fb260071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb26015f140 con 0x7fb2600b2d40 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb26015efc0 con 0x7fb26015bcf0 2024-09-10T08:40:35.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb265000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb26015f2c0 con 0x7fb26013eb20 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb25de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb25de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41984/0 (socket says 172.21.15.52:41984) 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb25de00640 1 -- 172.21.15.52:0/3306604337 learned_addr learned my addr 172.21.15.52:0/3306604337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb25e800640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26015bcf0 0x7fb260071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.761+0000 7fb257e00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb260155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 -- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 msgr2=0x7fb260155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb260155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 -- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26015bcf0 msgr2=0x7fb260071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26015bcf0 0x7fb260071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 -- 172.21.15.52:0/3306604337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26013e220 con 0x7fb2600b2d40 2024-09-10T08:40:35.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb25de00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fb25000d830 tx=0x7fb25000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:35.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250018020 con 0x7fb2600b2d40 2024-09-10T08:40:35.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2500096a0 con 0x7fb2600b2d40 2024-09-10T08:40:35.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250009a70 con 0x7fb2600b2d40 2024-09-10T08:40:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.762+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2601566a0 con 0x7fb2600b2d40 2024-09-10T08:40:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.763+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb260156c60 con 0x7fb2600b2d40 2024-09-10T08:40:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.763+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26015c1a0 con 0x7fb2600b2d40 2024-09-10T08:40:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.764+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb25001b020 con 0x7fb2600b2d40 2024-09-10T08:40:35.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.765+0000 7fb256000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 0x7fb23c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.765+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7fb25008b130 con 0x7fb2600b2d40 2024-09-10T08:40:35.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.766+0000 7fb257e00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 0x7fb23c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:35.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.767+0000 7fb257e00640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 0x7fb23c06e2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb2601f38a0 tx=0x7fb248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:35.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:35.770+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb250022020 con 0x7fb2600b2d40 2024-09-10T08:40:36.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.020+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb26006c9c0 con 0x7fb2600b2d40 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.020+0000 7fb256000640 1 -- 172.21.15.52:0/3306604337 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7fb250009e20 con 0x7fb2600b2d40 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:40:36.021 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:40:36.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.024 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.026 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:40:36.027 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.029 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:40:36.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:40:36.032 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:40:36.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:40:36.034 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:40:36.035 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 msgr2=0x7fb23c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 0x7fb23c06e2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb2601f38a0 tx=0x7fb248008040 comp rx=0 tx=0).stop 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 msgr2=0x7fb26013dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fb25000d830 tx=0x7fb25000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 shutdown_connections 2024-09-10T08:40:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb23c06be30 0x7fb23c06e2f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb26015bcf0 0x7fb260071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb26013eb20 0x7fb260155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 --2- 172.21.15.52:0/3306604337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2600b2d40 0x7fb26013dce0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 >> 172.21.15.52:0/3306604337 conn(0x7fb2600ccec0 msgr2=0x7fb260140a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 shutdown_connections 2024-09-10T08:40:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.023+0000 7fb265000640 1 -- 172.21.15.52:0/3306604337 wait complete. 2024-09-10T08:40:36.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:40:36.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.196+0000 7f1808800640 1 Processor -- start 2024-09-10T08:40:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.196+0000 7f1808800640 1 -- start start 2024-09-10T08:40:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1808800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f18000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1808800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f18000b90e0 0x7f18000b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1808800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18000d0e70 con 0x7f18000d23b0 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1808800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f18000d41c0 con 0x7f18000b90e0 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1808800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f18000d35b0 con 0x7f180015ed20 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1805400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f18000d23b0 0x7f18000cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32880/0 (socket says 172.21.15.52:32880) 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1805400640 1 -- 172.21.15.52:0/2255084053 learned_addr learned my addr 172.21.15.52:0/2255084053 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:36.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.197+0000 7f1806800640 1 --2- 172.21.15.52:0/2255084053 >> v2:172.21.15.52:3300/0 conn(0x7f18000b90e0 0x7f18000b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1805e00640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f18000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1804a00640 1 -- 172.21.15.52:0/2255084053 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660760741 0 0) 0x7f17f0001110 con 0x7f18000d23b0 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1804a00640 1 -- 172.21.15.52:0/2255084053 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e8003520 con 0x7f18000d23b0 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1806800640 1 -- 172.21.15.52:0/2255084053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 msgr2=0x7f18000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1806800640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f18000b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1806800640 1 -- 172.21.15.52:0/2255084053 >> v1:172.21.15.52:6789/0 conn(0x7f18000d23b0 legacy=0x7f18000cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.198+0000 7f1806800640 1 -- 172.21.15.52:0/2255084053 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18000d3890 con 0x7f18000b90e0 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.199+0000 7f1806800640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000b90e0 0x7f18000b67a0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009d90 tx=0x7f17fc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad9258920fbfc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.199+0000 7f1804a00640 1 -- 172.21.15.52:0/2255084053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc007740 con 0x7f18000b90e0 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.199+0000 7f1804a00640 1 -- 172.21.15.52:0/2255084053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc0078e0 con 0x7f18000b90e0 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.199+0000 7f1804a00640 1 -- 172.21.15.52:0/2255084053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc007cb0 con 0x7f18000b90e0 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 -- 172.21.15.52:0/2255084053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000b90e0 msgr2=0x7f18000b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000b90e0 0x7f18000b67a0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009d90 tx=0x7f17fc02a660 comp rx=0 tx=0).stop 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 -- 172.21.15.52:0/2255084053 shutdown_connections 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000b90e0 0x7f18000b67a0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 --2- 172.21.15.52:0/2255084053 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f18000b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 -- 172.21.15.52:0/2255084053 >> 172.21.15.52:0/2255084053 conn(0x7f18000d1260 msgr2=0x7f18000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 -- 172.21.15.52:0/2255084053 shutdown_connections 2024-09-10T08:40:36.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.200+0000 7f1808800640 1 -- 172.21.15.52:0/2255084053 wait complete. 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.201+0000 7f1808800640 1 Processor -- start 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 -- start start 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18000b90e0 0x7f18000cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f180015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18000d32a0 con 0x7f18000d23b0 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f18000d3e50 con 0x7f18000b90e0 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.202+0000 7f1808800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f180015f100 con 0x7f180015ed20 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41998/0 (socket says 172.21.15.52:41998) 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 -- 172.21.15.52:0/1267673508 learned_addr learned my addr 172.21.15.52:0/1267673508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805e00640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18000b90e0 0x7f18000cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1806800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f180015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 -- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 msgr2=0x7f180015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f180015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 -- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18000b90e0 msgr2=0x7f18000cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18000b90e0 0x7f18000cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.203+0000 7f1805400640 1 -- 172.21.15.52:0/1267673508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18000ccd10 con 0x7f18000d23b0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f1805400640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c760 tx=0x7f17f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0017070 con 0x7f18000d23b0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0005ab0 con 0x7f18000d23b0 2024-09-10T08:40:36.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f000ce10 con 0x7f18000d23b0 2024-09-10T08:40:36.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18000ccff0 con 0x7f18000d23b0 2024-09-10T08:40:36.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.204+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18000cd5b0 con 0x7f18000d23b0 2024-09-10T08:40:36.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.205+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18000b7010 con 0x7f18000d23b0 2024-09-10T08:40:36.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.206+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17f001a070 con 0x7f18000d23b0 2024-09-10T08:40:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.207+0000 7f17fa000640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.207+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7f17f0089e00 con 0x7f18000d23b0 2024-09-10T08:40:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.207+0000 7f1805e00640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.208+0000 7f1805e00640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 0x7f17e406e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009b40 tx=0x7f17f4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.211+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18000d0e70 con 0x7f18000d23b0 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.396+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f18000b3f20 con 0x7f18000d23b0 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.396+0000 7f17fa000640 1 -- 172.21.15.52:0/1267673508 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v167) ==== 84+0+65 (secure 0 0 0) 0x7f17f00584a0 con 0x7f18000d23b0 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:40:36.397 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:40:36.398 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:40:36.398 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:40:36.398 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:40:36.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 msgr2=0x7f17e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 0x7f17e406e2f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009b40 tx=0x7f17f4009190 comp rx=0 tx=0).stop 2024-09-10T08:40:36.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 msgr2=0x7f180015d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c760 tx=0x7f17f000cc20 comp rx=0 tx=0).stop 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 shutdown_connections 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f17e406be30 0x7f17e406e2f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f180015ed20 0x7f180015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18000d23b0 0x7f180015d8f0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 --2- 172.21.15.52:0/1267673508 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f18000b90e0 0x7f18000cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 >> 172.21.15.52:0/1267673508 conn(0x7f18000d1260 msgr2=0x7f18001e92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 shutdown_connections 2024-09-10T08:40:36.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.399+0000 7f1808800640 1 -- 172.21.15.52:0/1267673508 wait complete. 2024-09-10T08:40:36.415 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:40:36.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:40:36.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.576+0000 7f5af3200640 1 Processor -- start 2024-09-10T08:40:36.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.576+0000 7f5af3200640 1 -- start start 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af3200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5aec0b6000 0x7f5aec0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af3200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5aec0b2dc0 0x7f5aec0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af3200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec146220 con 0x7f5aec1454b0 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af3200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec0b1920 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af3200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec0cf640 con 0x7f5aec0b6000 2024-09-10T08:40:36.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5aebe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5aec1454b0 0x7f5aec0b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32890/0 (socket says 172.21.15.52:32890) 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5aebe00640 1 -- 172.21.15.52:0/3369686008 learned_addr learned my addr 172.21.15.52:0/3369686008 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.577+0000 7f5af1200640 1 --2- 172.21.15.52:0/3369686008 >> v2:172.21.15.52:3300/0 conn(0x7f5aec0b2dc0 0x7f5aec0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5aeb400640 1 --2- 172.21.15.52:0/3369686008 >> v2:172.21.15.176:3300/0 conn(0x7f5aec0b6000 0x7f5aec0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5aeaa00640 1 -- 172.21.15.52:0/3369686008 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851450495 0 0) 0x7f5adc001110 con 0x7f5aec1454b0 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5aeaa00640 1 -- 172.21.15.52:0/3369686008 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ad0003520 con 0x7f5aec1454b0 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5af1200640 1 -- 172.21.15.52:0/3369686008 >> v2:172.21.15.176:3300/0 conn(0x7f5aec0b6000 msgr2=0x7f5aec0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5af1200640 1 --2- 172.21.15.52:0/3369686008 >> v2:172.21.15.176:3300/0 conn(0x7f5aec0b6000 0x7f5aec0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5af1200640 1 -- 172.21.15.52:0/3369686008 >> v1:172.21.15.52:6789/0 conn(0x7f5aec1454b0 legacy=0x7f5aec0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.578+0000 7f5af1200640 1 -- 172.21.15.52:0/3369686008 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0cf8e0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.579+0000 7f5af1200640 1 --2- 172.21.15.52:0/3369686008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec0b0380 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0b6490 tx=0x7f5ae402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6b9068ec00dc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.579+0000 7f5aeaa00640 1 -- 172.21.15.52:0/3369686008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007740 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.579+0000 7f5aeaa00640 1 -- 172.21.15.52:0/3369686008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae40078e0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.579+0000 7f5aeaa00640 1 -- 172.21.15.52:0/3369686008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007cb0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 -- 172.21.15.52:0/3369686008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 msgr2=0x7f5aec0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 --2- 172.21.15.52:0/3369686008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec0b0380 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0b6490 tx=0x7f5ae402a710 comp rx=0 tx=0).stop 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 -- 172.21.15.52:0/3369686008 shutdown_connections 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 --2- 172.21.15.52:0/3369686008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec0b0380 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 --2- 172.21.15.52:0/3369686008 >> v2:172.21.15.176:3300/0 conn(0x7f5aec0b6000 0x7f5aec0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 -- 172.21.15.52:0/3369686008 >> 172.21.15.52:0/3369686008 conn(0x7f5aec06c240 msgr2=0x7f5aec06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 -- 172.21.15.52:0/3369686008 shutdown_connections 2024-09-10T08:40:36.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.580+0000 7f5af3200640 1 -- 172.21.15.52:0/3369686008 wait complete. 2024-09-10T08:40:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.581+0000 7f5af3200640 1 Processor -- start 2024-09-10T08:40:36.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.582+0000 7f5af3200640 1 -- start start 2024-09-10T08:40:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.582+0000 7f5af3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec0b6000 0x7f5aec1e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 0x7f5aec0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0d0180 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec0cfea0 con 0x7f5aec1454b0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec1459a0 con 0x7f5aec0b6000 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42028/0 (socket says 172.21.15.52:42028) 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 -- 172.21.15.52:0/1462973588 learned_addr learned my addr 172.21.15.52:0/1462973588 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aeb400640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec0b6000 0x7f5aec1e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af1200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 0x7f5aec0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 -- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec0b6000 msgr2=0x7f5aec1e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec0b6000 0x7f5aec1e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 -- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 msgr2=0x7f5aec0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 0x7f5aec0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5aebe00640 1 -- 172.21.15.52:0/1462973588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec1e59d0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.583+0000 7f5af1200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 0x7f5aec0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5aebe00640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c3d0 tx=0x7f5adc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc017070 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc005ce0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc007310 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec1e5cb0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.584+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec1e6270 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.585+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aec0b58f0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.586+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5adc01a070 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.587+0000 7f5ae3e00640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 0x7f5acc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.587+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 4857+0+0 (secure 0 0 0) 0x7f5adc089ff0 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.587+0000 7f5aeb400640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 0x7f5acc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:36.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.588+0000 7f5aeb400640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 0x7f5acc06e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0b54d0 tx=0x7f5ad8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:36.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.591+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aec146220 con 0x7f5aec0b2dc0 2024-09-10T08:40:36.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:36.776+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5aec143fa0 con 0x7f5aec0b2dc0 2024-09-10T08:40:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.575+0000 7f5ae3e00640 1 -- 172.21.15.52:0/1462973588 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v168) ==== 138+0+0 (secure 0 0 0) 0x7f5adc058c70 con 0x7f5aec0b2dc0 2024-09-10T08:40:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:40:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 msgr2=0x7f5acc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 0x7f5acc06e2f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0b54d0 tx=0x7f5ad8008040 comp rx=0 tx=0).stop 2024-09-10T08:40:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 msgr2=0x7f5aec1e7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c3d0 tx=0x7f5adc00c890 comp rx=0 tx=0).stop 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 shutdown_connections 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5acc06be30 0x7f5acc06e2f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5aec1454b0 0x7f5aec0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5aec0b6000 0x7f5aec1e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 --2- 172.21.15.52:0/1462973588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec0b2dc0 0x7f5aec1e7f90 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 >> 172.21.15.52:0/1462973588 conn(0x7f5aec06c240 msgr2=0x7f5aec0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:37.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 shutdown_connections 2024-09-10T08:40:37.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.579+0000 7f5af3200640 1 -- 172.21.15.52:0/1462973588 wait complete. 2024-09-10T08:40:37.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.771+0000 7f6960600640 1 Processor -- start 2024-09-10T08:40:37.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.771+0000 7f6960600640 1 -- start start 2024-09-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f6960600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958155950 0x7f6958073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f6960600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f69580afb20 0x7f69580affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f6960600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6958073cc0 con 0x7f6958162c80 2024-09-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f6960600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6958070370 con 0x7f69580afb20 2024-09-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f6960600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6958071aa0 con 0x7f6958155950 2024-09-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f695d200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6958162c80 0x7f695806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32906/0 (socket says 172.21.15.52:32906) 2024-09-10T08:40:37.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.772+0000 7f695d200640 1 -- 172.21.15.52:0/1352502951 learned_addr learned my addr 172.21.15.52:0/1352502951 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f695dc00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958155950 0x7f6958073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173456182 0 0) 0x7f6958073cc0 con 0x7f6958162c80 2024-09-10T08:40:37.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f695e600640 1 --2- 172.21.15.52:0/1352502951 >> v2:172.21.15.176:3300/0 conn(0x7f69580afb20 0x7f69580affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6940003520 con 0x7f6958162c80 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716923414 0 0) 0x7f6940003520 con 0x7f6958162c80 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958155950 msgr2=0x7f6958073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958155950 0x7f6958073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 >> v2:172.21.15.176:3300/0 conn(0x7f69580afb20 msgr2=0x7f69580affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 --2- 172.21.15.52:0/1352502951 >> v2:172.21.15.176:3300/0 conn(0x7f69580afb20 0x7f69580affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6958071d80 con 0x7f6958162c80 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f6944001670 con 0x7f6958162c80 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 >> v1:172.21.15.52:6789/0 conn(0x7f6958162c80 legacy=0x7f695806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69400039b0 0x7f6940003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f6940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69400051c0 0x7f694000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6958070370 con 0x7f6940004800 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6958071aa0 con 0x7f69400039b0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69400045a0 con 0x7f69400051c0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f695d200640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f6940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.773+0000 7f695dc00640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69400039b0 0x7f6940003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695e600640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69400051c0 0x7f694000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695d200640 1 -- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69400051c0 msgr2=0x7f694000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695d200640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69400051c0 0x7f694000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695d200640 1 -- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69400039b0 msgr2=0x7f6940003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695d200640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69400039b0 0x7f6940003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.774+0000 7f695d200640 1 -- 172.21.15.52:0/1352502951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6940003520 con 0x7f6940004800 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.775+0000 7f695d200640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f6940004c80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f694400c240 tx=0x7f6940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bd32b5e1a57f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:37.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.775+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944007d30 con 0x7f6940004800 2024-09-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.775+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69440058d0 con 0x7f6940004800 2024-09-10T08:40:37.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.775+0000 7f6957e00640 1 -- 172.21.15.52:0/1352502951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944005ce0 con 0x7f6940004800 2024-09-10T08:40:37.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 -- 172.21.15.52:0/1352502951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 msgr2=0x7f6940004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 --2- 172.21.15.52:0/1352502951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f6940004c80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f694400c240 tx=0x7f6940005830 comp rx=0 tx=0).stop 2024-09-10T08:40:37.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f695e600640 1 -- 172.21.15.52:0/1352502951 reap_dead start 2024-09-10T08:40:37.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 -- 172.21.15.52:0/1352502951 shutdown_connections 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 -- 172.21.15.52:0/1352502951 >> 172.21.15.52:0/1352502951 conn(0x7f695806db30 msgr2=0x7f695806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 -- 172.21.15.52:0/1352502951 shutdown_connections 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.776+0000 7f6960600640 1 -- 172.21.15.52:0/1352502951 wait complete. 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.777+0000 7f6960600640 1 Processor -- start 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 -- start start 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 0x7f69580ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580cec90 0x7f69580cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6958072060 con 0x7f6940004800 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69581630e0 con 0x7f69580cec90 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.778+0000 7f6960600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69580721e0 con 0x7f69581508a0 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42042/0 (socket says 172.21.15.52:42042) 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 -- 172.21.15.52:0/3326189305 learned_addr learned my addr 172.21.15.52:0/3326189305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695d200640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 0x7f69580ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695e600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580cec90 0x7f69580cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 -- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 msgr2=0x7f69580ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 0x7f69580ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 -- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580cec90 msgr2=0x7f69580cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580cec90 0x7f69580cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 -- 172.21.15.52:0/3326189305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69580b0640 con 0x7f6940004800 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695d200640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 0x7f69580ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.779+0000 7f695dc00640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f694c0118e0 tx=0x7f694c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.780+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00faf0 con 0x7f6940004800 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.780+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00fc90 con 0x7f6940004800 2024-09-10T08:40:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.780+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69580b0920 con 0x7f6940004800 2024-09-10T08:40:37.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.780+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c014440 con 0x7f6940004800 2024-09-10T08:40:37.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.780+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69580cf1b0 con 0x7f6940004800 2024-09-10T08:40:37.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.781+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6958155950 con 0x7f6940004800 2024-09-10T08:40:37.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.782+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f694c012040 con 0x7f6940004800 2024-09-10T08:40:37.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.783+0000 7f6955600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 0x7f693806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:37.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.783+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5227+0+0 (secure 0 0 0) 0x7f694c08b370 con 0x7f6940004800 2024-09-10T08:40:37.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.783+0000 7f695d200640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 0x7f693806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:37.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.784+0000 7f695d200640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 0x7f693806e320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f694400c240 tx=0x7f6944009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:37.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.788+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f694c019030 con 0x7f6940004800 2024-09-10T08:40:37.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:37.903 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:40:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:37.972+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f69580b6360 con 0x7f6940004800 2024-09-10T08:40:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.583+0000 7f6955600640 1 -- 172.21.15.52:0/3326189305 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v169) ==== 170+0+0 (secure 0 0 0) 0x7f694c059810 con 0x7f6940004800 2024-09-10T08:40:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:40:38.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 msgr2=0x7f693806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 0x7f693806e320 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f694400c240 tx=0x7f6944009030 comp rx=0 tx=0).stop 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 msgr2=0x7f695814eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f694c0118e0 tx=0x7f694c011da0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 shutdown_connections 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f693806be60 0x7f693806e320 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f69580cec90 0x7f69580cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69581508a0 0x7f69580ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 --2- 172.21.15.52:0/3326189305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6940004800 0x7f695814eac0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.586+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 >> 172.21.15.52:0/3326189305 conn(0x7f695806db30 msgr2=0x7f695806ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:38.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.587+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 shutdown_connections 2024-09-10T08:40:38.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.588+0000 7f6960600640 1 -- 172.21.15.52:0/3326189305 wait complete. 2024-09-10T08:40:38.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:40:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.778+0000 7f3b1ca00640 1 Processor -- start 2024-09-10T08:40:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.778+0000 7f3b1ca00640 1 -- start start 2024-09-10T08:40:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b1ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b1ca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 0x7f3b18071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b1ca00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b180cf2e0 con 0x7f3b1815b7c0 2024-09-10T08:40:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b1ca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3b18070fe0 con 0x7f3b180cead0 2024-09-10T08:40:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b1ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b180712c0 con 0x7f3b180ccf30 2024-09-10T08:40:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b15e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b15e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:48454/0 (socket says 172.21.15.52:48454) 2024-09-10T08:40:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b15e00640 1 -- 172.21.15.52:0/590943267 learned_addr learned my addr 172.21.15.52:0/590943267 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.780+0000 7f3b16800640 1 --2- 172.21.15.52:0/590943267 >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 0x7f3b18071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.781+0000 7f3b15e00640 1 -- 172.21.15.52:0/590943267 >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 msgr2=0x7f3b18071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.781+0000 7f3b15e00640 1 --2- 172.21.15.52:0/590943267 >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 0x7f3b18071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.781+0000 7f3b15e00640 1 -- 172.21.15.52:0/590943267 >> v1:172.21.15.176:6789/0 conn(0x7f3b1815b7c0 legacy=0x7f3b180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.781+0000 7f3b15e00640 1 -- 172.21.15.52:0/590943267 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b180715a0 con 0x7f3b180ccf30 2024-09-10T08:40:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.781+0000 7f3b16800640 1 --2- 172.21.15.52:0/590943267 >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 0x7f3b18071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.782+0000 7f3b15e00640 1 --2- 172.21.15.52:0/590943267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009870 tx=0x7f3b0802a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12133b1a90cdf95a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.782+0000 7f3b15400640 1 -- 172.21.15.52:0/590943267 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08037070 con 0x7f3b180ccf30 2024-09-10T08:40:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.782+0000 7f3b15400640 1 -- 172.21.15.52:0/590943267 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08032440 con 0x7f3b180ccf30 2024-09-10T08:40:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.782+0000 7f3b15400640 1 -- 172.21.15.52:0/590943267 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08032810 con 0x7f3b180ccf30 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 -- 172.21.15.52:0/590943267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 msgr2=0x7f3b180b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/590943267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009870 tx=0x7f3b0802a1d0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 -- 172.21.15.52:0/590943267 shutdown_connections 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/590943267 >> v2:172.21.15.176:3300/0 conn(0x7f3b180cead0 0x7f3b18071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/590943267 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b180ccf30 0x7f3b180b2c50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 -- 172.21.15.52:0/590943267 >> 172.21.15.52:0/590943267 conn(0x7f3b1806d0f0 msgr2=0x7f3b1806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 -- 172.21.15.52:0/590943267 shutdown_connections 2024-09-10T08:40:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.783+0000 7f3b1ca00640 1 -- 172.21.15.52:0/590943267 wait complete. 2024-09-10T08:40:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.785+0000 7f3b1ca00640 1 Processor -- start 2024-09-10T08:40:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.785+0000 7f3b1ca00640 1 -- start start 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b180cead0 0x7f3b180c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1815b7c0 0x7f3b18164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b18072000 con 0x7f3b180ccf30 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3b180cef60 con 0x7f3b180cead0 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b1ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3b18072180 con 0x7f3b1815b7c0 2024-09-10T08:40:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42044/0 (socket says 172.21.15.52:42044) 2024-09-10T08:40:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 -- 172.21.15.52:0/4042624957 learned_addr learned my addr 172.21.15.52:0/4042624957 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b16800640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1815b7c0 0x7f3b18164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b0fe00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b180cead0 0x7f3b180c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 -- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1815b7c0 msgr2=0x7f3b18164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1815b7c0 0x7f3b18164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 -- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b180cead0 msgr2=0x7f3b180c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b180cead0 0x7f3b180c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.786+0000 7f3b15e00640 1 -- 172.21.15.52:0/4042624957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b180c6720 con 0x7f3b180ccf30 2024-09-10T08:40:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b15e00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f3b08000c00 tx=0x7f3b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08037040 con 0x7f3b180ccf30 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08042070 con 0x7f3b180ccf30 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08030880 con 0x7f3b180ccf30 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b180c6a00 con 0x7f3b180ccf30 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.787+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b180c6fc0 con 0x7f3b180ccf30 2024-09-10T08:40:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.788+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b180b2c50 con 0x7f3b180ccf30 2024-09-10T08:40:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.790+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b08030a20 con 0x7f3b180ccf30 2024-09-10T08:40:38.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.791+0000 7f3b0e000640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 0x7f3af406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:38.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.791+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5609+0+0 (secure 0 0 0) 0x7f3b080ab690 con 0x7f3b180ccf30 2024-09-10T08:40:38.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.791+0000 7f3b0fe00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 0x7f3af406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:38.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.792+0000 7f3b0fe00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 0x7f3af406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3b00007fd0 tx=0x7f3b00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:38.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:38.795+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b0807a000 con 0x7f3b180ccf30 2024-09-10T08:40:39.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.016+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3b180d0290 con 0x7f3b180ccf30 2024-09-10T08:40:39.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.591+0000 7f3b0e000640 1 -- 172.21.15.52:0/4042624957 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v127) ==== 174+0+0 (secure 0 0 0) 0x7f3b08079900 con 0x7f3b180ccf30 2024-09-10T08:40:39.593 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 24 and data pool 25 2024-09-10T08:40:39.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.598+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 msgr2=0x7f3af406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.598+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 0x7f3af406e2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3b00007fd0 tx=0x7f3b00009040 comp rx=0 tx=0).stop 2024-09-10T08:40:39.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.598+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 msgr2=0x7f3b180cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.598+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f3b08000c00 tx=0x7f3b080046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 shutdown_connections 2024-09-10T08:40:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3af406be30 0x7f3af406e2f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3b1815b7c0 0x7f3b18164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3b180cead0 0x7f3b180c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 --2- 172.21.15.52:0/4042624957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b180ccf30 0x7f3b180cc380 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.600+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 >> 172.21.15.52:0/4042624957 conn(0x7f3b1806d0f0 msgr2=0x7f3b18151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:39.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.602+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 shutdown_connections 2024-09-10T08:40:39.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.602+0000 7f3b1ca00640 1 -- 172.21.15.52:0/4042624957 wait complete. 2024-09-10T08:40:39.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:39.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.789+0000 7ff936600640 1 Processor -- start 2024-09-10T08:40:39.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.789+0000 7ff936600640 1 -- start start 2024-09-10T08:40:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff936600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff93015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff936600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff93013eb20 0x7ff93015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff936600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff930071180 con 0x7ff9300b2d40 2024-09-10T08:40:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff936600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff930071ab0 con 0x7ff93013eb20 2024-09-10T08:40:39.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff936600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff930071460 con 0x7ff93006c320 2024-09-10T08:40:39.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff92fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff93013eb20 0x7ff93015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff92fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff93013eb20 0x7ff93015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42046/0 (socket says 172.21.15.52:42046) 2024-09-10T08:40:39.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff92fe00640 1 -- 172.21.15.52:0/1895897822 learned_addr learned my addr 172.21.15.52:0/1895897822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:39.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.791+0000 7ff927e00640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff93015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.792+0000 7ff92fe00640 1 -- 172.21.15.52:0/1895897822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 msgr2=0x7ff93015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.792+0000 7ff92fe00640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff93015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.792+0000 7ff92fe00640 1 -- 172.21.15.52:0/1895897822 >> v1:172.21.15.176:6789/0 conn(0x7ff9300b2d40 legacy=0x7ff93006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.792+0000 7ff92fe00640 1 -- 172.21.15.52:0/1895897822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff930071740 con 0x7ff93013eb20 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff92fe00640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93013eb20 0x7ff93015c230 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff928009e50 tx=0x7ff92802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681dc1245270f372 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff92ea00640 1 -- 172.21.15.52:0/1895897822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928036070 con 0x7ff93013eb20 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff92ea00640 1 -- 172.21.15.52:0/1895897822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff928031600 con 0x7ff93013eb20 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff92ea00640 1 -- 172.21.15.52:0/1895897822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9280319d0 con 0x7ff93013eb20 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 -- 172.21.15.52:0/1895897822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93013eb20 msgr2=0x7ff93015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93013eb20 0x7ff93015c230 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff928009e50 tx=0x7ff92802a710 comp rx=0 tx=0).stop 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 -- 172.21.15.52:0/1895897822 shutdown_connections 2024-09-10T08:40:39.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff93013eb20 0x7ff93015c230 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 --2- 172.21.15.52:0/1895897822 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff93015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.793+0000 7ff936600640 1 -- 172.21.15.52:0/1895897822 >> 172.21.15.52:0/1895897822 conn(0x7ff9300ccec0 msgr2=0x7ff9300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.794+0000 7ff936600640 1 -- 172.21.15.52:0/1895897822 shutdown_connections 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.794+0000 7ff936600640 1 -- 172.21.15.52:0/1895897822 wait complete. 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.795+0000 7ff936600640 1 Processor -- start 2024-09-10T08:40:39.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.795+0000 7ff936600640 1 -- start start 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff9300b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 0x7ff9300ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9300720c0 con 0x7ff9300b2d40 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff930071f40 con 0x7ff93013eb20 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff936600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff930072240 con 0x7ff93006c320 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff927e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.796+0000 7ff927e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42056/0 (socket says 172.21.15.52:42056) 2024-09-10T08:40:39.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 0x7ff9300ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 -- 172.21.15.52:0/2378423665 learned_addr learned my addr 172.21.15.52:0/2378423665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:39.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff92f400640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff9300b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 -- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 msgr2=0x7ff9300b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff9300b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 -- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 msgr2=0x7ff9300ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 0x7ff9300ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 -- 172.21.15.52:0/2378423665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93015b350 con 0x7ff9300b2d40 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff92fe00640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 0x7ff9300ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.797+0000 7ff927e00640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff91800e980 tx=0x7ff91800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.798+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918017070 con 0x7ff9300b2d40 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.798+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91800ca00 con 0x7ff9300b2d40 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.798+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91800cdd0 con 0x7ff9300b2d40 2024-09-10T08:40:39.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.798+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93015b630 con 0x7ff9300b2d40 2024-09-10T08:40:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.798+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff930140ae0 con 0x7ff9300b2d40 2024-09-10T08:40:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.799+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93015c110 con 0x7ff9300b2d40 2024-09-10T08:40:39.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.800+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff91801a070 con 0x7ff9300b2d40 2024-09-10T08:40:39.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.801+0000 7ff927400640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 0x7ff90c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:39.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.801+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7ff91808b1e0 con 0x7ff9300b2d40 2024-09-10T08:40:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.802+0000 7ff92f400640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 0x7ff90c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:39.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.802+0000 7ff92f400640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 0x7ff90c06e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff920001780 tx=0x7ff920009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:39.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.806+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff918059530 con 0x7ff9300b2d40 2024-09-10T08:40:39.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.990+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff93006bc10 con 0x7ff9300b2d40 2024-09-10T08:40:39.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.992+0000 7ff927400640 1 -- 172.21.15.52:0/2378423665 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16708 (secure 0 0 0) 0x7ff91805d830 con 0x7ff9300b2d40 2024-09-10T08:40:39.992 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:39.993 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":170,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:39.017959+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:40:36.819582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-10T08:40:38.015560+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 msgr2=0x7ff90c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 0x7ff90c06e2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff920001780 tx=0x7ff920009040 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 msgr2=0x7ff9300ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff91800e980 tx=0x7ff91800ee40 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 shutdown_connections 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff90c06be30 0x7ff90c06e2f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff93013eb20 0x7ff9300ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9300b2d40 0x7ff9300ca240 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 --2- 172.21.15.52:0/2378423665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff93006c320 0x7ff9300b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 >> 172.21.15.52:0/2378423665 conn(0x7ff9300ccec0 msgr2=0x7ff930156070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 shutdown_connections 2024-09-10T08:40:39.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:39.994+0000 7ff936600640 1 -- 172.21.15.52:0/2378423665 wait complete. 2024-09-10T08:40:40.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.165+0000 7efd33200640 1 Processor -- start 2024-09-10T08:40:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.166+0000 7efd33200640 1 -- start start 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd33200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd33200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 0x7efd2c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd33200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2c0d3990 con 0x7efd2c15e440 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd33200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c0d3c70 con 0x7efd2c0cf450 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd33200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0d3f50 con 0x7efd2c0b6710 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd32800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 0x7efd2c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd31400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd31400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:48486/0 (socket says 172.21.15.52:48486) 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd31e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7efd2c15e440 0x7efd2c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:34566/0 (socket says 172.21.15.52:34566) 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd31400640 1 -- 172.21.15.52:0/3751848104 learned_addr learned my addr 172.21.15.52:0/3751848104 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.167+0000 7efd32800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 0x7efd2c0b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:51740/0 (socket says 172.21.15.52:51740) 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.168+0000 7efd31400640 1 -- 172.21.15.52:0/3751848104 >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 msgr2=0x7efd2c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.168+0000 7efd31400640 1 --2- 172.21.15.52:0/3751848104 >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 0x7efd2c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.168+0000 7efd31400640 1 -- 172.21.15.52:0/3751848104 >> v1:172.21.15.176:6789/0 conn(0x7efd2c15e440 legacy=0x7efd2c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.168+0000 7efd31400640 1 -- 172.21.15.52:0/3751848104 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0d4230 con 0x7efd2c0b6710 2024-09-10T08:40:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd31400640 1 --2- 172.21.15.52:0/3751848104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009870 tx=0x7efd1c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f114078cefcfcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd30a00640 1 -- 172.21.15.52:0/3751848104 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c037070 con 0x7efd2c0b6710 2024-09-10T08:40:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd30a00640 1 -- 172.21.15.52:0/3751848104 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c02ae50 con 0x7efd2c0b6710 2024-09-10T08:40:40.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd30a00640 1 -- 172.21.15.52:0/3751848104 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c032860 con 0x7efd2c0b6710 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd33200640 1 -- 172.21.15.52:0/3751848104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 msgr2=0x7efd2c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.169+0000 7efd33200640 1 --2- 172.21.15.52:0/3751848104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009870 tx=0x7efd1c02a300 comp rx=0 tx=0).stop 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 -- 172.21.15.52:0/3751848104 shutdown_connections 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 --2- 172.21.15.52:0/3751848104 >> v2:172.21.15.176:3300/0 conn(0x7efd2c0cf450 0x7efd2c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 --2- 172.21.15.52:0/3751848104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0b6710 0x7efd2c0d3240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 -- 172.21.15.52:0/3751848104 >> 172.21.15.52:0/3751848104 conn(0x7efd2c067f80 msgr2=0x7efd2c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 -- 172.21.15.52:0/3751848104 shutdown_connections 2024-09-10T08:40:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.170+0000 7efd33200640 1 -- 172.21.15.52:0/3751848104 wait complete. 2024-09-10T08:40:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.171+0000 7efd33200640 1 Processor -- start 2024-09-10T08:40:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.171+0000 7efd33200640 1 -- start start 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 0x7efd2c1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0cf450 0x7efd2c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0b76c0 con 0x7efd2c15e440 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c0b7540 con 0x7efd2c0b6710 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.172+0000 7efd33200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0b80a0 con 0x7efd2c0cf450 2024-09-10T08:40:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd31e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 0x7efd2c1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd31400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0cf450 0x7efd2c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd31e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 0x7efd2c1f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:51752/0 (socket says 172.21.15.52:51752) 2024-09-10T08:40:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42062/0 (socket says 172.21.15.52:42062) 2024-09-10T08:40:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd31e00640 1 -- 172.21.15.52:0/869520331 learned_addr learned my addr 172.21.15.52:0/869520331 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:40.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 -- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0cf450 msgr2=0x7efd2c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0cf450 0x7efd2c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 -- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 msgr2=0x7efd2c1f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 0x7efd2c1f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 -- 172.21.15.52:0/869520331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0ab420 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.173+0000 7efd32800640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7efd2800efc0 tx=0x7efd2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.174+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28018020 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.174+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28014480 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.174+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c0cc800 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.174+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28014870 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.174+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c0ccdc0 con 0x7efd2c15e440 2024-09-10T08:40:40.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.175+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c0b7b60 con 0x7efd2c15e440 2024-09-10T08:40:40.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.176+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd28005d10 con 0x7efd2c15e440 2024-09-10T08:40:40.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.177+0000 7efd26000640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 0x7efd1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.177+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7efd2808bc20 con 0x7efd2c15e440 2024-09-10T08:40:40.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.177+0000 7efd31e00640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 0x7efd1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.178+0000 7efd31e00640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 0x7efd1006e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efd20004de0 tx=0x7efd20007f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.181+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd28022030 con 0x7efd2c15e440 2024-09-10T08:40:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.366+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd2c0b8fe0 con 0x7efd2c15e440 2024-09-10T08:40:40.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.367+0000 7efd26000640 1 -- 172.21.15.52:0/869520331 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) ==== 74+0+16708 (secure 0 0 0) 0x7efd28010040 con 0x7efd2c15e440 2024-09-10T08:40:40.368 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:40.368 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":170,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:39.017959+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:40:36.819582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-10T08:40:38.015560+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 msgr2=0x7efd1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 0x7efd1006e2f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efd20004de0 tx=0x7efd20007f10 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 msgr2=0x7efd2c0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7efd2800efc0 tx=0x7efd2800c490 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 shutdown_connections 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efd1006be30 0x7efd1006e2f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd2c15e440 0x7efd2c0b5e20 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efd2c0cf450 0x7efd2c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 --2- 172.21.15.52:0/869520331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd2c0b6710 0x7efd2c1f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 >> 172.21.15.52:0/869520331 conn(0x7efd2c067f80 msgr2=0x7efd2c0ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 shutdown_connections 2024-09-10T08:40:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.370+0000 7efd33200640 1 -- 172.21.15.52:0/869520331 wait complete. 2024-09-10T08:40:40.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:40:40.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.546+0000 7fd89b200640 1 Processor -- start 2024-09-10T08:40:40.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.546+0000 7fd89b200640 1 -- start start 2024-09-10T08:40:40.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd89b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd8940d1e60 0x7fd89415f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd89b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8940cef10 con 0x7fd89415c570 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd89b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89415fc10 con 0x7fd8940d1a80 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd89b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd8940cf1d0 con 0x7fd8940d1e60 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd893400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd89415c570 0x7fd89415eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32908/0 (socket says 172.21.15.52:32908) 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.547+0000 7fd893400640 1 -- 172.21.15.52:0/1206761453 learned_addr learned my addr 172.21.15.52:0/1206761453 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd899200640 1 --2- 172.21.15.52:0/1206761453 >> v2:172.21.15.176:3300/0 conn(0x7fd8940d1e60 0x7fd89415f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408743515 0 0) 0x7fd8940cef10 con 0x7fd89415c570 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd878003520 con 0x7fd89415c570 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246727683 0 0) 0x7fd89415fc10 con 0x7fd8940d1a80 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8940cef10 con 0x7fd8940d1a80 2024-09-10T08:40:40.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd899200640 1 -- 172.21.15.52:0/1206761453 >> v1:172.21.15.176:6789/0 conn(0x7fd8940d1a80 legacy=0x7fd89415be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd899200640 1 -- 172.21.15.52:0/1206761453 >> v1:172.21.15.52:6789/0 conn(0x7fd89415c570 legacy=0x7fd89415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.548+0000 7fd899200640 1 -- 172.21.15.52:0/1206761453 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8940cf4b0 con 0x7fd8940d1e60 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.549+0000 7fd899200640 1 --2- 172.21.15.52:0/1206761453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1e60 0x7fd89415f5f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009df0 tx=0x7fd88c02a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653ca523cc0a96d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c007740 con 0x7fd8940d1e60 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c0078e0 con 0x7fd8940d1e60 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd892a00640 1 -- 172.21.15.52:0/1206761453 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c007c90 con 0x7fd8940d1e60 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 -- 172.21.15.52:0/1206761453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1e60 msgr2=0x7fd89415f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 --2- 172.21.15.52:0/1206761453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1e60 0x7fd89415f5f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009df0 tx=0x7fd88c02a760 comp rx=0 tx=0).stop 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 -- 172.21.15.52:0/1206761453 shutdown_connections 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 --2- 172.21.15.52:0/1206761453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1e60 0x7fd89415f5f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 -- 172.21.15.52:0/1206761453 >> 172.21.15.52:0/1206761453 conn(0x7fd894067d70 msgr2=0x7fd894068180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 -- 172.21.15.52:0/1206761453 shutdown_connections 2024-09-10T08:40:40.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.550+0000 7fd89b200640 1 -- 172.21.15.52:0/1206761453 wait complete. 2024-09-10T08:40:40.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.552+0000 7fd89b200640 1 Processor -- start 2024-09-10T08:40:40.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.552+0000 7fd89b200640 1 -- start start 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 0x7fd8941533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 0x7fd894143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940cfe10 con 0x7fd8940d1e60 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940cfc90 con 0x7fd8940d1a80 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd89b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940cff90 con 0x7fd89415c570 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd893400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd893400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42072/0 (socket says 172.21.15.52:42072) 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.553+0000 7fd893400640 1 -- 172.21.15.52:0/370508821 learned_addr learned my addr 172.21.15.52:0/370508821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:40.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893e00640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 0x7fd8941533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd899200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 0x7fd894143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 -- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 msgr2=0x7fd894143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 0x7fd894143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 -- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 msgr2=0x7fd8941533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 0x7fd8941533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 -- 172.21.15.52:0/370508821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89415a490 con 0x7fd8940d1e60 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893e00640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 0x7fd8941533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd899200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 0x7fd894143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd893400640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c460 tx=0x7fd88000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880017070 con 0x7fd8940d1e60 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd880005ce0 con 0x7fd8940d1e60 2024-09-10T08:40:40.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880007290 con 0x7fd8940d1e60 2024-09-10T08:40:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89415a770 con 0x7fd8940d1e60 2024-09-10T08:40:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.554+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89415ad30 con 0x7fd8940d1e60 2024-09-10T08:40:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.556+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89415be60 con 0x7fd8940d1e60 2024-09-10T08:40:40.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.557+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd88001a070 con 0x7fd8940d1e60 2024-09-10T08:40:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.558+0000 7fd88be00640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 0x7fd87406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.558+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5709+0+0 (secure 0 0 0) 0x7fd88008a170 con 0x7fd8940d1e60 2024-09-10T08:40:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.558+0000 7fd893e00640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 0x7fd87406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:40.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.559+0000 7fd893e00640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 0x7fd87406e320 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd8840011e0 tx=0x7fd884009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:40.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.563+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd880058b20 con 0x7fd8940d1e60 2024-09-10T08:40:40.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:40.790+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd8940cecd0 con 0x7fd8940d1e60 2024-09-10T08:40:41.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.595+0000 7fd88be00640 1 -- 172.21.15.52:0/370508821 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v129) ==== 118+0+0 (secure 0 0 0) 0x7fd880058420 con 0x7fd8940d1e60 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 msgr2=0x7fd87406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 0x7fd87406e320 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd8840011e0 tx=0x7fd884009040 comp rx=0 tx=0).stop 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 msgr2=0x7fd894143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c460 tx=0x7fd88000c920 comp rx=0 tx=0).stop 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 shutdown_connections 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd87406be60 0x7fd87406e320 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd89415c570 0x7fd894143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8940d1e60 0x7fd894143700 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 --2- 172.21.15.52:0/370508821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8940d1a80 0x7fd8941533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 >> 172.21.15.52:0/370508821 conn(0x7fd894067d70 msgr2=0x7fd8940d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:41.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 shutdown_connections 2024-09-10T08:40:41.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.598+0000 7fd89b200640 1 -- 172.21.15.52:0/370508821 wait complete. 2024-09-10T08:40:41.617 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:40:41.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:40:41.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.783+0000 7f425a400640 1 Processor -- start 2024-09-10T08:40:41.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.783+0000 7f425a400640 1 -- start start 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.784+0000 7f425a400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42540cd2a0 0x7f425415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.784+0000 7f425a400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540714b0 con 0x7f42540732e0 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.784+0000 7f425a400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540cd880 con 0x7f42540cce30 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.784+0000 7f425a400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f42540cdb60 con 0x7f42540cd2a0 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.784+0000 7f4253400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f42540732e0 0x7f42540736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32920/0 (socket says 172.21.15.52:32920) 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4253400640 1 -- 172.21.15.52:0/3682139168 learned_addr learned my addr 172.21.15.52:0/3682139168 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:41.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4253e00640 1 --2- 172.21.15.52:0/3682139168 >> v2:172.21.15.176:3300/0 conn(0x7f42540cd2a0 0x7f425415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977741306 0 0) 0x7f42540714b0 con 0x7f42540732e0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4238003520 con 0x7f42540732e0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773373733 0 0) 0x7f42540cd880 con 0x7f42540cce30 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42540714b0 con 0x7f42540cce30 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 501271225 0 0) 0x7f4238003520 con 0x7f42540732e0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 >> v2:172.21.15.176:3300/0 conn(0x7f42540cd2a0 msgr2=0x7f425415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 --2- 172.21.15.52:0/3682139168 >> v2:172.21.15.176:3300/0 conn(0x7f42540cd2a0 0x7f425415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 >> v1:172.21.15.176:6789/0 conn(0x7f42540cce30 legacy=0x7f4254071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540cde40 con 0x7f42540732e0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f4244001670 con 0x7f42540732e0 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4253e00640 1 --2- 172.21.15.52:0/3682139168 >> v2:172.21.15.176:3300/0 conn(0x7f42540cd2a0 0x7f425415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:40:41.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 >> v1:172.21.15.52:6789/0 conn(0x7f42540732e0 legacy=0x7f42540736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4238003b40 0x7f4238003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 0x7f4238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.785+0000 7f4252000640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42380051c0 0x7f423800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42540cdb60 con 0x7f4238004800 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f423800c0f0 con 0x7f4238003b40 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f423800c2f0 con 0x7f42380051c0 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 0x7f4238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4253400640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4238003b40 0x7f4238003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4253e00640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42380051c0 0x7f423800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 -- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42380051c0 msgr2=0x7f423800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42380051c0 0x7f423800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 -- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4238003b40 msgr2=0x7f4238003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4238003b40 0x7f4238003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4252a00640 1 -- 172.21.15.52:0/3682139168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4238003520 con 0x7f4238004800 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.786+0000 7f4253e00640 1 -- 172.21.15.52:0/3682139168 reap_dead start 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.787+0000 7f4252a00640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 0x7f4238004c80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f42400018d0 tx=0x7f4238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7940232edeb541 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.787+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42400014f0 con 0x7f4238004800 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.787+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42400052d0 con 0x7f4238004800 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f4252000640 1 -- 172.21.15.52:0/3682139168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424002ac30 con 0x7f4238004800 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 -- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 msgr2=0x7f4238004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 0x7f4238004c80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f42400018d0 tx=0x7f4238005830 comp rx=0 tx=0).stop 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 -- 172.21.15.52:0/3682139168 shutdown_connections 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 --2- 172.21.15.52:0/3682139168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4238004800 0x7f4238004c80 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 -- 172.21.15.52:0/3682139168 >> 172.21.15.52:0/3682139168 conn(0x7f425406d0f0 msgr2=0x7f425406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 -- 172.21.15.52:0/3682139168 shutdown_connections 2024-09-10T08:40:41.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.788+0000 7f425a400640 1 -- 172.21.15.52:0/3682139168 wait complete. 2024-09-10T08:40:41.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.790+0000 7f425a400640 1 Processor -- start 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.790+0000 7f425a400640 1 -- start start 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4238004800 0x7f425414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4254159090 0x7f4254159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4254073840 con 0x7f4254153970 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42540736c0 con 0x7f4254159090 2024-09-10T08:40:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f425a400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42540739c0 con 0x7f4238004800 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42090/0 (socket says 172.21.15.52:42090) 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 -- 172.21.15.52:0/674108929 learned_addr learned my addr 172.21.15.52:0/674108929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4253e00640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4254159090 0x7f4254159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4253400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4238004800 0x7f425414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 -- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4238004800 msgr2=0x7f425414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4238004800 0x7f425414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 -- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4254159090 msgr2=0x7f4254159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.791+0000 7f4252a00640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4254159090 0x7f4254159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f4252a00640 1 -- 172.21.15.52:0/674108929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4254156890 con 0x7f4254153970 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f4252a00640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f4240000c00 tx=0x7f42400012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240037040 con 0x7f4254153970 2024-09-10T08:40:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240005480 con 0x7f4254153970 2024-09-10T08:40:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42541565b0 con 0x7f4254153970 2024-09-10T08:40:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42400014f0 con 0x7f4254153970 2024-09-10T08:40:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.792+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42540ce570 con 0x7f4254153970 2024-09-10T08:40:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.793+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4254071c70 con 0x7f4254153970 2024-09-10T08:40:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.794+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4240044020 con 0x7f4254153970 2024-09-10T08:40:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.795+0000 7f424b400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 0x7f423406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.796+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f42400aadd0 con 0x7f4254153970 2024-09-10T08:40:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.796+0000 7f4253400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 0x7f423406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.797+0000 7f4253400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 0x7f423406e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4244001eb0 tx=0x7f4244009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:41.800+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42400795d0 con 0x7f4254153970 2024-09-10T08:40:42.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.020+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f42540711f0 con 0x7f4254153970 2024-09-10T08:40:42.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.603+0000 7f424b400640 1 -- 172.21.15.52:0/674108929 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v130) ==== 122+0+0 (secure 0 0 0) 0x7f4240078ed0 con 0x7f4254153970 2024-09-10T08:40:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 msgr2=0x7f423406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 0x7f423406e2f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4244001eb0 tx=0x7f4244009040 comp rx=0 tx=0).stop 2024-09-10T08:40:42.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 msgr2=0x7f4254155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f4240000c00 tx=0x7f42400012d0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 shutdown_connections 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f423406be30 0x7f423406e2f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4254159090 0x7f4254159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4254153970 0x7f4254155c60 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 --2- 172.21.15.52:0/674108929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4238004800 0x7f425414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 >> 172.21.15.52:0/674108929 conn(0x7f425406d0f0 msgr2=0x7f425415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 shutdown_connections 2024-09-10T08:40:42.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.607+0000 7f425a400640 1 -- 172.21.15.52:0/674108929 wait complete. 2024-09-10T08:40:42.625 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:40:42.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:42.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.784+0000 7f6142800640 1 Processor -- start 2024-09-10T08:40:42.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.784+0000 7f6142800640 1 -- start start 2024-09-10T08:40:42.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6142800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f613c15e440 0x7f613c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6142800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f613c0cf450 0x7f613c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6142800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0d3990 con 0x7f613c0b6540 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6142800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0b6990 con 0x7f613c15e440 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6142800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f613c0d3c70 con 0x7f613c0cf450 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6141400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f613c15e440 0x7f613c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6141e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f613c0b6540 0x7f613c06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32922/0 (socket says 172.21.15.52:32922) 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.785+0000 7f6141e00640 1 -- 172.21.15.52:0/3698385027 learned_addr learned my addr 172.21.15.52:0/3698385027 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.786+0000 7f6140a00640 1 --2- 172.21.15.52:0/3698385027 >> v2:172.21.15.176:3300/0 conn(0x7f613c0cf450 0x7f613c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.786+0000 7f6141400640 1 -- 172.21.15.52:0/3698385027 >> v2:172.21.15.176:3300/0 conn(0x7f613c0cf450 msgr2=0x7f613c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.786+0000 7f6141400640 1 --2- 172.21.15.52:0/3698385027 >> v2:172.21.15.176:3300/0 conn(0x7f613c0cf450 0x7f613c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.786+0000 7f6141400640 1 -- 172.21.15.52:0/3698385027 >> v1:172.21.15.52:6789/0 conn(0x7f613c0b6540 legacy=0x7f613c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.786+0000 7f6141400640 1 -- 172.21.15.52:0/3698385027 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c0d3f50 con 0x7f613c15e440 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.787+0000 7f6141400640 1 --2- 172.21.15.52:0/3698385027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c15e440 0x7f613c0d3240 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b3f90 tx=0x7f613002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24eae5f8dfcae51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.787+0000 7f613be00640 1 -- 172.21.15.52:0/3698385027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037070 con 0x7f613c15e440 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.787+0000 7f613be00640 1 -- 172.21.15.52:0/3698385027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130032440 con 0x7f613c15e440 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.787+0000 7f613be00640 1 -- 172.21.15.52:0/3698385027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130032810 con 0x7f613c15e440 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 -- 172.21.15.52:0/3698385027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c15e440 msgr2=0x7f613c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 --2- 172.21.15.52:0/3698385027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c15e440 0x7f613c0d3240 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f613c0b3f90 tx=0x7f613002a250 comp rx=0 tx=0).stop 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 -- 172.21.15.52:0/3698385027 shutdown_connections 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 --2- 172.21.15.52:0/3698385027 >> v2:172.21.15.176:3300/0 conn(0x7f613c0cf450 0x7f613c0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 --2- 172.21.15.52:0/3698385027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c15e440 0x7f613c0d3240 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 -- 172.21.15.52:0/3698385027 >> 172.21.15.52:0/3698385027 conn(0x7f613c067f80 msgr2=0x7f613c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 -- 172.21.15.52:0/3698385027 shutdown_connections 2024-09-10T08:40:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.788+0000 7f6142800640 1 -- 172.21.15.52:0/3698385027 wait complete. 2024-09-10T08:40:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.790+0000 7f6142800640 1 Processor -- start 2024-09-10T08:40:42.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.790+0000 7f6142800640 1 -- start start 2024-09-10T08:40:42.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f613c0cf450 0x7f613c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c15e440 0x7f613c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f613c0b7540 con 0x7f613c0b6540 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f613c15e820 con 0x7f613c15e440 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6142800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f613c0b76c0 con 0x7f613c0cf450 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42104/0 (socket says 172.21.15.52:42104) 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 -- 172.21.15.52:0/1274621376 learned_addr learned my addr 172.21.15.52:0/1274621376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6140a00640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f613c0cf450 0x7f613c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141e00640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c15e440 0x7f613c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 -- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f613c0cf450 msgr2=0x7f613c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f613c0cf450 0x7f613c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 -- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c15e440 msgr2=0x7f613c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c15e440 0x7f613c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.791+0000 7f6141400640 1 -- 172.21.15.52:0/1274621376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c160a60 con 0x7f613c0b6540 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6141400640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c00 tx=0x7f61300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130037040 con 0x7f613c0b6540 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6130042070 con 0x7f613c0b6540 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1617a0 con 0x7f613c0b6540 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130030bd0 con 0x7f613c0b6540 2024-09-10T08:40:42.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.792+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c15a040 con 0x7f613c0b6540 2024-09-10T08:40:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.793+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c0b6000 con 0x7f613c0b6540 2024-09-10T08:40:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.794+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6130047460 con 0x7f613c0b6540 2024-09-10T08:40:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.795+0000 7f6139600640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.795+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f61300abac0 con 0x7f613c0b6540 2024-09-10T08:40:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.795+0000 7f6140a00640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.796+0000 7f6140a00640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 0x7f611c06e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f613c161080 tx=0x7f6128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:42.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:42.799+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6130032e20 con 0x7f613c0b6540 2024-09-10T08:40:43.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.019+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f613c0d4e20 con 0x7f613c0b6540 2024-09-10T08:40:43.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.020+0000 7f6139600640 1 -- 172.21.15.52:0/1274621376 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5236 (secure 0 0 0) 0x7f613007a460 con 0x7f613c0b6540 2024-09-10T08:40:43.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:43.021 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":130,"btime":"2024-09-10T08:40:42:596516+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:40:42.021824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:40:43.021 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 130 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 msgr2=0x7f611c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 0x7f611c06e2f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f613c161080 tx=0x7f6128008040 comp rx=0 tx=0).stop 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 msgr2=0x7f613c1610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f6130000c00 tx=0x7f61300046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 shutdown_connections 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f611c06be30 0x7f611c06e2f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f613c15e440 0x7f613c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f613c0cf450 0x7f613c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 --2- 172.21.15.52:0/1274621376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f613c0b6540 0x7f613c1610f0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 >> 172.21.15.52:0/1274621376 conn(0x7f613c067f80 msgr2=0x7f613c0cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:43.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 shutdown_connections 2024-09-10T08:40:43.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.022+0000 7f6142800640 1 -- 172.21.15.52:0/1274621376 wait complete. 2024-09-10T08:40:43.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:40:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.194+0000 7f7cbae00640 1 Processor -- start 2024-09-10T08:40:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.194+0000 7f7cbae00640 1 -- start start 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cbae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b63f0 0x7f7cb40cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cbae00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cbae00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb40cfb40 con 0x7f7cb40b67d0 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cbae00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7cb40d27f0 con 0x7f7cb40b7a30 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cbae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb40cfe20 con 0x7f7cb40b63f0 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cb9000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cb9000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42112/0 (socket says 172.21.15.52:42112) 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.195+0000 7f7cb9000640 1 -- 172.21.15.52:0/564288580 learned_addr learned my addr 172.21.15.52:0/564288580 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.196+0000 7f7cb9a00640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b63f0 0x7f7cb40cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.196+0000 7f7cb9000640 1 -- 172.21.15.52:0/564288580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b63f0 msgr2=0x7f7cb40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.196+0000 7f7cb9000640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b63f0 0x7f7cb40cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.196+0000 7f7cb9000640 1 -- 172.21.15.52:0/564288580 >> v1:172.21.15.176:6789/0 conn(0x7f7cb40b67d0 legacy=0x7f7cb415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.196+0000 7f7cb9000640 1 -- 172.21.15.52:0/564288580 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb40d2e00 con 0x7f7cb40b7a30 2024-09-10T08:40:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.197+0000 7f7cb9000640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4dbe3c2cd45dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.197+0000 7f7cb3e00640 1 -- 172.21.15.52:0/564288580 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0037070 con 0x7f7cb40b7a30 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.197+0000 7f7cb3e00640 1 -- 172.21.15.52:0/564288580 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca0032440 con 0x7f7cb40b7a30 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.197+0000 7f7cb3e00640 1 -- 172.21.15.52:0/564288580 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0032810 con 0x7f7cb40b7a30 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 -- 172.21.15.52:0/564288580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b7a30 msgr2=0x7f7cb40cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca002a270 comp rx=0 tx=0).stop 2024-09-10T08:40:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 -- 172.21.15.52:0/564288580 shutdown_connections 2024-09-10T08:40:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b7a30 0x7f7cb40cf4a0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 --2- 172.21.15.52:0/564288580 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b63f0 0x7f7cb40cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 -- 172.21.15.52:0/564288580 >> 172.21.15.52:0/564288580 conn(0x7f7cb40d1360 msgr2=0x7f7cb40d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 -- 172.21.15.52:0/564288580 shutdown_connections 2024-09-10T08:40:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.198+0000 7f7cbae00640 1 -- 172.21.15.52:0/564288580 wait complete. 2024-09-10T08:40:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.199+0000 7f7cbae00640 1 Processor -- start 2024-09-10T08:40:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.199+0000 7f7cbae00640 1 -- start start 2024-09-10T08:40:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cb40b63f0 0x7f7cb40ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b7a30 0x7f7cb4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb415e810 con 0x7f7cb40b67d0 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb415e690 con 0x7f7cb40b63f0 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.200+0000 7f7cbae00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb415e990 con 0x7f7cb40b7a30 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cb40b63f0 0x7f7cb40ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42122/0 (socket says 172.21.15.52:42122) 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 -- 172.21.15.52:0/3700980359 learned_addr learned my addr 172.21.15.52:0/3700980359 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cba400640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b7a30 0x7f7cb4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 -- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b7a30 msgr2=0x7f7cb4146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b7a30 0x7f7cb4146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 -- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cb40b63f0 msgr2=0x7f7cb40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cb40b63f0 0x7f7cb40ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 -- 172.21.15.52:0/3700980359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb4154ab0 con 0x7f7cb40b67d0 2024-09-10T08:40:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.201+0000 7f7cb9000640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.202+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0041020 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.202+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca00306c0 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.202+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0037040 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.202+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb40c9d60 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.202+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb40ca320 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.203+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb415df80 con 0x7f7cb40b67d0 2024-09-10T08:40:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.204+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ca0044020 con 0x7f7cb40b67d0 2024-09-10T08:40:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.205+0000 7f7cb1600640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 0x7f7c9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.205+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f7ca00ab620 con 0x7f7cb40b67d0 2024-09-10T08:40:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.205+0000 7f7cb9a00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 0x7f7c9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.206+0000 7f7cb9a00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 0x7f7c9406e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006fd0 tx=0x7f7ca8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.209+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ca004b030 con 0x7f7cb40b67d0 2024-09-10T08:40:43.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.396+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cb4161bd0 con 0x7f7cb40b67d0 2024-09-10T08:40:43.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.398+0000 7f7cb1600640 1 -- 172.21.15.52:0/3700980359 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16695 (secure 0 0 0) 0x7f7ca0079fc0 con 0x7f7cb40b67d0 2024-09-10T08:40:43.398 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:43.398 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":171,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:40.589627+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:40:36.819582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-10T08:40:38.015560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:40:43.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 msgr2=0x7f7c9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 0x7f7c9406e2f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8006fd0 tx=0x7f7ca8008040 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 msgr2=0x7f7cb4146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca00046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 shutdown_connections 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c9406be30 0x7f7c9406e2f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7cb40b7a30 0x7f7cb4146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cb40b67d0 0x7f7cb4146820 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 --2- 172.21.15.52:0/3700980359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7cb40b63f0 0x7f7cb40ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 >> 172.21.15.52:0/3700980359 conn(0x7f7cb40d1360 msgr2=0x7f7cb415f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 shutdown_connections 2024-09-10T08:40:43.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.400+0000 7f7cbae00640 1 -- 172.21.15.52:0/3700980359 wait complete. 2024-09-10T08:40:43.416 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:40:43.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:40:43.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.571+0000 7f4384200640 1 Processor -- start 2024-09-10T08:40:43.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.571+0000 7f4384200640 1 -- start start 2024-09-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.572+0000 7f4384200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f437c06c320 0x7f437c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.572+0000 7f4384200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f437c13eb20 0x7f437c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.572+0000 7f4384200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f437c071180 con 0x7f437c0b2d40 2024-09-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4384200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f437c071ab0 con 0x7f437c06c320 2024-09-10T08:40:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4384200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f437c071460 con 0x7f437c13eb20 2024-09-10T08:40:43.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f437c06c320 0x7f437c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f437c06c320 0x7f437c15bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42130/0 (socket says 172.21.15.52:42130) 2024-09-10T08:40:43.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 -- 172.21.15.52:0/3549124265 learned_addr learned my addr 172.21.15.52:0/3549124265 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:43.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4382200640 1 --2- 172.21.15.52:0/3549124265 >> v2:172.21.15.176:3300/0 conn(0x7f437c13eb20 0x7f437c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 -- 172.21.15.52:0/3549124265 >> v2:172.21.15.176:3300/0 conn(0x7f437c13eb20 msgr2=0x7f437c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 --2- 172.21.15.52:0/3549124265 >> v2:172.21.15.176:3300/0 conn(0x7f437c13eb20 0x7f437c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 -- 172.21.15.52:0/3549124265 >> v1:172.21.15.176:6789/0 conn(0x7f437c0b2d40 legacy=0x7f437c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.573+0000 7f4380e00640 1 -- 172.21.15.52:0/3549124265 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c071740 con 0x7f437c06c320 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.574+0000 7f4380e00640 1 --2- 172.21.15.52:0/3549124265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c06c320 0x7f437c15bcf0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f437c1595c0 tx=0x7f436802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3a9e1a9ddc93c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f437be00640 1 -- 172.21.15.52:0/3549124265 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368037070 con 0x7f437c06c320 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f437be00640 1 -- 172.21.15.52:0/3549124265 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4368032440 con 0x7f437c06c320 2024-09-10T08:40:43.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f437be00640 1 -- 172.21.15.52:0/3549124265 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368032810 con 0x7f437c06c320 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 -- 172.21.15.52:0/3549124265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c06c320 msgr2=0x7f437c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 --2- 172.21.15.52:0/3549124265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c06c320 0x7f437c15bcf0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f437c1595c0 tx=0x7f436802a270 comp rx=0 tx=0).stop 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 -- 172.21.15.52:0/3549124265 shutdown_connections 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 --2- 172.21.15.52:0/3549124265 >> v2:172.21.15.176:3300/0 conn(0x7f437c13eb20 0x7f437c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 --2- 172.21.15.52:0/3549124265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c06c320 0x7f437c15bcf0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 -- 172.21.15.52:0/3549124265 >> 172.21.15.52:0/3549124265 conn(0x7f437c0ccec0 msgr2=0x7f437c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 -- 172.21.15.52:0/3549124265 shutdown_connections 2024-09-10T08:40:43.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.575+0000 7f4384200640 1 -- 172.21.15.52:0/3549124265 wait complete. 2024-09-10T08:40:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.577+0000 7f4384200640 1 Processor -- start 2024-09-10T08:40:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.577+0000 7f4384200640 1 -- start start 2024-09-10T08:40:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f437c06c320 0x7f437c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 0x7f437c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f437c0720c0 con 0x7f437c13eb20 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f437c071f40 con 0x7f437c06c320 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4384200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f437c072240 con 0x7f437c0b2d40 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4382200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4382200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42138/0 (socket says 172.21.15.52:42138) 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.578+0000 7f4382200640 1 -- 172.21.15.52:0/1451377542 learned_addr learned my addr 172.21.15.52:0/1451377542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4380e00640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 0x7f437c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4381800640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f437c06c320 0x7f437c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 -- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 msgr2=0x7f437c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 0x7f437c15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 -- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f437c06c320 msgr2=0x7f437c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f437c06c320 0x7f437c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 -- 172.21.15.52:0/1451377542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c13f180 con 0x7f437c13eb20 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4380e00640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 0x7f437c15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4382200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f4374007e90 tx=0x7f437400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374014420 con 0x7f437c13eb20 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4374019070 con 0x7f437c13eb20 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c13f460 con 0x7f437c13eb20 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.579+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374014800 con 0x7f437c13eb20 2024-09-10T08:40:43.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.580+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c13fa20 con 0x7f437c13eb20 2024-09-10T08:40:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.581+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c06bc10 con 0x7f437c13eb20 2024-09-10T08:40:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.582+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43740149a0 con 0x7f437c13eb20 2024-09-10T08:40:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.582+0000 7f4379600640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 0x7f435c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.583+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f437408b670 con 0x7f437c13eb20 2024-09-10T08:40:43.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.583+0000 7f4381800640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 0x7f435c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.584+0000 7f4381800640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 0x7f435c06e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4370001640 tx=0x7f4370009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.587+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f437405a020 con 0x7f437c13eb20 2024-09-10T08:40:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.770+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f437c06c9c0 con 0x7f435c06be30 2024-09-10T08:40:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.777+0000 7f4379600640 1 -- 172.21.15.52:0/1451377542 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251673 (secure 0 0 0) 0x7f437c06c9c0 con 0x7f435c06be30 2024-09-10T08:40:43.782 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:43.784 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:40:43.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 msgr2=0x7f435c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 0x7f435c06e2f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4370001640 tx=0x7f4370009040 comp rx=0 tx=0).stop 2024-09-10T08:40:43.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 msgr2=0x7f437c0cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f4374007e90 tx=0x7f437400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 shutdown_connections 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f435c06be30 0x7f435c06e2f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f437c13eb20 0x7f437c0cc1b0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f437c0b2d40 0x7f437c15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 --2- 172.21.15.52:0/1451377542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f437c06c320 0x7f437c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 >> 172.21.15.52:0/1451377542 conn(0x7f437c0ccec0 msgr2=0x7f437c0cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 shutdown_connections 2024-09-10T08:40:43.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.781+0000 7f4384200640 1 -- 172.21.15.52:0/1451377542 wait complete. 2024-09-10T08:40:43.797 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":529,"stamp":"2024-09-10T08:40:43.633471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444896,"kb_used_data":17720,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529824,"statfs":{"total":773094113280,"available":772638539776,"internally_reserved":0,"allocated":18145280,"data_stored":8627585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614955+0000","last_change":"2024-09-10T08:40:39.611318+0000","last_active":"2024-09-10T08:40:39.614955+0000","last_peered":"2024-09-10T08:40:39.614955+0000","last_clean":"2024-09-10T08:40:39.614955+0000","last_became_active":"2024-09-10T08:40:39.611027+0000","last_became_peered":"2024-09-10T08:40:39.611027+0000","last_unstale":"2024-09-10T08:40:39.614955+0000","last_undegraded":"2024-09-10T08:40:39.614955+0000","last_fullsized":"2024-09-10T08:40:39.614955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:31.420624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615813+0000","last_change":"2024-09-10T08:40:39.609260+0000","last_active":"2024-09-10T08:40:39.615813+0000","last_peered":"2024-09-10T08:40:39.615813+0000","last_clean":"2024-09-10T08:40:39.615813+0000","last_became_active":"2024-09-10T08:40:39.608971+0000","last_became_peered":"2024-09-10T08:40:39.608971+0000","last_unstale":"2024-09-10T08:40:39.615813+0000","last_undegraded":"2024-09-10T08:40:39.615813+0000","last_fullsized":"2024-09-10T08:40:39.615813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:44.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596612+0000","last_change":"2024-09-10T08:40:38.596612+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596612+0000","last_undegraded":"2024-09-10T08:40:38.596612+0000","last_fullsized":"2024-09-10T08:40:38.596612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614970+0000","last_change":"2024-09-10T08:40:39.605534+0000","last_active":"2024-09-10T08:40:39.614970+0000","last_peered":"2024-09-10T08:40:39.614970+0000","last_clean":"2024-09-10T08:40:39.614970+0000","last_became_active":"2024-09-10T08:40:39.605235+0000","last_became_peered":"2024-09-10T08:40:39.605235+0000","last_unstale":"2024-09-10T08:40:39.614970+0000","last_undegraded":"2024-09-10T08:40:39.614970+0000","last_fullsized":"2024-09-10T08:40:39.614970+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:41.680474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615691+0000","last_change":"2024-09-10T08:40:39.614794+0000","last_active":"2024-09-10T08:40:39.615691+0000","last_peered":"2024-09-10T08:40:39.615691+0000","last_clean":"2024-09-10T08:40:39.615691+0000","last_became_active":"2024-09-10T08:40:39.614532+0000","last_became_peered":"2024-09-10T08:40:39.614532+0000","last_unstale":"2024-09-10T08:40:39.615691+0000","last_undegraded":"2024-09-10T08:40:39.615691+0000","last_fullsized":"2024-09-10T08:40:39.615691+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607803+0000","last_change":"2024-09-10T08:40:39.601372+0000","last_active":"2024-09-10T08:40:39.607803+0000","last_peered":"2024-09-10T08:40:39.607803+0000","last_clean":"2024-09-10T08:40:39.607803+0000","last_became_active":"2024-09-10T08:40:39.600883+0000","last_became_peered":"2024-09-10T08:40:39.600883+0000","last_unstale":"2024-09-10T08:40:39.607803+0000","last_undegraded":"2024-09-10T08:40:39.607803+0000","last_fullsized":"2024-09-10T08:40:39.607803+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:30.821124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.600518+0000","last_change":"2024-09-10T08:40:39.594012+0000","last_active":"2024-09-10T08:40:39.600518+0000","last_peered":"2024-09-10T08:40:39.600518+0000","last_clean":"2024-09-10T08:40:39.600518+0000","last_became_active":"2024-09-10T08:40:39.593736+0000","last_became_peered":"2024-09-10T08:40:39.593736+0000","last_unstale":"2024-09-10T08:40:39.600518+0000","last_undegraded":"2024-09-10T08:40:39.600518+0000","last_fullsized":"2024-09-10T08:40:39.600518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610000+0000","last_change":"2024-09-10T08:40:39.606793+0000","last_active":"2024-09-10T08:40:39.610000+0000","last_peered":"2024-09-10T08:40:39.610000+0000","last_clean":"2024-09-10T08:40:39.610000+0000","last_became_active":"2024-09-10T08:40:39.606321+0000","last_became_peered":"2024-09-10T08:40:39.606321+0000","last_unstale":"2024-09-10T08:40:39.610000+0000","last_undegraded":"2024-09-10T08:40:39.610000+0000","last_fullsized":"2024-09-10T08:40:39.610000+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:24.778080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615574+0000","last_change":"2024-09-10T08:40:39.607866+0000","last_active":"2024-09-10T08:40:39.615574+0000","last_peered":"2024-09-10T08:40:39.615574+0000","last_clean":"2024-09-10T08:40:39.615574+0000","last_became_active":"2024-09-10T08:40:39.607413+0000","last_became_peered":"2024-09-10T08:40:39.607413+0000","last_unstale":"2024-09-10T08:40:39.615574+0000","last_undegraded":"2024-09-10T08:40:39.615574+0000","last_fullsized":"2024-09-10T08:40:39.615574+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610285+0000","last_change":"2024-09-10T08:40:39.607709+0000","last_active":"2024-09-10T08:40:39.610285+0000","last_peered":"2024-09-10T08:40:39.610285+0000","last_clean":"2024-09-10T08:40:39.610285+0000","last_became_active":"2024-09-10T08:40:39.603723+0000","last_became_peered":"2024-09-10T08:40:39.603723+0000","last_unstale":"2024-09-10T08:40:39.610285+0000","last_undegraded":"2024-09-10T08:40:39.610285+0000","last_fullsized":"2024-09-10T08:40:39.610285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:32.851653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615496+0000","last_change":"2024-09-10T08:40:39.607624+0000","last_active":"2024-09-10T08:40:39.615496+0000","last_peered":"2024-09-10T08:40:39.615496+0000","last_clean":"2024-09-10T08:40:39.615496+0000","last_became_active":"2024-09-10T08:40:39.607331+0000","last_became_peered":"2024-09-10T08:40:39.607331+0000","last_unstale":"2024-09-10T08:40:39.615496+0000","last_undegraded":"2024-09-10T08:40:39.615496+0000","last_fullsized":"2024-09-10T08:40:39.615496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:28.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603220+0000","last_change":"2024-09-10T08:40:39.602367+0000","last_active":"2024-09-10T08:40:39.603220+0000","last_peered":"2024-09-10T08:40:39.603220+0000","last_clean":"2024-09-10T08:40:39.603220+0000","last_became_active":"2024-09-10T08:40:39.602061+0000","last_became_peered":"2024-09-10T08:40:39.602061+0000","last_unstale":"2024-09-10T08:40:39.603220+0000","last_undegraded":"2024-09-10T08:40:39.603220+0000","last_fullsized":"2024-09-10T08:40:39.603220+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:36.086412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608217+0000","last_change":"2024-09-10T08:40:39.606370+0000","last_active":"2024-09-10T08:40:39.608217+0000","last_peered":"2024-09-10T08:40:39.608217+0000","last_clean":"2024-09-10T08:40:39.608217+0000","last_became_active":"2024-09-10T08:40:39.606005+0000","last_became_peered":"2024-09-10T08:40:39.606005+0000","last_unstale":"2024-09-10T08:40:39.608217+0000","last_undegraded":"2024-09-10T08:40:39.608217+0000","last_fullsized":"2024-09-10T08:40:39.608217+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:38.921411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.617169+0000","last_change":"2024-09-10T08:40:39.611415+0000","last_active":"2024-09-10T08:40:39.617169+0000","last_peered":"2024-09-10T08:40:39.617169+0000","last_clean":"2024-09-10T08:40:39.617169+0000","last_became_active":"2024-09-10T08:40:39.611117+0000","last_became_peered":"2024-09-10T08:40:39.611117+0000","last_unstale":"2024-09-10T08:40:39.617169+0000","last_undegraded":"2024-09-10T08:40:39.617169+0000","last_fullsized":"2024-09-10T08:40:39.617169+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:29.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614988+0000","last_change":"2024-09-10T08:40:39.612070+0000","last_active":"2024-09-10T08:40:39.614988+0000","last_peered":"2024-09-10T08:40:39.614988+0000","last_clean":"2024-09-10T08:40:39.614988+0000","last_became_active":"2024-09-10T08:40:39.611186+0000","last_became_peered":"2024-09-10T08:40:39.611186+0000","last_unstale":"2024-09-10T08:40:39.614988+0000","last_undegraded":"2024-09-10T08:40:39.614988+0000","last_fullsized":"2024-09-10T08:40:39.614988+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:42.961556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.593853+0000","last_change":"2024-09-10T08:40:38.593853+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.593853+0000","last_undegraded":"2024-09-10T08:40:38.593853+0000","last_fullsized":"2024-09-10T08:40:38.593853+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608176+0000","last_change":"2024-09-10T08:40:39.606371+0000","last_active":"2024-09-10T08:40:39.608176+0000","last_peered":"2024-09-10T08:40:39.608176+0000","last_clean":"2024-09-10T08:40:39.608176+0000","last_became_active":"2024-09-10T08:40:39.606096+0000","last_became_peered":"2024-09-10T08:40:39.606096+0000","last_unstale":"2024-09-10T08:40:39.608176+0000","last_undegraded":"2024-09-10T08:40:39.608176+0000","last_fullsized":"2024-09-10T08:40:39.608176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:19.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608605+0000","last_change":"2024-09-10T08:40:39.607991+0000","last_active":"2024-09-10T08:40:39.608605+0000","last_peered":"2024-09-10T08:40:39.608605+0000","last_clean":"2024-09-10T08:40:39.608605+0000","last_became_active":"2024-09-10T08:40:39.607654+0000","last_became_peered":"2024-09-10T08:40:39.607654+0000","last_unstale":"2024-09-10T08:40:39.608605+0000","last_undegraded":"2024-09-10T08:40:39.608605+0000","last_fullsized":"2024-09-10T08:40:39.608605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596208+0000","last_change":"2024-09-10T08:40:38.596208+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596208+0000","last_undegraded":"2024-09-10T08:40:38.596208+0000","last_fullsized":"2024-09-10T08:40:38.596208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603905+0000","last_change":"2024-09-10T08:40:39.602035+0000","last_active":"2024-09-10T08:40:39.603905+0000","last_peered":"2024-09-10T08:40:39.603905+0000","last_clean":"2024-09-10T08:40:39.603905+0000","last_became_active":"2024-09-10T08:40:39.601010+0000","last_became_peered":"2024-09-10T08:40:39.601010+0000","last_unstale":"2024-09-10T08:40:39.603905+0000","last_undegraded":"2024-09-10T08:40:39.603905+0000","last_fullsized":"2024-09-10T08:40:39.603905+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:44.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.594932+0000","last_change":"2024-09-10T08:40:38.594932+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.594932+0000","last_undegraded":"2024-09-10T08:40:38.594932+0000","last_fullsized":"2024-09-10T08:40:38.594932+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604016+0000","last_change":"2024-09-10T08:40:39.602559+0000","last_active":"2024-09-10T08:40:39.604016+0000","last_peered":"2024-09-10T08:40:39.604016+0000","last_clean":"2024-09-10T08:40:39.604016+0000","last_became_active":"2024-09-10T08:40:39.601707+0000","last_became_peered":"2024-09-10T08:40:39.601707+0000","last_unstale":"2024-09-10T08:40:39.604016+0000","last_undegraded":"2024-09-10T08:40:39.604016+0000","last_fullsized":"2024-09-10T08:40:39.604016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:47.154878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609518+0000","last_change":"2024-09-10T08:40:39.606541+0000","last_active":"2024-09-10T08:40:39.609518+0000","last_peered":"2024-09-10T08:40:39.609518+0000","last_clean":"2024-09-10T08:40:39.609518+0000","last_became_active":"2024-09-10T08:40:39.605678+0000","last_became_peered":"2024-09-10T08:40:39.605678+0000","last_unstale":"2024-09-10T08:40:39.609518+0000","last_undegraded":"2024-09-10T08:40:39.609518+0000","last_fullsized":"2024-09-10T08:40:39.609518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610811+0000","last_change":"2024-09-10T08:40:39.607744+0000","last_active":"2024-09-10T08:40:39.610811+0000","last_peered":"2024-09-10T08:40:39.610811+0000","last_clean":"2024-09-10T08:40:39.610811+0000","last_became_active":"2024-09-10T08:40:39.604829+0000","last_became_peered":"2024-09-10T08:40:39.604829+0000","last_unstale":"2024-09-10T08:40:39.610811+0000","last_undegraded":"2024-09-10T08:40:39.610811+0000","last_fullsized":"2024-09-10T08:40:39.610811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:17.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615549+0000","last_change":"2024-09-10T08:40:39.607658+0000","last_active":"2024-09-10T08:40:39.615549+0000","last_peered":"2024-09-10T08:40:39.615549+0000","last_clean":"2024-09-10T08:40:39.615549+0000","last_became_active":"2024-09-10T08:40:39.607088+0000","last_became_peered":"2024-09-10T08:40:39.607088+0000","last_unstale":"2024-09-10T08:40:39.615549+0000","last_undegraded":"2024-09-10T08:40:39.615549+0000","last_fullsized":"2024-09-10T08:40:39.615549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:12.010728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595229+0000","last_change":"2024-09-10T08:40:39.590285+0000","last_active":"2024-09-10T08:40:39.595229+0000","last_peered":"2024-09-10T08:40:39.595229+0000","last_clean":"2024-09-10T08:40:39.595229+0000","last_became_active":"2024-09-10T08:40:39.588993+0000","last_became_peered":"2024-09-10T08:40:39.588993+0000","last_unstale":"2024-09-10T08:40:39.595229+0000","last_undegraded":"2024-09-10T08:40:39.595229+0000","last_fullsized":"2024-09-10T08:40:39.595229+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:07.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595772+0000","last_change":"2024-09-10T08:40:38.595772+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595772+0000","last_undegraded":"2024-09-10T08:40:38.595772+0000","last_fullsized":"2024-09-10T08:40:38.595772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611382+0000","last_change":"2024-09-10T08:40:39.610193+0000","last_active":"2024-09-10T08:40:39.611382+0000","last_peered":"2024-09-10T08:40:39.611382+0000","last_clean":"2024-09-10T08:40:39.611382+0000","last_became_active":"2024-09-10T08:40:39.609275+0000","last_became_peered":"2024-09-10T08:40:39.609275+0000","last_unstale":"2024-09-10T08:40:39.611382+0000","last_undegraded":"2024-09-10T08:40:39.611382+0000","last_fullsized":"2024-09-10T08:40:39.611382+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:42.617055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.612711+0000","last_change":"2024-09-10T08:40:39.610728+0000","last_active":"2024-09-10T08:40:39.612711+0000","last_peered":"2024-09-10T08:40:39.612711+0000","last_clean":"2024-09-10T08:40:39.612711+0000","last_became_active":"2024-09-10T08:40:39.609408+0000","last_became_peered":"2024-09-10T08:40:39.609408+0000","last_unstale":"2024-09-10T08:40:39.612711+0000","last_undegraded":"2024-09-10T08:40:39.612711+0000","last_fullsized":"2024-09-10T08:40:39.612711+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:41.928734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595387+0000","last_change":"2024-09-10T08:40:39.589135+0000","last_active":"2024-09-10T08:40:39.595387+0000","last_peered":"2024-09-10T08:40:39.595387+0000","last_clean":"2024-09-10T08:40:39.595387+0000","last_became_active":"2024-09-10T08:40:39.588819+0000","last_became_peered":"2024-09-10T08:40:39.588819+0000","last_unstale":"2024-09-10T08:40:39.595387+0000","last_undegraded":"2024-09-10T08:40:39.595387+0000","last_fullsized":"2024-09-10T08:40:39.595387+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:45.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598018+0000","last_change":"2024-09-10T08:40:39.597382+0000","last_active":"2024-09-10T08:40:39.598018+0000","last_peered":"2024-09-10T08:40:39.598018+0000","last_clean":"2024-09-10T08:40:39.598018+0000","last_became_active":"2024-09-10T08:40:39.597095+0000","last_became_peered":"2024-09-10T08:40:39.597095+0000","last_unstale":"2024-09-10T08:40:39.598018+0000","last_undegraded":"2024-09-10T08:40:39.598018+0000","last_fullsized":"2024-09-10T08:40:39.598018+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.724926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616582+0000","last_change":"2024-09-10T08:40:39.615657+0000","last_active":"2024-09-10T08:40:39.616582+0000","last_peered":"2024-09-10T08:40:39.616582+0000","last_clean":"2024-09-10T08:40:39.616582+0000","last_became_active":"2024-09-10T08:40:39.615390+0000","last_became_peered":"2024-09-10T08:40:39.615390+0000","last_unstale":"2024-09-10T08:40:39.616582+0000","last_undegraded":"2024-09-10T08:40:39.616582+0000","last_fullsized":"2024-09-10T08:40:39.616582+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604283+0000","last_change":"2024-09-10T08:40:39.603264+0000","last_active":"2024-09-10T08:40:39.604283+0000","last_peered":"2024-09-10T08:40:39.604283+0000","last_clean":"2024-09-10T08:40:39.604283+0000","last_became_active":"2024-09-10T08:40:39.602001+0000","last_became_peered":"2024-09-10T08:40:39.602001+0000","last_unstale":"2024-09-10T08:40:39.604283+0000","last_undegraded":"2024-09-10T08:40:39.604283+0000","last_fullsized":"2024-09-10T08:40:39.604283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.606585+0000","last_change":"2024-09-10T08:40:38.604785+0000","last_active":"2024-09-10T08:40:38.606585+0000","last_peered":"2024-09-10T08:40:38.606585+0000","last_clean":"2024-09-10T08:40:38.606585+0000","last_became_active":"2024-09-10T08:40:38.604514+0000","last_became_peered":"2024-09-10T08:40:38.604514+0000","last_unstale":"2024-09-10T08:40:38.606585+0000","last_undegraded":"2024-09-10T08:40:38.606585+0000","last_fullsized":"2024-09-10T08:40:38.606585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:29.631375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609620+0000","last_change":"2024-09-10T08:40:39.607215+0000","last_active":"2024-09-10T08:40:39.609620+0000","last_peered":"2024-09-10T08:40:39.609620+0000","last_clean":"2024-09-10T08:40:39.609620+0000","last_became_active":"2024-09-10T08:40:39.606858+0000","last_became_peered":"2024-09-10T08:40:39.606858+0000","last_unstale":"2024-09-10T08:40:39.609620+0000","last_undegraded":"2024-09-10T08:40:39.609620+0000","last_fullsized":"2024-09-10T08:40:39.609620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:09.425294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619702+0000","last_change":"2024-09-10T08:40:38.603266+0000","last_active":"2024-09-10T08:40:39.619702+0000","last_peered":"2024-09-10T08:40:39.619702+0000","last_clean":"2024-09-10T08:40:39.619702+0000","last_became_active":"2024-09-10T08:40:38.602932+0000","last_became_peered":"2024-09-10T08:40:38.602932+0000","last_unstale":"2024-09-10T08:40:39.619702+0000","last_undegraded":"2024-09-10T08:40:39.619702+0000","last_fullsized":"2024-09-10T08:40:39.619702+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.782228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616084+0000","last_change":"2024-09-10T08:40:39.609371+0000","last_active":"2024-09-10T08:40:39.616084+0000","last_peered":"2024-09-10T08:40:39.616084+0000","last_clean":"2024-09-10T08:40:39.616084+0000","last_became_active":"2024-09-10T08:40:39.609083+0000","last_became_peered":"2024-09-10T08:40:39.609083+0000","last_unstale":"2024-09-10T08:40:39.616084+0000","last_undegraded":"2024-09-10T08:40:39.616084+0000","last_fullsized":"2024-09-10T08:40:39.616084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:04.082259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621677+0000","last_change":"2024-09-10T08:40:38.611280+0000","last_active":"2024-09-10T08:40:39.621677+0000","last_peered":"2024-09-10T08:40:39.621677+0000","last_clean":"2024-09-10T08:40:39.621677+0000","last_became_active":"2024-09-10T08:40:38.610992+0000","last_became_peered":"2024-09-10T08:40:38.610992+0000","last_unstale":"2024-09-10T08:40:39.621677+0000","last_undegraded":"2024-09-10T08:40:39.621677+0000","last_fullsized":"2024-09-10T08:40:39.621677+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615697+0000","last_change":"2024-09-10T08:40:39.608923+0000","last_active":"2024-09-10T08:40:39.615697+0000","last_peered":"2024-09-10T08:40:39.615697+0000","last_clean":"2024-09-10T08:40:39.615697+0000","last_became_active":"2024-09-10T08:40:39.608659+0000","last_became_peered":"2024-09-10T08:40:39.608659+0000","last_unstale":"2024-09-10T08:40:39.615697+0000","last_undegraded":"2024-09-10T08:40:39.615697+0000","last_fullsized":"2024-09-10T08:40:39.615697+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:26.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622253+0000","last_change":"2024-09-10T08:40:38.603525+0000","last_active":"2024-09-10T08:40:39.622253+0000","last_peered":"2024-09-10T08:40:39.622253+0000","last_clean":"2024-09-10T08:40:39.622253+0000","last_became_active":"2024-09-10T08:40:38.603260+0000","last_became_peered":"2024-09-10T08:40:38.603260+0000","last_unstale":"2024-09-10T08:40:39.622253+0000","last_undegraded":"2024-09-10T08:40:39.622253+0000","last_fullsized":"2024-09-10T08:40:39.622253+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:55.827552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607782+0000","last_change":"2024-09-10T08:40:39.601136+0000","last_active":"2024-09-10T08:40:39.607782+0000","last_peered":"2024-09-10T08:40:39.607782+0000","last_clean":"2024-09-10T08:40:39.607782+0000","last_became_active":"2024-09-10T08:40:39.600532+0000","last_became_peered":"2024-09-10T08:40:39.600532+0000","last_unstale":"2024-09-10T08:40:39.607782+0000","last_undegraded":"2024-09-10T08:40:39.607782+0000","last_fullsized":"2024-09-10T08:40:39.607782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:07.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621755+0000","last_change":"2024-09-10T08:40:38.610462+0000","last_active":"2024-09-10T08:40:39.621755+0000","last_peered":"2024-09-10T08:40:39.621755+0000","last_clean":"2024-09-10T08:40:39.621755+0000","last_became_active":"2024-09-10T08:40:38.610181+0000","last_became_peered":"2024-09-10T08:40:38.610181+0000","last_unstale":"2024-09-10T08:40:39.621755+0000","last_undegraded":"2024-09-10T08:40:39.621755+0000","last_fullsized":"2024-09-10T08:40:39.621755+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:40.925346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616405+0000","last_change":"2024-09-10T08:40:39.615214+0000","last_active":"2024-09-10T08:40:39.616405+0000","last_peered":"2024-09-10T08:40:39.616405+0000","last_clean":"2024-09-10T08:40:39.616405+0000","last_became_active":"2024-09-10T08:40:39.614895+0000","last_became_peered":"2024-09-10T08:40:39.614895+0000","last_unstale":"2024-09-10T08:40:39.616405+0000","last_undegraded":"2024-09-10T08:40:39.616405+0000","last_fullsized":"2024-09-10T08:40:39.616405+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621084+0000","last_change":"2024-09-10T08:40:38.608616+0000","last_active":"2024-09-10T08:40:39.621084+0000","last_peered":"2024-09-10T08:40:39.621084+0000","last_clean":"2024-09-10T08:40:39.621084+0000","last_became_active":"2024-09-10T08:40:38.608335+0000","last_became_peered":"2024-09-10T08:40:38.608335+0000","last_unstale":"2024-09-10T08:40:39.621084+0000","last_undegraded":"2024-09-10T08:40:39.621084+0000","last_fullsized":"2024-09-10T08:40:39.621084+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:01.508308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608152+0000","last_change":"2024-09-10T08:40:39.600898+0000","last_active":"2024-09-10T08:40:39.608152+0000","last_peered":"2024-09-10T08:40:39.608152+0000","last_clean":"2024-09-10T08:40:39.608152+0000","last_became_active":"2024-09-10T08:40:39.600580+0000","last_became_peered":"2024-09-10T08:40:39.600580+0000","last_unstale":"2024-09-10T08:40:39.608152+0000","last_undegraded":"2024-09-10T08:40:39.608152+0000","last_fullsized":"2024-09-10T08:40:39.608152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:36.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.587705+0000","last_change":"2024-09-10T08:40:38.602353+0000","last_active":"2024-09-10T08:40:39.587705+0000","last_peered":"2024-09-10T08:40:39.587705+0000","last_clean":"2024-09-10T08:40:39.587705+0000","last_became_active":"2024-09-10T08:40:38.601969+0000","last_became_peered":"2024-09-10T08:40:38.601969+0000","last_unstale":"2024-09-10T08:40:39.587705+0000","last_undegraded":"2024-09-10T08:40:39.587705+0000","last_fullsized":"2024-09-10T08:40:39.587705+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.613667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596152+0000","last_change":"2024-09-10T08:40:38.596152+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596152+0000","last_undegraded":"2024-09-10T08:40:38.596152+0000","last_fullsized":"2024-09-10T08:40:38.596152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590590+0000","last_change":"2024-09-10T08:40:38.606684+0000","last_active":"2024-09-10T08:40:39.590590+0000","last_peered":"2024-09-10T08:40:39.590590+0000","last_clean":"2024-09-10T08:40:39.590590+0000","last_became_active":"2024-09-10T08:40:38.606419+0000","last_became_peered":"2024-09-10T08:40:38.606419+0000","last_unstale":"2024-09-10T08:40:39.590590+0000","last_undegraded":"2024-09-10T08:40:39.590590+0000","last_fullsized":"2024-09-10T08:40:39.590590+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:58.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609813+0000","last_change":"2024-09-10T08:40:39.608373+0000","last_active":"2024-09-10T08:40:39.609813+0000","last_peered":"2024-09-10T08:40:39.609813+0000","last_clean":"2024-09-10T08:40:39.609813+0000","last_became_active":"2024-09-10T08:40:39.607215+0000","last_became_peered":"2024-09-10T08:40:39.607215+0000","last_unstale":"2024-09-10T08:40:39.609813+0000","last_undegraded":"2024-09-10T08:40:39.609813+0000","last_fullsized":"2024-09-10T08:40:39.609813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:30.447019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598441+0000","last_change":"2024-09-10T08:40:38.602257+0000","last_active":"2024-09-10T08:40:39.598441+0000","last_peered":"2024-09-10T08:40:39.598441+0000","last_clean":"2024-09-10T08:40:39.598441+0000","last_became_active":"2024-09-10T08:40:38.600878+0000","last_became_peered":"2024-09-10T08:40:38.600878+0000","last_unstale":"2024-09-10T08:40:39.598441+0000","last_undegraded":"2024-09-10T08:40:39.598441+0000","last_fullsized":"2024-09-10T08:40:39.598441+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:16.094429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595667+0000","last_change":"2024-09-10T08:40:39.590087+0000","last_active":"2024-09-10T08:40:39.595667+0000","last_peered":"2024-09-10T08:40:39.595667+0000","last_clean":"2024-09-10T08:40:39.595667+0000","last_became_active":"2024-09-10T08:40:39.589804+0000","last_became_peered":"2024-09-10T08:40:39.589804+0000","last_unstale":"2024-09-10T08:40:39.595667+0000","last_undegraded":"2024-09-10T08:40:39.595667+0000","last_fullsized":"2024-09-10T08:40:39.595667+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621914+0000","last_change":"2024-09-10T08:40:38.609058+0000","last_active":"2024-09-10T08:40:39.621914+0000","last_peered":"2024-09-10T08:40:39.621914+0000","last_clean":"2024-09-10T08:40:39.621914+0000","last_became_active":"2024-09-10T08:40:38.608401+0000","last_became_peered":"2024-09-10T08:40:38.608401+0000","last_unstale":"2024-09-10T08:40:39.621914+0000","last_undegraded":"2024-09-10T08:40:39.621914+0000","last_fullsized":"2024-09-10T08:40:39.621914+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:55.897796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608791+0000","last_change":"2024-09-10T08:40:39.605532+0000","last_active":"2024-09-10T08:40:39.608791+0000","last_peered":"2024-09-10T08:40:39.608791+0000","last_clean":"2024-09-10T08:40:39.608791+0000","last_became_active":"2024-09-10T08:40:39.605078+0000","last_became_peered":"2024-09-10T08:40:39.605078+0000","last_unstale":"2024-09-10T08:40:39.608791+0000","last_undegraded":"2024-09-10T08:40:39.608791+0000","last_fullsized":"2024-09-10T08:40:39.608791+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.624689+0000","last_change":"2024-09-10T08:40:38.609036+0000","last_active":"2024-09-10T08:40:39.624689+0000","last_peered":"2024-09-10T08:40:39.624689+0000","last_clean":"2024-09-10T08:40:39.624689+0000","last_became_active":"2024-09-10T08:40:38.608738+0000","last_became_peered":"2024-09-10T08:40:38.608738+0000","last_unstale":"2024-09-10T08:40:39.624689+0000","last_undegraded":"2024-09-10T08:40:39.624689+0000","last_fullsized":"2024-09-10T08:40:39.624689+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:47.126499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608788+0000","last_change":"2024-09-10T08:40:39.605430+0000","last_active":"2024-09-10T08:40:39.608788+0000","last_peered":"2024-09-10T08:40:39.608788+0000","last_clean":"2024-09-10T08:40:39.608788+0000","last_became_active":"2024-09-10T08:40:39.603647+0000","last_became_peered":"2024-09-10T08:40:39.603647+0000","last_unstale":"2024-09-10T08:40:39.608788+0000","last_undegraded":"2024-09-10T08:40:39.608788+0000","last_fullsized":"2024-09-10T08:40:39.608788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621597+0000","last_change":"2024-09-10T08:40:38.608957+0000","last_active":"2024-09-10T08:40:39.621597+0000","last_peered":"2024-09-10T08:40:39.621597+0000","last_clean":"2024-09-10T08:40:39.621597+0000","last_became_active":"2024-09-10T08:40:38.608520+0000","last_became_peered":"2024-09-10T08:40:38.608520+0000","last_unstale":"2024-09-10T08:40:39.621597+0000","last_undegraded":"2024-09-10T08:40:39.621597+0000","last_fullsized":"2024-09-10T08:40:39.621597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:05.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598629+0000","last_change":"2024-09-10T08:40:39.596837+0000","last_active":"2024-09-10T08:40:39.598629+0000","last_peered":"2024-09-10T08:40:39.598629+0000","last_clean":"2024-09-10T08:40:39.598629+0000","last_became_active":"2024-09-10T08:40:39.596457+0000","last_became_peered":"2024-09-10T08:40:39.596457+0000","last_unstale":"2024-09-10T08:40:39.598629+0000","last_undegraded":"2024-09-10T08:40:39.598629+0000","last_fullsized":"2024-09-10T08:40:39.598629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599214+0000","last_change":"2024-09-10T08:40:38.599901+0000","last_active":"2024-09-10T08:40:39.599214+0000","last_peered":"2024-09-10T08:40:39.599214+0000","last_clean":"2024-09-10T08:40:39.599214+0000","last_became_active":"2024-09-10T08:40:38.599571+0000","last_became_peered":"2024-09-10T08:40:38.599571+0000","last_unstale":"2024-09-10T08:40:39.599214+0000","last_undegraded":"2024-09-10T08:40:39.599214+0000","last_fullsized":"2024-09-10T08:40:39.599214+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:05.993602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595690+0000","last_change":"2024-09-10T08:40:39.593816+0000","last_active":"2024-09-10T08:40:39.595690+0000","last_peered":"2024-09-10T08:40:39.595690+0000","last_clean":"2024-09-10T08:40:39.595690+0000","last_became_active":"2024-09-10T08:40:39.592965+0000","last_became_peered":"2024-09-10T08:40:39.592965+0000","last_unstale":"2024-09-10T08:40:39.595690+0000","last_undegraded":"2024-09-10T08:40:39.595690+0000","last_fullsized":"2024-09-10T08:40:39.595690+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:35.945534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593166+0000","last_change":"2024-09-10T08:40:38.606357+0000","last_active":"2024-09-10T08:40:39.593166+0000","last_peered":"2024-09-10T08:40:39.593166+0000","last_clean":"2024-09-10T08:40:39.593166+0000","last_became_active":"2024-09-10T08:40:38.606082+0000","last_became_peered":"2024-09-10T08:40:38.606082+0000","last_unstale":"2024-09-10T08:40:39.593166+0000","last_undegraded":"2024-09-10T08:40:39.593166+0000","last_fullsized":"2024-09-10T08:40:39.593166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:06.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611654+0000","last_change":"2024-09-10T08:40:39.611019+0000","last_active":"2024-09-10T08:40:39.611654+0000","last_peered":"2024-09-10T08:40:39.611654+0000","last_clean":"2024-09-10T08:40:39.611654+0000","last_became_active":"2024-09-10T08:40:39.610479+0000","last_became_peered":"2024-09-10T08:40:39.610479+0000","last_unstale":"2024-09-10T08:40:39.611654+0000","last_undegraded":"2024-09-10T08:40:39.611654+0000","last_fullsized":"2024-09-10T08:40:39.611654+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:06.996990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.623156+0000","last_change":"2024-09-10T08:40:38.599942+0000","last_active":"2024-09-10T08:40:39.623156+0000","last_peered":"2024-09-10T08:40:39.623156+0000","last_clean":"2024-09-10T08:40:39.623156+0000","last_became_active":"2024-09-10T08:40:38.599603+0000","last_became_peered":"2024-09-10T08:40:38.599603+0000","last_unstale":"2024-09-10T08:40:39.623156+0000","last_undegraded":"2024-09-10T08:40:39.623156+0000","last_fullsized":"2024-09-10T08:40:39.623156+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:44.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610303+0000","last_change":"2024-09-10T08:40:39.608592+0000","last_active":"2024-09-10T08:40:39.610303+0000","last_peered":"2024-09-10T08:40:39.610303+0000","last_clean":"2024-09-10T08:40:39.610303+0000","last_became_active":"2024-09-10T08:40:39.603659+0000","last_became_peered":"2024-09-10T08:40:39.603659+0000","last_unstale":"2024-09-10T08:40:39.610303+0000","last_undegraded":"2024-09-10T08:40:39.610303+0000","last_fullsized":"2024-09-10T08:40:39.610303+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:25.399740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622148+0000","last_change":"2024-09-10T08:40:38.609734+0000","last_active":"2024-09-10T08:40:39.622148+0000","last_peered":"2024-09-10T08:40:39.622148+0000","last_clean":"2024-09-10T08:40:39.622148+0000","last_became_active":"2024-09-10T08:40:38.609463+0000","last_became_peered":"2024-09-10T08:40:38.609463+0000","last_unstale":"2024-09-10T08:40:39.622148+0000","last_undegraded":"2024-09-10T08:40:39.622148+0000","last_fullsized":"2024-09-10T08:40:39.622148+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:35.083024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599659+0000","last_change":"2024-09-10T08:40:39.597891+0000","last_active":"2024-09-10T08:40:39.599659+0000","last_peered":"2024-09-10T08:40:39.599659+0000","last_clean":"2024-09-10T08:40:39.599659+0000","last_became_active":"2024-09-10T08:40:39.597179+0000","last_became_peered":"2024-09-10T08:40:39.597179+0000","last_unstale":"2024-09-10T08:40:39.599659+0000","last_undegraded":"2024-09-10T08:40:39.599659+0000","last_fullsized":"2024-09-10T08:40:39.599659+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.116764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619027+0000","last_change":"2024-09-10T08:40:38.609455+0000","last_active":"2024-09-10T08:40:39.619027+0000","last_peered":"2024-09-10T08:40:39.619027+0000","last_clean":"2024-09-10T08:40:39.619027+0000","last_became_active":"2024-09-10T08:40:38.609193+0000","last_became_peered":"2024-09-10T08:40:38.609193+0000","last_unstale":"2024-09-10T08:40:39.619027+0000","last_undegraded":"2024-09-10T08:40:39.619027+0000","last_fullsized":"2024-09-10T08:40:39.619027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:23.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613972+0000","last_change":"2024-09-10T08:40:39.604315+0000","last_active":"2024-09-10T08:40:39.613972+0000","last_peered":"2024-09-10T08:40:39.613972+0000","last_clean":"2024-09-10T08:40:39.613972+0000","last_became_active":"2024-09-10T08:40:39.603974+0000","last_became_peered":"2024-09-10T08:40:39.603974+0000","last_unstale":"2024-09-10T08:40:39.613972+0000","last_undegraded":"2024-09-10T08:40:39.613972+0000","last_fullsized":"2024-09-10T08:40:39.613972+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:37.302990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616894+0000","last_change":"2024-09-10T08:40:38.604618+0000","last_active":"2024-09-10T08:40:39.616894+0000","last_peered":"2024-09-10T08:40:39.616894+0000","last_clean":"2024-09-10T08:40:39.616894+0000","last_became_active":"2024-09-10T08:40:38.603739+0000","last_became_peered":"2024-09-10T08:40:38.603739+0000","last_unstale":"2024-09-10T08:40:39.616894+0000","last_undegraded":"2024-09-10T08:40:39.616894+0000","last_fullsized":"2024-09-10T08:40:39.616894+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:18.461479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595522+0000","last_change":"2024-09-10T08:40:39.591588+0000","last_active":"2024-09-10T08:40:39.595522+0000","last_peered":"2024-09-10T08:40:39.595522+0000","last_clean":"2024-09-10T08:40:39.595522+0000","last_became_active":"2024-09-10T08:40:39.591319+0000","last_became_peered":"2024-09-10T08:40:39.591319+0000","last_unstale":"2024-09-10T08:40:39.595522+0000","last_undegraded":"2024-09-10T08:40:39.595522+0000","last_fullsized":"2024-09-10T08:40:39.595522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:48.129887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592375+0000","last_change":"2024-09-10T08:40:38.607426+0000","last_active":"2024-09-10T08:40:39.592375+0000","last_peered":"2024-09-10T08:40:39.592375+0000","last_clean":"2024-09-10T08:40:39.592375+0000","last_became_active":"2024-09-10T08:40:38.606843+0000","last_became_peered":"2024-09-10T08:40:38.606843+0000","last_unstale":"2024-09-10T08:40:39.592375+0000","last_undegraded":"2024-09-10T08:40:39.592375+0000","last_fullsized":"2024-09-10T08:40:39.592375+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:12.746003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604029+0000","last_change":"2024-09-10T08:40:39.595611+0000","last_active":"2024-09-10T08:40:39.604029+0000","last_peered":"2024-09-10T08:40:39.604029+0000","last_clean":"2024-09-10T08:40:39.604029+0000","last_became_active":"2024-09-10T08:40:39.593091+0000","last_became_peered":"2024-09-10T08:40:39.593091+0000","last_unstale":"2024-09-10T08:40:39.604029+0000","last_undegraded":"2024-09-10T08:40:39.604029+0000","last_fullsized":"2024-09-10T08:40:39.604029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.263677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621202+0000","last_change":"2024-09-10T08:40:38.612800+0000","last_active":"2024-09-10T08:40:39.621202+0000","last_peered":"2024-09-10T08:40:39.621202+0000","last_clean":"2024-09-10T08:40:39.621202+0000","last_became_active":"2024-09-10T08:40:38.612501+0000","last_became_peered":"2024-09-10T08:40:38.612501+0000","last_unstale":"2024-09-10T08:40:39.621202+0000","last_undegraded":"2024-09-10T08:40:39.621202+0000","last_fullsized":"2024-09-10T08:40:39.621202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:17.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608648+0000","last_change":"2024-09-10T08:40:39.607946+0000","last_active":"2024-09-10T08:40:39.608648+0000","last_peered":"2024-09-10T08:40:39.608648+0000","last_clean":"2024-09-10T08:40:39.608648+0000","last_became_active":"2024-09-10T08:40:39.607670+0000","last_became_peered":"2024-09-10T08:40:39.607670+0000","last_unstale":"2024-09-10T08:40:39.608648+0000","last_undegraded":"2024-09-10T08:40:39.608648+0000","last_fullsized":"2024-09-10T08:40:39.608648+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585166+0000","last_change":"2024-09-10T08:40:38.609194+0000","last_active":"2024-09-10T08:40:39.585166+0000","last_peered":"2024-09-10T08:40:39.585166+0000","last_clean":"2024-09-10T08:40:39.585166+0000","last_became_active":"2024-09-10T08:40:38.608754+0000","last_became_peered":"2024-09-10T08:40:38.608754+0000","last_unstale":"2024-09-10T08:40:39.585166+0000","last_undegraded":"2024-09-10T08:40:39.585166+0000","last_fullsized":"2024-09-10T08:40:39.585166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.065351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.605233+0000","last_change":"2024-09-10T08:40:39.597582+0000","last_active":"2024-09-10T08:40:39.605233+0000","last_peered":"2024-09-10T08:40:39.605233+0000","last_clean":"2024-09-10T08:40:39.605233+0000","last_became_active":"2024-09-10T08:40:39.597309+0000","last_became_peered":"2024-09-10T08:40:39.597309+0000","last_unstale":"2024-09-10T08:40:39.605233+0000","last_undegraded":"2024-09-10T08:40:39.605233+0000","last_fullsized":"2024-09-10T08:40:39.605233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:44.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585031+0000","last_change":"2024-09-10T08:40:38.602833+0000","last_active":"2024-09-10T08:40:39.585031+0000","last_peered":"2024-09-10T08:40:39.585031+0000","last_clean":"2024-09-10T08:40:39.585031+0000","last_became_active":"2024-09-10T08:40:38.602520+0000","last_became_peered":"2024-09-10T08:40:38.602520+0000","last_unstale":"2024-09-10T08:40:39.585031+0000","last_undegraded":"2024-09-10T08:40:39.585031+0000","last_fullsized":"2024-09-10T08:40:39.585031+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:31.477687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608666+0000","last_change":"2024-09-10T08:40:39.605369+0000","last_active":"2024-09-10T08:40:39.608666+0000","last_peered":"2024-09-10T08:40:39.608666+0000","last_clean":"2024-09-10T08:40:39.608666+0000","last_became_active":"2024-09-10T08:40:39.604880+0000","last_became_peered":"2024-09-10T08:40:39.604880+0000","last_unstale":"2024-09-10T08:40:39.608666+0000","last_undegraded":"2024-09-10T08:40:39.608666+0000","last_fullsized":"2024-09-10T08:40:39.608666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590185+0000","last_change":"2024-09-10T08:40:38.602333+0000","last_active":"2024-09-10T08:40:39.590185+0000","last_peered":"2024-09-10T08:40:39.590185+0000","last_clean":"2024-09-10T08:40:39.590185+0000","last_became_active":"2024-09-10T08:40:38.599744+0000","last_became_peered":"2024-09-10T08:40:38.599744+0000","last_unstale":"2024-09-10T08:40:39.590185+0000","last_undegraded":"2024-09-10T08:40:39.590185+0000","last_fullsized":"2024-09-10T08:40:39.590185+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:44.559698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595680+0000","last_change":"2024-09-10T08:40:38.595680+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595680+0000","last_undegraded":"2024-09-10T08:40:38.595680+0000","last_fullsized":"2024-09-10T08:40:38.595680+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613473+0000","last_change":"2024-09-10T08:40:38.611840+0000","last_active":"2024-09-10T08:40:39.613473+0000","last_peered":"2024-09-10T08:40:39.613473+0000","last_clean":"2024-09-10T08:40:39.613473+0000","last_became_active":"2024-09-10T08:40:38.611553+0000","last_became_peered":"2024-09-10T08:40:38.611553+0000","last_unstale":"2024-09-10T08:40:39.613473+0000","last_undegraded":"2024-09-10T08:40:39.613473+0000","last_fullsized":"2024-09-10T08:40:39.613473+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:46.146476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.597389+0000","last_change":"2024-09-10T08:40:38.597389+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.597389+0000","last_undegraded":"2024-09-10T08:40:38.597389+0000","last_fullsized":"2024-09-10T08:40:38.597389+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.608107+0000","last_change":"2024-09-10T08:40:38.606693+0000","last_active":"2024-09-10T08:40:38.608107+0000","last_peered":"2024-09-10T08:40:38.608107+0000","last_clean":"2024-09-10T08:40:38.608107+0000","last_became_active":"2024-09-10T08:40:38.605494+0000","last_became_peered":"2024-09-10T08:40:38.605494+0000","last_unstale":"2024-09-10T08:40:38.608107+0000","last_undegraded":"2024-09-10T08:40:38.608107+0000","last_fullsized":"2024-09-10T08:40:38.608107+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:23.432231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.598658+0000","last_change":"2024-09-10T08:40:38.598658+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.598658+0000","last_undegraded":"2024-09-10T08:40:38.598658+0000","last_fullsized":"2024-09-10T08:40:38.598658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.605973+0000","last_change":"2024-09-10T08:40:38.601853+0000","last_active":"2024-09-10T08:40:38.605973+0000","last_peered":"2024-09-10T08:40:38.605973+0000","last_clean":"2024-09-10T08:40:38.605973+0000","last_became_active":"2024-09-10T08:40:38.601534+0000","last_became_peered":"2024-09-10T08:40:38.601534+0000","last_unstale":"2024-09-10T08:40:38.605973+0000","last_undegraded":"2024-09-10T08:40:38.605973+0000","last_fullsized":"2024-09-10T08:40:38.605973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:15.105563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615796+0000","last_change":"2024-09-10T08:40:39.614735+0000","last_active":"2024-09-10T08:40:39.615796+0000","last_peered":"2024-09-10T08:40:39.615796+0000","last_clean":"2024-09-10T08:40:39.615796+0000","last_became_active":"2024-09-10T08:40:39.614305+0000","last_became_peered":"2024-09-10T08:40:39.614305+0000","last_unstale":"2024-09-10T08:40:39.615796+0000","last_undegraded":"2024-09-10T08:40:39.615796+0000","last_fullsized":"2024-09-10T08:40:39.615796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593911+0000","last_change":"2024-09-10T08:40:38.607592+0000","last_active":"2024-09-10T08:40:39.593911+0000","last_peered":"2024-09-10T08:40:39.593911+0000","last_clean":"2024-09-10T08:40:39.593911+0000","last_became_active":"2024-09-10T08:40:38.607327+0000","last_became_peered":"2024-09-10T08:40:38.607327+0000","last_unstale":"2024-09-10T08:40:39.593911+0000","last_undegraded":"2024-09-10T08:40:39.593911+0000","last_fullsized":"2024-09-10T08:40:39.593911+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.942146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614886+0000","last_change":"2024-09-10T08:40:39.605335+0000","last_active":"2024-09-10T08:40:39.614886+0000","last_peered":"2024-09-10T08:40:39.614886+0000","last_clean":"2024-09-10T08:40:39.614886+0000","last_became_active":"2024-09-10T08:40:39.605015+0000","last_became_peered":"2024-09-10T08:40:39.605015+0000","last_unstale":"2024-09-10T08:40:39.614886+0000","last_undegraded":"2024-09-10T08:40:39.614886+0000","last_fullsized":"2024-09-10T08:40:39.614886+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:48.987807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592390+0000","last_change":"2024-09-10T08:40:38.604528+0000","last_active":"2024-09-10T08:40:39.592390+0000","last_peered":"2024-09-10T08:40:39.592390+0000","last_clean":"2024-09-10T08:40:39.592390+0000","last_became_active":"2024-09-10T08:40:38.602419+0000","last_became_peered":"2024-09-10T08:40:38.602419+0000","last_unstale":"2024-09-10T08:40:39.592390+0000","last_undegraded":"2024-09-10T08:40:39.592390+0000","last_fullsized":"2024-09-10T08:40:39.592390+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:53.016826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608198+0000","last_change":"2024-09-10T08:40:39.600972+0000","last_active":"2024-09-10T08:40:39.608198+0000","last_peered":"2024-09-10T08:40:39.608198+0000","last_clean":"2024-09-10T08:40:39.608198+0000","last_became_active":"2024-09-10T08:40:39.600696+0000","last_became_peered":"2024-09-10T08:40:39.600696+0000","last_unstale":"2024-09-10T08:40:39.608198+0000","last_undegraded":"2024-09-10T08:40:39.608198+0000","last_fullsized":"2024-09-10T08:40:39.608198+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:44.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597585+0000","last_change":"2024-09-10T08:40:38.598840+0000","last_active":"2024-09-10T08:40:39.597585+0000","last_peered":"2024-09-10T08:40:39.597585+0000","last_clean":"2024-09-10T08:40:39.597585+0000","last_became_active":"2024-09-10T08:40:38.598539+0000","last_became_peered":"2024-09-10T08:40:38.598539+0000","last_unstale":"2024-09-10T08:40:39.597585+0000","last_undegraded":"2024-09-10T08:40:39.597585+0000","last_fullsized":"2024-09-10T08:40:39.597585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:40.709904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616557+0000","last_change":"2024-09-10T08:40:39.610363+0000","last_active":"2024-09-10T08:40:39.616557+0000","last_peered":"2024-09-10T08:40:39.616557+0000","last_clean":"2024-09-10T08:40:39.616557+0000","last_became_active":"2024-09-10T08:40:39.609936+0000","last_became_peered":"2024-09-10T08:40:39.609936+0000","last_unstale":"2024-09-10T08:40:39.616557+0000","last_undegraded":"2024-09-10T08:40:39.616557+0000","last_fullsized":"2024-09-10T08:40:39.616557+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:59.391662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597883+0000","last_change":"2024-09-10T08:40:38.600904+0000","last_active":"2024-09-10T08:40:39.597883+0000","last_peered":"2024-09-10T08:40:39.597883+0000","last_clean":"2024-09-10T08:40:39.597883+0000","last_became_active":"2024-09-10T08:40:38.600572+0000","last_became_peered":"2024-09-10T08:40:38.600572+0000","last_unstale":"2024-09-10T08:40:39.597883+0000","last_undegraded":"2024-09-10T08:40:39.597883+0000","last_fullsized":"2024-09-10T08:40:39.597883+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:16.573172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609866+0000","last_change":"2024-09-10T08:40:39.605511+0000","last_active":"2024-09-10T08:40:39.609866+0000","last_peered":"2024-09-10T08:40:39.609866+0000","last_clean":"2024-09-10T08:40:39.609866+0000","last_became_active":"2024-09-10T08:40:39.605208+0000","last_became_peered":"2024-09-10T08:40:39.605208+0000","last_unstale":"2024-09-10T08:40:39.609866+0000","last_undegraded":"2024-09-10T08:40:39.609866+0000","last_fullsized":"2024-09-10T08:40:39.609866+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.227456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585592+0000","last_change":"2024-09-10T08:40:38.607736+0000","last_active":"2024-09-10T08:40:39.585592+0000","last_peered":"2024-09-10T08:40:39.585592+0000","last_clean":"2024-09-10T08:40:39.585592+0000","last_became_active":"2024-09-10T08:40:38.607482+0000","last_became_peered":"2024-09-10T08:40:38.607482+0000","last_unstale":"2024-09-10T08:40:39.585592+0000","last_undegraded":"2024-09-10T08:40:39.585592+0000","last_fullsized":"2024-09-10T08:40:39.585592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:25.625722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591040+0000","last_change":"2024-09-10T08:40:39.589188+0000","last_active":"2024-09-10T08:40:39.591040+0000","last_peered":"2024-09-10T08:40:39.591040+0000","last_clean":"2024-09-10T08:40:39.591040+0000","last_became_active":"2024-09-10T08:40:39.588915+0000","last_became_peered":"2024-09-10T08:40:39.588915+0000","last_unstale":"2024-09-10T08:40:39.591040+0000","last_undegraded":"2024-09-10T08:40:39.591040+0000","last_fullsized":"2024-09-10T08:40:39.591040+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:33.170578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.582541+0000","last_change":"2024-09-10T08:40:38.596603+0000","last_active":"2024-09-10T08:40:39.582541+0000","last_peered":"2024-09-10T08:40:39.582541+0000","last_clean":"2024-09-10T08:40:39.582541+0000","last_became_active":"2024-09-10T08:40:38.594989+0000","last_became_peered":"2024-09-10T08:40:38.594989+0000","last_unstale":"2024-09-10T08:40:39.582541+0000","last_undegraded":"2024-09-10T08:40:39.582541+0000","last_fullsized":"2024-09-10T08:40:39.582541+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:52.691150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":442,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591462+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:40:39.591462+0000","last_peered":"2024-09-10T08:40:39.591462+0000","last_clean":"2024-09-10T08:40:39.591462+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:40:39.591462+0000","last_undegraded":"2024-09-10T08:40:39.591462+0000","last_fullsized":"2024-09-10T08:40:39.591462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51316,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320524,"statfs":{"total":96636764160,"available":96584216576,"internally_reserved":0,"allocated":2129920,"data_stored":936713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55468,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316372,"statfs":{"total":96636764160,"available":96579964928,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47144,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324696,"statfs":{"total":96636764160,"available":96588488704,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63804,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308036,"statfs":{"total":96636764160,"available":96571428864,"internally_reserved":0,"allocated":2134016,"data_stored":936783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1520306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":2699264,"data_stored":1514031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:40:43.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:40:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.994+0000 7f4027a00640 1 Processor -- start 2024-09-10T08:40:43.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.994+0000 7f4027a00640 1 -- start start 2024-09-10T08:40:43.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4027a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f402006c320 0x7f402015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4027a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f402013eb20 0x7f402015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4027a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4020071180 con 0x7f40200b2d40 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4027a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4020071ab0 con 0x7f402013eb20 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4027a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4020071460 con 0x7f402006c320 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4025a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f402013eb20 0x7f402015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4025000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f40200b2d40 0x7f402006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32928/0 (socket says 172.21.15.52:32928) 2024-09-10T08:40:43.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.996+0000 7f4025000640 1 -- 172.21.15.52:0/3343739148 learned_addr learned my addr 172.21.15.52:0/3343739148 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f4017e00640 1 --2- 172.21.15.52:0/3343739148 >> v2:172.21.15.176:3300/0 conn(0x7f402006c320 0x7f402015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f4025a00640 1 -- 172.21.15.52:0/3343739148 >> v2:172.21.15.176:3300/0 conn(0x7f402006c320 msgr2=0x7f402015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f4025a00640 1 --2- 172.21.15.52:0/3343739148 >> v2:172.21.15.176:3300/0 conn(0x7f402006c320 0x7f402015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f4025a00640 1 -- 172.21.15.52:0/3343739148 >> v1:172.21.15.52:6789/0 conn(0x7f40200b2d40 legacy=0x7f402006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f401fe00640 1 -- 172.21.15.52:0/3343739148 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238584016 0 0) 0x7f4020071180 con 0x7f40200b2d40 2024-09-10T08:40:43.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.997+0000 7f4025a00640 1 -- 172.21.15.52:0/3343739148 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4020071740 con 0x7f402013eb20 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.998+0000 7f4025a00640 1 --2- 172.21.15.52:0/3343739148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402013eb20 0x7f402015c230 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f40200d1500 tx=0x7f401802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2169a42db78d6339 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.998+0000 7f401fe00640 1 -- 172.21.15.52:0/3343739148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018007740 con 0x7f402013eb20 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.998+0000 7f401fe00640 1 -- 172.21.15.52:0/3343739148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40180078e0 con 0x7f402013eb20 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.998+0000 7f401fe00640 1 -- 172.21.15.52:0/3343739148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018007cb0 con 0x7f402013eb20 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 -- 172.21.15.52:0/3343739148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402013eb20 msgr2=0x7f402015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:43.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 --2- 172.21.15.52:0/3343739148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402013eb20 0x7f402015c230 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f40200d1500 tx=0x7f401802a680 comp rx=0 tx=0).stop 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 -- 172.21.15.52:0/3343739148 shutdown_connections 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 --2- 172.21.15.52:0/3343739148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402013eb20 0x7f402015c230 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 --2- 172.21.15.52:0/3343739148 >> v2:172.21.15.176:3300/0 conn(0x7f402006c320 0x7f402015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 -- 172.21.15.52:0/3343739148 >> 172.21.15.52:0/3343739148 conn(0x7f40200ccec0 msgr2=0x7f40200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 -- 172.21.15.52:0/3343739148 shutdown_connections 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:43.999+0000 7f4027a00640 1 -- 172.21.15.52:0/3343739148 wait complete. 2024-09-10T08:40:44.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.000+0000 7f4027a00640 1 Processor -- start 2024-09-10T08:40:44.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 -- start start 2024-09-10T08:40:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40200b2d40 0x7f402013c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 0x7f40201f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40200720c0 con 0x7f402006c320 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4020071f40 con 0x7f402013eb20 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.001+0000 7f4027a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4020072240 con 0x7f40200b2d40 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42146/0 (socket says 172.21.15.52:42146) 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 -- 172.21.15.52:0/1561336503 learned_addr learned my addr 172.21.15.52:0/1561336503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4017e00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40200b2d40 0x7f402013c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 0x7f40201f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 -- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40200b2d40 msgr2=0x7f402013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40200b2d40 0x7f402013c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 -- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 msgr2=0x7f40201f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 0x7f40201f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 -- 172.21.15.52:0/1561336503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402013df70 con 0x7f402006c320 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 0x7f40201f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.002+0000 7f4025000640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f401000c4d0 tx=0x7f401000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.003+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010018070 con 0x7f402006c320 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.003+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010007500 con 0x7f402006c320 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.003+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010004a20 con 0x7f402006c320 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.003+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40200b4360 con 0x7f402006c320 2024-09-10T08:40:44.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.003+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40200b4920 con 0x7f402006c320 2024-09-10T08:40:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.004+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402006bc10 con 0x7f402006c320 2024-09-10T08:40:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.005+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f401001b070 con 0x7f402006c320 2024-09-10T08:40:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.006+0000 7f401d600640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.006+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f401008a110 con 0x7f402006c320 2024-09-10T08:40:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.007+0000 7f4017e00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.007+0000 7f4017e00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4020168530 tx=0x7f4008008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.011+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4010058460 con 0x7f402006c320 2024-09-10T08:40:44.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.195+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f402006c9c0 con 0x7f3ffc06be30 2024-09-10T08:40:44.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.201+0000 7f401d600640 1 -- 172.21.15.52:0/1561336503 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251673 (secure 0 0 0) 0x7f402006c9c0 con 0x7f3ffc06be30 2024-09-10T08:40:44.205 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:44.206 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:40:44.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.205+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 msgr2=0x7f3ffc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.205+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4020168530 tx=0x7f4008008040 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 msgr2=0x7f402013c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f401000c4d0 tx=0x7f401000c990 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 shutdown_connections 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3ffc06be30 0x7f3ffc06e2f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f402013eb20 0x7f40201f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40200b2d40 0x7f402013c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 --2- 172.21.15.52:0/1561336503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f402006c320 0x7f402013c0a0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 >> 172.21.15.52:0/1561336503 conn(0x7f40200ccec0 msgr2=0x7f402015b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 shutdown_connections 2024-09-10T08:40:44.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.206+0000 7f4027a00640 1 -- 172.21.15.52:0/1561336503 wait complete. 2024-09-10T08:40:44.222 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":529,"stamp":"2024-09-10T08:40:43.633471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444896,"kb_used_data":17720,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529824,"statfs":{"total":773094113280,"available":772638539776,"internally_reserved":0,"allocated":18145280,"data_stored":8627585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614955+0000","last_change":"2024-09-10T08:40:39.611318+0000","last_active":"2024-09-10T08:40:39.614955+0000","last_peered":"2024-09-10T08:40:39.614955+0000","last_clean":"2024-09-10T08:40:39.614955+0000","last_became_active":"2024-09-10T08:40:39.611027+0000","last_became_peered":"2024-09-10T08:40:39.611027+0000","last_unstale":"2024-09-10T08:40:39.614955+0000","last_undegraded":"2024-09-10T08:40:39.614955+0000","last_fullsized":"2024-09-10T08:40:39.614955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:31.420624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615813+0000","last_change":"2024-09-10T08:40:39.609260+0000","last_active":"2024-09-10T08:40:39.615813+0000","last_peered":"2024-09-10T08:40:39.615813+0000","last_clean":"2024-09-10T08:40:39.615813+0000","last_became_active":"2024-09-10T08:40:39.608971+0000","last_became_peered":"2024-09-10T08:40:39.608971+0000","last_unstale":"2024-09-10T08:40:39.615813+0000","last_undegraded":"2024-09-10T08:40:39.615813+0000","last_fullsized":"2024-09-10T08:40:39.615813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:44.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596612+0000","last_change":"2024-09-10T08:40:38.596612+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596612+0000","last_undegraded":"2024-09-10T08:40:38.596612+0000","last_fullsized":"2024-09-10T08:40:38.596612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614970+0000","last_change":"2024-09-10T08:40:39.605534+0000","last_active":"2024-09-10T08:40:39.614970+0000","last_peered":"2024-09-10T08:40:39.614970+0000","last_clean":"2024-09-10T08:40:39.614970+0000","last_became_active":"2024-09-10T08:40:39.605235+0000","last_became_peered":"2024-09-10T08:40:39.605235+0000","last_unstale":"2024-09-10T08:40:39.614970+0000","last_undegraded":"2024-09-10T08:40:39.614970+0000","last_fullsized":"2024-09-10T08:40:39.614970+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:41.680474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615691+0000","last_change":"2024-09-10T08:40:39.614794+0000","last_active":"2024-09-10T08:40:39.615691+0000","last_peered":"2024-09-10T08:40:39.615691+0000","last_clean":"2024-09-10T08:40:39.615691+0000","last_became_active":"2024-09-10T08:40:39.614532+0000","last_became_peered":"2024-09-10T08:40:39.614532+0000","last_unstale":"2024-09-10T08:40:39.615691+0000","last_undegraded":"2024-09-10T08:40:39.615691+0000","last_fullsized":"2024-09-10T08:40:39.615691+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607803+0000","last_change":"2024-09-10T08:40:39.601372+0000","last_active":"2024-09-10T08:40:39.607803+0000","last_peered":"2024-09-10T08:40:39.607803+0000","last_clean":"2024-09-10T08:40:39.607803+0000","last_became_active":"2024-09-10T08:40:39.600883+0000","last_became_peered":"2024-09-10T08:40:39.600883+0000","last_unstale":"2024-09-10T08:40:39.607803+0000","last_undegraded":"2024-09-10T08:40:39.607803+0000","last_fullsized":"2024-09-10T08:40:39.607803+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:30.821124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.600518+0000","last_change":"2024-09-10T08:40:39.594012+0000","last_active":"2024-09-10T08:40:39.600518+0000","last_peered":"2024-09-10T08:40:39.600518+0000","last_clean":"2024-09-10T08:40:39.600518+0000","last_became_active":"2024-09-10T08:40:39.593736+0000","last_became_peered":"2024-09-10T08:40:39.593736+0000","last_unstale":"2024-09-10T08:40:39.600518+0000","last_undegraded":"2024-09-10T08:40:39.600518+0000","last_fullsized":"2024-09-10T08:40:39.600518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610000+0000","last_change":"2024-09-10T08:40:39.606793+0000","last_active":"2024-09-10T08:40:39.610000+0000","last_peered":"2024-09-10T08:40:39.610000+0000","last_clean":"2024-09-10T08:40:39.610000+0000","last_became_active":"2024-09-10T08:40:39.606321+0000","last_became_peered":"2024-09-10T08:40:39.606321+0000","last_unstale":"2024-09-10T08:40:39.610000+0000","last_undegraded":"2024-09-10T08:40:39.610000+0000","last_fullsized":"2024-09-10T08:40:39.610000+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:24.778080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615574+0000","last_change":"2024-09-10T08:40:39.607866+0000","last_active":"2024-09-10T08:40:39.615574+0000","last_peered":"2024-09-10T08:40:39.615574+0000","last_clean":"2024-09-10T08:40:39.615574+0000","last_became_active":"2024-09-10T08:40:39.607413+0000","last_became_peered":"2024-09-10T08:40:39.607413+0000","last_unstale":"2024-09-10T08:40:39.615574+0000","last_undegraded":"2024-09-10T08:40:39.615574+0000","last_fullsized":"2024-09-10T08:40:39.615574+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610285+0000","last_change":"2024-09-10T08:40:39.607709+0000","last_active":"2024-09-10T08:40:39.610285+0000","last_peered":"2024-09-10T08:40:39.610285+0000","last_clean":"2024-09-10T08:40:39.610285+0000","last_became_active":"2024-09-10T08:40:39.603723+0000","last_became_peered":"2024-09-10T08:40:39.603723+0000","last_unstale":"2024-09-10T08:40:39.610285+0000","last_undegraded":"2024-09-10T08:40:39.610285+0000","last_fullsized":"2024-09-10T08:40:39.610285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:32.851653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615496+0000","last_change":"2024-09-10T08:40:39.607624+0000","last_active":"2024-09-10T08:40:39.615496+0000","last_peered":"2024-09-10T08:40:39.615496+0000","last_clean":"2024-09-10T08:40:39.615496+0000","last_became_active":"2024-09-10T08:40:39.607331+0000","last_became_peered":"2024-09-10T08:40:39.607331+0000","last_unstale":"2024-09-10T08:40:39.615496+0000","last_undegraded":"2024-09-10T08:40:39.615496+0000","last_fullsized":"2024-09-10T08:40:39.615496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:28.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603220+0000","last_change":"2024-09-10T08:40:39.602367+0000","last_active":"2024-09-10T08:40:39.603220+0000","last_peered":"2024-09-10T08:40:39.603220+0000","last_clean":"2024-09-10T08:40:39.603220+0000","last_became_active":"2024-09-10T08:40:39.602061+0000","last_became_peered":"2024-09-10T08:40:39.602061+0000","last_unstale":"2024-09-10T08:40:39.603220+0000","last_undegraded":"2024-09-10T08:40:39.603220+0000","last_fullsized":"2024-09-10T08:40:39.603220+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:36.086412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608217+0000","last_change":"2024-09-10T08:40:39.606370+0000","last_active":"2024-09-10T08:40:39.608217+0000","last_peered":"2024-09-10T08:40:39.608217+0000","last_clean":"2024-09-10T08:40:39.608217+0000","last_became_active":"2024-09-10T08:40:39.606005+0000","last_became_peered":"2024-09-10T08:40:39.606005+0000","last_unstale":"2024-09-10T08:40:39.608217+0000","last_undegraded":"2024-09-10T08:40:39.608217+0000","last_fullsized":"2024-09-10T08:40:39.608217+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:38.921411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.617169+0000","last_change":"2024-09-10T08:40:39.611415+0000","last_active":"2024-09-10T08:40:39.617169+0000","last_peered":"2024-09-10T08:40:39.617169+0000","last_clean":"2024-09-10T08:40:39.617169+0000","last_became_active":"2024-09-10T08:40:39.611117+0000","last_became_peered":"2024-09-10T08:40:39.611117+0000","last_unstale":"2024-09-10T08:40:39.617169+0000","last_undegraded":"2024-09-10T08:40:39.617169+0000","last_fullsized":"2024-09-10T08:40:39.617169+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:29.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614988+0000","last_change":"2024-09-10T08:40:39.612070+0000","last_active":"2024-09-10T08:40:39.614988+0000","last_peered":"2024-09-10T08:40:39.614988+0000","last_clean":"2024-09-10T08:40:39.614988+0000","last_became_active":"2024-09-10T08:40:39.611186+0000","last_became_peered":"2024-09-10T08:40:39.611186+0000","last_unstale":"2024-09-10T08:40:39.614988+0000","last_undegraded":"2024-09-10T08:40:39.614988+0000","last_fullsized":"2024-09-10T08:40:39.614988+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:42.961556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.593853+0000","last_change":"2024-09-10T08:40:38.593853+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.593853+0000","last_undegraded":"2024-09-10T08:40:38.593853+0000","last_fullsized":"2024-09-10T08:40:38.593853+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608176+0000","last_change":"2024-09-10T08:40:39.606371+0000","last_active":"2024-09-10T08:40:39.608176+0000","last_peered":"2024-09-10T08:40:39.608176+0000","last_clean":"2024-09-10T08:40:39.608176+0000","last_became_active":"2024-09-10T08:40:39.606096+0000","last_became_peered":"2024-09-10T08:40:39.606096+0000","last_unstale":"2024-09-10T08:40:39.608176+0000","last_undegraded":"2024-09-10T08:40:39.608176+0000","last_fullsized":"2024-09-10T08:40:39.608176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:19.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608605+0000","last_change":"2024-09-10T08:40:39.607991+0000","last_active":"2024-09-10T08:40:39.608605+0000","last_peered":"2024-09-10T08:40:39.608605+0000","last_clean":"2024-09-10T08:40:39.608605+0000","last_became_active":"2024-09-10T08:40:39.607654+0000","last_became_peered":"2024-09-10T08:40:39.607654+0000","last_unstale":"2024-09-10T08:40:39.608605+0000","last_undegraded":"2024-09-10T08:40:39.608605+0000","last_fullsized":"2024-09-10T08:40:39.608605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596208+0000","last_change":"2024-09-10T08:40:38.596208+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596208+0000","last_undegraded":"2024-09-10T08:40:38.596208+0000","last_fullsized":"2024-09-10T08:40:38.596208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603905+0000","last_change":"2024-09-10T08:40:39.602035+0000","last_active":"2024-09-10T08:40:39.603905+0000","last_peered":"2024-09-10T08:40:39.603905+0000","last_clean":"2024-09-10T08:40:39.603905+0000","last_became_active":"2024-09-10T08:40:39.601010+0000","last_became_peered":"2024-09-10T08:40:39.601010+0000","last_unstale":"2024-09-10T08:40:39.603905+0000","last_undegraded":"2024-09-10T08:40:39.603905+0000","last_fullsized":"2024-09-10T08:40:39.603905+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:44.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.594932+0000","last_change":"2024-09-10T08:40:38.594932+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.594932+0000","last_undegraded":"2024-09-10T08:40:38.594932+0000","last_fullsized":"2024-09-10T08:40:38.594932+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604016+0000","last_change":"2024-09-10T08:40:39.602559+0000","last_active":"2024-09-10T08:40:39.604016+0000","last_peered":"2024-09-10T08:40:39.604016+0000","last_clean":"2024-09-10T08:40:39.604016+0000","last_became_active":"2024-09-10T08:40:39.601707+0000","last_became_peered":"2024-09-10T08:40:39.601707+0000","last_unstale":"2024-09-10T08:40:39.604016+0000","last_undegraded":"2024-09-10T08:40:39.604016+0000","last_fullsized":"2024-09-10T08:40:39.604016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:47.154878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609518+0000","last_change":"2024-09-10T08:40:39.606541+0000","last_active":"2024-09-10T08:40:39.609518+0000","last_peered":"2024-09-10T08:40:39.609518+0000","last_clean":"2024-09-10T08:40:39.609518+0000","last_became_active":"2024-09-10T08:40:39.605678+0000","last_became_peered":"2024-09-10T08:40:39.605678+0000","last_unstale":"2024-09-10T08:40:39.609518+0000","last_undegraded":"2024-09-10T08:40:39.609518+0000","last_fullsized":"2024-09-10T08:40:39.609518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610811+0000","last_change":"2024-09-10T08:40:39.607744+0000","last_active":"2024-09-10T08:40:39.610811+0000","last_peered":"2024-09-10T08:40:39.610811+0000","last_clean":"2024-09-10T08:40:39.610811+0000","last_became_active":"2024-09-10T08:40:39.604829+0000","last_became_peered":"2024-09-10T08:40:39.604829+0000","last_unstale":"2024-09-10T08:40:39.610811+0000","last_undegraded":"2024-09-10T08:40:39.610811+0000","last_fullsized":"2024-09-10T08:40:39.610811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:17.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615549+0000","last_change":"2024-09-10T08:40:39.607658+0000","last_active":"2024-09-10T08:40:39.615549+0000","last_peered":"2024-09-10T08:40:39.615549+0000","last_clean":"2024-09-10T08:40:39.615549+0000","last_became_active":"2024-09-10T08:40:39.607088+0000","last_became_peered":"2024-09-10T08:40:39.607088+0000","last_unstale":"2024-09-10T08:40:39.615549+0000","last_undegraded":"2024-09-10T08:40:39.615549+0000","last_fullsized":"2024-09-10T08:40:39.615549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:12.010728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595229+0000","last_change":"2024-09-10T08:40:39.590285+0000","last_active":"2024-09-10T08:40:39.595229+0000","last_peered":"2024-09-10T08:40:39.595229+0000","last_clean":"2024-09-10T08:40:39.595229+0000","last_became_active":"2024-09-10T08:40:39.588993+0000","last_became_peered":"2024-09-10T08:40:39.588993+0000","last_unstale":"2024-09-10T08:40:39.595229+0000","last_undegraded":"2024-09-10T08:40:39.595229+0000","last_fullsized":"2024-09-10T08:40:39.595229+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:07.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595772+0000","last_change":"2024-09-10T08:40:38.595772+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595772+0000","last_undegraded":"2024-09-10T08:40:38.595772+0000","last_fullsized":"2024-09-10T08:40:38.595772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611382+0000","last_change":"2024-09-10T08:40:39.610193+0000","last_active":"2024-09-10T08:40:39.611382+0000","last_peered":"2024-09-10T08:40:39.611382+0000","last_clean":"2024-09-10T08:40:39.611382+0000","last_became_active":"2024-09-10T08:40:39.609275+0000","last_became_peered":"2024-09-10T08:40:39.609275+0000","last_unstale":"2024-09-10T08:40:39.611382+0000","last_undegraded":"2024-09-10T08:40:39.611382+0000","last_fullsized":"2024-09-10T08:40:39.611382+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:42.617055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.612711+0000","last_change":"2024-09-10T08:40:39.610728+0000","last_active":"2024-09-10T08:40:39.612711+0000","last_peered":"2024-09-10T08:40:39.612711+0000","last_clean":"2024-09-10T08:40:39.612711+0000","last_became_active":"2024-09-10T08:40:39.609408+0000","last_became_peered":"2024-09-10T08:40:39.609408+0000","last_unstale":"2024-09-10T08:40:39.612711+0000","last_undegraded":"2024-09-10T08:40:39.612711+0000","last_fullsized":"2024-09-10T08:40:39.612711+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:41.928734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595387+0000","last_change":"2024-09-10T08:40:39.589135+0000","last_active":"2024-09-10T08:40:39.595387+0000","last_peered":"2024-09-10T08:40:39.595387+0000","last_clean":"2024-09-10T08:40:39.595387+0000","last_became_active":"2024-09-10T08:40:39.588819+0000","last_became_peered":"2024-09-10T08:40:39.588819+0000","last_unstale":"2024-09-10T08:40:39.595387+0000","last_undegraded":"2024-09-10T08:40:39.595387+0000","last_fullsized":"2024-09-10T08:40:39.595387+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:45.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598018+0000","last_change":"2024-09-10T08:40:39.597382+0000","last_active":"2024-09-10T08:40:39.598018+0000","last_peered":"2024-09-10T08:40:39.598018+0000","last_clean":"2024-09-10T08:40:39.598018+0000","last_became_active":"2024-09-10T08:40:39.597095+0000","last_became_peered":"2024-09-10T08:40:39.597095+0000","last_unstale":"2024-09-10T08:40:39.598018+0000","last_undegraded":"2024-09-10T08:40:39.598018+0000","last_fullsized":"2024-09-10T08:40:39.598018+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.724926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616582+0000","last_change":"2024-09-10T08:40:39.615657+0000","last_active":"2024-09-10T08:40:39.616582+0000","last_peered":"2024-09-10T08:40:39.616582+0000","last_clean":"2024-09-10T08:40:39.616582+0000","last_became_active":"2024-09-10T08:40:39.615390+0000","last_became_peered":"2024-09-10T08:40:39.615390+0000","last_unstale":"2024-09-10T08:40:39.616582+0000","last_undegraded":"2024-09-10T08:40:39.616582+0000","last_fullsized":"2024-09-10T08:40:39.616582+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604283+0000","last_change":"2024-09-10T08:40:39.603264+0000","last_active":"2024-09-10T08:40:39.604283+0000","last_peered":"2024-09-10T08:40:39.604283+0000","last_clean":"2024-09-10T08:40:39.604283+0000","last_became_active":"2024-09-10T08:40:39.602001+0000","last_became_peered":"2024-09-10T08:40:39.602001+0000","last_unstale":"2024-09-10T08:40:39.604283+0000","last_undegraded":"2024-09-10T08:40:39.604283+0000","last_fullsized":"2024-09-10T08:40:39.604283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.606585+0000","last_change":"2024-09-10T08:40:38.604785+0000","last_active":"2024-09-10T08:40:38.606585+0000","last_peered":"2024-09-10T08:40:38.606585+0000","last_clean":"2024-09-10T08:40:38.606585+0000","last_became_active":"2024-09-10T08:40:38.604514+0000","last_became_peered":"2024-09-10T08:40:38.604514+0000","last_unstale":"2024-09-10T08:40:38.606585+0000","last_undegraded":"2024-09-10T08:40:38.606585+0000","last_fullsized":"2024-09-10T08:40:38.606585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:29.631375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609620+0000","last_change":"2024-09-10T08:40:39.607215+0000","last_active":"2024-09-10T08:40:39.609620+0000","last_peered":"2024-09-10T08:40:39.609620+0000","last_clean":"2024-09-10T08:40:39.609620+0000","last_became_active":"2024-09-10T08:40:39.606858+0000","last_became_peered":"2024-09-10T08:40:39.606858+0000","last_unstale":"2024-09-10T08:40:39.609620+0000","last_undegraded":"2024-09-10T08:40:39.609620+0000","last_fullsized":"2024-09-10T08:40:39.609620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:09.425294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619702+0000","last_change":"2024-09-10T08:40:38.603266+0000","last_active":"2024-09-10T08:40:39.619702+0000","last_peered":"2024-09-10T08:40:39.619702+0000","last_clean":"2024-09-10T08:40:39.619702+0000","last_became_active":"2024-09-10T08:40:38.602932+0000","last_became_peered":"2024-09-10T08:40:38.602932+0000","last_unstale":"2024-09-10T08:40:39.619702+0000","last_undegraded":"2024-09-10T08:40:39.619702+0000","last_fullsized":"2024-09-10T08:40:39.619702+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.782228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616084+0000","last_change":"2024-09-10T08:40:39.609371+0000","last_active":"2024-09-10T08:40:39.616084+0000","last_peered":"2024-09-10T08:40:39.616084+0000","last_clean":"2024-09-10T08:40:39.616084+0000","last_became_active":"2024-09-10T08:40:39.609083+0000","last_became_peered":"2024-09-10T08:40:39.609083+0000","last_unstale":"2024-09-10T08:40:39.616084+0000","last_undegraded":"2024-09-10T08:40:39.616084+0000","last_fullsized":"2024-09-10T08:40:39.616084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:04.082259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621677+0000","last_change":"2024-09-10T08:40:38.611280+0000","last_active":"2024-09-10T08:40:39.621677+0000","last_peered":"2024-09-10T08:40:39.621677+0000","last_clean":"2024-09-10T08:40:39.621677+0000","last_became_active":"2024-09-10T08:40:38.610992+0000","last_became_peered":"2024-09-10T08:40:38.610992+0000","last_unstale":"2024-09-10T08:40:39.621677+0000","last_undegraded":"2024-09-10T08:40:39.621677+0000","last_fullsized":"2024-09-10T08:40:39.621677+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615697+0000","last_change":"2024-09-10T08:40:39.608923+0000","last_active":"2024-09-10T08:40:39.615697+0000","last_peered":"2024-09-10T08:40:39.615697+0000","last_clean":"2024-09-10T08:40:39.615697+0000","last_became_active":"2024-09-10T08:40:39.608659+0000","last_became_peered":"2024-09-10T08:40:39.608659+0000","last_unstale":"2024-09-10T08:40:39.615697+0000","last_undegraded":"2024-09-10T08:40:39.615697+0000","last_fullsized":"2024-09-10T08:40:39.615697+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:26.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622253+0000","last_change":"2024-09-10T08:40:38.603525+0000","last_active":"2024-09-10T08:40:39.622253+0000","last_peered":"2024-09-10T08:40:39.622253+0000","last_clean":"2024-09-10T08:40:39.622253+0000","last_became_active":"2024-09-10T08:40:38.603260+0000","last_became_peered":"2024-09-10T08:40:38.603260+0000","last_unstale":"2024-09-10T08:40:39.622253+0000","last_undegraded":"2024-09-10T08:40:39.622253+0000","last_fullsized":"2024-09-10T08:40:39.622253+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:55.827552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607782+0000","last_change":"2024-09-10T08:40:39.601136+0000","last_active":"2024-09-10T08:40:39.607782+0000","last_peered":"2024-09-10T08:40:39.607782+0000","last_clean":"2024-09-10T08:40:39.607782+0000","last_became_active":"2024-09-10T08:40:39.600532+0000","last_became_peered":"2024-09-10T08:40:39.600532+0000","last_unstale":"2024-09-10T08:40:39.607782+0000","last_undegraded":"2024-09-10T08:40:39.607782+0000","last_fullsized":"2024-09-10T08:40:39.607782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:07.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621755+0000","last_change":"2024-09-10T08:40:38.610462+0000","last_active":"2024-09-10T08:40:39.621755+0000","last_peered":"2024-09-10T08:40:39.621755+0000","last_clean":"2024-09-10T08:40:39.621755+0000","last_became_active":"2024-09-10T08:40:38.610181+0000","last_became_peered":"2024-09-10T08:40:38.610181+0000","last_unstale":"2024-09-10T08:40:39.621755+0000","last_undegraded":"2024-09-10T08:40:39.621755+0000","last_fullsized":"2024-09-10T08:40:39.621755+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:40.925346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616405+0000","last_change":"2024-09-10T08:40:39.615214+0000","last_active":"2024-09-10T08:40:39.616405+0000","last_peered":"2024-09-10T08:40:39.616405+0000","last_clean":"2024-09-10T08:40:39.616405+0000","last_became_active":"2024-09-10T08:40:39.614895+0000","last_became_peered":"2024-09-10T08:40:39.614895+0000","last_unstale":"2024-09-10T08:40:39.616405+0000","last_undegraded":"2024-09-10T08:40:39.616405+0000","last_fullsized":"2024-09-10T08:40:39.616405+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621084+0000","last_change":"2024-09-10T08:40:38.608616+0000","last_active":"2024-09-10T08:40:39.621084+0000","last_peered":"2024-09-10T08:40:39.621084+0000","last_clean":"2024-09-10T08:40:39.621084+0000","last_became_active":"2024-09-10T08:40:38.608335+0000","last_became_peered":"2024-09-10T08:40:38.608335+0000","last_unstale":"2024-09-10T08:40:39.621084+0000","last_undegraded":"2024-09-10T08:40:39.621084+0000","last_fullsized":"2024-09-10T08:40:39.621084+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:01.508308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608152+0000","last_change":"2024-09-10T08:40:39.600898+0000","last_active":"2024-09-10T08:40:39.608152+0000","last_peered":"2024-09-10T08:40:39.608152+0000","last_clean":"2024-09-10T08:40:39.608152+0000","last_became_active":"2024-09-10T08:40:39.600580+0000","last_became_peered":"2024-09-10T08:40:39.600580+0000","last_unstale":"2024-09-10T08:40:39.608152+0000","last_undegraded":"2024-09-10T08:40:39.608152+0000","last_fullsized":"2024-09-10T08:40:39.608152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:36.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.587705+0000","last_change":"2024-09-10T08:40:38.602353+0000","last_active":"2024-09-10T08:40:39.587705+0000","last_peered":"2024-09-10T08:40:39.587705+0000","last_clean":"2024-09-10T08:40:39.587705+0000","last_became_active":"2024-09-10T08:40:38.601969+0000","last_became_peered":"2024-09-10T08:40:38.601969+0000","last_unstale":"2024-09-10T08:40:39.587705+0000","last_undegraded":"2024-09-10T08:40:39.587705+0000","last_fullsized":"2024-09-10T08:40:39.587705+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.613667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596152+0000","last_change":"2024-09-10T08:40:38.596152+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596152+0000","last_undegraded":"2024-09-10T08:40:38.596152+0000","last_fullsized":"2024-09-10T08:40:38.596152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590590+0000","last_change":"2024-09-10T08:40:38.606684+0000","last_active":"2024-09-10T08:40:39.590590+0000","last_peered":"2024-09-10T08:40:39.590590+0000","last_clean":"2024-09-10T08:40:39.590590+0000","last_became_active":"2024-09-10T08:40:38.606419+0000","last_became_peered":"2024-09-10T08:40:38.606419+0000","last_unstale":"2024-09-10T08:40:39.590590+0000","last_undegraded":"2024-09-10T08:40:39.590590+0000","last_fullsized":"2024-09-10T08:40:39.590590+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:58.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609813+0000","last_change":"2024-09-10T08:40:39.608373+0000","last_active":"2024-09-10T08:40:39.609813+0000","last_peered":"2024-09-10T08:40:39.609813+0000","last_clean":"2024-09-10T08:40:39.609813+0000","last_became_active":"2024-09-10T08:40:39.607215+0000","last_became_peered":"2024-09-10T08:40:39.607215+0000","last_unstale":"2024-09-10T08:40:39.609813+0000","last_undegraded":"2024-09-10T08:40:39.609813+0000","last_fullsized":"2024-09-10T08:40:39.609813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:30.447019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598441+0000","last_change":"2024-09-10T08:40:38.602257+0000","last_active":"2024-09-10T08:40:39.598441+0000","last_peered":"2024-09-10T08:40:39.598441+0000","last_clean":"2024-09-10T08:40:39.598441+0000","last_became_active":"2024-09-10T08:40:38.600878+0000","last_became_peered":"2024-09-10T08:40:38.600878+0000","last_unstale":"2024-09-10T08:40:39.598441+0000","last_undegraded":"2024-09-10T08:40:39.598441+0000","last_fullsized":"2024-09-10T08:40:39.598441+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:16.094429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595667+0000","last_change":"2024-09-10T08:40:39.590087+0000","last_active":"2024-09-10T08:40:39.595667+0000","last_peered":"2024-09-10T08:40:39.595667+0000","last_clean":"2024-09-10T08:40:39.595667+0000","last_became_active":"2024-09-10T08:40:39.589804+0000","last_became_peered":"2024-09-10T08:40:39.589804+0000","last_unstale":"2024-09-10T08:40:39.595667+0000","last_undegraded":"2024-09-10T08:40:39.595667+0000","last_fullsized":"2024-09-10T08:40:39.595667+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621914+0000","last_change":"2024-09-10T08:40:38.609058+0000","last_active":"2024-09-10T08:40:39.621914+0000","last_peered":"2024-09-10T08:40:39.621914+0000","last_clean":"2024-09-10T08:40:39.621914+0000","last_became_active":"2024-09-10T08:40:38.608401+0000","last_became_peered":"2024-09-10T08:40:38.608401+0000","last_unstale":"2024-09-10T08:40:39.621914+0000","last_undegraded":"2024-09-10T08:40:39.621914+0000","last_fullsized":"2024-09-10T08:40:39.621914+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:55.897796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608791+0000","last_change":"2024-09-10T08:40:39.605532+0000","last_active":"2024-09-10T08:40:39.608791+0000","last_peered":"2024-09-10T08:40:39.608791+0000","last_clean":"2024-09-10T08:40:39.608791+0000","last_became_active":"2024-09-10T08:40:39.605078+0000","last_became_peered":"2024-09-10T08:40:39.605078+0000","last_unstale":"2024-09-10T08:40:39.608791+0000","last_undegraded":"2024-09-10T08:40:39.608791+0000","last_fullsized":"2024-09-10T08:40:39.608791+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.624689+0000","last_change":"2024-09-10T08:40:38.609036+0000","last_active":"2024-09-10T08:40:39.624689+0000","last_peered":"2024-09-10T08:40:39.624689+0000","last_clean":"2024-09-10T08:40:39.624689+0000","last_became_active":"2024-09-10T08:40:38.608738+0000","last_became_peered":"2024-09-10T08:40:38.608738+0000","last_unstale":"2024-09-10T08:40:39.624689+0000","last_undegraded":"2024-09-10T08:40:39.624689+0000","last_fullsized":"2024-09-10T08:40:39.624689+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:47.126499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608788+0000","last_change":"2024-09-10T08:40:39.605430+0000","last_active":"2024-09-10T08:40:39.608788+0000","last_peered":"2024-09-10T08:40:39.608788+0000","last_clean":"2024-09-10T08:40:39.608788+0000","last_became_active":"2024-09-10T08:40:39.603647+0000","last_became_peered":"2024-09-10T08:40:39.603647+0000","last_unstale":"2024-09-10T08:40:39.608788+0000","last_undegraded":"2024-09-10T08:40:39.608788+0000","last_fullsized":"2024-09-10T08:40:39.608788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621597+0000","last_change":"2024-09-10T08:40:38.608957+0000","last_active":"2024-09-10T08:40:39.621597+0000","last_peered":"2024-09-10T08:40:39.621597+0000","last_clean":"2024-09-10T08:40:39.621597+0000","last_became_active":"2024-09-10T08:40:38.608520+0000","last_became_peered":"2024-09-10T08:40:38.608520+0000","last_unstale":"2024-09-10T08:40:39.621597+0000","last_undegraded":"2024-09-10T08:40:39.621597+0000","last_fullsized":"2024-09-10T08:40:39.621597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:05.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598629+0000","last_change":"2024-09-10T08:40:39.596837+0000","last_active":"2024-09-10T08:40:39.598629+0000","last_peered":"2024-09-10T08:40:39.598629+0000","last_clean":"2024-09-10T08:40:39.598629+0000","last_became_active":"2024-09-10T08:40:39.596457+0000","last_became_peered":"2024-09-10T08:40:39.596457+0000","last_unstale":"2024-09-10T08:40:39.598629+0000","last_undegraded":"2024-09-10T08:40:39.598629+0000","last_fullsized":"2024-09-10T08:40:39.598629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599214+0000","last_change":"2024-09-10T08:40:38.599901+0000","last_active":"2024-09-10T08:40:39.599214+0000","last_peered":"2024-09-10T08:40:39.599214+0000","last_clean":"2024-09-10T08:40:39.599214+0000","last_became_active":"2024-09-10T08:40:38.599571+0000","last_became_peered":"2024-09-10T08:40:38.599571+0000","last_unstale":"2024-09-10T08:40:39.599214+0000","last_undegraded":"2024-09-10T08:40:39.599214+0000","last_fullsized":"2024-09-10T08:40:39.599214+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:05.993602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595690+0000","last_change":"2024-09-10T08:40:39.593816+0000","last_active":"2024-09-10T08:40:39.595690+0000","last_peered":"2024-09-10T08:40:39.595690+0000","last_clean":"2024-09-10T08:40:39.595690+0000","last_became_active":"2024-09-10T08:40:39.592965+0000","last_became_peered":"2024-09-10T08:40:39.592965+0000","last_unstale":"2024-09-10T08:40:39.595690+0000","last_undegraded":"2024-09-10T08:40:39.595690+0000","last_fullsized":"2024-09-10T08:40:39.595690+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:35.945534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593166+0000","last_change":"2024-09-10T08:40:38.606357+0000","last_active":"2024-09-10T08:40:39.593166+0000","last_peered":"2024-09-10T08:40:39.593166+0000","last_clean":"2024-09-10T08:40:39.593166+0000","last_became_active":"2024-09-10T08:40:38.606082+0000","last_became_peered":"2024-09-10T08:40:38.606082+0000","last_unstale":"2024-09-10T08:40:39.593166+0000","last_undegraded":"2024-09-10T08:40:39.593166+0000","last_fullsized":"2024-09-10T08:40:39.593166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:06.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611654+0000","last_change":"2024-09-10T08:40:39.611019+0000","last_active":"2024-09-10T08:40:39.611654+0000","last_peered":"2024-09-10T08:40:39.611654+0000","last_clean":"2024-09-10T08:40:39.611654+0000","last_became_active":"2024-09-10T08:40:39.610479+0000","last_became_peered":"2024-09-10T08:40:39.610479+0000","last_unstale":"2024-09-10T08:40:39.611654+0000","last_undegraded":"2024-09-10T08:40:39.611654+0000","last_fullsized":"2024-09-10T08:40:39.611654+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:06.996990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.623156+0000","last_change":"2024-09-10T08:40:38.599942+0000","last_active":"2024-09-10T08:40:39.623156+0000","last_peered":"2024-09-10T08:40:39.623156+0000","last_clean":"2024-09-10T08:40:39.623156+0000","last_became_active":"2024-09-10T08:40:38.599603+0000","last_became_peered":"2024-09-10T08:40:38.599603+0000","last_unstale":"2024-09-10T08:40:39.623156+0000","last_undegraded":"2024-09-10T08:40:39.623156+0000","last_fullsized":"2024-09-10T08:40:39.623156+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:44.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610303+0000","last_change":"2024-09-10T08:40:39.608592+0000","last_active":"2024-09-10T08:40:39.610303+0000","last_peered":"2024-09-10T08:40:39.610303+0000","last_clean":"2024-09-10T08:40:39.610303+0000","last_became_active":"2024-09-10T08:40:39.603659+0000","last_became_peered":"2024-09-10T08:40:39.603659+0000","last_unstale":"2024-09-10T08:40:39.610303+0000","last_undegraded":"2024-09-10T08:40:39.610303+0000","last_fullsized":"2024-09-10T08:40:39.610303+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:25.399740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622148+0000","last_change":"2024-09-10T08:40:38.609734+0000","last_active":"2024-09-10T08:40:39.622148+0000","last_peered":"2024-09-10T08:40:39.622148+0000","last_clean":"2024-09-10T08:40:39.622148+0000","last_became_active":"2024-09-10T08:40:38.609463+0000","last_became_peered":"2024-09-10T08:40:38.609463+0000","last_unstale":"2024-09-10T08:40:39.622148+0000","last_undegraded":"2024-09-10T08:40:39.622148+0000","last_fullsized":"2024-09-10T08:40:39.622148+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:35.083024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599659+0000","last_change":"2024-09-10T08:40:39.597891+0000","last_active":"2024-09-10T08:40:39.599659+0000","last_peered":"2024-09-10T08:40:39.599659+0000","last_clean":"2024-09-10T08:40:39.599659+0000","last_became_active":"2024-09-10T08:40:39.597179+0000","last_became_peered":"2024-09-10T08:40:39.597179+0000","last_unstale":"2024-09-10T08:40:39.599659+0000","last_undegraded":"2024-09-10T08:40:39.599659+0000","last_fullsized":"2024-09-10T08:40:39.599659+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.116764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619027+0000","last_change":"2024-09-10T08:40:38.609455+0000","last_active":"2024-09-10T08:40:39.619027+0000","last_peered":"2024-09-10T08:40:39.619027+0000","last_clean":"2024-09-10T08:40:39.619027+0000","last_became_active":"2024-09-10T08:40:38.609193+0000","last_became_peered":"2024-09-10T08:40:38.609193+0000","last_unstale":"2024-09-10T08:40:39.619027+0000","last_undegraded":"2024-09-10T08:40:39.619027+0000","last_fullsized":"2024-09-10T08:40:39.619027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:23.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613972+0000","last_change":"2024-09-10T08:40:39.604315+0000","last_active":"2024-09-10T08:40:39.613972+0000","last_peered":"2024-09-10T08:40:39.613972+0000","last_clean":"2024-09-10T08:40:39.613972+0000","last_became_active":"2024-09-10T08:40:39.603974+0000","last_became_peered":"2024-09-10T08:40:39.603974+0000","last_unstale":"2024-09-10T08:40:39.613972+0000","last_undegraded":"2024-09-10T08:40:39.613972+0000","last_fullsized":"2024-09-10T08:40:39.613972+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:37.302990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616894+0000","last_change":"2024-09-10T08:40:38.604618+0000","last_active":"2024-09-10T08:40:39.616894+0000","last_peered":"2024-09-10T08:40:39.616894+0000","last_clean":"2024-09-10T08:40:39.616894+0000","last_became_active":"2024-09-10T08:40:38.603739+0000","last_became_peered":"2024-09-10T08:40:38.603739+0000","last_unstale":"2024-09-10T08:40:39.616894+0000","last_undegraded":"2024-09-10T08:40:39.616894+0000","last_fullsized":"2024-09-10T08:40:39.616894+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:18.461479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595522+0000","last_change":"2024-09-10T08:40:39.591588+0000","last_active":"2024-09-10T08:40:39.595522+0000","last_peered":"2024-09-10T08:40:39.595522+0000","last_clean":"2024-09-10T08:40:39.595522+0000","last_became_active":"2024-09-10T08:40:39.591319+0000","last_became_peered":"2024-09-10T08:40:39.591319+0000","last_unstale":"2024-09-10T08:40:39.595522+0000","last_undegraded":"2024-09-10T08:40:39.595522+0000","last_fullsized":"2024-09-10T08:40:39.595522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:48.129887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592375+0000","last_change":"2024-09-10T08:40:38.607426+0000","last_active":"2024-09-10T08:40:39.592375+0000","last_peered":"2024-09-10T08:40:39.592375+0000","last_clean":"2024-09-10T08:40:39.592375+0000","last_became_active":"2024-09-10T08:40:38.606843+0000","last_became_peered":"2024-09-10T08:40:38.606843+0000","last_unstale":"2024-09-10T08:40:39.592375+0000","last_undegraded":"2024-09-10T08:40:39.592375+0000","last_fullsized":"2024-09-10T08:40:39.592375+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:12.746003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604029+0000","last_change":"2024-09-10T08:40:39.595611+0000","last_active":"2024-09-10T08:40:39.604029+0000","last_peered":"2024-09-10T08:40:39.604029+0000","last_clean":"2024-09-10T08:40:39.604029+0000","last_became_active":"2024-09-10T08:40:39.593091+0000","last_became_peered":"2024-09-10T08:40:39.593091+0000","last_unstale":"2024-09-10T08:40:39.604029+0000","last_undegraded":"2024-09-10T08:40:39.604029+0000","last_fullsized":"2024-09-10T08:40:39.604029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.263677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621202+0000","last_change":"2024-09-10T08:40:38.612800+0000","last_active":"2024-09-10T08:40:39.621202+0000","last_peered":"2024-09-10T08:40:39.621202+0000","last_clean":"2024-09-10T08:40:39.621202+0000","last_became_active":"2024-09-10T08:40:38.612501+0000","last_became_peered":"2024-09-10T08:40:38.612501+0000","last_unstale":"2024-09-10T08:40:39.621202+0000","last_undegraded":"2024-09-10T08:40:39.621202+0000","last_fullsized":"2024-09-10T08:40:39.621202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:17.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608648+0000","last_change":"2024-09-10T08:40:39.607946+0000","last_active":"2024-09-10T08:40:39.608648+0000","last_peered":"2024-09-10T08:40:39.608648+0000","last_clean":"2024-09-10T08:40:39.608648+0000","last_became_active":"2024-09-10T08:40:39.607670+0000","last_became_peered":"2024-09-10T08:40:39.607670+0000","last_unstale":"2024-09-10T08:40:39.608648+0000","last_undegraded":"2024-09-10T08:40:39.608648+0000","last_fullsized":"2024-09-10T08:40:39.608648+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585166+0000","last_change":"2024-09-10T08:40:38.609194+0000","last_active":"2024-09-10T08:40:39.585166+0000","last_peered":"2024-09-10T08:40:39.585166+0000","last_clean":"2024-09-10T08:40:39.585166+0000","last_became_active":"2024-09-10T08:40:38.608754+0000","last_became_peered":"2024-09-10T08:40:38.608754+0000","last_unstale":"2024-09-10T08:40:39.585166+0000","last_undegraded":"2024-09-10T08:40:39.585166+0000","last_fullsized":"2024-09-10T08:40:39.585166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.065351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.605233+0000","last_change":"2024-09-10T08:40:39.597582+0000","last_active":"2024-09-10T08:40:39.605233+0000","last_peered":"2024-09-10T08:40:39.605233+0000","last_clean":"2024-09-10T08:40:39.605233+0000","last_became_active":"2024-09-10T08:40:39.597309+0000","last_became_peered":"2024-09-10T08:40:39.597309+0000","last_unstale":"2024-09-10T08:40:39.605233+0000","last_undegraded":"2024-09-10T08:40:39.605233+0000","last_fullsized":"2024-09-10T08:40:39.605233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:44.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585031+0000","last_change":"2024-09-10T08:40:38.602833+0000","last_active":"2024-09-10T08:40:39.585031+0000","last_peered":"2024-09-10T08:40:39.585031+0000","last_clean":"2024-09-10T08:40:39.585031+0000","last_became_active":"2024-09-10T08:40:38.602520+0000","last_became_peered":"2024-09-10T08:40:38.602520+0000","last_unstale":"2024-09-10T08:40:39.585031+0000","last_undegraded":"2024-09-10T08:40:39.585031+0000","last_fullsized":"2024-09-10T08:40:39.585031+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:31.477687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608666+0000","last_change":"2024-09-10T08:40:39.605369+0000","last_active":"2024-09-10T08:40:39.608666+0000","last_peered":"2024-09-10T08:40:39.608666+0000","last_clean":"2024-09-10T08:40:39.608666+0000","last_became_active":"2024-09-10T08:40:39.604880+0000","last_became_peered":"2024-09-10T08:40:39.604880+0000","last_unstale":"2024-09-10T08:40:39.608666+0000","last_undegraded":"2024-09-10T08:40:39.608666+0000","last_fullsized":"2024-09-10T08:40:39.608666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590185+0000","last_change":"2024-09-10T08:40:38.602333+0000","last_active":"2024-09-10T08:40:39.590185+0000","last_peered":"2024-09-10T08:40:39.590185+0000","last_clean":"2024-09-10T08:40:39.590185+0000","last_became_active":"2024-09-10T08:40:38.599744+0000","last_became_peered":"2024-09-10T08:40:38.599744+0000","last_unstale":"2024-09-10T08:40:39.590185+0000","last_undegraded":"2024-09-10T08:40:39.590185+0000","last_fullsized":"2024-09-10T08:40:39.590185+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:44.559698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595680+0000","last_change":"2024-09-10T08:40:38.595680+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595680+0000","last_undegraded":"2024-09-10T08:40:38.595680+0000","last_fullsized":"2024-09-10T08:40:38.595680+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613473+0000","last_change":"2024-09-10T08:40:38.611840+0000","last_active":"2024-09-10T08:40:39.613473+0000","last_peered":"2024-09-10T08:40:39.613473+0000","last_clean":"2024-09-10T08:40:39.613473+0000","last_became_active":"2024-09-10T08:40:38.611553+0000","last_became_peered":"2024-09-10T08:40:38.611553+0000","last_unstale":"2024-09-10T08:40:39.613473+0000","last_undegraded":"2024-09-10T08:40:39.613473+0000","last_fullsized":"2024-09-10T08:40:39.613473+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:46.146476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.597389+0000","last_change":"2024-09-10T08:40:38.597389+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.597389+0000","last_undegraded":"2024-09-10T08:40:38.597389+0000","last_fullsized":"2024-09-10T08:40:38.597389+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.608107+0000","last_change":"2024-09-10T08:40:38.606693+0000","last_active":"2024-09-10T08:40:38.608107+0000","last_peered":"2024-09-10T08:40:38.608107+0000","last_clean":"2024-09-10T08:40:38.608107+0000","last_became_active":"2024-09-10T08:40:38.605494+0000","last_became_peered":"2024-09-10T08:40:38.605494+0000","last_unstale":"2024-09-10T08:40:38.608107+0000","last_undegraded":"2024-09-10T08:40:38.608107+0000","last_fullsized":"2024-09-10T08:40:38.608107+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:23.432231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.598658+0000","last_change":"2024-09-10T08:40:38.598658+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.598658+0000","last_undegraded":"2024-09-10T08:40:38.598658+0000","last_fullsized":"2024-09-10T08:40:38.598658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.605973+0000","last_change":"2024-09-10T08:40:38.601853+0000","last_active":"2024-09-10T08:40:38.605973+0000","last_peered":"2024-09-10T08:40:38.605973+0000","last_clean":"2024-09-10T08:40:38.605973+0000","last_became_active":"2024-09-10T08:40:38.601534+0000","last_became_peered":"2024-09-10T08:40:38.601534+0000","last_unstale":"2024-09-10T08:40:38.605973+0000","last_undegraded":"2024-09-10T08:40:38.605973+0000","last_fullsized":"2024-09-10T08:40:38.605973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:15.105563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615796+0000","last_change":"2024-09-10T08:40:39.614735+0000","last_active":"2024-09-10T08:40:39.615796+0000","last_peered":"2024-09-10T08:40:39.615796+0000","last_clean":"2024-09-10T08:40:39.615796+0000","last_became_active":"2024-09-10T08:40:39.614305+0000","last_became_peered":"2024-09-10T08:40:39.614305+0000","last_unstale":"2024-09-10T08:40:39.615796+0000","last_undegraded":"2024-09-10T08:40:39.615796+0000","last_fullsized":"2024-09-10T08:40:39.615796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593911+0000","last_change":"2024-09-10T08:40:38.607592+0000","last_active":"2024-09-10T08:40:39.593911+0000","last_peered":"2024-09-10T08:40:39.593911+0000","last_clean":"2024-09-10T08:40:39.593911+0000","last_became_active":"2024-09-10T08:40:38.607327+0000","last_became_peered":"2024-09-10T08:40:38.607327+0000","last_unstale":"2024-09-10T08:40:39.593911+0000","last_undegraded":"2024-09-10T08:40:39.593911+0000","last_fullsized":"2024-09-10T08:40:39.593911+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.942146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614886+0000","last_change":"2024-09-10T08:40:39.605335+0000","last_active":"2024-09-10T08:40:39.614886+0000","last_peered":"2024-09-10T08:40:39.614886+0000","last_clean":"2024-09-10T08:40:39.614886+0000","last_became_active":"2024-09-10T08:40:39.605015+0000","last_became_peered":"2024-09-10T08:40:39.605015+0000","last_unstale":"2024-09-10T08:40:39.614886+0000","last_undegraded":"2024-09-10T08:40:39.614886+0000","last_fullsized":"2024-09-10T08:40:39.614886+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:48.987807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592390+0000","last_change":"2024-09-10T08:40:38.604528+0000","last_active":"2024-09-10T08:40:39.592390+0000","last_peered":"2024-09-10T08:40:39.592390+0000","last_clean":"2024-09-10T08:40:39.592390+0000","last_became_active":"2024-09-10T08:40:38.602419+0000","last_became_peered":"2024-09-10T08:40:38.602419+0000","last_unstale":"2024-09-10T08:40:39.592390+0000","last_undegraded":"2024-09-10T08:40:39.592390+0000","last_fullsized":"2024-09-10T08:40:39.592390+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:53.016826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608198+0000","last_change":"2024-09-10T08:40:39.600972+0000","last_active":"2024-09-10T08:40:39.608198+0000","last_peered":"2024-09-10T08:40:39.608198+0000","last_clean":"2024-09-10T08:40:39.608198+0000","last_became_active":"2024-09-10T08:40:39.600696+0000","last_became_peered":"2024-09-10T08:40:39.600696+0000","last_unstale":"2024-09-10T08:40:39.608198+0000","last_undegraded":"2024-09-10T08:40:39.608198+0000","last_fullsized":"2024-09-10T08:40:39.608198+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:44.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597585+0000","last_change":"2024-09-10T08:40:38.598840+0000","last_active":"2024-09-10T08:40:39.597585+0000","last_peered":"2024-09-10T08:40:39.597585+0000","last_clean":"2024-09-10T08:40:39.597585+0000","last_became_active":"2024-09-10T08:40:38.598539+0000","last_became_peered":"2024-09-10T08:40:38.598539+0000","last_unstale":"2024-09-10T08:40:39.597585+0000","last_undegraded":"2024-09-10T08:40:39.597585+0000","last_fullsized":"2024-09-10T08:40:39.597585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:40.709904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616557+0000","last_change":"2024-09-10T08:40:39.610363+0000","last_active":"2024-09-10T08:40:39.616557+0000","last_peered":"2024-09-10T08:40:39.616557+0000","last_clean":"2024-09-10T08:40:39.616557+0000","last_became_active":"2024-09-10T08:40:39.609936+0000","last_became_peered":"2024-09-10T08:40:39.609936+0000","last_unstale":"2024-09-10T08:40:39.616557+0000","last_undegraded":"2024-09-10T08:40:39.616557+0000","last_fullsized":"2024-09-10T08:40:39.616557+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:59.391662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597883+0000","last_change":"2024-09-10T08:40:38.600904+0000","last_active":"2024-09-10T08:40:39.597883+0000","last_peered":"2024-09-10T08:40:39.597883+0000","last_clean":"2024-09-10T08:40:39.597883+0000","last_became_active":"2024-09-10T08:40:38.600572+0000","last_became_peered":"2024-09-10T08:40:38.600572+0000","last_unstale":"2024-09-10T08:40:39.597883+0000","last_undegraded":"2024-09-10T08:40:39.597883+0000","last_fullsized":"2024-09-10T08:40:39.597883+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:16.573172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609866+0000","last_change":"2024-09-10T08:40:39.605511+0000","last_active":"2024-09-10T08:40:39.609866+0000","last_peered":"2024-09-10T08:40:39.609866+0000","last_clean":"2024-09-10T08:40:39.609866+0000","last_became_active":"2024-09-10T08:40:39.605208+0000","last_became_peered":"2024-09-10T08:40:39.605208+0000","last_unstale":"2024-09-10T08:40:39.609866+0000","last_undegraded":"2024-09-10T08:40:39.609866+0000","last_fullsized":"2024-09-10T08:40:39.609866+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.227456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585592+0000","last_change":"2024-09-10T08:40:38.607736+0000","last_active":"2024-09-10T08:40:39.585592+0000","last_peered":"2024-09-10T08:40:39.585592+0000","last_clean":"2024-09-10T08:40:39.585592+0000","last_became_active":"2024-09-10T08:40:38.607482+0000","last_became_peered":"2024-09-10T08:40:38.607482+0000","last_unstale":"2024-09-10T08:40:39.585592+0000","last_undegraded":"2024-09-10T08:40:39.585592+0000","last_fullsized":"2024-09-10T08:40:39.585592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:25.625722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591040+0000","last_change":"2024-09-10T08:40:39.589188+0000","last_active":"2024-09-10T08:40:39.591040+0000","last_peered":"2024-09-10T08:40:39.591040+0000","last_clean":"2024-09-10T08:40:39.591040+0000","last_became_active":"2024-09-10T08:40:39.588915+0000","last_became_peered":"2024-09-10T08:40:39.588915+0000","last_unstale":"2024-09-10T08:40:39.591040+0000","last_undegraded":"2024-09-10T08:40:39.591040+0000","last_fullsized":"2024-09-10T08:40:39.591040+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:33.170578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.582541+0000","last_change":"2024-09-10T08:40:38.596603+0000","last_active":"2024-09-10T08:40:39.582541+0000","last_peered":"2024-09-10T08:40:39.582541+0000","last_clean":"2024-09-10T08:40:39.582541+0000","last_became_active":"2024-09-10T08:40:38.594989+0000","last_became_peered":"2024-09-10T08:40:38.594989+0000","last_unstale":"2024-09-10T08:40:39.582541+0000","last_undegraded":"2024-09-10T08:40:39.582541+0000","last_fullsized":"2024-09-10T08:40:39.582541+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:52.691150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":442,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591462+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:40:39.591462+0000","last_peered":"2024-09-10T08:40:39.591462+0000","last_clean":"2024-09-10T08:40:39.591462+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:40:39.591462+0000","last_undegraded":"2024-09-10T08:40:39.591462+0000","last_fullsized":"2024-09-10T08:40:39.591462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51316,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320524,"statfs":{"total":96636764160,"available":96584216576,"internally_reserved":0,"allocated":2129920,"data_stored":936713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55468,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316372,"statfs":{"total":96636764160,"available":96579964928,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47144,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324696,"statfs":{"total":96636764160,"available":96588488704,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63804,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308036,"statfs":{"total":96636764160,"available":96571428864,"internally_reserved":0,"allocated":2134016,"data_stored":936783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1520306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":2699264,"data_stored":1514031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:40:44.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:40:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.418+0000 7f37c1400640 1 Processor -- start 2024-09-10T08:40:44.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.419+0000 7f37c1400640 1 -- start start 2024-09-10T08:40:44.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37c1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 0x7f37bc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37c1400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f37bc073180 0x7f37bc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37c1400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37bc0b4020 con 0x7f37bc0b5880 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37c1400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f37bc073b00 con 0x7f37bc073180 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37c1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37bc0b42c0 con 0x7f37bc145ed0 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37bb200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f37bc0b5880 0x7f37bc0b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46322/0 (socket says 172.21.15.52:46322) 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37bb200640 1 -- 172.21.15.52:0/2013101721 learned_addr learned my addr 172.21.15.52:0/2013101721 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37ba800640 1 --2- 172.21.15.52:0/2013101721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 0x7f37bc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.420+0000 7f37b9e00640 1 --2- 172.21.15.52:0/2013101721 >> v2:172.21.15.176:3300/0 conn(0x7f37bc073180 0x7f37bc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37b9400640 1 -- 172.21.15.52:0/2013101721 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532672181 0 0) 0x7f37bc0b4020 con 0x7f37bc0b5880 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37b9400640 1 -- 172.21.15.52:0/2013101721 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37a0003520 con 0x7f37bc0b5880 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37ba800640 1 -- 172.21.15.52:0/2013101721 >> v2:172.21.15.176:3300/0 conn(0x7f37bc073180 msgr2=0x7f37bc0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37ba800640 1 --2- 172.21.15.52:0/2013101721 >> v2:172.21.15.176:3300/0 conn(0x7f37bc073180 0x7f37bc0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37ba800640 1 -- 172.21.15.52:0/2013101721 >> v1:172.21.15.52:6789/0 conn(0x7f37bc0b5880 legacy=0x7f37bc0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.421+0000 7f37ba800640 1 -- 172.21.15.52:0/2013101721 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc0b45a0 con 0x7f37bc145ed0 2024-09-10T08:40:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.422+0000 7f37ba800640 1 --2- 172.21.15.52:0/2013101721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 0x7f37bc0b5080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0097a0 tx=0x7f37ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98157395705b5142 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.422+0000 7f37b9400640 1 -- 172.21.15.52:0/2013101721 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037070 con 0x7f37bc145ed0 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.422+0000 7f37b9400640 1 -- 172.21.15.52:0/2013101721 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac032440 con 0x7f37bc145ed0 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.422+0000 7f37b9400640 1 -- 172.21.15.52:0/2013101721 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0327f0 con 0x7f37bc145ed0 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 -- 172.21.15.52:0/2013101721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 msgr2=0x7f37bc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 --2- 172.21.15.52:0/2013101721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 0x7f37bc0b5080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0097a0 tx=0x7f37ac02a180 comp rx=0 tx=0).stop 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 -- 172.21.15.52:0/2013101721 shutdown_connections 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 --2- 172.21.15.52:0/2013101721 >> v2:172.21.15.176:3300/0 conn(0x7f37bc073180 0x7f37bc0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 --2- 172.21.15.52:0/2013101721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc145ed0 0x7f37bc0b5080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 -- 172.21.15.52:0/2013101721 >> 172.21.15.52:0/2013101721 conn(0x7f37bc0ccec0 msgr2=0x7f37bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 -- 172.21.15.52:0/2013101721 shutdown_connections 2024-09-10T08:40:44.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.423+0000 7f37c1400640 1 -- 172.21.15.52:0/2013101721 wait complete. 2024-09-10T08:40:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.425+0000 7f37c1400640 1 Processor -- start 2024-09-10T08:40:44.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.425+0000 7f37c1400640 1 -- start start 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 0x7f37bc145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 0x7f37bc156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc1462b0 con 0x7f37bc073180 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc0b4b60 con 0x7f37bc145ed0 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37c1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f37bc146430 con 0x7f37bc0b5880 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53744/0 (socket says 172.21.15.52:53744) 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 -- 172.21.15.52:0/4239023107 learned_addr learned my addr 172.21.15.52:0/4239023107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:44.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37bb200640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 0x7f37bc156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 -- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 msgr2=0x7f37bc145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37b9e00640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 0x7f37bc145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 0x7f37bc145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 -- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 msgr2=0x7f37bc156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 0x7f37bc156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37ba800640 1 -- 172.21.15.52:0/4239023107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc155aa0 con 0x7f37bc073180 2024-09-10T08:40:44.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37b9e00640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 0x7f37bc145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.426+0000 7f37bb200640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 0x7f37bc156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37ba800640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f37ac02a1c0 tx=0x7f37ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac041020 con 0x7f37bc073180 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac03d620 con 0x7f37bc073180 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037040 con 0x7f37bc073180 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc155d80 con 0x7f37bc073180 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.427+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc1455d0 con 0x7f37bc073180 2024-09-10T08:40:44.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.428+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc0735c0 con 0x7f37bc073180 2024-09-10T08:40:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.429+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37ac044020 con 0x7f37bc073180 2024-09-10T08:40:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.430+0000 7f37b2a00640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.430+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f37ac0ab710 con 0x7f37bc073180 2024-09-10T08:40:44.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.430+0000 7f37b9e00640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.431+0000 7f37b9e00640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0d0090 tx=0x7f37a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.434+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37ac04b030 con 0x7f37bc073180 2024-09-10T08:40:44.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.616+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37bc143260 con 0x7f379c06be30 2024-09-10T08:40:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.624+0000 7f37b2a00640 1 -- 172.21.15.52:0/4239023107 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251673 (secure 0 0 0) 0x7f37bc143260 con 0x7f379c06be30 2024-09-10T08:40:44.627 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 msgr2=0x7f379c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 0x7f379c06e2f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0d0090 tx=0x7f37a8008040 comp rx=0 tx=0).stop 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 msgr2=0x7f37bc13cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f37ac02a1c0 tx=0x7f37ac0046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 shutdown_connections 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f379c06be30 0x7f379c06e2f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f37bc145ed0 0x7f37bc156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37bc0b5880 0x7f37bc145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 --2- 172.21.15.52:0/4239023107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37bc073180 0x7f37bc13cb90 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 >> 172.21.15.52:0/4239023107 conn(0x7f37bc0ccec0 msgr2=0x7f37bc142600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 shutdown_connections 2024-09-10T08:40:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.628+0000 7f37c1400640 1 -- 172.21.15.52:0/4239023107 wait complete. 2024-09-10T08:40:44.644 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":529,"stamp":"2024-09-10T08:40:43.633471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444896,"kb_used_data":17720,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529824,"statfs":{"total":773094113280,"available":772638539776,"internally_reserved":0,"allocated":18145280,"data_stored":8627585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614955+0000","last_change":"2024-09-10T08:40:39.611318+0000","last_active":"2024-09-10T08:40:39.614955+0000","last_peered":"2024-09-10T08:40:39.614955+0000","last_clean":"2024-09-10T08:40:39.614955+0000","last_became_active":"2024-09-10T08:40:39.611027+0000","last_became_peered":"2024-09-10T08:40:39.611027+0000","last_unstale":"2024-09-10T08:40:39.614955+0000","last_undegraded":"2024-09-10T08:40:39.614955+0000","last_fullsized":"2024-09-10T08:40:39.614955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:31.420624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615813+0000","last_change":"2024-09-10T08:40:39.609260+0000","last_active":"2024-09-10T08:40:39.615813+0000","last_peered":"2024-09-10T08:40:39.615813+0000","last_clean":"2024-09-10T08:40:39.615813+0000","last_became_active":"2024-09-10T08:40:39.608971+0000","last_became_peered":"2024-09-10T08:40:39.608971+0000","last_unstale":"2024-09-10T08:40:39.615813+0000","last_undegraded":"2024-09-10T08:40:39.615813+0000","last_fullsized":"2024-09-10T08:40:39.615813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:44.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596612+0000","last_change":"2024-09-10T08:40:38.596612+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596612+0000","last_undegraded":"2024-09-10T08:40:38.596612+0000","last_fullsized":"2024-09-10T08:40:38.596612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614970+0000","last_change":"2024-09-10T08:40:39.605534+0000","last_active":"2024-09-10T08:40:39.614970+0000","last_peered":"2024-09-10T08:40:39.614970+0000","last_clean":"2024-09-10T08:40:39.614970+0000","last_became_active":"2024-09-10T08:40:39.605235+0000","last_became_peered":"2024-09-10T08:40:39.605235+0000","last_unstale":"2024-09-10T08:40:39.614970+0000","last_undegraded":"2024-09-10T08:40:39.614970+0000","last_fullsized":"2024-09-10T08:40:39.614970+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:41.680474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615691+0000","last_change":"2024-09-10T08:40:39.614794+0000","last_active":"2024-09-10T08:40:39.615691+0000","last_peered":"2024-09-10T08:40:39.615691+0000","last_clean":"2024-09-10T08:40:39.615691+0000","last_became_active":"2024-09-10T08:40:39.614532+0000","last_became_peered":"2024-09-10T08:40:39.614532+0000","last_unstale":"2024-09-10T08:40:39.615691+0000","last_undegraded":"2024-09-10T08:40:39.615691+0000","last_fullsized":"2024-09-10T08:40:39.615691+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607803+0000","last_change":"2024-09-10T08:40:39.601372+0000","last_active":"2024-09-10T08:40:39.607803+0000","last_peered":"2024-09-10T08:40:39.607803+0000","last_clean":"2024-09-10T08:40:39.607803+0000","last_became_active":"2024-09-10T08:40:39.600883+0000","last_became_peered":"2024-09-10T08:40:39.600883+0000","last_unstale":"2024-09-10T08:40:39.607803+0000","last_undegraded":"2024-09-10T08:40:39.607803+0000","last_fullsized":"2024-09-10T08:40:39.607803+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:30.821124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.600518+0000","last_change":"2024-09-10T08:40:39.594012+0000","last_active":"2024-09-10T08:40:39.600518+0000","last_peered":"2024-09-10T08:40:39.600518+0000","last_clean":"2024-09-10T08:40:39.600518+0000","last_became_active":"2024-09-10T08:40:39.593736+0000","last_became_peered":"2024-09-10T08:40:39.593736+0000","last_unstale":"2024-09-10T08:40:39.600518+0000","last_undegraded":"2024-09-10T08:40:39.600518+0000","last_fullsized":"2024-09-10T08:40:39.600518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610000+0000","last_change":"2024-09-10T08:40:39.606793+0000","last_active":"2024-09-10T08:40:39.610000+0000","last_peered":"2024-09-10T08:40:39.610000+0000","last_clean":"2024-09-10T08:40:39.610000+0000","last_became_active":"2024-09-10T08:40:39.606321+0000","last_became_peered":"2024-09-10T08:40:39.606321+0000","last_unstale":"2024-09-10T08:40:39.610000+0000","last_undegraded":"2024-09-10T08:40:39.610000+0000","last_fullsized":"2024-09-10T08:40:39.610000+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:24.778080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615574+0000","last_change":"2024-09-10T08:40:39.607866+0000","last_active":"2024-09-10T08:40:39.615574+0000","last_peered":"2024-09-10T08:40:39.615574+0000","last_clean":"2024-09-10T08:40:39.615574+0000","last_became_active":"2024-09-10T08:40:39.607413+0000","last_became_peered":"2024-09-10T08:40:39.607413+0000","last_unstale":"2024-09-10T08:40:39.615574+0000","last_undegraded":"2024-09-10T08:40:39.615574+0000","last_fullsized":"2024-09-10T08:40:39.615574+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610285+0000","last_change":"2024-09-10T08:40:39.607709+0000","last_active":"2024-09-10T08:40:39.610285+0000","last_peered":"2024-09-10T08:40:39.610285+0000","last_clean":"2024-09-10T08:40:39.610285+0000","last_became_active":"2024-09-10T08:40:39.603723+0000","last_became_peered":"2024-09-10T08:40:39.603723+0000","last_unstale":"2024-09-10T08:40:39.610285+0000","last_undegraded":"2024-09-10T08:40:39.610285+0000","last_fullsized":"2024-09-10T08:40:39.610285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:32.851653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615496+0000","last_change":"2024-09-10T08:40:39.607624+0000","last_active":"2024-09-10T08:40:39.615496+0000","last_peered":"2024-09-10T08:40:39.615496+0000","last_clean":"2024-09-10T08:40:39.615496+0000","last_became_active":"2024-09-10T08:40:39.607331+0000","last_became_peered":"2024-09-10T08:40:39.607331+0000","last_unstale":"2024-09-10T08:40:39.615496+0000","last_undegraded":"2024-09-10T08:40:39.615496+0000","last_fullsized":"2024-09-10T08:40:39.615496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:28.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603220+0000","last_change":"2024-09-10T08:40:39.602367+0000","last_active":"2024-09-10T08:40:39.603220+0000","last_peered":"2024-09-10T08:40:39.603220+0000","last_clean":"2024-09-10T08:40:39.603220+0000","last_became_active":"2024-09-10T08:40:39.602061+0000","last_became_peered":"2024-09-10T08:40:39.602061+0000","last_unstale":"2024-09-10T08:40:39.603220+0000","last_undegraded":"2024-09-10T08:40:39.603220+0000","last_fullsized":"2024-09-10T08:40:39.603220+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:36.086412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608217+0000","last_change":"2024-09-10T08:40:39.606370+0000","last_active":"2024-09-10T08:40:39.608217+0000","last_peered":"2024-09-10T08:40:39.608217+0000","last_clean":"2024-09-10T08:40:39.608217+0000","last_became_active":"2024-09-10T08:40:39.606005+0000","last_became_peered":"2024-09-10T08:40:39.606005+0000","last_unstale":"2024-09-10T08:40:39.608217+0000","last_undegraded":"2024-09-10T08:40:39.608217+0000","last_fullsized":"2024-09-10T08:40:39.608217+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:38.921411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.617169+0000","last_change":"2024-09-10T08:40:39.611415+0000","last_active":"2024-09-10T08:40:39.617169+0000","last_peered":"2024-09-10T08:40:39.617169+0000","last_clean":"2024-09-10T08:40:39.617169+0000","last_became_active":"2024-09-10T08:40:39.611117+0000","last_became_peered":"2024-09-10T08:40:39.611117+0000","last_unstale":"2024-09-10T08:40:39.617169+0000","last_undegraded":"2024-09-10T08:40:39.617169+0000","last_fullsized":"2024-09-10T08:40:39.617169+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:29.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614988+0000","last_change":"2024-09-10T08:40:39.612070+0000","last_active":"2024-09-10T08:40:39.614988+0000","last_peered":"2024-09-10T08:40:39.614988+0000","last_clean":"2024-09-10T08:40:39.614988+0000","last_became_active":"2024-09-10T08:40:39.611186+0000","last_became_peered":"2024-09-10T08:40:39.611186+0000","last_unstale":"2024-09-10T08:40:39.614988+0000","last_undegraded":"2024-09-10T08:40:39.614988+0000","last_fullsized":"2024-09-10T08:40:39.614988+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:42.961556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.593853+0000","last_change":"2024-09-10T08:40:38.593853+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.593853+0000","last_undegraded":"2024-09-10T08:40:38.593853+0000","last_fullsized":"2024-09-10T08:40:38.593853+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608176+0000","last_change":"2024-09-10T08:40:39.606371+0000","last_active":"2024-09-10T08:40:39.608176+0000","last_peered":"2024-09-10T08:40:39.608176+0000","last_clean":"2024-09-10T08:40:39.608176+0000","last_became_active":"2024-09-10T08:40:39.606096+0000","last_became_peered":"2024-09-10T08:40:39.606096+0000","last_unstale":"2024-09-10T08:40:39.608176+0000","last_undegraded":"2024-09-10T08:40:39.608176+0000","last_fullsized":"2024-09-10T08:40:39.608176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:19.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608605+0000","last_change":"2024-09-10T08:40:39.607991+0000","last_active":"2024-09-10T08:40:39.608605+0000","last_peered":"2024-09-10T08:40:39.608605+0000","last_clean":"2024-09-10T08:40:39.608605+0000","last_became_active":"2024-09-10T08:40:39.607654+0000","last_became_peered":"2024-09-10T08:40:39.607654+0000","last_unstale":"2024-09-10T08:40:39.608605+0000","last_undegraded":"2024-09-10T08:40:39.608605+0000","last_fullsized":"2024-09-10T08:40:39.608605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596208+0000","last_change":"2024-09-10T08:40:38.596208+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596208+0000","last_undegraded":"2024-09-10T08:40:38.596208+0000","last_fullsized":"2024-09-10T08:40:38.596208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603905+0000","last_change":"2024-09-10T08:40:39.602035+0000","last_active":"2024-09-10T08:40:39.603905+0000","last_peered":"2024-09-10T08:40:39.603905+0000","last_clean":"2024-09-10T08:40:39.603905+0000","last_became_active":"2024-09-10T08:40:39.601010+0000","last_became_peered":"2024-09-10T08:40:39.601010+0000","last_unstale":"2024-09-10T08:40:39.603905+0000","last_undegraded":"2024-09-10T08:40:39.603905+0000","last_fullsized":"2024-09-10T08:40:39.603905+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:44.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.594932+0000","last_change":"2024-09-10T08:40:38.594932+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.594932+0000","last_undegraded":"2024-09-10T08:40:38.594932+0000","last_fullsized":"2024-09-10T08:40:38.594932+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604016+0000","last_change":"2024-09-10T08:40:39.602559+0000","last_active":"2024-09-10T08:40:39.604016+0000","last_peered":"2024-09-10T08:40:39.604016+0000","last_clean":"2024-09-10T08:40:39.604016+0000","last_became_active":"2024-09-10T08:40:39.601707+0000","last_became_peered":"2024-09-10T08:40:39.601707+0000","last_unstale":"2024-09-10T08:40:39.604016+0000","last_undegraded":"2024-09-10T08:40:39.604016+0000","last_fullsized":"2024-09-10T08:40:39.604016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:47.154878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609518+0000","last_change":"2024-09-10T08:40:39.606541+0000","last_active":"2024-09-10T08:40:39.609518+0000","last_peered":"2024-09-10T08:40:39.609518+0000","last_clean":"2024-09-10T08:40:39.609518+0000","last_became_active":"2024-09-10T08:40:39.605678+0000","last_became_peered":"2024-09-10T08:40:39.605678+0000","last_unstale":"2024-09-10T08:40:39.609518+0000","last_undegraded":"2024-09-10T08:40:39.609518+0000","last_fullsized":"2024-09-10T08:40:39.609518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610811+0000","last_change":"2024-09-10T08:40:39.607744+0000","last_active":"2024-09-10T08:40:39.610811+0000","last_peered":"2024-09-10T08:40:39.610811+0000","last_clean":"2024-09-10T08:40:39.610811+0000","last_became_active":"2024-09-10T08:40:39.604829+0000","last_became_peered":"2024-09-10T08:40:39.604829+0000","last_unstale":"2024-09-10T08:40:39.610811+0000","last_undegraded":"2024-09-10T08:40:39.610811+0000","last_fullsized":"2024-09-10T08:40:39.610811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:17.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615549+0000","last_change":"2024-09-10T08:40:39.607658+0000","last_active":"2024-09-10T08:40:39.615549+0000","last_peered":"2024-09-10T08:40:39.615549+0000","last_clean":"2024-09-10T08:40:39.615549+0000","last_became_active":"2024-09-10T08:40:39.607088+0000","last_became_peered":"2024-09-10T08:40:39.607088+0000","last_unstale":"2024-09-10T08:40:39.615549+0000","last_undegraded":"2024-09-10T08:40:39.615549+0000","last_fullsized":"2024-09-10T08:40:39.615549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:12.010728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595229+0000","last_change":"2024-09-10T08:40:39.590285+0000","last_active":"2024-09-10T08:40:39.595229+0000","last_peered":"2024-09-10T08:40:39.595229+0000","last_clean":"2024-09-10T08:40:39.595229+0000","last_became_active":"2024-09-10T08:40:39.588993+0000","last_became_peered":"2024-09-10T08:40:39.588993+0000","last_unstale":"2024-09-10T08:40:39.595229+0000","last_undegraded":"2024-09-10T08:40:39.595229+0000","last_fullsized":"2024-09-10T08:40:39.595229+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:07.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595772+0000","last_change":"2024-09-10T08:40:38.595772+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595772+0000","last_undegraded":"2024-09-10T08:40:38.595772+0000","last_fullsized":"2024-09-10T08:40:38.595772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611382+0000","last_change":"2024-09-10T08:40:39.610193+0000","last_active":"2024-09-10T08:40:39.611382+0000","last_peered":"2024-09-10T08:40:39.611382+0000","last_clean":"2024-09-10T08:40:39.611382+0000","last_became_active":"2024-09-10T08:40:39.609275+0000","last_became_peered":"2024-09-10T08:40:39.609275+0000","last_unstale":"2024-09-10T08:40:39.611382+0000","last_undegraded":"2024-09-10T08:40:39.611382+0000","last_fullsized":"2024-09-10T08:40:39.611382+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:42.617055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.612711+0000","last_change":"2024-09-10T08:40:39.610728+0000","last_active":"2024-09-10T08:40:39.612711+0000","last_peered":"2024-09-10T08:40:39.612711+0000","last_clean":"2024-09-10T08:40:39.612711+0000","last_became_active":"2024-09-10T08:40:39.609408+0000","last_became_peered":"2024-09-10T08:40:39.609408+0000","last_unstale":"2024-09-10T08:40:39.612711+0000","last_undegraded":"2024-09-10T08:40:39.612711+0000","last_fullsized":"2024-09-10T08:40:39.612711+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:41.928734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595387+0000","last_change":"2024-09-10T08:40:39.589135+0000","last_active":"2024-09-10T08:40:39.595387+0000","last_peered":"2024-09-10T08:40:39.595387+0000","last_clean":"2024-09-10T08:40:39.595387+0000","last_became_active":"2024-09-10T08:40:39.588819+0000","last_became_peered":"2024-09-10T08:40:39.588819+0000","last_unstale":"2024-09-10T08:40:39.595387+0000","last_undegraded":"2024-09-10T08:40:39.595387+0000","last_fullsized":"2024-09-10T08:40:39.595387+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:45.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598018+0000","last_change":"2024-09-10T08:40:39.597382+0000","last_active":"2024-09-10T08:40:39.598018+0000","last_peered":"2024-09-10T08:40:39.598018+0000","last_clean":"2024-09-10T08:40:39.598018+0000","last_became_active":"2024-09-10T08:40:39.597095+0000","last_became_peered":"2024-09-10T08:40:39.597095+0000","last_unstale":"2024-09-10T08:40:39.598018+0000","last_undegraded":"2024-09-10T08:40:39.598018+0000","last_fullsized":"2024-09-10T08:40:39.598018+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.724926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616582+0000","last_change":"2024-09-10T08:40:39.615657+0000","last_active":"2024-09-10T08:40:39.616582+0000","last_peered":"2024-09-10T08:40:39.616582+0000","last_clean":"2024-09-10T08:40:39.616582+0000","last_became_active":"2024-09-10T08:40:39.615390+0000","last_became_peered":"2024-09-10T08:40:39.615390+0000","last_unstale":"2024-09-10T08:40:39.616582+0000","last_undegraded":"2024-09-10T08:40:39.616582+0000","last_fullsized":"2024-09-10T08:40:39.616582+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604283+0000","last_change":"2024-09-10T08:40:39.603264+0000","last_active":"2024-09-10T08:40:39.604283+0000","last_peered":"2024-09-10T08:40:39.604283+0000","last_clean":"2024-09-10T08:40:39.604283+0000","last_became_active":"2024-09-10T08:40:39.602001+0000","last_became_peered":"2024-09-10T08:40:39.602001+0000","last_unstale":"2024-09-10T08:40:39.604283+0000","last_undegraded":"2024-09-10T08:40:39.604283+0000","last_fullsized":"2024-09-10T08:40:39.604283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.606585+0000","last_change":"2024-09-10T08:40:38.604785+0000","last_active":"2024-09-10T08:40:38.606585+0000","last_peered":"2024-09-10T08:40:38.606585+0000","last_clean":"2024-09-10T08:40:38.606585+0000","last_became_active":"2024-09-10T08:40:38.604514+0000","last_became_peered":"2024-09-10T08:40:38.604514+0000","last_unstale":"2024-09-10T08:40:38.606585+0000","last_undegraded":"2024-09-10T08:40:38.606585+0000","last_fullsized":"2024-09-10T08:40:38.606585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:29.631375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609620+0000","last_change":"2024-09-10T08:40:39.607215+0000","last_active":"2024-09-10T08:40:39.609620+0000","last_peered":"2024-09-10T08:40:39.609620+0000","last_clean":"2024-09-10T08:40:39.609620+0000","last_became_active":"2024-09-10T08:40:39.606858+0000","last_became_peered":"2024-09-10T08:40:39.606858+0000","last_unstale":"2024-09-10T08:40:39.609620+0000","last_undegraded":"2024-09-10T08:40:39.609620+0000","last_fullsized":"2024-09-10T08:40:39.609620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:09.425294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619702+0000","last_change":"2024-09-10T08:40:38.603266+0000","last_active":"2024-09-10T08:40:39.619702+0000","last_peered":"2024-09-10T08:40:39.619702+0000","last_clean":"2024-09-10T08:40:39.619702+0000","last_became_active":"2024-09-10T08:40:38.602932+0000","last_became_peered":"2024-09-10T08:40:38.602932+0000","last_unstale":"2024-09-10T08:40:39.619702+0000","last_undegraded":"2024-09-10T08:40:39.619702+0000","last_fullsized":"2024-09-10T08:40:39.619702+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.782228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616084+0000","last_change":"2024-09-10T08:40:39.609371+0000","last_active":"2024-09-10T08:40:39.616084+0000","last_peered":"2024-09-10T08:40:39.616084+0000","last_clean":"2024-09-10T08:40:39.616084+0000","last_became_active":"2024-09-10T08:40:39.609083+0000","last_became_peered":"2024-09-10T08:40:39.609083+0000","last_unstale":"2024-09-10T08:40:39.616084+0000","last_undegraded":"2024-09-10T08:40:39.616084+0000","last_fullsized":"2024-09-10T08:40:39.616084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:04.082259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621677+0000","last_change":"2024-09-10T08:40:38.611280+0000","last_active":"2024-09-10T08:40:39.621677+0000","last_peered":"2024-09-10T08:40:39.621677+0000","last_clean":"2024-09-10T08:40:39.621677+0000","last_became_active":"2024-09-10T08:40:38.610992+0000","last_became_peered":"2024-09-10T08:40:38.610992+0000","last_unstale":"2024-09-10T08:40:39.621677+0000","last_undegraded":"2024-09-10T08:40:39.621677+0000","last_fullsized":"2024-09-10T08:40:39.621677+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615697+0000","last_change":"2024-09-10T08:40:39.608923+0000","last_active":"2024-09-10T08:40:39.615697+0000","last_peered":"2024-09-10T08:40:39.615697+0000","last_clean":"2024-09-10T08:40:39.615697+0000","last_became_active":"2024-09-10T08:40:39.608659+0000","last_became_peered":"2024-09-10T08:40:39.608659+0000","last_unstale":"2024-09-10T08:40:39.615697+0000","last_undegraded":"2024-09-10T08:40:39.615697+0000","last_fullsized":"2024-09-10T08:40:39.615697+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:26.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622253+0000","last_change":"2024-09-10T08:40:38.603525+0000","last_active":"2024-09-10T08:40:39.622253+0000","last_peered":"2024-09-10T08:40:39.622253+0000","last_clean":"2024-09-10T08:40:39.622253+0000","last_became_active":"2024-09-10T08:40:38.603260+0000","last_became_peered":"2024-09-10T08:40:38.603260+0000","last_unstale":"2024-09-10T08:40:39.622253+0000","last_undegraded":"2024-09-10T08:40:39.622253+0000","last_fullsized":"2024-09-10T08:40:39.622253+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:55.827552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607782+0000","last_change":"2024-09-10T08:40:39.601136+0000","last_active":"2024-09-10T08:40:39.607782+0000","last_peered":"2024-09-10T08:40:39.607782+0000","last_clean":"2024-09-10T08:40:39.607782+0000","last_became_active":"2024-09-10T08:40:39.600532+0000","last_became_peered":"2024-09-10T08:40:39.600532+0000","last_unstale":"2024-09-10T08:40:39.607782+0000","last_undegraded":"2024-09-10T08:40:39.607782+0000","last_fullsized":"2024-09-10T08:40:39.607782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:07.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621755+0000","last_change":"2024-09-10T08:40:38.610462+0000","last_active":"2024-09-10T08:40:39.621755+0000","last_peered":"2024-09-10T08:40:39.621755+0000","last_clean":"2024-09-10T08:40:39.621755+0000","last_became_active":"2024-09-10T08:40:38.610181+0000","last_became_peered":"2024-09-10T08:40:38.610181+0000","last_unstale":"2024-09-10T08:40:39.621755+0000","last_undegraded":"2024-09-10T08:40:39.621755+0000","last_fullsized":"2024-09-10T08:40:39.621755+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:40.925346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616405+0000","last_change":"2024-09-10T08:40:39.615214+0000","last_active":"2024-09-10T08:40:39.616405+0000","last_peered":"2024-09-10T08:40:39.616405+0000","last_clean":"2024-09-10T08:40:39.616405+0000","last_became_active":"2024-09-10T08:40:39.614895+0000","last_became_peered":"2024-09-10T08:40:39.614895+0000","last_unstale":"2024-09-10T08:40:39.616405+0000","last_undegraded":"2024-09-10T08:40:39.616405+0000","last_fullsized":"2024-09-10T08:40:39.616405+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621084+0000","last_change":"2024-09-10T08:40:38.608616+0000","last_active":"2024-09-10T08:40:39.621084+0000","last_peered":"2024-09-10T08:40:39.621084+0000","last_clean":"2024-09-10T08:40:39.621084+0000","last_became_active":"2024-09-10T08:40:38.608335+0000","last_became_peered":"2024-09-10T08:40:38.608335+0000","last_unstale":"2024-09-10T08:40:39.621084+0000","last_undegraded":"2024-09-10T08:40:39.621084+0000","last_fullsized":"2024-09-10T08:40:39.621084+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:01.508308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608152+0000","last_change":"2024-09-10T08:40:39.600898+0000","last_active":"2024-09-10T08:40:39.608152+0000","last_peered":"2024-09-10T08:40:39.608152+0000","last_clean":"2024-09-10T08:40:39.608152+0000","last_became_active":"2024-09-10T08:40:39.600580+0000","last_became_peered":"2024-09-10T08:40:39.600580+0000","last_unstale":"2024-09-10T08:40:39.608152+0000","last_undegraded":"2024-09-10T08:40:39.608152+0000","last_fullsized":"2024-09-10T08:40:39.608152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:36.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.587705+0000","last_change":"2024-09-10T08:40:38.602353+0000","last_active":"2024-09-10T08:40:39.587705+0000","last_peered":"2024-09-10T08:40:39.587705+0000","last_clean":"2024-09-10T08:40:39.587705+0000","last_became_active":"2024-09-10T08:40:38.601969+0000","last_became_peered":"2024-09-10T08:40:38.601969+0000","last_unstale":"2024-09-10T08:40:39.587705+0000","last_undegraded":"2024-09-10T08:40:39.587705+0000","last_fullsized":"2024-09-10T08:40:39.587705+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.613667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596152+0000","last_change":"2024-09-10T08:40:38.596152+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596152+0000","last_undegraded":"2024-09-10T08:40:38.596152+0000","last_fullsized":"2024-09-10T08:40:38.596152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590590+0000","last_change":"2024-09-10T08:40:38.606684+0000","last_active":"2024-09-10T08:40:39.590590+0000","last_peered":"2024-09-10T08:40:39.590590+0000","last_clean":"2024-09-10T08:40:39.590590+0000","last_became_active":"2024-09-10T08:40:38.606419+0000","last_became_peered":"2024-09-10T08:40:38.606419+0000","last_unstale":"2024-09-10T08:40:39.590590+0000","last_undegraded":"2024-09-10T08:40:39.590590+0000","last_fullsized":"2024-09-10T08:40:39.590590+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:58.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609813+0000","last_change":"2024-09-10T08:40:39.608373+0000","last_active":"2024-09-10T08:40:39.609813+0000","last_peered":"2024-09-10T08:40:39.609813+0000","last_clean":"2024-09-10T08:40:39.609813+0000","last_became_active":"2024-09-10T08:40:39.607215+0000","last_became_peered":"2024-09-10T08:40:39.607215+0000","last_unstale":"2024-09-10T08:40:39.609813+0000","last_undegraded":"2024-09-10T08:40:39.609813+0000","last_fullsized":"2024-09-10T08:40:39.609813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:30.447019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598441+0000","last_change":"2024-09-10T08:40:38.602257+0000","last_active":"2024-09-10T08:40:39.598441+0000","last_peered":"2024-09-10T08:40:39.598441+0000","last_clean":"2024-09-10T08:40:39.598441+0000","last_became_active":"2024-09-10T08:40:38.600878+0000","last_became_peered":"2024-09-10T08:40:38.600878+0000","last_unstale":"2024-09-10T08:40:39.598441+0000","last_undegraded":"2024-09-10T08:40:39.598441+0000","last_fullsized":"2024-09-10T08:40:39.598441+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:16.094429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595667+0000","last_change":"2024-09-10T08:40:39.590087+0000","last_active":"2024-09-10T08:40:39.595667+0000","last_peered":"2024-09-10T08:40:39.595667+0000","last_clean":"2024-09-10T08:40:39.595667+0000","last_became_active":"2024-09-10T08:40:39.589804+0000","last_became_peered":"2024-09-10T08:40:39.589804+0000","last_unstale":"2024-09-10T08:40:39.595667+0000","last_undegraded":"2024-09-10T08:40:39.595667+0000","last_fullsized":"2024-09-10T08:40:39.595667+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621914+0000","last_change":"2024-09-10T08:40:38.609058+0000","last_active":"2024-09-10T08:40:39.621914+0000","last_peered":"2024-09-10T08:40:39.621914+0000","last_clean":"2024-09-10T08:40:39.621914+0000","last_became_active":"2024-09-10T08:40:38.608401+0000","last_became_peered":"2024-09-10T08:40:38.608401+0000","last_unstale":"2024-09-10T08:40:39.621914+0000","last_undegraded":"2024-09-10T08:40:39.621914+0000","last_fullsized":"2024-09-10T08:40:39.621914+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:55.897796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608791+0000","last_change":"2024-09-10T08:40:39.605532+0000","last_active":"2024-09-10T08:40:39.608791+0000","last_peered":"2024-09-10T08:40:39.608791+0000","last_clean":"2024-09-10T08:40:39.608791+0000","last_became_active":"2024-09-10T08:40:39.605078+0000","last_became_peered":"2024-09-10T08:40:39.605078+0000","last_unstale":"2024-09-10T08:40:39.608791+0000","last_undegraded":"2024-09-10T08:40:39.608791+0000","last_fullsized":"2024-09-10T08:40:39.608791+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.624689+0000","last_change":"2024-09-10T08:40:38.609036+0000","last_active":"2024-09-10T08:40:39.624689+0000","last_peered":"2024-09-10T08:40:39.624689+0000","last_clean":"2024-09-10T08:40:39.624689+0000","last_became_active":"2024-09-10T08:40:38.608738+0000","last_became_peered":"2024-09-10T08:40:38.608738+0000","last_unstale":"2024-09-10T08:40:39.624689+0000","last_undegraded":"2024-09-10T08:40:39.624689+0000","last_fullsized":"2024-09-10T08:40:39.624689+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:47.126499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608788+0000","last_change":"2024-09-10T08:40:39.605430+0000","last_active":"2024-09-10T08:40:39.608788+0000","last_peered":"2024-09-10T08:40:39.608788+0000","last_clean":"2024-09-10T08:40:39.608788+0000","last_became_active":"2024-09-10T08:40:39.603647+0000","last_became_peered":"2024-09-10T08:40:39.603647+0000","last_unstale":"2024-09-10T08:40:39.608788+0000","last_undegraded":"2024-09-10T08:40:39.608788+0000","last_fullsized":"2024-09-10T08:40:39.608788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621597+0000","last_change":"2024-09-10T08:40:38.608957+0000","last_active":"2024-09-10T08:40:39.621597+0000","last_peered":"2024-09-10T08:40:39.621597+0000","last_clean":"2024-09-10T08:40:39.621597+0000","last_became_active":"2024-09-10T08:40:38.608520+0000","last_became_peered":"2024-09-10T08:40:38.608520+0000","last_unstale":"2024-09-10T08:40:39.621597+0000","last_undegraded":"2024-09-10T08:40:39.621597+0000","last_fullsized":"2024-09-10T08:40:39.621597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:05.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598629+0000","last_change":"2024-09-10T08:40:39.596837+0000","last_active":"2024-09-10T08:40:39.598629+0000","last_peered":"2024-09-10T08:40:39.598629+0000","last_clean":"2024-09-10T08:40:39.598629+0000","last_became_active":"2024-09-10T08:40:39.596457+0000","last_became_peered":"2024-09-10T08:40:39.596457+0000","last_unstale":"2024-09-10T08:40:39.598629+0000","last_undegraded":"2024-09-10T08:40:39.598629+0000","last_fullsized":"2024-09-10T08:40:39.598629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599214+0000","last_change":"2024-09-10T08:40:38.599901+0000","last_active":"2024-09-10T08:40:39.599214+0000","last_peered":"2024-09-10T08:40:39.599214+0000","last_clean":"2024-09-10T08:40:39.599214+0000","last_became_active":"2024-09-10T08:40:38.599571+0000","last_became_peered":"2024-09-10T08:40:38.599571+0000","last_unstale":"2024-09-10T08:40:39.599214+0000","last_undegraded":"2024-09-10T08:40:39.599214+0000","last_fullsized":"2024-09-10T08:40:39.599214+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:05.993602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595690+0000","last_change":"2024-09-10T08:40:39.593816+0000","last_active":"2024-09-10T08:40:39.595690+0000","last_peered":"2024-09-10T08:40:39.595690+0000","last_clean":"2024-09-10T08:40:39.595690+0000","last_became_active":"2024-09-10T08:40:39.592965+0000","last_became_peered":"2024-09-10T08:40:39.592965+0000","last_unstale":"2024-09-10T08:40:39.595690+0000","last_undegraded":"2024-09-10T08:40:39.595690+0000","last_fullsized":"2024-09-10T08:40:39.595690+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:35.945534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593166+0000","last_change":"2024-09-10T08:40:38.606357+0000","last_active":"2024-09-10T08:40:39.593166+0000","last_peered":"2024-09-10T08:40:39.593166+0000","last_clean":"2024-09-10T08:40:39.593166+0000","last_became_active":"2024-09-10T08:40:38.606082+0000","last_became_peered":"2024-09-10T08:40:38.606082+0000","last_unstale":"2024-09-10T08:40:39.593166+0000","last_undegraded":"2024-09-10T08:40:39.593166+0000","last_fullsized":"2024-09-10T08:40:39.593166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:06.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611654+0000","last_change":"2024-09-10T08:40:39.611019+0000","last_active":"2024-09-10T08:40:39.611654+0000","last_peered":"2024-09-10T08:40:39.611654+0000","last_clean":"2024-09-10T08:40:39.611654+0000","last_became_active":"2024-09-10T08:40:39.610479+0000","last_became_peered":"2024-09-10T08:40:39.610479+0000","last_unstale":"2024-09-10T08:40:39.611654+0000","last_undegraded":"2024-09-10T08:40:39.611654+0000","last_fullsized":"2024-09-10T08:40:39.611654+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:06.996990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.623156+0000","last_change":"2024-09-10T08:40:38.599942+0000","last_active":"2024-09-10T08:40:39.623156+0000","last_peered":"2024-09-10T08:40:39.623156+0000","last_clean":"2024-09-10T08:40:39.623156+0000","last_became_active":"2024-09-10T08:40:38.599603+0000","last_became_peered":"2024-09-10T08:40:38.599603+0000","last_unstale":"2024-09-10T08:40:39.623156+0000","last_undegraded":"2024-09-10T08:40:39.623156+0000","last_fullsized":"2024-09-10T08:40:39.623156+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:44.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610303+0000","last_change":"2024-09-10T08:40:39.608592+0000","last_active":"2024-09-10T08:40:39.610303+0000","last_peered":"2024-09-10T08:40:39.610303+0000","last_clean":"2024-09-10T08:40:39.610303+0000","last_became_active":"2024-09-10T08:40:39.603659+0000","last_became_peered":"2024-09-10T08:40:39.603659+0000","last_unstale":"2024-09-10T08:40:39.610303+0000","last_undegraded":"2024-09-10T08:40:39.610303+0000","last_fullsized":"2024-09-10T08:40:39.610303+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:25.399740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622148+0000","last_change":"2024-09-10T08:40:38.609734+0000","last_active":"2024-09-10T08:40:39.622148+0000","last_peered":"2024-09-10T08:40:39.622148+0000","last_clean":"2024-09-10T08:40:39.622148+0000","last_became_active":"2024-09-10T08:40:38.609463+0000","last_became_peered":"2024-09-10T08:40:38.609463+0000","last_unstale":"2024-09-10T08:40:39.622148+0000","last_undegraded":"2024-09-10T08:40:39.622148+0000","last_fullsized":"2024-09-10T08:40:39.622148+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:35.083024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599659+0000","last_change":"2024-09-10T08:40:39.597891+0000","last_active":"2024-09-10T08:40:39.599659+0000","last_peered":"2024-09-10T08:40:39.599659+0000","last_clean":"2024-09-10T08:40:39.599659+0000","last_became_active":"2024-09-10T08:40:39.597179+0000","last_became_peered":"2024-09-10T08:40:39.597179+0000","last_unstale":"2024-09-10T08:40:39.599659+0000","last_undegraded":"2024-09-10T08:40:39.599659+0000","last_fullsized":"2024-09-10T08:40:39.599659+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.116764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619027+0000","last_change":"2024-09-10T08:40:38.609455+0000","last_active":"2024-09-10T08:40:39.619027+0000","last_peered":"2024-09-10T08:40:39.619027+0000","last_clean":"2024-09-10T08:40:39.619027+0000","last_became_active":"2024-09-10T08:40:38.609193+0000","last_became_peered":"2024-09-10T08:40:38.609193+0000","last_unstale":"2024-09-10T08:40:39.619027+0000","last_undegraded":"2024-09-10T08:40:39.619027+0000","last_fullsized":"2024-09-10T08:40:39.619027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:23.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613972+0000","last_change":"2024-09-10T08:40:39.604315+0000","last_active":"2024-09-10T08:40:39.613972+0000","last_peered":"2024-09-10T08:40:39.613972+0000","last_clean":"2024-09-10T08:40:39.613972+0000","last_became_active":"2024-09-10T08:40:39.603974+0000","last_became_peered":"2024-09-10T08:40:39.603974+0000","last_unstale":"2024-09-10T08:40:39.613972+0000","last_undegraded":"2024-09-10T08:40:39.613972+0000","last_fullsized":"2024-09-10T08:40:39.613972+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:37.302990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616894+0000","last_change":"2024-09-10T08:40:38.604618+0000","last_active":"2024-09-10T08:40:39.616894+0000","last_peered":"2024-09-10T08:40:39.616894+0000","last_clean":"2024-09-10T08:40:39.616894+0000","last_became_active":"2024-09-10T08:40:38.603739+0000","last_became_peered":"2024-09-10T08:40:38.603739+0000","last_unstale":"2024-09-10T08:40:39.616894+0000","last_undegraded":"2024-09-10T08:40:39.616894+0000","last_fullsized":"2024-09-10T08:40:39.616894+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:18.461479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595522+0000","last_change":"2024-09-10T08:40:39.591588+0000","last_active":"2024-09-10T08:40:39.595522+0000","last_peered":"2024-09-10T08:40:39.595522+0000","last_clean":"2024-09-10T08:40:39.595522+0000","last_became_active":"2024-09-10T08:40:39.591319+0000","last_became_peered":"2024-09-10T08:40:39.591319+0000","last_unstale":"2024-09-10T08:40:39.595522+0000","last_undegraded":"2024-09-10T08:40:39.595522+0000","last_fullsized":"2024-09-10T08:40:39.595522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:48.129887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592375+0000","last_change":"2024-09-10T08:40:38.607426+0000","last_active":"2024-09-10T08:40:39.592375+0000","last_peered":"2024-09-10T08:40:39.592375+0000","last_clean":"2024-09-10T08:40:39.592375+0000","last_became_active":"2024-09-10T08:40:38.606843+0000","last_became_peered":"2024-09-10T08:40:38.606843+0000","last_unstale":"2024-09-10T08:40:39.592375+0000","last_undegraded":"2024-09-10T08:40:39.592375+0000","last_fullsized":"2024-09-10T08:40:39.592375+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:12.746003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604029+0000","last_change":"2024-09-10T08:40:39.595611+0000","last_active":"2024-09-10T08:40:39.604029+0000","last_peered":"2024-09-10T08:40:39.604029+0000","last_clean":"2024-09-10T08:40:39.604029+0000","last_became_active":"2024-09-10T08:40:39.593091+0000","last_became_peered":"2024-09-10T08:40:39.593091+0000","last_unstale":"2024-09-10T08:40:39.604029+0000","last_undegraded":"2024-09-10T08:40:39.604029+0000","last_fullsized":"2024-09-10T08:40:39.604029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.263677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621202+0000","last_change":"2024-09-10T08:40:38.612800+0000","last_active":"2024-09-10T08:40:39.621202+0000","last_peered":"2024-09-10T08:40:39.621202+0000","last_clean":"2024-09-10T08:40:39.621202+0000","last_became_active":"2024-09-10T08:40:38.612501+0000","last_became_peered":"2024-09-10T08:40:38.612501+0000","last_unstale":"2024-09-10T08:40:39.621202+0000","last_undegraded":"2024-09-10T08:40:39.621202+0000","last_fullsized":"2024-09-10T08:40:39.621202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:17.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608648+0000","last_change":"2024-09-10T08:40:39.607946+0000","last_active":"2024-09-10T08:40:39.608648+0000","last_peered":"2024-09-10T08:40:39.608648+0000","last_clean":"2024-09-10T08:40:39.608648+0000","last_became_active":"2024-09-10T08:40:39.607670+0000","last_became_peered":"2024-09-10T08:40:39.607670+0000","last_unstale":"2024-09-10T08:40:39.608648+0000","last_undegraded":"2024-09-10T08:40:39.608648+0000","last_fullsized":"2024-09-10T08:40:39.608648+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585166+0000","last_change":"2024-09-10T08:40:38.609194+0000","last_active":"2024-09-10T08:40:39.585166+0000","last_peered":"2024-09-10T08:40:39.585166+0000","last_clean":"2024-09-10T08:40:39.585166+0000","last_became_active":"2024-09-10T08:40:38.608754+0000","last_became_peered":"2024-09-10T08:40:38.608754+0000","last_unstale":"2024-09-10T08:40:39.585166+0000","last_undegraded":"2024-09-10T08:40:39.585166+0000","last_fullsized":"2024-09-10T08:40:39.585166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.065351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.605233+0000","last_change":"2024-09-10T08:40:39.597582+0000","last_active":"2024-09-10T08:40:39.605233+0000","last_peered":"2024-09-10T08:40:39.605233+0000","last_clean":"2024-09-10T08:40:39.605233+0000","last_became_active":"2024-09-10T08:40:39.597309+0000","last_became_peered":"2024-09-10T08:40:39.597309+0000","last_unstale":"2024-09-10T08:40:39.605233+0000","last_undegraded":"2024-09-10T08:40:39.605233+0000","last_fullsized":"2024-09-10T08:40:39.605233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:44.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585031+0000","last_change":"2024-09-10T08:40:38.602833+0000","last_active":"2024-09-10T08:40:39.585031+0000","last_peered":"2024-09-10T08:40:39.585031+0000","last_clean":"2024-09-10T08:40:39.585031+0000","last_became_active":"2024-09-10T08:40:38.602520+0000","last_became_peered":"2024-09-10T08:40:38.602520+0000","last_unstale":"2024-09-10T08:40:39.585031+0000","last_undegraded":"2024-09-10T08:40:39.585031+0000","last_fullsized":"2024-09-10T08:40:39.585031+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:31.477687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608666+0000","last_change":"2024-09-10T08:40:39.605369+0000","last_active":"2024-09-10T08:40:39.608666+0000","last_peered":"2024-09-10T08:40:39.608666+0000","last_clean":"2024-09-10T08:40:39.608666+0000","last_became_active":"2024-09-10T08:40:39.604880+0000","last_became_peered":"2024-09-10T08:40:39.604880+0000","last_unstale":"2024-09-10T08:40:39.608666+0000","last_undegraded":"2024-09-10T08:40:39.608666+0000","last_fullsized":"2024-09-10T08:40:39.608666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590185+0000","last_change":"2024-09-10T08:40:38.602333+0000","last_active":"2024-09-10T08:40:39.590185+0000","last_peered":"2024-09-10T08:40:39.590185+0000","last_clean":"2024-09-10T08:40:39.590185+0000","last_became_active":"2024-09-10T08:40:38.599744+0000","last_became_peered":"2024-09-10T08:40:38.599744+0000","last_unstale":"2024-09-10T08:40:39.590185+0000","last_undegraded":"2024-09-10T08:40:39.590185+0000","last_fullsized":"2024-09-10T08:40:39.590185+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:44.559698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595680+0000","last_change":"2024-09-10T08:40:38.595680+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595680+0000","last_undegraded":"2024-09-10T08:40:38.595680+0000","last_fullsized":"2024-09-10T08:40:38.595680+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613473+0000","last_change":"2024-09-10T08:40:38.611840+0000","last_active":"2024-09-10T08:40:39.613473+0000","last_peered":"2024-09-10T08:40:39.613473+0000","last_clean":"2024-09-10T08:40:39.613473+0000","last_became_active":"2024-09-10T08:40:38.611553+0000","last_became_peered":"2024-09-10T08:40:38.611553+0000","last_unstale":"2024-09-10T08:40:39.613473+0000","last_undegraded":"2024-09-10T08:40:39.613473+0000","last_fullsized":"2024-09-10T08:40:39.613473+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:46.146476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.597389+0000","last_change":"2024-09-10T08:40:38.597389+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.597389+0000","last_undegraded":"2024-09-10T08:40:38.597389+0000","last_fullsized":"2024-09-10T08:40:38.597389+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.608107+0000","last_change":"2024-09-10T08:40:38.606693+0000","last_active":"2024-09-10T08:40:38.608107+0000","last_peered":"2024-09-10T08:40:38.608107+0000","last_clean":"2024-09-10T08:40:38.608107+0000","last_became_active":"2024-09-10T08:40:38.605494+0000","last_became_peered":"2024-09-10T08:40:38.605494+0000","last_unstale":"2024-09-10T08:40:38.608107+0000","last_undegraded":"2024-09-10T08:40:38.608107+0000","last_fullsized":"2024-09-10T08:40:38.608107+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:23.432231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.598658+0000","last_change":"2024-09-10T08:40:38.598658+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.598658+0000","last_undegraded":"2024-09-10T08:40:38.598658+0000","last_fullsized":"2024-09-10T08:40:38.598658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.605973+0000","last_change":"2024-09-10T08:40:38.601853+0000","last_active":"2024-09-10T08:40:38.605973+0000","last_peered":"2024-09-10T08:40:38.605973+0000","last_clean":"2024-09-10T08:40:38.605973+0000","last_became_active":"2024-09-10T08:40:38.601534+0000","last_became_peered":"2024-09-10T08:40:38.601534+0000","last_unstale":"2024-09-10T08:40:38.605973+0000","last_undegraded":"2024-09-10T08:40:38.605973+0000","last_fullsized":"2024-09-10T08:40:38.605973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:15.105563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615796+0000","last_change":"2024-09-10T08:40:39.614735+0000","last_active":"2024-09-10T08:40:39.615796+0000","last_peered":"2024-09-10T08:40:39.615796+0000","last_clean":"2024-09-10T08:40:39.615796+0000","last_became_active":"2024-09-10T08:40:39.614305+0000","last_became_peered":"2024-09-10T08:40:39.614305+0000","last_unstale":"2024-09-10T08:40:39.615796+0000","last_undegraded":"2024-09-10T08:40:39.615796+0000","last_fullsized":"2024-09-10T08:40:39.615796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593911+0000","last_change":"2024-09-10T08:40:38.607592+0000","last_active":"2024-09-10T08:40:39.593911+0000","last_peered":"2024-09-10T08:40:39.593911+0000","last_clean":"2024-09-10T08:40:39.593911+0000","last_became_active":"2024-09-10T08:40:38.607327+0000","last_became_peered":"2024-09-10T08:40:38.607327+0000","last_unstale":"2024-09-10T08:40:39.593911+0000","last_undegraded":"2024-09-10T08:40:39.593911+0000","last_fullsized":"2024-09-10T08:40:39.593911+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.942146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614886+0000","last_change":"2024-09-10T08:40:39.605335+0000","last_active":"2024-09-10T08:40:39.614886+0000","last_peered":"2024-09-10T08:40:39.614886+0000","last_clean":"2024-09-10T08:40:39.614886+0000","last_became_active":"2024-09-10T08:40:39.605015+0000","last_became_peered":"2024-09-10T08:40:39.605015+0000","last_unstale":"2024-09-10T08:40:39.614886+0000","last_undegraded":"2024-09-10T08:40:39.614886+0000","last_fullsized":"2024-09-10T08:40:39.614886+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:48.987807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592390+0000","last_change":"2024-09-10T08:40:38.604528+0000","last_active":"2024-09-10T08:40:39.592390+0000","last_peered":"2024-09-10T08:40:39.592390+0000","last_clean":"2024-09-10T08:40:39.592390+0000","last_became_active":"2024-09-10T08:40:38.602419+0000","last_became_peered":"2024-09-10T08:40:38.602419+0000","last_unstale":"2024-09-10T08:40:39.592390+0000","last_undegraded":"2024-09-10T08:40:39.592390+0000","last_fullsized":"2024-09-10T08:40:39.592390+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:53.016826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608198+0000","last_change":"2024-09-10T08:40:39.600972+0000","last_active":"2024-09-10T08:40:39.608198+0000","last_peered":"2024-09-10T08:40:39.608198+0000","last_clean":"2024-09-10T08:40:39.608198+0000","last_became_active":"2024-09-10T08:40:39.600696+0000","last_became_peered":"2024-09-10T08:40:39.600696+0000","last_unstale":"2024-09-10T08:40:39.608198+0000","last_undegraded":"2024-09-10T08:40:39.608198+0000","last_fullsized":"2024-09-10T08:40:39.608198+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:44.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597585+0000","last_change":"2024-09-10T08:40:38.598840+0000","last_active":"2024-09-10T08:40:39.597585+0000","last_peered":"2024-09-10T08:40:39.597585+0000","last_clean":"2024-09-10T08:40:39.597585+0000","last_became_active":"2024-09-10T08:40:38.598539+0000","last_became_peered":"2024-09-10T08:40:38.598539+0000","last_unstale":"2024-09-10T08:40:39.597585+0000","last_undegraded":"2024-09-10T08:40:39.597585+0000","last_fullsized":"2024-09-10T08:40:39.597585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:40.709904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616557+0000","last_change":"2024-09-10T08:40:39.610363+0000","last_active":"2024-09-10T08:40:39.616557+0000","last_peered":"2024-09-10T08:40:39.616557+0000","last_clean":"2024-09-10T08:40:39.616557+0000","last_became_active":"2024-09-10T08:40:39.609936+0000","last_became_peered":"2024-09-10T08:40:39.609936+0000","last_unstale":"2024-09-10T08:40:39.616557+0000","last_undegraded":"2024-09-10T08:40:39.616557+0000","last_fullsized":"2024-09-10T08:40:39.616557+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:59.391662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597883+0000","last_change":"2024-09-10T08:40:38.600904+0000","last_active":"2024-09-10T08:40:39.597883+0000","last_peered":"2024-09-10T08:40:39.597883+0000","last_clean":"2024-09-10T08:40:39.597883+0000","last_became_active":"2024-09-10T08:40:38.600572+0000","last_became_peered":"2024-09-10T08:40:38.600572+0000","last_unstale":"2024-09-10T08:40:39.597883+0000","last_undegraded":"2024-09-10T08:40:39.597883+0000","last_fullsized":"2024-09-10T08:40:39.597883+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:16.573172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609866+0000","last_change":"2024-09-10T08:40:39.605511+0000","last_active":"2024-09-10T08:40:39.609866+0000","last_peered":"2024-09-10T08:40:39.609866+0000","last_clean":"2024-09-10T08:40:39.609866+0000","last_became_active":"2024-09-10T08:40:39.605208+0000","last_became_peered":"2024-09-10T08:40:39.605208+0000","last_unstale":"2024-09-10T08:40:39.609866+0000","last_undegraded":"2024-09-10T08:40:39.609866+0000","last_fullsized":"2024-09-10T08:40:39.609866+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.227456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585592+0000","last_change":"2024-09-10T08:40:38.607736+0000","last_active":"2024-09-10T08:40:39.585592+0000","last_peered":"2024-09-10T08:40:39.585592+0000","last_clean":"2024-09-10T08:40:39.585592+0000","last_became_active":"2024-09-10T08:40:38.607482+0000","last_became_peered":"2024-09-10T08:40:38.607482+0000","last_unstale":"2024-09-10T08:40:39.585592+0000","last_undegraded":"2024-09-10T08:40:39.585592+0000","last_fullsized":"2024-09-10T08:40:39.585592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:25.625722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591040+0000","last_change":"2024-09-10T08:40:39.589188+0000","last_active":"2024-09-10T08:40:39.591040+0000","last_peered":"2024-09-10T08:40:39.591040+0000","last_clean":"2024-09-10T08:40:39.591040+0000","last_became_active":"2024-09-10T08:40:39.588915+0000","last_became_peered":"2024-09-10T08:40:39.588915+0000","last_unstale":"2024-09-10T08:40:39.591040+0000","last_undegraded":"2024-09-10T08:40:39.591040+0000","last_fullsized":"2024-09-10T08:40:39.591040+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:33.170578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.582541+0000","last_change":"2024-09-10T08:40:38.596603+0000","last_active":"2024-09-10T08:40:39.582541+0000","last_peered":"2024-09-10T08:40:39.582541+0000","last_clean":"2024-09-10T08:40:39.582541+0000","last_became_active":"2024-09-10T08:40:38.594989+0000","last_became_peered":"2024-09-10T08:40:38.594989+0000","last_unstale":"2024-09-10T08:40:39.582541+0000","last_undegraded":"2024-09-10T08:40:39.582541+0000","last_fullsized":"2024-09-10T08:40:39.582541+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:52.691150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":442,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591462+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:40:39.591462+0000","last_peered":"2024-09-10T08:40:39.591462+0000","last_clean":"2024-09-10T08:40:39.591462+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:40:39.591462+0000","last_undegraded":"2024-09-10T08:40:39.591462+0000","last_fullsized":"2024-09-10T08:40:39.591462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51316,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320524,"statfs":{"total":96636764160,"available":96584216576,"internally_reserved":0,"allocated":2129920,"data_stored":936713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55468,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316372,"statfs":{"total":96636764160,"available":96579964928,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47144,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324696,"statfs":{"total":96636764160,"available":96588488704,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63804,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308036,"statfs":{"total":96636764160,"available":96571428864,"internally_reserved":0,"allocated":2134016,"data_stored":936783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1520306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":2699264,"data_stored":1514031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3d is not active+clean 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.596612+0000', 'last_change': '2024-09-10T08:40:38.596612+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.596612+0000', 'last_undegraded': '2024-09-10T08:40:38.596612+0000', 'last_fullsized': '2024-09-10T08:40:38.596612+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:PG 25.30 is not active+clean 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.593853+0000', 'last_change': '2024-09-10T08:40:38.593853+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.593853+0000', 'last_undegraded': '2024-09-10T08:40:38.593853+0000', 'last_fullsized': '2024-09-10T08:40:38.593853+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2d is not active+clean 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.596208+0000', 'last_change': '2024-09-10T08:40:38.596208+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.596208+0000', 'last_undegraded': '2024-09-10T08:40:38.596208+0000', 'last_fullsized': '2024-09-10T08:40:38.596208+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.649 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2b is not active+clean 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.594932+0000', 'last_change': '2024-09-10T08:40:38.594932+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.594932+0000', 'last_undegraded': '2024-09-10T08:40:38.594932+0000', 'last_fullsized': '2024-09-10T08:40:38.594932+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:PG 25.25 is not active+clean 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.595772+0000', 'last_change': '2024-09-10T08:40:38.595772+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.595772+0000', 'last_undegraded': '2024-09-10T08:40:38.595772+0000', 'last_fullsized': '2024-09-10T08:40:38.595772+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:PG 25.16 is not active+clean 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.596152+0000', 'last_change': '2024-09-10T08:40:38.596152+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.596152+0000', 'last_undegraded': '2024-09-10T08:40:38.596152+0000', 'last_fullsized': '2024-09-10T08:40:38.596152+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:PG 25.6 is not active+clean 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.595680+0000', 'last_change': '2024-09-10T08:40:38.595680+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.595680+0000', 'last_undegraded': '2024-09-10T08:40:38.595680+0000', 'last_fullsized': '2024-09-10T08:40:38.595680+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.597389+0000', 'last_change': '2024-09-10T08:40:38.597389+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.597389+0000', 'last_undegraded': '2024-09-10T08:40:38.597389+0000', 'last_fullsized': '2024-09-10T08:40:38.597389+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.650 INFO:tasks.ceph.ceph_manager.ceph:PG 25.4 is not active+clean 2024-09-10T08:40:44.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:40:38.598658+0000', 'last_change': '2024-09-10T08:40:38.598658+0000', 'last_active': '2024-09-10T08:40:38.576890+0000', 'last_peered': '2024-09-10T08:40:38.576890+0000', 'last_clean': '2024-09-10T08:40:38.576890+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:40:38.598658+0000', 'last_undegraded': '2024-09-10T08:40:38.598658+0000', 'last_fullsized': '2024-09-10T08:40:38.598658+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'last_clean_scrub_stamp': '2024-09-10T08:40:38.576890+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:40:44.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:40:44.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.838+0000 7ff9df200640 1 Processor -- start 2024-09-10T08:40:44.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.839+0000 7ff9df200640 1 -- start start 2024-09-10T08:40:44.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9df200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9e00cfbd0 0x7ff9e0162c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9df200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9e00c6140 0x7ff9e00ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9df200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e00cbe70 con 0x7ff9e015e760 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9df200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e015eb40 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9df200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e00cc150 con 0x7ff9e00c6140 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9d5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9e00cfbd0 0x7ff9e0162c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9d5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff9e00cfbd0 0x7ff9e0162c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53752/0 (socket says 172.21.15.52:53752) 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9d5400640 1 -- 172.21.15.52:0/1992395598 learned_addr learned my addr 172.21.15.52:0/1992395598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:44.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.840+0000 7ff9de800640 1 --2- 172.21.15.52:0/1992395598 >> v2:172.21.15.176:3300/0 conn(0x7ff9e00c6140 0x7ff9e00ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.841+0000 7ff9d5400640 1 -- 172.21.15.52:0/1992395598 >> v2:172.21.15.176:3300/0 conn(0x7ff9e00c6140 msgr2=0x7ff9e00ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:44.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.841+0000 7ff9d5400640 1 --2- 172.21.15.52:0/1992395598 >> v2:172.21.15.176:3300/0 conn(0x7ff9e00c6140 0x7ff9e00ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.841+0000 7ff9d5400640 1 -- 172.21.15.52:0/1992395598 >> v1:172.21.15.176:6789/0 conn(0x7ff9e015e760 legacy=0x7ff9e00cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.841+0000 7ff9d5400640 1 -- 172.21.15.52:0/1992395598 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e00cc430 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9d5400640 1 --2- 172.21.15.52:0/1992395598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e0162c60 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0071460 tx=0x7ff9c802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c715577577efc52a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9dd400640 1 -- 172.21.15.52:0/1992395598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8037070 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9dd400640 1 -- 172.21.15.52:0/1992395598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c8032440 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9dd400640 1 -- 172.21.15.52:0/1992395598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8032810 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9df200640 1 -- 172.21.15.52:0/1992395598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e00cfbd0 msgr2=0x7ff9e0162c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.842+0000 7ff9df200640 1 --2- 172.21.15.52:0/1992395598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e0162c60 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0071460 tx=0x7ff9c802a150 comp rx=0 tx=0).stop 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 -- 172.21.15.52:0/1992395598 shutdown_connections 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 --2- 172.21.15.52:0/1992395598 >> v2:172.21.15.176:3300/0 conn(0x7ff9e00c6140 0x7ff9e00ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 --2- 172.21.15.52:0/1992395598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e0162c60 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 -- 172.21.15.52:0/1992395598 >> 172.21.15.52:0/1992395598 conn(0x7ff9e00d0d40 msgr2=0x7ff9e00d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 -- 172.21.15.52:0/1992395598 shutdown_connections 2024-09-10T08:40:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.843+0000 7ff9df200640 1 -- 172.21.15.52:0/1992395598 wait complete. 2024-09-10T08:40:44.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.844+0000 7ff9df200640 1 Processor -- start 2024-09-10T08:40:44.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.844+0000 7ff9df200640 1 -- start start 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e00c6140 0x7ff9e01e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e00b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00ae870 con 0x7ff9e015e760 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e00cf220 con 0x7ff9e00cfbd0 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.845+0000 7ff9df200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00ae9f0 con 0x7ff9e00c6140 2024-09-10T08:40:44.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53766/0 (socket says 172.21.15.52:53766) 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 -- 172.21.15.52:0/2599964205 learned_addr learned my addr 172.21.15.52:0/2599964205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9dde00640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e00c6140 0x7ff9e01e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9d5400640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e00b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 -- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e00c6140 msgr2=0x7ff9e01e89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e00c6140 0x7ff9e01e89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 -- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00cfbd0 msgr2=0x7ff9e00b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e00b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 -- 172.21.15.52:0/2599964205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01e8f80 con 0x7ff9e015e760 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.846+0000 7ff9de800640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8007e70 tx=0x7ff9d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.847+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8014420 con 0x7ff9e015e760 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.847+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d8019070 con 0x7ff9e015e760 2024-09-10T08:40:44.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.847+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8014820 con 0x7ff9e015e760 2024-09-10T08:40:44.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.847+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e01e94e0 con 0x7ff9e015e760 2024-09-10T08:40:44.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.847+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e01e9aa0 con 0x7ff9e015e760 2024-09-10T08:40:44.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.848+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e00ccf10 con 0x7ff9e015e760 2024-09-10T08:40:44.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.849+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9d80149c0 con 0x7ff9e015e760 2024-09-10T08:40:44.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.850+0000 7ff9d6a00640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 0x7ff9bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:44.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.850+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff9d808b720 con 0x7ff9e015e760 2024-09-10T08:40:44.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.850+0000 7ff9dde00640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 0x7ff9bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:44.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.851+0000 7ff9dde00640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 0x7ff9bc06e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00016e0 tx=0x7ff9d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:44.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:44.854+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9d8059950 con 0x7ff9e015e760 2024-09-10T08:40:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.104+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff9e00cb540 con 0x7ff9e015e760 2024-09-10T08:40:45.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.105+0000 7ff9d6a00640 1 -- 172.21.15.52:0/2599964205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1146 (secure 0 0 0) 0x7ff9d805dc50 con 0x7ff9e015e760 2024-09-10T08:40:45.105 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:45.105 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":744,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":171,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"creating+peering","count":9}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592196,"bytes_used":455573504,"bytes_avail":772638539776,"bytes_total":773094113280,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":130,"btime":"2024-09-10T08:40:42:596516+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":9753}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-10T08:40:27.629889+0000","services":{}},"progress_events":{}} 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 msgr2=0x7ff9bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 0x7ff9bc06e2f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00016e0 tx=0x7ff9d0009040 comp rx=0 tx=0).stop 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 msgr2=0x7ff9e0148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8007e70 tx=0x7ff9d800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 shutdown_connections 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff9bc06be30 0x7ff9bc06e2f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e015e760 0x7ff9e0148690 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e00cfbd0 0x7ff9e00b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 --2- 172.21.15.52:0/2599964205 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9e00c6140 0x7ff9e01e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 >> 172.21.15.52:0/2599964205 conn(0x7ff9e00d0d40 msgr2=0x7ff9e015cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.107+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 shutdown_connections 2024-09-10T08:40:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.108+0000 7ff9df200640 1 -- 172.21.15.52:0/2599964205 wait complete. 2024-09-10T08:40:45.124 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:40:45.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:40:45.179 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:40:45.179+0000 7f5802600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:40:45.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.280+0000 7f0cfaa00640 1 Processor -- start 2024-09-10T08:40:45.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.280+0000 7f0cfaa00640 1 -- start start 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfaa00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0cf41522d0 0x7f0cf40b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfaa00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0cf415f5d0 0x7f0cf415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfaa00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf40b6660 con 0x7f0cf40b60e0 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfaa00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0cf415ca90 con 0x7f0cf415f5d0 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfaa00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0cf415cce0 con 0x7f0cf41522d0 2024-09-10T08:40:45.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cf8c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0cf40b60e0 0x7f0cf415eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46332/0 (socket says 172.21.15.52:46332) 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cfa000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0cf415f5d0 0x7f0cf415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.281+0000 7f0cf8c00640 1 -- 172.21.15.52:0/2538876724 learned_addr learned my addr 172.21.15.52:0/2538876724 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cf9600640 1 --2- 172.21.15.52:0/2538876724 >> v2:172.21.15.176:3300/0 conn(0x7f0cf41522d0 0x7f0cf40b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cf3e00640 1 -- 172.21.15.52:0/2538876724 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794908988 0 0) 0x7f0cf40b6660 con 0x7f0cf40b60e0 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cf3e00640 1 -- 172.21.15.52:0/2538876724 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cdc003520 con 0x7f0cf40b60e0 2024-09-10T08:40:45.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cfa000640 1 -- 172.21.15.52:0/2538876724 >> v2:172.21.15.176:3300/0 conn(0x7f0cf41522d0 msgr2=0x7f0cf40b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cfa000640 1 --2- 172.21.15.52:0/2538876724 >> v2:172.21.15.176:3300/0 conn(0x7f0cf41522d0 0x7f0cf40b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cfa000640 1 -- 172.21.15.52:0/2538876724 >> v1:172.21.15.52:6789/0 conn(0x7f0cf40b60e0 legacy=0x7f0cf415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.282+0000 7f0cfa000640 1 -- 172.21.15.52:0/2538876724 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf415cfc0 con 0x7f0cf415f5d0 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.283+0000 7f0cfa000640 1 --2- 172.21.15.52:0/2538876724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf415f5d0 0x7f0cf415d7c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406f210 tx=0x7f0cec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abeb71162cefafe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.283+0000 7f0cf3e00640 1 -- 172.21.15.52:0/2538876724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec007740 con 0x7f0cf415f5d0 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.283+0000 7f0cf3e00640 1 -- 172.21.15.52:0/2538876724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cec0078e0 con 0x7f0cf415f5d0 2024-09-10T08:40:45.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.283+0000 7f0cf3e00640 1 -- 172.21.15.52:0/2538876724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec007cb0 con 0x7f0cf415f5d0 2024-09-10T08:40:45.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 -- 172.21.15.52:0/2538876724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf415f5d0 msgr2=0x7f0cf415d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/2538876724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf415f5d0 0x7f0cf415d7c0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406f210 tx=0x7f0cec02a680 comp rx=0 tx=0).stop 2024-09-10T08:40:45.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 -- 172.21.15.52:0/2538876724 shutdown_connections 2024-09-10T08:40:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/2538876724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf415f5d0 0x7f0cf415d7c0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/2538876724 >> v2:172.21.15.176:3300/0 conn(0x7f0cf41522d0 0x7f0cf40b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 -- 172.21.15.52:0/2538876724 >> 172.21.15.52:0/2538876724 conn(0x7f0cf406c240 msgr2=0x7f0cf406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 -- 172.21.15.52:0/2538876724 shutdown_connections 2024-09-10T08:40:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.284+0000 7f0cfaa00640 1 -- 172.21.15.52:0/2538876724 wait complete. 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.286+0000 7f0cfaa00640 1 Processor -- start 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.286+0000 7f0cfaa00640 1 -- start start 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40b60e0 0x7f0cf414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415f5d0 0x7f0cf4071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf41526b0 con 0x7f0cf41522d0 2024-09-10T08:40:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf415fc80 con 0x7f0cf40b60e0 2024-09-10T08:40:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfaa00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf4152830 con 0x7f0cf415f5d0 2024-09-10T08:40:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53784/0 (socket says 172.21.15.52:53784) 2024-09-10T08:40:45.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 -- 172.21.15.52:0/1588776919 learned_addr learned my addr 172.21.15.52:0/1588776919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf9600640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40b60e0 0x7f0cf414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cfa000640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415f5d0 0x7f0cf4071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 -- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415f5d0 msgr2=0x7f0cf4071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415f5d0 0x7f0cf4071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 -- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40b60e0 msgr2=0x7f0cf414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40b60e0 0x7f0cf414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.287+0000 7f0cf8c00640 1 -- 172.21.15.52:0/1588776919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf41f26b0 con 0x7f0cf41522d0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cf8c00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00010e0 tx=0x7f0ce000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0017070 con 0x7f0cf41522d0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0005d00 con 0x7f0cf41522d0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00072b0 con 0x7f0cf41522d0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf41f2990 con 0x7f0cf41522d0 2024-09-10T08:40:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.288+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf41578c0 con 0x7f0cf41522d0 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.289+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf4157ac0 con 0x7f0cf41522d0 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.290+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ce001a070 con 0x7f0cf41522d0 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.291+0000 7f0cf1600640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 0x7f0cd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.291+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f0ce008a250 con 0x7f0cf41522d0 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.292+0000 7f0cf9600640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 0x7f0cd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.292+0000 7f0cf9600640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 0x7f0cd406e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8006fd0 tx=0x7f0ce8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:45.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.295+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cf4157ac0 con 0x7f0cf41522d0 2024-09-10T08:40:45.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.475+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0cf40b5ba0 con 0x7f0cd406be30 2024-09-10T08:40:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.481+0000 7f0cf1600640 1 -- 172.21.15.52:0/1588776919 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251673 (secure 0 0 0) 0x7f0cf40b5ba0 con 0x7f0cd406be30 2024-09-10T08:40:45.485 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:45.486 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:40:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 msgr2=0x7f0cd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 0x7f0cd406e2f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8006fd0 tx=0x7f0ce8008040 comp rx=0 tx=0).stop 2024-09-10T08:40:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 msgr2=0x7f0cf41f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00010e0 tx=0x7f0ce000c960 comp rx=0 tx=0).stop 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 shutdown_connections 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0cd406be30 0x7f0cd406e2f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0cf415f5d0 0x7f0cf4071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0cf41522d0 0x7f0cf41f1e60 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 --2- 172.21.15.52:0/1588776919 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0cf40b60e0 0x7f0cf414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 >> 172.21.15.52:0/1588776919 conn(0x7f0cf406c240 msgr2=0x7f0cf406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 shutdown_connections 2024-09-10T08:40:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:45.485+0000 7f0cfaa00640 1 -- 172.21.15.52:0/1588776919 wait complete. 2024-09-10T08:40:45.503 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":529,"stamp":"2024-09-10T08:40:43.633471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":444896,"kb_used_data":17720,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529824,"statfs":{"total":773094113280,"available":772638539776,"internally_reserved":0,"allocated":18145280,"data_stored":8627585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001395"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614955+0000","last_change":"2024-09-10T08:40:39.611318+0000","last_active":"2024-09-10T08:40:39.614955+0000","last_peered":"2024-09-10T08:40:39.614955+0000","last_clean":"2024-09-10T08:40:39.614955+0000","last_became_active":"2024-09-10T08:40:39.611027+0000","last_became_peered":"2024-09-10T08:40:39.611027+0000","last_unstale":"2024-09-10T08:40:39.614955+0000","last_undegraded":"2024-09-10T08:40:39.614955+0000","last_fullsized":"2024-09-10T08:40:39.614955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:07:31.420624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615813+0000","last_change":"2024-09-10T08:40:39.609260+0000","last_active":"2024-09-10T08:40:39.615813+0000","last_peered":"2024-09-10T08:40:39.615813+0000","last_clean":"2024-09-10T08:40:39.615813+0000","last_became_active":"2024-09-10T08:40:39.608971+0000","last_became_peered":"2024-09-10T08:40:39.608971+0000","last_unstale":"2024-09-10T08:40:39.615813+0000","last_undegraded":"2024-09-10T08:40:39.615813+0000","last_fullsized":"2024-09-10T08:40:39.615813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:44.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596612+0000","last_change":"2024-09-10T08:40:38.596612+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596612+0000","last_undegraded":"2024-09-10T08:40:38.596612+0000","last_fullsized":"2024-09-10T08:40:38.596612+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614970+0000","last_change":"2024-09-10T08:40:39.605534+0000","last_active":"2024-09-10T08:40:39.614970+0000","last_peered":"2024-09-10T08:40:39.614970+0000","last_clean":"2024-09-10T08:40:39.614970+0000","last_became_active":"2024-09-10T08:40:39.605235+0000","last_became_peered":"2024-09-10T08:40:39.605235+0000","last_unstale":"2024-09-10T08:40:39.614970+0000","last_undegraded":"2024-09-10T08:40:39.614970+0000","last_fullsized":"2024-09-10T08:40:39.614970+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:41:41.680474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615691+0000","last_change":"2024-09-10T08:40:39.614794+0000","last_active":"2024-09-10T08:40:39.615691+0000","last_peered":"2024-09-10T08:40:39.615691+0000","last_clean":"2024-09-10T08:40:39.615691+0000","last_became_active":"2024-09-10T08:40:39.614532+0000","last_became_peered":"2024-09-10T08:40:39.614532+0000","last_unstale":"2024-09-10T08:40:39.615691+0000","last_undegraded":"2024-09-10T08:40:39.615691+0000","last_fullsized":"2024-09-10T08:40:39.615691+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607803+0000","last_change":"2024-09-10T08:40:39.601372+0000","last_active":"2024-09-10T08:40:39.607803+0000","last_peered":"2024-09-10T08:40:39.607803+0000","last_clean":"2024-09-10T08:40:39.607803+0000","last_became_active":"2024-09-10T08:40:39.600883+0000","last_became_peered":"2024-09-10T08:40:39.600883+0000","last_unstale":"2024-09-10T08:40:39.607803+0000","last_undegraded":"2024-09-10T08:40:39.607803+0000","last_fullsized":"2024-09-10T08:40:39.607803+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:30.821124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.600518+0000","last_change":"2024-09-10T08:40:39.594012+0000","last_active":"2024-09-10T08:40:39.600518+0000","last_peered":"2024-09-10T08:40:39.600518+0000","last_clean":"2024-09-10T08:40:39.600518+0000","last_became_active":"2024-09-10T08:40:39.593736+0000","last_became_peered":"2024-09-10T08:40:39.593736+0000","last_unstale":"2024-09-10T08:40:39.600518+0000","last_undegraded":"2024-09-10T08:40:39.600518+0000","last_fullsized":"2024-09-10T08:40:39.600518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610000+0000","last_change":"2024-09-10T08:40:39.606793+0000","last_active":"2024-09-10T08:40:39.610000+0000","last_peered":"2024-09-10T08:40:39.610000+0000","last_clean":"2024-09-10T08:40:39.610000+0000","last_became_active":"2024-09-10T08:40:39.606321+0000","last_became_peered":"2024-09-10T08:40:39.606321+0000","last_unstale":"2024-09-10T08:40:39.610000+0000","last_undegraded":"2024-09-10T08:40:39.610000+0000","last_fullsized":"2024-09-10T08:40:39.610000+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:24.778080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615574+0000","last_change":"2024-09-10T08:40:39.607866+0000","last_active":"2024-09-10T08:40:39.615574+0000","last_peered":"2024-09-10T08:40:39.615574+0000","last_clean":"2024-09-10T08:40:39.615574+0000","last_became_active":"2024-09-10T08:40:39.607413+0000","last_became_peered":"2024-09-10T08:40:39.607413+0000","last_unstale":"2024-09-10T08:40:39.615574+0000","last_undegraded":"2024-09-10T08:40:39.615574+0000","last_fullsized":"2024-09-10T08:40:39.615574+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:24.451777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610285+0000","last_change":"2024-09-10T08:40:39.607709+0000","last_active":"2024-09-10T08:40:39.610285+0000","last_peered":"2024-09-10T08:40:39.610285+0000","last_clean":"2024-09-10T08:40:39.610285+0000","last_became_active":"2024-09-10T08:40:39.603723+0000","last_became_peered":"2024-09-10T08:40:39.603723+0000","last_unstale":"2024-09-10T08:40:39.610285+0000","last_undegraded":"2024-09-10T08:40:39.610285+0000","last_fullsized":"2024-09-10T08:40:39.610285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:32.851653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615496+0000","last_change":"2024-09-10T08:40:39.607624+0000","last_active":"2024-09-10T08:40:39.615496+0000","last_peered":"2024-09-10T08:40:39.615496+0000","last_clean":"2024-09-10T08:40:39.615496+0000","last_became_active":"2024-09-10T08:40:39.607331+0000","last_became_peered":"2024-09-10T08:40:39.607331+0000","last_unstale":"2024-09-10T08:40:39.615496+0000","last_undegraded":"2024-09-10T08:40:39.615496+0000","last_fullsized":"2024-09-10T08:40:39.615496+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:28.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603220+0000","last_change":"2024-09-10T08:40:39.602367+0000","last_active":"2024-09-10T08:40:39.603220+0000","last_peered":"2024-09-10T08:40:39.603220+0000","last_clean":"2024-09-10T08:40:39.603220+0000","last_became_active":"2024-09-10T08:40:39.602061+0000","last_became_peered":"2024-09-10T08:40:39.602061+0000","last_unstale":"2024-09-10T08:40:39.603220+0000","last_undegraded":"2024-09-10T08:40:39.603220+0000","last_fullsized":"2024-09-10T08:40:39.603220+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:36.086412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608217+0000","last_change":"2024-09-10T08:40:39.606370+0000","last_active":"2024-09-10T08:40:39.608217+0000","last_peered":"2024-09-10T08:40:39.608217+0000","last_clean":"2024-09-10T08:40:39.608217+0000","last_became_active":"2024-09-10T08:40:39.606005+0000","last_became_peered":"2024-09-10T08:40:39.606005+0000","last_unstale":"2024-09-10T08:40:39.608217+0000","last_undegraded":"2024-09-10T08:40:39.608217+0000","last_fullsized":"2024-09-10T08:40:39.608217+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:38.921411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.617169+0000","last_change":"2024-09-10T08:40:39.611415+0000","last_active":"2024-09-10T08:40:39.617169+0000","last_peered":"2024-09-10T08:40:39.617169+0000","last_clean":"2024-09-10T08:40:39.617169+0000","last_became_active":"2024-09-10T08:40:39.611117+0000","last_became_peered":"2024-09-10T08:40:39.611117+0000","last_unstale":"2024-09-10T08:40:39.617169+0000","last_undegraded":"2024-09-10T08:40:39.617169+0000","last_fullsized":"2024-09-10T08:40:39.617169+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:38:29.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614988+0000","last_change":"2024-09-10T08:40:39.612070+0000","last_active":"2024-09-10T08:40:39.614988+0000","last_peered":"2024-09-10T08:40:39.614988+0000","last_clean":"2024-09-10T08:40:39.614988+0000","last_became_active":"2024-09-10T08:40:39.611186+0000","last_became_peered":"2024-09-10T08:40:39.611186+0000","last_unstale":"2024-09-10T08:40:39.614988+0000","last_undegraded":"2024-09-10T08:40:39.614988+0000","last_fullsized":"2024-09-10T08:40:39.614988+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:42.961556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.593853+0000","last_change":"2024-09-10T08:40:38.593853+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.593853+0000","last_undegraded":"2024-09-10T08:40:38.593853+0000","last_fullsized":"2024-09-10T08:40:38.593853+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608176+0000","last_change":"2024-09-10T08:40:39.606371+0000","last_active":"2024-09-10T08:40:39.608176+0000","last_peered":"2024-09-10T08:40:39.608176+0000","last_clean":"2024-09-10T08:40:39.608176+0000","last_became_active":"2024-09-10T08:40:39.606096+0000","last_became_peered":"2024-09-10T08:40:39.606096+0000","last_unstale":"2024-09-10T08:40:39.608176+0000","last_undegraded":"2024-09-10T08:40:39.608176+0000","last_fullsized":"2024-09-10T08:40:39.608176+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:19.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608605+0000","last_change":"2024-09-10T08:40:39.607991+0000","last_active":"2024-09-10T08:40:39.608605+0000","last_peered":"2024-09-10T08:40:39.608605+0000","last_clean":"2024-09-10T08:40:39.608605+0000","last_became_active":"2024-09-10T08:40:39.607654+0000","last_became_peered":"2024-09-10T08:40:39.607654+0000","last_unstale":"2024-09-10T08:40:39.608605+0000","last_undegraded":"2024-09-10T08:40:39.608605+0000","last_fullsized":"2024-09-10T08:40:39.608605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596208+0000","last_change":"2024-09-10T08:40:38.596208+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596208+0000","last_undegraded":"2024-09-10T08:40:38.596208+0000","last_fullsized":"2024-09-10T08:40:38.596208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.603905+0000","last_change":"2024-09-10T08:40:39.602035+0000","last_active":"2024-09-10T08:40:39.603905+0000","last_peered":"2024-09-10T08:40:39.603905+0000","last_clean":"2024-09-10T08:40:39.603905+0000","last_became_active":"2024-09-10T08:40:39.601010+0000","last_became_peered":"2024-09-10T08:40:39.601010+0000","last_unstale":"2024-09-10T08:40:39.603905+0000","last_undegraded":"2024-09-10T08:40:39.603905+0000","last_fullsized":"2024-09-10T08:40:39.603905+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:44.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.594932+0000","last_change":"2024-09-10T08:40:38.594932+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.594932+0000","last_undegraded":"2024-09-10T08:40:38.594932+0000","last_fullsized":"2024-09-10T08:40:38.594932+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604016+0000","last_change":"2024-09-10T08:40:39.602559+0000","last_active":"2024-09-10T08:40:39.604016+0000","last_peered":"2024-09-10T08:40:39.604016+0000","last_clean":"2024-09-10T08:40:39.604016+0000","last_became_active":"2024-09-10T08:40:39.601707+0000","last_became_peered":"2024-09-10T08:40:39.601707+0000","last_unstale":"2024-09-10T08:40:39.604016+0000","last_undegraded":"2024-09-10T08:40:39.604016+0000","last_fullsized":"2024-09-10T08:40:39.604016+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:47.154878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609518+0000","last_change":"2024-09-10T08:40:39.606541+0000","last_active":"2024-09-10T08:40:39.609518+0000","last_peered":"2024-09-10T08:40:39.609518+0000","last_clean":"2024-09-10T08:40:39.609518+0000","last_became_active":"2024-09-10T08:40:39.605678+0000","last_became_peered":"2024-09-10T08:40:39.605678+0000","last_unstale":"2024-09-10T08:40:39.609518+0000","last_undegraded":"2024-09-10T08:40:39.609518+0000","last_fullsized":"2024-09-10T08:40:39.609518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610811+0000","last_change":"2024-09-10T08:40:39.607744+0000","last_active":"2024-09-10T08:40:39.610811+0000","last_peered":"2024-09-10T08:40:39.610811+0000","last_clean":"2024-09-10T08:40:39.610811+0000","last_became_active":"2024-09-10T08:40:39.604829+0000","last_became_peered":"2024-09-10T08:40:39.604829+0000","last_unstale":"2024-09-10T08:40:39.610811+0000","last_undegraded":"2024-09-10T08:40:39.610811+0000","last_fullsized":"2024-09-10T08:40:39.610811+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:17.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615549+0000","last_change":"2024-09-10T08:40:39.607658+0000","last_active":"2024-09-10T08:40:39.615549+0000","last_peered":"2024-09-10T08:40:39.615549+0000","last_clean":"2024-09-10T08:40:39.615549+0000","last_became_active":"2024-09-10T08:40:39.607088+0000","last_became_peered":"2024-09-10T08:40:39.607088+0000","last_unstale":"2024-09-10T08:40:39.615549+0000","last_undegraded":"2024-09-10T08:40:39.615549+0000","last_fullsized":"2024-09-10T08:40:39.615549+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:12.010728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595229+0000","last_change":"2024-09-10T08:40:39.590285+0000","last_active":"2024-09-10T08:40:39.595229+0000","last_peered":"2024-09-10T08:40:39.595229+0000","last_clean":"2024-09-10T08:40:39.595229+0000","last_became_active":"2024-09-10T08:40:39.588993+0000","last_became_peered":"2024-09-10T08:40:39.588993+0000","last_unstale":"2024-09-10T08:40:39.595229+0000","last_undegraded":"2024-09-10T08:40:39.595229+0000","last_fullsized":"2024-09-10T08:40:39.595229+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:07.241857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595772+0000","last_change":"2024-09-10T08:40:38.595772+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595772+0000","last_undegraded":"2024-09-10T08:40:38.595772+0000","last_fullsized":"2024-09-10T08:40:38.595772+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611382+0000","last_change":"2024-09-10T08:40:39.610193+0000","last_active":"2024-09-10T08:40:39.611382+0000","last_peered":"2024-09-10T08:40:39.611382+0000","last_clean":"2024-09-10T08:40:39.611382+0000","last_became_active":"2024-09-10T08:40:39.609275+0000","last_became_peered":"2024-09-10T08:40:39.609275+0000","last_unstale":"2024-09-10T08:40:39.611382+0000","last_undegraded":"2024-09-10T08:40:39.611382+0000","last_fullsized":"2024-09-10T08:40:39.611382+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:42.617055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.612711+0000","last_change":"2024-09-10T08:40:39.610728+0000","last_active":"2024-09-10T08:40:39.612711+0000","last_peered":"2024-09-10T08:40:39.612711+0000","last_clean":"2024-09-10T08:40:39.612711+0000","last_became_active":"2024-09-10T08:40:39.609408+0000","last_became_peered":"2024-09-10T08:40:39.609408+0000","last_unstale":"2024-09-10T08:40:39.612711+0000","last_undegraded":"2024-09-10T08:40:39.612711+0000","last_fullsized":"2024-09-10T08:40:39.612711+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:41.928734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595387+0000","last_change":"2024-09-10T08:40:39.589135+0000","last_active":"2024-09-10T08:40:39.595387+0000","last_peered":"2024-09-10T08:40:39.595387+0000","last_clean":"2024-09-10T08:40:39.595387+0000","last_became_active":"2024-09-10T08:40:39.588819+0000","last_became_peered":"2024-09-10T08:40:39.588819+0000","last_unstale":"2024-09-10T08:40:39.595387+0000","last_undegraded":"2024-09-10T08:40:39.595387+0000","last_fullsized":"2024-09-10T08:40:39.595387+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:45.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598018+0000","last_change":"2024-09-10T08:40:39.597382+0000","last_active":"2024-09-10T08:40:39.598018+0000","last_peered":"2024-09-10T08:40:39.598018+0000","last_clean":"2024-09-10T08:40:39.598018+0000","last_became_active":"2024-09-10T08:40:39.597095+0000","last_became_peered":"2024-09-10T08:40:39.597095+0000","last_unstale":"2024-09-10T08:40:39.598018+0000","last_undegraded":"2024-09-10T08:40:39.598018+0000","last_fullsized":"2024-09-10T08:40:39.598018+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.724926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616582+0000","last_change":"2024-09-10T08:40:39.615657+0000","last_active":"2024-09-10T08:40:39.616582+0000","last_peered":"2024-09-10T08:40:39.616582+0000","last_clean":"2024-09-10T08:40:39.616582+0000","last_became_active":"2024-09-10T08:40:39.615390+0000","last_became_peered":"2024-09-10T08:40:39.615390+0000","last_unstale":"2024-09-10T08:40:39.616582+0000","last_undegraded":"2024-09-10T08:40:39.616582+0000","last_fullsized":"2024-09-10T08:40:39.616582+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:27.919896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604283+0000","last_change":"2024-09-10T08:40:39.603264+0000","last_active":"2024-09-10T08:40:39.604283+0000","last_peered":"2024-09-10T08:40:39.604283+0000","last_clean":"2024-09-10T08:40:39.604283+0000","last_became_active":"2024-09-10T08:40:39.602001+0000","last_became_peered":"2024-09-10T08:40:39.602001+0000","last_unstale":"2024-09-10T08:40:39.604283+0000","last_undegraded":"2024-09-10T08:40:39.604283+0000","last_fullsized":"2024-09-10T08:40:39.604283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.606585+0000","last_change":"2024-09-10T08:40:38.604785+0000","last_active":"2024-09-10T08:40:38.606585+0000","last_peered":"2024-09-10T08:40:38.606585+0000","last_clean":"2024-09-10T08:40:38.606585+0000","last_became_active":"2024-09-10T08:40:38.604514+0000","last_became_peered":"2024-09-10T08:40:38.604514+0000","last_unstale":"2024-09-10T08:40:38.606585+0000","last_undegraded":"2024-09-10T08:40:38.606585+0000","last_fullsized":"2024-09-10T08:40:38.606585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:29.631375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609620+0000","last_change":"2024-09-10T08:40:39.607215+0000","last_active":"2024-09-10T08:40:39.609620+0000","last_peered":"2024-09-10T08:40:39.609620+0000","last_clean":"2024-09-10T08:40:39.609620+0000","last_became_active":"2024-09-10T08:40:39.606858+0000","last_became_peered":"2024-09-10T08:40:39.606858+0000","last_unstale":"2024-09-10T08:40:39.609620+0000","last_undegraded":"2024-09-10T08:40:39.609620+0000","last_fullsized":"2024-09-10T08:40:39.609620+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:09.425294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619702+0000","last_change":"2024-09-10T08:40:38.603266+0000","last_active":"2024-09-10T08:40:39.619702+0000","last_peered":"2024-09-10T08:40:39.619702+0000","last_clean":"2024-09-10T08:40:39.619702+0000","last_became_active":"2024-09-10T08:40:38.602932+0000","last_became_peered":"2024-09-10T08:40:38.602932+0000","last_unstale":"2024-09-10T08:40:39.619702+0000","last_undegraded":"2024-09-10T08:40:39.619702+0000","last_fullsized":"2024-09-10T08:40:39.619702+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.782228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616084+0000","last_change":"2024-09-10T08:40:39.609371+0000","last_active":"2024-09-10T08:40:39.616084+0000","last_peered":"2024-09-10T08:40:39.616084+0000","last_clean":"2024-09-10T08:40:39.616084+0000","last_became_active":"2024-09-10T08:40:39.609083+0000","last_became_peered":"2024-09-10T08:40:39.609083+0000","last_unstale":"2024-09-10T08:40:39.616084+0000","last_undegraded":"2024-09-10T08:40:39.616084+0000","last_fullsized":"2024-09-10T08:40:39.616084+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:04.082259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621677+0000","last_change":"2024-09-10T08:40:38.611280+0000","last_active":"2024-09-10T08:40:39.621677+0000","last_peered":"2024-09-10T08:40:39.621677+0000","last_clean":"2024-09-10T08:40:39.621677+0000","last_became_active":"2024-09-10T08:40:38.610992+0000","last_became_peered":"2024-09-10T08:40:38.610992+0000","last_unstale":"2024-09-10T08:40:39.621677+0000","last_undegraded":"2024-09-10T08:40:39.621677+0000","last_fullsized":"2024-09-10T08:40:39.621677+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615697+0000","last_change":"2024-09-10T08:40:39.608923+0000","last_active":"2024-09-10T08:40:39.615697+0000","last_peered":"2024-09-10T08:40:39.615697+0000","last_clean":"2024-09-10T08:40:39.615697+0000","last_became_active":"2024-09-10T08:40:39.608659+0000","last_became_peered":"2024-09-10T08:40:39.608659+0000","last_unstale":"2024-09-10T08:40:39.615697+0000","last_undegraded":"2024-09-10T08:40:39.615697+0000","last_fullsized":"2024-09-10T08:40:39.615697+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:47:26.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622253+0000","last_change":"2024-09-10T08:40:38.603525+0000","last_active":"2024-09-10T08:40:39.622253+0000","last_peered":"2024-09-10T08:40:39.622253+0000","last_clean":"2024-09-10T08:40:39.622253+0000","last_became_active":"2024-09-10T08:40:38.603260+0000","last_became_peered":"2024-09-10T08:40:38.603260+0000","last_unstale":"2024-09-10T08:40:39.622253+0000","last_undegraded":"2024-09-10T08:40:39.622253+0000","last_fullsized":"2024-09-10T08:40:39.622253+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:55.827552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.607782+0000","last_change":"2024-09-10T08:40:39.601136+0000","last_active":"2024-09-10T08:40:39.607782+0000","last_peered":"2024-09-10T08:40:39.607782+0000","last_clean":"2024-09-10T08:40:39.607782+0000","last_became_active":"2024-09-10T08:40:39.600532+0000","last_became_peered":"2024-09-10T08:40:39.600532+0000","last_unstale":"2024-09-10T08:40:39.607782+0000","last_undegraded":"2024-09-10T08:40:39.607782+0000","last_fullsized":"2024-09-10T08:40:39.607782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:07.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621755+0000","last_change":"2024-09-10T08:40:38.610462+0000","last_active":"2024-09-10T08:40:39.621755+0000","last_peered":"2024-09-10T08:40:39.621755+0000","last_clean":"2024-09-10T08:40:39.621755+0000","last_became_active":"2024-09-10T08:40:38.610181+0000","last_became_peered":"2024-09-10T08:40:38.610181+0000","last_unstale":"2024-09-10T08:40:39.621755+0000","last_undegraded":"2024-09-10T08:40:39.621755+0000","last_fullsized":"2024-09-10T08:40:39.621755+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:40.925346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616405+0000","last_change":"2024-09-10T08:40:39.615214+0000","last_active":"2024-09-10T08:40:39.616405+0000","last_peered":"2024-09-10T08:40:39.616405+0000","last_clean":"2024-09-10T08:40:39.616405+0000","last_became_active":"2024-09-10T08:40:39.614895+0000","last_became_peered":"2024-09-10T08:40:39.614895+0000","last_unstale":"2024-09-10T08:40:39.616405+0000","last_undegraded":"2024-09-10T08:40:39.616405+0000","last_fullsized":"2024-09-10T08:40:39.616405+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621084+0000","last_change":"2024-09-10T08:40:38.608616+0000","last_active":"2024-09-10T08:40:39.621084+0000","last_peered":"2024-09-10T08:40:39.621084+0000","last_clean":"2024-09-10T08:40:39.621084+0000","last_became_active":"2024-09-10T08:40:38.608335+0000","last_became_peered":"2024-09-10T08:40:38.608335+0000","last_unstale":"2024-09-10T08:40:39.621084+0000","last_undegraded":"2024-09-10T08:40:39.621084+0000","last_fullsized":"2024-09-10T08:40:39.621084+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:01.508308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608152+0000","last_change":"2024-09-10T08:40:39.600898+0000","last_active":"2024-09-10T08:40:39.608152+0000","last_peered":"2024-09-10T08:40:39.608152+0000","last_clean":"2024-09-10T08:40:39.608152+0000","last_became_active":"2024-09-10T08:40:39.600580+0000","last_became_peered":"2024-09-10T08:40:39.600580+0000","last_unstale":"2024-09-10T08:40:39.608152+0000","last_undegraded":"2024-09-10T08:40:39.608152+0000","last_fullsized":"2024-09-10T08:40:39.608152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:36.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.587705+0000","last_change":"2024-09-10T08:40:38.602353+0000","last_active":"2024-09-10T08:40:39.587705+0000","last_peered":"2024-09-10T08:40:39.587705+0000","last_clean":"2024-09-10T08:40:39.587705+0000","last_became_active":"2024-09-10T08:40:38.601969+0000","last_became_peered":"2024-09-10T08:40:38.601969+0000","last_unstale":"2024-09-10T08:40:39.587705+0000","last_undegraded":"2024-09-10T08:40:39.587705+0000","last_fullsized":"2024-09-10T08:40:39.587705+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.613667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.596152+0000","last_change":"2024-09-10T08:40:38.596152+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.596152+0000","last_undegraded":"2024-09-10T08:40:38.596152+0000","last_fullsized":"2024-09-10T08:40:38.596152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590590+0000","last_change":"2024-09-10T08:40:38.606684+0000","last_active":"2024-09-10T08:40:39.590590+0000","last_peered":"2024-09-10T08:40:39.590590+0000","last_clean":"2024-09-10T08:40:39.590590+0000","last_became_active":"2024-09-10T08:40:38.606419+0000","last_became_peered":"2024-09-10T08:40:38.606419+0000","last_unstale":"2024-09-10T08:40:39.590590+0000","last_undegraded":"2024-09-10T08:40:39.590590+0000","last_fullsized":"2024-09-10T08:40:39.590590+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:58.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609813+0000","last_change":"2024-09-10T08:40:39.608373+0000","last_active":"2024-09-10T08:40:39.609813+0000","last_peered":"2024-09-10T08:40:39.609813+0000","last_clean":"2024-09-10T08:40:39.609813+0000","last_became_active":"2024-09-10T08:40:39.607215+0000","last_became_peered":"2024-09-10T08:40:39.607215+0000","last_unstale":"2024-09-10T08:40:39.609813+0000","last_undegraded":"2024-09-10T08:40:39.609813+0000","last_fullsized":"2024-09-10T08:40:39.609813+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:30.447019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598441+0000","last_change":"2024-09-10T08:40:38.602257+0000","last_active":"2024-09-10T08:40:39.598441+0000","last_peered":"2024-09-10T08:40:39.598441+0000","last_clean":"2024-09-10T08:40:39.598441+0000","last_became_active":"2024-09-10T08:40:38.600878+0000","last_became_peered":"2024-09-10T08:40:38.600878+0000","last_unstale":"2024-09-10T08:40:39.598441+0000","last_undegraded":"2024-09-10T08:40:39.598441+0000","last_fullsized":"2024-09-10T08:40:39.598441+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:16.094429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595667+0000","last_change":"2024-09-10T08:40:39.590087+0000","last_active":"2024-09-10T08:40:39.595667+0000","last_peered":"2024-09-10T08:40:39.595667+0000","last_clean":"2024-09-10T08:40:39.595667+0000","last_became_active":"2024-09-10T08:40:39.589804+0000","last_became_peered":"2024-09-10T08:40:39.589804+0000","last_unstale":"2024-09-10T08:40:39.595667+0000","last_undegraded":"2024-09-10T08:40:39.595667+0000","last_fullsized":"2024-09-10T08:40:39.595667+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.511696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"170'3","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621914+0000","last_change":"2024-09-10T08:40:38.609058+0000","last_active":"2024-09-10T08:40:39.621914+0000","last_peered":"2024-09-10T08:40:39.621914+0000","last_clean":"2024-09-10T08:40:39.621914+0000","last_became_active":"2024-09-10T08:40:38.608401+0000","last_became_peered":"2024-09-10T08:40:38.608401+0000","last_unstale":"2024-09-10T08:40:39.621914+0000","last_undegraded":"2024-09-10T08:40:39.621914+0000","last_fullsized":"2024-09-10T08:40:39.621914+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:55.897796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608791+0000","last_change":"2024-09-10T08:40:39.605532+0000","last_active":"2024-09-10T08:40:39.608791+0000","last_peered":"2024-09-10T08:40:39.608791+0000","last_clean":"2024-09-10T08:40:39.608791+0000","last_became_active":"2024-09-10T08:40:39.605078+0000","last_became_peered":"2024-09-10T08:40:39.605078+0000","last_unstale":"2024-09-10T08:40:39.608791+0000","last_undegraded":"2024-09-10T08:40:39.608791+0000","last_fullsized":"2024-09-10T08:40:39.608791+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:23.982336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"170'6","reported_seq":18,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.624689+0000","last_change":"2024-09-10T08:40:38.609036+0000","last_active":"2024-09-10T08:40:39.624689+0000","last_peered":"2024-09-10T08:40:39.624689+0000","last_clean":"2024-09-10T08:40:39.624689+0000","last_became_active":"2024-09-10T08:40:38.608738+0000","last_became_peered":"2024-09-10T08:40:38.608738+0000","last_unstale":"2024-09-10T08:40:39.624689+0000","last_undegraded":"2024-09-10T08:40:39.624689+0000","last_fullsized":"2024-09-10T08:40:39.624689+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:47.126499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608788+0000","last_change":"2024-09-10T08:40:39.605430+0000","last_active":"2024-09-10T08:40:39.608788+0000","last_peered":"2024-09-10T08:40:39.608788+0000","last_clean":"2024-09-10T08:40:39.608788+0000","last_became_active":"2024-09-10T08:40:39.603647+0000","last_became_peered":"2024-09-10T08:40:39.603647+0000","last_unstale":"2024-09-10T08:40:39.608788+0000","last_undegraded":"2024-09-10T08:40:39.608788+0000","last_fullsized":"2024-09-10T08:40:39.608788+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:06.763196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621597+0000","last_change":"2024-09-10T08:40:38.608957+0000","last_active":"2024-09-10T08:40:39.621597+0000","last_peered":"2024-09-10T08:40:39.621597+0000","last_clean":"2024-09-10T08:40:39.621597+0000","last_became_active":"2024-09-10T08:40:38.608520+0000","last_became_peered":"2024-09-10T08:40:38.608520+0000","last_unstale":"2024-09-10T08:40:39.621597+0000","last_undegraded":"2024-09-10T08:40:39.621597+0000","last_fullsized":"2024-09-10T08:40:39.621597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:05.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.598629+0000","last_change":"2024-09-10T08:40:39.596837+0000","last_active":"2024-09-10T08:40:39.598629+0000","last_peered":"2024-09-10T08:40:39.598629+0000","last_clean":"2024-09-10T08:40:39.598629+0000","last_became_active":"2024-09-10T08:40:39.596457+0000","last_became_peered":"2024-09-10T08:40:39.596457+0000","last_unstale":"2024-09-10T08:40:39.598629+0000","last_undegraded":"2024-09-10T08:40:39.598629+0000","last_fullsized":"2024-09-10T08:40:39.598629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599214+0000","last_change":"2024-09-10T08:40:38.599901+0000","last_active":"2024-09-10T08:40:39.599214+0000","last_peered":"2024-09-10T08:40:39.599214+0000","last_clean":"2024-09-10T08:40:39.599214+0000","last_became_active":"2024-09-10T08:40:38.599571+0000","last_became_peered":"2024-09-10T08:40:38.599571+0000","last_unstale":"2024-09-10T08:40:39.599214+0000","last_undegraded":"2024-09-10T08:40:39.599214+0000","last_fullsized":"2024-09-10T08:40:39.599214+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:05.993602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595690+0000","last_change":"2024-09-10T08:40:39.593816+0000","last_active":"2024-09-10T08:40:39.595690+0000","last_peered":"2024-09-10T08:40:39.595690+0000","last_clean":"2024-09-10T08:40:39.595690+0000","last_became_active":"2024-09-10T08:40:39.592965+0000","last_became_peered":"2024-09-10T08:40:39.592965+0000","last_unstale":"2024-09-10T08:40:39.595690+0000","last_undegraded":"2024-09-10T08:40:39.595690+0000","last_fullsized":"2024-09-10T08:40:39.595690+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:35.945534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593166+0000","last_change":"2024-09-10T08:40:38.606357+0000","last_active":"2024-09-10T08:40:39.593166+0000","last_peered":"2024-09-10T08:40:39.593166+0000","last_clean":"2024-09-10T08:40:39.593166+0000","last_became_active":"2024-09-10T08:40:38.606082+0000","last_became_peered":"2024-09-10T08:40:38.606082+0000","last_unstale":"2024-09-10T08:40:39.593166+0000","last_undegraded":"2024-09-10T08:40:39.593166+0000","last_fullsized":"2024-09-10T08:40:39.593166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:06.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.611654+0000","last_change":"2024-09-10T08:40:39.611019+0000","last_active":"2024-09-10T08:40:39.611654+0000","last_peered":"2024-09-10T08:40:39.611654+0000","last_clean":"2024-09-10T08:40:39.611654+0000","last_became_active":"2024-09-10T08:40:39.610479+0000","last_became_peered":"2024-09-10T08:40:39.610479+0000","last_unstale":"2024-09-10T08:40:39.611654+0000","last_undegraded":"2024-09-10T08:40:39.611654+0000","last_fullsized":"2024-09-10T08:40:39.611654+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:06.996990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"170'8","reported_seq":20,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.623156+0000","last_change":"2024-09-10T08:40:38.599942+0000","last_active":"2024-09-10T08:40:39.623156+0000","last_peered":"2024-09-10T08:40:39.623156+0000","last_clean":"2024-09-10T08:40:39.623156+0000","last_became_active":"2024-09-10T08:40:38.599603+0000","last_became_peered":"2024-09-10T08:40:38.599603+0000","last_unstale":"2024-09-10T08:40:39.623156+0000","last_undegraded":"2024-09-10T08:40:39.623156+0000","last_fullsized":"2024-09-10T08:40:39.623156+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:44.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.610303+0000","last_change":"2024-09-10T08:40:39.608592+0000","last_active":"2024-09-10T08:40:39.610303+0000","last_peered":"2024-09-10T08:40:39.610303+0000","last_clean":"2024-09-10T08:40:39.610303+0000","last_became_active":"2024-09-10T08:40:39.603659+0000","last_became_peered":"2024-09-10T08:40:39.603659+0000","last_unstale":"2024-09-10T08:40:39.610303+0000","last_undegraded":"2024-09-10T08:40:39.610303+0000","last_fullsized":"2024-09-10T08:40:39.610303+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:25.399740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.622148+0000","last_change":"2024-09-10T08:40:38.609734+0000","last_active":"2024-09-10T08:40:39.622148+0000","last_peered":"2024-09-10T08:40:39.622148+0000","last_clean":"2024-09-10T08:40:39.622148+0000","last_became_active":"2024-09-10T08:40:38.609463+0000","last_became_peered":"2024-09-10T08:40:38.609463+0000","last_unstale":"2024-09-10T08:40:39.622148+0000","last_undegraded":"2024-09-10T08:40:39.622148+0000","last_fullsized":"2024-09-10T08:40:39.622148+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:35.083024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.599659+0000","last_change":"2024-09-10T08:40:39.597891+0000","last_active":"2024-09-10T08:40:39.599659+0000","last_peered":"2024-09-10T08:40:39.599659+0000","last_clean":"2024-09-10T08:40:39.599659+0000","last_became_active":"2024-09-10T08:40:39.597179+0000","last_became_peered":"2024-09-10T08:40:39.597179+0000","last_unstale":"2024-09-10T08:40:39.599659+0000","last_undegraded":"2024-09-10T08:40:39.599659+0000","last_fullsized":"2024-09-10T08:40:39.599659+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:53.116764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.619027+0000","last_change":"2024-09-10T08:40:38.609455+0000","last_active":"2024-09-10T08:40:39.619027+0000","last_peered":"2024-09-10T08:40:39.619027+0000","last_clean":"2024-09-10T08:40:39.619027+0000","last_became_active":"2024-09-10T08:40:38.609193+0000","last_became_peered":"2024-09-10T08:40:38.609193+0000","last_unstale":"2024-09-10T08:40:39.619027+0000","last_undegraded":"2024-09-10T08:40:39.619027+0000","last_fullsized":"2024-09-10T08:40:39.619027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:23.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613972+0000","last_change":"2024-09-10T08:40:39.604315+0000","last_active":"2024-09-10T08:40:39.613972+0000","last_peered":"2024-09-10T08:40:39.613972+0000","last_clean":"2024-09-10T08:40:39.613972+0000","last_became_active":"2024-09-10T08:40:39.603974+0000","last_became_peered":"2024-09-10T08:40:39.603974+0000","last_unstale":"2024-09-10T08:40:39.613972+0000","last_undegraded":"2024-09-10T08:40:39.613972+0000","last_fullsized":"2024-09-10T08:40:39.613972+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:39:37.302990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"170'1","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616894+0000","last_change":"2024-09-10T08:40:38.604618+0000","last_active":"2024-09-10T08:40:39.616894+0000","last_peered":"2024-09-10T08:40:39.616894+0000","last_clean":"2024-09-10T08:40:39.616894+0000","last_became_active":"2024-09-10T08:40:38.603739+0000","last_became_peered":"2024-09-10T08:40:38.603739+0000","last_unstale":"2024-09-10T08:40:39.616894+0000","last_undegraded":"2024-09-10T08:40:39.616894+0000","last_fullsized":"2024-09-10T08:40:39.616894+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:18.461479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.595522+0000","last_change":"2024-09-10T08:40:39.591588+0000","last_active":"2024-09-10T08:40:39.595522+0000","last_peered":"2024-09-10T08:40:39.595522+0000","last_clean":"2024-09-10T08:40:39.595522+0000","last_became_active":"2024-09-10T08:40:39.591319+0000","last_became_peered":"2024-09-10T08:40:39.591319+0000","last_unstale":"2024-09-10T08:40:39.595522+0000","last_undegraded":"2024-09-10T08:40:39.595522+0000","last_fullsized":"2024-09-10T08:40:39.595522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:48.129887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592375+0000","last_change":"2024-09-10T08:40:38.607426+0000","last_active":"2024-09-10T08:40:39.592375+0000","last_peered":"2024-09-10T08:40:39.592375+0000","last_clean":"2024-09-10T08:40:39.592375+0000","last_became_active":"2024-09-10T08:40:38.606843+0000","last_became_peered":"2024-09-10T08:40:38.606843+0000","last_unstale":"2024-09-10T08:40:39.592375+0000","last_undegraded":"2024-09-10T08:40:39.592375+0000","last_fullsized":"2024-09-10T08:40:39.592375+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:12.746003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.604029+0000","last_change":"2024-09-10T08:40:39.595611+0000","last_active":"2024-09-10T08:40:39.604029+0000","last_peered":"2024-09-10T08:40:39.604029+0000","last_clean":"2024-09-10T08:40:39.604029+0000","last_became_active":"2024-09-10T08:40:39.593091+0000","last_became_peered":"2024-09-10T08:40:39.593091+0000","last_unstale":"2024-09-10T08:40:39.604029+0000","last_undegraded":"2024-09-10T08:40:39.604029+0000","last_fullsized":"2024-09-10T08:40:39.604029+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:33.263677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.621202+0000","last_change":"2024-09-10T08:40:38.612800+0000","last_active":"2024-09-10T08:40:39.621202+0000","last_peered":"2024-09-10T08:40:39.621202+0000","last_clean":"2024-09-10T08:40:39.621202+0000","last_became_active":"2024-09-10T08:40:38.612501+0000","last_became_peered":"2024-09-10T08:40:38.612501+0000","last_unstale":"2024-09-10T08:40:39.621202+0000","last_undegraded":"2024-09-10T08:40:39.621202+0000","last_fullsized":"2024-09-10T08:40:39.621202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:17.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608648+0000","last_change":"2024-09-10T08:40:39.607946+0000","last_active":"2024-09-10T08:40:39.608648+0000","last_peered":"2024-09-10T08:40:39.608648+0000","last_clean":"2024-09-10T08:40:39.608648+0000","last_became_active":"2024-09-10T08:40:39.607670+0000","last_became_peered":"2024-09-10T08:40:39.607670+0000","last_unstale":"2024-09-10T08:40:39.608648+0000","last_undegraded":"2024-09-10T08:40:39.608648+0000","last_fullsized":"2024-09-10T08:40:39.608648+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585166+0000","last_change":"2024-09-10T08:40:38.609194+0000","last_active":"2024-09-10T08:40:39.585166+0000","last_peered":"2024-09-10T08:40:39.585166+0000","last_clean":"2024-09-10T08:40:39.585166+0000","last_became_active":"2024-09-10T08:40:38.608754+0000","last_became_peered":"2024-09-10T08:40:38.608754+0000","last_unstale":"2024-09-10T08:40:39.585166+0000","last_undegraded":"2024-09-10T08:40:39.585166+0000","last_fullsized":"2024-09-10T08:40:39.585166+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.065351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.605233+0000","last_change":"2024-09-10T08:40:39.597582+0000","last_active":"2024-09-10T08:40:39.605233+0000","last_peered":"2024-09-10T08:40:39.605233+0000","last_clean":"2024-09-10T08:40:39.605233+0000","last_became_active":"2024-09-10T08:40:39.597309+0000","last_became_peered":"2024-09-10T08:40:39.597309+0000","last_unstale":"2024-09-10T08:40:39.605233+0000","last_undegraded":"2024-09-10T08:40:39.605233+0000","last_fullsized":"2024-09-10T08:40:39.605233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:44.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585031+0000","last_change":"2024-09-10T08:40:38.602833+0000","last_active":"2024-09-10T08:40:39.585031+0000","last_peered":"2024-09-10T08:40:39.585031+0000","last_clean":"2024-09-10T08:40:39.585031+0000","last_became_active":"2024-09-10T08:40:38.602520+0000","last_became_peered":"2024-09-10T08:40:38.602520+0000","last_unstale":"2024-09-10T08:40:39.585031+0000","last_undegraded":"2024-09-10T08:40:39.585031+0000","last_fullsized":"2024-09-10T08:40:39.585031+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:31.477687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608666+0000","last_change":"2024-09-10T08:40:39.605369+0000","last_active":"2024-09-10T08:40:39.608666+0000","last_peered":"2024-09-10T08:40:39.608666+0000","last_clean":"2024-09-10T08:40:39.608666+0000","last_became_active":"2024-09-10T08:40:39.604880+0000","last_became_peered":"2024-09-10T08:40:39.604880+0000","last_unstale":"2024-09-10T08:40:39.608666+0000","last_undegraded":"2024-09-10T08:40:39.608666+0000","last_fullsized":"2024-09-10T08:40:39.608666+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.590185+0000","last_change":"2024-09-10T08:40:38.602333+0000","last_active":"2024-09-10T08:40:39.590185+0000","last_peered":"2024-09-10T08:40:39.590185+0000","last_clean":"2024-09-10T08:40:39.590185+0000","last_became_active":"2024-09-10T08:40:38.599744+0000","last_became_peered":"2024-09-10T08:40:38.599744+0000","last_unstale":"2024-09-10T08:40:39.590185+0000","last_undegraded":"2024-09-10T08:40:39.590185+0000","last_fullsized":"2024-09-10T08:40:39.590185+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:44.559698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.595680+0000","last_change":"2024-09-10T08:40:38.595680+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.595680+0000","last_undegraded":"2024-09-10T08:40:38.595680+0000","last_fullsized":"2024-09-10T08:40:38.595680+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"170'2","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.613473+0000","last_change":"2024-09-10T08:40:38.611840+0000","last_active":"2024-09-10T08:40:39.613473+0000","last_peered":"2024-09-10T08:40:39.613473+0000","last_clean":"2024-09-10T08:40:39.613473+0000","last_became_active":"2024-09-10T08:40:38.611553+0000","last_became_peered":"2024-09-10T08:40:38.611553+0000","last_unstale":"2024-09-10T08:40:39.613473+0000","last_undegraded":"2024-09-10T08:40:39.613473+0000","last_fullsized":"2024-09-10T08:40:39.613473+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:46.146476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.597389+0000","last_change":"2024-09-10T08:40:38.597389+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.597389+0000","last_undegraded":"2024-09-10T08:40:38.597389+0000","last_fullsized":"2024-09-10T08:40:38.597389+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.608107+0000","last_change":"2024-09-10T08:40:38.606693+0000","last_active":"2024-09-10T08:40:38.608107+0000","last_peered":"2024-09-10T08:40:38.608107+0000","last_clean":"2024-09-10T08:40:38.608107+0000","last_became_active":"2024-09-10T08:40:38.605494+0000","last_became_peered":"2024-09-10T08:40:38.605494+0000","last_unstale":"2024-09-10T08:40:38.608107+0000","last_undegraded":"2024-09-10T08:40:38.608107+0000","last_fullsized":"2024-09-10T08:40:38.608107+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:23.432231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2024-09-10T08:40:38.598658+0000","last_change":"2024-09-10T08:40:38.598658+0000","last_active":"2024-09-10T08:40:38.576890+0000","last_peered":"2024-09-10T08:40:38.576890+0000","last_clean":"2024-09-10T08:40:38.576890+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:40:38.598658+0000","last_undegraded":"2024-09-10T08:40:38.598658+0000","last_fullsized":"2024-09-10T08:40:38.598658+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-10T08:40:38.605973+0000","last_change":"2024-09-10T08:40:38.601853+0000","last_active":"2024-09-10T08:40:38.605973+0000","last_peered":"2024-09-10T08:40:38.605973+0000","last_clean":"2024-09-10T08:40:38.605973+0000","last_became_active":"2024-09-10T08:40:38.601534+0000","last_became_peered":"2024-09-10T08:40:38.601534+0000","last_unstale":"2024-09-10T08:40:38.605973+0000","last_undegraded":"2024-09-10T08:40:38.605973+0000","last_fullsized":"2024-09-10T08:40:38.605973+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:15.105563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.615796+0000","last_change":"2024-09-10T08:40:39.614735+0000","last_active":"2024-09-10T08:40:39.615796+0000","last_peered":"2024-09-10T08:40:39.615796+0000","last_clean":"2024-09-10T08:40:39.615796+0000","last_became_active":"2024-09-10T08:40:39.614305+0000","last_became_peered":"2024-09-10T08:40:39.614305+0000","last_unstale":"2024-09-10T08:40:39.615796+0000","last_undegraded":"2024-09-10T08:40:39.615796+0000","last_fullsized":"2024-09-10T08:40:39.615796+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:28:06.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.593911+0000","last_change":"2024-09-10T08:40:38.607592+0000","last_active":"2024-09-10T08:40:39.593911+0000","last_peered":"2024-09-10T08:40:39.593911+0000","last_clean":"2024-09-10T08:40:39.593911+0000","last_became_active":"2024-09-10T08:40:38.607327+0000","last_became_peered":"2024-09-10T08:40:38.607327+0000","last_unstale":"2024-09-10T08:40:39.593911+0000","last_undegraded":"2024-09-10T08:40:39.593911+0000","last_fullsized":"2024-09-10T08:40:39.593911+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.942146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.614886+0000","last_change":"2024-09-10T08:40:39.605335+0000","last_active":"2024-09-10T08:40:39.614886+0000","last_peered":"2024-09-10T08:40:39.614886+0000","last_clean":"2024-09-10T08:40:39.614886+0000","last_became_active":"2024-09-10T08:40:39.605015+0000","last_became_peered":"2024-09-10T08:40:39.605015+0000","last_unstale":"2024-09-10T08:40:39.614886+0000","last_undegraded":"2024-09-10T08:40:39.614886+0000","last_fullsized":"2024-09-10T08:40:39.614886+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:07:48.987807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.592390+0000","last_change":"2024-09-10T08:40:38.604528+0000","last_active":"2024-09-10T08:40:39.592390+0000","last_peered":"2024-09-10T08:40:39.592390+0000","last_clean":"2024-09-10T08:40:39.592390+0000","last_became_active":"2024-09-10T08:40:38.602419+0000","last_became_peered":"2024-09-10T08:40:38.602419+0000","last_unstale":"2024-09-10T08:40:39.592390+0000","last_undegraded":"2024-09-10T08:40:39.592390+0000","last_fullsized":"2024-09-10T08:40:39.592390+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:53.016826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.608198+0000","last_change":"2024-09-10T08:40:39.600972+0000","last_active":"2024-09-10T08:40:39.608198+0000","last_peered":"2024-09-10T08:40:39.608198+0000","last_clean":"2024-09-10T08:40:39.608198+0000","last_became_active":"2024-09-10T08:40:39.600696+0000","last_became_peered":"2024-09-10T08:40:39.600696+0000","last_unstale":"2024-09-10T08:40:39.608198+0000","last_undegraded":"2024-09-10T08:40:39.608198+0000","last_fullsized":"2024-09-10T08:40:39.608198+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:13:44.597794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597585+0000","last_change":"2024-09-10T08:40:38.598840+0000","last_active":"2024-09-10T08:40:39.597585+0000","last_peered":"2024-09-10T08:40:39.597585+0000","last_clean":"2024-09-10T08:40:39.597585+0000","last_became_active":"2024-09-10T08:40:38.598539+0000","last_became_peered":"2024-09-10T08:40:38.598539+0000","last_unstale":"2024-09-10T08:40:39.597585+0000","last_undegraded":"2024-09-10T08:40:39.597585+0000","last_fullsized":"2024-09-10T08:40:39.597585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:40.709904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.616557+0000","last_change":"2024-09-10T08:40:39.610363+0000","last_active":"2024-09-10T08:40:39.616557+0000","last_peered":"2024-09-10T08:40:39.616557+0000","last_clean":"2024-09-10T08:40:39.616557+0000","last_became_active":"2024-09-10T08:40:39.609936+0000","last_became_peered":"2024-09-10T08:40:39.609936+0000","last_unstale":"2024-09-10T08:40:39.616557+0000","last_undegraded":"2024-09-10T08:40:39.616557+0000","last_fullsized":"2024-09-10T08:40:39.616557+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:59.391662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.597883+0000","last_change":"2024-09-10T08:40:38.600904+0000","last_active":"2024-09-10T08:40:39.597883+0000","last_peered":"2024-09-10T08:40:39.597883+0000","last_clean":"2024-09-10T08:40:39.597883+0000","last_became_active":"2024-09-10T08:40:38.600572+0000","last_became_peered":"2024-09-10T08:40:38.600572+0000","last_unstale":"2024-09-10T08:40:39.597883+0000","last_undegraded":"2024-09-10T08:40:39.597883+0000","last_fullsized":"2024-09-10T08:40:39.597883+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:16.573172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.609866+0000","last_change":"2024-09-10T08:40:39.605511+0000","last_active":"2024-09-10T08:40:39.609866+0000","last_peered":"2024-09-10T08:40:39.609866+0000","last_clean":"2024-09-10T08:40:39.609866+0000","last_became_active":"2024-09-10T08:40:39.605208+0000","last_became_peered":"2024-09-10T08:40:39.605208+0000","last_unstale":"2024-09-10T08:40:39.609866+0000","last_undegraded":"2024-09-10T08:40:39.609866+0000","last_fullsized":"2024-09-10T08:40:39.609866+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.227456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.585592+0000","last_change":"2024-09-10T08:40:38.607736+0000","last_active":"2024-09-10T08:40:39.585592+0000","last_peered":"2024-09-10T08:40:39.585592+0000","last_clean":"2024-09-10T08:40:39.585592+0000","last_became_active":"2024-09-10T08:40:38.607482+0000","last_became_peered":"2024-09-10T08:40:38.607482+0000","last_unstale":"2024-09-10T08:40:39.585592+0000","last_undegraded":"2024-09-10T08:40:39.585592+0000","last_fullsized":"2024-09-10T08:40:39.585592+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:25.625722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591040+0000","last_change":"2024-09-10T08:40:39.589188+0000","last_active":"2024-09-10T08:40:39.591040+0000","last_peered":"2024-09-10T08:40:39.591040+0000","last_clean":"2024-09-10T08:40:39.591040+0000","last_became_active":"2024-09-10T08:40:39.588915+0000","last_became_peered":"2024-09-10T08:40:39.588915+0000","last_unstale":"2024-09-10T08:40:39.591040+0000","last_undegraded":"2024-09-10T08:40:39.591040+0000","last_fullsized":"2024-09-10T08:40:39.591040+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:33.170578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.582541+0000","last_change":"2024-09-10T08:40:38.596603+0000","last_active":"2024-09-10T08:40:39.582541+0000","last_peered":"2024-09-10T08:40:39.582541+0000","last_clean":"2024-09-10T08:40:39.582541+0000","last_became_active":"2024-09-10T08:40:38.594989+0000","last_became_peered":"2024-09-10T08:40:38.594989+0000","last_unstale":"2024-09-10T08:40:39.582541+0000","last_undegraded":"2024-09-10T08:40:39.582541+0000","last_fullsized":"2024-09-10T08:40:39.582541+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:52.691150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":442,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-10T08:40:39.591462+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:40:39.591462+0000","last_peered":"2024-09-10T08:40:39.591462+0000","last_clean":"2024-09-10T08:40:39.591462+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:40:39.591462+0000","last_undegraded":"2024-09-10T08:40:39.591462+0000","last_fullsized":"2024-09-10T08:40:39.591462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51316,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320524,"statfs":{"total":96636764160,"available":96584216576,"internally_reserved":0,"allocated":2129920,"data_stored":936713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55468,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316372,"statfs":{"total":96636764160,"available":96579964928,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509588,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47144,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324696,"statfs":{"total":96636764160,"available":96588488704,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509589,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63804,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308036,"statfs":{"total":96636764160,"available":96571428864,"internally_reserved":0,"allocated":2134016,"data_stored":936783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509588,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1520306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2117632,"data_stored":929938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56032,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315808,"statfs":{"total":96636764160,"available":96579387392,"internally_reserved":0,"allocated":2699264,"data_stored":1514031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:40:48.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:40:48.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.674+0000 7f50e5a00640 1 Processor -- start 2024-09-10T08:40:48.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.674+0000 7f50e5a00640 1 -- start start 2024-09-10T08:40:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.675+0000 7f50e5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 0x7f50e006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.675+0000 7f50e5a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e0071180 con 0x7f50e006c150 2024-09-10T08:40:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50e5a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e0071460 con 0x7f50e013eb20 2024-09-10T08:40:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50e5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50e0071ab0 con 0x7f50e00b2d40 2024-09-10T08:40:48.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50df400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50e006c150 0x7f50e0071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46334/0 (socket says 172.21.15.52:46334) 2024-09-10T08:40:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50df400640 1 -- 172.21.15.52:0/550981661 learned_addr learned my addr 172.21.15.52:0/550981661 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:48.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50dea00640 1 --2- 172.21.15.52:0/550981661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 0x7f50e006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565728660 0 0) 0x7f50e0071180 con 0x7f50e006c150 2024-09-10T08:40:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c4003520 con 0x7f50e006c150 2024-09-10T08:40:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779028820 0 0) 0x7f50e0071460 con 0x7f50e013eb20 2024-09-10T08:40:48.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.676+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e0071180 con 0x7f50e013eb20 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.677+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2192427140 0 0) 0x7f50c4003520 con 0x7f50e006c150 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.677+0000 7f50dea00640 1 -- 172.21.15.52:0/550981661 >> v1:172.21.15.176:6789/0 conn(0x7f50e013eb20 legacy=0x7f50e015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.677+0000 7f50dea00640 1 -- 172.21.15.52:0/550981661 >> v1:172.21.15.52:6789/0 conn(0x7f50e006c150 legacy=0x7f50e0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.677+0000 7f50dea00640 1 -- 172.21.15.52:0/550981661 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e0071740 con 0x7f50e00b2d40 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50dea00640 1 --2- 172.21.15.52:0/550981661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 0x7f50e006bc10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50d00097d0 tx=0x7f50d002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37487cb092c31886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0037070 con 0x7f50e00b2d40 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d002ac30 con 0x7f50e00b2d40 2024-09-10T08:40:48.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50dd600640 1 -- 172.21.15.52:0/550981661 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d80019f0 con 0x7f50e00b2d40 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50e5a00640 1 -- 172.21.15.52:0/550981661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 msgr2=0x7f50e006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.678+0000 7f50e5a00640 1 --2- 172.21.15.52:0/550981661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 0x7f50e006bc10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50d00097d0 tx=0x7f50d002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.679+0000 7f50e5a00640 1 -- 172.21.15.52:0/550981661 shutdown_connections 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.679+0000 7f50e5a00640 1 --2- 172.21.15.52:0/550981661 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e00b2d40 0x7f50e006bc10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.679+0000 7f50e5a00640 1 -- 172.21.15.52:0/550981661 >> 172.21.15.52:0/550981661 conn(0x7f50e00ccec0 msgr2=0x7f50e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:48.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.679+0000 7f50e5a00640 1 -- 172.21.15.52:0/550981661 shutdown_connections 2024-09-10T08:40:48.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.679+0000 7f50e5a00640 1 -- 172.21.15.52:0/550981661 wait complete. 2024-09-10T08:40:48.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.680+0000 7f50e5a00640 1 Processor -- start 2024-09-10T08:40:48.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.680+0000 7f50e5a00640 1 -- start start 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e006c150 0x7f50e015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e013eb20 0x7f50e015e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50e015c7d0 con 0x7f50e00b2d40 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50e015c650 con 0x7f50e013eb20 2024-09-10T08:40:48.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50e5a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50e0072650 con 0x7f50e006c150 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.681+0000 7f50de000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53798/0 (socket says 172.21.15.52:53798) 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 -- 172.21.15.52:0/4235372335 learned_addr learned my addr 172.21.15.52:0/4235372335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50df400640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e013eb20 0x7f50e015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50dea00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e006c150 0x7f50e015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 -- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e006c150 msgr2=0x7f50e015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e006c150 0x7f50e015f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 -- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e013eb20 msgr2=0x7f50e015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e013eb20 0x7f50e015e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 -- 172.21.15.52:0/4235372335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e00b5140 con 0x7f50e00b2d40 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.682+0000 7f50de000640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c3f0 tx=0x7f50cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.683+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc017070 con 0x7f50e00b2d40 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.683+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc0052f0 con 0x7f50e00b2d40 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.683+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc003830 con 0x7f50e00b2d40 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.683+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e00b5420 con 0x7f50e00b2d40 2024-09-10T08:40:48.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.683+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e015fde0 con 0x7f50e00b2d40 2024-09-10T08:40:48.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.684+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e006bc10 con 0x7f50e00b2d40 2024-09-10T08:40:48.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.685+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50cc01a070 con 0x7f50e00b2d40 2024-09-10T08:40:48.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.686+0000 7f50d6a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:48.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.686+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f50cc08a270 con 0x7f50e00b2d40 2024-09-10T08:40:48.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.686+0000 7f50dea00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:48.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.687+0000 7f50dea00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 0x7f50c006e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f50d0034000 tx=0x7f50d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:48.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.690+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50cc0585f0 con 0x7f50e00b2d40 2024-09-10T08:40:48.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.869+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50e013f080 con 0x7f50c006be30 2024-09-10T08:40:48.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.875+0000 7f50d6a00640 1 -- 172.21.15.52:0/4235372335 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252434 (secure 0 0 0) 0x7f50e013f080 con 0x7f50c006be30 2024-09-10T08:40:48.879 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:48.880 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 msgr2=0x7f50c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 0x7f50c006e2f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f50d0034000 tx=0x7f50d002e000 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 msgr2=0x7f50e015cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c3f0 tx=0x7f50cc00c8b0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 shutdown_connections 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e013eb20 0x7f50e015e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e00b2d40 0x7f50e015cb70 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 --2- 172.21.15.52:0/4235372335 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e006c150 0x7f50e015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 >> 172.21.15.52:0/4235372335 conn(0x7f50e00ccec0 msgr2=0x7f50e01580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:48.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 shutdown_connections 2024-09-10T08:40:48.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:48.879+0000 7f50e5a00640 1 -- 172.21.15.52:0/4235372335 wait complete. 2024-09-10T08:40:48.896 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":531,"stamp":"2024-09-10T08:40:47.634679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":449340,"kb_used_data":17960,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754525380,"statfs":{"total":773094113280,"available":772633989120,"internally_reserved":0,"allocated":18391040,"data_stored":8729660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.053599"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777475+0000","last_change":"2024-09-10T08:40:39.611318+0000","last_active":"2024-09-10T08:40:40.777475+0000","last_peered":"2024-09-10T08:40:40.777475+0000","last_clean":"2024-09-10T08:40:40.777475+0000","last_became_active":"2024-09-10T08:40:39.611027+0000","last_became_peered":"2024-09-10T08:40:39.611027+0000","last_unstale":"2024-09-10T08:40:40.777475+0000","last_undegraded":"2024-09-10T08:40:40.777475+0000","last_fullsized":"2024-09-10T08:40:40.777475+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:54.499275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776929+0000","last_change":"2024-09-10T08:40:39.609260+0000","last_active":"2024-09-10T08:40:40.776929+0000","last_peered":"2024-09-10T08:40:40.776929+0000","last_clean":"2024-09-10T08:40:40.776929+0000","last_became_active":"2024-09-10T08:40:39.608971+0000","last_became_peered":"2024-09-10T08:40:39.608971+0000","last_unstale":"2024-09-10T08:40:40.776929+0000","last_undegraded":"2024-09-10T08:40:40.776929+0000","last_fullsized":"2024-09-10T08:40:40.776929+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:28.242269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602435+0000","last_change":"2024-09-10T08:40:39.600427+0000","last_active":"2024-09-10T08:40:40.602435+0000","last_peered":"2024-09-10T08:40:40.602435+0000","last_clean":"2024-09-10T08:40:40.602435+0000","last_became_active":"2024-09-10T08:40:39.600133+0000","last_became_peered":"2024-09-10T08:40:39.600133+0000","last_unstale":"2024-09-10T08:40:40.602435+0000","last_undegraded":"2024-09-10T08:40:40.602435+0000","last_fullsized":"2024-09-10T08:40:40.602435+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:48:35.635382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776674+0000","last_change":"2024-09-10T08:40:39.605534+0000","last_active":"2024-09-10T08:40:40.776674+0000","last_peered":"2024-09-10T08:40:40.776674+0000","last_clean":"2024-09-10T08:40:40.776674+0000","last_became_active":"2024-09-10T08:40:39.605235+0000","last_became_peered":"2024-09-10T08:40:39.605235+0000","last_unstale":"2024-09-10T08:40:40.776674+0000","last_undegraded":"2024-09-10T08:40:40.776674+0000","last_fullsized":"2024-09-10T08:40:40.776674+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:55:30.125617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776356+0000","last_change":"2024-09-10T08:40:39.614794+0000","last_active":"2024-09-10T08:40:40.776356+0000","last_peered":"2024-09-10T08:40:40.776356+0000","last_clean":"2024-09-10T08:40:40.776356+0000","last_became_active":"2024-09-10T08:40:39.614532+0000","last_became_peered":"2024-09-10T08:40:39.614532+0000","last_unstale":"2024-09-10T08:40:40.776356+0000","last_undegraded":"2024-09-10T08:40:40.776356+0000","last_fullsized":"2024-09-10T08:40:40.776356+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:42.617055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601222+0000","last_change":"2024-09-10T08:40:39.601372+0000","last_active":"2024-09-10T08:40:40.601222+0000","last_peered":"2024-09-10T08:40:40.601222+0000","last_clean":"2024-09-10T08:40:40.601222+0000","last_became_active":"2024-09-10T08:40:39.600883+0000","last_became_peered":"2024-09-10T08:40:39.600883+0000","last_unstale":"2024-09-10T08:40:40.601222+0000","last_undegraded":"2024-09-10T08:40:40.601222+0000","last_fullsized":"2024-09-10T08:40:40.601222+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:45.563086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.595999+0000","last_change":"2024-09-10T08:40:39.594012+0000","last_active":"2024-09-10T08:40:40.595999+0000","last_peered":"2024-09-10T08:40:40.595999+0000","last_clean":"2024-09-10T08:40:40.595999+0000","last_became_active":"2024-09-10T08:40:39.593736+0000","last_became_peered":"2024-09-10T08:40:39.593736+0000","last_unstale":"2024-09-10T08:40:40.595999+0000","last_undegraded":"2024-09-10T08:40:40.595999+0000","last_fullsized":"2024-09-10T08:40:40.595999+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:31.760587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776081+0000","last_change":"2024-09-10T08:40:39.606793+0000","last_active":"2024-09-10T08:40:40.776081+0000","last_peered":"2024-09-10T08:40:40.776081+0000","last_clean":"2024-09-10T08:40:40.776081+0000","last_became_active":"2024-09-10T08:40:39.606321+0000","last_became_peered":"2024-09-10T08:40:39.606321+0000","last_unstale":"2024-09-10T08:40:40.776081+0000","last_undegraded":"2024-09-10T08:40:40.776081+0000","last_fullsized":"2024-09-10T08:40:40.776081+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:32.851653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776732+0000","last_change":"2024-09-10T08:40:39.607866+0000","last_active":"2024-09-10T08:40:40.776732+0000","last_peered":"2024-09-10T08:40:40.776732+0000","last_clean":"2024-09-10T08:40:40.776732+0000","last_became_active":"2024-09-10T08:40:39.607413+0000","last_became_peered":"2024-09-10T08:40:39.607413+0000","last_unstale":"2024-09-10T08:40:40.776732+0000","last_undegraded":"2024-09-10T08:40:40.776732+0000","last_fullsized":"2024-09-10T08:40:40.776732+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:16.200113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606793+0000","last_change":"2024-09-10T08:40:39.607709+0000","last_active":"2024-09-10T08:40:40.606793+0000","last_peered":"2024-09-10T08:40:40.606793+0000","last_clean":"2024-09-10T08:40:40.606793+0000","last_became_active":"2024-09-10T08:40:39.603723+0000","last_became_peered":"2024-09-10T08:40:39.603723+0000","last_unstale":"2024-09-10T08:40:40.606793+0000","last_undegraded":"2024-09-10T08:40:40.606793+0000","last_fullsized":"2024-09-10T08:40:40.606793+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:32.483663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777595+0000","last_change":"2024-09-10T08:40:39.607624+0000","last_active":"2024-09-10T08:40:40.777595+0000","last_peered":"2024-09-10T08:40:40.777595+0000","last_clean":"2024-09-10T08:40:40.777595+0000","last_became_active":"2024-09-10T08:40:39.607331+0000","last_became_peered":"2024-09-10T08:40:39.607331+0000","last_unstale":"2024-09-10T08:40:40.777595+0000","last_undegraded":"2024-09-10T08:40:40.777595+0000","last_fullsized":"2024-09-10T08:40:40.777595+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:36.690248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776113+0000","last_change":"2024-09-10T08:40:39.602367+0000","last_active":"2024-09-10T08:40:40.776113+0000","last_peered":"2024-09-10T08:40:40.776113+0000","last_clean":"2024-09-10T08:40:40.776113+0000","last_became_active":"2024-09-10T08:40:39.602061+0000","last_became_peered":"2024-09-10T08:40:39.602061+0000","last_unstale":"2024-09-10T08:40:40.776113+0000","last_undegraded":"2024-09-10T08:40:40.776113+0000","last_fullsized":"2024-09-10T08:40:40.776113+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:15:47.154878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777202+0000","last_change":"2024-09-10T08:40:39.606370+0000","last_active":"2024-09-10T08:40:40.777202+0000","last_peered":"2024-09-10T08:40:40.777202+0000","last_clean":"2024-09-10T08:40:40.777202+0000","last_became_active":"2024-09-10T08:40:39.606005+0000","last_became_peered":"2024-09-10T08:40:39.606005+0000","last_unstale":"2024-09-10T08:40:40.777202+0000","last_undegraded":"2024-09-10T08:40:40.777202+0000","last_fullsized":"2024-09-10T08:40:40.777202+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:00.592522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776400+0000","last_change":"2024-09-10T08:40:39.611415+0000","last_active":"2024-09-10T08:40:40.776400+0000","last_peered":"2024-09-10T08:40:40.776400+0000","last_clean":"2024-09-10T08:40:40.776400+0000","last_became_active":"2024-09-10T08:40:39.611117+0000","last_became_peered":"2024-09-10T08:40:39.611117+0000","last_unstale":"2024-09-10T08:40:40.776400+0000","last_undegraded":"2024-09-10T08:40:40.776400+0000","last_fullsized":"2024-09-10T08:40:40.776400+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:28.830604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777191+0000","last_change":"2024-09-10T08:40:39.612070+0000","last_active":"2024-09-10T08:40:40.777191+0000","last_peered":"2024-09-10T08:40:40.777191+0000","last_clean":"2024-09-10T08:40:40.777191+0000","last_became_active":"2024-09-10T08:40:39.611186+0000","last_became_peered":"2024-09-10T08:40:39.611186+0000","last_unstale":"2024-09-10T08:40:40.777191+0000","last_undegraded":"2024-09-10T08:40:40.777191+0000","last_fullsized":"2024-09-10T08:40:40.777191+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:50:12.210447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601529+0000","last_change":"2024-09-10T08:40:39.589436+0000","last_active":"2024-09-10T08:40:40.601529+0000","last_peered":"2024-09-10T08:40:40.601529+0000","last_clean":"2024-09-10T08:40:40.601529+0000","last_became_active":"2024-09-10T08:40:39.589156+0000","last_became_peered":"2024-09-10T08:40:39.589156+0000","last_unstale":"2024-09-10T08:40:40.601529+0000","last_undegraded":"2024-09-10T08:40:40.601529+0000","last_fullsized":"2024-09-10T08:40:40.601529+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:05:04.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602357+0000","last_change":"2024-09-10T08:40:39.606371+0000","last_active":"2024-09-10T08:40:40.602357+0000","last_peered":"2024-09-10T08:40:40.602357+0000","last_clean":"2024-09-10T08:40:40.602357+0000","last_became_active":"2024-09-10T08:40:39.606096+0000","last_became_peered":"2024-09-10T08:40:39.606096+0000","last_unstale":"2024-09-10T08:40:40.602357+0000","last_undegraded":"2024-09-10T08:40:40.602357+0000","last_fullsized":"2024-09-10T08:40:40.602357+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:08:44.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.596374+0000","last_change":"2024-09-10T08:40:39.607991+0000","last_active":"2024-09-10T08:40:40.596374+0000","last_peered":"2024-09-10T08:40:40.596374+0000","last_clean":"2024-09-10T08:40:40.596374+0000","last_became_active":"2024-09-10T08:40:39.607654+0000","last_became_peered":"2024-09-10T08:40:39.607654+0000","last_unstale":"2024-09-10T08:40:40.596374+0000","last_undegraded":"2024-09-10T08:40:40.596374+0000","last_fullsized":"2024-09-10T08:40:40.596374+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:29.129231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602101+0000","last_change":"2024-09-10T08:40:39.589774+0000","last_active":"2024-09-10T08:40:40.602101+0000","last_peered":"2024-09-10T08:40:40.602101+0000","last_clean":"2024-09-10T08:40:40.602101+0000","last_became_active":"2024-09-10T08:40:39.589331+0000","last_became_peered":"2024-09-10T08:40:39.589331+0000","last_unstale":"2024-09-10T08:40:40.602101+0000","last_undegraded":"2024-09-10T08:40:40.602101+0000","last_fullsized":"2024-09-10T08:40:40.602101+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:30.896634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776806+0000","last_change":"2024-09-10T08:40:39.602035+0000","last_active":"2024-09-10T08:40:40.776806+0000","last_peered":"2024-09-10T08:40:40.776806+0000","last_clean":"2024-09-10T08:40:40.776806+0000","last_became_active":"2024-09-10T08:40:39.601010+0000","last_became_peered":"2024-09-10T08:40:39.601010+0000","last_unstale":"2024-09-10T08:40:40.776806+0000","last_undegraded":"2024-09-10T08:40:40.776806+0000","last_fullsized":"2024-09-10T08:40:40.776806+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:31.760587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602187+0000","last_change":"2024-09-10T08:40:39.587634+0000","last_active":"2024-09-10T08:40:40.602187+0000","last_peered":"2024-09-10T08:40:40.602187+0000","last_clean":"2024-09-10T08:40:40.602187+0000","last_became_active":"2024-09-10T08:40:39.587081+0000","last_became_peered":"2024-09-10T08:40:39.587081+0000","last_unstale":"2024-09-10T08:40:40.602187+0000","last_undegraded":"2024-09-10T08:40:40.602187+0000","last_fullsized":"2024-09-10T08:40:40.602187+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:10.700669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776518+0000","last_change":"2024-09-10T08:40:39.602559+0000","last_active":"2024-09-10T08:40:40.776518+0000","last_peered":"2024-09-10T08:40:40.776518+0000","last_clean":"2024-09-10T08:40:40.776518+0000","last_became_active":"2024-09-10T08:40:39.601707+0000","last_became_peered":"2024-09-10T08:40:39.601707+0000","last_unstale":"2024-09-10T08:40:40.776518+0000","last_undegraded":"2024-09-10T08:40:40.776518+0000","last_fullsized":"2024-09-10T08:40:40.776518+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606479+0000","last_change":"2024-09-10T08:40:39.606541+0000","last_active":"2024-09-10T08:40:40.606479+0000","last_peered":"2024-09-10T08:40:40.606479+0000","last_clean":"2024-09-10T08:40:40.606479+0000","last_became_active":"2024-09-10T08:40:39.605678+0000","last_became_peered":"2024-09-10T08:40:39.605678+0000","last_unstale":"2024-09-10T08:40:40.606479+0000","last_undegraded":"2024-09-10T08:40:40.606479+0000","last_fullsized":"2024-09-10T08:40:40.606479+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:45.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776115+0000","last_change":"2024-09-10T08:40:39.607744+0000","last_active":"2024-09-10T08:40:40.776115+0000","last_peered":"2024-09-10T08:40:40.776115+0000","last_clean":"2024-09-10T08:40:40.776115+0000","last_became_active":"2024-09-10T08:40:39.604829+0000","last_became_peered":"2024-09-10T08:40:39.604829+0000","last_unstale":"2024-09-10T08:40:40.776115+0000","last_undegraded":"2024-09-10T08:40:40.776115+0000","last_fullsized":"2024-09-10T08:40:40.776115+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:34:25.399740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776885+0000","last_change":"2024-09-10T08:40:39.607658+0000","last_active":"2024-09-10T08:40:40.776885+0000","last_peered":"2024-09-10T08:40:40.776885+0000","last_clean":"2024-09-10T08:40:40.776885+0000","last_became_active":"2024-09-10T08:40:39.607088+0000","last_became_peered":"2024-09-10T08:40:39.607088+0000","last_unstale":"2024-09-10T08:40:40.776885+0000","last_undegraded":"2024-09-10T08:40:40.776885+0000","last_fullsized":"2024-09-10T08:40:40.776885+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:09.346444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776331+0000","last_change":"2024-09-10T08:40:39.590285+0000","last_active":"2024-09-10T08:40:40.776331+0000","last_peered":"2024-09-10T08:40:40.776331+0000","last_clean":"2024-09-10T08:40:40.776331+0000","last_became_active":"2024-09-10T08:40:39.588993+0000","last_became_peered":"2024-09-10T08:40:39.588993+0000","last_unstale":"2024-09-10T08:40:40.776331+0000","last_undegraded":"2024-09-10T08:40:40.776331+0000","last_fullsized":"2024-09-10T08:40:40.776331+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:24.778080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602252+0000","last_change":"2024-09-10T08:40:39.589791+0000","last_active":"2024-09-10T08:40:40.602252+0000","last_peered":"2024-09-10T08:40:40.602252+0000","last_clean":"2024-09-10T08:40:40.602252+0000","last_became_active":"2024-09-10T08:40:39.589343+0000","last_became_peered":"2024-09-10T08:40:39.589343+0000","last_unstale":"2024-09-10T08:40:40.602252+0000","last_undegraded":"2024-09-10T08:40:40.602252+0000","last_fullsized":"2024-09-10T08:40:40.602252+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:11:31.761332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606619+0000","last_change":"2024-09-10T08:40:39.610193+0000","last_active":"2024-09-10T08:40:40.606619+0000","last_peered":"2024-09-10T08:40:40.606619+0000","last_clean":"2024-09-10T08:40:40.606619+0000","last_became_active":"2024-09-10T08:40:39.609275+0000","last_became_peered":"2024-09-10T08:40:39.609275+0000","last_unstale":"2024-09-10T08:40:40.606619+0000","last_undegraded":"2024-09-10T08:40:40.606619+0000","last_fullsized":"2024-09-10T08:40:40.606619+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775720+0000","last_change":"2024-09-10T08:40:39.610728+0000","last_active":"2024-09-10T08:40:40.775720+0000","last_peered":"2024-09-10T08:40:40.775720+0000","last_clean":"2024-09-10T08:40:40.775720+0000","last_became_active":"2024-09-10T08:40:39.609408+0000","last_became_peered":"2024-09-10T08:40:39.609408+0000","last_unstale":"2024-09-10T08:40:40.775720+0000","last_undegraded":"2024-09-10T08:40:40.775720+0000","last_fullsized":"2024-09-10T08:40:40.775720+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:34:44.678749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775680+0000","last_change":"2024-09-10T08:40:39.589135+0000","last_active":"2024-09-10T08:40:40.775680+0000","last_peered":"2024-09-10T08:40:40.775680+0000","last_clean":"2024-09-10T08:40:40.775680+0000","last_became_active":"2024-09-10T08:40:39.588819+0000","last_became_peered":"2024-09-10T08:40:39.588819+0000","last_unstale":"2024-09-10T08:40:40.775680+0000","last_undegraded":"2024-09-10T08:40:40.775680+0000","last_fullsized":"2024-09-10T08:40:40.775680+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:56.901184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776115+0000","last_change":"2024-09-10T08:40:39.597382+0000","last_active":"2024-09-10T08:40:40.776115+0000","last_peered":"2024-09-10T08:40:40.776115+0000","last_clean":"2024-09-10T08:40:40.776115+0000","last_became_active":"2024-09-10T08:40:39.597095+0000","last_became_peered":"2024-09-10T08:40:39.597095+0000","last_unstale":"2024-09-10T08:40:40.776115+0000","last_undegraded":"2024-09-10T08:40:40.776115+0000","last_fullsized":"2024-09-10T08:40:40.776115+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:30.447019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776648+0000","last_change":"2024-09-10T08:40:39.615657+0000","last_active":"2024-09-10T08:40:40.776648+0000","last_peered":"2024-09-10T08:40:40.776648+0000","last_clean":"2024-09-10T08:40:40.776648+0000","last_became_active":"2024-09-10T08:40:39.615390+0000","last_became_peered":"2024-09-10T08:40:39.615390+0000","last_unstale":"2024-09-10T08:40:40.776648+0000","last_undegraded":"2024-09-10T08:40:40.776648+0000","last_fullsized":"2024-09-10T08:40:40.776648+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776427+0000","last_change":"2024-09-10T08:40:39.603264+0000","last_active":"2024-09-10T08:40:40.776427+0000","last_peered":"2024-09-10T08:40:40.776427+0000","last_clean":"2024-09-10T08:40:40.776427+0000","last_became_active":"2024-09-10T08:40:39.602001+0000","last_became_peered":"2024-09-10T08:40:39.602001+0000","last_unstale":"2024-09-10T08:40:40.776427+0000","last_undegraded":"2024-09-10T08:40:40.776427+0000","last_fullsized":"2024-09-10T08:40:40.776427+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"170'4","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602618+0000","last_change":"2024-09-10T08:40:38.604785+0000","last_active":"2024-09-10T08:40:40.602618+0000","last_peered":"2024-09-10T08:40:40.602618+0000","last_clean":"2024-09-10T08:40:40.602618+0000","last_became_active":"2024-09-10T08:40:38.604514+0000","last_became_peered":"2024-09-10T08:40:38.604514+0000","last_unstale":"2024-09-10T08:40:40.602618+0000","last_undegraded":"2024-09-10T08:40:40.602618+0000","last_fullsized":"2024-09-10T08:40:40.602618+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:10.167266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606944+0000","last_change":"2024-09-10T08:40:39.607215+0000","last_active":"2024-09-10T08:40:40.606944+0000","last_peered":"2024-09-10T08:40:40.606944+0000","last_clean":"2024-09-10T08:40:40.606944+0000","last_became_active":"2024-09-10T08:40:39.606858+0000","last_became_peered":"2024-09-10T08:40:39.606858+0000","last_unstale":"2024-09-10T08:40:40.606944+0000","last_undegraded":"2024-09-10T08:40:40.606944+0000","last_fullsized":"2024-09-10T08:40:40.606944+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:29.129231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776425+0000","last_change":"2024-09-10T08:40:38.603266+0000","last_active":"2024-09-10T08:40:40.776425+0000","last_peered":"2024-09-10T08:40:40.776425+0000","last_clean":"2024-09-10T08:40:40.776425+0000","last_became_active":"2024-09-10T08:40:38.602932+0000","last_became_peered":"2024-09-10T08:40:38.602932+0000","last_unstale":"2024-09-10T08:40:40.776425+0000","last_undegraded":"2024-09-10T08:40:40.776425+0000","last_fullsized":"2024-09-10T08:40:40.776425+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:02.782228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776908+0000","last_change":"2024-09-10T08:40:39.609371+0000","last_active":"2024-09-10T08:40:40.776908+0000","last_peered":"2024-09-10T08:40:40.776908+0000","last_clean":"2024-09-10T08:40:40.776908+0000","last_became_active":"2024-09-10T08:40:39.609083+0000","last_became_peered":"2024-09-10T08:40:39.609083+0000","last_unstale":"2024-09-10T08:40:40.776908+0000","last_undegraded":"2024-09-10T08:40:40.776908+0000","last_fullsized":"2024-09-10T08:40:40.776908+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:37:20.060698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776626+0000","last_change":"2024-09-10T08:40:38.611280+0000","last_active":"2024-09-10T08:40:40.776626+0000","last_peered":"2024-09-10T08:40:40.776626+0000","last_clean":"2024-09-10T08:40:40.776626+0000","last_became_active":"2024-09-10T08:40:38.610992+0000","last_became_peered":"2024-09-10T08:40:38.610992+0000","last_unstale":"2024-09-10T08:40:40.776626+0000","last_undegraded":"2024-09-10T08:40:40.776626+0000","last_fullsized":"2024-09-10T08:40:40.776626+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:52.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776753+0000","last_change":"2024-09-10T08:40:39.608923+0000","last_active":"2024-09-10T08:40:40.776753+0000","last_peered":"2024-09-10T08:40:40.776753+0000","last_clean":"2024-09-10T08:40:40.776753+0000","last_became_active":"2024-09-10T08:40:39.608659+0000","last_became_peered":"2024-09-10T08:40:39.608659+0000","last_unstale":"2024-09-10T08:40:40.776753+0000","last_undegraded":"2024-09-10T08:40:40.776753+0000","last_fullsized":"2024-09-10T08:40:40.776753+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:36.684748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776335+0000","last_change":"2024-09-10T08:40:38.603525+0000","last_active":"2024-09-10T08:40:40.776335+0000","last_peered":"2024-09-10T08:40:40.776335+0000","last_clean":"2024-09-10T08:40:40.776335+0000","last_became_active":"2024-09-10T08:40:38.603260+0000","last_became_peered":"2024-09-10T08:40:38.603260+0000","last_unstale":"2024-09-10T08:40:40.776335+0000","last_undegraded":"2024-09-10T08:40:40.776335+0000","last_fullsized":"2024-09-10T08:40:40.776335+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:55.827552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601400+0000","last_change":"2024-09-10T08:40:39.601136+0000","last_active":"2024-09-10T08:40:40.601400+0000","last_peered":"2024-09-10T08:40:40.601400+0000","last_clean":"2024-09-10T08:40:40.601400+0000","last_became_active":"2024-09-10T08:40:39.600532+0000","last_became_peered":"2024-09-10T08:40:39.600532+0000","last_unstale":"2024-09-10T08:40:40.601400+0000","last_undegraded":"2024-09-10T08:40:40.601400+0000","last_fullsized":"2024-09-10T08:40:40.601400+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:47.149864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776830+0000","last_change":"2024-09-10T08:40:38.610462+0000","last_active":"2024-09-10T08:40:40.776830+0000","last_peered":"2024-09-10T08:40:40.776830+0000","last_clean":"2024-09-10T08:40:40.776830+0000","last_became_active":"2024-09-10T08:40:38.610181+0000","last_became_peered":"2024-09-10T08:40:38.610181+0000","last_unstale":"2024-09-10T08:40:40.776830+0000","last_undegraded":"2024-09-10T08:40:40.776830+0000","last_fullsized":"2024-09-10T08:40:40.776830+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:40.925346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776609+0000","last_change":"2024-09-10T08:40:39.615214+0000","last_active":"2024-09-10T08:40:40.776609+0000","last_peered":"2024-09-10T08:40:40.776609+0000","last_clean":"2024-09-10T08:40:40.776609+0000","last_became_active":"2024-09-10T08:40:39.614895+0000","last_became_peered":"2024-09-10T08:40:39.614895+0000","last_unstale":"2024-09-10T08:40:40.776609+0000","last_undegraded":"2024-09-10T08:40:40.776609+0000","last_fullsized":"2024-09-10T08:40:40.776609+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:03.818697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776683+0000","last_change":"2024-09-10T08:40:38.608616+0000","last_active":"2024-09-10T08:40:40.776683+0000","last_peered":"2024-09-10T08:40:40.776683+0000","last_clean":"2024-09-10T08:40:40.776683+0000","last_became_active":"2024-09-10T08:40:38.608335+0000","last_became_peered":"2024-09-10T08:40:38.608335+0000","last_unstale":"2024-09-10T08:40:40.776683+0000","last_undegraded":"2024-09-10T08:40:40.776683+0000","last_fullsized":"2024-09-10T08:40:40.776683+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:01.508308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777235+0000","last_change":"2024-09-10T08:40:39.600898+0000","last_active":"2024-09-10T08:40:40.777235+0000","last_peered":"2024-09-10T08:40:40.777235+0000","last_clean":"2024-09-10T08:40:40.777235+0000","last_became_active":"2024-09-10T08:40:39.600580+0000","last_became_peered":"2024-09-10T08:40:39.600580+0000","last_unstale":"2024-09-10T08:40:40.777235+0000","last_undegraded":"2024-09-10T08:40:40.777235+0000","last_fullsized":"2024-09-10T08:40:40.777235+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:50:06.415244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.595844+0000","last_change":"2024-09-10T08:40:38.602353+0000","last_active":"2024-09-10T08:40:40.595844+0000","last_peered":"2024-09-10T08:40:40.595844+0000","last_clean":"2024-09-10T08:40:40.595844+0000","last_became_active":"2024-09-10T08:40:38.601969+0000","last_became_peered":"2024-09-10T08:40:38.601969+0000","last_unstale":"2024-09-10T08:40:40.595844+0000","last_undegraded":"2024-09-10T08:40:40.595844+0000","last_fullsized":"2024-09-10T08:40:40.595844+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.613667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602540+0000","last_change":"2024-09-10T08:40:39.591836+0000","last_active":"2024-09-10T08:40:40.602540+0000","last_peered":"2024-09-10T08:40:40.602540+0000","last_clean":"2024-09-10T08:40:40.602540+0000","last_became_active":"2024-09-10T08:40:39.591449+0000","last_became_peered":"2024-09-10T08:40:39.591449+0000","last_unstale":"2024-09-10T08:40:40.602540+0000","last_undegraded":"2024-09-10T08:40:40.602540+0000","last_fullsized":"2024-09-10T08:40:40.602540+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:24:08.475156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777561+0000","last_change":"2024-09-10T08:40:38.606684+0000","last_active":"2024-09-10T08:40:40.777561+0000","last_peered":"2024-09-10T08:40:40.777561+0000","last_clean":"2024-09-10T08:40:40.777561+0000","last_became_active":"2024-09-10T08:40:38.606419+0000","last_became_peered":"2024-09-10T08:40:38.606419+0000","last_unstale":"2024-09-10T08:40:40.777561+0000","last_undegraded":"2024-09-10T08:40:40.777561+0000","last_fullsized":"2024-09-10T08:40:40.777561+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:58.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606926+0000","last_change":"2024-09-10T08:40:39.608373+0000","last_active":"2024-09-10T08:40:40.606926+0000","last_peered":"2024-09-10T08:40:40.606926+0000","last_clean":"2024-09-10T08:40:40.606926+0000","last_became_active":"2024-09-10T08:40:39.607215+0000","last_became_peered":"2024-09-10T08:40:39.607215+0000","last_unstale":"2024-09-10T08:40:40.606926+0000","last_undegraded":"2024-09-10T08:40:40.606926+0000","last_fullsized":"2024-09-10T08:40:40.606926+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:08.851894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606881+0000","last_change":"2024-09-10T08:40:38.602257+0000","last_active":"2024-09-10T08:40:40.606881+0000","last_peered":"2024-09-10T08:40:40.606881+0000","last_clean":"2024-09-10T08:40:40.606881+0000","last_became_active":"2024-09-10T08:40:38.600878+0000","last_became_peered":"2024-09-10T08:40:38.600878+0000","last_unstale":"2024-09-10T08:40:40.606881+0000","last_undegraded":"2024-09-10T08:40:40.606881+0000","last_fullsized":"2024-09-10T08:40:40.606881+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:16.094429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776251+0000","last_change":"2024-09-10T08:40:39.590087+0000","last_active":"2024-09-10T08:40:40.776251+0000","last_peered":"2024-09-10T08:40:40.776251+0000","last_clean":"2024-09-10T08:40:40.776251+0000","last_became_active":"2024-09-10T08:40:39.589804+0000","last_became_peered":"2024-09-10T08:40:39.589804+0000","last_unstale":"2024-09-10T08:40:40.776251+0000","last_undegraded":"2024-09-10T08:40:40.776251+0000","last_fullsized":"2024-09-10T08:40:40.776251+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:36.227456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"170'3","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776782+0000","last_change":"2024-09-10T08:40:38.609058+0000","last_active":"2024-09-10T08:40:40.776782+0000","last_peered":"2024-09-10T08:40:40.776782+0000","last_clean":"2024-09-10T08:40:40.776782+0000","last_became_active":"2024-09-10T08:40:38.608401+0000","last_became_peered":"2024-09-10T08:40:38.608401+0000","last_unstale":"2024-09-10T08:40:40.776782+0000","last_undegraded":"2024-09-10T08:40:40.776782+0000","last_fullsized":"2024-09-10T08:40:40.776782+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:32:55.897796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606740+0000","last_change":"2024-09-10T08:40:39.605532+0000","last_active":"2024-09-10T08:40:40.606740+0000","last_peered":"2024-09-10T08:40:40.606740+0000","last_clean":"2024-09-10T08:40:40.606740+0000","last_became_active":"2024-09-10T08:40:39.605078+0000","last_became_peered":"2024-09-10T08:40:39.605078+0000","last_unstale":"2024-09-10T08:40:40.606740+0000","last_undegraded":"2024-09-10T08:40:40.606740+0000","last_fullsized":"2024-09-10T08:40:40.606740+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:59.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"170'6","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776412+0000","last_change":"2024-09-10T08:40:38.609036+0000","last_active":"2024-09-10T08:40:40.776412+0000","last_peered":"2024-09-10T08:40:40.776412+0000","last_clean":"2024-09-10T08:40:40.776412+0000","last_became_active":"2024-09-10T08:40:38.608738+0000","last_became_peered":"2024-09-10T08:40:38.608738+0000","last_unstale":"2024-09-10T08:40:40.776412+0000","last_undegraded":"2024-09-10T08:40:40.776412+0000","last_fullsized":"2024-09-10T08:40:40.776412+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:47.126499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606499+0000","last_change":"2024-09-10T08:40:39.605430+0000","last_active":"2024-09-10T08:40:40.606499+0000","last_peered":"2024-09-10T08:40:40.606499+0000","last_clean":"2024-09-10T08:40:40.606499+0000","last_became_active":"2024-09-10T08:40:39.603647+0000","last_became_peered":"2024-09-10T08:40:39.603647+0000","last_unstale":"2024-09-10T08:40:40.606499+0000","last_undegraded":"2024-09-10T08:40:40.606499+0000","last_fullsized":"2024-09-10T08:40:40.606499+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:52.849484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776015+0000","last_change":"2024-09-10T08:40:38.608957+0000","last_active":"2024-09-10T08:40:40.776015+0000","last_peered":"2024-09-10T08:40:40.776015+0000","last_clean":"2024-09-10T08:40:40.776015+0000","last_became_active":"2024-09-10T08:40:38.608520+0000","last_became_peered":"2024-09-10T08:40:38.608520+0000","last_unstale":"2024-09-10T08:40:40.776015+0000","last_undegraded":"2024-09-10T08:40:40.776015+0000","last_fullsized":"2024-09-10T08:40:40.776015+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:05.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.596127+0000","last_change":"2024-09-10T08:40:39.596837+0000","last_active":"2024-09-10T08:40:40.596127+0000","last_peered":"2024-09-10T08:40:40.596127+0000","last_clean":"2024-09-10T08:40:40.596127+0000","last_became_active":"2024-09-10T08:40:39.596457+0000","last_became_peered":"2024-09-10T08:40:39.596457+0000","last_unstale":"2024-09-10T08:40:40.596127+0000","last_undegraded":"2024-09-10T08:40:40.596127+0000","last_fullsized":"2024-09-10T08:40:40.596127+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:32.483663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606431+0000","last_change":"2024-09-10T08:40:38.599901+0000","last_active":"2024-09-10T08:40:40.606431+0000","last_peered":"2024-09-10T08:40:40.606431+0000","last_clean":"2024-09-10T08:40:40.606431+0000","last_became_active":"2024-09-10T08:40:38.599571+0000","last_became_peered":"2024-09-10T08:40:38.599571+0000","last_unstale":"2024-09-10T08:40:40.606431+0000","last_undegraded":"2024-09-10T08:40:40.606431+0000","last_fullsized":"2024-09-10T08:40:40.606431+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:05.993602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775713+0000","last_change":"2024-09-10T08:40:39.593816+0000","last_active":"2024-09-10T08:40:40.775713+0000","last_peered":"2024-09-10T08:40:40.775713+0000","last_clean":"2024-09-10T08:40:40.775713+0000","last_became_active":"2024-09-10T08:40:39.592965+0000","last_became_peered":"2024-09-10T08:40:39.592965+0000","last_unstale":"2024-09-10T08:40:40.775713+0000","last_undegraded":"2024-09-10T08:40:40.775713+0000","last_fullsized":"2024-09-10T08:40:40.775713+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:32.724926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776747+0000","last_change":"2024-09-10T08:40:38.606357+0000","last_active":"2024-09-10T08:40:40.776747+0000","last_peered":"2024-09-10T08:40:40.776747+0000","last_clean":"2024-09-10T08:40:40.776747+0000","last_became_active":"2024-09-10T08:40:38.606082+0000","last_became_peered":"2024-09-10T08:40:38.606082+0000","last_unstale":"2024-09-10T08:40:40.776747+0000","last_undegraded":"2024-09-10T08:40:40.776747+0000","last_fullsized":"2024-09-10T08:40:40.776747+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:06.238469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776255+0000","last_change":"2024-09-10T08:40:39.611019+0000","last_active":"2024-09-10T08:40:40.776255+0000","last_peered":"2024-09-10T08:40:40.776255+0000","last_clean":"2024-09-10T08:40:40.776255+0000","last_became_active":"2024-09-10T08:40:39.610479+0000","last_became_peered":"2024-09-10T08:40:39.610479+0000","last_unstale":"2024-09-10T08:40:40.776255+0000","last_undegraded":"2024-09-10T08:40:40.776255+0000","last_fullsized":"2024-09-10T08:40:40.776255+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:45.564647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"170'8","reported_seq":22,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.595903+0000","last_change":"2024-09-10T08:40:38.599942+0000","last_active":"2024-09-10T08:40:40.595903+0000","last_peered":"2024-09-10T08:40:40.595903+0000","last_clean":"2024-09-10T08:40:40.595903+0000","last_became_active":"2024-09-10T08:40:38.599603+0000","last_became_peered":"2024-09-10T08:40:38.599603+0000","last_unstale":"2024-09-10T08:40:40.595903+0000","last_undegraded":"2024-09-10T08:40:40.595903+0000","last_fullsized":"2024-09-10T08:40:40.595903+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:44.561259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606801+0000","last_change":"2024-09-10T08:40:39.608592+0000","last_active":"2024-09-10T08:40:40.606801+0000","last_peered":"2024-09-10T08:40:40.606801+0000","last_clean":"2024-09-10T08:40:40.606801+0000","last_became_active":"2024-09-10T08:40:39.603659+0000","last_became_peered":"2024-09-10T08:40:39.603659+0000","last_unstale":"2024-09-10T08:40:40.606801+0000","last_undegraded":"2024-09-10T08:40:40.606801+0000","last_fullsized":"2024-09-10T08:40:40.606801+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:07:31.760587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776628+0000","last_change":"2024-09-10T08:40:38.609734+0000","last_active":"2024-09-10T08:40:40.776628+0000","last_peered":"2024-09-10T08:40:40.776628+0000","last_clean":"2024-09-10T08:40:40.776628+0000","last_became_active":"2024-09-10T08:40:38.609463+0000","last_became_peered":"2024-09-10T08:40:38.609463+0000","last_unstale":"2024-09-10T08:40:40.776628+0000","last_undegraded":"2024-09-10T08:40:40.776628+0000","last_fullsized":"2024-09-10T08:40:40.776628+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:50:35.083024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777141+0000","last_change":"2024-09-10T08:40:39.597891+0000","last_active":"2024-09-10T08:40:40.777141+0000","last_peered":"2024-09-10T08:40:40.777141+0000","last_clean":"2024-09-10T08:40:40.777141+0000","last_became_active":"2024-09-10T08:40:39.597179+0000","last_became_peered":"2024-09-10T08:40:39.597179+0000","last_unstale":"2024-09-10T08:40:40.777141+0000","last_undegraded":"2024-09-10T08:40:40.777141+0000","last_fullsized":"2024-09-10T08:40:40.777141+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:26:17.097817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602264+0000","last_change":"2024-09-10T08:40:38.609455+0000","last_active":"2024-09-10T08:40:40.602264+0000","last_peered":"2024-09-10T08:40:40.602264+0000","last_clean":"2024-09-10T08:40:40.602264+0000","last_became_active":"2024-09-10T08:40:38.609193+0000","last_became_peered":"2024-09-10T08:40:38.609193+0000","last_unstale":"2024-09-10T08:40:40.602264+0000","last_undegraded":"2024-09-10T08:40:40.602264+0000","last_fullsized":"2024-09-10T08:40:40.602264+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:23.682321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777052+0000","last_change":"2024-09-10T08:40:39.604315+0000","last_active":"2024-09-10T08:40:40.777052+0000","last_peered":"2024-09-10T08:40:40.777052+0000","last_clean":"2024-09-10T08:40:40.777052+0000","last_became_active":"2024-09-10T08:40:39.603974+0000","last_became_peered":"2024-09-10T08:40:39.603974+0000","last_unstale":"2024-09-10T08:40:40.777052+0000","last_undegraded":"2024-09-10T08:40:40.777052+0000","last_fullsized":"2024-09-10T08:40:40.777052+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:28:55.562256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"170'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777693+0000","last_change":"2024-09-10T08:40:38.604618+0000","last_active":"2024-09-10T08:40:40.777693+0000","last_peered":"2024-09-10T08:40:40.777693+0000","last_clean":"2024-09-10T08:40:40.777693+0000","last_became_active":"2024-09-10T08:40:38.603739+0000","last_became_peered":"2024-09-10T08:40:38.603739+0000","last_unstale":"2024-09-10T08:40:40.777693+0000","last_undegraded":"2024-09-10T08:40:40.777693+0000","last_fullsized":"2024-09-10T08:40:40.777693+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:18.461479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776222+0000","last_change":"2024-09-10T08:40:39.591588+0000","last_active":"2024-09-10T08:40:40.776222+0000","last_peered":"2024-09-10T08:40:40.776222+0000","last_clean":"2024-09-10T08:40:40.776222+0000","last_became_active":"2024-09-10T08:40:39.591319+0000","last_became_peered":"2024-09-10T08:40:39.591319+0000","last_unstale":"2024-09-10T08:40:40.776222+0000","last_undegraded":"2024-09-10T08:40:40.776222+0000","last_fullsized":"2024-09-10T08:40:40.776222+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:18.989959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777351+0000","last_change":"2024-09-10T08:40:38.607426+0000","last_active":"2024-09-10T08:40:40.777351+0000","last_peered":"2024-09-10T08:40:40.777351+0000","last_clean":"2024-09-10T08:40:40.777351+0000","last_became_active":"2024-09-10T08:40:38.606843+0000","last_became_peered":"2024-09-10T08:40:38.606843+0000","last_unstale":"2024-09-10T08:40:40.777351+0000","last_undegraded":"2024-09-10T08:40:40.777351+0000","last_fullsized":"2024-09-10T08:40:40.777351+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:12.746003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601685+0000","last_change":"2024-09-10T08:40:39.595611+0000","last_active":"2024-09-10T08:40:40.601685+0000","last_peered":"2024-09-10T08:40:40.601685+0000","last_clean":"2024-09-10T08:40:40.601685+0000","last_became_active":"2024-09-10T08:40:39.593091+0000","last_became_peered":"2024-09-10T08:40:39.593091+0000","last_unstale":"2024-09-10T08:40:40.601685+0000","last_undegraded":"2024-09-10T08:40:40.601685+0000","last_fullsized":"2024-09-10T08:40:40.601685+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:00:13.749391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776854+0000","last_change":"2024-09-10T08:40:38.612800+0000","last_active":"2024-09-10T08:40:40.776854+0000","last_peered":"2024-09-10T08:40:40.776854+0000","last_clean":"2024-09-10T08:40:40.776854+0000","last_became_active":"2024-09-10T08:40:38.612501+0000","last_became_peered":"2024-09-10T08:40:38.612501+0000","last_unstale":"2024-09-10T08:40:40.776854+0000","last_undegraded":"2024-09-10T08:40:40.776854+0000","last_fullsized":"2024-09-10T08:40:40.776854+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:17.618725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.596152+0000","last_change":"2024-09-10T08:40:39.607946+0000","last_active":"2024-09-10T08:40:40.596152+0000","last_peered":"2024-09-10T08:40:40.596152+0000","last_clean":"2024-09-10T08:40:40.596152+0000","last_became_active":"2024-09-10T08:40:39.607670+0000","last_became_peered":"2024-09-10T08:40:39.607670+0000","last_unstale":"2024-09-10T08:40:40.596152+0000","last_undegraded":"2024-09-10T08:40:40.596152+0000","last_fullsized":"2024-09-10T08:40:40.596152+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:08.851894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601795+0000","last_change":"2024-09-10T08:40:38.609194+0000","last_active":"2024-09-10T08:40:40.601795+0000","last_peered":"2024-09-10T08:40:40.601795+0000","last_clean":"2024-09-10T08:40:40.601795+0000","last_became_active":"2024-09-10T08:40:38.608754+0000","last_became_peered":"2024-09-10T08:40:38.608754+0000","last_unstale":"2024-09-10T08:40:40.601795+0000","last_undegraded":"2024-09-10T08:40:40.601795+0000","last_fullsized":"2024-09-10T08:40:40.601795+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:26.065351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775949+0000","last_change":"2024-09-10T08:40:39.597582+0000","last_active":"2024-09-10T08:40:40.775949+0000","last_peered":"2024-09-10T08:40:40.775949+0000","last_clean":"2024-09-10T08:40:40.775949+0000","last_became_active":"2024-09-10T08:40:39.597309+0000","last_became_peered":"2024-09-10T08:40:39.597309+0000","last_unstale":"2024-09-10T08:40:40.775949+0000","last_undegraded":"2024-09-10T08:40:40.775949+0000","last_fullsized":"2024-09-10T08:40:40.775949+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:45.693218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601168+0000","last_change":"2024-09-10T08:40:38.602833+0000","last_active":"2024-09-10T08:40:40.601168+0000","last_peered":"2024-09-10T08:40:40.601168+0000","last_clean":"2024-09-10T08:40:40.601168+0000","last_became_active":"2024-09-10T08:40:38.602520+0000","last_became_peered":"2024-09-10T08:40:38.602520+0000","last_unstale":"2024-09-10T08:40:40.601168+0000","last_undegraded":"2024-09-10T08:40:40.601168+0000","last_fullsized":"2024-09-10T08:40:40.601168+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:31.477687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.606506+0000","last_change":"2024-09-10T08:40:39.605369+0000","last_active":"2024-09-10T08:40:40.606506+0000","last_peered":"2024-09-10T08:40:40.606506+0000","last_clean":"2024-09-10T08:40:40.606506+0000","last_became_active":"2024-09-10T08:40:39.604880+0000","last_became_peered":"2024-09-10T08:40:39.604880+0000","last_unstale":"2024-09-10T08:40:40.606506+0000","last_undegraded":"2024-09-10T08:40:40.606506+0000","last_fullsized":"2024-09-10T08:40:40.606506+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:07.825781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776853+0000","last_change":"2024-09-10T08:40:38.602333+0000","last_active":"2024-09-10T08:40:40.776853+0000","last_peered":"2024-09-10T08:40:40.776853+0000","last_clean":"2024-09-10T08:40:40.776853+0000","last_became_active":"2024-09-10T08:40:38.599744+0000","last_became_peered":"2024-09-10T08:40:38.599744+0000","last_unstale":"2024-09-10T08:40:40.776853+0000","last_undegraded":"2024-09-10T08:40:40.776853+0000","last_fullsized":"2024-09-10T08:40:40.776853+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:42:44.559698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602535+0000","last_change":"2024-09-10T08:40:39.616505+0000","last_active":"2024-09-10T08:40:40.602535+0000","last_peered":"2024-09-10T08:40:40.602535+0000","last_clean":"2024-09-10T08:40:40.602535+0000","last_became_active":"2024-09-10T08:40:39.615880+0000","last_became_peered":"2024-09-10T08:40:39.615880+0000","last_unstale":"2024-09-10T08:40:40.602535+0000","last_undegraded":"2024-09-10T08:40:40.602535+0000","last_fullsized":"2024-09-10T08:40:40.602535+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:25.920948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"170'2","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777649+0000","last_change":"2024-09-10T08:40:38.611840+0000","last_active":"2024-09-10T08:40:40.777649+0000","last_peered":"2024-09-10T08:40:40.777649+0000","last_clean":"2024-09-10T08:40:40.777649+0000","last_became_active":"2024-09-10T08:40:38.611553+0000","last_became_peered":"2024-09-10T08:40:38.611553+0000","last_unstale":"2024-09-10T08:40:40.777649+0000","last_undegraded":"2024-09-10T08:40:40.777649+0000","last_fullsized":"2024-09-10T08:40:40.777649+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:21:46.146476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602642+0000","last_change":"2024-09-10T08:40:39.600821+0000","last_active":"2024-09-10T08:40:40.602642+0000","last_peered":"2024-09-10T08:40:40.602642+0000","last_clean":"2024-09-10T08:40:40.602642+0000","last_became_active":"2024-09-10T08:40:39.599580+0000","last_became_peered":"2024-09-10T08:40:39.599580+0000","last_unstale":"2024-09-10T08:40:40.602642+0000","last_undegraded":"2024-09-10T08:40:40.602642+0000","last_fullsized":"2024-09-10T08:40:40.602642+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:04:58.385199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"171'1","reported_seq":15,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602645+0000","last_change":"2024-09-10T08:40:38.606693+0000","last_active":"2024-09-10T08:40:40.602645+0000","last_peered":"2024-09-10T08:40:40.602645+0000","last_clean":"2024-09-10T08:40:40.602645+0000","last_became_active":"2024-09-10T08:40:38.605494+0000","last_became_peered":"2024-09-10T08:40:38.605494+0000","last_unstale":"2024-09-10T08:40:40.602645+0000","last_undegraded":"2024-09-10T08:40:40.602645+0000","last_fullsized":"2024-09-10T08:40:40.602645+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.759762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602079+0000","last_change":"2024-09-10T08:40:39.601073+0000","last_active":"2024-09-10T08:40:40.602079+0000","last_peered":"2024-09-10T08:40:40.602079+0000","last_clean":"2024-09-10T08:40:40.602079+0000","last_became_active":"2024-09-10T08:40:39.600338+0000","last_became_peered":"2024-09-10T08:40:39.600338+0000","last_unstale":"2024-09-10T08:40:40.602079+0000","last_undegraded":"2024-09-10T08:40:40.602079+0000","last_fullsized":"2024-09-10T08:40:40.602079+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:27:23.228066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.602349+0000","last_change":"2024-09-10T08:40:38.601853+0000","last_active":"2024-09-10T08:40:40.602349+0000","last_peered":"2024-09-10T08:40:40.602349+0000","last_clean":"2024-09-10T08:40:40.602349+0000","last_became_active":"2024-09-10T08:40:38.601534+0000","last_became_peered":"2024-09-10T08:40:38.601534+0000","last_unstale":"2024-09-10T08:40:40.602349+0000","last_undegraded":"2024-09-10T08:40:40.602349+0000","last_fullsized":"2024-09-10T08:40:40.602349+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:02.328186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776935+0000","last_change":"2024-09-10T08:40:39.614735+0000","last_active":"2024-09-10T08:40:40.776935+0000","last_peered":"2024-09-10T08:40:40.776935+0000","last_clean":"2024-09-10T08:40:40.776935+0000","last_became_active":"2024-09-10T08:40:39.614305+0000","last_became_peered":"2024-09-10T08:40:39.614305+0000","last_unstale":"2024-09-10T08:40:40.776935+0000","last_undegraded":"2024-09-10T08:40:40.776935+0000","last_fullsized":"2024-09-10T08:40:40.776935+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:06:08.851894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776539+0000","last_change":"2024-09-10T08:40:38.607592+0000","last_active":"2024-09-10T08:40:40.776539+0000","last_peered":"2024-09-10T08:40:40.776539+0000","last_clean":"2024-09-10T08:40:40.776539+0000","last_became_active":"2024-09-10T08:40:38.607327+0000","last_became_peered":"2024-09-10T08:40:38.607327+0000","last_unstale":"2024-09-10T08:40:40.776539+0000","last_undegraded":"2024-09-10T08:40:40.776539+0000","last_fullsized":"2024-09-10T08:40:40.776539+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:34.942146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776546+0000","last_change":"2024-09-10T08:40:39.605335+0000","last_active":"2024-09-10T08:40:40.776546+0000","last_peered":"2024-09-10T08:40:40.776546+0000","last_clean":"2024-09-10T08:40:40.776546+0000","last_became_active":"2024-09-10T08:40:39.605015+0000","last_became_peered":"2024-09-10T08:40:39.605015+0000","last_unstale":"2024-09-10T08:40:40.776546+0000","last_undegraded":"2024-09-10T08:40:40.776546+0000","last_fullsized":"2024-09-10T08:40:40.776546+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:24.841924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776699+0000","last_change":"2024-09-10T08:40:38.604528+0000","last_active":"2024-09-10T08:40:40.776699+0000","last_peered":"2024-09-10T08:40:40.776699+0000","last_clean":"2024-09-10T08:40:40.776699+0000","last_became_active":"2024-09-10T08:40:38.602419+0000","last_became_peered":"2024-09-10T08:40:38.602419+0000","last_unstale":"2024-09-10T08:40:40.776699+0000","last_undegraded":"2024-09-10T08:40:40.776699+0000","last_fullsized":"2024-09-10T08:40:40.776699+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:53.016826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.777353+0000","last_change":"2024-09-10T08:40:39.600972+0000","last_active":"2024-09-10T08:40:40.777353+0000","last_peered":"2024-09-10T08:40:40.777353+0000","last_clean":"2024-09-10T08:40:40.777353+0000","last_became_active":"2024-09-10T08:40:39.600696+0000","last_became_peered":"2024-09-10T08:40:39.600696+0000","last_unstale":"2024-09-10T08:40:40.777353+0000","last_undegraded":"2024-09-10T08:40:40.777353+0000","last_fullsized":"2024-09-10T08:40:40.777353+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:05.394144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776641+0000","last_change":"2024-09-10T08:40:38.598840+0000","last_active":"2024-09-10T08:40:40.776641+0000","last_peered":"2024-09-10T08:40:40.776641+0000","last_clean":"2024-09-10T08:40:40.776641+0000","last_became_active":"2024-09-10T08:40:38.598539+0000","last_became_peered":"2024-09-10T08:40:38.598539+0000","last_unstale":"2024-09-10T08:40:40.776641+0000","last_undegraded":"2024-09-10T08:40:40.776641+0000","last_fullsized":"2024-09-10T08:40:40.776641+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:40.709904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775967+0000","last_change":"2024-09-10T08:40:39.610363+0000","last_active":"2024-09-10T08:40:40.775967+0000","last_peered":"2024-09-10T08:40:40.775967+0000","last_clean":"2024-09-10T08:40:40.775967+0000","last_became_active":"2024-09-10T08:40:39.609936+0000","last_became_peered":"2024-09-10T08:40:39.609936+0000","last_unstale":"2024-09-10T08:40:40.775967+0000","last_undegraded":"2024-09-10T08:40:40.775967+0000","last_fullsized":"2024-09-10T08:40:40.775967+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:04.633507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776313+0000","last_change":"2024-09-10T08:40:38.600904+0000","last_active":"2024-09-10T08:40:40.776313+0000","last_peered":"2024-09-10T08:40:40.776313+0000","last_clean":"2024-09-10T08:40:40.776313+0000","last_became_active":"2024-09-10T08:40:38.600572+0000","last_became_peered":"2024-09-10T08:40:38.600572+0000","last_unstale":"2024-09-10T08:40:40.776313+0000","last_undegraded":"2024-09-10T08:40:40.776313+0000","last_fullsized":"2024-09-10T08:40:40.776313+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:16.573172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776362+0000","last_change":"2024-09-10T08:40:39.605511+0000","last_active":"2024-09-10T08:40:40.776362+0000","last_peered":"2024-09-10T08:40:40.776362+0000","last_clean":"2024-09-10T08:40:40.776362+0000","last_became_active":"2024-09-10T08:40:39.605208+0000","last_became_peered":"2024-09-10T08:40:39.605208+0000","last_unstale":"2024-09-10T08:40:40.776362+0000","last_undegraded":"2024-09-10T08:40:40.776362+0000","last_fullsized":"2024-09-10T08:40:40.776362+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:32.483663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601431+0000","last_change":"2024-09-10T08:40:38.607736+0000","last_active":"2024-09-10T08:40:40.601431+0000","last_peered":"2024-09-10T08:40:40.601431+0000","last_clean":"2024-09-10T08:40:40.601431+0000","last_became_active":"2024-09-10T08:40:38.607482+0000","last_became_peered":"2024-09-10T08:40:38.607482+0000","last_unstale":"2024-09-10T08:40:40.601431+0000","last_undegraded":"2024-09-10T08:40:40.601431+0000","last_fullsized":"2024-09-10T08:40:40.601431+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:19:25.625722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.601321+0000","last_change":"2024-09-10T08:40:39.589188+0000","last_active":"2024-09-10T08:40:40.601321+0000","last_peered":"2024-09-10T08:40:40.601321+0000","last_clean":"2024-09-10T08:40:40.601321+0000","last_became_active":"2024-09-10T08:40:39.588915+0000","last_became_peered":"2024-09-10T08:40:39.588915+0000","last_unstale":"2024-09-10T08:40:40.601321+0000","last_undegraded":"2024-09-10T08:40:40.601321+0000","last_fullsized":"2024-09-10T08:40:40.601321+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:38.576890+0000","last_clean_scrub_stamp":"2024-09-10T08:40:38.576890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:59.241203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.775722+0000","last_change":"2024-09-10T08:40:38.596603+0000","last_active":"2024-09-10T08:40:40.775722+0000","last_peered":"2024-09-10T08:40:40.775722+0000","last_clean":"2024-09-10T08:40:40.775722+0000","last_became_active":"2024-09-10T08:40:38.594989+0000","last_became_peered":"2024-09-10T08:40:38.594989+0000","last_unstale":"2024-09-10T08:40:40.775722+0000","last_undegraded":"2024-09-10T08:40:40.775722+0000","last_fullsized":"2024-09-10T08:40:40.775722+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:40:37.573502+0000","last_clean_scrub_stamp":"2024-09-10T08:40:37.573502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:13:52.691150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":444,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-10T08:40:40.776092+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:40:40.776092+0000","last_peered":"2024-09-10T08:40:40.776092+0000","last_clean":"2024-09-10T08:40:40.776092+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:40:40.776092+0000","last_undegraded":"2024-09-10T08:40:40.776092+0000","last_fullsized":"2024-09-10T08:40:40.776092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509589,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51352,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320488,"statfs":{"total":96636764160,"available":96584179712,"internally_reserved":0,"allocated":2162688,"data_stored":944737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509589,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55500,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316340,"statfs":{"total":96636764160,"available":96579932160,"internally_reserved":0,"allocated":2146304,"data_stored":943103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509588,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59656,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312184,"statfs":{"total":96636764160,"available":96575676416,"internally_reserved":0,"allocated":2146304,"data_stored":943047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509589,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2158592,"data_stored":944695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509590,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63820,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308020,"statfs":{"total":96636764160,"available":96571412480,"internally_reserved":0,"allocated":2146304,"data_stored":943083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509589,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60236,"kb_used_data":2672,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311604,"statfs":{"total":96636764160,"available":96575082496,"internally_reserved":0,"allocated":2736128,"data_stored":1533381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509591,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2150400,"data_stored":943629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542292,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56080,"kb_used_data":2680,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315760,"statfs":{"total":96636764160,"available":96579338240,"internally_reserved":0,"allocated":2744320,"data_stored":1533985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:40:48.901 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:40:48.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:40:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.099+0000 7efe24c00640 1 Processor -- start 2024-09-10T08:40:49.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.099+0000 7efe24c00640 1 -- start start 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.100+0000 7efe24c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe200d13a0 0x7efe200b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.100+0000 7efe24c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe200d3250 con 0x7efe2015e620 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.100+0000 7efe24c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe200b78b0 con 0x7efe200d0f60 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.100+0000 7efe24c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7efe200b7680 con 0x7efe200d13a0 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efe2015e620 0x7efe200d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46348/0 (socket says 172.21.15.52:46348) 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1f400640 1 -- 172.21.15.52:0/3646901080 learned_addr learned my addr 172.21.15.52:0/3646901080 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:49.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1fe00640 1 --2- 172.21.15.52:0/3646901080 >> v2:172.21.15.52:3300/0 conn(0x7efe200d13a0 0x7efe200b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1ea00640 1 -- 172.21.15.52:0/3646901080 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084463444 0 0) 0x7efe200d3250 con 0x7efe2015e620 2024-09-10T08:40:49.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1ea00640 1 -- 172.21.15.52:0/3646901080 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe04003520 con 0x7efe2015e620 2024-09-10T08:40:49.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1fe00640 1 -- 172.21.15.52:0/3646901080 >> v1:172.21.15.176:6789/0 conn(0x7efe200d0f60 legacy=0x7efe200b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1fe00640 1 -- 172.21.15.52:0/3646901080 >> v1:172.21.15.52:6789/0 conn(0x7efe2015e620 legacy=0x7efe200d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.101+0000 7efe1fe00640 1 -- 172.21.15.52:0/3646901080 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2015ea00 con 0x7efe200d13a0 2024-09-10T08:40:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.102+0000 7efe1fe00640 1 --2- 172.21.15.52:0/3646901080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe200d13a0 0x7efe200b8780 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7efe18009d90 tx=0x7efe1802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9ca3d1f71fa6fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe1ea00640 1 -- 172.21.15.52:0/3646901080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18007740 con 0x7efe200d13a0 2024-09-10T08:40:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe1ea00640 1 -- 172.21.15.52:0/3646901080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe180078e0 con 0x7efe200d13a0 2024-09-10T08:40:49.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe1ea00640 1 -- 172.21.15.52:0/3646901080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18007cb0 con 0x7efe200d13a0 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 -- 172.21.15.52:0/3646901080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe200d13a0 msgr2=0x7efe200b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 --2- 172.21.15.52:0/3646901080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe200d13a0 0x7efe200b8780 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7efe18009d90 tx=0x7efe1802a6f0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 -- 172.21.15.52:0/3646901080 shutdown_connections 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 --2- 172.21.15.52:0/3646901080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe200d13a0 0x7efe200b8780 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 -- 172.21.15.52:0/3646901080 >> 172.21.15.52:0/3646901080 conn(0x7efe20067950 msgr2=0x7efe20067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 -- 172.21.15.52:0/3646901080 shutdown_connections 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.103+0000 7efe24c00640 1 -- 172.21.15.52:0/3646901080 wait complete. 2024-09-10T08:40:49.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.105+0000 7efe24c00640 1 Processor -- start 2024-09-10T08:40:49.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.105+0000 7efe24c00640 1 -- start start 2024-09-10T08:40:49.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe200d0f60 0x7efe201576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe200d13a0 0x7efe2014a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe200d40a0 con 0x7efe2015e620 2024-09-10T08:40:49.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efe200d2f70 con 0x7efe200d13a0 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe24c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7efe200d1830 con 0x7efe200d0f60 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe1fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53816/0 (socket says 172.21.15.52:53816) 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe1fe00640 1 -- 172.21.15.52:0/2954910413 learned_addr learned my addr 172.21.15.52:0/2954910413 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe1f400640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe200d0f60 0x7efe201576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.106+0000 7efe17e00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe200d13a0 0x7efe2014a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 -- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe200d0f60 msgr2=0x7efe201576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe200d0f60 0x7efe201576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 -- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe200d13a0 msgr2=0x7efe2014a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe200d13a0 0x7efe2014a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 -- 172.21.15.52:0/2954910413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2014ad60 con 0x7efe2015e620 2024-09-10T08:40:49.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe1fe00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7efe18009eb0 tx=0x7efe18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18040070 con 0x7efe2015e620 2024-09-10T08:40:49.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe18031bc0 con 0x7efe2015e620 2024-09-10T08:40:49.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18009450 con 0x7efe2015e620 2024-09-10T08:40:49.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe20157dc0 con 0x7efe2015e620 2024-09-10T08:40:49.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.107+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe20155830 con 0x7efe2015e620 2024-09-10T08:40:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.108+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe200d2120 con 0x7efe2015e620 2024-09-10T08:40:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.109+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe18039040 con 0x7efe2015e620 2024-09-10T08:40:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.111+0000 7efe17400640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 0x7efdfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.111+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7efe180ac6d0 con 0x7efe2015e620 2024-09-10T08:40:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.111+0000 7efe1f400640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 0x7efdfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.112+0000 7efe1f400640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 0x7efdfc06e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efe100011e0 tx=0x7efe10007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.115+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe1807a990 con 0x7efe2015e620 2024-09-10T08:40:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.368+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efe20153f40 con 0x7efe2015e620 2024-09-10T08:40:49.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.371+0000 7efe17400640 1 -- 172.21.15.52:0/2954910413 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7efe1807fe20 con 0x7efe2015e620 2024-09-10T08:40:49.371 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:40:49.371 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:40:49.371 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:40:49.372 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:40:49.372 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:40:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 msgr2=0x7efdfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 0x7efdfc06e2f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efe100011e0 tx=0x7efe10007d30 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 msgr2=0x7efe2015a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7efe18009eb0 tx=0x7efe18004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 shutdown_connections 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efdfc06be30 0x7efdfc06e2f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe2015e620 0x7efe2015a060 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe200d13a0 0x7efe2014a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 --2- 172.21.15.52:0/2954910413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe200d0f60 0x7efe201576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 >> 172.21.15.52:0/2954910413 conn(0x7efe20067950 msgr2=0x7efe200ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 shutdown_connections 2024-09-10T08:40:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.373+0000 7efe24c00640 1 -- 172.21.15.52:0/2954910413 wait complete. 2024-09-10T08:40:49.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:40:49.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.544+0000 7f4bab200640 1 Processor -- start 2024-09-10T08:40:49.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.545+0000 7f4bab200640 1 -- start start 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4bab200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 0x7f4ba406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4bab200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ba4071680 0x7f4ba406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4bab200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba4071b30 con 0x7f4ba4147e80 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4bab200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba4074200 con 0x7f4ba4071680 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4bab200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba40b3e40 con 0x7f4ba4148260 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4ba4147e80 0x7f4ba4070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46356/0 (socket says 172.21.15.52:46356) 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba3e00640 1 -- 172.21.15.52:0/2256018063 learned_addr learned my addr 172.21.15.52:0/2256018063 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba9200640 1 --2- 172.21.15.52:0/2256018063 >> v2:172.21.15.52:3300/0 conn(0x7f4ba4071680 0x7f4ba406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4b9be00640 1 --2- 172.21.15.52:0/2256018063 >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 0x7f4ba406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba9200640 1 -- 172.21.15.52:0/2256018063 >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 msgr2=0x7f4ba406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba9200640 1 --2- 172.21.15.52:0/2256018063 >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 0x7f4ba406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.546+0000 7f4ba9200640 1 -- 172.21.15.52:0/2256018063 >> v1:172.21.15.52:6789/0 conn(0x7f4ba4147e80 legacy=0x7f4ba4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.547+0000 7f4ba9200640 1 -- 172.21.15.52:0/2256018063 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba40b3510 con 0x7f4ba4071680 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.547+0000 7f4ba3400640 1 -- 172.21.15.52:0/2256018063 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439757995 0 0) 0x7f4ba4071b30 con 0x7f4ba4147e80 2024-09-10T08:40:49.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.547+0000 7f4b9be00640 1 --2- 172.21.15.52:0/2256018063 >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 0x7f4ba406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4ba9200640 1 --2- 172.21.15.52:0/2256018063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4071680 0x7f4ba406c150 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40cce90 tx=0x7f4b9c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8681acedbcfbdaaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4ba3400640 1 -- 172.21.15.52:0/2256018063 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007740 con 0x7f4ba4071680 2024-09-10T08:40:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4ba3400640 1 -- 172.21.15.52:0/2256018063 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0078e0 con 0x7f4ba4071680 2024-09-10T08:40:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4ba3400640 1 -- 172.21.15.52:0/2256018063 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007cb0 con 0x7f4ba4071680 2024-09-10T08:40:49.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4bab200640 1 -- 172.21.15.52:0/2256018063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4071680 msgr2=0x7f4ba406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4bab200640 1 --2- 172.21.15.52:0/2256018063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4071680 0x7f4ba406c150 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40cce90 tx=0x7f4b9c02a680 comp rx=0 tx=0).stop 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.548+0000 7f4bab200640 1 -- 172.21.15.52:0/2256018063 shutdown_connections 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.549+0000 7f4bab200640 1 --2- 172.21.15.52:0/2256018063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4071680 0x7f4ba406c150 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.549+0000 7f4bab200640 1 --2- 172.21.15.52:0/2256018063 >> v2:172.21.15.176:3300/0 conn(0x7f4ba4148260 0x7f4ba406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.549+0000 7f4bab200640 1 -- 172.21.15.52:0/2256018063 >> 172.21.15.52:0/2256018063 conn(0x7f4ba40ccec0 msgr2=0x7f4ba40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.549+0000 7f4bab200640 1 -- 172.21.15.52:0/2256018063 shutdown_connections 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.549+0000 7f4bab200640 1 -- 172.21.15.52:0/2256018063 wait complete. 2024-09-10T08:40:49.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.550+0000 7f4bab200640 1 Processor -- start 2024-09-10T08:40:49.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.550+0000 7f4bab200640 1 -- start start 2024-09-10T08:40:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ba4071680 0x7f4ba41e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ba4147e80 0x7f4ba41e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40b42d0 con 0x7f4ba4148260 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba40b3ad0 con 0x7f4ba4071680 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.551+0000 7f4bab200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba40b4450 con 0x7f4ba4147e80 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53838/0 (socket says 172.21.15.52:53838) 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 -- 172.21.15.52:0/249158639 learned_addr learned my addr 172.21.15.52:0/249158639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba3e00640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ba4071680 0x7f4ba41e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4b9be00640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ba4147e80 0x7f4ba41e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 -- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ba4147e80 msgr2=0x7f4ba41e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ba4147e80 0x7f4ba41e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 -- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ba4071680 msgr2=0x7f4ba41e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ba4071680 0x7f4ba41e8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.552+0000 7f4ba9200640 1 -- 172.21.15.52:0/249158639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba41e7b90 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4ba9200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c02ac70 tx=0x7f4b9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c040070 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c031bc0 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c045460 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba41e7e70 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.553+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba41e8430 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.554+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba40ce5a0 con 0x7f4ba4148260 2024-09-10T08:40:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.555+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b9c039040 con 0x7f4ba4148260 2024-09-10T08:40:49.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.556+0000 7f4ba0c00640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 0x7f4b8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:49.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.556+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f4b9c0ac7c0 con 0x7f4ba4148260 2024-09-10T08:40:49.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.556+0000 7f4ba3e00640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 0x7f4b8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:49.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.557+0000 7f4ba3e00640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 0x7f4b8006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4b94000f60 tx=0x7f4b94007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:49.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.560+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b9c07a9f0 con 0x7f4ba4148260 2024-09-10T08:40:49.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.781+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba415eac0 con 0x7f4ba4148260 2024-09-10T08:40:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.781+0000 7f4ba0c00640 1 -- 172.21.15.52:0/249158639 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+5236 (secure 0 0 0) 0x7f4b9c07ecf0 con 0x7f4ba4148260 2024-09-10T08:40:49.782 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:40:49.782 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":130,"btime":"2024-09-10T08:40:42:596516+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:40:42.021824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:40:49.782 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 130 2024-09-10T08:40:49.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 msgr2=0x7f4b8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 0x7f4b8006e2f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4b94000f60 tx=0x7f4b94007d50 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 msgr2=0x7f4ba415e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c02ac70 tx=0x7f4b9c004a40 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 shutdown_connections 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4b8006be30 0x7f4b8006e2f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ba4148260 0x7f4ba415e580 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ba4147e80 0x7f4ba41e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 --2- 172.21.15.52:0/249158639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ba4071680 0x7f4ba41e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 >> 172.21.15.52:0/249158639 conn(0x7f4ba40ccec0 msgr2=0x7f4ba40730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 shutdown_connections 2024-09-10T08:40:49.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:49.784+0000 7f4bab200640 1 -- 172.21.15.52:0/249158639 wait complete. 2024-09-10T08:40:50.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 130, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:40:39.018331+0000', 'modified': '2024-09-10T08:40:42.021824+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9753}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9753': {'gid': 9753, 'name': 'c', 'rank': 0, 'incarnation': 127, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/2110837576', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2110837576}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 2110837576}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9753, 'qdb_cluster': [9753]} 2024-09-10T08:40:50.204 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:40:50.204 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:40:50.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.367+0000 7f80e8000640 1 Processor -- start 2024-09-10T08:40:50.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.367+0000 7f80e8000640 1 -- start start 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.368+0000 7f80e8000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80e0147e80 0x7f80e0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.368+0000 7f80e8000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.368+0000 7f80e8000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0071b30 con 0x7f80e0148260 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.368+0000 7f80e8000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f80e0074200 con 0x7f80e0147e80 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.368+0000 7f80e8000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00b3e40 con 0x7f80e006c320 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:43688/0 (socket says 172.21.15.52:43688) 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 -- 172.21.15.52:0/1453828716 learned_addr learned my addr 172.21.15.52:0/1453828716 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e5600640 1 --2- 172.21.15.52:0/1453828716 >> v2:172.21.15.176:3300/0 conn(0x7f80e0147e80 0x7f80e0070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 -- 172.21.15.52:0/1453828716 >> v2:172.21.15.176:3300/0 conn(0x7f80e0147e80 msgr2=0x7f80e0070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 --2- 172.21.15.52:0/1453828716 >> v2:172.21.15.176:3300/0 conn(0x7f80e0147e80 0x7f80e0070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 -- 172.21.15.52:0/1453828716 >> v1:172.21.15.176:6789/0 conn(0x7f80e0148260 legacy=0x7f80e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.369+0000 7f80e6000640 1 -- 172.21.15.52:0/1453828716 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e00b3510 con 0x7f80e006c320 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.370+0000 7f80e6000640 1 --2- 172.21.15.52:0/1453828716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e5d99f74ced1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80dfe00640 1 -- 172.21.15.52:0/1453828716 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8036070 con 0x7f80e006c320 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80dfe00640 1 -- 172.21.15.52:0/1453828716 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8031600 con 0x7f80e006c320 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80dfe00640 1 -- 172.21.15.52:0/1453828716 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80319d0 con 0x7f80e006c320 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 -- 172.21.15.52:0/1453828716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 msgr2=0x7f80e00714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 --2- 172.21.15.52:0/1453828716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802a710 comp rx=0 tx=0).stop 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 -- 172.21.15.52:0/1453828716 shutdown_connections 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 --2- 172.21.15.52:0/1453828716 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e00714b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 --2- 172.21.15.52:0/1453828716 >> v2:172.21.15.176:3300/0 conn(0x7f80e0147e80 0x7f80e0070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.371+0000 7f80e8000640 1 -- 172.21.15.52:0/1453828716 >> 172.21.15.52:0/1453828716 conn(0x7f80e00ccec0 msgr2=0x7f80e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.372+0000 7f80e8000640 1 -- 172.21.15.52:0/1453828716 shutdown_connections 2024-09-10T08:40:50.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.372+0000 7f80e8000640 1 -- 172.21.15.52:0/1453828716 wait complete. 2024-09-10T08:40:50.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.374+0000 7f80e8000640 1 Processor -- start 2024-09-10T08:40:50.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.374+0000 7f80e8000640 1 -- start start 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e01f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e0148260 0x7f80e00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b42d0 con 0x7f80e0147e80 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b3ad0 con 0x7f80e0148260 2024-09-10T08:40:50.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.375+0000 7f80e8000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00b4450 con 0x7f80e006c320 2024-09-10T08:40:50.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e01f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53840/0 (socket says 172.21.15.52:53840) 2024-09-10T08:40:50.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 -- 172.21.15.52:0/3894500767 learned_addr learned my addr 172.21.15.52:0/3894500767 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e6000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e0148260 0x7f80e00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 -- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 msgr2=0x7f80e01f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e01f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 -- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e0148260 msgr2=0x7f80e00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e0148260 0x7f80e00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 -- 172.21.15.52:0/3894500767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e00aaf10 con 0x7f80e0147e80 2024-09-10T08:40:50.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.376+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c3c0 tx=0x7f80cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.377+0000 7f80dd600640 1 -- 172.21.15.52:0/3894500767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0052d0 con 0x7f80e0147e80 2024-09-10T08:40:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.377+0000 7f80dd600640 1 -- 172.21.15.52:0/3894500767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc005490 con 0x7f80e0147e80 2024-09-10T08:40:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.377+0000 7f80dd600640 1 -- 172.21.15.52:0/3894500767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc007260 con 0x7f80e0147e80 2024-09-10T08:40:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.377+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e00ab1f0 con 0x7f80e0147e80 2024-09-10T08:40:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.377+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e00aba90 con 0x7f80e0147e80 2024-09-10T08:40:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.380+0000 7f80dd600640 1 -- 172.21.15.52:0/3894500767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80cc007400 con 0x7f80e0147e80 2024-09-10T08:40:50.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.380+0000 7f80dd600640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 0x7f80c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.381+0000 7f80dd600640 1 -- 172.21.15.52:0/3894500767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f80cc08a290 con 0x7f80e0147e80 2024-09-10T08:40:50.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.381+0000 7f80e5600640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 0x7f80c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.381+0000 7f80eadfb740 1 Processor -- start 2024-09-10T08:40:50.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.381+0000 7f80eadfb740 1 -- start start 2024-09-10T08:40:50.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e5600640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 0x7f80c006e2f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b40 tx=0x7f80d4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f06490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39ebb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f39e1f3b0 con 0x559f39ebe4b0 2024-09-10T08:40:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559f39e24410 con 0x559f39ec2480 2024-09-10T08:40:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x559f39dcc620 con 0x559f39ec0cf0 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53848/0 (socket says 172.21.15.52:53848) 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e4c00640 1 -- 172.21.15.52:0/119045361 learned_addr learned my addr 172.21.15.52:0/119045361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e5600640 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f06490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.382+0000 7f80e6000640 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39ebb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 -- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 msgr2=0x559f39f06490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f06490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 -- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 msgr2=0x559f39ebb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39ebb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 -- 172.21.15.52:0/119045361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f39b372d0 con 0x559f39ebe4b0 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80e4c00640 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f80cc088730 tx=0x7f80cc00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d036fe2e53faab02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80d1c00640 1 -- 172.21.15.52:0/119045361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc08a0c0 con 0x559f39ebe4b0 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80d1c00640 1 -- 172.21.15.52:0/119045361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc0568f0 con 0x559f39ebe4b0 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.383+0000 7f80d1c00640 1 -- 172.21.15.52:0/119045361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc060c90 con 0x559f39ebe4b0 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 -- 172.21.15.52:0/119045361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 msgr2=0x559f39ec10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f80cc088730 tx=0x7f80cc00a000 comp rx=0 tx=0).stop 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 -- 172.21.15.52:0/119045361 shutdown_connections 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39ebb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ebe4b0 0x559f39ec10d0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 --2- 172.21.15.52:0/119045361 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f06490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 -- 172.21.15.52:0/119045361 >> 172.21.15.52:0/119045361 conn(0x559f39ebd740 msgr2=0x559f39f05960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 -- 172.21.15.52:0/119045361 shutdown_connections 2024-09-10T08:40:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.384+0000 7f80eadfb740 1 -- 172.21.15.52:0/119045361 wait complete. 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.385+0000 7f80eadfb740 1 -- start start 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.385+0000 7f80eadfb740 1 Processor -- start 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39edf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39ebf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f39ddf780 con 0x559f39ec2480 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559f39e203d0 con 0x559f39edf8b0 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x559f39ebcbe0 con 0x559f39ec0cf0 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80eadfb740 10 client.0 _ll_register_callbacks cb 0x559f39e1d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53854/0 (socket says 172.21.15.52:53854) 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.386+0000 7f80e4c00640 1 -- 172.21.15.52:0/3957851880 learned_addr learned my addr 172.21.15.52:0/3957851880 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e5600640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39edf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e6000640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39ebf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 -- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 msgr2=0x559f39edf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39edf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 -- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 msgr2=0x559f39ebf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39ebf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 -- 172.21.15.52:0/3957851880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f39c016b0 con 0x559f39ec2480 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e5600640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39edf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e6000640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39ebf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:40:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00cd80 tx=0x7f80cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443aa14c397dd08d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80c6000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc08a0c0 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80cc0568f0 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.387+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f80cc054c60 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f80cc07c050 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 10 client.9903 fetch_fsmap learned FSMap version 130 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x559f39ee0c10 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc0568f0 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f80cc060c90 con 0x559f39ec2480 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 10 client.9903 fetch_fsmap finished waiting for FSMap version 130 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 10 client.9903 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 20 client.9903 populate_metadata read hostname 'smithi052' 2024-09-10T08:40:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39ebaa70 0x559f39ee1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 4 client.9903 mds_command: new command op to 9753 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:40:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 --> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f39e31b40 con 0x559f39ebaa70 2024-09-10T08:40:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.388+0000 7f80e5600640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39ebaa70 0x559f39ee1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.389+0000 7f80e5600640 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39ebaa70 0x559f39ee1420 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de6c442bb2636e server_cookie=7a5c89f8395bd117 in_seq=0 out_seq=0 2024-09-10T08:40:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.389+0000 7f80c6000640 10 client.9903 ms_handle_connect on v2:172.21.15.52:6832/2110837576 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80c6000640 1 -- 172.21.15.52:0/3957851880 <== mds.0 v2:172.21.15.52:6832/2110837576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f39e31b40 con 0x559f39ebaa70 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80c6000640 10 client.9903 handle_command_reply: tid=0 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 client.9903 shutdown 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 msgr2=0x559f39eba530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00cd80 tx=0x7f80cc000bc0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 shutdown_connections 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39ebf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39ebaa70 0x559f39ee1420 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39eba530 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3957851880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39edf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80c6000640 0 client.9903 ms_handle_reset on v2:172.21.15.52:6832/2110837576 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 >> 172.21.15.52:0/3957851880 conn(0x559f39ebe4b0 msgr2=0x559f39f04f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 shutdown_connections 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.390+0000 7f80eadfb740 1 -- 172.21.15.52:0/3957851880 wait complete. 2024-09-10T08:40:50.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.391+0000 7f80eadfb740 20 client.9903 trim_cache size 0 max 16384 2024-09-10T08:40:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.409+0000 7f80eadfb740 1 Processor -- start 2024-09-10T08:40:50.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.409+0000 7f80eadfb740 1 -- start start 2024-09-10T08:40:50.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39f29af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01ffd20 con 0x559f39ec2480 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01ff0d0 con 0x559f39edf8b0 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80e01ff6d0 con 0x559f39ec0cf0 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.410+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53858/0 (socket says 172.21.15.52:53858) 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 -- 172.21.15.52:0/2024594780 learned_addr learned my addr 172.21.15.52:0/2024594780 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 -- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 msgr2=0x559f39f03bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 -- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 msgr2=0x559f39f29af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39f29af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 -- 172.21.15.52:0/2024594780 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f39ebf530 con 0x559f39ec2480 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80e4c00640 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f80cc060bf0 tx=0x7f80cc06e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eeeb96419e7942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80d1200640 1 -- 172.21.15.52:0/2024594780 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0568f0 con 0x559f39ec2480 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80d1200640 1 -- 172.21.15.52:0/2024594780 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc077500 con 0x559f39ec2480 2024-09-10T08:40:50.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.411+0000 7f80d1200640 1 -- 172.21.15.52:0/2024594780 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc057a40 con 0x559f39ec2480 2024-09-10T08:40:50.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 -- 172.21.15.52:0/2024594780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 msgr2=0x559f39f295b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f80cc060bf0 tx=0x7f80cc06e040 comp rx=0 tx=0).stop 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 -- 172.21.15.52:0/2024594780 shutdown_connections 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39edf8b0 0x559f39f29af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec2480 0x559f39f295b0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 --2- 172.21.15.52:0/2024594780 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39ec0cf0 0x559f39f03bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 -- 172.21.15.52:0/2024594780 >> 172.21.15.52:0/2024594780 conn(0x559f39ebe4b0 msgr2=0x559f39f02850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 -- 172.21.15.52:0/2024594780 shutdown_connections 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.412+0000 7f80eadfb740 1 -- 172.21.15.52:0/2024594780 wait complete. 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.413+0000 7f80eadfb740 1 -- start start 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.413+0000 7f80eadfb740 1 Processor -- start 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39f7dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39edf8b0 0x559f39f29ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f39ddf780 con 0x559f39ec0cf0 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x559f39ebcbe0 con 0x559f39ec2480 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x559f39e203d0 con 0x559f39edf8b0 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80eadfb740 10 client.0 _ll_register_callbacks cb 0x7f80cc06f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53866/0 (socket says 172.21.15.52:53866) 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 -- 172.21.15.52:0/3221717671 learned_addr learned my addr 172.21.15.52:0/3221717671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 -- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39edf8b0 msgr2=0x559f39f29ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39edf8b0 0x559f39f29ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 -- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 msgr2=0x559f39f7dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39f7dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39f7dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e5600640 1 -- 172.21.15.52:0/3221717671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f39edf400 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.414+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39f7dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80e5600640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x559f39ebaf40 tx=0x7f80d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff776de075c37c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80c6000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4014d10 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f80d4004030 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80cc077500 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f80d4004230 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80eadfb740 10 client.9909 fetch_fsmap learned FSMap version 130 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) -- 0x559f39f2a0e0 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.415+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc077500 con 0x559f39ec0cf0 2024-09-10T08:40:50.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 130) ==== 3502+0+0 (secure 0 0 0) 0x7f80d4034050 con 0x559f39ec0cf0 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 10 client.9909 fetch_fsmap finished waiting for FSMap version 130 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 10 client.9909 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 20 client.9909 populate_metadata read hostname 'smithi052' 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39f09540 0x559f39ee56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 4 client.9909 mds_command: new command op to 9753 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 --> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] -- command(tid 0: {"prefix": "status"}) -- 0x559f39f04d00 con 0x559f39f09540 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39f09540 0x559f39ee56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80e4c00640 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39f09540 0x559f39ee56e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de588e4316691e93 server_cookie=40796c88c5a753e in_seq=0 out_seq=0 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.416+0000 7f80c6000640 10 client.9909 ms_handle_connect on v2:172.21.15.52:6832/2110837576 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80c6000640 1 -- 172.21.15.52:0/3221717671 <== mds.0 v2:172.21.15.52:6832/2110837576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x559f39f04d00 con 0x559f39f09540 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80c6000640 10 client.9909 handle_command_reply: tid=0 2024-09-10T08:40:50.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 client.9909 shutdown 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 msgr2=0x559f39f180a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x559f39ebaf40 tx=0x7f80d40046c0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 shutdown_connections 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x559f39edf8b0 0x559f39f29ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x559f39ec2480 0x559f39f7dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x559f39f09540 0x559f39ee56e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 --2- 172.21.15.52:0/3221717671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f39ec0cf0 0x559f39f180a0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 >> 172.21.15.52:0/3221717671 conn(0x559f39ebe4b0 msgr2=0x559f39f074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80c6000640 0 client.9909 ms_handle_reset on v2:172.21.15.52:6832/2110837576 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 shutdown_connections 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 1 -- 172.21.15.52:0/3221717671 wait complete. 2024-09-10T08:40:50.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.417+0000 7f80eadfb740 20 client.9909 trim_cache size 0 max 16384 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 9753, 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.826470689000001, 2024-09-10T08:40:50.423 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 130, 2024-09-10T08:40:50.424 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 171, 2024-09-10T08:40:50.424 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 171, 2024-09-10T08:40:50.424 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.896422303 2024-09-10T08:40:50.424 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 msgr2=0x7f80c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 0x7f80c006e2f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b40 tx=0x7f80d4009190 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 msgr2=0x7f80e00acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00c3c0 tx=0x7f80cc00c880 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 shutdown_connections 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f80c006be30 0x7f80c006e2f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80e0148260 0x7f80e00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80e0147e80 0x7f80e00acb50 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 --2- 172.21.15.52:0/3894500767 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80e006c320 0x7f80e01f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 >> 172.21.15.52:0/3894500767 conn(0x7f80e00ccec0 msgr2=0x7f80e00c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 shutdown_connections 2024-09-10T08:40:50.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.418+0000 7f80e8000640 1 -- 172.21.15.52:0/3894500767 wait complete. 2024-09-10T08:40:50.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:40:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.590+0000 7f0013c00640 1 Processor -- start 2024-09-10T08:40:50.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.590+0000 7f0013c00640 1 -- start start 2024-09-10T08:40:50.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0013c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 0x7f000c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0013c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c071180 con 0x7f000c06c320 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0013c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c071460 con 0x7f000c0b2d40 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0013c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f000c071ab0 con 0x7f000c13eb20 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0003e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f000c06c320 0x7f000c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46358/0 (socket says 172.21.15.52:46358) 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0003e00640 1 -- 172.21.15.52:0/2758412284 learned_addr learned my addr 172.21.15.52:0/2758412284 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:40:50.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.592+0000 7f0011c00640 1 --2- 172.21.15.52:0/2758412284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 0x7f000c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141263978 0 0) 0x7f000c071180 con 0x7f000c06c320 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff0003520 con 0x7f000c06c320 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160251941 0 0) 0x7f000c071460 con 0x7f000c0b2d40 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f000c071180 con 0x7f000c0b2d40 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f0011c00640 1 -- 172.21.15.52:0/2758412284 >> v1:172.21.15.176:6789/0 conn(0x7f000c0b2d40 legacy=0x7f000c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f0011c00640 1 -- 172.21.15.52:0/2758412284 >> v1:172.21.15.52:6789/0 conn(0x7f000c06c320 legacy=0x7f000c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.593+0000 7f0011c00640 1 -- 172.21.15.52:0/2758412284 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c071740 con 0x7f000c13eb20 2024-09-10T08:40:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.594+0000 7f0011c00640 1 --2- 172.21.15.52:0/2758412284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 0x7f000c15c400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0004009dc0 tx=0x7f000402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2019347ead268c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.594+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004007740 con 0x7f000c13eb20 2024-09-10T08:40:50.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.594+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040078e0 con 0x7f000c13eb20 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.594+0000 7f000be00640 1 -- 172.21.15.52:0/2758412284 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004007cb0 con 0x7f000c13eb20 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 -- 172.21.15.52:0/2758412284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 msgr2=0x7f000c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 --2- 172.21.15.52:0/2758412284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 0x7f000c15c400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0004009dc0 tx=0x7f000402a6d0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 -- 172.21.15.52:0/2758412284 shutdown_connections 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 --2- 172.21.15.52:0/2758412284 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c13eb20 0x7f000c15c400 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 -- 172.21.15.52:0/2758412284 >> 172.21.15.52:0/2758412284 conn(0x7f000c0ccec0 msgr2=0x7f000c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 -- 172.21.15.52:0/2758412284 shutdown_connections 2024-09-10T08:40:50.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.595+0000 7f0013c00640 1 -- 172.21.15.52:0/2758412284 wait complete. 2024-09-10T08:40:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.596+0000 7f0013c00640 1 Processor -- start 2024-09-10T08:40:50.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 -- start start 2024-09-10T08:40:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c0b2d40 0x7f000c13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000c13eb20 0x7f000c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0b3980 con 0x7f000c06c320 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f000c0b3800 con 0x7f000c13eb20 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.597+0000 7f0013c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f000c0b3b00 con 0x7f000c0b2d40 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53878/0 (socket says 172.21.15.52:53878) 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 -- 172.21.15.52:0/3384726749 learned_addr learned my addr 172.21.15.52:0/3384726749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0003e00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c0b2d40 0x7f000c13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000c13eb20 0x7f000c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 -- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c0b2d40 msgr2=0x7f000c13c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c0b2d40 0x7f000c13c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 -- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000c13eb20 msgr2=0x7f000c15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000c13eb20 0x7f000c15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 -- 172.21.15.52:0/3384726749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c15aa10 con 0x7f000c06c320 2024-09-10T08:40:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.598+0000 7f0011200640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c4c0 tx=0x7efffc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.599+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0052d0 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.599+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc005470 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.599+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc012870 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.599+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c15acf0 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.599+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c15b2b0 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.600+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c06bc10 con 0x7f000c06c320 2024-09-10T08:40:50.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.601+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efffc012a10 con 0x7f000c06c320 2024-09-10T08:40:50.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.602+0000 7f0009600640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 0x7effe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:40:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.602+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7efffc08aa00 con 0x7f000c06c320 2024-09-10T08:40:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.603+0000 7f0003e00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 0x7effe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:40:50.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.603+0000 7f0003e00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 0x7effe806e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f000c1556c0 tx=0x7efff4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:40:50.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.607+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efffc058cc0 con 0x7f000c06c320 2024-09-10T08:40:50.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.833+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f000c06c9c0 con 0x7f000c06c320 2024-09-10T08:40:50.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.833+0000 7f0009600640 1 -- 172.21.15.52:0/3384726749 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v130) ==== 53+0+73 (secure 0 0 0) 0x7efffc05cfc0 con 0x7f000c06c320 2024-09-10T08:40:50.834 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 msgr2=0x7effe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 0x7effe806e2f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f000c1556c0 tx=0x7efff4007d30 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 msgr2=0x7f000c0c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c4c0 tx=0x7efffc00c980 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 shutdown_connections 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7effe806be30 0x7effe806e2f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f000c13eb20 0x7f000c15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f000c0b2d40 0x7f000c13c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 --2- 172.21.15.52:0/3384726749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f000c06c320 0x7f000c0c9860 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 >> 172.21.15.52:0/3384726749 conn(0x7f000c0ccec0 msgr2=0x7f000c140460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:40:50.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 shutdown_connections 2024-09-10T08:40:50.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:50.835+0000 7f0013c00640 1 -- 172.21.15.52:0/3384726749 wait complete. 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:40:50.852 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:40:50.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:50.853 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:40:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41952sec preferred_lft 41952sec 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:40:50.890 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:40:50.891 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:40:50.892 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:40:50.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:50.893 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:40:50.983 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:40:50.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:50.986 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:40:51.023 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:40:51.023 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:40:51.024 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:40:51.024 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:40:51.024 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:40:51.024 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:40:51.024 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:51.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:40:51.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:40:51.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:40:51.025 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:51.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:40:51.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:51.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:51.222 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:40:51.257 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:40:51.258 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:40:51.258 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:40:51.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:51.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:40:51.354 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:40:51.354 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:40:51.389 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:40:51.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:40:51.390 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:40:51.464 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:40:51.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:51.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:40:51.592 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:40:51.592 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:40:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:40:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:40:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:40:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:40:51.622 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:40:51.623 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:40:51.623 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:40:51.623 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:40:51.624 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:40:51.624 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:40:51.626 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:40:51.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:40:51.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:40:51.684 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:40:51.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:51.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:51.780 INFO:teuthology.orchestra.run.smithi052.stdout:client9133 2024-09-10T08:40:51.781 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:40:51.781 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:40:51.816 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.0 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:51.817 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163152 s, 64.3 MB/s 2024-09-10T08:40:51.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:51.983 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:51.984 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144185 s, 72.7 MB/s 2024-09-10T08:40:52.002 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.003 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163092 s, 64.3 MB/s 2024-09-10T08:40:52.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138141 s, 75.9 MB/s 2024-09-10T08:40:52.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.038 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151076 s, 69.4 MB/s 2024-09-10T08:40:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177799 s, 59.0 MB/s 2024-09-10T08:40:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155711 s, 67.3 MB/s 2024-09-10T08:40:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157545 s, 66.6 MB/s 2024-09-10T08:40:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.113 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141582 s, 74.1 MB/s 2024-09-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.130 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133973 s, 78.3 MB/s 2024-09-10T08:40:52.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.147 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.147 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143908 s, 72.9 MB/s 2024-09-10T08:40:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013949 s, 75.2 MB/s 2024-09-10T08:40:52.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.180 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131584 s, 79.7 MB/s 2024-09-10T08:40:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014192 s, 73.9 MB/s 2024-09-10T08:40:52.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136413 s, 76.9 MB/s 2024-09-10T08:40:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.231 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145128 s, 72.3 MB/s 2024-09-10T08:40:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.250 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153814 s, 68.2 MB/s 2024-09-10T08:40:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.267 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140155 s, 74.8 MB/s 2024-09-10T08:40:52.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160058 s, 65.5 MB/s 2024-09-10T08:40:52.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.306 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170104 s, 61.6 MB/s 2024-09-10T08:40:52.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.325 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.325 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160644 s, 65.3 MB/s 2024-09-10T08:40:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169479 s, 61.9 MB/s 2024-09-10T08:40:52.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.365 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.365 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164913 s, 63.6 MB/s 2024-09-10T08:40:52.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.384 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01572 s, 66.7 MB/s 2024-09-10T08:40:52.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.400 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133224 s, 78.7 MB/s 2024-09-10T08:40:52.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.417 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136671 s, 76.7 MB/s 2024-09-10T08:40:52.435 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157742 s, 66.5 MB/s 2024-09-10T08:40:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151649 s, 69.1 MB/s 2024-09-10T08:40:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163327 s, 64.2 MB/s 2024-09-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016695 s, 62.8 MB/s 2024-09-10T08:40:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.511 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155631 s, 67.4 MB/s 2024-09-10T08:40:52.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146879 s, 71.4 MB/s 2024-09-10T08:40:52.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.1 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:52.538 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:52.539 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:52.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:52.640 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163041 s, 64.3 MB/s 2024-09-10T08:40:52.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.661 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.661 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169485 s, 61.9 MB/s 2024-09-10T08:40:52.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.676 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123381 s, 85.0 MB/s 2024-09-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140169 s, 74.8 MB/s 2024-09-10T08:40:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134109 s, 78.2 MB/s 2024-09-10T08:40:52.728 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.729 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157914 s, 66.4 MB/s 2024-09-10T08:40:52.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.746 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141786 s, 74.0 MB/s 2024-09-10T08:40:52.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.762 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131633 s, 79.7 MB/s 2024-09-10T08:40:52.778 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.779 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.779 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136574 s, 76.8 MB/s 2024-09-10T08:40:52.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.795 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.795 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128226 s, 81.8 MB/s 2024-09-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.814 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148077 s, 70.8 MB/s 2024-09-10T08:40:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.830 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138313 s, 75.8 MB/s 2024-09-10T08:40:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.845 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011799 s, 88.9 MB/s 2024-09-10T08:40:52.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.861 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134529 s, 77.9 MB/s 2024-09-10T08:40:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136175 s, 77.0 MB/s 2024-09-10T08:40:52.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.898 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171029 s, 61.3 MB/s 2024-09-10T08:40:52.914 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013647 s, 76.8 MB/s 2024-09-10T08:40:52.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.931 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138382 s, 75.8 MB/s 2024-09-10T08:40:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131863 s, 79.5 MB/s 2024-09-10T08:40:52.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132478 s, 79.2 MB/s 2024-09-10T08:40:52.981 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.984 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.984 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140459 s, 74.7 MB/s 2024-09-10T08:40:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:52.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:52.997 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127114 s, 82.5 MB/s 2024-09-10T08:40:53.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.013 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134402 s, 78.0 MB/s 2024-09-10T08:40:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132417 s, 79.2 MB/s 2024-09-10T08:40:53.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.049 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.050 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171351 s, 61.2 MB/s 2024-09-10T08:40:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135808 s, 77.2 MB/s 2024-09-10T08:40:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161369 s, 65.0 MB/s 2024-09-10T08:40:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015621 s, 67.1 MB/s 2024-09-10T08:40:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128819 s, 81.4 MB/s 2024-09-10T08:40:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.135 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130001 s, 80.7 MB/s 2024-09-10T08:40:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.153 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130934 s, 80.1 MB/s 2024-09-10T08:40:53.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.171 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163392 s, 64.2 MB/s 2024-09-10T08:40:53.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:53.180 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:53.180 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:53.180 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.2 2024-09-10T08:40:53.181 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:53.181 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:53.181 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:53.181 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:53.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129117 s, 81.2 MB/s 2024-09-10T08:40:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137085 s, 76.5 MB/s 2024-09-10T08:40:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.312 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133466 s, 78.6 MB/s 2024-09-10T08:40:53.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137201 s, 76.4 MB/s 2024-09-10T08:40:53.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133461 s, 78.6 MB/s 2024-09-10T08:40:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.364 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016161 s, 64.9 MB/s 2024-09-10T08:40:53.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.380 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.380 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128924 s, 81.3 MB/s 2024-09-10T08:40:53.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.396 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.396 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134249 s, 78.1 MB/s 2024-09-10T08:40:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.412 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127709 s, 82.1 MB/s 2024-09-10T08:40:53.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130024 s, 80.6 MB/s 2024-09-10T08:40:53.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.445 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131727 s, 79.6 MB/s 2024-09-10T08:40:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128862 s, 81.4 MB/s 2024-09-10T08:40:53.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.477 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136116 s, 77.0 MB/s 2024-09-10T08:40:53.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.495 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.495 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151002 s, 69.4 MB/s 2024-09-10T08:40:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130563 s, 80.3 MB/s 2024-09-10T08:40:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131451 s, 79.8 MB/s 2024-09-10T08:40:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149905 s, 69.9 MB/s 2024-09-10T08:40:53.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.564 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.564 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136014 s, 77.1 MB/s 2024-09-10T08:40:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013489 s, 77.7 MB/s 2024-09-10T08:40:53.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.596 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135718 s, 77.3 MB/s 2024-09-10T08:40:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125255 s, 83.7 MB/s 2024-09-10T08:40:53.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.627 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127949 s, 82.0 MB/s 2024-09-10T08:40:53.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.647 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.648 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167692 s, 62.5 MB/s 2024-09-10T08:40:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133769 s, 78.4 MB/s 2024-09-10T08:40:53.680 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.681 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139684 s, 75.1 MB/s 2024-09-10T08:40:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.697 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134241 s, 78.1 MB/s 2024-09-10T08:40:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162146 s, 64.7 MB/s 2024-09-10T08:40:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140023 s, 74.9 MB/s 2024-09-10T08:40:53.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.750 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137568 s, 76.2 MB/s 2024-09-10T08:40:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.770 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016086 s, 65.2 MB/s 2024-09-10T08:40:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126766 s, 82.7 MB/s 2024-09-10T08:40:53.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017076 s, 61.4 MB/s 2024-09-10T08:40:53.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:53.814 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:53.814 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:53.814 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.3 2024-09-10T08:40:53.815 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:53.815 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:53.815 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:53.815 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:53.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.915 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141163 s, 74.3 MB/s 2024-09-10T08:40:53.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.931 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130557 s, 80.3 MB/s 2024-09-10T08:40:53.948 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.948 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.948 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133352 s, 78.6 MB/s 2024-09-10T08:40:53.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.964 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.964 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135016 s, 77.7 MB/s 2024-09-10T08:40:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131615 s, 79.7 MB/s 2024-09-10T08:40:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128362 s, 81.7 MB/s 2024-09-10T08:40:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157419 s, 66.6 MB/s 2024-09-10T08:40:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163698 s, 64.1 MB/s 2024-09-10T08:40:54.050 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.050 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.050 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127951 s, 82.0 MB/s 2024-09-10T08:40:54.068 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.069 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141219 s, 74.3 MB/s 2024-09-10T08:40:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.084 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126459 s, 82.9 MB/s 2024-09-10T08:40:54.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.101 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134076 s, 78.2 MB/s 2024-09-10T08:40:54.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134438 s, 78.0 MB/s 2024-09-10T08:40:54.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133771 s, 78.4 MB/s 2024-09-10T08:40:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135964 s, 77.1 MB/s 2024-09-10T08:40:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122643 s, 85.5 MB/s 2024-09-10T08:40:54.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.183 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.183 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01507 s, 69.6 MB/s 2024-09-10T08:40:54.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.200 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136106 s, 77.0 MB/s 2024-09-10T08:40:54.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.215 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127586 s, 82.2 MB/s 2024-09-10T08:40:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131541 s, 79.7 MB/s 2024-09-10T08:40:54.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.247 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127018 s, 82.6 MB/s 2024-09-10T08:40:54.263 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.264 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.264 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013228 s, 79.3 MB/s 2024-09-10T08:40:54.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134904 s, 77.7 MB/s 2024-09-10T08:40:54.300 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.300 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.300 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165466 s, 63.4 MB/s 2024-09-10T08:40:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131588 s, 79.7 MB/s 2024-09-10T08:40:54.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.333 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136577 s, 76.8 MB/s 2024-09-10T08:40:54.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168852 s, 62.1 MB/s 2024-09-10T08:40:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129871 s, 80.7 MB/s 2024-09-10T08:40:54.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.388 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160429 s, 65.4 MB/s 2024-09-10T08:40:54.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.404 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013445 s, 78.0 MB/s 2024-09-10T08:40:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129142 s, 81.2 MB/s 2024-09-10T08:40:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128821 s, 81.4 MB/s 2024-09-10T08:40:54.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.4 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:54.445 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:54.446 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:54.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.551 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181716 s, 57.7 MB/s 2024-09-10T08:40:54.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.568 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.568 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014172 s, 74.0 MB/s 2024-09-10T08:40:54.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117181 s, 89.5 MB/s 2024-09-10T08:40:54.600 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.601 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.601 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138609 s, 75.7 MB/s 2024-09-10T08:40:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.618 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013601 s, 77.1 MB/s 2024-09-10T08:40:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134258 s, 78.1 MB/s 2024-09-10T08:40:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137094 s, 76.5 MB/s 2024-09-10T08:40:54.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.668 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131775 s, 79.6 MB/s 2024-09-10T08:40:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135769 s, 77.2 MB/s 2024-09-10T08:40:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132523 s, 79.1 MB/s 2024-09-10T08:40:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.717 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139077 s, 75.4 MB/s 2024-09-10T08:40:54.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.735 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.735 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141851 s, 73.9 MB/s 2024-09-10T08:40:54.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140161 s, 74.8 MB/s 2024-09-10T08:40:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128558 s, 81.6 MB/s 2024-09-10T08:40:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133202 s, 78.7 MB/s 2024-09-10T08:40:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136497 s, 76.8 MB/s 2024-09-10T08:40:54.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.818 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.818 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140686 s, 74.5 MB/s 2024-09-10T08:40:54.834 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.835 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.835 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138582 s, 75.7 MB/s 2024-09-10T08:40:54.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162209 s, 64.6 MB/s 2024-09-10T08:40:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178465 s, 58.8 MB/s 2024-09-10T08:40:54.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124942 s, 83.9 MB/s 2024-09-10T08:40:54.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.907 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012813 s, 81.8 MB/s 2024-09-10T08:40:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172857 s, 60.7 MB/s 2024-09-10T08:40:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013509 s, 77.6 MB/s 2024-09-10T08:40:54.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132019 s, 79.4 MB/s 2024-09-10T08:40:54.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128844 s, 81.4 MB/s 2024-09-10T08:40:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133988 s, 78.3 MB/s 2024-09-10T08:40:55.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127845 s, 82.0 MB/s 2024-09-10T08:40:55.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.025 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137878 s, 76.1 MB/s 2024-09-10T08:40:55.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013019 s, 80.5 MB/s 2024-09-10T08:40:55.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133683 s, 78.4 MB/s 2024-09-10T08:40:55.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012838 s, 81.7 MB/s 2024-09-10T08:40:55.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:55.082 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:55.082 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:55.083 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.5 2024-09-10T08:40:55.083 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:55.083 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:55.083 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:55.083 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:55.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129704 s, 80.8 MB/s 2024-09-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.198 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132052 s, 79.4 MB/s 2024-09-10T08:40:55.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.216 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147775 s, 71.0 MB/s 2024-09-10T08:40:55.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.235 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162053 s, 64.7 MB/s 2024-09-10T08:40:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127715 s, 82.1 MB/s 2024-09-10T08:40:55.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137012 s, 76.5 MB/s 2024-09-10T08:40:55.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133754 s, 78.4 MB/s 2024-09-10T08:40:55.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.298 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.298 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116759 s, 89.8 MB/s 2024-09-10T08:40:55.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.313 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.313 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115114 s, 91.1 MB/s 2024-09-10T08:40:55.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.329 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.329 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135176 s, 77.6 MB/s 2024-09-10T08:40:55.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.344 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.344 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012005 s, 87.3 MB/s 2024-09-10T08:40:55.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.366 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.366 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184483 s, 56.8 MB/s 2024-09-10T08:40:55.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017272 s, 60.7 MB/s 2024-09-10T08:40:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157839 s, 66.4 MB/s 2024-09-10T08:40:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.425 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168321 s, 62.3 MB/s 2024-09-10T08:40:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137661 s, 76.2 MB/s 2024-09-10T08:40:55.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.458 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.458 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129345 s, 81.1 MB/s 2024-09-10T08:40:55.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.474 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135214 s, 77.5 MB/s 2024-09-10T08:40:55.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.494 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168784 s, 62.1 MB/s 2024-09-10T08:40:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170315 s, 61.6 MB/s 2024-09-10T08:40:55.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123223 s, 85.1 MB/s 2024-09-10T08:40:55.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138923 s, 75.5 MB/s 2024-09-10T08:40:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127537 s, 82.2 MB/s 2024-09-10T08:40:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.578 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129181 s, 81.2 MB/s 2024-09-10T08:40:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169936 s, 61.7 MB/s 2024-09-10T08:40:55.618 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.655 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.655 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161093 s, 65.1 MB/s 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139721 s, 75.0 MB/s 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.656 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134691 s, 77.9 MB/s 2024-09-10T08:40:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.667 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124786 s, 84.0 MB/s 2024-09-10T08:40:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139261 s, 75.3 MB/s 2024-09-10T08:40:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127246 s, 82.4 MB/s 2024-09-10T08:40:55.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013409 s, 78.2 MB/s 2024-09-10T08:40:55.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.6 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:55.726 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:55.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:55.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.825 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131813 s, 79.6 MB/s 2024-09-10T08:40:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130952 s, 80.1 MB/s 2024-09-10T08:40:55.856 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.857 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125059 s, 83.8 MB/s 2024-09-10T08:40:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132902 s, 78.9 MB/s 2024-09-10T08:40:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.889 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133096 s, 78.8 MB/s 2024-09-10T08:40:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134285 s, 78.1 MB/s 2024-09-10T08:40:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013503 s, 77.7 MB/s 2024-09-10T08:40:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129693 s, 80.9 MB/s 2024-09-10T08:40:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.957 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154265 s, 68.0 MB/s 2024-09-10T08:40:55.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140846 s, 74.4 MB/s 2024-09-10T08:40:55.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:55.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:55.990 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127973 s, 81.9 MB/s 2024-09-10T08:40:56.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131882 s, 79.5 MB/s 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160396 s, 65.4 MB/s 2024-09-10T08:40:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.042 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135742 s, 77.2 MB/s 2024-09-10T08:40:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011509 s, 91.1 MB/s 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132881 s, 78.9 MB/s 2024-09-10T08:40:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.092 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158067 s, 66.3 MB/s 2024-09-10T08:40:56.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.105 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.106 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107116 s, 97.9 MB/s 2024-09-10T08:40:56.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157934 s, 66.4 MB/s 2024-09-10T08:40:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141299 s, 74.2 MB/s 2024-09-10T08:40:56.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.162 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174726 s, 60.0 MB/s 2024-09-10T08:40:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.181 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162385 s, 64.6 MB/s 2024-09-10T08:40:56.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128275 s, 81.7 MB/s 2024-09-10T08:40:56.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128817 s, 81.4 MB/s 2024-09-10T08:40:56.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.229 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.229 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131157 s, 79.9 MB/s 2024-09-10T08:40:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138148 s, 75.9 MB/s 2024-09-10T08:40:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.262 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130205 s, 80.5 MB/s 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.279 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138353 s, 75.8 MB/s 2024-09-10T08:40:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135152 s, 77.6 MB/s 2024-09-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.312 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131824 s, 79.5 MB/s 2024-09-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012918 s, 81.2 MB/s 2024-09-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129847 s, 80.8 MB/s 2024-09-10T08:40:56.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:56.353 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:56.353 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:56.353 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.7 2024-09-10T08:40:56.353 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:56.353 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:56.354 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:56.354 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:56.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:56.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131994 s, 79.4 MB/s 2024-09-10T08:40:56.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.469 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.469 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013058 s, 80.3 MB/s 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141291 s, 74.2 MB/s 2024-09-10T08:40:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.507 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170562 s, 61.5 MB/s 2024-09-10T08:40:56.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.523 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.523 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133188 s, 78.7 MB/s 2024-09-10T08:40:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.544 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172271 s, 60.9 MB/s 2024-09-10T08:40:56.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.560 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.560 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132991 s, 78.8 MB/s 2024-09-10T08:40:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160433 s, 65.4 MB/s 2024-09-10T08:40:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169601 s, 61.8 MB/s 2024-09-10T08:40:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132231 s, 79.3 MB/s 2024-09-10T08:40:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157775 s, 66.5 MB/s 2024-09-10T08:40:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140315 s, 74.7 MB/s 2024-09-10T08:40:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169951 s, 61.7 MB/s 2024-09-10T08:40:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164486 s, 63.7 MB/s 2024-09-10T08:40:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.708 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140827 s, 74.5 MB/s 2024-09-10T08:40:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137782 s, 76.1 MB/s 2024-09-10T08:40:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.742 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141582 s, 74.1 MB/s 2024-09-10T08:40:56.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.757 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.757 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115138 s, 91.1 MB/s 2024-09-10T08:40:56.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129709 s, 80.8 MB/s 2024-09-10T08:40:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158285 s, 66.2 MB/s 2024-09-10T08:40:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.811 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167869 s, 62.5 MB/s 2024-09-10T08:40:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.827 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131184 s, 79.9 MB/s 2024-09-10T08:40:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.847 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016514 s, 63.5 MB/s 2024-09-10T08:40:56.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.863 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013599 s, 77.1 MB/s 2024-09-10T08:40:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.879 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127166 s, 82.5 MB/s 2024-09-10T08:40:56.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.896 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134137 s, 78.2 MB/s 2024-09-10T08:40:56.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.912 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130851 s, 80.1 MB/s 2024-09-10T08:40:56.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130767 s, 80.2 MB/s 2024-09-10T08:40:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127657 s, 82.1 MB/s 2024-09-10T08:40:56.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167002 s, 62.8 MB/s 2024-09-10T08:40:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132199 s, 79.3 MB/s 2024-09-10T08:40:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127644 s, 82.1 MB/s 2024-09-10T08:40:56.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:57.004 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.8 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:57.005 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168883 s, 62.1 MB/s 2024-09-10T08:40:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133645 s, 78.5 MB/s 2024-09-10T08:40:57.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.141 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.141 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140056 s, 74.9 MB/s 2024-09-10T08:40:57.158 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142726 s, 73.5 MB/s 2024-09-10T08:40:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.177 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147635 s, 71.0 MB/s 2024-09-10T08:40:57.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.192 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.192 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127463 s, 82.3 MB/s 2024-09-10T08:40:57.212 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.213 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169019 s, 62.0 MB/s 2024-09-10T08:40:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129611 s, 80.9 MB/s 2024-09-10T08:40:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136944 s, 76.6 MB/s 2024-09-10T08:40:57.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.262 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.262 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140223 s, 74.8 MB/s 2024-09-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.282 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160156 s, 65.5 MB/s 2024-09-10T08:40:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.297 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126608 s, 82.8 MB/s 2024-09-10T08:40:57.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.316 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.316 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161711 s, 64.8 MB/s 2024-09-10T08:40:57.333 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.334 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139315 s, 75.3 MB/s 2024-09-10T08:40:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162975 s, 64.3 MB/s 2024-09-10T08:40:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137453 s, 76.3 MB/s 2024-09-10T08:40:57.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138858 s, 75.5 MB/s 2024-09-10T08:40:57.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.403 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134145 s, 78.2 MB/s 2024-09-10T08:40:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168347 s, 62.3 MB/s 2024-09-10T08:40:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140774 s, 74.5 MB/s 2024-09-10T08:40:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138449 s, 75.7 MB/s 2024-09-10T08:40:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.474 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144121 s, 72.8 MB/s 2024-09-10T08:40:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161784 s, 64.8 MB/s 2024-09-10T08:40:57.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156826 s, 66.9 MB/s 2024-09-10T08:40:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138738 s, 75.6 MB/s 2024-09-10T08:40:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137709 s, 76.1 MB/s 2024-09-10T08:40:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133463 s, 78.6 MB/s 2024-09-10T08:40:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133888 s, 78.3 MB/s 2024-09-10T08:40:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127788 s, 82.1 MB/s 2024-09-10T08:40:57.610 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.610 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.610 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127828 s, 82.0 MB/s 2024-09-10T08:40:57.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161724 s, 64.8 MB/s 2024-09-10T08:40:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.647 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144158 s, 72.7 MB/s 2024-09-10T08:40:57.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:57.655 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.9 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:57.656 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:57.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128239 s, 81.8 MB/s 2024-09-10T08:40:57.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136708 s, 76.7 MB/s 2024-09-10T08:40:57.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.790 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.790 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137179 s, 76.4 MB/s 2024-09-10T08:40:57.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.806 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.806 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131912 s, 79.5 MB/s 2024-09-10T08:40:57.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.826 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.826 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165079 s, 63.5 MB/s 2024-09-10T08:40:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131364 s, 79.8 MB/s 2024-09-10T08:40:57.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.859 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139246 s, 75.3 MB/s 2024-09-10T08:40:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133981 s, 78.3 MB/s 2024-09-10T08:40:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168092 s, 62.4 MB/s 2024-09-10T08:40:57.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.911 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136902 s, 76.6 MB/s 2024-09-10T08:40:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132184 s, 79.3 MB/s 2024-09-10T08:40:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134045 s, 78.2 MB/s 2024-09-10T08:40:57.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157376 s, 66.6 MB/s 2024-09-10T08:40:57.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136531 s, 76.8 MB/s 2024-09-10T08:40:57.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:57.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:57.996 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133302 s, 78.7 MB/s 2024-09-10T08:40:58.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013691 s, 76.6 MB/s 2024-09-10T08:40:58.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.029 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131165 s, 79.9 MB/s 2024-09-10T08:40:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131907 s, 79.5 MB/s 2024-09-10T08:40:58.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.062 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.062 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141918 s, 73.9 MB/s 2024-09-10T08:40:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160547 s, 65.3 MB/s 2024-09-10T08:40:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.098 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132329 s, 79.2 MB/s 2024-09-10T08:40:58.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.117 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160984 s, 65.1 MB/s 2024-09-10T08:40:58.133 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.134 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135142 s, 77.6 MB/s 2024-09-10T08:40:58.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013351 s, 78.5 MB/s 2024-09-10T08:40:58.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.164 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110536 s, 94.9 MB/s 2024-09-10T08:40:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012248 s, 85.6 MB/s 2024-09-10T08:40:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131081 s, 80.0 MB/s 2024-09-10T08:40:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.210 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012288 s, 85.3 MB/s 2024-09-10T08:40:58.227 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.228 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133381 s, 78.6 MB/s 2024-09-10T08:40:58.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.244 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135598 s, 77.3 MB/s 2024-09-10T08:40:58.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.260 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.260 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131381 s, 79.8 MB/s 2024-09-10T08:40:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.276 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128826 s, 81.4 MB/s 2024-09-10T08:40:58.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.10 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:58.285 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:58.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:58.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.385 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131891 s, 79.5 MB/s 2024-09-10T08:40:58.400 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.401 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013346 s, 78.6 MB/s 2024-09-10T08:40:58.416 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.417 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127955 s, 81.9 MB/s 2024-09-10T08:40:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.433 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135495 s, 77.4 MB/s 2024-09-10T08:40:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.449 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129178 s, 81.2 MB/s 2024-09-10T08:40:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163042 s, 64.3 MB/s 2024-09-10T08:40:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.487 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156218 s, 67.1 MB/s 2024-09-10T08:40:58.504 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.505 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135351 s, 77.5 MB/s 2024-09-10T08:40:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.520 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136208 s, 77.0 MB/s 2024-09-10T08:40:58.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.537 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137073 s, 76.5 MB/s 2024-09-10T08:40:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167025 s, 62.8 MB/s 2024-09-10T08:40:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.572 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128402 s, 81.7 MB/s 2024-09-10T08:40:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.588 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01285 s, 81.6 MB/s 2024-09-10T08:40:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164588 s, 63.7 MB/s 2024-09-10T08:40:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.627 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161482 s, 64.9 MB/s 2024-09-10T08:40:58.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.643 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128589 s, 81.5 MB/s 2024-09-10T08:40:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132536 s, 79.1 MB/s 2024-09-10T08:40:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.675 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131354 s, 79.8 MB/s 2024-09-10T08:40:58.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.692 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131856 s, 79.5 MB/s 2024-09-10T08:40:58.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.712 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.712 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171786 s, 61.0 MB/s 2024-09-10T08:40:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152371 s, 68.8 MB/s 2024-09-10T08:40:58.745 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120704 s, 86.9 MB/s 2024-09-10T08:40:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134836 s, 77.8 MB/s 2024-09-10T08:40:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167345 s, 62.7 MB/s 2024-09-10T08:40:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130995 s, 80.0 MB/s 2024-09-10T08:40:58.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.817 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.817 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155097 s, 67.6 MB/s 2024-09-10T08:40:58.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.832 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.832 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125537 s, 83.5 MB/s 2024-09-10T08:40:58.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.849 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135495 s, 77.4 MB/s 2024-09-10T08:40:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.865 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133872 s, 78.3 MB/s 2024-09-10T08:40:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.881 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125408 s, 83.6 MB/s 2024-09-10T08:40:58.896 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.897 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124682 s, 84.1 MB/s 2024-09-10T08:40:58.912 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:58.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:58.914 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128859 s, 81.4 MB/s 2024-09-10T08:40:58.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.11 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:58.922 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:59.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127862 s, 82.0 MB/s 2024-09-10T08:40:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162545 s, 64.5 MB/s 2024-09-10T08:40:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158106 s, 66.3 MB/s 2024-09-10T08:40:59.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.074 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.074 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012781 s, 82.0 MB/s 2024-09-10T08:40:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133775 s, 78.4 MB/s 2024-09-10T08:40:59.107 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.108 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.108 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136992 s, 76.5 MB/s 2024-09-10T08:40:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.124 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132976 s, 78.9 MB/s 2024-09-10T08:40:59.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.140 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.140 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125342 s, 83.7 MB/s 2024-09-10T08:40:59.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013288 s, 78.9 MB/s 2024-09-10T08:40:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129442 s, 81.0 MB/s 2024-09-10T08:40:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.191 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155709 s, 67.3 MB/s 2024-09-10T08:40:59.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.208 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.208 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142627 s, 73.5 MB/s 2024-09-10T08:40:59.224 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013125 s, 79.9 MB/s 2024-09-10T08:40:59.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.244 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.245 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167436 s, 62.6 MB/s 2024-09-10T08:40:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132197 s, 79.3 MB/s 2024-09-10T08:40:59.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.277 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.277 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132655 s, 79.0 MB/s 2024-09-10T08:40:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.293 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128014 s, 81.9 MB/s 2024-09-10T08:40:59.309 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.310 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137985 s, 76.0 MB/s 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135765 s, 77.2 MB/s 2024-09-10T08:40:59.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.343 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.343 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137104 s, 76.5 MB/s 2024-09-10T08:40:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135761 s, 77.2 MB/s 2024-09-10T08:40:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160186 s, 65.5 MB/s 2024-09-10T08:40:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.395 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126343 s, 83.0 MB/s 2024-09-10T08:40:59.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.411 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.411 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135684 s, 77.3 MB/s 2024-09-10T08:40:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.427 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129029 s, 81.3 MB/s 2024-09-10T08:40:59.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134317 s, 78.1 MB/s 2024-09-10T08:40:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136253 s, 77.0 MB/s 2024-09-10T08:40:59.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.477 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.477 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135307 s, 77.5 MB/s 2024-09-10T08:40:59.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.493 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128809 s, 81.4 MB/s 2024-09-10T08:40:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130301 s, 80.5 MB/s 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.526 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144124 s, 72.8 MB/s 2024-09-10T08:40:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015444 s, 67.9 MB/s 2024-09-10T08:40:59.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.12 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:40:59.559 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:40:59.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:40:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:40:59.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.659 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128955 s, 81.3 MB/s 2024-09-10T08:40:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.676 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131664 s, 79.6 MB/s 2024-09-10T08:40:59.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140213 s, 74.8 MB/s 2024-09-10T08:40:59.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.709 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.709 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138377 s, 75.8 MB/s 2024-09-10T08:40:59.729 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.730 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166601 s, 62.9 MB/s 2024-09-10T08:40:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.746 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134705 s, 77.8 MB/s 2024-09-10T08:40:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162365 s, 64.6 MB/s 2024-09-10T08:40:59.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.782 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.782 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132428 s, 79.2 MB/s 2024-09-10T08:40:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.798 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131517 s, 79.7 MB/s 2024-09-10T08:40:59.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.816 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.816 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151933 s, 69.0 MB/s 2024-09-10T08:40:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.833 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136641 s, 76.7 MB/s 2024-09-10T08:40:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.849 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129737 s, 80.8 MB/s 2024-09-10T08:40:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.866 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140647 s, 74.6 MB/s 2024-09-10T08:40:59.882 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.882 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.882 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129375 s, 81.0 MB/s 2024-09-10T08:40:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.898 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129242 s, 81.1 MB/s 2024-09-10T08:40:59.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.913 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.913 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116808 s, 89.8 MB/s 2024-09-10T08:40:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126713 s, 82.8 MB/s 2024-09-10T08:40:59.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.945 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135686 s, 77.3 MB/s 2024-09-10T08:40:59.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127486 s, 82.3 MB/s 2024-09-10T08:40:59.975 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.976 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121511 s, 86.3 MB/s 2024-09-10T08:40:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:40:59.992 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:40:59.993 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138115 s, 75.9 MB/s 2024-09-10T08:41:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132014 s, 79.4 MB/s 2024-09-10T08:41:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.025 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134489 s, 78.0 MB/s 2024-09-10T08:41:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140426 s, 74.7 MB/s 2024-09-10T08:41:00.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.060 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.060 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140812 s, 74.5 MB/s 2024-09-10T08:41:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.077 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135972 s, 77.1 MB/s 2024-09-10T08:41:00.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.095 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.095 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156405 s, 67.0 MB/s 2024-09-10T08:41:00.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.111 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135607 s, 77.3 MB/s 2024-09-10T08:41:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013255 s, 79.1 MB/s 2024-09-10T08:41:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119519 s, 87.7 MB/s 2024-09-10T08:41:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133111 s, 78.8 MB/s 2024-09-10T08:41:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136926 s, 76.6 MB/s 2024-09-10T08:41:00.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.13 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:00.185 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:00.186 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:00.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:00.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.285 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140427 s, 74.7 MB/s 2024-09-10T08:41:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.302 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138459 s, 75.7 MB/s 2024-09-10T08:41:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131904 s, 79.5 MB/s 2024-09-10T08:41:00.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.334 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.335 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136225 s, 77.0 MB/s 2024-09-10T08:41:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161006 s, 65.1 MB/s 2024-09-10T08:41:00.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137837 s, 76.1 MB/s 2024-09-10T08:41:00.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.387 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.387 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138147 s, 75.9 MB/s 2024-09-10T08:41:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139595 s, 75.1 MB/s 2024-09-10T08:41:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.421 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013512 s, 77.6 MB/s 2024-09-10T08:41:00.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.437 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134946 s, 77.7 MB/s 2024-09-10T08:41:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128281 s, 81.7 MB/s 2024-09-10T08:41:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.472 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156129 s, 67.2 MB/s 2024-09-10T08:41:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134651 s, 77.9 MB/s 2024-09-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.507 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161353 s, 65.0 MB/s 2024-09-10T08:41:00.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.525 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150142 s, 69.8 MB/s 2024-09-10T08:41:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131817 s, 79.5 MB/s 2024-09-10T08:41:00.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.557 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.557 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125514 s, 83.5 MB/s 2024-09-10T08:41:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124914 s, 83.9 MB/s 2024-09-10T08:41:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131066 s, 80.0 MB/s 2024-09-10T08:41:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.609 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172007 s, 61.0 MB/s 2024-09-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129788 s, 80.8 MB/s 2024-09-10T08:41:00.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.642 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013169 s, 79.6 MB/s 2024-09-10T08:41:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124557 s, 84.2 MB/s 2024-09-10T08:41:00.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125319 s, 83.7 MB/s 2024-09-10T08:41:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167591 s, 62.6 MB/s 2024-09-10T08:41:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.711 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156744 s, 66.9 MB/s 2024-09-10T08:41:00.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.727 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.728 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130379 s, 80.4 MB/s 2024-09-10T08:41:00.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.744 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.744 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131432 s, 79.8 MB/s 2024-09-10T08:41:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128698 s, 81.5 MB/s 2024-09-10T08:41:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01347 s, 77.8 MB/s 2024-09-10T08:41:00.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.793 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139505 s, 75.2 MB/s 2024-09-10T08:41:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.810 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137467 s, 76.3 MB/s 2024-09-10T08:41:00.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.14 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:00.819 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126209 s, 83.1 MB/s 2024-09-10T08:41:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01615 s, 64.9 MB/s 2024-09-10T08:41:00.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118218 s, 88.7 MB/s 2024-09-10T08:41:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.972 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157854 s, 66.4 MB/s 2024-09-10T08:41:00.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:00.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:00.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137439 s, 76.3 MB/s 2024-09-10T08:41:01.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.005 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129212 s, 81.2 MB/s 2024-09-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157267 s, 66.7 MB/s 2024-09-10T08:41:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107331 s, 97.7 MB/s 2024-09-10T08:41:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165329 s, 63.4 MB/s 2024-09-10T08:41:01.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133385 s, 78.6 MB/s 2024-09-10T08:41:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.090 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146828 s, 71.4 MB/s 2024-09-10T08:41:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126865 s, 82.7 MB/s 2024-09-10T08:41:01.124 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153026 s, 68.5 MB/s 2024-09-10T08:41:01.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.142 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.142 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149034 s, 70.4 MB/s 2024-09-10T08:41:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173855 s, 60.3 MB/s 2024-09-10T08:41:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.180 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144393 s, 72.6 MB/s 2024-09-10T08:41:01.195 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122829 s, 85.4 MB/s 2024-09-10T08:41:01.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.216 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168341 s, 62.3 MB/s 2024-09-10T08:41:01.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.232 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132495 s, 79.1 MB/s 2024-09-10T08:41:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132512 s, 79.1 MB/s 2024-09-10T08:41:01.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.268 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168575 s, 62.2 MB/s 2024-09-10T08:41:01.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135995 s, 77.1 MB/s 2024-09-10T08:41:01.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.302 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137522 s, 76.2 MB/s 2024-09-10T08:41:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.318 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131021 s, 80.0 MB/s 2024-09-10T08:41:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163602 s, 64.1 MB/s 2024-09-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132035 s, 79.4 MB/s 2024-09-10T08:41:01.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131018 s, 80.0 MB/s 2024-09-10T08:41:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135364 s, 77.5 MB/s 2024-09-10T08:41:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139478 s, 75.2 MB/s 2024-09-10T08:41:01.419 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.419 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.420 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131145 s, 80.0 MB/s 2024-09-10T08:41:01.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.436 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.436 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136574 s, 76.8 MB/s 2024-09-10T08:41:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141229 s, 74.2 MB/s 2024-09-10T08:41:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.15 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:01.462 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:01.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:01.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169818 s, 61.7 MB/s 2024-09-10T08:41:01.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.580 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.580 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127049 s, 82.5 MB/s 2024-09-10T08:41:01.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.596 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.596 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127516 s, 82.2 MB/s 2024-09-10T08:41:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135282 s, 77.5 MB/s 2024-09-10T08:41:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.633 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168252 s, 62.3 MB/s 2024-09-10T08:41:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.653 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170112 s, 61.6 MB/s 2024-09-10T08:41:01.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.669 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.669 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130508 s, 80.3 MB/s 2024-09-10T08:41:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136394 s, 76.9 MB/s 2024-09-10T08:41:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.702 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136237 s, 77.0 MB/s 2024-09-10T08:41:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177446 s, 59.1 MB/s 2024-09-10T08:41:01.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.740 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.740 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137824 s, 76.1 MB/s 2024-09-10T08:41:01.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.760 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.760 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170058 s, 61.7 MB/s 2024-09-10T08:41:01.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.777 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.777 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135149 s, 77.6 MB/s 2024-09-10T08:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-10T08:41:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133904 s, 78.3 MB/s 2024-09-10T08:41:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.825 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117925 s, 88.9 MB/s 2024-09-10T08:41:01.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134709 s, 77.8 MB/s 2024-09-10T08:41:01.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133868 s, 78.3 MB/s 2024-09-10T08:41:01.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.874 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134229 s, 78.1 MB/s 2024-09-10T08:41:01.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131279 s, 79.9 MB/s 2024-09-10T08:41:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.907 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134765 s, 77.8 MB/s 2024-09-10T08:41:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.924 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138879 s, 75.5 MB/s 2024-09-10T08:41:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156391 s, 67.0 MB/s 2024-09-10T08:41:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134884 s, 77.7 MB/s 2024-09-10T08:41:01.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113045 s, 92.8 MB/s 2024-09-10T08:41:01.990 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:01.991 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:01.991 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135029 s, 77.7 MB/s 2024-09-10T08:41:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131522 s, 79.7 MB/s 2024-09-10T08:41:02.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.023 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.023 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133374 s, 78.6 MB/s 2024-09-10T08:41:02.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.039 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.039 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135159 s, 77.6 MB/s 2024-09-10T08:41:02.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.056 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.056 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131451 s, 79.8 MB/s 2024-09-10T08:41:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.075 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162271 s, 64.6 MB/s 2024-09-10T08:41:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016027 s, 65.4 MB/s 2024-09-10T08:41:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:02.103 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:02.103 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:02.103 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.16 2024-09-10T08:41:02.104 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:02.104 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:02.104 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:02.104 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:02.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.203 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129909 s, 80.7 MB/s 2024-09-10T08:41:02.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134562 s, 77.9 MB/s 2024-09-10T08:41:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.236 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129917 s, 80.7 MB/s 2024-09-10T08:41:02.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013726 s, 76.4 MB/s 2024-09-10T08:41:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153413 s, 68.3 MB/s 2024-09-10T08:41:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131097 s, 80.0 MB/s 2024-09-10T08:41:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137352 s, 76.3 MB/s 2024-09-10T08:41:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130116 s, 80.6 MB/s 2024-09-10T08:41:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017 s, 61.7 MB/s 2024-09-10T08:41:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.355 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131547 s, 79.7 MB/s 2024-09-10T08:41:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.374 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158363 s, 66.2 MB/s 2024-09-10T08:41:02.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.394 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.395 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017165 s, 61.1 MB/s 2024-09-10T08:41:02.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.410 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.410 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124838 s, 84.0 MB/s 2024-09-10T08:41:02.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.426 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.426 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131478 s, 79.8 MB/s 2024-09-10T08:41:02.442 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.443 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013318 s, 78.7 MB/s 2024-09-10T08:41:02.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138417 s, 75.8 MB/s 2024-09-10T08:41:02.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.476 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.476 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136834 s, 76.6 MB/s 2024-09-10T08:41:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128591 s, 81.5 MB/s 2024-09-10T08:41:02.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132318 s, 79.2 MB/s 2024-09-10T08:41:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169754 s, 61.8 MB/s 2024-09-10T08:41:02.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.545 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135404 s, 77.4 MB/s 2024-09-10T08:41:02.561 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130978 s, 80.1 MB/s 2024-09-10T08:41:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135191 s, 77.6 MB/s 2024-09-10T08:41:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136769 s, 76.7 MB/s 2024-09-10T08:41:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141263 s, 74.2 MB/s 2024-09-10T08:41:02.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.628 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135259 s, 77.5 MB/s 2024-09-10T08:41:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.648 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164906 s, 63.6 MB/s 2024-09-10T08:41:02.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.664 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.664 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128537 s, 81.6 MB/s 2024-09-10T08:41:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167433 s, 62.6 MB/s 2024-09-10T08:41:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134992 s, 77.7 MB/s 2024-09-10T08:41:02.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.716 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.716 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134282 s, 78.1 MB/s 2024-09-10T08:41:02.733 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014059 s, 74.6 MB/s 2024-09-10T08:41:02.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.17 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:02.743 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:02.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:02.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.842 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.842 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135358 s, 77.5 MB/s 2024-09-10T08:41:02.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.858 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.859 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133018 s, 78.8 MB/s 2024-09-10T08:41:02.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.875 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.875 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136473 s, 76.8 MB/s 2024-09-10T08:41:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.891 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133209 s, 78.7 MB/s 2024-09-10T08:41:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.908 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135124 s, 77.6 MB/s 2024-09-10T08:41:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133694 s, 78.4 MB/s 2024-09-10T08:41:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137864 s, 76.1 MB/s 2024-09-10T08:41:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137346 s, 76.3 MB/s 2024-09-10T08:41:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134337 s, 78.1 MB/s 2024-09-10T08:41:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129526 s, 81.0 MB/s 2024-09-10T08:41:03.007 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140298 s, 74.7 MB/s 2024-09-10T08:41:03.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137713 s, 76.1 MB/s 2024-09-10T08:41:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136325 s, 76.9 MB/s 2024-09-10T08:41:03.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.057 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131049 s, 80.0 MB/s 2024-09-10T08:41:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124672 s, 84.1 MB/s 2024-09-10T08:41:03.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.093 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.093 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171216 s, 61.2 MB/s 2024-09-10T08:41:03.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.110 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.110 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013708 s, 76.5 MB/s 2024-09-10T08:41:03.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165621 s, 63.3 MB/s 2024-09-10T08:41:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.145 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126821 s, 82.7 MB/s 2024-09-10T08:41:03.162 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.163 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.163 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146499 s, 71.6 MB/s 2024-09-10T08:41:03.178 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.179 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.179 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127764 s, 82.1 MB/s 2024-09-10T08:41:03.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151731 s, 69.1 MB/s 2024-09-10T08:41:03.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.214 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.214 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142498 s, 73.6 MB/s 2024-09-10T08:41:03.230 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.231 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134436 s, 78.0 MB/s 2024-09-10T08:41:03.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.247 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.247 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013625 s, 77.0 MB/s 2024-09-10T08:41:03.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.267 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016732 s, 62.7 MB/s 2024-09-10T08:41:03.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013915 s, 75.4 MB/s 2024-09-10T08:41:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136901 s, 76.6 MB/s 2024-09-10T08:41:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166614 s, 62.9 MB/s 2024-09-10T08:41:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133952 s, 78.3 MB/s 2024-09-10T08:41:03.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127634 s, 82.2 MB/s 2024-09-10T08:41:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137336 s, 76.4 MB/s 2024-09-10T08:41:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.18 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:03.379 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:03.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:03.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.478 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.478 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134465 s, 78.0 MB/s 2024-09-10T08:41:03.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.494 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.494 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126204 s, 83.1 MB/s 2024-09-10T08:41:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.509 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115555 s, 90.7 MB/s 2024-09-10T08:41:03.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.525 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.525 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137153 s, 76.5 MB/s 2024-09-10T08:41:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140974 s, 74.4 MB/s 2024-09-10T08:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140489 s, 74.6 MB/s 2024-09-10T08:41:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.576 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133097 s, 78.8 MB/s 2024-09-10T08:41:03.594 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.594 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.594 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150162 s, 69.8 MB/s 2024-09-10T08:41:03.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.614 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.614 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176446 s, 59.4 MB/s 2024-09-10T08:41:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.634 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165987 s, 63.2 MB/s 2024-09-10T08:41:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132539 s, 79.1 MB/s 2024-09-10T08:41:03.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.666 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.666 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131991 s, 79.4 MB/s 2024-09-10T08:41:03.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.685 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.685 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154436 s, 67.9 MB/s 2024-09-10T08:41:03.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.701 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.701 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130034 s, 80.6 MB/s 2024-09-10T08:41:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.718 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137161 s, 76.4 MB/s 2024-09-10T08:41:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128589 s, 81.5 MB/s 2024-09-10T08:41:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.751 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132763 s, 79.0 MB/s 2024-09-10T08:41:03.767 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.768 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135875 s, 77.2 MB/s 2024-09-10T08:41:03.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.787 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.787 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160115 s, 65.5 MB/s 2024-09-10T08:41:03.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.803 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.803 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137357 s, 76.3 MB/s 2024-09-10T08:41:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138819 s, 75.5 MB/s 2024-09-10T08:41:03.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.836 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.837 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131963 s, 79.5 MB/s 2024-09-10T08:41:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.854 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145135 s, 72.2 MB/s 2024-09-10T08:41:03.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142099 s, 73.8 MB/s 2024-09-10T08:41:03.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.887 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.887 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128367 s, 81.7 MB/s 2024-09-10T08:41:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137802 s, 76.1 MB/s 2024-09-10T08:41:03.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140011 s, 74.9 MB/s 2024-09-10T08:41:03.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012709 s, 82.5 MB/s 2024-09-10T08:41:03.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.952 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127177 s, 82.5 MB/s 2024-09-10T08:41:03.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.973 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.973 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168341 s, 62.3 MB/s 2024-09-10T08:41:03.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:03.988 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:03.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130005 s, 80.7 MB/s 2024-09-10T08:41:04.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.006 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.007 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015012 s, 69.8 MB/s 2024-09-10T08:41:04.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.19 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:04.016 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:04.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:04.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.116 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140524 s, 74.6 MB/s 2024-09-10T08:41:04.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.133 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136224 s, 77.0 MB/s 2024-09-10T08:41:04.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135545 s, 77.4 MB/s 2024-09-10T08:41:04.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128371 s, 81.7 MB/s 2024-09-10T08:41:04.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.181 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132871 s, 78.9 MB/s 2024-09-10T08:41:04.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012948 s, 81.0 MB/s 2024-09-10T08:41:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.217 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168543 s, 62.2 MB/s 2024-09-10T08:41:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013702 s, 76.5 MB/s 2024-09-10T08:41:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131877 s, 79.5 MB/s 2024-09-10T08:41:04.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.267 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.267 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140214 s, 74.8 MB/s 2024-09-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136587 s, 76.8 MB/s 2024-09-10T08:41:04.300 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133893 s, 78.3 MB/s 2024-09-10T08:41:04.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.320 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157022 s, 66.8 MB/s 2024-09-10T08:41:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137724 s, 76.1 MB/s 2024-09-10T08:41:04.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164121 s, 63.9 MB/s 2024-09-10T08:41:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158402 s, 66.2 MB/s 2024-09-10T08:41:04.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.391 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.391 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134067 s, 78.2 MB/s 2024-09-10T08:41:04.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139987 s, 74.9 MB/s 2024-09-10T08:41:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165655 s, 63.3 MB/s 2024-09-10T08:41:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131279 s, 79.9 MB/s 2024-09-10T08:41:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137643 s, 76.2 MB/s 2024-09-10T08:41:04.480 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.481 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.481 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163765 s, 64.0 MB/s 2024-09-10T08:41:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.497 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137497 s, 76.3 MB/s 2024-09-10T08:41:04.515 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.516 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153784 s, 68.2 MB/s 2024-09-10T08:41:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137365 s, 76.3 MB/s 2024-09-10T08:41:04.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013292 s, 78.9 MB/s 2024-09-10T08:41:04.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.565 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.565 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127143 s, 82.5 MB/s 2024-09-10T08:41:04.581 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.581 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.581 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127812 s, 82.0 MB/s 2024-09-10T08:41:04.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.598 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.598 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134349 s, 78.0 MB/s 2024-09-10T08:41:04.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.622 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.622 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197021 s, 53.2 MB/s 2024-09-10T08:41:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.639 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140303 s, 74.7 MB/s 2024-09-10T08:41:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.654 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127447 s, 82.3 MB/s 2024-09-10T08:41:04.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:04.663 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.20 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:04.664 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:04.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:04.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.764 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.764 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130512 s, 80.3 MB/s 2024-09-10T08:41:04.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.780 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.780 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132948 s, 78.9 MB/s 2024-09-10T08:41:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137263 s, 76.4 MB/s 2024-09-10T08:41:04.812 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.813 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127736 s, 82.1 MB/s 2024-09-10T08:41:04.828 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.829 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.829 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012783 s, 82.0 MB/s 2024-09-10T08:41:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.848 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161265 s, 65.0 MB/s 2024-09-10T08:41:04.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.864 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.864 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130287 s, 80.5 MB/s 2024-09-10T08:41:04.882 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159012 s, 65.9 MB/s 2024-09-10T08:41:04.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.899 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.899 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130234 s, 80.5 MB/s 2024-09-10T08:41:04.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.915 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.916 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134041 s, 78.2 MB/s 2024-09-10T08:41:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.934 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.935 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160154 s, 65.5 MB/s 2024-09-10T08:41:04.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.953 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158441 s, 66.2 MB/s 2024-09-10T08:41:04.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013899 s, 75.4 MB/s 2024-09-10T08:41:04.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:04.986 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:04.986 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013518 s, 77.6 MB/s 2024-09-10T08:41:05.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.003 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.003 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133216 s, 78.7 MB/s 2024-09-10T08:41:05.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.021 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144007 s, 72.8 MB/s 2024-09-10T08:41:05.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.037 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.037 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132378 s, 79.2 MB/s 2024-09-10T08:41:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127328 s, 82.4 MB/s 2024-09-10T08:41:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.069 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136317 s, 76.9 MB/s 2024-09-10T08:41:05.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.085 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127429 s, 82.3 MB/s 2024-09-10T08:41:05.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.101 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124509 s, 84.2 MB/s 2024-09-10T08:41:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128455 s, 81.6 MB/s 2024-09-10T08:41:05.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.132 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.132 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125581 s, 83.5 MB/s 2024-09-10T08:41:05.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162449 s, 64.5 MB/s 2024-09-10T08:41:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129373 s, 81.1 MB/s 2024-09-10T08:41:05.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.184 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.184 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134323 s, 78.1 MB/s 2024-09-10T08:41:05.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.201 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013569 s, 77.3 MB/s 2024-09-10T08:41:05.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.219 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.219 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155567 s, 67.4 MB/s 2024-09-10T08:41:05.236 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143092 s, 73.3 MB/s 2024-09-10T08:41:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126187 s, 83.1 MB/s 2024-09-10T08:41:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.272 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171402 s, 61.2 MB/s 2024-09-10T08:41:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.289 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138093 s, 75.9 MB/s 2024-09-10T08:41:05.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:05.298 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:05.298 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:05.299 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.21 2024-09-10T08:41:05.299 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:05.299 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:05.299 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:05.299 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:05.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.398 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135176 s, 77.6 MB/s 2024-09-10T08:41:05.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.414 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138957 s, 75.5 MB/s 2024-09-10T08:41:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.431 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137579 s, 76.2 MB/s 2024-09-10T08:41:05.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.447 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.447 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127421 s, 82.3 MB/s 2024-09-10T08:41:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173394 s, 60.5 MB/s 2024-09-10T08:41:05.484 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.485 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.485 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137921 s, 76.0 MB/s 2024-09-10T08:41:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.500 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127129 s, 82.5 MB/s 2024-09-10T08:41:05.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.516 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.517 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132276 s, 79.3 MB/s 2024-09-10T08:41:05.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.532 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01296 s, 80.9 MB/s 2024-09-10T08:41:05.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.549 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.549 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134974 s, 77.7 MB/s 2024-09-10T08:41:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.566 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142429 s, 73.6 MB/s 2024-09-10T08:41:05.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.583 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.583 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133637 s, 78.5 MB/s 2024-09-10T08:41:05.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.599 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.599 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135752 s, 77.2 MB/s 2024-09-10T08:41:05.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.616 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.616 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134504 s, 78.0 MB/s 2024-09-10T08:41:05.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.632 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.632 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134218 s, 78.1 MB/s 2024-09-10T08:41:05.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.649 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138755 s, 75.6 MB/s 2024-09-10T08:41:05.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126244 s, 83.1 MB/s 2024-09-10T08:41:05.681 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135099 s, 77.6 MB/s 2024-09-10T08:41:05.698 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.699 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138038 s, 76.0 MB/s 2024-09-10T08:41:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016916 s, 62.0 MB/s 2024-09-10T08:41:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.736 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143652 s, 73.0 MB/s 2024-09-10T08:41:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135284 s, 77.5 MB/s 2024-09-10T08:41:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.769 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132027 s, 79.4 MB/s 2024-09-10T08:41:05.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.786 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.786 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134775 s, 77.8 MB/s 2024-09-10T08:41:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.802 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134695 s, 77.8 MB/s 2024-09-10T08:41:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166023 s, 63.2 MB/s 2024-09-10T08:41:05.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.839 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136237 s, 77.0 MB/s 2024-09-10T08:41:05.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.857 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.857 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154957 s, 67.7 MB/s 2024-09-10T08:41:05.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127872 s, 82.0 MB/s 2024-09-10T08:41:05.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.889 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013464 s, 77.9 MB/s 2024-09-10T08:41:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136492 s, 76.8 MB/s 2024-09-10T08:41:05.920 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:05.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:05.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114711 s, 91.4 MB/s 2024-09-10T08:41:05.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:05.929 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:05.929 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:05.930 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.22 2024-09-10T08:41:05.930 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:05.930 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:05.930 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:05.930 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:06.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.031 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015938 s, 65.8 MB/s 2024-09-10T08:41:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.048 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133942 s, 78.3 MB/s 2024-09-10T08:41:06.064 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136294 s, 76.9 MB/s 2024-09-10T08:41:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013127 s, 79.9 MB/s 2024-09-10T08:41:06.097 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.097 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.097 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134968 s, 77.7 MB/s 2024-09-10T08:41:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.113 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129297 s, 81.1 MB/s 2024-09-10T08:41:06.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130132 s, 80.6 MB/s 2024-09-10T08:41:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.148 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164485 s, 63.7 MB/s 2024-09-10T08:41:06.164 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132097 s, 79.4 MB/s 2024-09-10T08:41:06.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014006 s, 74.9 MB/s 2024-09-10T08:41:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161339 s, 65.0 MB/s 2024-09-10T08:41:06.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.218 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.218 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142367 s, 73.7 MB/s 2024-09-10T08:41:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.234 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126904 s, 82.6 MB/s 2024-09-10T08:41:06.249 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126391 s, 83.0 MB/s 2024-09-10T08:41:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159108 s, 65.9 MB/s 2024-09-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.285 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129949 s, 80.7 MB/s 2024-09-10T08:41:06.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.302 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.302 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136492 s, 76.8 MB/s 2024-09-10T08:41:06.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.318 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.318 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134113 s, 78.2 MB/s 2024-09-10T08:41:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163495 s, 64.1 MB/s 2024-09-10T08:41:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127118 s, 82.5 MB/s 2024-09-10T08:41:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.370 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136109 s, 77.0 MB/s 2024-09-10T08:41:06.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.386 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133451 s, 78.6 MB/s 2024-09-10T08:41:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133802 s, 78.4 MB/s 2024-09-10T08:41:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.422 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.423 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169558 s, 61.8 MB/s 2024-09-10T08:41:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.439 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.440 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138018 s, 76.0 MB/s 2024-09-10T08:41:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.455 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126446 s, 82.9 MB/s 2024-09-10T08:41:06.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.475 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.475 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167172 s, 62.7 MB/s 2024-09-10T08:41:06.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.492 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135567 s, 77.3 MB/s 2024-09-10T08:41:06.507 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130392 s, 80.4 MB/s 2024-09-10T08:41:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.524 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133149 s, 78.8 MB/s 2024-09-10T08:41:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159807 s, 65.6 MB/s 2024-09-10T08:41:06.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153967 s, 68.1 MB/s 2024-09-10T08:41:06.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:06.571 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:06.571 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:06.572 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.23 2024-09-10T08:41:06.572 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:06.572 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:06.572 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:06.572 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:06.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:06.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164967 s, 63.6 MB/s 2024-09-10T08:41:06.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.688 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.688 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117677 s, 89.1 MB/s 2024-09-10T08:41:06.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.704 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.704 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127907 s, 82.0 MB/s 2024-09-10T08:41:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139675 s, 75.1 MB/s 2024-09-10T08:41:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013679 s, 76.7 MB/s 2024-09-10T08:41:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132579 s, 79.1 MB/s 2024-09-10T08:41:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.771 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137841 s, 76.1 MB/s 2024-09-10T08:41:06.787 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137328 s, 76.4 MB/s 2024-09-10T08:41:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.804 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133132 s, 78.8 MB/s 2024-09-10T08:41:06.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.821 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.821 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140796 s, 74.5 MB/s 2024-09-10T08:41:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137786 s, 76.1 MB/s 2024-09-10T08:41:06.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.855 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.855 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135104 s, 77.6 MB/s 2024-09-10T08:41:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130836 s, 80.1 MB/s 2024-09-10T08:41:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.889 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156224 s, 67.1 MB/s 2024-09-10T08:41:06.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.906 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135646 s, 77.3 MB/s 2024-09-10T08:41:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131566 s, 79.7 MB/s 2024-09-10T08:41:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.937 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117157 s, 89.5 MB/s 2024-09-10T08:41:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129494 s, 81.0 MB/s 2024-09-10T08:41:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.972 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158361 s, 66.2 MB/s 2024-09-10T08:41:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:06.988 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130161 s, 80.6 MB/s 2024-09-10T08:41:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134449 s, 78.0 MB/s 2024-09-10T08:41:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.020 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123095 s, 85.2 MB/s 2024-09-10T08:41:07.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.036 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.036 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133186 s, 78.7 MB/s 2024-09-10T08:41:07.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.052 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.052 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013146 s, 79.8 MB/s 2024-09-10T08:41:07.069 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.072 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.072 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129711 s, 80.8 MB/s 2024-09-10T08:41:07.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.084 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.085 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128575 s, 81.6 MB/s 2024-09-10T08:41:07.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.101 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.101 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139852 s, 75.0 MB/s 2024-09-10T08:41:07.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.118 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.118 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136003 s, 77.1 MB/s 2024-09-10T08:41:07.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.135 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.135 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143902 s, 72.9 MB/s 2024-09-10T08:41:07.151 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.152 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133024 s, 78.8 MB/s 2024-09-10T08:41:07.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.168 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.168 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013838 s, 75.8 MB/s 2024-09-10T08:41:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017782 s, 59.0 MB/s 2024-09-10T08:41:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.24 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:07.202 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:07.203 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:07.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134761 s, 77.8 MB/s 2024-09-10T08:41:07.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.320 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.320 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016379 s, 64.0 MB/s 2024-09-10T08:41:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013048 s, 80.4 MB/s 2024-09-10T08:41:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134013 s, 78.2 MB/s 2024-09-10T08:41:07.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.369 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.369 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131747 s, 79.6 MB/s 2024-09-10T08:41:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.385 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.386 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132719 s, 79.0 MB/s 2024-09-10T08:41:07.401 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.402 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133278 s, 78.7 MB/s 2024-09-10T08:41:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128063 s, 81.9 MB/s 2024-09-10T08:41:07.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171725 s, 61.1 MB/s 2024-09-10T08:41:07.456 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.457 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016145 s, 64.9 MB/s 2024-09-10T08:41:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.473 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134433 s, 78.0 MB/s 2024-09-10T08:41:07.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.490 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.490 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138315 s, 75.8 MB/s 2024-09-10T08:41:07.509 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.510 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161912 s, 64.8 MB/s 2024-09-10T08:41:07.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.529 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.529 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170062 s, 61.7 MB/s 2024-09-10T08:41:07.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.546 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.546 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133681 s, 78.4 MB/s 2024-09-10T08:41:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.562 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127805 s, 82.0 MB/s 2024-09-10T08:41:07.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134808 s, 77.8 MB/s 2024-09-10T08:41:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.596 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135203 s, 77.6 MB/s 2024-09-10T08:41:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.612 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138835 s, 75.5 MB/s 2024-09-10T08:41:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.627 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119859 s, 87.5 MB/s 2024-09-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.643 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128516 s, 81.6 MB/s 2024-09-10T08:41:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.659 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126561 s, 82.9 MB/s 2024-09-10T08:41:07.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.675 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127605 s, 82.2 MB/s 2024-09-10T08:41:07.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.691 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.691 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130979 s, 80.1 MB/s 2024-09-10T08:41:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.706 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.707 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127553 s, 82.2 MB/s 2024-09-10T08:41:07.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.723 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.723 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134251 s, 78.1 MB/s 2024-09-10T08:41:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129318 s, 81.1 MB/s 2024-09-10T08:41:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134696 s, 77.8 MB/s 2024-09-10T08:41:07.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132821 s, 78.9 MB/s 2024-09-10T08:41:07.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139671 s, 75.1 MB/s 2024-09-10T08:41:07.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131973 s, 79.5 MB/s 2024-09-10T08:41:07.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136174 s, 77.0 MB/s 2024-09-10T08:41:07.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.25 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:07.832 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:07.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.931 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013708 s, 76.5 MB/s 2024-09-10T08:41:07.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.947 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.947 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131178 s, 79.9 MB/s 2024-09-10T08:41:07.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.963 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.963 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131981 s, 79.4 MB/s 2024-09-10T08:41:07.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.979 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.979 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132467 s, 79.2 MB/s 2024-09-10T08:41:07.996 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:07.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:07.997 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138009 s, 76.0 MB/s 2024-09-10T08:41:08.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:08.004 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.012 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.013 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131391 s, 79.8 MB/s 2024-09-10T08:41:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140449 s, 74.7 MB/s 2024-09-10T08:41:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.046 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130069 s, 80.6 MB/s 2024-09-10T08:41:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.063 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141137 s, 74.3 MB/s 2024-09-10T08:41:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.079 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131967 s, 79.5 MB/s 2024-09-10T08:41:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.096 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136609 s, 76.8 MB/s 2024-09-10T08:41:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.113 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136959 s, 76.6 MB/s 2024-09-10T08:41:08.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.129 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.129 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135854 s, 77.2 MB/s 2024-09-10T08:41:08.145 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.146 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133304 s, 78.7 MB/s 2024-09-10T08:41:08.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.165 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.165 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163972 s, 63.9 MB/s 2024-09-10T08:41:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.181 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128683 s, 81.5 MB/s 2024-09-10T08:41:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130015 s, 80.7 MB/s 2024-09-10T08:41:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154403 s, 67.9 MB/s 2024-09-10T08:41:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.235 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166236 s, 63.1 MB/s 2024-09-10T08:41:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.252 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142777 s, 73.4 MB/s 2024-09-10T08:41:08.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147765 s, 71.0 MB/s 2024-09-10T08:41:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016619 s, 63.1 MB/s 2024-09-10T08:41:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133852 s, 78.3 MB/s 2024-09-10T08:41:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131893 s, 79.5 MB/s 2024-09-10T08:41:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136028 s, 77.1 MB/s 2024-09-10T08:41:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133883 s, 78.3 MB/s 2024-09-10T08:41:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.371 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.372 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013047 s, 80.4 MB/s 2024-09-10T08:41:08.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.388 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134986 s, 77.7 MB/s 2024-09-10T08:41:08.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.408 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.408 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165217 s, 63.5 MB/s 2024-09-10T08:41:08.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.424 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.424 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130803 s, 80.2 MB/s 2024-09-10T08:41:08.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.441 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.441 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139832 s, 75.0 MB/s 2024-09-10T08:41:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164936 s, 63.6 MB/s 2024-09-10T08:41:08.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:08.469 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.26 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:08.470 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.608 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135691 s, 77.3 MB/s 2024-09-10T08:41:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128059 s, 81.9 MB/s 2024-09-10T08:41:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137921 s, 76.0 MB/s 2024-09-10T08:41:08.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.657 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.657 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129883 s, 80.7 MB/s 2024-09-10T08:41:08.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.673 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.673 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134539 s, 77.9 MB/s 2024-09-10T08:41:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.690 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135784 s, 77.2 MB/s 2024-09-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.705 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123927 s, 84.6 MB/s 2024-09-10T08:41:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01278 s, 82.0 MB/s 2024-09-10T08:41:08.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.737 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.737 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127685 s, 82.1 MB/s 2024-09-10T08:41:08.753 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.754 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.754 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134976 s, 77.7 MB/s 2024-09-10T08:41:08.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.774 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.774 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168195 s, 62.3 MB/s 2024-09-10T08:41:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124026 s, 84.5 MB/s 2024-09-10T08:41:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162611 s, 64.5 MB/s 2024-09-10T08:41:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131507 s, 79.7 MB/s 2024-09-10T08:41:08.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.841 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136705 s, 76.7 MB/s 2024-09-10T08:41:08.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.861 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.861 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162626 s, 64.5 MB/s 2024-09-10T08:41:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.877 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137219 s, 76.4 MB/s 2024-09-10T08:41:08.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.893 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.893 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130858 s, 80.1 MB/s 2024-09-10T08:41:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.910 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134713 s, 77.8 MB/s 2024-09-10T08:41:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143597 s, 73.0 MB/s 2024-09-10T08:41:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.944 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133704 s, 78.4 MB/s 2024-09-10T08:41:08.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.961 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132114 s, 79.4 MB/s 2024-09-10T08:41:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.977 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134495 s, 78.0 MB/s 2024-09-10T08:41:08.993 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:08.994 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134664 s, 77.9 MB/s 2024-09-10T08:41:09.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.009 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.010 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126902 s, 82.6 MB/s 2024-09-10T08:41:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.026 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138964 s, 75.5 MB/s 2024-09-10T08:41:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.043 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138004 s, 76.0 MB/s 2024-09-10T08:41:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.059 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131781 s, 79.6 MB/s 2024-09-10T08:41:09.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.078 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.078 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156136 s, 67.2 MB/s 2024-09-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127681 s, 82.1 MB/s 2024-09-10T08:41:09.111 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.112 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142549 s, 73.6 MB/s 2024-09-10T08:41:09.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.128 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.128 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132536 s, 79.1 MB/s 2024-09-10T08:41:09.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.27 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:09.138 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:09.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129832 s, 80.8 MB/s 2024-09-10T08:41:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144937 s, 72.3 MB/s 2024-09-10T08:41:09.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132782 s, 79.0 MB/s 2024-09-10T08:41:09.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.286 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.286 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124644 s, 84.1 MB/s 2024-09-10T08:41:09.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.301 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.301 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127826 s, 82.0 MB/s 2024-09-10T08:41:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.321 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134917 s, 77.7 MB/s 2024-09-10T08:41:09.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.335 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.335 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139594 s, 75.1 MB/s 2024-09-10T08:41:09.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.351 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.351 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126385 s, 83.0 MB/s 2024-09-10T08:41:09.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.367 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.367 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131313 s, 79.9 MB/s 2024-09-10T08:41:09.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.383 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.383 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128366 s, 81.7 MB/s 2024-09-10T08:41:09.402 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.403 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.403 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162703 s, 64.4 MB/s 2024-09-10T08:41:09.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.418 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.418 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129739 s, 80.8 MB/s 2024-09-10T08:41:09.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.434 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.434 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127116 s, 82.5 MB/s 2024-09-10T08:41:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125856 s, 83.3 MB/s 2024-09-10T08:41:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.465 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125882 s, 83.3 MB/s 2024-09-10T08:41:09.481 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.482 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131309 s, 79.9 MB/s 2024-09-10T08:41:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169425 s, 61.9 MB/s 2024-09-10T08:41:09.521 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.522 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.522 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166581 s, 62.9 MB/s 2024-09-10T08:41:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145988 s, 71.8 MB/s 2024-09-10T08:41:09.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.555 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.555 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012795 s, 82.0 MB/s 2024-09-10T08:41:09.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.570 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.571 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122229 s, 85.8 MB/s 2024-09-10T08:41:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.589 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153153 s, 68.5 MB/s 2024-09-10T08:41:09.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.608 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155137 s, 67.6 MB/s 2024-09-10T08:41:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141573 s, 74.1 MB/s 2024-09-10T08:41:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130281 s, 80.5 MB/s 2024-09-10T08:41:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.658 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134812 s, 77.8 MB/s 2024-09-10T08:41:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013316 s, 78.7 MB/s 2024-09-10T08:41:09.692 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.693 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140377 s, 74.7 MB/s 2024-09-10T08:41:09.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.708 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.708 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129034 s, 81.3 MB/s 2024-09-10T08:41:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135165 s, 77.6 MB/s 2024-09-10T08:41:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.743 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.743 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135086 s, 77.6 MB/s 2024-09-10T08:41:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111968 s, 93.6 MB/s 2024-09-10T08:41:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.28 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:09.765 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:09.766 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:09.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.868 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164777 s, 63.6 MB/s 2024-09-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.884 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132088 s, 79.4 MB/s 2024-09-10T08:41:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132588 s, 79.1 MB/s 2024-09-10T08:41:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.917 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132611 s, 79.1 MB/s 2024-09-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.933 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133275 s, 78.7 MB/s 2024-09-10T08:41:09.949 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.950 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.950 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136782 s, 76.7 MB/s 2024-09-10T08:41:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.966 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133951 s, 78.3 MB/s 2024-09-10T08:41:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:09.982 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133623 s, 78.5 MB/s 2024-09-10T08:41:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:09.999 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.000 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140627 s, 74.6 MB/s 2024-09-10T08:41:10.018 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.019 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156687 s, 66.9 MB/s 2024-09-10T08:41:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.034 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128809 s, 81.4 MB/s 2024-09-10T08:41:10.050 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.051 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133153 s, 78.7 MB/s 2024-09-10T08:41:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128797 s, 81.4 MB/s 2024-09-10T08:41:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.083 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013167 s, 79.6 MB/s 2024-09-10T08:41:10.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.098 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.098 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126075 s, 83.2 MB/s 2024-09-10T08:41:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.115 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136892 s, 76.6 MB/s 2024-09-10T08:41:10.137 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172634 s, 60.7 MB/s 2024-09-10T08:41:10.149 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.150 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.150 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111007 s, 94.5 MB/s 2024-09-10T08:41:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.166 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128653 s, 81.5 MB/s 2024-09-10T08:41:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.182 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136119 s, 77.0 MB/s 2024-09-10T08:41:10.199 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.200 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143571 s, 73.0 MB/s 2024-09-10T08:41:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.216 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136994 s, 76.5 MB/s 2024-09-10T08:41:10.232 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.233 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132308 s, 79.3 MB/s 2024-09-10T08:41:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.250 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143779 s, 72.9 MB/s 2024-09-10T08:41:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172383 s, 60.8 MB/s 2024-09-10T08:41:10.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138065 s, 75.9 MB/s 2024-09-10T08:41:10.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126223 s, 83.1 MB/s 2024-09-10T08:41:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132937 s, 78.9 MB/s 2024-09-10T08:41:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138597 s, 75.7 MB/s 2024-09-10T08:41:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130953 s, 80.1 MB/s 2024-09-10T08:41:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012731 s, 82.4 MB/s 2024-09-10T08:41:10.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.384 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.384 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136726 s, 76.7 MB/s 2024-09-10T08:41:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:10.393 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:10.393 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:10.393 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.29 2024-09-10T08:41:10.394 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:10.394 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:10.394 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:10.394 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.492 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.493 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134287 s, 78.1 MB/s 2024-09-10T08:41:10.511 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.512 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161028 s, 65.1 MB/s 2024-09-10T08:41:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163133 s, 64.3 MB/s 2024-09-10T08:41:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.548 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013711 s, 76.5 MB/s 2024-09-10T08:41:10.562 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.563 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115822 s, 90.5 MB/s 2024-09-10T08:41:10.578 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.579 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134554 s, 77.9 MB/s 2024-09-10T08:41:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.595 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135516 s, 77.4 MB/s 2024-09-10T08:41:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.613 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146878 s, 71.4 MB/s 2024-09-10T08:41:10.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.629 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.629 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131361 s, 79.8 MB/s 2024-09-10T08:41:10.649 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172417 s, 60.8 MB/s 2024-09-10T08:41:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124277 s, 84.4 MB/s 2024-09-10T08:41:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.682 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141477 s, 74.1 MB/s 2024-09-10T08:41:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137926 s, 76.0 MB/s 2024-09-10T08:41:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161047 s, 65.1 MB/s 2024-09-10T08:41:10.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.734 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.734 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132873 s, 78.9 MB/s 2024-09-10T08:41:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139927 s, 74.9 MB/s 2024-09-10T08:41:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172483 s, 60.8 MB/s 2024-09-10T08:41:10.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.788 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.788 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133042 s, 78.8 MB/s 2024-09-10T08:41:10.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.807 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.807 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158913 s, 66.0 MB/s 2024-09-10T08:41:10.823 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.824 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.824 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013381 s, 78.4 MB/s 2024-09-10T08:41:10.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.843 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.843 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158458 s, 66.2 MB/s 2024-09-10T08:41:10.859 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.859 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.859 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135784 s, 77.2 MB/s 2024-09-10T08:41:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167286 s, 62.7 MB/s 2024-09-10T08:41:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.895 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135599 s, 77.3 MB/s 2024-09-10T08:41:10.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.911 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.912 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134177 s, 78.1 MB/s 2024-09-10T08:41:10.927 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.928 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.928 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130194 s, 80.5 MB/s 2024-09-10T08:41:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.943 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012806 s, 81.9 MB/s 2024-09-10T08:41:10.959 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.960 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.960 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134047 s, 78.2 MB/s 2024-09-10T08:41:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130595 s, 80.3 MB/s 2024-09-10T08:41:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165625 s, 63.3 MB/s 2024-09-10T08:41:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.011 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125534 s, 83.5 MB/s 2024-09-10T08:41:11.029 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.030 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.030 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159308 s, 65.8 MB/s 2024-09-10T08:41:11.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:11.038 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.30 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:11.039 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:11.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:11.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.138 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.138 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136863 s, 76.6 MB/s 2024-09-10T08:41:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134209 s, 78.1 MB/s 2024-09-10T08:41:11.170 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.171 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128213 s, 81.8 MB/s 2024-09-10T08:41:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153913 s, 68.1 MB/s 2024-09-10T08:41:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.205 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128245 s, 81.8 MB/s 2024-09-10T08:41:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.221 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129429 s, 81.0 MB/s 2024-09-10T08:41:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.237 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130756 s, 80.2 MB/s 2024-09-10T08:41:11.253 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.254 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136384 s, 76.9 MB/s 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.268 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113393 s, 92.5 MB/s 2024-09-10T08:41:11.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.287 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.287 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158644 s, 66.1 MB/s 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.303 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132513 s, 79.1 MB/s 2024-09-10T08:41:11.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.319 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.319 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138061 s, 76.0 MB/s 2024-09-10T08:41:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.336 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135019 s, 77.7 MB/s 2024-09-10T08:41:11.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.353 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.353 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135439 s, 77.4 MB/s 2024-09-10T08:41:11.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.372 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.372 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159825 s, 65.6 MB/s 2024-09-10T08:41:11.388 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.389 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.389 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139237 s, 75.3 MB/s 2024-09-10T08:41:11.404 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.405 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.405 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128922 s, 81.3 MB/s 2024-09-10T08:41:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.421 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.422 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139182 s, 75.3 MB/s 2024-09-10T08:41:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132481 s, 79.1 MB/s 2024-09-10T08:41:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125686 s, 83.4 MB/s 2024-09-10T08:41:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133914 s, 78.3 MB/s 2024-09-10T08:41:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137181 s, 76.4 MB/s 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.503 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138988 s, 75.4 MB/s 2024-09-10T08:41:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134448 s, 78.0 MB/s 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147321 s, 71.2 MB/s 2024-09-10T08:41:11.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.554 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.554 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133076 s, 78.8 MB/s 2024-09-10T08:41:11.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.573 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.573 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158359 s, 66.2 MB/s 2024-09-10T08:41:11.589 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.590 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.590 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135299 s, 77.5 MB/s 2024-09-10T08:41:11.607 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.608 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.608 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147602 s, 71.0 MB/s 2024-09-10T08:41:11.626 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.626 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.626 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148907 s, 70.4 MB/s 2024-09-10T08:41:11.645 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.646 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.646 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169472 s, 61.9 MB/s 2024-09-10T08:41:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013596 s, 77.1 MB/s 2024-09-10T08:41:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p scrub_control_test_path/dir.31 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> for ((i = 0; i < 32; i++)); do 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-10T08:41:11.672 DEBUG:teuthology.orchestra.run.smithi052:> done 2024-09-10T08:41:11.673 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:11.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:11.772 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.773 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130138 s, 80.6 MB/s 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.789 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139575 s, 75.1 MB/s 2024-09-10T08:41:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.805 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125757 s, 83.4 MB/s 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.822 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138031 s, 76.0 MB/s 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.838 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130669 s, 80.2 MB/s 2024-09-10T08:41:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.853 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121084 s, 86.6 MB/s 2024-09-10T08:41:11.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.873 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.873 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171669 s, 61.1 MB/s 2024-09-10T08:41:11.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.890 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.890 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136516 s, 76.8 MB/s 2024-09-10T08:41:11.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.905 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.905 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117855 s, 89.0 MB/s 2024-09-10T08:41:11.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.921 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133638 s, 78.5 MB/s 2024-09-10T08:41:11.937 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131856 s, 79.5 MB/s 2024-09-10T08:41:11.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.953 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.954 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131047 s, 80.0 MB/s 2024-09-10T08:41:11.969 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.970 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.970 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131168 s, 79.9 MB/s 2024-09-10T08:41:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:11.989 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163103 s, 64.3 MB/s 2024-09-10T08:41:12.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.008 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.008 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161493 s, 64.9 MB/s 2024-09-10T08:41:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134073 s, 78.2 MB/s 2024-09-10T08:41:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139675 s, 75.1 MB/s 2024-09-10T08:41:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.057 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.058 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131447 s, 79.8 MB/s 2024-09-10T08:41:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.073 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124002 s, 84.6 MB/s 2024-09-10T08:41:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127726 s, 82.1 MB/s 2024-09-10T08:41:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.104 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125008 s, 83.9 MB/s 2024-09-10T08:41:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.120 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127534 s, 82.2 MB/s 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.136 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.137 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132001 s, 79.4 MB/s 2024-09-10T08:41:12.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.156 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.156 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016236 s, 64.6 MB/s 2024-09-10T08:41:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.172 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127572 s, 82.2 MB/s 2024-09-10T08:41:12.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.189 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.189 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141619 s, 74.0 MB/s 2024-09-10T08:41:12.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.206 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138838 s, 75.5 MB/s 2024-09-10T08:41:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.225 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164479 s, 63.8 MB/s 2024-09-10T08:41:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013566 s, 77.3 MB/s 2024-09-10T08:41:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159184 s, 65.9 MB/s 2024-09-10T08:41:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157376 s, 66.6 MB/s 2024-09-10T08:41:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T08:41:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T08:41:12.296 INFO:teuthology.orchestra.run.smithi052.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013401 s, 78.2 MB/s 2024-09-10T08:41:12.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:12.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-10T08:41:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.463+0000 7f5dbfe00640 1 Processor -- start 2024-09-10T08:41:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.463+0000 7f5dbfe00640 1 -- start start 2024-09-10T08:41:12.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5db80ccf30 0x7f5db80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbfe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db80cf2e0 con 0x7f5db815b7c0 2024-09-10T08:41:12.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbfe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db8070fe0 con 0x7f5db80cead0 2024-09-10T08:41:12.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5db80712c0 con 0x7f5db80ccf30 2024-09-10T08:41:12.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbd400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5db80ccf30 0x7f5db80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbca00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5db815b7c0 0x7f5db80cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46282/0 (socket says 172.21.15.52:46282) 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.465+0000 7f5dbca00640 1 -- 172.21.15.52:0/1551239641 learned_addr learned my addr 172.21.15.52:0/1551239641 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.466+0000 7f5db7e00640 1 -- 172.21.15.52:0/1551239641 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013367054 0 0) 0x7f5db80cf2e0 con 0x7f5db815b7c0 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.466+0000 7f5dbd400640 1 -- 172.21.15.52:0/1551239641 >> v1:172.21.15.176:6789/0 conn(0x7f5db80cead0 legacy=0x7f5db8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.466+0000 7f5dbd400640 1 -- 172.21.15.52:0/1551239641 >> v1:172.21.15.52:6789/0 conn(0x7f5db815b7c0 legacy=0x7f5db80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.466+0000 7f5dbd400640 1 -- 172.21.15.52:0/1551239641 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db80715a0 con 0x7f5db80ccf30 2024-09-10T08:41:12.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbd400640 1 --2- 172.21.15.52:0/1551239641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80ccf30 0x7f5db80b2c50 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097a0 tx=0x7f5dac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41dc1900aaa0db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5db7e00640 1 -- 172.21.15.52:0/1551239641 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac037070 con 0x7f5db80ccf30 2024-09-10T08:41:12.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5db7e00640 1 -- 172.21.15.52:0/1551239641 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac032440 con 0x7f5db80ccf30 2024-09-10T08:41:12.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5db7e00640 1 -- 172.21.15.52:0/1551239641 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac032810 con 0x7f5db80ccf30 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbfe00640 1 -- 172.21.15.52:0/1551239641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80ccf30 msgr2=0x7f5db80b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/1551239641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80ccf30 0x7f5db80b2c50 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097a0 tx=0x7f5dac02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbfe00640 1 -- 172.21.15.52:0/1551239641 shutdown_connections 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/1551239641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80ccf30 0x7f5db80b2c50 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.467+0000 7f5dbfe00640 1 -- 172.21.15.52:0/1551239641 >> 172.21.15.52:0/1551239641 conn(0x7f5db806d0f0 msgr2=0x7f5db806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.468+0000 7f5dbfe00640 1 -- 172.21.15.52:0/1551239641 shutdown_connections 2024-09-10T08:41:12.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.468+0000 7f5dbfe00640 1 -- 172.21.15.52:0/1551239641 wait complete. 2024-09-10T08:41:12.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.469+0000 7f5dbfe00640 1 Processor -- start 2024-09-10T08:41:12.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.469+0000 7f5dbfe00640 1 -- start start 2024-09-10T08:41:12.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db80ccf30 0x7f5db80c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5db815b7c0 0x7f5db815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80cf080 con 0x7f5db80cead0 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80cef00 con 0x7f5db80ccf30 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5db80721d0 con 0x7f5db815b7c0 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41976/0 (socket says 172.21.15.52:41976) 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.470+0000 7f5dbca00640 1 -- 172.21.15.52:0/345826827 learned_addr learned my addr 172.21.15.52:0/345826827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbde00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5db815b7c0 0x7f5db815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbd400640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db80ccf30 0x7f5db80c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 -- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5db815b7c0 msgr2=0x7f5db815cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5db815b7c0 0x7f5db815cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 -- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db80ccf30 msgr2=0x7f5db80c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db80ccf30 0x7f5db80c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 -- 172.21.15.52:0/345826827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db80c5a00 con 0x7f5db80cead0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbca00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f5da400c3f0 tx=0x7f5da400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da40074e0 con 0x7f5db80cead0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da40047e0 con 0x7f5db80cead0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4004c10 con 0x7f5db80cead0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.471+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db80c5f80 con 0x7f5db80cead0 2024-09-10T08:41:12.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.472+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db80c6540 con 0x7f5db80cead0 2024-09-10T08:41:12.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.473+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db80b2c50 con 0x7f5db80cead0 2024-09-10T08:41:12.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.474+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5da4011070 con 0x7f5db80cead0 2024-09-10T08:41:12.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.475+0000 7f5db5600640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 0x7f5d9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:12.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.475+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f5da408a990 con 0x7f5db80cead0 2024-09-10T08:41:12.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.475+0000 7f5dbd400640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 0x7f5d9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:12.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.476+0000 7f5dbd400640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 0x7f5d9806e2f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5dac034000 tx=0x7f5dac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:12.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.479+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5da4058c60 con 0x7f5db80cead0 2024-09-10T08:41:12.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:12.699+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f5db80cc960 con 0x7f5db80cead0 2024-09-10T08:41:13.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.703+0000 7f5db5600640 1 -- 172.21.15.52:0/345826827 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v131) ==== 105+0+0 (secure 0 0 0) 0x7f5da405cf60 con 0x7f5db80cead0 2024-09-10T08:41:13.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 msgr2=0x7f5d9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 0x7f5d9806e2f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5dac034000 tx=0x7f5dac02e000 comp rx=0 tx=0).stop 2024-09-10T08:41:13.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 msgr2=0x7f5db80c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f5da400c3f0 tx=0x7f5da400c8b0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 shutdown_connections 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d9806be30 0x7f5d9806e2f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5db815b7c0 0x7f5db815cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5db80cead0 0x7f5db80c7d30 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 --2- 172.21.15.52:0/345826827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5db80ccf30 0x7f5db80c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 >> 172.21.15.52:0/345826827 conn(0x7f5db806d0f0 msgr2=0x7f5db814fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 shutdown_connections 2024-09-10T08:41:13.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.707+0000 7f5dbfe00640 1 -- 172.21.15.52:0/345826827 wait complete. 2024-09-10T08:41:13.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-10T08:41:13.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.893+0000 7ff969000640 1 Processor -- start 2024-09-10T08:41:13.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.894+0000 7ff969000640 1 -- start start 2024-09-10T08:41:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff969000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9640afb90 0x7ff964162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff969000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff96406c320 0x7ff9640729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff969000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff964144090 con 0x7ff964158c80 2024-09-10T08:41:13.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff969000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff964141a00 con 0x7ff96406c320 2024-09-10T08:41:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff969000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff964072f10 con 0x7ff9640afb90 2024-09-10T08:41:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff962800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff96406c320 0x7ff9640729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff961e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff964158c80 0x7ff96406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:46288/0 (socket says 172.21.15.52:46288) 2024-09-10T08:41:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff961e00640 1 -- 172.21.15.52:0/2259781894 learned_addr learned my addr 172.21.15.52:0/2259781894 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:13.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.895+0000 7ff95be00640 1 --2- 172.21.15.52:0/2259781894 >> v2:172.21.15.176:3300/0 conn(0x7ff9640afb90 0x7ff964162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.896+0000 7ff962800640 1 -- 172.21.15.52:0/2259781894 >> v2:172.21.15.176:3300/0 conn(0x7ff9640afb90 msgr2=0x7ff964162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.896+0000 7ff962800640 1 --2- 172.21.15.52:0/2259781894 >> v2:172.21.15.176:3300/0 conn(0x7ff9640afb90 0x7ff964162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.896+0000 7ff962800640 1 -- 172.21.15.52:0/2259781894 >> v1:172.21.15.52:6789/0 conn(0x7ff964158c80 legacy=0x7ff96406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.896+0000 7ff962800640 1 -- 172.21.15.52:0/2259781894 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff964144370 con 0x7ff96406c320 2024-09-10T08:41:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff962800640 1 --2- 172.21.15.52:0/2259781894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff96406c320 0x7ff9640729d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7ff964070870 tx=0x7ff95c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17e2ab97e589d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff961400640 1 -- 172.21.15.52:0/2259781894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c007740 con 0x7ff96406c320 2024-09-10T08:41:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff961400640 1 -- 172.21.15.52:0/2259781894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95c0078e0 con 0x7ff96406c320 2024-09-10T08:41:13.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff961400640 1 -- 172.21.15.52:0/2259781894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c007cb0 con 0x7ff96406c320 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 -- 172.21.15.52:0/2259781894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff96406c320 msgr2=0x7ff9640729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 --2- 172.21.15.52:0/2259781894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff96406c320 0x7ff9640729d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7ff964070870 tx=0x7ff95c02a680 comp rx=0 tx=0).stop 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 -- 172.21.15.52:0/2259781894 shutdown_connections 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 --2- 172.21.15.52:0/2259781894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff96406c320 0x7ff9640729d0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 --2- 172.21.15.52:0/2259781894 >> v2:172.21.15.176:3300/0 conn(0x7ff9640afb90 0x7ff964162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.897+0000 7ff969000640 1 -- 172.21.15.52:0/2259781894 >> 172.21.15.52:0/2259781894 conn(0x7ff96406cd20 msgr2=0x7ff96406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.898+0000 7ff969000640 1 -- 172.21.15.52:0/2259781894 shutdown_connections 2024-09-10T08:41:13.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.898+0000 7ff969000640 1 -- 172.21.15.52:0/2259781894 wait complete. 2024-09-10T08:41:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.899+0000 7ff969000640 1 Processor -- start 2024-09-10T08:41:13.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.899+0000 7ff969000640 1 -- start start 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff96406c320 0x7ff96413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff964158c80 0x7ff96415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff964144c10 con 0x7ff9640afb90 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff964144930 con 0x7ff96406c320 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff969000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff964159060 con 0x7ff964158c80 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.900+0000 7ff95be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41994/0 (socket says 172.21.15.52:41994) 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 -- 172.21.15.52:0/1754784413 learned_addr learned my addr 172.21.15.52:0/1754784413 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff961e00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff96406c320 0x7ff96413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff962800640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff964158c80 0x7ff96415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 -- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff964158c80 msgr2=0x7ff96415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff964158c80 0x7ff96415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 -- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff96406c320 msgr2=0x7ff96413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff96406c320 0x7ff96413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 -- 172.21.15.52:0/1754784413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640b56c0 con 0x7ff9640afb90 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95be00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00d800 tx=0x7ff94c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.901+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c004030 con 0x7ff9640afb90 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.902+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c0041d0 con 0x7ff9640afb90 2024-09-10T08:41:13.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.902+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00b6c0 con 0x7ff9640afb90 2024-09-10T08:41:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.902+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9640b59a0 con 0x7ff9640afb90 2024-09-10T08:41:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.902+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96415c820 con 0x7ff9640afb90 2024-09-10T08:41:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.903+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff964143d20 con 0x7ff9640afb90 2024-09-10T08:41:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.904+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff94c00b860 con 0x7ff9640afb90 2024-09-10T08:41:13.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.904+0000 7ff95a000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 0x7ff94006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.904+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff94c08b120 con 0x7ff9640afb90 2024-09-10T08:41:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.905+0000 7ff961e00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 0x7ff94006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:13.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.906+0000 7ff961e00640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 0x7ff94006e2f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff954007fd0 tx=0x7ff954007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:13.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:13.909+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff94c0593e0 con 0x7ff9640afb90 2024-09-10T08:41:14.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.127+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ff9640730a0 con 0x7ff9640afb90 2024-09-10T08:41:14.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.705+0000 7ff95a000640 1 -- 172.21.15.52:0/1754784413 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v132) ==== 121+0+0 (secure 0 0 0) 0x7ff94c05d6e0 con 0x7ff9640afb90 2024-09-10T08:41:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 msgr2=0x7ff94006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 0x7ff94006e2f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff954007fd0 tx=0x7ff954007e80 comp rx=0 tx=0).stop 2024-09-10T08:41:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 msgr2=0x7ff964138f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:14.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00d800 tx=0x7ff94c00dcc0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 shutdown_connections 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff94006be30 0x7ff94006e2f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff964158c80 0x7ff96415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9640afb90 0x7ff964138f80 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 --2- 172.21.15.52:0/1754784413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff96406c320 0x7ff96413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 >> 172.21.15.52:0/1754784413 conn(0x7ff96406cd20 msgr2=0x7ff96406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 shutdown_connections 2024-09-10T08:41:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.708+0000 7ff969000640 1 -- 172.21.15.52:0/1754784413 wait complete. 2024-09-10T08:41:14.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.887+0000 7f40bca00640 1 Processor -- start 2024-09-10T08:41:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.887+0000 7f40bca00640 1 -- start start 2024-09-10T08:41:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40b80cf5c0 0x7f40b80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 0x7f40b80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 0x7f40b8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f40b80b4650 con 0x7f40b80cf5c0 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f40b80b4370 con 0x7f40b81600f0 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40bca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40b80b4dc0 con 0x7f40b80cf9a0 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.888+0000 7f40b6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40b80cf5c0 0x7f40b80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40b80cf5c0 0x7f40b80b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37516/0 (socket says 172.21.15.52:37516) 2024-09-10T08:41:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 -- 172.21.15.52:0/930895888 learned_addr learned my addr 172.21.15.52:0/930895888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b5e00640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 0x7f40b80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b7200640 1 --2- 172.21.15.52:0/930895888 >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 0x7f40b8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 -- 172.21.15.52:0/930895888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 msgr2=0x7f40b80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 0x7f40b80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 -- 172.21.15.52:0/930895888 >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 msgr2=0x7f40b8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 --2- 172.21.15.52:0/930895888 >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 0x7f40b8160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b6800640 1 -- 172.21.15.52:0/930895888 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b80b50a0 con 0x7f40b80cf5c0 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b7200640 1 --2- 172.21.15.52:0/930895888 >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 0x7f40b8160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.889+0000 7f40b5e00640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 0x7f40b80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.890+0000 7f40b6800640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf5c0 0x7f40b80b36f0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f40b80c66d0 tx=0x7f40a802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b12bf5bcb817e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.890+0000 7f40b5400640 1 -- 172.21.15.52:0/930895888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8037070 con 0x7f40b80cf5c0 2024-09-10T08:41:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.890+0000 7f40b5400640 1 -- 172.21.15.52:0/930895888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a802ae00 con 0x7f40b80cf5c0 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.890+0000 7f40b5400640 1 -- 172.21.15.52:0/930895888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8032660 con 0x7f40b80cf5c0 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 -- 172.21.15.52:0/930895888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf5c0 msgr2=0x7f40b80b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf5c0 0x7f40b80b36f0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f40b80c66d0 tx=0x7f40a802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 -- 172.21.15.52:0/930895888 shutdown_connections 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 --2- 172.21.15.52:0/930895888 >> v2:172.21.15.176:3300/0 conn(0x7f40b81600f0 0x7f40b8160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b80cf9a0 0x7f40b80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 --2- 172.21.15.52:0/930895888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf5c0 0x7f40b80b36f0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 -- 172.21.15.52:0/930895888 >> 172.21.15.52:0/930895888 conn(0x7f40b806c240 msgr2=0x7f40b806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 -- 172.21.15.52:0/930895888 shutdown_connections 2024-09-10T08:41:14.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.891+0000 7f40bca00640 1 -- 172.21.15.52:0/930895888 wait complete. 2024-09-10T08:41:14.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.893+0000 7f40bca00640 1 Processor -- start 2024-09-10T08:41:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.893+0000 7f40bca00640 1 -- start start 2024-09-10T08:41:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 0x7f40b8145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 0x7f40b8152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8160c40 con 0x7f40b80cf9a0 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8160ac0 con 0x7f40b80cf5c0 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40bca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f40b8160dc0 con 0x7f40b81600f0 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37530/0 (socket says 172.21.15.52:37530) 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 -- 172.21.15.52:0/1345755516 learned_addr learned my addr 172.21.15.52:0/1345755516 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b6800640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 0x7f40b8145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b7200640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 0x7f40b8152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 -- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 msgr2=0x7f40b8152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 0x7f40b8152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 -- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 msgr2=0x7f40b8145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 0x7f40b8145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b5e00640 1 -- 172.21.15.52:0/1345755516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b81464c0 con 0x7f40b80cf9a0 2024-09-10T08:41:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b6800640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 0x7f40b8145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.894+0000 7f40b7200640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 0x7f40b8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40b5e00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e810 tx=0x7f40a400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a400f040 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4004030 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4004400 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b8151360 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.895+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b8151920 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.896+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b8160580 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.897+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40a400c6d0 con 0x7f40b80cf9a0 2024-09-10T08:41:14.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.898+0000 7f40aea00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 0x7f409806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:14.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.898+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f40a408ab80 con 0x7f40b80cf9a0 2024-09-10T08:41:14.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.898+0000 7f40b6800640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 0x7f409806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:14.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.899+0000 7f40b6800640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 0x7f409806e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034000 tx=0x7f40a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:14.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:14.902+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40b81464c0 con 0x7f40b80cf9a0 2024-09-10T08:41:15.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.124+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40b81594b0 con 0x7f40b80cf9a0 2024-09-10T08:41:15.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.124+0000 7f40aea00640 1 -- 172.21.15.52:0/1345755516 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5242 (secure 0 0 0) 0x7f40a4017020 con 0x7f40b80cf9a0 2024-09-10T08:41:15.125 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:15.125 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":133,"btime":"2024-09-10T08:41:14:708763+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":133,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:41:14.708751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8989":{"gid":8989,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:41:15.125 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 133 2024-09-10T08:41:15.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 msgr2=0x7f409806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 0x7f409806e2f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034000 tx=0x7f40a802e000 comp rx=0 tx=0).stop 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 msgr2=0x7f40b815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e810 tx=0x7f40a400ecd0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 shutdown_connections 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f409806be30 0x7f409806e2f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f40b81600f0 0x7f40b8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40b80cf9a0 0x7f40b815c7c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 --2- 172.21.15.52:0/1345755516 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40b80cf5c0 0x7f40b8145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 >> 172.21.15.52:0/1345755516 conn(0x7f40b806c240 msgr2=0x7f40b8072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 shutdown_connections 2024-09-10T08:41:15.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.127+0000 7f40bca00640 1 -- 172.21.15.52:0/1345755516 wait complete. 2024-09-10T08:41:15.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 133, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T08:40:39.018331+0000', 'modified': '2024-09-10T08:41:14.708751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9753}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8989': {'gid': 8989, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6835/505845934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 505845934}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 505845934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_9753': {'gid': 9753, 'name': 'c', 'rank': 0, 'incarnation': 127, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/2110837576', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2110837576}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 2110837576}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9753, 'qdb_cluster': [9753]} 2024-09-10T08:41:15.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:41:15.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:41:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.705+0000 7fd5e6a00640 1 Processor -- start 2024-09-10T08:41:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.706+0000 7fd5e6a00640 1 -- start start 2024-09-10T08:41:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.707+0000 7fd5e6a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5e0073890 0x7fd5e00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.707+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 0x7fd5e00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.707+0000 7fd5e6a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00b4020 con 0x7fd5e0145ed0 2024-09-10T08:41:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.707+0000 7fd5e6a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e00b42c0 con 0x7fd5e0073890 2024-09-10T08:41:15.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.707+0000 7fd5e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00b45a0 con 0x7fd5e00b5880 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5e0073890 0x7fd5e00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5e4a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 0x7fd5e00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5dfe00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fd5e0145ed0 0x7fd5e0073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:42020/0 (socket says 172.21.15.52:42020) 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5dfe00640 1 -- 172.21.15.52:0/1213101132 learned_addr learned my addr 172.21.15.52:0/1213101132 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd5e0073890 0x7fd5e00b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:58662/0 (socket says 172.21.15.52:58662) 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5df400640 1 -- 172.21.15.52:0/1213101132 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779511889 0 0) 0x7fd5e00b4020 con 0x7fd5e0145ed0 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5df400640 1 -- 172.21.15.52:0/1213101132 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c4003520 con 0x7fd5e0145ed0 2024-09-10T08:41:15.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 -- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 msgr2=0x7fd5e00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 0x7fd5e00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 -- 172.21.15.52:0/1213101132 >> v1:172.21.15.176:6789/0 conn(0x7fd5e0145ed0 legacy=0x7fd5e0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5d7400640 1 -- 172.21.15.52:0/1213101132 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e00b4880 con 0x7fd5e0073890 2024-09-10T08:41:15.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.708+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 0x7fd5e00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.709+0000 7fd5d7400640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0073890 0x7fd5e00b5080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097a0 tx=0x7fd5c802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=453af79f2fc33e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5df400640 1 -- 172.21.15.52:0/1213101132 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8037070 con 0x7fd5e0073890 2024-09-10T08:41:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5df400640 1 -- 172.21.15.52:0/1213101132 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8032440 con 0x7fd5e0073890 2024-09-10T08:41:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5df400640 1 -- 172.21.15.52:0/1213101132 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8032810 con 0x7fd5e0073890 2024-09-10T08:41:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 -- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0073890 msgr2=0x7fd5e00b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0073890 0x7fd5e00b5080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80097a0 tx=0x7fd5c802a180 comp rx=0 tx=0).stop 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 -- 172.21.15.52:0/1213101132 shutdown_connections 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e00b5880 0x7fd5e00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/1213101132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0073890 0x7fd5e00b5080 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.710+0000 7fd5e6a00640 1 -- 172.21.15.52:0/1213101132 >> 172.21.15.52:0/1213101132 conn(0x7fd5e00ccec0 msgr2=0x7fd5e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.711+0000 7fd5e6a00640 1 -- 172.21.15.52:0/1213101132 shutdown_connections 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.711+0000 7fd5e6a00640 1 -- 172.21.15.52:0/1213101132 wait complete. 2024-09-10T08:41:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.712+0000 7fd5e6a00640 1 Processor -- start 2024-09-10T08:41:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.712+0000 7fd5e6a00640 1 -- start start 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0073890 0x7fd5e0137010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0145ed0 0x7fd5e013ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00b6270 con 0x7fd5e00b5880 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e01462b0 con 0x7fd5e0145ed0 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e6a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e013f630 con 0x7fd5e0073890 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37536/0 (socket says 172.21.15.52:37536) 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 -- 172.21.15.52:0/2456648960 learned_addr learned my addr 172.21.15.52:0/2456648960 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0073890 0x7fd5e0137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0145ed0 0x7fd5e013ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 -- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0073890 msgr2=0x7fd5e0137010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0073890 0x7fd5e0137010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 -- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0145ed0 msgr2=0x7fd5e013ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0145ed0 0x7fd5e013ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.714+0000 7fd5d7400640 1 -- 172.21.15.52:0/2456648960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e013f910 con 0x7fd5e00b5880 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.715+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8035040 tx=0x7fd5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.716+0000 7fd5dcc00640 1 -- 172.21.15.52:0/2456648960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8041030 con 0x7fd5e00b5880 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.716+0000 7fd5dcc00640 1 -- 172.21.15.52:0/2456648960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c803d420 con 0x7fd5e00b5880 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.716+0000 7fd5dcc00640 1 -- 172.21.15.52:0/2456648960 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8037040 con 0x7fd5e00b5880 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.716+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e013fbf0 con 0x7fd5e00b5880 2024-09-10T08:41:15.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.716+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01401b0 con 0x7fd5e00b5880 2024-09-10T08:41:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.718+0000 7fd5dcc00640 1 -- 172.21.15.52:0/2456648960 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5c8044070 con 0x7fd5e00b5880 2024-09-10T08:41:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.719+0000 7fd5dcc00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 0x7fd5bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.719+0000 7fd5dcc00640 1 -- 172.21.15.52:0/2456648960 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fd5c80ab3b0 con 0x7fd5e00b5880 2024-09-10T08:41:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.720+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 0x7fd5bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.720+0000 7fd5e98b2740 1 Processor -- start 2024-09-10T08:41:15.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.720+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 0x7fd5bc06e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0001200 tx=0x7fd5d0000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.720+0000 7fd5e98b2740 1 -- start start 2024-09-10T08:41:15.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36834f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca36850cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca367693b0 con 0x55ca368084b0 2024-09-10T08:41:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca3676e410 con 0x55ca36834b50 2024-09-10T08:41:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca36716620 con 0x55ca3684f510 2024-09-10T08:41:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.721+0000 7fd5e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37546/0 (socket says 172.21.15.52:37546) 2024-09-10T08:41:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1455003009 learned_addr learned my addr 172.21.15.52:0/1455003009 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36834f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5d7400640 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca36850cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 msgr2=0x55ca36850cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca36850cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 msgr2=0x55ca36834f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36834f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1455003009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca364812d0 con 0x55ca368084b0 2024-09-10T08:41:15.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80115b0 tx=0x7fd5d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc4699770d1de30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5cfe00640 1 -- 172.21.15.52:0/1455003009 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8003b90 con 0x55ca368084b0 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5cfe00640 1 -- 172.21.15.52:0/1455003009 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8003d30 con 0x55ca368084b0 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.722+0000 7fd5cfe00640 1 -- 172.21.15.52:0/1455003009 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004240 con 0x55ca368084b0 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1455003009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 msgr2=0x55ca36851200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80115b0 tx=0x7fd5d8009750 comp rx=0 tx=0).stop 2024-09-10T08:41:15.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1455003009 shutdown_connections 2024-09-10T08:41:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca368084b0 0x55ca36851200 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca36850cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1455003009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36834f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1455003009 >> 172.21.15.52:0/1455003009 conn(0x55ca36807740 msgr2=0x55ca3684f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1455003009 shutdown_connections 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.723+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1455003009 wait complete. 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.724+0000 7fd5e98b2740 1 -- start start 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.724+0000 7fd5e98b2740 1 Processor -- start 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca36835d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca368379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca36729780 con 0x55ca3684cad0 2024-09-10T08:41:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca3676a3d0 con 0x55ca3684f510 2024-09-10T08:41:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca36835910 con 0x55ca36834b50 2024-09-10T08:41:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e98b2740 10 client.0 _ll_register_callbacks cb 0x55ca367675d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:15.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e4a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37558/0 (socket says 172.21.15.52:37558) 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1786090754 learned_addr learned my addr 172.21.15.52:0/1786090754 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.725+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca36835d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5d7400640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca368379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 msgr2=0x55ca36835d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca36835d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 msgr2=0x55ca368379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca368379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 -- 172.21.15.52:0/1786090754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3654b6b0 con 0x55ca3684cad0 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca36835d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009790 tx=0x7fd5d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e4e9bb41c8e906 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d802c060 con 0x55ca3684cad0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fd5d8015b80 con 0x55ca3684cad0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.726+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5d8003d30 con 0x55ca3684cad0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fd5d8015d80 con 0x55ca3684cad0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 10 client.9948 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ca3684b3e0 con 0x55ca3684cad0 2024-09-10T08:41:15.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d8003d30 con 0x55ca3684cad0 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7fd5d8003ee0 con 0x55ca3684cad0 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 10 client.9948 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 10 client.9948 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 20 client.9948 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca368090e0 0x55ca36872150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 4 client.9948 mds_command: new command op to 9753 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 --> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca3677bb40 con 0x55ca368090e0 2024-09-10T08:41:15.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.727+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca368090e0 0x55ca36872150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.728+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca368090e0 0x55ca36872150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f23cac4311c406e server_cookie=5315c121a61f5401 in_seq=0 out_seq=0 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.728+0000 7fd5ccc00640 10 client.9948 ms_handle_connect on v2:172.21.15.52:6832/2110837576 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5ccc00640 1 -- 172.21.15.52:0/1786090754 <== mds.0 v2:172.21.15.52:6832/2110837576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca3677bb40 con 0x55ca368090e0 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5ccc00640 10 client.9948 handle_command_reply: tid=0 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 client.9948 shutdown 2024-09-10T08:41:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 msgr2=0x55ca36837f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009790 tx=0x7fd5d8004ab0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 shutdown_connections 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca368090e0 0x55ca36872150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36837f30 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca368379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/1786090754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca36835d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5ccc00640 0 client.9948 ms_handle_reset on v2:172.21.15.52:6832/2110837576 2024-09-10T08:41:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 >> 172.21.15.52:0/1786090754 conn(0x55ca368084b0 msgr2=0x55ca36859300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 shutdown_connections 2024-09-10T08:41:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 1 -- 172.21.15.52:0/1786090754 wait complete. 2024-09-10T08:41:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.729+0000 7fd5e98b2740 20 client.9948 trim_cache size 0 max 16384 2024-09-10T08:41:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.748+0000 7fd5e98b2740 1 Processor -- start 2024-09-10T08:41:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.748+0000 7fd5e98b2740 1 -- start start 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca3682bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca36835810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e01fc7d0 con 0x55ca3684cad0 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00c6e80 con 0x55ca3684f510 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00c74d0 con 0x55ca36834b50 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37568/0 (socket says 172.21.15.52:37568) 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.749+0000 7fd5d7400640 1 -- 172.21.15.52:0/4059032962 learned_addr learned my addr 172.21.15.52:0/4059032962 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca36835810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca3682bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 -- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 msgr2=0x55ca3682bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca3682bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 -- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 msgr2=0x55ca36835810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca36835810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 -- 172.21.15.52:0/4059032962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca368062c0 con 0x55ca3684cad0 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5d7400640 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009560 tx=0x7fd5c80ab040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668f8de29b1b9c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5cf400640 1 -- 172.21.15.52:0/4059032962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c807d980 con 0x55ca3684cad0 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5cf400640 1 -- 172.21.15.52:0/4059032962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c80821b0 con 0x55ca3684cad0 2024-09-10T08:41:15.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.750+0000 7fd5cf400640 1 -- 172.21.15.52:0/4059032962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80ab0b0 con 0x55ca3684cad0 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 -- 172.21.15.52:0/4059032962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 msgr2=0x55ca3680bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009560 tx=0x7fd5c80ab040 comp rx=0 tx=0).stop 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 -- 172.21.15.52:0/4059032962 shutdown_connections 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca3684f510 0x55ca36835810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca3680bbe0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/4059032962 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca36834b50 0x55ca3682bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 -- 172.21.15.52:0/4059032962 >> 172.21.15.52:0/4059032962 conn(0x55ca368084b0 msgr2=0x55ca36837980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 -- 172.21.15.52:0/4059032962 shutdown_connections 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.751+0000 7fd5e98b2740 1 -- 172.21.15.52:0/4059032962 wait complete. 2024-09-10T08:41:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.752+0000 7fd5e98b2740 1 -- start start 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.752+0000 7fd5e98b2740 1 Processor -- start 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36836f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca368d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca36808f60 con 0x55ca3684cad0 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ca36836250 con 0x55ca36834b50 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ca368094f0 con 0x55ca3684f510 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e98b2740 10 client.0 _ll_register_callbacks cb 0x7fd5d8011450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37574/0 (socket says 172.21.15.52:37574) 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 -- 172.21.15.52:0/2115284699 learned_addr learned my addr 172.21.15.52:0/2115284699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36836f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5e4a00640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca368d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 -- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 msgr2=0x55ca368d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca368d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 -- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 msgr2=0x55ca36836f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36836f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.753+0000 7fd5d7400640 1 -- 172.21.15.52:0/2115284699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca368512c0 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5d7400640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80792d0 tx=0x7fd5c8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cec1f2d106d405 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8081d20 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fd5c8081ec0 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5c80821b0 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7fd5c8078a20 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5e98b2740 10 client.9954 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ca368d25b0 con 0x55ca3684cad0 2024-09-10T08:41:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.754+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c80821b0 con 0x55ca3684cad0 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7fd5c804e060 con 0x55ca3684cad0 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 10 client.9954 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 10 client.9954 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 20 client.9954 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca3684e920 0x55ca3684ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 4 client.9954 mds_command: new command op to 9753 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 --> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] -- command(tid 0: {"prefix": "status"}) -- 0x55ca36775e90 con 0x55ca3684e920 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca3684e920 0x55ca3684ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5dfe00640 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca3684e920 0x55ca3684ed00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489b17fb5a1bb0a0 server_cookie=aa5c9b39a236070f in_seq=0 out_seq=0 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.755+0000 7fd5ccc00640 10 client.9954 ms_handle_connect on v2:172.21.15.52:6832/2110837576 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5ccc00640 1 -- 172.21.15.52:0/2115284699 <== mds.0 v2:172.21.15.52:6832/2110837576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55ca36775e90 con 0x55ca3684e920 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5ccc00640 10 client.9954 handle_command_reply: tid=0 2024-09-10T08:41:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 client.9954 shutdown 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 msgr2=0x55ca36850a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80792d0 tx=0x7fd5c8009190 comp rx=0 tx=0).stop 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 shutdown_connections 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ca3684f510 0x55ca368d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:6832/2110837576,v1:172.21.15.52:6834/2110837576] conn(0x55ca3684e920 0x55ca3684ed00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca3684cad0 0x55ca36850a90 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 --2- 172.21.15.52:0/2115284699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ca36834b50 0x55ca36836f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5ccc00640 0 client.9954 ms_handle_reset on v2:172.21.15.52:6832/2110837576 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 >> 172.21.15.52:0/2115284699 conn(0x55ca368084b0 msgr2=0x55ca368377d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 shutdown_connections 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 1 -- 172.21.15.52:0/2115284699 wait complete. 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.756+0000 7fd5e98b2740 20 client.9954 trim_cache size 0 max 16384 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:41:15.762 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 9753, 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 36.165689426999997, 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 133, 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 171, 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 171, 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 41.235640957000001 2024-09-10T08:41:15.763 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:41:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 msgr2=0x7fd5bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 0x7fd5bc06e2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0001200 tx=0x7fd5d0000bc0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 msgr2=0x7fd5e013ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8035040 tx=0x7fd5c80046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 shutdown_connections 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd5bc06be30 0x7fd5bc06e2f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5e0145ed0 0x7fd5e013ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5e00b5880 0x7fd5e013ea20 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 --2- 172.21.15.52:0/2456648960 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5e0073890 0x7fd5e0137010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 >> 172.21.15.52:0/2456648960 conn(0x7fd5e00ccec0 msgr2=0x7fd5e0140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 shutdown_connections 2024-09-10T08:41:15.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.757+0000 7fd5e6a00640 1 -- 172.21.15.52:0/2456648960 wait complete. 2024-09-10T08:41:15.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub start /scrub_control_test_path recursive 2024-09-10T08:41:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.934+0000 7f2f0ee00640 1 Processor -- start 2024-09-10T08:41:15.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.934+0000 7f2f0ee00640 1 -- start start 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.935+0000 7f2f0ee00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f08155b20 0x7f2f080b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.935+0000 7f2f0ee00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2f080b21a0 0x7f2f080cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f0ee00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f080b0680 con 0x7f2f080cf960 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f0ee00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2f080b01e0 con 0x7f2f08155b20 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f0ee00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2f080ccf70 con 0x7f2f080b21a0 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f08155b20 0x7f2f080b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f08155b20 0x7f2f080b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37588/0 (socket says 172.21.15.52:37588) 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 -- 172.21.15.52:0/2462022048 learned_addr learned my addr 172.21.15.52:0/2462022048 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2eff400640 1 --2- 172.21.15.52:0/2462022048 >> v2:172.21.15.176:3300/0 conn(0x7f2f080b21a0 0x7f2f080cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 -- 172.21.15.52:0/2462022048 >> v2:172.21.15.176:3300/0 conn(0x7f2f080b21a0 msgr2=0x7f2f080cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2462022048 >> v2:172.21.15.176:3300/0 conn(0x7f2f080b21a0 0x7f2f080cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 -- 172.21.15.52:0/2462022048 >> v1:172.21.15.176:6789/0 conn(0x7f2f080cf960 legacy=0x7f2f0815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.936+0000 7f2f07e00640 1 -- 172.21.15.52:0/2462022048 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f080ce940 con 0x7f2f08155b20 2024-09-10T08:41:15.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.937+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2462022048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f080b1c60 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806f060 tx=0x7f2ef802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97204aecb5af5612 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f07400640 1 -- 172.21.15.52:0/2462022048 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037070 con 0x7f2f08155b20 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f07400640 1 -- 172.21.15.52:0/2462022048 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef8032440 con 0x7f2f08155b20 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f07400640 1 -- 172.21.15.52:0/2462022048 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8032810 con 0x7f2f08155b20 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2462022048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 msgr2=0x7f2f080b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 --2- 172.21.15.52:0/2462022048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f080b1c60 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f2f0806f060 tx=0x7f2ef802a230 comp rx=0 tx=0).stop 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2462022048 shutdown_connections 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 --2- 172.21.15.52:0/2462022048 >> v2:172.21.15.176:3300/0 conn(0x7f2f080b21a0 0x7f2f080cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 --2- 172.21.15.52:0/2462022048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f080b1c60 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2462022048 >> 172.21.15.52:0/2462022048 conn(0x7f2f0806c240 msgr2=0x7f2f0806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2462022048 shutdown_connections 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.938+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2462022048 wait complete. 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.940+0000 7f2f0ee00640 1 Processor -- start 2024-09-10T08:41:15.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.940+0000 7f2f0ee00640 1 -- start start 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f080b21a0 0x7f2f08151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f080cf960 0x7f2f080b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f0814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2f080ce610 con 0x7f2f08155b20 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f080cef00 con 0x7f2f080b21a0 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f080cfd80 con 0x7f2f080cf960 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f0814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f0814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37590/0 (socket says 172.21.15.52:37590) 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f0ce00640 1 -- 172.21.15.52:0/2832756246 learned_addr learned my addr 172.21.15.52:0/2832756246 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.941+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f080b21a0 0x7f2f08151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2eff400640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f080cf960 0x7f2f080b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 -- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f080cf960 msgr2=0x7f2f080b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2f080cf960 0x7f2f080b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 -- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f080b21a0 msgr2=0x7f2f08151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f080b21a0 0x7f2f08151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 -- 172.21.15.52:0/2832756246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0815be20 con 0x7f2f08155b20 2024-09-10T08:41:15.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f08155b20 0x7f2f0814dac0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000b970 tx=0x7f2f0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f04c00640 1 -- 172.21.15.52:0/2832756246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00019070 con 0x7f2f08155b20 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f04c00640 1 -- 172.21.15.52:0/2832756246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0000cb40 con 0x7f2f08155b20 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f04c00640 1 -- 172.21.15.52:0/2832756246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00014440 con 0x7f2f08155b20 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.942+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2832756246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0815c100 con 0x7f2f08155b20 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.943+0000 7f2f0ee00640 1 -- 172.21.15.52:0/2832756246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0815c6c0 con 0x7f2f08155b20 2024-09-10T08:41:15.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.945+0000 7f2f04c00640 1 -- 172.21.15.52:0/2832756246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f0001c070 con 0x7f2f08155b20 2024-09-10T08:41:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.946+0000 7f2f04c00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ee406be30 0x7f2ee406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.946+0000 7f2f04c00640 1 -- 172.21.15.52:0/2832756246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f2f0008aab0 con 0x7f2f08155b20 2024-09-10T08:41:15.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.947+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ee406be30 0x7f2ee406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.947+0000 7f2f11bf8740 1 Processor -- start 2024-09-10T08:41:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.947+0000 7f2f11bf8740 1 -- start start 2024-09-10T08:41:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.947+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2832756246 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ee406be30 0x7f2ee406e2f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8034000 tx=0x7f2ef802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 0x55ac733cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733cffd0 0x55ac733cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac73335750 con 0x55ac733d2810 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ac732dd6e0 con 0x55ac733cffd0 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ac73331710 con 0x55ac733cdf10 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37592/0 (socket says 172.21.15.52:37592) 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f07e00640 1 -- 172.21.15.52:0/1293684071 learned_addr learned my addr 172.21.15.52:0/1293684071 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733cffd0 0x55ac733cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.948+0000 7f2eff400640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 0x55ac733cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 -- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 msgr2=0x55ac733cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 0x55ac733cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 -- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733cffd0 msgr2=0x55ac733cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733cffd0 0x55ac733cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 -- 172.21.15.52:0/1293684071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac732c20f0 con 0x55ac733d2810 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2eff400640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 0x55ac733cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009960 tx=0x7f2ef802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2815e464cb9958 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2efcc00640 1 -- 172.21.15.52:0/1293684071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8037040 con 0x55ac733d2810 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2efcc00640 1 -- 172.21.15.52:0/1293684071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef804d070 con 0x55ac733d2810 2024-09-10T08:41:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.949+0000 7f2efcc00640 1 -- 172.21.15.52:0/1293684071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8032de0 con 0x55ac733d2810 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1293684071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 msgr2=0x55ac733d2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009960 tx=0x7f2ef802c000 comp rx=0 tx=0).stop 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1293684071 shutdown_connections 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733cffd0 0x55ac733cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cdf10 0x55ac733cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1293684071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac733d2bf0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1293684071 >> 172.21.15.52:0/1293684071 conn(0x55ac733cefd0 msgr2=0x55ac73417690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1293684071 shutdown_connections 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.950+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1293684071 wait complete. 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.951+0000 7f2f11bf8740 1 -- start start 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.951+0000 7f2f11bf8740 1 Processor -- start 2024-09-10T08:41:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 0x55ac733fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac734126a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac733fd0a0 con 0x55ac733cffd0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ac732f09a0 con 0x55ac73410fe0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ac73417da0 con 0x55ac733d2810 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f11bf8740 10 client.0 _ll_register_callbacks cb 0x55ac73047d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37608/0 (socket says 172.21.15.52:37608) 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f07e00640 1 -- 172.21.15.52:0/1665001194 learned_addr learned my addr 172.21.15.52:0/1665001194 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac734126a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.952+0000 7f2eff400640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 0x55ac733fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 -- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 msgr2=0x55ac733fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 0x55ac733fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 -- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 msgr2=0x55ac734126a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac734126a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 -- 172.21.15.52:0/1665001194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac73114940 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2eff400640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 0x55ac733fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac734126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f07e00640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8000c00 tx=0x7f2ef8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b367052996b0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2ef5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8003610 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef80037b0 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.953+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ef804d070 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f2ef8062050 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 10 client.9966 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ac731750d0 con 0x55ac733cffd0 2024-09-10T08:41:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef804d070 con 0x55ac733cffd0 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f2ef8065020 con 0x55ac733cffd0 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 10 client.9966 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 10 client.9966 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 20 client.9966 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac7342b040 0x55ac7342b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 4 client.9966 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac73342e80 con 0x55ac7342b040 2024-09-10T08:41:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.954+0000 7f2eff400640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac7342b040 0x55ac7342b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.955+0000 7f2eff400640 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac7342b040 0x55ac7342b420 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=fc9e1719eb88d0c6 server_cookie=a9a8054c854a68d4 in_seq=0 out_seq=0 2024-09-10T08:41:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.955+0000 7f2ef5600640 10 client.9966 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2ef5600640 1 -- 172.21.15.52:0/1665001194 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac73342e80 con 0x55ac7342b040 2024-09-10T08:41:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2ef5600640 10 client.9966 handle_command_reply: tid=0 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 client.9966 shutdown 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 msgr2=0x55ac73413d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8000c00 tx=0x7f2ef8004730 comp rx=0 tx=0).stop 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 shutdown_connections 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac7342b040 0x55ac7342b420 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac734126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733d2810 0x55ac733fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/1665001194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733cffd0 0x55ac73413d10 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 >> 172.21.15.52:0/1665001194 conn(0x55ac733cdf10 msgr2=0x55ac734181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2ef5600640 0 client.9966 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 shutdown_connections 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 1 -- 172.21.15.52:0/1665001194 wait complete. 2024-09-10T08:41:15.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.956+0000 7f2f11bf8740 20 client.9966 trim_cache size 0 max 16384 2024-09-10T08:41:15.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.974+0000 7f2f11bf8740 1 Processor -- start 2024-09-10T08:41:15.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 -- start start 2024-09-10T08:41:15.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac733fda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac73426f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2f08200eb0 con 0x55ac733d2810 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0814c600 con 0x55ac73410fe0 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.975+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0814cc50 con 0x55ac733cffd0 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37620/0 (socket says 172.21.15.52:37620) 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 -- 172.21.15.52:0/2391981304 learned_addr learned my addr 172.21.15.52:0/2391981304 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac733fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac73426f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 -- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 msgr2=0x55ac733fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac733fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 -- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 msgr2=0x55ac73426f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac73426f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 -- 172.21.15.52:0/2391981304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac73008230 con 0x55ac733d2810 2024-09-10T08:41:15.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2f07e00640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac733fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:15.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2eff400640 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f2f081f7a50 tx=0x7f2ef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3fffd6e86dba1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.976+0000 7f2ef7e00640 1 -- 172.21.15.52:0/2391981304 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0007d40 con 0x55ac733d2810 2024-09-10T08:41:15.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2ef7e00640 1 -- 172.21.15.52:0/2391981304 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef0004030 con 0x55ac733d2810 2024-09-10T08:41:15.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2ef7e00640 1 -- 172.21.15.52:0/2391981304 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0004220 con 0x55ac733d2810 2024-09-10T08:41:15.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 -- 172.21.15.52:0/2391981304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 msgr2=0x55ac734269e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:15.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f2f081f7a50 tx=0x7f2ef0008040 comp rx=0 tx=0).stop 2024-09-10T08:41:15.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 -- 172.21.15.52:0/2391981304 shutdown_connections 2024-09-10T08:41:15.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac73410fe0 0x55ac73426f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac733d2810 0x55ac734269e0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/2391981304 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac733fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 -- 172.21.15.52:0/2391981304 >> 172.21.15.52:0/2391981304 conn(0x55ac733cdf10 msgr2=0x55ac733d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:15.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 -- 172.21.15.52:0/2391981304 shutdown_connections 2024-09-10T08:41:15.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.977+0000 7f2f11bf8740 1 -- 172.21.15.52:0/2391981304 wait complete. 2024-09-10T08:41:15.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T08:41:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.978+0000 7f2f11bf8740 1 -- start start 2024-09-10T08:41:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.978+0000 7f2f11bf8740 1 Processor -- start 2024-09-10T08:41:15.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac7349dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733d2810 0x55ac73425d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac73410ac0 con 0x55ac73410fe0 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55ac73410500 con 0x55ac733d2810 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55ac73413300 con 0x55ac733cffd0 2024-09-10T08:41:15.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f11bf8740 10 client.0 _ll_register_callbacks cb 0x7f2ef80326a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f0ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37636/0 (socket says 172.21.15.52:37636) 2024-09-10T08:41:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.979+0000 7f2f0ce00640 1 -- 172.21.15.52:0/772629815 learned_addr learned my addr 172.21.15.52:0/772629815 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f07e00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac7349dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2eff400640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733d2810 0x55ac73425d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:15.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 -- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 msgr2=0x55ac7349dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac7349dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 -- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733d2810 msgr2=0x55ac73425d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:15.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733d2810 0x55ac73425d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:15.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 -- 172.21.15.52:0/772629815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac732fd140 con 0x55ac73410fe0 2024-09-10T08:41:15.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f0ce00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f2f000551d0 tx=0x7f2f0005d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e0f9b15ad0cdaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:15.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2ef5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:15.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00057130 con 0x55ac73410fe0 2024-09-10T08:41:15.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f2f00061410 con 0x55ac73410fe0 2024-09-10T08:41:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.980+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ef0004030 con 0x55ac73410fe0 2024-09-10T08:41:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f2f00061610 con 0x55ac73410fe0 2024-09-10T08:41:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 10 client.9972 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55ac732fce20 con 0x55ac73410fe0 2024-09-10T08:41:16.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0007b020 con 0x55ac73410fe0 2024-09-10T08:41:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f2f000581c0 con 0x55ac73410fe0 2024-09-10T08:41:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 10 client.9972 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 10 client.9972 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 20 client.9972 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac734272b0 0x55ac733d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 4 client.9972 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55ac7333d1d0 con 0x55ac734272b0 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.981+0000 7f2f07e00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac734272b0 0x55ac733d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f07e00640 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac734272b0 0x55ac733d0570 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=df34caf1091fb3c1 server_cookie=6fbb8e8746284486 in_seq=0 out_seq=0 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2ef5600640 10 client.9972 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2ef5600640 1 -- 172.21.15.52:0/772629815 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55ac7333d1d0 con 0x55ac734272b0 2024-09-10T08:41:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2ef5600640 10 client.9972 handle_command_reply: tid=0 2024-09-10T08:41:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 client.9972 shutdown 2024-09-10T08:41:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 msgr2=0x55ac734262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f2f000551d0 tx=0x7f2f0005d070 comp rx=0 tx=0).stop 2024-09-10T08:41:16.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 shutdown_connections 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55ac734272b0 0x55ac733d0570 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac73410fe0 0x55ac734262b0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55ac733d2810 0x55ac73425d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 --2- 172.21.15.52:0/772629815 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55ac733cffd0 0x55ac7349dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2ef5600640 0 client.9972 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 >> 172.21.15.52:0/772629815 conn(0x55ac733cdf10 msgr2=0x55ac734155d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 shutdown_connections 2024-09-10T08:41:16.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 1 -- 172.21.15.52:0/772629815 wait complete. 2024-09-10T08:41:16.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:15.982+0000 7f2f11bf8740 20 client.9972 trim_cache size 0 max 16384 2024-09-10T08:41:16.005 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: MDS is not active 2024-09-10T08:41:16.006 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub pause 2024-09-10T08:41:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.165+0000 7f307b200640 1 Processor -- start 2024-09-10T08:41:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.165+0000 7f307b200640 1 -- start start 2024-09-10T08:41:16.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f307b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f307b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c068700 con 0x7f307c0b67d0 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f307b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c0cf0b0 con 0x7f307c15e730 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f307b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f307c0d2750 con 0x7f307c0cfb90 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f3073e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f307c0b67d0 0x7f307c0d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56600/0 (socket says 172.21.15.52:56600) 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.166+0000 7f3073e00640 1 -- 172.21.15.52:0/2188975877 learned_addr learned my addr 172.21.15.52:0/2188975877 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f307a800640 1 --2- 172.21.15.52:0/2188975877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380885706 0 0) 0x7f307c068700 con 0x7f307c0b67d0 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3060003520 con 0x7f307c0b67d0 2024-09-10T08:41:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664882861 0 0) 0x7f307c0cf0b0 con 0x7f307c15e730 2024-09-10T08:41:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307c068700 con 0x7f307c15e730 2024-09-10T08:41:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f307a800640 1 -- 172.21.15.52:0/2188975877 >> v1:172.21.15.176:6789/0 conn(0x7f307c15e730 legacy=0x7f307c0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f307a800640 1 -- 172.21.15.52:0/2188975877 >> v1:172.21.15.52:6789/0 conn(0x7f307c0b67d0 legacy=0x7f307c0d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.167+0000 7f307a800640 1 -- 172.21.15.52:0/2188975877 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c0cf390 con 0x7f307c0cfb90 2024-09-10T08:41:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.168+0000 7f307a800640 1 --2- 172.21.15.52:0/2188975877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0d2210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3074009dc0 tx=0x7f307402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7019245546b9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.168+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074007740 con 0x7f307c0cfb90 2024-09-10T08:41:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.168+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30740078e0 con 0x7f307c0cfb90 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.168+0000 7f3079400640 1 -- 172.21.15.52:0/2188975877 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074007cb0 con 0x7f307c0cfb90 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 -- 172.21.15.52:0/2188975877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 msgr2=0x7f307c0d2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 --2- 172.21.15.52:0/2188975877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0d2210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3074009dc0 tx=0x7f307402a6d0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 -- 172.21.15.52:0/2188975877 shutdown_connections 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 --2- 172.21.15.52:0/2188975877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0d2210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 -- 172.21.15.52:0/2188975877 >> 172.21.15.52:0/2188975877 conn(0x7f307c0d10c0 msgr2=0x7f307c0d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 -- 172.21.15.52:0/2188975877 shutdown_connections 2024-09-10T08:41:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.169+0000 7f307b200640 1 -- 172.21.15.52:0/2188975877 wait complete. 2024-09-10T08:41:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.171+0000 7f307b200640 1 Processor -- start 2024-09-10T08:41:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.171+0000 7f307b200640 1 -- start start 2024-09-10T08:41:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307c0b67d0 0x7f307c1f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f307c15e730 0x7f307c14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f307c15eb10 con 0x7f307c15e730 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f307c0b39e0 con 0x7f307c0b67d0 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f307c15ec90 con 0x7f307c0cfb90 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f307c15e730 0x7f307c14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f307c15e730 0x7f307c14f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37648/0 (socket says 172.21.15.52:37648) 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 -- 172.21.15.52:0/3330584913 learned_addr learned my addr 172.21.15.52:0/3330584913 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f3073e00640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f3079e00640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307c0b67d0 0x7f307c1f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 -- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 msgr2=0x7f307c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f307c0cfb90 0x7f307c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 -- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307c0b67d0 msgr2=0x7f307c1f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.172+0000 7f307a800640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f307c0b67d0 0x7f307c1f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f307a800640 1 -- 172.21.15.52:0/3330584913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c0ccd70 con 0x7f307c15e730 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f307a800640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f307c15e730 0x7f307c14f660 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f3074009ee0 tx=0x7f3074004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f3072000640 1 -- 172.21.15.52:0/3330584913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074040070 con 0x7f307c15e730 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f3072000640 1 -- 172.21.15.52:0/3330584913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3074031bc0 con 0x7f307c15e730 2024-09-10T08:41:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f307b200640 1 -- 172.21.15.52:0/3330584913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c0c8140 con 0x7f307c15e730 2024-09-10T08:41:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f3072000640 1 -- 172.21.15.52:0/3330584913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074009450 con 0x7f307c15e730 2024-09-10T08:41:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.173+0000 7f307b200640 1 -- 172.21.15.52:0/3330584913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c0c8700 con 0x7f307c15e730 2024-09-10T08:41:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.175+0000 7f3072000640 1 -- 172.21.15.52:0/3330584913 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3074039040 con 0x7f307c15e730 2024-09-10T08:41:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.176+0000 7f3072000640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f305806be30 0x7f305806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.176+0000 7f3072000640 1 -- 172.21.15.52:0/3330584913 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f30740ac540 con 0x7f307c15e730 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.177+0000 7f3079e00640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f305806be30 0x7f305806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.177+0000 7f3083edb740 1 Processor -- start 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.177+0000 7f3083edb740 1 -- start start 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3079e00640 1 --2- 172.21.15.52:0/3330584913 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f305806be30 0x7f305806e2f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f306c0011e0 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b6db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221bb9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e221a7c280 con 0x55e221b6e070 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e221ad57b0 con 0x55e221bb73d0 2024-09-10T08:41:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e221a7d7d0 con 0x55e221b6d750 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3073e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3079e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b6db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3073e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37662/0 (socket says 172.21.15.52:37662) 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f3073e00640 1 -- 172.21.15.52:0/145372032 learned_addr learned my addr 172.21.15.52:0/145372032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.178+0000 7f307a800640 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221bb9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 -- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 msgr2=0x55e221b6db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b6db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 -- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 msgr2=0x55e221bb9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221bb9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 -- 172.21.15.52:0/145372032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2217cc120 con 0x55e221b6e070 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f3073e00640 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f3064005880 tx=0x7f3064007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f186ed57df5513 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f306aa00640 1 -- 172.21.15.52:0/145372032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064005ac0 con 0x55e221b6e070 2024-09-10T08:41:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f306aa00640 1 -- 172.21.15.52:0/145372032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3064018070 con 0x55e221b6e070 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.179+0000 7f306aa00640 1 -- 172.21.15.52:0/145372032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064005e60 con 0x55e221b6e070 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 -- 172.21.15.52:0/145372032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 msgr2=0x55e221bb8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f3064005880 tx=0x7f3064007db0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 -- 172.21.15.52:0/145372032 shutdown_connections 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221bb9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221bb8d30 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 --2- 172.21.15.52:0/145372032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b6db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 -- 172.21.15.52:0/145372032 >> 172.21.15.52:0/145372032 conn(0x55e221b39ec0 msgr2=0x55e221bb7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 -- 172.21.15.52:0/145372032 shutdown_connections 2024-09-10T08:41:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.180+0000 7f3083edb740 1 -- 172.21.15.52:0/145372032 wait complete. 2024-09-10T08:41:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.181+0000 7f3083edb740 1 -- start start 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.181+0000 7f3083edb740 1 Processor -- start 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221bb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e221a5e3f0 con 0x55e221bb73d0 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e221ad1770 con 0x55e221b6e070 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e221b739e0 con 0x55e221b6d750 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3083edb740 10 client.0 _ll_register_callbacks cb 0x55e221a825d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37664/0 (socket says 172.21.15.52:37664) 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 -- 172.21.15.52:0/3743980659 learned_addr learned my addr 172.21.15.52:0/3743980659 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3079e00640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f3073e00640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221bb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 -- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 msgr2=0x55e221b8ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b8ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 -- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 msgr2=0x55e221bb3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221bb3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.182+0000 7f307a800640 1 -- 172.21.15.52:0/3743980659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2218b2500 con 0x55e221bb73d0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f3079e00640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b8ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f307a800640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f30740aa9d0 tx=0x7f3074081110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a4122a6cb9569c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074092030 con 0x55e221bb73d0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f307408ebe0 con 0x55e221bb73d0 2024-09-10T08:41:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3064018070 con 0x55e221bb73d0 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f3074083330 con 0x55e221bb73d0 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f3083edb740 10 client.9984 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55e221912c90 con 0x55e221bb73d0 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3064018070 con 0x55e221bb73d0 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.183+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f307407aa60 con 0x55e221bb73d0 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 10 client.9984 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 10 client.9984 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 20 client.9984 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221bd3270 0x55e221bd5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 4 client.9984 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e221ae2ee0 con 0x55e221bd3270 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3079e00640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221bd3270 0x55e221bd5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f3079e00640 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221bd3270 0x55e221bd5660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=e4992a34f4e30ef1 server_cookie=32d38ae7f13b967f in_seq=0 out_seq=0 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.184+0000 7f305f400640 10 client.9984 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f305f400640 1 -- 172.21.15.52:0/3743980659 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e221ae2ee0 con 0x55e221bd3270 2024-09-10T08:41:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f305f400640 10 client.9984 handle_command_reply: tid=0 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 client.9984 shutdown 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 msgr2=0x55e221bb35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f30740aa9d0 tx=0x7f3074081110 comp rx=0 tx=0).stop 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 shutdown_connections 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221bd3270 0x55e221bd5660 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221bb73d0 0x55e221bb35d0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221bb3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 --2- 172.21.15.52:0/3743980659 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b8ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.185+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 >> 172.21.15.52:0/3743980659 conn(0x55e221b39ec0 msgr2=0x55e221bb7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.186+0000 7f305f400640 0 client.9984 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.186+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 shutdown_connections 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.186+0000 7f3083edb740 1 -- 172.21.15.52:0/3743980659 wait complete. 2024-09-10T08:41:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.186+0000 7f3083edb740 20 client.9984 trim_cache size 0 max 16384 2024-09-10T08:41:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.204+0000 7f3083edb740 1 Processor -- start 2024-09-10T08:41:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.204+0000 7f3083edb740 1 -- start start 2024-09-10T08:41:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.204+0000 7f3083edb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221b72ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221bb73d0 0x55e221b73220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3083edb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f307c200b20 con 0x55e221b6d750 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f307c1f8420 con 0x55e221b6e070 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f307c0c96e0 con 0x55e221bb73d0 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37670/0 (socket says 172.21.15.52:37670) 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 -- 172.21.15.52:0/1196563551 learned_addr learned my addr 172.21.15.52:0/1196563551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 -- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221bb73d0 msgr2=0x55e221b73220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221bb73d0 0x55e221b73220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 -- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 msgr2=0x55e221b72ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221b72ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.205+0000 7f3079e00640 1 -- 172.21.15.52:0/1196563551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2217a7e20 con 0x55e221b6d750 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3079e00640 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f306c00f5a0 tx=0x7f306c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5feec740ebdc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f306a000640 1 -- 172.21.15.52:0/1196563551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c02f070 con 0x55e221b6d750 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f306a000640 1 -- 172.21.15.52:0/1196563551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c01b040 con 0x55e221b6d750 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f306a000640 1 -- 172.21.15.52:0/1196563551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c023910 con 0x55e221b6d750 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 -- 172.21.15.52:0/1196563551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 msgr2=0x55e221bb5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f306c00f5a0 tx=0x7f306c012000 comp rx=0 tx=0).stop 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 -- 172.21.15.52:0/1196563551 shutdown_connections 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221bb73d0 0x55e221b73220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221b6e070 0x55e221b72ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 --2- 172.21.15.52:0/1196563551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6d750 0x55e221bb5040 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.206+0000 7f3083edb740 1 -- 172.21.15.52:0/1196563551 >> 172.21.15.52:0/1196563551 conn(0x55e221b39ec0 msgr2=0x55e221b6c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.207+0000 7f3083edb740 1 -- 172.21.15.52:0/1196563551 shutdown_connections 2024-09-10T08:41:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.207+0000 7f3083edb740 1 -- 172.21.15.52:0/1196563551 wait complete. 2024-09-10T08:41:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.207+0000 7f3083edb740 1 -- start start 2024-09-10T08:41:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.207+0000 7f3083edb740 1 Processor -- start 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b72ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221c38690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e221b967a0 con 0x55e221b6e070 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e221b9cb40 con 0x55e221bb73d0 2024-09-10T08:41:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e221b99270 con 0x55e221b6d750 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3083edb740 10 client.0 _ll_register_callbacks cb 0x7f307407a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.208+0000 7f3073e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37680/0 (socket says 172.21.15.52:37680) 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 -- 172.21.15.52:0/1411581562 learned_addr learned my addr 172.21.15.52:0/1411581562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3079e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b72ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f307a800640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221c38690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 -- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 msgr2=0x55e221b72ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b72ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 -- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 msgr2=0x55e221c38690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221c38690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 -- 172.21.15.52:0/1411581562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e221b916a0 con 0x55e221b6e070 2024-09-10T08:41:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f307a800640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221c38690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3073e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f3064000f60 tx=0x7f30640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfade4e2a49f2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f305f400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306400fc50 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f306400fdf0 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.209+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f306c01b040 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f306402d050 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 10 client.9990 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55e221bb2cc0 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c01b040 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f3064030020 con 0x55e221b6e070 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 10 client.9990 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 10 client.9990 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 20 client.9990 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221c34c30 0x55e221c35010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 4 client.9990 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55e221add230 con 0x55e221c34c30 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.210+0000 7f3079e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221c34c30 0x55e221c35010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3079e00640 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221c34c30 0x55e221c35010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=67fc73d83e42b758 server_cookie=5d6638f44eb2fa94 in_seq=0 out_seq=0 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f305f400640 10 client.9990 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f305f400640 1 -- 172.21.15.52:0/1411581562 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55e221add230 con 0x55e221c34c30 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f305f400640 10 client.9990 handle_command_reply: tid=0 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 client.9990 shutdown 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 msgr2=0x55e221b73220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f3064000f60 tx=0x7f30640057f0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 shutdown_connections 2024-09-10T08:41:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e221c34c30 0x55e221c35010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e221bb73d0 0x55e221c38690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e221b6e070 0x55e221b73220 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 --2- 172.21.15.52:0/1411581562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e221b6d750 0x55e221b72ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f305f400640 0 client.9990 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.211+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 >> 172.21.15.52:0/1411581562 conn(0x55e221b39ec0 msgr2=0x55e221b99d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.212+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 shutdown_connections 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.212+0000 7f3083edb740 1 -- 172.21.15.52:0/1411581562 wait complete. 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.212+0000 7f3083edb740 20 client.9990 trim_cache size 0 max 16384 2024-09-10T08:41:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: MDS is not active 2024-09-10T08:41:16.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T08:41:16.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub abort 2024-09-10T08:41:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.376+0000 7f98f1a00640 1 Processor -- start 2024-09-10T08:41:16.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.376+0000 7f98f1a00640 1 -- start start 2024-09-10T08:41:16.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98f1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98f1a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98f1a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ec0cf2e0 con 0x7f98ec0ccf30 2024-09-10T08:41:16.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98f1a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f98ec070fe0 con 0x7f98ec0cead0 2024-09-10T08:41:16.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98f1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec0712c0 con 0x7f98ec15b7c0 2024-09-10T08:41:16.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98eb400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36372/0 (socket says 172.21.15.52:36372) 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98e3e00640 1 -- 172.21.15.52:0/2401468412 learned_addr learned my addr 172.21.15.52:0/2401468412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.378+0000 7f98eb400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:58786/0 (socket says 172.21.15.52:58786) 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98ea000640 1 -- 172.21.15.52:0/2401468412 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692863297 0 0) 0x7f98ec0cf2e0 con 0x7f98ec0ccf30 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98e3e00640 1 -- 172.21.15.52:0/2401468412 >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 msgr2=0x7f98ec071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98e3e00640 1 --2- 172.21.15.52:0/2401468412 >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98e3e00640 1 -- 172.21.15.52:0/2401468412 >> v1:172.21.15.176:6789/0 conn(0x7f98ec0ccf30 legacy=0x7f98ec0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98e3e00640 1 -- 172.21.15.52:0/2401468412 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0715a0 con 0x7f98ec15b7c0 2024-09-10T08:41:16.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.379+0000 7f98eb400640 1 --2- 172.21.15.52:0/2401468412 >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.380+0000 7f98e3e00640 1 --2- 172.21.15.52:0/2401468412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98d400bb10 tx=0x7f98d402c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7340ae39e9dbc93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.380+0000 7f98ea000640 1 -- 172.21.15.52:0/2401468412 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4032790 con 0x7f98ec15b7c0 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.380+0000 7f98ea000640 1 -- 172.21.15.52:0/2401468412 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4038070 con 0x7f98ec15b7c0 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.380+0000 7f98ea000640 1 -- 172.21.15.52:0/2401468412 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4032b50 con 0x7f98ec15b7c0 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 -- 172.21.15.52:0/2401468412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 msgr2=0x7f98ec0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 --2- 172.21.15.52:0/2401468412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98d400bb10 tx=0x7f98d402c890 comp rx=0 tx=0).stop 2024-09-10T08:41:16.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 -- 172.21.15.52:0/2401468412 shutdown_connections 2024-09-10T08:41:16.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 --2- 172.21.15.52:0/2401468412 >> v2:172.21.15.176:3300/0 conn(0x7f98ec0cead0 0x7f98ec071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 --2- 172.21.15.52:0/2401468412 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec0b2c50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 -- 172.21.15.52:0/2401468412 >> 172.21.15.52:0/2401468412 conn(0x7f98ec06d0f0 msgr2=0x7f98ec06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 -- 172.21.15.52:0/2401468412 shutdown_connections 2024-09-10T08:41:16.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.381+0000 7f98f1a00640 1 -- 172.21.15.52:0/2401468412 wait complete. 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.382+0000 7f98f1a00640 1 Processor -- start 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 -- start start 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98ec0ccf30 0x7f98ec15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98ec0cead0 0x7f98ec1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0cf060 con 0x7f98ec0ccf30 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0ceee0 con 0x7f98ec0cead0 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.383+0000 7f98f1a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec072000 con 0x7f98ec15b7c0 2024-09-10T08:41:16.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98ec0ccf30 0x7f98ec15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98ec0ccf30 0x7f98ec15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37690/0 (socket says 172.21.15.52:37690) 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 -- 172.21.15.52:0/3558000013 learned_addr learned my addr 172.21.15.52:0/3558000013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98e3e00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98ec0cead0 0x7f98ec1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eb400640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 -- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 msgr2=0x7f98ec159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98ec15b7c0 0x7f98ec159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 -- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98ec0cead0 msgr2=0x7f98ec1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98ec0cead0 0x7f98ec1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.384+0000 7f98eaa00640 1 -- 172.21.15.52:0/3558000013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec15a240 con 0x7f98ec0ccf30 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98ec0ccf30 0x7f98ec15e450 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c460 tx=0x7f98dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98e2a00640 1 -- 172.21.15.52:0/3558000013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc017070 con 0x7f98ec0ccf30 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98e2a00640 1 -- 172.21.15.52:0/3558000013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc0035f0 con 0x7f98ec0ccf30 2024-09-10T08:41:16.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98e2a00640 1 -- 172.21.15.52:0/3558000013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0039e0 con 0x7f98ec0ccf30 2024-09-10T08:41:16.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98f1a00640 1 -- 172.21.15.52:0/3558000013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec15a520 con 0x7f98ec0ccf30 2024-09-10T08:41:16.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.385+0000 7f98f1a00640 1 -- 172.21.15.52:0/3558000013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec14f1b0 con 0x7f98ec0ccf30 2024-09-10T08:41:16.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.388+0000 7f98e2a00640 1 -- 172.21.15.52:0/3558000013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98dc01a070 con 0x7f98ec0ccf30 2024-09-10T08:41:16.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.389+0000 7f98e2a00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f98c806be30 0x7f98c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.389+0000 7f98e2a00640 1 -- 172.21.15.52:0/3558000013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f98dc08a220 con 0x7f98ec0ccf30 2024-09-10T08:41:16.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.389+0000 7f98e3e00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f98c806be30 0x7f98c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.389+0000 7f98f4857740 1 Processor -- start 2024-09-10T08:41:16.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.390+0000 7f98f4857740 1 -- start start 2024-09-10T08:41:16.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.390+0000 7f98e3e00640 1 --2- 172.21.15.52:0/3558000013 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f98c806be30 0x7f98c806e2f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f98d4037000 tx=0x7f98d4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbecb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e19dab0280 con 0x55e19dba1570 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e19db097b0 con 0x55e19dbeb1f0 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e19dab17d0 con 0x55e19dba1e90 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37692/0 (socket says 172.21.15.52:37692) 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 -- 172.21.15.52:0/1684655001 learned_addr learned my addr 172.21.15.52:0/1684655001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 -- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 msgr2=0x55e19dbecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 -- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 msgr2=0x55e19dbed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 -- 172.21.15.52:0/1684655001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e19d800120 con 0x55e19dba1570 2024-09-10T08:41:16.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.391+0000 7f98eaa00640 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00cfd0 tx=0x7f98dc057f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74655da58471e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98db400640 1 -- 172.21.15.52:0/1684655001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0567e0 con 0x55e19dba1570 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98db400640 1 -- 172.21.15.52:0/1684655001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc054b50 con 0x55e19dba1570 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98db400640 1 -- 172.21.15.52:0/1684655001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc070400 con 0x55e19dba1570 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 -- 172.21.15.52:0/1684655001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 msgr2=0x55e19dba1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00cfd0 tx=0x7f98dc057f40 comp rx=0 tx=0).stop 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 -- 172.21.15.52:0/1684655001 shutdown_connections 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 --2- 172.21.15.52:0/1684655001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dba1950 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 -- 172.21.15.52:0/1684655001 >> 172.21.15.52:0/1684655001 conn(0x55e19db6dec0 msgr2=0x55e19dbeba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 -- 172.21.15.52:0/1684655001 shutdown_connections 2024-09-10T08:41:16.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.392+0000 7f98f4857740 1 -- 172.21.15.52:0/1684655001 wait complete. 2024-09-10T08:41:16.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.393+0000 7f98f4857740 1 -- start start 2024-09-10T08:41:16.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.393+0000 7f98f4857740 1 Processor -- start 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1570 0x55e19dbfc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbcba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e19da923f0 con 0x55e19dbeb1f0 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e19db05770 con 0x55e19dba1570 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e19dba7800 con 0x55e19dba1e90 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.394+0000 7f98f4857740 10 client.0 _ll_register_callbacks cb 0x55e19dab65d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1570 0x55e19dbfc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37706/0 (socket says 172.21.15.52:37706) 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 -- 172.21.15.52:0/2710179786 learned_addr learned my addr 172.21.15.52:0/2710179786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98e3e00640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbcba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 -- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 msgr2=0x55e19dbcba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbcba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 -- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1570 msgr2=0x55e19dbfc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1570 0x55e19dbfc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 -- 172.21.15.52:0/2710179786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e19d8e6500 con 0x55e19dbeb1f0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98eb400640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011d40 tx=0x7f98e400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dc15013c5fe816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.395+0000 7f98cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e400fe10 con 0x55e19dbeb1f0 2024-09-10T08:41:16.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98dc054b50 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f98e4003990 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f98e4024050 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 10 client.9999 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55e19d946c90 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98dc054b50 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f98e4027020 con 0x55e19dbeb1f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 10 client.9999 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 10 client.9999 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 20 client.9999 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dbcf2f0 0x55e19dbff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 4 client.9999 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.396+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e19db16ee0 con 0x55e19dbcf2f0 2024-09-10T08:41:16.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.397+0000 7f98eaa00640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dbcf2f0 0x55e19dbff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.397+0000 7f98eaa00640 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dbcf2f0 0x55e19dbff2f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=3bf42efcc8a1ccee server_cookie=c8b417eaac4f47a5 in_seq=0 out_seq=0 2024-09-10T08:41:16.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.397+0000 7f98cfe00640 10 client.9999 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98cfe00640 1 -- 172.21.15.52:0/2710179786 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e19db16ee0 con 0x55e19dbcf2f0 2024-09-10T08:41:16.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98cfe00640 10 client.9999 handle_command_reply: tid=0 2024-09-10T08:41:16.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 client.9999 shutdown 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 msgr2=0x55e19dbe6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011d40 tx=0x7f98e400f580 comp rx=0 tx=0).stop 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 shutdown_connections 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dbcf2f0 0x55e19dbff2f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dbeb1f0 0x55e19dbe6500 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1e90 0x55e19dbcba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 --2- 172.21.15.52:0/2710179786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1570 0x55e19dbfc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98cfe00640 0 client.9999 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 >> 172.21.15.52:0/2710179786 conn(0x55e19db6dec0 msgr2=0x55e19dba6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 shutdown_connections 2024-09-10T08:41:16.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 1 -- 172.21.15.52:0/2710179786 wait complete. 2024-09-10T08:41:16.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.398+0000 7f98f4857740 20 client.9999 trim_cache size 0 max 16384 2024-09-10T08:41:16.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.416+0000 7f98f4857740 1 Processor -- start 2024-09-10T08:41:16.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.416+0000 7f98f4857740 1 -- start start 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1570 0x55e19dc0ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbcda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec200b00 con 0x55e19dba1e90 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec1ff010 con 0x55e19dbeb1f0 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec1ff540 con 0x55e19dba1570 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37718/0 (socket says 172.21.15.52:37718) 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.417+0000 7f98e3e00640 1 -- 172.21.15.52:0/156586723 learned_addr learned my addr 172.21.15.52:0/156586723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98eb400640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbcda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98eaa00640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1570 0x55e19dc0ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 -- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1570 msgr2=0x55e19dc0ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1570 0x55e19dc0ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 -- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 msgr2=0x55e19dbcda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbcda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 -- 172.21.15.52:0/156586723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e19d7dbe20 con 0x55e19dba1e90 2024-09-10T08:41:16.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98eb400640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbcda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:16.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.418+0000 7f98e3e00640 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f98d4008010 tx=0x7f98d4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677b3ee67ad1d485 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98daa00640 1 -- 172.21.15.52:0/156586723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4042070 con 0x55e19dba1e90 2024-09-10T08:41:16.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98daa00640 1 -- 172.21.15.52:0/156586723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4038040 con 0x55e19dba1e90 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98daa00640 1 -- 172.21.15.52:0/156586723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d40338e0 con 0x55e19dba1e90 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 -- 172.21.15.52:0/156586723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 msgr2=0x55e19dbe9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f98d4008010 tx=0x7f98d4031000 comp rx=0 tx=0).stop 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 -- 172.21.15.52:0/156586723 shutdown_connections 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dbeb1f0 0x55e19dbcda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1e90 0x55e19dbe9730 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 --2- 172.21.15.52:0/156586723 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dba1570 0x55e19dc0ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 -- 172.21.15.52:0/156586723 >> 172.21.15.52:0/156586723 conn(0x55e19db6dec0 msgr2=0x55e19dba72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 -- 172.21.15.52:0/156586723 shutdown_connections 2024-09-10T08:41:16.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.419+0000 7f98f4857740 1 -- 172.21.15.52:0/156586723 wait complete. 2024-09-10T08:41:16.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.420+0000 7f98f4857740 1 -- start start 2024-09-10T08:41:16.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.420+0000 7f98f4857740 1 Processor -- start 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1e90 0x55e19dbfa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dbeb1f0 0x55e19dbe9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e19dbcf710 con 0x55e19dba1570 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55e19dbe8350 con 0x55e19dba1e90 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55e19dbe8cf0 con 0x55e19dbeb1f0 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98f4857740 10 client.0 _ll_register_callbacks cb 0x7f98e4011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98eaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37728/0 (socket says 172.21.15.52:37728) 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98eaa00640 1 -- 172.21.15.52:0/3137495596 learned_addr learned my addr 172.21.15.52:0/3137495596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98eaa00640 1 -- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dbeb1f0 msgr2=0x55e19dbe9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.421+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dbeb1f0 0x55e19dbe9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98eaa00640 1 -- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1e90 msgr2=0x55e19dbfa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1e90 0x55e19dbfa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98eaa00640 1 -- 172.21.15.52:0/3137495596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e19dbce6f0 con 0x55e19dba1570 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98eaa00640 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005600 tx=0x7f98dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ef5debaa4151c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc07c060 con 0x55e19dba1570 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f98dc0567e0 con 0x55e19dba1570 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98d4038040 con 0x55e19dba1570 2024-09-10T08:41:16.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f98dc088040 con 0x55e19dba1570 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98f4857740 10 client.10005 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55e19dbce410 con 0x55e19dba1570 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.422+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4038040 con 0x55e19dba1570 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f98dc0881e0 con 0x55e19dba1570 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 10 client.10005 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 10 client.10005 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 20 client.10005 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dc6a400 0x55e19dc6a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 4 client.10005 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55e19dbee5f0 con 0x55e19dc6a400 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98e3e00640 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dc6a400 0x55e19dc6a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98e3e00640 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dc6a400 0x55e19dc6a7e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=2c7ccca038c9b72e server_cookie=6498c675c1b92de5 in_seq=0 out_seq=0 2024-09-10T08:41:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.423+0000 7f98cfe00640 10 client.10005 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98cfe00640 1 -- 172.21.15.52:0/3137495596 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55e19dbee5f0 con 0x55e19dc6a400 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98cfe00640 10 client.10005 handle_command_reply: tid=0 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 client.10005 shutdown 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 msgr2=0x55e19dc672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005600 tx=0x7f98dc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 shutdown_connections 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55e19dc6a400 0x55e19dc6a7e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55e19dbeb1f0 0x55e19dbe9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55e19dba1e90 0x55e19dbfa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98cfe00640 0 client.10005 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 --2- 172.21.15.52:0/3137495596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e19dba1570 0x55e19dc672d0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 >> 172.21.15.52:0/3137495596 conn(0x55e19db6dec0 msgr2=0x55e19dbe7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 shutdown_connections 2024-09-10T08:41:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 1 -- 172.21.15.52:0/3137495596 wait complete. 2024-09-10T08:41:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.424+0000 7f98f4857740 20 client.10005 trim_cache size 0 max 16384 2024-09-10T08:41:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: MDS is not active 2024-09-10T08:41:16.431 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T08:41:16.432 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub resume 2024-09-10T08:41:16.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.590+0000 7f08c6400640 1 Processor -- start 2024-09-10T08:41:16.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.590+0000 7f08c6400640 1 -- start start 2024-09-10T08:41:16.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.591+0000 7f08c6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c00cce30 0x7f08c00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.591+0000 7f08c6400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f08c0071c70 0x7f08c0072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.591+0000 7f08c6400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c00714b0 con 0x7f08c00732e0 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.591+0000 7f08c6400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f08c00cd880 con 0x7f08c0071c70 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.591+0000 7f08c6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08c00cdb60 con 0x7f08c00cce30 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bf400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f08c00732e0 0x7f08c00736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56602/0 (socket says 172.21.15.52:56602) 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bf400640 1 -- 172.21.15.52:0/156700121 learned_addr learned my addr 172.21.15.52:0/156700121 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bfe00640 1 --2- 172.21.15.52:0/156700121 >> v2:172.21.15.52:3300/0 conn(0x7f08c0071c70 0x7f08c0072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08b7e00640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c00cce30 0x7f08c00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bea00640 1 -- 172.21.15.52:0/156700121 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414816618 0 0) 0x7f08c00714b0 con 0x7f08c00732e0 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bea00640 1 -- 172.21.15.52:0/156700121 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a4003520 con 0x7f08c00732e0 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bfe00640 1 -- 172.21.15.52:0/156700121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c00cce30 msgr2=0x7f08c00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bfe00640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c00cce30 0x7f08c00cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bfe00640 1 -- 172.21.15.52:0/156700121 >> v1:172.21.15.52:6789/0 conn(0x7f08c00732e0 legacy=0x7f08c00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.592+0000 7f08bfe00640 1 -- 172.21.15.52:0/156700121 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c00cde40 con 0x7f08c0071c70 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.593+0000 7f08bfe00640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c0071c70 0x7f08c0072120 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2fb02760f0f8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08bea00640 1 -- 172.21.15.52:0/156700121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8031600 con 0x7f08c0071c70 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08bea00640 1 -- 172.21.15.52:0/156700121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b80317a0 con 0x7f08c0071c70 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08bea00640 1 -- 172.21.15.52:0/156700121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8031b70 con 0x7f08c0071c70 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 -- 172.21.15.52:0/156700121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c0071c70 msgr2=0x7f08c0072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c0071c70 0x7f08c0072120 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 -- 172.21.15.52:0/156700121 shutdown_connections 2024-09-10T08:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c0071c70 0x7f08c0072120 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 --2- 172.21.15.52:0/156700121 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c00cce30 0x7f08c00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 -- 172.21.15.52:0/156700121 >> 172.21.15.52:0/156700121 conn(0x7f08c006d0f0 msgr2=0x7f08c006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 -- 172.21.15.52:0/156700121 shutdown_connections 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.594+0000 7f08c6400640 1 -- 172.21.15.52:0/156700121 wait complete. 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.596+0000 7f08c6400640 1 Processor -- start 2024-09-10T08:41:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.596+0000 7f08c6400640 1 -- start start 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c0071c70 0x7f08c00ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08c00732e0 0x7f08c01529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c00cce30 0x7f08c0159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08c015ca50 con 0x7f08c00cce30 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08c015c8d0 con 0x7f08c00732e0 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08c6400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08c015cbd0 con 0x7f08c0071c70 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c00cce30 0x7f08c0159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c00cce30 0x7f08c0159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37746/0 (socket says 172.21.15.52:37746) 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.597+0000 7f08bfe00640 1 -- 172.21.15.52:0/3994647014 learned_addr learned my addr 172.21.15.52:0/3994647014 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bf400640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c0071c70 0x7f08c00ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08b7e00640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08c00732e0 0x7f08c01529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 -- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c0071c70 msgr2=0x7f08c00ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08c0071c70 0x7f08c00ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 -- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08c00732e0 msgr2=0x7f08c01529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08c00732e0 0x7f08c01529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 -- 172.21.15.52:0/3994647014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c01f4720 con 0x7f08c00cce30 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08c00cce30 0x7f08c0159050 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08b7400640 1 -- 172.21.15.52:0/3994647014 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8040070 con 0x7f08c00cce30 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08b7400640 1 -- 172.21.15.52:0/3994647014 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8030b60 con 0x7f08c00cce30 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08b7400640 1 -- 172.21.15.52:0/3994647014 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8009450 con 0x7f08c00cce30 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.598+0000 7f08c6400640 1 -- 172.21.15.52:0/3994647014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c01f4990 con 0x7f08c00cce30 2024-09-10T08:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.599+0000 7f08c6400640 1 -- 172.21.15.52:0/3994647014 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c01f4f50 con 0x7f08c00cce30 2024-09-10T08:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.601+0000 7f08b7400640 1 -- 172.21.15.52:0/3994647014 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08b8039040 con 0x7f08c00cce30 2024-09-10T08:41:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.601+0000 7f08b7400640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f089c06be30 0x7f089c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.602+0000 7f08b7400640 1 -- 172.21.15.52:0/3994647014 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f08b80ac230 con 0x7f08c00cce30 2024-09-10T08:41:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.602+0000 7f08bf400640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f089c06be30 0x7f089c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.602+0000 7f08c91ec740 1 Processor -- start 2024-09-10T08:41:16.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.602+0000 7f08c91ec740 1 -- start start 2024-09-10T08:41:16.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08bf400640 1 --2- 172.21.15.52:0/3994647014 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f089c06be30 0x7f089c06e2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f08b0005880 tx=0x7f08b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 0x55897ad5d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad15240 0x55897ad17e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 0x55897ad12070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55897acdecf0 con 0x55897ad19210 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55897ac7a7f0 con 0x55897ad15240 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.603+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55897ac22800 con 0x55897ad17a80 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 0x55897ad12070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bf400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 0x55897ad5d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08b7e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad15240 0x55897ad17e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bf400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 0x55897ad5d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36452/0 (socket says 172.21.15.52:36452) 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bf400640 1 -- 172.21.15.52:0/1067869338 learned_addr learned my addr 172.21.15.52:0/1067869338 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 -- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 msgr2=0x55897ad5d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 0x55897ad5d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 -- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad15240 msgr2=0x55897ad17e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad15240 0x55897ad17e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 -- 172.21.15.52:0/1067869338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897aa577d0 con 0x55897ad19210 2024-09-10T08:41:16.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.604+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 0x55897ad12070 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f08b80aa690 tx=0x7f08b80ac110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3555891c3023cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08afe00640 1 -- 172.21.15.52:0/1067869338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8083020 con 0x55897ad19210 2024-09-10T08:41:16.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08afe00640 1 -- 172.21.15.52:0/1067869338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8031700 con 0x55897ad19210 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08afe00640 1 -- 172.21.15.52:0/1067869338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8076b60 con 0x55897ad19210 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 -- 172.21.15.52:0/1067869338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 msgr2=0x55897ad12070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 0x55897ad12070 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f08b80aa690 tx=0x7f08b80ac110 comp rx=0 tx=0).stop 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 -- 172.21.15.52:0/1067869338 shutdown_connections 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad19210 0x55897ad12070 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad15240 0x55897ad17e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1067869338 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad17a80 0x55897ad5d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 -- 172.21.15.52:0/1067869338 >> 172.21.15.52:0/1067869338 conn(0x55897ad14240 msgr2=0x55897ad5c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 -- 172.21.15.52:0/1067869338 shutdown_connections 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.605+0000 7f08c91ec740 1 -- 172.21.15.52:0/1067869338 wait complete. 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.606+0000 7f08c91ec740 1 -- start start 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.606+0000 7f08c91ec740 1 Processor -- start 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897ad170f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897ad129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55897ac03750 con 0x55897ad17a80 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55897ac767b0 con 0x55897ad19210 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55897acdecf0 con 0x55897ad59930 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08c91ec740 10 client.0 _ll_register_callbacks cb 0x55897a98cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.607+0000 7f08bf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37764/0 (socket says 172.21.15.52:37764) 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 -- 172.21.15.52:0/3057287069 learned_addr learned my addr 172.21.15.52:0/3057287069 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897ad129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08b7e00640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897ad170f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 -- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 msgr2=0x55897ad129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897ad129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 -- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 msgr2=0x55897ad170f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897ad170f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 -- 172.21.15.52:0/3057287069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897a94d0f0 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08b7e00640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897ad170f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08bf400640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f08b0007100 tx=0x7f08b00010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d93fdbb07b7ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08acc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0026060 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f08b0010040 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.608+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b8031700 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f08b002c050 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 10 client.10020 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55897aab7f60 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8031700 con 0x55897ad17a80 2024-09-10T08:41:16.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f08b002f020 con 0x55897ad17a80 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 10 client.10020 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 10 client.10020 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 20 client.10020 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad77ff0 0x55897ad7a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 4 client.10020 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:16.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55897ac87f20 con 0x55897ad77ff0 2024-09-10T08:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.609+0000 7f08b7e00640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad77ff0 0x55897ad7a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.610+0000 7f08b7e00640 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad77ff0 0x55897ad7a3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=d9e3da0d14751ebf server_cookie=16a3cad55c243b17 in_seq=0 out_seq=0 2024-09-10T08:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.610+0000 7f08acc00640 10 client.10020 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08acc00640 1 -- 172.21.15.52:0/3057287069 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55897ac87f20 con 0x55897ad77ff0 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08acc00640 10 client.10020 handle_command_reply: tid=0 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 client.10020 shutdown 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 msgr2=0x55897ad2ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f08b0007100 tx=0x7f08b00010a0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 shutdown_connections 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad77ff0 0x55897ad7a3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897ad129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897ad170f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3057287069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad2ab10 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 >> 172.21.15.52:0/3057287069 conn(0x55897ad15240 msgr2=0x55897ad5be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08acc00640 0 client.10020 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 shutdown_connections 2024-09-10T08:41:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 1 -- 172.21.15.52:0/3057287069 wait complete. 2024-09-10T08:41:16.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.611+0000 7f08c91ec740 20 client.10020 trim_cache size 0 max 16384 2024-09-10T08:41:16.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 Processor -- start 2024-09-10T08:41:16.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 -- start start 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad19210 0x55897add14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 0x55897ad3e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08c0200a40 con 0x55897ad17a80 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08c01f8b60 con 0x55897ad59930 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.630+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08c00cadd0 con 0x55897ad19210 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37766/0 (socket says 172.21.15.52:37766) 2024-09-10T08:41:16.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 -- 172.21.15.52:0/3005200668 learned_addr learned my addr 172.21.15.52:0/3005200668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 -- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad19210 msgr2=0x55897add14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 0x55897ad3e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad19210 0x55897add14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 -- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 msgr2=0x55897ad3e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 0x55897ad3e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 -- 172.21.15.52:0/3005200668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897ad805d0 con 0x55897ad17a80 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bfe00640 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 0x55897ad3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.631+0000 7f08bf400640 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f08b0007f50 tx=0x7f08b0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00e0711b1af550c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08af400640 1 -- 172.21.15.52:0/3005200668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b000eb80 con 0x55897ad17a80 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08af400640 1 -- 172.21.15.52:0/3005200668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b0013470 con 0x55897ad17a80 2024-09-10T08:41:16.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08af400640 1 -- 172.21.15.52:0/3005200668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b0013840 con 0x55897ad17a80 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 -- 172.21.15.52:0/3005200668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 msgr2=0x55897ad3c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f08b0007f50 tx=0x7f08b0020000 comp rx=0 tx=0).stop 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 -- 172.21.15.52:0/3005200668 shutdown_connections 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad59930 0x55897ad3e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad19210 0x55897add14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 --2- 172.21.15.52:0/3005200668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad17a80 0x55897ad3c390 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 -- 172.21.15.52:0/3005200668 >> 172.21.15.52:0/3005200668 conn(0x55897ad15240 msgr2=0x55897ad5fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 -- 172.21.15.52:0/3005200668 shutdown_connections 2024-09-10T08:41:16.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.632+0000 7f08c91ec740 1 -- 172.21.15.52:0/3005200668 wait complete. 2024-09-10T08:41:16.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.633+0000 7f08c91ec740 1 -- start start 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.633+0000 7f08c91ec740 1 Processor -- start 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897add34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897adbe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55897ad59d90 con 0x55897ad37c80 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55897ad2b270 con 0x55897ad19210 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55897ad40510 con 0x55897ad59930 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08c91ec740 10 client.0 _ll_register_callbacks cb 0x7f08b0001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08bfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37778/0 (socket says 172.21.15.52:37778) 2024-09-10T08:41:16.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08bfe00640 1 -- 172.21.15.52:0/1488658306 learned_addr learned my addr 172.21.15.52:0/1488658306 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08b7e00640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897adbe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.634+0000 7f08bf400640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897add34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 -- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 msgr2=0x55897adbe300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897adbe300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 -- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 msgr2=0x55897add34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897add34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 -- 172.21.15.52:0/1488658306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55897a9261b0 con 0x55897ad37c80 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08bfe00640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f08b80aa690 tx=0x7f08b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d62d48cb173024 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:16.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08acc00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8083020 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f08b80aa1f0 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b0013470 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=133) ==== 24+0+0 (secure 0 0 0) 0x7f08b80aa3f0 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08c91ec740 10 client.10026 fetch_fsmap learned FSMap version 133 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.635+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=133,monmap=2+}) -- 0x55897add0a30 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b0013470 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 133) ==== 3490+0+0 (secure 0 0 0) 0x7f08b80992c0 con 0x55897ad37c80 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 10 client.10026 fetch_fsmap finished waiting for FSMap version 133 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 10 client.10026 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 20 client.10026 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad3d9b0 0x55897ad3dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:16.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 4 client.10026 mds_command: new command op to 8989 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 --> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55897ac82270 con 0x55897ad3d9b0 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.636+0000 7f08bf400640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad3d9b0 0x55897ad3dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08bf400640 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad3d9b0 0x55897ad3dd90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.8989 client_cookie=7930d0cf02fb62e server_cookie=8d340c407352e887 in_seq=0 out_seq=0 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08acc00640 10 client.10026 ms_handle_connect on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08acc00640 1 -- 172.21.15.52:0/1488658306 <== mds.8989 v2:172.21.15.52:6833/505845934 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55897ac82270 con 0x55897ad3d9b0 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08acc00640 10 client.10026 handle_command_reply: tid=0 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 client.10026 shutdown 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 msgr2=0x55897ad38100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f08b80aa690 tx=0x7f08b8009750 comp rx=0 tx=0).stop 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 shutdown_connections 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:6833/505845934,v1:172.21.15.52:6835/505845934] conn(0x55897ad3d9b0 0x55897ad3dd90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55897ad37c80 0x55897ad38100 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55897ad59930 0x55897adbe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 --2- 172.21.15.52:0/1488658306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55897ad19210 0x55897add34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08acc00640 0 client.10026 ms_handle_reset on v2:172.21.15.52:6833/505845934 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 >> 172.21.15.52:0/1488658306 conn(0x55897ad15240 msgr2=0x55897ad3c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 shutdown_connections 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 1 -- 172.21.15.52:0/1488658306 wait complete. 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:16.637+0000 7f08c91ec740 20 client.10026 trim_cache size 0 max 16384 2024-09-10T08:41:16.644 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: MDS is not active 2024-09-10T08:41:16.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-10T08:41:16.645 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:41:16.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:41:16.743 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:41:16.840 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:41:16.840 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:41:16.841 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:16.841 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:16.876 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:16.876 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:16.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:41:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.148+0000 7ff66d600640 1 Processor -- start 2024-09-10T08:41:17.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.148+0000 7ff66d600640 1 -- start start 2024-09-10T08:41:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff66d600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 0x7ff66806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff66d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff66d600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff668071b30 con 0x7ff668147e80 2024-09-10T08:41:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff66d600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff668074200 con 0x7ff668148260 2024-09-10T08:41:17.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff66d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680b3e40 con 0x7ff668071680 2024-09-10T08:41:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff667400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff65fe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 0x7ff66806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff667400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36492/0 (socket says 172.21.15.52:36492) 2024-09-10T08:41:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff667400640 1 -- 172.21.15.52:0/2146995476 learned_addr learned my addr 172.21.15.52:0/2146995476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:17.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.150+0000 7ff65fe00640 1 --2- 172.21.15.52:0/2146995476 >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 0x7ff66806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:58930/0 (socket says 172.21.15.52:58930) 2024-09-10T08:41:17.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.151+0000 7ff667400640 1 -- 172.21.15.52:0/2146995476 >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 msgr2=0x7ff66806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:17.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.151+0000 7ff667400640 1 --2- 172.21.15.52:0/2146995476 >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 0x7ff66806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.151+0000 7ff667400640 1 -- 172.21.15.52:0/2146995476 >> v1:172.21.15.176:6789/0 conn(0x7ff668147e80 legacy=0x7ff668070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.151+0000 7ff667400640 1 -- 172.21.15.52:0/2146995476 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6680b3510 con 0x7ff668071680 2024-09-10T08:41:17.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.151+0000 7ff666000640 1 -- 172.21.15.52:0/2146995476 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124149747 0 0) 0x7ff668071b30 con 0x7ff668147e80 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.152+0000 7ff667400640 1 --2- 172.21.15.52:0/2146995476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff660009e50 tx=0x7ff66002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65934211b7960e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.152+0000 7ff666000640 1 -- 172.21.15.52:0/2146995476 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660036070 con 0x7ff668071680 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.152+0000 7ff666000640 1 -- 172.21.15.52:0/2146995476 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff660031600 con 0x7ff668071680 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.152+0000 7ff666000640 1 -- 172.21.15.52:0/2146995476 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6600319d0 con 0x7ff668071680 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 -- 172.21.15.52:0/2146995476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 msgr2=0x7ff66806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 --2- 172.21.15.52:0/2146995476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff660009e50 tx=0x7ff66002a710 comp rx=0 tx=0).stop 2024-09-10T08:41:17.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 -- 172.21.15.52:0/2146995476 shutdown_connections 2024-09-10T08:41:17.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 --2- 172.21.15.52:0/2146995476 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66806c150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 --2- 172.21.15.52:0/2146995476 >> v2:172.21.15.176:3300/0 conn(0x7ff668148260 0x7ff66806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 -- 172.21.15.52:0/2146995476 >> 172.21.15.52:0/2146995476 conn(0x7ff6680ccec0 msgr2=0x7ff6680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:17.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 -- 172.21.15.52:0/2146995476 shutdown_connections 2024-09-10T08:41:17.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.153+0000 7ff66d600640 1 -- 172.21.15.52:0/2146995476 wait complete. 2024-09-10T08:41:17.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.154+0000 7ff66d600640 1 Processor -- start 2024-09-10T08:41:17.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 -- start start 2024-09-10T08:41:17.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66815e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff668147e80 0x7ff6680cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680b42d0 con 0x7ff668148260 2024-09-10T08:41:17.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680b3ad0 con 0x7ff668147e80 2024-09-10T08:41:17.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.155+0000 7ff66d600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680b4450 con 0x7ff668071680 2024-09-10T08:41:17.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37786/0 (socket says 172.21.15.52:37786) 2024-09-10T08:41:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 -- 172.21.15.52:0/3947516272 learned_addr learned my addr 172.21.15.52:0/3947516272 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff666a00640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff65fe00640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff668147e80 0x7ff6680cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 -- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 msgr2=0x7ff66815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 -- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff668147e80 msgr2=0x7ff6680cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff668147e80 0x7ff6680cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.156+0000 7ff667400640 1 -- 172.21.15.52:0/3947516272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6681f7980 con 0x7ff668148260 2024-09-10T08:41:17.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff667400640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff660034040 tx=0x7ff660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:17.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660036050 con 0x7ff668148260 2024-09-10T08:41:17.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff660042070 con 0x7ff668148260 2024-09-10T08:41:17.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660009510 con 0x7ff668148260 2024-09-10T08:41:17.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6681f7c60 con 0x7ff668148260 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.157+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6681f8220 con 0x7ff668148260 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.158+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6680ce690 con 0x7ff668148260 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.159+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff660007bf0 con 0x7ff668148260 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.160+0000 7ff65ea00640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 0x7ff64406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.160+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7ff6600abaf0 con 0x7ff668148260 2024-09-10T08:41:17.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.161+0000 7ff666a00640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 0x7ff64406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:17.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.161+0000 7ff666a00640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 0x7ff64406e320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff658000f60 tx=0x7ff658009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:17.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.165+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff660079e40 con 0x7ff668148260 2024-09-10T08:41:17.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.360+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff66815e570 con 0x7ff668148260 2024-09-10T08:41:17.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.360+0000 7ff65ea00640 1 -- 172.21.15.52:0/3947516272 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v171) ==== 80+0+0 (secure 0 0 0) 0x7ff66007e140 con 0x7ff668148260 2024-09-10T08:41:17.361 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.362+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 msgr2=0x7ff64406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.362+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 0x7ff64406e320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff658000f60 tx=0x7ff658009040 comp rx=0 tx=0).stop 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.362+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 msgr2=0x7ff6680cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.362+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff660034040 tx=0x7ff660004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 shutdown_connections 2024-09-10T08:41:17.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff64406be60 0x7ff64406e320 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff668148260 0x7ff6680cf700 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff668147e80 0x7ff6680cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 --2- 172.21.15.52:0/3947516272 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff668071680 0x7ff66815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 >> 172.21.15.52:0/3947516272 conn(0x7ff6680ccec0 msgr2=0x7ff668072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 shutdown_connections 2024-09-10T08:41:17.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:17.363+0000 7ff66d600640 1 -- 172.21.15.52:0/3947516272 wait complete. 2024-09-10T08:41:17.379 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:41:17.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:17.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:41:18.178 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:41:18.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:18.178 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:41:18.214 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:41:18.214 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:41:18.215 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:18.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:41:18.253 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:41:18.253 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:18.253 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:18.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:41:18.289 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:41:18.290 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:41:18.290 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:18.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:41:18.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.485+0000 7f6b9c000640 1 Processor -- start 2024-09-10T08:41:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.485+0000 7f6b9c000640 1 -- start start 2024-09-10T08:41:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.486+0000 7f6b9c000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b9414c480 0x7f6b94163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.486+0000 7f6b9c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.486+0000 7f6b9c000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b94164120 con 0x7f6b94073750 2024-09-10T08:41:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.486+0000 7f6b9c000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6b940732c0 con 0x7f6b9414c480 2024-09-10T08:41:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.486+0000 7f6b9c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6b940712a0 con 0x7f6b94073bc0 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.487+0000 7f6b9a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.487+0000 7f6b99600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6b9414c480 0x7f6b94163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.487+0000 7f6b98c00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f6b94073750 0x7f6b94164650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:42064/0 (socket says 172.21.15.52:42064) 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.487+0000 7f6b98c00640 1 -- 172.21.15.52:0/3504872066 learned_addr learned my addr 172.21.15.52:0/3504872066 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.487+0000 7f6b9a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:36508/0 (socket says 172.21.15.52:36508) 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b99600640 1 -- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 msgr2=0x7f6b9406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b99600640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b99600640 1 -- 172.21.15.52:0/3504872066 >> v1:172.21.15.176:6789/0 conn(0x7f6b94073750 legacy=0x7f6b94164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b93e00640 1 -- 172.21.15.52:0/3504872066 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890489903 0 0) 0x7f6b80001110 con 0x7f6b94073750 2024-09-10T08:41:18.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b99600640 1 -- 172.21.15.52:0/3504872066 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b94072c70 con 0x7f6b9414c480 2024-09-10T08:41:18.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.488+0000 7f6b9a000640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b99600640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b9414c480 0x7f6b94163be0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009d90 tx=0x7f6b8802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7faee4b967d54d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b93e00640 1 -- 172.21.15.52:0/3504872066 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88007740 con 0x7f6b9414c480 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b93e00640 1 -- 172.21.15.52:0/3504872066 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b880078e0 con 0x7f6b9414c480 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b93e00640 1 -- 172.21.15.52:0/3504872066 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88007cb0 con 0x7f6b9414c480 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b9c000640 1 -- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b9414c480 msgr2=0x7f6b94163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.489+0000 7f6b9c000640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b9414c480 0x7f6b94163be0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009d90 tx=0x7f6b8802a660 comp rx=0 tx=0).stop 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 -- 172.21.15.52:0/3504872066 shutdown_connections 2024-09-10T08:41:18.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b94073bc0 0x7f6b9406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 --2- 172.21.15.52:0/3504872066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b9414c480 0x7f6b94163be0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 -- 172.21.15.52:0/3504872066 >> 172.21.15.52:0/3504872066 conn(0x7f6b940ccec0 msgr2=0x7f6b940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 -- 172.21.15.52:0/3504872066 shutdown_connections 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.490+0000 7f6b9c000640 1 -- 172.21.15.52:0/3504872066 wait complete. 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.491+0000 7f6b9c000640 1 Processor -- start 2024-09-10T08:41:18.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.491+0000 7f6b9c000640 1 -- start start 2024-09-10T08:41:18.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b94073750 0x7f6b941488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b9414c480 0x7f6b94166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94071580 con 0x7f6b94073bc0 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6b94070f70 con 0x7f6b94073750 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.492+0000 7f6b9c000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6b940b6350 con 0x7f6b9414c480 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37790/0 (socket says 172.21.15.52:37790) 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b99600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b94073750 0x7f6b941488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 -- 172.21.15.52:0/765645291 learned_addr learned my addr 172.21.15.52:0/765645291 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b9a000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b9414c480 0x7f6b94166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 -- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b9414c480 msgr2=0x7f6b94166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b9414c480 0x7f6b94166670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 -- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b94073750 msgr2=0x7f6b941488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b94073750 0x7f6b941488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 -- 172.21.15.52:0/765645291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9414bc90 con 0x7f6b94073bc0 2024-09-10T08:41:18.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b98c00640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c780 tx=0x7f6b8000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.493+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80018070 con 0x7f6b94073bc0 2024-09-10T08:41:18.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.494+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b800072d0 con 0x7f6b94073bc0 2024-09-10T08:41:18.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.494+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9414b6d0 con 0x7f6b94073bc0 2024-09-10T08:41:18.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.494+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b800047e0 con 0x7f6b94073bc0 2024-09-10T08:41:18.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.494+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b941417e0 con 0x7f6b94073bc0 2024-09-10T08:41:18.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.495+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b94163be0 con 0x7f6b94073bc0 2024-09-10T08:41:18.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.496+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b8001b070 con 0x7f6b94073bc0 2024-09-10T08:41:18.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.497+0000 7f6b91600640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.497+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f6b80089fd0 con 0x7f6b94073bc0 2024-09-10T08:41:18.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.497+0000 7f6b99600640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.498+0000 7f6b99600640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6b88034000 tx=0x7f6b8802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.501+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b94164120 con 0x7f6b94073bc0 2024-09-10T08:41:18.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.725+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b940b5df0 con 0x7f6b94073bc0 2024-09-10T08:41:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.726+0000 7f6b91600640 1 -- 172.21.15.52:0/765645291 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5242 (secure 0 0 0) 0x7f6b80007d00 con 0x7f6b94073bc0 2024-09-10T08:41:18.726 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:18.726 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":133,"btime":"2024-09-10T08:41:14:708763+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":133,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:41:14.708751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8989":{"gid":8989,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:41:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 133 2024-09-10T08:41:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 msgr2=0x7f6b7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6b88034000 tx=0x7f6b8802f000 comp rx=0 tx=0).stop 2024-09-10T08:41:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 msgr2=0x7f6b94142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c780 tx=0x7f6b8000cb80 comp rx=0 tx=0).stop 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 shutdown_connections 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6b9414c480 0x7f6b94166670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b94073bc0 0x7f6b94142330 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 --2- 172.21.15.52:0/765645291 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b94073750 0x7f6b941488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 >> 172.21.15.52:0/765645291 conn(0x7f6b940ccec0 msgr2=0x7f6b940cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 shutdown_connections 2024-09-10T08:41:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.728+0000 7f6b9c000640 1 -- 172.21.15.52:0/765645291 wait complete. 2024-09-10T08:41:18.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.901+0000 7fb26f200640 1 Processor -- start 2024-09-10T08:41:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.901+0000 7fb26f200640 1 -- start start 2024-09-10T08:41:18.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.902+0000 7fb26f200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb27015e440 0x7fb2700d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.902+0000 7fb26f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 0x7fb2700b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.902+0000 7fb26f200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700d3990 con 0x7fb2700b6540 2024-09-10T08:41:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.902+0000 7fb26f200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb2700b69b0 con 0x7fb27015e440 2024-09-10T08:41:18.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.902+0000 7fb26f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700d3c70 con 0x7fb2700cf450 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26d400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 0x7fb2700b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26de00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb27015e440 0x7fb2700d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26e800640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fb2700b6540 0x7fb27006bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:42078/0 (socket says 172.21.15.52:42078) 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26e800640 1 -- 172.21.15.52:0/371860041 learned_addr learned my addr 172.21.15.52:0/371860041 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26ca00640 1 -- 172.21.15.52:0/371860041 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492417977 0 0) 0x7fb2700d3990 con 0x7fb2700b6540 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26ca00640 1 -- 172.21.15.52:0/371860041 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb254003520 con 0x7fb2700b6540 2024-09-10T08:41:18.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26de00640 1 -- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 msgr2=0x7fb2700b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26de00640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 0x7fb2700b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26de00640 1 -- 172.21.15.52:0/371860041 >> v1:172.21.15.176:6789/0 conn(0x7fb2700b6540 legacy=0x7fb27006bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26de00640 1 -- 172.21.15.52:0/371860041 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2700d3f50 con 0x7fb27015e440 2024-09-10T08:41:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.903+0000 7fb26d400640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 0x7fb2700b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.904+0000 7fb26de00640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700d3240 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097a0 tx=0x7fb26002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b8a74222f8c254 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26ca00640 1 -- 172.21.15.52:0/371860041 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260037070 con 0x7fb27015e440 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26ca00640 1 -- 172.21.15.52:0/371860041 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb260032440 con 0x7fb27015e440 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26ca00640 1 -- 172.21.15.52:0/371860041 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260032810 con 0x7fb27015e440 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 -- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 msgr2=0x7fb2700d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700d3240 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097a0 tx=0x7fb26002a210 comp rx=0 tx=0).stop 2024-09-10T08:41:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 -- 172.21.15.52:0/371860041 shutdown_connections 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700cf450 0x7fb2700b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 --2- 172.21.15.52:0/371860041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700d3240 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.905+0000 7fb26f200640 1 -- 172.21.15.52:0/371860041 >> 172.21.15.52:0/371860041 conn(0x7fb270067f80 msgr2=0x7fb2700d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.906+0000 7fb26f200640 1 -- 172.21.15.52:0/371860041 shutdown_connections 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.906+0000 7fb26f200640 1 -- 172.21.15.52:0/371860041 wait complete. 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.907+0000 7fb26f200640 1 Processor -- start 2024-09-10T08:41:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.907+0000 7fb26f200640 1 -- start start 2024-09-10T08:41:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700b6540 0x7fb270152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700b7540 con 0x7fb2700cf450 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb27015e820 con 0x7fb27015e440 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26f200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700b76c0 con 0x7fb2700b6540 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26d400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37798/0 (socket says 172.21.15.52:37798) 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.908+0000 7fb26d400640 1 -- 172.21.15.52:0/4010003655 learned_addr learned my addr 172.21.15.52:0/4010003655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26e800640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26de00640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700b6540 0x7fb270152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 -- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700b6540 msgr2=0x7fb270152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700b6540 0x7fb270152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 -- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 msgr2=0x7fb2700c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:18.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:18.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 -- 172.21.15.52:0/4010003655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2700cbe90 con 0x7fb2700cf450 2024-09-10T08:41:18.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26e800640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:18.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26d400640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00ebe0 tx=0x7fb25c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c017070 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c00cbd0 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c013470 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.909+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2700cc170 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.910+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2700cc730 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.911+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2700b6000 con 0x7fb2700cf450 2024-09-10T08:41:18.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.912+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb25c01a070 con 0x7fb2700cf450 2024-09-10T08:41:18.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.913+0000 7fb266000640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:18.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.913+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fb25c08b1e0 con 0x7fb2700cf450 2024-09-10T08:41:18.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.913+0000 7fb26de00640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:18.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.914+0000 7fb26de00640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 0x7fb25006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb260034000 tx=0x7fb26002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:18.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:18.917+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb25c059a60 con 0x7fb2700cf450 2024-09-10T08:41:19.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.136+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2700b4850 con 0x7fb2700cf450 2024-09-10T08:41:19.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.136+0000 7fb266000640 1 -- 172.21.15.52:0/4010003655 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5242 (secure 0 0 0) 0x7fb25c059360 con 0x7fb2700cf450 2024-09-10T08:41:19.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:19.137 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":133,"btime":"2024-09-10T08:41:14:708763+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":133,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:41:14.708751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8989":{"gid":8989,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:41:19.138 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 133 2024-09-10T08:41:19.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.138+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 msgr2=0x7fb25006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.138+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 0x7fb25006e2f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb260034000 tx=0x7fb26002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 msgr2=0x7fb2700ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00ebe0 tx=0x7fb25c00c520 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 shutdown_connections 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb27015e440 0x7fb2700c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2700cf450 0x7fb2700ca2b0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 --2- 172.21.15.52:0/4010003655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2700b6540 0x7fb270152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 >> 172.21.15.52:0/4010003655 conn(0x7fb270067f80 msgr2=0x7fb2700b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 shutdown_connections 2024-09-10T08:41:19.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.139+0000 7fb26f200640 1 -- 172.21.15.52:0/4010003655 wait complete. 2024-09-10T08:41:19.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:19.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.311+0000 7fe254a00640 1 Processor -- start 2024-09-10T08:41:19.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.311+0000 7fe254a00640 1 -- start start 2024-09-10T08:41:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe254a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 0x7fe25015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe254a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2500b4370 con 0x7fe2500b3e00 2024-09-10T08:41:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe254a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2500b4dc0 con 0x7fe2500cf5c0 2024-09-10T08:41:19.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe254a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe2500b4650 con 0x7fe2500cf9a0 2024-09-10T08:41:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe2500b3e00 0x7fe25015bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56604/0 (socket says 172.21.15.52:56604) 2024-09-10T08:41:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24de00640 1 -- 172.21.15.52:0/2976080987 learned_addr learned my addr 172.21.15.52:0/2976080987 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24f200640 1 --2- 172.21.15.52:0/2976080987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 0x7fe25015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144074329 0 0) 0x7fe2500b4370 con 0x7fe2500b3e00 2024-09-10T08:41:19.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe234003520 con 0x7fe2500b3e00 2024-09-10T08:41:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.313+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012538855 0 0) 0x7fe2500b4dc0 con 0x7fe2500cf5c0 2024-09-10T08:41:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.314+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2500b4370 con 0x7fe2500cf5c0 2024-09-10T08:41:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.314+0000 7fe24f200640 1 -- 172.21.15.52:0/2976080987 >> v1:172.21.15.176:6789/0 conn(0x7fe2500cf5c0 legacy=0x7fe2500b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.314+0000 7fe24f200640 1 -- 172.21.15.52:0/2976080987 >> v1:172.21.15.52:6789/0 conn(0x7fe2500b3e00 legacy=0x7fe25015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.314+0000 7fe24f200640 1 -- 172.21.15.52:0/2976080987 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2500b50a0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe24f200640 1 --2- 172.21.15.52:0/2976080987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 0x7fe25015c6f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2500b47d0 tx=0x7fe24802a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f711e1af91abdacc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248007740 con 0x7fe2500cf9a0 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480078e0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe24d400640 1 -- 172.21.15.52:0/2976080987 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248007cb0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe254a00640 1 -- 172.21.15.52:0/2976080987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 msgr2=0x7fe25015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.315+0000 7fe254a00640 1 --2- 172.21.15.52:0/2976080987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 0x7fe25015c6f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe2500b47d0 tx=0x7fe24802a5b0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.316+0000 7fe254a00640 1 -- 172.21.15.52:0/2976080987 shutdown_connections 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.316+0000 7fe254a00640 1 --2- 172.21.15.52:0/2976080987 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500cf9a0 0x7fe25015c6f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.316+0000 7fe254a00640 1 -- 172.21.15.52:0/2976080987 >> 172.21.15.52:0/2976080987 conn(0x7fe25006c240 msgr2=0x7fe25006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.316+0000 7fe254a00640 1 -- 172.21.15.52:0/2976080987 shutdown_connections 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.316+0000 7fe254a00640 1 -- 172.21.15.52:0/2976080987 wait complete. 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.317+0000 7fe254a00640 1 Processor -- start 2024-09-10T08:41:19.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.317+0000 7fe254a00640 1 -- start start 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500b3e00 0x7fe250153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2500cf5c0 0x7fe250152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe25015cdb0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe25015cc30 con 0x7fe2500cf5c0 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe254a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe250167230 con 0x7fe2500b3e00 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe24f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe24f200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37810/0 (socket says 172.21.15.52:37810) 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.318+0000 7fe24f200640 1 -- 172.21.15.52:0/2492305511 learned_addr learned my addr 172.21.15.52:0/2492305511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:19.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24e800640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500b3e00 0x7fe250153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24de00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2500cf5c0 0x7fe250152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 -- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500b3e00 msgr2=0x7fe250153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500b3e00 0x7fe250153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 -- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2500cf5c0 msgr2=0x7fe250152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2500cf5c0 0x7fe250152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 -- 172.21.15.52:0/2492305511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2501568b0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe24f200640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fe248009eb0 tx=0x7fe248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.319+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24803f070 con 0x7fe2500cf9a0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.320+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248031bc0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.320+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe250155ca0 con 0x7fe2500cf9a0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.320+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248009450 con 0x7fe2500cf9a0 2024-09-10T08:41:19.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.320+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe250156260 con 0x7fe2500cf9a0 2024-09-10T08:41:19.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.321+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250148870 con 0x7fe2500cf9a0 2024-09-10T08:41:19.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.322+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe24803b410 con 0x7fe2500cf9a0 2024-09-10T08:41:19.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.322+0000 7fe246a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.323+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7fe2480ac490 con 0x7fe2500cf9a0 2024-09-10T08:41:19.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.323+0000 7fe24e800640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.324+0000 7fe24e800640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 0x7fe23006e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe240007fd0 tx=0x7fe240009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.327+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe24807a750 con 0x7fe2500cf9a0 2024-09-10T08:41:19.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.512+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe250076260 con 0x7fe2500cf9a0 2024-09-10T08:41:19.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.513+0000 7fe246a00640 1 -- 172.21.15.52:0/2492305511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16695 (secure 0 0 0) 0x7fe24807ea50 con 0x7fe2500cf9a0 2024-09-10T08:41:19.514 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:19.514 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":171,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:40.589627+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:40:36.819582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-10T08:40:38.015560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 msgr2=0x7fe23006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 0x7fe23006e2f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe240007fd0 tx=0x7fe240009040 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 msgr2=0x7fe250146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fe248009eb0 tx=0x7fe248004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 shutdown_connections 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe23006be30 0x7fe23006e2f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2500cf9a0 0x7fe250146bf0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2500cf5c0 0x7fe250152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 --2- 172.21.15.52:0/2492305511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe2500b3e00 0x7fe250153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 >> 172.21.15.52:0/2492305511 conn(0x7fe25006c240 msgr2=0x7fe25006d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 shutdown_connections 2024-09-10T08:41:19.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.516+0000 7fe254a00640 1 -- 172.21.15.52:0/2492305511 wait complete. 2024-09-10T08:41:19.533 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:41:19.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.692+0000 7f3871e00640 1 Processor -- start 2024-09-10T08:41:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.692+0000 7f3871e00640 1 -- start start 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.693+0000 7f3871e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f386c15e440 0x7f386c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.693+0000 7f3871e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 0x7f386c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.693+0000 7f3871e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386c0d3990 con 0x7f386c0cf450 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.693+0000 7f3871e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0d3c70 con 0x7f386c15e440 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.693+0000 7f3871e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0d3f50 con 0x7f386c0b6710 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f386be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f386c0cf450 0x7f386c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56618/0 (socket says 172.21.15.52:56618) 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f386be00640 1 -- 172.21.15.52:0/3598241576 learned_addr learned my addr 172.21.15.52:0/3598241576 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3870a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f386c15e440 0x7f386c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3871400640 1 --2- 172.21.15.52:0/3598241576 >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 0x7f386c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3870a00640 1 -- 172.21.15.52:0/3598241576 >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 msgr2=0x7f386c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3870a00640 1 --2- 172.21.15.52:0/3598241576 >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 0x7f386c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3870a00640 1 -- 172.21.15.52:0/3598241576 >> v1:172.21.15.52:6789/0 conn(0x7f386c0cf450 legacy=0x7f386c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3870a00640 1 -- 172.21.15.52:0/3598241576 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c0d4230 con 0x7f386c15e440 2024-09-10T08:41:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f386b400640 1 -- 172.21.15.52:0/3598241576 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733743937 0 0) 0x7f386c0d3990 con 0x7f386c0cf450 2024-09-10T08:41:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.694+0000 7f3871400640 1 --2- 172.21.15.52:0/3598241576 >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 0x7f386c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.695+0000 7f3870a00640 1 --2- 172.21.15.52:0/3598241576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c15e440 0x7f386c0d3240 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f386c0d24b0 tx=0x7f386002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160e24111c8b7830 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.695+0000 7f386b400640 1 -- 172.21.15.52:0/3598241576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860037070 con 0x7f386c15e440 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.695+0000 7f386b400640 1 -- 172.21.15.52:0/3598241576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860032440 con 0x7f386c15e440 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.695+0000 7f386b400640 1 -- 172.21.15.52:0/3598241576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860032810 con 0x7f386c15e440 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 -- 172.21.15.52:0/3598241576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c15e440 msgr2=0x7f386c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 --2- 172.21.15.52:0/3598241576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c15e440 0x7f386c0d3240 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f386c0d24b0 tx=0x7f386002a250 comp rx=0 tx=0).stop 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 -- 172.21.15.52:0/3598241576 shutdown_connections 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 --2- 172.21.15.52:0/3598241576 >> v2:172.21.15.176:3300/0 conn(0x7f386c0b6710 0x7f386c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 --2- 172.21.15.52:0/3598241576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c15e440 0x7f386c0d3240 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 -- 172.21.15.52:0/3598241576 >> 172.21.15.52:0/3598241576 conn(0x7f386c067f80 msgr2=0x7f386c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 -- 172.21.15.52:0/3598241576 shutdown_connections 2024-09-10T08:41:19.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.696+0000 7f3871e00640 1 -- 172.21.15.52:0/3598241576 wait complete. 2024-09-10T08:41:19.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.698+0000 7f3871e00640 1 Processor -- start 2024-09-10T08:41:19.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.698+0000 7f3871e00640 1 -- start start 2024-09-10T08:41:19.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f386c0b6710 0x7f386c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 0x7f386c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0b76c0 con 0x7f386c0cf450 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0b7540 con 0x7f386c0b6710 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0b80a0 con 0x7f386c15e440 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37828/0 (socket says 172.21.15.52:37828) 2024-09-10T08:41:19.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 -- 172.21.15.52:0/171383986 learned_addr learned my addr 172.21.15.52:0/171383986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:19.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3870a00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f386c0b6710 0x7f386c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f3871400640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 0x7f386c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 -- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 msgr2=0x7f386c0c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 0x7f386c0c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 -- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f386c0b6710 msgr2=0x7f386c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.699+0000 7f386be00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f386c0b6710 0x7f386c15f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f386be00640 1 -- 172.21.15.52:0/171383986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1f4e90 con 0x7f386c0cf450 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3871400640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 0x7f386c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f386be00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f385800c4d0 tx=0x7f385800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858018070 con 0x7f386c0cf450 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3858007500 con 0x7f386c0cf450 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858004a20 con 0x7f386c0cf450 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c1f5170 con 0x7f386c0cf450 2024-09-10T08:41:19.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.700+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c160a20 con 0x7f386c0cf450 2024-09-10T08:41:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.701+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c0cf240 con 0x7f386c0cf450 2024-09-10T08:41:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.702+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f385801b070 con 0x7f386c0cf450 2024-09-10T08:41:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.704+0000 7f3868c00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 0x7f384c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.704+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f385808a150 con 0x7f386c0cf450 2024-09-10T08:41:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.704+0000 7f3870a00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 0x7f384c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.705+0000 7f3870a00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 0x7f384c06e2f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3860034000 tx=0x7f386002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.708+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f386c0cf240 con 0x7f386c0cf450 2024-09-10T08:41:19.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.932+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f386c0b7b60 con 0x7f386c0cf450 2024-09-10T08:41:19.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.933+0000 7f3868c00640 1 -- 172.21.15.52:0/171383986 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5242 (secure 0 0 0) 0x7f3858058b90 con 0x7f386c0cf450 2024-09-10T08:41:19.933 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":133,"btime":"2024-09-10T08:41:14:708763+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":133,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:41:14.708751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8989":{"gid":8989,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:41:19.934 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 133 2024-09-10T08:41:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 msgr2=0x7f384c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 0x7f384c06e2f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3860034000 tx=0x7f386002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 msgr2=0x7f386c161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f385800c4d0 tx=0x7f385800c990 comp rx=0 tx=0).stop 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 shutdown_connections 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f384c06be30 0x7f384c06e2f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f386c15e440 0x7f386c0c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f386c0cf450 0x7f386c161600 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 --2- 172.21.15.52:0/171383986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f386c0b6710 0x7f386c15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 >> 172.21.15.52:0/171383986 conn(0x7f386c067f80 msgr2=0x7f386c0b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 shutdown_connections 2024-09-10T08:41:19.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:19.935+0000 7f3871e00640 1 -- 172.21.15.52:0/171383986 wait complete. 2024-09-10T08:41:19.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.108+0000 7f9bc6800640 1 Processor -- start 2024-09-10T08:41:20.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.108+0000 7f9bc6800640 1 -- start start 2024-09-10T08:41:20.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bc6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0148260 0x7f9bc006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bc6800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc0071680 0x7f9bc006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bc6800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc0071b30 con 0x7f9bc0147e80 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bc6800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc0074200 con 0x7f9bc0071680 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bc6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc00b3e40 con 0x7f9bc0148260 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc0071680 0x7f9bc006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9bc0071680 0x7f9bc006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37830/0 (socket says 172.21.15.52:37830) 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 -- 172.21.15.52:0/1696868038 learned_addr learned my addr 172.21.15.52:0/1696868038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bb7e00640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0148260 0x7f9bc006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 -- 172.21.15.52:0/1696868038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0148260 msgr2=0x7f9bc006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0148260 0x7f9bc006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 -- 172.21.15.52:0/1696868038 >> v1:172.21.15.176:6789/0 conn(0x7f9bc0147e80 legacy=0x7f9bc0070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.110+0000 7f9bbfe00640 1 -- 172.21.15.52:0/1696868038 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc00b3510 con 0x7f9bc0071680 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.111+0000 7f9bbfe00640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc006c150 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009e50 tx=0x7f9bb802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbce01e9748a7bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bbea00640 1 -- 172.21.15.52:0/1696868038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8036070 con 0x7f9bc0071680 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bbea00640 1 -- 172.21.15.52:0/1696868038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8031600 con 0x7f9bc0071680 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bbea00640 1 -- 172.21.15.52:0/1696868038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80319d0 con 0x7f9bc0071680 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 -- 172.21.15.52:0/1696868038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 msgr2=0x7f9bc006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc006c150 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009e50 tx=0x7f9bb802a710 comp rx=0 tx=0).stop 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 -- 172.21.15.52:0/1696868038 shutdown_connections 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc006c150 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 --2- 172.21.15.52:0/1696868038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0148260 0x7f9bc006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 -- 172.21.15.52:0/1696868038 >> 172.21.15.52:0/1696868038 conn(0x7f9bc00ccec0 msgr2=0x7f9bc00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 -- 172.21.15.52:0/1696868038 shutdown_connections 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.112+0000 7f9bc6800640 1 -- 172.21.15.52:0/1696868038 wait complete. 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.114+0000 7f9bc6800640 1 Processor -- start 2024-09-10T08:41:20.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.114+0000 7f9bc6800640 1 -- start start 2024-09-10T08:41:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 0x7f9bc0140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 0x7f9bc01f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc00b42d0 con 0x7f9bc0071680 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc00b3ad0 con 0x7f9bc0148260 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bc6800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc00b4450 con 0x7f9bc0147e80 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bbf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bbf400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37838/0 (socket says 172.21.15.52:37838) 2024-09-10T08:41:20.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.115+0000 7f9bbf400640 1 -- 172.21.15.52:0/566474717 learned_addr learned my addr 172.21.15.52:0/566474717 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbfe00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 0x7f9bc01f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bb7e00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 0x7f9bc0140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 -- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 msgr2=0x7f9bc0140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 0x7f9bc0140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 -- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 msgr2=0x7f9bc01f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 0x7f9bc01f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 -- 172.21.15.52:0/566474717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc01f4bb0 con 0x7f9bc0071680 2024-09-10T08:41:20.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbfe00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 0x7f9bc01f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bb7e00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 0x7f9bc0140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bbf400640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c400 tx=0x7f9bb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00052d0 con 0x7f9bc0071680 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb0005490 con 0x7f9bc0071680 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0007260 con 0x7f9bc0071680 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc01f8990 con 0x7f9bc0071680 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.116+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc01f4e70 con 0x7f9bc0071680 2024-09-10T08:41:20.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.117+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc0070f70 con 0x7f9bc0071680 2024-09-10T08:41:20.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.118+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bb0007400 con 0x7f9bc0071680 2024-09-10T08:41:20.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.119+0000 7f9bb7400640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 0x7f9b9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.119+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f9bb008a390 con 0x7f9bc0071680 2024-09-10T08:41:20.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.120+0000 7f9bb7e00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 0x7f9b9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.121+0000 7f9bb7e00640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 0x7f9b9c06e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00abbc0 tx=0x7f9ba8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.124+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bb0058d30 con 0x7f9bc0071680 2024-09-10T08:41:20.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.346+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bc01f4970 con 0x7f9bc0071680 2024-09-10T08:41:20.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.347+0000 7f9bb7400640 1 -- 172.21.15.52:0/566474717 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 133 v133) ==== 95+0+5242 (secure 0 0 0) 0x7f9bb0058630 con 0x7f9bc0071680 2024-09-10T08:41:20.348 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:20.348 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":133,"btime":"2024-09-10T08:41:14:708763+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[{"mdsmap":{"epoch":133,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:40:39.018331+0000","modified":"2024-09-10T08:41:14.708751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9753},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8989":{"gid":8989,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/505845934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":505845934},{"type":"v1","addr":"172.21.15.52:6835","nonce":505845934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9753":{"gid":9753,"name":"c","rank":0,"incarnation":127,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/2110837576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2110837576},{"type":"v1","addr":"172.21.15.52:6834","nonce":2110837576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9753,"qdb_cluster":[9753]},"id":12}]} 2024-09-10T08:41:20.348 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 133 2024-09-10T08:41:20.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 msgr2=0x7f9b9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 0x7f9b9c06e2f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00abbc0 tx=0x7f9ba8008040 comp rx=0 tx=0).stop 2024-09-10T08:41:20.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 msgr2=0x7f9bc01f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000c400 tx=0x7f9bb000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 shutdown_connections 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9b9c06be30 0x7f9b9c06e2f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0148260 0x7f9bc01f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9bc0147e80 0x7f9bc0140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 --2- 172.21.15.52:0/566474717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bc0071680 0x7f9bc01f5390 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 >> 172.21.15.52:0/566474717 conn(0x7f9bc00ccec0 msgr2=0x7f9bc00cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 shutdown_connections 2024-09-10T08:41:20.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.349+0000 7f9bc6800640 1 -- 172.21.15.52:0/566474717 wait complete. 2024-09-10T08:41:20.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:20.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.521+0000 7f2e57600640 1 Processor -- start 2024-09-10T08:41:20.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.521+0000 7f2e57600640 1 -- start start 2024-09-10T08:41:20.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.522+0000 7f2e57600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e5006c320 0x7f2e5015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.522+0000 7f2e57600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 0x7f2e5015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e57600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50071180 con 0x7f2e500b2d40 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e57600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2e50071ab0 con 0x7f2e5006c320 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e57600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2e50071460 con 0x7f2e5013eb20 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e5006c320 0x7f2e5015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2e5006c320 0x7f2e5015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37842/0 (socket says 172.21.15.52:37842) 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 -- 172.21.15.52:0/2484782757 learned_addr learned my addr 172.21.15.52:0/2484782757 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e55600640 1 --2- 172.21.15.52:0/2484782757 >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 0x7f2e5015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 -- 172.21.15.52:0/2484782757 >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 msgr2=0x7f2e5015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 --2- 172.21.15.52:0/2484782757 >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 0x7f2e5015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 -- 172.21.15.52:0/2484782757 >> v1:172.21.15.176:6789/0 conn(0x7f2e500b2d40 legacy=0x7f2e5006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e4fe00640 1 -- 172.21.15.52:0/2484782757 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e50071740 con 0x7f2e5006c320 2024-09-10T08:41:20.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.523+0000 7f2e55600640 1 --2- 172.21.15.52:0/2484782757 >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 0x7f2e5015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.524+0000 7f2e4fe00640 1 --2- 172.21.15.52:0/2484782757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5006c320 0x7f2e5015bcf0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f2e501595c0 tx=0x7f2e3c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad60dadb2e001356 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.524+0000 7f2e4f400640 1 -- 172.21.15.52:0/2484782757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0325a0 con 0x7f2e5006c320 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.524+0000 7f2e4f400640 1 -- 172.21.15.52:0/2484782757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c038070 con 0x7f2e5006c320 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e4f400640 1 -- 172.21.15.52:0/2484782757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c032960 con 0x7f2e5006c320 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 -- 172.21.15.52:0/2484782757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5006c320 msgr2=0x7f2e5015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 --2- 172.21.15.52:0/2484782757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5006c320 0x7f2e5015bcf0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f2e501595c0 tx=0x7f2e3c02c8e0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 -- 172.21.15.52:0/2484782757 shutdown_connections 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 --2- 172.21.15.52:0/2484782757 >> v2:172.21.15.176:3300/0 conn(0x7f2e5013eb20 0x7f2e5015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 --2- 172.21.15.52:0/2484782757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5006c320 0x7f2e5015bcf0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 -- 172.21.15.52:0/2484782757 >> 172.21.15.52:0/2484782757 conn(0x7f2e500ccec0 msgr2=0x7f2e500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 -- 172.21.15.52:0/2484782757 shutdown_connections 2024-09-10T08:41:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.525+0000 7f2e57600640 1 -- 172.21.15.52:0/2484782757 wait complete. 2024-09-10T08:41:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.527+0000 7f2e57600640 1 Processor -- start 2024-09-10T08:41:20.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.527+0000 7f2e57600640 1 -- start start 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5006c320 0x7f2e5013d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e500b2d40 0x7f2e500caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e500720c0 con 0x7f2e5013eb20 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50071f40 con 0x7f2e5006c320 2024-09-10T08:41:20.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e57600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2e50072240 con 0x7f2e500b2d40 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e55600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e55600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37844/0 (socket says 172.21.15.52:37844) 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.528+0000 7f2e55600640 1 -- 172.21.15.52:0/1760249318 learned_addr learned my addr 172.21.15.52:0/1760249318 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e4fe00640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e500b2d40 0x7f2e500caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e54c00640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5006c320 0x7f2e5013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 -- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e500b2d40 msgr2=0x7f2e500caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e500b2d40 0x7f2e500caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 -- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5006c320 msgr2=0x7f2e5013d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5006c320 0x7f2e5013d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 -- 172.21.15.52:0/1760249318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5013d6b0 con 0x7f2e5013eb20 2024-09-10T08:41:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e55600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800cd80 tx=0x7f2e4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800f680 con 0x7f2e5013eb20 2024-09-10T08:41:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4800f840 con 0x7f2e5013eb20 2024-09-10T08:41:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.529+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800fc30 con 0x7f2e5013eb20 2024-09-10T08:41:20.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.530+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e500cb4e0 con 0x7f2e5013eb20 2024-09-10T08:41:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.530+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e500cb790 con 0x7f2e5013eb20 2024-09-10T08:41:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.531+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e500cfc70 con 0x7f2e5013eb20 2024-09-10T08:41:20.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.532+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e4800e3e0 con 0x7f2e5013eb20 2024-09-10T08:41:20.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.532+0000 7f2e4cc00640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 0x7f2e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.533+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f2e4808baa0 con 0x7f2e5013eb20 2024-09-10T08:41:20.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.533+0000 7f2e54c00640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 0x7f2e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.534+0000 7f2e54c00640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 0x7f2e3006e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2e5013fda0 tx=0x7f2e44007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.537+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e500cfc70 con 0x7f2e5013eb20 2024-09-10T08:41:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.723+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e5006bc10 con 0x7f2e5013eb20 2024-09-10T08:41:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.724+0000 7f2e4cc00640 1 -- 172.21.15.52:0/1760249318 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16695 (secure 0 0 0) 0x7f2e5013d6b0 con 0x7f2e5013eb20 2024-09-10T08:41:20.725 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:20.725 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":171,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:40:40.589627+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:40:36.819582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-10T08:40:38.015560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.726+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 msgr2=0x7f2e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.726+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 0x7f2e3006e2f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2e5013fda0 tx=0x7f2e44007e30 comp rx=0 tx=0).stop 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.726+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 msgr2=0x7f2e500cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.726+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800cd80 tx=0x7f2e4800a650 comp rx=0 tx=0).stop 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 shutdown_connections 2024-09-10T08:41:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2e3006be30 0x7f2e3006e2f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e5013eb20 0x7f2e500cafa0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e500b2d40 0x7f2e500caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 --2- 172.21.15.52:0/1760249318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e5006c320 0x7f2e5013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 >> 172.21.15.52:0/1760249318 conn(0x7f2e500ccec0 msgr2=0x7f2e5015f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 shutdown_connections 2024-09-10T08:41:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.727+0000 7f2e57600640 1 -- 172.21.15.52:0/1760249318 wait complete. 2024-09-10T08:41:20.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:41:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.900+0000 7f55b3c00640 1 Processor -- start 2024-09-10T08:41:20.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.900+0000 7f55b3c00640 1 -- start start 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b3c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55ac148260 0x7f55ac06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b3c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac071b30 con 0x7f55ac147e80 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b3c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac0b3510 con 0x7f55ac071680 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b3c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac074200 con 0x7f55ac148260 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55abe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f55ac148260 0x7f55ac06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b1200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f55ac147e80 0x7f55ac070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56626/0 (socket says 172.21.15.52:56626) 2024-09-10T08:41:20.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55b1200640 1 -- 172.21.15.52:0/834031188 learned_addr learned my addr 172.21.15.52:0/834031188 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55abe00640 1 -- 172.21.15.52:0/834031188 >> v1:172.21.15.176:6789/0 conn(0x7f55ac071680 legacy=0x7f55ac0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55abe00640 1 -- 172.21.15.52:0/834031188 >> v1:172.21.15.52:6789/0 conn(0x7f55ac147e80 legacy=0x7f55ac070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.903+0000 7f55abe00640 1 -- 172.21.15.52:0/834031188 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac0b37f0 con 0x7f55ac148260 2024-09-10T08:41:20.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.902+0000 7f55ab400640 1 -- 172.21.15.52:0/834031188 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803453103 0 0) 0x7f55ac071b30 con 0x7f55ac147e80 2024-09-10T08:41:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55abe00640 1 --2- 172.21.15.52:0/834031188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac148260 0x7f55ac06bc10 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6456e3cb7a2889 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55ab400640 1 -- 172.21.15.52:0/834031188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598037070 con 0x7f55ac148260 2024-09-10T08:41:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55ab400640 1 -- 172.21.15.52:0/834031188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598032440 con 0x7f55ac148260 2024-09-10T08:41:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55ab400640 1 -- 172.21.15.52:0/834031188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598032810 con 0x7f55ac148260 2024-09-10T08:41:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55b3c00640 1 -- 172.21.15.52:0/834031188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac148260 msgr2=0x7f55ac06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55b3c00640 1 --2- 172.21.15.52:0/834031188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac148260 0x7f55ac06bc10 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802a230 comp rx=0 tx=0).stop 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55b3c00640 1 -- 172.21.15.52:0/834031188 shutdown_connections 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55b3c00640 1 --2- 172.21.15.52:0/834031188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac148260 0x7f55ac06bc10 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.904+0000 7f55b3c00640 1 -- 172.21.15.52:0/834031188 >> 172.21.15.52:0/834031188 conn(0x7f55ac0ccec0 msgr2=0x7f55ac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.905+0000 7f55b3c00640 1 -- 172.21.15.52:0/834031188 shutdown_connections 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.905+0000 7f55b3c00640 1 -- 172.21.15.52:0/834031188 wait complete. 2024-09-10T08:41:20.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.906+0000 7f55b3c00640 1 Processor -- start 2024-09-10T08:41:20.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.906+0000 7f55b3c00640 1 -- start start 2024-09-10T08:41:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55ac071680 0x7f55ac0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 0x7f55ac1f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac06c150 con 0x7f55ac147e80 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac0b3e40 con 0x7f55ac148260 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55b3c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f55ac06c2d0 con 0x7f55ac071680 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.907+0000 7f55abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37868/0 (socket says 172.21.15.52:37868) 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 -- 172.21.15.52:0/4237829433 learned_addr learned my addr 172.21.15.52:0/4237829433 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55b1200640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55ac071680 0x7f55ac0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55b1c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 0x7f55ac1f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 -- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55ac071680 msgr2=0x7f55ac0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55ac071680 0x7f55ac0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 -- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 msgr2=0x7f55ac1f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 0x7f55ac1f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 -- 172.21.15.52:0/4237829433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac144be0 con 0x7f55ac147e80 2024-09-10T08:41:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55b1c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 0x7f55ac1f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:20.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.908+0000 7f55abe00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f5598000c00 tx=0x7f55980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.909+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598037040 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.909+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598042070 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.909+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598030a70 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.909+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1e4870 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.909+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1e4e30 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.910+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac06bc10 con 0x7f55ac147e80 2024-09-10T08:41:20.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.911+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5598030c10 con 0x7f55ac147e80 2024-09-10T08:41:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.912+0000 7f55a8c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 0x7f558c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.912+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5709+0+0 (secure 0 0 0) 0x7f55980ab890 con 0x7f55ac147e80 2024-09-10T08:41:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.912+0000 7f55b1200640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 0x7f558c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.913+0000 7f55b1200640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 0x7f558c06e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f55a0007f70 tx=0x7f55a0007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:20.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:20.916+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55ac144be0 con 0x7f55ac147e80 2024-09-10T08:41:21.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.134+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f55ac06c9c0 con 0x7f55ac147e80 2024-09-10T08:41:21.135 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:41:21.135+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:41:21.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.137+0000 7f55a8c00640 1 -- 172.21.15.52:0/4237829433 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v134) ==== 161+0+0 (secure 0 0 0) 0x7f559807a230 con 0x7f55ac147e80 2024-09-10T08:41:21.138 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:41:21.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 msgr2=0x7f558c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 0x7f558c06e2f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f55a0007f70 tx=0x7f55a0007f00 comp rx=0 tx=0).stop 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 msgr2=0x7f55ac1e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f5598000c00 tx=0x7f55980046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 shutdown_connections 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f558c06be30 0x7f558c06e2f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55ac148260 0x7f55ac1f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f55ac147e80 0x7f55ac1e5910 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 --2- 172.21.15.52:0/4237829433 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55ac071680 0x7f55ac0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.141+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 >> 172.21.15.52:0/4237829433 conn(0x7f55ac0ccec0 msgr2=0x7f55ac0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.142+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 shutdown_connections 2024-09-10T08:41:21.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.142+0000 7f55b3c00640 1 -- 172.21.15.52:0/4237829433 wait complete. 2024-09-10T08:41:21.160 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:41:21.209 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:41:21.216 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:41:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.322+0000 7fb50d800640 1 Processor -- start 2024-09-10T08:41:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.322+0000 7fb50d800640 1 -- start start 2024-09-10T08:41:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb50d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5080732e0 0x7fb5080736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb50d800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 0x7fb5080cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb50d800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5080714b0 con 0x7fb508071c70 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb50d800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb508073c00 con 0x7fb5080732e0 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb50d800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb5080cd880 con 0x7fb5080cce30 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5080732e0 0x7fb5080736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb5080732e0 0x7fb5080736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37906/0 (socket says 172.21.15.52:37906) 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 -- 172.21.15.52:0/695494514 learned_addr learned my addr 172.21.15.52:0/695494514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb4ffe00640 1 --2- 172.21.15.52:0/695494514 >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 0x7fb5080cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 -- 172.21.15.52:0/695494514 >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 msgr2=0x7fb5080cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 --2- 172.21.15.52:0/695494514 >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 0x7fb5080cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 -- 172.21.15.52:0/695494514 >> v1:172.21.15.176:6789/0 conn(0x7fb508071c70 legacy=0x7fb50815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb506a00640 1 -- 172.21.15.52:0/695494514 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5080cdb60 con 0x7fb5080732e0 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.324+0000 7fb4ffe00640 1 --2- 172.21.15.52:0/695494514 >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 0x7fb5080cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:21.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.325+0000 7fb506a00640 1 --2- 172.21.15.52:0/695494514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080736c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb5080c57f0 tx=0x7fb4f802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89fe3a54fb89af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb506000640 1 -- 172.21.15.52:0/695494514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8037070 con 0x7fb5080732e0 2024-09-10T08:41:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb506000640 1 -- 172.21.15.52:0/695494514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f8032440 con 0x7fb5080732e0 2024-09-10T08:41:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb506000640 1 -- 172.21.15.52:0/695494514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8032810 con 0x7fb5080732e0 2024-09-10T08:41:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 -- 172.21.15.52:0/695494514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 msgr2=0x7fb5080736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 --2- 172.21.15.52:0/695494514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080736c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb5080c57f0 tx=0x7fb4f802a1f0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 -- 172.21.15.52:0/695494514 shutdown_connections 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 --2- 172.21.15.52:0/695494514 >> v2:172.21.15.176:3300/0 conn(0x7fb5080cce30 0x7fb5080cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 --2- 172.21.15.52:0/695494514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080736c0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 -- 172.21.15.52:0/695494514 >> 172.21.15.52:0/695494514 conn(0x7fb50806d0f0 msgr2=0x7fb50806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 -- 172.21.15.52:0/695494514 shutdown_connections 2024-09-10T08:41:21.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.326+0000 7fb50d800640 1 -- 172.21.15.52:0/695494514 wait complete. 2024-09-10T08:41:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.328+0000 7fb50d800640 1 Processor -- start 2024-09-10T08:41:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.328+0000 7fb50d800640 1 -- start start 2024-09-10T08:41:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 0x7fb508152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 0x7fb5080b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb50806bf70 con 0x7fb5080732e0 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb50806bdf0 con 0x7fb5080cce30 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb50d800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb50815cfe0 con 0x7fb508071c70 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37920/0 (socket says 172.21.15.52:37920) 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 -- 172.21.15.52:0/1770895344 learned_addr learned my addr 172.21.15.52:0/1770895344 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb506a00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 0x7fb508152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 -- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 msgr2=0x7fb508152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb507400640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 0x7fb5080b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 0x7fb508152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.329+0000 7fb4ffe00640 1 -- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 msgr2=0x7fb5080b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:21.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4ffe00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 0x7fb5080b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4ffe00640 1 -- 172.21.15.52:0/1770895344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb508152680 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb506a00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 0x7fb508152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb507400640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 0x7fb5080b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4ffe00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000d7d0 tx=0x7fb4f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0004030 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f00041d0 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00096a0 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5080c6660 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.330+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5080c6c20 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.331+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50815d370 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.332+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4f0009840 con 0x7fb5080732e0 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.333+0000 7fb4fea00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 0x7fb4e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:21.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.333+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5795+0+0 (secure 0 0 0) 0x7fb4f008b190 con 0x7fb5080732e0 2024-09-10T08:41:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.334+0000 7fb506a00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 0x7fb4e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:21.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.334+0000 7fb506a00640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 0x7fb4e406e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8034000 tx=0x7fb4f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:21.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.337+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4f0059ad0 con 0x7fb5080732e0 2024-09-10T08:41:21.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:21.557+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb5080c61b0 con 0x7fb5080732e0 2024-09-10T08:41:22.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.143+0000 7fb4fea00640 1 -- 172.21.15.52:0/1770895344 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v135) ==== 104+0+0 (secure 0 0 0) 0x7fb4f00593d0 con 0x7fb5080732e0 2024-09-10T08:41:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 msgr2=0x7fb4e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 0x7fb4e406e2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8034000 tx=0x7fb4f802e000 comp rx=0 tx=0).stop 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 msgr2=0x7fb5080b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000d7d0 tx=0x7fb4f000dc90 comp rx=0 tx=0).stop 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 shutdown_connections 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb4e406be30 0x7fb4e406e2f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5080cce30 0x7fb5080b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5080732e0 0x7fb5080b2770 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 --2- 172.21.15.52:0/1770895344 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb508071c70 0x7fb508152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.147+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 >> 172.21.15.52:0/1770895344 conn(0x7fb50806d0f0 msgr2=0x7fb50815e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.148+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 shutdown_connections 2024-09-10T08:41:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.148+0000 7fb50d800640 1 -- 172.21.15.52:0/1770895344 wait complete. 2024-09-10T08:41:22.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:41:22.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.332+0000 7f592de00640 1 Processor -- start 2024-09-10T08:41:22.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.332+0000 7f592de00640 1 -- start start 2024-09-10T08:41:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f592de00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59280b6000 0x7f59280afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:22.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f592de00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5928146220 con 0x7f59280b2dc0 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f592de00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59280cf640 con 0x7f59281454b0 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f592de00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f59280b1920 con 0x7f59280b6000 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59280b6000 0x7f59280afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f59280b6000 0x7f59280afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37932/0 (socket says 172.21.15.52:37932) 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f5927400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f59280b2dc0 0x7f59280b0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56656/0 (socket says 172.21.15.52:56656) 2024-09-10T08:41:22.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 -- 172.21.15.52:0/1473441799 learned_addr learned my addr 172.21.15.52:0/1473441799 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 -- 172.21.15.52:0/1473441799 >> v1:172.21.15.176:6789/0 conn(0x7f59281454b0 legacy=0x7f59280b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 -- 172.21.15.52:0/1473441799 >> v1:172.21.15.52:6789/0 conn(0x7f59280b2dc0 legacy=0x7f59280b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.334+0000 7f591fe00640 1 -- 172.21.15.52:0/1473441799 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59280cf8e0 con 0x7f59280b6000 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.335+0000 7f591fe00640 1 --2- 172.21.15.52:0/1473441799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b6000 0x7f59280afe40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f591002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f756fa6d046abd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f5926000640 1 -- 172.21.15.52:0/1473441799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910037070 con 0x7f59280b6000 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f5926000640 1 -- 172.21.15.52:0/1473441799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910032640 con 0x7f59280b6000 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f5926000640 1 -- 172.21.15.52:0/1473441799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910032a10 con 0x7f59280b6000 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 -- 172.21.15.52:0/1473441799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b6000 msgr2=0x7f59280afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 --2- 172.21.15.52:0/1473441799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b6000 0x7f59280afe40 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f591002a330 comp rx=0 tx=0).stop 2024-09-10T08:41:22.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 -- 172.21.15.52:0/1473441799 shutdown_connections 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 --2- 172.21.15.52:0/1473441799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b6000 0x7f59280afe40 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 -- 172.21.15.52:0/1473441799 >> 172.21.15.52:0/1473441799 conn(0x7f592806c240 msgr2=0x7f592806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 -- 172.21.15.52:0/1473441799 shutdown_connections 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.336+0000 7f592de00640 1 -- 172.21.15.52:0/1473441799 wait complete. 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.338+0000 7f592de00640 1 Processor -- start 2024-09-10T08:41:22.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.338+0000 7f592de00640 1 -- start start 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59280b6000 0x7f5928143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59281454b0 0x7f59280aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59280d0180 con 0x7f59280b2dc0 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59280cfea0 con 0x7f59281454b0 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f592de00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f59281459a0 con 0x7f59280b6000 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f5926a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:22.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f5926a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37934/0 (socket says 172.21.15.52:37934) 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f5926a00640 1 -- 172.21.15.52:0/3250042696 learned_addr learned my addr 172.21.15.52:0/3250042696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f5927400640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59281454b0 0x7f59280aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.339+0000 7f591fe00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59280b6000 0x7f5928143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 -- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59280b6000 msgr2=0x7f5928143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59280b6000 0x7f5928143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 -- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59281454b0 msgr2=0x7f59280aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59281454b0 0x7f59280aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 -- 172.21.15.52:0/3250042696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5928130d00 con 0x7f59280b2dc0 2024-09-10T08:41:22.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f5926a00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f591800b3f0 tx=0x7f591800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918015020 con 0x7f59280b2dc0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5918011830 con 0x7f59280b2dc0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918011c20 con 0x7f59280b2dc0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5928130fe0 con 0x7f59280b2dc0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.340+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59281315a0 con 0x7f59280b2dc0 2024-09-10T08:41:22.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.341+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59280b58f0 con 0x7f59280b2dc0 2024-09-10T08:41:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.342+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5918018020 con 0x7f59280b2dc0 2024-09-10T08:41:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.343+0000 7f591f400640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 0x7f590406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.343+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5795+0+0 (secure 0 0 0) 0x7f591808ac20 con 0x7f59280b2dc0 2024-09-10T08:41:22.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.344+0000 7f591fe00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 0x7f590406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:22.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.344+0000 7f591fe00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 0x7f590406e2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f591002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:22.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.347+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f591801f030 con 0x7f59280b2dc0 2024-09-10T08:41:22.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:22.533+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f59280b0bd0 con 0x7f59280b2dc0 2024-09-10T08:41:23.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.145+0000 7f591f400640 1 -- 172.21.15.52:0/3250042696 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v173) ==== 181+0+0 (secure 0 0 0) 0x7f59180172c0 con 0x7f59280b2dc0 2024-09-10T08:41:23.145 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:41:23.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.148+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 msgr2=0x7f590406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.148+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 0x7f590406e2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f591002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:23.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.148+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 msgr2=0x7f5928142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.148+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f591800b3f0 tx=0x7f591800b8b0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 shutdown_connections 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f590406be30 0x7f590406e2f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59281454b0 0x7f59280aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59280b6000 0x7f5928143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 --2- 172.21.15.52:0/3250042696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59280b2dc0 0x7f5928142c50 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 >> 172.21.15.52:0/3250042696 conn(0x7f592806c240 msgr2=0x7f59280afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.149+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 shutdown_connections 2024-09-10T08:41:23.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.150+0000 7f592de00640 1 -- 172.21.15.52:0/3250042696 wait complete. 2024-09-10T08:41:23.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:41:23.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.335+0000 7f9c46600640 1 Processor -- start 2024-09-10T08:41:23.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.335+0000 7f9c46600640 1 -- start start 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.336+0000 7f9c46600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c400d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.336+0000 7f9c46600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4015d1f0 con 0x7f9c400b3e00 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.336+0000 7f9c46600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4015d4d0 con 0x7f9c400cf370 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.336+0000 7f9c46600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4015d7b0 con 0x7f9c400cef90 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9c400b3e00 0x7f9c4006e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56672/0 (socket says 172.21.15.52:56672) 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3fe00640 1 -- 172.21.15.52:0/720453881 learned_addr learned my addr 172.21.15.52:0/720453881 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:23.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3f400640 1 --2- 172.21.15.52:0/720453881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c400d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907661305 0 0) 0x7f9c4015d1f0 con 0x7f9c400b3e00 2024-09-10T08:41:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c24003520 con 0x7f9c400b3e00 2024-09-10T08:41:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983589460 0 0) 0x7f9c4015d4d0 con 0x7f9c400cf370 2024-09-10T08:41:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4015d1f0 con 0x7f9c400cf370 2024-09-10T08:41:23.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3f400640 1 -- 172.21.15.52:0/720453881 >> v1:172.21.15.176:6789/0 conn(0x7f9c400cf370 legacy=0x7f9c400b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3f400640 1 -- 172.21.15.52:0/720453881 >> v1:172.21.15.52:6789/0 conn(0x7f9c400b3e00 legacy=0x7f9c4006e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.337+0000 7f9c3f400640 1 -- 172.21.15.52:0/720453881 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4015da90 con 0x7f9c400cef90 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.338+0000 7f9c3f400640 1 --2- 172.21.15.52:0/720453881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c400d0e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097d0 tx=0x7f9c3002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8eab93170ad69b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30037070 con 0x7f9c400cef90 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30032440 con 0x7f9c400cef90 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c3e000640 1 -- 172.21.15.52:0/720453881 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c300327f0 con 0x7f9c400cef90 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 -- 172.21.15.52:0/720453881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 msgr2=0x7f9c400d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 --2- 172.21.15.52:0/720453881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c400d0e10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c300097d0 tx=0x7f9c3002a210 comp rx=0 tx=0).stop 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 -- 172.21.15.52:0/720453881 shutdown_connections 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 --2- 172.21.15.52:0/720453881 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c400d0e10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 -- 172.21.15.52:0/720453881 >> 172.21.15.52:0/720453881 conn(0x7f9c40067da0 msgr2=0x7f9c4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 -- 172.21.15.52:0/720453881 shutdown_connections 2024-09-10T08:41:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.339+0000 7f9c46600640 1 -- 172.21.15.52:0/720453881 wait complete. 2024-09-10T08:41:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.341+0000 7f9c46600640 1 Processor -- start 2024-09-10T08:41:23.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.341+0000 7f9c46600640 1 -- start start 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c40153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 0x7f9c401535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015ce00 con 0x7f9c400b3e00 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4015cc80 con 0x7f9c400cf370 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c46600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4015cf80 con 0x7f9c400cef90 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c3f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c3f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37936/0 (socket says 172.21.15.52:37936) 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.342+0000 7f9c3f400640 1 -- 172.21.15.52:0/1219789159 learned_addr learned my addr 172.21.15.52:0/1219789159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3ea00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c40153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3fe00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 0x7f9c401535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 -- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 msgr2=0x7f9c40153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c40153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 -- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 msgr2=0x7f9c401535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 0x7f9c401535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 -- 172.21.15.52:0/1219789159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c401f41a0 con 0x7f9c400b3e00 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3ea00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c40153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3fe00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 0x7f9c401535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c3f400640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002a250 tx=0x7f9c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30041030 con 0x7f9c400b3e00 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3003d4e0 con 0x7f9c400b3e00 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c401f4480 con 0x7f9c400b3e00 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c30037040 con 0x7f9c400b3e00 2024-09-10T08:41:23.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.343+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c401f4a40 con 0x7f9c400b3e00 2024-09-10T08:41:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.344+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c400d0e10 con 0x7f9c400b3e00 2024-09-10T08:41:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.345+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c30044070 con 0x7f9c400b3e00 2024-09-10T08:41:23.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.346+0000 7f9c37400640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 0x7f9c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.346+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5357+0+0 (secure 0 0 0) 0x7f9c300ab4b0 con 0x7f9c400b3e00 2024-09-10T08:41:23.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.347+0000 7f9c3ea00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 0x7f9c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:23.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.348+0000 7f9c3ea00640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 0x7f9c2006e2f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c001610 tx=0x7f9c2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:23.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.350+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c30044e40 con 0x7f9c400b3e00 2024-09-10T08:41:23.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:23.535+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c4006f1b0 con 0x7f9c400b3e00 2024-09-10T08:41:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.151+0000 7f9c37400640 1 -- 172.21.15.52:0/1219789159 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v174) ==== 169+0+0 (secure 0 0 0) 0x7f9c30079f30 con 0x7f9c400b3e00 2024-09-10T08:41:24.152 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:41:24.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.155+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 msgr2=0x7f9c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.155+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 0x7f9c2006e2f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c001610 tx=0x7f9c2c009040 comp rx=0 tx=0).stop 2024-09-10T08:41:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.155+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 msgr2=0x7f9c400b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.155+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002a250 tx=0x7f9c300046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 shutdown_connections 2024-09-10T08:41:24.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9c2006be30 0x7f9c2006e2f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9c400cf370 0x7f9c401535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9c400cef90 0x7f9c40153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 --2- 172.21.15.52:0/1219789159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c400b3e00 0x7f9c400b2740 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 >> 172.21.15.52:0/1219789159 conn(0x7f9c40067da0 msgr2=0x7f9c4015e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.156+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 shutdown_connections 2024-09-10T08:41:24.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.157+0000 7f9c46600640 1 -- 172.21.15.52:0/1219789159 wait complete. 2024-09-10T08:41:24.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:41:24.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.356+0000 7ff355400640 1 Processor -- start 2024-09-10T08:41:24.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.356+0000 7ff355400640 1 -- start start 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff355400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff350073600 0x7ff350162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff355400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 0x7ff3500aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff355400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350073cc0 con 0x7ff350155950 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff355400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff3501631c0 con 0x7ff350073600 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff355400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff3500b04d0 con 0x7ff3500afb20 2024-09-10T08:41:24.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff34e800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff350155950 0x7ff35006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35656/0 (socket says 172.21.15.52:35656) 2024-09-10T08:41:24.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff34e800640 1 -- 172.21.15.52:0/1515329643 learned_addr learned my addr 172.21.15.52:0/1515329643 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:24.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff347e00640 1 --2- 172.21.15.52:0/1515329643 >> v2:172.21.15.52:3300/0 conn(0x7ff350073600 0x7ff350162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff34f200640 1 --2- 172.21.15.52:0/1515329643 >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 0x7ff3500aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff347e00640 1 -- 172.21.15.52:0/1515329643 >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 msgr2=0x7ff3500aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff347e00640 1 --2- 172.21.15.52:0/1515329643 >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 0x7ff3500aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff347e00640 1 -- 172.21.15.52:0/1515329643 >> v1:172.21.15.52:6789/0 conn(0x7ff350155950 legacy=0x7ff35006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff34de00640 1 -- 172.21.15.52:0/1515329643 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649306380 0 0) 0x7ff350073cc0 con 0x7ff350155950 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff347e00640 1 -- 172.21.15.52:0/1515329643 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff350071aa0 con 0x7ff350073600 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.358+0000 7ff34f200640 1 --2- 172.21.15.52:0/1515329643 >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 0x7ff3500aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:24.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.359+0000 7ff347e00640 1 --2- 172.21.15.52:0/1515329643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff350073600 0x7ff350162c80 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff35006ebb0 tx=0x7ff33802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aba65c5bbfd174 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff34de00640 1 -- 172.21.15.52:0/1515329643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338037070 con 0x7ff350073600 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff34de00640 1 -- 172.21.15.52:0/1515329643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff338032440 con 0x7ff350073600 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff34de00640 1 -- 172.21.15.52:0/1515329643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338032810 con 0x7ff350073600 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 -- 172.21.15.52:0/1515329643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff350073600 msgr2=0x7ff350162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 --2- 172.21.15.52:0/1515329643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff350073600 0x7ff350162c80 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7ff35006ebb0 tx=0x7ff33802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 -- 172.21.15.52:0/1515329643 shutdown_connections 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 --2- 172.21.15.52:0/1515329643 >> v2:172.21.15.176:3300/0 conn(0x7ff3500afb20 0x7ff3500aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 --2- 172.21.15.52:0/1515329643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff350073600 0x7ff350162c80 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 -- 172.21.15.52:0/1515329643 >> 172.21.15.52:0/1515329643 conn(0x7ff35006db30 msgr2=0x7ff35006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 -- 172.21.15.52:0/1515329643 shutdown_connections 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.360+0000 7ff355400640 1 -- 172.21.15.52:0/1515329643 wait complete. 2024-09-10T08:41:24.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.362+0000 7ff355400640 1 Processor -- start 2024-09-10T08:41:24.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.362+0000 7ff355400640 1 -- start start 2024-09-10T08:41:24.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff350073600 0x7ff350143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 0x7ff350153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff350073a60 con 0x7ff3500afb20 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff350070370 con 0x7ff350073600 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff355400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff35006c320 con 0x7ff3500d0150 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff347e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff347e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47216/0 (socket says 172.21.15.52:47216) 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.363+0000 7ff347e00640 1 -- 172.21.15.52:0/1234043878 learned_addr learned my addr 172.21.15.52:0/1234043878 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff34e800640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff350073600 0x7ff350143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff34f200640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 0x7ff350153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 -- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 msgr2=0x7ff350153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 0x7ff350153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 -- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff350073600 msgr2=0x7ff350143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff350073600 0x7ff350143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 -- 172.21.15.52:0/1234043878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff350154450 con 0x7ff3500afb20 2024-09-10T08:41:24.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff34f200640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 0x7ff350153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff347e00640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff338000c00 tx=0x7ff3380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.364+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338037050 con 0x7ff3500afb20 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.365+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff338038040 con 0x7ff3500afb20 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.365+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3501413f0 con 0x7ff3500afb20 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.365+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338004450 con 0x7ff3500afb20 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.365+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3501419b0 con 0x7ff3500afb20 2024-09-10T08:41:24.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.366+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff350072060 con 0x7ff3500afb20 2024-09-10T08:41:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.367+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff338030980 con 0x7ff3500afb20 2024-09-10T08:41:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.367+0000 7ff346a00640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 0x7ff32c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.368+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7ff3380ab7c0 con 0x7ff3500afb20 2024-09-10T08:41:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.368+0000 7ff34e800640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 0x7ff32c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.369+0000 7ff34e800640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 0x7ff32c06e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff340007fd0 tx=0x7ff340007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.372+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff33807a4f0 con 0x7ff3500afb20 2024-09-10T08:41:24.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.576+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff350154f20 con 0x7ff3500afb20 2024-09-10T08:41:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.580+0000 7ff346a00640 1 -- 172.21.15.52:0/1234043878 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7ff338079df0 con 0x7ff3500afb20 2024-09-10T08:41:24.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 msgr2=0x7ff32c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 0x7ff32c06e2f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff340007fd0 tx=0x7ff340007de0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 msgr2=0x7ff3500cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7ff338000c00 tx=0x7ff3380046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 shutdown_connections 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff32c06be30 0x7ff32c06e2f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3500d0150 0x7ff350153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3500afb20 0x7ff3500cfc10 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 --2- 172.21.15.52:0/1234043878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff350073600 0x7ff350143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.582+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 >> 172.21.15.52:0/1234043878 conn(0x7ff35006db30 msgr2=0x7ff35006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.583+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 shutdown_connections 2024-09-10T08:41:24.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.583+0000 7ff355400640 1 -- 172.21.15.52:0/1234043878 wait complete. 2024-09-10T08:41:24.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-10T08:41:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.755+0000 7f58afe00640 1 Processor -- start 2024-09-10T08:41:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.755+0000 7f58afe00640 1 -- start start 2024-09-10T08:41:24.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.756+0000 7f58afe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f58a80b2d40 0x7f58a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58afe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a8071180 con 0x7f58a813eb20 2024-09-10T08:41:24.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58afe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a8071460 con 0x7f58a806c150 2024-09-10T08:41:24.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58afe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f58a8071ab0 con 0x7f58a80b2d40 2024-09-10T08:41:24.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58aca00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f58a813eb20 0x7f58a815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35662/0 (socket says 172.21.15.52:35662) 2024-09-10T08:41:24.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58aca00640 1 -- 172.21.15.52:0/486968117 learned_addr learned my addr 172.21.15.52:0/486968117 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:24.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58ad400640 1 --2- 172.21.15.52:0/486968117 >> v2:172.21.15.176:3300/0 conn(0x7f58a80b2d40 0x7f58a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264290890 0 0) 0x7f58a8071180 con 0x7f58a813eb20 2024-09-10T08:41:24.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5890003520 con 0x7f58a813eb20 2024-09-10T08:41:24.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58ad400640 1 -- 172.21.15.52:0/486968117 >> v1:172.21.15.176:6789/0 conn(0x7f58a806c150 legacy=0x7f58a8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.757+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871246096 0 0) 0x7f58a8071460 con 0x7f58a806c150 2024-09-10T08:41:24.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.758+0000 7f58ad400640 1 -- 172.21.15.52:0/486968117 >> v1:172.21.15.52:6789/0 conn(0x7f58a813eb20 legacy=0x7f58a815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.758+0000 7f58ad400640 1 -- 172.21.15.52:0/486968117 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a8071740 con 0x7f58a80b2d40 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58ad400640 1 --2- 172.21.15.52:0/486968117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a80b2d40 0x7f58a806bc10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f589c0097a0 tx=0x7f589c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d8ceca847d71295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c037070 con 0x7f58a80b2d40 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c032440 con 0x7f58a80b2d40 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58a7e00640 1 -- 172.21.15.52:0/486968117 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c032810 con 0x7f58a80b2d40 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58afe00640 1 -- 172.21.15.52:0/486968117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a80b2d40 msgr2=0x7f58a806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58afe00640 1 --2- 172.21.15.52:0/486968117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a80b2d40 0x7f58a806bc10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f589c0097a0 tx=0x7f589c02a230 comp rx=0 tx=0).stop 2024-09-10T08:41:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58afe00640 1 -- 172.21.15.52:0/486968117 shutdown_connections 2024-09-10T08:41:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.759+0000 7f58afe00640 1 --2- 172.21.15.52:0/486968117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a80b2d40 0x7f58a806bc10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.760+0000 7f58afe00640 1 -- 172.21.15.52:0/486968117 >> 172.21.15.52:0/486968117 conn(0x7f58a80ccec0 msgr2=0x7f58a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.760+0000 7f58afe00640 1 -- 172.21.15.52:0/486968117 shutdown_connections 2024-09-10T08:41:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.760+0000 7f58afe00640 1 -- 172.21.15.52:0/486968117 wait complete. 2024-09-10T08:41:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.761+0000 7f58afe00640 1 Processor -- start 2024-09-10T08:41:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.761+0000 7f58afe00640 1 -- start start 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58a80b2d40 0x7f58a8152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a813eb20 0x7f58a80b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58a815c7d0 con 0x7f58a806c150 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f58a815c650 con 0x7f58a813eb20 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58afe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f58a8072650 con 0x7f58a80b2d40 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.762+0000 7f58ad400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47228/0 (socket says 172.21.15.52:47228) 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 -- 172.21.15.52:0/2456819519 learned_addr learned my addr 172.21.15.52:0/2456819519 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ade00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a813eb20 0x7f58a80b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58aca00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58a80b2d40 0x7f58a8152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 -- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58a80b2d40 msgr2=0x7f58a8152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58a80b2d40 0x7f58a8152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 -- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a813eb20 msgr2=0x7f58a80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a813eb20 0x7f58a80b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 -- 172.21.15.52:0/2456819519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a80b3670 con 0x7f58a806c150 2024-09-10T08:41:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.763+0000 7f58ad400640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f589c0098c0 tx=0x7f589c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.764+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c041020 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.764+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c03d6e0 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.764+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c037040 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.764+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a80b3950 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.764+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a80b3f10 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.765+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a806bc10 con 0x7f58a806c150 2024-09-10T08:41:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.766+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f589c044020 con 0x7f58a806c150 2024-09-10T08:41:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.767+0000 7f58a5600640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 0x7f588806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.767+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f589c0ab230 con 0x7f58a806c150 2024-09-10T08:41:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.767+0000 7f58aca00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 0x7f588806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.768+0000 7f58aca00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 0x7f588806e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f58a80cfd10 tx=0x7f5894009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:24.771+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f589c04b030 con 0x7f58a806c150 2024-09-10T08:41:25.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.023+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f58a806c9c0 con 0x7f58a806c150 2024-09-10T08:41:25.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.153+0000 7f58a5600640 1 -- 172.21.15.52:0/2456819519 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v598) ==== 159+0+0 (secure 0 0 0) 0x7f589c079880 con 0x7f58a806c150 2024-09-10T08:41:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.155+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 msgr2=0x7f588806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.155+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 0x7f588806e2f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f58a80cfd10 tx=0x7f5894009040 comp rx=0 tx=0).stop 2024-09-10T08:41:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.155+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 msgr2=0x7f58a8158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.155+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f589c0098c0 tx=0x7f589c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 shutdown_connections 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f588806be30 0x7f588806e2f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f58a813eb20 0x7f58a80b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f58a80b2d40 0x7f58a8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 --2- 172.21.15.52:0/2456819519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a806c150 0x7f58a8158380 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 >> 172.21.15.52:0/2456819519 conn(0x7f58a80ccec0 msgr2=0x7f58a8140210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 shutdown_connections 2024-09-10T08:41:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.156+0000 7f58afe00640 1 -- 172.21.15.52:0/2456819519 wait complete. 2024-09-10T08:41:25.173 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-10T08:41:25.173 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:41:25.174 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.329+0000 7f9de9a00640 1 Processor -- start 2024-09-10T08:41:25.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.329+0000 7f9de9a00640 1 -- start start 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9de40b2d40 0x7f9de406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9de415bcf0 0x7f9de415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9de4071ab0 con 0x7f9de40b2d40 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9de4071180 con 0x7f9de415bcf0 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.330+0000 7f9de9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9de4071460 con 0x7f9de413eb20 2024-09-10T08:41:25.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9de40b2d40 0x7f9de406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9de40b2d40 0x7f9de406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47234/0 (socket says 172.21.15.52:47234) 2024-09-10T08:41:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 -- 172.21.15.52:0/2201577545 learned_addr learned my addr 172.21.15.52:0/2201577545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de3400640 1 --2- 172.21.15.52:0/2201577545 >> v2:172.21.15.176:3300/0 conn(0x7f9de415bcf0 0x7f9de415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9dda000640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 -- 172.21.15.52:0/2201577545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 msgr2=0x7f9de406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 -- 172.21.15.52:0/2201577545 >> v2:172.21.15.176:3300/0 conn(0x7f9de415bcf0 msgr2=0x7f9de415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 --2- 172.21.15.52:0/2201577545 >> v2:172.21.15.176:3300/0 conn(0x7f9de415bcf0 0x7f9de415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.331+0000 7f9de2a00640 1 -- 172.21.15.52:0/2201577545 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de4071740 con 0x7f9de40b2d40 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.332+0000 7f9de2a00640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de40b2d40 0x7f9de406bc10 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f9de41595c0 tx=0x7f9dd402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11363c94baadd3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.332+0000 7f9de2000640 1 -- 172.21.15.52:0/2201577545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4037070 con 0x7f9de40b2d40 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.332+0000 7f9de2000640 1 -- 172.21.15.52:0/2201577545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4032440 con 0x7f9de40b2d40 2024-09-10T08:41:25.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.332+0000 7f9de2000640 1 -- 172.21.15.52:0/2201577545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4032810 con 0x7f9de40b2d40 2024-09-10T08:41:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 -- 172.21.15.52:0/2201577545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de40b2d40 msgr2=0x7f9de406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de40b2d40 0x7f9de406bc10 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f9de41595c0 tx=0x7f9dd402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 -- 172.21.15.52:0/2201577545 shutdown_connections 2024-09-10T08:41:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 --2- 172.21.15.52:0/2201577545 >> v2:172.21.15.176:3300/0 conn(0x7f9de415bcf0 0x7f9de415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 --2- 172.21.15.52:0/2201577545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de40b2d40 0x7f9de406bc10 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 -- 172.21.15.52:0/2201577545 >> 172.21.15.52:0/2201577545 conn(0x7f9de40ccec0 msgr2=0x7f9de40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 -- 172.21.15.52:0/2201577545 shutdown_connections 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.333+0000 7f9de9a00640 1 -- 172.21.15.52:0/2201577545 wait complete. 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.335+0000 7f9de9a00640 1 Processor -- start 2024-09-10T08:41:25.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.335+0000 7f9de9a00640 1 -- start start 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de40b2d40 0x7f9de4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9de415f140 con 0x7f9de415bcf0 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9de415efc0 con 0x7f9de40b2d40 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de9a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9de415f2c0 con 0x7f9de413eb20 2024-09-10T08:41:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de2a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de40b2d40 0x7f9de4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47242/0 (socket says 172.21.15.52:47242) 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9de3400640 1 -- 172.21.15.52:0/1537307570 learned_addr learned my addr 172.21.15.52:0/1537307570 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.336+0000 7f9dda000640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 -- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 msgr2=0x7f9de40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de40b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 -- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de40b2d40 msgr2=0x7f9de4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de40b2d40 0x7f9de4155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 -- 172.21.15.52:0/1537307570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de40b56d0 con 0x7f9de415bcf0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de3400640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc007e90 tx=0x7f9ddc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc014420 con 0x7f9de415bcf0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc019070 con 0x7f9de415bcf0 2024-09-10T08:41:25.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc014800 con 0x7f9de415bcf0 2024-09-10T08:41:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.337+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de40b59b0 con 0x7f9de415bcf0 2024-09-10T08:41:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.338+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de4156060 con 0x7f9de415bcf0 2024-09-10T08:41:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.339+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de40b5ed0 con 0x7f9de415bcf0 2024-09-10T08:41:25.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.339+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ddc0149a0 con 0x7f9de415bcf0 2024-09-10T08:41:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.340+0000 7f9ddb400640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 0x7f9dc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.340+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f9ddc08b270 con 0x7f9de415bcf0 2024-09-10T08:41:25.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.341+0000 7f9de2a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 0x7f9dc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.341+0000 7f9de2a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 0x7f9dc006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4034000 tx=0x7f9dd402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.344+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9de40b5ed0 con 0x7f9de415bcf0 2024-09-10T08:41:25.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.531+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9de415c1a0 con 0x7f9de415bcf0 2024-09-10T08:41:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.533+0000 7f9ddb400640 1 -- 172.21.15.52:0/1537307570 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) ==== 74+0+13054 (secure 0 0 0) 0x7f9ddc089e20 con 0x7f9de415bcf0 2024-09-10T08:41:25.533 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:25.533 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":174,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:24.146447+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6834/2110837576":"2024-09-11T08:41:21.136022+0000","172.21.15.52:6832/2110837576":"2024-09-11T08:41:21.136022+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 msgr2=0x7f9dc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 0x7f9dc006e2f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4034000 tx=0x7f9dd402e000 comp rx=0 tx=0).stop 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 msgr2=0x7f9de413e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc007e90 tx=0x7f9ddc00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 shutdown_connections 2024-09-10T08:41:25.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dc006be30 0x7f9dc006e2f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9de415bcf0 0x7f9de413e080 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9de413eb20 0x7f9de40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 --2- 172.21.15.52:0/1537307570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9de40b2d40 0x7f9de4155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 >> 172.21.15.52:0/1537307570 conn(0x7f9de40ccec0 msgr2=0x7f9de415b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 shutdown_connections 2024-09-10T08:41:25.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.535+0000 7f9de9a00640 1 -- 172.21.15.52:0/1537307570 wait complete. 2024-09-10T08:41:25.552 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:41:25.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:41:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.711+0000 7fd767e00640 1 Processor -- start 2024-09-10T08:41:25.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.711+0000 7fd767e00640 1 -- start start 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.712+0000 7fd767e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600732e0 0x7fd7600736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.712+0000 7fd767e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7600cce30 0x7fd7600cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd767e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7600714b0 con 0x7fd760071c70 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd767e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd760073c00 con 0x7fd7600cce30 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd767e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7600cd880 con 0x7fd7600732e0 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7600cce30 0x7fd7600cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7600cce30 0x7fd7600cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47250/0 (socket says 172.21.15.52:47250) 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 -- 172.21.15.52:0/21435996 learned_addr learned my addr 172.21.15.52:0/21435996 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd765400640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600732e0 0x7fd7600736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 -- 172.21.15.52:0/21435996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600732e0 msgr2=0x7fd7600736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600732e0 0x7fd7600736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 -- 172.21.15.52:0/21435996 >> v1:172.21.15.176:6789/0 conn(0x7fd760071c70 legacy=0x7fd76015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.713+0000 7fd764a00640 1 -- 172.21.15.52:0/21435996 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7600cdb60 con 0x7fd7600cce30 2024-09-10T08:41:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.714+0000 7fd764a00640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600cce30 0x7fd7600cd270 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009870 tx=0x7fd74c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab75e23ee5d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd75fe00640 1 -- 172.21.15.52:0/21435996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c037070 con 0x7fd7600cce30 2024-09-10T08:41:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd75fe00640 1 -- 172.21.15.52:0/21435996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74c032440 con 0x7fd7600cce30 2024-09-10T08:41:25.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd75fe00640 1 -- 172.21.15.52:0/21435996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032810 con 0x7fd7600cce30 2024-09-10T08:41:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 -- 172.21.15.52:0/21435996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600cce30 msgr2=0x7fd7600cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600cce30 0x7fd7600cd270 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009870 tx=0x7fd74c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 -- 172.21.15.52:0/21435996 shutdown_connections 2024-09-10T08:41:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600cce30 0x7fd7600cd270 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 --2- 172.21.15.52:0/21435996 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7600732e0 0x7fd7600736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 -- 172.21.15.52:0/21435996 >> 172.21.15.52:0/21435996 conn(0x7fd76006d0f0 msgr2=0x7fd76006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 -- 172.21.15.52:0/21435996 shutdown_connections 2024-09-10T08:41:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.715+0000 7fd767e00640 1 -- 172.21.15.52:0/21435996 wait complete. 2024-09-10T08:41:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.717+0000 7fd767e00640 1 Processor -- start 2024-09-10T08:41:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.717+0000 7fd767e00640 1 -- start start 2024-09-10T08:41:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd760071c70 0x7fd76014ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600cce30 0x7fd76014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd76006bf70 con 0x7fd7600732e0 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd76006bdf0 con 0x7fd7600cce30 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd767e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd760072120 con 0x7fd760071c70 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd764a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd764a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47262/0 (socket says 172.21.15.52:47262) 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd764a00640 1 -- 172.21.15.52:0/4050422249 learned_addr learned my addr 172.21.15.52:0/4050422249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.718+0000 7fd765400640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd760071c70 0x7fd76014ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd765e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600cce30 0x7fd76014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 -- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd760071c70 msgr2=0x7fd76014ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd760071c70 0x7fd76014ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 -- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600cce30 msgr2=0x7fd76014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600cce30 0x7fd76014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 -- 172.21.15.52:0/4050422249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7601e7c40 con 0x7fd7600732e0 2024-09-10T08:41:25.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.719+0000 7fd764a00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fd74c02a200 tx=0x7fd74c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.720+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c041020 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.720+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74c0306c0 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.720+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c037040 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.720+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7601e7f20 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.720+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601e84e0 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.721+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7600724b0 con 0x7fd7600732e0 2024-09-10T08:41:25.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.722+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd74c044020 con 0x7fd7600732e0 2024-09-10T08:41:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.723+0000 7fd75d600640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 0x7fd74006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:25.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.723+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fd74c0ab350 con 0x7fd7600732e0 2024-09-10T08:41:25.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.723+0000 7fd765400640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 0x7fd74006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:25.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.724+0000 7fd765400640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 0x7fd74006e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd754006fd0 tx=0x7fd754008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:25.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.728+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd74c04b030 con 0x7fd7600732e0 2024-09-10T08:41:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.910+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7600711f0 con 0x7fd7600732e0 2024-09-10T08:41:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.911+0000 7fd75d600640 1 -- 172.21.15.52:0/4050422249 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) ==== 93+0+10 (secure 0 0 0) 0x7fd74c079f70 con 0x7fd7600732e0 2024-09-10T08:41:25.912 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 msgr2=0x7fd74006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 0x7fd74006e2f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd754006fd0 tx=0x7fd754008040 comp rx=0 tx=0).stop 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 msgr2=0x7fd7601e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fd74c02a200 tx=0x7fd74c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 shutdown_connections 2024-09-10T08:41:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd74006be30 0x7fd74006e2f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7600cce30 0x7fd76014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7600732e0 0x7fd7601e73f0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 --2- 172.21.15.52:0/4050422249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd760071c70 0x7fd76014ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 >> 172.21.15.52:0/4050422249 conn(0x7fd76006d0f0 msgr2=0x7fd7600b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.913+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 shutdown_connections 2024-09-10T08:41:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:25.914+0000 7fd767e00640 1 -- 172.21.15.52:0/4050422249 wait complete. 2024-09-10T08:41:25.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-10T08:41:26.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.084+0000 7f883b200640 1 Processor -- start 2024-09-10T08:41:26.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.084+0000 7f883b200640 1 -- start start 2024-09-10T08:41:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.085+0000 7f883b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.085+0000 7f883b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.085+0000 7f883b200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883c0cfb40 con 0x7f883c0b63f0 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f883b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f883c0d27f0 con 0x7f883c0b7a30 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f883b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f883c0cfe20 con 0x7f883c0cf670 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f8833e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f883a800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f883a800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:56814/0 (socket says 172.21.15.52:56814) 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f8833e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:38540/0 (socket says 172.21.15.52:38540) 2024-09-10T08:41:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.086+0000 7f883a800640 1 -- 172.21.15.52:0/1430382940 learned_addr learned my addr 172.21.15.52:0/1430382940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:26.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.087+0000 7f8833e00640 1 -- 172.21.15.52:0/1430382940 >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 msgr2=0x7f883c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:26.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.087+0000 7f8833e00640 1 --2- 172.21.15.52:0/1430382940 >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.087+0000 7f8833e00640 1 -- 172.21.15.52:0/1430382940 >> v1:172.21.15.176:6789/0 conn(0x7f883c0b63f0 legacy=0x7f883c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.087+0000 7f8833e00640 1 -- 172.21.15.52:0/1430382940 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c0d2e00 con 0x7f883c0cf670 2024-09-10T08:41:26.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.087+0000 7f883a800640 1 --2- 172.21.15.52:0/1430382940 >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:26.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f8833e00640 1 --2- 172.21.15.52:0/1430382940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88240097a0 tx=0x7f882402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e098237cc626b000 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:26.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f8839400640 1 -- 172.21.15.52:0/1430382940 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824037070 con 0x7f883c0cf670 2024-09-10T08:41:26.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f8839400640 1 -- 172.21.15.52:0/1430382940 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882402ae50 con 0x7f883c0cf670 2024-09-10T08:41:26.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f8839400640 1 -- 172.21.15.52:0/1430382940 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824032660 con 0x7f883c0cf670 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f883b200640 1 -- 172.21.15.52:0/1430382940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 msgr2=0x7f883c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.088+0000 7f883b200640 1 --2- 172.21.15.52:0/1430382940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f88240097a0 tx=0x7f882402a100 comp rx=0 tx=0).stop 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 -- 172.21.15.52:0/1430382940 shutdown_connections 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 --2- 172.21.15.52:0/1430382940 >> v2:172.21.15.176:3300/0 conn(0x7f883c0b7a30 0x7f883c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 --2- 172.21.15.52:0/1430382940 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0cf670 0x7f883c15df80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 -- 172.21.15.52:0/1430382940 >> 172.21.15.52:0/1430382940 conn(0x7f883c0d1360 msgr2=0x7f883c0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 -- 172.21.15.52:0/1430382940 shutdown_connections 2024-09-10T08:41:26.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.089+0000 7f883b200640 1 -- 172.21.15.52:0/1430382940 wait complete. 2024-09-10T08:41:26.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.090+0000 7f883b200640 1 Processor -- start 2024-09-10T08:41:26.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.090+0000 7f883b200640 1 -- start start 2024-09-10T08:41:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f883c0b63f0 0x7f883c14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0b7a30 0x7f883c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f883c15eb80 con 0x7f883c0cf670 2024-09-10T08:41:26.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f883c15ea00 con 0x7f883c0b63f0 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f883c0b67d0 con 0x7f883c0b7a30 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.091+0000 7f883a800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47278/0 (socket says 172.21.15.52:47278) 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 -- 172.21.15.52:0/3618350303 learned_addr learned my addr 172.21.15.52:0/3618350303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f8833e00640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0b7a30 0x7f883c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f8839e00640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f883c0b63f0 0x7f883c14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 -- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0b7a30 msgr2=0x7f883c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0b7a30 0x7f883c0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 -- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f883c0b63f0 msgr2=0x7f883c14d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f883c0b63f0 0x7f883c14d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 -- 172.21.15.52:0/3618350303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c0ab2e0 con 0x7f883c0cf670 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.092+0000 7f883a800640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f883400ef90 tx=0x7f883400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:26.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.093+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883400cbe0 con 0x7f883c0cf670 2024-09-10T08:41:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.093+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883400cd80 con 0x7f883c0cf670 2024-09-10T08:41:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.093+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834003bd0 con 0x7f883c0cf670 2024-09-10T08:41:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.093+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883c0c92e0 con 0x7f883c0cf670 2024-09-10T08:41:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.093+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883c0c98a0 con 0x7f883c0cf670 2024-09-10T08:41:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.094+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883c0cef60 con 0x7f883c0cf670 2024-09-10T08:41:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.095+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f883401b030 con 0x7f883c0cf670 2024-09-10T08:41:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.096+0000 7f8832000640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 0x7f881806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.096+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f883408ae60 con 0x7f883c0cf670 2024-09-10T08:41:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.096+0000 7f8839e00640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 0x7f881806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:26.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.097+0000 7f8839e00640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 0x7f881806e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f882c001780 tx=0x7f882c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:26.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.100+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8834022020 con 0x7f883c0cf670 2024-09-10T08:41:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:26.357+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f883c0d5190 con 0x7f883c0cf670 2024-09-10T08:41:27.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.161+0000 7f8832000640 1 -- 172.21.15.52:0/3618350303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v600) ==== 143+0+0 (secure 0 0 0) 0x7f8834010040 con 0x7f883c0cf670 2024-09-10T08:41:27.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.163+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 msgr2=0x7f881806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.163+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 0x7f881806e2f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f882c001780 tx=0x7f882c009040 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 msgr2=0x7f883c0ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f883400ef90 tx=0x7f883400c490 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 shutdown_connections 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f881806be30 0x7f881806e2f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f883c0cf670 0x7f883c0ad640 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f883c0b7a30 0x7f883c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 --2- 172.21.15.52:0/3618350303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f883c0b63f0 0x7f883c14d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 >> 172.21.15.52:0/3618350303 conn(0x7f883c0d1360 msgr2=0x7f883c15ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 shutdown_connections 2024-09-10T08:41:27.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.164+0000 7f883b200640 1 -- 172.21.15.52:0/3618350303 wait complete. 2024-09-10T08:41:27.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:41:27.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.348+0000 7f42c0200640 1 Processor -- start 2024-09-10T08:41:27.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.350+0000 7f42c0200640 1 -- start start 2024-09-10T08:41:27.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42b80732e0 0x7f42b80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f42b80cce30 0x7f42b80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b8071c70 0x7f42b80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f42b80714b0 con 0x7f42b80732e0 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f42b8073c00 con 0x7f42b80cce30 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42c0200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42b80cd880 con 0x7f42b8071c70 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42b80732e0 0x7f42b80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f42b80732e0 0x7f42b80736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47280/0 (socket says 172.21.15.52:47280) 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 -- 172.21.15.52:0/57602463 learned_addr learned my addr 172.21.15.52:0/57602463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:27.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bce00640 1 --2- 172.21.15.52:0/57602463 >> v2:172.21.15.176:3300/0 conn(0x7f42b80cce30 0x7f42b80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42be200640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b8071c70 0x7f42b80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 -- 172.21.15.52:0/57602463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b8071c70 msgr2=0x7f42b80720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b8071c70 0x7f42b80720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 -- 172.21.15.52:0/57602463 >> v2:172.21.15.176:3300/0 conn(0x7f42b80cce30 msgr2=0x7f42b80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 --2- 172.21.15.52:0/57602463 >> v2:172.21.15.176:3300/0 conn(0x7f42b80cce30 0x7f42b80cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.351+0000 7f42bd800640 1 -- 172.21.15.52:0/57602463 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b80cdb60 con 0x7f42b80732e0 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.352+0000 7f42bd800640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80732e0 0x7f42b80736c0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f42b80c57f0 tx=0x7f42ac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb4db02ae5d5a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.352+0000 7f42b7e00640 1 -- 172.21.15.52:0/57602463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac037070 con 0x7f42b80732e0 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.352+0000 7f42b7e00640 1 -- 172.21.15.52:0/57602463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac032440 con 0x7f42b80732e0 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.352+0000 7f42b7e00640 1 -- 172.21.15.52:0/57602463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac032810 con 0x7f42b80732e0 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 -- 172.21.15.52:0/57602463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80732e0 msgr2=0x7f42b80736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80732e0 0x7f42b80736c0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f42b80c57f0 tx=0x7f42ac02a140 comp rx=0 tx=0).stop 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 -- 172.21.15.52:0/57602463 shutdown_connections 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 --2- 172.21.15.52:0/57602463 >> v2:172.21.15.176:3300/0 conn(0x7f42b80cce30 0x7f42b80cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b8071c70 0x7f42b80720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 --2- 172.21.15.52:0/57602463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80732e0 0x7f42b80736c0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 -- 172.21.15.52:0/57602463 >> 172.21.15.52:0/57602463 conn(0x7f42b806d0f0 msgr2=0x7f42b806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 -- 172.21.15.52:0/57602463 shutdown_connections 2024-09-10T08:41:27.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.354+0000 7f42c0200640 1 -- 172.21.15.52:0/57602463 wait complete. 2024-09-10T08:41:27.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 Processor -- start 2024-09-10T08:41:27.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 -- start start 2024-09-10T08:41:27.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b8071c70 0x7f42b814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b80732e0 0x7f42b815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42b806bf70 con 0x7f42b80cce30 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42b806bdf0 con 0x7f42b8071c70 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.355+0000 7f42c0200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f42b815c8d0 con 0x7f42b80732e0 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47290/0 (socket says 172.21.15.52:47290) 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 -- 172.21.15.52:0/1844124015 learned_addr learned my addr 172.21.15.52:0/1844124015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42bd800640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b8071c70 0x7f42b814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42bce00640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b80732e0 0x7f42b815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 -- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b80732e0 msgr2=0x7f42b815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b80732e0 0x7f42b815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 -- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b8071c70 msgr2=0x7f42b814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b8071c70 0x7f42b814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.356+0000 7f42be200640 1 -- 172.21.15.52:0/1844124015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b81e5ca0 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42be200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f42b0007e60 tx=0x7f42b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0014620 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0019070 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b81e6b40 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0014a20 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.357+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b814c6e0 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.358+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b80736c0 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.359+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42b0014bc0 con 0x7f42b80cce30 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.360+0000 7f42b5600640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:27.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.360+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f42b008b3c0 con 0x7f42b80cce30 2024-09-10T08:41:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.360+0000 7f42bd800640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:27.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.361+0000 7f42bd800640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 0x7f429806e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f42ac034000 tx=0x7f42ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:27.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.365+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42b00598f0 con 0x7f42b80cce30 2024-09-10T08:41:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.548+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f42b80711f0 con 0x7f42b80cce30 2024-09-10T08:41:27.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.552+0000 7f42b5600640 1 -- 172.21.15.52:0/1844124015 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f42b005dbf0 con 0x7f42b80cce30 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 msgr2=0x7f429806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 0x7f429806e2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f42ac034000 tx=0x7f42ac02e000 comp rx=0 tx=0).stop 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 msgr2=0x7f42b815b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f42b0007e60 tx=0x7f42b000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 shutdown_connections 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f429806be30 0x7f429806e2f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42b80cce30 0x7f42b815b3f0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f42b80732e0 0x7f42b815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 --2- 172.21.15.52:0/1844124015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42b8071c70 0x7f42b814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:27.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 >> 172.21.15.52:0/1844124015 conn(0x7f42b806d0f0 msgr2=0x7f42b806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:27.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 shutdown_connections 2024-09-10T08:41:27.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:27.554+0000 7f42c0200640 1 -- 172.21.15.52:0/1844124015 wait complete. 2024-09-10T08:41:27.570 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:41:27.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:41:27.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:41:27.747 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:41:27.747 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:27.747 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:27.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:41:27.783 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:41:27.783 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:27.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:41:27.820 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:27.820 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:27.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:41:27.859 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:41:27.859 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:27.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:41:27.896 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:41:27.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:28.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.055+0000 7fed14600640 1 Processor -- start 2024-09-10T08:41:28.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.055+0000 7fed14600640 1 -- start start 2024-09-10T08:41:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.056+0000 7fed14600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 0x7fed0c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.056+0000 7fed14600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed0c13eb20 0x7fed0c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.056+0000 7fed14600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0c071180 con 0x7fed0c15bcf0 2024-09-10T08:41:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.056+0000 7fed14600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c071ab0 con 0x7fed0c13eb20 2024-09-10T08:41:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.056+0000 7fed14600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fed0c071460 con 0x7fed0c0b2d40 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fed0c13eb20 0x7fed0c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 0x7fed0c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed12600640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fed0c15bcf0 0x7fed0c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:51290/0 (socket says 172.21.15.52:51290) 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed12600640 1 -- 172.21.15.52:0/541171228 learned_addr learned my addr 172.21.15.52:0/541171228 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed0be00640 1 -- 172.21.15.52:0/541171228 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540150603 0 0) 0x7fed0c071180 con 0x7fed0c15bcf0 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed0be00640 1 -- 172.21.15.52:0/541171228 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf4003520 con 0x7fed0c15bcf0 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11200640 1 -- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 msgr2=0x7fed0c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11200640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 0x7fed0c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11200640 1 -- 172.21.15.52:0/541171228 >> v1:172.21.15.176:6789/0 conn(0x7fed0c15bcf0 legacy=0x7fed0c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11200640 1 -- 172.21.15.52:0/541171228 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c071740 con 0x7fed0c13eb20 2024-09-10T08:41:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.057+0000 7fed11c00640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 0x7fed0c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.058+0000 7fed11200640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c13eb20 0x7fed0c06c150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fed0c071c30 tx=0x7fecf802c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331ff63ea23fe14e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed0be00640 1 -- 172.21.15.52:0/541171228 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8034620 con 0x7fed0c13eb20 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed0be00640 1 -- 172.21.15.52:0/541171228 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf80347c0 con 0x7fed0c13eb20 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed0be00640 1 -- 172.21.15.52:0/541171228 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8034b70 con 0x7fed0c13eb20 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 -- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c13eb20 msgr2=0x7fed0c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c13eb20 0x7fed0c06c150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fed0c071c30 tx=0x7fecf802c830 comp rx=0 tx=0).stop 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 -- 172.21.15.52:0/541171228 shutdown_connections 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c13eb20 0x7fed0c06c150 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 --2- 172.21.15.52:0/541171228 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c0b2d40 0x7fed0c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 -- 172.21.15.52:0/541171228 >> 172.21.15.52:0/541171228 conn(0x7fed0c0ccec0 msgr2=0x7fed0c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 -- 172.21.15.52:0/541171228 shutdown_connections 2024-09-10T08:41:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.059+0000 7fed14600640 1 -- 172.21.15.52:0/541171228 wait complete. 2024-09-10T08:41:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.061+0000 7fed14600640 1 Processor -- start 2024-09-10T08:41:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.061+0000 7fed14600640 1 -- start start 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c0b2d40 0x7fed0c1e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c15bcf0 0x7fed0c130e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c0722d0 con 0x7fed0c13eb20 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c072150 con 0x7fed0c0b2d40 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed14600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fed0c072450 con 0x7fed0c15bcf0 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed11200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed11200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47302/0 (socket says 172.21.15.52:47302) 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed11200640 1 -- 172.21.15.52:0/3824322173 learned_addr learned my addr 172.21.15.52:0/3824322173 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed11c00640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c0b2d40 0x7fed0c1e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.062+0000 7fed12600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c15bcf0 0x7fed0c130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 -- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c15bcf0 msgr2=0x7fed0c130e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c15bcf0 0x7fed0c130e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 -- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c0b2d40 msgr2=0x7fed0c1e21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c0b2d40 0x7fed0c1e21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 -- 172.21.15.52:0/3824322173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c1e3f80 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed11200640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fecf802ce20 tx=0x7fecf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.063+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8043070 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.064+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf8033850 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.064+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8033c00 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.064+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c1e2880 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.064+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c0b3980 con 0x7fed0c13eb20 2024-09-10T08:41:28.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.065+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c072890 con 0x7fed0c13eb20 2024-09-10T08:41:28.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.066+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecf803c040 con 0x7fed0c13eb20 2024-09-10T08:41:28.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.067+0000 7fed09600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.067+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fecf80adfd0 con 0x7fed0c13eb20 2024-09-10T08:41:28.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.067+0000 7fed11c00640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.068+0000 7fed11c00640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 0x7fecec06e2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fed00009560 tx=0x7fed00009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.071+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecf807c740 con 0x7fed0c13eb20 2024-09-10T08:41:28.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.292+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed0c06c9c0 con 0x7fed0c13eb20 2024-09-10T08:41:28.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.293+0000 7fed09600640 1 -- 172.21.15.52:0/3824322173 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) ==== 95+0+3921 (secure 0 0 0) 0x7fecf8080a40 con 0x7fed0c13eb20 2024-09-10T08:41:28.292 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:28.292 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":135,"btime":"2024-09-10T08:41:22:138608+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8971,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4150838253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4150838253},{"type":"v1","addr":"172.21.15.176:6835","nonce":4150838253}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":8983,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/2136429123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6836","nonce":2136429123},{"type":"v1","addr":"172.21.15.176:6837","nonce":2136429123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126},{"gid":10080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2541438118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2541438118},{"type":"v1","addr":"172.21.15.52:6833","nonce":2541438118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":135},{"gid":10083,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/736210640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":736210640},{"type":"v1","addr":"172.21.15.52:6835","nonce":736210640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":135}],"filesystems":[]} 2024-09-10T08:41:28.293 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 135 2024-09-10T08:41:28.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 msgr2=0x7fecec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 0x7fecec06e2f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fed00009560 tx=0x7fed00009190 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 msgr2=0x7fed0c1e3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fecf802ce20 tx=0x7fecf80046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 shutdown_connections 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed0c15bcf0 0x7fed0c130e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed0c13eb20 0x7fed0c1e3a40 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 --2- 172.21.15.52:0/3824322173 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed0c0b2d40 0x7fed0c1e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 >> 172.21.15.52:0/3824322173 conn(0x7fed0c0ccec0 msgr2=0x7fed0c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 shutdown_connections 2024-09-10T08:41:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.295+0000 7fed14600640 1 -- 172.21.15.52:0/3824322173 wait complete. 2024-09-10T08:41:28.311 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:41:28.311 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:41:28.311 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:41:28.311 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:41:28.312 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:41:28.312 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:41:28.312 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:41:28.312 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:41:28.312 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:41:28.312 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:41:28.313 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:41:28.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:41:28.313 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:41:28.313 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:41:28.313 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:41:28.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:41:28.325 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:41:28.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:41:28.326 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:41:28.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:41:28.329 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:41:28.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:41:28.329 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:41:28.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:41:28.371 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:41:28.372 DEBUG:teuthology.parallel:result is None 2024-09-10T08:41:28.373 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:41:28.373 DEBUG:teuthology.parallel:result is None 2024-09-10T08:41:28.374 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:41:28.374 DEBUG:teuthology.parallel:result is None 2024-09-10T08:41:28.376 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:41:28.376 DEBUG:teuthology.parallel:result is None 2024-09-10T08:41:28.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:41:28.504 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:41:28.505 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:41:28.508 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:41:28.508 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:41:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.544+0000 7f3e17600640 1 Processor -- start 2024-09-10T08:41:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.545+0000 7f3e17600640 1 -- start start 2024-09-10T08:41:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e17600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006c320 0x7f3e10072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e17600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3e1006e170 0x7f3e1015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e17600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1006e800 con 0x7f3e1015c6a0 2024-09-10T08:41:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e17600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1006e5e0 con 0x7f3e1006e170 2024-09-10T08:41:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e17600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e10072410 con 0x7f3e1006c320 2024-09-10T08:41:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e14c00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3e1015c6a0 0x7f3e1006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35686/0 (socket says 172.21.15.52:35686) 2024-09-10T08:41:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e14c00640 1 -- 172.21.15.52:0/2560091109 learned_addr learned my addr 172.21.15.52:0/2560091109 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e07e00640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006c320 0x7f3e10072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.546+0000 7f3e15600640 1 --2- 172.21.15.52:0/2560091109 >> v2:172.21.15.176:3300/0 conn(0x7f3e1006e170 0x7f3e1015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e0fe00640 1 -- 172.21.15.52:0/2560091109 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019990696 0 0) 0x7f3e1006e800 con 0x7f3e1015c6a0 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e0fe00640 1 -- 172.21.15.52:0/2560091109 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df4003520 con 0x7f3e1015c6a0 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e15600640 1 -- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006c320 msgr2=0x7f3e10072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e15600640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006c320 0x7f3e10072fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e15600640 1 -- 172.21.15.52:0/2560091109 >> v1:172.21.15.52:6789/0 conn(0x7f3e1015c6a0 legacy=0x7f3e1006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.547+0000 7f3e15600640 1 -- 172.21.15.52:0/2560091109 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1006eae0 con 0x7f3e1006e170 2024-09-10T08:41:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.548+0000 7f3e15600640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1006e170 0x7f3e1015ca80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bee434ed750fa626 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.548+0000 7f3e0fe00640 1 -- 172.21.15.52:0/2560091109 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007740 con 0x7f3e1006e170 2024-09-10T08:41:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.548+0000 7f3e0fe00640 1 -- 172.21.15.52:0/2560091109 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080078e0 con 0x7f3e1006e170 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.548+0000 7f3e0fe00640 1 -- 172.21.15.52:0/2560091109 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007c90 con 0x7f3e1006e170 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 -- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1006e170 msgr2=0x7f3e1015ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1006e170 0x7f3e1015ca80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009d90 tx=0x7f3e0802a660 comp rx=0 tx=0).stop 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 -- 172.21.15.52:0/2560091109 shutdown_connections 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1006e170 0x7f3e1015ca80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 --2- 172.21.15.52:0/2560091109 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006c320 0x7f3e10072fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 -- 172.21.15.52:0/2560091109 >> 172.21.15.52:0/2560091109 conn(0x7f3e1006cd20 msgr2=0x7f3e1006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 -- 172.21.15.52:0/2560091109 shutdown_connections 2024-09-10T08:41:28.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.549+0000 7f3e17600640 1 -- 172.21.15.52:0/2560091109 wait complete. 2024-09-10T08:41:28.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.551+0000 7f3e17600640 1 Processor -- start 2024-09-10T08:41:28.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.551+0000 7f3e17600640 1 -- start start 2024-09-10T08:41:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 0x7f3e101f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1015c6a0 0x7f3e1014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1006f0a0 con 0x7f3e1006c320 2024-09-10T08:41:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1006f410 con 0x7f3e1015c6a0 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.552+0000 7f3e17600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1015cfc0 con 0x7f3e1006e170 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47358/0 (socket says 172.21.15.52:47358) 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 -- 172.21.15.52:0/1998244483 learned_addr learned my addr 172.21.15.52:0/1998244483 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e07e00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 0x7f3e101f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e15600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1015c6a0 0x7f3e1014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 -- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 msgr2=0x7f3e101f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 0x7f3e101f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 -- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1015c6a0 msgr2=0x7f3e1014f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1015c6a0 0x7f3e1014f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e14c00640 1 -- 172.21.15.52:0/1998244483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101f5ac0 con 0x7f3e1006c320 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.553+0000 7f3e07e00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 0x7f3e101f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:41:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.554+0000 7f3e14c00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c390 tx=0x7f3e0000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.555+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00017070 con 0x7f3e1006c320 2024-09-10T08:41:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.555+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e00005ce0 con 0x7f3e1006c320 2024-09-10T08:41:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.555+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000072f0 con 0x7f3e1006c320 2024-09-10T08:41:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.555+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101563a0 con 0x7f3e1006c320 2024-09-10T08:41:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.555+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e10156960 con 0x7f3e1006c320 2024-09-10T08:41:28.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.557+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1015ca80 con 0x7f3e1006c320 2024-09-10T08:41:28.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.558+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e0001a070 con 0x7f3e1006c320 2024-09-10T08:41:28.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.559+0000 7f3e0d600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:28.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.559+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 4943+0+0 (secure 0 0 0) 0x7f3e00088810 con 0x7f3e1006c320 2024-09-10T08:41:28.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.559+0000 7f3e07e00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:28.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.560+0000 7f3e07e00640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 0x7f3dec06e2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cdf80 tx=0x7f3df8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:28.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.564+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e101f5ac0 con 0x7f3e1006c320 2024-09-10T08:41:28.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:28.766+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3e1006d3e0 con 0x7f3e1006c320 2024-09-10T08:41:29.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.570+0000 7f3e0d600640 1 -- 172.21.15.52:0/1998244483 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v179) ==== 97+0+0 (secure 0 0 0) 0x7f3e00058530 con 0x7f3e1006c320 2024-09-10T08:41:29.570 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:41:29.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 msgr2=0x7f3dec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 0x7f3dec06e2f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cdf80 tx=0x7f3df8009190 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 msgr2=0x7f3e10155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c390 tx=0x7f3e0000c850 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 shutdown_connections 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3dec06be30 0x7f3dec06e2f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e1015c6a0 0x7f3e1014f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e1006e170 0x7f3e101f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 --2- 172.21.15.52:0/1998244483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e1006c320 0x7f3e10155cc0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 >> 172.21.15.52:0/1998244483 conn(0x7f3e1006cd20 msgr2=0x7f3e100cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 shutdown_connections 2024-09-10T08:41:29.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.574+0000 7f3e17600640 1 -- 172.21.15.52:0/1998244483 wait complete. 2024-09-10T08:41:29.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:41:29.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.754+0000 7f3981800640 1 Processor -- start 2024-09-10T08:41:29.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.754+0000 7f3981800640 1 -- start start 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f3981800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f397c06c320 0x7f397c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f3981800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f397c13eb20 0x7f397c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f3981800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c071180 con 0x7f397c0b2d40 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f3981800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f397c071ab0 con 0x7f397c06c320 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f3981800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f397c071460 con 0x7f397c13eb20 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f397a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f397c06c320 0x7f397c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.755+0000 7f397aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f397c0b2d40 0x7f397c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35690/0 (socket says 172.21.15.52:35690) 2024-09-10T08:41:29.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397aa00640 1 -- 172.21.15.52:0/183942219 learned_addr learned my addr 172.21.15.52:0/183942219 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:29.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397b400640 1 --2- 172.21.15.52:0/183942219 >> v2:172.21.15.176:3300/0 conn(0x7f397c13eb20 0x7f397c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397a000640 1 -- 172.21.15.52:0/183942219 >> v2:172.21.15.176:3300/0 conn(0x7f397c13eb20 msgr2=0x7f397c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:29.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397a000640 1 --2- 172.21.15.52:0/183942219 >> v2:172.21.15.176:3300/0 conn(0x7f397c13eb20 0x7f397c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397a000640 1 -- 172.21.15.52:0/183942219 >> v1:172.21.15.52:6789/0 conn(0x7f397c0b2d40 legacy=0x7f397c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f397a000640 1 -- 172.21.15.52:0/183942219 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c071740 con 0x7f397c06c320 2024-09-10T08:41:29.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.756+0000 7f3979600640 1 -- 172.21.15.52:0/183942219 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440739033 0 0) 0x7f397c071180 con 0x7f397c0b2d40 2024-09-10T08:41:29.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.757+0000 7f397a000640 1 --2- 172.21.15.52:0/183942219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c15bcf0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f397c1595c0 tx=0x7f396802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19b72032249e55c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.757+0000 7f3979600640 1 -- 172.21.15.52:0/183942219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968032770 con 0x7f397c06c320 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.757+0000 7f3979600640 1 -- 172.21.15.52:0/183942219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3968038070 con 0x7f397c06c320 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.757+0000 7f3979600640 1 -- 172.21.15.52:0/183942219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968032b30 con 0x7f397c06c320 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 -- 172.21.15.52:0/183942219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 msgr2=0x7f397c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 --2- 172.21.15.52:0/183942219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c15bcf0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f397c1595c0 tx=0x7f396802c870 comp rx=0 tx=0).stop 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 -- 172.21.15.52:0/183942219 shutdown_connections 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 --2- 172.21.15.52:0/183942219 >> v2:172.21.15.176:3300/0 conn(0x7f397c13eb20 0x7f397c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 --2- 172.21.15.52:0/183942219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c15bcf0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 -- 172.21.15.52:0/183942219 >> 172.21.15.52:0/183942219 conn(0x7f397c0ccec0 msgr2=0x7f397c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 -- 172.21.15.52:0/183942219 shutdown_connections 2024-09-10T08:41:29.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.758+0000 7f3981800640 1 -- 172.21.15.52:0/183942219 wait complete. 2024-09-10T08:41:29.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.760+0000 7f3981800640 1 Processor -- start 2024-09-10T08:41:29.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.760+0000 7f3981800640 1 -- start start 2024-09-10T08:41:29.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f397c0b2d40 0x7f397c1fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 0x7f397c1fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f397c0720c0 con 0x7f397c06c320 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f397c071f40 con 0x7f397c13eb20 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f3981800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f397c072240 con 0x7f397c0b2d40 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f397aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f397aa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47374/0 (socket says 172.21.15.52:47374) 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f397aa00640 1 -- 172.21.15.52:0/1782186326 learned_addr learned my addr 172.21.15.52:0/1782186326 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f397a000640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f397c0b2d40 0x7f397c1fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.761+0000 7f397b400640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 0x7f397c1fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 -- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f397c0b2d40 msgr2=0x7f397c1fbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f397c0b2d40 0x7f397c1fbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 -- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 msgr2=0x7f397c1fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 0x7f397c1fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 -- 172.21.15.52:0/1782186326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0b4530 con 0x7f397c06c320 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397b400640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 0x7f397c1fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f397aa00640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c500 tx=0x7f396c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c018070 con 0x7f397c06c320 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c007580 con 0x7f397c06c320 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c0b47d0 con 0x7f397c06c320 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396c004a20 con 0x7f397c06c320 2024-09-10T08:41:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.762+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c0b4d90 con 0x7f397c06c320 2024-09-10T08:41:29.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.763+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c156120 con 0x7f397c06c320 2024-09-10T08:41:29.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.764+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f396c01b070 con 0x7f397c06c320 2024-09-10T08:41:29.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.765+0000 7f3972a00640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:29.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.765+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f396c089e20 con 0x7f397c06c320 2024-09-10T08:41:29.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.765+0000 7f397a000640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:29.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.766+0000 7f397a000640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 0x7f395c06e2f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3968037000 tx=0x7f3968032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:29.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:29.769+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f397c156120 con 0x7f397c06c320 2024-09-10T08:41:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.024+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f397c06bc10 con 0x7f397c06c320 2024-09-10T08:41:30.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.024+0000 7f3972a00640 1 -- 172.21.15.52:0/1782186326 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7f396c058b10 con 0x7f397c06c320 2024-09-10T08:41:30.024 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:30.024 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:41:30.024 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:41:30.025 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:41:30.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.027 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.030 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.033 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.034 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.035 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:41:30.036 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:41:30.037 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:41:30.038 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.039 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:41:30.040 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.041 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:41:30.042 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:41:30.043 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 msgr2=0x7f395c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 0x7f395c06e2f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3968037000 tx=0x7f3968032000 comp rx=0 tx=0).stop 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 msgr2=0x7f397c1f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f396c00c500 tx=0x7f396c00c9c0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 shutdown_connections 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f395c06be30 0x7f395c06e2f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f397c13eb20 0x7f397c1fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f397c0b2d40 0x7f397c1fbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 --2- 172.21.15.52:0/1782186326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f397c06c320 0x7f397c1f8440 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 >> 172.21.15.52:0/1782186326 conn(0x7f397c0ccec0 msgr2=0x7f397c156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 shutdown_connections 2024-09-10T08:41:30.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.027+0000 7f3981800640 1 -- 172.21.15.52:0/1782186326 wait complete. 2024-09-10T08:41:30.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:41:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.204+0000 7f4b0ee00640 1 Processor -- start 2024-09-10T08:41:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.205+0000 7f4b0ee00640 1 -- start start 2024-09-10T08:41:30.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4b0806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ee00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4b0806c150 0x7f4b0815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ee00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b08071180 con 0x7f4b0813eb20 2024-09-10T08:41:30.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ee00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4b08071ab0 con 0x7f4b0806c150 2024-09-10T08:41:30.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b08071460 con 0x7f4b080b2d40 2024-09-10T08:41:30.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4aff400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4b0813eb20 0x7f4b0815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35698/0 (socket says 172.21.15.52:35698) 2024-09-10T08:41:30.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4aff400640 1 -- 172.21.15.52:0/980924511 learned_addr learned my addr 172.21.15.52:0/980924511 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/980924511 >> v2:172.21.15.176:3300/0 conn(0x7f4b0806c150 0x7f4b0815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b07e00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4b0806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.206+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988940431 0 0) 0x7f4b08071180 con 0x7f4b0813eb20 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aec005730 con 0x7f4b0813eb20 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 269530194 0 0) 0x7f4aec005730 con 0x7f4b0813eb20 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 msgr2=0x7f4b0806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4b0806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 >> v2:172.21.15.176:3300/0 conn(0x7f4b0806c150 msgr2=0x7f4b0815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:30.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 --2- 172.21.15.52:0/980924511 >> v2:172.21.15.176:3300/0 conn(0x7f4b0806c150 0x7f4b0815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08071740 con 0x7f4b0813eb20 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f4af0001670 con 0x7f4b0813eb20 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 >> v1:172.21.15.52:6789/0 conn(0x7f4b0813eb20 legacy=0x7f4b0815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aec005bc0 0x7f4aec006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4aec006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4aec0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08071ab0 con 0x7f4aec006f50 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08071460 con 0x7f4aec005bc0 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec00dbd0 con 0x7f4b080b2d40 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4aec0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4aff400640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4aec006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.207+0000 7f4b07e00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aec005bc0 0x7f4aec006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.208+0000 7f4b0ce00640 1 -- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 msgr2=0x7f4aec006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:30.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.208+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b080b2d40 0x7f4aec006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.208+0000 7f4b0ce00640 1 -- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aec005bc0 msgr2=0x7f4aec006000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:30.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.208+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4aec005bc0 0x7f4aec006000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.208+0000 7f4b0ce00640 1 -- 172.21.15.52:0/980924511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec005730 con 0x7f4aec006f50 2024-09-10T08:41:30.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4aec0073d0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009fc0 tx=0x7f4aec007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a408a6a257c7c646 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00009c10 con 0x7f4aec006f50 2024-09-10T08:41:30.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00036070 con 0x7f4aec006f50 2024-09-10T08:41:30.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b07400640 1 -- 172.21.15.52:0/980924511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0002d070 con 0x7f4aec006f50 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b0ee00640 1 -- 172.21.15.52:0/980924511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 msgr2=0x7f4aec0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/980924511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4aec0073d0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009fc0 tx=0x7f4aec007a40 comp rx=0 tx=0).stop 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.209+0000 7f4b0ce00640 1 -- 172.21.15.52:0/980924511 reap_dead start 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.210+0000 7f4b0ee00640 1 -- 172.21.15.52:0/980924511 shutdown_connections 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.210+0000 7f4b0ee00640 1 -- 172.21.15.52:0/980924511 >> 172.21.15.52:0/980924511 conn(0x7f4b080ccec0 msgr2=0x7f4b080cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.210+0000 7f4b0ee00640 1 -- 172.21.15.52:0/980924511 shutdown_connections 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.210+0000 7f4b0ee00640 1 -- 172.21.15.52:0/980924511 wait complete. 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.211+0000 7f4b0ee00640 1 Processor -- start 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.211+0000 7f4b0ee00640 1 -- start start 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0813c7e0 0x7f4b081445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08141730 0x7f4b08141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0806bfa0 con 0x7f4aec006f50 2024-09-10T08:41:30.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0806be20 con 0x7f4b08141730 2024-09-10T08:41:30.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b0ee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4b08071f40 con 0x7f4b0813c7e0 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.212+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47390/0 (socket says 172.21.15.52:47390) 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 -- 172.21.15.52:0/1346702451 learned_addr learned my addr 172.21.15.52:0/1346702451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b0ce00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08141730 0x7f4b08141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4aff400640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0813c7e0 0x7f4b081445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 -- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0813c7e0 msgr2=0x7f4b081445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0813c7e0 0x7f4b081445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 -- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08141730 msgr2=0x7f4b08141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08141730 0x7f4b08141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 -- 172.21.15.52:0/1346702451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b081420f0 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b07e00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f4af80118e0 tx=0x7f4af8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.213+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af800faf0 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.214+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af800fc90 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.214+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8014440 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.214+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0815b9d0 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.214+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b08143dc0 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.215+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b080722d0 con 0x7f4aec006f50 2024-09-10T08:41:30.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.216+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4af8012040 con 0x7f4aec006f50 2024-09-10T08:41:30.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.217+0000 7f4b04c00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 0x7f4ae4072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.217+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f4af808afb0 con 0x7f4aec006f50 2024-09-10T08:41:30.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.217+0000 7f4aff400640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 0x7f4ae4072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.218+0000 7f4aff400640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 0x7f4ae4072700 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4b081f34d0 tx=0x7f4af00078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.221+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4af8019030 con 0x7f4aec006f50 2024-09-10T08:41:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.406+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4b0806c9c0 con 0x7f4aec006f50 2024-09-10T08:41:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.406+0000 7f4b04c00640 1 -- 172.21.15.52:0/1346702451 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v179) ==== 84+0+65 (secure 0 0 0) 0x7f4af80596f0 con 0x7f4aec006f50 2024-09-10T08:41:30.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:30.406 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:41:30.406 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:41:30.407 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:41:30.407 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:41:30.407 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:30.407 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 msgr2=0x7f4ae4072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 0x7f4ae4072700 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4b081f34d0 tx=0x7f4af00078f0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 msgr2=0x7f4b0815b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f4af80118e0 tx=0x7f4af8011da0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 shutdown_connections 2024-09-10T08:41:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ae4070240 0x7f4ae4072700 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4b08141730 0x7f4b08141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4b0813c7e0 0x7f4b081445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 --2- 172.21.15.52:0/1346702451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4aec006f50 0x7f4b0815b3f0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 >> 172.21.15.52:0/1346702451 conn(0x7f4b080ccec0 msgr2=0x7f4b0813ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.408+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 shutdown_connections 2024-09-10T08:41:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.409+0000 7f4b0ee00640 1 -- 172.21.15.52:0/1346702451 wait complete. 2024-09-10T08:41:30.424 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:41:30.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:41:30.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.584+0000 7f5ec4c00640 1 Processor -- start 2024-09-10T08:41:30.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.585+0000 7f5ec4c00640 1 -- start start 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ec4c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ec01454b0 0x7f5ec00b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec00b0e50 0x7f5ec00b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ec4c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec0146220 con 0x7f5ec01459a0 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ec4c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec00b1920 con 0x7f5ec01454b0 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec00cf640 con 0x7f5ec00b0e50 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ebde00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5ec01454b0 0x7f5ec00b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5eb7e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5ec01459a0 0x7f5ec00b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35704/0 (socket says 172.21.15.52:35704) 2024-09-10T08:41:30.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5eb7e00640 1 -- 172.21.15.52:0/2005597269 learned_addr learned my addr 172.21.15.52:0/2005597269 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.586+0000 7f5ebe800640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec00b0e50 0x7f5ec00b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.587+0000 7f5ebde00640 1 -- 172.21.15.52:0/2005597269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec00b0e50 msgr2=0x7f5ec00b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.587+0000 7f5ebde00640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec00b0e50 0x7f5ec00b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.587+0000 7f5ebde00640 1 -- 172.21.15.52:0/2005597269 >> v1:172.21.15.52:6789/0 conn(0x7f5ec01459a0 legacy=0x7f5ec00b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.587+0000 7f5ebde00640 1 -- 172.21.15.52:0/2005597269 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec00cf8e0 con 0x7f5ec01454b0 2024-09-10T08:41:30.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ebde00640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01454b0 0x7f5ec00b58f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097a0 tx=0x7f5eb002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633c366c7f42eee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ebd400640 1 -- 172.21.15.52:0/2005597269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0037070 con 0x7f5ec01454b0 2024-09-10T08:41:30.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ebd400640 1 -- 172.21.15.52:0/2005597269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb0032440 con 0x7f5ec01454b0 2024-09-10T08:41:30.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ebd400640 1 -- 172.21.15.52:0/2005597269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0032810 con 0x7f5ec01454b0 2024-09-10T08:41:30.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 -- 172.21.15.52:0/2005597269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01454b0 msgr2=0x7f5ec00b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01454b0 0x7f5ec00b58f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097a0 tx=0x7f5eb002a210 comp rx=0 tx=0).stop 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 -- 172.21.15.52:0/2005597269 shutdown_connections 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec00b0e50 0x7f5ec00b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/2005597269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01454b0 0x7f5ec00b58f0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 -- 172.21.15.52:0/2005597269 >> 172.21.15.52:0/2005597269 conn(0x7f5ec006c240 msgr2=0x7f5ec006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 -- 172.21.15.52:0/2005597269 shutdown_connections 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.588+0000 7f5ec4c00640 1 -- 172.21.15.52:0/2005597269 wait complete. 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.590+0000 7f5ec4c00640 1 Processor -- start 2024-09-10T08:41:30.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.590+0000 7f5ec4c00640 1 -- start start 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 0x7f5ec01e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec01454b0 0x7f5ec00aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec00d0180 con 0x7f5ec01459a0 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec00cfea0 con 0x7f5ec00b0e50 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ec4c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec00b24c0 con 0x7f5ec01454b0 2024-09-10T08:41:30.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47400/0 (socket says 172.21.15.52:47400) 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.591+0000 7f5ebe800640 1 -- 172.21.15.52:0/1086801971 learned_addr learned my addr 172.21.15.52:0/1086801971 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebde00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 0x7f5ec01e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5eb7e00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec01454b0 0x7f5ec00aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 -- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec01454b0 msgr2=0x7f5ec00aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec01454b0 0x7f5ec00aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 -- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 msgr2=0x7f5ec01e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 0x7f5ec01e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 -- 172.21.15.52:0/1086801971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec01f7d80 con 0x7f5ec01459a0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebde00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 0x7f5ec01e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ebe800640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007e40 tx=0x7f5eb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8014620 con 0x7f5ec01459a0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8019070 con 0x7f5ec01459a0 2024-09-10T08:41:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8014a20 con 0x7f5ec01459a0 2024-09-10T08:41:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.592+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec01f8020 con 0x7f5ec01459a0 2024-09-10T08:41:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.593+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01f85e0 con 0x7f5ec01459a0 2024-09-10T08:41:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.594+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec00b1d90 con 0x7f5ec01459a0 2024-09-10T08:41:30.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.595+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5eb8014bc0 con 0x7f5ec01459a0 2024-09-10T08:41:30.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.595+0000 7f5eb6000640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 0x7f5e9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:30.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.596+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4857+0+0 (secure 0 0 0) 0x7f5eb808b430 con 0x7f5ec01459a0 2024-09-10T08:41:30.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.596+0000 7f5ebde00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 0x7f5e9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:30.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.597+0000 7f5ebde00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 0x7f5e9c06e2f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0034000 tx=0x7f5eb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:30.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.600+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5eb805a120 con 0x7f5ec01459a0 2024-09-10T08:41:30.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:30.783+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5ec0144400 con 0x7f5ec01459a0 2024-09-10T08:41:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.574+0000 7f5eb6000640 1 -- 172.21.15.52:0/1086801971 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v180) ==== 138+0+0 (secure 0 0 0) 0x7f5eb8059a20 con 0x7f5ec01459a0 2024-09-10T08:41:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:41:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 msgr2=0x7f5e9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 0x7f5e9c06e2f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0034000 tx=0x7f5eb002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 msgr2=0x7f5ec01e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007e40 tx=0x7f5eb800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 shutdown_connections 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5e9c06be30 0x7f5e9c06e2f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec01459a0 0x7f5ec01e59f0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ec01454b0 0x7f5ec00aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 --2- 172.21.15.52:0/1086801971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ec00b0e50 0x7f5ec01e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 >> 172.21.15.52:0/1086801971 conn(0x7f5ec006c240 msgr2=0x7f5ec0072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 shutdown_connections 2024-09-10T08:41:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.577+0000 7f5ec4c00640 1 -- 172.21.15.52:0/1086801971 wait complete. 2024-09-10T08:41:31.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:41:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.767+0000 7f8f07400640 1 Processor -- start 2024-09-10T08:41:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.767+0000 7f8f07400640 1 -- start start 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8f07400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f000b3350 0x7f8f000d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8f07400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000cf710 con 0x7f8f000b38a0 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8f07400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000cf9f0 con 0x7f8f0006bfd0 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8f07400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8f000b78a0 con 0x7f8f000b3350 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8effe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f000b3350 0x7f8f000d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8effe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8f000b3350 0x7f8f000d2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47414/0 (socket says 172.21.15.52:47414) 2024-09-10T08:41:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.768+0000 7f8effe00640 1 -- 172.21.15.52:0/2465998686 learned_addr learned my addr 172.21.15.52:0/2465998686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.769+0000 7f8effe00640 1 -- 172.21.15.52:0/2465998686 >> v1:172.21.15.176:6789/0 conn(0x7f8f0006bfd0 legacy=0x7f8f0006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.769+0000 7f8effe00640 1 -- 172.21.15.52:0/2465998686 >> v1:172.21.15.52:6789/0 conn(0x7f8f000b38a0 legacy=0x7f8f000d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.769+0000 7f8effe00640 1 -- 172.21.15.52:0/2465998686 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000cfcd0 con 0x7f8f000b3350 2024-09-10T08:41:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.770+0000 7f8effe00640 1 --2- 172.21.15.52:0/2465998686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b3350 0x7f8f000d2920 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec02a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52329fa6aa55b48a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.770+0000 7f8eff400640 1 -- 172.21.15.52:0/2465998686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec037070 con 0x7f8f000b3350 2024-09-10T08:41:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.770+0000 7f8eff400640 1 -- 172.21.15.52:0/2465998686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec032640 con 0x7f8f000b3350 2024-09-10T08:41:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.770+0000 7f8eff400640 1 -- 172.21.15.52:0/2465998686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec032a10 con 0x7f8f000b3350 2024-09-10T08:41:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 -- 172.21.15.52:0/2465998686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b3350 msgr2=0x7f8f000d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 --2- 172.21.15.52:0/2465998686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b3350 0x7f8f000d2920 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec02a3c0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 -- 172.21.15.52:0/2465998686 shutdown_connections 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 --2- 172.21.15.52:0/2465998686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b3350 0x7f8f000d2920 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 -- 172.21.15.52:0/2465998686 >> 172.21.15.52:0/2465998686 conn(0x7f8f000d11c0 msgr2=0x7f8f000d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 -- 172.21.15.52:0/2465998686 shutdown_connections 2024-09-10T08:41:31.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.771+0000 7f8f07400640 1 -- 172.21.15.52:0/2465998686 wait complete. 2024-09-10T08:41:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.772+0000 7f8f07400640 1 Processor -- start 2024-09-10T08:41:31.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 -- start start 2024-09-10T08:41:31.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f0006bfd0 0x7f8f00153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f000b3350 0x7f8f001f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0006cd50 con 0x7f8f000b38a0 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000cffb0 con 0x7f8f000b3350 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.773+0000 7f8f07400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0015eae0 con 0x7f8f0006bfd0 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47418/0 (socket says 172.21.15.52:47418) 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 -- 172.21.15.52:0/2863623796 learned_addr learned my addr 172.21.15.52:0/2863623796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8effe00640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f000b3350 0x7f8f001f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f04a00640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f0006bfd0 0x7f8f00153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 -- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f0006bfd0 msgr2=0x7f8f00153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f0006bfd0 0x7f8f00153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 -- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f000b3350 msgr2=0x7f8f001f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:31.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f000b3350 0x7f8f001f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:31.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 -- 172.21.15.52:0/2863623796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0015f610 con 0x7f8f000b38a0 2024-09-10T08:41:31.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.774+0000 7f8f05400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c6e0 tx=0x7f8ef800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:31.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.775+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8003b70 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.775+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8003d30 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.775+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8005310 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.775+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0015f8f0 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.775+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f00153f40 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.776+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0006c3b0 con 0x7f8f000b38a0 2024-09-10T08:41:31.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.777+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8ef80054b0 con 0x7f8f000b38a0 2024-09-10T08:41:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.778+0000 7f8efcc00640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 0x7f8ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:31.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.778+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5227+0+0 (secure 0 0 0) 0x7f8ef808a990 con 0x7f8f000b38a0 2024-09-10T08:41:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.779+0000 7f8f04a00640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 0x7f8ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:31.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.779+0000 7f8f04a00640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 0x7f8ee006e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f00161180 tx=0x7f8ef4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:31.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.783+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ef8058ec0 con 0x7f8f000b38a0 2024-09-10T08:41:31.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:31.966+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8f000d0cf0 con 0x7f8f000b38a0 2024-09-10T08:41:32.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.581+0000 7f8efcc00640 1 -- 172.21.15.52:0/2863623796 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v181) ==== 170+0+0 (secure 0 0 0) 0x7f8ef805d1c0 con 0x7f8f000b38a0 2024-09-10T08:41:32.582 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:41:32.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 msgr2=0x7f8ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 0x7f8ee006e2f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f00161180 tx=0x7f8ef4009040 comp rx=0 tx=0).stop 2024-09-10T08:41:32.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 msgr2=0x7f8f001f7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800c6e0 tx=0x7f8ef800cba0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 shutdown_connections 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8ee006be30 0x7f8ee006e2f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f000b38a0 0x7f8f001f7fe0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f000b3350 0x7f8f001f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 --2- 172.21.15.52:0/2863623796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f0006bfd0 0x7f8f00153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 >> 172.21.15.52:0/2863623796 conn(0x7f8f000d11c0 msgr2=0x7f8f000cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:32.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 shutdown_connections 2024-09-10T08:41:32.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.585+0000 7f8f07400640 1 -- 172.21.15.52:0/2863623796 wait complete. 2024-09-10T08:41:32.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:41:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.779+0000 7f9e26600640 1 Processor -- start 2024-09-10T08:41:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.779+0000 7f9e26600640 1 -- start start 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.780+0000 7f9e26600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200ccf30 0x7f9e200b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e26600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e2015b7c0 0x7f9e200cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e26600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e200cd850 con 0x7f9e200cead0 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e26600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9e200cf2e0 con 0x7f9e2015b7c0 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e26600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e20070fe0 con 0x7f9e200ccf30 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e2015b7c0 0x7f9e200cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9e2015b7c0 0x7f9e200cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47424/0 (socket says 172.21.15.52:47424) 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 -- 172.21.15.52:0/1485214862 learned_addr learned my addr 172.21.15.52:0/1485214862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e1f400640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200ccf30 0x7f9e200b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 -- 172.21.15.52:0/1485214862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200ccf30 msgr2=0x7f9e200b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200ccf30 0x7f9e200b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 -- 172.21.15.52:0/1485214862 >> v1:172.21.15.52:6789/0 conn(0x7f9e200cead0 legacy=0x7f9e2015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.781+0000 7f9e17e00640 1 -- 172.21.15.52:0/1485214862 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e200712c0 con 0x7f9e2015b7c0 2024-09-10T08:41:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.782+0000 7f9e17e00640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2015b7c0 0x7f9e200cd310 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800bb10 tx=0x7f9e0802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5196078edb3db69f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e1ea00640 1 -- 172.21.15.52:0/1485214862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08032790 con 0x7f9e2015b7c0 2024-09-10T08:41:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e1ea00640 1 -- 172.21.15.52:0/1485214862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08038070 con 0x7f9e2015b7c0 2024-09-10T08:41:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e1ea00640 1 -- 172.21.15.52:0/1485214862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08032b50 con 0x7f9e2015b7c0 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 -- 172.21.15.52:0/1485214862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2015b7c0 msgr2=0x7f9e200cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2015b7c0 0x7f9e200cd310 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800bb10 tx=0x7f9e0802c890 comp rx=0 tx=0).stop 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 -- 172.21.15.52:0/1485214862 shutdown_connections 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e2015b7c0 0x7f9e200cd310 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 --2- 172.21.15.52:0/1485214862 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200ccf30 0x7f9e200b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 -- 172.21.15.52:0/1485214862 >> 172.21.15.52:0/1485214862 conn(0x7f9e2006d0f0 msgr2=0x7f9e2006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 -- 172.21.15.52:0/1485214862 shutdown_connections 2024-09-10T08:41:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.783+0000 7f9e26600640 1 -- 172.21.15.52:0/1485214862 wait complete. 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.785+0000 7f9e26600640 1 Processor -- start 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.785+0000 7f9e26600640 1 -- start start 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200cead0 0x7f9e2015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e2015b7c0 0x7f9e20143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e200cef40 con 0x7f9e200ccf30 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e200cf5c0 con 0x7f9e2015b7c0 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e26600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9e200cf0c0 con 0x7f9e200cead0 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47430/0 (socket says 172.21.15.52:47430) 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e1f400640 1 -- 172.21.15.52:0/2146898646 learned_addr learned my addr 172.21.15.52:0/2146898646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e17e00640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200cead0 0x7f9e2015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.786+0000 7f9e1fe00640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e2015b7c0 0x7f9e20143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 -- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200cead0 msgr2=0x7f9e2015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200cead0 0x7f9e2015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 -- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e2015b7c0 msgr2=0x7f9e20143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e2015b7c0 0x7f9e20143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 -- 172.21.15.52:0/2146898646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e20155f30 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e1f400640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000d830 tx=0x7f9e1000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000b6c0 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e10019070 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000ba80 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.787+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e20156210 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.788+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e201567d0 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.789+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e200b2c50 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.790+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e1001e460 con 0x7f9e200ccf30 2024-09-10T08:41:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.791+0000 7f9e17400640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 0x7f9dfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.791+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5609+0+0 (secure 0 0 0) 0x7f9e1008bea0 con 0x7f9e200ccf30 2024-09-10T08:41:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.791+0000 7f9e17e00640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 0x7f9dfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.792+0000 7f9e17e00640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 0x7f9dfc06e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9e08037000 tx=0x7f9e0803e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:32.794+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e1005a250 con 0x7f9e200ccf30 2024-09-10T08:41:33.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.013+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9e200cc960 con 0x7f9e200ccf30 2024-09-10T08:41:33.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.583+0000 7f9e17400640 1 -- 172.21.15.52:0/2146898646 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v137) ==== 174+0+0 (secure 0 0 0) 0x7f9e1005e550 con 0x7f9e200ccf30 2024-09-10T08:41:33.584 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 26 and data pool 27 2024-09-10T08:41:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.587+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 msgr2=0x7f9dfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.587+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 0x7f9dfc06e2f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9e08037000 tx=0x7f9e0803e040 comp rx=0 tx=0).stop 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.587+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 msgr2=0x7f9e20155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.587+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000d830 tx=0x7f9e1000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 shutdown_connections 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9dfc06be30 0x7f9dfc06e2f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e2015b7c0 0x7f9e20143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e200cead0 0x7f9e2015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 --2- 172.21.15.52:0/2146898646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e200ccf30 0x7f9e20155830 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.589+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 >> 172.21.15.52:0/2146898646 conn(0x7f9e2006d0f0 msgr2=0x7f9e2006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.590+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 shutdown_connections 2024-09-10T08:41:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.590+0000 7f9e26600640 1 -- 172.21.15.52:0/2146898646 wait complete. 2024-09-10T08:41:33.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.790+0000 7f0f08c00640 1 Processor -- start 2024-09-10T08:41:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.790+0000 7f0f08c00640 1 -- start start 2024-09-10T08:41:33.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.791+0000 7f0f08c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f0415eb60 0x7f0f0415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.791+0000 7f0f08c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f040b66a0 0x7f0f040b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.791+0000 7f0f08c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f0415f590 con 0x7f0f041624b0 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.791+0000 7f0f08c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0f040b7070 con 0x7f0f0415eb60 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.791+0000 7f0f08c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0415f870 con 0x7f0f040b66a0 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f0415eb60 0x7f0f0415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f0415eb60 0x7f0f0415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47440/0 (socket says 172.21.15.52:47440) 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 -- 172.21.15.52:0/2494494442 learned_addr learned my addr 172.21.15.52:0/2494494442 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f02800640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f040b66a0 0x7f0f040b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 -- 172.21.15.52:0/2494494442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f040b66a0 msgr2=0x7f0f040b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f040b66a0 0x7f0f040b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 -- 172.21.15.52:0/2494494442 >> v1:172.21.15.176:6789/0 conn(0x7f0f041624b0 legacy=0x7f0f040d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.792+0000 7f0f01e00640 1 -- 172.21.15.52:0/2494494442 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0415fb50 con 0x7f0f0415eb60 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.793+0000 7f0f01e00640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415ef40 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009870 tx=0x7f0ef402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ec6b1753291f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.793+0000 7f0f01400640 1 -- 172.21.15.52:0/2494494442 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4037070 con 0x7f0f0415eb60 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.793+0000 7f0f01400640 1 -- 172.21.15.52:0/2494494442 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef4032440 con 0x7f0f0415eb60 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.793+0000 7f0f01400640 1 -- 172.21.15.52:0/2494494442 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4032810 con 0x7f0f0415eb60 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 -- 172.21.15.52:0/2494494442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 msgr2=0x7f0f0415ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415ef40 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009870 tx=0x7f0ef402a130 comp rx=0 tx=0).stop 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 -- 172.21.15.52:0/2494494442 shutdown_connections 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f040b66a0 0x7f0f040b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 --2- 172.21.15.52:0/2494494442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415ef40 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 -- 172.21.15.52:0/2494494442 >> 172.21.15.52:0/2494494442 conn(0x7f0f040d16f0 msgr2=0x7f0f040d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:33.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 -- 172.21.15.52:0/2494494442 shutdown_connections 2024-09-10T08:41:33.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.794+0000 7f0f08c00640 1 -- 172.21.15.52:0/2494494442 wait complete. 2024-09-10T08:41:33.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.796+0000 7f0f08c00640 1 Processor -- start 2024-09-10T08:41:33.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.796+0000 7f0f08c00640 1 -- start start 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f040b66a0 0x7f0f04156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 0x7f0f04158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f040d4480 con 0x7f0f0415eb60 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f040cef40 con 0x7f0f040b66a0 2024-09-10T08:41:33.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f08c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f040d4600 con 0x7f0f041624b0 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47442/0 (socket says 172.21.15.52:47442) 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 -- 172.21.15.52:0/3163848220 learned_addr learned my addr 172.21.15.52:0/3163848220 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f01e00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f040b66a0 0x7f0f04156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f02800640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 0x7f0f04158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 -- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 msgr2=0x7f0f04158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 0x7f0f04158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 -- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f040b66a0 msgr2=0x7f0f04156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f040b66a0 0x7f0f04156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0efbe00640 1 -- 172.21.15.52:0/3163848220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0415b2c0 con 0x7f0f0415eb60 2024-09-10T08:41:33.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.797+0000 7f0f02800640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 0x7f0f04158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0efbe00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c400 tx=0x7f0eec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0052d0 con 0x7f0f0415eb60 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec005490 con 0x7f0f0415eb60 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec007260 con 0x7f0f0415eb60 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0415b5a0 con 0x7f0f0415eb60 2024-09-10T08:41:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.798+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0415be40 con 0x7f0f0415eb60 2024-09-10T08:41:33.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.799+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0415b770 con 0x7f0f0415eb60 2024-09-10T08:41:33.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.800+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0eec007400 con 0x7f0f0415eb60 2024-09-10T08:41:33.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.801+0000 7f0efa000640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:33.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.801+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f0eec08a390 con 0x7f0f0415eb60 2024-09-10T08:41:33.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.801+0000 7f0f01e00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:33.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.802+0000 7f0f01e00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4034000 tx=0x7f0ef402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:33.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.805+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0eec058650 con 0x7f0f0415eb60 2024-09-10T08:41:33.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.990+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f0415c040 con 0x7f0f0415eb60 2024-09-10T08:41:33.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.991+0000 7f0efa000640 1 -- 172.21.15.52:0/3163848220 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16700 (secure 0 0 0) 0x7f0f0415c040 con 0x7f0f0415eb60 2024-09-10T08:41:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:33.992 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":182,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:33.015349+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:41:30.825257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-10T08:41:32.008185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 msgr2=0x7f0ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4034000 tx=0x7f0ef402e000 comp rx=0 tx=0).stop 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 msgr2=0x7f0f0415c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c400 tx=0x7f0eec00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 shutdown_connections 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f041624b0 0x7f0f04158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0415eb60 0x7f0f0415c360 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 --2- 172.21.15.52:0/3163848220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f040b66a0 0x7f0f04156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:33.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 >> 172.21.15.52:0/3163848220 conn(0x7f0f040d16f0 msgr2=0x7f0f040d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:33.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 shutdown_connections 2024-09-10T08:41:33.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:33.993+0000 7f0f08c00640 1 -- 172.21.15.52:0/3163848220 wait complete. 2024-09-10T08:41:34.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.166+0000 7fba90800640 1 Processor -- start 2024-09-10T08:41:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.166+0000 7fba90800640 1 -- start start 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.167+0000 7fba90800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fba880b5080 0x7fba880b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.167+0000 7fba90800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880b4020 con 0x7fba88145ed0 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.167+0000 7fba90800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba880b42c0 con 0x7fba88073890 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.167+0000 7fba90800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fba880b45a0 con 0x7fba880b5080 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8de00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fba88145ed0 0x7fba88073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32858/0 (socket says 172.21.15.52:32858) 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8de00640 1 -- 172.21.15.52:0/1986138195 learned_addr learned my addr 172.21.15.52:0/1986138195 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8e800640 1 --2- 172.21.15.52:0/1986138195 >> v2:172.21.15.176:3300/0 conn(0x7fba880b5080 0x7fba880b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8ca00640 1 -- 172.21.15.52:0/1986138195 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158820168 0 0) 0x7fba880b4020 con 0x7fba88145ed0 2024-09-10T08:41:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8ca00640 1 -- 172.21.15.52:0/1986138195 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba70003520 con 0x7fba88145ed0 2024-09-10T08:41:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8e800640 1 -- 172.21.15.52:0/1986138195 >> v1:172.21.15.176:6789/0 conn(0x7fba88073890 legacy=0x7fba880b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8e800640 1 -- 172.21.15.52:0/1986138195 >> v1:172.21.15.52:6789/0 conn(0x7fba88145ed0 legacy=0x7fba88073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.168+0000 7fba8e800640 1 -- 172.21.15.52:0/1986138195 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba880b4880 con 0x7fba880b5080 2024-09-10T08:41:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.169+0000 7fba8e800640 1 --2- 172.21.15.52:0/1986138195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba880b5080 0x7fba880b5f90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fba84009d90 tx=0x7fba8402a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=926572ac3b03cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba8ca00640 1 -- 172.21.15.52:0/1986138195 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84037070 con 0x7fba880b5080 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba8ca00640 1 -- 172.21.15.52:0/1986138195 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84007740 con 0x7fba880b5080 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba8ca00640 1 -- 172.21.15.52:0/1986138195 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84007b10 con 0x7fba880b5080 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 -- 172.21.15.52:0/1986138195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba880b5080 msgr2=0x7fba880b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 --2- 172.21.15.52:0/1986138195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba880b5080 0x7fba880b5f90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fba84009d90 tx=0x7fba8402a780 comp rx=0 tx=0).stop 2024-09-10T08:41:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 -- 172.21.15.52:0/1986138195 shutdown_connections 2024-09-10T08:41:34.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 --2- 172.21.15.52:0/1986138195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba880b5080 0x7fba880b5f90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 -- 172.21.15.52:0/1986138195 >> 172.21.15.52:0/1986138195 conn(0x7fba880ccec0 msgr2=0x7fba880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:34.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 -- 172.21.15.52:0/1986138195 shutdown_connections 2024-09-10T08:41:34.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.170+0000 7fba90800640 1 -- 172.21.15.52:0/1986138195 wait complete. 2024-09-10T08:41:34.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.172+0000 7fba90800640 1 Processor -- start 2024-09-10T08:41:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.172+0000 7fba90800640 1 -- start start 2024-09-10T08:41:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 0x7fba88140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba88145ed0 0x7fba88141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba88146430 con 0x7fba88073890 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fba881462b0 con 0x7fba88145ed0 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba90800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fba8815cdc0 con 0x7fba880b5080 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba8de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba8de00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34046/0 (socket says 172.21.15.52:34046) 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba8de00640 1 -- 172.21.15.52:0/2053829379 learned_addr learned my addr 172.21.15.52:0/2053829379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:34.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.173+0000 7fba8e800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba88145ed0 0x7fba88141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8d400640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 0x7fba88140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 -- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 msgr2=0x7fba88140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 0x7fba88140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 -- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba88145ed0 msgr2=0x7fba88141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba88145ed0 0x7fba88141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 -- 172.21.15.52:0/2053829379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8813f1a0 con 0x7fba88073890 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8d400640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 0x7fba88140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba8de00640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00c400 tx=0x7fba7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c017070 con 0x7fba88073890 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c005ce0 con 0x7fba88073890 2024-09-10T08:41:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0072d0 con 0x7fba88073890 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.174+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8813f480 con 0x7fba88073890 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.175+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8813fa40 con 0x7fba88073890 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.176+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba880720f0 con 0x7fba88073890 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.177+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba7c01a070 con 0x7fba88073890 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.178+0000 7fba82000640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 0x7fba6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.178+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fba7c08a190 con 0x7fba88073890 2024-09-10T08:41:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.178+0000 7fba8d400640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 0x7fba6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.179+0000 7fba8d400640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 0x7fba6c06e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fba880726d0 tx=0x7fba78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.182+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba880720f0 con 0x7fba88073890 2024-09-10T08:41:34.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.368+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba88144be0 con 0x7fba88073890 2024-09-10T08:41:34.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.369+0000 7fba82000640 1 -- 172.21.15.52:0/2053829379 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16700 (secure 0 0 0) 0x7fba7c0584e0 con 0x7fba88073890 2024-09-10T08:41:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:34.370 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":182,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:33.015349+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:41:30.825257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-10T08:41:32.008185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 msgr2=0x7fba6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 0x7fba6c06e2f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fba880726d0 tx=0x7fba78009040 comp rx=0 tx=0).stop 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 msgr2=0x7fba8815b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00c400 tx=0x7fba7c00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 shutdown_connections 2024-09-10T08:41:34.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fba6c06be30 0x7fba6c06e2f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fba88145ed0 0x7fba88141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fba880b5080 0x7fba88140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 --2- 172.21.15.52:0/2053829379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88073890 0x7fba8815b810 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.371+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 >> 172.21.15.52:0/2053829379 conn(0x7fba880ccec0 msgr2=0x7fba880cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.372+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 shutdown_connections 2024-09-10T08:41:34.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.372+0000 7fba90800640 1 -- 172.21.15.52:0/2053829379 wait complete. 2024-09-10T08:41:34.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:41:34.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.547+0000 7f514ec00640 1 Processor -- start 2024-09-10T08:41:34.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.547+0000 7f514ec00640 1 -- start start 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51480d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514ec00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480d3250 con 0x7f514815e620 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514ec00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480b78b0 con 0x7f51480b8070 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51480b7680 con 0x7f51480d0f60 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514d800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f514815e620 0x7f51480d2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32870/0 (socket says 172.21.15.52:32870) 2024-09-10T08:41:34.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.548+0000 7f514d800640 1 -- 172.21.15.52:0/2802026420 learned_addr learned my addr 172.21.15.52:0/2802026420 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f514ce00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51480d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742089095 0 0) 0x7f51480d3250 con 0x7f514815e620 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5130003520 con 0x7f514815e620 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15480629 0 0) 0x7f5130003520 con 0x7f514815e620 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 msgr2=0x7f51480d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51480d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 >> v1:172.21.15.176:6789/0 conn(0x7f51480b8070 legacy=0x7f51480b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514815ea00 con 0x7f514815e620 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f513c001670 con 0x7f514815e620 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 >> v1:172.21.15.52:6789/0 conn(0x7f514815e620 legacy=0x7f51480d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51300039e0 0x7f5130003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f513000ba70 con 0x7f51300039e0 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f513000bbf0 con 0x7f5130004800 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.549+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f513000bdf0 con 0x7f51480d0f60 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51300039e0 0x7f5130003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514ce00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514e200640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 -- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 msgr2=0x7f51300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480d0f60 0x7f51300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 -- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5130004800 msgr2=0x7f5130004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5130004800 0x7f5130004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.550+0000 7f514d800640 1 -- 172.21.15.52:0/2802026420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5130003520 con 0x7f51300039e0 2024-09-10T08:41:34.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.551+0000 7f514d800640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51300039e0 0x7f5130003e00 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f513c001eb0 tx=0x7f5130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff8d13d10ff56ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.551+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c007d30 con 0x7f51300039e0 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.551+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c005af0 con 0x7f51300039e0 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.551+0000 7f5147e00640 1 -- 172.21.15.52:0/2802026420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c007070 con 0x7f51300039e0 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 -- 172.21.15.52:0/2802026420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51300039e0 msgr2=0x7f5130003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 --2- 172.21.15.52:0/2802026420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51300039e0 0x7f5130003e00 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f513c001eb0 tx=0x7f5130005830 comp rx=0 tx=0).stop 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514e200640 1 -- 172.21.15.52:0/2802026420 reap_dead start 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 -- 172.21.15.52:0/2802026420 shutdown_connections 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 -- 172.21.15.52:0/2802026420 >> 172.21.15.52:0/2802026420 conn(0x7f5148067950 msgr2=0x7f5148067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 -- 172.21.15.52:0/2802026420 shutdown_connections 2024-09-10T08:41:34.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.552+0000 7f514ec00640 1 -- 172.21.15.52:0/2802026420 wait complete. 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.554+0000 7f514ec00640 1 Processor -- start 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.554+0000 7f514ec00640 1 -- start start 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 0x7f514815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 0x7f51480cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51480d40a0 con 0x7f51480cdf50 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f51480d2f70 con 0x7f51300039e0 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f51480d2830 con 0x7f51480ca370 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34074/0 (socket says 172.21.15.52:34074) 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 -- 172.21.15.52:0/450842566 learned_addr learned my addr 172.21.15.52:0/450842566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514d800640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 0x7f514815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514e200640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 0x7f51480cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 -- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 msgr2=0x7f51480cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 0x7f51480cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 -- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 msgr2=0x7f514815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 0x7f514815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514ce00640 1 -- 172.21.15.52:0/450842566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51480ce450 con 0x7f51480cdf50 2024-09-10T08:41:34.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514e200640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 0x7f51480cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.555+0000 7f514d800640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 0x7f514815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f514ce00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5134011940 tx=0x7f5134011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513400faf0 con 0x7f51480cdf50 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513400fc90 con 0x7f51480cdf50 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51480ce730 con 0x7f51480cdf50 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134014440 con 0x7f51480cdf50 2024-09-10T08:41:34.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.556+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51480cecf0 con 0x7f51480cdf50 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.557+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148068cf0 con 0x7f51480cdf50 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.558+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5134012040 con 0x7f51480cdf50 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.559+0000 7f5145600640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 0x7f512806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.559+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f513408b500 con 0x7f51480cdf50 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.559+0000 7f514d800640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 0x7f512806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:34.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.560+0000 7f514d800640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 0x7f512806e320 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f513c032000 tx=0x7f513c02d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:34.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.564+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5148068cf0 con 0x7f51480cdf50 2024-09-10T08:41:34.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:34.795+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f51480cf180 con 0x7f51480cdf50 2024-09-10T08:41:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.607+0000 7f5145600640 1 -- 172.21.15.52:0/450842566 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v140) ==== 118+0+0 (secure 0 0 0) 0x7f5134019030 con 0x7f51480cdf50 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 msgr2=0x7f512806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 0x7f512806e320 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f513c032000 tx=0x7f513c02d000 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 msgr2=0x7f51480cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5134011940 tx=0x7f5134011e00 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 shutdown_connections 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f512806be60 0x7f512806e320 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f51480ca370 0x7f51480cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51480cdf50 0x7f51480cf4f0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 --2- 172.21.15.52:0/450842566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f51300039e0 0x7f514815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 >> 172.21.15.52:0/450842566 conn(0x7f5148067950 msgr2=0x7f5148160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 shutdown_connections 2024-09-10T08:41:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.611+0000 7f514ec00640 1 -- 172.21.15.52:0/450842566 wait complete. 2024-09-10T08:41:35.630 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:41:35.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:41:35.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.793+0000 7f209b200640 1 Processor -- start 2024-09-10T08:41:35.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.793+0000 7f209b200640 1 -- start start 2024-09-10T08:41:35.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f209b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f20940cce30 0x7f20940cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f209b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2094071c70 0x7f20940720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f209b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20940714b0 con 0x7f20940732e0 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f209b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f20940cd880 con 0x7f2094071c70 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f209b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f20940cdb60 con 0x7f20940cce30 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f2093e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20940732e0 0x7f20940736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32884/0 (socket says 172.21.15.52:32884) 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f2093e00640 1 -- 172.21.15.52:0/2239575703 learned_addr learned my addr 172.21.15.52:0/2239575703 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f2099200640 1 --2- 172.21.15.52:0/2239575703 >> v2:172.21.15.52:3300/0 conn(0x7f2094071c70 0x7f20940720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f208b400640 1 --2- 172.21.15.52:0/2239575703 >> v2:172.21.15.176:3300/0 conn(0x7f20940cce30 0x7f20940cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.795+0000 7f2093400640 1 -- 172.21.15.52:0/2239575703 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720659412 0 0) 0x7f20940714b0 con 0x7f20940732e0 2024-09-10T08:41:35.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.796+0000 7f2099200640 1 -- 172.21.15.52:0/2239575703 >> v2:172.21.15.176:3300/0 conn(0x7f20940cce30 msgr2=0x7f20940cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:35.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.796+0000 7f2099200640 1 --2- 172.21.15.52:0/2239575703 >> v2:172.21.15.176:3300/0 conn(0x7f20940cce30 0x7f20940cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.796+0000 7f2099200640 1 -- 172.21.15.52:0/2239575703 >> v1:172.21.15.52:6789/0 conn(0x7f20940732e0 legacy=0x7f20940736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.796+0000 7f2099200640 1 -- 172.21.15.52:0/2239575703 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20940cde40 con 0x7f2094071c70 2024-09-10T08:41:35.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f2099200640 1 --2- 172.21.15.52:0/2239575703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2094071c70 0x7f20940720c0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f20940c57f0 tx=0x7f208c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ac48b3a11f8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:35.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f2093400640 1 -- 172.21.15.52:0/2239575703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c007740 con 0x7f2094071c70 2024-09-10T08:41:35.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f2093400640 1 -- 172.21.15.52:0/2239575703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0078e0 con 0x7f2094071c70 2024-09-10T08:41:35.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f2093400640 1 -- 172.21.15.52:0/2239575703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c007cb0 con 0x7f2094071c70 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 -- 172.21.15.52:0/2239575703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2094071c70 msgr2=0x7f20940720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 --2- 172.21.15.52:0/2239575703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2094071c70 0x7f20940720c0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f20940c57f0 tx=0x7f208c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 -- 172.21.15.52:0/2239575703 shutdown_connections 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 --2- 172.21.15.52:0/2239575703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2094071c70 0x7f20940720c0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 --2- 172.21.15.52:0/2239575703 >> v2:172.21.15.176:3300/0 conn(0x7f20940cce30 0x7f20940cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.797+0000 7f209b200640 1 -- 172.21.15.52:0/2239575703 >> 172.21.15.52:0/2239575703 conn(0x7f209406d0f0 msgr2=0x7f209406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.798+0000 7f209b200640 1 -- 172.21.15.52:0/2239575703 shutdown_connections 2024-09-10T08:41:35.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.798+0000 7f209b200640 1 -- 172.21.15.52:0/2239575703 wait complete. 2024-09-10T08:41:35.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.799+0000 7f209b200640 1 Processor -- start 2024-09-10T08:41:35.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.799+0000 7f209b200640 1 -- start start 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2094071c70 0x7f2094152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 0x7f209414f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f209415ca50 con 0x7f20940cce30 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f209415c8d0 con 0x7f2094071c70 2024-09-10T08:41:35.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.800+0000 7f209b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f209415cbd0 con 0x7f20940732e0 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34090/0 (socket says 172.21.15.52:34090) 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 -- 172.21.15.52:0/2291383380 learned_addr learned my addr 172.21.15.52:0/2291383380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2093e00640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2094071c70 0x7f2094152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f208b400640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 0x7f209414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 -- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 msgr2=0x7f209414f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 0x7f209414f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 -- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2094071c70 msgr2=0x7f2094152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2094071c70 0x7f2094152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 -- 172.21.15.52:0/2291383380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20941f8650 con 0x7f20940cce30 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f208b400640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 0x7f209414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:35.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.801+0000 7f2099200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f208c02abe0 tx=0x7f208c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.802+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c040070 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.802+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c031c40 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.802+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20941e4680 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.802+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c009450 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.802+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20941e4c40 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.803+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20940cd2a0 con 0x7f20940cce30 2024-09-10T08:41:35.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.804+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f208c039040 con 0x7f20940cce30 2024-09-10T08:41:35.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.805+0000 7f2090c00640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 0x7f207006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:35.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.805+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f208c0abff0 con 0x7f20940cce30 2024-09-10T08:41:35.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.805+0000 7f2093e00640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 0x7f207006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:35.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.806+0000 7f2093e00640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 0x7f207006e320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2084000f60 tx=0x7f2084007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:35.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:35.810+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f208c07a2d0 con 0x7f20940cce30 2024-09-10T08:41:36.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.028+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f209415f4d0 con 0x7f20940cce30 2024-09-10T08:41:36.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.613+0000 7f2090c00640 1 -- 172.21.15.52:0/2291383380 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v141) ==== 122+0+0 (secure 0 0 0) 0x7f208c07e5d0 con 0x7f20940cce30 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 msgr2=0x7f207006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 0x7f207006e320 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2084000f60 tx=0x7f2084007d50 comp rx=0 tx=0).stop 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 msgr2=0x7f20940cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f208c02abe0 tx=0x7f208c004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 shutdown_connections 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f207006be60 0x7f207006e320 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20940cce30 0x7f20940cf560 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20940732e0 0x7f209414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 --2- 172.21.15.52:0/2291383380 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2094071c70 0x7f2094152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 >> 172.21.15.52:0/2291383380 conn(0x7f209406d0f0 msgr2=0x7f2094073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:36.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 shutdown_connections 2024-09-10T08:41:36.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.615+0000 7f209b200640 1 -- 172.21.15.52:0/2291383380 wait complete. 2024-09-10T08:41:36.633 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:41:36.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:36.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.789+0000 7f5279c00640 1 Processor -- start 2024-09-10T08:41:36.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.789+0000 7f5279c00640 1 -- start start 2024-09-10T08:41:36.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5279c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5274145ed0 0x7f52740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5279c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 0x7f52740735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5279c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740b4020 con 0x7f52740b5880 2024-09-10T08:41:36.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5279c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5274073b00 con 0x7f5274145ed0 2024-09-10T08:41:36.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5279c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f52740b42c0 con 0x7f5274073180 2024-09-10T08:41:36.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f526a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 0x7f52740735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5272a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5274145ed0 0x7f52740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.791+0000 7f5273400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f52740b5880 0x7f52740b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:36502/0 (socket says 172.21.15.52:36502) 2024-09-10T08:41:36.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.792+0000 7f5273400640 1 -- 172.21.15.52:0/1348288606 learned_addr learned my addr 172.21.15.52:0/1348288606 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.792+0000 7f526a000640 1 -- 172.21.15.52:0/1348288606 >> v2:172.21.15.176:3300/0 conn(0x7f5274145ed0 msgr2=0x7f52740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.792+0000 7f526a000640 1 --2- 172.21.15.52:0/1348288606 >> v2:172.21.15.176:3300/0 conn(0x7f5274145ed0 0x7f52740b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.792+0000 7f526a000640 1 -- 172.21.15.52:0/1348288606 >> v1:172.21.15.176:6789/0 conn(0x7f52740b5880 legacy=0x7f52740b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.792+0000 7f526a000640 1 -- 172.21.15.52:0/1348288606 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52740b45a0 con 0x7f5274073180 2024-09-10T08:41:36.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.793+0000 7f526a000640 1 --2- 172.21.15.52:0/1348288606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 0x7f52740735c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f525c0097a0 tx=0x7f525c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c307796f34b016 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5272000640 1 -- 172.21.15.52:0/1348288606 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c037070 con 0x7f5274073180 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5272000640 1 -- 172.21.15.52:0/1348288606 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c032440 con 0x7f5274073180 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5272000640 1 -- 172.21.15.52:0/1348288606 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c032810 con 0x7f5274073180 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 -- 172.21.15.52:0/1348288606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 msgr2=0x7f52740735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 --2- 172.21.15.52:0/1348288606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 0x7f52740735c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f525c0097a0 tx=0x7f525c02a180 comp rx=0 tx=0).stop 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 -- 172.21.15.52:0/1348288606 shutdown_connections 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 --2- 172.21.15.52:0/1348288606 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274073180 0x7f52740735c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 --2- 172.21.15.52:0/1348288606 >> v2:172.21.15.176:3300/0 conn(0x7f5274145ed0 0x7f52740b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 -- 172.21.15.52:0/1348288606 >> 172.21.15.52:0/1348288606 conn(0x7f52740ccec0 msgr2=0x7f52740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:36.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 -- 172.21.15.52:0/1348288606 shutdown_connections 2024-09-10T08:41:36.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.794+0000 7f5279c00640 1 -- 172.21.15.52:0/1348288606 wait complete. 2024-09-10T08:41:36.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.796+0000 7f5279c00640 1 Processor -- start 2024-09-10T08:41:36.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.796+0000 7f5279c00640 1 -- start start 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5274073180 0x7f52741f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274145ed0 0x7f5274072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52741462b0 con 0x7f52740b5880 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52740b4b60 con 0x7f5274073180 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5279c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5274146430 con 0x7f5274145ed0 2024-09-10T08:41:36.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f526a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f526a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34104/0 (socket says 172.21.15.52:34104) 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f526a000640 1 -- 172.21.15.52:0/1127970752 learned_addr learned my addr 172.21.15.52:0/1127970752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5272a00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5274073180 0x7f52741f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.797+0000 7f5273400640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274145ed0 0x7f5274072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 -- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274145ed0 msgr2=0x7f5274072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274145ed0 0x7f5274072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 -- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5274073180 msgr2=0x7f52741f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5274073180 0x7f52741f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 -- 172.21.15.52:0/1127970752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5274141330 con 0x7f52740b5880 2024-09-10T08:41:36.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526a000640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f525c0098c0 tx=0x7f525c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:36.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c037040 con 0x7f52740b5880 2024-09-10T08:41:36.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c030500 con 0x7f52740b5880 2024-09-10T08:41:36.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5274141610 con 0x7f52740b5880 2024-09-10T08:41:36.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c0308d0 con 0x7f52740b5880 2024-09-10T08:41:36.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.798+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5274141bd0 con 0x7f52740b5880 2024-09-10T08:41:36.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.799+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52740735c0 con 0x7f52740b5880 2024-09-10T08:41:36.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.800+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f525c044020 con 0x7f52740b5880 2024-09-10T08:41:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.801+0000 7f526b400640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.801+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f525c0aaf40 con 0x7f52740b5880 2024-09-10T08:41:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.801+0000 7f5272a00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:36.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.802+0000 7f5272a00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 0x7f525006e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5274154ed0 tx=0x7f5264009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:36.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:36.805+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f525c079290 con 0x7f52740b5880 2024-09-10T08:41:37.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.026+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52740d03a0 con 0x7f52740b5880 2024-09-10T08:41:37.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.027+0000 7f526b400640 1 -- 172.21.15.52:0/1127970752 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7f525c07d590 con 0x7f52740b5880 2024-09-10T08:41:37.027 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:37.027 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:41:37.028 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:41:37.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 msgr2=0x7f525006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 0x7f525006e2f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5274154ed0 tx=0x7f5264009190 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 msgr2=0x7f5274071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f525c0098c0 tx=0x7f525c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 shutdown_connections 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5274145ed0 0x7f5274072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52740b5880 0x7f5274071ff0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 --2- 172.21.15.52:0/1127970752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5274073180 0x7f52741f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 >> 172.21.15.52:0/1127970752 conn(0x7f52740ccec0 msgr2=0x7f52740d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 shutdown_connections 2024-09-10T08:41:37.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.029+0000 7f5279c00640 1 -- 172.21.15.52:0/1127970752 wait complete. 2024-09-10T08:41:37.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:41:37.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.201+0000 7f900a000640 1 Processor -- start 2024-09-10T08:41:37.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.201+0000 7f900a000640 1 -- start start 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.202+0000 7f900a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f900a000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040736d0 con 0x7f900406cf30 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f900a000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040739b0 con 0x7f9004073160 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f900a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f90040709a0 con 0x7f900415e8d0 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f9003e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f900406cf30 0x7f9004070e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32888/0 (socket says 172.21.15.52:32888) 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f9003e00640 1 -- 172.21.15.52:0/1796943729 learned_addr learned my addr 172.21.15.52:0/1796943729 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f9003400640 1 --2- 172.21.15.52:0/1796943729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062999310 0 0) 0x7f90040736d0 con 0x7f900406cf30 2024-09-10T08:41:37.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.203+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe8003520 con 0x7f900406cf30 2024-09-10T08:41:37.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.204+0000 7f9003400640 1 -- 172.21.15.52:0/1796943729 >> v1:172.21.15.176:6789/0 conn(0x7f9004073160 legacy=0x7f90040cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.204+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914452703 0 0) 0x7f90040739b0 con 0x7f9004073160 2024-09-10T08:41:37.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.204+0000 7f9003400640 1 -- 172.21.15.52:0/1796943729 >> v1:172.21.15.52:6789/0 conn(0x7f900406cf30 legacy=0x7f9004070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.204+0000 7f9003400640 1 -- 172.21.15.52:0/1796943729 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004073c90 con 0x7f900415e8d0 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.205+0000 7f9003400640 1 --2- 172.21.15.52:0/1796943729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040d03c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097d0 tx=0x7f8ff402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a0791b665e6d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.205+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4037070 con 0x7f900415e8d0 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.205+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4032440 con 0x7f900415e8d0 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.205+0000 7f9002a00640 1 -- 172.21.15.52:0/1796943729 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4032810 con 0x7f900415e8d0 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 -- 172.21.15.52:0/1796943729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 msgr2=0x7f90040d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 --2- 172.21.15.52:0/1796943729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040d03c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40097d0 tx=0x7f8ff402a180 comp rx=0 tx=0).stop 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 -- 172.21.15.52:0/1796943729 shutdown_connections 2024-09-10T08:41:37.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 --2- 172.21.15.52:0/1796943729 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040d03c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 -- 172.21.15.52:0/1796943729 >> 172.21.15.52:0/1796943729 conn(0x7f90040b4300 msgr2=0x7f90040b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:37.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 -- 172.21.15.52:0/1796943729 shutdown_connections 2024-09-10T08:41:37.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.206+0000 7f900a000640 1 -- 172.21.15.52:0/1796943729 wait complete. 2024-09-10T08:41:37.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.207+0000 7f900a000640 1 Processor -- start 2024-09-10T08:41:37.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.207+0000 7f900a000640 1 -- start start 2024-09-10T08:41:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 0x7f900415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f900406d380 con 0x7f9004073160 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f90040d0900 con 0x7f900406cf30 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.208+0000 7f900a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f900406d500 con 0x7f900415e8d0 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34118/0 (socket says 172.21.15.52:34118) 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 -- 172.21.15.52:0/1815191503 learned_addr learned my addr 172.21.15.52:0/1815191503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f9003400640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 0x7f900415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f9003e00640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 -- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 msgr2=0x7f90040ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 -- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 msgr2=0x7f900415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 0x7f900415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f8ffbe00640 1 -- 172.21.15.52:0/1815191503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90040cc230 con 0x7f9004073160 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f9003400640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 0x7f900415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.209+0000 7f9003e00640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f8ffbe00640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c490 tx=0x7f8fec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005480 con 0x7f9004073160 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec0035f0 con 0x7f9004073160 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0039c0 con 0x7f9004073160 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90040cc510 con 0x7f9004073160 2024-09-10T08:41:37.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.210+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90040ccad0 con 0x7f9004073160 2024-09-10T08:41:37.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.211+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90040d03c0 con 0x7f9004073160 2024-09-10T08:41:37.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.212+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fec003b60 con 0x7f9004073160 2024-09-10T08:41:37.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.214+0000 7f8ffb400640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 0x7f8fe006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.214+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f8fec08ab80 con 0x7f9004073160 2024-09-10T08:41:37.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.214+0000 7f9003400640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 0x7f8fe006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.215+0000 7f9003400640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 0x7f8fe006e490 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4034000 tx=0x7f8ff402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.218+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fec0182b0 con 0x7f9004073160 2024-09-10T08:41:37.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.406+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f900415b0f0 con 0x7f9004073160 2024-09-10T08:41:37.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.408+0000 7f8ffb400640 1 -- 172.21.15.52:0/1815191503 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+16687 (secure 0 0 0) 0x7f8fec059490 con 0x7f9004073160 2024-09-10T08:41:37.408 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:37.409 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":183,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:34.595477+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:41:30.825257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-10T08:41:32.008185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:41:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 msgr2=0x7f8fe006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 0x7f8fe006e490 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4034000 tx=0x7f8ff402e000 comp rx=0 tx=0).stop 2024-09-10T08:41:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 msgr2=0x7f90040b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c490 tx=0x7f8fec00c950 comp rx=0 tx=0).stop 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 shutdown_connections 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8fe006bfd0 0x7f8fe006e490 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f900415e8d0 0x7f90040ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9004073160 0x7f90040b7df0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 --2- 172.21.15.52:0/1815191503 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f900406cf30 0x7f900415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 >> 172.21.15.52:0/1815191503 conn(0x7f90040b4300 msgr2=0x7f9004074e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 shutdown_connections 2024-09-10T08:41:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.410+0000 7f900a000640 1 -- 172.21.15.52:0/1815191503 wait complete. 2024-09-10T08:41:37.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:41:37.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:41:37.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.583+0000 7f0f07a00640 1 Processor -- start 2024-09-10T08:41:37.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.583+0000 7f0f07a00640 1 -- start start 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.584+0000 7f0f07a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0f0015eb60 0x7f0f0015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.584+0000 7f0f07a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f000b66a0 0x7f0f000b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.584+0000 7f0f07a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f000b7030 con 0x7f0f001624b0 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.584+0000 7f0f07a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0015f590 con 0x7f0f000b66a0 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.584+0000 7f0f07a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0015f870 con 0x7f0f0015eb60 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f000b66a0 0x7f0f000b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f000b66a0 0x7f0f000b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34126/0 (socket says 172.21.15.52:34126) 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 -- 172.21.15.52:0/2510544735 learned_addr learned my addr 172.21.15.52:0/2510544735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05000640 1 --2- 172.21.15.52:0/2510544735 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015eb60 0x7f0f0015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 -- 172.21.15.52:0/2510544735 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015eb60 msgr2=0x7f0f0015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 --2- 172.21.15.52:0/2510544735 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015eb60 0x7f0f0015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 -- 172.21.15.52:0/2510544735 >> v1:172.21.15.176:6789/0 conn(0x7f0f001624b0 legacy=0x7f0f000d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.585+0000 7f0f05a00640 1 -- 172.21.15.52:0/2510544735 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0015fb50 con 0x7f0f000b66a0 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.586+0000 7f0f05a00640 1 --2- 172.21.15.52:0/2510544735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000b66a0 0x7f0f000b6af0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f0f000cb8d0 tx=0x7f0ef802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f061bd018053e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.586+0000 7f0eff400640 1 -- 172.21.15.52:0/2510544735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8036070 con 0x7f0f000b66a0 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.586+0000 7f0eff400640 1 -- 172.21.15.52:0/2510544735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef8031600 con 0x7f0f000b66a0 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.586+0000 7f0eff400640 1 -- 172.21.15.52:0/2510544735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80319d0 con 0x7f0f000b66a0 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 -- 172.21.15.52:0/2510544735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000b66a0 msgr2=0x7f0f000b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 --2- 172.21.15.52:0/2510544735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000b66a0 0x7f0f000b6af0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f0f000cb8d0 tx=0x7f0ef802a610 comp rx=0 tx=0).stop 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 -- 172.21.15.52:0/2510544735 shutdown_connections 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 --2- 172.21.15.52:0/2510544735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f000b66a0 0x7f0f000b6af0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 --2- 172.21.15.52:0/2510544735 >> v2:172.21.15.176:3300/0 conn(0x7f0f0015eb60 0x7f0f0015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 -- 172.21.15.52:0/2510544735 >> 172.21.15.52:0/2510544735 conn(0x7f0f000d16f0 msgr2=0x7f0f000d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 -- 172.21.15.52:0/2510544735 shutdown_connections 2024-09-10T08:41:37.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.587+0000 7f0f07a00640 1 -- 172.21.15.52:0/2510544735 wait complete. 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.589+0000 7f0f07a00640 1 Processor -- start 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.589+0000 7f0f07a00640 1 -- start start 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f000b66a0 0x7f0f0015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f0015eb60 0x7f0f000d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000d4480 con 0x7f0f001624b0 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000cef40 con 0x7f0f000b66a0 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f07a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f000d4600 con 0x7f0f0015eb60 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34142/0 (socket says 172.21.15.52:34142) 2024-09-10T08:41:37.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 -- 172.21.15.52:0/1806221397 learned_addr learned my addr 172.21.15.52:0/1806221397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05000640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f000b66a0 0x7f0f0015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0effe00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f0015eb60 0x7f0f000d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 -- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f0015eb60 msgr2=0x7f0f000d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f0015eb60 0x7f0f000d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 -- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f000b66a0 msgr2=0x7f0f0015afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f000b66a0 0x7f0f0015afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.590+0000 7f0f05a00640 1 -- 172.21.15.52:0/1806221397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f00159bc0 con 0x7f0f001624b0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0f05a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8034040 tx=0x7f0ef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8036050 con 0x7f0f001624b0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef8042070 con 0x7f0f001624b0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8009510 con 0x7f0f001624b0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f00159ea0 con 0x7f0f001624b0 2024-09-10T08:41:37.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.591+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0015a740 con 0x7f0f001624b0 2024-09-10T08:41:37.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.592+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0015a290 con 0x7f0f001624b0 2024-09-10T08:41:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.593+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ef8007bd0 con 0x7f0f001624b0 2024-09-10T08:41:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.594+0000 7f0efcc00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.594+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f0ef80abb50 con 0x7f0f001624b0 2024-09-10T08:41:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.594+0000 7f0f05000640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:37.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.595+0000 7f0f05000640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0f000cfc60 tx=0x7f0ef4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:37.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.598+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ef8079e10 con 0x7f0f001624b0 2024-09-10T08:41:37.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.781+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f000b6af0 con 0x7f0ee006be30 2024-09-10T08:41:37.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.789+0000 7f0efcc00640 1 -- 172.21.15.52:0/1806221397 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252449 (secure 0 0 0) 0x7f0f000b6af0 con 0x7f0ee006be30 2024-09-10T08:41:37.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:37.793 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:41:37.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 msgr2=0x7f0ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0f000cfc60 tx=0x7f0ef4009190 comp rx=0 tx=0).stop 2024-09-10T08:41:37.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 msgr2=0x7f0f001f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:37.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8034040 tx=0x7f0ef8004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:37.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 shutdown_connections 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0ee006be30 0x7f0ee006e2f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f001624b0 0x7f0f001f4140 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f0015eb60 0x7f0f000d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 --2- 172.21.15.52:0/1806221397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f000b66a0 0x7f0f0015afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 >> 172.21.15.52:0/1806221397 conn(0x7f0f000d16f0 msgr2=0x7f0f000d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 shutdown_connections 2024-09-10T08:41:37.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:37.792+0000 7f0f07a00640 1 -- 172.21.15.52:0/1806221397 wait complete. 2024-09-10T08:41:37.809 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-10T08:41:37.647401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460080,"kb_used_data":19080,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754514640,"statfs":{"total":773094113280,"available":772622991360,"internally_reserved":0,"allocated":19537920,"data_stored":9227380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001418"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620038+0000","last_change":"2024-09-10T08:41:33.619019+0000","last_active":"2024-09-10T08:41:33.620038+0000","last_peered":"2024-09-10T08:41:33.620038+0000","last_clean":"2024-09-10T08:41:33.620038+0000","last_became_active":"2024-09-10T08:41:33.618675+0000","last_became_peered":"2024-09-10T08:41:33.618675+0000","last_unstale":"2024-09-10T08:41:33.620038+0000","last_undegraded":"2024-09-10T08:41:33.620038+0000","last_fullsized":"2024-09-10T08:41:33.620038+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:06.097941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.604682+0000","last_change":"2024-09-10T08:41:33.600984+0000","last_active":"2024-09-10T08:41:33.604682+0000","last_peered":"2024-09-10T08:41:33.604682+0000","last_clean":"2024-09-10T08:41:33.604682+0000","last_became_active":"2024-09-10T08:41:33.598949+0000","last_became_peered":"2024-09-10T08:41:33.598949+0000","last_unstale":"2024-09-10T08:41:33.604682+0000","last_undegraded":"2024-09-10T08:41:33.604682+0000","last_fullsized":"2024-09-10T08:41:33.604682+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:37.370470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916756+0000","last_change":"2024-09-10T08:41:33.614987+0000","last_active":"2024-09-10T08:41:34.916756+0000","last_peered":"2024-09-10T08:41:34.916756+0000","last_clean":"2024-09-10T08:41:34.916756+0000","last_became_active":"2024-09-10T08:41:33.614687+0000","last_became_peered":"2024-09-10T08:41:33.614687+0000","last_unstale":"2024-09-10T08:41:34.916756+0000","last_undegraded":"2024-09-10T08:41:34.916756+0000","last_fullsized":"2024-09-10T08:41:34.916756+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:40.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.615708+0000","last_change":"2024-09-10T08:41:33.607154+0000","last_active":"2024-09-10T08:41:33.615708+0000","last_peered":"2024-09-10T08:41:33.615708+0000","last_clean":"2024-09-10T08:41:33.615708+0000","last_became_active":"2024-09-10T08:41:33.604996+0000","last_became_peered":"2024-09-10T08:41:33.604996+0000","last_unstale":"2024-09-10T08:41:33.615708+0000","last_undegraded":"2024-09-10T08:41:33.615708+0000","last_fullsized":"2024-09-10T08:41:33.615708+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:00.761241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916865+0000","last_change":"2024-09-10T08:41:33.626408+0000","last_active":"2024-09-10T08:41:34.916865+0000","last_peered":"2024-09-10T08:41:34.916865+0000","last_clean":"2024-09-10T08:41:34.916865+0000","last_became_active":"2024-09-10T08:41:33.626132+0000","last_became_peered":"2024-09-10T08:41:33.626132+0000","last_unstale":"2024-09-10T08:41:34.916865+0000","last_undegraded":"2024-09-10T08:41:34.916865+0000","last_fullsized":"2024-09-10T08:41:34.916865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:00.366202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622835+0000","last_change":"2024-09-10T08:41:33.613932+0000","last_active":"2024-09-10T08:41:33.622835+0000","last_peered":"2024-09-10T08:41:33.622835+0000","last_clean":"2024-09-10T08:41:33.622835+0000","last_became_active":"2024-09-10T08:41:33.613549+0000","last_became_peered":"2024-09-10T08:41:33.613549+0000","last_unstale":"2024-09-10T08:41:33.622835+0000","last_undegraded":"2024-09-10T08:41:33.622835+0000","last_fullsized":"2024-09-10T08:41:33.622835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:39.135776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.624342+0000","last_change":"2024-09-10T08:41:33.623018+0000","last_active":"2024-09-10T08:41:33.624342+0000","last_peered":"2024-09-10T08:41:33.624342+0000","last_clean":"2024-09-10T08:41:33.624342+0000","last_became_active":"2024-09-10T08:41:33.622367+0000","last_became_peered":"2024-09-10T08:41:33.622367+0000","last_unstale":"2024-09-10T08:41:33.624342+0000","last_undegraded":"2024-09-10T08:41:33.624342+0000","last_fullsized":"2024-09-10T08:41:33.624342+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:38.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604565+0000","last_change":"2024-09-10T08:41:33.601510+0000","last_active":"2024-09-10T08:41:34.604565+0000","last_peered":"2024-09-10T08:41:34.604565+0000","last_clean":"2024-09-10T08:41:34.604565+0000","last_became_active":"2024-09-10T08:41:33.601234+0000","last_became_peered":"2024-09-10T08:41:33.601234+0000","last_unstale":"2024-09-10T08:41:34.604565+0000","last_undegraded":"2024-09-10T08:41:34.604565+0000","last_fullsized":"2024-09-10T08:41:34.604565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:35.220839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.600270+0000","last_change":"2024-09-10T08:41:33.596174+0000","last_active":"2024-09-10T08:41:33.600270+0000","last_peered":"2024-09-10T08:41:33.600270+0000","last_clean":"2024-09-10T08:41:33.600270+0000","last_became_active":"2024-09-10T08:41:33.595864+0000","last_became_peered":"2024-09-10T08:41:33.595864+0000","last_unstale":"2024-09-10T08:41:33.600270+0000","last_undegraded":"2024-09-10T08:41:33.600270+0000","last_fullsized":"2024-09-10T08:41:33.600270+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:22.361004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917086+0000","last_change":"2024-09-10T08:41:33.623401+0000","last_active":"2024-09-10T08:41:34.917086+0000","last_peered":"2024-09-10T08:41:34.917086+0000","last_clean":"2024-09-10T08:41:34.917086+0000","last_became_active":"2024-09-10T08:41:33.623111+0000","last_became_peered":"2024-09-10T08:41:33.623111+0000","last_unstale":"2024-09-10T08:41:34.917086+0000","last_undegraded":"2024-09-10T08:41:34.917086+0000","last_fullsized":"2024-09-10T08:41:34.917086+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.352397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617431+0000","last_change":"2024-09-10T08:41:33.612369+0000","last_active":"2024-09-10T08:41:33.617431+0000","last_peered":"2024-09-10T08:41:33.617431+0000","last_clean":"2024-09-10T08:41:33.617431+0000","last_became_active":"2024-09-10T08:41:33.612105+0000","last_became_peered":"2024-09-10T08:41:33.612105+0000","last_unstale":"2024-09-10T08:41:33.617431+0000","last_undegraded":"2024-09-10T08:41:33.617431+0000","last_fullsized":"2024-09-10T08:41:33.617431+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:08.969764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603359+0000","last_change":"2024-09-10T08:41:33.603399+0000","last_active":"2024-09-10T08:41:34.603359+0000","last_peered":"2024-09-10T08:41:34.603359+0000","last_clean":"2024-09-10T08:41:34.603359+0000","last_became_active":"2024-09-10T08:41:33.603012+0000","last_became_peered":"2024-09-10T08:41:33.603012+0000","last_unstale":"2024-09-10T08:41:34.603359+0000","last_undegraded":"2024-09-10T08:41:34.603359+0000","last_fullsized":"2024-09-10T08:41:34.603359+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:01.040204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606814+0000","last_change":"2024-09-10T08:41:33.602814+0000","last_active":"2024-09-10T08:41:33.606814+0000","last_peered":"2024-09-10T08:41:33.606814+0000","last_clean":"2024-09-10T08:41:33.606814+0000","last_became_active":"2024-09-10T08:41:33.602556+0000","last_became_peered":"2024-09-10T08:41:33.602556+0000","last_unstale":"2024-09-10T08:41:33.606814+0000","last_undegraded":"2024-09-10T08:41:33.606814+0000","last_fullsized":"2024-09-10T08:41:33.606814+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:30.225501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.608321+0000","last_change":"2024-09-10T08:41:33.601537+0000","last_active":"2024-09-10T08:41:33.608321+0000","last_peered":"2024-09-10T08:41:33.608321+0000","last_clean":"2024-09-10T08:41:33.608321+0000","last_became_active":"2024-09-10T08:41:33.601235+0000","last_became_peered":"2024-09-10T08:41:33.601235+0000","last_unstale":"2024-09-10T08:41:33.608321+0000","last_undegraded":"2024-09-10T08:41:33.608321+0000","last_fullsized":"2024-09-10T08:41:33.608321+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:30.490895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613481+0000","last_change":"2024-09-10T08:41:33.611677+0000","last_active":"2024-09-10T08:41:33.613481+0000","last_peered":"2024-09-10T08:41:33.613481+0000","last_clean":"2024-09-10T08:41:33.613481+0000","last_became_active":"2024-09-10T08:41:33.607286+0000","last_became_peered":"2024-09-10T08:41:33.607286+0000","last_unstale":"2024-09-10T08:41:33.613481+0000","last_undegraded":"2024-09-10T08:41:33.613481+0000","last_fullsized":"2024-09-10T08:41:33.613481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:49.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619063+0000","last_change":"2024-09-10T08:41:33.612910+0000","last_active":"2024-09-10T08:41:33.619063+0000","last_peered":"2024-09-10T08:41:33.619063+0000","last_clean":"2024-09-10T08:41:33.619063+0000","last_became_active":"2024-09-10T08:41:33.611061+0000","last_became_peered":"2024-09-10T08:41:33.611061+0000","last_unstale":"2024-09-10T08:41:33.619063+0000","last_undegraded":"2024-09-10T08:41:33.619063+0000","last_fullsized":"2024-09-10T08:41:33.619063+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:34.796464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619780+0000","last_change":"2024-09-10T08:41:33.618651+0000","last_active":"2024-09-10T08:41:33.619780+0000","last_peered":"2024-09-10T08:41:33.619780+0000","last_clean":"2024-09-10T08:41:33.619780+0000","last_became_active":"2024-09-10T08:41:33.617170+0000","last_became_peered":"2024-09-10T08:41:33.617170+0000","last_unstale":"2024-09-10T08:41:33.619780+0000","last_undegraded":"2024-09-10T08:41:33.619780+0000","last_fullsized":"2024-09-10T08:41:33.619780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:43.803623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917130+0000","last_change":"2024-09-10T08:41:33.619081+0000","last_active":"2024-09-10T08:41:34.917130+0000","last_peered":"2024-09-10T08:41:34.917130+0000","last_clean":"2024-09-10T08:41:34.917130+0000","last_became_active":"2024-09-10T08:41:33.616678+0000","last_became_peered":"2024-09-10T08:41:33.616678+0000","last_unstale":"2024-09-10T08:41:34.917130+0000","last_undegraded":"2024-09-10T08:41:34.917130+0000","last_fullsized":"2024-09-10T08:41:34.917130+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:52.938009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916826+0000","last_change":"2024-09-10T08:41:33.615967+0000","last_active":"2024-09-10T08:41:34.916826+0000","last_peered":"2024-09-10T08:41:34.916826+0000","last_clean":"2024-09-10T08:41:34.916826+0000","last_became_active":"2024-09-10T08:41:33.614756+0000","last_became_peered":"2024-09-10T08:41:33.614756+0000","last_unstale":"2024-09-10T08:41:34.916826+0000","last_undegraded":"2024-09-10T08:41:34.916826+0000","last_fullsized":"2024-09-10T08:41:34.916826+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:39.268403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916743+0000","last_change":"2024-09-10T08:41:33.623534+0000","last_active":"2024-09-10T08:41:34.916743+0000","last_peered":"2024-09-10T08:41:34.916743+0000","last_clean":"2024-09-10T08:41:34.916743+0000","last_became_active":"2024-09-10T08:41:33.621986+0000","last_became_peered":"2024-09-10T08:41:33.621986+0000","last_unstale":"2024-09-10T08:41:34.916743+0000","last_undegraded":"2024-09-10T08:41:34.916743+0000","last_fullsized":"2024-09-10T08:41:34.916743+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:31.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603321+0000","last_change":"2024-09-10T08:41:33.609956+0000","last_active":"2024-09-10T08:41:34.603321+0000","last_peered":"2024-09-10T08:41:34.603321+0000","last_clean":"2024-09-10T08:41:34.603321+0000","last_became_active":"2024-09-10T08:41:33.609691+0000","last_became_peered":"2024-09-10T08:41:33.609691+0000","last_unstale":"2024-09-10T08:41:34.603321+0000","last_undegraded":"2024-09-10T08:41:34.603321+0000","last_fullsized":"2024-09-10T08:41:34.603321+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:27.168623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.615100+0000","last_change":"2024-09-10T08:41:33.612875+0000","last_active":"2024-09-10T08:41:33.615100+0000","last_peered":"2024-09-10T08:41:33.615100+0000","last_clean":"2024-09-10T08:41:33.615100+0000","last_became_active":"2024-09-10T08:41:33.612621+0000","last_became_peered":"2024-09-10T08:41:33.612621+0000","last_unstale":"2024-09-10T08:41:33.615100+0000","last_undegraded":"2024-09-10T08:41:33.615100+0000","last_fullsized":"2024-09-10T08:41:33.615100+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:51.143243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613892+0000","last_change":"2024-09-10T08:41:33.606217+0000","last_active":"2024-09-10T08:41:33.613892+0000","last_peered":"2024-09-10T08:41:33.613892+0000","last_clean":"2024-09-10T08:41:33.613892+0000","last_became_active":"2024-09-10T08:41:33.605929+0000","last_became_peered":"2024-09-10T08:41:33.605929+0000","last_unstale":"2024-09-10T08:41:33.613892+0000","last_undegraded":"2024-09-10T08:41:33.613892+0000","last_fullsized":"2024-09-10T08:41:33.613892+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:00.259933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.600515+0000","last_change":"2024-09-10T08:41:33.596297+0000","last_active":"2024-09-10T08:41:33.600515+0000","last_peered":"2024-09-10T08:41:33.600515+0000","last_clean":"2024-09-10T08:41:33.600515+0000","last_became_active":"2024-09-10T08:41:33.595997+0000","last_became_peered":"2024-09-10T08:41:33.595997+0000","last_unstale":"2024-09-10T08:41:33.600515+0000","last_undegraded":"2024-09-10T08:41:33.600515+0000","last_fullsized":"2024-09-10T08:41:33.600515+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:25.418669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625396+0000","last_change":"2024-09-10T08:41:33.624354+0000","last_active":"2024-09-10T08:41:33.625396+0000","last_peered":"2024-09-10T08:41:33.625396+0000","last_clean":"2024-09-10T08:41:33.625396+0000","last_became_active":"2024-09-10T08:41:33.623938+0000","last_became_peered":"2024-09-10T08:41:33.623938+0000","last_unstale":"2024-09-10T08:41:33.625396+0000","last_undegraded":"2024-09-10T08:41:33.625396+0000","last_fullsized":"2024-09-10T08:41:33.625396+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:39.562692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605538+0000","last_change":"2024-09-10T08:41:33.602183+0000","last_active":"2024-09-10T08:41:34.605538+0000","last_peered":"2024-09-10T08:41:34.605538+0000","last_clean":"2024-09-10T08:41:34.605538+0000","last_became_active":"2024-09-10T08:41:33.600627+0000","last_became_peered":"2024-09-10T08:41:33.600627+0000","last_unstale":"2024-09-10T08:41:34.605538+0000","last_undegraded":"2024-09-10T08:41:34.605538+0000","last_fullsized":"2024-09-10T08:41:34.605538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:04.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603353+0000","last_change":"2024-09-10T08:41:33.611161+0000","last_active":"2024-09-10T08:41:34.603353+0000","last_peered":"2024-09-10T08:41:34.603353+0000","last_clean":"2024-09-10T08:41:34.603353+0000","last_became_active":"2024-09-10T08:41:33.610858+0000","last_became_peered":"2024-09-10T08:41:33.610858+0000","last_unstale":"2024-09-10T08:41:34.603353+0000","last_undegraded":"2024-09-10T08:41:34.603353+0000","last_fullsized":"2024-09-10T08:41:34.603353+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:27.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605678+0000","last_change":"2024-09-10T08:41:33.604436+0000","last_active":"2024-09-10T08:41:34.605678+0000","last_peered":"2024-09-10T08:41:34.605678+0000","last_clean":"2024-09-10T08:41:34.605678+0000","last_became_active":"2024-09-10T08:41:33.603868+0000","last_became_peered":"2024-09-10T08:41:33.603868+0000","last_unstale":"2024-09-10T08:41:34.605678+0000","last_undegraded":"2024-09-10T08:41:34.605678+0000","last_fullsized":"2024-09-10T08:41:34.605678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:51.143243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613603+0000","last_change":"2024-09-10T08:41:33.607514+0000","last_active":"2024-09-10T08:41:33.613603+0000","last_peered":"2024-09-10T08:41:33.613603+0000","last_clean":"2024-09-10T08:41:33.613603+0000","last_became_active":"2024-09-10T08:41:33.607210+0000","last_became_peered":"2024-09-10T08:41:33.607210+0000","last_unstale":"2024-09-10T08:41:33.613603+0000","last_undegraded":"2024-09-10T08:41:33.613603+0000","last_fullsized":"2024-09-10T08:41:33.613603+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:04.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620260+0000","last_change":"2024-09-10T08:41:33.617077+0000","last_active":"2024-09-10T08:41:33.620260+0000","last_peered":"2024-09-10T08:41:33.620260+0000","last_clean":"2024-09-10T08:41:33.620260+0000","last_became_active":"2024-09-10T08:41:33.616619+0000","last_became_peered":"2024-09-10T08:41:33.616619+0000","last_unstale":"2024-09-10T08:41:33.620260+0000","last_undegraded":"2024-09-10T08:41:33.620260+0000","last_fullsized":"2024-09-10T08:41:33.620260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:24.445065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916548+0000","last_change":"2024-09-10T08:41:33.609338+0000","last_active":"2024-09-10T08:41:34.916548+0000","last_peered":"2024-09-10T08:41:34.916548+0000","last_clean":"2024-09-10T08:41:34.916548+0000","last_became_active":"2024-09-10T08:41:33.609082+0000","last_became_peered":"2024-09-10T08:41:33.609082+0000","last_unstale":"2024-09-10T08:41:34.916548+0000","last_undegraded":"2024-09-10T08:41:34.916548+0000","last_fullsized":"2024-09-10T08:41:34.916548+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:58.472818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611575+0000","last_change":"2024-09-10T08:41:33.609890+0000","last_active":"2024-09-10T08:41:33.611575+0000","last_peered":"2024-09-10T08:41:33.611575+0000","last_clean":"2024-09-10T08:41:33.611575+0000","last_became_active":"2024-09-10T08:41:33.609582+0000","last_became_peered":"2024-09-10T08:41:33.609582+0000","last_unstale":"2024-09-10T08:41:33.611575+0000","last_undegraded":"2024-09-10T08:41:33.611575+0000","last_fullsized":"2024-09-10T08:41:33.611575+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:32.919456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603549+0000","last_change":"2024-09-10T08:41:33.611822+0000","last_active":"2024-09-10T08:41:34.603549+0000","last_peered":"2024-09-10T08:41:34.603549+0000","last_clean":"2024-09-10T08:41:34.603549+0000","last_became_active":"2024-09-10T08:41:33.611578+0000","last_became_peered":"2024-09-10T08:41:33.611578+0000","last_unstale":"2024-09-10T08:41:34.603549+0000","last_undegraded":"2024-09-10T08:41:34.603549+0000","last_fullsized":"2024-09-10T08:41:34.603549+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:13.462912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"182'4","reported_seq":18,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603612+0000","last_change":"2024-09-10T08:41:32.605733+0000","last_active":"2024-09-10T08:41:34.603612+0000","last_peered":"2024-09-10T08:41:34.603612+0000","last_clean":"2024-09-10T08:41:34.603612+0000","last_became_active":"2024-09-10T08:41:32.605395+0000","last_became_peered":"2024-09-10T08:41:32.605395+0000","last_unstale":"2024-09-10T08:41:34.603612+0000","last_undegraded":"2024-09-10T08:41:34.603612+0000","last_fullsized":"2024-09-10T08:41:34.603612+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:22.124432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617395+0000","last_change":"2024-09-10T08:41:33.610882+0000","last_active":"2024-09-10T08:41:33.617395+0000","last_peered":"2024-09-10T08:41:33.617395+0000","last_clean":"2024-09-10T08:41:33.617395+0000","last_became_active":"2024-09-10T08:41:33.610615+0000","last_became_peered":"2024-09-10T08:41:33.610615+0000","last_unstale":"2024-09-10T08:41:33.617395+0000","last_undegraded":"2024-09-10T08:41:33.617395+0000","last_fullsized":"2024-09-10T08:41:33.617395+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:03.423339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.618015+0000","last_change":"2024-09-10T08:41:32.606768+0000","last_active":"2024-09-10T08:41:33.618015+0000","last_peered":"2024-09-10T08:41:33.618015+0000","last_clean":"2024-09-10T08:41:33.618015+0000","last_became_active":"2024-09-10T08:41:32.606505+0000","last_became_peered":"2024-09-10T08:41:32.606505+0000","last_unstale":"2024-09-10T08:41:33.618015+0000","last_undegraded":"2024-09-10T08:41:33.618015+0000","last_fullsized":"2024-09-10T08:41:33.618015+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:40.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916915+0000","last_change":"2024-09-10T08:41:33.616713+0000","last_active":"2024-09-10T08:41:34.916915+0000","last_peered":"2024-09-10T08:41:34.916915+0000","last_clean":"2024-09-10T08:41:34.916915+0000","last_became_active":"2024-09-10T08:41:33.616401+0000","last_became_peered":"2024-09-10T08:41:33.616401+0000","last_unstale":"2024-09-10T08:41:34.916915+0000","last_undegraded":"2024-09-10T08:41:34.916915+0000","last_fullsized":"2024-09-10T08:41:34.916915+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:32.273696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605143+0000","last_change":"2024-09-10T08:41:32.601583+0000","last_active":"2024-09-10T08:41:34.605143+0000","last_peered":"2024-09-10T08:41:34.605143+0000","last_clean":"2024-09-10T08:41:34.605143+0000","last_became_active":"2024-09-10T08:41:32.599057+0000","last_became_peered":"2024-09-10T08:41:32.599057+0000","last_unstale":"2024-09-10T08:41:34.605143+0000","last_undegraded":"2024-09-10T08:41:34.605143+0000","last_fullsized":"2024-09-10T08:41:34.605143+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:47.542958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917164+0000","last_change":"2024-09-10T08:41:33.621301+0000","last_active":"2024-09-10T08:41:34.917164+0000","last_peered":"2024-09-10T08:41:34.917164+0000","last_clean":"2024-09-10T08:41:34.917164+0000","last_became_active":"2024-09-10T08:41:33.618601+0000","last_became_peered":"2024-09-10T08:41:33.618601+0000","last_unstale":"2024-09-10T08:41:34.917164+0000","last_undegraded":"2024-09-10T08:41:34.917164+0000","last_fullsized":"2024-09-10T08:41:34.917164+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:28.729354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622344+0000","last_change":"2024-09-10T08:41:32.609128+0000","last_active":"2024-09-10T08:41:33.622344+0000","last_peered":"2024-09-10T08:41:33.622344+0000","last_clean":"2024-09-10T08:41:33.622344+0000","last_became_active":"2024-09-10T08:41:32.608829+0000","last_became_peered":"2024-09-10T08:41:32.608829+0000","last_unstale":"2024-09-10T08:41:33.622344+0000","last_undegraded":"2024-09-10T08:41:33.622344+0000","last_fullsized":"2024-09-10T08:41:33.622344+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:16.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617925+0000","last_change":"2024-09-10T08:41:33.612116+0000","last_active":"2024-09-10T08:41:33.617925+0000","last_peered":"2024-09-10T08:41:33.617925+0000","last_clean":"2024-09-10T08:41:33.617925+0000","last_became_active":"2024-09-10T08:41:33.611812+0000","last_became_peered":"2024-09-10T08:41:33.611812+0000","last_unstale":"2024-09-10T08:41:33.617925+0000","last_undegraded":"2024-09-10T08:41:33.617925+0000","last_fullsized":"2024-09-10T08:41:33.617925+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:26.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625809+0000","last_change":"2024-09-10T08:41:32.607859+0000","last_active":"2024-09-10T08:41:33.625809+0000","last_peered":"2024-09-10T08:41:33.625809+0000","last_clean":"2024-09-10T08:41:33.625809+0000","last_became_active":"2024-09-10T08:41:32.607579+0000","last_became_peered":"2024-09-10T08:41:32.607579+0000","last_unstale":"2024-09-10T08:41:33.625809+0000","last_undegraded":"2024-09-10T08:41:33.625809+0000","last_fullsized":"2024-09-10T08:41:33.625809+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.508027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.607844+0000","last_change":"2024-09-10T08:41:33.606604+0000","last_active":"2024-09-10T08:41:33.607844+0000","last_peered":"2024-09-10T08:41:33.607844+0000","last_clean":"2024-09-10T08:41:33.607844+0000","last_became_active":"2024-09-10T08:41:33.603345+0000","last_became_peered":"2024-09-10T08:41:33.603345+0000","last_unstale":"2024-09-10T08:41:33.607844+0000","last_undegraded":"2024-09-10T08:41:33.607844+0000","last_fullsized":"2024-09-10T08:41:33.607844+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:53.612443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604513+0000","last_change":"2024-09-10T08:41:32.604623+0000","last_active":"2024-09-10T08:41:34.604513+0000","last_peered":"2024-09-10T08:41:34.604513+0000","last_clean":"2024-09-10T08:41:34.604513+0000","last_became_active":"2024-09-10T08:41:32.604340+0000","last_became_peered":"2024-09-10T08:41:32.604340+0000","last_unstale":"2024-09-10T08:41:34.604513+0000","last_undegraded":"2024-09-10T08:41:34.604513+0000","last_fullsized":"2024-09-10T08:41:34.604513+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.349554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.601164+0000","last_change":"2024-09-10T08:41:33.600595+0000","last_active":"2024-09-10T08:41:33.601164+0000","last_peered":"2024-09-10T08:41:33.601164+0000","last_clean":"2024-09-10T08:41:33.601164+0000","last_became_active":"2024-09-10T08:41:33.600250+0000","last_became_peered":"2024-09-10T08:41:33.600250+0000","last_unstale":"2024-09-10T08:41:33.601164+0000","last_undegraded":"2024-09-10T08:41:33.601164+0000","last_fullsized":"2024-09-10T08:41:33.601164+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:36.959601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598828+0000","last_change":"2024-09-10T08:41:32.610689+0000","last_active":"2024-09-10T08:41:33.598828+0000","last_peered":"2024-09-10T08:41:33.598828+0000","last_clean":"2024-09-10T08:41:33.598828+0000","last_became_active":"2024-09-10T08:41:32.610123+0000","last_became_peered":"2024-09-10T08:41:32.610123+0000","last_unstale":"2024-09-10T08:41:33.598828+0000","last_undegraded":"2024-09-10T08:41:33.598828+0000","last_fullsized":"2024-09-10T08:41:33.598828+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:37.673951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.624608+0000","last_change":"2024-09-10T08:41:33.623560+0000","last_active":"2024-09-10T08:41:33.624608+0000","last_peered":"2024-09-10T08:41:33.624608+0000","last_clean":"2024-09-10T08:41:33.624608+0000","last_became_active":"2024-09-10T08:41:33.623299+0000","last_became_peered":"2024-09-10T08:41:33.623299+0000","last_unstale":"2024-09-10T08:41:33.624608+0000","last_undegraded":"2024-09-10T08:41:33.624608+0000","last_fullsized":"2024-09-10T08:41:33.624608+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:36.615100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917161+0000","last_change":"2024-09-10T08:41:32.613051+0000","last_active":"2024-09-10T08:41:34.917161+0000","last_peered":"2024-09-10T08:41:34.917161+0000","last_clean":"2024-09-10T08:41:34.917161+0000","last_became_active":"2024-09-10T08:41:32.612734+0000","last_became_peered":"2024-09-10T08:41:32.612734+0000","last_unstale":"2024-09-10T08:41:34.917161+0000","last_undegraded":"2024-09-10T08:41:34.917161+0000","last_fullsized":"2024-09-10T08:41:34.917161+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611089+0000","last_change":"2024-09-10T08:41:33.607973+0000","last_active":"2024-09-10T08:41:33.611089+0000","last_peered":"2024-09-10T08:41:33.611089+0000","last_clean":"2024-09-10T08:41:33.611089+0000","last_became_active":"2024-09-10T08:41:33.605593+0000","last_became_peered":"2024-09-10T08:41:33.605593+0000","last_unstale":"2024-09-10T08:41:33.611089+0000","last_undegraded":"2024-09-10T08:41:33.611089+0000","last_fullsized":"2024-09-10T08:41:33.611089+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:38.595839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.609028+0000","last_change":"2024-09-10T08:41:32.611450+0000","last_active":"2024-09-10T08:41:33.609028+0000","last_peered":"2024-09-10T08:41:33.609028+0000","last_clean":"2024-09-10T08:41:33.609028+0000","last_became_active":"2024-09-10T08:41:32.611206+0000","last_became_peered":"2024-09-10T08:41:32.611206+0000","last_unstale":"2024-09-10T08:41:33.609028+0000","last_undegraded":"2024-09-10T08:41:33.609028+0000","last_fullsized":"2024-09-10T08:41:33.609028+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:20.915097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.597312+0000","last_change":"2024-09-10T08:41:33.593090+0000","last_active":"2024-09-10T08:41:33.597312+0000","last_peered":"2024-09-10T08:41:33.597312+0000","last_clean":"2024-09-10T08:41:33.597312+0000","last_became_active":"2024-09-10T08:41:33.592755+0000","last_became_peered":"2024-09-10T08:41:33.592755+0000","last_unstale":"2024-09-10T08:41:33.597312+0000","last_undegraded":"2024-09-10T08:41:33.597312+0000","last_fullsized":"2024-09-10T08:41:33.597312+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:32.919456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"182'3","reported_seq":17,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605252+0000","last_change":"2024-09-10T08:41:32.601616+0000","last_active":"2024-09-10T08:41:34.605252+0000","last_peered":"2024-09-10T08:41:34.605252+0000","last_clean":"2024-09-10T08:41:34.605252+0000","last_became_active":"2024-09-10T08:41:32.601342+0000","last_became_peered":"2024-09-10T08:41:32.601342+0000","last_unstale":"2024-09-10T08:41:34.605252+0000","last_undegraded":"2024-09-10T08:41:34.605252+0000","last_fullsized":"2024-09-10T08:41:34.605252+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:58.349424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604944+0000","last_change":"2024-09-10T08:41:33.603450+0000","last_active":"2024-09-10T08:41:34.604944+0000","last_peered":"2024-09-10T08:41:34.604944+0000","last_clean":"2024-09-10T08:41:34.604944+0000","last_became_active":"2024-09-10T08:41:33.603074+0000","last_became_peered":"2024-09-10T08:41:33.603074+0000","last_unstale":"2024-09-10T08:41:34.604944+0000","last_undegraded":"2024-09-10T08:41:34.604944+0000","last_fullsized":"2024-09-10T08:41:34.604944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:16.344217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"182'6","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625890+0000","last_change":"2024-09-10T08:41:32.603096+0000","last_active":"2024-09-10T08:41:33.625890+0000","last_peered":"2024-09-10T08:41:33.625890+0000","last_clean":"2024-09-10T08:41:33.625890+0000","last_became_active":"2024-09-10T08:41:32.602815+0000","last_became_peered":"2024-09-10T08:41:32.602815+0000","last_unstale":"2024-09-10T08:41:33.625890+0000","last_undegraded":"2024-09-10T08:41:33.625890+0000","last_fullsized":"2024-09-10T08:41:33.625890+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:29.488051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.621966+0000","last_change":"2024-09-10T08:41:33.617000+0000","last_active":"2024-09-10T08:41:33.621966+0000","last_peered":"2024-09-10T08:41:33.621966+0000","last_clean":"2024-09-10T08:41:33.621966+0000","last_became_active":"2024-09-10T08:41:33.616724+0000","last_became_peered":"2024-09-10T08:41:33.616724+0000","last_unstale":"2024-09-10T08:41:33.621966+0000","last_undegraded":"2024-09-10T08:41:33.621966+0000","last_fullsized":"2024-09-10T08:41:33.621966+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:22.361004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625860+0000","last_change":"2024-09-10T08:41:32.597691+0000","last_active":"2024-09-10T08:41:33.625860+0000","last_peered":"2024-09-10T08:41:33.625860+0000","last_clean":"2024-09-10T08:41:33.625860+0000","last_became_active":"2024-09-10T08:41:32.595879+0000","last_became_peered":"2024-09-10T08:41:32.595879+0000","last_unstale":"2024-09-10T08:41:33.625860+0000","last_undegraded":"2024-09-10T08:41:33.625860+0000","last_fullsized":"2024-09-10T08:41:33.625860+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917170+0000","last_change":"2024-09-10T08:41:33.620466+0000","last_active":"2024-09-10T08:41:34.917170+0000","last_peered":"2024-09-10T08:41:34.917170+0000","last_clean":"2024-09-10T08:41:34.917170+0000","last_became_active":"2024-09-10T08:41:33.618858+0000","last_became_peered":"2024-09-10T08:41:33.618858+0000","last_unstale":"2024-09-10T08:41:34.917170+0000","last_undegraded":"2024-09-10T08:41:34.917170+0000","last_fullsized":"2024-09-10T08:41:34.917170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.524898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.589725+0000","last_change":"2024-09-10T08:41:32.605104+0000","last_active":"2024-09-10T08:41:33.589725+0000","last_peered":"2024-09-10T08:41:33.589725+0000","last_clean":"2024-09-10T08:41:33.589725+0000","last_became_active":"2024-09-10T08:41:32.604429+0000","last_became_peered":"2024-09-10T08:41:32.604429+0000","last_unstale":"2024-09-10T08:41:33.589725+0000","last_undegraded":"2024-09-10T08:41:33.589725+0000","last_fullsized":"2024-09-10T08:41:33.589725+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:12.202383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916550+0000","last_change":"2024-09-10T08:41:33.610207+0000","last_active":"2024-09-10T08:41:34.916550+0000","last_peered":"2024-09-10T08:41:34.916550+0000","last_clean":"2024-09-10T08:41:34.916550+0000","last_became_active":"2024-09-10T08:41:33.607441+0000","last_became_peered":"2024-09-10T08:41:33.607441+0000","last_unstale":"2024-09-10T08:41:34.916550+0000","last_undegraded":"2024-09-10T08:41:34.916550+0000","last_fullsized":"2024-09-10T08:41:34.916550+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:43.848714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604616+0000","last_change":"2024-09-10T08:41:32.598318+0000","last_active":"2024-09-10T08:41:34.604616+0000","last_peered":"2024-09-10T08:41:34.604616+0000","last_clean":"2024-09-10T08:41:34.604616+0000","last_became_active":"2024-09-10T08:41:32.598035+0000","last_became_peered":"2024-09-10T08:41:32.598035+0000","last_unstale":"2024-09-10T08:41:34.604616+0000","last_undegraded":"2024-09-10T08:41:34.604616+0000","last_fullsized":"2024-09-10T08:41:34.604616+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:27.726510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611829+0000","last_change":"2024-09-10T08:41:33.605605+0000","last_active":"2024-09-10T08:41:33.611829+0000","last_peered":"2024-09-10T08:41:33.611829+0000","last_clean":"2024-09-10T08:41:33.611829+0000","last_became_active":"2024-09-10T08:41:33.601619+0000","last_became_peered":"2024-09-10T08:41:33.601619+0000","last_unstale":"2024-09-10T08:41:33.611829+0000","last_undegraded":"2024-09-10T08:41:33.611829+0000","last_fullsized":"2024-09-10T08:41:33.611829+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:13.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"182'8","reported_seq":22,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604446+0000","last_change":"2024-09-10T08:41:32.604892+0000","last_active":"2024-09-10T08:41:34.604446+0000","last_peered":"2024-09-10T08:41:34.604446+0000","last_clean":"2024-09-10T08:41:34.604446+0000","last_became_active":"2024-09-10T08:41:32.604628+0000","last_became_peered":"2024-09-10T08:41:32.604628+0000","last_unstale":"2024-09-10T08:41:34.604446+0000","last_undegraded":"2024-09-10T08:41:34.604446+0000","last_fullsized":"2024-09-10T08:41:34.604446+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:58.004923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603596+0000","last_change":"2024-09-10T08:41:33.612123+0000","last_active":"2024-09-10T08:41:34.603596+0000","last_peered":"2024-09-10T08:41:34.603596+0000","last_clean":"2024-09-10T08:41:34.603596+0000","last_became_active":"2024-09-10T08:41:33.611248+0000","last_became_peered":"2024-09-10T08:41:33.611248+0000","last_unstale":"2024-09-10T08:41:34.603596+0000","last_undegraded":"2024-09-10T08:41:34.603596+0000","last_fullsized":"2024-09-10T08:41:34.603596+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:39.561131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.627237+0000","last_change":"2024-09-10T08:41:32.606236+0000","last_active":"2024-09-10T08:41:33.627237+0000","last_peered":"2024-09-10T08:41:33.627237+0000","last_clean":"2024-09-10T08:41:33.627237+0000","last_became_active":"2024-09-10T08:41:32.605963+0000","last_became_peered":"2024-09-10T08:41:32.605963+0000","last_unstale":"2024-09-10T08:41:33.627237+0000","last_undegraded":"2024-09-10T08:41:33.627237+0000","last_fullsized":"2024-09-10T08:41:33.627237+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:47.959613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620288+0000","last_change":"2024-09-10T08:41:33.617236+0000","last_active":"2024-09-10T08:41:33.620288+0000","last_peered":"2024-09-10T08:41:33.620288+0000","last_clean":"2024-09-10T08:41:33.620288+0000","last_became_active":"2024-09-10T08:41:33.615357+0000","last_became_peered":"2024-09-10T08:41:33.615357+0000","last_unstale":"2024-09-10T08:41:33.620288+0000","last_undegraded":"2024-09-10T08:41:33.620288+0000","last_fullsized":"2024-09-10T08:41:33.620288+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:19.397785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622686+0000","last_change":"2024-09-10T08:41:32.595086+0000","last_active":"2024-09-10T08:41:33.622686+0000","last_peered":"2024-09-10T08:41:33.622686+0000","last_clean":"2024-09-10T08:41:33.622686+0000","last_became_active":"2024-09-10T08:41:32.593195+0000","last_became_peered":"2024-09-10T08:41:32.593195+0000","last_unstale":"2024-09-10T08:41:33.622686+0000","last_undegraded":"2024-09-10T08:41:33.622686+0000","last_fullsized":"2024-09-10T08:41:33.622686+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:37.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917068+0000","last_change":"2024-09-10T08:41:33.620455+0000","last_active":"2024-09-10T08:41:34.917068+0000","last_peered":"2024-09-10T08:41:34.917068+0000","last_clean":"2024-09-10T08:41:34.917068+0000","last_became_active":"2024-09-10T08:41:33.620069+0000","last_became_peered":"2024-09-10T08:41:33.620069+0000","last_unstale":"2024-09-10T08:41:34.917068+0000","last_undegraded":"2024-09-10T08:41:34.917068+0000","last_fullsized":"2024-09-10T08:41:34.917068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:20.156359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606425+0000","last_change":"2024-09-10T08:41:32.602663+0000","last_active":"2024-09-10T08:41:33.606425+0000","last_peered":"2024-09-10T08:41:33.606425+0000","last_clean":"2024-09-10T08:41:33.606425+0000","last_became_active":"2024-09-10T08:41:32.602403+0000","last_became_peered":"2024-09-10T08:41:32.602403+0000","last_unstale":"2024-09-10T08:41:33.606425+0000","last_undegraded":"2024-09-10T08:41:33.606425+0000","last_fullsized":"2024-09-10T08:41:33.606425+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:06.744592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.621299+0000","last_change":"2024-09-10T08:41:33.619273+0000","last_active":"2024-09-10T08:41:33.621299+0000","last_peered":"2024-09-10T08:41:33.621299+0000","last_clean":"2024-09-10T08:41:33.621299+0000","last_became_active":"2024-09-10T08:41:33.617631+0000","last_became_peered":"2024-09-10T08:41:33.617631+0000","last_unstale":"2024-09-10T08:41:33.621299+0000","last_undegraded":"2024-09-10T08:41:33.621299+0000","last_fullsized":"2024-09-10T08:41:33.621299+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:29.518077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598891+0000","last_change":"2024-09-10T08:41:32.591515+0000","last_active":"2024-09-10T08:41:33.598891+0000","last_peered":"2024-09-10T08:41:33.598891+0000","last_clean":"2024-09-10T08:41:33.598891+0000","last_became_active":"2024-09-10T08:41:32.591212+0000","last_became_peered":"2024-09-10T08:41:32.591212+0000","last_unstale":"2024-09-10T08:41:33.598891+0000","last_undegraded":"2024-09-10T08:41:33.598891+0000","last_fullsized":"2024-09-10T08:41:33.598891+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:52.677734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916735+0000","last_change":"2024-09-10T08:41:33.615251+0000","last_active":"2024-09-10T08:41:34.916735+0000","last_peered":"2024-09-10T08:41:34.916735+0000","last_clean":"2024-09-10T08:41:34.916735+0000","last_became_active":"2024-09-10T08:41:33.613368+0000","last_became_peered":"2024-09-10T08:41:33.613368+0000","last_unstale":"2024-09-10T08:41:34.916735+0000","last_undegraded":"2024-09-10T08:41:34.916735+0000","last_fullsized":"2024-09-10T08:41:34.916735+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:44.581617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.607722+0000","last_change":"2024-09-10T08:41:32.597817+0000","last_active":"2024-09-10T08:41:33.607722+0000","last_peered":"2024-09-10T08:41:33.607722+0000","last_clean":"2024-09-10T08:41:33.607722+0000","last_became_active":"2024-09-10T08:41:32.597508+0000","last_became_peered":"2024-09-10T08:41:32.597508+0000","last_unstale":"2024-09-10T08:41:33.607722+0000","last_undegraded":"2024-09-10T08:41:33.607722+0000","last_fullsized":"2024-09-10T08:41:33.607722+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625047+0000","last_change":"2024-09-10T08:41:33.623942+0000","last_active":"2024-09-10T08:41:33.625047+0000","last_peered":"2024-09-10T08:41:33.625047+0000","last_clean":"2024-09-10T08:41:33.625047+0000","last_became_active":"2024-09-10T08:41:33.623399+0000","last_became_peered":"2024-09-10T08:41:33.623399+0000","last_unstale":"2024-09-10T08:41:33.625047+0000","last_undegraded":"2024-09-10T08:41:33.625047+0000","last_fullsized":"2024-09-10T08:41:33.625047+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:12.480917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604688+0000","last_change":"2024-09-10T08:41:32.594615+0000","last_active":"2024-09-10T08:41:34.604688+0000","last_peered":"2024-09-10T08:41:34.604688+0000","last_clean":"2024-09-10T08:41:34.604688+0000","last_became_active":"2024-09-10T08:41:32.594261+0000","last_became_peered":"2024-09-10T08:41:32.594261+0000","last_unstale":"2024-09-10T08:41:34.604688+0000","last_undegraded":"2024-09-10T08:41:34.604688+0000","last_fullsized":"2024-09-10T08:41:34.604688+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:51.935165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.604930+0000","last_change":"2024-09-10T08:41:33.601715+0000","last_active":"2024-09-10T08:41:33.604930+0000","last_peered":"2024-09-10T08:41:33.604930+0000","last_clean":"2024-09-10T08:41:33.604930+0000","last_became_active":"2024-09-10T08:41:33.599534+0000","last_became_peered":"2024-09-10T08:41:33.599534+0000","last_unstale":"2024-09-10T08:41:33.604930+0000","last_undegraded":"2024-09-10T08:41:33.604930+0000","last_fullsized":"2024-09-10T08:41:33.604930+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:41.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916564+0000","last_change":"2024-09-10T08:41:32.608050+0000","last_active":"2024-09-10T08:41:34.916564+0000","last_peered":"2024-09-10T08:41:34.916564+0000","last_clean":"2024-09-10T08:41:34.916564+0000","last_became_active":"2024-09-10T08:41:32.607771+0000","last_became_peered":"2024-09-10T08:41:32.607771+0000","last_unstale":"2024-09-10T08:41:34.916564+0000","last_undegraded":"2024-09-10T08:41:34.916564+0000","last_fullsized":"2024-09-10T08:41:34.916564+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:40.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.612411+0000","last_change":"2024-09-10T08:41:33.603423+0000","last_active":"2024-09-10T08:41:33.612411+0000","last_peered":"2024-09-10T08:41:33.612411+0000","last_clean":"2024-09-10T08:41:33.612411+0000","last_became_active":"2024-09-10T08:41:33.602895+0000","last_became_peered":"2024-09-10T08:41:33.602895+0000","last_unstale":"2024-09-10T08:41:33.612411+0000","last_undegraded":"2024-09-10T08:41:33.612411+0000","last_fullsized":"2024-09-10T08:41:33.612411+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:11.095862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604545+0000","last_change":"2024-09-10T08:41:32.602752+0000","last_active":"2024-09-10T08:41:34.604545+0000","last_peered":"2024-09-10T08:41:34.604545+0000","last_clean":"2024-09-10T08:41:34.604545+0000","last_became_active":"2024-09-10T08:41:32.600578+0000","last_became_peered":"2024-09-10T08:41:32.600578+0000","last_unstale":"2024-09-10T08:41:34.604545+0000","last_undegraded":"2024-09-10T08:41:34.604545+0000","last_fullsized":"2024-09-10T08:41:34.604545+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:25.642470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603678+0000","last_change":"2024-09-10T08:41:33.621320+0000","last_active":"2024-09-10T08:41:34.603678+0000","last_peered":"2024-09-10T08:41:34.603678+0000","last_clean":"2024-09-10T08:41:34.603678+0000","last_became_active":"2024-09-10T08:41:33.621013+0000","last_became_peered":"2024-09-10T08:41:33.621013+0000","last_unstale":"2024-09-10T08:41:34.603678+0000","last_undegraded":"2024-09-10T08:41:34.603678+0000","last_fullsized":"2024-09-10T08:41:34.603678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:53.239248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.606079+0000","last_change":"2024-09-10T08:41:32.604013+0000","last_active":"2024-09-10T08:41:34.606079+0000","last_peered":"2024-09-10T08:41:34.606079+0000","last_clean":"2024-09-10T08:41:34.606079+0000","last_became_active":"2024-09-10T08:41:32.602983+0000","last_became_peered":"2024-09-10T08:41:32.602983+0000","last_unstale":"2024-09-10T08:41:34.606079+0000","last_undegraded":"2024-09-10T08:41:34.606079+0000","last_fullsized":"2024-09-10T08:41:34.606079+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:41.522054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619751+0000","last_change":"2024-09-10T08:41:33.618420+0000","last_active":"2024-09-10T08:41:33.619751+0000","last_peered":"2024-09-10T08:41:33.619751+0000","last_clean":"2024-09-10T08:41:33.619751+0000","last_became_active":"2024-09-10T08:41:33.615696+0000","last_became_peered":"2024-09-10T08:41:33.615696+0000","last_unstale":"2024-09-10T08:41:33.619751+0000","last_undegraded":"2024-09-10T08:41:33.619751+0000","last_fullsized":"2024-09-10T08:41:33.619751+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:23.214975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.589509+0000","last_change":"2024-09-10T08:41:32.603023+0000","last_active":"2024-09-10T08:41:33.589509+0000","last_peered":"2024-09-10T08:41:33.589509+0000","last_clean":"2024-09-10T08:41:33.589509+0000","last_became_active":"2024-09-10T08:41:32.602707+0000","last_became_peered":"2024-09-10T08:41:32.602707+0000","last_unstale":"2024-09-10T08:41:33.589509+0000","last_undegraded":"2024-09-10T08:41:33.589509+0000","last_fullsized":"2024-09-10T08:41:33.589509+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:02.734090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.608547+0000","last_change":"2024-09-10T08:41:33.606762+0000","last_active":"2024-09-10T08:41:33.608547+0000","last_peered":"2024-09-10T08:41:33.608547+0000","last_clean":"2024-09-10T08:41:33.608547+0000","last_became_active":"2024-09-10T08:41:33.604977+0000","last_became_peered":"2024-09-10T08:41:33.604977+0000","last_unstale":"2024-09-10T08:41:33.608547+0000","last_undegraded":"2024-09-10T08:41:33.608547+0000","last_fullsized":"2024-09-10T08:41:33.608547+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:35.220839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598342+0000","last_change":"2024-09-10T08:41:32.598971+0000","last_active":"2024-09-10T08:41:33.598342+0000","last_peered":"2024-09-10T08:41:33.598342+0000","last_clean":"2024-09-10T08:41:33.598342+0000","last_became_active":"2024-09-10T08:41:32.597696+0000","last_became_peered":"2024-09-10T08:41:32.597696+0000","last_unstale":"2024-09-10T08:41:33.598342+0000","last_undegraded":"2024-09-10T08:41:33.598342+0000","last_fullsized":"2024-09-10T08:41:33.598342+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.061327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603505+0000","last_change":"2024-09-10T08:41:33.611758+0000","last_active":"2024-09-10T08:41:34.603505+0000","last_peered":"2024-09-10T08:41:34.603505+0000","last_clean":"2024-09-10T08:41:34.603505+0000","last_became_active":"2024-09-10T08:41:33.611481+0000","last_became_peered":"2024-09-10T08:41:33.611481+0000","last_unstale":"2024-09-10T08:41:34.603505+0000","last_undegraded":"2024-09-10T08:41:34.603505+0000","last_fullsized":"2024-09-10T08:41:34.603505+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:24.819169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.599054+0000","last_change":"2024-09-10T08:41:32.610842+0000","last_active":"2024-09-10T08:41:33.599054+0000","last_peered":"2024-09-10T08:41:33.599054+0000","last_clean":"2024-09-10T08:41:33.599054+0000","last_became_active":"2024-09-10T08:41:32.610534+0000","last_became_peered":"2024-09-10T08:41:32.610534+0000","last_unstale":"2024-09-10T08:41:33.599054+0000","last_undegraded":"2024-09-10T08:41:33.599054+0000","last_fullsized":"2024-09-10T08:41:33.599054+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:50.852085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.626072+0000","last_change":"2024-09-10T08:41:33.624636+0000","last_active":"2024-09-10T08:41:33.626072+0000","last_peered":"2024-09-10T08:41:33.626072+0000","last_clean":"2024-09-10T08:41:33.626072+0000","last_became_active":"2024-09-10T08:41:33.623127+0000","last_became_peered":"2024-09-10T08:41:33.623127+0000","last_unstale":"2024-09-10T08:41:33.626072+0000","last_undegraded":"2024-09-10T08:41:33.626072+0000","last_fullsized":"2024-09-10T08:41:33.626072+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:02.992586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606243+0000","last_change":"2024-09-10T08:41:32.605407+0000","last_active":"2024-09-10T08:41:33.606243+0000","last_peered":"2024-09-10T08:41:33.606243+0000","last_clean":"2024-09-10T08:41:33.606243+0000","last_became_active":"2024-09-10T08:41:32.604962+0000","last_became_peered":"2024-09-10T08:41:32.604962+0000","last_unstale":"2024-09-10T08:41:33.606243+0000","last_undegraded":"2024-09-10T08:41:33.606243+0000","last_fullsized":"2024-09-10T08:41:33.606243+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:59.992191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613581+0000","last_change":"2024-09-10T08:41:33.607408+0000","last_active":"2024-09-10T08:41:33.613581+0000","last_peered":"2024-09-10T08:41:33.613581+0000","last_clean":"2024-09-10T08:41:33.613581+0000","last_became_active":"2024-09-10T08:41:33.607133+0000","last_became_peered":"2024-09-10T08:41:33.607133+0000","last_unstale":"2024-09-10T08:41:33.613581+0000","last_undegraded":"2024-09-10T08:41:33.613581+0000","last_fullsized":"2024-09-10T08:41:33.613581+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:16.344217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917009+0000","last_change":"2024-09-10T08:41:32.609032+0000","last_active":"2024-09-10T08:41:34.917009+0000","last_peered":"2024-09-10T08:41:34.917009+0000","last_clean":"2024-09-10T08:41:34.917009+0000","last_became_active":"2024-09-10T08:41:32.608800+0000","last_became_peered":"2024-09-10T08:41:32.608800+0000","last_unstale":"2024-09-10T08:41:34.917009+0000","last_undegraded":"2024-09-10T08:41:34.917009+0000","last_fullsized":"2024-09-10T08:41:34.917009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:06.744592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604334+0000","last_change":"2024-09-10T08:41:33.603487+0000","last_active":"2024-09-10T08:41:34.604334+0000","last_peered":"2024-09-10T08:41:34.604334+0000","last_clean":"2024-09-10T08:41:34.604334+0000","last_became_active":"2024-09-10T08:41:33.599583+0000","last_became_peered":"2024-09-10T08:41:33.599583+0000","last_unstale":"2024-09-10T08:41:34.604334+0000","last_undegraded":"2024-09-10T08:41:34.604334+0000","last_fullsized":"2024-09-10T08:41:34.604334+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:37.370470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603275+0000","last_change":"2024-09-10T08:41:32.603567+0000","last_active":"2024-09-10T08:41:34.603275+0000","last_peered":"2024-09-10T08:41:34.603275+0000","last_clean":"2024-09-10T08:41:34.603275+0000","last_became_active":"2024-09-10T08:41:32.603279+0000","last_became_peered":"2024-09-10T08:41:32.603279+0000","last_unstale":"2024-09-10T08:41:34.603275+0000","last_undegraded":"2024-09-10T08:41:34.603275+0000","last_fullsized":"2024-09-10T08:41:34.603275+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:25.478865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.612388+0000","last_change":"2024-09-10T08:41:33.603198+0000","last_active":"2024-09-10T08:41:33.612388+0000","last_peered":"2024-09-10T08:41:33.612388+0000","last_clean":"2024-09-10T08:41:33.612388+0000","last_became_active":"2024-09-10T08:41:33.602465+0000","last_became_peered":"2024-09-10T08:41:33.602465+0000","last_unstale":"2024-09-10T08:41:33.612388+0000","last_undegraded":"2024-09-10T08:41:33.612388+0000","last_fullsized":"2024-09-10T08:41:33.612388+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:18.776125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.602239+0000","last_change":"2024-09-10T08:41:32.610706+0000","last_active":"2024-09-10T08:41:33.602239+0000","last_peered":"2024-09-10T08:41:33.602239+0000","last_clean":"2024-09-10T08:41:33.602239+0000","last_became_active":"2024-09-10T08:41:32.610407+0000","last_became_peered":"2024-09-10T08:41:32.610407+0000","last_unstale":"2024-09-10T08:41:33.602239+0000","last_undegraded":"2024-09-10T08:41:33.602239+0000","last_fullsized":"2024-09-10T08:41:33.602239+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:11.985161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916620+0000","last_change":"2024-09-10T08:41:33.627602+0000","last_active":"2024-09-10T08:41:34.916620+0000","last_peered":"2024-09-10T08:41:34.916620+0000","last_clean":"2024-09-10T08:41:34.916620+0000","last_became_active":"2024-09-10T08:41:33.627312+0000","last_became_peered":"2024-09-10T08:41:33.627312+0000","last_unstale":"2024-09-10T08:41:34.916620+0000","last_undegraded":"2024-09-10T08:41:34.916620+0000","last_fullsized":"2024-09-10T08:41:34.916620+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:45.435795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.618290+0000","last_change":"2024-09-10T08:41:32.603225+0000","last_active":"2024-09-10T08:41:33.618290+0000","last_peered":"2024-09-10T08:41:33.618290+0000","last_clean":"2024-09-10T08:41:33.618290+0000","last_became_active":"2024-09-10T08:41:32.602916+0000","last_became_peered":"2024-09-10T08:41:32.602916+0000","last_unstale":"2024-09-10T08:41:33.618290+0000","last_undegraded":"2024-09-10T08:41:33.618290+0000","last_fullsized":"2024-09-10T08:41:33.618290+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:47.503039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":463,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.601432+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:41:33.601432+0000","last_peered":"2024-09-10T08:41:33.601432+0000","last_clean":"2024-09-10T08:41:33.601432+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:41:33.601432+0000","last_undegraded":"2024-09-10T08:41:33.601432+0000","last_fullsized":"2024-09-10T08:41:33.601432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51468,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320372,"statfs":{"total":96636764160,"available":96584060928,"internally_reserved":0,"allocated":2289664,"data_stored":1005250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2289664,"data_stored":1005298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2289664,"data_stored":1005318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69468,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302372,"statfs":{"total":96636764160,"available":96565628928,"internally_reserved":0,"allocated":2297856,"data_stored":1006840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509600,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2306048,"data_stored":1006944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60372,"kb_used_data":2812,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311468,"statfs":{"total":96636764160,"available":96574943232,"internally_reserved":0,"allocated":2879488,"data_stored":1595596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2289664,"data_stored":1005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60384,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311456,"statfs":{"total":96636764160,"available":96574930944,"internally_reserved":0,"allocated":2895872,"data_stored":1596324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:41:37.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:41:38.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.006+0000 7fa7da600640 1 Processor -- start 2024-09-10T08:41:38.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.006+0000 7fa7da600640 1 -- start start 2024-09-10T08:41:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.007+0000 7fa7da600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa7d4073890 0x7fa7d40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.007+0000 7fa7da600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7d40b5880 0x7fa7d40b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.007+0000 7fa7da600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d40b4020 con 0x7fa7d4145ed0 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.007+0000 7fa7da600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40b42c0 con 0x7fa7d40b5880 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.007+0000 7fa7da600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40b45a0 con 0x7fa7d4073890 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7d40b5880 0x7fa7d40b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa7d40b5880 0x7fa7d40b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34154/0 (socket says 172.21.15.52:34154) 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 -- 172.21.15.52:0/2140406626 learned_addr learned my addr 172.21.15.52:0/2140406626 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d2a00640 1 --2- 172.21.15.52:0/2140406626 >> v2:172.21.15.176:3300/0 conn(0x7fa7d4073890 0x7fa7d40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 -- 172.21.15.52:0/2140406626 >> v2:172.21.15.176:3300/0 conn(0x7fa7d4073890 msgr2=0x7fa7d40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 --2- 172.21.15.52:0/2140406626 >> v2:172.21.15.176:3300/0 conn(0x7fa7d4073890 0x7fa7d40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 -- 172.21.15.52:0/2140406626 >> v1:172.21.15.176:6789/0 conn(0x7fa7d4145ed0 legacy=0x7fa7d4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.008+0000 7fa7d3e00640 1 -- 172.21.15.52:0/2140406626 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d40b4880 con 0x7fa7d40b5880 2024-09-10T08:41:38.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.009+0000 7fa7d3e00640 1 --2- 172.21.15.52:0/2140406626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40b5ce0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40d1490 tx=0x7fa7cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2959b360db28fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.009+0000 7fa7d2000640 1 -- 172.21.15.52:0/2140406626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc036070 con 0x7fa7d40b5880 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.009+0000 7fa7d2000640 1 -- 172.21.15.52:0/2140406626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7cc031600 con 0x7fa7d40b5880 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.009+0000 7fa7d2000640 1 -- 172.21.15.52:0/2140406626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0319d0 con 0x7fa7d40b5880 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 -- 172.21.15.52:0/2140406626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 msgr2=0x7fa7d40b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 --2- 172.21.15.52:0/2140406626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40b5ce0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40d1490 tx=0x7fa7cc02a730 comp rx=0 tx=0).stop 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 -- 172.21.15.52:0/2140406626 shutdown_connections 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 --2- 172.21.15.52:0/2140406626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40b5ce0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 --2- 172.21.15.52:0/2140406626 >> v2:172.21.15.176:3300/0 conn(0x7fa7d4073890 0x7fa7d40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 -- 172.21.15.52:0/2140406626 >> 172.21.15.52:0/2140406626 conn(0x7fa7d40ccec0 msgr2=0x7fa7d40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 -- 172.21.15.52:0/2140406626 shutdown_connections 2024-09-10T08:41:38.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.010+0000 7fa7da600640 1 -- 172.21.15.52:0/2140406626 wait complete. 2024-09-10T08:41:38.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.012+0000 7fa7da600640 1 Processor -- start 2024-09-10T08:41:38.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.012+0000 7fa7da600640 1 -- start start 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 0x7fa7d4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d4145ed0 0x7fa7d4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40b63a0 con 0x7fa7d40b5880 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40b6220 con 0x7fa7d4145ed0 2024-09-10T08:41:38.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7da600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d41462b0 con 0x7fa7d4073890 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7d2a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34166/0 (socket says 172.21.15.52:34166) 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7d2a00640 1 -- 172.21.15.52:0/1526991360 learned_addr learned my addr 172.21.15.52:0/1526991360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7d3e00640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d4145ed0 0x7fa7d4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.013+0000 7fa7d3400640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 0x7fa7d4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 -- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 msgr2=0x7fa7d4154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 0x7fa7d4154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 -- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d4145ed0 msgr2=0x7fa7d4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d4145ed0 0x7fa7d4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 -- 172.21.15.52:0/1526991360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d41f4a10 con 0x7fa7d40b5880 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d3400640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 0x7fa7d4154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:38.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7d2a00640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000d800 tx=0x7fa7c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000b6c0 con 0x7fa7d40b5880 2024-09-10T08:41:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c0019070 con 0x7fa7d40b5880 2024-09-10T08:41:38.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d41f4cf0 con 0x7fa7d40b5880 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ba80 con 0x7fa7d40b5880 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.014+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d4072090 con 0x7fa7d40b5880 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.015+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d40b5080 con 0x7fa7d40b5880 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.016+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7c000bc20 con 0x7fa7d40b5880 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.017+0000 7fa7cb400640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 0x7fa7b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.017+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fa7c008b2f0 con 0x7fa7d40b5880 2024-09-10T08:41:38.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.017+0000 7fa7d3400640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 0x7fa7b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.018+0000 7fa7d3400640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 0x7fa7b406e2f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4144d20 tx=0x7fa7c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.021+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7c0059c00 con 0x7fa7d40b5880 2024-09-10T08:41:38.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:38.118 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:41:38.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.203+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7d40cd440 con 0x7fa7b406be30 2024-09-10T08:41:38.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.211+0000 7fa7cb400640 1 -- 172.21.15.52:0/1526991360 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252449 (secure 0 0 0) 0x7fa7d40cd440 con 0x7fa7b406be30 2024-09-10T08:41:38.214 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:38.216 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:41:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 msgr2=0x7fa7b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 0x7fa7b406e2f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4144d20 tx=0x7fa7c4009040 comp rx=0 tx=0).stop 2024-09-10T08:41:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 msgr2=0x7fa7d40cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000d800 tx=0x7fa7c000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 shutdown_connections 2024-09-10T08:41:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa7b406be30 0x7fa7b406e2f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7d4145ed0 0x7fa7d4071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7d40b5880 0x7fa7d40cbe30 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 --2- 172.21.15.52:0/1526991360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa7d4073890 0x7fa7d4154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 >> 172.21.15.52:0/1526991360 conn(0x7fa7d40ccec0 msgr2=0x7fa7d4140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 shutdown_connections 2024-09-10T08:41:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.215+0000 7fa7da600640 1 -- 172.21.15.52:0/1526991360 wait complete. 2024-09-10T08:41:38.233 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-10T08:41:37.647401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460080,"kb_used_data":19080,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754514640,"statfs":{"total":773094113280,"available":772622991360,"internally_reserved":0,"allocated":19537920,"data_stored":9227380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001418"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620038+0000","last_change":"2024-09-10T08:41:33.619019+0000","last_active":"2024-09-10T08:41:33.620038+0000","last_peered":"2024-09-10T08:41:33.620038+0000","last_clean":"2024-09-10T08:41:33.620038+0000","last_became_active":"2024-09-10T08:41:33.618675+0000","last_became_peered":"2024-09-10T08:41:33.618675+0000","last_unstale":"2024-09-10T08:41:33.620038+0000","last_undegraded":"2024-09-10T08:41:33.620038+0000","last_fullsized":"2024-09-10T08:41:33.620038+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:10:06.097941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.604682+0000","last_change":"2024-09-10T08:41:33.600984+0000","last_active":"2024-09-10T08:41:33.604682+0000","last_peered":"2024-09-10T08:41:33.604682+0000","last_clean":"2024-09-10T08:41:33.604682+0000","last_became_active":"2024-09-10T08:41:33.598949+0000","last_became_peered":"2024-09-10T08:41:33.598949+0000","last_unstale":"2024-09-10T08:41:33.604682+0000","last_undegraded":"2024-09-10T08:41:33.604682+0000","last_fullsized":"2024-09-10T08:41:33.604682+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:37.370470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916756+0000","last_change":"2024-09-10T08:41:33.614987+0000","last_active":"2024-09-10T08:41:34.916756+0000","last_peered":"2024-09-10T08:41:34.916756+0000","last_clean":"2024-09-10T08:41:34.916756+0000","last_became_active":"2024-09-10T08:41:33.614687+0000","last_became_peered":"2024-09-10T08:41:33.614687+0000","last_unstale":"2024-09-10T08:41:34.916756+0000","last_undegraded":"2024-09-10T08:41:34.916756+0000","last_fullsized":"2024-09-10T08:41:34.916756+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:40.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.615708+0000","last_change":"2024-09-10T08:41:33.607154+0000","last_active":"2024-09-10T08:41:33.615708+0000","last_peered":"2024-09-10T08:41:33.615708+0000","last_clean":"2024-09-10T08:41:33.615708+0000","last_became_active":"2024-09-10T08:41:33.604996+0000","last_became_peered":"2024-09-10T08:41:33.604996+0000","last_unstale":"2024-09-10T08:41:33.615708+0000","last_undegraded":"2024-09-10T08:41:33.615708+0000","last_fullsized":"2024-09-10T08:41:33.615708+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:00.761241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916865+0000","last_change":"2024-09-10T08:41:33.626408+0000","last_active":"2024-09-10T08:41:34.916865+0000","last_peered":"2024-09-10T08:41:34.916865+0000","last_clean":"2024-09-10T08:41:34.916865+0000","last_became_active":"2024-09-10T08:41:33.626132+0000","last_became_peered":"2024-09-10T08:41:33.626132+0000","last_unstale":"2024-09-10T08:41:34.916865+0000","last_undegraded":"2024-09-10T08:41:34.916865+0000","last_fullsized":"2024-09-10T08:41:34.916865+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:00.366202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622835+0000","last_change":"2024-09-10T08:41:33.613932+0000","last_active":"2024-09-10T08:41:33.622835+0000","last_peered":"2024-09-10T08:41:33.622835+0000","last_clean":"2024-09-10T08:41:33.622835+0000","last_became_active":"2024-09-10T08:41:33.613549+0000","last_became_peered":"2024-09-10T08:41:33.613549+0000","last_unstale":"2024-09-10T08:41:33.622835+0000","last_undegraded":"2024-09-10T08:41:33.622835+0000","last_fullsized":"2024-09-10T08:41:33.622835+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:39.135776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.624342+0000","last_change":"2024-09-10T08:41:33.623018+0000","last_active":"2024-09-10T08:41:33.624342+0000","last_peered":"2024-09-10T08:41:33.624342+0000","last_clean":"2024-09-10T08:41:33.624342+0000","last_became_active":"2024-09-10T08:41:33.622367+0000","last_became_peered":"2024-09-10T08:41:33.622367+0000","last_unstale":"2024-09-10T08:41:33.624342+0000","last_undegraded":"2024-09-10T08:41:33.624342+0000","last_fullsized":"2024-09-10T08:41:33.624342+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:38.669531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604565+0000","last_change":"2024-09-10T08:41:33.601510+0000","last_active":"2024-09-10T08:41:34.604565+0000","last_peered":"2024-09-10T08:41:34.604565+0000","last_clean":"2024-09-10T08:41:34.604565+0000","last_became_active":"2024-09-10T08:41:33.601234+0000","last_became_peered":"2024-09-10T08:41:33.601234+0000","last_unstale":"2024-09-10T08:41:34.604565+0000","last_undegraded":"2024-09-10T08:41:34.604565+0000","last_fullsized":"2024-09-10T08:41:34.604565+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:35.220839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.600270+0000","last_change":"2024-09-10T08:41:33.596174+0000","last_active":"2024-09-10T08:41:33.600270+0000","last_peered":"2024-09-10T08:41:33.600270+0000","last_clean":"2024-09-10T08:41:33.600270+0000","last_became_active":"2024-09-10T08:41:33.595864+0000","last_became_peered":"2024-09-10T08:41:33.595864+0000","last_unstale":"2024-09-10T08:41:33.600270+0000","last_undegraded":"2024-09-10T08:41:33.600270+0000","last_fullsized":"2024-09-10T08:41:33.600270+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:22.361004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917086+0000","last_change":"2024-09-10T08:41:33.623401+0000","last_active":"2024-09-10T08:41:34.917086+0000","last_peered":"2024-09-10T08:41:34.917086+0000","last_clean":"2024-09-10T08:41:34.917086+0000","last_became_active":"2024-09-10T08:41:33.623111+0000","last_became_peered":"2024-09-10T08:41:33.623111+0000","last_unstale":"2024-09-10T08:41:34.917086+0000","last_undegraded":"2024-09-10T08:41:34.917086+0000","last_fullsized":"2024-09-10T08:41:34.917086+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.352397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617431+0000","last_change":"2024-09-10T08:41:33.612369+0000","last_active":"2024-09-10T08:41:33.617431+0000","last_peered":"2024-09-10T08:41:33.617431+0000","last_clean":"2024-09-10T08:41:33.617431+0000","last_became_active":"2024-09-10T08:41:33.612105+0000","last_became_peered":"2024-09-10T08:41:33.612105+0000","last_unstale":"2024-09-10T08:41:33.617431+0000","last_undegraded":"2024-09-10T08:41:33.617431+0000","last_fullsized":"2024-09-10T08:41:33.617431+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:08.969764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603359+0000","last_change":"2024-09-10T08:41:33.603399+0000","last_active":"2024-09-10T08:41:34.603359+0000","last_peered":"2024-09-10T08:41:34.603359+0000","last_clean":"2024-09-10T08:41:34.603359+0000","last_became_active":"2024-09-10T08:41:33.603012+0000","last_became_peered":"2024-09-10T08:41:33.603012+0000","last_unstale":"2024-09-10T08:41:34.603359+0000","last_undegraded":"2024-09-10T08:41:34.603359+0000","last_fullsized":"2024-09-10T08:41:34.603359+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:58:01.040204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606814+0000","last_change":"2024-09-10T08:41:33.602814+0000","last_active":"2024-09-10T08:41:33.606814+0000","last_peered":"2024-09-10T08:41:33.606814+0000","last_clean":"2024-09-10T08:41:33.606814+0000","last_became_active":"2024-09-10T08:41:33.602556+0000","last_became_peered":"2024-09-10T08:41:33.602556+0000","last_unstale":"2024-09-10T08:41:33.606814+0000","last_undegraded":"2024-09-10T08:41:33.606814+0000","last_fullsized":"2024-09-10T08:41:33.606814+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:50:30.225501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.608321+0000","last_change":"2024-09-10T08:41:33.601537+0000","last_active":"2024-09-10T08:41:33.608321+0000","last_peered":"2024-09-10T08:41:33.608321+0000","last_clean":"2024-09-10T08:41:33.608321+0000","last_became_active":"2024-09-10T08:41:33.601235+0000","last_became_peered":"2024-09-10T08:41:33.601235+0000","last_unstale":"2024-09-10T08:41:33.608321+0000","last_undegraded":"2024-09-10T08:41:33.608321+0000","last_fullsized":"2024-09-10T08:41:33.608321+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:30.490895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613481+0000","last_change":"2024-09-10T08:41:33.611677+0000","last_active":"2024-09-10T08:41:33.613481+0000","last_peered":"2024-09-10T08:41:33.613481+0000","last_clean":"2024-09-10T08:41:33.613481+0000","last_became_active":"2024-09-10T08:41:33.607286+0000","last_became_peered":"2024-09-10T08:41:33.607286+0000","last_unstale":"2024-09-10T08:41:33.613481+0000","last_undegraded":"2024-09-10T08:41:33.613481+0000","last_fullsized":"2024-09-10T08:41:33.613481+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:49.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619063+0000","last_change":"2024-09-10T08:41:33.612910+0000","last_active":"2024-09-10T08:41:33.619063+0000","last_peered":"2024-09-10T08:41:33.619063+0000","last_clean":"2024-09-10T08:41:33.619063+0000","last_became_active":"2024-09-10T08:41:33.611061+0000","last_became_peered":"2024-09-10T08:41:33.611061+0000","last_unstale":"2024-09-10T08:41:33.619063+0000","last_undegraded":"2024-09-10T08:41:33.619063+0000","last_fullsized":"2024-09-10T08:41:33.619063+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:34.796464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619780+0000","last_change":"2024-09-10T08:41:33.618651+0000","last_active":"2024-09-10T08:41:33.619780+0000","last_peered":"2024-09-10T08:41:33.619780+0000","last_clean":"2024-09-10T08:41:33.619780+0000","last_became_active":"2024-09-10T08:41:33.617170+0000","last_became_peered":"2024-09-10T08:41:33.617170+0000","last_unstale":"2024-09-10T08:41:33.619780+0000","last_undegraded":"2024-09-10T08:41:33.619780+0000","last_fullsized":"2024-09-10T08:41:33.619780+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:43.803623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917130+0000","last_change":"2024-09-10T08:41:33.619081+0000","last_active":"2024-09-10T08:41:34.917130+0000","last_peered":"2024-09-10T08:41:34.917130+0000","last_clean":"2024-09-10T08:41:34.917130+0000","last_became_active":"2024-09-10T08:41:33.616678+0000","last_became_peered":"2024-09-10T08:41:33.616678+0000","last_unstale":"2024-09-10T08:41:34.917130+0000","last_undegraded":"2024-09-10T08:41:34.917130+0000","last_fullsized":"2024-09-10T08:41:34.917130+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:52.938009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916826+0000","last_change":"2024-09-10T08:41:33.615967+0000","last_active":"2024-09-10T08:41:34.916826+0000","last_peered":"2024-09-10T08:41:34.916826+0000","last_clean":"2024-09-10T08:41:34.916826+0000","last_became_active":"2024-09-10T08:41:33.614756+0000","last_became_peered":"2024-09-10T08:41:33.614756+0000","last_unstale":"2024-09-10T08:41:34.916826+0000","last_undegraded":"2024-09-10T08:41:34.916826+0000","last_fullsized":"2024-09-10T08:41:34.916826+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:39.268403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916743+0000","last_change":"2024-09-10T08:41:33.623534+0000","last_active":"2024-09-10T08:41:34.916743+0000","last_peered":"2024-09-10T08:41:34.916743+0000","last_clean":"2024-09-10T08:41:34.916743+0000","last_became_active":"2024-09-10T08:41:33.621986+0000","last_became_peered":"2024-09-10T08:41:33.621986+0000","last_unstale":"2024-09-10T08:41:34.916743+0000","last_undegraded":"2024-09-10T08:41:34.916743+0000","last_fullsized":"2024-09-10T08:41:34.916743+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:30:31.900934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603321+0000","last_change":"2024-09-10T08:41:33.609956+0000","last_active":"2024-09-10T08:41:34.603321+0000","last_peered":"2024-09-10T08:41:34.603321+0000","last_clean":"2024-09-10T08:41:34.603321+0000","last_became_active":"2024-09-10T08:41:33.609691+0000","last_became_peered":"2024-09-10T08:41:33.609691+0000","last_unstale":"2024-09-10T08:41:34.603321+0000","last_undegraded":"2024-09-10T08:41:34.603321+0000","last_fullsized":"2024-09-10T08:41:34.603321+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:27.168623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.615100+0000","last_change":"2024-09-10T08:41:33.612875+0000","last_active":"2024-09-10T08:41:33.615100+0000","last_peered":"2024-09-10T08:41:33.615100+0000","last_clean":"2024-09-10T08:41:33.615100+0000","last_became_active":"2024-09-10T08:41:33.612621+0000","last_became_peered":"2024-09-10T08:41:33.612621+0000","last_unstale":"2024-09-10T08:41:33.615100+0000","last_undegraded":"2024-09-10T08:41:33.615100+0000","last_fullsized":"2024-09-10T08:41:33.615100+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:51.143243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613892+0000","last_change":"2024-09-10T08:41:33.606217+0000","last_active":"2024-09-10T08:41:33.613892+0000","last_peered":"2024-09-10T08:41:33.613892+0000","last_clean":"2024-09-10T08:41:33.613892+0000","last_became_active":"2024-09-10T08:41:33.605929+0000","last_became_peered":"2024-09-10T08:41:33.605929+0000","last_unstale":"2024-09-10T08:41:33.613892+0000","last_undegraded":"2024-09-10T08:41:33.613892+0000","last_fullsized":"2024-09-10T08:41:33.613892+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:00.259933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.600515+0000","last_change":"2024-09-10T08:41:33.596297+0000","last_active":"2024-09-10T08:41:33.600515+0000","last_peered":"2024-09-10T08:41:33.600515+0000","last_clean":"2024-09-10T08:41:33.600515+0000","last_became_active":"2024-09-10T08:41:33.595997+0000","last_became_peered":"2024-09-10T08:41:33.595997+0000","last_unstale":"2024-09-10T08:41:33.600515+0000","last_undegraded":"2024-09-10T08:41:33.600515+0000","last_fullsized":"2024-09-10T08:41:33.600515+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:08:25.418669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625396+0000","last_change":"2024-09-10T08:41:33.624354+0000","last_active":"2024-09-10T08:41:33.625396+0000","last_peered":"2024-09-10T08:41:33.625396+0000","last_clean":"2024-09-10T08:41:33.625396+0000","last_became_active":"2024-09-10T08:41:33.623938+0000","last_became_peered":"2024-09-10T08:41:33.623938+0000","last_unstale":"2024-09-10T08:41:33.625396+0000","last_undegraded":"2024-09-10T08:41:33.625396+0000","last_fullsized":"2024-09-10T08:41:33.625396+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:39.562692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605538+0000","last_change":"2024-09-10T08:41:33.602183+0000","last_active":"2024-09-10T08:41:34.605538+0000","last_peered":"2024-09-10T08:41:34.605538+0000","last_clean":"2024-09-10T08:41:34.605538+0000","last_became_active":"2024-09-10T08:41:33.600627+0000","last_became_peered":"2024-09-10T08:41:33.600627+0000","last_unstale":"2024-09-10T08:41:34.605538+0000","last_undegraded":"2024-09-10T08:41:34.605538+0000","last_fullsized":"2024-09-10T08:41:34.605538+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:04.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603353+0000","last_change":"2024-09-10T08:41:33.611161+0000","last_active":"2024-09-10T08:41:34.603353+0000","last_peered":"2024-09-10T08:41:34.603353+0000","last_clean":"2024-09-10T08:41:34.603353+0000","last_became_active":"2024-09-10T08:41:33.610858+0000","last_became_peered":"2024-09-10T08:41:33.610858+0000","last_unstale":"2024-09-10T08:41:34.603353+0000","last_undegraded":"2024-09-10T08:41:34.603353+0000","last_fullsized":"2024-09-10T08:41:34.603353+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:27.261722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605678+0000","last_change":"2024-09-10T08:41:33.604436+0000","last_active":"2024-09-10T08:41:34.605678+0000","last_peered":"2024-09-10T08:41:34.605678+0000","last_clean":"2024-09-10T08:41:34.605678+0000","last_became_active":"2024-09-10T08:41:33.603868+0000","last_became_peered":"2024-09-10T08:41:33.603868+0000","last_unstale":"2024-09-10T08:41:34.605678+0000","last_undegraded":"2024-09-10T08:41:34.605678+0000","last_fullsized":"2024-09-10T08:41:34.605678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:51.143243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613603+0000","last_change":"2024-09-10T08:41:33.607514+0000","last_active":"2024-09-10T08:41:33.613603+0000","last_peered":"2024-09-10T08:41:33.613603+0000","last_clean":"2024-09-10T08:41:33.613603+0000","last_became_active":"2024-09-10T08:41:33.607210+0000","last_became_peered":"2024-09-10T08:41:33.607210+0000","last_unstale":"2024-09-10T08:41:33.613603+0000","last_undegraded":"2024-09-10T08:41:33.613603+0000","last_fullsized":"2024-09-10T08:41:33.613603+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:04.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620260+0000","last_change":"2024-09-10T08:41:33.617077+0000","last_active":"2024-09-10T08:41:33.620260+0000","last_peered":"2024-09-10T08:41:33.620260+0000","last_clean":"2024-09-10T08:41:33.620260+0000","last_became_active":"2024-09-10T08:41:33.616619+0000","last_became_peered":"2024-09-10T08:41:33.616619+0000","last_unstale":"2024-09-10T08:41:33.620260+0000","last_undegraded":"2024-09-10T08:41:33.620260+0000","last_fullsized":"2024-09-10T08:41:33.620260+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:24.445065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916548+0000","last_change":"2024-09-10T08:41:33.609338+0000","last_active":"2024-09-10T08:41:34.916548+0000","last_peered":"2024-09-10T08:41:34.916548+0000","last_clean":"2024-09-10T08:41:34.916548+0000","last_became_active":"2024-09-10T08:41:33.609082+0000","last_became_peered":"2024-09-10T08:41:33.609082+0000","last_unstale":"2024-09-10T08:41:34.916548+0000","last_undegraded":"2024-09-10T08:41:34.916548+0000","last_fullsized":"2024-09-10T08:41:34.916548+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:51:58.472818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611575+0000","last_change":"2024-09-10T08:41:33.609890+0000","last_active":"2024-09-10T08:41:33.611575+0000","last_peered":"2024-09-10T08:41:33.611575+0000","last_clean":"2024-09-10T08:41:33.611575+0000","last_became_active":"2024-09-10T08:41:33.609582+0000","last_became_peered":"2024-09-10T08:41:33.609582+0000","last_unstale":"2024-09-10T08:41:33.611575+0000","last_undegraded":"2024-09-10T08:41:33.611575+0000","last_fullsized":"2024-09-10T08:41:33.611575+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:32.919456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603549+0000","last_change":"2024-09-10T08:41:33.611822+0000","last_active":"2024-09-10T08:41:34.603549+0000","last_peered":"2024-09-10T08:41:34.603549+0000","last_clean":"2024-09-10T08:41:34.603549+0000","last_became_active":"2024-09-10T08:41:33.611578+0000","last_became_peered":"2024-09-10T08:41:33.611578+0000","last_unstale":"2024-09-10T08:41:34.603549+0000","last_undegraded":"2024-09-10T08:41:34.603549+0000","last_fullsized":"2024-09-10T08:41:34.603549+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:13.462912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"182'4","reported_seq":18,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603612+0000","last_change":"2024-09-10T08:41:32.605733+0000","last_active":"2024-09-10T08:41:34.603612+0000","last_peered":"2024-09-10T08:41:34.603612+0000","last_clean":"2024-09-10T08:41:34.603612+0000","last_became_active":"2024-09-10T08:41:32.605395+0000","last_became_peered":"2024-09-10T08:41:32.605395+0000","last_unstale":"2024-09-10T08:41:34.603612+0000","last_undegraded":"2024-09-10T08:41:34.603612+0000","last_fullsized":"2024-09-10T08:41:34.603612+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:22.124432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617395+0000","last_change":"2024-09-10T08:41:33.610882+0000","last_active":"2024-09-10T08:41:33.617395+0000","last_peered":"2024-09-10T08:41:33.617395+0000","last_clean":"2024-09-10T08:41:33.617395+0000","last_became_active":"2024-09-10T08:41:33.610615+0000","last_became_peered":"2024-09-10T08:41:33.610615+0000","last_unstale":"2024-09-10T08:41:33.617395+0000","last_undegraded":"2024-09-10T08:41:33.617395+0000","last_fullsized":"2024-09-10T08:41:33.617395+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:03.423339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.618015+0000","last_change":"2024-09-10T08:41:32.606768+0000","last_active":"2024-09-10T08:41:33.618015+0000","last_peered":"2024-09-10T08:41:33.618015+0000","last_clean":"2024-09-10T08:41:33.618015+0000","last_became_active":"2024-09-10T08:41:32.606505+0000","last_became_peered":"2024-09-10T08:41:32.606505+0000","last_unstale":"2024-09-10T08:41:33.618015+0000","last_undegraded":"2024-09-10T08:41:33.618015+0000","last_fullsized":"2024-09-10T08:41:33.618015+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:40.386692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916915+0000","last_change":"2024-09-10T08:41:33.616713+0000","last_active":"2024-09-10T08:41:34.916915+0000","last_peered":"2024-09-10T08:41:34.916915+0000","last_clean":"2024-09-10T08:41:34.916915+0000","last_became_active":"2024-09-10T08:41:33.616401+0000","last_became_peered":"2024-09-10T08:41:33.616401+0000","last_unstale":"2024-09-10T08:41:34.916915+0000","last_undegraded":"2024-09-10T08:41:34.916915+0000","last_fullsized":"2024-09-10T08:41:34.916915+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:32.273696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605143+0000","last_change":"2024-09-10T08:41:32.601583+0000","last_active":"2024-09-10T08:41:34.605143+0000","last_peered":"2024-09-10T08:41:34.605143+0000","last_clean":"2024-09-10T08:41:34.605143+0000","last_became_active":"2024-09-10T08:41:32.599057+0000","last_became_peered":"2024-09-10T08:41:32.599057+0000","last_unstale":"2024-09-10T08:41:34.605143+0000","last_undegraded":"2024-09-10T08:41:34.605143+0000","last_fullsized":"2024-09-10T08:41:34.605143+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:47.542958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917164+0000","last_change":"2024-09-10T08:41:33.621301+0000","last_active":"2024-09-10T08:41:34.917164+0000","last_peered":"2024-09-10T08:41:34.917164+0000","last_clean":"2024-09-10T08:41:34.917164+0000","last_became_active":"2024-09-10T08:41:33.618601+0000","last_became_peered":"2024-09-10T08:41:33.618601+0000","last_unstale":"2024-09-10T08:41:34.917164+0000","last_undegraded":"2024-09-10T08:41:34.917164+0000","last_fullsized":"2024-09-10T08:41:34.917164+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:28.729354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622344+0000","last_change":"2024-09-10T08:41:32.609128+0000","last_active":"2024-09-10T08:41:33.622344+0000","last_peered":"2024-09-10T08:41:33.622344+0000","last_clean":"2024-09-10T08:41:33.622344+0000","last_became_active":"2024-09-10T08:41:32.608829+0000","last_became_peered":"2024-09-10T08:41:32.608829+0000","last_unstale":"2024-09-10T08:41:33.622344+0000","last_undegraded":"2024-09-10T08:41:33.622344+0000","last_fullsized":"2024-09-10T08:41:33.622344+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:16.977537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.617925+0000","last_change":"2024-09-10T08:41:33.612116+0000","last_active":"2024-09-10T08:41:33.617925+0000","last_peered":"2024-09-10T08:41:33.617925+0000","last_clean":"2024-09-10T08:41:33.617925+0000","last_became_active":"2024-09-10T08:41:33.611812+0000","last_became_peered":"2024-09-10T08:41:33.611812+0000","last_unstale":"2024-09-10T08:41:33.617925+0000","last_undegraded":"2024-09-10T08:41:33.617925+0000","last_fullsized":"2024-09-10T08:41:33.617925+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:26.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625809+0000","last_change":"2024-09-10T08:41:32.607859+0000","last_active":"2024-09-10T08:41:33.625809+0000","last_peered":"2024-09-10T08:41:33.625809+0000","last_clean":"2024-09-10T08:41:33.625809+0000","last_became_active":"2024-09-10T08:41:32.607579+0000","last_became_peered":"2024-09-10T08:41:32.607579+0000","last_unstale":"2024-09-10T08:41:33.625809+0000","last_undegraded":"2024-09-10T08:41:33.625809+0000","last_fullsized":"2024-09-10T08:41:33.625809+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:03.508027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.607844+0000","last_change":"2024-09-10T08:41:33.606604+0000","last_active":"2024-09-10T08:41:33.607844+0000","last_peered":"2024-09-10T08:41:33.607844+0000","last_clean":"2024-09-10T08:41:33.607844+0000","last_became_active":"2024-09-10T08:41:33.603345+0000","last_became_peered":"2024-09-10T08:41:33.603345+0000","last_unstale":"2024-09-10T08:41:33.607844+0000","last_undegraded":"2024-09-10T08:41:33.607844+0000","last_fullsized":"2024-09-10T08:41:33.607844+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:53.612443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604513+0000","last_change":"2024-09-10T08:41:32.604623+0000","last_active":"2024-09-10T08:41:34.604513+0000","last_peered":"2024-09-10T08:41:34.604513+0000","last_clean":"2024-09-10T08:41:34.604513+0000","last_became_active":"2024-09-10T08:41:32.604340+0000","last_became_peered":"2024-09-10T08:41:32.604340+0000","last_unstale":"2024-09-10T08:41:34.604513+0000","last_undegraded":"2024-09-10T08:41:34.604513+0000","last_fullsized":"2024-09-10T08:41:34.604513+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:06.349554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.601164+0000","last_change":"2024-09-10T08:41:33.600595+0000","last_active":"2024-09-10T08:41:33.601164+0000","last_peered":"2024-09-10T08:41:33.601164+0000","last_clean":"2024-09-10T08:41:33.601164+0000","last_became_active":"2024-09-10T08:41:33.600250+0000","last_became_peered":"2024-09-10T08:41:33.600250+0000","last_unstale":"2024-09-10T08:41:33.601164+0000","last_undegraded":"2024-09-10T08:41:33.601164+0000","last_fullsized":"2024-09-10T08:41:33.601164+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:36.959601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598828+0000","last_change":"2024-09-10T08:41:32.610689+0000","last_active":"2024-09-10T08:41:33.598828+0000","last_peered":"2024-09-10T08:41:33.598828+0000","last_clean":"2024-09-10T08:41:33.598828+0000","last_became_active":"2024-09-10T08:41:32.610123+0000","last_became_peered":"2024-09-10T08:41:32.610123+0000","last_unstale":"2024-09-10T08:41:33.598828+0000","last_undegraded":"2024-09-10T08:41:33.598828+0000","last_fullsized":"2024-09-10T08:41:33.598828+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:37.673951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.624608+0000","last_change":"2024-09-10T08:41:33.623560+0000","last_active":"2024-09-10T08:41:33.624608+0000","last_peered":"2024-09-10T08:41:33.624608+0000","last_clean":"2024-09-10T08:41:33.624608+0000","last_became_active":"2024-09-10T08:41:33.623299+0000","last_became_peered":"2024-09-10T08:41:33.623299+0000","last_unstale":"2024-09-10T08:41:33.624608+0000","last_undegraded":"2024-09-10T08:41:33.624608+0000","last_fullsized":"2024-09-10T08:41:33.624608+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:36.615100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917161+0000","last_change":"2024-09-10T08:41:32.613051+0000","last_active":"2024-09-10T08:41:34.917161+0000","last_peered":"2024-09-10T08:41:34.917161+0000","last_clean":"2024-09-10T08:41:34.917161+0000","last_became_active":"2024-09-10T08:41:32.612734+0000","last_became_peered":"2024-09-10T08:41:32.612734+0000","last_unstale":"2024-09-10T08:41:34.917161+0000","last_undegraded":"2024-09-10T08:41:34.917161+0000","last_fullsized":"2024-09-10T08:41:34.917161+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611089+0000","last_change":"2024-09-10T08:41:33.607973+0000","last_active":"2024-09-10T08:41:33.611089+0000","last_peered":"2024-09-10T08:41:33.611089+0000","last_clean":"2024-09-10T08:41:33.611089+0000","last_became_active":"2024-09-10T08:41:33.605593+0000","last_became_peered":"2024-09-10T08:41:33.605593+0000","last_unstale":"2024-09-10T08:41:33.611089+0000","last_undegraded":"2024-09-10T08:41:33.611089+0000","last_fullsized":"2024-09-10T08:41:33.611089+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:38.595839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.609028+0000","last_change":"2024-09-10T08:41:32.611450+0000","last_active":"2024-09-10T08:41:33.609028+0000","last_peered":"2024-09-10T08:41:33.609028+0000","last_clean":"2024-09-10T08:41:33.609028+0000","last_became_active":"2024-09-10T08:41:32.611206+0000","last_became_peered":"2024-09-10T08:41:32.611206+0000","last_unstale":"2024-09-10T08:41:33.609028+0000","last_undegraded":"2024-09-10T08:41:33.609028+0000","last_fullsized":"2024-09-10T08:41:33.609028+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:20.915097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.597312+0000","last_change":"2024-09-10T08:41:33.593090+0000","last_active":"2024-09-10T08:41:33.597312+0000","last_peered":"2024-09-10T08:41:33.597312+0000","last_clean":"2024-09-10T08:41:33.597312+0000","last_became_active":"2024-09-10T08:41:33.592755+0000","last_became_peered":"2024-09-10T08:41:33.592755+0000","last_unstale":"2024-09-10T08:41:33.597312+0000","last_undegraded":"2024-09-10T08:41:33.597312+0000","last_fullsized":"2024-09-10T08:41:33.597312+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:26:32.919456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"182'3","reported_seq":17,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.605252+0000","last_change":"2024-09-10T08:41:32.601616+0000","last_active":"2024-09-10T08:41:34.605252+0000","last_peered":"2024-09-10T08:41:34.605252+0000","last_clean":"2024-09-10T08:41:34.605252+0000","last_became_active":"2024-09-10T08:41:32.601342+0000","last_became_peered":"2024-09-10T08:41:32.601342+0000","last_unstale":"2024-09-10T08:41:34.605252+0000","last_undegraded":"2024-09-10T08:41:34.605252+0000","last_fullsized":"2024-09-10T08:41:34.605252+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:17:58.349424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604944+0000","last_change":"2024-09-10T08:41:33.603450+0000","last_active":"2024-09-10T08:41:34.604944+0000","last_peered":"2024-09-10T08:41:34.604944+0000","last_clean":"2024-09-10T08:41:34.604944+0000","last_became_active":"2024-09-10T08:41:33.603074+0000","last_became_peered":"2024-09-10T08:41:33.603074+0000","last_unstale":"2024-09-10T08:41:34.604944+0000","last_undegraded":"2024-09-10T08:41:34.604944+0000","last_fullsized":"2024-09-10T08:41:34.604944+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:16.344217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"182'6","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625890+0000","last_change":"2024-09-10T08:41:32.603096+0000","last_active":"2024-09-10T08:41:33.625890+0000","last_peered":"2024-09-10T08:41:33.625890+0000","last_clean":"2024-09-10T08:41:33.625890+0000","last_became_active":"2024-09-10T08:41:32.602815+0000","last_became_peered":"2024-09-10T08:41:32.602815+0000","last_unstale":"2024-09-10T08:41:33.625890+0000","last_undegraded":"2024-09-10T08:41:33.625890+0000","last_fullsized":"2024-09-10T08:41:33.625890+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:29.488051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.621966+0000","last_change":"2024-09-10T08:41:33.617000+0000","last_active":"2024-09-10T08:41:33.621966+0000","last_peered":"2024-09-10T08:41:33.621966+0000","last_clean":"2024-09-10T08:41:33.621966+0000","last_became_active":"2024-09-10T08:41:33.616724+0000","last_became_peered":"2024-09-10T08:41:33.616724+0000","last_unstale":"2024-09-10T08:41:33.621966+0000","last_undegraded":"2024-09-10T08:41:33.621966+0000","last_fullsized":"2024-09-10T08:41:33.621966+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:22.361004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625860+0000","last_change":"2024-09-10T08:41:32.597691+0000","last_active":"2024-09-10T08:41:33.625860+0000","last_peered":"2024-09-10T08:41:33.625860+0000","last_clean":"2024-09-10T08:41:33.625860+0000","last_became_active":"2024-09-10T08:41:32.595879+0000","last_became_peered":"2024-09-10T08:41:32.595879+0000","last_unstale":"2024-09-10T08:41:33.625860+0000","last_undegraded":"2024-09-10T08:41:33.625860+0000","last_fullsized":"2024-09-10T08:41:33.625860+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917170+0000","last_change":"2024-09-10T08:41:33.620466+0000","last_active":"2024-09-10T08:41:34.917170+0000","last_peered":"2024-09-10T08:41:34.917170+0000","last_clean":"2024-09-10T08:41:34.917170+0000","last_became_active":"2024-09-10T08:41:33.618858+0000","last_became_peered":"2024-09-10T08:41:33.618858+0000","last_unstale":"2024-09-10T08:41:34.917170+0000","last_undegraded":"2024-09-10T08:41:34.917170+0000","last_fullsized":"2024-09-10T08:41:34.917170+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.524898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.589725+0000","last_change":"2024-09-10T08:41:32.605104+0000","last_active":"2024-09-10T08:41:33.589725+0000","last_peered":"2024-09-10T08:41:33.589725+0000","last_clean":"2024-09-10T08:41:33.589725+0000","last_became_active":"2024-09-10T08:41:32.604429+0000","last_became_peered":"2024-09-10T08:41:32.604429+0000","last_unstale":"2024-09-10T08:41:33.589725+0000","last_undegraded":"2024-09-10T08:41:33.589725+0000","last_fullsized":"2024-09-10T08:41:33.589725+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:33:12.202383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916550+0000","last_change":"2024-09-10T08:41:33.610207+0000","last_active":"2024-09-10T08:41:34.916550+0000","last_peered":"2024-09-10T08:41:34.916550+0000","last_clean":"2024-09-10T08:41:34.916550+0000","last_became_active":"2024-09-10T08:41:33.607441+0000","last_became_peered":"2024-09-10T08:41:33.607441+0000","last_unstale":"2024-09-10T08:41:34.916550+0000","last_undegraded":"2024-09-10T08:41:34.916550+0000","last_fullsized":"2024-09-10T08:41:34.916550+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:43.848714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604616+0000","last_change":"2024-09-10T08:41:32.598318+0000","last_active":"2024-09-10T08:41:34.604616+0000","last_peered":"2024-09-10T08:41:34.604616+0000","last_clean":"2024-09-10T08:41:34.604616+0000","last_became_active":"2024-09-10T08:41:32.598035+0000","last_became_peered":"2024-09-10T08:41:32.598035+0000","last_unstale":"2024-09-10T08:41:34.604616+0000","last_undegraded":"2024-09-10T08:41:34.604616+0000","last_fullsized":"2024-09-10T08:41:34.604616+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:27.726510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.611829+0000","last_change":"2024-09-10T08:41:33.605605+0000","last_active":"2024-09-10T08:41:33.611829+0000","last_peered":"2024-09-10T08:41:33.611829+0000","last_clean":"2024-09-10T08:41:33.611829+0000","last_became_active":"2024-09-10T08:41:33.601619+0000","last_became_peered":"2024-09-10T08:41:33.601619+0000","last_unstale":"2024-09-10T08:41:33.611829+0000","last_undegraded":"2024-09-10T08:41:33.611829+0000","last_fullsized":"2024-09-10T08:41:33.611829+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:13.488886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"182'8","reported_seq":22,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604446+0000","last_change":"2024-09-10T08:41:32.604892+0000","last_active":"2024-09-10T08:41:34.604446+0000","last_peered":"2024-09-10T08:41:34.604446+0000","last_clean":"2024-09-10T08:41:34.604446+0000","last_became_active":"2024-09-10T08:41:32.604628+0000","last_became_peered":"2024-09-10T08:41:32.604628+0000","last_unstale":"2024-09-10T08:41:34.604446+0000","last_undegraded":"2024-09-10T08:41:34.604446+0000","last_fullsized":"2024-09-10T08:41:34.604446+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:58.004923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603596+0000","last_change":"2024-09-10T08:41:33.612123+0000","last_active":"2024-09-10T08:41:34.603596+0000","last_peered":"2024-09-10T08:41:34.603596+0000","last_clean":"2024-09-10T08:41:34.603596+0000","last_became_active":"2024-09-10T08:41:33.611248+0000","last_became_peered":"2024-09-10T08:41:33.611248+0000","last_unstale":"2024-09-10T08:41:34.603596+0000","last_undegraded":"2024-09-10T08:41:34.603596+0000","last_fullsized":"2024-09-10T08:41:34.603596+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:39.561131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.627237+0000","last_change":"2024-09-10T08:41:32.606236+0000","last_active":"2024-09-10T08:41:33.627237+0000","last_peered":"2024-09-10T08:41:33.627237+0000","last_clean":"2024-09-10T08:41:33.627237+0000","last_became_active":"2024-09-10T08:41:32.605963+0000","last_became_peered":"2024-09-10T08:41:32.605963+0000","last_unstale":"2024-09-10T08:41:33.627237+0000","last_undegraded":"2024-09-10T08:41:33.627237+0000","last_fullsized":"2024-09-10T08:41:33.627237+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:47.959613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.620288+0000","last_change":"2024-09-10T08:41:33.617236+0000","last_active":"2024-09-10T08:41:33.620288+0000","last_peered":"2024-09-10T08:41:33.620288+0000","last_clean":"2024-09-10T08:41:33.620288+0000","last_became_active":"2024-09-10T08:41:33.615357+0000","last_became_peered":"2024-09-10T08:41:33.615357+0000","last_unstale":"2024-09-10T08:41:33.620288+0000","last_undegraded":"2024-09-10T08:41:33.620288+0000","last_fullsized":"2024-09-10T08:41:33.620288+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:35:19.397785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.622686+0000","last_change":"2024-09-10T08:41:32.595086+0000","last_active":"2024-09-10T08:41:33.622686+0000","last_peered":"2024-09-10T08:41:33.622686+0000","last_clean":"2024-09-10T08:41:33.622686+0000","last_became_active":"2024-09-10T08:41:32.593195+0000","last_became_peered":"2024-09-10T08:41:32.593195+0000","last_unstale":"2024-09-10T08:41:33.622686+0000","last_undegraded":"2024-09-10T08:41:33.622686+0000","last_fullsized":"2024-09-10T08:41:33.622686+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:37.592996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917068+0000","last_change":"2024-09-10T08:41:33.620455+0000","last_active":"2024-09-10T08:41:34.917068+0000","last_peered":"2024-09-10T08:41:34.917068+0000","last_clean":"2024-09-10T08:41:34.917068+0000","last_became_active":"2024-09-10T08:41:33.620069+0000","last_became_peered":"2024-09-10T08:41:33.620069+0000","last_unstale":"2024-09-10T08:41:34.917068+0000","last_undegraded":"2024-09-10T08:41:34.917068+0000","last_fullsized":"2024-09-10T08:41:34.917068+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:20.156359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606425+0000","last_change":"2024-09-10T08:41:32.602663+0000","last_active":"2024-09-10T08:41:33.606425+0000","last_peered":"2024-09-10T08:41:33.606425+0000","last_clean":"2024-09-10T08:41:33.606425+0000","last_became_active":"2024-09-10T08:41:32.602403+0000","last_became_peered":"2024-09-10T08:41:32.602403+0000","last_unstale":"2024-09-10T08:41:33.606425+0000","last_undegraded":"2024-09-10T08:41:33.606425+0000","last_fullsized":"2024-09-10T08:41:33.606425+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:06.744592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.621299+0000","last_change":"2024-09-10T08:41:33.619273+0000","last_active":"2024-09-10T08:41:33.621299+0000","last_peered":"2024-09-10T08:41:33.621299+0000","last_clean":"2024-09-10T08:41:33.621299+0000","last_became_active":"2024-09-10T08:41:33.617631+0000","last_became_peered":"2024-09-10T08:41:33.617631+0000","last_unstale":"2024-09-10T08:41:33.621299+0000","last_undegraded":"2024-09-10T08:41:33.621299+0000","last_fullsized":"2024-09-10T08:41:33.621299+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:29.518077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598891+0000","last_change":"2024-09-10T08:41:32.591515+0000","last_active":"2024-09-10T08:41:33.598891+0000","last_peered":"2024-09-10T08:41:33.598891+0000","last_clean":"2024-09-10T08:41:33.598891+0000","last_became_active":"2024-09-10T08:41:32.591212+0000","last_became_peered":"2024-09-10T08:41:32.591212+0000","last_unstale":"2024-09-10T08:41:33.598891+0000","last_undegraded":"2024-09-10T08:41:33.598891+0000","last_fullsized":"2024-09-10T08:41:33.598891+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:52.677734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916735+0000","last_change":"2024-09-10T08:41:33.615251+0000","last_active":"2024-09-10T08:41:34.916735+0000","last_peered":"2024-09-10T08:41:34.916735+0000","last_clean":"2024-09-10T08:41:34.916735+0000","last_became_active":"2024-09-10T08:41:33.613368+0000","last_became_peered":"2024-09-10T08:41:33.613368+0000","last_unstale":"2024-09-10T08:41:34.916735+0000","last_undegraded":"2024-09-10T08:41:34.916735+0000","last_fullsized":"2024-09-10T08:41:34.916735+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:44.581617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"182'2","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.607722+0000","last_change":"2024-09-10T08:41:32.597817+0000","last_active":"2024-09-10T08:41:33.607722+0000","last_peered":"2024-09-10T08:41:33.607722+0000","last_clean":"2024-09-10T08:41:33.607722+0000","last_became_active":"2024-09-10T08:41:32.597508+0000","last_became_peered":"2024-09-10T08:41:32.597508+0000","last_unstale":"2024-09-10T08:41:33.607722+0000","last_undegraded":"2024-09-10T08:41:33.607722+0000","last_fullsized":"2024-09-10T08:41:33.607722+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:37.641850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.625047+0000","last_change":"2024-09-10T08:41:33.623942+0000","last_active":"2024-09-10T08:41:33.625047+0000","last_peered":"2024-09-10T08:41:33.625047+0000","last_clean":"2024-09-10T08:41:33.625047+0000","last_became_active":"2024-09-10T08:41:33.623399+0000","last_became_peered":"2024-09-10T08:41:33.623399+0000","last_unstale":"2024-09-10T08:41:33.625047+0000","last_undegraded":"2024-09-10T08:41:33.625047+0000","last_fullsized":"2024-09-10T08:41:33.625047+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:47:12.480917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604688+0000","last_change":"2024-09-10T08:41:32.594615+0000","last_active":"2024-09-10T08:41:34.604688+0000","last_peered":"2024-09-10T08:41:34.604688+0000","last_clean":"2024-09-10T08:41:34.604688+0000","last_became_active":"2024-09-10T08:41:32.594261+0000","last_became_peered":"2024-09-10T08:41:32.594261+0000","last_unstale":"2024-09-10T08:41:34.604688+0000","last_undegraded":"2024-09-10T08:41:34.604688+0000","last_fullsized":"2024-09-10T08:41:34.604688+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:51.935165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.604930+0000","last_change":"2024-09-10T08:41:33.601715+0000","last_active":"2024-09-10T08:41:33.604930+0000","last_peered":"2024-09-10T08:41:33.604930+0000","last_clean":"2024-09-10T08:41:33.604930+0000","last_became_active":"2024-09-10T08:41:33.599534+0000","last_became_peered":"2024-09-10T08:41:33.599534+0000","last_unstale":"2024-09-10T08:41:33.604930+0000","last_undegraded":"2024-09-10T08:41:33.604930+0000","last_fullsized":"2024-09-10T08:41:33.604930+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:41.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916564+0000","last_change":"2024-09-10T08:41:32.608050+0000","last_active":"2024-09-10T08:41:34.916564+0000","last_peered":"2024-09-10T08:41:34.916564+0000","last_clean":"2024-09-10T08:41:34.916564+0000","last_became_active":"2024-09-10T08:41:32.607771+0000","last_became_peered":"2024-09-10T08:41:32.607771+0000","last_unstale":"2024-09-10T08:41:34.916564+0000","last_undegraded":"2024-09-10T08:41:34.916564+0000","last_fullsized":"2024-09-10T08:41:34.916564+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:40.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.612411+0000","last_change":"2024-09-10T08:41:33.603423+0000","last_active":"2024-09-10T08:41:33.612411+0000","last_peered":"2024-09-10T08:41:33.612411+0000","last_clean":"2024-09-10T08:41:33.612411+0000","last_became_active":"2024-09-10T08:41:33.602895+0000","last_became_peered":"2024-09-10T08:41:33.602895+0000","last_unstale":"2024-09-10T08:41:33.612411+0000","last_undegraded":"2024-09-10T08:41:33.612411+0000","last_fullsized":"2024-09-10T08:41:33.612411+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:27:11.095862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604545+0000","last_change":"2024-09-10T08:41:32.602752+0000","last_active":"2024-09-10T08:41:34.604545+0000","last_peered":"2024-09-10T08:41:34.604545+0000","last_clean":"2024-09-10T08:41:34.604545+0000","last_became_active":"2024-09-10T08:41:32.600578+0000","last_became_peered":"2024-09-10T08:41:32.600578+0000","last_unstale":"2024-09-10T08:41:34.604545+0000","last_undegraded":"2024-09-10T08:41:34.604545+0000","last_fullsized":"2024-09-10T08:41:34.604545+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:02:25.642470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603678+0000","last_change":"2024-09-10T08:41:33.621320+0000","last_active":"2024-09-10T08:41:34.603678+0000","last_peered":"2024-09-10T08:41:34.603678+0000","last_clean":"2024-09-10T08:41:34.603678+0000","last_became_active":"2024-09-10T08:41:33.621013+0000","last_became_peered":"2024-09-10T08:41:33.621013+0000","last_unstale":"2024-09-10T08:41:34.603678+0000","last_undegraded":"2024-09-10T08:41:34.603678+0000","last_fullsized":"2024-09-10T08:41:34.603678+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:53.239248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"182'2","reported_seq":16,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.606079+0000","last_change":"2024-09-10T08:41:32.604013+0000","last_active":"2024-09-10T08:41:34.606079+0000","last_peered":"2024-09-10T08:41:34.606079+0000","last_clean":"2024-09-10T08:41:34.606079+0000","last_became_active":"2024-09-10T08:41:32.602983+0000","last_became_peered":"2024-09-10T08:41:32.602983+0000","last_unstale":"2024-09-10T08:41:34.606079+0000","last_undegraded":"2024-09-10T08:41:34.606079+0000","last_fullsized":"2024-09-10T08:41:34.606079+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:41.522054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.619751+0000","last_change":"2024-09-10T08:41:33.618420+0000","last_active":"2024-09-10T08:41:33.619751+0000","last_peered":"2024-09-10T08:41:33.619751+0000","last_clean":"2024-09-10T08:41:33.619751+0000","last_became_active":"2024-09-10T08:41:33.615696+0000","last_became_peered":"2024-09-10T08:41:33.615696+0000","last_unstale":"2024-09-10T08:41:33.619751+0000","last_undegraded":"2024-09-10T08:41:33.619751+0000","last_fullsized":"2024-09-10T08:41:33.619751+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:23.214975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.589509+0000","last_change":"2024-09-10T08:41:32.603023+0000","last_active":"2024-09-10T08:41:33.589509+0000","last_peered":"2024-09-10T08:41:33.589509+0000","last_clean":"2024-09-10T08:41:33.589509+0000","last_became_active":"2024-09-10T08:41:32.602707+0000","last_became_peered":"2024-09-10T08:41:32.602707+0000","last_unstale":"2024-09-10T08:41:33.589509+0000","last_undegraded":"2024-09-10T08:41:33.589509+0000","last_fullsized":"2024-09-10T08:41:33.589509+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:02.734090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.608547+0000","last_change":"2024-09-10T08:41:33.606762+0000","last_active":"2024-09-10T08:41:33.608547+0000","last_peered":"2024-09-10T08:41:33.608547+0000","last_clean":"2024-09-10T08:41:33.608547+0000","last_became_active":"2024-09-10T08:41:33.604977+0000","last_became_peered":"2024-09-10T08:41:33.604977+0000","last_unstale":"2024-09-10T08:41:33.608547+0000","last_undegraded":"2024-09-10T08:41:33.608547+0000","last_fullsized":"2024-09-10T08:41:33.608547+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:26:35.220839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.598342+0000","last_change":"2024-09-10T08:41:32.598971+0000","last_active":"2024-09-10T08:41:33.598342+0000","last_peered":"2024-09-10T08:41:33.598342+0000","last_clean":"2024-09-10T08:41:33.598342+0000","last_became_active":"2024-09-10T08:41:32.597696+0000","last_became_peered":"2024-09-10T08:41:32.597696+0000","last_unstale":"2024-09-10T08:41:33.598342+0000","last_undegraded":"2024-09-10T08:41:33.598342+0000","last_fullsized":"2024-09-10T08:41:33.598342+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:16:18.061327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603505+0000","last_change":"2024-09-10T08:41:33.611758+0000","last_active":"2024-09-10T08:41:34.603505+0000","last_peered":"2024-09-10T08:41:34.603505+0000","last_clean":"2024-09-10T08:41:34.603505+0000","last_became_active":"2024-09-10T08:41:33.611481+0000","last_became_peered":"2024-09-10T08:41:33.611481+0000","last_unstale":"2024-09-10T08:41:34.603505+0000","last_undegraded":"2024-09-10T08:41:34.603505+0000","last_fullsized":"2024-09-10T08:41:34.603505+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:24.819169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.599054+0000","last_change":"2024-09-10T08:41:32.610842+0000","last_active":"2024-09-10T08:41:33.599054+0000","last_peered":"2024-09-10T08:41:33.599054+0000","last_clean":"2024-09-10T08:41:33.599054+0000","last_became_active":"2024-09-10T08:41:32.610534+0000","last_became_peered":"2024-09-10T08:41:32.610534+0000","last_unstale":"2024-09-10T08:41:33.599054+0000","last_undegraded":"2024-09-10T08:41:33.599054+0000","last_fullsized":"2024-09-10T08:41:33.599054+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:01:50.852085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.626072+0000","last_change":"2024-09-10T08:41:33.624636+0000","last_active":"2024-09-10T08:41:33.626072+0000","last_peered":"2024-09-10T08:41:33.626072+0000","last_clean":"2024-09-10T08:41:33.626072+0000","last_became_active":"2024-09-10T08:41:33.623127+0000","last_became_peered":"2024-09-10T08:41:33.623127+0000","last_unstale":"2024-09-10T08:41:33.626072+0000","last_undegraded":"2024-09-10T08:41:33.626072+0000","last_fullsized":"2024-09-10T08:41:33.626072+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:02.992586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.606243+0000","last_change":"2024-09-10T08:41:32.605407+0000","last_active":"2024-09-10T08:41:33.606243+0000","last_peered":"2024-09-10T08:41:33.606243+0000","last_clean":"2024-09-10T08:41:33.606243+0000","last_became_active":"2024-09-10T08:41:32.604962+0000","last_became_peered":"2024-09-10T08:41:32.604962+0000","last_unstale":"2024-09-10T08:41:33.606243+0000","last_undegraded":"2024-09-10T08:41:33.606243+0000","last_fullsized":"2024-09-10T08:41:33.606243+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:59.992191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.613581+0000","last_change":"2024-09-10T08:41:33.607408+0000","last_active":"2024-09-10T08:41:33.613581+0000","last_peered":"2024-09-10T08:41:33.613581+0000","last_clean":"2024-09-10T08:41:33.613581+0000","last_became_active":"2024-09-10T08:41:33.607133+0000","last_became_peered":"2024-09-10T08:41:33.607133+0000","last_unstale":"2024-09-10T08:41:33.613581+0000","last_undegraded":"2024-09-10T08:41:33.613581+0000","last_fullsized":"2024-09-10T08:41:33.613581+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:05:16.344217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.917009+0000","last_change":"2024-09-10T08:41:32.609032+0000","last_active":"2024-09-10T08:41:34.917009+0000","last_peered":"2024-09-10T08:41:34.917009+0000","last_clean":"2024-09-10T08:41:34.917009+0000","last_became_active":"2024-09-10T08:41:32.608800+0000","last_became_peered":"2024-09-10T08:41:32.608800+0000","last_unstale":"2024-09-10T08:41:34.917009+0000","last_undegraded":"2024-09-10T08:41:34.917009+0000","last_fullsized":"2024-09-10T08:41:34.917009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:01:06.744592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.604334+0000","last_change":"2024-09-10T08:41:33.603487+0000","last_active":"2024-09-10T08:41:34.604334+0000","last_peered":"2024-09-10T08:41:34.604334+0000","last_clean":"2024-09-10T08:41:34.604334+0000","last_became_active":"2024-09-10T08:41:33.599583+0000","last_became_peered":"2024-09-10T08:41:33.599583+0000","last_unstale":"2024-09-10T08:41:34.604334+0000","last_undegraded":"2024-09-10T08:41:34.604334+0000","last_fullsized":"2024-09-10T08:41:34.604334+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:19:37.370470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.603275+0000","last_change":"2024-09-10T08:41:32.603567+0000","last_active":"2024-09-10T08:41:34.603275+0000","last_peered":"2024-09-10T08:41:34.603275+0000","last_clean":"2024-09-10T08:41:34.603275+0000","last_became_active":"2024-09-10T08:41:32.603279+0000","last_became_peered":"2024-09-10T08:41:32.603279+0000","last_unstale":"2024-09-10T08:41:34.603275+0000","last_undegraded":"2024-09-10T08:41:34.603275+0000","last_fullsized":"2024-09-10T08:41:34.603275+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:46:25.478865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.612388+0000","last_change":"2024-09-10T08:41:33.603198+0000","last_active":"2024-09-10T08:41:33.612388+0000","last_peered":"2024-09-10T08:41:33.612388+0000","last_clean":"2024-09-10T08:41:33.612388+0000","last_became_active":"2024-09-10T08:41:33.602465+0000","last_became_peered":"2024-09-10T08:41:33.602465+0000","last_unstale":"2024-09-10T08:41:33.612388+0000","last_undegraded":"2024-09-10T08:41:33.612388+0000","last_fullsized":"2024-09-10T08:41:33.612388+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:32:18.776125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.602239+0000","last_change":"2024-09-10T08:41:32.610706+0000","last_active":"2024-09-10T08:41:33.602239+0000","last_peered":"2024-09-10T08:41:33.602239+0000","last_clean":"2024-09-10T08:41:33.602239+0000","last_became_active":"2024-09-10T08:41:32.610407+0000","last_became_peered":"2024-09-10T08:41:32.610407+0000","last_unstale":"2024-09-10T08:41:33.602239+0000","last_undegraded":"2024-09-10T08:41:33.602239+0000","last_fullsized":"2024-09-10T08:41:33.602239+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:11.985161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-09-10T08:41:34.916620+0000","last_change":"2024-09-10T08:41:33.627602+0000","last_active":"2024-09-10T08:41:34.916620+0000","last_peered":"2024-09-10T08:41:34.916620+0000","last_clean":"2024-09-10T08:41:34.916620+0000","last_became_active":"2024-09-10T08:41:33.627312+0000","last_became_peered":"2024-09-10T08:41:33.627312+0000","last_unstale":"2024-09-10T08:41:34.916620+0000","last_undegraded":"2024-09-10T08:41:34.916620+0000","last_fullsized":"2024-09-10T08:41:34.916620+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":181,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:32.574935+0000","last_clean_scrub_stamp":"2024-09-10T08:41:32.574935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:11:45.435795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"182'1","reported_seq":13,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.618290+0000","last_change":"2024-09-10T08:41:32.603225+0000","last_active":"2024-09-10T08:41:33.618290+0000","last_peered":"2024-09-10T08:41:33.618290+0000","last_clean":"2024-09-10T08:41:33.618290+0000","last_became_active":"2024-09-10T08:41:32.602916+0000","last_became_peered":"2024-09-10T08:41:32.602916+0000","last_unstale":"2024-09-10T08:41:33.618290+0000","last_undegraded":"2024-09-10T08:41:33.618290+0000","last_fullsized":"2024-09-10T08:41:33.618290+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:41:31.572092+0000","last_clean_scrub_stamp":"2024-09-10T08:41:31.572092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:47.503039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":463,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-10T08:41:33.601432+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:41:33.601432+0000","last_peered":"2024-09-10T08:41:33.601432+0000","last_clean":"2024-09-10T08:41:33.601432+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:41:33.601432+0000","last_undegraded":"2024-09-10T08:41:33.601432+0000","last_fullsized":"2024-09-10T08:41:33.601432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51468,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320372,"statfs":{"total":96636764160,"available":96584060928,"internally_reserved":0,"allocated":2289664,"data_stored":1005250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2289664,"data_stored":1005298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2289664,"data_stored":1005318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509599,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69468,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302372,"statfs":{"total":96636764160,"available":96565628928,"internally_reserved":0,"allocated":2297856,"data_stored":1006840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509600,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2306048,"data_stored":1006944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60372,"kb_used_data":2812,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311468,"statfs":{"total":96636764160,"available":96574943232,"internally_reserved":0,"allocated":2879488,"data_stored":1595596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2289664,"data_stored":1005810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60384,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311456,"statfs":{"total":96636764160,"available":96574930944,"internally_reserved":0,"allocated":2895872,"data_stored":1596324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:41:38.239 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:41:38.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:41:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.435+0000 7ff375a00640 1 Processor -- start 2024-09-10T08:41:38.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.435+0000 7ff375a00640 1 -- start start 2024-09-10T08:41:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff375a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3700cf8d0 0x7ff370070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff375a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37015f120 con 0x7ff3700cfcb0 2024-09-10T08:41:38.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff375a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37015f400 con 0x7ff370144a50 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff375a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff370141cd0 con 0x7ff3700cf8d0 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff366000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff3700cfcb0 0x7ff370144340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32898/0 (socket says 172.21.15.52:32898) 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff36ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff3700cf8d0 0x7ff370070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff366000640 1 -- 172.21.15.52:0/2168200516 learned_addr learned my addr 172.21.15.52:0/2168200516 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff36ea00640 1 -- 172.21.15.52:0/2168200516 >> v1:172.21.15.176:6789/0 conn(0x7ff370144a50 legacy=0x7ff3700b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff36ea00640 1 -- 172.21.15.52:0/2168200516 >> v1:172.21.15.52:6789/0 conn(0x7ff3700cfcb0 legacy=0x7ff370144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff36ea00640 1 -- 172.21.15.52:0/2168200516 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37015f6e0 con 0x7ff3700cf8d0 2024-09-10T08:41:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.437+0000 7ff36e000640 1 -- 172.21.15.52:0/2168200516 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196538771 0 0) 0x7ff37015f120 con 0x7ff3700cfcb0 2024-09-10T08:41:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.438+0000 7ff36ea00640 1 --2- 172.21.15.52:0/2168200516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3700cf8d0 0x7ff370070f40 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff3600097a0 tx=0x7ff36002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e854b93a0349f937 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff36e000640 1 -- 172.21.15.52:0/2168200516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360037070 con 0x7ff3700cf8d0 2024-09-10T08:41:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff36e000640 1 -- 172.21.15.52:0/2168200516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360032440 con 0x7ff3700cf8d0 2024-09-10T08:41:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff36e000640 1 -- 172.21.15.52:0/2168200516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360032810 con 0x7ff3700cf8d0 2024-09-10T08:41:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 -- 172.21.15.52:0/2168200516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3700cf8d0 msgr2=0x7ff370070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 --2- 172.21.15.52:0/2168200516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3700cf8d0 0x7ff370070f40 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff3600097a0 tx=0x7ff36002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 -- 172.21.15.52:0/2168200516 shutdown_connections 2024-09-10T08:41:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 --2- 172.21.15.52:0/2168200516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3700cf8d0 0x7ff370070f40 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 -- 172.21.15.52:0/2168200516 >> 172.21.15.52:0/2168200516 conn(0x7ff37006d0f0 msgr2=0x7ff37006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 -- 172.21.15.52:0/2168200516 shutdown_connections 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.439+0000 7ff375a00640 1 -- 172.21.15.52:0/2168200516 wait complete. 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.441+0000 7ff375a00640 1 Processor -- start 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.441+0000 7ff375a00640 1 -- start start 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3700cf8d0 0x7ff370137360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3700cfcb0 0x7ff37015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700ce0f0 con 0x7ff370144a50 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff37015ee30 con 0x7ff3700cfcb0 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff375a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff3700ce270 con 0x7ff3700cf8d0 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff36f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff36f400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34186/0 (socket says 172.21.15.52:34186) 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.442+0000 7ff36f400640 1 -- 172.21.15.52:0/2022898172 learned_addr learned my addr 172.21.15.52:0/2022898172 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff366000640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3700cfcb0 0x7ff37015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36ea00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3700cf8d0 0x7ff370137360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 -- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3700cf8d0 msgr2=0x7ff370137360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3700cf8d0 0x7ff370137360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 -- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3700cfcb0 msgr2=0x7ff37015e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3700cfcb0 0x7ff37015e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 -- 172.21.15.52:0/2022898172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3700cc2f0 con 0x7ff370144a50 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff36f400640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b970 tx=0x7ff36800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.443+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368019070 con 0x7ff370144a50 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.444+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36800cb40 con 0x7ff370144a50 2024-09-10T08:41:38.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.444+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368014440 con 0x7ff370144a50 2024-09-10T08:41:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.444+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3700cc5d0 con 0x7ff370144a50 2024-09-10T08:41:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.444+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37015e6f0 con 0x7ff370144a50 2024-09-10T08:41:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.445+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3700ca290 con 0x7ff370144a50 2024-09-10T08:41:38.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.446+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff36801c070 con 0x7ff370144a50 2024-09-10T08:41:38.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.446+0000 7ff367400640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.447+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7ff36808ab00 con 0x7ff370144a50 2024-09-10T08:41:38.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.447+0000 7ff36ea00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.448+0000 7ff36ea00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff360034000 tx=0x7ff36002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.451+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff368058d30 con 0x7ff370144a50 2024-09-10T08:41:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.701+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff37006f260 con 0x7ff370144a50 2024-09-10T08:41:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.704+0000 7ff367400640 1 -- 172.21.15.52:0/2022898172 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7ff36808ae20 con 0x7ff370144a50 2024-09-10T08:41:38.704 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:41:38.705 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:41:38.705 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:41:38.705 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:41:38.705 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:41:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:41:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 msgr2=0x7ff34c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 0x7ff34c06e2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff360034000 tx=0x7ff36002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 msgr2=0x7ff3700ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff36800b970 tx=0x7ff36800be30 comp rx=0 tx=0).stop 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 shutdown_connections 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff34c06be30 0x7ff34c06e2f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff370144a50 0x7ff3700ca9a0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3700cfcb0 0x7ff37015e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 --2- 172.21.15.52:0/2022898172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3700cf8d0 0x7ff370137360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.706+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 >> 172.21.15.52:0/2022898172 conn(0x7ff37006d0f0 msgr2=0x7ff370141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.707+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 shutdown_connections 2024-09-10T08:41:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.707+0000 7ff375a00640 1 -- 172.21.15.52:0/2022898172 wait complete. 2024-09-10T08:41:38.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:41:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.878+0000 7fd7d1c00640 1 Processor -- start 2024-09-10T08:41:38.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.878+0000 7fd7d1c00640 1 -- start start 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.879+0000 7fd7d1c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0b63f0 0x7fd7cc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.879+0000 7fd7d1c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0cfb40 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.879+0000 7fd7d1c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0cfe20 con 0x7fd7cc0b67d0 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.879+0000 7fd7d1c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc0d27f0 con 0x7fd7cc0b63f0 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7cb400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd7cc0b7a30 0x7fd7cc15df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32912/0 (socket says 172.21.15.52:32912) 2024-09-10T08:41:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7cb400640 1 -- 172.21.15.52:0/3454002227 learned_addr learned my addr 172.21.15.52:0/3454002227 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/3454002227 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0b63f0 0x7fd7cc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78825042 0 0) 0x7fd7cc0cfb40 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b0003520 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351899344 0 0) 0x7fd7cc0cfe20 con 0x7fd7cc0b67d0 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7cc0cfb40 con 0x7fd7cc0b67d0 2024-09-10T08:41:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4245623280 0 0) 0x7fd7b0003520 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0b63f0 msgr2=0x7fd7cc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 --2- 172.21.15.52:0/3454002227 >> v2:172.21.15.176:3300/0 conn(0x7fd7cc0b63f0 0x7fd7cc0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 >> v1:172.21.15.176:6789/0 conn(0x7fd7cc0b67d0 legacy=0x7fd7cc0d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0d2e00 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fd7b8001670 con 0x7fd7cc0b7a30 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 >> v1:172.21.15.52:6789/0 conn(0x7fd7cc0b7a30 legacy=0x7fd7cc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 0x7fd7b0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7b0004800 0x7fd7b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.880+0000 7fd7caa00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b00051c0 0x7fd7b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b000c090 con 0x7fd7b0003b90 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b000c210 con 0x7fd7b00051c0 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b000c410 con 0x7fd7b0004800 2024-09-10T08:41:38.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 0x7fd7b0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7d1200640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b00051c0 0x7fd7b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cb400640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7b0004800 0x7fd7b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 -- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7b0004800 msgr2=0x7fd7b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7b0004800 0x7fd7b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 -- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b00051c0 msgr2=0x7fd7b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b00051c0 0x7fd7b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cbe00640 1 -- 172.21.15.52:0/3454002227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b0003520 con 0x7fd7b0003b90 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7d1200640 1 -- 172.21.15.52:0/3454002227 reap_dead start 2024-09-10T08:41:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.881+0000 7fd7cb400640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7b0004800 0x7fd7b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:38.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.882+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 0x7fd7b0003f90 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009ac0 tx=0x7fd7b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eddd97232673662 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.882+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc036070 con 0x7fd7b0003b90 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc031400 con 0x7fd7b0003b90 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7caa00640 1 -- 172.21.15.52:0/3454002227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc009690 con 0x7fd7b0003b90 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 -- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 msgr2=0x7fd7b0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 0x7fd7b0003f90 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009ac0 tx=0x7fd7b0005830 comp rx=0 tx=0).stop 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 -- 172.21.15.52:0/3454002227 shutdown_connections 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/3454002227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7b0003b90 0x7fd7b0003f90 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 -- 172.21.15.52:0/3454002227 >> 172.21.15.52:0/3454002227 conn(0x7fd7cc0d1360 msgr2=0x7fd7cc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 -- 172.21.15.52:0/3454002227 shutdown_connections 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.883+0000 7fd7d1c00640 1 -- 172.21.15.52:0/3454002227 wait complete. 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.885+0000 7fd7d1c00640 1 Processor -- start 2024-09-10T08:41:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.885+0000 7fd7d1c00640 1 -- start start 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b0003b90 0x7fd7cc0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc1f3bf0 0x7fd7cc156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0cf0e0 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0cef60 con 0x7fd7b0003b90 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0cf260 con 0x7fd7cc1f3bf0 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34198/0 (socket says 172.21.15.52:34198) 2024-09-10T08:41:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 -- 172.21.15.52:0/655970449 learned_addr learned my addr 172.21.15.52:0/655970449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b0003b90 0x7fd7cc0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7cb400640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc1f3bf0 0x7fd7cc156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 -- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc1f3bf0 msgr2=0x7fd7cc156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc1f3bf0 0x7fd7cc156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 -- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b0003b90 msgr2=0x7fd7cc0ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b0003b90 0x7fd7cc0ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.886+0000 7fd7d1200640 1 -- 172.21.15.52:0/655970449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc159b80 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7d1200640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0d2450 tx=0x7fd7c4007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003c40 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c4018070 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40050d0 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc0ceac0 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.887+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc1f4360 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.888+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc0cf590 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.889+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7c4005270 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.890+0000 7fd7c3e00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:38.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.890+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c408ae70 con 0x7fd7cc0ca3a0 2024-09-10T08:41:38.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.890+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:38.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.891+0000 7fd7cbe00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc033000 tx=0x7fd7bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:38.894+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7cc159b80 con 0x7fd7cc0ca3a0 2024-09-10T08:41:39.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.114+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7cc069b20 con 0x7fd7cc0ca3a0 2024-09-10T08:41:39.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.115+0000 7fd7c3e00640 1 -- 172.21.15.52:0/655970449 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7fd7c401a310 con 0x7fd7cc0ca3a0 2024-09-10T08:41:39.115 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:39.115 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:41:39.116 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 msgr2=0x7fd7ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc033000 tx=0x7fd7bc008030 comp rx=0 tx=0).stop 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 msgr2=0x7fd7cc0ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0d2450 tx=0x7fd7c4007b80 comp rx=0 tx=0).stop 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 shutdown_connections 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd7ac06be30 0x7fd7ac06e2f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7cc0ca3a0 0x7fd7cc0ca850 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7cc1f3bf0 0x7fd7cc156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 --2- 172.21.15.52:0/655970449 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7b0003b90 0x7fd7cc0ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 >> 172.21.15.52:0/655970449 conn(0x7fd7cc0d1360 msgr2=0x7fd7cc0b9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 shutdown_connections 2024-09-10T08:41:39.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.117+0000 7fd7d1c00640 1 -- 172.21.15.52:0/655970449 wait complete. 2024-09-10T08:41:39.173 INFO:tasks.ceph.mds.b.smithi176.stderr:2024-09-10T08:41:39.173+0000 7f8beb600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:41:39.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 141, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:41:33.015700+0000', 'modified': '2024-09-10T08:41:36.030085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10176}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10176': {'gid': 10176, 'name': 'b', 'rank': 0, 'incarnation': 137, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6837/1803120524', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6835', 'nonce': 1803120524}, {'type': 'v1', 'addr': '172.21.15.176:6837', 'nonce': 1803120524}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10176, 'qdb_cluster': [10176]} 2024-09-10T08:41:39.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:41:39.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T08:41:39.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.697+0000 7f02d2e00640 1 Processor -- start 2024-09-10T08:41:39.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.698+0000 7f02d2e00640 1 -- start start 2024-09-10T08:41:39.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d2e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02cc0b5880 0x7f02cc0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d2e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02cc0b4020 con 0x7f02cc145ed0 2024-09-10T08:41:39.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d2e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f02cc0b42c0 con 0x7f02cc0b5880 2024-09-10T08:41:39.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc0b45a0 con 0x7f02cc073890 2024-09-10T08:41:39.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d0e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02cc0b5880 0x7f02cc0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02c3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d0e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f02cc0b5880 0x7f02cc0b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:35588/0 (socket says 172.21.15.52:35588) 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02d0e00640 1 -- 172.21.15.52:0/1023278944 learned_addr learned my addr 172.21.15.52:0/1023278944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.699+0000 7f02c3400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:34754/0 (socket says 172.21.15.52:34754) 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.700+0000 7f02d0e00640 1 -- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 msgr2=0x7f02cc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.700+0000 7f02d0e00640 1 --2- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.700+0000 7f02d0e00640 1 -- 172.21.15.52:0/1023278944 >> v1:172.21.15.176:6789/0 conn(0x7f02cc145ed0 legacy=0x7f02cc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.700+0000 7f02d0e00640 1 -- 172.21.15.52:0/1023278944 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc0b4880 con 0x7f02cc0b5880 2024-09-10T08:41:39.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.700+0000 7f02cb400640 1 -- 172.21.15.52:0/1023278944 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582487093 0 0) 0x7f02cc0b4020 con 0x7f02cc145ed0 2024-09-10T08:41:39.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.701+0000 7f02d0e00640 1 --2- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc0b5d30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009e50 tx=0x7f02c402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8c002f1091e088 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.701+0000 7f02cb400640 1 -- 172.21.15.52:0/1023278944 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4036070 con 0x7f02cc0b5880 2024-09-10T08:41:39.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.701+0000 7f02cb400640 1 -- 172.21.15.52:0/1023278944 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4031600 con 0x7f02cc0b5880 2024-09-10T08:41:39.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.701+0000 7f02cb400640 1 -- 172.21.15.52:0/1023278944 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40319d0 con 0x7f02cc0b5880 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 -- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 msgr2=0x7f02cc0b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 --2- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc0b5d30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009e50 tx=0x7f02c402a710 comp rx=0 tx=0).stop 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 -- 172.21.15.52:0/1023278944 shutdown_connections 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 --2- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc0b5d30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 --2- 172.21.15.52:0/1023278944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 -- 172.21.15.52:0/1023278944 >> 172.21.15.52:0/1023278944 conn(0x7f02cc0ccec0 msgr2=0x7f02cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 -- 172.21.15.52:0/1023278944 shutdown_connections 2024-09-10T08:41:39.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.702+0000 7f02d2e00640 1 -- 172.21.15.52:0/1023278944 wait complete. 2024-09-10T08:41:39.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.704+0000 7f02d2e00640 1 Processor -- start 2024-09-10T08:41:39.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.704+0000 7f02d2e00640 1 -- start start 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc0b6270 con 0x7f02cc145ed0 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1462b0 con 0x7f02cc0b5880 2024-09-10T08:41:39.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d2e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc13f770 con 0x7f02cc073890 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34206/0 (socket says 172.21.15.52:34206) 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02d0e00640 1 -- 172.21.15.52:0/2906928743 learned_addr learned my addr 172.21.15.52:0/2906928743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02cbe00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.705+0000 7f02c3400640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 -- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 msgr2=0x7f02cc13fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc13fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 -- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 msgr2=0x7f02cc144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 -- 172.21.15.52:0/2906928743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc13ee40 con 0x7f02cc145ed0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02cbe00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d0e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009f70 tx=0x7f02c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02c8c00640 1 -- 172.21.15.52:0/2906928743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4041020 con 0x7f02cc145ed0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02c8c00640 1 -- 172.21.15.52:0/2906928743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c4008730 con 0x7f02cc145ed0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02c8c00640 1 -- 172.21.15.52:0/2906928743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4036040 con 0x7f02cc145ed0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc13f120 con 0x7f02cc145ed0 2024-09-10T08:41:39.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.706+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc144d70 con 0x7f02cc145ed0 2024-09-10T08:41:39.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.709+0000 7f02c8c00640 1 -- 172.21.15.52:0/2906928743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02c4044020 con 0x7f02cc145ed0 2024-09-10T08:41:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.709+0000 7f02c8c00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.709+0000 7f02c8c00640 1 -- 172.21.15.52:0/2906928743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f02c40ab990 con 0x7f02cc145ed0 2024-09-10T08:41:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.710+0000 7f02cbe00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.710+0000 7f02d5e00740 1 Processor -- start 2024-09-10T08:41:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.710+0000 7f02d5e00740 1 -- start start 2024-09-10T08:41:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02cbe00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 0x7f02a806e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000f60 tx=0x7f02bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d125490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d0e1480 0x55f89d0da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f89d03e3b0 con 0x55f89d0dd4b0 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f89d043410 con 0x55f89d0dfcf0 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f89cfeb620 con 0x55f89d0e1480 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34208/0 (socket says 172.21.15.52:34208) 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02c3400640 1 -- 172.21.15.52:0/715349301 learned_addr learned my addr 172.21.15.52:0/715349301 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02cbe00640 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d125490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.711+0000 7f02d0e00640 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d0e1480 0x55f89d0da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 -- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d0e1480 msgr2=0x55f89d0da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d0e1480 0x55f89d0da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 -- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 msgr2=0x55f89d125490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d125490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 -- 172.21.15.52:0/715349301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89cd562d0 con 0x55f89d0dd4b0 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c3400640 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009bf0 tx=0x7f02b4011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476c5e6c99a620b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c0c00640 1 -- 172.21.15.52:0/715349301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4019070 con 0x55f89d0dd4b0 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c0c00640 1 -- 172.21.15.52:0/715349301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4004030 con 0x55f89d0dd4b0 2024-09-10T08:41:39.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.712+0000 7f02c0c00640 1 -- 172.21.15.52:0/715349301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40043e0 con 0x55f89d0dd4b0 2024-09-10T08:41:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 -- 172.21.15.52:0/715349301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 msgr2=0x55f89d0e00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009bf0 tx=0x7f02b4011690 comp rx=0 tx=0).stop 2024-09-10T08:41:39.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 -- 172.21.15.52:0/715349301 shutdown_connections 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d0e1480 0x55f89d0da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dd4b0 0x55f89d0e00d0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 --2- 172.21.15.52:0/715349301 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d125490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 -- 172.21.15.52:0/715349301 >> 172.21.15.52:0/715349301 conn(0x55f89d0dc740 msgr2=0x55f89d124960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 -- 172.21.15.52:0/715349301 shutdown_connections 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.713+0000 7f02d5e00740 1 -- 172.21.15.52:0/715349301 wait complete. 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.714+0000 7f02d5e00740 1 -- start start 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.714+0000 7f02d5e00740 1 Processor -- start 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d0fe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d108730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f89cffe780 con 0x55f89d0dfcf0 2024-09-10T08:41:39.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f89d03f3d0 con 0x55f89d0e1480 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f89d0dbbe0 con 0x55f89d109710 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02d5e00740 10 client.0 _ll_register_callbacks cb 0x55f89d03c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34212/0 (socket says 172.21.15.52:34212) 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 -- 172.21.15.52:0/1042865944 learned_addr learned my addr 172.21.15.52:0/1042865944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 -- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 msgr2=0x55f89d108730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d108730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 -- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 msgr2=0x55f89d0fe1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02c3400640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d0fe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d0fe1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02cbe00640 1 -- 172.21.15.52:0/1042865944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89ce206b0 con 0x55f89d0dfcf0 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.715+0000 7f02c3400640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d0fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:39.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02cbe00640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00ea90 tx=0x7f02bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc78ceaacfa3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02b9600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc027060 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f02bc010040 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b4004030 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f02bc003d80 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02d5e00740 10 client.10296 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55f89d100920 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.716+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4004030 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f02bc013420 con 0x55f89d0dfcf0 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 10 client.10296 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 10 client.10296 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:41:39.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 20 client.10296 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d138820 0x55f89d135420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 4 client.10296 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f89d050b40 con 0x55f89d138820 2024-09-10T08:41:39.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.717+0000 7f02c3400640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d138820 0x55f89d135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.718+0000 7f02c3400640 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d138820 0x55f89d135420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1438dd96f206274 server_cookie=4a6c567e73950f01 in_seq=0 out_seq=0 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.718+0000 7f02b9600640 10 client.10296 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02b9600640 1 -- 172.21.15.52:0/1042865944 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f89d050b40 con 0x55f89d138820 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02b9600640 10 client.10296 handle_command_reply: tid=0 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 client.10296 shutdown 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 msgr2=0x55f89d1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00ea90 tx=0x7f02bc000ed0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 shutdown_connections 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d138820 0x55f89d135420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d0fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02b9600640 0 client.10296 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 --2- 172.21.15.52:0/1042865944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d1003e0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 >> 172.21.15.52:0/1042865944 conn(0x55f89d0dd4b0 msgr2=0x55f89d123f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.719+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 shutdown_connections 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.720+0000 7f02d5e00740 1 -- 172.21.15.52:0/1042865944 wait complete. 2024-09-10T08:41:39.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.720+0000 7f02d5e00740 20 client.10296 trim_cache size 0 max 16384 2024-09-10T08:41:39.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.738+0000 7f02d5e00740 1 Processor -- start 2024-09-10T08:41:39.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.738+0000 7f02d5e00740 1 -- start start 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d123ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d0ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc13e650 con 0x55f89d0e1480 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc13d9b0 con 0x55f89d0dfcf0 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc13e000 con 0x55f89d109710 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.739+0000 7f02c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34224/0 (socket says 172.21.15.52:34224) 2024-09-10T08:41:39.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 -- 172.21.15.52:0/3912499558 learned_addr learned my addr 172.21.15.52:0/3912499558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02cbe00640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d123ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02d0e00640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d0ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 -- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 msgr2=0x55f89d0ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d0ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 -- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 msgr2=0x55f89d123ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d123ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 -- 172.21.15.52:0/3912499558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f89d078830 con 0x55f89d0e1480 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02d0e00640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d0ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02c3400640 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f02b4011b90 tx=0x7f02b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fccc5877a45d1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02bbe00640 1 -- 172.21.15.52:0/3912499558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4019040 con 0x55f89d0e1480 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02bbe00640 1 -- 172.21.15.52:0/3912499558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4004230 con 0x55f89d0e1480 2024-09-10T08:41:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.740+0000 7f02bbe00640 1 -- 172.21.15.52:0/3912499558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b401e690 con 0x55f89d0e1480 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 -- 172.21.15.52:0/3912499558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 msgr2=0x55f89d1264c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f02b4011b90 tx=0x7f02b4016000 comp rx=0 tx=0).stop 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 -- 172.21.15.52:0/3912499558 shutdown_connections 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d0ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0e1480 0x55f89d1264c0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3912499558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0dfcf0 0x55f89d123ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 -- 172.21.15.52:0/3912499558 >> 172.21.15.52:0/3912499558 conn(0x55f89d0dd4b0 msgr2=0x55f89d137430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 -- 172.21.15.52:0/3912499558 shutdown_connections 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.741+0000 7f02d5e00740 1 -- 172.21.15.52:0/3912499558 wait complete. 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.742+0000 7f02d5e00740 1 -- start start 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.742+0000 7f02d5e00740 1 Processor -- start 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d103f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d1229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f89d1386a0 con 0x55f89d0dfcf0 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55f89d108c70 con 0x55f89d0e1480 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55f89d138cc0 con 0x55f89d109710 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d5e00740 10 client.0 _ll_register_callbacks cb 0x7f02bc0013e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02cbe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34238/0 (socket says 172.21.15.52:34238) 2024-09-10T08:41:39.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02cbe00640 1 -- 172.21.15.52:0/3386330805 learned_addr learned my addr 172.21.15.52:0/3386330805 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02c3400640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02d0e00640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d1229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02cbe00640 1 -- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 msgr2=0x55f89d1229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.743+0000 7f02cbe00640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d1229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02cbe00640 1 -- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 msgr2=0x55f89d103f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02cbe00640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d103f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02cbe00640 1 -- 172.21.15.52:0/3386330805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f89d03f590 con 0x55f89d0dfcf0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02c3400640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02d0e00640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d1229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02cbe00640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e650 tx=0x7f02bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ef7fad0f92c4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02b9600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc027070 con 0x55f89d0dfcf0 2024-09-10T08:41:39.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f02bc010040 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b4004230 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f02bc013b80 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02d5e00740 10 client.10302 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.744+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55f89d1048d0 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4004230 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f02bc036450 con 0x55f89d0dfcf0 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 10 client.10302 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 10 client.10302 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 20 client.10302 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d0ddfc0 0x55f89d0d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 4 client.10302 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:41:39.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "status"}) -- 0x55f89d04ae90 con 0x55f89d0ddfc0 2024-09-10T08:41:39.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.745+0000 7f02c3400640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d0ddfc0 0x55f89d0d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02c3400640 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d0ddfc0 0x55f89d0d9530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4729a9f864069aed server_cookie=d518beda42d465bc in_seq=0 out_seq=0 2024-09-10T08:41:39.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02b9600640 10 client.10302 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:39.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02b9600640 1 -- 172.21.15.52:0/3386330805 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55f89d04ae90 con 0x55f89d0ddfc0 2024-09-10T08:41:39.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02b9600640 10 client.10302 handle_command_reply: tid=0 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 client.10302 shutdown 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 msgr2=0x55f89d19d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e650 tx=0x7f02bc013000 comp rx=0 tx=0).stop 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 shutdown_connections 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55f89d0ddfc0 0x55f89d0d9530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55f89d109710 0x55f89d1229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55f89d0e1480 0x55f89d103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 --2- 172.21.15.52:0/3386330805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f89d0dfcf0 0x55f89d19d320 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.746+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 >> 172.21.15.52:0/3386330805 conn(0x55f89d0dd4b0 msgr2=0x55f89d148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02b9600640 0 client.10302 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 shutdown_connections 2024-09-10T08:41:39.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d5e00740 1 -- 172.21.15.52:0/3386330805 wait complete. 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d5e00740 20 client.10302 trim_cache size 0 max 16384 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 10176, 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 6.1618267189999996, 2024-09-10T08:41:39.753 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 141, 2024-09-10T08:41:39.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 183, 2024-09-10T08:41:39.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 183, 2024-09-10T08:41:39.754 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 11.233920289 2024-09-10T08:41:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 msgr2=0x7f02a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 0x7f02a806e2f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000f60 tx=0x7f02bc009040 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 msgr2=0x7f02cc072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009f70 tx=0x7f02c4004a40 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 shutdown_connections 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02cc145ed0 0x7f02cc072ac0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f02cc0b5880 0x7f02cc144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 --2- 172.21.15.52:0/2906928743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f02cc073890 0x7f02cc13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.747+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 >> 172.21.15.52:0/2906928743 conn(0x7f02cc0ccec0 msgr2=0x7f02cc0ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.748+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 shutdown_connections 2024-09-10T08:41:39.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.748+0000 7f02d2e00640 1 -- 172.21.15.52:0/2906928743 wait complete. 2024-09-10T08:41:39.763 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:41:39.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.918+0000 7f35f5600640 1 Processor -- start 2024-09-10T08:41:39.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.919+0000 7f35f5600640 1 -- start start 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35f5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35f5600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f35f00b5880 0x7f35f00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35f5600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f00b4020 con 0x7f35f0145ed0 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35f5600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f35f00b42c0 con 0x7f35f00b5880 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35f5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35f00b45a0 con 0x7f35f0073890 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35eea00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f35f0145ed0 0x7f35f0073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32922/0 (socket says 172.21.15.52:32922) 2024-09-10T08:41:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35eea00640 1 -- 172.21.15.52:0/812874660 learned_addr learned my addr 172.21.15.52:0/812874660 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35ef400640 1 --2- 172.21.15.52:0/812874660 >> v2:172.21.15.52:3300/0 conn(0x7f35f00b5880 0x7f35f00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.920+0000 7f35e7e00640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ee000640 1 -- 172.21.15.52:0/812874660 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108648212 0 0) 0x7f35f00b4020 con 0x7f35f0145ed0 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ee000640 1 -- 172.21.15.52:0/812874660 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d4003520 con 0x7f35f0145ed0 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ef400640 1 -- 172.21.15.52:0/812874660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 msgr2=0x7f35f00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ef400640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ef400640 1 -- 172.21.15.52:0/812874660 >> v1:172.21.15.52:6789/0 conn(0x7f35f0145ed0 legacy=0x7f35f0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.921+0000 7f35ef400640 1 -- 172.21.15.52:0/812874660 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f00b4880 con 0x7f35f00b5880 2024-09-10T08:41:39.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35ef400640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f00b5d30 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577a1b94c56a9866 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35ee000640 1 -- 172.21.15.52:0/812874660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007740 con 0x7f35f00b5880 2024-09-10T08:41:39.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35ee000640 1 -- 172.21.15.52:0/812874660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e80078e0 con 0x7f35f00b5880 2024-09-10T08:41:39.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35ee000640 1 -- 172.21.15.52:0/812874660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007cb0 con 0x7f35f00b5880 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35f5600640 1 -- 172.21.15.52:0/812874660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 msgr2=0x7f35f00b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.922+0000 7f35f5600640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f00b5d30 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009d90 tx=0x7f35e802a660 comp rx=0 tx=0).stop 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 -- 172.21.15.52:0/812874660 shutdown_connections 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f00b5d30 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 --2- 172.21.15.52:0/812874660 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 -- 172.21.15.52:0/812874660 >> 172.21.15.52:0/812874660 conn(0x7f35f00ccec0 msgr2=0x7f35f00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 -- 172.21.15.52:0/812874660 shutdown_connections 2024-09-10T08:41:39.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.923+0000 7f35f5600640 1 -- 172.21.15.52:0/812874660 wait complete. 2024-09-10T08:41:39.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.924+0000 7f35f5600640 1 Processor -- start 2024-09-10T08:41:39.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.924+0000 7f35f5600640 1 -- start start 2024-09-10T08:41:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f013d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35f0145ed0 0x7f35f00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35f00b6270 con 0x7f35f00b5880 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35f01462b0 con 0x7f35f0145ed0 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.925+0000 7f35f5600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f35f0070f70 con 0x7f35f0073890 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35eea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f013d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34252/0 (socket says 172.21.15.52:34252) 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 -- 172.21.15.52:0/3474355320 learned_addr learned my addr 172.21.15.52:0/3474355320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35ef400640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35f0145ed0 0x7f35f00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 -- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 msgr2=0x7f35f013d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f013d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 -- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35f0145ed0 msgr2=0x7f35f00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:39.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35f0145ed0 0x7f35f00cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:39.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.926+0000 7f35e7e00640 1 -- 172.21.15.52:0/3474355320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f00711c0 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35e7e00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e9b0 tx=0x7f35d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8017070 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d800c9a0 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d800cd90 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f00714a0 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.927+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f0071a60 con 0x7f35f00b5880 2024-09-10T08:41:39.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.928+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f00b5080 con 0x7f35f00b5880 2024-09-10T08:41:39.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.929+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35d801a070 con 0x7f35f00b5880 2024-09-10T08:41:39.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.930+0000 7f35e6a00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 0x7f35cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:39.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.930+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f35d808b1e0 con 0x7f35f00b5880 2024-09-10T08:41:39.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.930+0000 7f35eea00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 0x7f35cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:39.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.931+0000 7f35eea00640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 0x7f35cc06e2f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005880 tx=0x7f35e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:39.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:39.934+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35d80594a0 con 0x7f35f00b5880 2024-09-10T08:41:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.157+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35f00d10b0 con 0x7f35f00b5880 2024-09-10T08:41:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.157+0000 7f35e6a00640 1 -- 172.21.15.52:0/3474355320 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v141) ==== 53+0+73 (secure 0 0 0) 0x7f35d805d7a0 con 0x7f35f00b5880 2024-09-10T08:41:40.158 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:41:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 msgr2=0x7f35cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 0x7f35cc06e2f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005880 tx=0x7f35e0009040 comp rx=0 tx=0).stop 2024-09-10T08:41:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 msgr2=0x7f35f01f4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f35d800e9b0 tx=0x7f35d800ee70 comp rx=0 tx=0).stop 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 shutdown_connections 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f35cc06be30 0x7f35cc06e2f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35f0145ed0 0x7f35f00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f00b5880 0x7f35f01f4fc0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 --2- 172.21.15.52:0/3474355320 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f35f0073890 0x7f35f013d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 >> 172.21.15.52:0/3474355320 conn(0x7f35f00ccec0 msgr2=0x7f35f0142910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 shutdown_connections 2024-09-10T08:41:40.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40.160+0000 7f35f5600640 1 -- 172.21.15.52:0/3474355320 wait complete. 2024-09-10T08:41:40.176 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:41:40.176 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:41:40.176 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:41:40.176 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:41:40.177 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:41:40.177 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:41:40.177 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:41:40.177 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:41:40.177 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:41:40.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.177 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:41:40.213 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:41:40.213 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:41:40.213 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:41:40.213 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:41:40.214 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41902sec preferred_lft 41902sec 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:41:40.215 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:41:40.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.216 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:41:40.306 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:41:40.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.310 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:41:40.345 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:41:40.345 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:41:40.346 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:41:40.346 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:41:40.346 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:41:40.346 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:41:40.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:41:40.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:40.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.544 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:41:40.579 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:41:40.580 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:41:40.580 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:41:40.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:41:40.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:41:40.677 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:41:40.712 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:41:40.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:41:40.713 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:41:40.787 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:41:40.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:41:40.915 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:41:40.916 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:41:40.943 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:41:40.944 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:41:40.944 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:41:40.944 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:41:40.944 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:41:40.945 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:41:40.945 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:41:40.945 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:41:40.945 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:41:40.945 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:41:40.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:41:40.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:40.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:41:41.005 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:41:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:41:41.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:41:41.104 INFO:teuthology.orchestra.run.smithi052.stdout:client8300 2024-09-10T08:41:41.105 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:41:41.105 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:41:41.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-10T08:41:41.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.337+0000 7f5dacc00640 1 Processor -- start 2024-09-10T08:41:41.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.337+0000 7f5dacc00640 1 -- start start 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5dacc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5da80cce30 0x7f5da80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5dacc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da80714b0 con 0x7f5da8071c70 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5dacc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da80cd880 con 0x7f5da80732e0 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5dacc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5da80cdb60 con 0x7f5da80cce30 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5da5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5da80cce30 0x7f5da80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5da5400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5da80cce30 0x7f5da80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34254/0 (socket says 172.21.15.52:34254) 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5da5400640 1 -- 172.21.15.52:0/4010628219 learned_addr learned my addr 172.21.15.52:0/4010628219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.338+0000 7f5da6800640 1 --1- 172.21.15.52:0/4010628219 >> v1:172.21.15.52:6789/0 conn(0x7f5da8071c70 0x7f5da815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32926/0 (socket says 172.21.15.52:32926) 2024-09-10T08:41:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.339+0000 7f5da5400640 1 -- 172.21.15.52:0/4010628219 >> v1:172.21.15.176:6789/0 conn(0x7f5da80732e0 legacy=0x7f5da80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.339+0000 7f5da5400640 1 -- 172.21.15.52:0/4010628219 >> v1:172.21.15.52:6789/0 conn(0x7f5da8071c70 legacy=0x7f5da815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.339+0000 7f5da4a00640 1 -- 172.21.15.52:0/4010628219 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940057380 0 0) 0x7f5da80714b0 con 0x7f5da8071c70 2024-09-10T08:41:41.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.339+0000 7f5da5400640 1 -- 172.21.15.52:0/4010628219 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da80cde40 con 0x7f5da80cce30 2024-09-10T08:41:41.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.340+0000 7f5da5400640 1 --2- 172.21.15.52:0/4010628219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80cce30 0x7f5da80cd2a0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209d1c6ed2f76831 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.340+0000 7f5da4a00640 1 -- 172.21.15.52:0/4010628219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94037070 con 0x7f5da80cce30 2024-09-10T08:41:41.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.340+0000 7f5da4a00640 1 -- 172.21.15.52:0/4010628219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94032440 con 0x7f5da80cce30 2024-09-10T08:41:41.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.340+0000 7f5da4a00640 1 -- 172.21.15.52:0/4010628219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94032810 con 0x7f5da80cce30 2024-09-10T08:41:41.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 -- 172.21.15.52:0/4010628219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80cce30 msgr2=0x7f5da80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 --2- 172.21.15.52:0/4010628219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80cce30 0x7f5da80cd2a0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402a210 comp rx=0 tx=0).stop 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 -- 172.21.15.52:0/4010628219 shutdown_connections 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 --2- 172.21.15.52:0/4010628219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80cce30 0x7f5da80cd2a0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 -- 172.21.15.52:0/4010628219 >> 172.21.15.52:0/4010628219 conn(0x7f5da806d0f0 msgr2=0x7f5da806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 -- 172.21.15.52:0/4010628219 shutdown_connections 2024-09-10T08:41:41.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.341+0000 7f5dacc00640 1 -- 172.21.15.52:0/4010628219 wait complete. 2024-09-10T08:41:41.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.342+0000 7f5dacc00640 1 Processor -- start 2024-09-10T08:41:41.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 -- start start 2024-09-10T08:41:41.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 0x7f5da80af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 0x7f5da8150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5da815d160 con 0x7f5da80732e0 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5da815cfe0 con 0x7f5da80cce30 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.343+0000 7f5dacc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5da815d2e0 con 0x7f5da8071c70 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34266/0 (socket says 172.21.15.52:34266) 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 -- 172.21.15.52:0/3386892470 learned_addr learned my addr 172.21.15.52:0/3386892470 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5e00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 0x7f5da80af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da6800640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 0x7f5da8150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 -- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 msgr2=0x7f5da80af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 0x7f5da80af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 -- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 msgr2=0x7f5da8150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 0x7f5da8150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 -- 172.21.15.52:0/3386892470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da80ab4b0 con 0x7f5da80732e0 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da6800640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 0x7f5da8150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5e00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 0x7f5da80af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.344+0000 7f5da5400640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.345+0000 7f5d9e000640 1 -- 172.21.15.52:0/3386892470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94041070 con 0x7f5da80732e0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.345+0000 7f5d9e000640 1 -- 172.21.15.52:0/3386892470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9403c890 con 0x7f5da80732e0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.345+0000 7f5d9e000640 1 -- 172.21.15.52:0/3386892470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94037040 con 0x7f5da80732e0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.345+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da81508a0 con 0x7f5da80732e0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.345+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da8150e60 con 0x7f5da80732e0 2024-09-10T08:41:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.347+0000 7f5d9e000640 1 -- 172.21.15.52:0/3386892470 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d94044070 con 0x7f5da80732e0 2024-09-10T08:41:41.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.348+0000 7f5d9e000640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 0x7f5d8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.348+0000 7f5d9e000640 1 -- 172.21.15.52:0/3386892470 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f5d940abcb0 con 0x7f5da80732e0 2024-09-10T08:41:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.349+0000 7f5da5e00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 0x7f5d8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.349+0000 7f5dafabe740 1 Processor -- start 2024-09-10T08:41:41.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.349+0000 7f5dafabe740 1 -- start start 2024-09-10T08:41:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da5e00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 0x7f5d8806e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006fd0 tx=0x7f5d98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21880 0x55da25d23410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d04040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da25c40490 con 0x55da25d240c0 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55da25be8690 con 0x55da25d21ce0 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55da25c3c450 con 0x55da25d21880 2024-09-10T08:41:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34282/0 (socket says 172.21.15.52:34282) 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da5e00640 1 -- 172.21.15.52:0/179695068 learned_addr learned my addr 172.21.15.52:0/179695068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da5400640 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21880 0x55da25d23410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.350+0000 7f5da6800640 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d04040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 -- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21880 msgr2=0x55da25d23410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21880 0x55da25d23410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 -- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 msgr2=0x55da25d04040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d04040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 -- 172.21.15.52:0/179695068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da25befe00 con 0x55da25d240c0 2024-09-10T08:41:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5da5e00640 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d8e0 tx=0x7f5d98010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0b6dfaa898c038 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5d92600640 1 -- 172.21.15.52:0/179695068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98024070 con 0x55da25d240c0 2024-09-10T08:41:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5d92600640 1 -- 172.21.15.52:0/179695068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d980149b0 con 0x55da25d240c0 2024-09-10T08:41:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.351+0000 7f5d92600640 1 -- 172.21.15.52:0/179695068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98014d80 con 0x55da25d240c0 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 -- 172.21.15.52:0/179695068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 msgr2=0x55da25d244a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d8e0 tx=0x7f5d98010000 comp rx=0 tx=0).stop 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 -- 172.21.15.52:0/179695068 shutdown_connections 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d04040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21880 0x55da25d23410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 --2- 172.21.15.52:0/179695068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d244a0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 -- 172.21.15.52:0/179695068 >> 172.21.15.52:0/179695068 conn(0x55da25cd9d20 msgr2=0x55da25d22130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 -- 172.21.15.52:0/179695068 shutdown_connections 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.352+0000 7f5dafabe740 1 -- 172.21.15.52:0/179695068 wait complete. 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.353+0000 7f5dafabe740 1 -- start start 2024-09-10T08:41:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.353+0000 7f5dafabe740 1 Processor -- start 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d07c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25d33640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55da25d207e0 con 0x55da25d240c0 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55da25bfb950 con 0x55da25d21ce0 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55da25d20ac0 con 0x55da25d05110 2024-09-10T08:41:41.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5dafabe740 10 client.0 _ll_register_callbacks cb 0x55da25bc74d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34288/0 (socket says 172.21.15.52:34288) 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 -- 172.21.15.52:0/2666718925 learned_addr learned my addr 172.21.15.52:0/2666718925 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5e00640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d07c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da6800640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25d33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 -- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 msgr2=0x55da25d33640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25d33640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 -- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 msgr2=0x55da25d07c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d07c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.354+0000 7f5da5400640 1 -- 172.21.15.52:0/2666718925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da25bf4f40 con 0x55da25d240c0 2024-09-10T08:41:41.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5da5400640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f5d94079d70 tx=0x7f5d9407a830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1beddfd4cc84b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9404b040 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f5d9403cc80 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d980149b0 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5d94082c50 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 10 client.10326 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55da259533f0 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d980149b0 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f5d940827c0 con 0x55da25d240c0 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 10 client.10326 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 10 client.10326 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 20 client.10326 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d33b80 0x55da25d04670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 4 client.10326 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.355+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da25c4dbc0 con 0x55da25d33b80 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.356+0000 7f5da5e00640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d33b80 0x55da25d04670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.356+0000 7f5da5e00640 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d33b80 0x55da25d04670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76664ae6924017 server_cookie=da7c7e54dca8880 in_seq=0 out_seq=0 2024-09-10T08:41:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.356+0000 7f5d86a00640 10 client.10326 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.357+0000 7f5d86a00640 1 -- 172.21.15.52:0/2666718925 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da25c4dbc0 con 0x55da25d33b80 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.357+0000 7f5d86a00640 10 client.10326 handle_command_reply: tid=0 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.357+0000 7f5dafabe740 1 client.10326 shutdown 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 msgr2=0x55da25d01db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f5d94079d70 tx=0x7f5d9407a830 comp rx=0 tx=0).stop 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 shutdown_connections 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d33b80 0x55da25d04670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25d33640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d01db0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 --2- 172.21.15.52:0/2666718925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25d07c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5d86a00640 0 client.10326 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 >> 172.21.15.52:0/2666718925 conn(0x55da25d21880 msgr2=0x55da25d22130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 shutdown_connections 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 1 -- 172.21.15.52:0/2666718925 wait complete. 2024-09-10T08:41:41.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.358+0000 7f5dafabe740 20 client.10326 trim_cache size 0 max 16384 2024-09-10T08:41:41.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.372+0000 7f5dafabe740 1 Processor -- start 2024-09-10T08:41:41.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.372+0000 7f5dafabe740 1 -- start start 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d05110 0x55da25d06a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21ce0 0x55da25d18540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8200c60 con 0x55da25d240c0 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81ffc40 con 0x55da25d05110 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5da81f4ff0 con 0x55da25d21ce0 2024-09-10T08:41:41.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34298/0 (socket says 172.21.15.52:34298) 2024-09-10T08:41:41.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 -- 172.21.15.52:0/3089225019 learned_addr learned my addr 172.21.15.52:0/3089225019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 -- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21ce0 msgr2=0x55da25d18540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21ce0 0x55da25d18540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 -- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d05110 msgr2=0x55da25d06a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d05110 0x55da25d06a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 -- 172.21.15.52:0/3089225019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da25a1d7d0 con 0x55da25d240c0 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.373+0000 7f5da6800640 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f5da00074b0 tx=0x7f5da0007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedc3f31e004b203 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5d91c00640 1 -- 172.21.15.52:0/3089225019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da001a030 con 0x55da25d240c0 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5d91c00640 1 -- 172.21.15.52:0/3089225019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da0004b60 con 0x55da25d240c0 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5d91c00640 1 -- 172.21.15.52:0/3089225019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004d10 con 0x55da25d240c0 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 -- 172.21.15.52:0/3089225019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 msgr2=0x55da25d34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f5da00074b0 tx=0x7f5da0007970 comp rx=0 tx=0).stop 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 -- 172.21.15.52:0/3089225019 shutdown_connections 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d34430 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d21ce0 0x55da25d18540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 --2- 172.21.15.52:0/3089225019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d05110 0x55da25d06a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 -- 172.21.15.52:0/3089225019 >> 172.21.15.52:0/3089225019 conn(0x55da25d21880 msgr2=0x55da25cdd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 -- 172.21.15.52:0/3089225019 shutdown_connections 2024-09-10T08:41:41.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.374+0000 7f5dafabe740 1 -- 172.21.15.52:0/3089225019 wait complete. 2024-09-10T08:41:41.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.375+0000 7f5dafabe740 1 -- start start 2024-09-10T08:41:41.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.375+0000 7f5dafabe740 1 Processor -- start 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25da3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25da01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5da80b4cb0 con 0x55da25d240c0 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55da25da4600 con 0x55da25d21ce0 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55da25d32c20 con 0x55da25d05110 2024-09-10T08:41:41.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5dafabe740 10 client.0 _ll_register_callbacks cb 0x7f5d9402a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5da6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5da6800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34300/0 (socket says 172.21.15.52:34300) 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5da6800640 1 -- 172.21.15.52:0/1031592756 learned_addr learned my addr 172.21.15.52:0/1031592756 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.376+0000 7f5da5400640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25da01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da5e00640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25da3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 -- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 msgr2=0x55da25da3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25da3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 -- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 msgr2=0x55da25da01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25da01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 -- 172.21.15.52:0/1031592756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da25da43f0 con 0x55da25d240c0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5da6800640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f5da0007f30 tx=0x7f5da0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6930f880781192 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5d86a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:41.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0016890 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f5da0016a30 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.377+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5da0004b60 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5da0016c30 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 10 client.10332 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55da25da08b0 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da0004b60 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f5da0020440 con 0x55da25d240c0 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 10 client.10332 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 10 client.10332 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 20 client.10332 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d44e30 0x55da25d23770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 4 client.10332 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da25c47f10 con 0x55da25d44e30 2024-09-10T08:41:41.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.378+0000 7f5da5e00640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d44e30 0x55da25d23770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5da5e00640 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d44e30 0x55da25d23770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e3b97b73c093dc server_cookie=bd42682d308434fa in_seq=0 out_seq=0 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5d86a00640 10 client.10332 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5d86a00640 1 -- 172.21.15.52:0/1031592756 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da25c47f10 con 0x55da25d44e30 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5d86a00640 10 client.10332 handle_command_reply: tid=0 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 client.10332 shutdown 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 msgr2=0x55da25d23230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f5da0007f30 tx=0x7f5da0007ec0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 shutdown_connections 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55da25d44e30 0x55da25d23770 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55da25d240c0 0x55da25d23230 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55da25d21ce0 0x55da25da01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 --2- 172.21.15.52:0/1031592756 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55da25d05110 0x55da25da3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5d86a00640 0 client.10332 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:41.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.379+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 >> 172.21.15.52:0/1031592756 conn(0x55da25d21880 msgr2=0x55da25d1afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 shutdown_connections 2024-09-10T08:41:41.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dafabe740 1 -- 172.21.15.52:0/1031592756 wait complete. 2024-09-10T08:41:41.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dafabe740 20 client.10332 trim_cache size 0 max 16384 2024-09-10T08:41:41.384 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 msgr2=0x7f5d8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 0x7f5d8806e2f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5d98006fd0 tx=0x7f5d98008040 comp rx=0 tx=0).stop 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 msgr2=0x7f5da80b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d940046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 shutdown_connections 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5d8806be30 0x7f5d8806e2f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5da80cce30 0x7f5da8150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5da80732e0 0x7f5da80b21c0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 --2- 172.21.15.52:0/3386892470 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5da8071c70 0x7f5da80af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 >> 172.21.15.52:0/3386892470 conn(0x7f5da806d0f0 msgr2=0x7f5da806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.380+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 shutdown_connections 2024-09-10T08:41:41.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.381+0000 7f5dacc00640 1 -- 172.21.15.52:0/3386892470 wait complete. 2024-09-10T08:41:41.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T08:41:41.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.550+0000 7fcfd5400640 1 Processor -- start 2024-09-10T08:41:41.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.550+0000 7fcfd5400640 1 -- start start 2024-09-10T08:41:41.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfd5400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcfd00b2d40 0x7fcfd006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfd5400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd0071180 con 0x7fcfd006c150 2024-09-10T08:41:41.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfd5400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd0071460 con 0x7fcfd013eb20 2024-09-10T08:41:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfd5400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd0071ab0 con 0x7fcfd00b2d40 2024-09-10T08:41:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfcf200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfd006c150 0x7fcfd0071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32932/0 (socket says 172.21.15.52:32932) 2024-09-10T08:41:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfcf200640 1 -- 172.21.15.52:0/2219600689 learned_addr learned my addr 172.21.15.52:0/2219600689 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:41.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfce800640 1 --2- 172.21.15.52:0/2219600689 >> v2:172.21.15.176:3300/0 conn(0x7fcfd00b2d40 0x7fcfd006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.552+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998721141 0 0) 0x7fcfd0071180 con 0x7fcfd006c150 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.553+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfb4005730 con 0x7fcfd006c150 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.553+0000 7fcfce800640 1 -- 172.21.15.52:0/2219600689 >> v1:172.21.15.176:6789/0 conn(0x7fcfd013eb20 legacy=0x7fcfd015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.553+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826324113 0 0) 0x7fcfd0071460 con 0x7fcfd013eb20 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.553+0000 7fcfce800640 1 -- 172.21.15.52:0/2219600689 >> v1:172.21.15.52:6789/0 conn(0x7fcfd006c150 legacy=0x7fcfd0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.553+0000 7fcfce800640 1 -- 172.21.15.52:0/2219600689 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd0071740 con 0x7fcfd00b2d40 2024-09-10T08:41:41.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.554+0000 7fcfce800640 1 --2- 172.21.15.52:0/2219600689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd006bc10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00097a0 tx=0x7fcfc002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8230ff96b52b8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.554+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0037070 con 0x7fcfd00b2d40 2024-09-10T08:41:41.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.554+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc002ac30 con 0x7fcfd00b2d40 2024-09-10T08:41:41.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.554+0000 7fcfcde00640 1 -- 172.21.15.52:0/2219600689 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80019f0 con 0x7fcfd00b2d40 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 -- 172.21.15.52:0/2219600689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 msgr2=0x7fcfd006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 --2- 172.21.15.52:0/2219600689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd006bc10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00097a0 tx=0x7fcfc002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 -- 172.21.15.52:0/2219600689 shutdown_connections 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 --2- 172.21.15.52:0/2219600689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd006bc10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 -- 172.21.15.52:0/2219600689 >> 172.21.15.52:0/2219600689 conn(0x7fcfd00ccec0 msgr2=0x7fcfd00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 -- 172.21.15.52:0/2219600689 shutdown_connections 2024-09-10T08:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.555+0000 7fcfd5400640 1 -- 172.21.15.52:0/2219600689 wait complete. 2024-09-10T08:41:41.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.557+0000 7fcfd5400640 1 Processor -- start 2024-09-10T08:41:41.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.557+0000 7fcfd5400640 1 -- start start 2024-09-10T08:41:41.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.557+0000 7fcfd5400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.557+0000 7fcfd5400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfd5400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd013eb20 0x7fcfd013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfd5400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd015c7d0 con 0x7fcfd006c150 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfd5400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd015c650 con 0x7fcfd00b2d40 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfd5400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd0072650 con 0x7fcfd013eb20 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34316/0 (socket says 172.21.15.52:34316) 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 -- 172.21.15.52:0/526496033 learned_addr learned my addr 172.21.15.52:0/526496033 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfcf200640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd013eb20 0x7fcfd013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfc7e00640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 -- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd013eb20 msgr2=0x7fcfd013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd013eb20 0x7fcfd013d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 -- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 msgr2=0x7fcfd00cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd00cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfce800640 1 -- 172.21.15.52:0/526496033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd013bcf0 con 0x7fcfd006c150 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.558+0000 7fcfc7e00640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd00cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:41.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfce800640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcfc002a790 tx=0x7fcfc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0042020 con 0x7fcfd006c150 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0003a40 con 0x7fcfd006c150 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0037040 con 0x7fcfd006c150 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd013bfd0 con 0x7fcfd006c150 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.559+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd013c590 con 0x7fcfd006c150 2024-09-10T08:41:41.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.560+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd006bc10 con 0x7fcfd006c150 2024-09-10T08:41:41.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.561+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfc0045020 con 0x7fcfd006c150 2024-09-10T08:41:41.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.562+0000 7fcfc6a00640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 0x7fcfac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.562+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fcfc00ab630 con 0x7fcfd006c150 2024-09-10T08:41:41.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.563+0000 7fcfc7e00640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 0x7fcfac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.564+0000 7fcfc7e00640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 0x7fcfac06e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcfd015c2c0 tx=0x7fcfb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.567+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfc004c030 con 0x7fcfd006c150 2024-09-10T08:41:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.796+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcfd006c9c0 con 0x7fcfd006c150 2024-09-10T08:41:41.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.796+0000 7fcfc6a00640 1 -- 172.21.15.52:0/526496033 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcfc0030340 con 0x7fcfd006c150 2024-09-10T08:41:41.797 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:41:41.797 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 msgr2=0x7fcfac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 0x7fcfac06e2f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcfd015c2c0 tx=0x7fcfb8009040 comp rx=0 tx=0).stop 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 msgr2=0x7fcfd0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fcfc002a790 tx=0x7fcfc00046c0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 shutdown_connections 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcfac06be30 0x7fcfac06e2f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcfd013eb20 0x7fcfd013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcfd00b2d40 0x7fcfd00cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 --2- 172.21.15.52:0/526496033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfd006c150 0x7fcfd0157540 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 >> 172.21.15.52:0/526496033 conn(0x7fcfd00ccec0 msgr2=0x7fcfd0140210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 shutdown_connections 2024-09-10T08:41:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.798+0000 7fcfd5400640 1 -- 172.21.15.52:0/526496033 wait complete. 2024-09-10T08:41:41.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:41.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-10T08:41:41.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.977+0000 7f0177c00640 1 Processor -- start 2024-09-10T08:41:41.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.977+0000 7f0177c00640 1 -- start start 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.978+0000 7f0177c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01701454b0 0x7f01700b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.978+0000 7f0177c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0177c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0170146220 con 0x7f01701459a0 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0177c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f01700b1920 con 0x7f01701454b0 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0177c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01700cf640 con 0x7f01700b0e50 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01701454b0 0x7f01700b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0167e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f01701459a0 0x7f01700b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32942/0 (socket says 172.21.15.52:32942) 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0167e00640 1 -- 172.21.15.52:0/248170621 learned_addr learned my addr 172.21.15.52:0/248170621 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175c00640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175200640 1 -- 172.21.15.52:0/248170621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 msgr2=0x7f01700b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175200640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175200640 1 -- 172.21.15.52:0/248170621 >> v1:172.21.15.52:6789/0 conn(0x7f01701459a0 legacy=0x7f01700b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175200640 1 -- 172.21.15.52:0/248170621 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01700cf8e0 con 0x7f01701454b0 2024-09-10T08:41:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.979+0000 7f0175c00640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.980+0000 7f0175200640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701454b0 0x7f01700b58f0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f01600097a0 tx=0x7f016002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90579098084ff38a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f016fe00640 1 -- 172.21.15.52:0/248170621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160037070 con 0x7f01701454b0 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f016fe00640 1 -- 172.21.15.52:0/248170621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0160032440 con 0x7f01701454b0 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f016fe00640 1 -- 172.21.15.52:0/248170621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160032810 con 0x7f01701454b0 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 -- 172.21.15.52:0/248170621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701454b0 msgr2=0x7f01700b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701454b0 0x7f01700b58f0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f01600097a0 tx=0x7f016002a230 comp rx=0 tx=0).stop 2024-09-10T08:41:41.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 -- 172.21.15.52:0/248170621 shutdown_connections 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 --2- 172.21.15.52:0/248170621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701454b0 0x7f01700b58f0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 -- 172.21.15.52:0/248170621 >> 172.21.15.52:0/248170621 conn(0x7f017006c240 msgr2=0x7f017006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 -- 172.21.15.52:0/248170621 shutdown_connections 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.981+0000 7f0177c00640 1 -- 172.21.15.52:0/248170621 wait complete. 2024-09-10T08:41:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.983+0000 7f0177c00640 1 Processor -- start 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.983+0000 7f0177c00640 1 -- start start 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01701454b0 0x7f017015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01700d0180 con 0x7f01701459a0 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01700cfea0 con 0x7f01701454b0 2024-09-10T08:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0177c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01700b24c0 con 0x7f01700b0e50 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34346/0 (socket says 172.21.15.52:34346) 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0175c00640 1 -- 172.21.15.52:0/3283149970 learned_addr learned my addr 172.21.15.52:0/3283149970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0175200640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.984+0000 7f0167e00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01701454b0 0x7f017015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 -- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 msgr2=0x7f01700c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 -- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01701454b0 msgr2=0x7f017015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01701454b0 0x7f017015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 -- 172.21.15.52:0/3283149970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017015c510 con 0x7f01701459a0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0175c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f016800cf20 tx=0x7f016800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f016d600640 1 -- 172.21.15.52:0/3283149970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016801a070 con 0x7f01701459a0 2024-09-10T08:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f016d600640 1 -- 172.21.15.52:0/3283149970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016800d840 con 0x7f01701459a0 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01700c6160 con 0x7f01701459a0 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f016d600640 1 -- 172.21.15.52:0/3283149970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016800dc30 con 0x7f01701459a0 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.985+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01700c6720 con 0x7f01701459a0 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.988+0000 7f016d600640 1 -- 172.21.15.52:0/3283149970 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f016801d070 con 0x7f01701459a0 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.989+0000 7f016d600640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.989+0000 7f016d600640 1 -- 172.21.15.52:0/3283149970 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f016808b670 con 0x7f01701459a0 2024-09-10T08:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.989+0000 7f017ac7c740 1 Processor -- start 2024-09-10T08:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.989+0000 7f0175200640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 -- start start 2024-09-10T08:41:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f0175200640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0160034000 tx=0x7f016002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 0x55c50ba29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba4c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c50b962970 con 0x55c50ba44ba0 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c50b90a8d0 con 0x55c50ba43460 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.990+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c50b95e930 con 0x55c50ba28c40 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34356/0 (socket says 172.21.15.52:34356) 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 -- 172.21.15.52:0/1684590394 learned_addr learned my addr 172.21.15.52:0/1684590394 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0175200640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 0x55c50ba29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0175c00640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba4c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:41.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 -- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 msgr2=0x55c50ba29020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 0x55c50ba29020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 -- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 msgr2=0x55c50ba4c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba4c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 -- 172.21.15.52:0/1684590394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50b741a20 con 0x55c50ba44ba0 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0175200640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 0x55c50ba29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0175c00640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba4c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0167e00640 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0158004e70 tx=0x7f0158007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55dd9fbd3b0729b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.991+0000 7f0165600640 1 -- 172.21.15.52:0/1684590394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580017a0 con 0x55c50ba44ba0 2024-09-10T08:41:41.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f0165600640 1 -- 172.21.15.52:0/1684590394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158018070 con 0x55c50ba44ba0 2024-09-10T08:41:41.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f0165600640 1 -- 172.21.15.52:0/1684590394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158001b80 con 0x55c50ba44ba0 2024-09-10T08:41:41.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 -- 172.21.15.52:0/1684590394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 msgr2=0x55c50ba4c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:41.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f0158004e70 tx=0x7f0158007430 comp rx=0 tx=0).stop 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 -- 172.21.15.52:0/1684590394 shutdown_connections 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba4c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50ba4c450 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 --2- 172.21.15.52:0/1684590394 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba28c40 0x55c50ba29020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 -- 172.21.15.52:0/1684590394 >> 172.21.15.52:0/1684590394 conn(0x55c50b9fb500 msgr2=0x55c50ba43a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 -- 172.21.15.52:0/1684590394 shutdown_connections 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.992+0000 7f017ac7c740 1 -- 172.21.15.52:0/1684590394 wait complete. 2024-09-10T08:41:42.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.993+0000 7f017ac7c740 1 -- start start 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.993+0000 7f017ac7c740 1 Processor -- start 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 0x55c50ba26f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c50b9febf0 con 0x55c50ba3adc0 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55c50b91daf0 con 0x55c50ba44ba0 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c50b9feed0 con 0x55c50ba43460 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f017ac7c740 10 client.0 _ll_register_callbacks cb 0x55c50b90f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34364/0 (socket says 172.21.15.52:34364) 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.994+0000 7f0175c00640 1 -- 172.21.15.52:0/291608339 learned_addr learned my addr 172.21.15.52:0/291608339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0167e00640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 -- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 msgr2=0x55c50ba26f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175200640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 0x55c50ba26f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 0x55c50ba26f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 -- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 msgr2=0x55c50ba3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 -- 172.21.15.52:0/291608339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50b635310 con 0x55c50ba3adc0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0167e00640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175200640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 0x55c50ba26f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f0175c00640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f016800cfd0 tx=0x7f0168059a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433fd8219c0ee9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f015e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680600c0 con 0x55c50ba3adc0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f0168071810 con 0x55c50ba3adc0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0158018070 con 0x55c50ba3adc0 2024-09-10T08:41:42.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f0168062060 con 0x55c50ba3adc0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f017ac7c740 10 client.10353 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.995+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55c50b7a21b0 con 0x55c50ba3adc0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0158018070 con 0x55c50ba3adc0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f0168058e10 con 0x55c50ba3adc0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 10 client.10353 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 10 client.10353 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 20 client.10353 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50ba3fe80 0x55c50ba25130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 4 client.10353 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c50b937100 con 0x55c50ba3fe80 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.996+0000 7f0175200640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50ba3fe80 0x55c50ba25130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.997+0000 7f0175200640 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50ba3fe80 0x55c50ba25130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacd46e8caa32b47 server_cookie=25af769dae6b8bfb in_seq=0 out_seq=0 2024-09-10T08:41:42.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.997+0000 7f015e000640 10 client.10353 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f015e000640 1 -- 172.21.15.52:0/291608339 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c50b937100 con 0x55c50ba3fe80 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f015e000640 10 client.10353 handle_command_reply: tid=0 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 client.10353 shutdown 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 msgr2=0x55c50ba23860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f016800cfd0 tx=0x7f0168059a80 comp rx=0 tx=0).stop 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 shutdown_connections 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50ba3fe80 0x55c50ba25130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba3adc0 0x55c50ba23860 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 --2- 172.21.15.52:0/291608339 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba43460 0x55c50ba26f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 >> 172.21.15.52:0/291608339 conn(0x55c50ba28c40 msgr2=0x55c50b9fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.998+0000 7f015e000640 0 client.10353 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.999+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 shutdown_connections 2024-09-10T08:41:42.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.999+0000 7f017ac7c740 1 -- 172.21.15.52:0/291608339 wait complete. 2024-09-10T08:41:42.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:41.999+0000 7f017ac7c740 20 client.10353 trim_cache size 0 max 16384 2024-09-10T08:41:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 Processor -- start 2024-09-10T08:41:42.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 -- start start 2024-09-10T08:41:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50ba25130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0170200c30 con 0x55c50ba44ba0 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.017+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01701ffc40 con 0x55c50ba43460 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f01700b3a80 con 0x55c50ba3adc0 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34378/0 (socket says 172.21.15.52:34378) 2024-09-10T08:41:42.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 -- 172.21.15.52:0/3078724545 learned_addr learned my addr 172.21.15.52:0/3078724545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 -- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 msgr2=0x55c50ba25130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50ba25130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 -- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 msgr2=0x55c50ba452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 -- 172.21.15.52:0/3078724545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c50b60e3d0 con 0x55c50ba44ba0 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.018+0000 7f0175c00640 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f016800acd0 tx=0x7f0168016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fae17aade71133b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f0164c00640 1 -- 172.21.15.52:0/3078724545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016805dcc0 con 0x55c50ba44ba0 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f0164c00640 1 -- 172.21.15.52:0/3078724545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016805ee50 con 0x55c50ba44ba0 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f0164c00640 1 -- 172.21.15.52:0/3078724545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168058e10 con 0x55c50ba44ba0 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 -- 172.21.15.52:0/3078724545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 msgr2=0x55c50babc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f016800acd0 tx=0x7f0168016000 comp rx=0 tx=0).stop 2024-09-10T08:41:42.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 -- 172.21.15.52:0/3078724545 shutdown_connections 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba44ba0 0x55c50babc430 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba43460 0x55c50ba452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 --2- 172.21.15.52:0/3078724545 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50ba25130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 -- 172.21.15.52:0/3078724545 >> 172.21.15.52:0/3078724545 conn(0x55c50ba28c40 msgr2=0x55c50ba3a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 -- 172.21.15.52:0/3078724545 shutdown_connections 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.019+0000 7f017ac7c740 1 -- 172.21.15.52:0/3078724545 wait complete. 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.020+0000 7f017ac7c740 1 -- start start 2024-09-10T08:41:42.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.020+0000 7f017ac7c740 1 Processor -- start 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50babb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c50b9fa4f0 con 0x55c50ba43460 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01700b40d0 con 0x55c50ba44ba0 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55c50ba42370 con 0x55c50ba3adc0 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f017ac7c740 10 client.0 _ll_register_callbacks cb 0x7f0168059320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:42.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f0167e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f0167e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34380/0 (socket says 172.21.15.52:34380) 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.021+0000 7f0167e00640 1 -- 172.21.15.52:0/2568406698 learned_addr learned my addr 172.21.15.52:0/2568406698 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0175c00640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0175200640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50babb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 -- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 msgr2=0x55c50babb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50babb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 -- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 msgr2=0x55c50ba3bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 -- 172.21.15.52:0/2568406698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c50ba3dad0 con 0x55c50ba43460 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f0167e00640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x55c50ba3e020 tx=0x7f0158000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735fae8b4ffc9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f015e000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158028420 con 0x55c50ba43460 2024-09-10T08:41:42.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f01580285c0 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.022+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016805ee50 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f015802f050 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 10 client.10359 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55c50bac2e60 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016805ee50 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f0158032020 con 0x55c50ba43460 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 10 client.10359 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 10 client.10359 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 20 client.10359 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50bac29b0 0x55c50ba244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 4 client.10359 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55c50b9700a0 con 0x55c50bac29b0 2024-09-10T08:41:42.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.023+0000 7f0175200640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50bac29b0 0x55c50ba244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.024+0000 7f0175200640 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50bac29b0 0x55c50ba244b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a042b50a75ef2477 server_cookie=6d35370d4c8f8aab in_seq=0 out_seq=0 2024-09-10T08:41:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.024+0000 7f015e000640 10 client.10359 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f015e000640 1 -- 172.21.15.52:0/2568406698 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c50b9700a0 con 0x55c50bac29b0 2024-09-10T08:41:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f015e000640 10 client.10359 handle_command_reply: tid=0 2024-09-10T08:41:42.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 client.10359 shutdown 2024-09-10T08:41:42.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 msgr2=0x55c50ba3b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x55c50ba3e020 tx=0x7f0158000ed0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 shutdown_connections 2024-09-10T08:41:42.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55c50bac29b0 0x55c50ba244b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55c50ba44ba0 0x55c50ba3bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c50ba43460 0x55c50ba3b690 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f015e000640 0 client.10359 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 --2- 172.21.15.52:0/2568406698 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55c50ba3adc0 0x55c50babb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 >> 172.21.15.52:0/2568406698 conn(0x55c50ba28c40 msgr2=0x55c50ba452c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 shutdown_connections 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 1 -- 172.21.15.52:0/2568406698 wait complete. 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.025+0000 7f017ac7c740 20 client.10359 trim_cache size 0 max 16384 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:41:42.030 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:41:42.031 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "f378a3e7-771b-4964-817c-31a15e2ab2b8", 2024-09-10T08:41:42.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:41:42.031 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 msgr2=0x7f014c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0160034000 tx=0x7f016002e000 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 msgr2=0x7f01700c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f016800cf20 tx=0x7f016800a7d0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 shutdown_connections 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f014c06be30 0x7f014c06e2f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01701459a0 0x7f01700c7d90 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01701454b0 0x7f017015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 --2- 172.21.15.52:0/3283149970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f01700b0e50 0x7f01700c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 >> 172.21.15.52:0/3283149970 conn(0x7f017006c240 msgr2=0x7f0170142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 shutdown_connections 2024-09-10T08:41:42.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.026+0000 7f0177c00640 1 -- 172.21.15.52:0/3283149970 wait complete. 2024-09-10T08:41:42.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:41:42.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-10T08:41:42.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.201+0000 7feb8d200640 1 Processor -- start 2024-09-10T08:41:42.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.201+0000 7feb8d200640 1 -- start start 2024-09-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.202+0000 7feb8d200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb880cd2a0 0x7feb8815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.202+0000 7feb8d200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880714b0 con 0x7feb880cce30 2024-09-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.202+0000 7feb8d200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb880cd880 con 0x7feb880732e0 2024-09-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.202+0000 7feb8d200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7feb880cdb60 con 0x7feb880cd2a0 2024-09-10T08:41:42.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb86800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7feb880cd2a0 0x7feb8815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb7fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feb880cce30 0x7feb88071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:32954/0 (socket says 172.21.15.52:32954) 2024-09-10T08:41:42.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb7fe00640 1 -- 172.21.15.52:0/1614879108 learned_addr learned my addr 172.21.15.52:0/1614879108 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb86800640 1 -- 172.21.15.52:0/1614879108 >> v1:172.21.15.176:6789/0 conn(0x7feb880732e0 legacy=0x7feb880736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb86800640 1 -- 172.21.15.52:0/1614879108 >> v1:172.21.15.52:6789/0 conn(0x7feb880cce30 legacy=0x7feb88071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb86800640 1 -- 172.21.15.52:0/1614879108 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880cde40 con 0x7feb880cd2a0 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.203+0000 7feb85400640 1 -- 172.21.15.52:0/1614879108 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444999295 0 0) 0x7feb880714b0 con 0x7feb880cce30 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.204+0000 7feb86800640 1 --2- 172.21.15.52:0/1614879108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cd2a0 0x7feb8815c8d0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb8002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e706a5732e996b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb85400640 1 -- 172.21.15.52:0/1614879108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80007740 con 0x7feb880cd2a0 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb85400640 1 -- 172.21.15.52:0/1614879108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb800078e0 con 0x7feb880cd2a0 2024-09-10T08:41:42.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb85400640 1 -- 172.21.15.52:0/1614879108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80007cb0 con 0x7feb880cd2a0 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 -- 172.21.15.52:0/1614879108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cd2a0 msgr2=0x7feb8815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 --2- 172.21.15.52:0/1614879108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cd2a0 0x7feb8815c8d0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb8002a660 comp rx=0 tx=0).stop 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 -- 172.21.15.52:0/1614879108 shutdown_connections 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 --2- 172.21.15.52:0/1614879108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cd2a0 0x7feb8815c8d0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 -- 172.21.15.52:0/1614879108 >> 172.21.15.52:0/1614879108 conn(0x7feb8806d0f0 msgr2=0x7feb8806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 -- 172.21.15.52:0/1614879108 shutdown_connections 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.205+0000 7feb8d200640 1 -- 172.21.15.52:0/1614879108 wait complete. 2024-09-10T08:41:42.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.207+0000 7feb8d200640 1 Processor -- start 2024-09-10T08:41:42.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.207+0000 7feb8d200640 1 -- start start 2024-09-10T08:41:42.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb880732e0 0x7feb880b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb880cd2a0 0x7feb880cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb88072500 con 0x7feb880cce30 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb88072380 con 0x7feb880732e0 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb8d200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb8815ce10 con 0x7feb880cd2a0 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34396/0 (socket says 172.21.15.52:34396) 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb7fe00640 1 -- 172.21.15.52:0/847631811 learned_addr learned my addr 172.21.15.52:0/847631811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb85e00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb880732e0 0x7feb880b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.208+0000 7feb86800640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb880cd2a0 0x7feb880cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 -- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb880cd2a0 msgr2=0x7feb880cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb880cd2a0 0x7feb880cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 -- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb880732e0 msgr2=0x7feb880b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb880732e0 0x7feb880b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 -- 172.21.15.52:0/847631811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8814ef00 con 0x7feb880cce30 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7fe00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c4a0 tx=0x7feb7000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7e000640 1 -- 172.21.15.52:0/847631811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70018070 con 0x7feb880cce30 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7e000640 1 -- 172.21.15.52:0/847631811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb700074e0 con 0x7feb880cce30 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb7e000640 1 -- 172.21.15.52:0/847631811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70004a20 con 0x7feb880cce30 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb880b2c50 con 0x7feb880cce30 2024-09-10T08:41:42.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.209+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881502e0 con 0x7feb880cce30 2024-09-10T08:41:42.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.211+0000 7feb7e000640 1 -- 172.21.15.52:0/847631811 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb70004bc0 con 0x7feb880cce30 2024-09-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.212+0000 7feb7e000640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.212+0000 7feb7e000640 1 -- 172.21.15.52:0/847631811 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7feb7008a1d0 con 0x7feb880cce30 2024-09-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.213+0000 7feb85e00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.213+0000 7feb90255740 1 Processor -- start 2024-09-10T08:41:42.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.213+0000 7feb90255740 1 -- start start 2024-09-10T08:41:42.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.213+0000 7feb85e00640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 0x7feb6406e2f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7feb78000f60 tx=0x7feb78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7c02c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 0x55d0f7c03740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7b20660 con 0x55d0f7bd2800 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7ac8680 con 0x55d0f7bb8480 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d0f7b1c620 con 0x55d0f7bd2420 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34406/0 (socket says 172.21.15.52:34406) 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb7fe00640 1 -- 172.21.15.52:0/631138057 learned_addr learned my addr 172.21.15.52:0/631138057 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb85e00640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7c02c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.214+0000 7feb86800640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 0x55d0f7c03740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 -- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 msgr2=0x55d0f7c02c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7c02c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 -- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 msgr2=0x55d0f7c03740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 0x55d0f7c03740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 -- 172.21.15.52:0/631138057 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f78fd7d0 con 0x55d0f7bd2800 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb86800640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 0x55d0f7c03740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb7fe00640 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7feb70060a90 tx=0x7feb7000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1842aa3b2096529 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb76a00640 1 -- 172.21.15.52:0/631138057 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70060fc0 con 0x55d0f7bd2800 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb76a00640 1 -- 172.21.15.52:0/631138057 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70056790 con 0x55d0f7bd2800 2024-09-10T08:41:42.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.215+0000 7feb76a00640 1 -- 172.21.15.52:0/631138057 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70070170 con 0x55d0f7bd2800 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 -- 172.21.15.52:0/631138057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 msgr2=0x55d0f7c03200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7feb70060a90 tx=0x7feb7000cf90 comp rx=0 tx=0).stop 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 -- 172.21.15.52:0/631138057 shutdown_connections 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bb8480 0x55d0f7c03740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7bd2800 0x55d0f7c03200 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 --2- 172.21.15.52:0/631138057 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7c02c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 -- 172.21.15.52:0/631138057 >> 172.21.15.52:0/631138057 conn(0x55d0f7bb9220 msgr2=0x55d0f7c01840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 -- 172.21.15.52:0/631138057 shutdown_connections 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.216+0000 7feb90255740 1 -- 172.21.15.52:0/631138057 wait complete. 2024-09-10T08:41:42.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.217+0000 7feb90255740 1 -- start start 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.217+0000 7feb90255740 1 Processor -- start 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7bfeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bfeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7bb73e0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7aa94c0 con 0x55d0f7bd2420 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d0f7bb76c0 con 0x55d0f7bd2800 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb90255740 10 client.0 _ll_register_callbacks cb 0x55d0f7b18e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34420/0 (socket says 172.21.15.52:34420) 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb86800640 1 -- 172.21.15.52:0/709867345 learned_addr learned my addr 172.21.15.52:0/709867345 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb85e00640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7bfeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.218+0000 7feb7fe00640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bfeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 -- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 msgr2=0x55d0f7bfeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bfeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 -- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 msgr2=0x55d0f7bfeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7bfeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 -- 172.21.15.52:0/709867345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f78333f0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb86800640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7feb8002ac50 tx=0x7feb80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23ada0e029ae5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb6b400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80004600 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7feb800047a0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb70056790 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7feb80007540 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.219+0000 7feb90255740 10 client.10374 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55d0f77f30f0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70056790 con 0x55d0f7be7bf0 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7feb80051080 con 0x55d0f7be7bf0 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 10 client.10374 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 10 client.10374 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 20 client.10374 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c10fc0 0x55d0f7c113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 4 client.10374 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f7b2dd90 con 0x55d0f7c10fc0 2024-09-10T08:41:42.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.220+0000 7feb85e00640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c10fc0 0x55d0f7c113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.221+0000 7feb85e00640 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c10fc0 0x55d0f7c113d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba0751c184f67271 server_cookie=c3a1164a7afbea31 in_seq=0 out_seq=0 2024-09-10T08:41:42.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.221+0000 7feb6b400640 10 client.10374 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb6b400640 1 -- 172.21.15.52:0/709867345 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0f7b2dd90 con 0x55d0f7c10fc0 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb6b400640 10 client.10374 handle_command_reply: tid=0 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 client.10374 shutdown 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 msgr2=0x55d0f7bd67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7feb8002ac50 tx=0x7feb80004ab0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 shutdown_connections 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c10fc0 0x55d0f7c113d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7bd67a0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bfeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 --2- 172.21.15.52:0/709867345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7bfeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb6b400640 0 client.10374 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.222+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 >> 172.21.15.52:0/709867345 conn(0x55d0f7bb8480 msgr2=0x55d0f7c017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.223+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 shutdown_connections 2024-09-10T08:41:42.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.223+0000 7feb90255740 1 -- 172.21.15.52:0/709867345 wait complete. 2024-09-10T08:41:42.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.223+0000 7feb90255740 20 client.10374 trim_cache size 0 max 16384 2024-09-10T08:41:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.241+0000 7feb90255740 1 Processor -- start 2024-09-10T08:41:42.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.241+0000 7feb90255740 1 -- start start 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7bb7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 0x55d0f7c25c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb88200b80 con 0x55d0f7be7bf0 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb8814eb90 con 0x55d0f7bd2800 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7feb8814def0 con 0x55d0f7bd2420 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34428/0 (socket says 172.21.15.52:34428) 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 -- 172.21.15.52:0/2469813629 learned_addr learned my addr 172.21.15.52:0/2469813629 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb85e00640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7bb7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb7fe00640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 0x55d0f7c25c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 -- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 msgr2=0x55d0f7bb7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7bb7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 -- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 msgr2=0x55d0f7c25c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 0x55d0f7c25c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb86800640 1 -- 172.21.15.52:0/2469813629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f7c11830 con 0x55d0f7be7bf0 2024-09-10T08:41:42.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.242+0000 7feb7fe00640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 0x55d0f7c25c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:42.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.243+0000 7feb86800640 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7feb80007070 tx=0x7feb80033070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f41cdaab68a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.243+0000 7feb76000640 1 -- 172.21.15.52:0/2469813629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80004600 con 0x55d0f7be7bf0 2024-09-10T08:41:42.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.243+0000 7feb76000640 1 -- 172.21.15.52:0/2469813629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80054070 con 0x55d0f7be7bf0 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.243+0000 7feb76000640 1 -- 172.21.15.52:0/2469813629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80007880 con 0x55d0f7be7bf0 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 -- 172.21.15.52:0/2469813629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 msgr2=0x55d0f7c26190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7feb80007070 tx=0x7feb80033070 comp rx=0 tx=0).stop 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 -- 172.21.15.52:0/2469813629 shutdown_connections 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7c26190 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2800 0x55d0f7c25c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 --2- 172.21.15.52:0/2469813629 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2420 0x55d0f7bb7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 -- 172.21.15.52:0/2469813629 >> 172.21.15.52:0/2469813629 conn(0x55d0f7bb8480 msgr2=0x55d0f7bfe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 -- 172.21.15.52:0/2469813629 shutdown_connections 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.244+0000 7feb90255740 1 -- 172.21.15.52:0/2469813629 wait complete. 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.245+0000 7feb90255740 1 -- start start 2024-09-10T08:41:42.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.245+0000 7feb90255740 1 Processor -- start 2024-09-10T08:41:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7c25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bb7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7c03cc0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb8814e540 con 0x55d0f7bd2420 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55d0f7bb3050 con 0x55d0f7bd2800 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb90255740 10 client.0 _ll_register_callbacks cb 0x7feb80003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34432/0 (socket says 172.21.15.52:34432) 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 -- 172.21.15.52:0/2890891032 learned_addr learned my addr 172.21.15.52:0/2890891032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb7fe00640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bb7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb85e00640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7c25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 -- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 msgr2=0x55d0f7bb7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bb7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 -- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 msgr2=0x55d0f7c25cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7c25cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb86800640 1 -- 172.21.15.52:0/2890891032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f7c03ad0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.246+0000 7feb85e00640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7c25cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb86800640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb80009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a26de01730b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80046670 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7feb80046810 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb80054070 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7feb80065050 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb90255740 10 client.10380 fetch_fsmap learned FSMap version 141 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55d0f7c01cd0 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80054070 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.247+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7feb80068020 con 0x55d0f7be7bf0 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 10 client.10380 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 10 client.10380 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:41:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 20 client.10380 populate_metadata read hostname 'smithi052' 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c83470 0x55d0f7be8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 4 client.10380 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0f7b280e0 con 0x55d0f7c83470 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.248+0000 7feb85e00640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c83470 0x55d0f7be8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb85e00640 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c83470 0x55d0f7be8ea0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb6a176956e68cf server_cookie=a52f5c94fc13b8b3 in_seq=0 out_seq=0 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb6b400640 10 client.10380 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb6b400640 1 -- 172.21.15.52:0/2890891032 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55d0f7b280e0 con 0x55d0f7c83470 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb6b400640 10 client.10380 handle_command_reply: tid=0 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 client.10380 shutdown 2024-09-10T08:41:42.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 msgr2=0x55d0f7be8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb80009750 comp rx=0 tx=0).stop 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 shutdown_connections 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x55d0f7c83470 0x55d0f7be8ea0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0f7be7bf0 0x55d0f7be8960 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55d0f7bd2800 0x55d0f7bb7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 --2- 172.21.15.52:0/2890891032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55d0f7bd2420 0x55d0f7c25cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb6b400640 0 client.10380 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 >> 172.21.15.52:0/2890891032 conn(0x55d0f7bb8480 msgr2=0x55d0f7bfe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 shutdown_connections 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 1 -- 172.21.15.52:0/2890891032 wait complete. 2024-09-10T08:41:42.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.249+0000 7feb90255740 20 client.10380 trim_cache size 0 max 16384 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "f378a3e7-771b-4964-817c-31a15e2ab2b8": { 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "~mds0", 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "f378a3e7-771b-4964-817c-31a15e2ab2b8", 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive" 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:41:42.255 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:41:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 msgr2=0x7feb6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 0x7feb6406e2f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7feb78000f60 tx=0x7feb78009040 comp rx=0 tx=0).stop 2024-09-10T08:41:42.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 msgr2=0x7feb880cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c4a0 tx=0x7feb7000c960 comp rx=0 tx=0).stop 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 shutdown_connections 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7feb6406be30 0x7feb6406e2f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb880cd2a0 0x7feb880cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb880cce30 0x7feb880cb190 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 --2- 172.21.15.52:0/847631811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb880732e0 0x7feb880b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 >> 172.21.15.52:0/847631811 conn(0x7feb8806d0f0 msgr2=0x7feb880b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 shutdown_connections 2024-09-10T08:41:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:41:42.250+0000 7feb8d200640 1 -- 172.21.15.52:0/847631811 wait complete. 2024-09-10T08:41:42.268 INFO:tasks.cephfs.filesystem:scrub status for tag:f378a3e7-771b-4964-817c-31a15e2ab2b8 - {'path': '~mds0', 'tag': 'f378a3e7-771b-4964-817c-31a15e2ab2b8', 'options': 'recursive'} 2024-09-10T08:42:08.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:08.341 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:12.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:12.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-10T08:42:12.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.438+0000 7f3d78000640 1 Processor -- start 2024-09-10T08:42:12.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.439+0000 7f3d78000640 1 -- start start 2024-09-10T08:42:12.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d78000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d700cce30 0x7f3d700cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d78000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d700714b0 con 0x7f3d700732e0 2024-09-10T08:42:12.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d78000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d700cd880 con 0x7f3d70071c70 2024-09-10T08:42:12.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d78000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3d700cdb60 con 0x7f3d700cce30 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d75600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d700732e0 0x7f3d700736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39184/0 (socket says 172.21.15.52:39184) 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d75600640 1 -- 172.21.15.52:0/2259352705 learned_addr learned my addr 172.21.15.52:0/2259352705 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.440+0000 7f3d74c00640 1 --2- 172.21.15.52:0/2259352705 >> v2:172.21.15.52:3300/0 conn(0x7f3d700cce30 0x7f3d700cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.441+0000 7f3d6fe00640 1 -- 172.21.15.52:0/2259352705 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412961697 0 0) 0x7f3d700714b0 con 0x7f3d700732e0 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.441+0000 7f3d74c00640 1 -- 172.21.15.52:0/2259352705 >> v1:172.21.15.176:6789/0 conn(0x7f3d70071c70 legacy=0x7f3d7015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.441+0000 7f3d74c00640 1 -- 172.21.15.52:0/2259352705 >> v1:172.21.15.52:6789/0 conn(0x7f3d700732e0 legacy=0x7f3d700736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.441+0000 7f3d74c00640 1 -- 172.21.15.52:0/2259352705 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d700cde40 con 0x7f3d700cce30 2024-09-10T08:42:12.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d74c00640 1 --2- 172.21.15.52:0/2259352705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cd2a0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0097a0 tx=0x7f3d5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9934316c7e63378e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d6fe00640 1 -- 172.21.15.52:0/2259352705 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c037070 con 0x7f3d700cce30 2024-09-10T08:42:12.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d6fe00640 1 -- 172.21.15.52:0/2259352705 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c032440 con 0x7f3d700cce30 2024-09-10T08:42:12.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d6fe00640 1 -- 172.21.15.52:0/2259352705 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c032810 con 0x7f3d700cce30 2024-09-10T08:42:12.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d78000640 1 -- 172.21.15.52:0/2259352705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 msgr2=0x7f3d700cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.442+0000 7f3d78000640 1 --2- 172.21.15.52:0/2259352705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cd2a0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0097a0 tx=0x7f3d5c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.443+0000 7f3d78000640 1 -- 172.21.15.52:0/2259352705 shutdown_connections 2024-09-10T08:42:12.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.443+0000 7f3d78000640 1 --2- 172.21.15.52:0/2259352705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cd2a0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.443+0000 7f3d78000640 1 -- 172.21.15.52:0/2259352705 >> 172.21.15.52:0/2259352705 conn(0x7f3d7006d0f0 msgr2=0x7f3d7006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.443+0000 7f3d78000640 1 -- 172.21.15.52:0/2259352705 shutdown_connections 2024-09-10T08:42:12.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.443+0000 7f3d78000640 1 -- 172.21.15.52:0/2259352705 wait complete. 2024-09-10T08:42:12.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.444+0000 7f3d78000640 1 Processor -- start 2024-09-10T08:42:12.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.444+0000 7f3d78000640 1 -- start start 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700732e0 0x7f3d700cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7015d160 con 0x7f3d700cce30 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7015cfe0 con 0x7f3d70071c70 2024-09-10T08:42:12.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.445+0000 7f3d78000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7015d2e0 con 0x7f3d700732e0 2024-09-10T08:42:12.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d75600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d75600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:59222/0 (socket says 172.21.15.52:59222) 2024-09-10T08:42:12.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d75600640 1 -- 172.21.15.52:0/75742512 learned_addr learned my addr 172.21.15.52:0/75742512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d74c00640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700732e0 0x7f3d700cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 -- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700732e0 msgr2=0x7f3d700cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700732e0 0x7f3d700cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 -- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 msgr2=0x7f3d70157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d76000640 1 -- 172.21.15.52:0/75742512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7015e760 con 0x7f3d700cce30 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.446+0000 7f3d75600640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:12.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d76000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cf7b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c730 tx=0x7f3d6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d6d600640 1 -- 172.21.15.52:0/75742512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68003b70 con 0x7f3d700cce30 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d6d600640 1 -- 172.21.15.52:0/75742512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d68003d10 con 0x7f3d700cce30 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d6d600640 1 -- 172.21.15.52:0/75742512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68005310 con 0x7f3d700cce30 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7015ea40 con 0x7f3d700cce30 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.447+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7015f000 con 0x7f3d700cce30 2024-09-10T08:42:12.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.449+0000 7f3d6d600640 1 -- 172.21.15.52:0/75742512 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d680056c0 con 0x7f3d700cce30 2024-09-10T08:42:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.450+0000 7f3d6d600640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 0x7f3d5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.451+0000 7f3d6d600640 1 -- 172.21.15.52:0/75742512 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f3d6808acf0 con 0x7f3d700cce30 2024-09-10T08:42:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.451+0000 7f3d75600640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 0x7f3d5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.451+0000 7f3d7b057740 1 Processor -- start 2024-09-10T08:42:12.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.451+0000 7f3d7b057740 1 -- start start 2024-09-10T08:42:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d75600640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 0x7f3d5006e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3d64007c40 tx=0x7f3d64007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 0x556924aea200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556924a07660 con 0x556924a9f480 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5569249af680 con 0x556924ab9800 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556924a03620 con 0x556924ab9420 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d76000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d76000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52124/0 (socket says 172.21.15.52:52124) 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.452+0000 7f3d76000640 1 -- 172.21.15.52:0/184977672 learned_addr learned my addr 172.21.15.52:0/184977672 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d74c00640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 0x556924aea200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d75600640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 -- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 msgr2=0x556924ae9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 -- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 msgr2=0x556924aea200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 0x556924aea200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 -- 172.21.15.52:0/184977672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569247e47d0 con 0x556924a9f480 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d74c00640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 0x556924aea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d75600640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d76000640 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f3d68058fd0 tx=0x7f3d68059100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c426cd768e5e6172 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d61c00640 1 -- 172.21.15.52:0/184977672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68087070 con 0x556924a9f480 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d61c00640 1 -- 172.21.15.52:0/184977672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d68057340 con 0x556924a9f480 2024-09-10T08:42:12.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.453+0000 7f3d61c00640 1 -- 172.21.15.52:0/184977672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68082b70 con 0x556924a9f480 2024-09-10T08:42:12.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 -- 172.21.15.52:0/184977672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 msgr2=0x556924aea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f3d68058fd0 tx=0x7f3d68059100 comp rx=0 tx=0).stop 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 -- 172.21.15.52:0/184977672 shutdown_connections 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924a9f480 0x556924aea740 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ab9800 0x556924aea200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 --2- 172.21.15.52:0/184977672 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 -- 172.21.15.52:0/184977672 >> 172.21.15.52:0/184977672 conn(0x556924aa0220 msgr2=0x556924ae8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 -- 172.21.15.52:0/184977672 shutdown_connections 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.454+0000 7f3d7b057740 1 -- 172.21.15.52:0/184977672 wait complete. 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.455+0000 7f3d7b057740 1 -- start start 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.455+0000 7f3d7b057740 1 Processor -- start 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924ae5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924adf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556924a9e3e0 con 0x556924ab9420 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5569249904c0 con 0x556924ae42d0 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556924a9e6c0 con 0x556924ab9800 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d7b057740 10 client.0 _ll_register_callbacks cb 0x5569249ffe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d75600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d75600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52128/0 (socket says 172.21.15.52:52128) 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d75600640 1 -- 172.21.15.52:0/4020030702 learned_addr learned my addr 172.21.15.52:0/4020030702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d76000640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924adf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.456+0000 7f3d74c00640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924ae5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 -- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 msgr2=0x556924ae5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924ae5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 -- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 msgr2=0x556924adf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924adf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 -- 172.21.15.52:0/4020030702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692471a3f0 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d75600640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3d640049f0 tx=0x7f3d64007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15502193aa5886a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d56000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64026060 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f3d64021aa0 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d68057340 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f3d64019070 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d7b057740 10 client.10395 fetch_fsmap learned FSMap version 141 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.457+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x5569246da0f0 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d68057340 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f3d6401f070 con 0x556924ab9420 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 10 client.10395 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:42:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 10 client.10395 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:42:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 20 client.10395 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924af8c20 0x556924af9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 4 client.10395 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:42:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556924a14d90 con 0x556924af8c20 2024-09-10T08:42:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.458+0000 7f3d74c00640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924af8c20 0x556924af9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.459+0000 7f3d74c00640 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924af8c20 0x556924af9030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b731ab63607fac server_cookie=258bd7e969e98fcf in_seq=0 out_seq=0 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.459+0000 7f3d56000640 10 client.10395 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d56000640 1 -- 172.21.15.52:0/4020030702 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556924a14d90 con 0x556924af8c20 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d56000640 10 client.10395 handle_command_reply: tid=0 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 client.10395 shutdown 2024-09-10T08:42:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 msgr2=0x556924ade930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f3d640049f0 tx=0x7f3d64007ed0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 shutdown_connections 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924af8c20 0x556924af9030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924adf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924ae5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 --2- 172.21.15.52:0/4020030702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924ade930 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d56000640 0 client.10395 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.460+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 >> 172.21.15.52:0/4020030702 conn(0x556924a9f480 msgr2=0x556924ae87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.461+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 shutdown_connections 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.461+0000 7f3d7b057740 1 -- 172.21.15.52:0/4020030702 wait complete. 2024-09-10T08:42:12.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.461+0000 7f3d7b057740 20 client.10395 trim_cache size 0 max 16384 2024-09-10T08:42:12.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 Processor -- start 2024-09-10T08:42:12.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 -- start start 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924af6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70200df0 con 0x556924ab9800 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d701ffe70 con 0x556924ae42d0 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.479+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3d701e9c80 con 0x556924ab9420 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52130/0 (socket says 172.21.15.52:52130) 2024-09-10T08:42:12.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 -- 172.21.15.52:0/1040575600 learned_addr learned my addr 172.21.15.52:0/1040575600 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 -- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 msgr2=0x556924ae0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d76000640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924af6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d75600640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 -- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 msgr2=0x556924af6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924af6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 -- 172.21.15.52:0/1040575600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556924ae05a0 con 0x556924ab9800 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d76000640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924af6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d75600640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:12.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.480+0000 7f3d74c00640 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0098c0 tx=0x7f3d5c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea61a26fb6a938 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d61200640 1 -- 172.21.15.52:0/1040575600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c037040 con 0x556924ab9800 2024-09-10T08:42:12.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d61200640 1 -- 172.21.15.52:0/1040575600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c038040 con 0x556924ab9800 2024-09-10T08:42:12.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d61200640 1 -- 172.21.15.52:0/1040575600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003850 con 0x556924ab9800 2024-09-10T08:42:12.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 -- 172.21.15.52:0/1040575600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 msgr2=0x556924ae10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0098c0 tx=0x7f3d5c02c000 comp rx=0 tx=0).stop 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 -- 172.21.15.52:0/1040575600 shutdown_connections 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924af6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9800 0x556924ae10d0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 --2- 172.21.15.52:0/1040575600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9420 0x556924ae0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 -- 172.21.15.52:0/1040575600 >> 172.21.15.52:0/1040575600 conn(0x556924a9f480 msgr2=0x556924acdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 -- 172.21.15.52:0/1040575600 shutdown_connections 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.481+0000 7f3d7b057740 1 -- 172.21.15.52:0/1040575600 wait complete. 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.482+0000 7f3d7b057740 1 -- start start 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.482+0000 7f3d7b057740 1 Processor -- start 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924afe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924afe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556924ae1840 con 0x556924ab9420 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d701ea2d0 con 0x556924ae42d0 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556924aceb90 con 0x556924ab9800 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d7b057740 10 client.0 _ll_register_callbacks cb 0x7f3d64004800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d75600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d75600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52140/0 (socket says 172.21.15.52:52140) 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d75600640 1 -- 172.21.15.52:0/514266622 learned_addr learned my addr 172.21.15.52:0/514266622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d76000640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924afe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.483+0000 7f3d74c00640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924afe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 -- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 msgr2=0x556924afe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924afe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 -- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 msgr2=0x556924afe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924afe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 -- 172.21.15.52:0/514266622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556924afee40 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d75600640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f3d64012ff0 tx=0x7f3d64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a154ef2298ee7a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d56000640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64039060 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f3d64026820 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.484+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d5c038040 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f3d64030040 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 10 client.10401 fetch_fsmap learned FSMap version 141 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x556924ae5cb0 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c038040 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7f3d64033030 con 0x556924ab9420 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 10 client.10401 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:42:12.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 10 client.10401 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:42:12.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 20 client.10401 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:12.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924aa4540 0x556924a9cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 4 client.10401 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:42:12.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.485+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556924a0f0e0 con 0x556924aa4540 2024-09-10T08:42:12.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.486+0000 7f3d74c00640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924aa4540 0x556924a9cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d74c00640 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924aa4540 0x556924a9cf60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d96b97f2e7f43f4 server_cookie=ed9bd6516dbb6dec in_seq=0 out_seq=0 2024-09-10T08:42:12.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d56000640 10 client.10401 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d56000640 1 -- 172.21.15.52:0/514266622 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556924a0f0e0 con 0x556924aa4540 2024-09-10T08:42:12.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d56000640 10 client.10401 handle_command_reply: tid=0 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 client.10401 shutdown 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 msgr2=0x556924b5c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f3d64012ff0 tx=0x7f3d64014000 comp rx=0 tx=0).stop 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 shutdown_connections 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556924aa4540 0x556924a9cf60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556924ae42d0 0x556924afe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556924ab9800 0x556924afe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 --2- 172.21.15.52:0/514266622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556924ab9420 0x556924b5c8d0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 >> 172.21.15.52:0/514266622 conn(0x556924a9f480 msgr2=0x556924adea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d56000640 0 client.10401 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 shutdown_connections 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 1 -- 172.21.15.52:0/514266622 wait complete. 2024-09-10T08:42:12.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.487+0000 7f3d7b057740 20 client.10401 trim_cache size 0 max 16384 2024-09-10T08:42:12.492 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:12.492 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:42:12.492 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:42:12.492 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 msgr2=0x7f3d5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 0x7f3d5006e2f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3d64007c40 tx=0x7f3d64007b90 comp rx=0 tx=0).stop 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 msgr2=0x7f3d700cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cf7b0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c730 tx=0x7f3d6800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 shutdown_connections 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3d5006be30 0x7f3d5006e2f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d700cce30 0x7f3d700cf7b0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700732e0 0x7f3d700cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 --2- 172.21.15.52:0/75742512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d70071c70 0x7f3d70157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 >> 172.21.15.52:0/75742512 conn(0x7f3d7006d0f0 msgr2=0x7f3d7006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 shutdown_connections 2024-09-10T08:42:12.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.488+0000 7f3d78000640 1 -- 172.21.15.52:0/75742512 wait complete. 2024-09-10T08:42:12.504 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:42:12.504 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-10T08:42:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.663+0000 7ff284200640 1 Processor -- start 2024-09-10T08:42:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.664+0000 7ff284200640 1 -- start start 2024-09-10T08:42:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff284200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 0x7ff27c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff284200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff27c0cd270 0x7ff27c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff284200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27c0714b0 con 0x7ff27c0cce30 2024-09-10T08:42:12.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff284200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff27c073c00 con 0x7ff27c0cd270 2024-09-10T08:42:12.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff284200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c0cd880 con 0x7ff27c0732e0 2024-09-10T08:42:12.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff280e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff27c0cce30 0x7ff27c071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39186/0 (socket says 172.21.15.52:39186) 2024-09-10T08:42:12.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff280e00640 1 -- 172.21.15.52:0/4256477665 learned_addr learned my addr 172.21.15.52:0/4256477665 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:12.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352195862 0 0) 0x7ff27c0714b0 con 0x7ff27c0cce30 2024-09-10T08:42:12.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.665+0000 7ff281800640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 0x7ff27c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff264003520 con 0x7ff27c0cce30 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff282200640 1 --2- 172.21.15.52:0/4256477665 >> v2:172.21.15.176:3300/0 conn(0x7ff27c0cd270 0x7ff27c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3434386213 0 0) 0x7ff264003520 con 0x7ff27c0cce30 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 msgr2=0x7ff27c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 0x7ff27c0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 >> v2:172.21.15.176:3300/0 conn(0x7ff27c0cd270 msgr2=0x7ff27c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 --2- 172.21.15.52:0/4256477665 >> v2:172.21.15.176:3300/0 conn(0x7ff27c0cd270 0x7ff27c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c0cdb60 con 0x7ff27c0cce30 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7ff268001670 con 0x7ff27c0cce30 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 >> v1:172.21.15.52:6789/0 conn(0x7ff27c0cce30 legacy=0x7ff27c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff264003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff264004800 0x7ff264004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 0x7ff2640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c073c00 con 0x7ff2640039b0 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0cd880 con 0x7ff264004800 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff26400bb20 con 0x7ff27c0732e0 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff281800640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff264003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff280e00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff264004800 0x7ff264004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff281800640 1 -- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 msgr2=0x7ff2640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.666+0000 7ff281800640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0732e0 0x7ff2640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.667+0000 7ff281800640 1 -- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff264004800 msgr2=0x7ff264004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.667+0000 7ff281800640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff264004800 0x7ff264004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.667+0000 7ff281800640 1 -- 172.21.15.52:0/4256477665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264003520 con 0x7ff2640039b0 2024-09-10T08:42:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.667+0000 7ff280e00640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff264004800 0x7ff264004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff281800640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff264003dd0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff27000ba00 tx=0x7ff264005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a6cc5b66cb446e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270030070 con 0x7ff2640039b0 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27002adb0 con 0x7ff2640039b0 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff27be00640 1 -- 172.21.15.52:0/4256477665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000b600 con 0x7ff2640039b0 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff284200640 1 -- 172.21.15.52:0/4256477665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 msgr2=0x7ff264003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff284200640 1 --2- 172.21.15.52:0/4256477665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff264003dd0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff27000ba00 tx=0x7ff264005830 comp rx=0 tx=0).stop 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff282200640 1 -- 172.21.15.52:0/4256477665 reap_dead start 2024-09-10T08:42:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff284200640 1 -- 172.21.15.52:0/4256477665 shutdown_connections 2024-09-10T08:42:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff284200640 1 -- 172.21.15.52:0/4256477665 >> 172.21.15.52:0/4256477665 conn(0x7ff27c06d0f0 msgr2=0x7ff27c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.668+0000 7ff284200640 1 -- 172.21.15.52:0/4256477665 shutdown_connections 2024-09-10T08:42:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.669+0000 7ff284200640 1 -- 172.21.15.52:0/4256477665 wait complete. 2024-09-10T08:42:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.670+0000 7ff284200640 1 Processor -- start 2024-09-10T08:42:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.670+0000 7ff284200640 1 -- start start 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0c69f0 0x7ff27c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 0x7ff27c0b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c06bf70 con 0x7ff2640039b0 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c06bdf0 con 0x7ff27c1f1fe0 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff284200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c072380 con 0x7ff27c0c69f0 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff281800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff281800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52158/0 (socket says 172.21.15.52:52158) 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.671+0000 7ff281800640 1 -- 172.21.15.52:0/834517624 learned_addr learned my addr 172.21.15.52:0/834517624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff280e00640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0c69f0 0x7ff27c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff282200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 0x7ff27c0b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 -- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0c69f0 msgr2=0x7ff27c15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0c69f0 0x7ff27c15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 -- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 msgr2=0x7ff27c0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 0x7ff27c0b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 -- 172.21.15.52:0/834517624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c1f2950 con 0x7ff2640039b0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff282200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 0x7ff27c0b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff281800640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7ff27000bb20 tx=0x7ff270004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.672+0000 7ff279600640 1 -- 172.21.15.52:0/834517624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270043020 con 0x7ff2640039b0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.673+0000 7ff279600640 1 -- 172.21.15.52:0/834517624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27003f680 con 0x7ff2640039b0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.673+0000 7ff279600640 1 -- 172.21.15.52:0/834517624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000b600 con 0x7ff2640039b0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.673+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c1f2c30 con 0x7ff2640039b0 2024-09-10T08:42:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.673+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c157160 con 0x7ff2640039b0 2024-09-10T08:42:12.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.675+0000 7ff279600640 1 -- 172.21.15.52:0/834517624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff270046020 con 0x7ff2640039b0 2024-09-10T08:42:12.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.676+0000 7ff279600640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 0x7ff25c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.676+0000 7ff279600640 1 -- 172.21.15.52:0/834517624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7ff2700ab930 con 0x7ff2640039b0 2024-09-10T08:42:12.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.677+0000 7ff280e00640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 0x7ff25c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.677+0000 7ff287001740 1 Processor -- start 2024-09-10T08:42:12.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.677+0000 7ff287001740 1 -- start start 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.677+0000 7ff280e00640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 0x7ff25c06e320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff268001860 tx=0x7ff268007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec2c0 0x556a82c09be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82c0b8b0 0x556a82c0bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a82b28490 con 0x556a82bec6a0 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a82ad0690 con 0x556a82bec2c0 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a82b24450 con 0x556a82c0b8b0 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff280e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff280e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52172/0 (socket says 172.21.15.52:52172) 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff280e00640 1 -- 172.21.15.52:0/4281883719 learned_addr learned my addr 172.21.15.52:0/4281883719 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff282200640 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82c0b8b0 0x556a82c0bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.678+0000 7ff281800640 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec2c0 0x556a82c09be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 -- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82c0b8b0 msgr2=0x556a82c0bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82c0b8b0 0x556a82c0bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 -- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec2c0 msgr2=0x556a82c09be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec2c0 0x556a82c09be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 -- 172.21.15.52:0/4281883719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a82ad7e00 con 0x556a82bec6a0 2024-09-10T08:42:12.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff280e00640 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7ff268011ce0 tx=0x7ff268014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e77fc9a14fb5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff26e000640 1 -- 172.21.15.52:0/4281883719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268027070 con 0x556a82bec6a0 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff26e000640 1 -- 172.21.15.52:0/4281883719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268022420 con 0x556a82bec6a0 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.679+0000 7ff26e000640 1 -- 172.21.15.52:0/4281883719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2680227d0 con 0x556a82bec6a0 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 -- 172.21.15.52:0/4281883719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 msgr2=0x556a82c09360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7ff268011ce0 tx=0x7ff268014000 comp rx=0 tx=0).stop 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 -- 172.21.15.52:0/4281883719 shutdown_connections 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82c0b8b0 0x556a82c0bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c09360 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 --2- 172.21.15.52:0/4281883719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec2c0 0x556a82c09be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 -- 172.21.15.52:0/4281883719 >> 172.21.15.52:0/4281883719 conn(0x556a82bc1d20 msgr2=0x556a82c0a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 -- 172.21.15.52:0/4281883719 shutdown_connections 2024-09-10T08:42:12.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.680+0000 7ff287001740 1 -- 172.21.15.52:0/4281883719 wait complete. 2024-09-10T08:42:12.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.681+0000 7ff287001740 1 -- start start 2024-09-10T08:42:12.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.681+0000 7ff287001740 1 Processor -- start 2024-09-10T08:42:12.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bec6a0 0x556a82bf1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82be9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a82c0b280 con 0x556a82bc4830 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a82ae3950 con 0x556a82c0b8b0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a82c0b560 con 0x556a82bec6a0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff287001740 10 client.0 _ll_register_callbacks cb 0x556a82aaf4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff282200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff282200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52188/0 (socket says 172.21.15.52:52188) 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff282200640 1 -- 172.21.15.52:0/3833266000 learned_addr learned my addr 172.21.15.52:0/3833266000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff281800640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bec6a0 0x556a82bf1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.682+0000 7ff280e00640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82be9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 -- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bec6a0 msgr2=0x556a82bf1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bec6a0 0x556a82bf1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 -- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 msgr2=0x556a82be9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82be9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 -- 172.21.15.52:0/3833266000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a82adcf40 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff282200640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7ff274012990 tx=0x7ff274012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f39218a82d8a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff262a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27401c020 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7ff274007c00 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.683+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff268022420 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7ff274026050 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 10 client.10413 fetch_fsmap learned FSMap version 141 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x556a8283b3f0 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268022420 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7ff274029020 con 0x556a82bc4830 2024-09-10T08:42:12.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 10 client.10413 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 10 client.10413 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 20 client.10413 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82beed80 0x556a82bef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 4 client.10413 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.684+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a82b35bc0 con 0x556a82beed80 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.685+0000 7ff281800640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82beed80 0x556a82bef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.685+0000 7ff281800640 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82beed80 0x556a82bef1b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6293e0d6aace6edd server_cookie=7141bab0df8a4695 in_seq=0 out_seq=0 2024-09-10T08:42:12.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.685+0000 7ff262a00640 10 client.10413 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff262a00640 1 -- 172.21.15.52:0/3833266000 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a82b35bc0 con 0x556a82beed80 2024-09-10T08:42:12.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff262a00640 10 client.10413 handle_command_reply: tid=0 2024-09-10T08:42:12.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 client.10413 shutdown 2024-09-10T08:42:12.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 msgr2=0x556a82bc4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7ff274012990 tx=0x7ff274012e50 comp rx=0 tx=0).stop 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 shutdown_connections 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82beed80 0x556a82bef1b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bc4830 0x556a82bc4cb0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82be9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 --2- 172.21.15.52:0/3833266000 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bec6a0 0x556a82bf1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 >> 172.21.15.52:0/3833266000 conn(0x556a82bec2c0 msgr2=0x556a82c087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.686+0000 7ff262a00640 0 client.10413 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.687+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 shutdown_connections 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.687+0000 7ff287001740 1 -- 172.21.15.52:0/3833266000 wait complete. 2024-09-10T08:42:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.687+0000 7ff287001740 20 client.10413 trim_cache size 0 max 16384 2024-09-10T08:42:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.700+0000 7ff287001740 1 Processor -- start 2024-09-10T08:42:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 -- start start 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82c82f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82c0d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c1fcf80 con 0x556a82bec6a0 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0cfb70 con 0x556a82c0b8b0 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.701+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c1f61a0 con 0x556a82bc4830 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52200/0 (socket says 172.21.15.52:52200) 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 -- 172.21.15.52:0/202910793 learned_addr learned my addr 172.21.15.52:0/202910793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff281800640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82c82f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff282200640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82c0d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 -- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 msgr2=0x556a82c82f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82c82f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 -- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 msgr2=0x556a82c0d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82c0d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 -- 172.21.15.52:0/202910793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a829057d0 con 0x556a82bec6a0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff282200640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82c0d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.702+0000 7ff280e00640 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d655c671d95b1f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff26d600640 1 -- 172.21.15.52:0/202910793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268027040 con 0x556a82bec6a0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff26d600640 1 -- 172.21.15.52:0/202910793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268028040 con 0x556a82bec6a0 2024-09-10T08:42:12.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff26d600640 1 -- 172.21.15.52:0/202910793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268022a10 con 0x556a82bec6a0 2024-09-10T08:42:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 -- 172.21.15.52:0/202910793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 msgr2=0x556a82c0d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7ff268000c00 tx=0x7ff268016000 comp rx=0 tx=0).stop 2024-09-10T08:42:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 -- 172.21.15.52:0/202910793 shutdown_connections 2024-09-10T08:42:12.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82c0b8b0 0x556a82c0d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82bec6a0 0x556a82c0d310 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 --2- 172.21.15.52:0/202910793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82c82f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 -- 172.21.15.52:0/202910793 >> 172.21.15.52:0/202910793 conn(0x556a82bec2c0 msgr2=0x556a82c0bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 -- 172.21.15.52:0/202910793 shutdown_connections 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.703+0000 7ff287001740 1 -- 172.21.15.52:0/202910793 wait complete. 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.704+0000 7ff287001740 1 -- start start 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.704+0000 7ff287001740 1 Processor -- start 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82bde730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 0x556a82c81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a82bed770 con 0x556a82c0b8b0 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c0cf520 con 0x556a82bec6a0 2024-09-10T08:42:12.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a82bedaa0 con 0x556a82bc4830 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff287001740 10 client.0 _ll_register_callbacks cb 0x7ff274009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff282200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff282200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52206/0 (socket says 172.21.15.52:52206) 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.705+0000 7ff282200640 1 -- 172.21.15.52:0/3410167011 learned_addr learned my addr 172.21.15.52:0/3410167011 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff280e00640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 0x556a82c81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff281800640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82bde730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 -- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 msgr2=0x556a82bde730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82bde730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 -- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 msgr2=0x556a82c81970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 0x556a82c81970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 -- 172.21.15.52:0/3410167011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a82c31f20 con 0x556a82c0b8b0 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff280e00640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 0x556a82c81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:12.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff281800640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82bde730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff282200640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7ff274012350 tx=0x7ff274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c8563232084b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff262a00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27401c040 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7ff274016420 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.706+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff268028040 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7ff274007d70 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 10 client.10419 fetch_fsmap learned FSMap version 141 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x556a82c81f40 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff268028040 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 141) ==== 3502+0+0 (secure 0 0 0) 0x7ff27403a080 con 0x556a82c0b8b0 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 10 client.10419 fetch_fsmap finished waiting for FSMap version 141 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 10 client.10419 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-10T08:42:12.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 20 client.10419 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:12.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82c32790 0x556a82be8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 4 client.10419 mds_command: new command op to 10176 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T08:42:12.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 --> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a82bbb460 con 0x556a82c32790 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.707+0000 7ff281800640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82c32790 0x556a82be8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff281800640 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82c32790 0x556a82be8ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7ac141dc60c4654 server_cookie=860c2d137a98572e in_seq=0 out_seq=0 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff262a00640 10 client.10419 ms_handle_connect on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff262a00640 1 -- 172.21.15.52:0/3410167011 <== mds.0 v2:172.21.15.176:6835/1803120524 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a82bbb460 con 0x556a82c32790 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff262a00640 10 client.10419 handle_command_reply: tid=0 2024-09-10T08:42:12.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 client.10419 shutdown 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 msgr2=0x556a82c1f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7ff274012350 tx=0x7ff274004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 shutdown_connections 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:6835/1803120524,v1:172.21.15.176:6837/1803120524] conn(0x556a82c32790 0x556a82be8ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a82c0b8b0 0x556a82c1f1d0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff262a00640 0 client.10419 ms_handle_reset on v2:172.21.15.176:6835/1803120524 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a82bec6a0 0x556a82c81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 --2- 172.21.15.52:0/3410167011 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a82bc4830 0x556a82bde730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.708+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 >> 172.21.15.52:0/3410167011 conn(0x556a82bec2c0 msgr2=0x556a82c824f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 shutdown_connections 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff287001740 1 -- 172.21.15.52:0/3410167011 wait complete. 2024-09-10T08:42:12.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff287001740 20 client.10419 trim_cache size 0 max 16384 2024-09-10T08:42:12.714 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-10T08:42:12.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 msgr2=0x7ff25c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 0x7ff25c06e320 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff268001860 tx=0x7ff268007040 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 msgr2=0x7ff27c156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7ff27000bb20 tx=0x7ff270004730 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 shutdown_connections 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff25c06be60 0x7ff25c06e320 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1f1fe0 0x7ff27c0b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff27c0c69f0 0x7ff27c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 --2- 172.21.15.52:0/834517624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2640039b0 0x7ff27c156c20 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 >> 172.21.15.52:0/834517624 conn(0x7ff27c06d0f0 msgr2=0x7ff27c0cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.709+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 shutdown_connections 2024-09-10T08:42:12.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.710+0000 7ff284200640 1 -- 172.21.15.52:0/834517624 wait complete. 2024-09-10T08:42:12.725 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T08:42:12.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.880+0000 7fea4dc00640 1 Processor -- start 2024-09-10T08:42:12.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.880+0000 7fea4dc00640 1 -- start start 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea4dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea48070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea4dc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fea48148260 0x7fea480714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea4dc00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea48071b30 con 0x7fea4806bc10 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea4dc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fea48074200 con 0x7fea48148260 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea4dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea480b3e40 con 0x7fea48147e80 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea47400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fea4806bc10 0x7fea481623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:39188/0 (socket says 172.21.15.52:39188) 2024-09-10T08:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.881+0000 7fea47400640 1 -- 172.21.15.52:0/3269719439 learned_addr learned my addr 172.21.15.52:0/3269719439 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea46a00640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea48070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980788420 0 0) 0x7fea48071b30 con 0x7fea4806bc10 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea46000640 1 --2- 172.21.15.52:0/3269719439 >> v2:172.21.15.176:3300/0 conn(0x7fea48148260 0x7fea480714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea2c003520 con 0x7fea4806bc10 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1293666817 0 0) 0x7fea2c003520 con 0x7fea4806bc10 2024-09-10T08:42:12.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 msgr2=0x7fea48070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea48070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 >> v2:172.21.15.176:3300/0 conn(0x7fea48148260 msgr2=0x7fea480714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 --2- 172.21.15.52:0/3269719439 >> v2:172.21.15.176:3300/0 conn(0x7fea48148260 0x7fea480714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea480b3510 con 0x7fea4806bc10 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fea400019f0 con 0x7fea4806bc10 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 >> v1:172.21.15.52:6789/0 conn(0x7fea4806bc10 legacy=0x7fea481623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c0039b0 0x7fea2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea48074200 con 0x7fea2c004800 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea480b3e40 con 0x7fea2c0039b0 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.882+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea2c00b9c0 con 0x7fea48147e80 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46a00640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c0039b0 0x7fea2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea47400640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 -- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 msgr2=0x7fea2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea48147e80 0x7fea2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 -- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c0039b0 msgr2=0x7fea2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c0039b0 0x7fea2c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46000640 1 -- 172.21.15.52:0/3269719439 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2c003520 con 0x7fea2c004800 2024-09-10T08:42:12.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.883+0000 7fea46a00640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea2c0039b0 0x7fea2c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.884+0000 7fea46000640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea2c004c80 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fea34009a90 tx=0x7fea2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386f283c31b9542d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.884+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34036070 con 0x7fea2c004800 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.884+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea34031400 con 0x7fea2c004800 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.884+0000 7fea45600640 1 -- 172.21.15.52:0/3269719439 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34009690 con 0x7fea2c004800 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 -- 172.21.15.52:0/3269719439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 msgr2=0x7fea2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 --2- 172.21.15.52:0/3269719439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea2c004c80 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fea34009a90 tx=0x7fea2c005830 comp rx=0 tx=0).stop 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea47400640 1 -- 172.21.15.52:0/3269719439 reap_dead start 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 -- 172.21.15.52:0/3269719439 shutdown_connections 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 -- 172.21.15.52:0/3269719439 >> 172.21.15.52:0/3269719439 conn(0x7fea480ccec0 msgr2=0x7fea480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 -- 172.21.15.52:0/3269719439 shutdown_connections 2024-09-10T08:42:12.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.885+0000 7fea4dc00640 1 -- 172.21.15.52:0/3269719439 wait complete. 2024-09-10T08:42:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.887+0000 7fea4dc00640 1 Processor -- start 2024-09-10T08:42:12.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.887+0000 7fea4dc00640 1 -- start start 2024-09-10T08:42:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 0x7fea480cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea480cca40 0x7fea48073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea480b52e0 con 0x7fea2c004800 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea480b3ad0 con 0x7fea481e7bd0 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea4dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fea480b5460 con 0x7fea480cca40 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52230/0 (socket says 172.21.15.52:52230) 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 -- 172.21.15.52:0/1415892584 learned_addr learned my addr 172.21.15.52:0/1415892584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 -- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea480cca40 msgr2=0x7fea48073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea480cca40 0x7fea48073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 -- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 msgr2=0x7fea480cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46000640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 0x7fea480cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.888+0000 7fea46a00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 0x7fea480cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:12.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea46a00640 1 -- 172.21.15.52:0/1415892584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea48141510 con 0x7fea2c004800 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea46000640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 0x7fea480cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea46a00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fea38011a20 tx=0x7fea38011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3800fbb0 con 0x7fea2c004800 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3800fd50 con 0x7fea2c004800 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38014640 con 0x7fea2c004800 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea481e8050 con 0x7fea2c004800 2024-09-10T08:42:12.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.889+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea481e5b10 con 0x7fea2c004800 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.890+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4806c070 con 0x7fea2c004800 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.891+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea38012040 con 0x7fea2c004800 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.892+0000 7fea3ea00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 0x7fea2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.892+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fea3808b570 con 0x7fea2c004800 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.893+0000 7fea46000640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 0x7fea2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:12.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.893+0000 7fea46000640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 0x7fea2806e2f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fea34033000 tx=0x7fea34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:12.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:12.897+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea38019030 con 0x7fea2c004800 2024-09-10T08:42:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.118+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea48073f30 con 0x7fea2c004800 2024-09-10T08:42:13.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.118+0000 7fea3ea00640 1 -- 172.21.15.52:0/1415892584 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fea38089e20 con 0x7fea2c004800 2024-09-10T08:42:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:13.119 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:42:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.120+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 msgr2=0x7fea2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.120+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 0x7fea2806e2f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fea34033000 tx=0x7fea34008030 comp rx=0 tx=0).stop 2024-09-10T08:42:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.120+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 msgr2=0x7fea48140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.120+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fea38011a20 tx=0x7fea38011ee0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 shutdown_connections 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fea2806be30 0x7fea2806e2f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fea480cca40 0x7fea48073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea481e7bd0 0x7fea480cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 --2- 172.21.15.52:0/1415892584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea2c004800 0x7fea48140bf0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 >> 172.21.15.52:0/1415892584 conn(0x7fea480ccec0 msgr2=0x7fea480cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 shutdown_connections 2024-09-10T08:42:13.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.121+0000 7fea4dc00640 1 -- 172.21.15.52:0/1415892584 wait complete. 2024-09-10T08:42:13.137 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:42:13.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:42:13.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:42:13.333 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:42:13.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:42:13.334 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:13.334 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:13.369 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:13.369 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:13.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:42:13.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.643+0000 7fb958c00640 1 Processor -- start 2024-09-10T08:42:13.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.643+0000 7fb958c00640 1 -- start start 2024-09-10T08:42:13.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb958c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb95415e790 0x7fb954073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb958c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb95406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb958c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9541631c0 con 0x7fb954162c60 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb958c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb95415eb70 con 0x7fb95415e790 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb958c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540700c0 con 0x7fb95406f730 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.644+0000 7fb951e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb95415e790 0x7fb954073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb95415e790 0x7fb954073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52238/0 (socket says 172.21.15.52:52238) 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 -- 172.21.15.52:0/2137368188 learned_addr learned my addr 172.21.15.52:0/2137368188 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb952800640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb95406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 -- 172.21.15.52:0/2137368188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 msgr2=0x7fb95406fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb95406fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 -- 172.21.15.52:0/2137368188 >> v1:172.21.15.176:6789/0 conn(0x7fb954162c60 legacy=0x7fb9540b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.645+0000 7fb951e00640 1 -- 172.21.15.52:0/2137368188 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540ae9a0 con 0x7fb95415e790 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.646+0000 7fb951e00640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb954073a40 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb944009870 tx=0x7fb94402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c786e589b48320e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.646+0000 7fb950a00640 1 -- 172.21.15.52:0/2137368188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944037070 con 0x7fb95415e790 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.646+0000 7fb950a00640 1 -- 172.21.15.52:0/2137368188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb944032440 con 0x7fb95415e790 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.646+0000 7fb950a00640 1 -- 172.21.15.52:0/2137368188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944032810 con 0x7fb95415e790 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 -- 172.21.15.52:0/2137368188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 msgr2=0x7fb954073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb954073a40 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb944009870 tx=0x7fb94402a140 comp rx=0 tx=0).stop 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 -- 172.21.15.52:0/2137368188 shutdown_connections 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb95406fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 --2- 172.21.15.52:0/2137368188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb954073a40 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 -- 172.21.15.52:0/2137368188 >> 172.21.15.52:0/2137368188 conn(0x7fb9540b0a80 msgr2=0x7fb9540b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:13.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 -- 172.21.15.52:0/2137368188 shutdown_connections 2024-09-10T08:42:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.647+0000 7fb958c00640 1 -- 172.21.15.52:0/2137368188 wait complete. 2024-09-10T08:42:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.649+0000 7fb958c00640 1 Processor -- start 2024-09-10T08:42:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.649+0000 7fb958c00640 1 -- start start 2024-09-10T08:42:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.649+0000 7fb958c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb9540cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb958c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb958c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb954162c60 0x7fb9540c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb958c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540af200 con 0x7fb95415e790 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb958c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540aef20 con 0x7fb954162c60 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb958c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540b5b40 con 0x7fb95406f730 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52248/0 (socket says 172.21.15.52:52248) 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 -- 172.21.15.52:0/2311419094 learned_addr learned my addr 172.21.15.52:0/2311419094 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951e00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb9540cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb952800640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb954162c60 0x7fb9540c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 -- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 msgr2=0x7fb9540cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb9540cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 -- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb954162c60 msgr2=0x7fb9540c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb954162c60 0x7fb9540c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.650+0000 7fb951400640 1 -- 172.21.15.52:0/2311419094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540ca7b0 con 0x7fb95415e790 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb951400640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c430 tx=0x7fb94000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400052d0 con 0x7fb95415e790 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940005490 con 0x7fb95415e790 2024-09-10T08:42:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940007260 con 0x7fb95415e790 2024-09-10T08:42:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9540cc1e0 con 0x7fb95415e790 2024-09-10T08:42:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.651+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9540cbe90 con 0x7fb95415e790 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.652+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95406f430 con 0x7fb95415e790 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.653+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb940007400 con 0x7fb95415e790 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.654+0000 7fb94a000640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 0x7fb93406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.654+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fb94008a420 con 0x7fb95415e790 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.654+0000 7fb951e00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 0x7fb93406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.655+0000 7fb951e00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 0x7fb93406e320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:13.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.658+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb940058d30 con 0x7fb95415e790 2024-09-10T08:42:13.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.855+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9540cd820 con 0x7fb95415e790 2024-09-10T08:42:13.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.855+0000 7fb94a000640 1 -- 172.21.15.52:0/2311419094 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v183) ==== 80+0+0 (secure 0 0 0) 0x7fb940058630 con 0x7fb95415e790 2024-09-10T08:42:13.856 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:42:13.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 msgr2=0x7fb93406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 0x7fb93406e320 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:13.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 msgr2=0x7fb95414a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:13.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c430 tx=0x7fb94000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 shutdown_connections 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb93406be60 0x7fb93406e320 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb954162c60 0x7fb9540c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb95415e790 0x7fb95414a750 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 --2- 172.21.15.52:0/2311419094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb95406f730 0x7fb9540cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 >> 172.21.15.52:0/2311419094 conn(0x7fb9540b0a80 msgr2=0x7fb954161fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 shutdown_connections 2024-09-10T08:42:13.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:13.857+0000 7fb958c00640 1 -- 172.21.15.52:0/2311419094 wait complete. 2024-09-10T08:42:13.873 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:42:13.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:13.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:42:13.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:42:13.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:13.937 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:42:13.972 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:42:13.973 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:42:13.973 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:14.014 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:42:14.014 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:42:14.015 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:14.015 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:14.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:42:14.050 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:42:14.050 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:42:14.050 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:14.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:42:14.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.249+0000 7f855dc00640 1 Processor -- start 2024-09-10T08:42:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.249+0000 7f855dc00640 1 -- start start 2024-09-10T08:42:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.250+0000 7f855dc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f855815e440 0x7f85580d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.250+0000 7f855dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.250+0000 7f855dc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580d3990 con 0x7f85580cf450 2024-09-10T08:42:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.250+0000 7f855dc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f85580d3c70 con 0x7f855815e440 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.250+0000 7f855dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85580d3f50 con 0x7f85580b6710 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:33676/0 (socket says 172.21.15.52:33676) 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 -- 172.21.15.52:0/1918536312 learned_addr learned my addr 172.21.15.52:0/1918536312 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f8557e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f855815e440 0x7f85580d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f8557400640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f85580cf450 0x7f85580b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:39700/0 (socket says 172.21.15.52:39700) 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 -- 172.21.15.52:0/1918536312 >> v2:172.21.15.176:3300/0 conn(0x7f855815e440 msgr2=0x7f85580d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 --2- 172.21.15.52:0/1918536312 >> v2:172.21.15.176:3300/0 conn(0x7f855815e440 0x7f85580d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 -- 172.21.15.52:0/1918536312 >> v1:172.21.15.176:6789/0 conn(0x7f85580cf450 legacy=0x7f85580b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.251+0000 7f855d200640 1 -- 172.21.15.52:0/1918536312 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580d4230 con 0x7f85580b6710 2024-09-10T08:42:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.252+0000 7f855d200640 1 --2- 172.21.15.52:0/1918536312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8550009e50 tx=0x7f855002a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f085ecb10ed8c704 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f8556a00640 1 -- 172.21.15.52:0/1918536312 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550036070 con 0x7f85580b6710 2024-09-10T08:42:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f8556a00640 1 -- 172.21.15.52:0/1918536312 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550031600 con 0x7f85580b6710 2024-09-10T08:42:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f8556a00640 1 -- 172.21.15.52:0/1918536312 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500319f0 con 0x7f85580b6710 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 -- 172.21.15.52:0/1918536312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 msgr2=0x7f85580b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 --2- 172.21.15.52:0/1918536312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8550009e50 tx=0x7f855002a7c0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 -- 172.21.15.52:0/1918536312 shutdown_connections 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 --2- 172.21.15.52:0/1918536312 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85580b6710 0x7f85580b7b60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 --2- 172.21.15.52:0/1918536312 >> v2:172.21.15.176:3300/0 conn(0x7f855815e440 0x7f85580d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 -- 172.21.15.52:0/1918536312 >> 172.21.15.52:0/1918536312 conn(0x7f8558067f80 msgr2=0x7f85580d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 -- 172.21.15.52:0/1918536312 shutdown_connections 2024-09-10T08:42:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.253+0000 7f855dc00640 1 -- 172.21.15.52:0/1918536312 wait complete. 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.255+0000 7f855dc00640 1 Processor -- start 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.255+0000 7f855dc00640 1 -- start start 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 0x7f8558157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855815e440 0x7f85580ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85580b76c0 con 0x7f85580b6710 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85580b7540 con 0x7f85580cf450 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f855dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f85580b80a0 con 0x7f855815e440 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f8557e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f8557e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45724/0 (socket says 172.21.15.52:45724) 2024-09-10T08:42:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.256+0000 7f8557e00640 1 -- 172.21.15.52:0/1418241473 learned_addr learned my addr 172.21.15.52:0/1418241473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557400640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 0x7f8558157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f855d200640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855815e440 0x7f85580ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 -- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855815e440 msgr2=0x7f85580ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855815e440 0x7f85580ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 -- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 msgr2=0x7f8558157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 0x7f8558157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 -- 172.21.15.52:0/1418241473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580b9e00 con 0x7f85580b6710 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557400640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 0x7f8558157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f8557e00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f854800e870 tx=0x7f854800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548017070 con 0x7f85580b6710 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854800c940 con 0x7f85580b6710 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85581614e0 con 0x7f85580b6710 2024-09-10T08:42:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.257+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854800cd30 con 0x7f85580b6710 2024-09-10T08:42:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.258+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8558161aa0 con 0x7f85580b6710 2024-09-10T08:42:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.258+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580b7b60 con 0x7f85580b6710 2024-09-10T08:42:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.259+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f854801a070 con 0x7f85580b6710 2024-09-10T08:42:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.261+0000 7f854fe00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 0x7f853806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.261+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f854808ad00 con 0x7f85580b6710 2024-09-10T08:42:14.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.261+0000 7f8557400640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 0x7f853806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.262+0000 7f8557400640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 0x7f853806e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8544007fd0 tx=0x7f8544007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.265+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85480596a0 con 0x7f85580b6710 2024-09-10T08:42:14.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.488+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8558157fe0 con 0x7f85580b6710 2024-09-10T08:42:14.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.488+0000 7f854fe00640 1 -- 172.21.15.52:0/1418241473 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7f8548058fa0 con 0x7f85580b6710 2024-09-10T08:42:14.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:14.489 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:42:14.489 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:42:14.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 msgr2=0x7f853806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 0x7f853806e2f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8544007fd0 tx=0x7f8544007d60 comp rx=0 tx=0).stop 2024-09-10T08:42:14.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 msgr2=0x7f85580b98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f854800e870 tx=0x7f854800ed30 comp rx=0 tx=0).stop 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 shutdown_connections 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f853806be30 0x7f853806e2f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f855815e440 0x7f85580ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85580cf450 0x7f8558157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 --2- 172.21.15.52:0/1418241473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85580b6710 0x7f85580b98c0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 >> 172.21.15.52:0/1418241473 conn(0x7f8558067f80 msgr2=0x7f855815d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:14.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 shutdown_connections 2024-09-10T08:42:14.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.490+0000 7f855dc00640 1 -- 172.21.15.52:0/1418241473 wait complete. 2024-09-10T08:42:14.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:14.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.664+0000 7f9aa8a00640 1 Processor -- start 2024-09-10T08:42:14.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.665+0000 7f9aa8a00640 1 -- start start 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa8a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9aa4073890 0x7f9aa40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa8a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9aa40b5880 0x7f9aa40b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa8a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa40b4020 con 0x7f9aa4145ed0 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa8a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa40b42c0 con 0x7f9aa40b5880 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa8a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa40b45a0 con 0x7f9aa4073890 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9aa40b5880 0x7f9aa40b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9aa40b5880 0x7f9aa40b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45736/0 (socket says 172.21.15.52:45736) 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa2800640 1 -- 172.21.15.52:0/3935268712 learned_addr learned my addr 172.21.15.52:0/3935268712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:14.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9aa1e00640 1 --1- 172.21.15.52:0/3935268712 >> v1:172.21.15.52:6789/0 conn(0x7f9aa4145ed0 0x7f9aa4073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45084/0 (socket says 172.21.15.52:45084) 2024-09-10T08:42:14.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.666+0000 7f9a99400640 1 --2- 172.21.15.52:0/3935268712 >> v2:172.21.15.176:3300/0 conn(0x7f9aa4073890 0x7f9aa40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.667+0000 7f9aa2800640 1 -- 172.21.15.52:0/3935268712 >> v2:172.21.15.176:3300/0 conn(0x7f9aa4073890 msgr2=0x7f9aa40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:14.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.667+0000 7f9aa2800640 1 --2- 172.21.15.52:0/3935268712 >> v2:172.21.15.176:3300/0 conn(0x7f9aa4073890 0x7f9aa40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.667+0000 7f9aa2800640 1 -- 172.21.15.52:0/3935268712 >> v1:172.21.15.52:6789/0 conn(0x7f9aa4145ed0 legacy=0x7f9aa4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.667+0000 7f9aa2800640 1 -- 172.21.15.52:0/3935268712 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa40b4880 con 0x7f9aa40b5880 2024-09-10T08:42:14.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa2800640 1 --2- 172.21.15.52:0/3935268712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa40b5ce0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40d1490 tx=0x7f9a9c02a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dce3e6907b385e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa1400640 1 -- 172.21.15.52:0/3935268712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c036070 con 0x7f9aa40b5880 2024-09-10T08:42:14.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa1400640 1 -- 172.21.15.52:0/3935268712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c031600 con 0x7f9aa40b5880 2024-09-10T08:42:14.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa1400640 1 -- 172.21.15.52:0/3935268712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0319d0 con 0x7f9aa40b5880 2024-09-10T08:42:14.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 -- 172.21.15.52:0/3935268712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 msgr2=0x7f9aa40b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/3935268712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa40b5ce0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40d1490 tx=0x7f9a9c02a740 comp rx=0 tx=0).stop 2024-09-10T08:42:14.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 -- 172.21.15.52:0/3935268712 shutdown_connections 2024-09-10T08:42:14.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/3935268712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa40b5ce0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/3935268712 >> v2:172.21.15.176:3300/0 conn(0x7f9aa4073890 0x7f9aa40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 -- 172.21.15.52:0/3935268712 >> 172.21.15.52:0/3935268712 conn(0x7f9aa40ccec0 msgr2=0x7f9aa40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:14.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.668+0000 7f9aa8a00640 1 -- 172.21.15.52:0/3935268712 shutdown_connections 2024-09-10T08:42:14.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.669+0000 7f9aa8a00640 1 -- 172.21.15.52:0/3935268712 wait complete. 2024-09-10T08:42:14.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.670+0000 7f9aa8a00640 1 Processor -- start 2024-09-10T08:42:14.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.670+0000 7f9aa8a00640 1 -- start start 2024-09-10T08:42:14.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 0x7f9aa4130030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 0x7f9aa413f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa40b63a0 con 0x7f9aa40b5880 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa40b6220 con 0x7f9aa4073890 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa8a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa41462b0 con 0x7f9aa4145ed0 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9a99400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9a99400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45740/0 (socket says 172.21.15.52:45740) 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9a99400640 1 -- 172.21.15.52:0/76700467 learned_addr learned my addr 172.21.15.52:0/76700467 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.671+0000 7f9aa1e00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 0x7f9aa4130030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9aa2800640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 0x7f9aa413f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 -- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 msgr2=0x7f9aa413f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 0x7f9aa413f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 -- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 msgr2=0x7f9aa4130030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 0x7f9aa4130030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 -- 172.21.15.52:0/76700467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa41e95e0 con 0x7f9aa40b5880 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9aa1e00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 0x7f9aa4130030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9aa2800640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 0x7f9aa413f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a99400640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00d800 tx=0x7f9a8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00b6c0 con 0x7f9aa40b5880 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8c019070 con 0x7f9aa40b5880 2024-09-10T08:42:14.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00ba80 con 0x7f9aa40b5880 2024-09-10T08:42:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.672+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa4158cb0 con 0x7f9aa40b5880 2024-09-10T08:42:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.673+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa4159270 con 0x7f9aa40b5880 2024-09-10T08:42:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.674+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa40b5080 con 0x7f9aa40b5880 2024-09-10T08:42:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.674+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a8c00bc20 con 0x7f9aa40b5880 2024-09-10T08:42:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.675+0000 7f9a9aa00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 0x7f9a8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.675+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f9a8c08b340 con 0x7f9aa40b5880 2024-09-10T08:42:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.676+0000 7f9aa1e00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 0x7f9a8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.676+0000 7f9aa1e00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 0x7f9a8006e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000f60 tx=0x7f9a94007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:14.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.680+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a8c059ce0 con 0x7f9aa40b5880 2024-09-10T08:42:14.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.900+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9aa40ce130 con 0x7f9aa40b5880 2024-09-10T08:42:14.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.900+0000 7f9a9aa00640 1 -- 172.21.15.52:0/76700467 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7f9a8c0595e0 con 0x7f9aa40b5880 2024-09-10T08:42:14.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:14.901 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:42:14.902 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:42:14.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 msgr2=0x7f9a8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 0x7f9a8006e2f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000f60 tx=0x7f9a94007ce0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 msgr2=0x7f9aa413ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00d800 tx=0x7f9a8c00dcc0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 shutdown_connections 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9a8006be30 0x7f9a8006e2f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9aa4145ed0 0x7f9aa413f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9aa40b5880 0x7f9aa413ed80 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 --2- 172.21.15.52:0/76700467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9aa4073890 0x7f9aa4130030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.902+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 >> 172.21.15.52:0/76700467 conn(0x7f9aa40ccec0 msgr2=0x7f9aa40ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.903+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 shutdown_connections 2024-09-10T08:42:14.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:14.903+0000 7f9aa8a00640 1 -- 172.21.15.52:0/76700467 wait complete. 2024-09-10T08:42:14.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.075+0000 7f83b0200640 1 Processor -- start 2024-09-10T08:42:15.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.075+0000 7f83b0200640 1 -- start start 2024-09-10T08:42:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83b0200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f83a8147e80 0x7f83a8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83b0200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a8071b30 con 0x7f83a806c320 2024-09-10T08:42:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83b0200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80b3510 con 0x7f83a8148260 2024-09-10T08:42:15.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83b0200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f83a8074200 con 0x7f83a8147e80 2024-09-10T08:42:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83ae200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f83a806c320 0x7f83a80b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45094/0 (socket says 172.21.15.52:45094) 2024-09-10T08:42:15.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83ae200640 1 -- 172.21.15.52:0/3758818901 learned_addr learned my addr 172.21.15.52:0/3758818901 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83ad800640 1 --2- 172.21.15.52:0/3758818901 >> v2:172.21.15.176:3300/0 conn(0x7f83a8147e80 0x7f83a8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451857143 0 0) 0x7f83a8071b30 con 0x7f83a806c320 2024-09-10T08:42:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.077+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8390003520 con 0x7f83a806c320 2024-09-10T08:42:15.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 429026393 0 0) 0x7f8390003520 con 0x7f83a806c320 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 >> v2:172.21.15.176:3300/0 conn(0x7f83a8147e80 msgr2=0x7f83a8070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 --2- 172.21.15.52:0/3758818901 >> v2:172.21.15.176:3300/0 conn(0x7f83a8147e80 0x7f83a8070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 >> v1:172.21.15.176:6789/0 conn(0x7f83a8148260 legacy=0x7f83a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80b37f0 con 0x7f83a806c320 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f83a00019f0 con 0x7f83a806c320 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 >> v1:172.21.15.52:6789/0 conn(0x7f83a806c320 legacy=0x7f83a80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8390003a00 0x7f8390003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8390004800 0x7f8390004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 0x7f839000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83a8074200 con 0x7f83900051c0 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f839000c0c0 con 0x7f8390003a00 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f839000c2c0 con 0x7f8390004800 2024-09-10T08:42:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83ae200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 0x7f839000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83ad800640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8390003a00 0x7f8390003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.078+0000 7f83ace00640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8390004800 0x7f8390004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.079+0000 7f83ae200640 1 -- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8390004800 msgr2=0x7f8390004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.079+0000 7f83ae200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8390004800 0x7f8390004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.079+0000 7f83ae200640 1 -- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8390003a00 msgr2=0x7f8390003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.079+0000 7f83ae200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8390003a00 0x7f8390003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.079+0000 7f83ae200640 1 -- 172.21.15.52:0/3758818901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8390003520 con 0x7f83900051c0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83ae200640 1 -- 172.21.15.52:0/3758818901 reap_dead start 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83ae200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 0x7f839000b9c0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a740 tx=0x7f8390005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90eddeb19de31f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a000a390 con 0x7f83900051c0 2024-09-10T08:42:15.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a002f070 con 0x7f83900051c0 2024-09-10T08:42:15.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83a7e00640 1 -- 172.21.15.52:0/3758818901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a002bbc0 con 0x7f83900051c0 2024-09-10T08:42:15.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83b0200640 1 -- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 msgr2=0x7f839000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83b0200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 0x7f839000b9c0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a740 tx=0x7f8390005830 comp rx=0 tx=0).stop 2024-09-10T08:42:15.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83b0200640 1 -- 172.21.15.52:0/3758818901 shutdown_connections 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.080+0000 7f83b0200640 1 --2- 172.21.15.52:0/3758818901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83900051c0 0x7f839000b9c0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.081+0000 7f83b0200640 1 -- 172.21.15.52:0/3758818901 >> 172.21.15.52:0/3758818901 conn(0x7f83a80ccec0 msgr2=0x7f83a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.081+0000 7f83b0200640 1 -- 172.21.15.52:0/3758818901 shutdown_connections 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.081+0000 7f83b0200640 1 -- 172.21.15.52:0/3758818901 wait complete. 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.082+0000 7f83b0200640 1 Processor -- start 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.082+0000 7f83b0200640 1 -- start start 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 0x7f83a815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 0x7f83a80b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f83a806bc10 con 0x7f83a80af3e0 2024-09-10T08:42:15.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80b3e40 con 0x7f83900051c0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83b0200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f83a806bd90 con 0x7f83a80b58a0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.083+0000 7f83ace00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45758/0 (socket says 172.21.15.52:45758) 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 -- 172.21.15.52:0/3164635958 learned_addr learned my addr 172.21.15.52:0/3164635958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ad800640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 0x7f83a815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ae200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 0x7f83a80b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 -- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 msgr2=0x7f83a80b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 0x7f83a80b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 -- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 msgr2=0x7f83a815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 0x7f83a815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 -- 172.21.15.52:0/3164635958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80afea0 con 0x7f83a80af3e0 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ad800640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 0x7f83a815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:15.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ae200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 0x7f83a80b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83ace00640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f839400e4d0 tx=0x7f839400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940052e0 con 0x7f83a80af3e0 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394018070 con 0x7f83a80af3e0 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394003810 con 0x7f83a80af3e0 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.084+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a80b15f0 con 0x7f83a80af3e0 2024-09-10T08:42:15.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.085+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a80b1bb0 con 0x7f83a80af3e0 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.085+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a8070f70 con 0x7f83a80af3e0 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.086+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83940039b0 con 0x7f83a80af3e0 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.087+0000 7f83a5600640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 0x7f838806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.087+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f839408aae0 con 0x7f83a80af3e0 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.088+0000 7f83ad800640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 0x7f838806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.089+0000 7f83ad800640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 0x7f838806e320 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f83a80b6420 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.092+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83940593f0 con 0x7f83a80af3e0 2024-09-10T08:42:15.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.276+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83a80cfdc0 con 0x7f83a80af3e0 2024-09-10T08:42:15.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.277+0000 7f83a5600640 1 -- 172.21.15.52:0/3164635958 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+16687 (secure 0 0 0) 0x7f8394058cf0 con 0x7f83a80af3e0 2024-09-10T08:42:15.278 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:15.278 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":183,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:34.595477+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:41:30.825257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-10T08:41:32.008185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.279+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 msgr2=0x7f838806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.279+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 0x7f838806e320 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f83a80b6420 tx=0x7f839c008040 comp rx=0 tx=0).stop 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.279+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 msgr2=0x7f83a80af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.279+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f839400e4d0 tx=0x7f839400e990 comp rx=0 tx=0).stop 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 shutdown_connections 2024-09-10T08:42:15.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f838806be60 0x7f838806e320 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83a80b58a0 0x7f83a80b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83a80af3e0 0x7f83a80af860 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 --2- 172.21.15.52:0/3164635958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83900051c0 0x7f83a815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 >> 172.21.15.52:0/3164635958 conn(0x7f83a80ccec0 msgr2=0x7f83a80cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 shutdown_connections 2024-09-10T08:42:15.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.280+0000 7f83b0200640 1 -- 172.21.15.52:0/3164635958 wait complete. 2024-09-10T08:42:15.296 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:42:15.297 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:15.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.451+0000 7f6548000640 1 Processor -- start 2024-09-10T08:42:15.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.451+0000 7f6548000640 1 -- start start 2024-09-10T08:42:15.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6548000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f65400b5080 0x7f65400b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6548000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65400b4020 con 0x7f6540145ed0 2024-09-10T08:42:15.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6548000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65400b42c0 con 0x7f6540073890 2024-09-10T08:42:15.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6548000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f65400b45a0 con 0x7f65400b5080 2024-09-10T08:42:15.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6545600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6540145ed0 0x7f6540073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45096/0 (socket says 172.21.15.52:45096) 2024-09-10T08:42:15.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6545600640 1 -- 172.21.15.52:0/209524309 learned_addr learned my addr 172.21.15.52:0/209524309 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:15.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6546000640 1 --2- 172.21.15.52:0/209524309 >> v2:172.21.15.52:3300/0 conn(0x7f65400b5080 0x7f65400b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6546000640 1 -- 172.21.15.52:0/209524309 >> v1:172.21.15.176:6789/0 conn(0x7f6540073890 legacy=0x7f65400b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6546000640 1 -- 172.21.15.52:0/209524309 >> v1:172.21.15.52:6789/0 conn(0x7f6540145ed0 legacy=0x7f6540073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f6546000640 1 -- 172.21.15.52:0/209524309 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65400b4880 con 0x7f65400b5080 2024-09-10T08:42:15.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.453+0000 7f653fe00640 1 -- 172.21.15.52:0/209524309 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096557392 0 0) 0x7f65400b4020 con 0x7f6540145ed0 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.454+0000 7f6546000640 1 --2- 172.21.15.52:0/209524309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65400b5080 0x7f65400b5f90 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f653802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb35e571521717b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f653fe00640 1 -- 172.21.15.52:0/209524309 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538037070 con 0x7f65400b5080 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f653fe00640 1 -- 172.21.15.52:0/209524309 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538007740 con 0x7f65400b5080 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f653fe00640 1 -- 172.21.15.52:0/209524309 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538007b10 con 0x7f65400b5080 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 -- 172.21.15.52:0/209524309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65400b5080 msgr2=0x7f65400b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 --2- 172.21.15.52:0/209524309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65400b5080 0x7f65400b5f90 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f653802a780 comp rx=0 tx=0).stop 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 -- 172.21.15.52:0/209524309 shutdown_connections 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 --2- 172.21.15.52:0/209524309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65400b5080 0x7f65400b5f90 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 -- 172.21.15.52:0/209524309 >> 172.21.15.52:0/209524309 conn(0x7f65400ccec0 msgr2=0x7f65400cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 -- 172.21.15.52:0/209524309 shutdown_connections 2024-09-10T08:42:15.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.455+0000 7f6548000640 1 -- 172.21.15.52:0/209524309 wait complete. 2024-09-10T08:42:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.457+0000 7f6548000640 1 Processor -- start 2024-09-10T08:42:15.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.457+0000 7f6548000640 1 -- start start 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6540073890 0x7f65400cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65400b5080 0x7f654013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6540146430 con 0x7f6540145ed0 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65401462b0 con 0x7f65400b5080 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6548000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f654015cdc0 con 0x7f6540073890 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6546000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6546000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45776/0 (socket says 172.21.15.52:45776) 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6546000640 1 -- 172.21.15.52:0/2644862542 learned_addr learned my addr 172.21.15.52:0/2644862542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6544c00640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65400b5080 0x7f654013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.458+0000 7f6545600640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6540073890 0x7f65400cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 -- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6540073890 msgr2=0x7f65400cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6540073890 0x7f65400cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 -- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65400b5080 msgr2=0x7f654013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65400b5080 0x7f654013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 -- 172.21.15.52:0/2644862542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6540072f80 con 0x7f6540145ed0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6546000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f6538004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538042020 con 0x7f6540145ed0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6538032990 con 0x7f6540145ed0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538037040 con 0x7f6540145ed0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.459+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65400caa20 con 0x7f6540145ed0 2024-09-10T08:42:15.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.460+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65400cafe0 con 0x7f6540145ed0 2024-09-10T08:42:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.461+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6540073180 con 0x7f6540145ed0 2024-09-10T08:42:15.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.462+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6538005d10 con 0x7f6540145ed0 2024-09-10T08:42:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.462+0000 7f653d600640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 0x7f652006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.463+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f65380abf30 con 0x7f6540145ed0 2024-09-10T08:42:15.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.463+0000 7f6545600640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 0x7f652006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.464+0000 7f6545600640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 0x7f652006e2f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6534007c30 tx=0x7f6534007b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.467+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f653804c070 con 0x7f6540145ed0 2024-09-10T08:42:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.687+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65400cd790 con 0x7f6540145ed0 2024-09-10T08:42:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.688+0000 7f653d600640 1 -- 172.21.15.52:0/2644862542 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7f653807a340 con 0x7f6540145ed0 2024-09-10T08:42:15.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:15.688 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:42:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:42:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 msgr2=0x7f652006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 0x7f652006e2f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6534007c30 tx=0x7f6534007b80 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 msgr2=0x7f654013cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f6538004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 shutdown_connections 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f652006be30 0x7f652006e2f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6540145ed0 0x7f654013cef0 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65400b5080 0x7f654013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 --2- 172.21.15.52:0/2644862542 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6540073890 0x7f65400cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 >> 172.21.15.52:0/2644862542 conn(0x7f65400ccec0 msgr2=0x7f65400ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 shutdown_connections 2024-09-10T08:42:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.690+0000 7f6548000640 1 -- 172.21.15.52:0/2644862542 wait complete. 2024-09-10T08:42:15.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:15.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.863+0000 7f7f32e00640 1 Processor -- start 2024-09-10T08:42:15.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.864+0000 7f7f32e00640 1 -- start start 2024-09-10T08:42:15.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f32e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 0x7f7f2c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f32e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f32e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2c0b4020 con 0x7f7f2c145ed0 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f32e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c0b42c0 con 0x7f7f2c0b5880 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f32e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0b45a0 con 0x7f7f2c073890 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f30e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f30e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45780/0 (socket says 172.21.15.52:45780) 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.865+0000 7f7f30e00640 1 -- 172.21.15.52:0/174740611 learned_addr learned my addr 172.21.15.52:0/174740611 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f23400640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 0x7f7f2c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f30e00640 1 -- 172.21.15.52:0/174740611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 msgr2=0x7f7f2c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f30e00640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 0x7f7f2c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f30e00640 1 -- 172.21.15.52:0/174740611 >> v1:172.21.15.176:6789/0 conn(0x7f7f2c145ed0 legacy=0x7f7f2c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f30e00640 1 -- 172.21.15.52:0/174740611 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c0b4880 con 0x7f7f2c0b5880 2024-09-10T08:42:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.866+0000 7f7f23400640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 0x7f7f2c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f30e00640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009e50 tx=0x7f7f2402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceaed2bb3488fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f2b400640 1 -- 172.21.15.52:0/174740611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24036070 con 0x7f7f2c0b5880 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f2b400640 1 -- 172.21.15.52:0/174740611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f24031600 con 0x7f7f2c0b5880 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f2b400640 1 -- 172.21.15.52:0/174740611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f240319d0 con 0x7f7f2c0b5880 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f32e00640 1 -- 172.21.15.52:0/174740611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c0b5880 msgr2=0x7f7f2c0b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.867+0000 7f7f32e00640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009e50 tx=0x7f7f2402a6d0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 -- 172.21.15.52:0/174740611 shutdown_connections 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0b5d30 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 --2- 172.21.15.52:0/174740611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c073890 0x7f7f2c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 -- 172.21.15.52:0/174740611 >> 172.21.15.52:0/174740611 conn(0x7f7f2c0ccec0 msgr2=0x7f7f2c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 -- 172.21.15.52:0/174740611 shutdown_connections 2024-09-10T08:42:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.868+0000 7f7f32e00640 1 -- 172.21.15.52:0/174740611 wait complete. 2024-09-10T08:42:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.869+0000 7f7f32e00640 1 Processor -- start 2024-09-10T08:42:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.870+0000 7f7f32e00640 1 -- start start 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.870+0000 7f7f32e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.870+0000 7f7f32e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f32e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c145ed0 0x7f7f2c071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f32e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0b6270 con 0x7f7f2c073890 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f32e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c1462b0 con 0x7f7f2c0b5880 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f32e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0c76d0 con 0x7f7f2c145ed0 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45784/0 (socket says 172.21.15.52:45784) 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 -- 172.21.15.52:0/3265571083 learned_addr learned my addr 172.21.15.52:0/3265571083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:15.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f23400640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f30e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c145ed0 0x7f7f2c071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 -- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c145ed0 msgr2=0x7f7f2c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c145ed0 0x7f7f2c071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 -- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0b5880 msgr2=0x7f7f2c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.871+0000 7f7f2be00640 1 -- 172.21.15.52:0/3265571083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c0c6e30 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f2be00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00b3f0 tx=0x7f7f1c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c015020 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1c011830 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c0c7110 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c011c20 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.872+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c1e5ef0 con 0x7f7f2c073890 2024-09-10T08:42:15.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.873+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c1e60f0 con 0x7f7f2c073890 2024-09-10T08:42:15.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.874+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f1c018020 con 0x7f7f2c073890 2024-09-10T08:42:15.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.875+0000 7f7f28c00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 0x7f7f0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:15.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.875+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f7f1c08aa90 con 0x7f7f2c073890 2024-09-10T08:42:15.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.875+0000 7f7f23400640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 0x7f7f0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:15.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.876+0000 7f7f23400640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 0x7f7f0806e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c073680 tx=0x7f7f14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:15.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:15.879+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f2c1e60f0 con 0x7f7f2c073890 2024-09-10T08:42:16.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.100+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f2c0733d0 con 0x7f7f2c073890 2024-09-10T08:42:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.101+0000 7f7f28c00640 1 -- 172.21.15.52:0/3265571083 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5241 (secure 0 0 0) 0x7f7f1c01f030 con 0x7f7f2c073890 2024-09-10T08:42:16.101 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:16.102 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":141,"btime":"2024-09-10T08:41:36:609079+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[{"mdsmap":{"epoch":141,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:41:33.015700+0000","modified":"2024-09-10T08:41:36.030085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10176},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10176":{"gid":10176,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6837/1803120524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":1803120524},{"type":"v1","addr":"172.21.15.176:6837","nonce":1803120524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10176,"qdb_cluster":[10176]},"id":13}]} 2024-09-10T08:42:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 141 2024-09-10T08:42:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 msgr2=0x7f7f0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 0x7f7f0806e2f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c073680 tx=0x7f7f14008040 comp rx=0 tx=0).stop 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 msgr2=0x7f7f2c15bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00b3f0 tx=0x7f7f1c00b8b0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 shutdown_connections 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7f0806be30 0x7f7f0806e2f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f2c145ed0 0x7f7f2c071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f2c0b5880 0x7f7f2c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 --2- 172.21.15.52:0/3265571083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f2c073890 0x7f7f2c15bb50 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 >> 172.21.15.52:0/3265571083 conn(0x7f7f2c0ccec0 msgr2=0x7f7f2c145130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 shutdown_connections 2024-09-10T08:42:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.103+0000 7f7f32e00640 1 -- 172.21.15.52:0/3265571083 wait complete. 2024-09-10T08:42:16.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.276+0000 7f4eb0c00640 1 Processor -- start 2024-09-10T08:42:16.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.276+0000 7f4eb0c00640 1 -- start start 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eb0c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4eac145ed0 0x7f4eac0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac0b5f90 0x7f4eac0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eb0c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eac0b4020 con 0x7f4eac073180 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eb0c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4eac073b00 con 0x7f4eac145ed0 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eb0c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac0b42c0 con 0x7f4eac0b5f90 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4ea3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4eac073180 0x7f4eac0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45098/0 (socket says 172.21.15.52:45098) 2024-09-10T08:42:16.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4ea3e00640 1 -- 172.21.15.52:0/3884413848 learned_addr learned my addr 172.21.15.52:0/3884413848 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/3884413848 >> v2:172.21.15.176:3300/0 conn(0x7f4eac145ed0 0x7f4eac0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4eaa800640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac0b5f90 0x7f4eac0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4ea9400640 1 -- 172.21.15.52:0/3884413848 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135481607 0 0) 0x7f4eac0b4020 con 0x7f4eac073180 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.278+0000 7f4ea9400640 1 -- 172.21.15.52:0/3884413848 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e90003520 con 0x7f4eac073180 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.279+0000 7f4ea9e00640 1 -- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac0b5f90 msgr2=0x7f4eac0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.279+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac0b5f90 0x7f4eac0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.279+0000 7f4ea9e00640 1 -- 172.21.15.52:0/3884413848 >> v1:172.21.15.52:6789/0 conn(0x7f4eac073180 legacy=0x7f4eac0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.279+0000 7f4ea9e00640 1 -- 172.21.15.52:0/3884413848 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac0b45a0 con 0x7f4eac145ed0 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.280+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac145ed0 0x7f4eac0b5080 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4eac073c80 tx=0x7f4e9c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f37266226958f953 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.280+0000 7f4ea9400640 1 -- 172.21.15.52:0/3884413848 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c037070 con 0x7f4eac145ed0 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.280+0000 7f4ea9400640 1 -- 172.21.15.52:0/3884413848 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c032440 con 0x7f4eac145ed0 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.280+0000 7f4ea9400640 1 -- 172.21.15.52:0/3884413848 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c032810 con 0x7f4eac145ed0 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.280+0000 7f4eb0c00640 1 -- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac145ed0 msgr2=0x7f4eac0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac145ed0 0x7f4eac0b5080 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4eac073c80 tx=0x7f4e9c02a180 comp rx=0 tx=0).stop 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 -- 172.21.15.52:0/3884413848 shutdown_connections 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac0b5f90 0x7f4eac0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/3884413848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac145ed0 0x7f4eac0b5080 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 -- 172.21.15.52:0/3884413848 >> 172.21.15.52:0/3884413848 conn(0x7f4eac0ccec0 msgr2=0x7f4eac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 -- 172.21.15.52:0/3884413848 shutdown_connections 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.281+0000 7f4eb0c00640 1 -- 172.21.15.52:0/3884413848 wait complete. 2024-09-10T08:42:16.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.282+0000 7f4eb0c00640 1 Processor -- start 2024-09-10T08:42:16.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.282+0000 7f4eb0c00640 1 -- start start 2024-09-10T08:42:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 0x7f4eac072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac145ed0 0x7f4eac1f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1462b0 con 0x7f4eac073180 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0b4b60 con 0x7f4eac0b5f90 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.283+0000 7f4eb0c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac146430 con 0x7f4eac145ed0 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45794/0 (socket says 172.21.15.52:45794) 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 -- 172.21.15.52:0/1295589809 learned_addr learned my addr 172.21.15.52:0/1295589809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 -- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac145ed0 msgr2=0x7f4eac1f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac145ed0 0x7f4eac1f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 -- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 msgr2=0x7f4eac072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea3e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 0x7f4eac072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 0x7f4eac072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 -- 172.21.15.52:0/1295589809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac1f52e0 con 0x7f4eac073180 2024-09-10T08:42:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea3e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 0x7f4eac072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.284+0000 7f4ea9e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000c00 tx=0x7f4e9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.285+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c041020 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.285+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9c03d700 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.285+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c037040 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.285+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1f4d00 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.285+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac154bb0 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.286+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac0735c0 con 0x7f4eac073180 2024-09-10T08:42:16.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.287+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e9c044020 con 0x7f4eac073180 2024-09-10T08:42:16.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.288+0000 7f4ea2000640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 0x7f4e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.288+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f4e9c0ab600 con 0x7f4eac073180 2024-09-10T08:42:16.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.288+0000 7f4ea3e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 0x7f4e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.289+0000 7f4ea3e00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 0x7f4e8806e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0ccaf0 tx=0x7f4e94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.292+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e9c04b030 con 0x7f4eac073180 2024-09-10T08:42:16.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.477+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eac142b60 con 0x7f4eac073180 2024-09-10T08:42:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.478+0000 7f4ea2000640 1 -- 172.21.15.52:0/1295589809 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) ==== 74+0+16687 (secure 0 0 0) 0x7f4e9c079f20 con 0x7f4eac073180 2024-09-10T08:42:16.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:16.479 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":183,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:41:34.595477+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:41:30.825257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-10T08:41:32.008185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 msgr2=0x7f4e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 0x7f4e8806e2f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0ccaf0 tx=0x7f4e94009040 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 msgr2=0x7f4eac072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c000c00 tx=0x7f4e9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 shutdown_connections 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e8806be30 0x7f4e8806e2f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4eac145ed0 0x7f4eac1f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4eac0b5f90 0x7f4eac072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 --2- 172.21.15.52:0/1295589809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac073180 0x7f4eac072250 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 >> 172.21.15.52:0/1295589809 conn(0x7f4eac0ccec0 msgr2=0x7f4eac0712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 shutdown_connections 2024-09-10T08:42:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.480+0000 7f4eb0c00640 1 -- 172.21.15.52:0/1295589809 wait complete. 2024-09-10T08:42:16.497 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:42:16.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.654+0000 7f6788c00640 1 Processor -- start 2024-09-10T08:42:16.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.655+0000 7f6788c00640 1 -- start start 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6788c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6788c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67840b5f90 0x7f67840735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6788c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67840b4020 con 0x7f6784073180 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6788c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6784073b00 con 0x7f67840b5f90 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6788c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f67840b42c0 con 0x7f6784145ed0 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6782800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f67840b5f90 0x7f67840735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f677be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6784073180 0x7f67840b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45114/0 (socket says 172.21.15.52:45114) 2024-09-10T08:42:16.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f677be00640 1 -- 172.21.15.52:0/3152351354 learned_addr learned my addr 172.21.15.52:0/3152351354 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.656+0000 7f6781e00640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.657+0000 7f6782800640 1 -- 172.21.15.52:0/3152351354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 msgr2=0x7f67840b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.657+0000 7f6782800640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.657+0000 7f6782800640 1 -- 172.21.15.52:0/3152351354 >> v1:172.21.15.52:6789/0 conn(0x7f6784073180 legacy=0x7f67840b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.657+0000 7f6782800640 1 -- 172.21.15.52:0/3152351354 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840b45a0 con 0x7f67840b5f90 2024-09-10T08:42:16.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.657+0000 7f6781400640 1 -- 172.21.15.52:0/3152351354 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796182106 0 0) 0x7f67840b4020 con 0x7f6784073180 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6782800640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840735c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c7399366108f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6781400640 1 -- 172.21.15.52:0/3152351354 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c007740 con 0x7f67840b5f90 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6781400640 1 -- 172.21.15.52:0/3152351354 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c0078e0 con 0x7f67840b5f90 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6781400640 1 -- 172.21.15.52:0/3152351354 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c007cb0 con 0x7f67840b5f90 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 -- 172.21.15.52:0/3152351354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 msgr2=0x7f67840735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840735c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c02a660 comp rx=0 tx=0).stop 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 -- 172.21.15.52:0/3152351354 shutdown_connections 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840735c0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 --2- 172.21.15.52:0/3152351354 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.658+0000 7f6788c00640 1 -- 172.21.15.52:0/3152351354 >> 172.21.15.52:0/3152351354 conn(0x7f67840ccec0 msgr2=0x7f67840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.659+0000 7f6788c00640 1 -- 172.21.15.52:0/3152351354 shutdown_connections 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.659+0000 7f6788c00640 1 -- 172.21.15.52:0/3152351354 wait complete. 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.660+0000 7f6788c00640 1 Processor -- start 2024-09-10T08:42:16.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.660+0000 7f6788c00640 1 -- start start 2024-09-10T08:42:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6784073180 0x7f6784159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67841462b0 con 0x7f67840b5f90 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67840b4b60 con 0x7f6784073180 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f6788c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6784146430 con 0x7f6784145ed0 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f677be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f677be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45820/0 (socket says 172.21.15.52:45820) 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.661+0000 7f677be00640 1 -- 172.21.15.52:0/1049470877 learned_addr learned my addr 172.21.15.52:0/1049470877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f6781e00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6784073180 0x7f6784159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f6782800640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 -- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 msgr2=0x7f67840c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 -- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6784073180 msgr2=0x7f6784159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6784073180 0x7f6784159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 -- 172.21.15.52:0/1049470877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678415c3b0 con 0x7f67840b5f90 2024-09-10T08:42:16.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677be00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c4b0 tx=0x7f676c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c018070 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676c007500 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67840c7120 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.662+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c004a20 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.663+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678413b9c0 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.664+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67840735c0 con 0x7f67840b5f90 2024-09-10T08:42:16.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.665+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f676c01b070 con 0x7f67840b5f90 2024-09-10T08:42:16.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.665+0000 7f677a000640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:16.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.665+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f676c08a1f0 con 0x7f67840b5f90 2024-09-10T08:42:16.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.666+0000 7f6781e00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:16.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.666+0000 7f6781e00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 0x7f676006e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6774006fd0 tx=0x7f6774008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:16.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.670+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f676c058c50 con 0x7f67840b5f90 2024-09-10T08:42:16.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.889+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67841598c0 con 0x7f67840b5f90 2024-09-10T08:42:16.890 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:42:16.889+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:42:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.891+0000 7f677a000640 1 -- 172.21.15.52:0/1049470877 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v142) ==== 161+0+0 (secure 0 0 0) 0x7f676c058550 con 0x7f67840b5f90 2024-09-10T08:42:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:42:16.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 msgr2=0x7f676006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 0x7f676006e2f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6774006fd0 tx=0x7f6774008040 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 msgr2=0x7f67840c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c4b0 tx=0x7f676c00c970 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 shutdown_connections 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f676006be30 0x7f676006e2f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6784145ed0 0x7f67840c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840b5f90 0x7f67840c8290 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 --2- 172.21.15.52:0/1049470877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6784073180 0x7f6784159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 >> 172.21.15.52:0/1049470877 conn(0x7f67840ccec0 msgr2=0x7f67840cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 shutdown_connections 2024-09-10T08:42:16.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:16.894+0000 7f6788c00640 1 -- 172.21.15.52:0/1049470877 wait complete. 2024-09-10T08:42:16.903 INFO:tasks.ceph.mds.b.smithi176.stderr: -3394> 2024-09-10T08:41:39.173+0000 7f8beb600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:42:16.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:42:16.953 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:42:17.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.068+0000 7f2adfe00640 1 Processor -- start 2024-09-10T08:42:17.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.068+0000 7f2adfe00640 1 -- start start 2024-09-10T08:42:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.069+0000 7f2adfe00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2ae00b5fd0 0x7f2ae00d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.069+0000 7f2adfe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ae00b7c10 0x7f2ae00b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.069+0000 7f2adfe00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae00d3950 con 0x7f2ae00b63b0 2024-09-10T08:42:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.069+0000 7f2adfe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae00d3c30 con 0x7f2ae00b7c10 2024-09-10T08:42:17.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.069+0000 7f2adfe00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae00d3f10 con 0x7f2ae00b5fd0 2024-09-10T08:42:17.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ae00b7c10 0x7f2ae00b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2ae00b7c10 0x7f2ae00b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45824/0 (socket says 172.21.15.52:45824) 2024-09-10T08:42:17.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 -- 172.21.15.52:0/3581197931 learned_addr learned my addr 172.21.15.52:0/3581197931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:17.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adea00640 1 --2- 172.21.15.52:0/3581197931 >> v2:172.21.15.176:3300/0 conn(0x7f2ae00b5fd0 0x7f2ae00d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 -- 172.21.15.52:0/3581197931 >> v2:172.21.15.176:3300/0 conn(0x7f2ae00b5fd0 msgr2=0x7f2ae00d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 --2- 172.21.15.52:0/3581197931 >> v2:172.21.15.176:3300/0 conn(0x7f2ae00b5fd0 0x7f2ae00d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 -- 172.21.15.52:0/3581197931 >> v1:172.21.15.52:6789/0 conn(0x7f2ae00b63b0 legacy=0x7f2ae00cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.070+0000 7f2adf400640 1 -- 172.21.15.52:0/3581197931 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae00d41f0 con 0x7f2ae00b7c10 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.071+0000 7f2adf400640 1 --2- 172.21.15.52:0/3581197931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b7c10 0x7f2ae00b80a0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00d5620 tx=0x7f2ad802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715a4a9ef84aab7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.071+0000 7f2add600640 1 -- 172.21.15.52:0/3581197931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8036070 con 0x7f2ae00b7c10 2024-09-10T08:42:17.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.071+0000 7f2add600640 1 -- 172.21.15.52:0/3581197931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad8031600 con 0x7f2ae00b7c10 2024-09-10T08:42:17.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.071+0000 7f2add600640 1 -- 172.21.15.52:0/3581197931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80319f0 con 0x7f2ae00b7c10 2024-09-10T08:42:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 -- 172.21.15.52:0/3581197931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b7c10 msgr2=0x7f2ae00b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3581197931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b7c10 0x7f2ae00b80a0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00d5620 tx=0x7f2ad802a7c0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 -- 172.21.15.52:0/3581197931 shutdown_connections 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3581197931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b7c10 0x7f2ae00b80a0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3581197931 >> v2:172.21.15.176:3300/0 conn(0x7f2ae00b5fd0 0x7f2ae00d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 -- 172.21.15.52:0/3581197931 >> 172.21.15.52:0/3581197931 conn(0x7f2ae00d0fd0 msgr2=0x7f2ae00d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 -- 172.21.15.52:0/3581197931 shutdown_connections 2024-09-10T08:42:17.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.072+0000 7f2adfe00640 1 -- 172.21.15.52:0/3581197931 wait complete. 2024-09-10T08:42:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.074+0000 7f2adfe00640 1 Processor -- start 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.074+0000 7f2adfe00640 1 -- start start 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 0x7f2ae0154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ae00b7c10 0x7f2ae01583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae00b6950 con 0x7f2ae00b63b0 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae00b67d0 con 0x7f2ae00b5fd0 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adfe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae015e7f0 con 0x7f2ae00b7c10 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2ade000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 0x7f2ae0154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2ade000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45834/0 (socket says 172.21.15.52:45834) 2024-09-10T08:42:17.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2ade000640 1 -- 172.21.15.52:0/3219707003 learned_addr learned my addr 172.21.15.52:0/3219707003 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.075+0000 7f2adf400640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ae00b7c10 0x7f2ae01583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 -- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ae00b7c10 msgr2=0x7f2ae01583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ae00b7c10 0x7f2ae01583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 -- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 msgr2=0x7f2ae0154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 0x7f2ae0154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 -- 172.21.15.52:0/3219707003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae00c9c60 con 0x7f2ae00b63b0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2adea00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 0x7f2ae0154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ade000640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c400 tx=0x7f2acc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0052d0 con 0x7f2ae00b63b0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2acc005490 con 0x7f2ae00b63b0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc007260 con 0x7f2ae00b63b0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae00c96a0 con 0x7f2ae00b63b0 2024-09-10T08:42:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.076+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae0155570 con 0x7f2ae00b63b0 2024-09-10T08:42:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.077+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae0156f80 con 0x7f2ae00b63b0 2024-09-10T08:42:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.078+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2acc007400 con 0x7f2ae00b63b0 2024-09-10T08:42:17.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.080+0000 7f2ad6a00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 0x7f2ac006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:17.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.080+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5795+0+0 (secure 0 0 0) 0x7f2acc08a3f0 con 0x7f2ae00b63b0 2024-09-10T08:42:17.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.080+0000 7f2adea00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 0x7f2ac006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:17.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.081+0000 7f2adea00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 0x7f2ac006e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e90 tx=0x7f2ad0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:17.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.084+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2acc058650 con 0x7f2ae00b63b0 2024-09-10T08:42:17.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.305+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ae00b46c0 con 0x7f2ae00b63b0 2024-09-10T08:42:17.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.898+0000 7f2ad6a00640 1 -- 172.21.15.52:0/3219707003 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v143) ==== 104+0+0 (secure 0 0 0) 0x7f2acc05c950 con 0x7f2ae00b63b0 2024-09-10T08:42:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 msgr2=0x7f2ac006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 0x7f2ac006e320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e90 tx=0x7f2ad0009190 comp rx=0 tx=0).stop 2024-09-10T08:42:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 msgr2=0x7f2ae015b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c400 tx=0x7f2acc00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 shutdown_connections 2024-09-10T08:42:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ac006be60 0x7f2ac006e320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ae00b7c10 0x7f2ae01583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ae00b63b0 0x7f2ae015b100 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 --2- 172.21.15.52:0/3219707003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ae00b5fd0 0x7f2ae0154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 >> 172.21.15.52:0/3219707003 conn(0x7f2ae00d0fd0 msgr2=0x7f2ae00b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 shutdown_connections 2024-09-10T08:42:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:17.901+0000 7f2adfe00640 1 -- 172.21.15.52:0/3219707003 wait complete. 2024-09-10T08:42:17.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:42:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.083+0000 7f6d4d000640 1 Processor -- start 2024-09-10T08:42:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.083+0000 7f6d4d000640 1 -- start start 2024-09-10T08:42:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 0x7f6d48169780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d4d000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d480d10f0 con 0x7f6d480b3fe0 2024-09-10T08:42:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d4d000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d480d13d0 con 0x7f6d4815ea10 2024-09-10T08:42:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d4d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d480d1d00 con 0x7f6d480d34b0 2024-09-10T08:42:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d45400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6d480b3fe0 0x7f6d480d2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45134/0 (socket says 172.21.15.52:45134) 2024-09-10T08:42:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d45400640 1 -- 172.21.15.52:0/2127073329 learned_addr learned my addr 172.21.15.52:0/2127073329 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.084+0000 7f6d46800640 1 --2- 172.21.15.52:0/2127073329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 0x7f6d48169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24648890 0 0) 0x7f6d480d10f0 con 0x7f6d480b3fe0 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d2c003520 con 0x7f6d480b3fe0 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724159593 0 0) 0x7f6d480d13d0 con 0x7f6d4815ea10 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d46800640 1 -- 172.21.15.52:0/2127073329 >> v1:172.21.15.176:6789/0 conn(0x7f6d4815ea10 legacy=0x7f6d480d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d46800640 1 -- 172.21.15.52:0/2127073329 >> v1:172.21.15.52:6789/0 conn(0x7f6d480b3fe0 legacy=0x7f6d480d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.085+0000 7f6d46800640 1 -- 172.21.15.52:0/2127073329 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480d16b0 con 0x7f6d480d34b0 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.086+0000 7f6d46800640 1 --2- 172.21.15.52:0/2127073329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 0x7f6d48169780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009dc0 tx=0x7f6d4002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9487cc1cecb63b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.086+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007740 con 0x7f6d480d34b0 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.086+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d400078e0 con 0x7f6d480d34b0 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.086+0000 7f6d44a00640 1 -- 172.21.15.52:0/2127073329 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007cb0 con 0x7f6d480d34b0 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 -- 172.21.15.52:0/2127073329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 msgr2=0x7f6d48169780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 --2- 172.21.15.52:0/2127073329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 0x7f6d48169780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009dc0 tx=0x7f6d4002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 -- 172.21.15.52:0/2127073329 shutdown_connections 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 --2- 172.21.15.52:0/2127073329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480d34b0 0x7f6d48169780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 -- 172.21.15.52:0/2127073329 >> 172.21.15.52:0/2127073329 conn(0x7f6d4809dd60 msgr2=0x7f6d480d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 -- 172.21.15.52:0/2127073329 shutdown_connections 2024-09-10T08:42:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.087+0000 7f6d4d000640 1 -- 172.21.15.52:0/2127073329 wait complete. 2024-09-10T08:42:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 Processor -- start 2024-09-10T08:42:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 -- start start 2024-09-10T08:42:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480b3fe0 0x7f6d4815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d480d34b0 0x7f6d480cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480d0800 con 0x7f6d4815ea10 2024-09-10T08:42:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.089+0000 7f6d4d000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480d0680 con 0x7f6d480d34b0 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d4d000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6d48169cc0 con 0x7f6d480b3fe0 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45840/0 (socket says 172.21.15.52:45840) 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 -- 172.21.15.52:0/3774045920 learned_addr learned my addr 172.21.15.52:0/3774045920 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d45400640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d480d34b0 0x7f6d480cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d45e00640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480b3fe0 0x7f6d4815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 -- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480b3fe0 msgr2=0x7f6d4815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480b3fe0 0x7f6d4815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 -- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d480d34b0 msgr2=0x7f6d480cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d480d34b0 0x7f6d480cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.090+0000 7f6d46800640 1 -- 172.21.15.52:0/3774045920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480c99b0 con 0x7f6d4815ea10 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d46800640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009ee0 tx=0x7f6d40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40040070 con 0x7f6d4815ea10 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d40031bc0 con 0x7f6d4815ea10 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40009450 con 0x7f6d4815ea10 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d480c9c90 con 0x7f6d4815ea10 2024-09-10T08:42:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.091+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d480ca250 con 0x7f6d4815ea10 2024-09-10T08:42:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.092+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d480d2130 con 0x7f6d4815ea10 2024-09-10T08:42:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.093+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d40039040 con 0x7f6d4815ea10 2024-09-10T08:42:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.094+0000 7f6d3e000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 0x7f6d2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.094+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5795+0+0 (secure 0 0 0) 0x7f6d400ac5d0 con 0x7f6d4815ea10 2024-09-10T08:42:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.094+0000 7f6d45e00640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 0x7f6d2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.095+0000 7f6d45e00640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 0x7f6d2806e2f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000f60 tx=0x7f6d38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.098+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d4007a8c0 con 0x7f6d4815ea10 2024-09-10T08:42:18.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.281+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d48169a80 con 0x7f6d4815ea10 2024-09-10T08:42:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.900+0000 7f6d3e000640 1 -- 172.21.15.52:0/3774045920 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) ==== 181+0+0 (secure 0 0 0) 0x7f6d400aae20 con 0x7f6d4815ea10 2024-09-10T08:42:18.901 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:42:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 msgr2=0x7f6d2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 0x7f6d2806e2f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000f60 tx=0x7f6d38009040 comp rx=0 tx=0).stop 2024-09-10T08:42:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 msgr2=0x7f6d480b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:18.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009ee0 tx=0x7f6d40004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 shutdown_connections 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6d2806be30 0x7f6d2806e2f0 secure :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6d38000f60 tx=0x7f6d38009040 comp rx=0 tx=0).stop 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d4815ea10 0x7f6d480b6750 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d480d34b0 0x7f6d480cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 --2- 172.21.15.52:0/3774045920 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6d480b3fe0 0x7f6d4815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:18.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.905+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 >> 172.21.15.52:0/3774045920 conn(0x7f6d4809dd60 msgr2=0x7f6d480b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:18.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.906+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 shutdown_connections 2024-09-10T08:42:18.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:18.907+0000 7f6d4d000640 1 -- 172.21.15.52:0/3774045920 wait complete. 2024-09-10T08:42:18.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:42:19.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.095+0000 7f5692e00640 1 Processor -- start 2024-09-10T08:42:19.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.095+0000 7f5692e00640 1 -- start start 2024-09-10T08:42:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.096+0000 7f5692e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f568c0b6000 0x7f568c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.096+0000 7f5692e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 0x7f568c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.096+0000 7f5692e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568c146220 con 0x7f568c1454b0 2024-09-10T08:42:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.096+0000 7f5692e00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f568c0b1920 con 0x7f568c0b6000 2024-09-10T08:42:19.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.096+0000 7f5692e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f568c0cf640 con 0x7f568c0b2dc0 2024-09-10T08:42:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f568be00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f568c1454b0 0x7f568c0b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45150/0 (socket says 172.21.15.52:45150) 2024-09-10T08:42:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f568be00640 1 -- 172.21.15.52:0/3350907245 learned_addr learned my addr 172.21.15.52:0/3350907245 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5683400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f568c0b6000 0x7f568c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5683400640 1 -- 172.21.15.52:0/3350907245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 msgr2=0x7f568c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5690e00640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 0x7f568c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5683400640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 0x7f568c0b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5683400640 1 -- 172.21.15.52:0/3350907245 >> v1:172.21.15.52:6789/0 conn(0x7f568c1454b0 legacy=0x7f568c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5683400640 1 -- 172.21.15.52:0/3350907245 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c0cf8e0 con 0x7f568c0b6000 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f568b400640 1 -- 172.21.15.52:0/3350907245 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106529982 0 0) 0x7f567c001110 con 0x7f568c1454b0 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.097+0000 7f5690e00640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 0x7f568c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.098+0000 7f5683400640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b6000 0x7f568c0afe40 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f56740097a0 tx=0x7f567402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e108d437112935dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.098+0000 7f568b400640 1 -- 172.21.15.52:0/3350907245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674037070 con 0x7f568c0b6000 2024-09-10T08:42:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f568b400640 1 -- 172.21.15.52:0/3350907245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5674032440 con 0x7f568c0b6000 2024-09-10T08:42:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f568b400640 1 -- 172.21.15.52:0/3350907245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674032810 con 0x7f568c0b6000 2024-09-10T08:42:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 -- 172.21.15.52:0/3350907245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b6000 msgr2=0x7f568c0afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b6000 0x7f568c0afe40 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f56740097a0 tx=0x7f567402a230 comp rx=0 tx=0).stop 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 -- 172.21.15.52:0/3350907245 shutdown_connections 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c0b2dc0 0x7f568c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 --2- 172.21.15.52:0/3350907245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b6000 0x7f568c0afe40 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 -- 172.21.15.52:0/3350907245 >> 172.21.15.52:0/3350907245 conn(0x7f568c06c240 msgr2=0x7f568c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 -- 172.21.15.52:0/3350907245 shutdown_connections 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.099+0000 7f5692e00640 1 -- 172.21.15.52:0/3350907245 wait complete. 2024-09-10T08:42:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.101+0000 7f5692e00640 1 Processor -- start 2024-09-10T08:42:19.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.101+0000 7f5692e00640 1 -- start start 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f568c0b6000 0x7f568c0b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c1454b0 0x7f568c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f568c0d0180 con 0x7f568c0b2dc0 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f568c0cfea0 con 0x7f568c0b6000 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5692e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f568c1459a0 con 0x7f568c1454b0 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f568be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f568be00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45858/0 (socket says 172.21.15.52:45858) 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f568be00640 1 -- 172.21.15.52:0/2035477182 learned_addr learned my addr 172.21.15.52:0/2035477182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5690e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c1454b0 0x7f568c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.102+0000 7f5683400640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f568c0b6000 0x7f568c0b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 -- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c1454b0 msgr2=0x7f568c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c1454b0 0x7f568c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 -- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f568c0b6000 msgr2=0x7f568c0b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f568c0b6000 0x7f568c0b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 -- 172.21.15.52:0/2035477182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c0b4790 con 0x7f568c0b2dc0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f568be00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c460 tx=0x7f567c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c018070 con 0x7f568c0b2dc0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c007500 con 0x7f568c0b2dc0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c0b4a70 con 0x7f568c0b2dc0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c004a20 con 0x7f568c0b2dc0 2024-09-10T08:42:19.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.103+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c0b5030 con 0x7f568c0b2dc0 2024-09-10T08:42:19.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.104+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c1422e0 con 0x7f568c0b2dc0 2024-09-10T08:42:19.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.105+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f567c01b070 con 0x7f568c0b2dc0 2024-09-10T08:42:19.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.107+0000 7f5688c00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 0x7f566806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:19.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.107+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5357+0+0 (secure 0 0 0) 0x7f567c089fb0 con 0x7f568c0b2dc0 2024-09-10T08:42:19.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.107+0000 7f5683400640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 0x7f566806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:19.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.108+0000 7f5683400640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 0x7f566806e320 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f567402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:19.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.111+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f568c1422e0 con 0x7f568c0b2dc0 2024-09-10T08:42:19.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.296+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f568c0b5680 con 0x7f568c0b2dc0 2024-09-10T08:42:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.906+0000 7f5688c00640 1 -- 172.21.15.52:0/2035477182 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v186) ==== 169+0+0 (secure 0 0 0) 0x7f568c146220 con 0x7f568c0b2dc0 2024-09-10T08:42:19.907 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:42:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.910+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 msgr2=0x7f566806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.910+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 0x7f566806e320 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f567402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.910+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 msgr2=0x7f568c1f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:19.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.910+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c460 tx=0x7f567c00c920 comp rx=0 tx=0).stop 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 shutdown_connections 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f566806be60 0x7f566806e320 secure :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f567402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f568c1454b0 0x7f568c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f568c0b6000 0x7f568c0b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 --2- 172.21.15.52:0/2035477182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f568c0b2dc0 0x7f568c1f7370 secure :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c460 tx=0x7f567c00c920 comp rx=0 tx=0).stop 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.911+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 >> 172.21.15.52:0/2035477182 conn(0x7f568c06c240 msgr2=0x7f568c072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:19.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.913+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 shutdown_connections 2024-09-10T08:42:19.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:19.913+0000 7f5692e00640 1 -- 172.21.15.52:0/2035477182 wait complete. 2024-09-10T08:42:19.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:42:20.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.096+0000 7f1590a00640 1 Processor -- start 2024-09-10T08:42:20.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.096+0000 7f1590a00640 1 -- start start 2024-09-10T08:42:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f1590a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f158c0b5fd0 0x7f158c0d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f1590a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 0x7f158c0b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f1590a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158c0d3950 con 0x7f158c0b63b0 2024-09-10T08:42:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f1590a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f158c0d3c30 con 0x7f158c0b5fd0 2024-09-10T08:42:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f1590a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f158c0d3f10 con 0x7f158c0b7c10 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f158b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f158c0b5fd0 0x7f158c0d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f158b400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f158c0b5fd0 0x7f158c0d32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45872/0 (socket says 172.21.15.52:45872) 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.097+0000 7f158b400640 1 -- 172.21.15.52:0/1847037129 learned_addr learned my addr 172.21.15.52:0/1847037129 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158be00640 1 --2- 172.21.15.52:0/1847037129 >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 0x7f158c0b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158b400640 1 -- 172.21.15.52:0/1847037129 >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 msgr2=0x7f158c0b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158b400640 1 --2- 172.21.15.52:0/1847037129 >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 0x7f158c0b80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158b400640 1 -- 172.21.15.52:0/1847037129 >> v1:172.21.15.176:6789/0 conn(0x7f158c0b63b0 legacy=0x7f158c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158b400640 1 -- 172.21.15.52:0/1847037129 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c0d41f0 con 0x7f158c0b5fd0 2024-09-10T08:42:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.098+0000 7f158be00640 1 --2- 172.21.15.52:0/1847037129 >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 0x7f158c0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.099+0000 7f158b400640 1 --2- 172.21.15.52:0/1847037129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b5fd0 0x7f158c0d32c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f158c0ceb30 tx=0x7f157c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720bf3611500ba44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.099+0000 7f158aa00640 1 -- 172.21.15.52:0/1847037129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c037070 con 0x7f158c0b5fd0 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.099+0000 7f158aa00640 1 -- 172.21.15.52:0/1847037129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157c02ae50 con 0x7f158c0b5fd0 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.099+0000 7f158aa00640 1 -- 172.21.15.52:0/1847037129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c032860 con 0x7f158c0b5fd0 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 -- 172.21.15.52:0/1847037129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b5fd0 msgr2=0x7f158c0d32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 --2- 172.21.15.52:0/1847037129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b5fd0 0x7f158c0d32c0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f158c0ceb30 tx=0x7f157c02a300 comp rx=0 tx=0).stop 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 -- 172.21.15.52:0/1847037129 shutdown_connections 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 --2- 172.21.15.52:0/1847037129 >> v2:172.21.15.176:3300/0 conn(0x7f158c0b7c10 0x7f158c0b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 --2- 172.21.15.52:0/1847037129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b5fd0 0x7f158c0d32c0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 -- 172.21.15.52:0/1847037129 >> 172.21.15.52:0/1847037129 conn(0x7f158c0d0fd0 msgr2=0x7f158c0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 -- 172.21.15.52:0/1847037129 shutdown_connections 2024-09-10T08:42:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.100+0000 7f1590a00640 1 -- 172.21.15.52:0/1847037129 wait complete. 2024-09-10T08:42:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.101+0000 7f1590a00640 1 Processor -- start 2024-09-10T08:42:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 -- start start 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f158c0b5fd0 0x7f158c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f158c0b7c10 0x7f158c0d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0b6950 con 0x7f158c0b63b0 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f158c0b67d0 con 0x7f158c0b7c10 2024-09-10T08:42:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.102+0000 7f1590a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f158c15e7f0 con 0x7f158c0b5fd0 2024-09-10T08:42:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45878/0 (socket says 172.21.15.52:45878) 2024-09-10T08:42:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 -- 172.21.15.52:0/876561874 learned_addr learned my addr 172.21.15.52:0/876561874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f158b400640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f158c0b5fd0 0x7f158c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f158be00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f158c0b7c10 0x7f158c0d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 -- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f158c0b5fd0 msgr2=0x7f158c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f158c0b5fd0 0x7f158c157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 -- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f158c0b7c10 msgr2=0x7f158c0d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f158c0b7c10 0x7f158c0d4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.103+0000 7f1583e00640 1 -- 172.21.15.52:0/876561874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c156d90 con 0x7f158c0b63b0 2024-09-10T08:42:20.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1583e00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f157400c400 tx=0x7f157400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15740052d0 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1574005490 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574007260 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1f8870 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.104+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c157310 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.105+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c0d32c0 con 0x7f158c0b63b0 2024-09-10T08:42:20.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.106+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1574007400 con 0x7f158c0b63b0 2024-09-10T08:42:20.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.107+0000 7f1583400640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 0x7f156806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.107+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f157408a090 con 0x7f158c0b63b0 2024-09-10T08:42:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.108+0000 7f158b400640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 0x7f156806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.108+0000 7f158b400640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 0x7f156806e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f157c034000 tx=0x7f157c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.112+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1574058650 con 0x7f158c0b63b0 2024-09-10T08:42:20.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.295+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f158c0c7e20 con 0x7f158c0b63b0 2024-09-10T08:42:20.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.299+0000 7f1583400640 1 -- 172.21.15.52:0/876561874 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f157405c950 con 0x7f158c0b63b0 2024-09-10T08:42:20.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 msgr2=0x7f156806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 0x7f156806e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f157c034000 tx=0x7f157c02e000 comp rx=0 tx=0).stop 2024-09-10T08:42:20.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 msgr2=0x7f158c0d4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f157400c400 tx=0x7f157400c8c0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 shutdown_connections 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f156806be60 0x7f156806e320 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f158c0b7c10 0x7f158c0d4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f158c0b63b0 0x7f158c0d4530 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 --2- 172.21.15.52:0/876561874 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f158c0b5fd0 0x7f158c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 >> 172.21.15.52:0/876561874 conn(0x7f158c0d0fd0 msgr2=0x7f158c1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 shutdown_connections 2024-09-10T08:42:20.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.301+0000 7f1590a00640 1 -- 172.21.15.52:0/876561874 wait complete. 2024-09-10T08:42:20.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-10T08:42:20.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.474+0000 7f5f03200640 1 Processor -- start 2024-09-10T08:42:20.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.474+0000 7f5f03200640 1 -- start start 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f03200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc073890 0x7f5efc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f03200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5efc0b5880 0x7f5efc0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f03200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5efc0b4020 con 0x7f5efc145ed0 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f03200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5efc0b42c0 con 0x7f5efc0b5880 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f03200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5efc0b45a0 con 0x7f5efc073890 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5efbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5efc145ed0 0x7f5efc073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45162/0 (socket says 172.21.15.52:45162) 2024-09-10T08:42:20.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5efbe00640 1 -- 172.21.15.52:0/3032059382 learned_addr learned my addr 172.21.15.52:0/3032059382 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:20.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5f01200640 1 --2- 172.21.15.52:0/3032059382 >> v2:172.21.15.176:3300/0 conn(0x7f5efc0b5880 0x7f5efc0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5ef3400640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc073890 0x7f5efc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352785784 0 0) 0x7f5efc0b4020 con 0x7f5efc145ed0 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.476+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee0003520 con 0x7f5efc145ed0 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.477+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 241462141 0 0) 0x7f5ee0003520 con 0x7f5efc145ed0 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.477+0000 7f5f01200640 1 -- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc073890 msgr2=0x7f5efc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.477+0000 7f5f01200640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc073890 0x7f5efc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.477+0000 7f5f01200640 1 -- 172.21.15.52:0/3032059382 >> v1:172.21.15.52:6789/0 conn(0x7f5efc145ed0 legacy=0x7f5efc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.477+0000 7f5f01200640 1 -- 172.21.15.52:0/3032059382 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc0b4880 con 0x7f5efc0b5880 2024-09-10T08:42:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.478+0000 7f5f01200640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc0b5880 0x7f5efc0b5d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365a3ae0e236e317 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.478+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec001670 con 0x7f5efc0b5880 2024-09-10T08:42:20.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.478+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4007540 con 0x7f5efc0b5880 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.478+0000 7f5efb400640 1 -- 172.21.15.52:0/3032059382 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4007910 con 0x7f5efc0b5880 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 -- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc0b5880 msgr2=0x7f5efc0b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc0b5880 0x7f5efc0b5d30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef402a5f0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 -- 172.21.15.52:0/3032059382 shutdown_connections 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc0b5880 0x7f5efc0b5d30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 --2- 172.21.15.52:0/3032059382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc073890 0x7f5efc0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 -- 172.21.15.52:0/3032059382 >> 172.21.15.52:0/3032059382 conn(0x7f5efc0ccec0 msgr2=0x7f5efc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 -- 172.21.15.52:0/3032059382 shutdown_connections 2024-09-10T08:42:20.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.479+0000 7f5f03200640 1 -- 172.21.15.52:0/3032059382 wait complete. 2024-09-10T08:42:20.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.480+0000 7f5f03200640 1 Processor -- start 2024-09-10T08:42:20.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.481+0000 7f5f03200640 1 -- start start 2024-09-10T08:42:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc073890 0x7f5efc15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc0b5880 0x7f5efc1f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc0b6270 con 0x7f5efc145ed0 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc1462b0 con 0x7f5efc073890 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f03200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5efc145440 con 0x7f5efc0b5880 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45892/0 (socket says 172.21.15.52:45892) 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 -- 172.21.15.52:0/393675552 learned_addr learned my addr 172.21.15.52:0/393675552 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5efbe00640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc073890 0x7f5efc15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5ef3400640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc0b5880 0x7f5efc1f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 -- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc0b5880 msgr2=0x7f5efc1f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc0b5880 0x7f5efc1f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 -- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc073890 msgr2=0x7f5efc15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc073890 0x7f5efc15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.482+0000 7f5f01200640 1 -- 172.21.15.52:0/393675552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc0c8080 con 0x7f5efc145ed0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5f01200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4040070 con 0x7f5efc145ed0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4031b40 con 0x7f5efc145ed0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4007e90 con 0x7f5efc145ed0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5efc0c8360 con 0x7f5efc145ed0 2024-09-10T08:42:20.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.483+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5efc0c9520 con 0x7f5efc145ed0 2024-09-10T08:42:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.484+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5efc0b5080 con 0x7f5efc145ed0 2024-09-10T08:42:20.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.485+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ef4039040 con 0x7f5efc145ed0 2024-09-10T08:42:20.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.486+0000 7f5ef8c00640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 0x7f5ed806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:20.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.486+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f5ef40abff0 con 0x7f5efc145ed0 2024-09-10T08:42:20.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.486+0000 7f5efbe00640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 0x7f5ed806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:20.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.487+0000 7f5efbe00640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 0x7f5ed806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5eec005880 tx=0x7f5eec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:20.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.490+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ef404b340 con 0x7f5efc145ed0 2024-09-10T08:42:20.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.740+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f5efc143670 con 0x7f5efc145ed0 2024-09-10T08:42:20.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.908+0000 7f5ef8c00640 1 -- 172.21.15.52:0/393675552 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v637) ==== 140+0+0 (secure 0 0 0) 0x7f5ef407ac00 con 0x7f5efc145ed0 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 msgr2=0x7f5ed806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 0x7f5ed806e2f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5eec005880 tx=0x7f5eec009040 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 msgr2=0x7f5efc0c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009d90 tx=0x7f5ef4004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 shutdown_connections 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5ed806be30 0x7f5ed806e2f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5efc145ed0 0x7f5efc0c74c0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5efc0b5880 0x7f5efc1f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 --2- 172.21.15.52:0/393675552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5efc073890 0x7f5efc15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 >> 172.21.15.52:0/393675552 conn(0x7f5efc0ccec0 msgr2=0x7f5efc0cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:20.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 shutdown_connections 2024-09-10T08:42:20.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:20.911+0000 7f5f03200640 1 -- 172.21.15.52:0/393675552 wait complete. 2024-09-10T08:42:20.929 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-10T08:42:20.929 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:42:20.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:21.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.085+0000 7f1909800640 1 Processor -- start 2024-09-10T08:42:21.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.085+0000 7f1909800640 1 -- start start 2024-09-10T08:42:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f190415e6d0 0x7f1904071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f190406cd20 0x7f19040b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1904070b80 0x7f19040b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f19040b77e0 con 0x7f190406cd20 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f190415eab0 con 0x7f190415e6d0 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1909800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f190415ed70 con 0x7f1904070b80 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.086+0000 7f1902000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f190406cd20 0x7f19040b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f190406cd20 0x7f19040b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45906/0 (socket says 172.21.15.52:45906) 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 -- 172.21.15.52:0/3473448077 learned_addr learned my addr 172.21.15.52:0/3473448077 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1903400640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1904070b80 0x7f19040b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902a00640 1 --2- 172.21.15.52:0/3473448077 >> v2:172.21.15.176:3300/0 conn(0x7f190415e6d0 0x7f1904071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 -- 172.21.15.52:0/3473448077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1904070b80 msgr2=0x7f19040b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1904070b80 0x7f19040b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 -- 172.21.15.52:0/3473448077 >> v2:172.21.15.176:3300/0 conn(0x7f190415e6d0 msgr2=0x7f1904071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 --2- 172.21.15.52:0/3473448077 >> v2:172.21.15.176:3300/0 conn(0x7f190415e6d0 0x7f1904071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.087+0000 7f1902000640 1 -- 172.21.15.52:0/3473448077 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190415f050 con 0x7f190406cd20 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.088+0000 7f1902000640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190406cd20 0x7f19040b6d60 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f190406fb10 tx=0x7f18f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bba0e35390f640 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.088+0000 7f1901600640 1 -- 172.21.15.52:0/3473448077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0037070 con 0x7f190406cd20 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.088+0000 7f1901600640 1 -- 172.21.15.52:0/3473448077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0032440 con 0x7f190406cd20 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.088+0000 7f1901600640 1 -- 172.21.15.52:0/3473448077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0032810 con 0x7f190406cd20 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 -- 172.21.15.52:0/3473448077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190406cd20 msgr2=0x7f19040b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190406cd20 0x7f19040b6d60 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f190406fb10 tx=0x7f18f002a1e0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 -- 172.21.15.52:0/3473448077 shutdown_connections 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1904070b80 0x7f19040b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 --2- 172.21.15.52:0/3473448077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190406cd20 0x7f19040b6d60 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 --2- 172.21.15.52:0/3473448077 >> v2:172.21.15.176:3300/0 conn(0x7f190415e6d0 0x7f1904071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 -- 172.21.15.52:0/3473448077 >> 172.21.15.52:0/3473448077 conn(0x7f1904067fb0 msgr2=0x7f190406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 -- 172.21.15.52:0/3473448077 shutdown_connections 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.089+0000 7f1909800640 1 -- 172.21.15.52:0/3473448077 wait complete. 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.091+0000 7f1909800640 1 Processor -- start 2024-09-10T08:42:21.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.091+0000 7f1909800640 1 -- start start 2024-09-10T08:42:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 0x7f19041f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415e6d0 0x7f1904156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f190415f8f0 con 0x7f1904070b80 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f190415f610 con 0x7f190406cd20 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1909800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f19040718d0 con 0x7f190415e6d0 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45916/0 (socket says 172.21.15.52:45916) 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 -- 172.21.15.52:0/2324624466 learned_addr learned my addr 172.21.15.52:0/2324624466 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902a00640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 0x7f19041f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1903400640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415e6d0 0x7f1904156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 -- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415e6d0 msgr2=0x7f1904156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415e6d0 0x7f1904156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 -- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 msgr2=0x7f19041f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 0x7f19041f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902000640 1 -- 172.21.15.52:0/2324624466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19041e9a30 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.092+0000 7f1902a00640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 0x7f19041f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f1902000640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f18f002a220 tx=0x7f18f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0041020 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f00306c0 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0037040 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19040b2590 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.093+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19040b2e30 con 0x7f1904070b80 2024-09-10T08:42:21.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.094+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19040b2760 con 0x7f1904070b80 2024-09-10T08:42:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.095+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18f0044020 con 0x7f1904070b80 2024-09-10T08:42:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.096+0000 7f18faa00640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 0x7f18e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.096+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f18f00ab3f0 con 0x7f1904070b80 2024-09-10T08:42:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.096+0000 7f1902a00640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 0x7f18e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.097+0000 7f1902a00640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 0x7f18e406e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b970 tx=0x7f18f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.100+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18f004b030 con 0x7f1904070b80 2024-09-10T08:42:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.288+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1904071390 con 0x7f1904070b80 2024-09-10T08:42:21.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.289+0000 7f18faa00640 1 -- 172.21.15.52:0/2324624466 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) ==== 74+0+13056 (secure 0 0 0) 0x7f18f007a000 con 0x7f1904070b80 2024-09-10T08:42:21.290 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:21.290 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":186,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:19.902455+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":181,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6837/1803120524":"2024-09-11T08:42:16.890628+0000","172.21.15.176:6835/1803120524":"2024-09-11T08:42:16.890628+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:21.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 msgr2=0x7f18e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 0x7f18e406e2f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b970 tx=0x7f18f4008040 comp rx=0 tx=0).stop 2024-09-10T08:42:21.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 msgr2=0x7f19041e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f18f002a220 tx=0x7f18f00046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 shutdown_connections 2024-09-10T08:42:21.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f18e406be30 0x7f18e406e2f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f190415e6d0 0x7f1904156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904070b80 0x7f19041e8f70 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 --2- 172.21.15.52:0/2324624466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f190406cd20 0x7f19041f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 >> 172.21.15.52:0/2324624466 conn(0x7f1904067fb0 msgr2=0x7f1904161fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 shutdown_connections 2024-09-10T08:42:21.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.291+0000 7f1909800640 1 -- 172.21.15.52:0/2324624466 wait complete. 2024-09-10T08:42:21.308 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:28:35.506252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:42:21.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:42:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.466+0000 7f719e800640 1 Processor -- start 2024-09-10T08:42:21.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.466+0000 7f719e800640 1 -- start start 2024-09-10T08:42:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.467+0000 7f719e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.467+0000 7f719e800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f719806c320 0x7f719815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.467+0000 7f719e800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7198158d00 con 0x7f7198070f40 2024-09-10T08:42:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.467+0000 7f719e800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7198072130 con 0x7f719806c320 2024-09-10T08:42:21.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.467+0000 7f719e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71980ce0f0 con 0x7f7198158920 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.468+0000 7f7197400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.468+0000 7f7197400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:33908/0 (socket says 172.21.15.52:33908) 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.468+0000 7f7197400640 1 -- 172.21.15.52:0/3829811913 learned_addr learned my addr 172.21.15.52:0/3829811913 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.468+0000 7f7197e00640 1 --2- 172.21.15.52:0/3829811913 >> v2:172.21.15.176:3300/0 conn(0x7f719806c320 0x7f719815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.469+0000 7f7197400640 1 -- 172.21.15.52:0/3829811913 >> v2:172.21.15.176:3300/0 conn(0x7f719806c320 msgr2=0x7f719815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:21.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.469+0000 7f7197400640 1 --2- 172.21.15.52:0/3829811913 >> v2:172.21.15.176:3300/0 conn(0x7f719806c320 0x7f719815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.469+0000 7f7197400640 1 -- 172.21.15.52:0/3829811913 >> v1:172.21.15.176:6789/0 conn(0x7f7198070f40 legacy=0x7f719806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.469+0000 7f7197400640 1 -- 172.21.15.52:0/3829811913 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7198071500 con 0x7f7198158920 2024-09-10T08:42:21.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f7197400640 1 --2- 172.21.15.52:0/3829811913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f718800bb10 tx=0x7f718802c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8515fc1bb85f4681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f7196a00640 1 -- 172.21.15.52:0/3829811913 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188032790 con 0x7f7198158920 2024-09-10T08:42:21.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f7196a00640 1 -- 172.21.15.52:0/3829811913 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188038070 con 0x7f7198158920 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f7196a00640 1 -- 172.21.15.52:0/3829811913 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188032b50 con 0x7f7198158920 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 -- 172.21.15.52:0/3829811913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 msgr2=0x7f7198073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 --2- 172.21.15.52:0/3829811913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f718800bb10 tx=0x7f718802c890 comp rx=0 tx=0).stop 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 -- 172.21.15.52:0/3829811913 shutdown_connections 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 --2- 172.21.15.52:0/3829811913 >> v2:172.21.15.176:3300/0 conn(0x7f719806c320 0x7f719815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 --2- 172.21.15.52:0/3829811913 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7198158920 0x7f7198073ac0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.470+0000 7f719e800640 1 -- 172.21.15.52:0/3829811913 >> 172.21.15.52:0/3829811913 conn(0x7f719806d0f0 msgr2=0x7f719806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.471+0000 7f719e800640 1 -- 172.21.15.52:0/3829811913 shutdown_connections 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.471+0000 7f719e800640 1 -- 172.21.15.52:0/3829811913 wait complete. 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.472+0000 7f719e800640 1 Processor -- start 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.472+0000 7f719e800640 1 -- start start 2024-09-10T08:42:21.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719806c320 0x7f7198151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7198070f40 0x7f7198149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f719806cc30 con 0x7f7198158920 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7198071dc0 con 0x7f7198070f40 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f719e800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71980725c0 con 0x7f719806c320 2024-09-10T08:42:21.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f7197e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f7197e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45918/0 (socket says 172.21.15.52:45918) 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f7197e00640 1 -- 172.21.15.52:0/337333216 learned_addr learned my addr 172.21.15.52:0/337333216 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f7197400640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719806c320 0x7f7198151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.473+0000 7f718fe00640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7198070f40 0x7f7198149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 -- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719806c320 msgr2=0x7f7198151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719806c320 0x7f7198151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 -- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7198070f40 msgr2=0x7f7198149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7198070f40 0x7f7198149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 -- 172.21.15.52:0/337333216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719814d260 con 0x7f7198158920 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f7197e00640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f719000efc0 tx=0x7f719000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.474+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190018020 con 0x7f7198158920 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.475+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7190014480 con 0x7f7198158920 2024-09-10T08:42:21.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.475+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190014870 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.475+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719814d540 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.475+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719814db00 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.476+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7198073ac0 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.477+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7190005d10 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.477+0000 7f718f400640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 0x7f717406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.477+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f719008b8a0 con 0x7f7198158920 2024-09-10T08:42:21.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.478+0000 7f7197400640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 0x7f717406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.479+0000 7f7197400640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 0x7f717406e2f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7188037000 tx=0x7f7188032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.482+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7190022030 con 0x7f7198158920 2024-09-10T08:42:21.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.667+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71980ccad0 con 0x7f7198158920 2024-09-10T08:42:21.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.667+0000 7f718f400640 1 -- 172.21.15.52:0/337333216 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) ==== 93+0+10 (secure 0 0 0) 0x7f7190010040 con 0x7f7198158920 2024-09-10T08:42:21.668 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-10T08:42:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 msgr2=0x7f717406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 0x7f717406e2f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f7188037000 tx=0x7f7188032000 comp rx=0 tx=0).stop 2024-09-10T08:42:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 msgr2=0x7f7198154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f719000efc0 tx=0x7f719000c490 comp rx=0 tx=0).stop 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 shutdown_connections 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f717406be30 0x7f717406e2f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7198158920 0x7f7198154e30 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7198070f40 0x7f7198149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 --2- 172.21.15.52:0/337333216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f719806c320 0x7f7198151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 >> 172.21.15.52:0/337333216 conn(0x7f719806d0f0 msgr2=0x7f71980ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 shutdown_connections 2024-09-10T08:42:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.670+0000 7f719e800640 1 -- 172.21.15.52:0/337333216 wait complete. 2024-09-10T08:42:21.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-10T08:42:21.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.843+0000 7f9128c00640 1 Processor -- start 2024-09-10T08:42:21.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.843+0000 7f9128c00640 1 -- start start 2024-09-10T08:42:21.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9128c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9124145ed0 0x7f91240b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9128c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91240b4020 con 0x7f9124073180 2024-09-10T08:42:21.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9128c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91240b42c0 con 0x7f91240b5f90 2024-09-10T08:42:21.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9128c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f91240b63d0 con 0x7f9124145ed0 2024-09-10T08:42:21.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9121400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9124073180 0x7f91240b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45172/0 (socket says 172.21.15.52:45172) 2024-09-10T08:42:21.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9121400640 1 -- 172.21.15.52:0/2932933039 learned_addr learned my addr 172.21.15.52:0/2932933039 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:21.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9121e00640 1 --2- 172.21.15.52:0/2932933039 >> v2:172.21.15.176:3300/0 conn(0x7f9124145ed0 0x7f91240b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9120a00640 1 -- 172.21.15.52:0/2932933039 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698768004 0 0) 0x7f91240b4020 con 0x7f9124073180 2024-09-10T08:42:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.845+0000 7f9120a00640 1 -- 172.21.15.52:0/2932933039 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9108003520 con 0x7f9124073180 2024-09-10T08:42:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.846+0000 7f9121e00640 1 -- 172.21.15.52:0/2932933039 >> v1:172.21.15.176:6789/0 conn(0x7f91240b5f90 legacy=0x7f912415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.846+0000 7f9121e00640 1 -- 172.21.15.52:0/2932933039 >> v1:172.21.15.52:6789/0 conn(0x7f9124073180 legacy=0x7f91240b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.846+0000 7f9121e00640 1 -- 172.21.15.52:0/2932933039 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240b45a0 con 0x7f9124145ed0 2024-09-10T08:42:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.847+0000 7f9121e00640 1 --2- 172.21.15.52:0/2932933039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91240b5080 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f91140097a0 tx=0x7f911402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9deff2b2f0902e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.847+0000 7f9120a00640 1 -- 172.21.15.52:0/2932933039 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114037070 con 0x7f9124145ed0 2024-09-10T08:42:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.847+0000 7f9120a00640 1 -- 172.21.15.52:0/2932933039 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9114032440 con 0x7f9124145ed0 2024-09-10T08:42:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.847+0000 7f9120a00640 1 -- 172.21.15.52:0/2932933039 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9114032810 con 0x7f9124145ed0 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 -- 172.21.15.52:0/2932933039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 msgr2=0x7f91240b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 --2- 172.21.15.52:0/2932933039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91240b5080 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f91140097a0 tx=0x7f911402a230 comp rx=0 tx=0).stop 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 -- 172.21.15.52:0/2932933039 shutdown_connections 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 --2- 172.21.15.52:0/2932933039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91240b5080 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 -- 172.21.15.52:0/2932933039 >> 172.21.15.52:0/2932933039 conn(0x7f91240ccec0 msgr2=0x7f91240cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 -- 172.21.15.52:0/2932933039 shutdown_connections 2024-09-10T08:42:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.848+0000 7f9128c00640 1 -- 172.21.15.52:0/2932933039 wait complete. 2024-09-10T08:42:21.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.849+0000 7f9128c00640 1 Processor -- start 2024-09-10T08:42:21.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.849+0000 7f9128c00640 1 -- start start 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 0x7f91240ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91241449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91241462b0 con 0x7f91240b5f90 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91240b4b60 con 0x7f9124145ed0 2024-09-10T08:42:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.850+0000 7f9128c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9124146430 con 0x7f9124073180 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 0x7f91240ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45920/0 (socket says 172.21.15.52:45920) 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 -- 172.21.15.52:0/1236892869 learned_addr learned my addr 172.21.15.52:0/1236892869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 0x7f91240ab840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:33930/0 (socket says 172.21.15.52:33930) 2024-09-10T08:42:21.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9122800640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91241449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 -- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 msgr2=0x7f91240ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 0x7f91240ab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 -- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 msgr2=0x7f91241449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91241449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 -- 172.21.15.52:0/1236892869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91240cb550 con 0x7f91240b5f90 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.851+0000 7f9121400640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f911000c400 tx=0x7f911000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.852+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110017070 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.852+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9110005ce0 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.852+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91100072d0 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.852+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91240cb830 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.852+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91240cbdf0 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.853+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91241f4390 con 0x7f91240b5f90 2024-09-10T08:42:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.854+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f911001a070 con 0x7f91240b5f90 2024-09-10T08:42:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.854+0000 7f911a000640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.855+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f9110089e40 con 0x7f91240b5f90 2024-09-10T08:42:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.855+0000 7f9121e00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.856+0000 7f9121e00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 0x7f910406e2f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9114034000 tx=0x7f911402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:21.859+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9110058490 con 0x7f91240b5f90 2024-09-10T08:42:22.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.108+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f9124071720 con 0x7f91240b5f90 2024-09-10T08:42:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.915+0000 7f911a000640 1 -- 172.21.15.52:0/1236892869 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v639) ==== 136+0+0 (secure 0 0 0) 0x7f911005c790 con 0x7f91240b5f90 2024-09-10T08:42:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.918+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 msgr2=0x7f910406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.918+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 0x7f910406e2f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9114034000 tx=0x7f911402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.918+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 msgr2=0x7f91241444b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.918+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f911000c400 tx=0x7f911000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 shutdown_connections 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f910406be30 0x7f910406e2f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9124145ed0 0x7f91241449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91240b5f90 0x7f91241444b0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 --2- 172.21.15.52:0/1236892869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9124073180 0x7f91240ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 >> 172.21.15.52:0/1236892869 conn(0x7f91240ccec0 msgr2=0x7f9124071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 shutdown_connections 2024-09-10T08:42:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:22.919+0000 7f9128c00640 1 -- 172.21.15.52:0/1236892869 wait complete. 2024-09-10T08:42:22.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:42:23.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.104+0000 7f0373800640 1 Processor -- start 2024-09-10T08:42:23.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.104+0000 7f0373800640 1 -- start start 2024-09-10T08:42:23.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0373800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c162d90 0x7f036c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0373800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036c071870 con 0x7f036c0b6e00 2024-09-10T08:42:23.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0373800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036c15ec10 con 0x7f036c0d3040 2024-09-10T08:42:23.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0373800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f036c0d3480 con 0x7f036c162d90 2024-09-10T08:42:23.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0370e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f036c0b6e00 0x7f036c0b71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45180/0 (socket says 172.21.15.52:45180) 2024-09-10T08:42:23.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.105+0000 7f0370e00640 1 -- 172.21.15.52:0/366470959 learned_addr learned my addr 172.21.15.52:0/366470959 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f0371800640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c162d90 0x7f036c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275814323 0 0) 0x7f036c071870 con 0x7f036c0b6e00 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0350003520 con 0x7f036c0b6e00 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302756896 0 0) 0x7f036c15ec10 con 0x7f036c0d3040 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f036c071870 con 0x7f036c0d3040 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 241909727 0 0) 0x7f0350003520 con 0x7f036c0b6e00 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c162d90 msgr2=0x7f036c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c162d90 0x7f036c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 >> v1:172.21.15.176:6789/0 conn(0x7f036c0d3040 legacy=0x7f036c071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c06ed20 con 0x7f036c0b6e00 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f035c001670 con 0x7f036c0b6e00 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 >> v1:172.21.15.52:6789/0 conn(0x7f036c0b6e00 legacy=0x7f036c0b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0350003b70 0x7f0350003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350004800 0x7f0350004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0350005210 0x7f035000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f036c0d3480 con 0x7f0350005210 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f035000c140 con 0x7f0350004800 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.106+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f035000c340 con 0x7f0350003b70 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0350003b70 0x7f0350003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0363e00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350004800 0x7f0350004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0371800640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0350005210 0x7f035000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 -- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350004800 msgr2=0x7f0350004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:23.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350004800 0x7f0350004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 -- 172.21.15.52:0/366470959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0350005210 msgr2=0x7f035000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:23.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0350005210 0x7f035000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0370e00640 1 -- 172.21.15.52:0/366470959 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0350003520 con 0x7f0350003b70 2024-09-10T08:42:23.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.107+0000 7f0371800640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0350005210 0x7f035000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.108+0000 7f0370e00640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0350003b70 0x7f0350003f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f035c007fb0 tx=0x7f0350005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5f6f2fe77f297d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c007c00 con 0x7f0350003b70 2024-09-10T08:42:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035c005af0 con 0x7f0350003b70 2024-09-10T08:42:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f036be00640 1 -- 172.21.15.52:0/366470959 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c007070 con 0x7f0350003b70 2024-09-10T08:42:23.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 -- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0350003b70 msgr2=0x7f0350003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 --2- 172.21.15.52:0/366470959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0350003b70 0x7f0350003f70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f035c007fb0 tx=0x7f0350005830 comp rx=0 tx=0).stop 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0371800640 1 -- 172.21.15.52:0/366470959 reap_dead start 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 -- 172.21.15.52:0/366470959 shutdown_connections 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 -- 172.21.15.52:0/366470959 >> 172.21.15.52:0/366470959 conn(0x7f036c0d2550 msgr2=0x7f036c0d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 -- 172.21.15.52:0/366470959 shutdown_connections 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.109+0000 7f0373800640 1 -- 172.21.15.52:0/366470959 wait complete. 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.111+0000 7f0373800640 1 Processor -- start 2024-09-10T08:42:23.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.111+0000 7f0373800640 1 -- start start 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 0x7f036c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 0x7f036c1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f036c070960 con 0x7f036c1610a0 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f036c06e7f0 con 0x7f0350003b70 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0373800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f036c070c40 con 0x7f036c142d70 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0371800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0371800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45950/0 (socket says 172.21.15.52:45950) 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0371800640 1 -- 172.21.15.52:0/3160759431 learned_addr learned my addr 172.21.15.52:0/3160759431 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0370e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 0x7f036c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.112+0000 7f0363e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 0x7f036c1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 -- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 msgr2=0x7f036c1431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 0x7f036c1431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 -- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 msgr2=0x7f036c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 0x7f036c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 -- 172.21.15.52:0/3160759431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c160070 con 0x7f036c1610a0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0363e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 0x7f036c1431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0370e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 0x7f036c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0371800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f036c0691a0 tx=0x7f036400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364009bd0 con 0x7f036c1610a0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036400fd90 con 0x7f036c1610a0 2024-09-10T08:42:23.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364003bd0 con 0x7f036c1610a0 2024-09-10T08:42:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c1602e0 con 0x7f036c1610a0 2024-09-10T08:42:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.113+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c1608a0 con 0x7f036c1610a0 2024-09-10T08:42:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.115+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036c0d1a70 con 0x7f036c1610a0 2024-09-10T08:42:23.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.115+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f036401f020 con 0x7f036c1610a0 2024-09-10T08:42:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.117+0000 7f0369600640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.117+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f036408ae60 con 0x7f036c1610a0 2024-09-10T08:42:23.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.117+0000 7f0370e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.118+0000 7f0370e00640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 0x7f034806e320 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f035c032000 tx=0x7f035c02d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.121+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0364010040 con 0x7f036c1610a0 2024-09-10T08:42:23.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.309+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f036c15da40 con 0x7f036c1610a0 2024-09-10T08:42:23.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.313+0000 7f0369600640 1 -- 172.21.15.52:0/3160759431 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f0364059a80 con 0x7f036c1610a0 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 msgr2=0x7f034806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 0x7f034806e320 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f035c032000 tx=0x7f035c02d000 comp rx=0 tx=0).stop 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 msgr2=0x7f036c161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f036c0691a0 tx=0x7f036400f580 comp rx=0 tx=0).stop 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 shutdown_connections 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f034806be60 0x7f034806e320 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f036c1610a0 0x7f036c161520 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f036c142d70 0x7f036c1431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 --2- 172.21.15.52:0/3160759431 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0350003b70 0x7f036c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 >> 172.21.15.52:0/3160759431 conn(0x7f036c0d2550 msgr2=0x7f036c162060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:23.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 shutdown_connections 2024-09-10T08:42:23.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.316+0000 7f0373800640 1 -- 172.21.15.52:0/3160759431 wait complete. 2024-09-10T08:42:23.332 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:42:23.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:42:23.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:42:23.529 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:42:23.529 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:23.530 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:23.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:42:23.566 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:42:23.566 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:23.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:42:23.604 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:23.604 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:23.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:42:23.641 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:42:23.641 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:23.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:42:23.680 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:42:23.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.837+0000 7f7ff9800640 1 Processor -- start 2024-09-10T08:42:23.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.837+0000 7f7ff9800640 1 -- start start 2024-09-10T08:42:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.838+0000 7f7ff9800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7ff4145ed0 0x7f7ff40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff9800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b4020 con 0x7f7ff4073180 2024-09-10T08:42:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff9800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff40b42c0 con 0x7f7ff40b5f90 2024-09-10T08:42:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff9800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff40b63d0 con 0x7f7ff4145ed0 2024-09-10T08:42:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7fea000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7ff4073180 0x7f7ff40b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:45196/0 (socket says 172.21.15.52:45196) 2024-09-10T08:42:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7fea000640 1 -- 172.21.15.52:0/287940642 learned_addr learned my addr 172.21.15.52:0/287940642 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:23.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff2a00640 1 --2- 172.21.15.52:0/287940642 >> v2:172.21.15.176:3300/0 conn(0x7f7ff4145ed0 0x7f7ff40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790728019 0 0) 0x7f7ff40b4020 con 0x7f7ff4073180 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd8003520 con 0x7f7ff4073180 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727465422 0 0) 0x7f7ff40b42c0 con 0x7f7ff40b5f90 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.839+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff40b4020 con 0x7f7ff40b5f90 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.840+0000 7f7ff2a00640 1 -- 172.21.15.52:0/287940642 >> v1:172.21.15.176:6789/0 conn(0x7f7ff40b5f90 legacy=0x7f7ff415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.840+0000 7f7ff2a00640 1 -- 172.21.15.52:0/287940642 >> v1:172.21.15.52:6789/0 conn(0x7f7ff4073180 legacy=0x7f7ff40b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.840+0000 7f7ff2a00640 1 -- 172.21.15.52:0/287940642 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40b45a0 con 0x7f7ff4145ed0 2024-09-10T08:42:23.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff2a00640 1 --2- 172.21.15.52:0/287940642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff4145ed0 0x7f7ff40b5080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40097a0 tx=0x7f7fe402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=341edf0edd11e019 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4037070 con 0x7f7ff4145ed0 2024-09-10T08:42:23.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4032440 con 0x7f7ff4145ed0 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff2000640 1 -- 172.21.15.52:0/287940642 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4032810 con 0x7f7ff4145ed0 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff9800640 1 -- 172.21.15.52:0/287940642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff4145ed0 msgr2=0x7f7ff40b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.841+0000 7f7ff9800640 1 --2- 172.21.15.52:0/287940642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff4145ed0 0x7f7ff40b5080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40097a0 tx=0x7f7fe402a230 comp rx=0 tx=0).stop 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.842+0000 7f7ff9800640 1 -- 172.21.15.52:0/287940642 shutdown_connections 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.842+0000 7f7ff9800640 1 --2- 172.21.15.52:0/287940642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff4145ed0 0x7f7ff40b5080 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.842+0000 7f7ff9800640 1 -- 172.21.15.52:0/287940642 >> 172.21.15.52:0/287940642 conn(0x7f7ff40ccec0 msgr2=0x7f7ff40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.842+0000 7f7ff9800640 1 -- 172.21.15.52:0/287940642 shutdown_connections 2024-09-10T08:42:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.842+0000 7f7ff9800640 1 -- 172.21.15.52:0/287940642 wait complete. 2024-09-10T08:42:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.843+0000 7f7ff9800640 1 Processor -- start 2024-09-10T08:42:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.843+0000 7f7ff9800640 1 -- start start 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ff4073180 0x7f7ff41e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff40b5f90 0x7f7ff40ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff41462b0 con 0x7f7ff4145ed0 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff40b4b60 con 0x7f7ff40b5f90 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff9800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff4146430 con 0x7f7ff4073180 2024-09-10T08:42:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.844+0000 7f7ff3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45952/0 (socket says 172.21.15.52:45952) 2024-09-10T08:42:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 -- 172.21.15.52:0/1703873892 learned_addr learned my addr 172.21.15.52:0/1703873892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7fea000640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff40b5f90 0x7f7ff40ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff2a00640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ff4073180 0x7f7ff41e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 -- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ff4073180 msgr2=0x7f7ff41e8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ff4073180 0x7f7ff41e8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 -- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff40b5f90 msgr2=0x7f7ff40ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff40b5f90 0x7f7ff40ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 -- 172.21.15.52:0/1703873892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff40cb140 con 0x7f7ff4145ed0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.845+0000 7f7ff3400640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c790 tx=0x7f7fec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.846+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec003b70 con 0x7f7ff4145ed0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.846+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fec003d10 con 0x7f7ff4145ed0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.846+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00aa50 con 0x7f7ff4145ed0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.846+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff40cb420 con 0x7f7ff4145ed0 2024-09-10T08:42:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.846+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff40cb9e0 con 0x7f7ff4145ed0 2024-09-10T08:42:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.847+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff40b5080 con 0x7f7ff4145ed0 2024-09-10T08:42:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.848+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fec00abf0 con 0x7f7ff4145ed0 2024-09-10T08:42:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.849+0000 7f7feb400640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.849+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 4943+0+0 (secure 0 0 0) 0x7f7fec08aa80 con 0x7f7ff4145ed0 2024-09-10T08:42:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.849+0000 7f7ff2a00640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.850+0000 7f7ff2a00640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 0x7f7fd006e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4034000 tx=0x7f7fe402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:23.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:23.854+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fec08ce20 con 0x7f7ff4145ed0 2024-09-10T08:42:24.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.077+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ff41e9090 con 0x7f7ff4145ed0 2024-09-10T08:42:24.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.078+0000 7f7feb400640 1 -- 172.21.15.52:0/1703873892 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+3919 (secure 0 0 0) 0x7f7fec059040 con 0x7f7ff4145ed0 2024-09-10T08:42:24.079 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:24.079 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":143,"btime":"2024-09-10T08:42:17:893330+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8201,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/1636814716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1636814716},{"type":"v1","addr":"172.21.15.52:6835","nonce":1636814716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8204,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/4012077434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":4012077434},{"type":"v1","addr":"172.21.15.176:6836","nonce":4012077434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136},{"gid":8408,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3656141681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3656141681},{"type":"v1","addr":"172.21.15.176:6837","nonce":3656141681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/298844368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":298844368},{"type":"v1","addr":"172.21.15.52:6834","nonce":298844368}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":136}],"filesystems":[]} 2024-09-10T08:42:24.079 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 143 2024-09-10T08:42:24.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 msgr2=0x7f7fd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 0x7f7fd006e2f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4034000 tx=0x7f7fe402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:24.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 msgr2=0x7f7ff41435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00c790 tx=0x7f7fec00cc50 comp rx=0 tx=0).stop 2024-09-10T08:42:24.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 shutdown_connections 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff4145ed0 0x7f7ff41435b0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ff40b5f90 0x7f7ff40ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 --2- 172.21.15.52:0/1703873892 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ff4073180 0x7f7ff41e8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.080+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 >> 172.21.15.52:0/1703873892 conn(0x7f7ff40ccec0 msgr2=0x7f7ff415bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.081+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 shutdown_connections 2024-09-10T08:42:24.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.081+0000 7f7ff9800640 1 -- 172.21.15.52:0/1703873892 wait complete. 2024-09-10T08:42:24.097 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:42:24.097 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:42:24.097 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:42:24.097 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:42:24.097 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:42:24.097 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:42:24.098 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:42:24.098 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:42:24.098 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:42:24.098 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:42:24.098 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:42:24.098 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:42:24.098 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:42:24.099 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:42:24.099 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:42:24.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:42:24.111 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:42:24.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:42:24.112 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:42:24.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:42:24.115 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:42:24.115 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:42:24.115 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:42:24.115 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:42:24.156 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:42:24.157 DEBUG:teuthology.parallel:result is None 2024-09-10T08:42:24.158 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:42:24.159 DEBUG:teuthology.parallel:result is None 2024-09-10T08:42:24.159 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:42:24.159 DEBUG:teuthology.parallel:result is None 2024-09-10T08:42:24.161 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:42:24.161 DEBUG:teuthology.parallel:result is None 2024-09-10T08:42:24.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:42:24.287 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-10T08:42:24.289 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:42:24.289 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2024-09-10T08:42:24.290 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2024-09-10T08:42:24.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.329+0000 7f54d5c00640 1 Processor -- start 2024-09-10T08:42:24.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.329+0000 7f54d5c00640 1 -- start start 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f54d015e440 0x7f54d00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d00d3990 con 0x7f54d00cf450 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d00d3c70 con 0x7f54d00b6710 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f54d00d3f50 con 0x7f54d015e440 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5200640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f54d00b6710 0x7f54d00b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52702/0 (socket says 172.21.15.52:52702) 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54d5200640 1 -- 172.21.15.52:0/1359540430 learned_addr learned my addr 172.21.15.52:0/1359540430 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:24.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.331+0000 7f54cfe00640 1 --2- 172.21.15.52:0/1359540430 >> v2:172.21.15.52:3300/0 conn(0x7f54d015e440 0x7f54d00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.332+0000 7f54cfe00640 1 -- 172.21.15.52:0/1359540430 >> v1:172.21.15.176:6789/0 conn(0x7f54d00b6710 legacy=0x7f54d00b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.332+0000 7f54cfe00640 1 -- 172.21.15.52:0/1359540430 >> v1:172.21.15.52:6789/0 conn(0x7f54d00cf450 legacy=0x7f54d00b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:24.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.332+0000 7f54cfe00640 1 -- 172.21.15.52:0/1359540430 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d00d4230 con 0x7f54d015e440 2024-09-10T08:42:24.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.333+0000 7f54cfe00640 1 --2- 172.21.15.52:0/1359540430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d015e440 0x7f54d00d3240 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f4ea53dab76aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.334+0000 7f54cf400640 1 -- 172.21.15.52:0/1359540430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0037070 con 0x7f54d015e440 2024-09-10T08:42:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.334+0000 7f54cf400640 1 -- 172.21.15.52:0/1359540430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c0032440 con 0x7f54d015e440 2024-09-10T08:42:24.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.334+0000 7f54cf400640 1 -- 172.21.15.52:0/1359540430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0032810 con 0x7f54d015e440 2024-09-10T08:42:24.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 -- 172.21.15.52:0/1359540430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d015e440 msgr2=0x7f54d00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 --2- 172.21.15.52:0/1359540430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d015e440 0x7f54d00d3240 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f54c00097a0 tx=0x7f54c002a270 comp rx=0 tx=0).stop 2024-09-10T08:42:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 -- 172.21.15.52:0/1359540430 shutdown_connections 2024-09-10T08:42:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 --2- 172.21.15.52:0/1359540430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d015e440 0x7f54d00d3240 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 -- 172.21.15.52:0/1359540430 >> 172.21.15.52:0/1359540430 conn(0x7f54d0067f80 msgr2=0x7f54d00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 -- 172.21.15.52:0/1359540430 shutdown_connections 2024-09-10T08:42:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.335+0000 7f54d5c00640 1 -- 172.21.15.52:0/1359540430 wait complete. 2024-09-10T08:42:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.337+0000 7f54d5c00640 1 Processor -- start 2024-09-10T08:42:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.337+0000 7f54d5c00640 1 -- start start 2024-09-10T08:42:24.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b6710 0x7f54d015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015e440 0x7f54d01e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54d00b76c0 con 0x7f54d00cf450 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f54d00b7540 con 0x7f54d00b6710 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f54d00b8270 con 0x7f54d015e440 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54cfe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b6710 0x7f54d015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54164/0 (socket says 172.21.15.52:54164) 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 -- 172.21.15.52:0/2676510869 learned_addr learned my addr 172.21.15.52:0/2676510869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54d5200640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015e440 0x7f54d01e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 -- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015e440 msgr2=0x7f54d01e9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015e440 0x7f54d01e9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 -- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b6710 msgr2=0x7f54d015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b6710 0x7f54d015dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.338+0000 7f54c7e00640 1 -- 172.21.15.52:0/2676510869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d00cb650 con 0x7f54d00cf450 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54c7e00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c430 tx=0x7f54b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8011790 con 0x7f54d00cf450 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b8017070 con 0x7f54d00cf450 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8011b70 con 0x7f54d00cf450 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d00cb930 con 0x7f54d00cf450 2024-09-10T08:42:24.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.339+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d00cbef0 con 0x7f54d00cf450 2024-09-10T08:42:24.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.340+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d00d3240 con 0x7f54d00cf450 2024-09-10T08:42:24.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.341+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54b8011d10 con 0x7f54d00cf450 2024-09-10T08:42:24.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.342+0000 7f54ccc00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 0x7f54ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:24.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.342+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4943+0+0 (secure 0 0 0) 0x7f54b808a900 con 0x7f54d00cf450 2024-09-10T08:42:24.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.343+0000 7f54cfe00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 0x7f54ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:24.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.343+0000 7f54cfe00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 0x7f54ac06e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f54c0034000 tx=0x7f54c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:24.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.346+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54b8058ec0 con 0x7f54d00cf450 2024-09-10T08:42:24.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:24.542+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f54d00ca7d0 con 0x7f54d00cf450 2024-09-10T08:42:25.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.333+0000 7f54ccc00640 1 -- 172.21.15.52:0/2676510869 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v191) ==== 97+0+0 (secure 0 0 0) 0x7f54b805d1c0 con 0x7f54d00cf450 2024-09-10T08:42:25.334 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 msgr2=0x7f54ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 0x7f54ac06e2f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f54c0034000 tx=0x7f54c002e000 comp rx=0 tx=0).stop 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 msgr2=0x7f54d01e9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c430 tx=0x7f54b800c8f0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 shutdown_connections 2024-09-10T08:42:25.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f54ac06be30 0x7f54ac06e2f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f54d015e440 0x7f54d01e9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54d00cf450 0x7f54d01e9020 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 --2- 172.21.15.52:0/2676510869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54d00b6710 0x7f54d015dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.336+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 >> 172.21.15.52:0/2676510869 conn(0x7f54d0067f80 msgr2=0x7f54d00ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.337+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 shutdown_connections 2024-09-10T08:42:25.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.337+0000 7f54d5c00640 1 -- 172.21.15.52:0/2676510869 wait complete. 2024-09-10T08:42:25.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:42:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.517+0000 7fe4ad400640 1 Processor -- start 2024-09-10T08:42:25.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.517+0000 7fe4ad400640 1 -- start start 2024-09-10T08:42:25.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe4a80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe4ad400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a80d3990 con 0x7fe4a80cf450 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe4ad400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a80d3c70 con 0x7fe4a80b6710 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe4ad400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80d3f50 con 0x7fe4a815e440 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe49f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe4a80cf450 0x7fe4a80b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40308/0 (socket says 172.21.15.52:40308) 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe49f400640 1 -- 172.21.15.52:0/3483861770 learned_addr learned my addr 172.21.15.52:0/3483861770 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:25.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.518+0000 7fe4a7e00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe4a80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109015617 0 0) 0x7fe4a80d3990 con 0x7fe4a80cf450 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe48c003520 con 0x7fe4a80cf450 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847445666 0 0) 0x7fe4a80d3c70 con 0x7fe4a80b6710 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a80d3990 con 0x7fe4a80b6710 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3094464107 0 0) 0x7fe48c003520 con 0x7fe4a80cf450 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 msgr2=0x7fe4a80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe4a80d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 >> v1:172.21.15.176:6789/0 conn(0x7fe4a80b6710 legacy=0x7fe4a80b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80d4230 con 0x7fe4a80cf450 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fe490001670 con 0x7fe4a80cf450 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 >> v1:172.21.15.52:6789/0 conn(0x7fe4a80cf450 legacy=0x7fe4a80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe48c003b70 0x7fe48c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe48c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe48c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80d3f50 con 0x7fe48c004d40 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c00ba70 con 0x7fe48c003b70 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c00bc70 con 0x7fe4a815e440 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.519+0000 7fe4aca00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe48c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe49f400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe48c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4a7e00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe48c003b70 0x7fe48c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4aca00640 1 -- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 msgr2=0x7fe48c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4aca00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a815e440 0x7fe48c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4aca00640 1 -- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe48c003b70 msgr2=0x7fe48c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4aca00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe48c003b70 0x7fe48c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.520+0000 7fe4aca00640 1 -- 172.21.15.52:0/3483861770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c003520 con 0x7fe48c004d40 2024-09-10T08:42:25.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.521+0000 7fe4aca00640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe48c0051c0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001fa0 tx=0x7fe48c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50acdadec5f8bad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.521+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0001bf0 con 0x7fe48c004d40 2024-09-10T08:42:25.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.521+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0003b70 con 0x7fe48c004d40 2024-09-10T08:42:25.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.521+0000 7fe4a7400640 1 -- 172.21.15.52:0/3483861770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00050d0 con 0x7fe48c004d40 2024-09-10T08:42:25.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 -- 172.21.15.52:0/3483861770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 msgr2=0x7fe48c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 --2- 172.21.15.52:0/3483861770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe48c0051c0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0001fa0 tx=0x7fe48c005830 comp rx=0 tx=0).stop 2024-09-10T08:42:25.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4aca00640 1 -- 172.21.15.52:0/3483861770 reap_dead start 2024-09-10T08:42:25.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 -- 172.21.15.52:0/3483861770 shutdown_connections 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 -- 172.21.15.52:0/3483861770 >> 172.21.15.52:0/3483861770 conn(0x7fe4a8067f80 msgr2=0x7fe4a80d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 -- 172.21.15.52:0/3483861770 shutdown_connections 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.522+0000 7fe4ad400640 1 -- 172.21.15.52:0/3483861770 wait complete. 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.523+0000 7fe4ad400640 1 Processor -- start 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 -- start start 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 0x7fe4a80ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4a80cd820 0x7fe4a80cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80b76c0 con 0x7fe48c004d40 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80b7540 con 0x7fe4a80cd820 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.524+0000 7fe4ad400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80d3240 con 0x7fe4a80aafb0 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54190/0 (socket says 172.21.15.52:54190) 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 -- 172.21.15.52:0/1915877979 learned_addr learned my addr 172.21.15.52:0/1915877979 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe49f400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 0x7fe4a80ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 -- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 msgr2=0x7fe4a80ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 0x7fe4a80ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4aca00640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4a80cd820 0x7fe4a80cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 -- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4a80cd820 msgr2=0x7fe4a80cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4a80cd820 0x7fe4a80cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 -- 172.21.15.52:0/1915877979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80aba70 con 0x7fe48c004d40 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe49f400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 0x7fe4a80ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.525+0000 7fe4a7e00640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fe4980119a0 tx=0x7fe498011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.526+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49800fa90 con 0x7fe48c004d40 2024-09-10T08:42:25.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.526+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49800fc30 con 0x7fe48c004d40 2024-09-10T08:42:25.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.526+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498014440 con 0x7fe48c004d40 2024-09-10T08:42:25.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.526+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a80abd50 con 0x7fe48c004d40 2024-09-10T08:42:25.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.526+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a80ad450 con 0x7fe48c004d40 2024-09-10T08:42:25.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.527+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a80ce1e0 con 0x7fe48c004d40 2024-09-10T08:42:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.528+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe498012040 con 0x7fe48c004d40 2024-09-10T08:42:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.529+0000 7fe4a4c00640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 0x7fe48406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.529+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4857+0+0 (secure 0 0 0) 0x7fe49808b270 con 0x7fe48c004d40 2024-09-10T08:42:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.529+0000 7fe49f400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 0x7fe48406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.530+0000 7fe49f400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 0x7fe48406e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe490001050 tx=0x7fe490009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.533+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe498019030 con 0x7fe48c004d40 2024-09-10T08:42:25.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.783+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe4a80abf20 con 0x7fe48c004d40 2024-09-10T08:42:25.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.784+0000 7fe4a4c00640 1 -- 172.21.15.52:0/1915877979 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7fe498059ed0 con 0x7fe48c004d40 2024-09-10T08:42:25.784 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmIP9IJhAAOiG9UMgiVtfCroWwYF1eJg==", 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.785 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmBw/TORAAss9cHe92RGj+B8SjWyBozg==", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmwCkMMBAAJE9bEAPkm15VRni6qXDKiQ==", 2024-09-10T08:42:25.786 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.d", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmVJDoBxAA6fw3+UgEeZKUwD6xUWgC6A==", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:42:25.787 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD8AuBmk7jQNhAA3+An5dkJCNkCq6l93ZT7Mg==", 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQABA+BmzvojBhAA5RRiocqcJ5VSUVUWfQjlUw==", 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.789 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAFA+BmFZfAABAApWtiIzeVR6gTEBbn/9vfRg==", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAJA+BmJfW6CBAApgljKZd7nHxD8opGcTlnHA==", 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAQA+BmwYL0CBAAVT2LSES2cNDpR5y7G4W44A==", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.791 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAUA+BmYEJYExAApesyPQvKZp7HUMpy8BBMeg==", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAYA+Bmn/CHABAAMsF+di/+YLh46Utkgeh+UQ==", 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.792 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAcA+Bm54eNCRAAA0ZgEdDB7URkxAPfYq4xXA==", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.793 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA==", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow r", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.1", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmBF9WHRAA8E/xagpTjdX9M2xZDW48dw==", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.2", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBmATbgFhAAiZvf6wQxE2ljKeCyeclQEA==", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:42:25.795 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.3", 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD7AuBm+d69IxAAVS8aZQibfGnWKuzkv2Y/bA==", 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.796 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD5AuBmoSMEMhAAidqkWxX/NdNt+INfxQ9iNA==", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmF4ikHxAA5kZl6XfhD4LhnMo4OFzQ3w==", 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.797 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD6AuBmKM4FGBAA6hTxo98r2cXD5IiuHZmN4g==", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:25.799 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T08:42:25.799 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 msgr2=0x7fe48406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 0x7fe48406e2f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe490001050 tx=0x7fe490009040 comp rx=0 tx=0).stop 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 msgr2=0x7fe4a8157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fe4980119a0 tx=0x7fe498011e60 comp rx=0 tx=0).stop 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 shutdown_connections 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe48406be30 0x7fe48406e2f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe4a80cd820 0x7fe4a80cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe4a80aafb0 0x7fe4a80ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 --2- 172.21.15.52:0/1915877979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe48c004d40 0x7fe4a8157d60 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 >> 172.21.15.52:0/1915877979 conn(0x7fe4a8067f80 msgr2=0x7fe4a80b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 shutdown_connections 2024-09-10T08:42:25.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.786+0000 7fe4ad400640 1 -- 172.21.15.52:0/1915877979 wait complete. 2024-09-10T08:42:25.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:42:25.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.959+0000 7f1fd3200640 1 Processor -- start 2024-09-10T08:42:25.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.959+0000 7f1fd3200640 1 -- start start 2024-09-10T08:42:25.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd3200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fd415e770 0x7f1fd40b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40cf960 0x7f1fd40d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd3200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fd40b8a70 con 0x7f1fd40b6100 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd3200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1fd415eb50 con 0x7f1fd415e770 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd40b9680 con 0x7f1fd40cf960 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd1e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fd415e770 0x7f1fd40b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd1e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1fd415e770 0x7f1fd40b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54202/0 (socket says 172.21.15.52:54202) 2024-09-10T08:42:25.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fd1e00640 1 -- 172.21.15.52:0/1472359006 learned_addr learned my addr 172.21.15.52:0/1472359006 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.960+0000 7f1fcbe00640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40cf960 0x7f1fd40d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.961+0000 7f1fd1e00640 1 -- 172.21.15.52:0/1472359006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40cf960 msgr2=0x7f1fd40d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.961+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40cf960 0x7f1fd40d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.961+0000 7f1fd1e00640 1 -- 172.21.15.52:0/1472359006 >> v1:172.21.15.176:6789/0 conn(0x7f1fd40b6100 legacy=0x7f1fd40b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.961+0000 7f1fd1e00640 1 -- 172.21.15.52:0/1472359006 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd40b8d50 con 0x7f1fd415e770 2024-09-10T08:42:25.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40b8400 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009870 tx=0x7f1fc402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2c175352af3cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd1400640 1 -- 172.21.15.52:0/1472359006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4037070 con 0x7f1fd415e770 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd1400640 1 -- 172.21.15.52:0/1472359006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc4032440 con 0x7f1fd415e770 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd1400640 1 -- 172.21.15.52:0/1472359006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4032810 con 0x7f1fd415e770 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd3200640 1 -- 172.21.15.52:0/1472359006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 msgr2=0x7f1fd40b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.962+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40b8400 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009870 tx=0x7f1fc402a1c0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 -- 172.21.15.52:0/1472359006 shutdown_connections 2024-09-10T08:42:25.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40cf960 0x7f1fd40d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1472359006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40b8400 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 -- 172.21.15.52:0/1472359006 >> 172.21.15.52:0/1472359006 conn(0x7f1fd406c030 msgr2=0x7f1fd406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 -- 172.21.15.52:0/1472359006 shutdown_connections 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.963+0000 7f1fd3200640 1 -- 172.21.15.52:0/1472359006 wait complete. 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.964+0000 7f1fd3200640 1 Processor -- start 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.964+0000 7f1fd3200640 1 -- start start 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 0x7f1fd4154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fd40cf960 0x7f1fd40cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40d2790 con 0x7f1fd415e770 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40b9310 con 0x7f1fd40cf960 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.965+0000 7f1fd3200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd40cfda0 con 0x7f1fd40b6100 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54218/0 (socket says 172.21.15.52:54218) 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 -- 172.21.15.52:0/1774147076 learned_addr learned my addr 172.21.15.52:0/1774147076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 0x7f1fd4154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fcbe00640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fd40cf960 0x7f1fd40cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 -- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 msgr2=0x7f1fd4154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 0x7f1fd4154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 -- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fd40cf960 msgr2=0x7f1fd40cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fd40cf960 0x7f1fd40cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 -- 172.21.15.52:0/1774147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd41549a0 con 0x7f1fd415e770 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 0x7f1fd4154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd2800640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c7a0 tx=0x7f1fcc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc003b70 con 0x7f1fd415e770 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc003d30 con 0x7f1fd415e770 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.966+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd4155f90 con 0x7f1fd415e770 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.967+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00aa90 con 0x7f1fd415e770 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.967+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd4156550 con 0x7f1fd415e770 2024-09-10T08:42:25.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.968+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fd40d2250 con 0x7f1fd415e770 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.969+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fcc00ac30 con 0x7f1fd415e770 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.969+0000 7f1fca000640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 0x7f1fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.970+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4857+0+0 (secure 0 0 0) 0x7f1fcc08ab40 con 0x7f1fd415e770 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.970+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 0x7f1fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.971+0000 7f1fd1e00640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 0x7f1fb006e2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4034000 tx=0x7f1fc402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:25.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:25.974+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fcc0597a0 con 0x7f1fd415e770 2024-09-10T08:42:26.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.159+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1fd40b5410 con 0x7f1fd415e770 2024-09-10T08:42:26.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.160+0000 7f1fca000640 1 -- 172.21.15.52:0/1774147076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v191) ==== 84+0+65 (secure 0 0 0) 0x7f1fcc0590a0 con 0x7f1fd415e770 2024-09-10T08:42:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:26.160 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-10T08:42:26.160 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-10T08:42:26.161 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-10T08:42:26.161 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-10T08:42:26.161 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:26.161 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 msgr2=0x7f1fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 0x7f1fb006e2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4034000 tx=0x7f1fc402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 msgr2=0x7f1fd40ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c7a0 tx=0x7f1fcc00cc60 comp rx=0 tx=0).stop 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 shutdown_connections 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1fb006be30 0x7f1fb006e2f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fd415e770 0x7f1fd40ce2d0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1fd40cf960 0x7f1fd40cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 --2- 172.21.15.52:0/1774147076 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1fd40b6100 0x7f1fd4154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 >> 172.21.15.52:0/1774147076 conn(0x7f1fd406c030 msgr2=0x7f1fd406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:26.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 shutdown_connections 2024-09-10T08:42:26.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.162+0000 7f1fd3200640 1 -- 172.21.15.52:0/1774147076 wait complete. 2024-09-10T08:42:26.179 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:42:26.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:42:26.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.340+0000 7f9edc000640 1 Processor -- start 2024-09-10T08:42:26.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.340+0000 7f9edc000640 1 -- start start 2024-09-10T08:42:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.341+0000 7f9edc000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ed4155b20 0x7f9ed40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.341+0000 7f9edc000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9ed40b21a0 0x7f9ed40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.341+0000 7f9edc000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed40b0680 con 0x7f9ed40cf960 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.341+0000 7f9edc000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed40b01e0 con 0x7f9ed4155b20 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.341+0000 7f9edc000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed40ccf70 con 0x7f9ed40b21a0 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9eda000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ed40cf960 0x7f9ed415ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40320/0 (socket says 172.21.15.52:40320) 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed9600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ed4155b20 0x7f9ed40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9eda000640 1 -- 172.21.15.52:0/4204434887 learned_addr learned my addr 172.21.15.52:0/4204434887 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed8c00640 1 --2- 172.21.15.52:0/4204434887 >> v2:172.21.15.176:3300/0 conn(0x7f9ed40b21a0 0x7f9ed40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed3e00640 1 -- 172.21.15.52:0/4204434887 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584088368 0 0) 0x7f9ed40b0680 con 0x7f9ed40cf960 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed9600640 1 -- 172.21.15.52:0/4204434887 >> v2:172.21.15.176:3300/0 conn(0x7f9ed40b21a0 msgr2=0x7f9ed40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed9600640 1 --2- 172.21.15.52:0/4204434887 >> v2:172.21.15.176:3300/0 conn(0x7f9ed40b21a0 0x7f9ed40cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed9600640 1 -- 172.21.15.52:0/4204434887 >> v1:172.21.15.52:6789/0 conn(0x7f9ed40cf960 legacy=0x7f9ed415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.342+0000 7f9ed9600640 1 -- 172.21.15.52:0/4204434887 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40ce940 con 0x7f9ed4155b20 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.343+0000 7f9ed9600640 1 --2- 172.21.15.52:0/4204434887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed4155b20 0x7f9ed40b1c60 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406f060 tx=0x7f9ec802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cb9d109c3c9c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.343+0000 7f9ed3e00640 1 -- 172.21.15.52:0/4204434887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037070 con 0x7f9ed4155b20 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.343+0000 7f9ed3e00640 1 -- 172.21.15.52:0/4204434887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8032440 con 0x7f9ed4155b20 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.343+0000 7f9ed3e00640 1 -- 172.21.15.52:0/4204434887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8032810 con 0x7f9ed4155b20 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 -- 172.21.15.52:0/4204434887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed4155b20 msgr2=0x7f9ed40b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 --2- 172.21.15.52:0/4204434887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed4155b20 0x7f9ed40b1c60 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406f060 tx=0x7f9ec802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 -- 172.21.15.52:0/4204434887 shutdown_connections 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 --2- 172.21.15.52:0/4204434887 >> v2:172.21.15.176:3300/0 conn(0x7f9ed40b21a0 0x7f9ed40cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 --2- 172.21.15.52:0/4204434887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed4155b20 0x7f9ed40b1c60 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 -- 172.21.15.52:0/4204434887 >> 172.21.15.52:0/4204434887 conn(0x7f9ed406c240 msgr2=0x7f9ed406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 -- 172.21.15.52:0/4204434887 shutdown_connections 2024-09-10T08:42:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.344+0000 7f9edc000640 1 -- 172.21.15.52:0/4204434887 wait complete. 2024-09-10T08:42:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.346+0000 7f9edc000640 1 Processor -- start 2024-09-10T08:42:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.346+0000 7f9edc000640 1 -- start start 2024-09-10T08:42:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cf960 0x7f9ed40af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4155b20 0x7f9ed40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40ce610 con 0x7f9ed40b21a0 2024-09-10T08:42:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40cef00 con 0x7f9ed40cf960 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9edc000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed40cfd80 con 0x7f9ed4155b20 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed9600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54228/0 (socket says 172.21.15.52:54228) 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed9600640 1 -- 172.21.15.52:0/3043525130 learned_addr learned my addr 172.21.15.52:0/3043525130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed8c00640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cf960 0x7f9ed40af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9eda000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4155b20 0x7f9ed40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed9600640 1 -- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4155b20 msgr2=0x7f9ed40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.347+0000 7f9ed9600640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4155b20 0x7f9ed40af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed9600640 1 -- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cf960 msgr2=0x7f9ed40af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed9600640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cf960 0x7f9ed40af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed9600640 1 -- 172.21.15.52:0/3043525130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed41f7c70 con 0x7f9ed40b21a0 2024-09-10T08:42:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed9600640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8000c00 tx=0x7f9ec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037040 con 0x7f9ed40b21a0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8042070 con 0x7f9ed40b21a0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed41f7f50 con 0x7f9ed40b21a0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8030960 con 0x7f9ed40b21a0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.348+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41f8510 con 0x7f9ed40b21a0 2024-09-10T08:42:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.349+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed415a870 con 0x7f9ed40b21a0 2024-09-10T08:42:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.352+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ec8030b00 con 0x7f9ed40b21a0 2024-09-10T08:42:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.353+0000 7f9ed1600640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.353+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4857+0+0 (secure 0 0 0) 0x7f9ec80ab4d0 con 0x7f9ed40b21a0 2024-09-10T08:42:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.353+0000 7f9ed8c00640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.354+0000 7f9ed8c00640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 0x7f9eb406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4152d70 tx=0x7f9ec0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:26.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.360+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ed415a870 con 0x7f9ed40b21a0 2024-09-10T08:42:26.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:26.545+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9ed40ccb20 con 0x7f9ed40b21a0 2024-09-10T08:42:27.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.338+0000 7f9ed1600640 1 -- 172.21.15.52:0/3043525130 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v192) ==== 138+0+0 (secure 0 0 0) 0x7f9ec8045360 con 0x7f9ed40b21a0 2024-09-10T08:42:27.339 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-10T08:42:27.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 msgr2=0x7f9eb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 0x7f9eb406e2f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4152d70 tx=0x7f9ec0008040 comp rx=0 tx=0).stop 2024-09-10T08:42:27.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 msgr2=0x7f9ed41f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8000c00 tx=0x7f9ec80046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 shutdown_connections 2024-09-10T08:42:27.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f9eb406be30 0x7f9eb406e2f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9ed4155b20 0x7f9ed40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ed40cf960 0x7f9ed40af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 --2- 172.21.15.52:0/3043525130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ed40b21a0 0x7f9ed41f50d0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.342+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 >> 172.21.15.52:0/3043525130 conn(0x7f9ed406c240 msgr2=0x7f9ed40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:27.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.343+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 shutdown_connections 2024-09-10T08:42:27.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.343+0000 7f9edc000640 1 -- 172.21.15.52:0/3043525130 wait complete. 2024-09-10T08:42:27.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:42:27.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.533+0000 7f2a96800640 1 Processor -- start 2024-09-10T08:42:27.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.533+0000 7f2a96800640 1 -- start start 2024-09-10T08:42:27.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.534+0000 7f2a96800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 0x7f2a900d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.534+0000 7f2a96800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.534+0000 7f2a96800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a900d3950 con 0x7f2a90067950 2024-09-10T08:42:27.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.534+0000 7f2a96800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2a900d3c30 con 0x7f2a900b5fd0 2024-09-10T08:42:27.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.534+0000 7f2a96800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a900d3f10 con 0x7f2a900b63b0 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a94a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a95e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f2a90067950 0x7f2a90067e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52738/0 (socket says 172.21.15.52:52738) 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a95e00640 1 -- 172.21.15.52:0/706237642 learned_addr learned my addr 172.21.15.52:0/706237642 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a95400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 0x7f2a900d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a8fe00640 1 -- 172.21.15.52:0/706237642 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343452234 0 0) 0x7f2a900d3950 con 0x7f2a90067950 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a8fe00640 1 -- 172.21.15.52:0/706237642 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a78003520 con 0x7f2a90067950 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a94a00640 1 -- 172.21.15.52:0/706237642 >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 msgr2=0x7f2a900d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a94a00640 1 --2- 172.21.15.52:0/706237642 >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 0x7f2a900d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a94a00640 1 -- 172.21.15.52:0/706237642 >> v1:172.21.15.176:6789/0 conn(0x7f2a90067950 legacy=0x7f2a90067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a94a00640 1 -- 172.21.15.52:0/706237642 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a900d41f0 con 0x7f2a900b63b0 2024-09-10T08:42:27.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.535+0000 7f2a95400640 1 --2- 172.21.15.52:0/706237642 >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 0x7f2a900d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.536+0000 7f2a94a00640 1 --2- 172.21.15.52:0/706237642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900cf650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0097a0 tx=0x7f2a7c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b631e31031b2117 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a8fe00640 1 -- 172.21.15.52:0/706237642 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c037070 con 0x7f2a900b63b0 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a8fe00640 1 -- 172.21.15.52:0/706237642 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c032440 con 0x7f2a900b63b0 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a8fe00640 1 -- 172.21.15.52:0/706237642 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0327f0 con 0x7f2a900b63b0 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 -- 172.21.15.52:0/706237642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 msgr2=0x7f2a900cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 --2- 172.21.15.52:0/706237642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900cf650 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0097a0 tx=0x7f2a7c02a210 comp rx=0 tx=0).stop 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 -- 172.21.15.52:0/706237642 shutdown_connections 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 --2- 172.21.15.52:0/706237642 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900cf650 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 --2- 172.21.15.52:0/706237642 >> v2:172.21.15.176:3300/0 conn(0x7f2a900b5fd0 0x7f2a900d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 -- 172.21.15.52:0/706237642 >> 172.21.15.52:0/706237642 conn(0x7f2a900d0fd0 msgr2=0x7f2a900d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:27.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 -- 172.21.15.52:0/706237642 shutdown_connections 2024-09-10T08:42:27.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.537+0000 7f2a96800640 1 -- 172.21.15.52:0/706237642 wait complete. 2024-09-10T08:42:27.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.539+0000 7f2a96800640 1 Processor -- start 2024-09-10T08:42:27.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.539+0000 7f2a96800640 1 -- start start 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a90067950 0x7f2a901538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900cfd10 con 0x7f2a900b5fd0 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900cfb90 con 0x7f2a90067950 2024-09-10T08:42:27.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a96800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2a900b67d0 con 0x7f2a900b63b0 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a94a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a94a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54238/0 (socket says 172.21.15.52:54238) 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a94a00640 1 -- 172.21.15.52:0/3260867784 learned_addr learned my addr 172.21.15.52:0/3260867784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a95e00640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.540+0000 7f2a95400640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a90067950 0x7f2a901538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 -- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 msgr2=0x7f2a900ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 -- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a90067950 msgr2=0x7f2a901538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a90067950 0x7f2a901538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 -- 172.21.15.52:0/3260867784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9015faf0 con 0x7f2a900b5fd0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a94a00640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c02a250 tx=0x7f2a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c037040 con 0x7f2a900b5fd0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c042070 con 0x7f2a900b5fd0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c03b930 con 0x7f2a900b5fd0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.541+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a900cc970 con 0x7f2a900b5fd0 2024-09-10T08:42:27.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.542+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a900ccf30 con 0x7f2a900b5fd0 2024-09-10T08:42:27.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.543+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9015e7f0 con 0x7f2a900b5fd0 2024-09-10T08:42:27.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.544+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a7c03bad0 con 0x7f2a900b5fd0 2024-09-10T08:42:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.545+0000 7f2a8d600640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 0x7f2a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.545+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5227+0+0 (secure 0 0 0) 0x7f2a7c0ab480 con 0x7f2a900b5fd0 2024-09-10T08:42:27.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.546+0000 7f2a95400640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 0x7f2a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:27.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.547+0000 7f2a95400640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 0x7f2a7006e2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009560 tx=0x7f2a84009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:27.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.550+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a7c079920 con 0x7f2a900b5fd0 2024-09-10T08:42:27.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:27.735+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2a900b8c30 con 0x7f2a900b5fd0 2024-09-10T08:42:28.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.344+0000 7f2a8d600640 1 -- 172.21.15.52:0/3260867784 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v193) ==== 170+0+0 (secure 0 0 0) 0x7f2a7c07dc20 con 0x7f2a900b5fd0 2024-09-10T08:42:28.345 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-10T08:42:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.348+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 msgr2=0x7f2a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 0x7f2a7006e2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009560 tx=0x7f2a84009190 comp rx=0 tx=0).stop 2024-09-10T08:42:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 msgr2=0x7f2a9015f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:28.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c02a250 tx=0x7f2a7c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 shutdown_connections 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2a7006be30 0x7f2a7006e2f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a900b63b0 0x7f2a900ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a900b5fd0 0x7f2a9015f1f0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 --2- 172.21.15.52:0/3260867784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a90067950 0x7f2a901538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.349+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 >> 172.21.15.52:0/3260867784 conn(0x7f2a900d0fd0 msgr2=0x7f2a90067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:28.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.350+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 shutdown_connections 2024-09-10T08:42:28.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.350+0000 7f2a96800640 1 -- 172.21.15.52:0/3260867784 wait complete. 2024-09-10T08:42:28.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:42:28.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.542+0000 7fcd3d800640 1 Processor -- start 2024-09-10T08:42:28.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.542+0000 7fcd3d800640 1 -- start start 2024-09-10T08:42:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b5fd0 0x7fcd380d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd380b63b0 0x7fcd380cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcd38067950 0x7fcd38067e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcd380d3950 con 0x7fcd380b63b0 2024-09-10T08:42:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcd380d3c30 con 0x7fcd38067950 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.543+0000 7fcd3d800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380d3f10 con 0x7fcd380b5fd0 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd380b63b0 0x7fcd380cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcd380b63b0 0x7fcd380cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54254/0 (socket says 172.21.15.52:54254) 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 -- 172.21.15.52:0/1529813525 learned_addr learned my addr 172.21.15.52:0/1529813525 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd3ce00640 1 --2- 172.21.15.52:0/1529813525 >> v2:172.21.15.176:3300/0 conn(0x7fcd38067950 0x7fcd38067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd37e00640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b5fd0 0x7fcd380d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 -- 172.21.15.52:0/1529813525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b5fd0 msgr2=0x7fcd380d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b5fd0 0x7fcd380d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 -- 172.21.15.52:0/1529813525 >> v2:172.21.15.176:3300/0 conn(0x7fcd38067950 msgr2=0x7fcd38067e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1529813525 >> v2:172.21.15.176:3300/0 conn(0x7fcd38067950 0x7fcd38067e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.544+0000 7fcd2f400640 1 -- 172.21.15.52:0/1529813525 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd380d41f0 con 0x7fcd380b63b0 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.545+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd380b63b0 0x7fcd380cf650 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fcd3806d090 tx=0x7fcd2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd3061891205683 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.545+0000 7fcd37400640 1 -- 172.21.15.52:0/1529813525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20037070 con 0x7fcd380b63b0 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd37400640 1 -- 172.21.15.52:0/1529813525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd20032440 con 0x7fcd380b63b0 2024-09-10T08:42:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd37400640 1 -- 172.21.15.52:0/1529813525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20032810 con 0x7fcd380b63b0 2024-09-10T08:42:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 -- 172.21.15.52:0/1529813525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd380b63b0 msgr2=0x7fcd380cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd380b63b0 0x7fcd380cf650 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fcd3806d090 tx=0x7fcd2002a270 comp rx=0 tx=0).stop 2024-09-10T08:42:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 -- 172.21.15.52:0/1529813525 shutdown_connections 2024-09-10T08:42:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1529813525 >> v2:172.21.15.176:3300/0 conn(0x7fcd38067950 0x7fcd38067e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd380b63b0 0x7fcd380cf650 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1529813525 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b5fd0 0x7fcd380d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 -- 172.21.15.52:0/1529813525 >> 172.21.15.52:0/1529813525 conn(0x7fcd380d0fd0 msgr2=0x7fcd380d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 -- 172.21.15.52:0/1529813525 shutdown_connections 2024-09-10T08:42:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.546+0000 7fcd3d800640 1 -- 172.21.15.52:0/1529813525 wait complete. 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.548+0000 7fcd3d800640 1 Processor -- start 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.548+0000 7fcd3d800640 1 -- start start 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 0x7fcd38160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 0x7fcd38160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380cfd10 con 0x7fcd38067950 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380cfb90 con 0x7fcd380b5fd0 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3d800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380b67d0 con 0x7fcd380b63b0 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54260/0 (socket says 172.21.15.52:54260) 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 -- 172.21.15.52:0/1884352504 learned_addr learned my addr 172.21.15.52:0/1884352504 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd3ce00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 0x7fcd38160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 0x7fcd38160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 -- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 msgr2=0x7fcd38160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 0x7fcd38160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.549+0000 7fcd37e00640 1 -- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 msgr2=0x7fcd38160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd37e00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 0x7fcd38160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd37e00640 1 -- 172.21.15.52:0/1884352504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd380ce960 con 0x7fcd38067950 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd3ce00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 0x7fcd38160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 0x7fcd38160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd37e00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e9b0 tx=0x7fcd2800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28017070 con 0x7fcd38067950 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2800c9a0 con 0x7fcd38067950 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800cd90 con 0x7fcd38067950 2024-09-10T08:42:28.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd380c8e00 con 0x7fcd38067950 2024-09-10T08:42:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.550+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd380c93c0 con 0x7fcd38067950 2024-09-10T08:42:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.551+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd380c9a10 con 0x7fcd38067950 2024-09-10T08:42:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.552+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd2801a070 con 0x7fcd38067950 2024-09-10T08:42:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.553+0000 7fcd34c00640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.553+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5609+0+0 (secure 0 0 0) 0x7fcd2808aed0 con 0x7fcd38067950 2024-09-10T08:42:28.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.554+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:28.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.555+0000 7fcd2f400640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd20034000 tx=0x7fcd2002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:28.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.558+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd28059840 con 0x7fcd38067950 2024-09-10T08:42:28.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:28.778+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcd380b3bb0 con 0x7fcd38067950 2024-09-10T08:42:29.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.347+0000 7fcd34c00640 1 -- 172.21.15.52:0/1884352504 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v145) ==== 174+0+0 (secure 0 0 0) 0x7fcd28059140 con 0x7fcd38067950 2024-09-10T08:42:29.348 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 28 and data pool 29 2024-09-10T08:42:29.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.351+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 msgr2=0x7fcd1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.351+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 0x7fcd1406e2f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd20034000 tx=0x7fcd2002e000 comp rx=0 tx=0).stop 2024-09-10T08:42:29.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.351+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 msgr2=0x7fcd380ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.351+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e9b0 tx=0x7fcd2800ee70 comp rx=0 tx=0).stop 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 shutdown_connections 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcd1406be30 0x7fcd1406e2f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd380b63b0 0x7fcd38160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd380b5fd0 0x7fcd38160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 --2- 172.21.15.52:0/1884352504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd38067950 0x7fcd380ce420 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.352+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 >> 172.21.15.52:0/1884352504 conn(0x7fcd380d0fd0 msgr2=0x7fcd380b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.353+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 shutdown_connections 2024-09-10T08:42:29.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.354+0000 7fcd3d800640 1 -- 172.21.15.52:0/1884352504 wait complete. 2024-09-10T08:42:29.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:29.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.549+0000 7f3c33200640 1 Processor -- start 2024-09-10T08:42:29.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.549+0000 7f3c33200640 1 -- start start 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c33200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c340cf450 0x7f3c340d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c33200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c340d3990 con 0x7f3c3415e440 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c33200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c340d3c70 con 0x7f3c340b6710 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c33200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3c340d3f50 con 0x7f3c340cf450 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c31e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3c3415e440 0x7f3c340b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40332/0 (socket says 172.21.15.52:40332) 2024-09-10T08:42:29.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.550+0000 7f3c31e00640 1 -- 172.21.15.52:0/1961559951 learned_addr learned my addr 172.21.15.52:0/1961559951 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c32800640 1 --2- 172.21.15.52:0/1961559951 >> v2:172.21.15.176:3300/0 conn(0x7f3c340cf450 0x7f3c340d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760914215 0 0) 0x7f3c340d3990 con 0x7f3c3415e440 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c18003520 con 0x7f3c3415e440 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037475276 0 0) 0x7f3c340d3c70 con 0x7f3c340b6710 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c340d3990 con 0x7f3c340b6710 2024-09-10T08:42:29.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3632421002 0 0) 0x7f3c18003520 con 0x7f3c3415e440 2024-09-10T08:42:29.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c32800640 1 -- 172.21.15.52:0/1961559951 >> v1:172.21.15.176:6789/0 conn(0x7f3c340b6710 legacy=0x7f3c340b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c32800640 1 -- 172.21.15.52:0/1961559951 >> v1:172.21.15.52:6789/0 conn(0x7f3c3415e440 legacy=0x7f3c340b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.551+0000 7f3c32800640 1 -- 172.21.15.52:0/1961559951 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c340d4230 con 0x7f3c340cf450 2024-09-10T08:42:29.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.552+0000 7f3c32800640 1 --2- 172.21.15.52:0/1961559951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c340cf450 0x7f3c340d3240 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009d90 tx=0x7f3c2c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601334fe19acf637 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24001670 con 0x7f3c340cf450 2024-09-10T08:42:29.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c007540 con 0x7f3c340cf450 2024-09-10T08:42:29.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c30a00640 1 -- 172.21.15.52:0/1961559951 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007910 con 0x7f3c340cf450 2024-09-10T08:42:29.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 -- 172.21.15.52:0/1961559951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c340cf450 msgr2=0x7f3c340d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 --2- 172.21.15.52:0/1961559951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c340cf450 0x7f3c340d3240 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009d90 tx=0x7f3c2c02a710 comp rx=0 tx=0).stop 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 -- 172.21.15.52:0/1961559951 shutdown_connections 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 --2- 172.21.15.52:0/1961559951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c340cf450 0x7f3c340d3240 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 -- 172.21.15.52:0/1961559951 >> 172.21.15.52:0/1961559951 conn(0x7f3c34067f80 msgr2=0x7f3c340d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.553+0000 7f3c33200640 1 -- 172.21.15.52:0/1961559951 shutdown_connections 2024-09-10T08:42:29.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.554+0000 7f3c33200640 1 -- 172.21.15.52:0/1961559951 wait complete. 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.555+0000 7f3c33200640 1 Processor -- start 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.555+0000 7f3c33200640 1 -- start start 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c340b6710 0x7f3c340ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3415e440 0x7f3c341f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3c340b76c0 con 0x7f3c340cf450 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3c340b7540 con 0x7f3c3415e440 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c33200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3c340b8270 con 0x7f3c340b6710 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c31400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c31400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54266/0 (socket says 172.21.15.52:54266) 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.556+0000 7f3c31400640 1 -- 172.21.15.52:0/433263590 learned_addr learned my addr 172.21.15.52:0/433263590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31e00640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c340b6710 0x7f3c340ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c32800640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3415e440 0x7f3c341f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 -- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c340b6710 msgr2=0x7f3c340ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c340b6710 0x7f3c340ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 -- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3415e440 msgr2=0x7f3c341f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3415e440 0x7f3c341f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 -- 172.21.15.52:0/433263590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c34156f80 con 0x7f3c340cf450 2024-09-10T08:42:29.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c31400640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c500 tx=0x7f3c2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c200052d0 con 0x7f3c340cf450 2024-09-10T08:42:29.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c20005490 con 0x7f3c340cf450 2024-09-10T08:42:29.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20012870 con 0x7f3c340cf450 2024-09-10T08:42:29.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.557+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c340ae6b0 con 0x7f3c340cf450 2024-09-10T08:42:29.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.558+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c340aec70 con 0x7f3c340cf450 2024-09-10T08:42:29.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.559+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c340d3240 con 0x7f3c340cf450 2024-09-10T08:42:29.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.560+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c20012a10 con 0x7f3c340cf450 2024-09-10T08:42:29.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.560+0000 7f3c2a000640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.560+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f3c2008abe0 con 0x7f3c340cf450 2024-09-10T08:42:29.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.561+0000 7f3c31e00640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.561+0000 7f3c31e00640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 0x7f3c1406e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3c240011e0 tx=0x7f3c24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.565+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c34156f80 con 0x7f3c340cf450 2024-09-10T08:42:29.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.753+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c34069b20 con 0x7f3c340cf450 2024-09-10T08:42:29.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.754+0000 7f3c2a000640 1 -- 172.21.15.52:0/433263590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+16768 (secure 0 0 0) 0x7f3c20059500 con 0x7f3c340cf450 2024-09-10T08:42:29.755 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:29.755 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":194,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:28.780253+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:42:26.587832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-10T08:42:27.779046+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:29.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.756+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 msgr2=0x7f3c1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.756+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 0x7f3c1406e2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3c240011e0 tx=0x7f3c24009040 comp rx=0 tx=0).stop 2024-09-10T08:42:29.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 msgr2=0x7f3c34156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000c500 tx=0x7f3c2000c9c0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 shutdown_connections 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c3415e440 0x7f3c341f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c340cf450 0x7f3c34156a40 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 --2- 172.21.15.52:0/433263590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c340b6710 0x7f3c340ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 >> 172.21.15.52:0/433263590 conn(0x7f3c34067f80 msgr2=0x7f3c340b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:29.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 shutdown_connections 2024-09-10T08:42:29.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.757+0000 7f3c33200640 1 -- 172.21.15.52:0/433263590 wait complete. 2024-09-10T08:42:29.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.929+0000 7fb73a000640 1 Processor -- start 2024-09-10T08:42:29.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.929+0000 7fb73a000640 1 -- start start 2024-09-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb73a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb73a000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb73406c150 0x7fb73415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb73a000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb734071180 con 0x7fb73413eb20 2024-09-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb73a000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb734071ab0 con 0x7fb73406c150 2024-09-10T08:42:29.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb73a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb734071460 con 0x7fb7340b2d40 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb733e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb73406c150 0x7fb73415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb733e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb73406c150 0x7fb73415c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54274/0 (socket says 172.21.15.52:54274) 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.930+0000 7fb733e00640 1 -- 172.21.15.52:0/171834055 learned_addr learned my addr 172.21.15.52:0/171834055 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733400640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733e00640 1 -- 172.21.15.52:0/171834055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 msgr2=0x7fb73406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733e00640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733e00640 1 -- 172.21.15.52:0/171834055 >> v1:172.21.15.176:6789/0 conn(0x7fb73413eb20 legacy=0x7fb73415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733e00640 1 -- 172.21.15.52:0/171834055 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb734071740 con 0x7fb73406c150 2024-09-10T08:42:29.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.931+0000 7fb733400640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.932+0000 7fb733e00640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73406c150 0x7fb73415c400 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fb734071c30 tx=0x7fb72c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e1507817515ded server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.932+0000 7fb732000640 1 -- 172.21.15.52:0/171834055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c036070 con 0x7fb73406c150 2024-09-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.932+0000 7fb732000640 1 -- 172.21.15.52:0/171834055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c031600 con 0x7fb73406c150 2024-09-10T08:42:29.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.932+0000 7fb732000640 1 -- 172.21.15.52:0/171834055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0319d0 con 0x7fb73406c150 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 -- 172.21.15.52:0/171834055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73406c150 msgr2=0x7fb73415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73406c150 0x7fb73415c400 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fb734071c30 tx=0x7fb72c02a710 comp rx=0 tx=0).stop 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 -- 172.21.15.52:0/171834055 shutdown_connections 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73406c150 0x7fb73415c400 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 --2- 172.21.15.52:0/171834055 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 -- 172.21.15.52:0/171834055 >> 172.21.15.52:0/171834055 conn(0x7fb7340ccec0 msgr2=0x7fb7340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 -- 172.21.15.52:0/171834055 shutdown_connections 2024-09-10T08:42:29.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.933+0000 7fb73a000640 1 -- 172.21.15.52:0/171834055 wait complete. 2024-09-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.934+0000 7fb73a000640 1 Processor -- start 2024-09-10T08:42:29.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 -- start start 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 0x7fb734154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7340722d0 con 0x7fb73413eb20 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb734072150 con 0x7fb73406c150 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.935+0000 7fb73a000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb734072450 con 0x7fb7340b2d40 2024-09-10T08:42:29.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54282/0 (socket says 172.21.15.52:54282) 2024-09-10T08:42:29.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 -- 172.21.15.52:0/4110025039 learned_addr learned my addr 172.21.15.52:0/4110025039 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb732a00640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 -- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 msgr2=0x7fb73415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733400640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 0x7fb734154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 -- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 msgr2=0x7fb734154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 0x7fb734154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 -- 172.21.15.52:0/4110025039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73415b8e0 con 0x7fb73413eb20 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb732a00640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:29.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733400640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 0x7fb734154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.936+0000 7fb733e00640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009f40 tx=0x7fb72c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.937+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c036050 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.937+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c042070 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.937+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c009510 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.937+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73415bea0 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.937+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73415c460 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.938+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73406bc10 con 0x7fb73413eb20 2024-09-10T08:42:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.939+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb72c007bb0 con 0x7fb73413eb20 2024-09-10T08:42:29.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.940+0000 7fb72b400640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 0x7fb71406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:29.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.940+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fb72c0abcd0 con 0x7fb73413eb20 2024-09-10T08:42:29.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.940+0000 7fb733400640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 0x7fb71406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:29.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.941+0000 7fb733400640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 0x7fb71406e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb724006fd0 tx=0x7fb724008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:29.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:29.944+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb72c045360 con 0x7fb73413eb20 2024-09-10T08:42:30.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.136+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb73406c9c0 con 0x7fb73413eb20 2024-09-10T08:42:30.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.137+0000 7fb72b400640 1 -- 172.21.15.52:0/4110025039 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+16768 (secure 0 0 0) 0x7fb72c07a680 con 0x7fb73413eb20 2024-09-10T08:42:30.138 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:30.138 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":194,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:28.780253+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:42:26.587832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-10T08:42:27.779046+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:30.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.139+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 msgr2=0x7fb71406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.139+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 0x7fb71406e2f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb724006fd0 tx=0x7fb724008040 comp rx=0 tx=0).stop 2024-09-10T08:42:30.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.139+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 msgr2=0x7fb7341595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.139+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009f40 tx=0x7fb72c004a40 comp rx=0 tx=0).stop 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 shutdown_connections 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb71406be30 0x7fb71406e2f0 secure :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb724006fd0 tx=0x7fb724008040 comp rx=0 tx=0).stop 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb73413eb20 0x7fb7341595f0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7340b2d40 0x7fb73415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 --2- 172.21.15.52:0/4110025039 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb73406c150 0x7fb734154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 >> 172.21.15.52:0/4110025039 conn(0x7fb7340ccec0 msgr2=0x7fb7340ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 shutdown_connections 2024-09-10T08:42:30.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.140+0000 7fb73a000640 1 -- 172.21.15.52:0/4110025039 wait complete. 2024-09-10T08:42:30.156 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:42:30.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.315+0000 7f2d53200640 1 Processor -- start 2024-09-10T08:42:30.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.316+0000 7f2d53200640 1 -- start start 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d53200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d53200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d540afa10 con 0x7f2d5415c310 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d53200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d54071220 con 0x7f2d540725c0 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d53200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d54071500 con 0x7f2d540d0880 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d51e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2d5415c310 0x7f2d540d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40342/0 (socket says 172.21.15.52:40342) 2024-09-10T08:42:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d51e00640 1 -- 172.21.15.52:0/3161996897 learned_addr learned my addr 172.21.15.52:0/3161996897 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:30.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d49400640 1 --2- 172.21.15.52:0/3161996897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:30.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.317+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668594246 0 0) 0x7f2d540afa10 con 0x7f2d5415c310 2024-09-10T08:42:30.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.318+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d38003520 con 0x7f2d5415c310 2024-09-10T08:42:30.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.318+0000 7f2d49400640 1 -- 172.21.15.52:0/3161996897 >> v1:172.21.15.176:6789/0 conn(0x7f2d540725c0 legacy=0x7f2d540cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.318+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708802680 0 0) 0x7f2d54071220 con 0x7f2d540725c0 2024-09-10T08:42:30.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.318+0000 7f2d49400640 1 -- 172.21.15.52:0/3161996897 >> v1:172.21.15.52:6789/0 conn(0x7f2d5415c310 legacy=0x7f2d540d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.318+0000 7f2d49400640 1 -- 172.21.15.52:0/3161996897 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d540717e0 con 0x7f2d540d0880 2024-09-10T08:42:30.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.319+0000 7f2d49400640 1 --2- 172.21.15.52:0/3161996897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54071d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0097d0 tx=0x7f2d3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c048130e76bd6be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:30.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.319+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c037070 con 0x7f2d540d0880 2024-09-10T08:42:30.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.319+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c02ac10 con 0x7f2d540d0880 2024-09-10T08:42:30.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.319+0000 7f2d51400640 1 -- 172.21.15.52:0/3161996897 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44001670 con 0x7f2d540d0880 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 -- 172.21.15.52:0/3161996897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 msgr2=0x7f2d54071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 --2- 172.21.15.52:0/3161996897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54071d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0097d0 tx=0x7f2d3c02a180 comp rx=0 tx=0).stop 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 -- 172.21.15.52:0/3161996897 shutdown_connections 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 --2- 172.21.15.52:0/3161996897 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54071d00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 -- 172.21.15.52:0/3161996897 >> 172.21.15.52:0/3161996897 conn(0x7f2d5406bc10 msgr2=0x7f2d5406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 -- 172.21.15.52:0/3161996897 shutdown_connections 2024-09-10T08:42:30.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.320+0000 7f2d53200640 1 -- 172.21.15.52:0/3161996897 wait complete. 2024-09-10T08:42:30.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.322+0000 7f2d53200640 1 Processor -- start 2024-09-10T08:42:30.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.322+0000 7f2d53200640 1 -- start start 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5415c310 0x7f2d54151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d54073e30 con 0x7f2d540725c0 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540af6c0 con 0x7f2d5415c310 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d53200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2d54073fb0 con 0x7f2d540d0880 2024-09-10T08:42:30.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54298/0 (socket says 172.21.15.52:54298) 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 -- 172.21.15.52:0/3920707611 learned_addr learned my addr 172.21.15.52:0/3920707611 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d52800640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5415c310 0x7f2d54151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d49400640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 -- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 msgr2=0x7f2d54152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 -- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5415c310 msgr2=0x7f2d54151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5415c310 0x7f2d54151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.323+0000 7f2d51e00640 1 -- 172.21.15.52:0/3920707611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5415f930 con 0x7f2d540725c0 2024-09-10T08:42:30.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d51e00640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c780 tx=0x7f2d4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:30.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44018070 con 0x7f2d540725c0 2024-09-10T08:42:30.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d440074e0 con 0x7f2d540725c0 2024-09-10T08:42:30.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d54151090 con 0x7f2d540725c0 2024-09-10T08:42:30.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44004a00 con 0x7f2d540725c0 2024-09-10T08:42:30.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.324+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d54151650 con 0x7f2d540725c0 2024-09-10T08:42:30.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.325+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5415c6f0 con 0x7f2d540725c0 2024-09-10T08:42:30.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.326+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d4401b070 con 0x7f2d540725c0 2024-09-10T08:42:30.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.327+0000 7f2d4aa00640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 0x7f2d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:30.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.327+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f2d4408a3d0 con 0x7f2d540725c0 2024-09-10T08:42:30.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.328+0000 7f2d49400640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 0x7f2d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:30.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.328+0000 7f2d49400640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 0x7f2d3006e2f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c034000 tx=0x7f2d3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:30.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.331+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d44058d70 con 0x7f2d540725c0 2024-09-10T08:42:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:30.563+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2d5406eff0 con 0x7f2d540725c0 2024-09-10T08:42:31.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.374+0000 7f2d4aa00640 1 -- 172.21.15.52:0/3920707611 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v148) ==== 118+0+0 (secure 0 0 0) 0x7f2d44058670 con 0x7f2d540725c0 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 msgr2=0x7f2d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 0x7f2d3006e2f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c034000 tx=0x7f2d3c02e000 comp rx=0 tx=0).stop 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 msgr2=0x7f2d5415f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c780 tx=0x7f2d4400cc40 comp rx=0 tx=0).stop 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 shutdown_connections 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d3006be30 0x7f2d3006e2f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d5415c310 0x7f2d54151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d540d0880 0x7f2d54152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 --2- 172.21.15.52:0/3920707611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d540725c0 0x7f2d5415f2e0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 >> 172.21.15.52:0/3920707611 conn(0x7f2d5406bc10 msgr2=0x7f2d540cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:31.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 shutdown_connections 2024-09-10T08:42:31.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.377+0000 7f2d53200640 1 -- 172.21.15.52:0/3920707611 wait complete. 2024-09-10T08:42:31.395 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:42:31.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:42:31.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.558+0000 7f49de000640 1 Processor -- start 2024-09-10T08:42:31.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.558+0000 7f49de000640 1 -- start start 2024-09-10T08:42:31.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49de000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f49d80cd2a0 0x7f49d815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:31.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49de000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d80714b0 con 0x7f49d80732e0 2024-09-10T08:42:31.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49de000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d80cd880 con 0x7f49d80cce30 2024-09-10T08:42:31.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49de000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f49d80cdb60 con 0x7f49d80cd2a0 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49d7400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f49d80732e0 0x7f49d80736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40358/0 (socket says 172.21.15.52:40358) 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49d7400640 1 -- 172.21.15.52:0/2800735344 learned_addr learned my addr 172.21.15.52:0/2800735344 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49d7e00640 1 --2- 172.21.15.52:0/2800735344 >> v2:172.21.15.176:3300/0 conn(0x7f49d80cd2a0 0x7f49d815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11383485 0 0) 0x7f49d80714b0 con 0x7f49d80732e0 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.560+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49bc003520 con 0x7f49d80732e0 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264953612 0 0) 0x7f49d80cd880 con 0x7f49d80cce30 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49d80714b0 con 0x7f49d80cce30 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d7e00640 1 -- 172.21.15.52:0/2800735344 >> v1:172.21.15.176:6789/0 conn(0x7f49d80cce30 legacy=0x7f49d8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d7e00640 1 -- 172.21.15.52:0/2800735344 >> v1:172.21.15.52:6789/0 conn(0x7f49d80732e0 legacy=0x7f49d80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2090034242 0 0) 0x7f49bc003520 con 0x7f49d80732e0 2024-09-10T08:42:31.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.561+0000 7f49d7e00640 1 -- 172.21.15.52:0/2800735344 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d80cde40 con 0x7f49d80cd2a0 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49d7e00640 1 --2- 172.21.15.52:0/2800735344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815c8d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98136b8d65a8e6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8001670 con 0x7f49d80cd2a0 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d0007540 con 0x7f49d80cd2a0 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49d6a00640 1 -- 172.21.15.52:0/2800735344 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0007910 con 0x7f49d80cd2a0 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49de000640 1 -- 172.21.15.52:0/2800735344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 msgr2=0x7f49d815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.562+0000 7f49de000640 1 --2- 172.21.15.52:0/2800735344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815c8d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.563+0000 7f49de000640 1 -- 172.21.15.52:0/2800735344 shutdown_connections 2024-09-10T08:42:31.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.563+0000 7f49de000640 1 --2- 172.21.15.52:0/2800735344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815c8d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.563+0000 7f49de000640 1 -- 172.21.15.52:0/2800735344 >> 172.21.15.52:0/2800735344 conn(0x7f49d806d0f0 msgr2=0x7f49d806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:31.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.563+0000 7f49de000640 1 -- 172.21.15.52:0/2800735344 shutdown_connections 2024-09-10T08:42:31.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.563+0000 7f49de000640 1 -- 172.21.15.52:0/2800735344 wait complete. 2024-09-10T08:42:31.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.564+0000 7f49de000640 1 Processor -- start 2024-09-10T08:42:31.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.564+0000 7f49de000640 1 -- start start 2024-09-10T08:42:31.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49d80732e0 0x7f49d8159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:31.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:31.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:31.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8072500 con 0x7f49d80cce30 2024-09-10T08:42:31.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8072380 con 0x7f49d80cd2a0 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.565+0000 7f49de000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f49d815ce10 con 0x7f49d80732e0 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54300/0 (socket says 172.21.15.52:54300) 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 -- 172.21.15.52:0/1400282584 learned_addr learned my addr 172.21.15.52:0/1400282584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49d7400640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49d80732e0 0x7f49d8159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49d7e00640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 -- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49d80732e0 msgr2=0x7f49d8159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49d80732e0 0x7f49d8159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 -- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 msgr2=0x7f49d815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.566+0000 7f49cea00640 1 -- 172.21.15.52:0/1400282584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d81e8c60 con 0x7f49d80cce30 2024-09-10T08:42:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49cea00640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c500 tx=0x7f49c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c00052d0 con 0x7f49d80cce30 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c0005490 con 0x7f49d80cce30 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81e8f40 con 0x7f49d80cce30 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0012870 con 0x7f49d80cce30 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.567+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81e9500 con 0x7f49d80cce30 2024-09-10T08:42:31.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.568+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d815d200 con 0x7f49d80cce30 2024-09-10T08:42:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.569+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49c0012a10 con 0x7f49d80cce30 2024-09-10T08:42:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.570+0000 7f49cfe00640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 0x7f49b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.570+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f49c008aa60 con 0x7f49d80cce30 2024-09-10T08:42:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.570+0000 7f49d7400640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 0x7f49b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.571+0000 7f49d7400640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 0x7f49b406e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f49c8001eb0 tx=0x7f49c80016d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.574+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49c0058d30 con 0x7f49d80cce30 2024-09-10T08:42:31.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:31.796+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f49d80711f0 con 0x7f49d80cce30 2024-09-10T08:42:32.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.379+0000 7f49cfe00640 1 -- 172.21.15.52:0/1400282584 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v149) ==== 122+0+0 (secure 0 0 0) 0x7f49c005d030 con 0x7f49d80cce30 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 msgr2=0x7f49b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 0x7f49b406e2f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f49c8001eb0 tx=0x7f49c80016d0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 msgr2=0x7f49d815ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c500 tx=0x7f49c000c9c0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 shutdown_connections 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f49b406be30 0x7f49b406e2f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49d80cd2a0 0x7f49d815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49d80cce30 0x7f49d815ab70 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 --2- 172.21.15.52:0/1400282584 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49d80732e0 0x7f49d8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 >> 172.21.15.52:0/1400282584 conn(0x7f49d806d0f0 msgr2=0x7f49d80b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 shutdown_connections 2024-09-10T08:42:32.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.382+0000 7f49de000640 1 -- 172.21.15.52:0/1400282584 wait complete. 2024-09-10T08:42:32.399 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:42:32.399 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.557+0000 7f1056400640 1 Processor -- start 2024-09-10T08:42:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.557+0000 7f1056400640 1 -- start start 2024-09-10T08:42:32.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f1056400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10500d2c30 0x7f1050160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f1056400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f10500b1990 0x7f10500d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f1056400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1050071b60 con 0x7f105015c420 2024-09-10T08:42:32.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f1056400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f10500d04c0 con 0x7f10500d2c30 2024-09-10T08:42:32.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f1056400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f10500b1e20 con 0x7f10500b1990 2024-09-10T08:42:32.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f104f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f105015c420 0x7f10500d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40370/0 (socket says 172.21.15.52:40370) 2024-09-10T08:42:32.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f104f400640 1 -- 172.21.15.52:0/1666315920 learned_addr learned my addr 172.21.15.52:0/1666315920 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f104ea00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f10500d2c30 0x7f1050160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.558+0000 7f104fe00640 1 --2- 172.21.15.52:0/1666315920 >> v2:172.21.15.176:3300/0 conn(0x7f10500b1990 0x7f10500d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.559+0000 7f104ea00640 1 -- 172.21.15.52:0/1666315920 >> v2:172.21.15.176:3300/0 conn(0x7f10500b1990 msgr2=0x7f10500d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.559+0000 7f104e000640 1 -- 172.21.15.52:0/1666315920 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352362372 0 0) 0x7f1050071b60 con 0x7f105015c420 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.559+0000 7f104ea00640 1 --2- 172.21.15.52:0/1666315920 >> v2:172.21.15.176:3300/0 conn(0x7f10500b1990 0x7f10500d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.559+0000 7f104ea00640 1 -- 172.21.15.52:0/1666315920 >> v1:172.21.15.52:6789/0 conn(0x7f105015c420 legacy=0x7f10500d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.559+0000 7f104ea00640 1 -- 172.21.15.52:0/1666315920 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500715a0 con 0x7f10500d2c30 2024-09-10T08:42:32.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.560+0000 7f104ea00640 1 --2- 172.21.15.52:0/1666315920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10500d2c30 0x7f1050160a40 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f1050070330 tx=0x7f103c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87985dd2aa102cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.560+0000 7f104e000640 1 -- 172.21.15.52:0/1666315920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c037070 con 0x7f10500d2c30 2024-09-10T08:42:32.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.560+0000 7f104e000640 1 -- 172.21.15.52:0/1666315920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c02add0 con 0x7f10500d2c30 2024-09-10T08:42:32.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.560+0000 7f104e000640 1 -- 172.21.15.52:0/1666315920 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c032660 con 0x7f10500d2c30 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 -- 172.21.15.52:0/1666315920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10500d2c30 msgr2=0x7f1050160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 --2- 172.21.15.52:0/1666315920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10500d2c30 0x7f1050160a40 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f1050070330 tx=0x7f103c02a080 comp rx=0 tx=0).stop 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 -- 172.21.15.52:0/1666315920 shutdown_connections 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 --2- 172.21.15.52:0/1666315920 >> v2:172.21.15.176:3300/0 conn(0x7f10500b1990 0x7f10500d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 --2- 172.21.15.52:0/1666315920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10500d2c30 0x7f1050160a40 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 -- 172.21.15.52:0/1666315920 >> 172.21.15.52:0/1666315920 conn(0x7f1050067fb0 msgr2=0x7f105006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 -- 172.21.15.52:0/1666315920 shutdown_connections 2024-09-10T08:42:32.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.561+0000 7f1056400640 1 -- 172.21.15.52:0/1666315920 wait complete. 2024-09-10T08:42:32.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.562+0000 7f1056400640 1 Processor -- start 2024-09-10T08:42:32.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.563+0000 7f1056400640 1 -- start start 2024-09-10T08:42:32.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.563+0000 7f1056400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10500b1990 0x7f1050148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f1056400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10500d2c30 0x7f1050158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f1056400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f1056400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10500d0e90 con 0x7f105015c420 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f1056400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f105015c800 con 0x7f10500b1990 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f1056400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f10500d1010 con 0x7f10500d2c30 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54326/0 (socket says 172.21.15.52:54326) 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 -- 172.21.15.52:0/2264006094 learned_addr learned my addr 172.21.15.52:0/2264006094 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104f400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10500b1990 0x7f1050148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104ea00640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10500d2c30 0x7f1050158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 -- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10500d2c30 msgr2=0x7f1050158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10500d2c30 0x7f1050158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 -- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10500b1990 msgr2=0x7f1050148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10500b1990 0x7f1050148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.564+0000 7f104fe00640 1 -- 172.21.15.52:0/2264006094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10500b3320 con 0x7f105015c420 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f104fe00640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f104800efc0 tx=0x7f104800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048018020 con 0x7f105015c420 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048014480 con 0x7f105015c420 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048014870 con 0x7f105015c420 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10500b3600 con 0x7f105015c420 2024-09-10T08:42:32.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.565+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10500b3bc0 con 0x7f105015c420 2024-09-10T08:42:32.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.566+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10500b5d20 con 0x7f105015c420 2024-09-10T08:42:32.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.567+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1048005d10 con 0x7f105015c420 2024-09-10T08:42:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.568+0000 7f1047400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 0x7f103006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.569+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f104808bc40 con 0x7f105015c420 2024-09-10T08:42:32.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.569+0000 7f104f400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 0x7f103006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.570+0000 7f104f400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 0x7f103006e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1040007fd0 tx=0x7f1040007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.573+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10500b5d20 con 0x7f105015c420 2024-09-10T08:42:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.793+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10500008d0 con 0x7f105015c420 2024-09-10T08:42:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.793+0000 7f1047400640 1 -- 172.21.15.52:0/2264006094 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f1048022030 con 0x7f105015c420 2024-09-10T08:42:32.794 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:32.794 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:42:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:42:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 msgr2=0x7f103006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 0x7f103006e2f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1040007fd0 tx=0x7f1040007de0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 msgr2=0x7f1050158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f104800efc0 tx=0x7f104800c490 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 shutdown_connections 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f103006be30 0x7f103006e2f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f105015c420 0x7f1050158960 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10500d2c30 0x7f1050158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 --2- 172.21.15.52:0/2264006094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10500b1990 0x7f1050148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 >> 172.21.15.52:0/2264006094 conn(0x7f1050067fb0 msgr2=0x7f10500b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 shutdown_connections 2024-09-10T08:42:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.796+0000 7f1056400640 1 -- 172.21.15.52:0/2264006094 wait complete. 2024-09-10T08:42:32.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:42:32.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.968+0000 7fdf3b200640 1 Processor -- start 2024-09-10T08:42:32.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.968+0000 7fdf3b200640 1 -- start start 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.969+0000 7fdf3b200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf3c15e440 0x7fdf3c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.969+0000 7fdf3b200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdf3c0cf450 0x7fdf3c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.969+0000 7fdf3b200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf3c0d3990 con 0x7fdf3c0b6540 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.969+0000 7fdf3b200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c0b6990 con 0x7fdf3c0cf450 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.969+0000 7fdf3b200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdf3c0d3c70 con 0x7fdf3c15e440 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf3a800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdf3c0b6540 0x7fdf3c06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:40376/0 (socket says 172.21.15.52:40376) 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf3a800640 1 -- 172.21.15.52:0/1097645378 learned_addr learned my addr 172.21.15.52:0/1097645378 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:32.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39400640 1 --2- 172.21.15.52:0/1097645378 >> v2:172.21.15.52:3300/0 conn(0x7fdf3c0cf450 0x7fdf3c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39e00640 1 --2- 172.21.15.52:0/1097645378 >> v2:172.21.15.176:3300/0 conn(0x7fdf3c15e440 0x7fdf3c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39400640 1 -- 172.21.15.52:0/1097645378 >> v2:172.21.15.176:3300/0 conn(0x7fdf3c15e440 msgr2=0x7fdf3c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:32.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39400640 1 --2- 172.21.15.52:0/1097645378 >> v2:172.21.15.176:3300/0 conn(0x7fdf3c15e440 0x7fdf3c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39400640 1 -- 172.21.15.52:0/1097645378 >> v1:172.21.15.52:6789/0 conn(0x7fdf3c0b6540 legacy=0x7fdf3c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf39400640 1 -- 172.21.15.52:0/1097645378 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c0d3f50 con 0x7fdf3c0cf450 2024-09-10T08:42:32.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.970+0000 7fdf38a00640 1 -- 172.21.15.52:0/1097645378 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639356074 0 0) 0x7fdf3c0d3990 con 0x7fdf3c0b6540 2024-09-10T08:42:32.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.971+0000 7fdf39400640 1 --2- 172.21.15.52:0/1097645378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0cf450 0x7fdf3c0b6000 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c068870 tx=0x7fdf2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845348fcde6ea1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.971+0000 7fdf38a00640 1 -- 172.21.15.52:0/1097645378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28037070 con 0x7fdf3c0cf450 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.971+0000 7fdf38a00640 1 -- 172.21.15.52:0/1097645378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28032440 con 0x7fdf3c0cf450 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.971+0000 7fdf38a00640 1 -- 172.21.15.52:0/1097645378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28032810 con 0x7fdf3c0cf450 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 -- 172.21.15.52:0/1097645378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0cf450 msgr2=0x7fdf3c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 --2- 172.21.15.52:0/1097645378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0cf450 0x7fdf3c0b6000 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c068870 tx=0x7fdf2802a230 comp rx=0 tx=0).stop 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 -- 172.21.15.52:0/1097645378 shutdown_connections 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 --2- 172.21.15.52:0/1097645378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0cf450 0x7fdf3c0b6000 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 --2- 172.21.15.52:0/1097645378 >> v2:172.21.15.176:3300/0 conn(0x7fdf3c15e440 0x7fdf3c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 -- 172.21.15.52:0/1097645378 >> 172.21.15.52:0/1097645378 conn(0x7fdf3c067f80 msgr2=0x7fdf3c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:32.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 -- 172.21.15.52:0/1097645378 shutdown_connections 2024-09-10T08:42:32.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.972+0000 7fdf3b200640 1 -- 172.21.15.52:0/1097645378 wait complete. 2024-09-10T08:42:32.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.974+0000 7fdf3b200640 1 Processor -- start 2024-09-10T08:42:32.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.974+0000 7fdf3b200640 1 -- start start 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.974+0000 7fdf3b200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3b200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 0x7fdf3c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3b200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf3c15e440 0x7fdf3c14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3b200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c0b7540 con 0x7fdf3c0b6540 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3b200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c15e820 con 0x7fdf3c15e440 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3b200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c0b76c0 con 0x7fdf3c0cf450 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54338/0 (socket says 172.21.15.52:54338) 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 -- 172.21.15.52:0/3600706990 learned_addr learned my addr 172.21.15.52:0/3600706990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf3a800640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf3c15e440 0x7fdf3c14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39400640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 0x7fdf3c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 -- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 msgr2=0x7fdf3c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 0x7fdf3c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 -- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf3c15e440 msgr2=0x7fdf3c14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf3c15e440 0x7fdf3c14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 -- 172.21.15.52:0/3600706990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c14daf0 con 0x7fdf3c0b6540 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39400640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 0x7fdf3c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:32.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.975+0000 7fdf39e00640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9e0 tx=0x7fdf2c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.976+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c017070 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.976+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00c9d0 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.976+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00cdc0 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.976+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c14ddb0 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.976+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c14e370 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.977+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c0b6000 con 0x7fdf3c0b6540 2024-09-10T08:42:32.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.978+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdf2c01a070 con 0x7fdf3c0b6540 2024-09-10T08:42:32.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.979+0000 7fdf32000640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 0x7fdf1c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:32.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.979+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fdf2c08af80 con 0x7fdf3c0b6540 2024-09-10T08:42:32.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.979+0000 7fdf39400640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 0x7fdf1c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:32.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.980+0000 7fdf39400640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 0x7fdf1c06e320 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdf28034000 tx=0x7fdf2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:32.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:32.983+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf2c059800 con 0x7fdf3c0b6540 2024-09-10T08:42:33.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.171+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf3c0b4660 con 0x7fdf3c0b6540 2024-09-10T08:42:33.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.172+0000 7fdf32000640 1 -- 172.21.15.52:0/3600706990 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) ==== 74+0+16755 (secure 0 0 0) 0x7fdf2c059100 con 0x7fdf3c0b6540 2024-09-10T08:42:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:33.173 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":195,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:30.360232+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:42:26.587832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-10T08:42:27.779046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 msgr2=0x7fdf1c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 0x7fdf1c06e320 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdf28034000 tx=0x7fdf2802e000 comp rx=0 tx=0).stop 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 msgr2=0x7fdf3c0aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9e0 tx=0x7fdf2c00eea0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 shutdown_connections 2024-09-10T08:42:33.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fdf1c06be60 0x7fdf1c06e320 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf3c15e440 0x7fdf3c14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf3c0cf450 0x7fdf3c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 --2- 172.21.15.52:0/3600706990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf3c0b6540 0x7fdf3c0aafb0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 >> 172.21.15.52:0/3600706990 conn(0x7fdf3c067f80 msgr2=0x7fdf3c0b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:33.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.174+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 shutdown_connections 2024-09-10T08:42:33.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.175+0000 7fdf3b200640 1 -- 172.21.15.52:0/3600706990 wait complete. 2024-09-10T08:42:33.191 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:42:33.191 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:42:33.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.347+0000 7f8fb1600640 1 Processor -- start 2024-09-10T08:42:33.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.347+0000 7f8fb1600640 1 -- start start 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.348+0000 7f8fb1600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8fac14c480 0x7f8fac163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.348+0000 7f8fb1600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fac073750 0x7f8fac073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.348+0000 7f8fb1600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fac164120 con 0x7f8fac164650 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.348+0000 7f8fb1600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8fac0732c0 con 0x7f8fac073750 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.348+0000 7f8fb1600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8fac0712a0 con 0x7f8fac14c480 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fac073750 0x7f8fac073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8fac073750 0x7f8fac073bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54352/0 (socket says 172.21.15.52:54352) 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 -- 172.21.15.52:0/1900763870 learned_addr learned my addr 172.21.15.52:0/1900763870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:33.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faaa00640 1 --2- 172.21.15.52:0/1900763870 >> v2:172.21.15.176:3300/0 conn(0x7f8fac14c480 0x7f8fac163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 -- 172.21.15.52:0/1900763870 >> v2:172.21.15.176:3300/0 conn(0x7f8fac14c480 msgr2=0x7f8fac163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 --2- 172.21.15.52:0/1900763870 >> v2:172.21.15.176:3300/0 conn(0x7f8fac14c480 0x7f8fac163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 -- 172.21.15.52:0/1900763870 >> v1:172.21.15.176:6789/0 conn(0x7f8fac164650 legacy=0x7f8fac06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.349+0000 7f8faa000640 1 -- 172.21.15.52:0/1900763870 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac072c70 con 0x7f8fac073750 2024-09-10T08:42:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.350+0000 7f8faa000640 1 --2- 172.21.15.52:0/1900763870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac073bc0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f8fac069be0 tx=0x7f8f9802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42311cbe43e8d36a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.350+0000 7f8fa9600640 1 -- 172.21.15.52:0/1900763870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98037070 con 0x7f8fac073750 2024-09-10T08:42:33.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.350+0000 7f8fa9600640 1 -- 172.21.15.52:0/1900763870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98032440 con 0x7f8fac073750 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.350+0000 7f8fa9600640 1 -- 172.21.15.52:0/1900763870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98032810 con 0x7f8fac073750 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 -- 172.21.15.52:0/1900763870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 msgr2=0x7f8fac073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 --2- 172.21.15.52:0/1900763870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac073bc0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f8fac069be0 tx=0x7f8f9802a200 comp rx=0 tx=0).stop 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 -- 172.21.15.52:0/1900763870 shutdown_connections 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 --2- 172.21.15.52:0/1900763870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac073bc0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 --2- 172.21.15.52:0/1900763870 >> v2:172.21.15.176:3300/0 conn(0x7f8fac14c480 0x7f8fac163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 -- 172.21.15.52:0/1900763870 >> 172.21.15.52:0/1900763870 conn(0x7f8fac0ccec0 msgr2=0x7f8fac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:33.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 -- 172.21.15.52:0/1900763870 shutdown_connections 2024-09-10T08:42:33.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.351+0000 7f8fb1600640 1 -- 172.21.15.52:0/1900763870 wait complete. 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.353+0000 7f8fb1600640 1 Processor -- start 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.353+0000 7f8fb1600640 1 -- start start 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fac14c480 0x7f8fac0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fac164650 0x7f8fac0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac071580 con 0x7f8fac073750 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac070f70 con 0x7f8fac14c480 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fb1600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8fac0b6350 con 0x7f8fac164650 2024-09-10T08:42:33.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faaa00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54356/0 (socket says 172.21.15.52:54356) 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faaa00640 1 -- 172.21.15.52:0/303251079 learned_addr learned my addr 172.21.15.52:0/303251079 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faa000640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fac14c480 0x7f8fac0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8fab400640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fac164650 0x7f8fac0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faaa00640 1 -- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fac164650 msgr2=0x7f8fac0c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.354+0000 7f8faaa00640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fac164650 0x7f8fac0c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8faaa00640 1 -- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fac14c480 msgr2=0x7f8fac0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8faaa00640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fac14c480 0x7f8fac0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8faaa00640 1 -- 172.21.15.52:0/303251079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac160b50 con 0x7f8fac073750 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8faaa00640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00e9b0 tx=0x7f8f9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c017070 con 0x7f8fac073750 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00c9a0 con 0x7f8fac073750 2024-09-10T08:42:33.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fac1edf20 con 0x7f8fac073750 2024-09-10T08:42:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00cd90 con 0x7f8fac073750 2024-09-10T08:42:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.355+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fac1ee4e0 con 0x7f8fac073750 2024-09-10T08:42:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.356+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fac073bc0 con 0x7f8fac073750 2024-09-10T08:42:33.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.357+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f9c01a070 con 0x7f8fac073750 2024-09-10T08:42:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.359+0000 7f8fa2a00640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 0x7f8f8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.359+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f8f9c08ae80 con 0x7f8fac073750 2024-09-10T08:42:33.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.359+0000 7f8faa000640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 0x7f8f8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.360+0000 7f8faa000640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 0x7f8f8c06e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f98034000 tx=0x7f8f9802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.363+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f9c059140 con 0x7f8fac073750 2024-09-10T08:42:33.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.547+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fac0cdbf0 con 0x7f8f8c06be30 2024-09-10T08:42:33.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.554+0000 7f8fa2a00640 1 -- 172.21.15.52:0/303251079 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7f8fac0cdbf0 con 0x7f8f8c06be30 2024-09-10T08:42:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:33.558 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 msgr2=0x7f8f8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 0x7f8f8c06e2f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8f98034000 tx=0x7f8f9802e000 comp rx=0 tx=0).stop 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 msgr2=0x7f8fac1ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00e9b0 tx=0x7f8f9c00ee70 comp rx=0 tx=0).stop 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 shutdown_connections 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f8c06be30 0x7f8f8c06e2f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8fac164650 0x7f8fac0c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8fac14c480 0x7f8fac0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 --2- 172.21.15.52:0/303251079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fac073750 0x7f8fac1ed7f0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.557+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 >> 172.21.15.52:0/303251079 conn(0x7f8fac0ccec0 msgr2=0x7f8fac1621d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:33.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.558+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 shutdown_connections 2024-09-10T08:42:33.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.558+0000 7f8fb1600640 1 -- 172.21.15.52:0/303251079 wait complete. 2024-09-10T08:42:33.574 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":607,"stamp":"2024-09-10T08:42:31.661920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461232,"kb_used_data":20204,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513488,"statfs":{"total":773094113280,"available":772621811712,"internally_reserved":0,"allocated":20688896,"data_stored":9744410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.322102"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391220+0000","last_change":"2024-09-10T08:42:29.385887+0000","last_active":"2024-09-10T08:42:29.391220+0000","last_peered":"2024-09-10T08:42:29.391220+0000","last_clean":"2024-09-10T08:42:29.391220+0000","last_became_active":"2024-09-10T08:42:29.383384+0000","last_became_peered":"2024-09-10T08:42:29.383384+0000","last_unstale":"2024-09-10T08:42:29.391220+0000","last_undegraded":"2024-09-10T08:42:29.391220+0000","last_fullsized":"2024-09-10T08:42:29.391220+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:27.665416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390710+0000","last_change":"2024-09-10T08:42:29.388781+0000","last_active":"2024-09-10T08:42:29.390710+0000","last_peered":"2024-09-10T08:42:29.390710+0000","last_clean":"2024-09-10T08:42:29.390710+0000","last_became_active":"2024-09-10T08:42:29.388292+0000","last_became_peered":"2024-09-10T08:42:29.388292+0000","last_unstale":"2024-09-10T08:42:29.390710+0000","last_undegraded":"2024-09-10T08:42:29.390710+0000","last_fullsized":"2024-09-10T08:42:29.390710+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372275+0000","last_change":"2024-09-10T08:42:29.367007+0000","last_active":"2024-09-10T08:42:29.372275+0000","last_peered":"2024-09-10T08:42:29.372275+0000","last_clean":"2024-09-10T08:42:29.372275+0000","last_became_active":"2024-09-10T08:42:29.366713+0000","last_became_peered":"2024-09-10T08:42:29.366713+0000","last_unstale":"2024-09-10T08:42:29.372275+0000","last_undegraded":"2024-09-10T08:42:29.372275+0000","last_fullsized":"2024-09-10T08:42:29.372275+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:48.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368733+0000","last_change":"2024-09-10T08:42:29.366363+0000","last_active":"2024-09-10T08:42:29.368733+0000","last_peered":"2024-09-10T08:42:29.368733+0000","last_clean":"2024-09-10T08:42:29.368733+0000","last_became_active":"2024-09-10T08:42:29.366094+0000","last_became_peered":"2024-09-10T08:42:29.366094+0000","last_unstale":"2024-09-10T08:42:29.368733+0000","last_undegraded":"2024-09-10T08:42:29.368733+0000","last_fullsized":"2024-09-10T08:42:29.368733+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:04.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368259+0000","last_change":"2024-09-10T08:42:29.365511+0000","last_active":"2024-09-10T08:42:29.368259+0000","last_peered":"2024-09-10T08:42:29.368259+0000","last_clean":"2024-09-10T08:42:29.368259+0000","last_became_active":"2024-09-10T08:42:29.362055+0000","last_became_peered":"2024-09-10T08:42:29.362055+0000","last_unstale":"2024-09-10T08:42:29.368259+0000","last_undegraded":"2024-09-10T08:42:29.368259+0000","last_fullsized":"2024-09-10T08:42:29.368259+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368289+0000","last_change":"2024-09-10T08:42:29.362962+0000","last_active":"2024-09-10T08:42:29.368289+0000","last_peered":"2024-09-10T08:42:29.368289+0000","last_clean":"2024-09-10T08:42:29.368289+0000","last_became_active":"2024-09-10T08:42:29.362665+0000","last_became_peered":"2024-09-10T08:42:29.362665+0000","last_unstale":"2024-09-10T08:42:29.368289+0000","last_undegraded":"2024-09-10T08:42:29.368289+0000","last_fullsized":"2024-09-10T08:42:29.368289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:55.712843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375949+0000","last_change":"2024-09-10T08:42:29.373037+0000","last_active":"2024-09-10T08:42:29.375949+0000","last_peered":"2024-09-10T08:42:29.375949+0000","last_clean":"2024-09-10T08:42:29.375949+0000","last_became_active":"2024-09-10T08:42:29.372745+0000","last_became_peered":"2024-09-10T08:42:29.372745+0000","last_unstale":"2024-09-10T08:42:29.375949+0000","last_undegraded":"2024-09-10T08:42:29.375949+0000","last_fullsized":"2024-09-10T08:42:29.375949+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:54.772249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.376620+0000","last_change":"2024-09-10T08:42:29.375322+0000","last_active":"2024-09-10T08:42:29.376620+0000","last_peered":"2024-09-10T08:42:29.376620+0000","last_clean":"2024-09-10T08:42:29.376620+0000","last_became_active":"2024-09-10T08:42:29.375050+0000","last_became_peered":"2024-09-10T08:42:29.375050+0000","last_unstale":"2024-09-10T08:42:29.376620+0000","last_undegraded":"2024-09-10T08:42:29.376620+0000","last_fullsized":"2024-09-10T08:42:29.376620+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.379615+0000","last_change":"2024-09-10T08:42:29.372907+0000","last_active":"2024-09-10T08:42:29.379615+0000","last_peered":"2024-09-10T08:42:29.379615+0000","last_clean":"2024-09-10T08:42:29.379615+0000","last_became_active":"2024-09-10T08:42:29.371130+0000","last_became_peered":"2024-09-10T08:42:29.371130+0000","last_unstale":"2024-09-10T08:42:29.379615+0000","last_undegraded":"2024-09-10T08:42:29.379615+0000","last_fullsized":"2024-09-10T08:42:29.379615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370658+0000","last_change":"2024-09-10T08:42:29.366985+0000","last_active":"2024-09-10T08:42:29.370658+0000","last_peered":"2024-09-10T08:42:29.370658+0000","last_clean":"2024-09-10T08:42:29.370658+0000","last_became_active":"2024-09-10T08:42:29.366690+0000","last_became_peered":"2024-09-10T08:42:29.366690+0000","last_unstale":"2024-09-10T08:42:29.370658+0000","last_undegraded":"2024-09-10T08:42:29.370658+0000","last_fullsized":"2024-09-10T08:42:29.370658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382997+0000","last_change":"2024-09-10T08:42:29.380452+0000","last_active":"2024-09-10T08:42:29.382997+0000","last_peered":"2024-09-10T08:42:29.382997+0000","last_clean":"2024-09-10T08:42:29.382997+0000","last_became_active":"2024-09-10T08:42:29.379753+0000","last_became_peered":"2024-09-10T08:42:29.379753+0000","last_unstale":"2024-09-10T08:42:29.382997+0000","last_undegraded":"2024-09-10T08:42:29.382997+0000","last_fullsized":"2024-09-10T08:42:29.382997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381298+0000","last_change":"2024-09-10T08:42:29.377573+0000","last_active":"2024-09-10T08:42:29.381298+0000","last_peered":"2024-09-10T08:42:29.381298+0000","last_clean":"2024-09-10T08:42:29.381298+0000","last_became_active":"2024-09-10T08:42:29.377309+0000","last_became_peered":"2024-09-10T08:42:29.377309+0000","last_unstale":"2024-09-10T08:42:29.381298+0000","last_undegraded":"2024-09-10T08:42:29.381298+0000","last_fullsized":"2024-09-10T08:42:29.381298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392289+0000","last_change":"2024-09-10T08:42:29.384443+0000","last_active":"2024-09-10T08:42:29.392289+0000","last_peered":"2024-09-10T08:42:29.392289+0000","last_clean":"2024-09-10T08:42:29.392289+0000","last_became_active":"2024-09-10T08:42:29.384157+0000","last_became_peered":"2024-09-10T08:42:29.384157+0000","last_unstale":"2024-09-10T08:42:29.392289+0000","last_undegraded":"2024-09-10T08:42:29.392289+0000","last_fullsized":"2024-09-10T08:42:29.392289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:54.237300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378176+0000","last_change":"2024-09-10T08:42:29.368203+0000","last_active":"2024-09-10T08:42:29.378176+0000","last_peered":"2024-09-10T08:42:29.378176+0000","last_clean":"2024-09-10T08:42:29.378176+0000","last_became_active":"2024-09-10T08:42:29.367829+0000","last_became_peered":"2024-09-10T08:42:29.367829+0000","last_unstale":"2024-09-10T08:42:29.378176+0000","last_undegraded":"2024-09-10T08:42:29.378176+0000","last_fullsized":"2024-09-10T08:42:29.378176+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.493836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.366216+0000","last_change":"2024-09-10T08:42:29.361268+0000","last_active":"2024-09-10T08:42:29.366216+0000","last_peered":"2024-09-10T08:42:29.366216+0000","last_clean":"2024-09-10T08:42:29.366216+0000","last_became_active":"2024-09-10T08:42:29.360989+0000","last_became_peered":"2024-09-10T08:42:29.360989+0000","last_unstale":"2024-09-10T08:42:29.366216+0000","last_undegraded":"2024-09-10T08:42:29.366216+0000","last_fullsized":"2024-09-10T08:42:29.366216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:54.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.374189+0000","last_change":"2024-09-10T08:42:29.365642+0000","last_active":"2024-09-10T08:42:29.374189+0000","last_peered":"2024-09-10T08:42:29.374189+0000","last_clean":"2024-09-10T08:42:29.374189+0000","last_became_active":"2024-09-10T08:42:29.358997+0000","last_became_peered":"2024-09-10T08:42:29.358997+0000","last_unstale":"2024-09-10T08:42:29.374189+0000","last_undegraded":"2024-09-10T08:42:29.374189+0000","last_fullsized":"2024-09-10T08:42:29.374189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386658+0000","last_change":"2024-09-10T08:42:29.383360+0000","last_active":"2024-09-10T08:42:29.386658+0000","last_peered":"2024-09-10T08:42:29.386658+0000","last_clean":"2024-09-10T08:42:29.386658+0000","last_became_active":"2024-09-10T08:42:29.380706+0000","last_became_peered":"2024-09-10T08:42:29.380706+0000","last_unstale":"2024-09-10T08:42:29.386658+0000","last_undegraded":"2024-09-10T08:42:29.386658+0000","last_fullsized":"2024-09-10T08:42:29.386658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:45.709011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.363033+0000","last_change":"2024-09-10T08:42:28.363033+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.363033+0000","last_undegraded":"2024-09-10T08:42:28.363033+0000","last_fullsized":"2024-09-10T08:42:28.363033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375595+0000","last_change":"2024-09-10T08:42:29.370587+0000","last_active":"2024-09-10T08:42:29.375595+0000","last_peered":"2024-09-10T08:42:29.375595+0000","last_clean":"2024-09-10T08:42:29.375595+0000","last_became_active":"2024-09-10T08:42:29.368564+0000","last_became_peered":"2024-09-10T08:42:29.368564+0000","last_unstale":"2024-09-10T08:42:29.375595+0000","last_undegraded":"2024-09-10T08:42:29.375595+0000","last_fullsized":"2024-09-10T08:42:29.375595+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.401473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.361855+0000","last_change":"2024-09-10T08:42:28.361855+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.361855+0000","last_undegraded":"2024-09-10T08:42:28.361855+0000","last_fullsized":"2024-09-10T08:42:28.361855+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.359126+0000","last_change":"2024-09-10T08:42:28.359126+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.359126+0000","last_undegraded":"2024-09-10T08:42:28.359126+0000","last_fullsized":"2024-09-10T08:42:28.359126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388704+0000","last_change":"2024-09-10T08:42:29.388085+0000","last_active":"2024-09-10T08:42:29.388704+0000","last_peered":"2024-09-10T08:42:29.388704+0000","last_clean":"2024-09-10T08:42:29.388704+0000","last_became_active":"2024-09-10T08:42:29.387481+0000","last_became_peered":"2024-09-10T08:42:29.387481+0000","last_unstale":"2024-09-10T08:42:29.388704+0000","last_undegraded":"2024-09-10T08:42:29.388704+0000","last_fullsized":"2024-09-10T08:42:29.388704+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:18.086767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391499+0000","last_change":"2024-09-10T08:42:29.386980+0000","last_active":"2024-09-10T08:42:29.391499+0000","last_peered":"2024-09-10T08:42:29.391499+0000","last_clean":"2024-09-10T08:42:29.391499+0000","last_became_active":"2024-09-10T08:42:29.386230+0000","last_became_peered":"2024-09-10T08:42:29.386230+0000","last_unstale":"2024-09-10T08:42:29.391499+0000","last_undegraded":"2024-09-10T08:42:29.391499+0000","last_fullsized":"2024-09-10T08:42:29.391499+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:28.038178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368228+0000","last_change":"2024-09-10T08:42:29.365247+0000","last_active":"2024-09-10T08:42:29.368228+0000","last_peered":"2024-09-10T08:42:29.368228+0000","last_clean":"2024-09-10T08:42:29.368228+0000","last_became_active":"2024-09-10T08:42:29.365006+0000","last_became_peered":"2024-09-10T08:42:29.365006+0000","last_unstale":"2024-09-10T08:42:29.368228+0000","last_undegraded":"2024-09-10T08:42:29.368228+0000","last_fullsized":"2024-09-10T08:42:29.368228+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:21.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382728+0000","last_change":"2024-09-10T08:42:29.380286+0000","last_active":"2024-09-10T08:42:29.382728+0000","last_peered":"2024-09-10T08:42:29.382728+0000","last_clean":"2024-09-10T08:42:29.382728+0000","last_became_active":"2024-09-10T08:42:29.379995+0000","last_became_peered":"2024-09-10T08:42:29.379995+0000","last_unstale":"2024-09-10T08:42:29.382728+0000","last_undegraded":"2024-09-10T08:42:29.382728+0000","last_fullsized":"2024-09-10T08:42:29.382728+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377613+0000","last_change":"2024-09-10T08:42:29.375078+0000","last_active":"2024-09-10T08:42:29.377613+0000","last_peered":"2024-09-10T08:42:29.377613+0000","last_clean":"2024-09-10T08:42:29.377613+0000","last_became_active":"2024-09-10T08:42:29.373435+0000","last_became_peered":"2024-09-10T08:42:29.373435+0000","last_unstale":"2024-09-10T08:42:29.377613+0000","last_undegraded":"2024-09-10T08:42:29.377613+0000","last_fullsized":"2024-09-10T08:42:29.377613+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:30.490305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383430+0000","last_change":"2024-09-10T08:42:29.380722+0000","last_active":"2024-09-10T08:42:29.383430+0000","last_peered":"2024-09-10T08:42:29.383430+0000","last_clean":"2024-09-10T08:42:29.383430+0000","last_became_active":"2024-09-10T08:42:29.380128+0000","last_became_peered":"2024-09-10T08:42:29.380128+0000","last_unstale":"2024-09-10T08:42:29.383430+0000","last_undegraded":"2024-09-10T08:42:29.383430+0000","last_fullsized":"2024-09-10T08:42:29.383430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375864+0000","last_change":"2024-09-10T08:42:29.372114+0000","last_active":"2024-09-10T08:42:29.375864+0000","last_peered":"2024-09-10T08:42:29.375864+0000","last_clean":"2024-09-10T08:42:29.375864+0000","last_became_active":"2024-09-10T08:42:29.371781+0000","last_became_peered":"2024-09-10T08:42:29.371781+0000","last_unstale":"2024-09-10T08:42:29.375864+0000","last_undegraded":"2024-09-10T08:42:29.375864+0000","last_fullsized":"2024-09-10T08:42:29.375864+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381151+0000","last_change":"2024-09-10T08:42:29.375856+0000","last_active":"2024-09-10T08:42:29.381151+0000","last_peered":"2024-09-10T08:42:29.381151+0000","last_clean":"2024-09-10T08:42:29.381151+0000","last_became_active":"2024-09-10T08:42:29.375593+0000","last_became_peered":"2024-09-10T08:42:29.375593+0000","last_unstale":"2024-09-10T08:42:29.381151+0000","last_undegraded":"2024-09-10T08:42:29.381151+0000","last_fullsized":"2024-09-10T08:42:29.381151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389201+0000","last_change":"2024-09-10T08:42:29.388359+0000","last_active":"2024-09-10T08:42:29.389201+0000","last_peered":"2024-09-10T08:42:29.389201+0000","last_clean":"2024-09-10T08:42:29.389201+0000","last_became_active":"2024-09-10T08:42:29.388047+0000","last_became_peered":"2024-09-10T08:42:29.388047+0000","last_unstale":"2024-09-10T08:42:29.389201+0000","last_undegraded":"2024-09-10T08:42:29.389201+0000","last_fullsized":"2024-09-10T08:42:29.389201+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.357072+0000","last_change":"2024-09-10T08:42:28.357072+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.357072+0000","last_undegraded":"2024-09-10T08:42:28.357072+0000","last_fullsized":"2024-09-10T08:42:28.357072+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383353+0000","last_change":"2024-09-10T08:42:29.382521+0000","last_active":"2024-09-10T08:42:29.383353+0000","last_peered":"2024-09-10T08:42:29.383353+0000","last_clean":"2024-09-10T08:42:29.383353+0000","last_became_active":"2024-09-10T08:42:29.382070+0000","last_became_peered":"2024-09-10T08:42:29.382070+0000","last_unstale":"2024-09-10T08:42:29.383353+0000","last_undegraded":"2024-09-10T08:42:29.383353+0000","last_fullsized":"2024-09-10T08:42:29.383353+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390692+0000","last_change":"2024-09-10T08:42:29.388579+0000","last_active":"2024-09-10T08:42:29.390692+0000","last_peered":"2024-09-10T08:42:29.390692+0000","last_clean":"2024-09-10T08:42:29.390692+0000","last_became_active":"2024-09-10T08:42:29.387955+0000","last_became_peered":"2024-09-10T08:42:29.387955+0000","last_unstale":"2024-09-10T08:42:29.390692+0000","last_undegraded":"2024-09-10T08:42:29.390692+0000","last_fullsized":"2024-09-10T08:42:29.390692+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"194'4","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.387578+0000","last_change":"2024-09-10T08:42:28.372955+0000","last_active":"2024-09-10T08:42:29.387578+0000","last_peered":"2024-09-10T08:42:29.387578+0000","last_clean":"2024-09-10T08:42:29.387578+0000","last_became_active":"2024-09-10T08:42:28.372574+0000","last_became_peered":"2024-09-10T08:42:28.372574+0000","last_unstale":"2024-09-10T08:42:29.387578+0000","last_undegraded":"2024-09-10T08:42:29.387578+0000","last_fullsized":"2024-09-10T08:42:29.387578+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:26.918397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384459+0000","last_change":"2024-09-10T08:42:29.383975+0000","last_active":"2024-09-10T08:42:29.384459+0000","last_peered":"2024-09-10T08:42:29.384459+0000","last_clean":"2024-09-10T08:42:29.384459+0000","last_became_active":"2024-09-10T08:42:29.383653+0000","last_became_peered":"2024-09-10T08:42:29.383653+0000","last_unstale":"2024-09-10T08:42:29.384459+0000","last_undegraded":"2024-09-10T08:42:29.384459+0000","last_fullsized":"2024-09-10T08:42:29.384459+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:38.555871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394413+0000","last_change":"2024-09-10T08:42:28.369545+0000","last_active":"2024-09-10T08:42:29.394413+0000","last_peered":"2024-09-10T08:42:29.394413+0000","last_clean":"2024-09-10T08:42:29.394413+0000","last_became_active":"2024-09-10T08:42:28.369294+0000","last_became_peered":"2024-09-10T08:42:28.369294+0000","last_unstale":"2024-09-10T08:42:29.394413+0000","last_undegraded":"2024-09-10T08:42:29.394413+0000","last_fullsized":"2024-09-10T08:42:29.394413+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389643+0000","last_change":"2024-09-10T08:42:29.388371+0000","last_active":"2024-09-10T08:42:29.389643+0000","last_peered":"2024-09-10T08:42:29.389643+0000","last_clean":"2024-09-10T08:42:29.389643+0000","last_became_active":"2024-09-10T08:42:29.387376+0000","last_became_peered":"2024-09-10T08:42:29.387376+0000","last_unstale":"2024-09-10T08:42:29.389643+0000","last_undegraded":"2024-09-10T08:42:29.389643+0000","last_fullsized":"2024-09-10T08:42:29.389643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382489+0000","last_change":"2024-09-10T08:42:28.360994+0000","last_active":"2024-09-10T08:42:29.382489+0000","last_peered":"2024-09-10T08:42:29.382489+0000","last_clean":"2024-09-10T08:42:29.382489+0000","last_became_active":"2024-09-10T08:42:28.360662+0000","last_became_peered":"2024-09-10T08:42:28.360662+0000","last_unstale":"2024-09-10T08:42:29.382489+0000","last_undegraded":"2024-09-10T08:42:29.382489+0000","last_fullsized":"2024-09-10T08:42:29.382489+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:03.922764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390423+0000","last_change":"2024-09-10T08:42:29.388335+0000","last_active":"2024-09-10T08:42:29.390423+0000","last_peered":"2024-09-10T08:42:29.390423+0000","last_clean":"2024-09-10T08:42:29.390423+0000","last_became_active":"2024-09-10T08:42:29.387186+0000","last_became_peered":"2024-09-10T08:42:29.387186+0000","last_unstale":"2024-09-10T08:42:29.390423+0000","last_undegraded":"2024-09-10T08:42:29.390423+0000","last_fullsized":"2024-09-10T08:42:29.390423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372480+0000","last_change":"2024-09-10T08:42:28.358867+0000","last_active":"2024-09-10T08:42:29.372480+0000","last_peered":"2024-09-10T08:42:29.372480+0000","last_clean":"2024-09-10T08:42:29.372480+0000","last_became_active":"2024-09-10T08:42:28.358299+0000","last_became_peered":"2024-09-10T08:42:28.358299+0000","last_unstale":"2024-09-10T08:42:29.372480+0000","last_undegraded":"2024-09-10T08:42:29.372480+0000","last_fullsized":"2024-09-10T08:42:29.372480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:04.222556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388672+0000","last_change":"2024-09-10T08:42:29.387982+0000","last_active":"2024-09-10T08:42:29.388672+0000","last_peered":"2024-09-10T08:42:29.388672+0000","last_clean":"2024-09-10T08:42:29.388672+0000","last_became_active":"2024-09-10T08:42:29.387636+0000","last_became_peered":"2024-09-10T08:42:29.387636+0000","last_unstale":"2024-09-10T08:42:29.388672+0000","last_undegraded":"2024-09-10T08:42:29.388672+0000","last_fullsized":"2024-09-10T08:42:29.388672+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:40.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392957+0000","last_change":"2024-09-10T08:42:28.374924+0000","last_active":"2024-09-10T08:42:29.392957+0000","last_peered":"2024-09-10T08:42:29.392957+0000","last_clean":"2024-09-10T08:42:29.392957+0000","last_became_active":"2024-09-10T08:42:28.374637+0000","last_became_peered":"2024-09-10T08:42:28.374637+0000","last_unstale":"2024-09-10T08:42:29.392957+0000","last_undegraded":"2024-09-10T08:42:29.392957+0000","last_fullsized":"2024-09-10T08:42:29.392957+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380123+0000","last_change":"2024-09-10T08:42:29.379574+0000","last_active":"2024-09-10T08:42:29.380123+0000","last_peered":"2024-09-10T08:42:29.380123+0000","last_clean":"2024-09-10T08:42:29.380123+0000","last_became_active":"2024-09-10T08:42:29.379202+0000","last_became_peered":"2024-09-10T08:42:29.379202+0000","last_unstale":"2024-09-10T08:42:29.380123+0000","last_undegraded":"2024-09-10T08:42:29.380123+0000","last_fullsized":"2024-09-10T08:42:29.380123+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:51.653936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353194+0000","last_change":"2024-09-10T08:42:28.356438+0000","last_active":"2024-09-10T08:42:29.353194+0000","last_peered":"2024-09-10T08:42:29.353194+0000","last_clean":"2024-09-10T08:42:29.353194+0000","last_became_active":"2024-09-10T08:42:28.356140+0000","last_became_peered":"2024-09-10T08:42:28.356140+0000","last_unstale":"2024-09-10T08:42:29.353194+0000","last_undegraded":"2024-09-10T08:42:29.353194+0000","last_fullsized":"2024-09-10T08:42:29.353194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391478+0000","last_change":"2024-09-10T08:42:29.386977+0000","last_active":"2024-09-10T08:42:29.391478+0000","last_peered":"2024-09-10T08:42:29.391478+0000","last_clean":"2024-09-10T08:42:29.391478+0000","last_became_active":"2024-09-10T08:42:29.385141+0000","last_became_peered":"2024-09-10T08:42:29.385141+0000","last_unstale":"2024-09-10T08:42:29.391478+0000","last_undegraded":"2024-09-10T08:42:29.391478+0000","last_fullsized":"2024-09-10T08:42:29.391478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.130684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.367066+0000","last_change":"2024-09-10T08:42:28.365813+0000","last_active":"2024-09-10T08:42:28.367066+0000","last_peered":"2024-09-10T08:42:28.367066+0000","last_clean":"2024-09-10T08:42:28.367066+0000","last_became_active":"2024-09-10T08:42:28.365458+0000","last_became_peered":"2024-09-10T08:42:28.365458+0000","last_unstale":"2024-09-10T08:42:28.367066+0000","last_undegraded":"2024-09-10T08:42:28.367066+0000","last_fullsized":"2024-09-10T08:42:28.367066+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:33.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390318+0000","last_change":"2024-09-10T08:42:29.389734+0000","last_active":"2024-09-10T08:42:29.390318+0000","last_peered":"2024-09-10T08:42:29.390318+0000","last_clean":"2024-09-10T08:42:29.390318+0000","last_became_active":"2024-09-10T08:42:29.389260+0000","last_became_peered":"2024-09-10T08:42:29.389260+0000","last_unstale":"2024-09-10T08:42:29.390318+0000","last_undegraded":"2024-09-10T08:42:29.390318+0000","last_fullsized":"2024-09-10T08:42:29.390318+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:01.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390920+0000","last_change":"2024-09-10T08:42:28.372691+0000","last_active":"2024-09-10T08:42:29.390920+0000","last_peered":"2024-09-10T08:42:29.390920+0000","last_clean":"2024-09-10T08:42:29.390920+0000","last_became_active":"2024-09-10T08:42:28.372367+0000","last_became_peered":"2024-09-10T08:42:28.372367+0000","last_unstale":"2024-09-10T08:42:29.390920+0000","last_undegraded":"2024-09-10T08:42:29.390920+0000","last_fullsized":"2024-09-10T08:42:29.390920+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383027+0000","last_change":"2024-09-10T08:42:29.380637+0000","last_active":"2024-09-10T08:42:29.383027+0000","last_peered":"2024-09-10T08:42:29.383027+0000","last_clean":"2024-09-10T08:42:29.383027+0000","last_became_active":"2024-09-10T08:42:29.380035+0000","last_became_peered":"2024-09-10T08:42:29.380035+0000","last_unstale":"2024-09-10T08:42:29.383027+0000","last_undegraded":"2024-09-10T08:42:29.383027+0000","last_fullsized":"2024-09-10T08:42:29.383027+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360806+0000","last_change":"2024-09-10T08:42:28.361429+0000","last_active":"2024-09-10T08:42:29.360806+0000","last_peered":"2024-09-10T08:42:29.360806+0000","last_clean":"2024-09-10T08:42:29.360806+0000","last_became_active":"2024-09-10T08:42:28.361128+0000","last_became_peered":"2024-09-10T08:42:28.361128+0000","last_unstale":"2024-09-10T08:42:29.360806+0000","last_undegraded":"2024-09-10T08:42:29.360806+0000","last_fullsized":"2024-09-10T08:42:29.360806+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.109808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381251+0000","last_change":"2024-09-10T08:42:29.377162+0000","last_active":"2024-09-10T08:42:29.381251+0000","last_peered":"2024-09-10T08:42:29.381251+0000","last_clean":"2024-09-10T08:42:29.381251+0000","last_became_active":"2024-09-10T08:42:29.376654+0000","last_became_peered":"2024-09-10T08:42:29.376654+0000","last_unstale":"2024-09-10T08:42:29.381251+0000","last_undegraded":"2024-09-10T08:42:29.381251+0000","last_fullsized":"2024-09-10T08:42:29.381251+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"194'3","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377858+0000","last_change":"2024-09-10T08:42:28.361008+0000","last_active":"2024-09-10T08:42:29.377858+0000","last_peered":"2024-09-10T08:42:29.377858+0000","last_clean":"2024-09-10T08:42:29.377858+0000","last_became_active":"2024-09-10T08:42:28.360416+0000","last_became_peered":"2024-09-10T08:42:28.360416+0000","last_unstale":"2024-09-10T08:42:29.377858+0000","last_undegraded":"2024-09-10T08:42:29.377858+0000","last_fullsized":"2024-09-10T08:42:29.377858+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389677+0000","last_change":"2024-09-10T08:42:29.388994+0000","last_active":"2024-09-10T08:42:29.389677+0000","last_peered":"2024-09-10T08:42:29.389677+0000","last_clean":"2024-09-10T08:42:29.389677+0000","last_became_active":"2024-09-10T08:42:29.388728+0000","last_became_peered":"2024-09-10T08:42:29.388728+0000","last_unstale":"2024-09-10T08:42:29.389677+0000","last_undegraded":"2024-09-10T08:42:29.389677+0000","last_fullsized":"2024-09-10T08:42:29.389677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369785+0000","last_change":"2024-09-10T08:42:28.368808+0000","last_active":"2024-09-10T08:42:28.369785+0000","last_peered":"2024-09-10T08:42:28.369785+0000","last_clean":"2024-09-10T08:42:28.369785+0000","last_became_active":"2024-09-10T08:42:28.368332+0000","last_became_peered":"2024-09-10T08:42:28.368332+0000","last_unstale":"2024-09-10T08:42:28.369785+0000","last_undegraded":"2024-09-10T08:42:28.369785+0000","last_fullsized":"2024-09-10T08:42:28.369785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:53.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368463+0000","last_change":"2024-09-10T08:42:29.365138+0000","last_active":"2024-09-10T08:42:29.368463+0000","last_peered":"2024-09-10T08:42:29.368463+0000","last_clean":"2024-09-10T08:42:29.368463+0000","last_became_active":"2024-09-10T08:42:29.364846+0000","last_became_peered":"2024-09-10T08:42:29.364846+0000","last_unstale":"2024-09-10T08:42:29.368463+0000","last_undegraded":"2024-09-10T08:42:29.368463+0000","last_fullsized":"2024-09-10T08:42:29.368463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:31.290863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382903+0000","last_change":"2024-09-10T08:42:28.367429+0000","last_active":"2024-09-10T08:42:29.382903+0000","last_peered":"2024-09-10T08:42:29.382903+0000","last_clean":"2024-09-10T08:42:29.382903+0000","last_became_active":"2024-09-10T08:42:28.367107+0000","last_became_peered":"2024-09-10T08:42:28.367107+0000","last_unstale":"2024-09-10T08:42:29.382903+0000","last_undegraded":"2024-09-10T08:42:29.382903+0000","last_fullsized":"2024-09-10T08:42:29.382903+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368673+0000","last_change":"2024-09-10T08:42:29.367545+0000","last_active":"2024-09-10T08:42:29.368673+0000","last_peered":"2024-09-10T08:42:29.368673+0000","last_clean":"2024-09-10T08:42:29.368673+0000","last_became_active":"2024-09-10T08:42:29.367259+0000","last_became_peered":"2024-09-10T08:42:29.367259+0000","last_unstale":"2024-09-10T08:42:29.368673+0000","last_undegraded":"2024-09-10T08:42:29.368673+0000","last_fullsized":"2024-09-10T08:42:29.368673+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355995+0000","last_change":"2024-09-10T08:42:28.371165+0000","last_active":"2024-09-10T08:42:29.355995+0000","last_peered":"2024-09-10T08:42:29.355995+0000","last_clean":"2024-09-10T08:42:29.355995+0000","last_became_active":"2024-09-10T08:42:28.370828+0000","last_became_peered":"2024-09-10T08:42:28.370828+0000","last_unstale":"2024-09-10T08:42:29.355995+0000","last_undegraded":"2024-09-10T08:42:29.355995+0000","last_fullsized":"2024-09-10T08:42:29.355995+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:47.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380877+0000","last_change":"2024-09-10T08:42:29.375188+0000","last_active":"2024-09-10T08:42:29.380877+0000","last_peered":"2024-09-10T08:42:29.380877+0000","last_clean":"2024-09-10T08:42:29.380877+0000","last_became_active":"2024-09-10T08:42:29.374605+0000","last_became_peered":"2024-09-10T08:42:29.374605+0000","last_unstale":"2024-09-10T08:42:29.380877+0000","last_undegraded":"2024-09-10T08:42:29.380877+0000","last_fullsized":"2024-09-10T08:42:29.380877+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355279+0000","last_change":"2024-09-10T08:42:28.367589+0000","last_active":"2024-09-10T08:42:29.355279+0000","last_peered":"2024-09-10T08:42:29.355279+0000","last_clean":"2024-09-10T08:42:29.355279+0000","last_became_active":"2024-09-10T08:42:28.367298+0000","last_became_peered":"2024-09-10T08:42:28.367298+0000","last_unstale":"2024-09-10T08:42:29.355279+0000","last_undegraded":"2024-09-10T08:42:29.355279+0000","last_fullsized":"2024-09-10T08:42:29.355279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:23.134397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375894+0000","last_change":"2024-09-10T08:42:29.368320+0000","last_active":"2024-09-10T08:42:29.375894+0000","last_peered":"2024-09-10T08:42:29.375894+0000","last_clean":"2024-09-10T08:42:29.375894+0000","last_became_active":"2024-09-10T08:42:29.367925+0000","last_became_peered":"2024-09-10T08:42:29.367925+0000","last_unstale":"2024-09-10T08:42:29.375894+0000","last_undegraded":"2024-09-10T08:42:29.375894+0000","last_fullsized":"2024-09-10T08:42:29.375894+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:38.289380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"194'8","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382255+0000","last_change":"2024-09-10T08:42:28.370026+0000","last_active":"2024-09-10T08:42:29.382255+0000","last_peered":"2024-09-10T08:42:29.382255+0000","last_clean":"2024-09-10T08:42:29.382255+0000","last_became_active":"2024-09-10T08:42:28.369757+0000","last_became_peered":"2024-09-10T08:42:28.369757+0000","last_unstale":"2024-09-10T08:42:29.382255+0000","last_undegraded":"2024-09-10T08:42:29.382255+0000","last_fullsized":"2024-09-10T08:42:29.382255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368376+0000","last_change":"2024-09-10T08:42:29.365719+0000","last_active":"2024-09-10T08:42:29.368376+0000","last_peered":"2024-09-10T08:42:29.368376+0000","last_clean":"2024-09-10T08:42:29.368376+0000","last_became_active":"2024-09-10T08:42:29.365419+0000","last_became_peered":"2024-09-10T08:42:29.365419+0000","last_unstale":"2024-09-10T08:42:29.368376+0000","last_undegraded":"2024-09-10T08:42:29.368376+0000","last_fullsized":"2024-09-10T08:42:29.368376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:59.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393966+0000","last_change":"2024-09-10T08:42:28.371311+0000","last_active":"2024-09-10T08:42:29.393966+0000","last_peered":"2024-09-10T08:42:29.393966+0000","last_clean":"2024-09-10T08:42:29.393966+0000","last_became_active":"2024-09-10T08:42:28.371021+0000","last_became_peered":"2024-09-10T08:42:28.371021+0000","last_unstale":"2024-09-10T08:42:29.393966+0000","last_undegraded":"2024-09-10T08:42:29.393966+0000","last_fullsized":"2024-09-10T08:42:29.393966+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:47.699312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.362207+0000","last_change":"2024-09-10T08:42:28.362207+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.362207+0000","last_undegraded":"2024-09-10T08:42:28.362207+0000","last_fullsized":"2024-09-10T08:42:28.362207+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369959+0000","last_change":"2024-09-10T08:42:28.369134+0000","last_active":"2024-09-10T08:42:28.369959+0000","last_peered":"2024-09-10T08:42:28.369959+0000","last_clean":"2024-09-10T08:42:28.369959+0000","last_became_active":"2024-09-10T08:42:28.368736+0000","last_became_peered":"2024-09-10T08:42:28.368736+0000","last_unstale":"2024-09-10T08:42:28.369959+0000","last_undegraded":"2024-09-10T08:42:28.369959+0000","last_fullsized":"2024-09-10T08:42:28.369959+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:14.483339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378153+0000","last_change":"2024-09-10T08:42:29.376134+0000","last_active":"2024-09-10T08:42:29.378153+0000","last_peered":"2024-09-10T08:42:29.378153+0000","last_clean":"2024-09-10T08:42:29.378153+0000","last_became_active":"2024-09-10T08:42:29.374622+0000","last_became_peered":"2024-09-10T08:42:29.374622+0000","last_unstale":"2024-09-10T08:42:29.378153+0000","last_undegraded":"2024-09-10T08:42:29.378153+0000","last_fullsized":"2024-09-10T08:42:29.378153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394649+0000","last_change":"2024-09-10T08:42:28.371235+0000","last_active":"2024-09-10T08:42:29.394649+0000","last_peered":"2024-09-10T08:42:29.394649+0000","last_clean":"2024-09-10T08:42:29.394649+0000","last_became_active":"2024-09-10T08:42:28.370717+0000","last_became_peered":"2024-09-10T08:42:28.370717+0000","last_unstale":"2024-09-10T08:42:29.394649+0000","last_undegraded":"2024-09-10T08:42:29.394649+0000","last_fullsized":"2024-09-10T08:42:29.394649+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389665+0000","last_change":"2024-09-10T08:42:29.388578+0000","last_active":"2024-09-10T08:42:29.389665+0000","last_peered":"2024-09-10T08:42:29.389665+0000","last_clean":"2024-09-10T08:42:29.389665+0000","last_became_active":"2024-09-10T08:42:29.387485+0000","last_became_peered":"2024-09-10T08:42:29.387485+0000","last_unstale":"2024-09-10T08:42:29.389665+0000","last_undegraded":"2024-09-10T08:42:29.389665+0000","last_fullsized":"2024-09-10T08:42:29.389665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:30.985321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.359666+0000","last_change":"2024-09-10T08:42:28.366118+0000","last_active":"2024-09-10T08:42:29.359666+0000","last_peered":"2024-09-10T08:42:29.359666+0000","last_clean":"2024-09-10T08:42:29.359666+0000","last_became_active":"2024-09-10T08:42:28.365820+0000","last_became_peered":"2024-09-10T08:42:28.365820+0000","last_unstale":"2024-09-10T08:42:29.359666+0000","last_undegraded":"2024-09-10T08:42:29.359666+0000","last_fullsized":"2024-09-10T08:42:29.359666+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:15.022898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.358190+0000","last_change":"2024-09-10T08:42:28.358190+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.358190+0000","last_undegraded":"2024-09-10T08:42:28.358190+0000","last_fullsized":"2024-09-10T08:42:28.358190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393860+0000","last_change":"2024-09-10T08:42:28.369096+0000","last_active":"2024-09-10T08:42:29.393860+0000","last_peered":"2024-09-10T08:42:29.393860+0000","last_clean":"2024-09-10T08:42:29.393860+0000","last_became_active":"2024-09-10T08:42:28.367579+0000","last_became_peered":"2024-09-10T08:42:28.367579+0000","last_unstale":"2024-09-10T08:42:29.393860+0000","last_undegraded":"2024-09-10T08:42:29.393860+0000","last_fullsized":"2024-09-10T08:42:29.393860+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:34.790766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381174+0000","last_change":"2024-09-10T08:42:29.376975+0000","last_active":"2024-09-10T08:42:29.381174+0000","last_peered":"2024-09-10T08:42:29.381174+0000","last_clean":"2024-09-10T08:42:29.381174+0000","last_became_active":"2024-09-10T08:42:29.375816+0000","last_became_peered":"2024-09-10T08:42:29.375816+0000","last_unstale":"2024-09-10T08:42:29.381174+0000","last_undegraded":"2024-09-10T08:42:29.381174+0000","last_fullsized":"2024-09-10T08:42:29.381174+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370654+0000","last_change":"2024-09-10T08:42:28.365210+0000","last_active":"2024-09-10T08:42:29.370654+0000","last_peered":"2024-09-10T08:42:29.370654+0000","last_clean":"2024-09-10T08:42:29.370654+0000","last_became_active":"2024-09-10T08:42:28.364926+0000","last_became_peered":"2024-09-10T08:42:28.364926+0000","last_unstale":"2024-09-10T08:42:29.370654+0000","last_undegraded":"2024-09-10T08:42:29.370654+0000","last_fullsized":"2024-09-10T08:42:29.370654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:58.755691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377086+0000","last_change":"2024-09-10T08:42:29.375211+0000","last_active":"2024-09-10T08:42:29.377086+0000","last_peered":"2024-09-10T08:42:29.377086+0000","last_clean":"2024-09-10T08:42:29.377086+0000","last_became_active":"2024-09-10T08:42:29.374945+0000","last_became_peered":"2024-09-10T08:42:29.374945+0000","last_unstale":"2024-09-10T08:42:29.377086+0000","last_undegraded":"2024-09-10T08:42:29.377086+0000","last_fullsized":"2024-09-10T08:42:29.377086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.362732+0000","last_change":"2024-09-10T08:42:28.368260+0000","last_active":"2024-09-10T08:42:29.362732+0000","last_peered":"2024-09-10T08:42:29.362732+0000","last_clean":"2024-09-10T08:42:29.362732+0000","last_became_active":"2024-09-10T08:42:28.366958+0000","last_became_peered":"2024-09-10T08:42:28.366958+0000","last_unstale":"2024-09-10T08:42:29.362732+0000","last_undegraded":"2024-09-10T08:42:29.362732+0000","last_fullsized":"2024-09-10T08:42:29.362732+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388562+0000","last_change":"2024-09-10T08:42:29.387997+0000","last_active":"2024-09-10T08:42:29.388562+0000","last_peered":"2024-09-10T08:42:29.388562+0000","last_clean":"2024-09-10T08:42:29.388562+0000","last_became_active":"2024-09-10T08:42:29.387143+0000","last_became_peered":"2024-09-10T08:42:29.387143+0000","last_unstale":"2024-09-10T08:42:29.388562+0000","last_undegraded":"2024-09-10T08:42:29.388562+0000","last_fullsized":"2024-09-10T08:42:29.388562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360759+0000","last_change":"2024-09-10T08:42:28.373429+0000","last_active":"2024-09-10T08:42:29.360759+0000","last_peered":"2024-09-10T08:42:29.360759+0000","last_clean":"2024-09-10T08:42:29.360759+0000","last_became_active":"2024-09-10T08:42:28.373018+0000","last_became_peered":"2024-09-10T08:42:28.373018+0000","last_unstale":"2024-09-10T08:42:29.360759+0000","last_undegraded":"2024-09-10T08:42:29.360759+0000","last_fullsized":"2024-09-10T08:42:29.360759+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:55.127506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.360430+0000","last_change":"2024-09-10T08:42:28.360430+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.360430+0000","last_undegraded":"2024-09-10T08:42:28.360430+0000","last_fullsized":"2024-09-10T08:42:28.360430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.370467+0000","last_change":"2024-09-10T08:42:28.369947+0000","last_active":"2024-09-10T08:42:28.370467+0000","last_peered":"2024-09-10T08:42:28.370467+0000","last_clean":"2024-09-10T08:42:28.370467+0000","last_became_active":"2024-09-10T08:42:28.368829+0000","last_became_peered":"2024-09-10T08:42:28.368829+0000","last_unstale":"2024-09-10T08:42:28.370467+0000","last_undegraded":"2024-09-10T08:42:28.370467+0000","last_fullsized":"2024-09-10T08:42:28.370467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:00.951036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391197+0000","last_change":"2024-09-10T08:42:29.383681+0000","last_active":"2024-09-10T08:42:29.391197+0000","last_peered":"2024-09-10T08:42:29.391197+0000","last_clean":"2024-09-10T08:42:29.391197+0000","last_became_active":"2024-09-10T08:42:29.383061+0000","last_became_peered":"2024-09-10T08:42:29.383061+0000","last_unstale":"2024-09-10T08:42:29.391197+0000","last_undegraded":"2024-09-10T08:42:29.391197+0000","last_fullsized":"2024-09-10T08:42:29.391197+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:40.346099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391289+0000","last_change":"2024-09-10T08:42:28.372012+0000","last_active":"2024-09-10T08:42:29.391289+0000","last_peered":"2024-09-10T08:42:29.391289+0000","last_clean":"2024-09-10T08:42:29.391289+0000","last_became_active":"2024-09-10T08:42:28.371754+0000","last_became_peered":"2024-09-10T08:42:28.371754+0000","last_unstale":"2024-09-10T08:42:29.391289+0000","last_undegraded":"2024-09-10T08:42:29.391289+0000","last_fullsized":"2024-09-10T08:42:29.391289+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385489+0000","last_change":"2024-09-10T08:42:29.378781+0000","last_active":"2024-09-10T08:42:29.385489+0000","last_peered":"2024-09-10T08:42:29.385489+0000","last_clean":"2024-09-10T08:42:29.385489+0000","last_became_active":"2024-09-10T08:42:29.378509+0000","last_became_peered":"2024-09-10T08:42:29.378509+0000","last_unstale":"2024-09-10T08:42:29.385489+0000","last_undegraded":"2024-09-10T08:42:29.385489+0000","last_fullsized":"2024-09-10T08:42:29.385489+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:26.452775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353377+0000","last_change":"2024-09-10T08:42:28.361630+0000","last_active":"2024-09-10T08:42:29.353377+0000","last_peered":"2024-09-10T08:42:29.353377+0000","last_clean":"2024-09-10T08:42:29.353377+0000","last_became_active":"2024-09-10T08:42:28.358295+0000","last_became_peered":"2024-09-10T08:42:28.358295+0000","last_unstale":"2024-09-10T08:42:29.353377+0000","last_undegraded":"2024-09-10T08:42:29.353377+0000","last_fullsized":"2024-09-10T08:42:29.353377+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:21.406617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372202+0000","last_change":"2024-09-10T08:42:29.368037+0000","last_active":"2024-09-10T08:42:29.372202+0000","last_peered":"2024-09-10T08:42:29.372202+0000","last_clean":"2024-09-10T08:42:29.372202+0000","last_became_active":"2024-09-10T08:42:29.367522+0000","last_became_peered":"2024-09-10T08:42:29.367522+0000","last_unstale":"2024-09-10T08:42:29.372202+0000","last_undegraded":"2024-09-10T08:42:29.372202+0000","last_fullsized":"2024-09-10T08:42:29.372202+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361112+0000","last_change":"2024-09-10T08:42:28.370188+0000","last_active":"2024-09-10T08:42:29.361112+0000","last_peered":"2024-09-10T08:42:29.361112+0000","last_clean":"2024-09-10T08:42:29.361112+0000","last_became_active":"2024-09-10T08:42:28.369878+0000","last_became_peered":"2024-09-10T08:42:28.369878+0000","last_unstale":"2024-09-10T08:42:29.361112+0000","last_undegraded":"2024-09-10T08:42:29.361112+0000","last_fullsized":"2024-09-10T08:42:29.361112+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:27.034999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386671+0000","last_change":"2024-09-10T08:42:29.384764+0000","last_active":"2024-09-10T08:42:29.386671+0000","last_peered":"2024-09-10T08:42:29.386671+0000","last_clean":"2024-09-10T08:42:29.386671+0000","last_became_active":"2024-09-10T08:42:29.383341+0000","last_became_peered":"2024-09-10T08:42:29.383341+0000","last_unstale":"2024-09-10T08:42:29.386671+0000","last_undegraded":"2024-09-10T08:42:29.386671+0000","last_fullsized":"2024-09-10T08:42:29.386671+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:39.613196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.364278+0000","last_change":"2024-09-10T08:42:28.368721+0000","last_active":"2024-09-10T08:42:29.364278+0000","last_peered":"2024-09-10T08:42:29.364278+0000","last_clean":"2024-09-10T08:42:29.364278+0000","last_became_active":"2024-09-10T08:42:28.368451+0000","last_became_peered":"2024-09-10T08:42:28.368451+0000","last_unstale":"2024-09-10T08:42:29.364278+0000","last_undegraded":"2024-09-10T08:42:29.364278+0000","last_fullsized":"2024-09-10T08:42:29.364278+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386290+0000","last_change":"2024-09-10T08:42:29.383876+0000","last_active":"2024-09-10T08:42:29.386290+0000","last_peered":"2024-09-10T08:42:29.386290+0000","last_clean":"2024-09-10T08:42:29.386290+0000","last_became_active":"2024-09-10T08:42:29.383482+0000","last_became_peered":"2024-09-10T08:42:29.383482+0000","last_unstale":"2024-09-10T08:42:29.386290+0000","last_undegraded":"2024-09-10T08:42:29.386290+0000","last_fullsized":"2024-09-10T08:42:29.386290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:52.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.356275+0000","last_change":"2024-09-10T08:42:28.365843+0000","last_active":"2024-09-10T08:42:29.356275+0000","last_peered":"2024-09-10T08:42:29.356275+0000","last_clean":"2024-09-10T08:42:29.356275+0000","last_became_active":"2024-09-10T08:42:28.365472+0000","last_became_peered":"2024-09-10T08:42:28.365472+0000","last_unstale":"2024-09-10T08:42:29.356275+0000","last_undegraded":"2024-09-10T08:42:29.356275+0000","last_fullsized":"2024-09-10T08:42:29.356275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:30.588924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390402+0000","last_change":"2024-09-10T08:42:29.387773+0000","last_active":"2024-09-10T08:42:29.390402+0000","last_peered":"2024-09-10T08:42:29.390402+0000","last_clean":"2024-09-10T08:42:29.390402+0000","last_became_active":"2024-09-10T08:42:29.387377+0000","last_became_peered":"2024-09-10T08:42:29.387377+0000","last_unstale":"2024-09-10T08:42:29.390402+0000","last_undegraded":"2024-09-10T08:42:29.390402+0000","last_fullsized":"2024-09-10T08:42:29.390402+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361238+0000","last_change":"2024-09-10T08:42:28.361831+0000","last_active":"2024-09-10T08:42:29.361238+0000","last_peered":"2024-09-10T08:42:29.361238+0000","last_clean":"2024-09-10T08:42:29.361238+0000","last_became_active":"2024-09-10T08:42:28.360230+0000","last_became_peered":"2024-09-10T08:42:28.360230+0000","last_unstale":"2024-09-10T08:42:29.361238+0000","last_undegraded":"2024-09-10T08:42:29.361238+0000","last_fullsized":"2024-09-10T08:42:29.361238+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373931+0000","last_change":"2024-09-10T08:42:29.364854+0000","last_active":"2024-09-10T08:42:29.373931+0000","last_peered":"2024-09-10T08:42:29.373931+0000","last_clean":"2024-09-10T08:42:29.373931+0000","last_became_active":"2024-09-10T08:42:29.364185+0000","last_became_peered":"2024-09-10T08:42:29.364185+0000","last_unstale":"2024-09-10T08:42:29.373931+0000","last_undegraded":"2024-09-10T08:42:29.373931+0000","last_fullsized":"2024-09-10T08:42:29.373931+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385275+0000","last_change":"2024-09-10T08:42:28.371106+0000","last_active":"2024-09-10T08:42:29.385275+0000","last_peered":"2024-09-10T08:42:29.385275+0000","last_clean":"2024-09-10T08:42:29.385275+0000","last_became_active":"2024-09-10T08:42:28.370787+0000","last_became_peered":"2024-09-10T08:42:28.370787+0000","last_unstale":"2024-09-10T08:42:29.385275+0000","last_undegraded":"2024-09-10T08:42:29.385275+0000","last_fullsized":"2024-09-10T08:42:29.385275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:40.197098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373800+0000","last_change":"2024-09-10T08:42:29.364367+0000","last_active":"2024-09-10T08:42:29.373800+0000","last_peered":"2024-09-10T08:42:29.373800+0000","last_clean":"2024-09-10T08:42:29.373800+0000","last_became_active":"2024-09-10T08:42:29.364048+0000","last_became_peered":"2024-09-10T08:42:29.364048+0000","last_unstale":"2024-09-10T08:42:29.373800+0000","last_undegraded":"2024-09-10T08:42:29.373800+0000","last_fullsized":"2024-09-10T08:42:29.373800+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.395734+0000","last_change":"2024-09-10T08:42:28.374827+0000","last_active":"2024-09-10T08:42:29.395734+0000","last_peered":"2024-09-10T08:42:29.395734+0000","last_clean":"2024-09-10T08:42:29.395734+0000","last_became_active":"2024-09-10T08:42:28.374529+0000","last_became_peered":"2024-09-10T08:42:28.374529+0000","last_unstale":"2024-09-10T08:42:29.395734+0000","last_undegraded":"2024-09-10T08:42:29.395734+0000","last_fullsized":"2024-09-10T08:42:29.395734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384457+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:42:29.384457+0000","last_peered":"2024-09-10T08:42:29.384457+0000","last_clean":"2024-09-10T08:42:29.384457+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:42:29.384457+0000","last_undegraded":"2024-09-10T08:42:29.384457+0000","last_fullsized":"2024-09-10T08:42:29.384457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1074415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1073867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509609,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509610,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69596,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302244,"statfs":{"total":96636764160,"available":96565497856,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2445312,"data_stored":1073777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509610,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55788,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2441216,"data_stored":1073743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60508,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311332,"statfs":{"total":96636764160,"available":96574803968,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:42:33.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:42:33.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.772+0000 7f718ea00640 1 Processor -- start 2024-09-10T08:42:33.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.772+0000 7f718ea00640 1 -- start start 2024-09-10T08:42:33.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.773+0000 7f718ea00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7188148260 0x7f718806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.773+0000 7f718ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.773+0000 7f718ea00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7188071b30 con 0x7f7188147e80 2024-09-10T08:42:33.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.773+0000 7f718ea00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7188074200 con 0x7f7188148260 2024-09-10T08:42:33.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.773+0000 7f718ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71880b3e40 con 0x7f7188071680 2024-09-10T08:42:33.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:47456/0 (socket says 172.21.15.52:47456) 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 -- 172.21.15.52:0/1185124667 learned_addr learned my addr 172.21.15.52:0/1185124667 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f7187e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f7188147e80 0x7f7188070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:52778/0 (socket says 172.21.15.52:52778) 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f7187400640 1 --2- 172.21.15.52:0/1185124667 >> v2:172.21.15.176:3300/0 conn(0x7f7188148260 0x7f718806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 -- 172.21.15.52:0/1185124667 >> v2:172.21.15.176:3300/0 conn(0x7f7188148260 msgr2=0x7f718806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:33.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 --2- 172.21.15.52:0/1185124667 >> v2:172.21.15.176:3300/0 conn(0x7f7188148260 0x7f718806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 -- 172.21.15.52:0/1185124667 >> v1:172.21.15.176:6789/0 conn(0x7f7188147e80 legacy=0x7f7188070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.774+0000 7f718ca00640 1 -- 172.21.15.52:0/1185124667 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71880b3510 con 0x7f7188071680 2024-09-10T08:42:33.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f718ca00640 1 --2- 172.21.15.52:0/1185124667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7180009e50 tx=0x7f718002a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15847f308562ed3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f7186a00640 1 -- 172.21.15.52:0/1185124667 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180036070 con 0x7f7188071680 2024-09-10T08:42:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f7186a00640 1 -- 172.21.15.52:0/1185124667 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180031600 con 0x7f7188071680 2024-09-10T08:42:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f7186a00640 1 -- 172.21.15.52:0/1185124667 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800319d0 con 0x7f7188071680 2024-09-10T08:42:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f718ea00640 1 -- 172.21.15.52:0/1185124667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 msgr2=0x7f718806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f718ea00640 1 --2- 172.21.15.52:0/1185124667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7180009e50 tx=0x7f718002a730 comp rx=0 tx=0).stop 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f718ea00640 1 -- 172.21.15.52:0/1185124667 shutdown_connections 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.776+0000 7f718ea00640 1 --2- 172.21.15.52:0/1185124667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718806c150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.777+0000 7f718ea00640 1 --2- 172.21.15.52:0/1185124667 >> v2:172.21.15.176:3300/0 conn(0x7f7188148260 0x7f718806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.777+0000 7f718ea00640 1 -- 172.21.15.52:0/1185124667 >> 172.21.15.52:0/1185124667 conn(0x7f71880ccec0 msgr2=0x7f71880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.777+0000 7f718ea00640 1 -- 172.21.15.52:0/1185124667 shutdown_connections 2024-09-10T08:42:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.777+0000 7f718ea00640 1 -- 172.21.15.52:0/1185124667 wait complete. 2024-09-10T08:42:33.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.778+0000 7f718ea00640 1 Processor -- start 2024-09-10T08:42:33.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.778+0000 7f718ea00640 1 -- start start 2024-09-10T08:42:33.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718813e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7188148260 0x7f71880cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71880b42d0 con 0x7f7188147e80 2024-09-10T08:42:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f71880b3ad0 con 0x7f7188148260 2024-09-10T08:42:33.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.779+0000 7f718ea00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f71880b4450 con 0x7f7188071680 2024-09-10T08:42:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54366/0 (socket says 172.21.15.52:54366) 2024-09-10T08:42:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 -- 172.21.15.52:0/3940843880 learned_addr learned my addr 172.21.15.52:0/3940843880 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:33.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f718ca00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7188148260 0x7f71880cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 -- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 msgr2=0x7f718813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718813e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 -- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7188148260 msgr2=0x7f71880cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7188148260 0x7f71880cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 -- 172.21.15.52:0/3940843880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718813e650 con 0x7f7188147e80 2024-09-10T08:42:33.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.780+0000 7f7187400640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f717400e870 tx=0x7f717400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.781+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174017070 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.781+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717400c940 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.781+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718813ff50 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.781+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717400cd30 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.781+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7188140510 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.782+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7188070f70 con 0x7f7188147e80 2024-09-10T08:42:33.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.783+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f717401a070 con 0x7f7188147e80 2024-09-10T08:42:33.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.784+0000 7f717fe00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 0x7f716806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:33.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.784+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f717408ac00 con 0x7f7188147e80 2024-09-10T08:42:33.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.784+0000 7f7187e00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 0x7f716806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.785+0000 7f7187e00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 0x7f716806e2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7178007fd0 tx=0x7f7178007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:33.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.788+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7174091080 con 0x7f7188147e80 2024-09-10T08:42:33.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.968+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71881ea7a0 con 0x7f716806be30 2024-09-10T08:42:33.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.974+0000 7f717fe00640 1 -- 172.21.15.52:0/3940843880 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7f71881ea7a0 con 0x7f716806be30 2024-09-10T08:42:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:33.979 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:42:33.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 msgr2=0x7f716806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 0x7f716806e2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7178007fd0 tx=0x7f7178007e80 comp rx=0 tx=0).stop 2024-09-10T08:42:33.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 msgr2=0x7f7188140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:33.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f717400e870 tx=0x7f717400ed30 comp rx=0 tx=0).stop 2024-09-10T08:42:33.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 shutdown_connections 2024-09-10T08:42:33.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f716806be30 0x7f716806e2f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7188148260 0x7f71880cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7188147e80 0x7f7188140ff0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 --2- 172.21.15.52:0/3940843880 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7188071680 0x7f718813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:33.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 >> 172.21.15.52:0/3940843880 conn(0x7f71880ccec0 msgr2=0x7f71880730d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:33.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 shutdown_connections 2024-09-10T08:42:33.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:33.978+0000 7f718ea00640 1 -- 172.21.15.52:0/3940843880 wait complete. 2024-09-10T08:42:33.995 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":608,"stamp":"2024-09-10T08:42:33.662335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461232,"kb_used_data":20204,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513488,"statfs":{"total":773094113280,"available":772621811712,"internally_reserved":0,"allocated":20688896,"data_stored":9744410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001396"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391220+0000","last_change":"2024-09-10T08:42:29.385887+0000","last_active":"2024-09-10T08:42:29.391220+0000","last_peered":"2024-09-10T08:42:29.391220+0000","last_clean":"2024-09-10T08:42:29.391220+0000","last_became_active":"2024-09-10T08:42:29.383384+0000","last_became_peered":"2024-09-10T08:42:29.383384+0000","last_unstale":"2024-09-10T08:42:29.391220+0000","last_undegraded":"2024-09-10T08:42:29.391220+0000","last_fullsized":"2024-09-10T08:42:29.391220+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:27.665416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390710+0000","last_change":"2024-09-10T08:42:29.388781+0000","last_active":"2024-09-10T08:42:29.390710+0000","last_peered":"2024-09-10T08:42:29.390710+0000","last_clean":"2024-09-10T08:42:29.390710+0000","last_became_active":"2024-09-10T08:42:29.388292+0000","last_became_peered":"2024-09-10T08:42:29.388292+0000","last_unstale":"2024-09-10T08:42:29.390710+0000","last_undegraded":"2024-09-10T08:42:29.390710+0000","last_fullsized":"2024-09-10T08:42:29.390710+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372275+0000","last_change":"2024-09-10T08:42:29.367007+0000","last_active":"2024-09-10T08:42:29.372275+0000","last_peered":"2024-09-10T08:42:29.372275+0000","last_clean":"2024-09-10T08:42:29.372275+0000","last_became_active":"2024-09-10T08:42:29.366713+0000","last_became_peered":"2024-09-10T08:42:29.366713+0000","last_unstale":"2024-09-10T08:42:29.372275+0000","last_undegraded":"2024-09-10T08:42:29.372275+0000","last_fullsized":"2024-09-10T08:42:29.372275+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:48.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368733+0000","last_change":"2024-09-10T08:42:29.366363+0000","last_active":"2024-09-10T08:42:29.368733+0000","last_peered":"2024-09-10T08:42:29.368733+0000","last_clean":"2024-09-10T08:42:29.368733+0000","last_became_active":"2024-09-10T08:42:29.366094+0000","last_became_peered":"2024-09-10T08:42:29.366094+0000","last_unstale":"2024-09-10T08:42:29.368733+0000","last_undegraded":"2024-09-10T08:42:29.368733+0000","last_fullsized":"2024-09-10T08:42:29.368733+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:04.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368259+0000","last_change":"2024-09-10T08:42:29.365511+0000","last_active":"2024-09-10T08:42:29.368259+0000","last_peered":"2024-09-10T08:42:29.368259+0000","last_clean":"2024-09-10T08:42:29.368259+0000","last_became_active":"2024-09-10T08:42:29.362055+0000","last_became_peered":"2024-09-10T08:42:29.362055+0000","last_unstale":"2024-09-10T08:42:29.368259+0000","last_undegraded":"2024-09-10T08:42:29.368259+0000","last_fullsized":"2024-09-10T08:42:29.368259+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368289+0000","last_change":"2024-09-10T08:42:29.362962+0000","last_active":"2024-09-10T08:42:29.368289+0000","last_peered":"2024-09-10T08:42:29.368289+0000","last_clean":"2024-09-10T08:42:29.368289+0000","last_became_active":"2024-09-10T08:42:29.362665+0000","last_became_peered":"2024-09-10T08:42:29.362665+0000","last_unstale":"2024-09-10T08:42:29.368289+0000","last_undegraded":"2024-09-10T08:42:29.368289+0000","last_fullsized":"2024-09-10T08:42:29.368289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:55.712843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375949+0000","last_change":"2024-09-10T08:42:29.373037+0000","last_active":"2024-09-10T08:42:29.375949+0000","last_peered":"2024-09-10T08:42:29.375949+0000","last_clean":"2024-09-10T08:42:29.375949+0000","last_became_active":"2024-09-10T08:42:29.372745+0000","last_became_peered":"2024-09-10T08:42:29.372745+0000","last_unstale":"2024-09-10T08:42:29.375949+0000","last_undegraded":"2024-09-10T08:42:29.375949+0000","last_fullsized":"2024-09-10T08:42:29.375949+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:54.772249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.376620+0000","last_change":"2024-09-10T08:42:29.375322+0000","last_active":"2024-09-10T08:42:29.376620+0000","last_peered":"2024-09-10T08:42:29.376620+0000","last_clean":"2024-09-10T08:42:29.376620+0000","last_became_active":"2024-09-10T08:42:29.375050+0000","last_became_peered":"2024-09-10T08:42:29.375050+0000","last_unstale":"2024-09-10T08:42:29.376620+0000","last_undegraded":"2024-09-10T08:42:29.376620+0000","last_fullsized":"2024-09-10T08:42:29.376620+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.379615+0000","last_change":"2024-09-10T08:42:29.372907+0000","last_active":"2024-09-10T08:42:29.379615+0000","last_peered":"2024-09-10T08:42:29.379615+0000","last_clean":"2024-09-10T08:42:29.379615+0000","last_became_active":"2024-09-10T08:42:29.371130+0000","last_became_peered":"2024-09-10T08:42:29.371130+0000","last_unstale":"2024-09-10T08:42:29.379615+0000","last_undegraded":"2024-09-10T08:42:29.379615+0000","last_fullsized":"2024-09-10T08:42:29.379615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370658+0000","last_change":"2024-09-10T08:42:29.366985+0000","last_active":"2024-09-10T08:42:29.370658+0000","last_peered":"2024-09-10T08:42:29.370658+0000","last_clean":"2024-09-10T08:42:29.370658+0000","last_became_active":"2024-09-10T08:42:29.366690+0000","last_became_peered":"2024-09-10T08:42:29.366690+0000","last_unstale":"2024-09-10T08:42:29.370658+0000","last_undegraded":"2024-09-10T08:42:29.370658+0000","last_fullsized":"2024-09-10T08:42:29.370658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382997+0000","last_change":"2024-09-10T08:42:29.380452+0000","last_active":"2024-09-10T08:42:29.382997+0000","last_peered":"2024-09-10T08:42:29.382997+0000","last_clean":"2024-09-10T08:42:29.382997+0000","last_became_active":"2024-09-10T08:42:29.379753+0000","last_became_peered":"2024-09-10T08:42:29.379753+0000","last_unstale":"2024-09-10T08:42:29.382997+0000","last_undegraded":"2024-09-10T08:42:29.382997+0000","last_fullsized":"2024-09-10T08:42:29.382997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381298+0000","last_change":"2024-09-10T08:42:29.377573+0000","last_active":"2024-09-10T08:42:29.381298+0000","last_peered":"2024-09-10T08:42:29.381298+0000","last_clean":"2024-09-10T08:42:29.381298+0000","last_became_active":"2024-09-10T08:42:29.377309+0000","last_became_peered":"2024-09-10T08:42:29.377309+0000","last_unstale":"2024-09-10T08:42:29.381298+0000","last_undegraded":"2024-09-10T08:42:29.381298+0000","last_fullsized":"2024-09-10T08:42:29.381298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392289+0000","last_change":"2024-09-10T08:42:29.384443+0000","last_active":"2024-09-10T08:42:29.392289+0000","last_peered":"2024-09-10T08:42:29.392289+0000","last_clean":"2024-09-10T08:42:29.392289+0000","last_became_active":"2024-09-10T08:42:29.384157+0000","last_became_peered":"2024-09-10T08:42:29.384157+0000","last_unstale":"2024-09-10T08:42:29.392289+0000","last_undegraded":"2024-09-10T08:42:29.392289+0000","last_fullsized":"2024-09-10T08:42:29.392289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:54.237300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378176+0000","last_change":"2024-09-10T08:42:29.368203+0000","last_active":"2024-09-10T08:42:29.378176+0000","last_peered":"2024-09-10T08:42:29.378176+0000","last_clean":"2024-09-10T08:42:29.378176+0000","last_became_active":"2024-09-10T08:42:29.367829+0000","last_became_peered":"2024-09-10T08:42:29.367829+0000","last_unstale":"2024-09-10T08:42:29.378176+0000","last_undegraded":"2024-09-10T08:42:29.378176+0000","last_fullsized":"2024-09-10T08:42:29.378176+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.493836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.366216+0000","last_change":"2024-09-10T08:42:29.361268+0000","last_active":"2024-09-10T08:42:29.366216+0000","last_peered":"2024-09-10T08:42:29.366216+0000","last_clean":"2024-09-10T08:42:29.366216+0000","last_became_active":"2024-09-10T08:42:29.360989+0000","last_became_peered":"2024-09-10T08:42:29.360989+0000","last_unstale":"2024-09-10T08:42:29.366216+0000","last_undegraded":"2024-09-10T08:42:29.366216+0000","last_fullsized":"2024-09-10T08:42:29.366216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:54.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.374189+0000","last_change":"2024-09-10T08:42:29.365642+0000","last_active":"2024-09-10T08:42:29.374189+0000","last_peered":"2024-09-10T08:42:29.374189+0000","last_clean":"2024-09-10T08:42:29.374189+0000","last_became_active":"2024-09-10T08:42:29.358997+0000","last_became_peered":"2024-09-10T08:42:29.358997+0000","last_unstale":"2024-09-10T08:42:29.374189+0000","last_undegraded":"2024-09-10T08:42:29.374189+0000","last_fullsized":"2024-09-10T08:42:29.374189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386658+0000","last_change":"2024-09-10T08:42:29.383360+0000","last_active":"2024-09-10T08:42:29.386658+0000","last_peered":"2024-09-10T08:42:29.386658+0000","last_clean":"2024-09-10T08:42:29.386658+0000","last_became_active":"2024-09-10T08:42:29.380706+0000","last_became_peered":"2024-09-10T08:42:29.380706+0000","last_unstale":"2024-09-10T08:42:29.386658+0000","last_undegraded":"2024-09-10T08:42:29.386658+0000","last_fullsized":"2024-09-10T08:42:29.386658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:45.709011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.363033+0000","last_change":"2024-09-10T08:42:28.363033+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.363033+0000","last_undegraded":"2024-09-10T08:42:28.363033+0000","last_fullsized":"2024-09-10T08:42:28.363033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375595+0000","last_change":"2024-09-10T08:42:29.370587+0000","last_active":"2024-09-10T08:42:29.375595+0000","last_peered":"2024-09-10T08:42:29.375595+0000","last_clean":"2024-09-10T08:42:29.375595+0000","last_became_active":"2024-09-10T08:42:29.368564+0000","last_became_peered":"2024-09-10T08:42:29.368564+0000","last_unstale":"2024-09-10T08:42:29.375595+0000","last_undegraded":"2024-09-10T08:42:29.375595+0000","last_fullsized":"2024-09-10T08:42:29.375595+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.401473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.361855+0000","last_change":"2024-09-10T08:42:28.361855+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.361855+0000","last_undegraded":"2024-09-10T08:42:28.361855+0000","last_fullsized":"2024-09-10T08:42:28.361855+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.359126+0000","last_change":"2024-09-10T08:42:28.359126+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.359126+0000","last_undegraded":"2024-09-10T08:42:28.359126+0000","last_fullsized":"2024-09-10T08:42:28.359126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388704+0000","last_change":"2024-09-10T08:42:29.388085+0000","last_active":"2024-09-10T08:42:29.388704+0000","last_peered":"2024-09-10T08:42:29.388704+0000","last_clean":"2024-09-10T08:42:29.388704+0000","last_became_active":"2024-09-10T08:42:29.387481+0000","last_became_peered":"2024-09-10T08:42:29.387481+0000","last_unstale":"2024-09-10T08:42:29.388704+0000","last_undegraded":"2024-09-10T08:42:29.388704+0000","last_fullsized":"2024-09-10T08:42:29.388704+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:18.086767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391499+0000","last_change":"2024-09-10T08:42:29.386980+0000","last_active":"2024-09-10T08:42:29.391499+0000","last_peered":"2024-09-10T08:42:29.391499+0000","last_clean":"2024-09-10T08:42:29.391499+0000","last_became_active":"2024-09-10T08:42:29.386230+0000","last_became_peered":"2024-09-10T08:42:29.386230+0000","last_unstale":"2024-09-10T08:42:29.391499+0000","last_undegraded":"2024-09-10T08:42:29.391499+0000","last_fullsized":"2024-09-10T08:42:29.391499+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:28.038178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368228+0000","last_change":"2024-09-10T08:42:29.365247+0000","last_active":"2024-09-10T08:42:29.368228+0000","last_peered":"2024-09-10T08:42:29.368228+0000","last_clean":"2024-09-10T08:42:29.368228+0000","last_became_active":"2024-09-10T08:42:29.365006+0000","last_became_peered":"2024-09-10T08:42:29.365006+0000","last_unstale":"2024-09-10T08:42:29.368228+0000","last_undegraded":"2024-09-10T08:42:29.368228+0000","last_fullsized":"2024-09-10T08:42:29.368228+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:21.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382728+0000","last_change":"2024-09-10T08:42:29.380286+0000","last_active":"2024-09-10T08:42:29.382728+0000","last_peered":"2024-09-10T08:42:29.382728+0000","last_clean":"2024-09-10T08:42:29.382728+0000","last_became_active":"2024-09-10T08:42:29.379995+0000","last_became_peered":"2024-09-10T08:42:29.379995+0000","last_unstale":"2024-09-10T08:42:29.382728+0000","last_undegraded":"2024-09-10T08:42:29.382728+0000","last_fullsized":"2024-09-10T08:42:29.382728+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377613+0000","last_change":"2024-09-10T08:42:29.375078+0000","last_active":"2024-09-10T08:42:29.377613+0000","last_peered":"2024-09-10T08:42:29.377613+0000","last_clean":"2024-09-10T08:42:29.377613+0000","last_became_active":"2024-09-10T08:42:29.373435+0000","last_became_peered":"2024-09-10T08:42:29.373435+0000","last_unstale":"2024-09-10T08:42:29.377613+0000","last_undegraded":"2024-09-10T08:42:29.377613+0000","last_fullsized":"2024-09-10T08:42:29.377613+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:30.490305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383430+0000","last_change":"2024-09-10T08:42:29.380722+0000","last_active":"2024-09-10T08:42:29.383430+0000","last_peered":"2024-09-10T08:42:29.383430+0000","last_clean":"2024-09-10T08:42:29.383430+0000","last_became_active":"2024-09-10T08:42:29.380128+0000","last_became_peered":"2024-09-10T08:42:29.380128+0000","last_unstale":"2024-09-10T08:42:29.383430+0000","last_undegraded":"2024-09-10T08:42:29.383430+0000","last_fullsized":"2024-09-10T08:42:29.383430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375864+0000","last_change":"2024-09-10T08:42:29.372114+0000","last_active":"2024-09-10T08:42:29.375864+0000","last_peered":"2024-09-10T08:42:29.375864+0000","last_clean":"2024-09-10T08:42:29.375864+0000","last_became_active":"2024-09-10T08:42:29.371781+0000","last_became_peered":"2024-09-10T08:42:29.371781+0000","last_unstale":"2024-09-10T08:42:29.375864+0000","last_undegraded":"2024-09-10T08:42:29.375864+0000","last_fullsized":"2024-09-10T08:42:29.375864+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381151+0000","last_change":"2024-09-10T08:42:29.375856+0000","last_active":"2024-09-10T08:42:29.381151+0000","last_peered":"2024-09-10T08:42:29.381151+0000","last_clean":"2024-09-10T08:42:29.381151+0000","last_became_active":"2024-09-10T08:42:29.375593+0000","last_became_peered":"2024-09-10T08:42:29.375593+0000","last_unstale":"2024-09-10T08:42:29.381151+0000","last_undegraded":"2024-09-10T08:42:29.381151+0000","last_fullsized":"2024-09-10T08:42:29.381151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389201+0000","last_change":"2024-09-10T08:42:29.388359+0000","last_active":"2024-09-10T08:42:29.389201+0000","last_peered":"2024-09-10T08:42:29.389201+0000","last_clean":"2024-09-10T08:42:29.389201+0000","last_became_active":"2024-09-10T08:42:29.388047+0000","last_became_peered":"2024-09-10T08:42:29.388047+0000","last_unstale":"2024-09-10T08:42:29.389201+0000","last_undegraded":"2024-09-10T08:42:29.389201+0000","last_fullsized":"2024-09-10T08:42:29.389201+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.357072+0000","last_change":"2024-09-10T08:42:28.357072+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.357072+0000","last_undegraded":"2024-09-10T08:42:28.357072+0000","last_fullsized":"2024-09-10T08:42:28.357072+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383353+0000","last_change":"2024-09-10T08:42:29.382521+0000","last_active":"2024-09-10T08:42:29.383353+0000","last_peered":"2024-09-10T08:42:29.383353+0000","last_clean":"2024-09-10T08:42:29.383353+0000","last_became_active":"2024-09-10T08:42:29.382070+0000","last_became_peered":"2024-09-10T08:42:29.382070+0000","last_unstale":"2024-09-10T08:42:29.383353+0000","last_undegraded":"2024-09-10T08:42:29.383353+0000","last_fullsized":"2024-09-10T08:42:29.383353+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390692+0000","last_change":"2024-09-10T08:42:29.388579+0000","last_active":"2024-09-10T08:42:29.390692+0000","last_peered":"2024-09-10T08:42:29.390692+0000","last_clean":"2024-09-10T08:42:29.390692+0000","last_became_active":"2024-09-10T08:42:29.387955+0000","last_became_peered":"2024-09-10T08:42:29.387955+0000","last_unstale":"2024-09-10T08:42:29.390692+0000","last_undegraded":"2024-09-10T08:42:29.390692+0000","last_fullsized":"2024-09-10T08:42:29.390692+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"194'4","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.387578+0000","last_change":"2024-09-10T08:42:28.372955+0000","last_active":"2024-09-10T08:42:29.387578+0000","last_peered":"2024-09-10T08:42:29.387578+0000","last_clean":"2024-09-10T08:42:29.387578+0000","last_became_active":"2024-09-10T08:42:28.372574+0000","last_became_peered":"2024-09-10T08:42:28.372574+0000","last_unstale":"2024-09-10T08:42:29.387578+0000","last_undegraded":"2024-09-10T08:42:29.387578+0000","last_fullsized":"2024-09-10T08:42:29.387578+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:26.918397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384459+0000","last_change":"2024-09-10T08:42:29.383975+0000","last_active":"2024-09-10T08:42:29.384459+0000","last_peered":"2024-09-10T08:42:29.384459+0000","last_clean":"2024-09-10T08:42:29.384459+0000","last_became_active":"2024-09-10T08:42:29.383653+0000","last_became_peered":"2024-09-10T08:42:29.383653+0000","last_unstale":"2024-09-10T08:42:29.384459+0000","last_undegraded":"2024-09-10T08:42:29.384459+0000","last_fullsized":"2024-09-10T08:42:29.384459+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:38.555871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394413+0000","last_change":"2024-09-10T08:42:28.369545+0000","last_active":"2024-09-10T08:42:29.394413+0000","last_peered":"2024-09-10T08:42:29.394413+0000","last_clean":"2024-09-10T08:42:29.394413+0000","last_became_active":"2024-09-10T08:42:28.369294+0000","last_became_peered":"2024-09-10T08:42:28.369294+0000","last_unstale":"2024-09-10T08:42:29.394413+0000","last_undegraded":"2024-09-10T08:42:29.394413+0000","last_fullsized":"2024-09-10T08:42:29.394413+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389643+0000","last_change":"2024-09-10T08:42:29.388371+0000","last_active":"2024-09-10T08:42:29.389643+0000","last_peered":"2024-09-10T08:42:29.389643+0000","last_clean":"2024-09-10T08:42:29.389643+0000","last_became_active":"2024-09-10T08:42:29.387376+0000","last_became_peered":"2024-09-10T08:42:29.387376+0000","last_unstale":"2024-09-10T08:42:29.389643+0000","last_undegraded":"2024-09-10T08:42:29.389643+0000","last_fullsized":"2024-09-10T08:42:29.389643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382489+0000","last_change":"2024-09-10T08:42:28.360994+0000","last_active":"2024-09-10T08:42:29.382489+0000","last_peered":"2024-09-10T08:42:29.382489+0000","last_clean":"2024-09-10T08:42:29.382489+0000","last_became_active":"2024-09-10T08:42:28.360662+0000","last_became_peered":"2024-09-10T08:42:28.360662+0000","last_unstale":"2024-09-10T08:42:29.382489+0000","last_undegraded":"2024-09-10T08:42:29.382489+0000","last_fullsized":"2024-09-10T08:42:29.382489+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:03.922764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390423+0000","last_change":"2024-09-10T08:42:29.388335+0000","last_active":"2024-09-10T08:42:29.390423+0000","last_peered":"2024-09-10T08:42:29.390423+0000","last_clean":"2024-09-10T08:42:29.390423+0000","last_became_active":"2024-09-10T08:42:29.387186+0000","last_became_peered":"2024-09-10T08:42:29.387186+0000","last_unstale":"2024-09-10T08:42:29.390423+0000","last_undegraded":"2024-09-10T08:42:29.390423+0000","last_fullsized":"2024-09-10T08:42:29.390423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372480+0000","last_change":"2024-09-10T08:42:28.358867+0000","last_active":"2024-09-10T08:42:29.372480+0000","last_peered":"2024-09-10T08:42:29.372480+0000","last_clean":"2024-09-10T08:42:29.372480+0000","last_became_active":"2024-09-10T08:42:28.358299+0000","last_became_peered":"2024-09-10T08:42:28.358299+0000","last_unstale":"2024-09-10T08:42:29.372480+0000","last_undegraded":"2024-09-10T08:42:29.372480+0000","last_fullsized":"2024-09-10T08:42:29.372480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:04.222556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388672+0000","last_change":"2024-09-10T08:42:29.387982+0000","last_active":"2024-09-10T08:42:29.388672+0000","last_peered":"2024-09-10T08:42:29.388672+0000","last_clean":"2024-09-10T08:42:29.388672+0000","last_became_active":"2024-09-10T08:42:29.387636+0000","last_became_peered":"2024-09-10T08:42:29.387636+0000","last_unstale":"2024-09-10T08:42:29.388672+0000","last_undegraded":"2024-09-10T08:42:29.388672+0000","last_fullsized":"2024-09-10T08:42:29.388672+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:40.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392957+0000","last_change":"2024-09-10T08:42:28.374924+0000","last_active":"2024-09-10T08:42:29.392957+0000","last_peered":"2024-09-10T08:42:29.392957+0000","last_clean":"2024-09-10T08:42:29.392957+0000","last_became_active":"2024-09-10T08:42:28.374637+0000","last_became_peered":"2024-09-10T08:42:28.374637+0000","last_unstale":"2024-09-10T08:42:29.392957+0000","last_undegraded":"2024-09-10T08:42:29.392957+0000","last_fullsized":"2024-09-10T08:42:29.392957+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380123+0000","last_change":"2024-09-10T08:42:29.379574+0000","last_active":"2024-09-10T08:42:29.380123+0000","last_peered":"2024-09-10T08:42:29.380123+0000","last_clean":"2024-09-10T08:42:29.380123+0000","last_became_active":"2024-09-10T08:42:29.379202+0000","last_became_peered":"2024-09-10T08:42:29.379202+0000","last_unstale":"2024-09-10T08:42:29.380123+0000","last_undegraded":"2024-09-10T08:42:29.380123+0000","last_fullsized":"2024-09-10T08:42:29.380123+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:51.653936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353194+0000","last_change":"2024-09-10T08:42:28.356438+0000","last_active":"2024-09-10T08:42:29.353194+0000","last_peered":"2024-09-10T08:42:29.353194+0000","last_clean":"2024-09-10T08:42:29.353194+0000","last_became_active":"2024-09-10T08:42:28.356140+0000","last_became_peered":"2024-09-10T08:42:28.356140+0000","last_unstale":"2024-09-10T08:42:29.353194+0000","last_undegraded":"2024-09-10T08:42:29.353194+0000","last_fullsized":"2024-09-10T08:42:29.353194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391478+0000","last_change":"2024-09-10T08:42:29.386977+0000","last_active":"2024-09-10T08:42:29.391478+0000","last_peered":"2024-09-10T08:42:29.391478+0000","last_clean":"2024-09-10T08:42:29.391478+0000","last_became_active":"2024-09-10T08:42:29.385141+0000","last_became_peered":"2024-09-10T08:42:29.385141+0000","last_unstale":"2024-09-10T08:42:29.391478+0000","last_undegraded":"2024-09-10T08:42:29.391478+0000","last_fullsized":"2024-09-10T08:42:29.391478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.130684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.367066+0000","last_change":"2024-09-10T08:42:28.365813+0000","last_active":"2024-09-10T08:42:28.367066+0000","last_peered":"2024-09-10T08:42:28.367066+0000","last_clean":"2024-09-10T08:42:28.367066+0000","last_became_active":"2024-09-10T08:42:28.365458+0000","last_became_peered":"2024-09-10T08:42:28.365458+0000","last_unstale":"2024-09-10T08:42:28.367066+0000","last_undegraded":"2024-09-10T08:42:28.367066+0000","last_fullsized":"2024-09-10T08:42:28.367066+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:33.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390318+0000","last_change":"2024-09-10T08:42:29.389734+0000","last_active":"2024-09-10T08:42:29.390318+0000","last_peered":"2024-09-10T08:42:29.390318+0000","last_clean":"2024-09-10T08:42:29.390318+0000","last_became_active":"2024-09-10T08:42:29.389260+0000","last_became_peered":"2024-09-10T08:42:29.389260+0000","last_unstale":"2024-09-10T08:42:29.390318+0000","last_undegraded":"2024-09-10T08:42:29.390318+0000","last_fullsized":"2024-09-10T08:42:29.390318+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:01.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390920+0000","last_change":"2024-09-10T08:42:28.372691+0000","last_active":"2024-09-10T08:42:29.390920+0000","last_peered":"2024-09-10T08:42:29.390920+0000","last_clean":"2024-09-10T08:42:29.390920+0000","last_became_active":"2024-09-10T08:42:28.372367+0000","last_became_peered":"2024-09-10T08:42:28.372367+0000","last_unstale":"2024-09-10T08:42:29.390920+0000","last_undegraded":"2024-09-10T08:42:29.390920+0000","last_fullsized":"2024-09-10T08:42:29.390920+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383027+0000","last_change":"2024-09-10T08:42:29.380637+0000","last_active":"2024-09-10T08:42:29.383027+0000","last_peered":"2024-09-10T08:42:29.383027+0000","last_clean":"2024-09-10T08:42:29.383027+0000","last_became_active":"2024-09-10T08:42:29.380035+0000","last_became_peered":"2024-09-10T08:42:29.380035+0000","last_unstale":"2024-09-10T08:42:29.383027+0000","last_undegraded":"2024-09-10T08:42:29.383027+0000","last_fullsized":"2024-09-10T08:42:29.383027+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360806+0000","last_change":"2024-09-10T08:42:28.361429+0000","last_active":"2024-09-10T08:42:29.360806+0000","last_peered":"2024-09-10T08:42:29.360806+0000","last_clean":"2024-09-10T08:42:29.360806+0000","last_became_active":"2024-09-10T08:42:28.361128+0000","last_became_peered":"2024-09-10T08:42:28.361128+0000","last_unstale":"2024-09-10T08:42:29.360806+0000","last_undegraded":"2024-09-10T08:42:29.360806+0000","last_fullsized":"2024-09-10T08:42:29.360806+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.109808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381251+0000","last_change":"2024-09-10T08:42:29.377162+0000","last_active":"2024-09-10T08:42:29.381251+0000","last_peered":"2024-09-10T08:42:29.381251+0000","last_clean":"2024-09-10T08:42:29.381251+0000","last_became_active":"2024-09-10T08:42:29.376654+0000","last_became_peered":"2024-09-10T08:42:29.376654+0000","last_unstale":"2024-09-10T08:42:29.381251+0000","last_undegraded":"2024-09-10T08:42:29.381251+0000","last_fullsized":"2024-09-10T08:42:29.381251+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"194'3","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377858+0000","last_change":"2024-09-10T08:42:28.361008+0000","last_active":"2024-09-10T08:42:29.377858+0000","last_peered":"2024-09-10T08:42:29.377858+0000","last_clean":"2024-09-10T08:42:29.377858+0000","last_became_active":"2024-09-10T08:42:28.360416+0000","last_became_peered":"2024-09-10T08:42:28.360416+0000","last_unstale":"2024-09-10T08:42:29.377858+0000","last_undegraded":"2024-09-10T08:42:29.377858+0000","last_fullsized":"2024-09-10T08:42:29.377858+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389677+0000","last_change":"2024-09-10T08:42:29.388994+0000","last_active":"2024-09-10T08:42:29.389677+0000","last_peered":"2024-09-10T08:42:29.389677+0000","last_clean":"2024-09-10T08:42:29.389677+0000","last_became_active":"2024-09-10T08:42:29.388728+0000","last_became_peered":"2024-09-10T08:42:29.388728+0000","last_unstale":"2024-09-10T08:42:29.389677+0000","last_undegraded":"2024-09-10T08:42:29.389677+0000","last_fullsized":"2024-09-10T08:42:29.389677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369785+0000","last_change":"2024-09-10T08:42:28.368808+0000","last_active":"2024-09-10T08:42:28.369785+0000","last_peered":"2024-09-10T08:42:28.369785+0000","last_clean":"2024-09-10T08:42:28.369785+0000","last_became_active":"2024-09-10T08:42:28.368332+0000","last_became_peered":"2024-09-10T08:42:28.368332+0000","last_unstale":"2024-09-10T08:42:28.369785+0000","last_undegraded":"2024-09-10T08:42:28.369785+0000","last_fullsized":"2024-09-10T08:42:28.369785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:53.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368463+0000","last_change":"2024-09-10T08:42:29.365138+0000","last_active":"2024-09-10T08:42:29.368463+0000","last_peered":"2024-09-10T08:42:29.368463+0000","last_clean":"2024-09-10T08:42:29.368463+0000","last_became_active":"2024-09-10T08:42:29.364846+0000","last_became_peered":"2024-09-10T08:42:29.364846+0000","last_unstale":"2024-09-10T08:42:29.368463+0000","last_undegraded":"2024-09-10T08:42:29.368463+0000","last_fullsized":"2024-09-10T08:42:29.368463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:31.290863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382903+0000","last_change":"2024-09-10T08:42:28.367429+0000","last_active":"2024-09-10T08:42:29.382903+0000","last_peered":"2024-09-10T08:42:29.382903+0000","last_clean":"2024-09-10T08:42:29.382903+0000","last_became_active":"2024-09-10T08:42:28.367107+0000","last_became_peered":"2024-09-10T08:42:28.367107+0000","last_unstale":"2024-09-10T08:42:29.382903+0000","last_undegraded":"2024-09-10T08:42:29.382903+0000","last_fullsized":"2024-09-10T08:42:29.382903+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368673+0000","last_change":"2024-09-10T08:42:29.367545+0000","last_active":"2024-09-10T08:42:29.368673+0000","last_peered":"2024-09-10T08:42:29.368673+0000","last_clean":"2024-09-10T08:42:29.368673+0000","last_became_active":"2024-09-10T08:42:29.367259+0000","last_became_peered":"2024-09-10T08:42:29.367259+0000","last_unstale":"2024-09-10T08:42:29.368673+0000","last_undegraded":"2024-09-10T08:42:29.368673+0000","last_fullsized":"2024-09-10T08:42:29.368673+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355995+0000","last_change":"2024-09-10T08:42:28.371165+0000","last_active":"2024-09-10T08:42:29.355995+0000","last_peered":"2024-09-10T08:42:29.355995+0000","last_clean":"2024-09-10T08:42:29.355995+0000","last_became_active":"2024-09-10T08:42:28.370828+0000","last_became_peered":"2024-09-10T08:42:28.370828+0000","last_unstale":"2024-09-10T08:42:29.355995+0000","last_undegraded":"2024-09-10T08:42:29.355995+0000","last_fullsized":"2024-09-10T08:42:29.355995+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:47.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380877+0000","last_change":"2024-09-10T08:42:29.375188+0000","last_active":"2024-09-10T08:42:29.380877+0000","last_peered":"2024-09-10T08:42:29.380877+0000","last_clean":"2024-09-10T08:42:29.380877+0000","last_became_active":"2024-09-10T08:42:29.374605+0000","last_became_peered":"2024-09-10T08:42:29.374605+0000","last_unstale":"2024-09-10T08:42:29.380877+0000","last_undegraded":"2024-09-10T08:42:29.380877+0000","last_fullsized":"2024-09-10T08:42:29.380877+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355279+0000","last_change":"2024-09-10T08:42:28.367589+0000","last_active":"2024-09-10T08:42:29.355279+0000","last_peered":"2024-09-10T08:42:29.355279+0000","last_clean":"2024-09-10T08:42:29.355279+0000","last_became_active":"2024-09-10T08:42:28.367298+0000","last_became_peered":"2024-09-10T08:42:28.367298+0000","last_unstale":"2024-09-10T08:42:29.355279+0000","last_undegraded":"2024-09-10T08:42:29.355279+0000","last_fullsized":"2024-09-10T08:42:29.355279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:23.134397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375894+0000","last_change":"2024-09-10T08:42:29.368320+0000","last_active":"2024-09-10T08:42:29.375894+0000","last_peered":"2024-09-10T08:42:29.375894+0000","last_clean":"2024-09-10T08:42:29.375894+0000","last_became_active":"2024-09-10T08:42:29.367925+0000","last_became_peered":"2024-09-10T08:42:29.367925+0000","last_unstale":"2024-09-10T08:42:29.375894+0000","last_undegraded":"2024-09-10T08:42:29.375894+0000","last_fullsized":"2024-09-10T08:42:29.375894+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:38.289380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"194'8","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382255+0000","last_change":"2024-09-10T08:42:28.370026+0000","last_active":"2024-09-10T08:42:29.382255+0000","last_peered":"2024-09-10T08:42:29.382255+0000","last_clean":"2024-09-10T08:42:29.382255+0000","last_became_active":"2024-09-10T08:42:28.369757+0000","last_became_peered":"2024-09-10T08:42:28.369757+0000","last_unstale":"2024-09-10T08:42:29.382255+0000","last_undegraded":"2024-09-10T08:42:29.382255+0000","last_fullsized":"2024-09-10T08:42:29.382255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368376+0000","last_change":"2024-09-10T08:42:29.365719+0000","last_active":"2024-09-10T08:42:29.368376+0000","last_peered":"2024-09-10T08:42:29.368376+0000","last_clean":"2024-09-10T08:42:29.368376+0000","last_became_active":"2024-09-10T08:42:29.365419+0000","last_became_peered":"2024-09-10T08:42:29.365419+0000","last_unstale":"2024-09-10T08:42:29.368376+0000","last_undegraded":"2024-09-10T08:42:29.368376+0000","last_fullsized":"2024-09-10T08:42:29.368376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:59.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393966+0000","last_change":"2024-09-10T08:42:28.371311+0000","last_active":"2024-09-10T08:42:29.393966+0000","last_peered":"2024-09-10T08:42:29.393966+0000","last_clean":"2024-09-10T08:42:29.393966+0000","last_became_active":"2024-09-10T08:42:28.371021+0000","last_became_peered":"2024-09-10T08:42:28.371021+0000","last_unstale":"2024-09-10T08:42:29.393966+0000","last_undegraded":"2024-09-10T08:42:29.393966+0000","last_fullsized":"2024-09-10T08:42:29.393966+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:47.699312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.362207+0000","last_change":"2024-09-10T08:42:28.362207+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.362207+0000","last_undegraded":"2024-09-10T08:42:28.362207+0000","last_fullsized":"2024-09-10T08:42:28.362207+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369959+0000","last_change":"2024-09-10T08:42:28.369134+0000","last_active":"2024-09-10T08:42:28.369959+0000","last_peered":"2024-09-10T08:42:28.369959+0000","last_clean":"2024-09-10T08:42:28.369959+0000","last_became_active":"2024-09-10T08:42:28.368736+0000","last_became_peered":"2024-09-10T08:42:28.368736+0000","last_unstale":"2024-09-10T08:42:28.369959+0000","last_undegraded":"2024-09-10T08:42:28.369959+0000","last_fullsized":"2024-09-10T08:42:28.369959+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:14.483339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378153+0000","last_change":"2024-09-10T08:42:29.376134+0000","last_active":"2024-09-10T08:42:29.378153+0000","last_peered":"2024-09-10T08:42:29.378153+0000","last_clean":"2024-09-10T08:42:29.378153+0000","last_became_active":"2024-09-10T08:42:29.374622+0000","last_became_peered":"2024-09-10T08:42:29.374622+0000","last_unstale":"2024-09-10T08:42:29.378153+0000","last_undegraded":"2024-09-10T08:42:29.378153+0000","last_fullsized":"2024-09-10T08:42:29.378153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394649+0000","last_change":"2024-09-10T08:42:28.371235+0000","last_active":"2024-09-10T08:42:29.394649+0000","last_peered":"2024-09-10T08:42:29.394649+0000","last_clean":"2024-09-10T08:42:29.394649+0000","last_became_active":"2024-09-10T08:42:28.370717+0000","last_became_peered":"2024-09-10T08:42:28.370717+0000","last_unstale":"2024-09-10T08:42:29.394649+0000","last_undegraded":"2024-09-10T08:42:29.394649+0000","last_fullsized":"2024-09-10T08:42:29.394649+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389665+0000","last_change":"2024-09-10T08:42:29.388578+0000","last_active":"2024-09-10T08:42:29.389665+0000","last_peered":"2024-09-10T08:42:29.389665+0000","last_clean":"2024-09-10T08:42:29.389665+0000","last_became_active":"2024-09-10T08:42:29.387485+0000","last_became_peered":"2024-09-10T08:42:29.387485+0000","last_unstale":"2024-09-10T08:42:29.389665+0000","last_undegraded":"2024-09-10T08:42:29.389665+0000","last_fullsized":"2024-09-10T08:42:29.389665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:30.985321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.359666+0000","last_change":"2024-09-10T08:42:28.366118+0000","last_active":"2024-09-10T08:42:29.359666+0000","last_peered":"2024-09-10T08:42:29.359666+0000","last_clean":"2024-09-10T08:42:29.359666+0000","last_became_active":"2024-09-10T08:42:28.365820+0000","last_became_peered":"2024-09-10T08:42:28.365820+0000","last_unstale":"2024-09-10T08:42:29.359666+0000","last_undegraded":"2024-09-10T08:42:29.359666+0000","last_fullsized":"2024-09-10T08:42:29.359666+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:15.022898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.358190+0000","last_change":"2024-09-10T08:42:28.358190+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.358190+0000","last_undegraded":"2024-09-10T08:42:28.358190+0000","last_fullsized":"2024-09-10T08:42:28.358190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393860+0000","last_change":"2024-09-10T08:42:28.369096+0000","last_active":"2024-09-10T08:42:29.393860+0000","last_peered":"2024-09-10T08:42:29.393860+0000","last_clean":"2024-09-10T08:42:29.393860+0000","last_became_active":"2024-09-10T08:42:28.367579+0000","last_became_peered":"2024-09-10T08:42:28.367579+0000","last_unstale":"2024-09-10T08:42:29.393860+0000","last_undegraded":"2024-09-10T08:42:29.393860+0000","last_fullsized":"2024-09-10T08:42:29.393860+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:34.790766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381174+0000","last_change":"2024-09-10T08:42:29.376975+0000","last_active":"2024-09-10T08:42:29.381174+0000","last_peered":"2024-09-10T08:42:29.381174+0000","last_clean":"2024-09-10T08:42:29.381174+0000","last_became_active":"2024-09-10T08:42:29.375816+0000","last_became_peered":"2024-09-10T08:42:29.375816+0000","last_unstale":"2024-09-10T08:42:29.381174+0000","last_undegraded":"2024-09-10T08:42:29.381174+0000","last_fullsized":"2024-09-10T08:42:29.381174+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370654+0000","last_change":"2024-09-10T08:42:28.365210+0000","last_active":"2024-09-10T08:42:29.370654+0000","last_peered":"2024-09-10T08:42:29.370654+0000","last_clean":"2024-09-10T08:42:29.370654+0000","last_became_active":"2024-09-10T08:42:28.364926+0000","last_became_peered":"2024-09-10T08:42:28.364926+0000","last_unstale":"2024-09-10T08:42:29.370654+0000","last_undegraded":"2024-09-10T08:42:29.370654+0000","last_fullsized":"2024-09-10T08:42:29.370654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:58.755691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377086+0000","last_change":"2024-09-10T08:42:29.375211+0000","last_active":"2024-09-10T08:42:29.377086+0000","last_peered":"2024-09-10T08:42:29.377086+0000","last_clean":"2024-09-10T08:42:29.377086+0000","last_became_active":"2024-09-10T08:42:29.374945+0000","last_became_peered":"2024-09-10T08:42:29.374945+0000","last_unstale":"2024-09-10T08:42:29.377086+0000","last_undegraded":"2024-09-10T08:42:29.377086+0000","last_fullsized":"2024-09-10T08:42:29.377086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.362732+0000","last_change":"2024-09-10T08:42:28.368260+0000","last_active":"2024-09-10T08:42:29.362732+0000","last_peered":"2024-09-10T08:42:29.362732+0000","last_clean":"2024-09-10T08:42:29.362732+0000","last_became_active":"2024-09-10T08:42:28.366958+0000","last_became_peered":"2024-09-10T08:42:28.366958+0000","last_unstale":"2024-09-10T08:42:29.362732+0000","last_undegraded":"2024-09-10T08:42:29.362732+0000","last_fullsized":"2024-09-10T08:42:29.362732+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388562+0000","last_change":"2024-09-10T08:42:29.387997+0000","last_active":"2024-09-10T08:42:29.388562+0000","last_peered":"2024-09-10T08:42:29.388562+0000","last_clean":"2024-09-10T08:42:29.388562+0000","last_became_active":"2024-09-10T08:42:29.387143+0000","last_became_peered":"2024-09-10T08:42:29.387143+0000","last_unstale":"2024-09-10T08:42:29.388562+0000","last_undegraded":"2024-09-10T08:42:29.388562+0000","last_fullsized":"2024-09-10T08:42:29.388562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360759+0000","last_change":"2024-09-10T08:42:28.373429+0000","last_active":"2024-09-10T08:42:29.360759+0000","last_peered":"2024-09-10T08:42:29.360759+0000","last_clean":"2024-09-10T08:42:29.360759+0000","last_became_active":"2024-09-10T08:42:28.373018+0000","last_became_peered":"2024-09-10T08:42:28.373018+0000","last_unstale":"2024-09-10T08:42:29.360759+0000","last_undegraded":"2024-09-10T08:42:29.360759+0000","last_fullsized":"2024-09-10T08:42:29.360759+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:55.127506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.360430+0000","last_change":"2024-09-10T08:42:28.360430+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.360430+0000","last_undegraded":"2024-09-10T08:42:28.360430+0000","last_fullsized":"2024-09-10T08:42:28.360430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.370467+0000","last_change":"2024-09-10T08:42:28.369947+0000","last_active":"2024-09-10T08:42:28.370467+0000","last_peered":"2024-09-10T08:42:28.370467+0000","last_clean":"2024-09-10T08:42:28.370467+0000","last_became_active":"2024-09-10T08:42:28.368829+0000","last_became_peered":"2024-09-10T08:42:28.368829+0000","last_unstale":"2024-09-10T08:42:28.370467+0000","last_undegraded":"2024-09-10T08:42:28.370467+0000","last_fullsized":"2024-09-10T08:42:28.370467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:00.951036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391197+0000","last_change":"2024-09-10T08:42:29.383681+0000","last_active":"2024-09-10T08:42:29.391197+0000","last_peered":"2024-09-10T08:42:29.391197+0000","last_clean":"2024-09-10T08:42:29.391197+0000","last_became_active":"2024-09-10T08:42:29.383061+0000","last_became_peered":"2024-09-10T08:42:29.383061+0000","last_unstale":"2024-09-10T08:42:29.391197+0000","last_undegraded":"2024-09-10T08:42:29.391197+0000","last_fullsized":"2024-09-10T08:42:29.391197+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:40.346099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391289+0000","last_change":"2024-09-10T08:42:28.372012+0000","last_active":"2024-09-10T08:42:29.391289+0000","last_peered":"2024-09-10T08:42:29.391289+0000","last_clean":"2024-09-10T08:42:29.391289+0000","last_became_active":"2024-09-10T08:42:28.371754+0000","last_became_peered":"2024-09-10T08:42:28.371754+0000","last_unstale":"2024-09-10T08:42:29.391289+0000","last_undegraded":"2024-09-10T08:42:29.391289+0000","last_fullsized":"2024-09-10T08:42:29.391289+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385489+0000","last_change":"2024-09-10T08:42:29.378781+0000","last_active":"2024-09-10T08:42:29.385489+0000","last_peered":"2024-09-10T08:42:29.385489+0000","last_clean":"2024-09-10T08:42:29.385489+0000","last_became_active":"2024-09-10T08:42:29.378509+0000","last_became_peered":"2024-09-10T08:42:29.378509+0000","last_unstale":"2024-09-10T08:42:29.385489+0000","last_undegraded":"2024-09-10T08:42:29.385489+0000","last_fullsized":"2024-09-10T08:42:29.385489+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:26.452775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353377+0000","last_change":"2024-09-10T08:42:28.361630+0000","last_active":"2024-09-10T08:42:29.353377+0000","last_peered":"2024-09-10T08:42:29.353377+0000","last_clean":"2024-09-10T08:42:29.353377+0000","last_became_active":"2024-09-10T08:42:28.358295+0000","last_became_peered":"2024-09-10T08:42:28.358295+0000","last_unstale":"2024-09-10T08:42:29.353377+0000","last_undegraded":"2024-09-10T08:42:29.353377+0000","last_fullsized":"2024-09-10T08:42:29.353377+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:21.406617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372202+0000","last_change":"2024-09-10T08:42:29.368037+0000","last_active":"2024-09-10T08:42:29.372202+0000","last_peered":"2024-09-10T08:42:29.372202+0000","last_clean":"2024-09-10T08:42:29.372202+0000","last_became_active":"2024-09-10T08:42:29.367522+0000","last_became_peered":"2024-09-10T08:42:29.367522+0000","last_unstale":"2024-09-10T08:42:29.372202+0000","last_undegraded":"2024-09-10T08:42:29.372202+0000","last_fullsized":"2024-09-10T08:42:29.372202+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361112+0000","last_change":"2024-09-10T08:42:28.370188+0000","last_active":"2024-09-10T08:42:29.361112+0000","last_peered":"2024-09-10T08:42:29.361112+0000","last_clean":"2024-09-10T08:42:29.361112+0000","last_became_active":"2024-09-10T08:42:28.369878+0000","last_became_peered":"2024-09-10T08:42:28.369878+0000","last_unstale":"2024-09-10T08:42:29.361112+0000","last_undegraded":"2024-09-10T08:42:29.361112+0000","last_fullsized":"2024-09-10T08:42:29.361112+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:27.034999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386671+0000","last_change":"2024-09-10T08:42:29.384764+0000","last_active":"2024-09-10T08:42:29.386671+0000","last_peered":"2024-09-10T08:42:29.386671+0000","last_clean":"2024-09-10T08:42:29.386671+0000","last_became_active":"2024-09-10T08:42:29.383341+0000","last_became_peered":"2024-09-10T08:42:29.383341+0000","last_unstale":"2024-09-10T08:42:29.386671+0000","last_undegraded":"2024-09-10T08:42:29.386671+0000","last_fullsized":"2024-09-10T08:42:29.386671+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:39.613196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.364278+0000","last_change":"2024-09-10T08:42:28.368721+0000","last_active":"2024-09-10T08:42:29.364278+0000","last_peered":"2024-09-10T08:42:29.364278+0000","last_clean":"2024-09-10T08:42:29.364278+0000","last_became_active":"2024-09-10T08:42:28.368451+0000","last_became_peered":"2024-09-10T08:42:28.368451+0000","last_unstale":"2024-09-10T08:42:29.364278+0000","last_undegraded":"2024-09-10T08:42:29.364278+0000","last_fullsized":"2024-09-10T08:42:29.364278+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386290+0000","last_change":"2024-09-10T08:42:29.383876+0000","last_active":"2024-09-10T08:42:29.386290+0000","last_peered":"2024-09-10T08:42:29.386290+0000","last_clean":"2024-09-10T08:42:29.386290+0000","last_became_active":"2024-09-10T08:42:29.383482+0000","last_became_peered":"2024-09-10T08:42:29.383482+0000","last_unstale":"2024-09-10T08:42:29.386290+0000","last_undegraded":"2024-09-10T08:42:29.386290+0000","last_fullsized":"2024-09-10T08:42:29.386290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:52.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.356275+0000","last_change":"2024-09-10T08:42:28.365843+0000","last_active":"2024-09-10T08:42:29.356275+0000","last_peered":"2024-09-10T08:42:29.356275+0000","last_clean":"2024-09-10T08:42:29.356275+0000","last_became_active":"2024-09-10T08:42:28.365472+0000","last_became_peered":"2024-09-10T08:42:28.365472+0000","last_unstale":"2024-09-10T08:42:29.356275+0000","last_undegraded":"2024-09-10T08:42:29.356275+0000","last_fullsized":"2024-09-10T08:42:29.356275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:30.588924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390402+0000","last_change":"2024-09-10T08:42:29.387773+0000","last_active":"2024-09-10T08:42:29.390402+0000","last_peered":"2024-09-10T08:42:29.390402+0000","last_clean":"2024-09-10T08:42:29.390402+0000","last_became_active":"2024-09-10T08:42:29.387377+0000","last_became_peered":"2024-09-10T08:42:29.387377+0000","last_unstale":"2024-09-10T08:42:29.390402+0000","last_undegraded":"2024-09-10T08:42:29.390402+0000","last_fullsized":"2024-09-10T08:42:29.390402+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361238+0000","last_change":"2024-09-10T08:42:28.361831+0000","last_active":"2024-09-10T08:42:29.361238+0000","last_peered":"2024-09-10T08:42:29.361238+0000","last_clean":"2024-09-10T08:42:29.361238+0000","last_became_active":"2024-09-10T08:42:28.360230+0000","last_became_peered":"2024-09-10T08:42:28.360230+0000","last_unstale":"2024-09-10T08:42:29.361238+0000","last_undegraded":"2024-09-10T08:42:29.361238+0000","last_fullsized":"2024-09-10T08:42:29.361238+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373931+0000","last_change":"2024-09-10T08:42:29.364854+0000","last_active":"2024-09-10T08:42:29.373931+0000","last_peered":"2024-09-10T08:42:29.373931+0000","last_clean":"2024-09-10T08:42:29.373931+0000","last_became_active":"2024-09-10T08:42:29.364185+0000","last_became_peered":"2024-09-10T08:42:29.364185+0000","last_unstale":"2024-09-10T08:42:29.373931+0000","last_undegraded":"2024-09-10T08:42:29.373931+0000","last_fullsized":"2024-09-10T08:42:29.373931+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385275+0000","last_change":"2024-09-10T08:42:28.371106+0000","last_active":"2024-09-10T08:42:29.385275+0000","last_peered":"2024-09-10T08:42:29.385275+0000","last_clean":"2024-09-10T08:42:29.385275+0000","last_became_active":"2024-09-10T08:42:28.370787+0000","last_became_peered":"2024-09-10T08:42:28.370787+0000","last_unstale":"2024-09-10T08:42:29.385275+0000","last_undegraded":"2024-09-10T08:42:29.385275+0000","last_fullsized":"2024-09-10T08:42:29.385275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:40.197098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373800+0000","last_change":"2024-09-10T08:42:29.364367+0000","last_active":"2024-09-10T08:42:29.373800+0000","last_peered":"2024-09-10T08:42:29.373800+0000","last_clean":"2024-09-10T08:42:29.373800+0000","last_became_active":"2024-09-10T08:42:29.364048+0000","last_became_peered":"2024-09-10T08:42:29.364048+0000","last_unstale":"2024-09-10T08:42:29.373800+0000","last_undegraded":"2024-09-10T08:42:29.373800+0000","last_fullsized":"2024-09-10T08:42:29.373800+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.395734+0000","last_change":"2024-09-10T08:42:28.374827+0000","last_active":"2024-09-10T08:42:29.395734+0000","last_peered":"2024-09-10T08:42:29.395734+0000","last_clean":"2024-09-10T08:42:29.395734+0000","last_became_active":"2024-09-10T08:42:28.374529+0000","last_became_peered":"2024-09-10T08:42:28.374529+0000","last_unstale":"2024-09-10T08:42:29.395734+0000","last_undegraded":"2024-09-10T08:42:29.395734+0000","last_fullsized":"2024-09-10T08:42:29.395734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384457+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:42:29.384457+0000","last_peered":"2024-09-10T08:42:29.384457+0000","last_clean":"2024-09-10T08:42:29.384457+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:42:29.384457+0000","last_undegraded":"2024-09-10T08:42:29.384457+0000","last_fullsized":"2024-09-10T08:42:29.384457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1074415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1073867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509609,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509610,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69596,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302244,"statfs":{"total":96636764160,"available":96565497856,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2445312,"data_stored":1073777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509610,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55788,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2441216,"data_stored":1073743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60508,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311332,"statfs":{"total":96636764160,"available":96574803968,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:42:33.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:42:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.191+0000 7fe380c00640 1 Processor -- start 2024-09-10T08:42:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.191+0000 7fe380c00640 1 -- start start 2024-09-10T08:42:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c15e440 0x7fe37c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe37c0cf450 0x7fe37c0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe37c0b6540 0x7fe37c06bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe37c0b69b0 con 0x7fe37c0b6540 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe37c0d3990 con 0x7fe37c0cf450 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe380c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c0d3c70 con 0x7fe37c15e440 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe37be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe37c0b6540 0x7fe37c06bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe37be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe37c0b6540 0x7fe37c06bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49986/0 (socket says 172.21.15.52:49986) 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe37be00640 1 -- 172.21.15.52:0/54999263 learned_addr learned my addr 172.21.15.52:0/54999263 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.192+0000 7fe373e00640 1 --2- 172.21.15.52:0/54999263 >> v2:172.21.15.176:3300/0 conn(0x7fe37c0cf450 0x7fe37c0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37b400640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c15e440 0x7fe37c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37be00640 1 -- 172.21.15.52:0/54999263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c15e440 msgr2=0x7fe37c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37be00640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c15e440 0x7fe37c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37be00640 1 -- 172.21.15.52:0/54999263 >> v2:172.21.15.176:3300/0 conn(0x7fe37c0cf450 msgr2=0x7fe37c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37be00640 1 --2- 172.21.15.52:0/54999263 >> v2:172.21.15.176:3300/0 conn(0x7fe37c0cf450 0x7fe37c0b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.193+0000 7fe37be00640 1 -- 172.21.15.52:0/54999263 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c0d3f50 con 0x7fe37c0b6540 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.194+0000 7fe37be00640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0b6540 0x7fe37c06bf40 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0d3ba0 tx=0x7fe37402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b40a74db680082 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.194+0000 7fe37aa00640 1 -- 172.21.15.52:0/54999263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374036070 con 0x7fe37c0b6540 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.194+0000 7fe37aa00640 1 -- 172.21.15.52:0/54999263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe374031600 con 0x7fe37c0b6540 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.194+0000 7fe37aa00640 1 -- 172.21.15.52:0/54999263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3740319d0 con 0x7fe37c0b6540 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 -- 172.21.15.52:0/54999263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0b6540 msgr2=0x7fe37c06bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0b6540 0x7fe37c06bf40 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0d3ba0 tx=0x7fe37402a710 comp rx=0 tx=0).stop 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 -- 172.21.15.52:0/54999263 shutdown_connections 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 --2- 172.21.15.52:0/54999263 >> v2:172.21.15.176:3300/0 conn(0x7fe37c0cf450 0x7fe37c0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0b6540 0x7fe37c06bf40 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 --2- 172.21.15.52:0/54999263 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c15e440 0x7fe37c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 -- 172.21.15.52:0/54999263 >> 172.21.15.52:0/54999263 conn(0x7fe37c067f80 msgr2=0x7fe37c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 -- 172.21.15.52:0/54999263 shutdown_connections 2024-09-10T08:42:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.195+0000 7fe380c00640 1 -- 172.21.15.52:0/54999263 wait complete. 2024-09-10T08:42:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.196+0000 7fe380c00640 1 Processor -- start 2024-09-10T08:42:34.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 -- start start 2024-09-10T08:42:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 0x7fe37c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe37c15e440 0x7fe37c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c0b7540 con 0x7fe37c0cf450 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c15e820 con 0x7fe37c15e440 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.197+0000 7fe380c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c0b76c0 con 0x7fe37c0b6540 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49990/0 (socket says 172.21.15.52:49990) 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 -- 172.21.15.52:0/608921454 learned_addr learned my addr 172.21.15.52:0/608921454 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe37b400640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 0x7fe37c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe37be00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe37c15e440 0x7fe37c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 -- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 msgr2=0x7fe37c0adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 0x7fe37c0adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 -- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe37c15e440 msgr2=0x7fe37c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe37c15e440 0x7fe37c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 -- 172.21.15.52:0/608921454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c1f5160 con 0x7fe37c0cf450 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe37b400640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 0x7fe37c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.198+0000 7fe373e00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e9e0 tx=0x7fe36400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.199+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364017070 con 0x7fe37c0cf450 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.199+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe36400c9d0 con 0x7fe37c0cf450 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.199+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36400cdc0 con 0x7fe37c0cf450 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.199+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c1f7c50 con 0x7fe37c0cf450 2024-09-10T08:42:34.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.199+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1f8730 con 0x7fe37c0cf450 2024-09-10T08:42:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.200+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c0b6000 con 0x7fe37c0cf450 2024-09-10T08:42:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.201+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe36401a070 con 0x7fe37c0cf450 2024-09-10T08:42:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.201+0000 7fe373400640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 0x7fe35806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.202+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fe36408b240 con 0x7fe37c0cf450 2024-09-10T08:42:34.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.202+0000 7fe37b400640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 0x7fe35806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.203+0000 7fe37b400640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 0x7fe35806e2f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009a70 tx=0x7fe36c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.206+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe364059be0 con 0x7fe37c0cf450 2024-09-10T08:42:34.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.392+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe37c0b4af0 con 0x7fe35806be30 2024-09-10T08:42:34.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.399+0000 7fe373400640 1 -- 172.21.15.52:0/608921454 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7fe37c0b4af0 con 0x7fe35806be30 2024-09-10T08:42:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:34.404 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:42:34.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 msgr2=0x7fe35806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 0x7fe35806e2f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009a70 tx=0x7fe36c008040 comp rx=0 tx=0).stop 2024-09-10T08:42:34.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 msgr2=0x7fe37c0b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fe36400e9e0 tx=0x7fe36400eea0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 shutdown_connections 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe35806be30 0x7fe35806e2f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe37c15e440 0x7fe37c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe37c0cf450 0x7fe37c0b20c0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 --2- 172.21.15.52:0/608921454 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe37c0b6540 0x7fe37c0adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 >> 172.21.15.52:0/608921454 conn(0x7fe37c067f80 msgr2=0x7fe37c0d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 shutdown_connections 2024-09-10T08:42:34.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.404+0000 7fe380c00640 1 -- 172.21.15.52:0/608921454 wait complete. 2024-09-10T08:42:34.421 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":608,"stamp":"2024-09-10T08:42:33.662335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461232,"kb_used_data":20204,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513488,"statfs":{"total":773094113280,"available":772621811712,"internally_reserved":0,"allocated":20688896,"data_stored":9744410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001396"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391220+0000","last_change":"2024-09-10T08:42:29.385887+0000","last_active":"2024-09-10T08:42:29.391220+0000","last_peered":"2024-09-10T08:42:29.391220+0000","last_clean":"2024-09-10T08:42:29.391220+0000","last_became_active":"2024-09-10T08:42:29.383384+0000","last_became_peered":"2024-09-10T08:42:29.383384+0000","last_unstale":"2024-09-10T08:42:29.391220+0000","last_undegraded":"2024-09-10T08:42:29.391220+0000","last_fullsized":"2024-09-10T08:42:29.391220+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:27.665416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390710+0000","last_change":"2024-09-10T08:42:29.388781+0000","last_active":"2024-09-10T08:42:29.390710+0000","last_peered":"2024-09-10T08:42:29.390710+0000","last_clean":"2024-09-10T08:42:29.390710+0000","last_became_active":"2024-09-10T08:42:29.388292+0000","last_became_peered":"2024-09-10T08:42:29.388292+0000","last_unstale":"2024-09-10T08:42:29.390710+0000","last_undegraded":"2024-09-10T08:42:29.390710+0000","last_fullsized":"2024-09-10T08:42:29.390710+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372275+0000","last_change":"2024-09-10T08:42:29.367007+0000","last_active":"2024-09-10T08:42:29.372275+0000","last_peered":"2024-09-10T08:42:29.372275+0000","last_clean":"2024-09-10T08:42:29.372275+0000","last_became_active":"2024-09-10T08:42:29.366713+0000","last_became_peered":"2024-09-10T08:42:29.366713+0000","last_unstale":"2024-09-10T08:42:29.372275+0000","last_undegraded":"2024-09-10T08:42:29.372275+0000","last_fullsized":"2024-09-10T08:42:29.372275+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:48.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368733+0000","last_change":"2024-09-10T08:42:29.366363+0000","last_active":"2024-09-10T08:42:29.368733+0000","last_peered":"2024-09-10T08:42:29.368733+0000","last_clean":"2024-09-10T08:42:29.368733+0000","last_became_active":"2024-09-10T08:42:29.366094+0000","last_became_peered":"2024-09-10T08:42:29.366094+0000","last_unstale":"2024-09-10T08:42:29.368733+0000","last_undegraded":"2024-09-10T08:42:29.368733+0000","last_fullsized":"2024-09-10T08:42:29.368733+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:04.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368259+0000","last_change":"2024-09-10T08:42:29.365511+0000","last_active":"2024-09-10T08:42:29.368259+0000","last_peered":"2024-09-10T08:42:29.368259+0000","last_clean":"2024-09-10T08:42:29.368259+0000","last_became_active":"2024-09-10T08:42:29.362055+0000","last_became_peered":"2024-09-10T08:42:29.362055+0000","last_unstale":"2024-09-10T08:42:29.368259+0000","last_undegraded":"2024-09-10T08:42:29.368259+0000","last_fullsized":"2024-09-10T08:42:29.368259+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368289+0000","last_change":"2024-09-10T08:42:29.362962+0000","last_active":"2024-09-10T08:42:29.368289+0000","last_peered":"2024-09-10T08:42:29.368289+0000","last_clean":"2024-09-10T08:42:29.368289+0000","last_became_active":"2024-09-10T08:42:29.362665+0000","last_became_peered":"2024-09-10T08:42:29.362665+0000","last_unstale":"2024-09-10T08:42:29.368289+0000","last_undegraded":"2024-09-10T08:42:29.368289+0000","last_fullsized":"2024-09-10T08:42:29.368289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:55.712843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375949+0000","last_change":"2024-09-10T08:42:29.373037+0000","last_active":"2024-09-10T08:42:29.375949+0000","last_peered":"2024-09-10T08:42:29.375949+0000","last_clean":"2024-09-10T08:42:29.375949+0000","last_became_active":"2024-09-10T08:42:29.372745+0000","last_became_peered":"2024-09-10T08:42:29.372745+0000","last_unstale":"2024-09-10T08:42:29.375949+0000","last_undegraded":"2024-09-10T08:42:29.375949+0000","last_fullsized":"2024-09-10T08:42:29.375949+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:54.772249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.376620+0000","last_change":"2024-09-10T08:42:29.375322+0000","last_active":"2024-09-10T08:42:29.376620+0000","last_peered":"2024-09-10T08:42:29.376620+0000","last_clean":"2024-09-10T08:42:29.376620+0000","last_became_active":"2024-09-10T08:42:29.375050+0000","last_became_peered":"2024-09-10T08:42:29.375050+0000","last_unstale":"2024-09-10T08:42:29.376620+0000","last_undegraded":"2024-09-10T08:42:29.376620+0000","last_fullsized":"2024-09-10T08:42:29.376620+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.379615+0000","last_change":"2024-09-10T08:42:29.372907+0000","last_active":"2024-09-10T08:42:29.379615+0000","last_peered":"2024-09-10T08:42:29.379615+0000","last_clean":"2024-09-10T08:42:29.379615+0000","last_became_active":"2024-09-10T08:42:29.371130+0000","last_became_peered":"2024-09-10T08:42:29.371130+0000","last_unstale":"2024-09-10T08:42:29.379615+0000","last_undegraded":"2024-09-10T08:42:29.379615+0000","last_fullsized":"2024-09-10T08:42:29.379615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370658+0000","last_change":"2024-09-10T08:42:29.366985+0000","last_active":"2024-09-10T08:42:29.370658+0000","last_peered":"2024-09-10T08:42:29.370658+0000","last_clean":"2024-09-10T08:42:29.370658+0000","last_became_active":"2024-09-10T08:42:29.366690+0000","last_became_peered":"2024-09-10T08:42:29.366690+0000","last_unstale":"2024-09-10T08:42:29.370658+0000","last_undegraded":"2024-09-10T08:42:29.370658+0000","last_fullsized":"2024-09-10T08:42:29.370658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382997+0000","last_change":"2024-09-10T08:42:29.380452+0000","last_active":"2024-09-10T08:42:29.382997+0000","last_peered":"2024-09-10T08:42:29.382997+0000","last_clean":"2024-09-10T08:42:29.382997+0000","last_became_active":"2024-09-10T08:42:29.379753+0000","last_became_peered":"2024-09-10T08:42:29.379753+0000","last_unstale":"2024-09-10T08:42:29.382997+0000","last_undegraded":"2024-09-10T08:42:29.382997+0000","last_fullsized":"2024-09-10T08:42:29.382997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381298+0000","last_change":"2024-09-10T08:42:29.377573+0000","last_active":"2024-09-10T08:42:29.381298+0000","last_peered":"2024-09-10T08:42:29.381298+0000","last_clean":"2024-09-10T08:42:29.381298+0000","last_became_active":"2024-09-10T08:42:29.377309+0000","last_became_peered":"2024-09-10T08:42:29.377309+0000","last_unstale":"2024-09-10T08:42:29.381298+0000","last_undegraded":"2024-09-10T08:42:29.381298+0000","last_fullsized":"2024-09-10T08:42:29.381298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392289+0000","last_change":"2024-09-10T08:42:29.384443+0000","last_active":"2024-09-10T08:42:29.392289+0000","last_peered":"2024-09-10T08:42:29.392289+0000","last_clean":"2024-09-10T08:42:29.392289+0000","last_became_active":"2024-09-10T08:42:29.384157+0000","last_became_peered":"2024-09-10T08:42:29.384157+0000","last_unstale":"2024-09-10T08:42:29.392289+0000","last_undegraded":"2024-09-10T08:42:29.392289+0000","last_fullsized":"2024-09-10T08:42:29.392289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:54.237300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378176+0000","last_change":"2024-09-10T08:42:29.368203+0000","last_active":"2024-09-10T08:42:29.378176+0000","last_peered":"2024-09-10T08:42:29.378176+0000","last_clean":"2024-09-10T08:42:29.378176+0000","last_became_active":"2024-09-10T08:42:29.367829+0000","last_became_peered":"2024-09-10T08:42:29.367829+0000","last_unstale":"2024-09-10T08:42:29.378176+0000","last_undegraded":"2024-09-10T08:42:29.378176+0000","last_fullsized":"2024-09-10T08:42:29.378176+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.493836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.366216+0000","last_change":"2024-09-10T08:42:29.361268+0000","last_active":"2024-09-10T08:42:29.366216+0000","last_peered":"2024-09-10T08:42:29.366216+0000","last_clean":"2024-09-10T08:42:29.366216+0000","last_became_active":"2024-09-10T08:42:29.360989+0000","last_became_peered":"2024-09-10T08:42:29.360989+0000","last_unstale":"2024-09-10T08:42:29.366216+0000","last_undegraded":"2024-09-10T08:42:29.366216+0000","last_fullsized":"2024-09-10T08:42:29.366216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:54.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.374189+0000","last_change":"2024-09-10T08:42:29.365642+0000","last_active":"2024-09-10T08:42:29.374189+0000","last_peered":"2024-09-10T08:42:29.374189+0000","last_clean":"2024-09-10T08:42:29.374189+0000","last_became_active":"2024-09-10T08:42:29.358997+0000","last_became_peered":"2024-09-10T08:42:29.358997+0000","last_unstale":"2024-09-10T08:42:29.374189+0000","last_undegraded":"2024-09-10T08:42:29.374189+0000","last_fullsized":"2024-09-10T08:42:29.374189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386658+0000","last_change":"2024-09-10T08:42:29.383360+0000","last_active":"2024-09-10T08:42:29.386658+0000","last_peered":"2024-09-10T08:42:29.386658+0000","last_clean":"2024-09-10T08:42:29.386658+0000","last_became_active":"2024-09-10T08:42:29.380706+0000","last_became_peered":"2024-09-10T08:42:29.380706+0000","last_unstale":"2024-09-10T08:42:29.386658+0000","last_undegraded":"2024-09-10T08:42:29.386658+0000","last_fullsized":"2024-09-10T08:42:29.386658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:45.709011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.363033+0000","last_change":"2024-09-10T08:42:28.363033+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.363033+0000","last_undegraded":"2024-09-10T08:42:28.363033+0000","last_fullsized":"2024-09-10T08:42:28.363033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375595+0000","last_change":"2024-09-10T08:42:29.370587+0000","last_active":"2024-09-10T08:42:29.375595+0000","last_peered":"2024-09-10T08:42:29.375595+0000","last_clean":"2024-09-10T08:42:29.375595+0000","last_became_active":"2024-09-10T08:42:29.368564+0000","last_became_peered":"2024-09-10T08:42:29.368564+0000","last_unstale":"2024-09-10T08:42:29.375595+0000","last_undegraded":"2024-09-10T08:42:29.375595+0000","last_fullsized":"2024-09-10T08:42:29.375595+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.401473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.361855+0000","last_change":"2024-09-10T08:42:28.361855+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.361855+0000","last_undegraded":"2024-09-10T08:42:28.361855+0000","last_fullsized":"2024-09-10T08:42:28.361855+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.359126+0000","last_change":"2024-09-10T08:42:28.359126+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.359126+0000","last_undegraded":"2024-09-10T08:42:28.359126+0000","last_fullsized":"2024-09-10T08:42:28.359126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388704+0000","last_change":"2024-09-10T08:42:29.388085+0000","last_active":"2024-09-10T08:42:29.388704+0000","last_peered":"2024-09-10T08:42:29.388704+0000","last_clean":"2024-09-10T08:42:29.388704+0000","last_became_active":"2024-09-10T08:42:29.387481+0000","last_became_peered":"2024-09-10T08:42:29.387481+0000","last_unstale":"2024-09-10T08:42:29.388704+0000","last_undegraded":"2024-09-10T08:42:29.388704+0000","last_fullsized":"2024-09-10T08:42:29.388704+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:18.086767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391499+0000","last_change":"2024-09-10T08:42:29.386980+0000","last_active":"2024-09-10T08:42:29.391499+0000","last_peered":"2024-09-10T08:42:29.391499+0000","last_clean":"2024-09-10T08:42:29.391499+0000","last_became_active":"2024-09-10T08:42:29.386230+0000","last_became_peered":"2024-09-10T08:42:29.386230+0000","last_unstale":"2024-09-10T08:42:29.391499+0000","last_undegraded":"2024-09-10T08:42:29.391499+0000","last_fullsized":"2024-09-10T08:42:29.391499+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:28.038178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368228+0000","last_change":"2024-09-10T08:42:29.365247+0000","last_active":"2024-09-10T08:42:29.368228+0000","last_peered":"2024-09-10T08:42:29.368228+0000","last_clean":"2024-09-10T08:42:29.368228+0000","last_became_active":"2024-09-10T08:42:29.365006+0000","last_became_peered":"2024-09-10T08:42:29.365006+0000","last_unstale":"2024-09-10T08:42:29.368228+0000","last_undegraded":"2024-09-10T08:42:29.368228+0000","last_fullsized":"2024-09-10T08:42:29.368228+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:21.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382728+0000","last_change":"2024-09-10T08:42:29.380286+0000","last_active":"2024-09-10T08:42:29.382728+0000","last_peered":"2024-09-10T08:42:29.382728+0000","last_clean":"2024-09-10T08:42:29.382728+0000","last_became_active":"2024-09-10T08:42:29.379995+0000","last_became_peered":"2024-09-10T08:42:29.379995+0000","last_unstale":"2024-09-10T08:42:29.382728+0000","last_undegraded":"2024-09-10T08:42:29.382728+0000","last_fullsized":"2024-09-10T08:42:29.382728+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377613+0000","last_change":"2024-09-10T08:42:29.375078+0000","last_active":"2024-09-10T08:42:29.377613+0000","last_peered":"2024-09-10T08:42:29.377613+0000","last_clean":"2024-09-10T08:42:29.377613+0000","last_became_active":"2024-09-10T08:42:29.373435+0000","last_became_peered":"2024-09-10T08:42:29.373435+0000","last_unstale":"2024-09-10T08:42:29.377613+0000","last_undegraded":"2024-09-10T08:42:29.377613+0000","last_fullsized":"2024-09-10T08:42:29.377613+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:30.490305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383430+0000","last_change":"2024-09-10T08:42:29.380722+0000","last_active":"2024-09-10T08:42:29.383430+0000","last_peered":"2024-09-10T08:42:29.383430+0000","last_clean":"2024-09-10T08:42:29.383430+0000","last_became_active":"2024-09-10T08:42:29.380128+0000","last_became_peered":"2024-09-10T08:42:29.380128+0000","last_unstale":"2024-09-10T08:42:29.383430+0000","last_undegraded":"2024-09-10T08:42:29.383430+0000","last_fullsized":"2024-09-10T08:42:29.383430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375864+0000","last_change":"2024-09-10T08:42:29.372114+0000","last_active":"2024-09-10T08:42:29.375864+0000","last_peered":"2024-09-10T08:42:29.375864+0000","last_clean":"2024-09-10T08:42:29.375864+0000","last_became_active":"2024-09-10T08:42:29.371781+0000","last_became_peered":"2024-09-10T08:42:29.371781+0000","last_unstale":"2024-09-10T08:42:29.375864+0000","last_undegraded":"2024-09-10T08:42:29.375864+0000","last_fullsized":"2024-09-10T08:42:29.375864+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381151+0000","last_change":"2024-09-10T08:42:29.375856+0000","last_active":"2024-09-10T08:42:29.381151+0000","last_peered":"2024-09-10T08:42:29.381151+0000","last_clean":"2024-09-10T08:42:29.381151+0000","last_became_active":"2024-09-10T08:42:29.375593+0000","last_became_peered":"2024-09-10T08:42:29.375593+0000","last_unstale":"2024-09-10T08:42:29.381151+0000","last_undegraded":"2024-09-10T08:42:29.381151+0000","last_fullsized":"2024-09-10T08:42:29.381151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389201+0000","last_change":"2024-09-10T08:42:29.388359+0000","last_active":"2024-09-10T08:42:29.389201+0000","last_peered":"2024-09-10T08:42:29.389201+0000","last_clean":"2024-09-10T08:42:29.389201+0000","last_became_active":"2024-09-10T08:42:29.388047+0000","last_became_peered":"2024-09-10T08:42:29.388047+0000","last_unstale":"2024-09-10T08:42:29.389201+0000","last_undegraded":"2024-09-10T08:42:29.389201+0000","last_fullsized":"2024-09-10T08:42:29.389201+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.357072+0000","last_change":"2024-09-10T08:42:28.357072+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.357072+0000","last_undegraded":"2024-09-10T08:42:28.357072+0000","last_fullsized":"2024-09-10T08:42:28.357072+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383353+0000","last_change":"2024-09-10T08:42:29.382521+0000","last_active":"2024-09-10T08:42:29.383353+0000","last_peered":"2024-09-10T08:42:29.383353+0000","last_clean":"2024-09-10T08:42:29.383353+0000","last_became_active":"2024-09-10T08:42:29.382070+0000","last_became_peered":"2024-09-10T08:42:29.382070+0000","last_unstale":"2024-09-10T08:42:29.383353+0000","last_undegraded":"2024-09-10T08:42:29.383353+0000","last_fullsized":"2024-09-10T08:42:29.383353+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390692+0000","last_change":"2024-09-10T08:42:29.388579+0000","last_active":"2024-09-10T08:42:29.390692+0000","last_peered":"2024-09-10T08:42:29.390692+0000","last_clean":"2024-09-10T08:42:29.390692+0000","last_became_active":"2024-09-10T08:42:29.387955+0000","last_became_peered":"2024-09-10T08:42:29.387955+0000","last_unstale":"2024-09-10T08:42:29.390692+0000","last_undegraded":"2024-09-10T08:42:29.390692+0000","last_fullsized":"2024-09-10T08:42:29.390692+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"194'4","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.387578+0000","last_change":"2024-09-10T08:42:28.372955+0000","last_active":"2024-09-10T08:42:29.387578+0000","last_peered":"2024-09-10T08:42:29.387578+0000","last_clean":"2024-09-10T08:42:29.387578+0000","last_became_active":"2024-09-10T08:42:28.372574+0000","last_became_peered":"2024-09-10T08:42:28.372574+0000","last_unstale":"2024-09-10T08:42:29.387578+0000","last_undegraded":"2024-09-10T08:42:29.387578+0000","last_fullsized":"2024-09-10T08:42:29.387578+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:26.918397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384459+0000","last_change":"2024-09-10T08:42:29.383975+0000","last_active":"2024-09-10T08:42:29.384459+0000","last_peered":"2024-09-10T08:42:29.384459+0000","last_clean":"2024-09-10T08:42:29.384459+0000","last_became_active":"2024-09-10T08:42:29.383653+0000","last_became_peered":"2024-09-10T08:42:29.383653+0000","last_unstale":"2024-09-10T08:42:29.384459+0000","last_undegraded":"2024-09-10T08:42:29.384459+0000","last_fullsized":"2024-09-10T08:42:29.384459+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:38.555871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394413+0000","last_change":"2024-09-10T08:42:28.369545+0000","last_active":"2024-09-10T08:42:29.394413+0000","last_peered":"2024-09-10T08:42:29.394413+0000","last_clean":"2024-09-10T08:42:29.394413+0000","last_became_active":"2024-09-10T08:42:28.369294+0000","last_became_peered":"2024-09-10T08:42:28.369294+0000","last_unstale":"2024-09-10T08:42:29.394413+0000","last_undegraded":"2024-09-10T08:42:29.394413+0000","last_fullsized":"2024-09-10T08:42:29.394413+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389643+0000","last_change":"2024-09-10T08:42:29.388371+0000","last_active":"2024-09-10T08:42:29.389643+0000","last_peered":"2024-09-10T08:42:29.389643+0000","last_clean":"2024-09-10T08:42:29.389643+0000","last_became_active":"2024-09-10T08:42:29.387376+0000","last_became_peered":"2024-09-10T08:42:29.387376+0000","last_unstale":"2024-09-10T08:42:29.389643+0000","last_undegraded":"2024-09-10T08:42:29.389643+0000","last_fullsized":"2024-09-10T08:42:29.389643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382489+0000","last_change":"2024-09-10T08:42:28.360994+0000","last_active":"2024-09-10T08:42:29.382489+0000","last_peered":"2024-09-10T08:42:29.382489+0000","last_clean":"2024-09-10T08:42:29.382489+0000","last_became_active":"2024-09-10T08:42:28.360662+0000","last_became_peered":"2024-09-10T08:42:28.360662+0000","last_unstale":"2024-09-10T08:42:29.382489+0000","last_undegraded":"2024-09-10T08:42:29.382489+0000","last_fullsized":"2024-09-10T08:42:29.382489+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:03.922764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390423+0000","last_change":"2024-09-10T08:42:29.388335+0000","last_active":"2024-09-10T08:42:29.390423+0000","last_peered":"2024-09-10T08:42:29.390423+0000","last_clean":"2024-09-10T08:42:29.390423+0000","last_became_active":"2024-09-10T08:42:29.387186+0000","last_became_peered":"2024-09-10T08:42:29.387186+0000","last_unstale":"2024-09-10T08:42:29.390423+0000","last_undegraded":"2024-09-10T08:42:29.390423+0000","last_fullsized":"2024-09-10T08:42:29.390423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372480+0000","last_change":"2024-09-10T08:42:28.358867+0000","last_active":"2024-09-10T08:42:29.372480+0000","last_peered":"2024-09-10T08:42:29.372480+0000","last_clean":"2024-09-10T08:42:29.372480+0000","last_became_active":"2024-09-10T08:42:28.358299+0000","last_became_peered":"2024-09-10T08:42:28.358299+0000","last_unstale":"2024-09-10T08:42:29.372480+0000","last_undegraded":"2024-09-10T08:42:29.372480+0000","last_fullsized":"2024-09-10T08:42:29.372480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:04.222556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388672+0000","last_change":"2024-09-10T08:42:29.387982+0000","last_active":"2024-09-10T08:42:29.388672+0000","last_peered":"2024-09-10T08:42:29.388672+0000","last_clean":"2024-09-10T08:42:29.388672+0000","last_became_active":"2024-09-10T08:42:29.387636+0000","last_became_peered":"2024-09-10T08:42:29.387636+0000","last_unstale":"2024-09-10T08:42:29.388672+0000","last_undegraded":"2024-09-10T08:42:29.388672+0000","last_fullsized":"2024-09-10T08:42:29.388672+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:40.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392957+0000","last_change":"2024-09-10T08:42:28.374924+0000","last_active":"2024-09-10T08:42:29.392957+0000","last_peered":"2024-09-10T08:42:29.392957+0000","last_clean":"2024-09-10T08:42:29.392957+0000","last_became_active":"2024-09-10T08:42:28.374637+0000","last_became_peered":"2024-09-10T08:42:28.374637+0000","last_unstale":"2024-09-10T08:42:29.392957+0000","last_undegraded":"2024-09-10T08:42:29.392957+0000","last_fullsized":"2024-09-10T08:42:29.392957+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380123+0000","last_change":"2024-09-10T08:42:29.379574+0000","last_active":"2024-09-10T08:42:29.380123+0000","last_peered":"2024-09-10T08:42:29.380123+0000","last_clean":"2024-09-10T08:42:29.380123+0000","last_became_active":"2024-09-10T08:42:29.379202+0000","last_became_peered":"2024-09-10T08:42:29.379202+0000","last_unstale":"2024-09-10T08:42:29.380123+0000","last_undegraded":"2024-09-10T08:42:29.380123+0000","last_fullsized":"2024-09-10T08:42:29.380123+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:51.653936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353194+0000","last_change":"2024-09-10T08:42:28.356438+0000","last_active":"2024-09-10T08:42:29.353194+0000","last_peered":"2024-09-10T08:42:29.353194+0000","last_clean":"2024-09-10T08:42:29.353194+0000","last_became_active":"2024-09-10T08:42:28.356140+0000","last_became_peered":"2024-09-10T08:42:28.356140+0000","last_unstale":"2024-09-10T08:42:29.353194+0000","last_undegraded":"2024-09-10T08:42:29.353194+0000","last_fullsized":"2024-09-10T08:42:29.353194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391478+0000","last_change":"2024-09-10T08:42:29.386977+0000","last_active":"2024-09-10T08:42:29.391478+0000","last_peered":"2024-09-10T08:42:29.391478+0000","last_clean":"2024-09-10T08:42:29.391478+0000","last_became_active":"2024-09-10T08:42:29.385141+0000","last_became_peered":"2024-09-10T08:42:29.385141+0000","last_unstale":"2024-09-10T08:42:29.391478+0000","last_undegraded":"2024-09-10T08:42:29.391478+0000","last_fullsized":"2024-09-10T08:42:29.391478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.130684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.367066+0000","last_change":"2024-09-10T08:42:28.365813+0000","last_active":"2024-09-10T08:42:28.367066+0000","last_peered":"2024-09-10T08:42:28.367066+0000","last_clean":"2024-09-10T08:42:28.367066+0000","last_became_active":"2024-09-10T08:42:28.365458+0000","last_became_peered":"2024-09-10T08:42:28.365458+0000","last_unstale":"2024-09-10T08:42:28.367066+0000","last_undegraded":"2024-09-10T08:42:28.367066+0000","last_fullsized":"2024-09-10T08:42:28.367066+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:33.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390318+0000","last_change":"2024-09-10T08:42:29.389734+0000","last_active":"2024-09-10T08:42:29.390318+0000","last_peered":"2024-09-10T08:42:29.390318+0000","last_clean":"2024-09-10T08:42:29.390318+0000","last_became_active":"2024-09-10T08:42:29.389260+0000","last_became_peered":"2024-09-10T08:42:29.389260+0000","last_unstale":"2024-09-10T08:42:29.390318+0000","last_undegraded":"2024-09-10T08:42:29.390318+0000","last_fullsized":"2024-09-10T08:42:29.390318+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:01.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390920+0000","last_change":"2024-09-10T08:42:28.372691+0000","last_active":"2024-09-10T08:42:29.390920+0000","last_peered":"2024-09-10T08:42:29.390920+0000","last_clean":"2024-09-10T08:42:29.390920+0000","last_became_active":"2024-09-10T08:42:28.372367+0000","last_became_peered":"2024-09-10T08:42:28.372367+0000","last_unstale":"2024-09-10T08:42:29.390920+0000","last_undegraded":"2024-09-10T08:42:29.390920+0000","last_fullsized":"2024-09-10T08:42:29.390920+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383027+0000","last_change":"2024-09-10T08:42:29.380637+0000","last_active":"2024-09-10T08:42:29.383027+0000","last_peered":"2024-09-10T08:42:29.383027+0000","last_clean":"2024-09-10T08:42:29.383027+0000","last_became_active":"2024-09-10T08:42:29.380035+0000","last_became_peered":"2024-09-10T08:42:29.380035+0000","last_unstale":"2024-09-10T08:42:29.383027+0000","last_undegraded":"2024-09-10T08:42:29.383027+0000","last_fullsized":"2024-09-10T08:42:29.383027+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360806+0000","last_change":"2024-09-10T08:42:28.361429+0000","last_active":"2024-09-10T08:42:29.360806+0000","last_peered":"2024-09-10T08:42:29.360806+0000","last_clean":"2024-09-10T08:42:29.360806+0000","last_became_active":"2024-09-10T08:42:28.361128+0000","last_became_peered":"2024-09-10T08:42:28.361128+0000","last_unstale":"2024-09-10T08:42:29.360806+0000","last_undegraded":"2024-09-10T08:42:29.360806+0000","last_fullsized":"2024-09-10T08:42:29.360806+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.109808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381251+0000","last_change":"2024-09-10T08:42:29.377162+0000","last_active":"2024-09-10T08:42:29.381251+0000","last_peered":"2024-09-10T08:42:29.381251+0000","last_clean":"2024-09-10T08:42:29.381251+0000","last_became_active":"2024-09-10T08:42:29.376654+0000","last_became_peered":"2024-09-10T08:42:29.376654+0000","last_unstale":"2024-09-10T08:42:29.381251+0000","last_undegraded":"2024-09-10T08:42:29.381251+0000","last_fullsized":"2024-09-10T08:42:29.381251+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"194'3","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377858+0000","last_change":"2024-09-10T08:42:28.361008+0000","last_active":"2024-09-10T08:42:29.377858+0000","last_peered":"2024-09-10T08:42:29.377858+0000","last_clean":"2024-09-10T08:42:29.377858+0000","last_became_active":"2024-09-10T08:42:28.360416+0000","last_became_peered":"2024-09-10T08:42:28.360416+0000","last_unstale":"2024-09-10T08:42:29.377858+0000","last_undegraded":"2024-09-10T08:42:29.377858+0000","last_fullsized":"2024-09-10T08:42:29.377858+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389677+0000","last_change":"2024-09-10T08:42:29.388994+0000","last_active":"2024-09-10T08:42:29.389677+0000","last_peered":"2024-09-10T08:42:29.389677+0000","last_clean":"2024-09-10T08:42:29.389677+0000","last_became_active":"2024-09-10T08:42:29.388728+0000","last_became_peered":"2024-09-10T08:42:29.388728+0000","last_unstale":"2024-09-10T08:42:29.389677+0000","last_undegraded":"2024-09-10T08:42:29.389677+0000","last_fullsized":"2024-09-10T08:42:29.389677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369785+0000","last_change":"2024-09-10T08:42:28.368808+0000","last_active":"2024-09-10T08:42:28.369785+0000","last_peered":"2024-09-10T08:42:28.369785+0000","last_clean":"2024-09-10T08:42:28.369785+0000","last_became_active":"2024-09-10T08:42:28.368332+0000","last_became_peered":"2024-09-10T08:42:28.368332+0000","last_unstale":"2024-09-10T08:42:28.369785+0000","last_undegraded":"2024-09-10T08:42:28.369785+0000","last_fullsized":"2024-09-10T08:42:28.369785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:53.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368463+0000","last_change":"2024-09-10T08:42:29.365138+0000","last_active":"2024-09-10T08:42:29.368463+0000","last_peered":"2024-09-10T08:42:29.368463+0000","last_clean":"2024-09-10T08:42:29.368463+0000","last_became_active":"2024-09-10T08:42:29.364846+0000","last_became_peered":"2024-09-10T08:42:29.364846+0000","last_unstale":"2024-09-10T08:42:29.368463+0000","last_undegraded":"2024-09-10T08:42:29.368463+0000","last_fullsized":"2024-09-10T08:42:29.368463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:31.290863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382903+0000","last_change":"2024-09-10T08:42:28.367429+0000","last_active":"2024-09-10T08:42:29.382903+0000","last_peered":"2024-09-10T08:42:29.382903+0000","last_clean":"2024-09-10T08:42:29.382903+0000","last_became_active":"2024-09-10T08:42:28.367107+0000","last_became_peered":"2024-09-10T08:42:28.367107+0000","last_unstale":"2024-09-10T08:42:29.382903+0000","last_undegraded":"2024-09-10T08:42:29.382903+0000","last_fullsized":"2024-09-10T08:42:29.382903+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368673+0000","last_change":"2024-09-10T08:42:29.367545+0000","last_active":"2024-09-10T08:42:29.368673+0000","last_peered":"2024-09-10T08:42:29.368673+0000","last_clean":"2024-09-10T08:42:29.368673+0000","last_became_active":"2024-09-10T08:42:29.367259+0000","last_became_peered":"2024-09-10T08:42:29.367259+0000","last_unstale":"2024-09-10T08:42:29.368673+0000","last_undegraded":"2024-09-10T08:42:29.368673+0000","last_fullsized":"2024-09-10T08:42:29.368673+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355995+0000","last_change":"2024-09-10T08:42:28.371165+0000","last_active":"2024-09-10T08:42:29.355995+0000","last_peered":"2024-09-10T08:42:29.355995+0000","last_clean":"2024-09-10T08:42:29.355995+0000","last_became_active":"2024-09-10T08:42:28.370828+0000","last_became_peered":"2024-09-10T08:42:28.370828+0000","last_unstale":"2024-09-10T08:42:29.355995+0000","last_undegraded":"2024-09-10T08:42:29.355995+0000","last_fullsized":"2024-09-10T08:42:29.355995+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:47.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380877+0000","last_change":"2024-09-10T08:42:29.375188+0000","last_active":"2024-09-10T08:42:29.380877+0000","last_peered":"2024-09-10T08:42:29.380877+0000","last_clean":"2024-09-10T08:42:29.380877+0000","last_became_active":"2024-09-10T08:42:29.374605+0000","last_became_peered":"2024-09-10T08:42:29.374605+0000","last_unstale":"2024-09-10T08:42:29.380877+0000","last_undegraded":"2024-09-10T08:42:29.380877+0000","last_fullsized":"2024-09-10T08:42:29.380877+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355279+0000","last_change":"2024-09-10T08:42:28.367589+0000","last_active":"2024-09-10T08:42:29.355279+0000","last_peered":"2024-09-10T08:42:29.355279+0000","last_clean":"2024-09-10T08:42:29.355279+0000","last_became_active":"2024-09-10T08:42:28.367298+0000","last_became_peered":"2024-09-10T08:42:28.367298+0000","last_unstale":"2024-09-10T08:42:29.355279+0000","last_undegraded":"2024-09-10T08:42:29.355279+0000","last_fullsized":"2024-09-10T08:42:29.355279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:23.134397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375894+0000","last_change":"2024-09-10T08:42:29.368320+0000","last_active":"2024-09-10T08:42:29.375894+0000","last_peered":"2024-09-10T08:42:29.375894+0000","last_clean":"2024-09-10T08:42:29.375894+0000","last_became_active":"2024-09-10T08:42:29.367925+0000","last_became_peered":"2024-09-10T08:42:29.367925+0000","last_unstale":"2024-09-10T08:42:29.375894+0000","last_undegraded":"2024-09-10T08:42:29.375894+0000","last_fullsized":"2024-09-10T08:42:29.375894+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:38.289380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"194'8","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382255+0000","last_change":"2024-09-10T08:42:28.370026+0000","last_active":"2024-09-10T08:42:29.382255+0000","last_peered":"2024-09-10T08:42:29.382255+0000","last_clean":"2024-09-10T08:42:29.382255+0000","last_became_active":"2024-09-10T08:42:28.369757+0000","last_became_peered":"2024-09-10T08:42:28.369757+0000","last_unstale":"2024-09-10T08:42:29.382255+0000","last_undegraded":"2024-09-10T08:42:29.382255+0000","last_fullsized":"2024-09-10T08:42:29.382255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368376+0000","last_change":"2024-09-10T08:42:29.365719+0000","last_active":"2024-09-10T08:42:29.368376+0000","last_peered":"2024-09-10T08:42:29.368376+0000","last_clean":"2024-09-10T08:42:29.368376+0000","last_became_active":"2024-09-10T08:42:29.365419+0000","last_became_peered":"2024-09-10T08:42:29.365419+0000","last_unstale":"2024-09-10T08:42:29.368376+0000","last_undegraded":"2024-09-10T08:42:29.368376+0000","last_fullsized":"2024-09-10T08:42:29.368376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:59.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393966+0000","last_change":"2024-09-10T08:42:28.371311+0000","last_active":"2024-09-10T08:42:29.393966+0000","last_peered":"2024-09-10T08:42:29.393966+0000","last_clean":"2024-09-10T08:42:29.393966+0000","last_became_active":"2024-09-10T08:42:28.371021+0000","last_became_peered":"2024-09-10T08:42:28.371021+0000","last_unstale":"2024-09-10T08:42:29.393966+0000","last_undegraded":"2024-09-10T08:42:29.393966+0000","last_fullsized":"2024-09-10T08:42:29.393966+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:47.699312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.362207+0000","last_change":"2024-09-10T08:42:28.362207+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.362207+0000","last_undegraded":"2024-09-10T08:42:28.362207+0000","last_fullsized":"2024-09-10T08:42:28.362207+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369959+0000","last_change":"2024-09-10T08:42:28.369134+0000","last_active":"2024-09-10T08:42:28.369959+0000","last_peered":"2024-09-10T08:42:28.369959+0000","last_clean":"2024-09-10T08:42:28.369959+0000","last_became_active":"2024-09-10T08:42:28.368736+0000","last_became_peered":"2024-09-10T08:42:28.368736+0000","last_unstale":"2024-09-10T08:42:28.369959+0000","last_undegraded":"2024-09-10T08:42:28.369959+0000","last_fullsized":"2024-09-10T08:42:28.369959+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:14.483339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378153+0000","last_change":"2024-09-10T08:42:29.376134+0000","last_active":"2024-09-10T08:42:29.378153+0000","last_peered":"2024-09-10T08:42:29.378153+0000","last_clean":"2024-09-10T08:42:29.378153+0000","last_became_active":"2024-09-10T08:42:29.374622+0000","last_became_peered":"2024-09-10T08:42:29.374622+0000","last_unstale":"2024-09-10T08:42:29.378153+0000","last_undegraded":"2024-09-10T08:42:29.378153+0000","last_fullsized":"2024-09-10T08:42:29.378153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394649+0000","last_change":"2024-09-10T08:42:28.371235+0000","last_active":"2024-09-10T08:42:29.394649+0000","last_peered":"2024-09-10T08:42:29.394649+0000","last_clean":"2024-09-10T08:42:29.394649+0000","last_became_active":"2024-09-10T08:42:28.370717+0000","last_became_peered":"2024-09-10T08:42:28.370717+0000","last_unstale":"2024-09-10T08:42:29.394649+0000","last_undegraded":"2024-09-10T08:42:29.394649+0000","last_fullsized":"2024-09-10T08:42:29.394649+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389665+0000","last_change":"2024-09-10T08:42:29.388578+0000","last_active":"2024-09-10T08:42:29.389665+0000","last_peered":"2024-09-10T08:42:29.389665+0000","last_clean":"2024-09-10T08:42:29.389665+0000","last_became_active":"2024-09-10T08:42:29.387485+0000","last_became_peered":"2024-09-10T08:42:29.387485+0000","last_unstale":"2024-09-10T08:42:29.389665+0000","last_undegraded":"2024-09-10T08:42:29.389665+0000","last_fullsized":"2024-09-10T08:42:29.389665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:30.985321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.359666+0000","last_change":"2024-09-10T08:42:28.366118+0000","last_active":"2024-09-10T08:42:29.359666+0000","last_peered":"2024-09-10T08:42:29.359666+0000","last_clean":"2024-09-10T08:42:29.359666+0000","last_became_active":"2024-09-10T08:42:28.365820+0000","last_became_peered":"2024-09-10T08:42:28.365820+0000","last_unstale":"2024-09-10T08:42:29.359666+0000","last_undegraded":"2024-09-10T08:42:29.359666+0000","last_fullsized":"2024-09-10T08:42:29.359666+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:15.022898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.358190+0000","last_change":"2024-09-10T08:42:28.358190+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.358190+0000","last_undegraded":"2024-09-10T08:42:28.358190+0000","last_fullsized":"2024-09-10T08:42:28.358190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393860+0000","last_change":"2024-09-10T08:42:28.369096+0000","last_active":"2024-09-10T08:42:29.393860+0000","last_peered":"2024-09-10T08:42:29.393860+0000","last_clean":"2024-09-10T08:42:29.393860+0000","last_became_active":"2024-09-10T08:42:28.367579+0000","last_became_peered":"2024-09-10T08:42:28.367579+0000","last_unstale":"2024-09-10T08:42:29.393860+0000","last_undegraded":"2024-09-10T08:42:29.393860+0000","last_fullsized":"2024-09-10T08:42:29.393860+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:34.790766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381174+0000","last_change":"2024-09-10T08:42:29.376975+0000","last_active":"2024-09-10T08:42:29.381174+0000","last_peered":"2024-09-10T08:42:29.381174+0000","last_clean":"2024-09-10T08:42:29.381174+0000","last_became_active":"2024-09-10T08:42:29.375816+0000","last_became_peered":"2024-09-10T08:42:29.375816+0000","last_unstale":"2024-09-10T08:42:29.381174+0000","last_undegraded":"2024-09-10T08:42:29.381174+0000","last_fullsized":"2024-09-10T08:42:29.381174+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370654+0000","last_change":"2024-09-10T08:42:28.365210+0000","last_active":"2024-09-10T08:42:29.370654+0000","last_peered":"2024-09-10T08:42:29.370654+0000","last_clean":"2024-09-10T08:42:29.370654+0000","last_became_active":"2024-09-10T08:42:28.364926+0000","last_became_peered":"2024-09-10T08:42:28.364926+0000","last_unstale":"2024-09-10T08:42:29.370654+0000","last_undegraded":"2024-09-10T08:42:29.370654+0000","last_fullsized":"2024-09-10T08:42:29.370654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:58.755691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377086+0000","last_change":"2024-09-10T08:42:29.375211+0000","last_active":"2024-09-10T08:42:29.377086+0000","last_peered":"2024-09-10T08:42:29.377086+0000","last_clean":"2024-09-10T08:42:29.377086+0000","last_became_active":"2024-09-10T08:42:29.374945+0000","last_became_peered":"2024-09-10T08:42:29.374945+0000","last_unstale":"2024-09-10T08:42:29.377086+0000","last_undegraded":"2024-09-10T08:42:29.377086+0000","last_fullsized":"2024-09-10T08:42:29.377086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.362732+0000","last_change":"2024-09-10T08:42:28.368260+0000","last_active":"2024-09-10T08:42:29.362732+0000","last_peered":"2024-09-10T08:42:29.362732+0000","last_clean":"2024-09-10T08:42:29.362732+0000","last_became_active":"2024-09-10T08:42:28.366958+0000","last_became_peered":"2024-09-10T08:42:28.366958+0000","last_unstale":"2024-09-10T08:42:29.362732+0000","last_undegraded":"2024-09-10T08:42:29.362732+0000","last_fullsized":"2024-09-10T08:42:29.362732+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388562+0000","last_change":"2024-09-10T08:42:29.387997+0000","last_active":"2024-09-10T08:42:29.388562+0000","last_peered":"2024-09-10T08:42:29.388562+0000","last_clean":"2024-09-10T08:42:29.388562+0000","last_became_active":"2024-09-10T08:42:29.387143+0000","last_became_peered":"2024-09-10T08:42:29.387143+0000","last_unstale":"2024-09-10T08:42:29.388562+0000","last_undegraded":"2024-09-10T08:42:29.388562+0000","last_fullsized":"2024-09-10T08:42:29.388562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360759+0000","last_change":"2024-09-10T08:42:28.373429+0000","last_active":"2024-09-10T08:42:29.360759+0000","last_peered":"2024-09-10T08:42:29.360759+0000","last_clean":"2024-09-10T08:42:29.360759+0000","last_became_active":"2024-09-10T08:42:28.373018+0000","last_became_peered":"2024-09-10T08:42:28.373018+0000","last_unstale":"2024-09-10T08:42:29.360759+0000","last_undegraded":"2024-09-10T08:42:29.360759+0000","last_fullsized":"2024-09-10T08:42:29.360759+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:55.127506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.360430+0000","last_change":"2024-09-10T08:42:28.360430+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.360430+0000","last_undegraded":"2024-09-10T08:42:28.360430+0000","last_fullsized":"2024-09-10T08:42:28.360430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.370467+0000","last_change":"2024-09-10T08:42:28.369947+0000","last_active":"2024-09-10T08:42:28.370467+0000","last_peered":"2024-09-10T08:42:28.370467+0000","last_clean":"2024-09-10T08:42:28.370467+0000","last_became_active":"2024-09-10T08:42:28.368829+0000","last_became_peered":"2024-09-10T08:42:28.368829+0000","last_unstale":"2024-09-10T08:42:28.370467+0000","last_undegraded":"2024-09-10T08:42:28.370467+0000","last_fullsized":"2024-09-10T08:42:28.370467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:00.951036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391197+0000","last_change":"2024-09-10T08:42:29.383681+0000","last_active":"2024-09-10T08:42:29.391197+0000","last_peered":"2024-09-10T08:42:29.391197+0000","last_clean":"2024-09-10T08:42:29.391197+0000","last_became_active":"2024-09-10T08:42:29.383061+0000","last_became_peered":"2024-09-10T08:42:29.383061+0000","last_unstale":"2024-09-10T08:42:29.391197+0000","last_undegraded":"2024-09-10T08:42:29.391197+0000","last_fullsized":"2024-09-10T08:42:29.391197+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:40.346099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391289+0000","last_change":"2024-09-10T08:42:28.372012+0000","last_active":"2024-09-10T08:42:29.391289+0000","last_peered":"2024-09-10T08:42:29.391289+0000","last_clean":"2024-09-10T08:42:29.391289+0000","last_became_active":"2024-09-10T08:42:28.371754+0000","last_became_peered":"2024-09-10T08:42:28.371754+0000","last_unstale":"2024-09-10T08:42:29.391289+0000","last_undegraded":"2024-09-10T08:42:29.391289+0000","last_fullsized":"2024-09-10T08:42:29.391289+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385489+0000","last_change":"2024-09-10T08:42:29.378781+0000","last_active":"2024-09-10T08:42:29.385489+0000","last_peered":"2024-09-10T08:42:29.385489+0000","last_clean":"2024-09-10T08:42:29.385489+0000","last_became_active":"2024-09-10T08:42:29.378509+0000","last_became_peered":"2024-09-10T08:42:29.378509+0000","last_unstale":"2024-09-10T08:42:29.385489+0000","last_undegraded":"2024-09-10T08:42:29.385489+0000","last_fullsized":"2024-09-10T08:42:29.385489+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:26.452775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353377+0000","last_change":"2024-09-10T08:42:28.361630+0000","last_active":"2024-09-10T08:42:29.353377+0000","last_peered":"2024-09-10T08:42:29.353377+0000","last_clean":"2024-09-10T08:42:29.353377+0000","last_became_active":"2024-09-10T08:42:28.358295+0000","last_became_peered":"2024-09-10T08:42:28.358295+0000","last_unstale":"2024-09-10T08:42:29.353377+0000","last_undegraded":"2024-09-10T08:42:29.353377+0000","last_fullsized":"2024-09-10T08:42:29.353377+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:21.406617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372202+0000","last_change":"2024-09-10T08:42:29.368037+0000","last_active":"2024-09-10T08:42:29.372202+0000","last_peered":"2024-09-10T08:42:29.372202+0000","last_clean":"2024-09-10T08:42:29.372202+0000","last_became_active":"2024-09-10T08:42:29.367522+0000","last_became_peered":"2024-09-10T08:42:29.367522+0000","last_unstale":"2024-09-10T08:42:29.372202+0000","last_undegraded":"2024-09-10T08:42:29.372202+0000","last_fullsized":"2024-09-10T08:42:29.372202+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361112+0000","last_change":"2024-09-10T08:42:28.370188+0000","last_active":"2024-09-10T08:42:29.361112+0000","last_peered":"2024-09-10T08:42:29.361112+0000","last_clean":"2024-09-10T08:42:29.361112+0000","last_became_active":"2024-09-10T08:42:28.369878+0000","last_became_peered":"2024-09-10T08:42:28.369878+0000","last_unstale":"2024-09-10T08:42:29.361112+0000","last_undegraded":"2024-09-10T08:42:29.361112+0000","last_fullsized":"2024-09-10T08:42:29.361112+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:27.034999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386671+0000","last_change":"2024-09-10T08:42:29.384764+0000","last_active":"2024-09-10T08:42:29.386671+0000","last_peered":"2024-09-10T08:42:29.386671+0000","last_clean":"2024-09-10T08:42:29.386671+0000","last_became_active":"2024-09-10T08:42:29.383341+0000","last_became_peered":"2024-09-10T08:42:29.383341+0000","last_unstale":"2024-09-10T08:42:29.386671+0000","last_undegraded":"2024-09-10T08:42:29.386671+0000","last_fullsized":"2024-09-10T08:42:29.386671+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:39.613196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.364278+0000","last_change":"2024-09-10T08:42:28.368721+0000","last_active":"2024-09-10T08:42:29.364278+0000","last_peered":"2024-09-10T08:42:29.364278+0000","last_clean":"2024-09-10T08:42:29.364278+0000","last_became_active":"2024-09-10T08:42:28.368451+0000","last_became_peered":"2024-09-10T08:42:28.368451+0000","last_unstale":"2024-09-10T08:42:29.364278+0000","last_undegraded":"2024-09-10T08:42:29.364278+0000","last_fullsized":"2024-09-10T08:42:29.364278+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386290+0000","last_change":"2024-09-10T08:42:29.383876+0000","last_active":"2024-09-10T08:42:29.386290+0000","last_peered":"2024-09-10T08:42:29.386290+0000","last_clean":"2024-09-10T08:42:29.386290+0000","last_became_active":"2024-09-10T08:42:29.383482+0000","last_became_peered":"2024-09-10T08:42:29.383482+0000","last_unstale":"2024-09-10T08:42:29.386290+0000","last_undegraded":"2024-09-10T08:42:29.386290+0000","last_fullsized":"2024-09-10T08:42:29.386290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:52.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.356275+0000","last_change":"2024-09-10T08:42:28.365843+0000","last_active":"2024-09-10T08:42:29.356275+0000","last_peered":"2024-09-10T08:42:29.356275+0000","last_clean":"2024-09-10T08:42:29.356275+0000","last_became_active":"2024-09-10T08:42:28.365472+0000","last_became_peered":"2024-09-10T08:42:28.365472+0000","last_unstale":"2024-09-10T08:42:29.356275+0000","last_undegraded":"2024-09-10T08:42:29.356275+0000","last_fullsized":"2024-09-10T08:42:29.356275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:30.588924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390402+0000","last_change":"2024-09-10T08:42:29.387773+0000","last_active":"2024-09-10T08:42:29.390402+0000","last_peered":"2024-09-10T08:42:29.390402+0000","last_clean":"2024-09-10T08:42:29.390402+0000","last_became_active":"2024-09-10T08:42:29.387377+0000","last_became_peered":"2024-09-10T08:42:29.387377+0000","last_unstale":"2024-09-10T08:42:29.390402+0000","last_undegraded":"2024-09-10T08:42:29.390402+0000","last_fullsized":"2024-09-10T08:42:29.390402+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361238+0000","last_change":"2024-09-10T08:42:28.361831+0000","last_active":"2024-09-10T08:42:29.361238+0000","last_peered":"2024-09-10T08:42:29.361238+0000","last_clean":"2024-09-10T08:42:29.361238+0000","last_became_active":"2024-09-10T08:42:28.360230+0000","last_became_peered":"2024-09-10T08:42:28.360230+0000","last_unstale":"2024-09-10T08:42:29.361238+0000","last_undegraded":"2024-09-10T08:42:29.361238+0000","last_fullsized":"2024-09-10T08:42:29.361238+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373931+0000","last_change":"2024-09-10T08:42:29.364854+0000","last_active":"2024-09-10T08:42:29.373931+0000","last_peered":"2024-09-10T08:42:29.373931+0000","last_clean":"2024-09-10T08:42:29.373931+0000","last_became_active":"2024-09-10T08:42:29.364185+0000","last_became_peered":"2024-09-10T08:42:29.364185+0000","last_unstale":"2024-09-10T08:42:29.373931+0000","last_undegraded":"2024-09-10T08:42:29.373931+0000","last_fullsized":"2024-09-10T08:42:29.373931+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385275+0000","last_change":"2024-09-10T08:42:28.371106+0000","last_active":"2024-09-10T08:42:29.385275+0000","last_peered":"2024-09-10T08:42:29.385275+0000","last_clean":"2024-09-10T08:42:29.385275+0000","last_became_active":"2024-09-10T08:42:28.370787+0000","last_became_peered":"2024-09-10T08:42:28.370787+0000","last_unstale":"2024-09-10T08:42:29.385275+0000","last_undegraded":"2024-09-10T08:42:29.385275+0000","last_fullsized":"2024-09-10T08:42:29.385275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:40.197098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373800+0000","last_change":"2024-09-10T08:42:29.364367+0000","last_active":"2024-09-10T08:42:29.373800+0000","last_peered":"2024-09-10T08:42:29.373800+0000","last_clean":"2024-09-10T08:42:29.373800+0000","last_became_active":"2024-09-10T08:42:29.364048+0000","last_became_peered":"2024-09-10T08:42:29.364048+0000","last_unstale":"2024-09-10T08:42:29.373800+0000","last_undegraded":"2024-09-10T08:42:29.373800+0000","last_fullsized":"2024-09-10T08:42:29.373800+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.395734+0000","last_change":"2024-09-10T08:42:28.374827+0000","last_active":"2024-09-10T08:42:29.395734+0000","last_peered":"2024-09-10T08:42:29.395734+0000","last_clean":"2024-09-10T08:42:29.395734+0000","last_became_active":"2024-09-10T08:42:28.374529+0000","last_became_peered":"2024-09-10T08:42:28.374529+0000","last_unstale":"2024-09-10T08:42:29.395734+0000","last_undegraded":"2024-09-10T08:42:29.395734+0000","last_fullsized":"2024-09-10T08:42:29.395734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384457+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:42:29.384457+0000","last_peered":"2024-09-10T08:42:29.384457+0000","last_clean":"2024-09-10T08:42:29.384457+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:42:29.384457+0000","last_undegraded":"2024-09-10T08:42:29.384457+0000","last_fullsized":"2024-09-10T08:42:29.384457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1074415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1073867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509609,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509610,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69596,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302244,"statfs":{"total":96636764160,"available":96565497856,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2445312,"data_stored":1073777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509610,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55788,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2441216,"data_stored":1073743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60508,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311332,"statfs":{"total":96636764160,"available":96574803968,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2e is not active+clean 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.363033+0000', 'last_change': '2024-09-10T08:42:28.363033+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.363033+0000', 'last_undegraded': '2024-09-10T08:42:28.363033+0000', 'last_fullsized': '2024-09-10T08:42:28.363033+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2c is not active+clean 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.361855+0000', 'last_change': '2024-09-10T08:42:28.361855+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.361855+0000', 'last_undegraded': '2024-09-10T08:42:28.361855+0000', 'last_fullsized': '2024-09-10T08:42:28.361855+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2b is not active+clean 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.359126+0000', 'last_change': '2024-09-10T08:42:28.359126+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.359126+0000', 'last_undegraded': '2024-09-10T08:42:28.359126+0000', 'last_fullsized': '2024-09-10T08:42:28.359126+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:PG 29.21 is not active+clean 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.357072+0000', 'last_change': '2024-09-10T08:42:28.357072+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.357072+0000', 'last_undegraded': '2024-09-10T08:42:28.357072+0000', 'last_fullsized': '2024-09-10T08:42:28.357072+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.425 INFO:tasks.ceph.ceph_manager.ceph:PG 29.f is not active+clean 2024-09-10T08:42:34.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.362207+0000', 'last_change': '2024-09-10T08:42:28.362207+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.362207+0000', 'last_undegraded': '2024-09-10T08:42:28.362207+0000', 'last_fullsized': '2024-09-10T08:42:28.362207+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.426 INFO:tasks.ceph.ceph_manager.ceph:PG 29.a is not active+clean 2024-09-10T08:42:34.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.358190+0000', 'last_change': '2024-09-10T08:42:28.358190+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.358190+0000', 'last_undegraded': '2024-09-10T08:42:28.358190+0000', 'last_fullsized': '2024-09-10T08:42:28.358190+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.426 INFO:tasks.ceph.ceph_manager.ceph:PG 29.6 is not active+clean 2024-09-10T08:42:34.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 193, 'state': 'creating+peering', 'last_fresh': '2024-09-10T08:42:28.360430+0000', 'last_change': '2024-09-10T08:42:28.360430+0000', 'last_active': '2024-09-10T08:42:28.339417+0000', 'last_peered': '2024-09-10T08:42:28.339417+0000', 'last_clean': '2024-09-10T08:42:28.339417+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T08:42:28.360430+0000', 'last_undegraded': '2024-09-10T08:42:28.360430+0000', 'last_fullsized': '2024-09-10T08:42:28.360430+0000', 'mapping_epoch': 193, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 193, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'last_clean_scrub_stamp': '2024-09-10T08:42:28.339417+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T08:42:34.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T08:42:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.616+0000 7f61f5c00640 1 Processor -- start 2024-09-10T08:42:34.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.616+0000 7f61f5c00640 1 -- start start 2024-09-10T08:42:34.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f015e9a0 0x7f61f00cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61f00cfce0 0x7f61f00d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5c00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f00d2610 con 0x7f61f015e5c0 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f61f00d2d10 con 0x7f61f00cfce0 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61f00d2ff0 con 0x7f61f015e9a0 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61f00cfce0 0x7f61f00d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f61f00cfce0 0x7f61f00d46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50000/0 (socket says 172.21.15.52:50000) 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61f5200640 1 -- 172.21.15.52:0/2158145984 learned_addr learned my addr 172.21.15.52:0/2158145984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:34.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.617+0000 7f61e7400640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f015e9a0 0x7f61f00cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.618+0000 7f61f5200640 1 -- 172.21.15.52:0/2158145984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f015e9a0 msgr2=0x7f61f00cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.618+0000 7f61f5200640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f015e9a0 0x7f61f00cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.618+0000 7f61f5200640 1 -- 172.21.15.52:0/2158145984 >> v1:172.21.15.176:6789/0 conn(0x7f61f015e5c0 legacy=0x7f61f00d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.618+0000 7f61f5200640 1 -- 172.21.15.52:0/2158145984 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f00d32d0 con 0x7f61f00cfce0 2024-09-10T08:42:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61f5200640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f00cfce0 0x7f61f00d46d0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009e50 tx=0x7f61e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727bd0dcf3ad348f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61ef400640 1 -- 172.21.15.52:0/2158145984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8036070 con 0x7f61f00cfce0 2024-09-10T08:42:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61ef400640 1 -- 172.21.15.52:0/2158145984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e8031600 con 0x7f61f00cfce0 2024-09-10T08:42:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61ef400640 1 -- 172.21.15.52:0/2158145984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e80319d0 con 0x7f61f00cfce0 2024-09-10T08:42:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61f5c00640 1 -- 172.21.15.52:0/2158145984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f00cfce0 msgr2=0x7f61f00d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.619+0000 7f61f5c00640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f00cfce0 0x7f61f00d46d0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009e50 tx=0x7f61e802a710 comp rx=0 tx=0).stop 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 -- 172.21.15.52:0/2158145984 shutdown_connections 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f00cfce0 0x7f61f00d46d0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 --2- 172.21.15.52:0/2158145984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f015e9a0 0x7f61f00cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 -- 172.21.15.52:0/2158145984 >> 172.21.15.52:0/2158145984 conn(0x7f61f006c030 msgr2=0x7f61f006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 -- 172.21.15.52:0/2158145984 shutdown_connections 2024-09-10T08:42:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.620+0000 7f61f5c00640 1 -- 172.21.15.52:0/2158145984 wait complete. 2024-09-10T08:42:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.621+0000 7f61f5c00640 1 Processor -- start 2024-09-10T08:42:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 -- start start 2024-09-10T08:42:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f00cfce0 0x7f61f00b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f015e9a0 0x7f61f00ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00d4c10 con 0x7f61f015e5c0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00d3890 con 0x7f61f015e9a0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.622+0000 7f61f5c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f61f00d4d90 con 0x7f61f00cfce0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50002/0 (socket says 172.21.15.52:50002) 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 -- 172.21.15.52:0/156822970 learned_addr learned my addr 172.21.15.52:0/156822970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61efe00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f00cfce0 0x7f61f00b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61f5200640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f015e9a0 0x7f61f00ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 -- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f00cfce0 msgr2=0x7f61f00b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f00cfce0 0x7f61f00b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 -- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f015e9a0 msgr2=0x7f61f00ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f015e9a0 0x7f61f00ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.623+0000 7f61e7400640 1 -- 172.21.15.52:0/156822970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f00ad650 con 0x7f61f015e5c0 2024-09-10T08:42:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61e7400640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f61d800e9b0 tx=0x7f61d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8017070 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d800c9a0 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f00cc790 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d800cd90 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.624+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f00cd030 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.625+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f00ccb80 con 0x7f61f015e5c0 2024-09-10T08:42:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.626+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61d801a070 con 0x7f61f015e5c0 2024-09-10T08:42:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.627+0000 7f61ecc00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 0x7f61cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.627+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f61d808ae80 con 0x7f61f015e5c0 2024-09-10T08:42:34.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.627+0000 7f61efe00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 0x7f61cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:34.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.628+0000 7f61efe00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 0x7f61cc06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001780 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:34.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.631+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61d8059140 con 0x7f61f015e5c0 2024-09-10T08:42:34.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.885+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f61f00d19d0 con 0x7f61f015e5c0 2024-09-10T08:42:34.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.885+0000 7f61ecc00640 1 -- 172.21.15.52:0/156822970 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1566 (secure 0 0 0) 0x7f61d805d440 con 0x7f61f015e5c0 2024-09-10T08:42:34.886 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:34.886 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":854,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":195,"num_osds":8,"num_up_osds":8,"osd_up_since":1725956914,"num_in_osds":8,"osd_in_since":1725956903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":591166,"bytes_used":472301568,"bytes_avail":772621811712,"bytes_total":773094113280,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":10566}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-10T08:42:17.658742+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T08:42:34.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 msgr2=0x7f61cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 0x7f61cc06e2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f61e0001780 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-09-10T08:42:34.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 msgr2=0x7f61f0154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:34.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f61d800e9b0 tx=0x7f61d800ee70 comp rx=0 tx=0).stop 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 shutdown_connections 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f61cc06be30 0x7f61cc06e2f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f015e9a0 0x7f61f00ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f015e5c0 0x7f61f0154ab0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 --2- 172.21.15.52:0/156822970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f00cfce0 0x7f61f00b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.887+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 >> 172.21.15.52:0/156822970 conn(0x7f61f006c030 msgr2=0x7f61f0161390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.888+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 shutdown_connections 2024-09-10T08:42:34.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:34.888+0000 7f61f5c00640 1 -- 172.21.15.52:0/156822970 wait complete. 2024-09-10T08:42:34.904 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T08:42:34.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:42:34.928 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:42:34.928+0000 7f087aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:42:35.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.059+0000 7fb63c200640 1 Processor -- start 2024-09-10T08:42:35.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.060+0000 7fb63c200640 1 -- start start 2024-09-10T08:42:35.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb63415e790 0x7fb634073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb634162c60 0x7fb6340b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6340b5970 0x7fb63406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb63415eb70 con 0x7fb63415e790 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb6341631c0 con 0x7fb6340b5970 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340ae9a0 con 0x7fb634162c60 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb639800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb63415e790 0x7fb634073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb639800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb63415e790 0x7fb634073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50006/0 (socket says 172.21.15.52:50006) 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb639800640 1 -- 172.21.15.52:0/3938187430 learned_addr learned my addr 172.21.15.52:0/3938187430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb638e00640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb634162c60 0x7fb6340b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.061+0000 7fb63a200640 1 --2- 172.21.15.52:0/3938187430 >> v2:172.21.15.176:3300/0 conn(0x7fb6340b5970 0x7fb63406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.062+0000 7fb639800640 1 -- 172.21.15.52:0/3938187430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb634162c60 msgr2=0x7fb6340b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.062+0000 7fb639800640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb634162c60 0x7fb6340b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.062+0000 7fb639800640 1 -- 172.21.15.52:0/3938187430 >> v2:172.21.15.176:3300/0 conn(0x7fb6340b5970 msgr2=0x7fb63406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:35.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.062+0000 7fb639800640 1 --2- 172.21.15.52:0/3938187430 >> v2:172.21.15.176:3300/0 conn(0x7fb6340b5970 0x7fb63406f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.062+0000 7fb639800640 1 -- 172.21.15.52:0/3938187430 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340aec40 con 0x7fb63415e790 2024-09-10T08:42:35.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb639800640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb63415e790 0x7fb634073a40 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fb6340b0960 tx=0x7fb62802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d95ccae350ad5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:35.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb633e00640 1 -- 172.21.15.52:0/3938187430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628037070 con 0x7fb63415e790 2024-09-10T08:42:35.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb633e00640 1 -- 172.21.15.52:0/3938187430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb628032440 con 0x7fb63415e790 2024-09-10T08:42:35.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb633e00640 1 -- 172.21.15.52:0/3938187430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628032810 con 0x7fb63415e790 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 -- 172.21.15.52:0/3938187430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb63415e790 msgr2=0x7fb634073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb63415e790 0x7fb634073a40 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fb6340b0960 tx=0x7fb62802a140 comp rx=0 tx=0).stop 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 -- 172.21.15.52:0/3938187430 shutdown_connections 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 --2- 172.21.15.52:0/3938187430 >> v2:172.21.15.176:3300/0 conn(0x7fb6340b5970 0x7fb63406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb634162c60 0x7fb6340b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.063+0000 7fb63c200640 1 --2- 172.21.15.52:0/3938187430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb63415e790 0x7fb634073a40 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.064+0000 7fb63c200640 1 -- 172.21.15.52:0/3938187430 >> 172.21.15.52:0/3938187430 conn(0x7fb6340b0a80 msgr2=0x7fb6340b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:35.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.064+0000 7fb63c200640 1 -- 172.21.15.52:0/3938187430 shutdown_connections 2024-09-10T08:42:35.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.064+0000 7fb63c200640 1 -- 172.21.15.52:0/3938187430 wait complete. 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.065+0000 7fb63c200640 1 Processor -- start 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.065+0000 7fb63c200640 1 -- start start 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6340b5970 0x7fb634160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb63415e790 0x7fb634153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb63406f430 con 0x7fb634162c60 2024-09-10T08:42:35.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340af200 con 0x7fb63415e790 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb63406fc70 con 0x7fb6340b5970 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.066+0000 7fb63a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50018/0 (socket says 172.21.15.52:50018) 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 -- 172.21.15.52:0/180237438 learned_addr learned my addr 172.21.15.52:0/180237438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb639800640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6340b5970 0x7fb634160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb638e00640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb63415e790 0x7fb634153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 -- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6340b5970 msgr2=0x7fb634160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6340b5970 0x7fb634160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 -- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb63415e790 msgr2=0x7fb634153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb63415e790 0x7fb634153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 -- 172.21.15.52:0/180237438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634160ca0 con 0x7fb634162c60 2024-09-10T08:42:35.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.067+0000 7fb63a200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fb62c007e30 tx=0x7fb62c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:35.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.068+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c014420 con 0x7fb634162c60 2024-09-10T08:42:35.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.068+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c019070 con 0x7fb634162c60 2024-09-10T08:42:35.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.068+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c014800 con 0x7fb634162c60 2024-09-10T08:42:35.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.068+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb634153a60 con 0x7fb634162c60 2024-09-10T08:42:35.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.068+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6340c7f20 con 0x7fb634162c60 2024-09-10T08:42:35.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.069+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb634073a40 con 0x7fb634162c60 2024-09-10T08:42:35.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.070+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62c0149a0 con 0x7fb634162c60 2024-09-10T08:42:35.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.071+0000 7fb631600640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:35.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.071+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fb62c08b540 con 0x7fb634162c60 2024-09-10T08:42:35.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.071+0000 7fb639800640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:35.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.072+0000 7fb639800640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb628034000 tx=0x7fb62802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:35.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.075+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb634160ca0 con 0x7fb634162c60 2024-09-10T08:42:35.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.255+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb634073540 con 0x7fb61406be30 2024-09-10T08:42:35.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.262+0000 7fb631600640 1 -- 172.21.15.52:0/180237438 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7fb634073540 con 0x7fb61406be30 2024-09-10T08:42:35.266 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:42:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 msgr2=0x7fb61406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 0x7fb61406e2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb628034000 tx=0x7fb62802e000 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 msgr2=0x7fb6340721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fb62c007e30 tx=0x7fb62c00e4b0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 shutdown_connections 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb61406be30 0x7fb61406e2f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb634162c60 0x7fb6340721b0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb63415e790 0x7fb634153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 --2- 172.21.15.52:0/180237438 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6340b5970 0x7fb634160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 >> 172.21.15.52:0/180237438 conn(0x7fb6340b0a80 msgr2=0x7fb6340b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 shutdown_connections 2024-09-10T08:42:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:35.266+0000 7fb63c200640 1 -- 172.21.15.52:0/180237438 wait complete. 2024-09-10T08:42:35.283 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":608,"stamp":"2024-09-10T08:42:33.662335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461232,"kb_used_data":20204,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513488,"statfs":{"total":773094113280,"available":772621811712,"internally_reserved":0,"allocated":20688896,"data_stored":9744410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001396"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391220+0000","last_change":"2024-09-10T08:42:29.385887+0000","last_active":"2024-09-10T08:42:29.391220+0000","last_peered":"2024-09-10T08:42:29.391220+0000","last_clean":"2024-09-10T08:42:29.391220+0000","last_became_active":"2024-09-10T08:42:29.383384+0000","last_became_peered":"2024-09-10T08:42:29.383384+0000","last_unstale":"2024-09-10T08:42:29.391220+0000","last_undegraded":"2024-09-10T08:42:29.391220+0000","last_fullsized":"2024-09-10T08:42:29.391220+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:27.665416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390710+0000","last_change":"2024-09-10T08:42:29.388781+0000","last_active":"2024-09-10T08:42:29.390710+0000","last_peered":"2024-09-10T08:42:29.390710+0000","last_clean":"2024-09-10T08:42:29.390710+0000","last_became_active":"2024-09-10T08:42:29.388292+0000","last_became_peered":"2024-09-10T08:42:29.388292+0000","last_unstale":"2024-09-10T08:42:29.390710+0000","last_undegraded":"2024-09-10T08:42:29.390710+0000","last_fullsized":"2024-09-10T08:42:29.390710+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372275+0000","last_change":"2024-09-10T08:42:29.367007+0000","last_active":"2024-09-10T08:42:29.372275+0000","last_peered":"2024-09-10T08:42:29.372275+0000","last_clean":"2024-09-10T08:42:29.372275+0000","last_became_active":"2024-09-10T08:42:29.366713+0000","last_became_peered":"2024-09-10T08:42:29.366713+0000","last_unstale":"2024-09-10T08:42:29.372275+0000","last_undegraded":"2024-09-10T08:42:29.372275+0000","last_fullsized":"2024-09-10T08:42:29.372275+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:48.702491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368733+0000","last_change":"2024-09-10T08:42:29.366363+0000","last_active":"2024-09-10T08:42:29.368733+0000","last_peered":"2024-09-10T08:42:29.368733+0000","last_clean":"2024-09-10T08:42:29.368733+0000","last_became_active":"2024-09-10T08:42:29.366094+0000","last_became_peered":"2024-09-10T08:42:29.366094+0000","last_unstale":"2024-09-10T08:42:29.368733+0000","last_undegraded":"2024-09-10T08:42:29.368733+0000","last_fullsized":"2024-09-10T08:42:29.368733+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:04.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368259+0000","last_change":"2024-09-10T08:42:29.365511+0000","last_active":"2024-09-10T08:42:29.368259+0000","last_peered":"2024-09-10T08:42:29.368259+0000","last_clean":"2024-09-10T08:42:29.368259+0000","last_became_active":"2024-09-10T08:42:29.362055+0000","last_became_peered":"2024-09-10T08:42:29.362055+0000","last_unstale":"2024-09-10T08:42:29.368259+0000","last_undegraded":"2024-09-10T08:42:29.368259+0000","last_fullsized":"2024-09-10T08:42:29.368259+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368289+0000","last_change":"2024-09-10T08:42:29.362962+0000","last_active":"2024-09-10T08:42:29.368289+0000","last_peered":"2024-09-10T08:42:29.368289+0000","last_clean":"2024-09-10T08:42:29.368289+0000","last_became_active":"2024-09-10T08:42:29.362665+0000","last_became_peered":"2024-09-10T08:42:29.362665+0000","last_unstale":"2024-09-10T08:42:29.368289+0000","last_undegraded":"2024-09-10T08:42:29.368289+0000","last_fullsized":"2024-09-10T08:42:29.368289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:55.712843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375949+0000","last_change":"2024-09-10T08:42:29.373037+0000","last_active":"2024-09-10T08:42:29.375949+0000","last_peered":"2024-09-10T08:42:29.375949+0000","last_clean":"2024-09-10T08:42:29.375949+0000","last_became_active":"2024-09-10T08:42:29.372745+0000","last_became_peered":"2024-09-10T08:42:29.372745+0000","last_unstale":"2024-09-10T08:42:29.375949+0000","last_undegraded":"2024-09-10T08:42:29.375949+0000","last_fullsized":"2024-09-10T08:42:29.375949+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:54.772249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.376620+0000","last_change":"2024-09-10T08:42:29.375322+0000","last_active":"2024-09-10T08:42:29.376620+0000","last_peered":"2024-09-10T08:42:29.376620+0000","last_clean":"2024-09-10T08:42:29.376620+0000","last_became_active":"2024-09-10T08:42:29.375050+0000","last_became_peered":"2024-09-10T08:42:29.375050+0000","last_unstale":"2024-09-10T08:42:29.376620+0000","last_undegraded":"2024-09-10T08:42:29.376620+0000","last_fullsized":"2024-09-10T08:42:29.376620+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.379615+0000","last_change":"2024-09-10T08:42:29.372907+0000","last_active":"2024-09-10T08:42:29.379615+0000","last_peered":"2024-09-10T08:42:29.379615+0000","last_clean":"2024-09-10T08:42:29.379615+0000","last_became_active":"2024-09-10T08:42:29.371130+0000","last_became_peered":"2024-09-10T08:42:29.371130+0000","last_unstale":"2024-09-10T08:42:29.379615+0000","last_undegraded":"2024-09-10T08:42:29.379615+0000","last_fullsized":"2024-09-10T08:42:29.379615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370658+0000","last_change":"2024-09-10T08:42:29.366985+0000","last_active":"2024-09-10T08:42:29.370658+0000","last_peered":"2024-09-10T08:42:29.370658+0000","last_clean":"2024-09-10T08:42:29.370658+0000","last_became_active":"2024-09-10T08:42:29.366690+0000","last_became_peered":"2024-09-10T08:42:29.366690+0000","last_unstale":"2024-09-10T08:42:29.370658+0000","last_undegraded":"2024-09-10T08:42:29.370658+0000","last_fullsized":"2024-09-10T08:42:29.370658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382997+0000","last_change":"2024-09-10T08:42:29.380452+0000","last_active":"2024-09-10T08:42:29.382997+0000","last_peered":"2024-09-10T08:42:29.382997+0000","last_clean":"2024-09-10T08:42:29.382997+0000","last_became_active":"2024-09-10T08:42:29.379753+0000","last_became_peered":"2024-09-10T08:42:29.379753+0000","last_unstale":"2024-09-10T08:42:29.382997+0000","last_undegraded":"2024-09-10T08:42:29.382997+0000","last_fullsized":"2024-09-10T08:42:29.382997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381298+0000","last_change":"2024-09-10T08:42:29.377573+0000","last_active":"2024-09-10T08:42:29.381298+0000","last_peered":"2024-09-10T08:42:29.381298+0000","last_clean":"2024-09-10T08:42:29.381298+0000","last_became_active":"2024-09-10T08:42:29.377309+0000","last_became_peered":"2024-09-10T08:42:29.377309+0000","last_unstale":"2024-09-10T08:42:29.381298+0000","last_undegraded":"2024-09-10T08:42:29.381298+0000","last_fullsized":"2024-09-10T08:42:29.381298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392289+0000","last_change":"2024-09-10T08:42:29.384443+0000","last_active":"2024-09-10T08:42:29.392289+0000","last_peered":"2024-09-10T08:42:29.392289+0000","last_clean":"2024-09-10T08:42:29.392289+0000","last_became_active":"2024-09-10T08:42:29.384157+0000","last_became_peered":"2024-09-10T08:42:29.384157+0000","last_unstale":"2024-09-10T08:42:29.392289+0000","last_undegraded":"2024-09-10T08:42:29.392289+0000","last_fullsized":"2024-09-10T08:42:29.392289+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:54.237300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378176+0000","last_change":"2024-09-10T08:42:29.368203+0000","last_active":"2024-09-10T08:42:29.378176+0000","last_peered":"2024-09-10T08:42:29.378176+0000","last_clean":"2024-09-10T08:42:29.378176+0000","last_became_active":"2024-09-10T08:42:29.367829+0000","last_became_peered":"2024-09-10T08:42:29.367829+0000","last_unstale":"2024-09-10T08:42:29.378176+0000","last_undegraded":"2024-09-10T08:42:29.378176+0000","last_fullsized":"2024-09-10T08:42:29.378176+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:24.493836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.366216+0000","last_change":"2024-09-10T08:42:29.361268+0000","last_active":"2024-09-10T08:42:29.366216+0000","last_peered":"2024-09-10T08:42:29.366216+0000","last_clean":"2024-09-10T08:42:29.366216+0000","last_became_active":"2024-09-10T08:42:29.360989+0000","last_became_peered":"2024-09-10T08:42:29.360989+0000","last_unstale":"2024-09-10T08:42:29.366216+0000","last_undegraded":"2024-09-10T08:42:29.366216+0000","last_fullsized":"2024-09-10T08:42:29.366216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:54.820048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.374189+0000","last_change":"2024-09-10T08:42:29.365642+0000","last_active":"2024-09-10T08:42:29.374189+0000","last_peered":"2024-09-10T08:42:29.374189+0000","last_clean":"2024-09-10T08:42:29.374189+0000","last_became_active":"2024-09-10T08:42:29.358997+0000","last_became_peered":"2024-09-10T08:42:29.358997+0000","last_unstale":"2024-09-10T08:42:29.374189+0000","last_undegraded":"2024-09-10T08:42:29.374189+0000","last_fullsized":"2024-09-10T08:42:29.374189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386658+0000","last_change":"2024-09-10T08:42:29.383360+0000","last_active":"2024-09-10T08:42:29.386658+0000","last_peered":"2024-09-10T08:42:29.386658+0000","last_clean":"2024-09-10T08:42:29.386658+0000","last_became_active":"2024-09-10T08:42:29.380706+0000","last_became_peered":"2024-09-10T08:42:29.380706+0000","last_unstale":"2024-09-10T08:42:29.386658+0000","last_undegraded":"2024-09-10T08:42:29.386658+0000","last_fullsized":"2024-09-10T08:42:29.386658+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:45.709011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.363033+0000","last_change":"2024-09-10T08:42:28.363033+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.363033+0000","last_undegraded":"2024-09-10T08:42:28.363033+0000","last_fullsized":"2024-09-10T08:42:28.363033+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375595+0000","last_change":"2024-09-10T08:42:29.370587+0000","last_active":"2024-09-10T08:42:29.375595+0000","last_peered":"2024-09-10T08:42:29.375595+0000","last_clean":"2024-09-10T08:42:29.375595+0000","last_became_active":"2024-09-10T08:42:29.368564+0000","last_became_peered":"2024-09-10T08:42:29.368564+0000","last_unstale":"2024-09-10T08:42:29.375595+0000","last_undegraded":"2024-09-10T08:42:29.375595+0000","last_fullsized":"2024-09-10T08:42:29.375595+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:42.401473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.361855+0000","last_change":"2024-09-10T08:42:28.361855+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.361855+0000","last_undegraded":"2024-09-10T08:42:28.361855+0000","last_fullsized":"2024-09-10T08:42:28.361855+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.359126+0000","last_change":"2024-09-10T08:42:28.359126+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.359126+0000","last_undegraded":"2024-09-10T08:42:28.359126+0000","last_fullsized":"2024-09-10T08:42:28.359126+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388704+0000","last_change":"2024-09-10T08:42:29.388085+0000","last_active":"2024-09-10T08:42:29.388704+0000","last_peered":"2024-09-10T08:42:29.388704+0000","last_clean":"2024-09-10T08:42:29.388704+0000","last_became_active":"2024-09-10T08:42:29.387481+0000","last_became_peered":"2024-09-10T08:42:29.387481+0000","last_unstale":"2024-09-10T08:42:29.388704+0000","last_undegraded":"2024-09-10T08:42:29.388704+0000","last_fullsized":"2024-09-10T08:42:29.388704+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:00:18.086767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391499+0000","last_change":"2024-09-10T08:42:29.386980+0000","last_active":"2024-09-10T08:42:29.391499+0000","last_peered":"2024-09-10T08:42:29.391499+0000","last_clean":"2024-09-10T08:42:29.391499+0000","last_became_active":"2024-09-10T08:42:29.386230+0000","last_became_peered":"2024-09-10T08:42:29.386230+0000","last_unstale":"2024-09-10T08:42:29.391499+0000","last_undegraded":"2024-09-10T08:42:29.391499+0000","last_fullsized":"2024-09-10T08:42:29.391499+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:28.038178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368228+0000","last_change":"2024-09-10T08:42:29.365247+0000","last_active":"2024-09-10T08:42:29.368228+0000","last_peered":"2024-09-10T08:42:29.368228+0000","last_clean":"2024-09-10T08:42:29.368228+0000","last_became_active":"2024-09-10T08:42:29.365006+0000","last_became_peered":"2024-09-10T08:42:29.365006+0000","last_unstale":"2024-09-10T08:42:29.368228+0000","last_undegraded":"2024-09-10T08:42:29.368228+0000","last_fullsized":"2024-09-10T08:42:29.368228+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:21.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382728+0000","last_change":"2024-09-10T08:42:29.380286+0000","last_active":"2024-09-10T08:42:29.382728+0000","last_peered":"2024-09-10T08:42:29.382728+0000","last_clean":"2024-09-10T08:42:29.382728+0000","last_became_active":"2024-09-10T08:42:29.379995+0000","last_became_peered":"2024-09-10T08:42:29.379995+0000","last_unstale":"2024-09-10T08:42:29.382728+0000","last_undegraded":"2024-09-10T08:42:29.382728+0000","last_fullsized":"2024-09-10T08:42:29.382728+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377613+0000","last_change":"2024-09-10T08:42:29.375078+0000","last_active":"2024-09-10T08:42:29.377613+0000","last_peered":"2024-09-10T08:42:29.377613+0000","last_clean":"2024-09-10T08:42:29.377613+0000","last_became_active":"2024-09-10T08:42:29.373435+0000","last_became_peered":"2024-09-10T08:42:29.373435+0000","last_unstale":"2024-09-10T08:42:29.377613+0000","last_undegraded":"2024-09-10T08:42:29.377613+0000","last_fullsized":"2024-09-10T08:42:29.377613+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:14:30.490305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383430+0000","last_change":"2024-09-10T08:42:29.380722+0000","last_active":"2024-09-10T08:42:29.383430+0000","last_peered":"2024-09-10T08:42:29.383430+0000","last_clean":"2024-09-10T08:42:29.383430+0000","last_became_active":"2024-09-10T08:42:29.380128+0000","last_became_peered":"2024-09-10T08:42:29.380128+0000","last_unstale":"2024-09-10T08:42:29.383430+0000","last_undegraded":"2024-09-10T08:42:29.383430+0000","last_fullsized":"2024-09-10T08:42:29.383430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375864+0000","last_change":"2024-09-10T08:42:29.372114+0000","last_active":"2024-09-10T08:42:29.375864+0000","last_peered":"2024-09-10T08:42:29.375864+0000","last_clean":"2024-09-10T08:42:29.375864+0000","last_became_active":"2024-09-10T08:42:29.371781+0000","last_became_peered":"2024-09-10T08:42:29.371781+0000","last_unstale":"2024-09-10T08:42:29.375864+0000","last_undegraded":"2024-09-10T08:42:29.375864+0000","last_fullsized":"2024-09-10T08:42:29.375864+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381151+0000","last_change":"2024-09-10T08:42:29.375856+0000","last_active":"2024-09-10T08:42:29.381151+0000","last_peered":"2024-09-10T08:42:29.381151+0000","last_clean":"2024-09-10T08:42:29.381151+0000","last_became_active":"2024-09-10T08:42:29.375593+0000","last_became_peered":"2024-09-10T08:42:29.375593+0000","last_unstale":"2024-09-10T08:42:29.381151+0000","last_undegraded":"2024-09-10T08:42:29.381151+0000","last_fullsized":"2024-09-10T08:42:29.381151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389201+0000","last_change":"2024-09-10T08:42:29.388359+0000","last_active":"2024-09-10T08:42:29.389201+0000","last_peered":"2024-09-10T08:42:29.389201+0000","last_clean":"2024-09-10T08:42:29.389201+0000","last_became_active":"2024-09-10T08:42:29.388047+0000","last_became_peered":"2024-09-10T08:42:29.388047+0000","last_unstale":"2024-09-10T08:42:29.389201+0000","last_undegraded":"2024-09-10T08:42:29.389201+0000","last_fullsized":"2024-09-10T08:42:29.389201+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.357072+0000","last_change":"2024-09-10T08:42:28.357072+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.357072+0000","last_undegraded":"2024-09-10T08:42:28.357072+0000","last_fullsized":"2024-09-10T08:42:28.357072+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383353+0000","last_change":"2024-09-10T08:42:29.382521+0000","last_active":"2024-09-10T08:42:29.383353+0000","last_peered":"2024-09-10T08:42:29.383353+0000","last_clean":"2024-09-10T08:42:29.383353+0000","last_became_active":"2024-09-10T08:42:29.382070+0000","last_became_peered":"2024-09-10T08:42:29.382070+0000","last_unstale":"2024-09-10T08:42:29.383353+0000","last_undegraded":"2024-09-10T08:42:29.383353+0000","last_fullsized":"2024-09-10T08:42:29.383353+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390692+0000","last_change":"2024-09-10T08:42:29.388579+0000","last_active":"2024-09-10T08:42:29.390692+0000","last_peered":"2024-09-10T08:42:29.390692+0000","last_clean":"2024-09-10T08:42:29.390692+0000","last_became_active":"2024-09-10T08:42:29.387955+0000","last_became_peered":"2024-09-10T08:42:29.387955+0000","last_unstale":"2024-09-10T08:42:29.390692+0000","last_undegraded":"2024-09-10T08:42:29.390692+0000","last_fullsized":"2024-09-10T08:42:29.390692+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"194'4","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.387578+0000","last_change":"2024-09-10T08:42:28.372955+0000","last_active":"2024-09-10T08:42:29.387578+0000","last_peered":"2024-09-10T08:42:29.387578+0000","last_clean":"2024-09-10T08:42:29.387578+0000","last_became_active":"2024-09-10T08:42:28.372574+0000","last_became_peered":"2024-09-10T08:42:28.372574+0000","last_unstale":"2024-09-10T08:42:29.387578+0000","last_undegraded":"2024-09-10T08:42:29.387578+0000","last_fullsized":"2024-09-10T08:42:29.387578+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:26.918397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384459+0000","last_change":"2024-09-10T08:42:29.383975+0000","last_active":"2024-09-10T08:42:29.384459+0000","last_peered":"2024-09-10T08:42:29.384459+0000","last_clean":"2024-09-10T08:42:29.384459+0000","last_became_active":"2024-09-10T08:42:29.383653+0000","last_became_peered":"2024-09-10T08:42:29.383653+0000","last_unstale":"2024-09-10T08:42:29.384459+0000","last_undegraded":"2024-09-10T08:42:29.384459+0000","last_fullsized":"2024-09-10T08:42:29.384459+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:38.555871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394413+0000","last_change":"2024-09-10T08:42:28.369545+0000","last_active":"2024-09-10T08:42:29.394413+0000","last_peered":"2024-09-10T08:42:29.394413+0000","last_clean":"2024-09-10T08:42:29.394413+0000","last_became_active":"2024-09-10T08:42:28.369294+0000","last_became_peered":"2024-09-10T08:42:28.369294+0000","last_unstale":"2024-09-10T08:42:29.394413+0000","last_undegraded":"2024-09-10T08:42:29.394413+0000","last_fullsized":"2024-09-10T08:42:29.394413+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389643+0000","last_change":"2024-09-10T08:42:29.388371+0000","last_active":"2024-09-10T08:42:29.389643+0000","last_peered":"2024-09-10T08:42:29.389643+0000","last_clean":"2024-09-10T08:42:29.389643+0000","last_became_active":"2024-09-10T08:42:29.387376+0000","last_became_peered":"2024-09-10T08:42:29.387376+0000","last_unstale":"2024-09-10T08:42:29.389643+0000","last_undegraded":"2024-09-10T08:42:29.389643+0000","last_fullsized":"2024-09-10T08:42:29.389643+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382489+0000","last_change":"2024-09-10T08:42:28.360994+0000","last_active":"2024-09-10T08:42:29.382489+0000","last_peered":"2024-09-10T08:42:29.382489+0000","last_clean":"2024-09-10T08:42:29.382489+0000","last_became_active":"2024-09-10T08:42:28.360662+0000","last_became_peered":"2024-09-10T08:42:28.360662+0000","last_unstale":"2024-09-10T08:42:29.382489+0000","last_undegraded":"2024-09-10T08:42:29.382489+0000","last_fullsized":"2024-09-10T08:42:29.382489+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:03.922764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390423+0000","last_change":"2024-09-10T08:42:29.388335+0000","last_active":"2024-09-10T08:42:29.390423+0000","last_peered":"2024-09-10T08:42:29.390423+0000","last_clean":"2024-09-10T08:42:29.390423+0000","last_became_active":"2024-09-10T08:42:29.387186+0000","last_became_peered":"2024-09-10T08:42:29.387186+0000","last_unstale":"2024-09-10T08:42:29.390423+0000","last_undegraded":"2024-09-10T08:42:29.390423+0000","last_fullsized":"2024-09-10T08:42:29.390423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372480+0000","last_change":"2024-09-10T08:42:28.358867+0000","last_active":"2024-09-10T08:42:29.372480+0000","last_peered":"2024-09-10T08:42:29.372480+0000","last_clean":"2024-09-10T08:42:29.372480+0000","last_became_active":"2024-09-10T08:42:28.358299+0000","last_became_peered":"2024-09-10T08:42:28.358299+0000","last_unstale":"2024-09-10T08:42:29.372480+0000","last_undegraded":"2024-09-10T08:42:29.372480+0000","last_fullsized":"2024-09-10T08:42:29.372480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:04.222556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388672+0000","last_change":"2024-09-10T08:42:29.387982+0000","last_active":"2024-09-10T08:42:29.388672+0000","last_peered":"2024-09-10T08:42:29.388672+0000","last_clean":"2024-09-10T08:42:29.388672+0000","last_became_active":"2024-09-10T08:42:29.387636+0000","last_became_peered":"2024-09-10T08:42:29.387636+0000","last_unstale":"2024-09-10T08:42:29.388672+0000","last_undegraded":"2024-09-10T08:42:29.388672+0000","last_fullsized":"2024-09-10T08:42:29.388672+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:40.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.392957+0000","last_change":"2024-09-10T08:42:28.374924+0000","last_active":"2024-09-10T08:42:29.392957+0000","last_peered":"2024-09-10T08:42:29.392957+0000","last_clean":"2024-09-10T08:42:29.392957+0000","last_became_active":"2024-09-10T08:42:28.374637+0000","last_became_peered":"2024-09-10T08:42:28.374637+0000","last_unstale":"2024-09-10T08:42:29.392957+0000","last_undegraded":"2024-09-10T08:42:29.392957+0000","last_fullsized":"2024-09-10T08:42:29.392957+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380123+0000","last_change":"2024-09-10T08:42:29.379574+0000","last_active":"2024-09-10T08:42:29.380123+0000","last_peered":"2024-09-10T08:42:29.380123+0000","last_clean":"2024-09-10T08:42:29.380123+0000","last_became_active":"2024-09-10T08:42:29.379202+0000","last_became_peered":"2024-09-10T08:42:29.379202+0000","last_unstale":"2024-09-10T08:42:29.380123+0000","last_undegraded":"2024-09-10T08:42:29.380123+0000","last_fullsized":"2024-09-10T08:42:29.380123+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:51.653936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353194+0000","last_change":"2024-09-10T08:42:28.356438+0000","last_active":"2024-09-10T08:42:29.353194+0000","last_peered":"2024-09-10T08:42:29.353194+0000","last_clean":"2024-09-10T08:42:29.353194+0000","last_became_active":"2024-09-10T08:42:28.356140+0000","last_became_peered":"2024-09-10T08:42:28.356140+0000","last_unstale":"2024-09-10T08:42:29.353194+0000","last_undegraded":"2024-09-10T08:42:29.353194+0000","last_fullsized":"2024-09-10T08:42:29.353194+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391478+0000","last_change":"2024-09-10T08:42:29.386977+0000","last_active":"2024-09-10T08:42:29.391478+0000","last_peered":"2024-09-10T08:42:29.391478+0000","last_clean":"2024-09-10T08:42:29.391478+0000","last_became_active":"2024-09-10T08:42:29.385141+0000","last_became_peered":"2024-09-10T08:42:29.385141+0000","last_unstale":"2024-09-10T08:42:29.391478+0000","last_undegraded":"2024-09-10T08:42:29.391478+0000","last_fullsized":"2024-09-10T08:42:29.391478+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:56.130684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.367066+0000","last_change":"2024-09-10T08:42:28.365813+0000","last_active":"2024-09-10T08:42:28.367066+0000","last_peered":"2024-09-10T08:42:28.367066+0000","last_clean":"2024-09-10T08:42:28.367066+0000","last_became_active":"2024-09-10T08:42:28.365458+0000","last_became_peered":"2024-09-10T08:42:28.365458+0000","last_unstale":"2024-09-10T08:42:28.367066+0000","last_undegraded":"2024-09-10T08:42:28.367066+0000","last_fullsized":"2024-09-10T08:42:28.367066+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:33.635713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390318+0000","last_change":"2024-09-10T08:42:29.389734+0000","last_active":"2024-09-10T08:42:29.390318+0000","last_peered":"2024-09-10T08:42:29.390318+0000","last_clean":"2024-09-10T08:42:29.390318+0000","last_became_active":"2024-09-10T08:42:29.389260+0000","last_became_peered":"2024-09-10T08:42:29.389260+0000","last_unstale":"2024-09-10T08:42:29.390318+0000","last_undegraded":"2024-09-10T08:42:29.390318+0000","last_fullsized":"2024-09-10T08:42:29.390318+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:01.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390920+0000","last_change":"2024-09-10T08:42:28.372691+0000","last_active":"2024-09-10T08:42:29.390920+0000","last_peered":"2024-09-10T08:42:29.390920+0000","last_clean":"2024-09-10T08:42:29.390920+0000","last_became_active":"2024-09-10T08:42:28.372367+0000","last_became_peered":"2024-09-10T08:42:28.372367+0000","last_unstale":"2024-09-10T08:42:29.390920+0000","last_undegraded":"2024-09-10T08:42:29.390920+0000","last_fullsized":"2024-09-10T08:42:29.390920+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.383027+0000","last_change":"2024-09-10T08:42:29.380637+0000","last_active":"2024-09-10T08:42:29.383027+0000","last_peered":"2024-09-10T08:42:29.383027+0000","last_clean":"2024-09-10T08:42:29.383027+0000","last_became_active":"2024-09-10T08:42:29.380035+0000","last_became_peered":"2024-09-10T08:42:29.380035+0000","last_unstale":"2024-09-10T08:42:29.383027+0000","last_undegraded":"2024-09-10T08:42:29.383027+0000","last_fullsized":"2024-09-10T08:42:29.383027+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360806+0000","last_change":"2024-09-10T08:42:28.361429+0000","last_active":"2024-09-10T08:42:29.360806+0000","last_peered":"2024-09-10T08:42:29.360806+0000","last_clean":"2024-09-10T08:42:29.360806+0000","last_became_active":"2024-09-10T08:42:28.361128+0000","last_became_peered":"2024-09-10T08:42:28.361128+0000","last_unstale":"2024-09-10T08:42:29.360806+0000","last_undegraded":"2024-09-10T08:42:29.360806+0000","last_fullsized":"2024-09-10T08:42:29.360806+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.109808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381251+0000","last_change":"2024-09-10T08:42:29.377162+0000","last_active":"2024-09-10T08:42:29.381251+0000","last_peered":"2024-09-10T08:42:29.381251+0000","last_clean":"2024-09-10T08:42:29.381251+0000","last_became_active":"2024-09-10T08:42:29.376654+0000","last_became_peered":"2024-09-10T08:42:29.376654+0000","last_unstale":"2024-09-10T08:42:29.381251+0000","last_undegraded":"2024-09-10T08:42:29.381251+0000","last_fullsized":"2024-09-10T08:42:29.381251+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:52.434399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"194'3","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377858+0000","last_change":"2024-09-10T08:42:28.361008+0000","last_active":"2024-09-10T08:42:29.377858+0000","last_peered":"2024-09-10T08:42:29.377858+0000","last_clean":"2024-09-10T08:42:29.377858+0000","last_became_active":"2024-09-10T08:42:28.360416+0000","last_became_peered":"2024-09-10T08:42:28.360416+0000","last_unstale":"2024-09-10T08:42:29.377858+0000","last_undegraded":"2024-09-10T08:42:29.377858+0000","last_fullsized":"2024-09-10T08:42:29.377858+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389677+0000","last_change":"2024-09-10T08:42:29.388994+0000","last_active":"2024-09-10T08:42:29.389677+0000","last_peered":"2024-09-10T08:42:29.389677+0000","last_clean":"2024-09-10T08:42:29.389677+0000","last_became_active":"2024-09-10T08:42:29.388728+0000","last_became_peered":"2024-09-10T08:42:29.388728+0000","last_unstale":"2024-09-10T08:42:29.389677+0000","last_undegraded":"2024-09-10T08:42:29.389677+0000","last_fullsized":"2024-09-10T08:42:29.389677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:41.416780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369785+0000","last_change":"2024-09-10T08:42:28.368808+0000","last_active":"2024-09-10T08:42:28.369785+0000","last_peered":"2024-09-10T08:42:28.369785+0000","last_clean":"2024-09-10T08:42:28.369785+0000","last_became_active":"2024-09-10T08:42:28.368332+0000","last_became_peered":"2024-09-10T08:42:28.368332+0000","last_unstale":"2024-09-10T08:42:28.369785+0000","last_undegraded":"2024-09-10T08:42:28.369785+0000","last_fullsized":"2024-09-10T08:42:28.369785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:53.842059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368463+0000","last_change":"2024-09-10T08:42:29.365138+0000","last_active":"2024-09-10T08:42:29.368463+0000","last_peered":"2024-09-10T08:42:29.368463+0000","last_clean":"2024-09-10T08:42:29.368463+0000","last_became_active":"2024-09-10T08:42:29.364846+0000","last_became_peered":"2024-09-10T08:42:29.364846+0000","last_unstale":"2024-09-10T08:42:29.368463+0000","last_undegraded":"2024-09-10T08:42:29.368463+0000","last_fullsized":"2024-09-10T08:42:29.368463+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:31.290863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382903+0000","last_change":"2024-09-10T08:42:28.367429+0000","last_active":"2024-09-10T08:42:29.382903+0000","last_peered":"2024-09-10T08:42:29.382903+0000","last_clean":"2024-09-10T08:42:29.382903+0000","last_became_active":"2024-09-10T08:42:28.367107+0000","last_became_peered":"2024-09-10T08:42:28.367107+0000","last_unstale":"2024-09-10T08:42:29.382903+0000","last_undegraded":"2024-09-10T08:42:29.382903+0000","last_fullsized":"2024-09-10T08:42:29.382903+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368673+0000","last_change":"2024-09-10T08:42:29.367545+0000","last_active":"2024-09-10T08:42:29.368673+0000","last_peered":"2024-09-10T08:42:29.368673+0000","last_clean":"2024-09-10T08:42:29.368673+0000","last_became_active":"2024-09-10T08:42:29.367259+0000","last_became_peered":"2024-09-10T08:42:29.367259+0000","last_unstale":"2024-09-10T08:42:29.368673+0000","last_undegraded":"2024-09-10T08:42:29.368673+0000","last_fullsized":"2024-09-10T08:42:29.368673+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355995+0000","last_change":"2024-09-10T08:42:28.371165+0000","last_active":"2024-09-10T08:42:29.355995+0000","last_peered":"2024-09-10T08:42:29.355995+0000","last_clean":"2024-09-10T08:42:29.355995+0000","last_became_active":"2024-09-10T08:42:28.370828+0000","last_became_peered":"2024-09-10T08:42:28.370828+0000","last_unstale":"2024-09-10T08:42:29.355995+0000","last_undegraded":"2024-09-10T08:42:29.355995+0000","last_fullsized":"2024-09-10T08:42:29.355995+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:47.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.380877+0000","last_change":"2024-09-10T08:42:29.375188+0000","last_active":"2024-09-10T08:42:29.380877+0000","last_peered":"2024-09-10T08:42:29.380877+0000","last_clean":"2024-09-10T08:42:29.380877+0000","last_became_active":"2024-09-10T08:42:29.374605+0000","last_became_peered":"2024-09-10T08:42:29.374605+0000","last_unstale":"2024-09-10T08:42:29.380877+0000","last_undegraded":"2024-09-10T08:42:29.380877+0000","last_fullsized":"2024-09-10T08:42:29.380877+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.355279+0000","last_change":"2024-09-10T08:42:28.367589+0000","last_active":"2024-09-10T08:42:29.355279+0000","last_peered":"2024-09-10T08:42:29.355279+0000","last_clean":"2024-09-10T08:42:29.355279+0000","last_became_active":"2024-09-10T08:42:28.367298+0000","last_became_peered":"2024-09-10T08:42:28.367298+0000","last_unstale":"2024-09-10T08:42:29.355279+0000","last_undegraded":"2024-09-10T08:42:29.355279+0000","last_fullsized":"2024-09-10T08:42:29.355279+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:23.134397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.375894+0000","last_change":"2024-09-10T08:42:29.368320+0000","last_active":"2024-09-10T08:42:29.375894+0000","last_peered":"2024-09-10T08:42:29.375894+0000","last_clean":"2024-09-10T08:42:29.375894+0000","last_became_active":"2024-09-10T08:42:29.367925+0000","last_became_peered":"2024-09-10T08:42:29.367925+0000","last_unstale":"2024-09-10T08:42:29.375894+0000","last_undegraded":"2024-09-10T08:42:29.375894+0000","last_fullsized":"2024-09-10T08:42:29.375894+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:38.289380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"194'8","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.382255+0000","last_change":"2024-09-10T08:42:28.370026+0000","last_active":"2024-09-10T08:42:29.382255+0000","last_peered":"2024-09-10T08:42:29.382255+0000","last_clean":"2024-09-10T08:42:29.382255+0000","last_became_active":"2024-09-10T08:42:28.369757+0000","last_became_peered":"2024-09-10T08:42:28.369757+0000","last_unstale":"2024-09-10T08:42:29.382255+0000","last_undegraded":"2024-09-10T08:42:29.382255+0000","last_fullsized":"2024-09-10T08:42:29.382255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.368376+0000","last_change":"2024-09-10T08:42:29.365719+0000","last_active":"2024-09-10T08:42:29.368376+0000","last_peered":"2024-09-10T08:42:29.368376+0000","last_clean":"2024-09-10T08:42:29.368376+0000","last_became_active":"2024-09-10T08:42:29.365419+0000","last_became_peered":"2024-09-10T08:42:29.365419+0000","last_unstale":"2024-09-10T08:42:29.368376+0000","last_undegraded":"2024-09-10T08:42:29.368376+0000","last_fullsized":"2024-09-10T08:42:29.368376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:59.758870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393966+0000","last_change":"2024-09-10T08:42:28.371311+0000","last_active":"2024-09-10T08:42:29.393966+0000","last_peered":"2024-09-10T08:42:29.393966+0000","last_clean":"2024-09-10T08:42:29.393966+0000","last_became_active":"2024-09-10T08:42:28.371021+0000","last_became_peered":"2024-09-10T08:42:28.371021+0000","last_unstale":"2024-09-10T08:42:29.393966+0000","last_undegraded":"2024-09-10T08:42:29.393966+0000","last_fullsized":"2024-09-10T08:42:29.393966+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:47.699312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.362207+0000","last_change":"2024-09-10T08:42:28.362207+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.362207+0000","last_undegraded":"2024-09-10T08:42:28.362207+0000","last_fullsized":"2024-09-10T08:42:28.362207+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.369959+0000","last_change":"2024-09-10T08:42:28.369134+0000","last_active":"2024-09-10T08:42:28.369959+0000","last_peered":"2024-09-10T08:42:28.369959+0000","last_clean":"2024-09-10T08:42:28.369959+0000","last_became_active":"2024-09-10T08:42:28.368736+0000","last_became_peered":"2024-09-10T08:42:28.368736+0000","last_unstale":"2024-09-10T08:42:28.369959+0000","last_undegraded":"2024-09-10T08:42:28.369959+0000","last_fullsized":"2024-09-10T08:42:28.369959+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:14.483339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.378153+0000","last_change":"2024-09-10T08:42:29.376134+0000","last_active":"2024-09-10T08:42:29.378153+0000","last_peered":"2024-09-10T08:42:29.378153+0000","last_clean":"2024-09-10T08:42:29.378153+0000","last_became_active":"2024-09-10T08:42:29.374622+0000","last_became_peered":"2024-09-10T08:42:29.374622+0000","last_unstale":"2024-09-10T08:42:29.378153+0000","last_undegraded":"2024-09-10T08:42:29.378153+0000","last_fullsized":"2024-09-10T08:42:29.378153+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"194'1","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.394649+0000","last_change":"2024-09-10T08:42:28.371235+0000","last_active":"2024-09-10T08:42:29.394649+0000","last_peered":"2024-09-10T08:42:29.394649+0000","last_clean":"2024-09-10T08:42:29.394649+0000","last_became_active":"2024-09-10T08:42:28.370717+0000","last_became_peered":"2024-09-10T08:42:28.370717+0000","last_unstale":"2024-09-10T08:42:29.394649+0000","last_undegraded":"2024-09-10T08:42:29.394649+0000","last_fullsized":"2024-09-10T08:42:29.394649+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.389665+0000","last_change":"2024-09-10T08:42:29.388578+0000","last_active":"2024-09-10T08:42:29.389665+0000","last_peered":"2024-09-10T08:42:29.389665+0000","last_clean":"2024-09-10T08:42:29.389665+0000","last_became_active":"2024-09-10T08:42:29.387485+0000","last_became_peered":"2024-09-10T08:42:29.387485+0000","last_unstale":"2024-09-10T08:42:29.389665+0000","last_undegraded":"2024-09-10T08:42:29.389665+0000","last_fullsized":"2024-09-10T08:42:29.389665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:30.985321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.359666+0000","last_change":"2024-09-10T08:42:28.366118+0000","last_active":"2024-09-10T08:42:29.359666+0000","last_peered":"2024-09-10T08:42:29.359666+0000","last_clean":"2024-09-10T08:42:29.359666+0000","last_became_active":"2024-09-10T08:42:28.365820+0000","last_became_peered":"2024-09-10T08:42:28.365820+0000","last_unstale":"2024-09-10T08:42:29.359666+0000","last_undegraded":"2024-09-10T08:42:29.359666+0000","last_fullsized":"2024-09-10T08:42:29.359666+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:15.022898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.358190+0000","last_change":"2024-09-10T08:42:28.358190+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.358190+0000","last_undegraded":"2024-09-10T08:42:28.358190+0000","last_fullsized":"2024-09-10T08:42:28.358190+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.393860+0000","last_change":"2024-09-10T08:42:28.369096+0000","last_active":"2024-09-10T08:42:29.393860+0000","last_peered":"2024-09-10T08:42:29.393860+0000","last_clean":"2024-09-10T08:42:29.393860+0000","last_became_active":"2024-09-10T08:42:28.367579+0000","last_became_peered":"2024-09-10T08:42:28.367579+0000","last_unstale":"2024-09-10T08:42:29.393860+0000","last_undegraded":"2024-09-10T08:42:29.393860+0000","last_fullsized":"2024-09-10T08:42:29.393860+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:34.790766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.381174+0000","last_change":"2024-09-10T08:42:29.376975+0000","last_active":"2024-09-10T08:42:29.381174+0000","last_peered":"2024-09-10T08:42:29.381174+0000","last_clean":"2024-09-10T08:42:29.381174+0000","last_became_active":"2024-09-10T08:42:29.375816+0000","last_became_peered":"2024-09-10T08:42:29.375816+0000","last_unstale":"2024-09-10T08:42:29.381174+0000","last_undegraded":"2024-09-10T08:42:29.381174+0000","last_fullsized":"2024-09-10T08:42:29.381174+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.370654+0000","last_change":"2024-09-10T08:42:28.365210+0000","last_active":"2024-09-10T08:42:29.370654+0000","last_peered":"2024-09-10T08:42:29.370654+0000","last_clean":"2024-09-10T08:42:29.370654+0000","last_became_active":"2024-09-10T08:42:28.364926+0000","last_became_peered":"2024-09-10T08:42:28.364926+0000","last_unstale":"2024-09-10T08:42:29.370654+0000","last_undegraded":"2024-09-10T08:42:29.370654+0000","last_fullsized":"2024-09-10T08:42:29.370654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:58.755691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.377086+0000","last_change":"2024-09-10T08:42:29.375211+0000","last_active":"2024-09-10T08:42:29.377086+0000","last_peered":"2024-09-10T08:42:29.377086+0000","last_clean":"2024-09-10T08:42:29.377086+0000","last_became_active":"2024-09-10T08:42:29.374945+0000","last_became_peered":"2024-09-10T08:42:29.374945+0000","last_unstale":"2024-09-10T08:42:29.377086+0000","last_undegraded":"2024-09-10T08:42:29.377086+0000","last_fullsized":"2024-09-10T08:42:29.377086+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:45:46.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.362732+0000","last_change":"2024-09-10T08:42:28.368260+0000","last_active":"2024-09-10T08:42:29.362732+0000","last_peered":"2024-09-10T08:42:29.362732+0000","last_clean":"2024-09-10T08:42:29.362732+0000","last_became_active":"2024-09-10T08:42:28.366958+0000","last_became_peered":"2024-09-10T08:42:28.366958+0000","last_unstale":"2024-09-10T08:42:29.362732+0000","last_undegraded":"2024-09-10T08:42:29.362732+0000","last_fullsized":"2024-09-10T08:42:29.362732+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.388562+0000","last_change":"2024-09-10T08:42:29.387997+0000","last_active":"2024-09-10T08:42:29.388562+0000","last_peered":"2024-09-10T08:42:29.388562+0000","last_clean":"2024-09-10T08:42:29.388562+0000","last_became_active":"2024-09-10T08:42:29.387143+0000","last_became_peered":"2024-09-10T08:42:29.387143+0000","last_unstale":"2024-09-10T08:42:29.388562+0000","last_undegraded":"2024-09-10T08:42:29.388562+0000","last_fullsized":"2024-09-10T08:42:29.388562+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.360759+0000","last_change":"2024-09-10T08:42:28.373429+0000","last_active":"2024-09-10T08:42:29.360759+0000","last_peered":"2024-09-10T08:42:29.360759+0000","last_clean":"2024-09-10T08:42:29.360759+0000","last_became_active":"2024-09-10T08:42:28.373018+0000","last_became_peered":"2024-09-10T08:42:28.373018+0000","last_unstale":"2024-09-10T08:42:29.360759+0000","last_undegraded":"2024-09-10T08:42:29.360759+0000","last_fullsized":"2024-09-10T08:42:29.360759+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:55.127506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":193,"state":"creating+peering","last_fresh":"2024-09-10T08:42:28.360430+0000","last_change":"2024-09-10T08:42:28.360430+0000","last_active":"2024-09-10T08:42:28.339417+0000","last_peered":"2024-09-10T08:42:28.339417+0000","last_clean":"2024-09-10T08:42:28.339417+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T08:42:28.360430+0000","last_undegraded":"2024-09-10T08:42:28.360430+0000","last_fullsized":"2024-09-10T08:42:28.360430+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2024-09-10T08:42:28.370467+0000","last_change":"2024-09-10T08:42:28.369947+0000","last_active":"2024-09-10T08:42:28.370467+0000","last_peered":"2024-09-10T08:42:28.370467+0000","last_clean":"2024-09-10T08:42:28.370467+0000","last_became_active":"2024-09-10T08:42:28.368829+0000","last_became_peered":"2024-09-10T08:42:28.368829+0000","last_unstale":"2024-09-10T08:42:28.370467+0000","last_undegraded":"2024-09-10T08:42:28.370467+0000","last_fullsized":"2024-09-10T08:42:28.370467+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:29:00.951036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391197+0000","last_change":"2024-09-10T08:42:29.383681+0000","last_active":"2024-09-10T08:42:29.391197+0000","last_peered":"2024-09-10T08:42:29.391197+0000","last_clean":"2024-09-10T08:42:29.391197+0000","last_became_active":"2024-09-10T08:42:29.383061+0000","last_became_peered":"2024-09-10T08:42:29.383061+0000","last_unstale":"2024-09-10T08:42:29.391197+0000","last_undegraded":"2024-09-10T08:42:29.391197+0000","last_fullsized":"2024-09-10T08:42:29.391197+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:40.346099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.391289+0000","last_change":"2024-09-10T08:42:28.372012+0000","last_active":"2024-09-10T08:42:29.391289+0000","last_peered":"2024-09-10T08:42:29.391289+0000","last_clean":"2024-09-10T08:42:29.391289+0000","last_became_active":"2024-09-10T08:42:28.371754+0000","last_became_peered":"2024-09-10T08:42:28.371754+0000","last_unstale":"2024-09-10T08:42:29.391289+0000","last_undegraded":"2024-09-10T08:42:29.391289+0000","last_fullsized":"2024-09-10T08:42:29.391289+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385489+0000","last_change":"2024-09-10T08:42:29.378781+0000","last_active":"2024-09-10T08:42:29.385489+0000","last_peered":"2024-09-10T08:42:29.385489+0000","last_clean":"2024-09-10T08:42:29.385489+0000","last_became_active":"2024-09-10T08:42:29.378509+0000","last_became_peered":"2024-09-10T08:42:29.378509+0000","last_unstale":"2024-09-10T08:42:29.385489+0000","last_undegraded":"2024-09-10T08:42:29.385489+0000","last_fullsized":"2024-09-10T08:42:29.385489+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:26.452775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.353377+0000","last_change":"2024-09-10T08:42:28.361630+0000","last_active":"2024-09-10T08:42:29.353377+0000","last_peered":"2024-09-10T08:42:29.353377+0000","last_clean":"2024-09-10T08:42:29.353377+0000","last_became_active":"2024-09-10T08:42:28.358295+0000","last_became_peered":"2024-09-10T08:42:28.358295+0000","last_unstale":"2024-09-10T08:42:29.353377+0000","last_undegraded":"2024-09-10T08:42:29.353377+0000","last_fullsized":"2024-09-10T08:42:29.353377+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:21.406617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.372202+0000","last_change":"2024-09-10T08:42:29.368037+0000","last_active":"2024-09-10T08:42:29.372202+0000","last_peered":"2024-09-10T08:42:29.372202+0000","last_clean":"2024-09-10T08:42:29.372202+0000","last_became_active":"2024-09-10T08:42:29.367522+0000","last_became_peered":"2024-09-10T08:42:29.367522+0000","last_unstale":"2024-09-10T08:42:29.372202+0000","last_undegraded":"2024-09-10T08:42:29.372202+0000","last_fullsized":"2024-09-10T08:42:29.372202+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:24:18.327157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361112+0000","last_change":"2024-09-10T08:42:28.370188+0000","last_active":"2024-09-10T08:42:29.361112+0000","last_peered":"2024-09-10T08:42:29.361112+0000","last_clean":"2024-09-10T08:42:29.361112+0000","last_became_active":"2024-09-10T08:42:28.369878+0000","last_became_peered":"2024-09-10T08:42:28.369878+0000","last_unstale":"2024-09-10T08:42:29.361112+0000","last_undegraded":"2024-09-10T08:42:29.361112+0000","last_fullsized":"2024-09-10T08:42:29.361112+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:27.034999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386671+0000","last_change":"2024-09-10T08:42:29.384764+0000","last_active":"2024-09-10T08:42:29.386671+0000","last_peered":"2024-09-10T08:42:29.386671+0000","last_clean":"2024-09-10T08:42:29.386671+0000","last_became_active":"2024-09-10T08:42:29.383341+0000","last_became_peered":"2024-09-10T08:42:29.383341+0000","last_unstale":"2024-09-10T08:42:29.386671+0000","last_undegraded":"2024-09-10T08:42:29.386671+0000","last_fullsized":"2024-09-10T08:42:29.386671+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:39.613196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.364278+0000","last_change":"2024-09-10T08:42:28.368721+0000","last_active":"2024-09-10T08:42:29.364278+0000","last_peered":"2024-09-10T08:42:29.364278+0000","last_clean":"2024-09-10T08:42:29.364278+0000","last_became_active":"2024-09-10T08:42:28.368451+0000","last_became_peered":"2024-09-10T08:42:28.368451+0000","last_unstale":"2024-09-10T08:42:29.364278+0000","last_undegraded":"2024-09-10T08:42:29.364278+0000","last_fullsized":"2024-09-10T08:42:29.364278+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.386290+0000","last_change":"2024-09-10T08:42:29.383876+0000","last_active":"2024-09-10T08:42:29.386290+0000","last_peered":"2024-09-10T08:42:29.386290+0000","last_clean":"2024-09-10T08:42:29.386290+0000","last_became_active":"2024-09-10T08:42:29.383482+0000","last_became_peered":"2024-09-10T08:42:29.383482+0000","last_unstale":"2024-09-10T08:42:29.386290+0000","last_undegraded":"2024-09-10T08:42:29.386290+0000","last_fullsized":"2024-09-10T08:42:29.386290+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:52.708428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.356275+0000","last_change":"2024-09-10T08:42:28.365843+0000","last_active":"2024-09-10T08:42:29.356275+0000","last_peered":"2024-09-10T08:42:29.356275+0000","last_clean":"2024-09-10T08:42:29.356275+0000","last_became_active":"2024-09-10T08:42:28.365472+0000","last_became_peered":"2024-09-10T08:42:28.365472+0000","last_unstale":"2024-09-10T08:42:29.356275+0000","last_undegraded":"2024-09-10T08:42:29.356275+0000","last_fullsized":"2024-09-10T08:42:29.356275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:30.588924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.390402+0000","last_change":"2024-09-10T08:42:29.387773+0000","last_active":"2024-09-10T08:42:29.390402+0000","last_peered":"2024-09-10T08:42:29.390402+0000","last_clean":"2024-09-10T08:42:29.390402+0000","last_became_active":"2024-09-10T08:42:29.387377+0000","last_became_peered":"2024-09-10T08:42:29.387377+0000","last_unstale":"2024-09-10T08:42:29.390402+0000","last_undegraded":"2024-09-10T08:42:29.390402+0000","last_fullsized":"2024-09-10T08:42:29.390402+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.361238+0000","last_change":"2024-09-10T08:42:28.361831+0000","last_active":"2024-09-10T08:42:29.361238+0000","last_peered":"2024-09-10T08:42:29.361238+0000","last_clean":"2024-09-10T08:42:29.361238+0000","last_became_active":"2024-09-10T08:42:28.360230+0000","last_became_peered":"2024-09-10T08:42:28.360230+0000","last_unstale":"2024-09-10T08:42:29.361238+0000","last_undegraded":"2024-09-10T08:42:29.361238+0000","last_fullsized":"2024-09-10T08:42:29.361238+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373931+0000","last_change":"2024-09-10T08:42:29.364854+0000","last_active":"2024-09-10T08:42:29.373931+0000","last_peered":"2024-09-10T08:42:29.373931+0000","last_clean":"2024-09-10T08:42:29.373931+0000","last_became_active":"2024-09-10T08:42:29.364185+0000","last_became_peered":"2024-09-10T08:42:29.364185+0000","last_unstale":"2024-09-10T08:42:29.373931+0000","last_undegraded":"2024-09-10T08:42:29.373931+0000","last_fullsized":"2024-09-10T08:42:29.373931+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.385275+0000","last_change":"2024-09-10T08:42:28.371106+0000","last_active":"2024-09-10T08:42:29.385275+0000","last_peered":"2024-09-10T08:42:29.385275+0000","last_clean":"2024-09-10T08:42:29.385275+0000","last_became_active":"2024-09-10T08:42:28.370787+0000","last_became_peered":"2024-09-10T08:42:28.370787+0000","last_unstale":"2024-09-10T08:42:29.385275+0000","last_undegraded":"2024-09-10T08:42:29.385275+0000","last_fullsized":"2024-09-10T08:42:29.385275+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:40.197098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.373800+0000","last_change":"2024-09-10T08:42:29.364367+0000","last_active":"2024-09-10T08:42:29.373800+0000","last_peered":"2024-09-10T08:42:29.373800+0000","last_clean":"2024-09-10T08:42:29.373800+0000","last_became_active":"2024-09-10T08:42:29.364048+0000","last_became_peered":"2024-09-10T08:42:29.364048+0000","last_unstale":"2024-09-10T08:42:29.373800+0000","last_undegraded":"2024-09-10T08:42:29.373800+0000","last_fullsized":"2024-09-10T08:42:29.373800+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"194'2","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.395734+0000","last_change":"2024-09-10T08:42:28.374827+0000","last_active":"2024-09-10T08:42:29.395734+0000","last_peered":"2024-09-10T08:42:29.395734+0000","last_clean":"2024-09-10T08:42:29.395734+0000","last_became_active":"2024-09-10T08:42:28.374529+0000","last_became_peered":"2024-09-10T08:42:28.374529+0000","last_unstale":"2024-09-10T08:42:29.395734+0000","last_undegraded":"2024-09-10T08:42:29.395734+0000","last_fullsized":"2024-09-10T08:42:29.395734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-10T08:42:29.384457+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:42:29.384457+0000","last_peered":"2024-09-10T08:42:29.384457+0000","last_clean":"2024-09-10T08:42:29.384457+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:42:29.384457+0000","last_undegraded":"2024-09-10T08:42:29.384457+0000","last_fullsized":"2024-09-10T08:42:29.384457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51632,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320208,"statfs":{"total":96636764160,"available":96583892992,"internally_reserved":0,"allocated":2449408,"data_stored":1074415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1073867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509609,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509610,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69596,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302244,"statfs":{"total":96636764160,"available":96565497856,"internally_reserved":0,"allocated":2428928,"data_stored":1066968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":2388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":2445312,"data_stored":1073777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509610,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60512,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311328,"statfs":{"total":96636764160,"available":96574799872,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509612,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55788,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2441216,"data_stored":1073743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60508,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311332,"statfs":{"total":96636764160,"available":96574803968,"internally_reserved":0,"allocated":3022848,"data_stored":1657336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:42:38.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:42:38.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:38.441 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:42:38.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.457+0000 7f1a69a00640 1 Processor -- start 2024-09-10T08:42:38.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.457+0000 7f1a69a00640 1 -- start start 2024-09-10T08:42:38.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.458+0000 7f1a69a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a6415ed20 0x7f1a640b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.458+0000 7f1a69a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 0x7f1a640b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a69a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640d0e70 con 0x7f1a640cf2d0 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a69a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640d41c0 con 0x7f1a6415ed20 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a69a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640d35b0 con 0x7f1a640d23b0 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a62a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a6415ed20 0x7f1a640b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a63400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a640cf2d0 0x7f1a640cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59616/0 (socket says 172.21.15.52:59616) 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a63400640 1 -- 172.21.15.52:0/3620764281 learned_addr learned my addr 172.21.15.52:0/3620764281 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a5be00640 1 --2- 172.21.15.52:0/3620764281 >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 0x7f1a640b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a62a00640 1 -- 172.21.15.52:0/3620764281 >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 msgr2=0x7f1a640b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:38.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a62a00640 1 --2- 172.21.15.52:0/3620764281 >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 0x7f1a640b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a62a00640 1 -- 172.21.15.52:0/3620764281 >> v1:172.21.15.52:6789/0 conn(0x7f1a640cf2d0 legacy=0x7f1a640cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a62a00640 1 -- 172.21.15.52:0/3620764281 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640d3890 con 0x7f1a6415ed20 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.459+0000 7f1a5be00640 1 --2- 172.21.15.52:0/3620764281 >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 0x7f1a640b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.460+0000 7f1a62a00640 1 --2- 172.21.15.52:0/3620764281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640b6260 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1a640d4690 tx=0x7f1a5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529f57df6c082074 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.461+0000 7f1a62000640 1 -- 172.21.15.52:0/3620764281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037070 con 0x7f1a6415ed20 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.461+0000 7f1a62000640 1 -- 172.21.15.52:0/3620764281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54032440 con 0x7f1a6415ed20 2024-09-10T08:42:38.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.461+0000 7f1a62000640 1 -- 172.21.15.52:0/3620764281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5402ae60 con 0x7f1a6415ed20 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.461+0000 7f1a69a00640 1 -- 172.21.15.52:0/3620764281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 msgr2=0x7f1a640b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.461+0000 7f1a69a00640 1 --2- 172.21.15.52:0/3620764281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640b6260 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f1a640d4690 tx=0x7f1a5402a110 comp rx=0 tx=0).stop 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 -- 172.21.15.52:0/3620764281 shutdown_connections 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 --2- 172.21.15.52:0/3620764281 >> v2:172.21.15.176:3300/0 conn(0x7f1a640d23b0 0x7f1a640b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 --2- 172.21.15.52:0/3620764281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640b6260 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 -- 172.21.15.52:0/3620764281 >> 172.21.15.52:0/3620764281 conn(0x7f1a640d1260 msgr2=0x7f1a640d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 -- 172.21.15.52:0/3620764281 shutdown_connections 2024-09-10T08:42:38.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.462+0000 7f1a69a00640 1 -- 172.21.15.52:0/3620764281 wait complete. 2024-09-10T08:42:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.463+0000 7f1a69a00640 1 Processor -- start 2024-09-10T08:42:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.464+0000 7f1a69a00640 1 -- start start 2024-09-10T08:42:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.464+0000 7f1a69a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a640cf2d0 0x7f1a641608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.464+0000 7f1a69a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640d23b0 0x7f1a6414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a69a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a69a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640d32a0 con 0x7f1a6415ed20 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a69a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640d3e50 con 0x7f1a640d23b0 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a69a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6415f100 con 0x7f1a640cf2d0 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a5be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640d23b0 0x7f1a6414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50024/0 (socket says 172.21.15.52:50024) 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 -- 172.21.15.52:0/1772993172 learned_addr learned my addr 172.21.15.52:0/1772993172 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a62a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a640cf2d0 0x7f1a641608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 -- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a640cf2d0 msgr2=0x7f1a641608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a640cf2d0 0x7f1a641608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 -- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640d23b0 msgr2=0x7f1a6414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640d23b0 0x7f1a6414fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.465+0000 7f1a63400640 1 -- 172.21.15.52:0/1772993172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6415f830 con 0x7f1a6415ed20 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a63400640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ca80 tx=0x7f1a5c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c017070 con 0x7f1a6415ed20 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00ac30 con 0x7f1a6415ed20 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c012600 con 0x7f1a6415ed20 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6415fb10 con 0x7f1a6415ed20 2024-09-10T08:42:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.466+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641600d0 con 0x7f1a6415ed20 2024-09-10T08:42:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.467+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a640b7010 con 0x7f1a6415ed20 2024-09-10T08:42:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.468+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a5c01a070 con 0x7f1a6415ed20 2024-09-10T08:42:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.469+0000 7f1a5aa00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 0x7f1a4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.469+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f1a5c08ab50 con 0x7f1a6415ed20 2024-09-10T08:42:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.470+0000 7f1a62a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 0x7f1a4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.470+0000 7f1a62a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 0x7f1a4006e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.474+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a640d0e70 con 0x7f1a6415ed20 2024-09-10T08:42:38.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.654+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a640b3f20 con 0x7f1a4006be30 2024-09-10T08:42:38.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.661+0000 7f1a5aa00640 1 -- 172.21.15.52:0/1772993172 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252475 (secure 0 0 0) 0x7f1a640b3f20 con 0x7f1a4006be30 2024-09-10T08:42:38.664 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:38.666 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 msgr2=0x7f1a4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 0x7f1a4006e2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).stop 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 msgr2=0x7f1a640cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ca80 tx=0x7f1a5c00cf40 comp rx=0 tx=0).stop 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 shutdown_connections 2024-09-10T08:42:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1a4006be30 0x7f1a4006e2f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a6415ed20 0x7f1a640cc9e0 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a640d23b0 0x7f1a6414fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 --2- 172.21.15.52:0/1772993172 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1a640cf2d0 0x7f1a641608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 >> 172.21.15.52:0/1772993172 conn(0x7f1a640d1260 msgr2=0x7f1a640cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 shutdown_connections 2024-09-10T08:42:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.665+0000 7f1a69a00640 1 -- 172.21.15.52:0/1772993172 wait complete. 2024-09-10T08:42:38.682 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-10T08:42:37.663610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":461392,"kb_used_data":20392,"kb_used_omap":12,"kb_used_meta":440819,"kb_avail":754513328,"statfs":{"total":773094113280,"available":772621647872,"internally_reserved":0,"allocated":20881408,"data_stored":9825900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":451399216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.314220"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372077+0000","last_change":"2024-09-10T08:42:29.385887+0000","last_active":"2024-09-10T08:42:30.372077+0000","last_peered":"2024-09-10T08:42:30.372077+0000","last_clean":"2024-09-10T08:42:30.372077+0000","last_became_active":"2024-09-10T08:42:29.383384+0000","last_became_peered":"2024-09-10T08:42:29.383384+0000","last_unstale":"2024-09-10T08:42:30.372077+0000","last_undegraded":"2024-09-10T08:42:30.372077+0000","last_fullsized":"2024-09-10T08:42:30.372077+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925529+0000","last_change":"2024-09-10T08:42:29.388781+0000","last_active":"2024-09-10T08:42:30.925529+0000","last_peered":"2024-09-10T08:42:30.925529+0000","last_clean":"2024-09-10T08:42:30.925529+0000","last_became_active":"2024-09-10T08:42:29.388292+0000","last_became_peered":"2024-09-10T08:42:29.388292+0000","last_unstale":"2024-09-10T08:42:30.925529+0000","last_undegraded":"2024-09-10T08:42:30.925529+0000","last_fullsized":"2024-09-10T08:42:30.925529+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:17.321799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925656+0000","last_change":"2024-09-10T08:42:29.367007+0000","last_active":"2024-09-10T08:42:30.925656+0000","last_peered":"2024-09-10T08:42:30.925656+0000","last_clean":"2024-09-10T08:42:30.925656+0000","last_became_active":"2024-09-10T08:42:29.366713+0000","last_became_peered":"2024-09-10T08:42:29.366713+0000","last_unstale":"2024-09-10T08:42:30.925656+0000","last_undegraded":"2024-09-10T08:42:30.925656+0000","last_fullsized":"2024-09-10T08:42:30.925656+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:24.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925297+0000","last_change":"2024-09-10T08:42:29.366363+0000","last_active":"2024-09-10T08:42:30.925297+0000","last_peered":"2024-09-10T08:42:30.925297+0000","last_clean":"2024-09-10T08:42:30.925297+0000","last_became_active":"2024-09-10T08:42:29.366094+0000","last_became_peered":"2024-09-10T08:42:29.366094+0000","last_unstale":"2024-09-10T08:42:30.925297+0000","last_undegraded":"2024-09-10T08:42:30.925297+0000","last_fullsized":"2024-09-10T08:42:30.925297+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.672941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925663+0000","last_change":"2024-09-10T08:42:29.365511+0000","last_active":"2024-09-10T08:42:30.925663+0000","last_peered":"2024-09-10T08:42:30.925663+0000","last_clean":"2024-09-10T08:42:30.925663+0000","last_became_active":"2024-09-10T08:42:29.362055+0000","last_became_peered":"2024-09-10T08:42:29.362055+0000","last_unstale":"2024-09-10T08:42:30.925663+0000","last_undegraded":"2024-09-10T08:42:30.925663+0000","last_fullsized":"2024-09-10T08:42:30.925663+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:57.062613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371425+0000","last_change":"2024-09-10T08:42:29.362962+0000","last_active":"2024-09-10T08:42:30.371425+0000","last_peered":"2024-09-10T08:42:30.371425+0000","last_clean":"2024-09-10T08:42:30.371425+0000","last_became_active":"2024-09-10T08:42:29.362665+0000","last_became_peered":"2024-09-10T08:42:29.362665+0000","last_unstale":"2024-09-10T08:42:30.371425+0000","last_undegraded":"2024-09-10T08:42:30.371425+0000","last_fullsized":"2024-09-10T08:42:30.371425+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:16.482695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924950+0000","last_change":"2024-09-10T08:42:29.373037+0000","last_active":"2024-09-10T08:42:30.924950+0000","last_peered":"2024-09-10T08:42:30.924950+0000","last_clean":"2024-09-10T08:42:30.924950+0000","last_became_active":"2024-09-10T08:42:29.372745+0000","last_became_peered":"2024-09-10T08:42:29.372745+0000","last_unstale":"2024-09-10T08:42:30.924950+0000","last_undegraded":"2024-09-10T08:42:30.924950+0000","last_fullsized":"2024-09-10T08:42:30.924950+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:12.108699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924967+0000","last_change":"2024-09-10T08:42:29.375322+0000","last_active":"2024-09-10T08:42:30.924967+0000","last_peered":"2024-09-10T08:42:30.924967+0000","last_clean":"2024-09-10T08:42:30.924967+0000","last_became_active":"2024-09-10T08:42:29.375050+0000","last_became_peered":"2024-09-10T08:42:29.375050+0000","last_unstale":"2024-09-10T08:42:30.924967+0000","last_undegraded":"2024-09-10T08:42:30.924967+0000","last_fullsized":"2024-09-10T08:42:30.924967+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370612+0000","last_change":"2024-09-10T08:42:29.372907+0000","last_active":"2024-09-10T08:42:30.370612+0000","last_peered":"2024-09-10T08:42:30.370612+0000","last_clean":"2024-09-10T08:42:30.370612+0000","last_became_active":"2024-09-10T08:42:29.371130+0000","last_became_peered":"2024-09-10T08:42:29.371130+0000","last_unstale":"2024-09-10T08:42:30.370612+0000","last_undegraded":"2024-09-10T08:42:30.370612+0000","last_fullsized":"2024-09-10T08:42:30.370612+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:17.321799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925999+0000","last_change":"2024-09-10T08:42:29.366985+0000","last_active":"2024-09-10T08:42:30.925999+0000","last_peered":"2024-09-10T08:42:30.925999+0000","last_clean":"2024-09-10T08:42:30.925999+0000","last_became_active":"2024-09-10T08:42:29.366690+0000","last_became_peered":"2024-09-10T08:42:29.366690+0000","last_unstale":"2024-09-10T08:42:30.925999+0000","last_undegraded":"2024-09-10T08:42:30.925999+0000","last_fullsized":"2024-09-10T08:42:30.925999+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:00.315278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925706+0000","last_change":"2024-09-10T08:42:29.380452+0000","last_active":"2024-09-10T08:42:30.925706+0000","last_peered":"2024-09-10T08:42:30.925706+0000","last_clean":"2024-09-10T08:42:30.925706+0000","last_became_active":"2024-09-10T08:42:29.379753+0000","last_became_peered":"2024-09-10T08:42:29.379753+0000","last_unstale":"2024-09-10T08:42:30.925706+0000","last_undegraded":"2024-09-10T08:42:30.925706+0000","last_fullsized":"2024-09-10T08:42:30.925706+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:27.921576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925232+0000","last_change":"2024-09-10T08:42:29.377573+0000","last_active":"2024-09-10T08:42:30.925232+0000","last_peered":"2024-09-10T08:42:30.925232+0000","last_clean":"2024-09-10T08:42:30.925232+0000","last_became_active":"2024-09-10T08:42:29.377309+0000","last_became_peered":"2024-09-10T08:42:29.377309+0000","last_unstale":"2024-09-10T08:42:30.925232+0000","last_undegraded":"2024-09-10T08:42:30.925232+0000","last_fullsized":"2024-09-10T08:42:30.925232+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:40.856857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371811+0000","last_change":"2024-09-10T08:42:29.384443+0000","last_active":"2024-09-10T08:42:30.371811+0000","last_peered":"2024-09-10T08:42:30.371811+0000","last_clean":"2024-09-10T08:42:30.371811+0000","last_became_active":"2024-09-10T08:42:29.384157+0000","last_became_peered":"2024-09-10T08:42:29.384157+0000","last_unstale":"2024-09-10T08:42:30.371811+0000","last_undegraded":"2024-09-10T08:42:30.371811+0000","last_fullsized":"2024-09-10T08:42:30.371811+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:55.116750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925319+0000","last_change":"2024-09-10T08:42:29.368203+0000","last_active":"2024-09-10T08:42:30.925319+0000","last_peered":"2024-09-10T08:42:30.925319+0000","last_clean":"2024-09-10T08:42:30.925319+0000","last_became_active":"2024-09-10T08:42:29.367829+0000","last_became_peered":"2024-09-10T08:42:29.367829+0000","last_unstale":"2024-09-10T08:42:30.925319+0000","last_undegraded":"2024-09-10T08:42:30.925319+0000","last_fullsized":"2024-09-10T08:42:30.925319+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:46.907725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371249+0000","last_change":"2024-09-10T08:42:29.361268+0000","last_active":"2024-09-10T08:42:30.371249+0000","last_peered":"2024-09-10T08:42:30.371249+0000","last_clean":"2024-09-10T08:42:30.371249+0000","last_became_active":"2024-09-10T08:42:29.360989+0000","last_became_peered":"2024-09-10T08:42:29.360989+0000","last_unstale":"2024-09-10T08:42:30.371249+0000","last_undegraded":"2024-09-10T08:42:30.371249+0000","last_fullsized":"2024-09-10T08:42:30.371249+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:22:32.626269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371040+0000","last_change":"2024-09-10T08:42:29.365642+0000","last_active":"2024-09-10T08:42:30.371040+0000","last_peered":"2024-09-10T08:42:30.371040+0000","last_clean":"2024-09-10T08:42:30.371040+0000","last_became_active":"2024-09-10T08:42:29.358997+0000","last_became_peered":"2024-09-10T08:42:29.358997+0000","last_unstale":"2024-09-10T08:42:30.371040+0000","last_undegraded":"2024-09-10T08:42:30.371040+0000","last_fullsized":"2024-09-10T08:42:30.371040+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:36.119919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372568+0000","last_change":"2024-09-10T08:42:29.383360+0000","last_active":"2024-09-10T08:42:30.372568+0000","last_peered":"2024-09-10T08:42:30.372568+0000","last_clean":"2024-09-10T08:42:30.372568+0000","last_became_active":"2024-09-10T08:42:29.380706+0000","last_became_peered":"2024-09-10T08:42:29.380706+0000","last_unstale":"2024-09-10T08:42:30.372568+0000","last_undegraded":"2024-09-10T08:42:30.372568+0000","last_fullsized":"2024-09-10T08:42:30.372568+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:20:33.134952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925711+0000","last_change":"2024-09-10T08:42:29.382341+0000","last_active":"2024-09-10T08:42:30.925711+0000","last_peered":"2024-09-10T08:42:30.925711+0000","last_clean":"2024-09-10T08:42:30.925711+0000","last_became_active":"2024-09-10T08:42:29.382050+0000","last_became_peered":"2024-09-10T08:42:29.382050+0000","last_unstale":"2024-09-10T08:42:30.925711+0000","last_undegraded":"2024-09-10T08:42:30.925711+0000","last_fullsized":"2024-09-10T08:42:30.925711+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:57:37.294595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371716+0000","last_change":"2024-09-10T08:42:29.370587+0000","last_active":"2024-09-10T08:42:30.371716+0000","last_peered":"2024-09-10T08:42:30.371716+0000","last_clean":"2024-09-10T08:42:30.371716+0000","last_became_active":"2024-09-10T08:42:29.368564+0000","last_became_peered":"2024-09-10T08:42:29.368564+0000","last_unstale":"2024-09-10T08:42:30.371716+0000","last_undegraded":"2024-09-10T08:42:30.371716+0000","last_fullsized":"2024-09-10T08:42:30.371716+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:16.026077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925659+0000","last_change":"2024-09-10T08:42:29.373681+0000","last_active":"2024-09-10T08:42:30.925659+0000","last_peered":"2024-09-10T08:42:30.925659+0000","last_clean":"2024-09-10T08:42:30.925659+0000","last_became_active":"2024-09-10T08:42:29.372401+0000","last_became_peered":"2024-09-10T08:42:29.372401+0000","last_unstale":"2024-09-10T08:42:30.925659+0000","last_undegraded":"2024-09-10T08:42:30.925659+0000","last_fullsized":"2024-09-10T08:42:30.925659+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:40.047090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925281+0000","last_change":"2024-09-10T08:42:29.387508+0000","last_active":"2024-09-10T08:42:30.925281+0000","last_peered":"2024-09-10T08:42:30.925281+0000","last_clean":"2024-09-10T08:42:30.925281+0000","last_became_active":"2024-09-10T08:42:29.387103+0000","last_became_peered":"2024-09-10T08:42:29.387103+0000","last_unstale":"2024-09-10T08:42:30.925281+0000","last_undegraded":"2024-09-10T08:42:30.925281+0000","last_fullsized":"2024-09-10T08:42:30.925281+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:47.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371545+0000","last_change":"2024-09-10T08:42:29.388085+0000","last_active":"2024-09-10T08:42:30.371545+0000","last_peered":"2024-09-10T08:42:30.371545+0000","last_clean":"2024-09-10T08:42:30.371545+0000","last_became_active":"2024-09-10T08:42:29.387481+0000","last_became_peered":"2024-09-10T08:42:29.387481+0000","last_unstale":"2024-09-10T08:42:30.371545+0000","last_undegraded":"2024-09-10T08:42:30.371545+0000","last_fullsized":"2024-09-10T08:42:30.371545+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:23:21.156661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372340+0000","last_change":"2024-09-10T08:42:29.386980+0000","last_active":"2024-09-10T08:42:30.372340+0000","last_peered":"2024-09-10T08:42:30.372340+0000","last_clean":"2024-09-10T08:42:30.372340+0000","last_became_active":"2024-09-10T08:42:29.386230+0000","last_became_peered":"2024-09-10T08:42:29.386230+0000","last_unstale":"2024-09-10T08:42:30.372340+0000","last_undegraded":"2024-09-10T08:42:30.372340+0000","last_fullsized":"2024-09-10T08:42:30.372340+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:56:44.270365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924437+0000","last_change":"2024-09-10T08:42:29.365247+0000","last_active":"2024-09-10T08:42:30.924437+0000","last_peered":"2024-09-10T08:42:30.924437+0000","last_clean":"2024-09-10T08:42:30.924437+0000","last_became_active":"2024-09-10T08:42:29.365006+0000","last_became_peered":"2024-09-10T08:42:29.365006+0000","last_unstale":"2024-09-10T08:42:30.924437+0000","last_undegraded":"2024-09-10T08:42:30.924437+0000","last_fullsized":"2024-09-10T08:42:30.924437+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:01.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925557+0000","last_change":"2024-09-10T08:42:29.380286+0000","last_active":"2024-09-10T08:42:30.925557+0000","last_peered":"2024-09-10T08:42:30.925557+0000","last_clean":"2024-09-10T08:42:30.925557+0000","last_became_active":"2024-09-10T08:42:29.379995+0000","last_became_peered":"2024-09-10T08:42:29.379995+0000","last_unstale":"2024-09-10T08:42:30.925557+0000","last_undegraded":"2024-09-10T08:42:30.925557+0000","last_fullsized":"2024-09-10T08:42:30.925557+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:28.595578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371574+0000","last_change":"2024-09-10T08:42:29.375078+0000","last_active":"2024-09-10T08:42:30.371574+0000","last_peered":"2024-09-10T08:42:30.371574+0000","last_clean":"2024-09-10T08:42:30.371574+0000","last_became_active":"2024-09-10T08:42:29.373435+0000","last_became_peered":"2024-09-10T08:42:29.373435+0000","last_unstale":"2024-09-10T08:42:30.371574+0000","last_undegraded":"2024-09-10T08:42:30.371574+0000","last_fullsized":"2024-09-10T08:42:30.371574+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:44.864079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925752+0000","last_change":"2024-09-10T08:42:29.380722+0000","last_active":"2024-09-10T08:42:30.925752+0000","last_peered":"2024-09-10T08:42:30.925752+0000","last_clean":"2024-09-10T08:42:30.925752+0000","last_became_active":"2024-09-10T08:42:29.380128+0000","last_became_peered":"2024-09-10T08:42:29.380128+0000","last_unstale":"2024-09-10T08:42:30.925752+0000","last_undegraded":"2024-09-10T08:42:30.925752+0000","last_fullsized":"2024-09-10T08:42:30.925752+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:31.592102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924837+0000","last_change":"2024-09-10T08:42:29.372114+0000","last_active":"2024-09-10T08:42:30.924837+0000","last_peered":"2024-09-10T08:42:30.924837+0000","last_clean":"2024-09-10T08:42:30.924837+0000","last_became_active":"2024-09-10T08:42:29.371781+0000","last_became_peered":"2024-09-10T08:42:29.371781+0000","last_unstale":"2024-09-10T08:42:30.924837+0000","last_undegraded":"2024-09-10T08:42:30.924837+0000","last_fullsized":"2024-09-10T08:42:30.924837+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371490+0000","last_change":"2024-09-10T08:42:29.375856+0000","last_active":"2024-09-10T08:42:30.371490+0000","last_peered":"2024-09-10T08:42:30.371490+0000","last_clean":"2024-09-10T08:42:30.371490+0000","last_became_active":"2024-09-10T08:42:29.375593+0000","last_became_peered":"2024-09-10T08:42:29.375593+0000","last_unstale":"2024-09-10T08:42:30.371490+0000","last_undegraded":"2024-09-10T08:42:30.371490+0000","last_fullsized":"2024-09-10T08:42:30.371490+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:24.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924777+0000","last_change":"2024-09-10T08:42:29.388359+0000","last_active":"2024-09-10T08:42:30.924777+0000","last_peered":"2024-09-10T08:42:30.924777+0000","last_clean":"2024-09-10T08:42:30.924777+0000","last_became_active":"2024-09-10T08:42:29.388047+0000","last_became_peered":"2024-09-10T08:42:29.388047+0000","last_unstale":"2024-09-10T08:42:30.924777+0000","last_undegraded":"2024-09-10T08:42:30.924777+0000","last_fullsized":"2024-09-10T08:42:30.924777+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:41.672941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925116+0000","last_change":"2024-09-10T08:42:29.360652+0000","last_active":"2024-09-10T08:42:30.925116+0000","last_peered":"2024-09-10T08:42:30.925116+0000","last_clean":"2024-09-10T08:42:30.925116+0000","last_became_active":"2024-09-10T08:42:29.360348+0000","last_became_peered":"2024-09-10T08:42:29.360348+0000","last_unstale":"2024-09-10T08:42:30.925116+0000","last_undegraded":"2024-09-10T08:42:30.925116+0000","last_fullsized":"2024-09-10T08:42:30.925116+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:17:41.393368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924802+0000","last_change":"2024-09-10T08:42:29.382521+0000","last_active":"2024-09-10T08:42:30.924802+0000","last_peered":"2024-09-10T08:42:30.924802+0000","last_clean":"2024-09-10T08:42:30.924802+0000","last_became_active":"2024-09-10T08:42:29.382070+0000","last_became_peered":"2024-09-10T08:42:29.382070+0000","last_unstale":"2024-09-10T08:42:30.924802+0000","last_undegraded":"2024-09-10T08:42:30.924802+0000","last_fullsized":"2024-09-10T08:42:30.924802+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925546+0000","last_change":"2024-09-10T08:42:29.388579+0000","last_active":"2024-09-10T08:42:30.925546+0000","last_peered":"2024-09-10T08:42:30.925546+0000","last_clean":"2024-09-10T08:42:30.925546+0000","last_became_active":"2024-09-10T08:42:29.387955+0000","last_became_peered":"2024-09-10T08:42:29.387955+0000","last_unstale":"2024-09-10T08:42:30.925546+0000","last_undegraded":"2024-09-10T08:42:30.925546+0000","last_fullsized":"2024-09-10T08:42:30.925546+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:51:36.119919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"194'4","reported_seq":18,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371939+0000","last_change":"2024-09-10T08:42:28.372955+0000","last_active":"2024-09-10T08:42:30.371939+0000","last_peered":"2024-09-10T08:42:30.371939+0000","last_clean":"2024-09-10T08:42:30.371939+0000","last_became_active":"2024-09-10T08:42:28.372574+0000","last_became_peered":"2024-09-10T08:42:28.372574+0000","last_unstale":"2024-09-10T08:42:30.371939+0000","last_undegraded":"2024-09-10T08:42:30.371939+0000","last_fullsized":"2024-09-10T08:42:30.371939+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:26.918397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371970+0000","last_change":"2024-09-10T08:42:29.383975+0000","last_active":"2024-09-10T08:42:30.371970+0000","last_peered":"2024-09-10T08:42:30.371970+0000","last_clean":"2024-09-10T08:42:30.371970+0000","last_became_active":"2024-09-10T08:42:29.383653+0000","last_became_peered":"2024-09-10T08:42:29.383653+0000","last_unstale":"2024-09-10T08:42:30.371970+0000","last_undegraded":"2024-09-10T08:42:30.371970+0000","last_fullsized":"2024-09-10T08:42:30.371970+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:43:20.821611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"194'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371894+0000","last_change":"2024-09-10T08:42:28.369545+0000","last_active":"2024-09-10T08:42:30.371894+0000","last_peered":"2024-09-10T08:42:30.371894+0000","last_clean":"2024-09-10T08:42:30.371894+0000","last_became_active":"2024-09-10T08:42:28.369294+0000","last_became_peered":"2024-09-10T08:42:28.369294+0000","last_unstale":"2024-09-10T08:42:30.371894+0000","last_undegraded":"2024-09-10T08:42:30.371894+0000","last_fullsized":"2024-09-10T08:42:30.371894+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370791+0000","last_change":"2024-09-10T08:42:29.388371+0000","last_active":"2024-09-10T08:42:30.370791+0000","last_peered":"2024-09-10T08:42:30.370791+0000","last_clean":"2024-09-10T08:42:30.370791+0000","last_became_active":"2024-09-10T08:42:29.387376+0000","last_became_peered":"2024-09-10T08:42:29.387376+0000","last_unstale":"2024-09-10T08:42:30.370791+0000","last_undegraded":"2024-09-10T08:42:30.370791+0000","last_fullsized":"2024-09-10T08:42:30.370791+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:11.276716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925334+0000","last_change":"2024-09-10T08:42:28.360994+0000","last_active":"2024-09-10T08:42:30.925334+0000","last_peered":"2024-09-10T08:42:30.925334+0000","last_clean":"2024-09-10T08:42:30.925334+0000","last_became_active":"2024-09-10T08:42:28.360662+0000","last_became_peered":"2024-09-10T08:42:28.360662+0000","last_unstale":"2024-09-10T08:42:30.925334+0000","last_undegraded":"2024-09-10T08:42:30.925334+0000","last_fullsized":"2024-09-10T08:42:30.925334+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:03.922764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925376+0000","last_change":"2024-09-10T08:42:29.388335+0000","last_active":"2024-09-10T08:42:30.925376+0000","last_peered":"2024-09-10T08:42:30.925376+0000","last_clean":"2024-09-10T08:42:30.925376+0000","last_became_active":"2024-09-10T08:42:29.387186+0000","last_became_peered":"2024-09-10T08:42:29.387186+0000","last_unstale":"2024-09-10T08:42:30.925376+0000","last_undegraded":"2024-09-10T08:42:30.925376+0000","last_fullsized":"2024-09-10T08:42:30.925376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:10.222056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"194'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925719+0000","last_change":"2024-09-10T08:42:28.358867+0000","last_active":"2024-09-10T08:42:30.925719+0000","last_peered":"2024-09-10T08:42:30.925719+0000","last_clean":"2024-09-10T08:42:30.925719+0000","last_became_active":"2024-09-10T08:42:28.358299+0000","last_became_peered":"2024-09-10T08:42:28.358299+0000","last_unstale":"2024-09-10T08:42:30.925719+0000","last_undegraded":"2024-09-10T08:42:30.925719+0000","last_fullsized":"2024-09-10T08:42:30.925719+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:04.222556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371672+0000","last_change":"2024-09-10T08:42:29.387982+0000","last_active":"2024-09-10T08:42:30.371672+0000","last_peered":"2024-09-10T08:42:30.371672+0000","last_clean":"2024-09-10T08:42:30.371672+0000","last_became_active":"2024-09-10T08:42:29.387636+0000","last_became_peered":"2024-09-10T08:42:29.387636+0000","last_unstale":"2024-09-10T08:42:30.371672+0000","last_undegraded":"2024-09-10T08:42:30.371672+0000","last_fullsized":"2024-09-10T08:42:30.371672+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:05.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"194'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370880+0000","last_change":"2024-09-10T08:42:28.374924+0000","last_active":"2024-09-10T08:42:30.370880+0000","last_peered":"2024-09-10T08:42:30.370880+0000","last_clean":"2024-09-10T08:42:30.370880+0000","last_became_active":"2024-09-10T08:42:28.374637+0000","last_became_peered":"2024-09-10T08:42:28.374637+0000","last_unstale":"2024-09-10T08:42:30.370880+0000","last_undegraded":"2024-09-10T08:42:30.370880+0000","last_fullsized":"2024-09-10T08:42:30.370880+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371374+0000","last_change":"2024-09-10T08:42:29.379574+0000","last_active":"2024-09-10T08:42:30.371374+0000","last_peered":"2024-09-10T08:42:30.371374+0000","last_clean":"2024-09-10T08:42:30.371374+0000","last_became_active":"2024-09-10T08:42:29.379202+0000","last_became_peered":"2024-09-10T08:42:29.379202+0000","last_unstale":"2024-09-10T08:42:30.371374+0000","last_undegraded":"2024-09-10T08:42:30.371374+0000","last_fullsized":"2024-09-10T08:42:30.371374+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:41:56.411114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370504+0000","last_change":"2024-09-10T08:42:28.356438+0000","last_active":"2024-09-10T08:42:30.370504+0000","last_peered":"2024-09-10T08:42:30.370504+0000","last_clean":"2024-09-10T08:42:30.370504+0000","last_became_active":"2024-09-10T08:42:28.356140+0000","last_became_peered":"2024-09-10T08:42:28.356140+0000","last_unstale":"2024-09-10T08:42:30.370504+0000","last_undegraded":"2024-09-10T08:42:30.370504+0000","last_fullsized":"2024-09-10T08:42:30.370504+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372288+0000","last_change":"2024-09-10T08:42:29.386977+0000","last_active":"2024-09-10T08:42:30.372288+0000","last_peered":"2024-09-10T08:42:30.372288+0000","last_clean":"2024-09-10T08:42:30.372288+0000","last_became_active":"2024-09-10T08:42:29.385141+0000","last_became_peered":"2024-09-10T08:42:29.385141+0000","last_unstale":"2024-09-10T08:42:30.372288+0000","last_undegraded":"2024-09-10T08:42:30.372288+0000","last_fullsized":"2024-09-10T08:42:30.372288+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:08.969709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924331+0000","last_change":"2024-09-10T08:42:28.365813+0000","last_active":"2024-09-10T08:42:30.924331+0000","last_peered":"2024-09-10T08:42:30.924331+0000","last_clean":"2024-09-10T08:42:30.924331+0000","last_became_active":"2024-09-10T08:42:28.365458+0000","last_became_peered":"2024-09-10T08:42:28.365458+0000","last_unstale":"2024-09-10T08:42:30.924331+0000","last_undegraded":"2024-09-10T08:42:30.924331+0000","last_fullsized":"2024-09-10T08:42:30.924331+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:21:01.544482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925056+0000","last_change":"2024-09-10T08:42:29.389734+0000","last_active":"2024-09-10T08:42:30.925056+0000","last_peered":"2024-09-10T08:42:30.925056+0000","last_clean":"2024-09-10T08:42:30.925056+0000","last_became_active":"2024-09-10T08:42:29.389260+0000","last_became_peered":"2024-09-10T08:42:29.389260+0000","last_unstale":"2024-09-10T08:42:30.925056+0000","last_undegraded":"2024-09-10T08:42:30.925056+0000","last_fullsized":"2024-09-10T08:42:30.925056+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:41.255079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372607+0000","last_change":"2024-09-10T08:42:28.372691+0000","last_active":"2024-09-10T08:42:30.372607+0000","last_peered":"2024-09-10T08:42:30.372607+0000","last_clean":"2024-09-10T08:42:30.372607+0000","last_became_active":"2024-09-10T08:42:28.372367+0000","last_became_peered":"2024-09-10T08:42:28.372367+0000","last_unstale":"2024-09-10T08:42:30.372607+0000","last_undegraded":"2024-09-10T08:42:30.372607+0000","last_fullsized":"2024-09-10T08:42:30.372607+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925666+0000","last_change":"2024-09-10T08:42:29.380637+0000","last_active":"2024-09-10T08:42:30.925666+0000","last_peered":"2024-09-10T08:42:30.925666+0000","last_clean":"2024-09-10T08:42:30.925666+0000","last_became_active":"2024-09-10T08:42:29.380035+0000","last_became_peered":"2024-09-10T08:42:29.380035+0000","last_unstale":"2024-09-10T08:42:30.925666+0000","last_undegraded":"2024-09-10T08:42:30.925666+0000","last_fullsized":"2024-09-10T08:42:30.925666+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:48.126601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.926090+0000","last_change":"2024-09-10T08:42:28.361429+0000","last_active":"2024-09-10T08:42:30.926090+0000","last_peered":"2024-09-10T08:42:30.926090+0000","last_clean":"2024-09-10T08:42:30.926090+0000","last_became_active":"2024-09-10T08:42:28.361128+0000","last_became_peered":"2024-09-10T08:42:28.361128+0000","last_unstale":"2024-09-10T08:42:30.926090+0000","last_undegraded":"2024-09-10T08:42:30.926090+0000","last_fullsized":"2024-09-10T08:42:30.926090+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:56.109808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925232+0000","last_change":"2024-09-10T08:42:29.377162+0000","last_active":"2024-09-10T08:42:30.925232+0000","last_peered":"2024-09-10T08:42:30.925232+0000","last_clean":"2024-09-10T08:42:30.925232+0000","last_became_active":"2024-09-10T08:42:29.376654+0000","last_became_peered":"2024-09-10T08:42:29.376654+0000","last_unstale":"2024-09-10T08:42:30.925232+0000","last_undegraded":"2024-09-10T08:42:30.925232+0000","last_fullsized":"2024-09-10T08:42:30.925232+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:00.315278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"194'3","reported_seq":17,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925266+0000","last_change":"2024-09-10T08:42:28.361008+0000","last_active":"2024-09-10T08:42:30.925266+0000","last_peered":"2024-09-10T08:42:30.925266+0000","last_clean":"2024-09-10T08:42:30.925266+0000","last_became_active":"2024-09-10T08:42:28.360416+0000","last_became_peered":"2024-09-10T08:42:28.360416+0000","last_unstale":"2024-09-10T08:42:30.925266+0000","last_undegraded":"2024-09-10T08:42:30.925266+0000","last_fullsized":"2024-09-10T08:42:30.925266+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924955+0000","last_change":"2024-09-10T08:42:29.388994+0000","last_active":"2024-09-10T08:42:30.924955+0000","last_peered":"2024-09-10T08:42:30.924955+0000","last_clean":"2024-09-10T08:42:30.924955+0000","last_became_active":"2024-09-10T08:42:29.388728+0000","last_became_peered":"2024-09-10T08:42:29.388728+0000","last_unstale":"2024-09-10T08:42:30.924955+0000","last_undegraded":"2024-09-10T08:42:30.924955+0000","last_fullsized":"2024-09-10T08:42:30.924955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:14.376246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"194'6","reported_seq":20,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925646+0000","last_change":"2024-09-10T08:42:28.368808+0000","last_active":"2024-09-10T08:42:30.925646+0000","last_peered":"2024-09-10T08:42:30.925646+0000","last_clean":"2024-09-10T08:42:30.925646+0000","last_became_active":"2024-09-10T08:42:28.368332+0000","last_became_peered":"2024-09-10T08:42:28.368332+0000","last_unstale":"2024-09-10T08:42:30.925646+0000","last_undegraded":"2024-09-10T08:42:30.925646+0000","last_fullsized":"2024-09-10T08:42:30.925646+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:43.130183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371781+0000","last_change":"2024-09-10T08:42:29.365138+0000","last_active":"2024-09-10T08:42:30.371781+0000","last_peered":"2024-09-10T08:42:30.371781+0000","last_clean":"2024-09-10T08:42:30.371781+0000","last_became_active":"2024-09-10T08:42:29.364846+0000","last_became_peered":"2024-09-10T08:42:29.364846+0000","last_unstale":"2024-09-10T08:42:30.371781+0000","last_undegraded":"2024-09-10T08:42:30.371781+0000","last_fullsized":"2024-09-10T08:42:30.371781+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:57.112986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925034+0000","last_change":"2024-09-10T08:42:28.367429+0000","last_active":"2024-09-10T08:42:30.925034+0000","last_peered":"2024-09-10T08:42:30.925034+0000","last_clean":"2024-09-10T08:42:30.925034+0000","last_became_active":"2024-09-10T08:42:28.367107+0000","last_became_peered":"2024-09-10T08:42:28.367107+0000","last_unstale":"2024-09-10T08:42:30.925034+0000","last_undegraded":"2024-09-10T08:42:30.925034+0000","last_fullsized":"2024-09-10T08:42:30.925034+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:37.286201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924798+0000","last_change":"2024-09-10T08:42:29.367545+0000","last_active":"2024-09-10T08:42:30.924798+0000","last_peered":"2024-09-10T08:42:30.924798+0000","last_clean":"2024-09-10T08:42:30.924798+0000","last_became_active":"2024-09-10T08:42:29.367259+0000","last_became_peered":"2024-09-10T08:42:29.367259+0000","last_unstale":"2024-09-10T08:42:30.924798+0000","last_undegraded":"2024-09-10T08:42:30.924798+0000","last_fullsized":"2024-09-10T08:42:30.924798+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:53:57.062613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371908+0000","last_change":"2024-09-10T08:42:28.371165+0000","last_active":"2024-09-10T08:42:30.371908+0000","last_peered":"2024-09-10T08:42:30.371908+0000","last_clean":"2024-09-10T08:42:30.371908+0000","last_became_active":"2024-09-10T08:42:28.370828+0000","last_became_peered":"2024-09-10T08:42:28.370828+0000","last_unstale":"2024-09-10T08:42:30.371908+0000","last_undegraded":"2024-09-10T08:42:30.371908+0000","last_fullsized":"2024-09-10T08:42:30.371908+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:29:47.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370404+0000","last_change":"2024-09-10T08:42:29.375188+0000","last_active":"2024-09-10T08:42:30.370404+0000","last_peered":"2024-09-10T08:42:30.370404+0000","last_clean":"2024-09-10T08:42:30.370404+0000","last_became_active":"2024-09-10T08:42:29.374605+0000","last_became_peered":"2024-09-10T08:42:29.374605+0000","last_unstale":"2024-09-10T08:42:30.370404+0000","last_undegraded":"2024-09-10T08:42:30.370404+0000","last_fullsized":"2024-09-10T08:42:30.370404+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:25:46.907725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371393+0000","last_change":"2024-09-10T08:42:28.367589+0000","last_active":"2024-09-10T08:42:30.371393+0000","last_peered":"2024-09-10T08:42:30.371393+0000","last_clean":"2024-09-10T08:42:30.371393+0000","last_became_active":"2024-09-10T08:42:28.367298+0000","last_became_peered":"2024-09-10T08:42:28.367298+0000","last_unstale":"2024-09-10T08:42:30.371393+0000","last_undegraded":"2024-09-10T08:42:30.371393+0000","last_fullsized":"2024-09-10T08:42:30.371393+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:23.134397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924968+0000","last_change":"2024-09-10T08:42:29.368320+0000","last_active":"2024-09-10T08:42:30.924968+0000","last_peered":"2024-09-10T08:42:30.924968+0000","last_clean":"2024-09-10T08:42:30.924968+0000","last_became_active":"2024-09-10T08:42:29.367925+0000","last_became_peered":"2024-09-10T08:42:29.367925+0000","last_unstale":"2024-09-10T08:42:30.924968+0000","last_undegraded":"2024-09-10T08:42:30.924968+0000","last_fullsized":"2024-09-10T08:42:30.924968+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:59.952205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"194'8","reported_seq":22,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924999+0000","last_change":"2024-09-10T08:42:28.370026+0000","last_active":"2024-09-10T08:42:30.924999+0000","last_peered":"2024-09-10T08:42:30.924999+0000","last_clean":"2024-09-10T08:42:30.924999+0000","last_became_active":"2024-09-10T08:42:28.369757+0000","last_became_peered":"2024-09-10T08:42:28.369757+0000","last_unstale":"2024-09-10T08:42:30.924999+0000","last_undegraded":"2024-09-10T08:42:30.924999+0000","last_fullsized":"2024-09-10T08:42:30.924999+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:34.029707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.926014+0000","last_change":"2024-09-10T08:42:29.365719+0000","last_active":"2024-09-10T08:42:30.926014+0000","last_peered":"2024-09-10T08:42:30.926014+0000","last_clean":"2024-09-10T08:42:30.926014+0000","last_became_active":"2024-09-10T08:42:29.365419+0000","last_became_peered":"2024-09-10T08:42:29.365419+0000","last_unstale":"2024-09-10T08:42:30.926014+0000","last_undegraded":"2024-09-10T08:42:30.926014+0000","last_fullsized":"2024-09-10T08:42:30.926014+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:06:41.255079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"194'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372657+0000","last_change":"2024-09-10T08:42:28.371311+0000","last_active":"2024-09-10T08:42:30.372657+0000","last_peered":"2024-09-10T08:42:30.372657+0000","last_clean":"2024-09-10T08:42:30.372657+0000","last_became_active":"2024-09-10T08:42:28.371021+0000","last_became_peered":"2024-09-10T08:42:28.371021+0000","last_unstale":"2024-09-10T08:42:30.372657+0000","last_undegraded":"2024-09-10T08:42:30.372657+0000","last_fullsized":"2024-09-10T08:42:30.372657+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:05:47.699312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925408+0000","last_change":"2024-09-10T08:42:29.371719+0000","last_active":"2024-09-10T08:42:30.925408+0000","last_peered":"2024-09-10T08:42:30.925408+0000","last_clean":"2024-09-10T08:42:30.925408+0000","last_became_active":"2024-09-10T08:42:29.371421+0000","last_became_peered":"2024-09-10T08:42:29.371421+0000","last_unstale":"2024-09-10T08:42:30.925408+0000","last_undegraded":"2024-09-10T08:42:30.925408+0000","last_fullsized":"2024-09-10T08:42:30.925408+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:44.577637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925811+0000","last_change":"2024-09-10T08:42:28.369134+0000","last_active":"2024-09-10T08:42:30.925811+0000","last_peered":"2024-09-10T08:42:30.925811+0000","last_clean":"2024-09-10T08:42:30.925811+0000","last_became_active":"2024-09-10T08:42:28.368736+0000","last_became_peered":"2024-09-10T08:42:28.368736+0000","last_unstale":"2024-09-10T08:42:30.925811+0000","last_undegraded":"2024-09-10T08:42:30.925811+0000","last_fullsized":"2024-09-10T08:42:30.925811+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:22.080850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925538+0000","last_change":"2024-09-10T08:42:29.376134+0000","last_active":"2024-09-10T08:42:30.925538+0000","last_peered":"2024-09-10T08:42:30.925538+0000","last_clean":"2024-09-10T08:42:30.925538+0000","last_became_active":"2024-09-10T08:42:29.374622+0000","last_became_peered":"2024-09-10T08:42:29.374622+0000","last_unstale":"2024-09-10T08:42:30.925538+0000","last_undegraded":"2024-09-10T08:42:30.925538+0000","last_fullsized":"2024-09-10T08:42:30.925538+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:11.276716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"194'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371037+0000","last_change":"2024-09-10T08:42:28.371235+0000","last_active":"2024-09-10T08:42:30.371037+0000","last_peered":"2024-09-10T08:42:30.371037+0000","last_clean":"2024-09-10T08:42:30.371037+0000","last_became_active":"2024-09-10T08:42:28.370717+0000","last_became_peered":"2024-09-10T08:42:28.370717+0000","last_unstale":"2024-09-10T08:42:30.371037+0000","last_undegraded":"2024-09-10T08:42:30.371037+0000","last_fullsized":"2024-09-10T08:42:30.371037+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370416+0000","last_change":"2024-09-10T08:42:29.388578+0000","last_active":"2024-09-10T08:42:30.370416+0000","last_peered":"2024-09-10T08:42:30.370416+0000","last_clean":"2024-09-10T08:42:30.370416+0000","last_became_active":"2024-09-10T08:42:29.387485+0000","last_became_peered":"2024-09-10T08:42:29.387485+0000","last_unstale":"2024-09-10T08:42:30.370416+0000","last_undegraded":"2024-09-10T08:42:30.370416+0000","last_fullsized":"2024-09-10T08:42:30.370416+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:41:10.222056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925396+0000","last_change":"2024-09-10T08:42:28.366118+0000","last_active":"2024-09-10T08:42:30.925396+0000","last_peered":"2024-09-10T08:42:30.925396+0000","last_clean":"2024-09-10T08:42:30.925396+0000","last_became_active":"2024-09-10T08:42:28.365820+0000","last_became_peered":"2024-09-10T08:42:28.365820+0000","last_unstale":"2024-09-10T08:42:30.925396+0000","last_undegraded":"2024-09-10T08:42:30.925396+0000","last_fullsized":"2024-09-10T08:42:30.925396+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:05:15.022898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925444+0000","last_change":"2024-09-10T08:42:29.375520+0000","last_active":"2024-09-10T08:42:30.925444+0000","last_peered":"2024-09-10T08:42:30.925444+0000","last_clean":"2024-09-10T08:42:30.925444+0000","last_became_active":"2024-09-10T08:42:29.371136+0000","last_became_peered":"2024-09-10T08:42:29.371136+0000","last_unstale":"2024-09-10T08:42:30.925444+0000","last_undegraded":"2024-09-10T08:42:30.925444+0000","last_fullsized":"2024-09-10T08:42:30.925444+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:30.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372086+0000","last_change":"2024-09-10T08:42:28.369096+0000","last_active":"2024-09-10T08:42:30.372086+0000","last_peered":"2024-09-10T08:42:30.372086+0000","last_clean":"2024-09-10T08:42:30.372086+0000","last_became_active":"2024-09-10T08:42:28.367579+0000","last_became_peered":"2024-09-10T08:42:28.367579+0000","last_unstale":"2024-09-10T08:42:30.372086+0000","last_undegraded":"2024-09-10T08:42:30.372086+0000","last_fullsized":"2024-09-10T08:42:30.372086+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:34.790766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371481+0000","last_change":"2024-09-10T08:42:29.376975+0000","last_active":"2024-09-10T08:42:30.371481+0000","last_peered":"2024-09-10T08:42:30.371481+0000","last_clean":"2024-09-10T08:42:30.371481+0000","last_became_active":"2024-09-10T08:42:29.375816+0000","last_became_peered":"2024-09-10T08:42:29.375816+0000","last_unstale":"2024-09-10T08:42:30.371481+0000","last_undegraded":"2024-09-10T08:42:30.371481+0000","last_fullsized":"2024-09-10T08:42:30.371481+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:28.595578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924836+0000","last_change":"2024-09-10T08:42:28.365210+0000","last_active":"2024-09-10T08:42:30.924836+0000","last_peered":"2024-09-10T08:42:30.924836+0000","last_clean":"2024-09-10T08:42:30.924836+0000","last_became_active":"2024-09-10T08:42:28.364926+0000","last_became_peered":"2024-09-10T08:42:28.364926+0000","last_unstale":"2024-09-10T08:42:30.924836+0000","last_undegraded":"2024-09-10T08:42:30.924836+0000","last_fullsized":"2024-09-10T08:42:30.924836+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:58.755691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924614+0000","last_change":"2024-09-10T08:42:29.375211+0000","last_active":"2024-09-10T08:42:30.924614+0000","last_peered":"2024-09-10T08:42:30.924614+0000","last_clean":"2024-09-10T08:42:30.924614+0000","last_became_active":"2024-09-10T08:42:29.374945+0000","last_became_peered":"2024-09-10T08:42:29.374945+0000","last_unstale":"2024-09-10T08:42:30.924614+0000","last_undegraded":"2024-09-10T08:42:30.924614+0000","last_fullsized":"2024-09-10T08:42:30.924614+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:54:54.589063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925143+0000","last_change":"2024-09-10T08:42:28.368260+0000","last_active":"2024-09-10T08:42:30.925143+0000","last_peered":"2024-09-10T08:42:30.925143+0000","last_clean":"2024-09-10T08:42:30.925143+0000","last_became_active":"2024-09-10T08:42:28.366958+0000","last_became_peered":"2024-09-10T08:42:28.366958+0000","last_unstale":"2024-09-10T08:42:30.925143+0000","last_undegraded":"2024-09-10T08:42:30.925143+0000","last_fullsized":"2024-09-10T08:42:30.925143+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924730+0000","last_change":"2024-09-10T08:42:29.387997+0000","last_active":"2024-09-10T08:42:30.924730+0000","last_peered":"2024-09-10T08:42:30.924730+0000","last_clean":"2024-09-10T08:42:30.924730+0000","last_became_active":"2024-09-10T08:42:29.387143+0000","last_became_peered":"2024-09-10T08:42:29.387143+0000","last_unstale":"2024-09-10T08:42:30.924730+0000","last_undegraded":"2024-09-10T08:42:30.924730+0000","last_fullsized":"2024-09-10T08:42:30.924730+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:09:37.154018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925082+0000","last_change":"2024-09-10T08:42:28.373429+0000","last_active":"2024-09-10T08:42:30.925082+0000","last_peered":"2024-09-10T08:42:30.925082+0000","last_clean":"2024-09-10T08:42:30.925082+0000","last_became_active":"2024-09-10T08:42:28.373018+0000","last_became_peered":"2024-09-10T08:42:28.373018+0000","last_unstale":"2024-09-10T08:42:30.925082+0000","last_undegraded":"2024-09-10T08:42:30.925082+0000","last_fullsized":"2024-09-10T08:42:30.925082+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:47:55.127506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925705+0000","last_change":"2024-09-10T08:42:29.371819+0000","last_active":"2024-09-10T08:42:30.925705+0000","last_peered":"2024-09-10T08:42:30.925705+0000","last_clean":"2024-09-10T08:42:30.925705+0000","last_became_active":"2024-09-10T08:42:29.371508+0000","last_became_peered":"2024-09-10T08:42:29.371508+0000","last_unstale":"2024-09-10T08:42:30.925705+0000","last_undegraded":"2024-09-10T08:42:30.925705+0000","last_fullsized":"2024-09-10T08:42:30.925705+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:31.332319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925515+0000","last_change":"2024-09-10T08:42:28.369947+0000","last_active":"2024-09-10T08:42:30.925515+0000","last_peered":"2024-09-10T08:42:30.925515+0000","last_clean":"2024-09-10T08:42:30.925515+0000","last_became_active":"2024-09-10T08:42:28.368829+0000","last_became_peered":"2024-09-10T08:42:28.368829+0000","last_unstale":"2024-09-10T08:42:30.925515+0000","last_undegraded":"2024-09-10T08:42:30.925515+0000","last_fullsized":"2024-09-10T08:42:30.925515+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:23:02.229625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372216+0000","last_change":"2024-09-10T08:42:29.383681+0000","last_active":"2024-09-10T08:42:30.372216+0000","last_peered":"2024-09-10T08:42:30.372216+0000","last_clean":"2024-09-10T08:42:30.372216+0000","last_became_active":"2024-09-10T08:42:29.383061+0000","last_became_peered":"2024-09-10T08:42:29.383061+0000","last_unstale":"2024-09-10T08:42:30.372216+0000","last_undegraded":"2024-09-10T08:42:30.372216+0000","last_fullsized":"2024-09-10T08:42:30.372216+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:59.501415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"195'1","reported_seq":15,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371963+0000","last_change":"2024-09-10T08:42:28.372012+0000","last_active":"2024-09-10T08:42:30.371963+0000","last_peered":"2024-09-10T08:42:30.371963+0000","last_clean":"2024-09-10T08:42:30.371963+0000","last_became_active":"2024-09-10T08:42:28.371754+0000","last_became_peered":"2024-09-10T08:42:28.371754+0000","last_unstale":"2024-09-10T08:42:30.371963+0000","last_undegraded":"2024-09-10T08:42:30.371963+0000","last_fullsized":"2024-09-10T08:42:30.371963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:23.490657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370846+0000","last_change":"2024-09-10T08:42:29.378781+0000","last_active":"2024-09-10T08:42:30.370846+0000","last_peered":"2024-09-10T08:42:30.370846+0000","last_clean":"2024-09-10T08:42:30.370846+0000","last_became_active":"2024-09-10T08:42:29.378509+0000","last_became_peered":"2024-09-10T08:42:29.378509+0000","last_unstale":"2024-09-10T08:42:30.370846+0000","last_undegraded":"2024-09-10T08:42:30.370846+0000","last_fullsized":"2024-09-10T08:42:30.370846+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:42:44.310284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370519+0000","last_change":"2024-09-10T08:42:28.361630+0000","last_active":"2024-09-10T08:42:30.370519+0000","last_peered":"2024-09-10T08:42:30.370519+0000","last_clean":"2024-09-10T08:42:30.370519+0000","last_became_active":"2024-09-10T08:42:28.358295+0000","last_became_peered":"2024-09-10T08:42:28.358295+0000","last_unstale":"2024-09-10T08:42:30.370519+0000","last_undegraded":"2024-09-10T08:42:30.370519+0000","last_fullsized":"2024-09-10T08:42:30.370519+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:21.406617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925905+0000","last_change":"2024-09-10T08:42:29.368037+0000","last_active":"2024-09-10T08:42:30.925905+0000","last_peered":"2024-09-10T08:42:30.925905+0000","last_clean":"2024-09-10T08:42:30.925905+0000","last_became_active":"2024-09-10T08:42:29.367522+0000","last_became_peered":"2024-09-10T08:42:29.367522+0000","last_unstale":"2024-09-10T08:42:30.925905+0000","last_undegraded":"2024-09-10T08:42:30.925905+0000","last_fullsized":"2024-09-10T08:42:30.925905+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:42:14.376246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925409+0000","last_change":"2024-09-10T08:42:28.370188+0000","last_active":"2024-09-10T08:42:30.925409+0000","last_peered":"2024-09-10T08:42:30.925409+0000","last_clean":"2024-09-10T08:42:30.925409+0000","last_became_active":"2024-09-10T08:42:28.369878+0000","last_became_peered":"2024-09-10T08:42:28.369878+0000","last_unstale":"2024-09-10T08:42:30.925409+0000","last_undegraded":"2024-09-10T08:42:30.925409+0000","last_fullsized":"2024-09-10T08:42:30.925409+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:37:27.034999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370829+0000","last_change":"2024-09-10T08:42:29.384764+0000","last_active":"2024-09-10T08:42:30.370829+0000","last_peered":"2024-09-10T08:42:30.370829+0000","last_clean":"2024-09-10T08:42:30.370829+0000","last_became_active":"2024-09-10T08:42:29.383341+0000","last_became_peered":"2024-09-10T08:42:29.383341+0000","last_unstale":"2024-09-10T08:42:30.370829+0000","last_undegraded":"2024-09-10T08:42:30.370829+0000","last_fullsized":"2024-09-10T08:42:30.370829+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:03:22.409795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.925346+0000","last_change":"2024-09-10T08:42:28.368721+0000","last_active":"2024-09-10T08:42:30.925346+0000","last_peered":"2024-09-10T08:42:30.925346+0000","last_clean":"2024-09-10T08:42:30.925346+0000","last_became_active":"2024-09-10T08:42:28.368451+0000","last_became_peered":"2024-09-10T08:42:28.368451+0000","last_unstale":"2024-09-10T08:42:30.925346+0000","last_undegraded":"2024-09-10T08:42:30.925346+0000","last_fullsized":"2024-09-10T08:42:30.925346+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:02.113701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371980+0000","last_change":"2024-09-10T08:42:29.383876+0000","last_active":"2024-09-10T08:42:30.371980+0000","last_peered":"2024-09-10T08:42:30.371980+0000","last_clean":"2024-09-10T08:42:30.371980+0000","last_became_active":"2024-09-10T08:42:29.383482+0000","last_became_peered":"2024-09-10T08:42:29.383482+0000","last_unstale":"2024-09-10T08:42:30.371980+0000","last_undegraded":"2024-09-10T08:42:30.371980+0000","last_fullsized":"2024-09-10T08:42:30.371980+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:12.195864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.372035+0000","last_change":"2024-09-10T08:42:28.365843+0000","last_active":"2024-09-10T08:42:30.372035+0000","last_peered":"2024-09-10T08:42:30.372035+0000","last_clean":"2024-09-10T08:42:30.372035+0000","last_became_active":"2024-09-10T08:42:28.365472+0000","last_became_peered":"2024-09-10T08:42:28.365472+0000","last_unstale":"2024-09-10T08:42:30.372035+0000","last_undegraded":"2024-09-10T08:42:30.372035+0000","last_fullsized":"2024-09-10T08:42:30.372035+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:30.588924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924818+0000","last_change":"2024-09-10T08:42:29.387773+0000","last_active":"2024-09-10T08:42:30.924818+0000","last_peered":"2024-09-10T08:42:30.924818+0000","last_clean":"2024-09-10T08:42:30.924818+0000","last_became_active":"2024-09-10T08:42:29.387377+0000","last_became_peered":"2024-09-10T08:42:29.387377+0000","last_unstale":"2024-09-10T08:42:30.924818+0000","last_undegraded":"2024-09-10T08:42:30.924818+0000","last_fullsized":"2024-09-10T08:42:30.924818+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:30.985321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.924836+0000","last_change":"2024-09-10T08:42:28.361831+0000","last_active":"2024-09-10T08:42:30.924836+0000","last_peered":"2024-09-10T08:42:30.924836+0000","last_clean":"2024-09-10T08:42:30.924836+0000","last_became_active":"2024-09-10T08:42:28.360230+0000","last_became_peered":"2024-09-10T08:42:28.360230+0000","last_unstale":"2024-09-10T08:42:30.924836+0000","last_undegraded":"2024-09-10T08:42:30.924836+0000","last_fullsized":"2024-09-10T08:42:30.924836+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:53.769070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370106+0000","last_change":"2024-09-10T08:42:29.364854+0000","last_active":"2024-09-10T08:42:30.370106+0000","last_peered":"2024-09-10T08:42:30.370106+0000","last_clean":"2024-09-10T08:42:30.370106+0000","last_became_active":"2024-09-10T08:42:29.364185+0000","last_became_peered":"2024-09-10T08:42:29.364185+0000","last_unstale":"2024-09-10T08:42:30.370106+0000","last_undegraded":"2024-09-10T08:42:30.370106+0000","last_fullsized":"2024-09-10T08:42:30.370106+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:06:12.108699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":14,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371612+0000","last_change":"2024-09-10T08:42:28.371106+0000","last_active":"2024-09-10T08:42:30.371612+0000","last_peered":"2024-09-10T08:42:30.371612+0000","last_clean":"2024-09-10T08:42:30.371612+0000","last_became_active":"2024-09-10T08:42:28.370787+0000","last_became_peered":"2024-09-10T08:42:28.370787+0000","last_unstale":"2024-09-10T08:42:30.371612+0000","last_undegraded":"2024-09-10T08:42:30.371612+0000","last_fullsized":"2024-09-10T08:42:30.371612+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:12:40.197098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":12,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370392+0000","last_change":"2024-09-10T08:42:29.364367+0000","last_active":"2024-09-10T08:42:30.370392+0000","last_peered":"2024-09-10T08:42:30.370392+0000","last_clean":"2024-09-10T08:42:30.370392+0000","last_became_active":"2024-09-10T08:42:29.364048+0000","last_became_peered":"2024-09-10T08:42:29.364048+0000","last_unstale":"2024-09-10T08:42:30.370392+0000","last_undegraded":"2024-09-10T08:42:30.370392+0000","last_fullsized":"2024-09-10T08:42:30.370392+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:28.339417+0000","last_clean_scrub_stamp":"2024-09-10T08:42:28.339417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:59.952205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"194'2","reported_seq":16,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.370995+0000","last_change":"2024-09-10T08:42:28.374827+0000","last_active":"2024-09-10T08:42:30.370995+0000","last_peered":"2024-09-10T08:42:30.370995+0000","last_clean":"2024-09-10T08:42:30.370995+0000","last_became_active":"2024-09-10T08:42:28.374529+0000","last_became_peered":"2024-09-10T08:42:28.374529+0000","last_unstale":"2024-09-10T08:42:30.370995+0000","last_undegraded":"2024-09-10T08:42:30.370995+0000","last_fullsized":"2024-09-10T08:42:30.370995+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:42:27.336239+0000","last_clean_scrub_stamp":"2024-09-10T08:42:27.336239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:14.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":488,"reported_epoch":195,"state":"active+clean","last_fresh":"2024-09-10T08:42:30.371705+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:42:30.371705+0000","last_peered":"2024-09-10T08:42:30.371705+0000","last_clean":"2024-09-10T08:42:30.371705+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:42:30.371705+0000","last_undegraded":"2024-09-10T08:42:30.371705+0000","last_fullsized":"2024-09-10T08:42:30.371705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509611,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51648,"kb_used_data":2404,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320192,"statfs":{"total":96636764160,"available":96583876608,"internally_reserved":0,"allocated":2461696,"data_stored":1080715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509611,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55804,"kb_used_data":2408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316036,"statfs":{"total":96636764160,"available":96579620864,"internally_reserved":0,"allocated":2465792,"data_stored":1080189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509610,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59964,"kb_used_data":2408,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311876,"statfs":{"total":96636764160,"available":96575361024,"internally_reserved":0,"allocated":2465792,"data_stored":1081655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509611,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69616,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302224,"statfs":{"total":96636764160,"available":96565477376,"internally_reserved":0,"allocated":2453504,"data_stored":1080043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509612,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47476,"kb_used_data":2400,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324364,"statfs":{"total":96636764160,"available":96588148736,"internally_reserved":0,"allocated":2457600,"data_stored":1080077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60544,"kb_used_data":2988,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311296,"statfs":{"total":96636764160,"available":96574767104,"internally_reserved":0,"allocated":3059712,"data_stored":1671085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509613,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55792,"kb_used_data":2396,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316048,"statfs":{"total":96636764160,"available":96579633152,"internally_reserved":0,"allocated":2453504,"data_stored":1080043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542314,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60548,"kb_used_data":2992,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311292,"statfs":{"total":96636764160,"available":96574763008,"internally_reserved":0,"allocated":3063808,"data_stored":1672093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:42:38.686 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:42:38.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:42:38.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.885+0000 7f0897800640 1 Processor -- start 2024-09-10T08:42:38.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.885+0000 7f0897800640 1 -- start start 2024-09-10T08:42:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0897800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08900d3160 0x7f089015d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0897800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0890160170 con 0x7f089006f400 2024-09-10T08:42:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0897800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08900b7380 con 0x7f089015c650 2024-09-10T08:42:38.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0897800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0890161040 con 0x7f08900d3160 2024-09-10T08:42:38.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0895800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f089006f400 0x7f08900b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59618/0 (socket says 172.21.15.52:59618) 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f0895800640 1 -- 172.21.15.52:0/3791470034 learned_addr learned my addr 172.21.15.52:0/3791470034 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.886+0000 7f088fe00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08900d3160 0x7f089015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139485557 0 0) 0x7f0890160170 con 0x7f089006f400 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0878003520 con 0x7f089006f400 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439194459 0 0) 0x7f08900b7380 con 0x7f089015c650 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0890160170 con 0x7f089015c650 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 646012515 0 0) 0x7f0878003520 con 0x7f089006f400 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08900d3160 msgr2=0x7f089015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08900d3160 0x7f089015d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 >> v1:172.21.15.176:6789/0 conn(0x7f089015c650 legacy=0x7f0890160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900b7660 con 0x7f089006f400 2024-09-10T08:42:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f08880019f0 con 0x7f089006f400 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 >> v1:172.21.15.52:6789/0 conn(0x7f089006f400 legacy=0x7f08900b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878003b70 0x7f0878003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0878004800 0x7f0878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08780051c0 0x7f087800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0890161040 con 0x7f0878003b70 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f087800c090 con 0x7f0878004800 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f087800c290 con 0x7f08780051c0 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f088fe00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08900d3160 0x7f089015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.887+0000 7f0894e00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878003b70 0x7f0878003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0895800640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08780051c0 0x7f087800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f088fe00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0878004800 0x7f0878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0894e00640 1 -- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08780051c0 msgr2=0x7f087800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0894e00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08780051c0 0x7f087800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0894e00640 1 -- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0878004800 msgr2=0x7f0878004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0894e00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0878004800 0x7f0878004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.888+0000 7f0894e00640 1 -- 172.21.15.52:0/3791470034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0878003520 con 0x7f0878003b70 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.889+0000 7f0894e00640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878003b70 0x7f0878003f70 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f08840018d0 tx=0x7f0878005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be7d6b033e0becc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.889+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840014f0 con 0x7f0878003b70 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.889+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08840052d0 con 0x7f0878003b70 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.889+0000 7f088f400640 1 -- 172.21.15.52:0/3791470034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088402aca0 con 0x7f0878003b70 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 -- 172.21.15.52:0/3791470034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878003b70 msgr2=0x7f0878003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 --2- 172.21.15.52:0/3791470034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878003b70 0x7f0878003f70 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f08840018d0 tx=0x7f0878005830 comp rx=0 tx=0).stop 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0895800640 1 -- 172.21.15.52:0/3791470034 reap_dead start 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 -- 172.21.15.52:0/3791470034 shutdown_connections 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 -- 172.21.15.52:0/3791470034 >> 172.21.15.52:0/3791470034 conn(0x7f08900d25d0 msgr2=0x7f08900d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 -- 172.21.15.52:0/3791470034 shutdown_connections 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.890+0000 7f0897800640 1 -- 172.21.15.52:0/3791470034 wait complete. 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.891+0000 7f0897800640 1 Processor -- start 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.892+0000 7f0897800640 1 -- start start 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.892+0000 7f0897800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0878003b70 0x7f08901515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.892+0000 7f0897800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.892+0000 7f0897800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 0x7f089006e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.892+0000 7f0897800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08900b5c30 con 0x7f08900ce240 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f0897800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08900b7940 con 0x7f089006e1e0 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f0897800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f08900b5db0 con 0x7f0878003b70 2024-09-10T08:42:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50040/0 (socket says 172.21.15.52:50040) 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 -- 172.21.15.52:0/3315067148 learned_addr learned my addr 172.21.15.52:0/3315067148 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f0894e00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0878003b70 0x7f08901515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f0895800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 0x7f089006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 -- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0878003b70 msgr2=0x7f08901515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0878003b70 0x7f08901515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 -- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 msgr2=0x7f089006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 0x7f089006e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f088fe00640 1 -- 172.21.15.52:0/3315067148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08900cb9d0 con 0x7f08900ce240 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.893+0000 7f0895800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 0x7f089006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f088fe00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f087c011860 tx=0x7f087c011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c00fb70 con 0x7f08900ce240 2024-09-10T08:42:38.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c00fd10 con 0x7f08900ce240 2024-09-10T08:42:38.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0156a0 con 0x7f08900ce240 2024-09-10T08:42:38.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08900cbcb0 con 0x7f08900ce240 2024-09-10T08:42:38.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.894+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08900cc270 con 0x7f08900ce240 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.895+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089006f890 con 0x7f08900ce240 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.896+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f087c015840 con 0x7f08900ce240 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.897+0000 7f088cc00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 0x7f087006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.897+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f087c08b760 con 0x7f08900ce240 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.897+0000 7f0894e00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 0x7f087006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.898+0000 7f0894e00640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 0x7f087006e320 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f08840018d0 tx=0x7f0884009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:38.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:38.901+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f087c019030 con 0x7f08900ce240 2024-09-10T08:42:39.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.153+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0890070440 con 0x7f08900ce240 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.156+0000 7f088cc00640 1 -- 172.21.15.52:0/3315067148 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7f087c05a100 con 0x7f08900ce240 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7AuBmsmZuEBAAmXnZU8JgsE+A9VxGODVlrA== 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:42:39.157 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2024-09-10T08:42:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.158+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 msgr2=0x7f087006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.158+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 0x7f087006e320 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f08840018d0 tx=0x7f0884009030 comp rx=0 tx=0).stop 2024-09-10T08:42:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.158+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 msgr2=0x7f08900cd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.158+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f087c011860 tx=0x7f087c011d20 comp rx=0 tx=0).stop 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 shutdown_connections 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f087006be60 0x7f087006e320 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f089006e1e0 0x7f089006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08900ce240 0x7f08900cd8d0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 --2- 172.21.15.52:0/3315067148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0878003b70 0x7f08901515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 >> 172.21.15.52:0/3315067148 conn(0x7f08900d25d0 msgr2=0x7f08901576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 shutdown_connections 2024-09-10T08:42:39.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.159+0000 7f0897800640 1 -- 172.21.15.52:0/3315067148 wait complete. 2024-09-10T08:42:39.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.331+0000 7f76f2800640 1 Processor -- start 2024-09-10T08:42:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.332+0000 7f76f2800640 1 -- start start 2024-09-10T08:42:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f76ec15e310 0x7f76ec15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f2800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec15ece0 con 0x7f76ec073790 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f2800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec15efc0 con 0x7f76ec0710e0 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f2800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f76ec073f00 con 0x7f76ec15e310 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f1e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f76ec073790 0x7f76ec0b5690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59624/0 (socket says 172.21.15.52:59624) 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f1e00640 1 -- 172.21.15.52:0/2858597704 learned_addr learned my addr 172.21.15.52:0/2858597704 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.333+0000 7f76f1400640 1 --2- 172.21.15.52:0/2858597704 >> v2:172.21.15.52:3300/0 conn(0x7f76ec15e310 0x7f76ec15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:39.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.334+0000 7f76f1400640 1 -- 172.21.15.52:0/2858597704 >> v1:172.21.15.176:6789/0 conn(0x7f76ec0710e0 legacy=0x7f76ec073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.334+0000 7f76ebe00640 1 -- 172.21.15.52:0/2858597704 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414684314 0 0) 0x7f76ec15ece0 con 0x7f76ec073790 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.334+0000 7f76f1400640 1 -- 172.21.15.52:0/2858597704 >> v1:172.21.15.52:6789/0 conn(0x7f76ec073790 legacy=0x7f76ec0b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.334+0000 7f76f1400640 1 -- 172.21.15.52:0/2858597704 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec15f2a0 con 0x7f76ec15e310 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76f1400640 1 --2- 172.21.15.52:0/2858597704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15e6f0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009720 tx=0x7f76e002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e869d46d5668524 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76ebe00640 1 -- 172.21.15.52:0/2858597704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0037070 con 0x7f76ec15e310 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76ebe00640 1 -- 172.21.15.52:0/2858597704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e002ade0 con 0x7f76ec15e310 2024-09-10T08:42:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76ebe00640 1 -- 172.21.15.52:0/2858597704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0032660 con 0x7f76ec15e310 2024-09-10T08:42:39.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76f2800640 1 -- 172.21.15.52:0/2858597704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 msgr2=0x7f76ec15e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.335+0000 7f76f2800640 1 --2- 172.21.15.52:0/2858597704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15e6f0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009720 tx=0x7f76e002a0d0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.336+0000 7f76f2800640 1 -- 172.21.15.52:0/2858597704 shutdown_connections 2024-09-10T08:42:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.336+0000 7f76f2800640 1 --2- 172.21.15.52:0/2858597704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15e6f0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.336+0000 7f76f2800640 1 -- 172.21.15.52:0/2858597704 >> 172.21.15.52:0/2858597704 conn(0x7f76ec0b4470 msgr2=0x7f76ec0b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.336+0000 7f76f2800640 1 -- 172.21.15.52:0/2858597704 shutdown_connections 2024-09-10T08:42:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.336+0000 7f76f2800640 1 -- 172.21.15.52:0/2858597704 wait complete. 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.337+0000 7f76f2800640 1 Processor -- start 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.337+0000 7f76f2800640 1 -- start start 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76ec0710e0 0x7f76ec0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 0x7f76ec15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec071550 con 0x7f76ec15e310 2024-09-10T08:42:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec15f860 con 0x7f76ec0710e0 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f2800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec0716d0 con 0x7f76ec073790 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.338+0000 7f76f1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50046/0 (socket says 172.21.15.52:50046) 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 -- 172.21.15.52:0/4058929340 learned_addr learned my addr 172.21.15.52:0/4058929340 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1400640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76ec0710e0 0x7f76ec0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f0a00640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 0x7f76ec15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 -- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 msgr2=0x7f76ec15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 0x7f76ec15c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 -- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76ec0710e0 msgr2=0x7f76ec0cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76ec0710e0 0x7f76ec0cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 -- 172.21.15.52:0/4058929340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec0cc3d0 con 0x7f76ec15e310 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f0a00640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 0x7f76ec15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76f1e00640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c7a0 tx=0x7f76e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4018070 con 0x7f76ec15e310 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e400a640 con 0x7f76ec15e310 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.339+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e400aab0 con 0x7f76ec15e310 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.340+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec0cc6b0 con 0x7f76ec15e310 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.340+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec0ccc70 con 0x7f76ec15e310 2024-09-10T08:42:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.341+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec15e6f0 con 0x7f76ec15e310 2024-09-10T08:42:39.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.342+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76e400ac50 con 0x7f76ec15e310 2024-09-10T08:42:39.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.342+0000 7f76e9600640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 0x7f76cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:39.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.343+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f76e408a470 con 0x7f76ec15e310 2024-09-10T08:42:39.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.343+0000 7f76f1400640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 0x7f76cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:39.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.344+0000 7f76f1400640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 0x7f76cc06e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f76e0034000 tx=0x7f76e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:39.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.347+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76e40587c0 con 0x7f76ec15e310 2024-09-10T08:42:39.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.566+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76ec068e70 con 0x7f76ec15e310 2024-09-10T08:42:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.566+0000 7f76e9600640 1 -- 172.21.15.52:0/4058929340 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f76e405cac0 con 0x7f76ec15e310 2024-09-10T08:42:39.567 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:39.567 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:42:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:42:39.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 msgr2=0x7f76cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 0x7f76cc06e2f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f76e0034000 tx=0x7f76e002e000 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 msgr2=0x7f76ec15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c7a0 tx=0x7f76e400cc60 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 shutdown_connections 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f76cc06be30 0x7f76cc06e2f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76ec15e310 0x7f76ec15ce40 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f76ec073790 0x7f76ec15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 --2- 172.21.15.52:0/4058929340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76ec0710e0 0x7f76ec0cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 >> 172.21.15.52:0/4058929340 conn(0x7f76ec0b4470 msgr2=0x7f76ec0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 shutdown_connections 2024-09-10T08:42:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:39.569+0000 7f76f2800640 1 -- 172.21.15.52:0/4058929340 wait complete. 2024-09-10T08:42:39.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 149, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:42:28.780680+0000', 'modified': '2024-09-10T08:42:31.798157+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10566': {'gid': 10566, 'name': 'c', 'rank': 0, 'incarnation': 145, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6834/1114908011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 1114908011}, {'type': 'v1', 'addr': '172.21.15.52:6834', 'nonce': 1114908011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10566, 'qdb_cluster': [10566]} 2024-09-10T08:42:39.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:42:39.989 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:42:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.148+0000 7f7c67600640 1 Processor -- start 2024-09-10T08:42:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.148+0000 7f7c67600640 1 -- start start 2024-09-10T08:42:40.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c67600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6015eb60 0x7f7c6015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c67600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7c601624b0 0x7f7c600d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c67600640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6015f590 con 0x7f7c600b66a0 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c67600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7c6015f870 con 0x7f7c6015eb60 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c67600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f7c6015fb50 con 0x7f7c601624b0 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c64c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6015eb60 0x7f7c6015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c64c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6015eb60 0x7f7c6015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50056/0 (socket says 172.21.15.52:50056) 2024-09-10T08:42:40.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.149+0000 7f7c64c00640 1 -- 172.21.15.52:0/3178970076 learned_addr learned my addr 172.21.15.52:0/3178970076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.150+0000 7f7c64c00640 1 -- 172.21.15.52:0/3178970076 >> v2:172.21.15.176:3300/0 conn(0x7f7c601624b0 msgr2=0x7f7c600d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.150+0000 7f7c64c00640 1 --2- 172.21.15.52:0/3178970076 >> v2:172.21.15.176:3300/0 conn(0x7f7c601624b0 0x7f7c600d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.150+0000 7f7c64c00640 1 -- 172.21.15.52:0/3178970076 >> v1:172.21.15.176:6789/0 conn(0x7f7c600b66a0 legacy=0x7f7c600b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.150+0000 7f7c64c00640 1 -- 172.21.15.52:0/3178970076 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6015fe30 con 0x7f7c6015eb60 2024-09-10T08:42:40.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.151+0000 7f7c64c00640 1 --2- 172.21.15.52:0/3178970076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6015eb60 0x7f7c6015ef40 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f7c600d0cd0 tx=0x7f7c5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91ac03f921fd219 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.151+0000 7f7c5f400640 1 -- 172.21.15.52:0/3178970076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54037070 con 0x7f7c6015eb60 2024-09-10T08:42:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.151+0000 7f7c5f400640 1 -- 172.21.15.52:0/3178970076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5402ae20 con 0x7f7c6015eb60 2024-09-10T08:42:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.151+0000 7f7c5f400640 1 -- 172.21.15.52:0/3178970076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54032660 con 0x7f7c6015eb60 2024-09-10T08:42:40.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 -- 172.21.15.52:0/3178970076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6015eb60 msgr2=0x7f7c6015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 --2- 172.21.15.52:0/3178970076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6015eb60 0x7f7c6015ef40 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f7c600d0cd0 tx=0x7f7c5402a110 comp rx=0 tx=0).stop 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 -- 172.21.15.52:0/3178970076 shutdown_connections 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 --2- 172.21.15.52:0/3178970076 >> v2:172.21.15.176:3300/0 conn(0x7f7c601624b0 0x7f7c600d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 --2- 172.21.15.52:0/3178970076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6015eb60 0x7f7c6015ef40 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 -- 172.21.15.52:0/3178970076 >> 172.21.15.52:0/3178970076 conn(0x7f7c600d16f0 msgr2=0x7f7c600d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 -- 172.21.15.52:0/3178970076 shutdown_connections 2024-09-10T08:42:40.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.152+0000 7f7c67600640 1 -- 172.21.15.52:0/3178970076 wait complete. 2024-09-10T08:42:40.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.153+0000 7f7c67600640 1 Processor -- start 2024-09-10T08:42:40.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.153+0000 7f7c67600640 1 -- start start 2024-09-10T08:42:40.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6015eb60 0x7f7c600ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c601624b0 0x7f7c6014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600d4480 con 0x7f7c600b66a0 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600d3190 con 0x7f7c6015eb60 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.154+0000 7f7c67600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600d4600 con 0x7f7c601624b0 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50070/0 (socket says 172.21.15.52:50070) 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 -- 172.21.15.52:0/4178734218 learned_addr learned my addr 172.21.15.52:0/4178734218 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6015eb60 0x7f7c600ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c65600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c601624b0 0x7f7c6014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 -- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c601624b0 msgr2=0x7f7c6014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c601624b0 0x7f7c6014d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 -- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6015eb60 msgr2=0x7f7c600ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6015eb60 0x7f7c600ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 -- 172.21.15.52:0/4178734218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6014de30 con 0x7f7c600b66a0 2024-09-10T08:42:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.155+0000 7f7c64c00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f7c54000c00 tx=0x7f7c540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.156+0000 7f7c5cc00640 1 -- 172.21.15.52:0/4178734218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54042070 con 0x7f7c600b66a0 2024-09-10T08:42:40.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.156+0000 7f7c5cc00640 1 -- 172.21.15.52:0/4178734218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5403e460 con 0x7f7c600b66a0 2024-09-10T08:42:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.156+0000 7f7c5cc00640 1 -- 172.21.15.52:0/4178734218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54037040 con 0x7f7c600b66a0 2024-09-10T08:42:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.156+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6014e110 con 0x7f7c600b66a0 2024-09-10T08:42:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.156+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c600cd8d0 con 0x7f7c600b66a0 2024-09-10T08:42:40.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.158+0000 7f7c5cc00640 1 -- 172.21.15.52:0/4178734218 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c54045070 con 0x7f7c600b66a0 2024-09-10T08:42:40.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.159+0000 7f7c5cc00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 0x7f7c4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.159+0000 7f7c5cc00640 1 -- 172.21.15.52:0/4178734218 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f7c540ab9e0 con 0x7f7c600b66a0 2024-09-10T08:42:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.160+0000 7f7c6a667740 1 Processor -- start 2024-09-10T08:42:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.160+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 0x7f7c4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.160+0000 7f7c6a667740 1 -- start start 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.160+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 0x7f7c4006e320 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7c6015d800 tx=0x7f7c4c009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352574b0 0x55a93525a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9351b83b0 con 0x55a93525b480 2024-09-10T08:42:40.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a9351bd410 con 0x55a935259cf0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a935165620 con 0x55a9352574b0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c5fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352574b0 0x55a93525a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50086/0 (socket says 172.21.15.52:50086) 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 -- 172.21.15.52:0/2132724721 learned_addr learned my addr 172.21.15.52:0/2132724721 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c64c00640 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 -- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352574b0 msgr2=0x55a93525a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352574b0 0x55a93525a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 -- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 msgr2=0x55a93529f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.161+0000 7f7c65600640 1 -- 172.21.15.52:0/2132724721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a934ed02d0 con 0x55a93525b480 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.162+0000 7f7c65600640 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800b530 tx=0x7f7c58009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2caba674bff4af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.162+0000 7f7c51200640 1 -- 172.21.15.52:0/2132724721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800a9f0 con 0x55a93525b480 2024-09-10T08:42:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.162+0000 7f7c51200640 1 -- 172.21.15.52:0/2132724721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58019070 con 0x55a93525b480 2024-09-10T08:42:40.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.162+0000 7f7c51200640 1 -- 172.21.15.52:0/2132724721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800ad90 con 0x55a93525b480 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 -- 172.21.15.52:0/2132724721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 msgr2=0x55a935254570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800b530 tx=0x7f7c58009630 comp rx=0 tx=0).stop 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 -- 172.21.15.52:0/2132724721 shutdown_connections 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a93525b480 0x55a935254570 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352574b0 0x55a93525a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 --2- 172.21.15.52:0/2132724721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 -- 172.21.15.52:0/2132724721 >> 172.21.15.52:0/2132724721 conn(0x55a935256740 msgr2=0x55a93529e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 -- 172.21.15.52:0/2132724721 shutdown_connections 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.163+0000 7f7c6a667740 1 -- 172.21.15.52:0/2132724721 wait complete. 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.164+0000 7f7c6a667740 1 -- start start 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.164+0000 7f7c6a667740 1 Processor -- start 2024-09-10T08:42:40.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a93525b480 0x55a935279280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352839a0 0x55a935254880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a935178780 con 0x55a935259cf0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a9351b93d0 con 0x55a93525b480 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a935255be0 con 0x55a9352839a0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c6a667740 10 client.0 _ll_register_callbacks cb 0x55a9351b65d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50098/0 (socket says 172.21.15.52:50098) 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 -- 172.21.15.52:0/877170038 learned_addr learned my addr 172.21.15.52:0/877170038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a93525b480 0x55a935279280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c65600640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352839a0 0x55a935254880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 -- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352839a0 msgr2=0x55a935254880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352839a0 0x55a935254880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 -- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a93525b480 msgr2=0x55a935279280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.165+0000 7f7c64c00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a93525b480 0x55a935279280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c64c00640 1 -- 172.21.15.52:0/877170038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a934f9a6b0 con 0x55a935259cf0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c64c00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f7c54079ac0 tx=0x7f7c540797e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f720dd2540d1508 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c45600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5404c040 con 0x55a935259cf0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f7c54082660 con 0x55a935259cf0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c58019070 con 0x55a935259cf0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f7c540828f0 con 0x55a935259cf0 2024-09-10T08:42:40.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c6a667740 10 client.10713 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x55a93527ac70 con 0x55a935259cf0 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.166+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58019070 con 0x55a935259cf0 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7f7c54082b40 con 0x55a935259cf0 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 10 client.10713 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 10 client.10713 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 20 client.10713 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a93527bbd0 0x55a93527bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 4 client.10713 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9351cab40 con 0x55a93527bbd0 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a93527bbd0 0x55a93527bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a93527bbd0 0x55a93527bfb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2182649ae92cc9d4 server_cookie=c05601131b6c5e45 in_seq=0 out_seq=0 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.167+0000 7f7c45600640 10 client.10713 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.168+0000 7f7c45600640 1 -- 172.21.15.52:0/877170038 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9351cab40 con 0x55a93527bbd0 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.168+0000 7f7c45600640 10 client.10713 handle_command_reply: tid=0 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.168+0000 7f7c6a667740 1 client.10713 shutdown 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 msgr2=0x55a935284040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f7c54079ac0 tx=0x7f7c540797e0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 shutdown_connections 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a93527bbd0 0x55a93527bfb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a9352839a0 0x55a935254880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a93525b480 0x55a935279280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c45600640 0 client.10713 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 --2- 172.21.15.52:0/877170038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a935284040 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 >> 172.21.15.52:0/877170038 conn(0x55a9352574b0 msgr2=0x55a93529c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 shutdown_connections 2024-09-10T08:42:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 1 -- 172.21.15.52:0/877170038 wait complete. 2024-09-10T08:42:40.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.169+0000 7f7c6a667740 20 client.10713 trim_cache size 0 max 16384 2024-09-10T08:42:40.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.188+0000 7f7c6a667740 1 Processor -- start 2024-09-10T08:42:40.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.188+0000 7f7c6a667740 1 -- start start 2024-09-10T08:42:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a93529df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6014ac20 con 0x55a9352839a0 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c600cc260 con 0x55a935259cf0 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6014a5d0 con 0x55a93525b480 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50110/0 (socket says 172.21.15.52:50110) 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 -- 172.21.15.52:0/821136848 learned_addr learned my addr 172.21.15.52:0/821136848 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c64c00640 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a93529df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 -- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 msgr2=0x55a93529df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a93529df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 -- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 msgr2=0x55a93529bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.189+0000 7f7c65600640 1 -- 172.21.15.52:0/821136848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a935246350 con 0x55a9352839a0 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c65600640 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800be80 tx=0x7f7c58012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276eed3a2975ec83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c47e00640 1 -- 172.21.15.52:0/821136848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003b70 con 0x55a9352839a0 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c47e00640 1 -- 172.21.15.52:0/821136848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58019040 con 0x55a9352839a0 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c47e00640 1 -- 172.21.15.52:0/821136848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800a7f0 con 0x55a9352839a0 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 -- 172.21.15.52:0/821136848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 msgr2=0x55a935254260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800be80 tx=0x7f7c58012000 comp rx=0 tx=0).stop 2024-09-10T08:42:40.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 -- 172.21.15.52:0/821136848 shutdown_connections 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9352839a0 0x55a935254260 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a93529df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 --2- 172.21.15.52:0/821136848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a935259cf0 0x55a93529bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.190+0000 7f7c6a667740 1 -- 172.21.15.52:0/821136848 >> 172.21.15.52:0/821136848 conn(0x55a9352574b0 msgr2=0x55a9352790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.191+0000 7f7c6a667740 1 -- 172.21.15.52:0/821136848 shutdown_connections 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.191+0000 7f7c6a667740 1 -- 172.21.15.52:0/821136848 wait complete. 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.191+0000 7f7c6a667740 1 -- start start 2024-09-10T08:42:40.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.191+0000 7f7c6a667740 1 Processor -- start 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a9352c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 0x55a93531c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9352797c0 con 0x55a935259cf0 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x55a93527ac70 con 0x55a9352839a0 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x55a935281ea0 con 0x55a93525b480 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c6a667740 10 client.0 _ll_register_callbacks cb 0x7f7c540097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:40.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.192+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50114/0 (socket says 172.21.15.52:50114) 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 -- 172.21.15.52:0/1763572450 learned_addr learned my addr 172.21.15.52:0/1763572450 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a9352c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c65600640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 0x55a93531c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 -- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 msgr2=0x55a9352c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a9352c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 -- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 msgr2=0x55a93531c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 0x55a93531c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 -- 172.21.15.52:0/1763572450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9352a5be0 con 0x55a935259cf0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a9352c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c65600640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 0x55a93531c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c64c00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f7c54006da0 tx=0x7f7c54040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4facb78a6d3494 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c45600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5404c050 con 0x55a935259cf0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f7c540802c0 con 0x55a935259cf0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.193+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c58019040 con 0x55a935259cf0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7f7c54079900 con 0x55a935259cf0 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 10 client.10719 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:40.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x55a9352a5be0 con 0x55a935259cf0 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58019040 con 0x55a935259cf0 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7f7c54075b10 con 0x55a935259cf0 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 10 client.10719 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 10 client.10719 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 20 client.10719 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a9352a0740 0x55a9352a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 4 client.10719 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "status"}) -- 0x55a9351c4e90 con 0x55a9352a0740 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.194+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a9352a0740 0x55a9352a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c5fe00640 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a9352a0740 0x55a9352a0b20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d79a22e9326f01a4 server_cookie=6b1f8cd71c327146 in_seq=0 out_seq=0 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c45600640 10 client.10719 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c45600640 1 -- 172.21.15.52:0/1763572450 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55a9351c4e90 con 0x55a9352a0740 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c45600640 10 client.10719 handle_command_reply: tid=0 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 client.10719 shutdown 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 msgr2=0x55a9352a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f7c54006da0 tx=0x7f7c54040040 comp rx=0 tx=0).stop 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 shutdown_connections 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x55a9352a0740 0x55a9352a0b20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x55a9352839a0 0x55a93531c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x55a93525b480 0x55a9352c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 --2- 172.21.15.52:0/1763572450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a935259cf0 0x55a9352a56a0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c45600640 0 client.10719 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 >> 172.21.15.52:0/1763572450 conn(0x55a9352574b0 msgr2=0x55a935281060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 shutdown_connections 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.195+0000 7f7c6a667740 1 -- 172.21.15.52:0/1763572450 wait complete. 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c6a667740 20 client.10719 trim_cache size 0 max 16384 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "4eb61a63-2a53-4336-9780-430e4b9fd90b", 2024-09-10T08:42:40.202 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 10566, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.847101765, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 149, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 195, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 195, 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 15.902855468 2024-09-10T08:42:40.203 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 msgr2=0x7f7c4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 0x7f7c4006e320 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7c6015d800 tx=0x7f7c4c009110 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 msgr2=0x7f7c601e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f7c54000c00 tx=0x7f7c540046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 shutdown_connections 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4006be60 0x7f7c4006e320 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c601624b0 0x7f7c6014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6015eb60 0x7f7c600ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 --2- 172.21.15.52:0/4178734218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c600b66a0 0x7f7c601e98b0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 >> 172.21.15.52:0/4178734218 conn(0x7f7c600d16f0 msgr2=0x7f7c600d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 shutdown_connections 2024-09-10T08:42:40.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.196+0000 7f7c67600640 1 -- 172.21.15.52:0/4178734218 wait complete. 2024-09-10T08:42:40.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:42:40.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.369+0000 7fcacf200640 1 Processor -- start 2024-09-10T08:42:40.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.369+0000 7fcacf200640 1 -- start start 2024-09-10T08:42:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcacf200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcac815ed20 0x7fcac80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcacf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80b90e0 0x7fcac80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcacf200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac80d0e70 con 0x7fcac80d23b0 2024-09-10T08:42:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcacf200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fcac80d41c0 con 0x7fcac815ed20 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcacf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcac80d35b0 con 0x7fcac80b90e0 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcac7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcac815ed20 0x7fcac80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcac7e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcac815ed20 0x7fcac80b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50126/0 (socket says 172.21.15.52:50126) 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.370+0000 7fcac7e00640 1 -- 172.21.15.52:0/1021651114 learned_addr learned my addr 172.21.15.52:0/1021651114 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.371+0000 7fcacd200640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80b90e0 0x7fcac80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.371+0000 7fcac7e00640 1 -- 172.21.15.52:0/1021651114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80b90e0 msgr2=0x7fcac80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.371+0000 7fcac7e00640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80b90e0 0x7fcac80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.371+0000 7fcac7e00640 1 -- 172.21.15.52:0/1021651114 >> v1:172.21.15.176:6789/0 conn(0x7fcac80d23b0 legacy=0x7fcac80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.371+0000 7fcac7e00640 1 -- 172.21.15.52:0/1021651114 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac80d3890 con 0x7fcac815ed20 2024-09-10T08:42:40.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.372+0000 7fcac7e00640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac815ed20 0x7fcac80b6260 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93741609070b6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.372+0000 7fcac6a00640 1 -- 172.21.15.52:0/1021651114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8037070 con 0x7fcac815ed20 2024-09-10T08:42:40.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.372+0000 7fcac6a00640 1 -- 172.21.15.52:0/1021651114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab8032440 con 0x7fcac815ed20 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.372+0000 7fcac6a00640 1 -- 172.21.15.52:0/1021651114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8032810 con 0x7fcac815ed20 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 -- 172.21.15.52:0/1021651114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac815ed20 msgr2=0x7fcac80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac815ed20 0x7fcac80b6260 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 -- 172.21.15.52:0/1021651114 shutdown_connections 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80b90e0 0x7fcac80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 --2- 172.21.15.52:0/1021651114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac815ed20 0x7fcac80b6260 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 -- 172.21.15.52:0/1021651114 >> 172.21.15.52:0/1021651114 conn(0x7fcac80d1260 msgr2=0x7fcac80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 -- 172.21.15.52:0/1021651114 shutdown_connections 2024-09-10T08:42:40.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.373+0000 7fcacf200640 1 -- 172.21.15.52:0/1021651114 wait complete. 2024-09-10T08:42:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.374+0000 7fcacf200640 1 Processor -- start 2024-09-10T08:42:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.374+0000 7fcacf200640 1 -- start start 2024-09-10T08:42:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 0x7fcac80d4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 0x7fcac80d4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80d32a0 con 0x7fcac80b90e0 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80d3e50 con 0x7fcac815ed20 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.375+0000 7fcacf200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcac815f100 con 0x7fcac80d23b0 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50128/0 (socket says 172.21.15.52:50128) 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 -- 172.21.15.52:0/1259306133 learned_addr learned my addr 172.21.15.52:0/1259306133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7400640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 0x7fcac80d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcacd200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 0x7fcac80d4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 -- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 msgr2=0x7fcac80d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 0x7fcac80d4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 -- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 msgr2=0x7fcac80d4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 0x7fcac80d4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 -- 172.21.15.52:0/1259306133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac80c8e10 con 0x7fcac80b90e0 2024-09-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7400640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 0x7fcac80d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcacd200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 0x7fcac80d4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcac7e00640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.376+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8041020 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.377+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab80306c0 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.377+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8037040 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.377+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac80c90f0 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.377+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac80c96b0 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.378+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac80ab130 con 0x7fcac80b90e0 2024-09-10T08:42:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.378+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab8044020 con 0x7fcac80b90e0 2024-09-10T08:42:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.379+0000 7fcabfe00640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.379+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fcab80ab780 con 0x7fcac80b90e0 2024-09-10T08:42:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.380+0000 7fcac7400640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.381+0000 7fcac7400640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcac81624d0 tx=0x7fcab4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.384+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcac80ab130 con 0x7fcac80b90e0 2024-09-10T08:42:40.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.605+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcac80b7010 con 0x7fcac80b90e0 2024-09-10T08:42:40.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.605+0000 7fcabfe00640 1 -- 172.21.15.52:0/1259306133 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v149) ==== 53+0+73 (secure 0 0 0) 0x7fcab804b030 con 0x7fcac80b90e0 2024-09-10T08:42:40.606 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:42:40.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 msgr2=0x7fcaa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fcac81624d0 tx=0x7fcab4009040 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 msgr2=0x7fcac815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7fcab8000c00 tx=0x7fcab80046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 shutdown_connections 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.607+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcac815ed20 0x7fcac80d4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcac80d23b0 0x7fcac80d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 --2- 172.21.15.52:0/1259306133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcac80b90e0 0x7fcac815cf90 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 >> 172.21.15.52:0/1259306133 conn(0x7fcac80d1260 msgr2=0x7fcac80cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 shutdown_connections 2024-09-10T08:42:40.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40.608+0000 7fcacf200640 1 -- 172.21.15.52:0/1259306133 wait complete. 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:42:40.624 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:42:40.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:42:40.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:42:40.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:40.625 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-10T08:42:40.661 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:42:40.661 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:42:40.661 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:42:40.661 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.661 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 41842sec preferred_lft 41842sec 2024-09-10T08:42:40.662 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-10T08:42:40.663 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.663 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::8039:bdff:feaa:1337/64 scope link 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0e:6a:57:64:5b:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:42:40.664 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::c6a:57ff:fe64:5bc0/64 scope link 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run.smithi052.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 32:b3:a0:b0:7a:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::30b3:a0ff:feb0:7afa/64 scope link 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:42:40.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:40.665 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:42:40.755 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-10T08:42:40.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:40.758 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-10T08:42:40.794 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-10T08:42:40.794 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:42:40.794 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:42:40.794 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:42:40.794 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:42:40.795 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-10T08:42:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:42:40.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:42:40.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:40.992 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:42:41.027 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:42:41.027 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:42:41.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:42:41.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:41.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-10T08:42:41.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:42:41.124 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:42:41.159 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:42:41.160 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:42:41.160 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:42:41.235 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:42:41.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:41.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:42:41.363 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:42:41.363 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:42:41.391 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-10T08:42:41.391 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-10T08:42:41.391 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.176:3300,172.21.15.176:3301" 2024-09-10T08:42:41.391 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@4eb61a63-2a53-4336-9780-430e4b9fd90b.cephfs=/ 2024-09-10T08:42:41.391 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.176:3300/172.21.15.176:3301" will pass to kernel 2024-09-10T08:42:41.392 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:42:41.393 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:42:41.393 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:42:41.393 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:42:41.393 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:42:41.395 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:42:41.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:41.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:42:41.453 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:42:41.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:42:41.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:42:41.550 INFO:teuthology.orchestra.run.smithi052.stdout:client9859 2024-09-10T08:42:41.550 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:41.550 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:41.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:41.586 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-10T08:42:41.668 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:42:41.668 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:42:41.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:41.745 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-10T08:42:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:6+0 records in 2024-09-10T08:42:41.908 INFO:teuthology.orchestra.run.smithi052.stderr:6+0 records out 2024-09-10T08:42:41.909 INFO:teuthology.orchestra.run.smithi052.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0868541 s, 72.4 MB/s 2024-09-10T08:42:41.910 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:42:41.914 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.009 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.010 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-10T08:42:42.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-10T08:42:42.012 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-09-10T08:42:42.014 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.015 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-10T08:42:42.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:42:42.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon down mkfs grace = 300 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on pool no app = False 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-10T08:42:42.018 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-09-10T08:42:42.019 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds cache max size = 1000 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds log max segments = 1 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = False 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.020 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.021 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.022 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:42:42.023 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-10T08:42:42.024 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-10T08:42:42.026 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:42:42.027 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-10T08:42:42.028 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:42:42.029 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on pool no app = False 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-10T08:42:42.030 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-10T08:42:42.031 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds cache max size = 1000 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds log max segments = 1 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = False 2024-09-10T08:42:42.032 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:42:42.033 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.033 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:42:42.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.145 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-10T08:42:42.146 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:42:42.147 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-10T08:42:42.148 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.149 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-10T08:42:42.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-10T08:42:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:42:42.152 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-10T08:42:42.153 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:42:42.154 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.154 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-10T08:42:42.154 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.154 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-10T08:42:42.154 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.155 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon down mkfs grace = 300 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on pool no app = False 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-10T08:42:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = "" 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.157 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2024-09-10T08:42:42.158 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds cache max size = 1000 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = False 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds log max segments = 1 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = False 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.159 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.160 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2024-09-10T08:42:42.161 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2024-09-10T08:42:42.162 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:42:42.163 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2024-09-10T08:42:42.164 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.52,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 4eb61a63-2a53-4336-9780-430e4b9fd90b 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:42:42.165 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.166 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2024-09-10T08:42:42.167 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.168 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2024-09-10T08:42:42.169 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.170 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: mon down mkfs grace = 300 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on pool no app = False 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2024-09-10T08:42:42.171 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.172 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout: mds cache max size = 1000 2024-09-10T08:42:42.173 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = False 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: mds log max segments = 1 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = False 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2024-09-10T08:42:42.174 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> import json 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> import sys 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:42:42.176 DEBUG:teuthology.orchestra.run.smithi052:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> except OSError as e: 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> sys.exit(e.errno) 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> print(json.dumps( 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> indent=2)) 2024-09-10T08:42:42.177 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:42:42.280 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:42.280 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mode": 33188, 2024-09-10T08:42:42.280 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ino": 1099511627777, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_dev": 43, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_nlink": 1, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_uid": 1000, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_gid": 1333, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_size": 6291456, 2024-09-10T08:42:42.281 INFO:teuthology.orchestra.run.smithi052.stdout: "st_atime": 1725957761.8200862, 2024-09-10T08:42:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mtime": 1725957761.854086, 2024-09-10T08:42:42.282 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ctime": 1725957761.854086 2024-09-10T08:42:42.282 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:42.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:42:42.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:42:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 Processor -- start 2024-09-10T08:42:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 -- start start 2024-09-10T08:42:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3a0c15e440 0x7f3a0c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0b6710 0x7f3a0c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a0c0d3990 con 0x7f3a0c0cf450 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3a0c0d3c70 con 0x7f3a0c15e440 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a10e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0c0d3f50 con 0x7f3a0c0b6710 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a0aa00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a0c0cf450 0x7f3a0c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:59626/0 (socket says 172.21.15.52:59626) 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.490+0000 7f3a0aa00640 1 -- 172.21.15.52:0/3887313464 learned_addr learned my addr 172.21.15.52:0/3887313464 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0b400640 1 --2- 172.21.15.52:0/3887313464 >> v2:172.21.15.176:3300/0 conn(0x7f3a0c15e440 0x7f3a0c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0be00640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0b6710 0x7f3a0c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029626490 0 0) 0x7f3a0c0d3990 con 0x7f3a0c0cf450 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39f0003520 con 0x7f3a0c0cf450 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0b400640 1 -- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0b6710 msgr2=0x7f3a0c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0b400640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0b6710 0x7f3a0c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0b400640 1 -- 172.21.15.52:0/3887313464 >> v1:172.21.15.52:6789/0 conn(0x7f3a0c0cf450 legacy=0x7f3a0c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2824668529 0 0) 0x7f39f0003520 con 0x7f3a0c0cf450 2024-09-10T08:42:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.491+0000 7f3a0b400640 1 -- 172.21.15.52:0/3887313464 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c0d4230 con 0x7f3a0c15e440 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.492+0000 7f3a0b400640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0d3240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0097a0 tx=0x7f39fc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b085dcfd86e5492 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.492+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc037070 con 0x7f3a0c15e440 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.492+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc02ac30 con 0x7f3a0c15e440 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.492+0000 7f3a0a000640 1 -- 172.21.15.52:0/3887313464 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8001670 con 0x7f3a0c15e440 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 -- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 msgr2=0x7f3a0c0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0d3240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0097a0 tx=0x7f39fc02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 -- 172.21.15.52:0/3887313464 shutdown_connections 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0b6710 0x7f3a0c0b7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 --2- 172.21.15.52:0/3887313464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0d3240 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 -- 172.21.15.52:0/3887313464 >> 172.21.15.52:0/3887313464 conn(0x7f3a0c067f80 msgr2=0x7f3a0c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 -- 172.21.15.52:0/3887313464 shutdown_connections 2024-09-10T08:42:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.493+0000 7f3a10e00640 1 -- 172.21.15.52:0/3887313464 wait complete. 2024-09-10T08:42:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.496+0000 7f3a10e00640 1 Processor -- start 2024-09-10T08:42:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.496+0000 7f3a10e00640 1 -- start start 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0cf450 0x7f3a0c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c0b76c0 con 0x7f3a0c0b6710 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c0b7540 con 0x7f3a0c15e440 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0c0b80a0 con 0x7f3a0c0cf450 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50132/0 (socket says 172.21.15.52:50132) 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 -- 172.21.15.52:0/4091340250 learned_addr learned my addr 172.21.15.52:0/4091340250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0aa00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0cf450 0x7f3a0c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0be00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 -- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0cf450 msgr2=0x7f3a0c14c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0cf450 0x7f3a0c14c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 -- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 msgr2=0x7f3a0c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 -- 172.21.15.52:0/4091340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c0cbb90 con 0x7f3a0c0b6710 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a0b400640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098c0 tx=0x7f39fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc041020 con 0x7f3a0c0b6710 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39fc03d620 con 0x7f3a0c0b6710 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc037040 con 0x7f3a0c0b6710 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0c0c8080 con 0x7f3a0c0b6710 2024-09-10T08:42:42.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.497+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0c0c9af0 con 0x7f3a0c0b6710 2024-09-10T08:42:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.498+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0c0b7b60 con 0x7f3a0c0b6710 2024-09-10T08:42:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.499+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39fc044020 con 0x7f3a0c0b6710 2024-09-10T08:42:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.500+0000 7f3a03400640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 0x7f39ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.500+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f39fc0ab400 con 0x7f3a0c0b6710 2024-09-10T08:42:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.500+0000 7f3a0aa00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 0x7f39ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.501+0000 7f3a0aa00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 0x7f39ec06e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001200 tx=0x7f39f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:42.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.504+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39fc04b030 con 0x7f3a0c0b6710 2024-09-10T08:42:42.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.725+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a0c0d3540 con 0x7f3a0c0b6710 2024-09-10T08:42:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.725+0000 7f3a03400640 1 -- 172.21.15.52:0/4091340250 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f39fc079da0 con 0x7f3a0c0b6710 2024-09-10T08:42:42.726 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:42:42.726 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:42:42.726 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:42:42.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 msgr2=0x7f39ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 0x7f39ec06e2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f39f8001200 tx=0x7f39f8009040 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 msgr2=0x7f3a0c0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0098c0 tx=0x7f39fc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 shutdown_connections 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f39ec06be30 0x7f39ec06e2f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a0c15e440 0x7f3a0c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3a0c0cf450 0x7f3a0c14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 --2- 172.21.15.52:0/4091340250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a0c0b6710 0x7f3a0c0cb650 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 >> 172.21.15.52:0/4091340250 conn(0x7f3a0c067f80 msgr2=0x7f3a0c0d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 shutdown_connections 2024-09-10T08:42:42.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:42.728+0000 7f3a10e00640 1 -- 172.21.15.52:0/4091340250 wait complete. 2024-09-10T08:42:42.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T08:42:42.927 INFO:teuthology.orchestra.run.smithi052.stdout:{"message":"","return_code":0} 2024-09-10T08:42:42.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T08:42:42.927 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-10T08:42:43.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.005+0000 7f2d36aacf40 1 Processor -- start 2024-09-10T08:42:43.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 -- start start 2024-09-10T08:42:43.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe4b8c0 0x5627efdabb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe561d0 0x5627efe56650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5627efdb01e0 con 0x5627efdcb2d0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5627efd24b30 con 0x5627efe561d0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5627efdb0480 con 0x5627efe4b8c0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50138/0 (socket says 172.21.15.52:50138) 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 -- 172.21.15.52:0/823069072 learned_addr learned my addr 172.21.15.52:0/823069072 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33c00640 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe4b8c0 0x5627efdabb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d34600640 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe561d0 0x5627efe56650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 -- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe4b8c0 msgr2=0x5627efdabb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe4b8c0 0x5627efdabb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 -- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe561d0 msgr2=0x5627efe56650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe561d0 0x5627efe56650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 -- 172.21.15.52:0/823069072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627efe57a60 con 0x5627efdcb2d0 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.007+0000 7f2d33200640 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009810 tx=0x7f2d20005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e146914dbac4621d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d31e00640 1 -- 172.21.15.52:0/823069072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20008690 con 0x5627efdcb2d0 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d31e00640 1 -- 172.21.15.52:0/823069072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2001a070 con 0x5627efdcb2d0 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d31e00640 1 -- 172.21.15.52:0/823069072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20008a30 con 0x5627efdcb2d0 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 -- 172.21.15.52:0/823069072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 msgr2=0x5627efdcb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009810 tx=0x7f2d20005a00 comp rx=0 tx=0).stop 2024-09-10T08:42:43.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 -- 172.21.15.52:0/823069072 shutdown_connections 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe561d0 0x5627efe56650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efdcb750 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/823069072 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe4b8c0 0x5627efdabb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 -- 172.21.15.52:0/823069072 >> 172.21.15.52:0/823069072 conn(0x5627efdad290 msgr2=0x5627efdad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 -- 172.21.15.52:0/823069072 shutdown_connections 2024-09-10T08:42:43.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.008+0000 7f2d36aacf40 1 -- 172.21.15.52:0/823069072 wait complete. 2024-09-10T08:42:43.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.009+0000 7f2d36aacf40 1 Processor -- start 2024-09-10T08:42:43.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.009+0000 7f2d36aacf40 1 -- start start 2024-09-10T08:42:43.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efe47cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe4b8c0 0x5627efe565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe561d0 0x5627efe56af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5627efe57d30 con 0x5627efdcb2d0 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5627efdc7770 con 0x5627efe4b8c0 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d36aacf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5627efdac620 con 0x5627efe561d0 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d33c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efe47cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d33c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efe47cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50142/0 (socket says 172.21.15.52:50142) 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.010+0000 7f2d33c00640 1 -- 172.21.15.52:0/1774071381 learned_addr learned my addr 172.21.15.52:0/1774071381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33200640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe4b8c0 0x5627efe565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d34600640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe561d0 0x5627efe56af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 -- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe561d0 msgr2=0x5627efe56af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5627efe561d0 0x5627efe56af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 -- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe4b8c0 msgr2=0x5627efe565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5627efe4b8c0 0x5627efe565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 -- 172.21.15.52:0/1774071381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627efe545c0 con 0x5627efdcb2d0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d33c00640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efe47cb0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009760 tx=0x7f2d24003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d30a00640 1 -- 172.21.15.52:0/1774071381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24068020 con 0x5627efdcb2d0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d30a00640 1 -- 172.21.15.52:0/1774071381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2404f960 con 0x5627efdcb2d0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d30a00640 1 -- 172.21.15.52:0/1774071381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2404fd50 con 0x5627efdcb2d0 2024-09-10T08:42:43.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627efe54320 con 0x5627efdcb2d0 2024-09-10T08:42:43.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.011+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627efdcb960 con 0x5627efdcb2d0 2024-09-10T08:42:43.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.013+0000 7f2d30a00640 1 -- 172.21.15.52:0/1774071381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d2406b020 con 0x5627efdcb2d0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.014+0000 7f2d30a00640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d1406a840 0x7f2d1406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.014+0000 7f2d30a00640 1 -- 172.21.15.52:0/1774071381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f2d240cd690 con 0x5627efdcb2d0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.014+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x5627efdac140 0x5627efeecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.014+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e195) -- 0x5627efdada80 con 0x5627efdac140 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.014+0000 7f2d33200640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d1406a840 0x7f2d1406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.015+0000 7f2d34600640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x5627efdac140 0x5627efeecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.015+0000 7f2d34600640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x5627efdac140 0x5627efeecc30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.015+0000 7f2d33200640 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d1406a840 0x7f2d1406cd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2d20017040 tx=0x7f2d20008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d34600640 1 -- 172.21.15.52:0/1774071381 <== osd.1 v2:172.21.15.52:6800/2452593582 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v195'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2d2c0017b0 con 0x5627efdac140 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x5627efdac140 msgr2=0x5627efeecc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x5627efdac140 0x5627efeecc30 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d1406a840 msgr2=0x7f2d1406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2d1406a840 0x7f2d1406cd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2d20017040 tx=0x7f2d20008000 comp rx=0 tx=0).stop 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 msgr2=0x5627efe47cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 --2- 172.21.15.52:0/1774071381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5627efdcb2d0 0x5627efe47cb0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009760 tx=0x7f2d24003020 comp rx=0 tx=0).stop 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d34600640 1 -- 172.21.15.52:0/1774071381 reap_dead start 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 shutdown_connections 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 >> 172.21.15.52:0/1774071381 conn(0x5627efdad290 msgr2=0x5627efe488a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 shutdown_connections 2024-09-10T08:42:43.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.017+0000 7f2d36aacf40 1 -- 172.21.15.52:0/1774071381 wait complete. 2024-09-10T08:42:43.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:43.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-10T08:42:43.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.182+0000 7fa8fdc00640 1 Processor -- start 2024-09-10T08:42:43.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.182+0000 7fa8fdc00640 1 -- start start 2024-09-10T08:42:43.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fdc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8f80d3800 0x7fa8f8162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fdc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8f80d3c40 0x7fa8f81628c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fdc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f80d41e0 con 0x7fa8f8161e10 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fdc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f80d2ad0 con 0x7fa8f80d3800 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fdc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f80b84e0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8efe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa8f80d3800 0x7fa8f8162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8f80d3c40 0x7fa8f81628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8f80d3c40 0x7fa8f81628c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:34480/0 (socket says 172.21.15.52:34480) 2024-09-10T08:42:43.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 -- 172.21.15.52:0/3633074043 learned_addr learned my addr 172.21.15.52:0/3633074043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 -- 172.21.15.52:0/3633074043 >> v2:172.21.15.52:3300/0 conn(0x7fa8f80d3800 msgr2=0x7fa8f8162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 --2- 172.21.15.52:0/3633074043 >> v2:172.21.15.52:3300/0 conn(0x7fa8f80d3800 0x7fa8f8162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 -- 172.21.15.52:0/3633074043 >> v1:172.21.15.176:6789/0 conn(0x7fa8f8161e10 legacy=0x7fa8f80cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 -- 172.21.15.52:0/3633074043 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80d2d20 con 0x7fa8f80d3c40 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.184+0000 7fa8fd200640 1 --2- 172.21.15.52:0/3633074043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f80d3c40 0x7fa8f81628c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806d850 tx=0x7fa8f002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182ae9d2f20eea6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8f7400640 1 -- 172.21.15.52:0/3633074043 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0036070 con 0x7fa8f80d3c40 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8f7400640 1 -- 172.21.15.52:0/3633074043 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0031600 con 0x7fa8f80d3c40 2024-09-10T08:42:43.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8f7400640 1 -- 172.21.15.52:0/3633074043 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00319d0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3633074043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f80d3c40 msgr2=0x7fa8f81628c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3633074043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f80d3c40 0x7fa8f81628c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa8f806d850 tx=0x7fa8f002a6a0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3633074043 shutdown_connections 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3633074043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f80d3c40 0x7fa8f81628c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3633074043 >> v2:172.21.15.52:3300/0 conn(0x7fa8f80d3800 0x7fa8f8162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3633074043 >> 172.21.15.52:0/3633074043 conn(0x7fa8f80d1000 msgr2=0x7fa8f80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.185+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3633074043 shutdown_connections 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.186+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3633074043 wait complete. 2024-09-10T08:42:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.187+0000 7fa8fdc00640 1 Processor -- start 2024-09-10T08:42:43.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.187+0000 7fa8fdc00640 1 -- start start 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8f80d3800 0x7fa8f814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 0x7fa8f814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80b74d0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80d32e0 con 0x7fa8f8161e10 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f80b7650 con 0x7fa8f80d3800 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50168/0 (socket says 172.21.15.52:50168) 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 -- 172.21.15.52:0/3445999956 learned_addr learned my addr 172.21.15.52:0/3445999956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8f80d3800 0x7fa8f814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fd200640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 0x7fa8f814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 -- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8f80d3800 msgr2=0x7fa8f814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8f80d3800 0x7fa8f814a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 -- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 msgr2=0x7fa8f814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 0x7fa8f814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 -- 172.21.15.52:0/3445999956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80ceaa0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fd200640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 0x7fa8f814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8efe00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000e9b0 tx=0x7fa8e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8f4c00640 1 -- 172.21.15.52:0/3445999956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0017070 con 0x7fa8f80d3c40 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8f4c00640 1 -- 172.21.15.52:0/3445999956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e000c9a0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8f4c00640 1 -- 172.21.15.52:0/3445999956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cd90 con 0x7fa8f80d3c40 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f80cdf20 con 0x7fa8f80d3c40 2024-09-10T08:42:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.189+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f80ce4e0 con 0x7fa8f80d3c40 2024-09-10T08:42:43.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.192+0000 7fa8f4c00640 1 -- 172.21.15.52:0/3445999956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8e001a070 con 0x7fa8f80d3c40 2024-09-10T08:42:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.192+0000 7fa8f4c00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 0x7fa8d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.193+0000 7fa8f4c00640 1 -- 172.21.15.52:0/3445999956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fa8e008ae60 con 0x7fa8f80d3c40 2024-09-10T08:42:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.193+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 0x7fa8d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.193+0000 7fa9021d0740 1 Processor -- start 2024-09-10T08:42:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.193+0000 7fa9021d0740 1 -- start start 2024-09-10T08:42:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.193+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 0x7fa8d406e320 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8007fd0 tx=0x7fa8e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa585410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa56b520 0x5558fa569d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558fa5312a0 con 0x5558fa5b59e0 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558fa4d3a10 con 0x5558fa56b520 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558fa47b910 con 0x5558fa585030 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa8fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa8fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50172/0 (socket says 172.21.15.52:50172) 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa8fd200640 1 -- 172.21.15.52:0/1161464288 learned_addr learned my addr 172.21.15.52:0/1161464288 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa585410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.194+0000 7fa8efe00640 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa56b520 0x5558fa569d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 -- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 msgr2=0x5558fa585410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa585410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 -- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa56b520 msgr2=0x5558fa569d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa56b520 0x5558fa569d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 -- 172.21.15.52:0/1161464288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fa1ca470 con 0x5558fa5b59e0 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8fd200640 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009f10 tx=0x7fa8f002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee476adb6c87b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8ecc00640 1 -- 172.21.15.52:0/1161464288 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0036040 con 0x5558fa5b59e0 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8ecc00640 1 -- 172.21.15.52:0/1161464288 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0031700 con 0x5558fa5b59e0 2024-09-10T08:42:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.195+0000 7fa8ecc00640 1 -- 172.21.15.52:0/1161464288 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0031ad0 con 0x5558fa5b59e0 2024-09-10T08:42:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 -- 172.21.15.52:0/1161464288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 msgr2=0x5558fa5b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009f10 tx=0x7fa8f002e000 comp rx=0 tx=0).stop 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 -- 172.21.15.52:0/1161464288 shutdown_connections 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5b59e0 0x5558fa5b5f30 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa56b520 0x5558fa569d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 --2- 172.21.15.52:0/1161464288 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa585410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 -- 172.21.15.52:0/1161464288 >> 172.21.15.52:0/1161464288 conn(0x5558fa56bf50 msgr2=0x5558fa5b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 -- 172.21.15.52:0/1161464288 shutdown_connections 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.196+0000 7fa9021d0740 1 -- 172.21.15.52:0/1161464288 wait complete. 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.197+0000 7fa9021d0740 1 -- start start 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.197+0000 7fa9021d0740 1 Processor -- start 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa577dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5b59e0 0x5558fa5840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558fa48eb60 con 0x5558fa5c7ed0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x5558fa4cf9d0 con 0x5558fa5b59e0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558fa56a480 con 0x5558fa585030 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 10 client.0 _ll_register_callbacks cb 0x5558fa45a530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50180/0 (socket says 172.21.15.52:50180) 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 -- 172.21.15.52:0/2235646923 learned_addr learned my addr 172.21.15.52:0/2235646923 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa577dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8efe00640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5b59e0 0x5558fa5840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 -- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 msgr2=0x5558fa577dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa577dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 -- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5b59e0 msgr2=0x5558fa5840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5b59e0 0x5558fa5840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 -- 172.21.15.52:0/2235646923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fa2ae7e0 con 0x5558fa5c7ed0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8fd200640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009590 tx=0x7fa8f0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0ccab9fd738b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8e5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0049070 con 0x5558fa5c7ed0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fa8f0031ac0 con 0x5558fa5c7ed0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8f0031700 con 0x5558fa5c7ed0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fa8f0053050 con 0x5558fa5c7ed0 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 10 client.10752 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:43.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x5558fa30ef70 con 0x5558fa5c7ed0 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.199+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0031700 con 0x5558fa5c7ed0 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7fa8f0056020 con 0x5558fa5c7ed0 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 10 client.10752 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 10 client.10752 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 20 client.10752 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c4db0 0x5558fa5c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 4 client.10752 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:42:43.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558fa4e1140 con 0x5558fa5c4db0 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c4db0 0x5558fa5c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c4db0 0x5558fa5c51c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2510516810606961 server_cookie=c5f317769d49c74a in_seq=0 out_seq=0 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.200+0000 7fa8e5600640 10 client.10752 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa8e5600640 1 -- 172.21.15.52:0/2235646923 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558fa4e1140 con 0x5558fa5c4db0 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa8e5600640 10 client.10752 handle_command_reply: tid=0 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 client.10752 shutdown 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 msgr2=0x5558fa5c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009590 tx=0x7fa8f0004ab0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 shutdown_connections 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c4db0 0x5558fa5c51c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa5c7ed0 0x5558fa5c8350 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5b59e0 0x5558fa5840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2235646923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa585030 0x5558fa577dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa8e5600640 0 client.10752 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.201+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 >> 172.21.15.52:0/2235646923 conn(0x5558fa56b520 msgr2=0x5558fa56a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.202+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 shutdown_connections 2024-09-10T08:42:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.202+0000 7fa9021d0740 1 -- 172.21.15.52:0/2235646923 wait complete. 2024-09-10T08:42:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.202+0000 7fa9021d0740 20 client.10752 trim_cache size 0 max 16384 2024-09-10T08:42:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.220+0000 7fa9021d0740 1 Processor -- start 2024-09-10T08:42:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.220+0000 7fa9021d0740 1 -- start start 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f8200c80 con 0x5558fa585030 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f81ffc80 con 0x5558fa5c7ed0 2024-09-10T08:42:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f81f7e70 con 0x5558fa5b59e0 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa8f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa8f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50192/0 (socket says 172.21.15.52:50192) 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa8f7e00640 1 -- 172.21.15.52:0/25117868 learned_addr learned my addr 172.21.15.52:0/25117868 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa8efe00640 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.221+0000 7fa8fd200640 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 -- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 msgr2=0x5558fa5ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 -- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 msgr2=0x5558fa5ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 -- 172.21.15.52:0/25117868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fa1a6170 con 0x5558fa585030 2024-09-10T08:42:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8007de0 tx=0x7fa8e8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b23bff28390eddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8e7e00640 1 -- 172.21.15.52:0/25117868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80038c0 con 0x5558fa585030 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8e7e00640 1 -- 172.21.15.52:0/25117868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e8003a60 con 0x5558fa585030 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.222+0000 7fa8e7e00640 1 -- 172.21.15.52:0/25117868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8003c10 con 0x5558fa585030 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- 172.21.15.52:0/25117868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 msgr2=0x5558fa5732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8007de0 tx=0x7fa8e8011000 comp rx=0 tx=0).stop 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- 172.21.15.52:0/25117868 shutdown_connections 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 --2- 172.21.15.52:0/25117868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5732b0 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- 172.21.15.52:0/25117868 >> 172.21.15.52:0/25117868 conn(0x5558fa56b520 msgr2=0x5558fa585410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- 172.21.15.52:0/25117868 shutdown_connections 2024-09-10T08:42:43.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- 172.21.15.52:0/25117868 wait complete. 2024-09-10T08:42:43.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.223+0000 7fa9021d0740 1 -- start start 2024-09-10T08:42:43.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.224+0000 7fa9021d0740 1 Processor -- start 2024-09-10T08:42:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558fa5790c0 con 0x5558fa585030 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f81ff680 con 0x5558fa5c7ed0 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x5558fa40aaf0 con 0x5558fa5b59e0 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa9021d0740 10 client.0 _ll_register_callbacks cb 0x7fa8e0004640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50200/0 (socket says 172.21.15.52:50200) 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 -- 172.21.15.52:0/2120397423 learned_addr learned my addr 172.21.15.52:0/2120397423 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 -- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 msgr2=0x5558fa5b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 -- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 msgr2=0x5558fa5b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.225+0000 7fa8f7e00640 1 -- 172.21.15.52:0/2120397423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fa5b8490 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8f7e00640 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009010 tx=0x7fa8e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba0b9a9db795fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80038c0 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fa8e800e870 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8e8003a60 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fa8e803b050 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 10 client.10758 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x5558fa633350 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e8003a60 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7fa8e803e020 con 0x5558fa585030 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 10 client.10758 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 10 client.10758 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:42:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 20 client.10758 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.226+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c78e0 0x5558fa5b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.227+0000 7fa9021d0740 4 client.10758 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.227+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x5558fa578950 con 0x5558fa5c78e0 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.227+0000 7fa8efe00640 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c78e0 0x5558fa5b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.227+0000 7fa8efe00640 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c78e0 0x5558fa5b5dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc53b5c7c63d011 server_cookie=8db0c022676b8e5b in_seq=0 out_seq=0 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.227+0000 7fa8e5600640 10 client.10758 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa8e5600640 1 -- 172.21.15.52:0/2120397423 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5558fa578950 con 0x5558fa5c78e0 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa8e5600640 10 client.10758 handle_command_reply: tid=0 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 client.10758 shutdown 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 msgr2=0x5558fa5b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009010 tx=0x7fa8e8000bc0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 shutdown_connections 2024-09-10T08:42:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x5558fa5c78e0 0x5558fa5b5dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5558fa5c7ed0 0x5558fa5b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5558fa5b59e0 0x5558fa5b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 --2- 172.21.15.52:0/2120397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558fa585030 0x5558fa5b37c0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 >> 172.21.15.52:0/2120397423 conn(0x5558fa56b520 msgr2=0x5558fa5d87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.232 INFO:tasks.ceph.mds.c.smithi052.stderr:2024-09-10T08:42:43.228+0000 7f0875a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-10T08:42:41.849085+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={9859=0-12582912@1} caps={9859=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=9859 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5555ac6b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa8e5600640 0 client.10758 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 shutdown_connections 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.228+0000 7fa9021d0740 1 -- 172.21.15.52:0/2120397423 wait complete. 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa9021d0740 20 client.10758 trim_cache size 0 max 16384 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:43.233 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-10T08:42:43.234 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "1d4a622a-e7c1-47a3-9d76-330678a08749", 2024-09-10T08:42:43.234 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-10T08:42:43.234 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 msgr2=0x7fa8d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 0x7fa8d406e320 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8007fd0 tx=0x7fa8e8009040 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 msgr2=0x7fa8f80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000e9b0 tx=0x7fa8e000ee70 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 shutdown_connections 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa8d406be60 0x7fa8d406e320 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8f8161e10 0x7fa8f814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8f80d3c40 0x7fa8f80cb5c0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 --2- 172.21.15.52:0/3445999956 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8f80d3800 0x7fa8f814a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 >> 172.21.15.52:0/3445999956 conn(0x7fa8f80d1000 msgr2=0x7fa8f80b9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 shutdown_connections 2024-09-10T08:42:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.229+0000 7fa8fdc00640 1 -- 172.21.15.52:0/3445999956 wait complete. 2024-09-10T08:42:43.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:42:43.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-10T08:42:43.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 Processor -- start 2024-09-10T08:42:43.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 -- start start 2024-09-10T08:42:43.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff57c06bfd0 0x7ff57c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff57c0b3350 0x7ff57c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff57c06c8f0 con 0x7ff57c0b38a0 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c0b78a0 con 0x7ff57c0b3350 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff583400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7ff57c0cffb0 con 0x7ff57c06bfd0 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff57be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff57c0b3350 0x7ff57c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff57be00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff57c0b3350 0x7ff57c1623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50204/0 (socket says 172.21.15.52:50204) 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff57be00640 1 -- 172.21.15.52:0/1379093599 learned_addr learned my addr 172.21.15.52:0/1379093599 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.406+0000 7ff580a00640 1 --2- 172.21.15.52:0/1379093599 >> v2:172.21.15.176:3300/0 conn(0x7ff57c06bfd0 0x7ff57c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.408+0000 7ff57be00640 1 -- 172.21.15.52:0/1379093599 >> v2:172.21.15.176:3300/0 conn(0x7ff57c06bfd0 msgr2=0x7ff57c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.408+0000 7ff57be00640 1 --2- 172.21.15.52:0/1379093599 >> v2:172.21.15.176:3300/0 conn(0x7ff57c06bfd0 0x7ff57c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.408+0000 7ff57be00640 1 -- 172.21.15.52:0/1379093599 >> v1:172.21.15.176:6789/0 conn(0x7ff57c0b38a0 legacy=0x7ff57c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.408+0000 7ff57be00640 1 -- 172.21.15.52:0/1379093599 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c0cf710 con 0x7ff57c0b3350 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff57be00640 1 --2- 172.21.15.52:0/1379093599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b3350 0x7ff57c1623a0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff57c06b0d0 tx=0x7ff56802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2caa18297388e99c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff57b400640 1 -- 172.21.15.52:0/1379093599 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568037070 con 0x7ff57c0b3350 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff57b400640 1 -- 172.21.15.52:0/1379093599 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff568032640 con 0x7ff57c0b3350 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff57b400640 1 -- 172.21.15.52:0/1379093599 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568032a10 con 0x7ff57c0b3350 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 -- 172.21.15.52:0/1379093599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b3350 msgr2=0x7ff57c1623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 --2- 172.21.15.52:0/1379093599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b3350 0x7ff57c1623a0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7ff57c06b0d0 tx=0x7ff56802a300 comp rx=0 tx=0).stop 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 -- 172.21.15.52:0/1379093599 shutdown_connections 2024-09-10T08:42:43.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 --2- 172.21.15.52:0/1379093599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b3350 0x7ff57c1623a0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 --2- 172.21.15.52:0/1379093599 >> v2:172.21.15.176:3300/0 conn(0x7ff57c06bfd0 0x7ff57c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 -- 172.21.15.52:0/1379093599 >> 172.21.15.52:0/1379093599 conn(0x7ff57c0d11c0 msgr2=0x7ff57c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 -- 172.21.15.52:0/1379093599 shutdown_connections 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.409+0000 7ff583400640 1 -- 172.21.15.52:0/1379093599 wait complete. 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.411+0000 7ff583400640 1 Processor -- start 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.411+0000 7ff583400640 1 -- start start 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c06bfd0 0x7ff57c155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c0b3350 0x7ff57c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0d2400 con 0x7ff57c0b38a0 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c0cfcd0 con 0x7ff57c0b3350 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff583400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c06cd50 con 0x7ff57c06bfd0 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.412+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff57be00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c0b3350 0x7ff57c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff580a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c06bfd0 0x7ff57c155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50216/0 (socket says 172.21.15.52:50216) 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 -- 172.21.15.52:0/1403272619 learned_addr learned my addr 172.21.15.52:0/1403272619 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 -- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c06bfd0 msgr2=0x7ff57c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c06bfd0 0x7ff57c155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 -- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c0b3350 msgr2=0x7ff57c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c0b3350 0x7ff57c0cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 -- 172.21.15.52:0/1403272619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c1561d0 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.413+0000 7ff581400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7ff57400b970 tx=0x7ff57400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.414+0000 7ff578c00640 1 -- 172.21.15.52:0/1403272619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574019070 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.414+0000 7ff578c00640 1 -- 172.21.15.52:0/1403272619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57400cb40 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.414+0000 7ff578c00640 1 -- 172.21.15.52:0/1403272619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574014440 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.414+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c0ce030 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.414+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c15efd0 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.416+0000 7ff578c00640 1 -- 172.21.15.52:0/1403272619 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff57401c070 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff578c00640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 0x7ff55c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff578c00640 1 -- 172.21.15.52:0/1403272619 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7ff57408aab0 con 0x7ff57c0b38a0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff580a00640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 0x7ff55c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 Processor -- start 2024-09-10T08:42:43.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 -- start start 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff580a00640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 0x7ff55c06e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff570006fd0 tx=0x7ff570008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e3245cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e3245d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e3237a660 con 0x564e32412480 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564e32322680 con 0x564e3242c420 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564e32376620 con 0x564e3242c800 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50220/0 (socket says 172.21.15.52:50220) 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.417+0000 7ff581400640 1 -- 172.21.15.52:0/384345311 learned_addr learned my addr 172.21.15.52:0/384345311 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff57be00640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e3245d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 -- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 msgr2=0x564e3245d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff580a00640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e3245cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e3245d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 -- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 msgr2=0x564e3245cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e3245cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 -- 172.21.15.52:0/384345311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e321577d0 con 0x564e32412480 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff580a00640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e3245cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff581400640 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7ff574061370 tx=0x7ff574058800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377cdd0a6f3500c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff56d200640 1 -- 172.21.15.52:0/384345311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574087070 con 0x564e32412480 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff56d200640 1 -- 172.21.15.52:0/384345311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574057070 con 0x564e32412480 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.419+0000 7ff56d200640 1 -- 172.21.15.52:0/384345311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574061410 con 0x564e32412480 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 -- 172.21.15.52:0/384345311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 msgr2=0x564e3245d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7ff574061370 tx=0x7ff574058800 comp rx=0 tx=0).stop 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 -- 172.21.15.52:0/384345311 shutdown_connections 2024-09-10T08:42:43.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e32412480 0x564e3245d740 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e3245d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 --2- 172.21.15.52:0/384345311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e3245cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 -- 172.21.15.52:0/384345311 >> 172.21.15.52:0/384345311 conn(0x564e32413220 msgr2=0x564e3245b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 -- 172.21.15.52:0/384345311 shutdown_connections 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.420+0000 7ff58628b740 1 -- 172.21.15.52:0/384345311 wait complete. 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.421+0000 7ff58628b740 1 -- start start 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.421+0000 7ff58628b740 1 Processor -- start 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e32441bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32451de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e324113e0 con 0x564e3246f180 2024-09-10T08:42:43.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x564e323034c0 con 0x564e3242c420 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564e324116c0 con 0x564e3242c800 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff58628b740 10 client.0 _ll_register_callbacks cb 0x564e32372e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50224/0 (socket says 172.21.15.52:50224) 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 -- 172.21.15.52:0/3713935668 learned_addr learned my addr 172.21.15.52:0/3713935668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff580a00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e32441bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff57be00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32451de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 -- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 msgr2=0x564e32451de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32451de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 -- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 msgr2=0x564e32441bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e32441bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff581400640 1 -- 172.21.15.52:0/3713935668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e3208d3f0 con 0x564e3246f180 2024-09-10T08:42:43.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.422+0000 7ff580a00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e32441bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff57be00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32451de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff581400640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7ff574058a70 tx=0x7ff57400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea33c50130ca37a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574074070 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7ff5740581c0 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff574057070 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7ff57407f050 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff58628b740 10 client.10770 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x564e3204d0f0 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574057070 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.423+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7ff574082020 con 0x564e3246f180 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 10 client.10770 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:43.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 10 client.10770 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 20 client.10770 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e32458b50 0x564e32458f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 4 client.10770 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e32387d90 con 0x564e32458b50 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff580a00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e32458b50 0x564e32458f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff580a00640 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e32458b50 0x564e32458f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4243392b8db113a4 server_cookie=22264a5af71e73fc in_seq=0 out_seq=0 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.424+0000 7ff561600640 10 client.10770 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff561600640 1 -- 172.21.15.52:0/3713935668 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e32387d90 con 0x564e32458b50 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff561600640 10 client.10770 handle_command_reply: tid=0 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 client.10770 shutdown 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 msgr2=0x564e3246f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7ff574058a70 tx=0x7ff57400bf60 comp rx=0 tx=0).stop 2024-09-10T08:42:43.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 shutdown_connections 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e32458b50 0x564e32458f60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e3246f600 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32451de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 --2- 172.21.15.52:0/3713935668 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e32441bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff561600640 0 client.10770 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 >> 172.21.15.52:0/3713935668 conn(0x564e32412480 msgr2=0x564e32459ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 shutdown_connections 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 1 -- 172.21.15.52:0/3713935668 wait complete. 2024-09-10T08:42:43.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.425+0000 7ff58628b740 20 client.10770 trim_cache size 0 max 16384 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.444+0000 7ff58628b740 1 Processor -- start 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.444+0000 7ff58628b740 1 -- start start 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c800 0x564e32480650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3246f180 0x564e32480b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c200e60 con 0x564e3242c420 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c1ffef0 con 0x564e3242c800 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7ff57c161c60 con 0x564e3246f180 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff580a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff580a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50234/0 (socket says 172.21.15.52:50234) 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.445+0000 7ff580a00640 1 -- 172.21.15.52:0/3497951052 learned_addr learned my addr 172.21.15.52:0/3497951052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff581400640 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3246f180 0x564e32480b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff57be00640 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c800 0x564e32480650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 -- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3246f180 msgr2=0x564e32480b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3246f180 0x564e32480b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 -- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c800 msgr2=0x564e32480650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c800 0x564e32480650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 -- 172.21.15.52:0/3497951052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e32477130 con 0x564e3242c420 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff580a00640 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7ff570007480 tx=0x7ff570016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c8ab71bdbf5779 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff563e00640 1 -- 172.21.15.52:0/3497951052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570010dc0 con 0x564e3242c420 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff563e00640 1 -- 172.21.15.52:0/3497951052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570014430 con 0x564e3242c420 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.446+0000 7ff563e00640 1 -- 172.21.15.52:0/3497951052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5700147e0 con 0x564e3242c420 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 -- 172.21.15.52:0/3497951052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 msgr2=0x564e32410150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7ff570007480 tx=0x7ff570016000 comp rx=0 tx=0).stop 2024-09-10T08:42:43.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 -- 172.21.15.52:0/3497951052 shutdown_connections 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3246f180 0x564e32480b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c800 0x564e32480650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 --2- 172.21.15.52:0/3497951052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3242c420 0x564e32410150 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 -- 172.21.15.52:0/3497951052 >> 172.21.15.52:0/3497951052 conn(0x564e32412480 msgr2=0x564e32459ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 -- 172.21.15.52:0/3497951052 shutdown_connections 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.447+0000 7ff58628b740 1 -- 172.21.15.52:0/3497951052 wait complete. 2024-09-10T08:42:43.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.448+0000 7ff58628b740 1 -- start start 2024-09-10T08:42:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.448+0000 7ff58628b740 1 Processor -- start 2024-09-10T08:42:43.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e324da720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32440dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e3237a660 con 0x564e3246f180 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c1ff8a0 con 0x564e3242c420 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x564e32476720 con 0x564e3242c800 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff58628b740 10 client.0 _ll_register_callbacks cb 0x7ff574085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50238/0 (socket says 172.21.15.52:50238) 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 -- 172.21.15.52:0/3391371197 learned_addr learned my addr 172.21.15.52:0/3391371197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff57be00640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32440dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff580a00640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e324da720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 -- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 msgr2=0x564e32440dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32440dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 -- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 msgr2=0x564e324da720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e324da720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.449+0000 7ff581400640 1 -- 172.21.15.52:0/3391371197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e324dd140 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff581400640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f80 tx=0x7ff57400e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a853e46598929b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff561600640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff574074040 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7ff57405f480 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff570014430 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7ff574087050 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff58628b740 10 client.10776 fetch_fsmap learned FSMap version 149 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x564e32476460 con 0x564e3246f180 2024-09-10T08:42:43.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.450+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff570014430 con 0x564e3246f180 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7ff574082040 con 0x564e3246f180 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 10 client.10776 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 10 client.10776 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 20 client.10776 populate_metadata read hostname 'smithi052' 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e324d9500 0x564e324517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 4 client.10776 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e323820e0 con 0x564e324d9500 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff580a00640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e324d9500 0x564e324517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff561600640 10 client.10776 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.451+0000 7ff580a00640 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e324d9500 0x564e324517c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18bedaffd13ca909 server_cookie=124e4614d87d5580 in_seq=0 out_seq=0 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff561600640 1 -- 172.21.15.52:0/3391371197 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x564e323820e0 con 0x564e324d9500 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff561600640 10 client.10776 handle_command_reply: tid=0 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 client.10776 shutdown 2024-09-10T08:42:43.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 msgr2=0x564e32475ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7ff574000f80 tx=0x7ff57400e070 comp rx=0 tx=0).stop 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 shutdown_connections 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x564e324d9500 0x564e324517c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e3246f180 0x564e32475ce0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x564e3242c800 0x564e32440dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 --2- 172.21.15.52:0/3391371197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x564e3242c420 0x564e324da720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff561600640 0 client.10776 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 >> 172.21.15.52:0/3391371197 conn(0x564e32412480 msgr2=0x564e32441770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 shutdown_connections 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 1 -- 172.21.15.52:0/3391371197 wait complete. 2024-09-10T08:42:43.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.452+0000 7ff58628b740 20 client.10776 trim_cache size 0 max 16384 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "1d4a622a-e7c1-47a3-9d76-330678a08749": { 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "1d4a622a-e7c1-47a3-9d76-330678a08749", 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,repair" 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T08:42:43.457 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:42:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 msgr2=0x7ff55c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 0x7ff55c06e2f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff570006fd0 tx=0x7ff570008040 comp rx=0 tx=0).stop 2024-09-10T08:42:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 msgr2=0x7ff57c0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:42:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7ff57400b970 tx=0x7ff57400be30 comp rx=0 tx=0).stop 2024-09-10T08:42:43.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 shutdown_connections 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7ff55c06be30 0x7ff55c06e2f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff57c0b38a0 0x7ff57c0cd7b0 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff57c0b3350 0x7ff57c0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 --2- 172.21.15.52:0/1403272619 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff57c06bfd0 0x7ff57c155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 >> 172.21.15.52:0/1403272619 conn(0x7ff57c0d11c0 msgr2=0x7ff57c0b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 shutdown_connections 2024-09-10T08:42:43.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:42:43.453+0000 7ff583400640 1 -- 172.21.15.52:0/1403272619 wait complete. 2024-09-10T08:42:43.467 INFO:tasks.cephfs.filesystem:scrub status for tag:1d4a622a-e7c1-47a3-9d76-330678a08749 - {'path': '/', 'tag': '1d4a622a-e7c1-47a3-9d76-330678a08749', 'options': 'recursive,repair'} 2024-09-10T08:43:08.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:08.538 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:13.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:13.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-10T08:43:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.637+0000 7fb21ec00640 1 Processor -- start 2024-09-10T08:43:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.638+0000 7fb21ec00640 1 -- start start 2024-09-10T08:43:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21ec00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb2180ccf30 0x7fb2180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb2180cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21ec00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2180cd850 con 0x7fb2180cead0 2024-09-10T08:43:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21ec00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb2180cf2e0 con 0x7fb2180ccf30 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb218070fe0 con 0x7fb21815b7c0 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21cc00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb2180cead0 0x7fb21815f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42478/0 (socket says 172.21.15.52:42478) 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb21cc00640 1 -- 172.21.15.52:0/2707376560 learned_addr learned my addr 172.21.15.52:0/2707376560 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb217e00640 1 --2- 172.21.15.52:0/2707376560 >> v2:172.21.15.176:3300/0 conn(0x7fb2180ccf30 0x7fb2180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb2180cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.639+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3774741376 0 0) 0x7fb2180cd850 con 0x7fb2180cead0 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1fc003520 con 0x7fb2180cead0 2024-09-10T08:43:13.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1065732061 0 0) 0x7fb1fc003520 con 0x7fb2180cead0 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 msgr2=0x7fb2180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb2180cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 >> v2:172.21.15.176:3300/0 conn(0x7fb2180ccf30 msgr2=0x7fb2180b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 --2- 172.21.15.52:0/2707376560 >> v2:172.21.15.176:3300/0 conn(0x7fb2180ccf30 0x7fb2180b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2180712c0 con 0x7fb2180cead0 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fb2100019f0 con 0x7fb2180cead0 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb2180cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb217e00640 1 --2- 172.21.15.52:0/2707376560 >> v2:172.21.15.176:3300/0 conn(0x7fb2180ccf30 0x7fb2180b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 >> v1:172.21.15.52:6789/0 conn(0x7fb2180cead0 legacy=0x7fb21815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb1fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1fc003ef0 0x7fb1fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc004d40 0x7fb1fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180cf2e0 con 0x7fb1fc003ef0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb218070fe0 con 0x7fb1fc004d40 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb1fc00b9c0 con 0x7fb21815b7c0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1fc003ef0 0x7fb1fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb217e00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb1fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.640+0000 7fb21cc00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc004d40 0x7fb1fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217400640 1 -- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 msgr2=0x7fb1fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb1fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217400640 1 -- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc004d40 msgr2=0x7fb1fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc004d40 0x7fb1fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217400640 1 -- 172.21.15.52:0/2707376560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1fc003520 con 0x7fb1fc003ef0 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.641+0000 7fb217e00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb21815b7c0 0x7fb1fc0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:13.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb217400640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1fc003ef0 0x7fb1fc004800 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fb204009c60 tx=0x7fb1fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc05f6e4a74f7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204036070 con 0x7fb1fc003ef0 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb204031400 con 0x7fb1fc003ef0 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb216a00640 1 -- 172.21.15.52:0/2707376560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204009860 con 0x7fb1fc003ef0 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb21ec00640 1 -- 172.21.15.52:0/2707376560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1fc003ef0 msgr2=0x7fb1fc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb21ec00640 1 --2- 172.21.15.52:0/2707376560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1fc003ef0 0x7fb1fc004800 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fb204009c60 tx=0x7fb1fc005830 comp rx=0 tx=0).stop 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb21cc00640 1 -- 172.21.15.52:0/2707376560 reap_dead start 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb21ec00640 1 -- 172.21.15.52:0/2707376560 shutdown_connections 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.642+0000 7fb21ec00640 1 -- 172.21.15.52:0/2707376560 >> 172.21.15.52:0/2707376560 conn(0x7fb21806d0f0 msgr2=0x7fb21806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.643+0000 7fb21ec00640 1 -- 172.21.15.52:0/2707376560 shutdown_connections 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.643+0000 7fb21ec00640 1 -- 172.21.15.52:0/2707376560 wait complete. 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.644+0000 7fb21ec00640 1 Processor -- start 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.644+0000 7fb21ec00640 1 -- start start 2024-09-10T08:43:13.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc003ef0 0x7fb2181688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb218145b30 0x7fb21815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180cef20 con 0x7fb21815de30 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180cf5c0 con 0x7fb1fc003ef0 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21ec00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb2180cf0a0 con 0x7fb218145b30 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33340/0 (socket says 172.21.15.52:33340) 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.645+0000 7fb21cc00640 1 -- 172.21.15.52:0/3554653970 learned_addr learned my addr 172.21.15.52:0/3554653970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb217e00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc003ef0 0x7fb2181688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb217400640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb218145b30 0x7fb21815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 -- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb218145b30 msgr2=0x7fb21815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb218145b30 0x7fb21815d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 -- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc003ef0 msgr2=0x7fb2181688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc003ef0 0x7fb2181688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 -- 172.21.15.52:0/3554653970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb218167840 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb218071160 tx=0x7fb21000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.646+0000 7fb20fe00640 1 -- 172.21.15.52:0/3554653970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21000eb90 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.647+0000 7fb20fe00640 1 -- 172.21.15.52:0/3554653970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21000ed30 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.647+0000 7fb20fe00640 1 -- 172.21.15.52:0/3554653970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210014670 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.647+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb218167b20 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.647+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2181680e0 con 0x7fb21815de30 2024-09-10T08:43:13.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.649+0000 7fb20fe00640 1 -- 172.21.15.52:0/3554653970 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb210014810 con 0x7fb21815de30 2024-09-10T08:43:13.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.649+0000 7fb20fe00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 0x7fb1f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.650+0000 7fb20fe00640 1 -- 172.21.15.52:0/3554653970 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fb21008abd0 con 0x7fb21815de30 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.650+0000 7fb217e00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 0x7fb1f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.650+0000 7fb221a41740 1 Processor -- start 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.650+0000 7fb221a41740 1 -- start start 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb217e00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 0x7fb1f806e320 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb208009d60 tx=0x7fb208008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e873f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e873fa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e87317660 con 0x560e873af480 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560e872bf680 con 0x560e873c9420 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560e87313620 con 0x560e873c9800 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33350/0 (socket says 172.21.15.52:33350) 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.651+0000 7fb21cc00640 1 -- 172.21.15.52:0/965036540 learned_addr learned my addr 172.21.15.52:0/965036540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb217400640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e873fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb217e00640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e873f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 -- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 msgr2=0x560e873fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e873fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 -- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 msgr2=0x560e873f9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e873f9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 -- 172.21.15.52:0/965036540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e870f47d0 con 0x560e873af480 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb217e00640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e873f9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb217400640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e873fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb21cc00640 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb210061490 tx=0x7fb210058920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a197bd115b9f0cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb203e00640 1 -- 172.21.15.52:0/965036540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210057190 con 0x560e873af480 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb203e00640 1 -- 172.21.15.52:0/965036540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210055500 con 0x560e873af480 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.652+0000 7fb203e00640 1 -- 172.21.15.52:0/965036540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210058520 con 0x560e873af480 2024-09-10T08:43:13.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 -- 172.21.15.52:0/965036540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 msgr2=0x560e873fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fb210061490 tx=0x7fb210058920 comp rx=0 tx=0).stop 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 -- 172.21.15.52:0/965036540 shutdown_connections 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873af480 0x560e873fa740 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e873fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 --2- 172.21.15.52:0/965036540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e873f9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 -- 172.21.15.52:0/965036540 >> 172.21.15.52:0/965036540 conn(0x560e873b0220 msgr2=0x560e873f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 -- 172.21.15.52:0/965036540 shutdown_connections 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.653+0000 7fb221a41740 1 -- 172.21.15.52:0/965036540 wait complete. 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.654+0000 7fb221a41740 1 -- start start 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.654+0000 7fb221a41740 1 Processor -- start 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 0x560e873b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e8740bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e873ae3e0 con 0x560e873c9420 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x560e872a04c0 con 0x560e873c9800 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560e873ae6c0 con 0x560e873b3010 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb221a41740 10 client.0 _ll_register_callbacks cb 0x560e8730fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb217e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb217e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33358/0 (socket says 172.21.15.52:33358) 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb217e00640 1 -- 172.21.15.52:0/2487227502 learned_addr learned my addr 172.21.15.52:0/2487227502 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.655+0000 7fb21cc00640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e8740bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217400640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 0x560e873b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 -- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 msgr2=0x560e8740bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e8740bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 -- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 msgr2=0x560e873b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 0x560e873b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 -- 172.21.15.52:0/2487227502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8702a3f0 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb21cc00640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e8740bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217400640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 0x560e873b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb217e00640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fb208009860 tx=0x7fb208004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fb831aaccd81be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb200c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208015b50 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb210055500 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fb208015cf0 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fb208032050 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb221a41740 10 client.10788 fetch_fsmap learned FSMap version 149 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.656+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x560e86fea0f0 con 0x560e873c9420 2024-09-10T08:43:13.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210055500 con 0x560e873c9420 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7fb208035020 con 0x560e873c9420 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 10 client.10788 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 10 client.10788 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 20 client.10788 populate_metadata read hostname 'smithi052' 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873d2ad0 0x560e87416270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 4 client.10788 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e87324d90 con 0x560e873d2ad0 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.657+0000 7fb217400640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873d2ad0 0x560e87416270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.658+0000 7fb217400640 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873d2ad0 0x560e87416270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf41172eb7b0e405 server_cookie=d2a3536376e56dd0 in_seq=0 out_seq=0 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.658+0000 7fb200c00640 10 client.10788 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.658+0000 7fb200c00640 1 -- 172.21.15.52:0/2487227502 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e87324d90 con 0x560e873d2ad0 2024-09-10T08:43:13.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.658+0000 7fb200c00640 10 client.10788 handle_command_reply: tid=0 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.658+0000 7fb221a41740 1 client.10788 shutdown 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 msgr2=0x560e873c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fb208009860 tx=0x7fb208004730 comp rx=0 tx=0).stop 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 shutdown_connections 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873d2ad0 0x560e87416270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e8740bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9800 0x560e873b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb200c00640 0 client.10788 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 --2- 172.21.15.52:0/2487227502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e873c8630 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 >> 172.21.15.52:0/2487227502 conn(0x560e873af480 msgr2=0x560e873f1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 shutdown_connections 2024-09-10T08:43:13.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 1 -- 172.21.15.52:0/2487227502 wait complete. 2024-09-10T08:43:13.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.659+0000 7fb221a41740 20 client.10788 trim_cache size 0 max 16384 2024-09-10T08:43:13.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.677+0000 7fb221a41740 1 Processor -- start 2024-09-10T08:43:13.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.677+0000 7fb221a41740 1 -- start start 2024-09-10T08:43:13.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e873ee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e874706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb218201320 con 0x560e873c9800 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb218200300 con 0x560e873c9420 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb21814da80 con 0x560e873b3010 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb21cc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33368/0 (socket says 172.21.15.52:33368) 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb21cc00640 1 -- 172.21.15.52:0/3242371770 learned_addr learned my addr 172.21.15.52:0/3242371770 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb217e00640 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e873ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.678+0000 7fb217400640 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e874706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 -- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 msgr2=0x560e873ee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e873ee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 -- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 msgr2=0x560e874706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e874706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 -- 172.21.15.52:0/3242371770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e87470c00 con 0x560e873c9800 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb21cc00640 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fb21005d350 tx=0x7fb210009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51654ee45ed5f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb203400640 1 -- 172.21.15.52:0/3242371770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210057190 con 0x560e873c9800 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb203400640 1 -- 172.21.15.52:0/3242371770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210079030 con 0x560e873c9800 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.679+0000 7fb203400640 1 -- 172.21.15.52:0/3242371770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100582e0 con 0x560e873c9800 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 -- 172.21.15.52:0/3242371770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 msgr2=0x560e873b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fb21005d350 tx=0x7fb210009070 comp rx=0 tx=0).stop 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 -- 172.21.15.52:0/3242371770 shutdown_connections 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9800 0x560e873b3ce0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873c9420 0x560e874706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 --2- 172.21.15.52:0/3242371770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873b3010 0x560e873ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 -- 172.21.15.52:0/3242371770 >> 172.21.15.52:0/3242371770 conn(0x560e873af480 msgr2=0x560e873f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 -- 172.21.15.52:0/3242371770 shutdown_connections 2024-09-10T08:43:13.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.680+0000 7fb221a41740 1 -- 172.21.15.52:0/3242371770 wait complete. 2024-09-10T08:43:13.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.681+0000 7fb221a41740 1 -- start start 2024-09-10T08:43:13.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.681+0000 7fb221a41740 1 Processor -- start 2024-09-10T08:43:13.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873b3010 0x560e873f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e8746f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e873a8c30 con 0x560e873c9420 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181ffed0 con 0x560e873b3010 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x560e873f74e0 con 0x560e873c9800 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb221a41740 10 client.0 _ll_register_callbacks cb 0x7fb20801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33384/0 (socket says 172.21.15.52:33384) 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 -- 172.21.15.52:0/1316086083 learned_addr learned my addr 172.21.15.52:0/1316086083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217e00640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873b3010 0x560e873f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb21cc00640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e8746f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 -- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 msgr2=0x560e8746f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e8746f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 -- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873b3010 msgr2=0x560e873f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873b3010 0x560e873f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb217400640 1 -- 172.21.15.52:0/1316086083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8746f1f0 con 0x560e873c9420 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.682+0000 7fb21cc00640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e8746f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb217400640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fb204000c00 tx=0x7fb2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f784aa106faa32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204036040 con 0x560e873c9420 2024-09-10T08:43:13.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fb204004020 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb210079030 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=149) ==== 24+0+0 (secure 0 0 0) 0x7fb204053050 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb221a41740 10 client.10794 fetch_fsmap learned FSMap version 149 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=149,monmap=2+}) -- 0x560e8740f450 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210079030 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 149) ==== 3502+0+0 (secure 0 0 0) 0x7fb204056020 con 0x560e873c9420 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.683+0000 7fb221a41740 10 client.10794 fetch_fsmap finished waiting for FSMap version 149 2024-09-10T08:43:13.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb221a41740 10 client.10794 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb221a41740 20 client.10794 populate_metadata read hostname 'smithi052' 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873f8e60 0x560e8746d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb221a41740 4 client.10794 mds_command: new command op to 10566 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 --> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e8731f0e0 con 0x560e873f8e60 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb217e00640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873f8e60 0x560e8746d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb217e00640 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873f8e60 0x560e8746d010 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d161c2d80cfa41b3 server_cookie=f7582a0e9d05638a in_seq=0 out_seq=0 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.684+0000 7fb200c00640 10 client.10794 ms_handle_connect on v2:172.21.15.52:6833/1114908011 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb200c00640 1 -- 172.21.15.52:0/1316086083 <== mds.0 v2:172.21.15.52:6833/1114908011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560e8731f0e0 con 0x560e873f8e60 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb200c00640 10 client.10794 handle_command_reply: tid=0 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 client.10794 shutdown 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 msgr2=0x560e8740ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fb204000c00 tx=0x7fb2040046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 shutdown_connections 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:6833/1114908011,v1:172.21.15.52:6834/1114908011] conn(0x560e873f8e60 0x560e8746d010 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x560e873c9800 0x560e8746f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e873c9420 0x560e8740ebc0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 --2- 172.21.15.52:0/1316086083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x560e873b3010 0x560e873f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb200c00640 0 client.10794 ms_handle_reset on v2:172.21.15.52:6833/1114908011 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 >> 172.21.15.52:0/1316086083 conn(0x560e873af480 msgr2=0x560e873f6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 shutdown_connections 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 1 -- 172.21.15.52:0/1316086083 wait complete. 2024-09-10T08:43:13.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.685+0000 7fb221a41740 20 client.10794 trim_cache size 0 max 16384 2024-09-10T08:43:13.693 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:13.693 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-10T08:43:13.693 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-10T08:43:13.693 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 msgr2=0x7fb1f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 0x7fb1f806e320 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb208009d60 tx=0x7fb208008040 comp rx=0 tx=0).stop 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 msgr2=0x7fb218072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fb218071160 tx=0x7fb21000e530 comp rx=0 tx=0).stop 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 shutdown_connections 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb1f806be60 0x7fb1f806e320 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb21815de30 0x7fb218072160 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb218145b30 0x7fb21815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 --2- 172.21.15.52:0/3554653970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1fc003ef0 0x7fb2181688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:13.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 >> 172.21.15.52:0/3554653970 conn(0x7fb21806d0f0 msgr2=0x7fb2180717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:13.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 shutdown_connections 2024-09-10T08:43:13.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13.686+0000 7fb21ec00640 1 -- 172.21.15.52:0/3554653970 wait complete. 2024-09-10T08:43:13.702 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> stdin-killer -- python3 -c ' 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> import stat 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> import json 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> import sys 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> try: 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> except OSError as e: 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> sys.exit(e.errno) 2024-09-10T08:43:13.703 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-10T08:43:13.704 DEBUG:teuthology.orchestra.run.smithi052:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T08:43:13.704 DEBUG:teuthology.orchestra.run.smithi052:> print(json.dumps( 2024-09-10T08:43:13.704 DEBUG:teuthology.orchestra.run.smithi052:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T08:43:13.704 DEBUG:teuthology.orchestra.run.smithi052:> indent=2)) 2024-09-10T08:43:13.704 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-10T08:43:13.807 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:13.807 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mode": 33188, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ino": 1099511627777, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_dev": 43, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_nlink": 1, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_uid": 1000, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_gid": 1333, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_size": 6291456, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_atime": 1725957761.8200862, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_mtime": 1725957761.854086, 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout: "st_ctime": 1725957761.854086 2024-09-10T08:43:13.808 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:13.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:43:13.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.015+0000 7f2038000640 1 Processor -- start 2024-09-10T08:43:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.015+0000 7f2038000640 1 -- start start 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2038000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2030073890 0x7f20300b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2038000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f20300b5880 0x7f20300b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2038000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20300b4020 con 0x7f2030145ed0 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2038000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f20300b42c0 con 0x7f20300b5880 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2038000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f20300b45a0 con 0x7f2030073890 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2035600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2030145ed0 0x7f2030073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42494/0 (socket says 172.21.15.52:42494) 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2035600640 1 -- 172.21.15.52:0/4132032409 learned_addr learned my addr 172.21.15.52:0/4132032409 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2036000640 1 --2- 172.21.15.52:0/4132032409 >> v2:172.21.15.52:3300/0 conn(0x7f20300b5880 0x7f20300b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2034c00640 1 --2- 172.21.15.52:0/4132032409 >> v2:172.21.15.176:3300/0 conn(0x7f2030073890 0x7f20300b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f202fe00640 1 -- 172.21.15.52:0/4132032409 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132295029 0 0) 0x7f20300b4020 con 0x7f2030145ed0 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f202fe00640 1 -- 172.21.15.52:0/4132032409 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2018003520 con 0x7f2030145ed0 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2036000640 1 -- 172.21.15.52:0/4132032409 >> v2:172.21.15.176:3300/0 conn(0x7f2030073890 msgr2=0x7f20300b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2036000640 1 --2- 172.21.15.52:0/4132032409 >> v2:172.21.15.176:3300/0 conn(0x7f2030073890 0x7f20300b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.017+0000 7f2036000640 1 -- 172.21.15.52:0/4132032409 >> v1:172.21.15.52:6789/0 conn(0x7f2030145ed0 legacy=0x7f2030073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.018+0000 7f2036000640 1 -- 172.21.15.52:0/4132032409 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20300b4880 con 0x7f20300b5880 2024-09-10T08:43:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2036000640 1 --2- 172.21.15.52:0/4132032409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f20300b5ce0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f20300d1490 tx=0x7f202802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cfbccd87aa11e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f202fe00640 1 -- 172.21.15.52:0/4132032409 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028007740 con 0x7f20300b5880 2024-09-10T08:43:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f202fe00640 1 -- 172.21.15.52:0/4132032409 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280078e0 con 0x7f20300b5880 2024-09-10T08:43:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f202fe00640 1 -- 172.21.15.52:0/4132032409 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028007c90 con 0x7f20300b5880 2024-09-10T08:43:14.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 -- 172.21.15.52:0/4132032409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 msgr2=0x7f20300b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 --2- 172.21.15.52:0/4132032409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f20300b5ce0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f20300d1490 tx=0x7f202802a680 comp rx=0 tx=0).stop 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 -- 172.21.15.52:0/4132032409 shutdown_connections 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 --2- 172.21.15.52:0/4132032409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f20300b5ce0 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 --2- 172.21.15.52:0/4132032409 >> v2:172.21.15.176:3300/0 conn(0x7f2030073890 0x7f20300b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.019+0000 7f2038000640 1 -- 172.21.15.52:0/4132032409 >> 172.21.15.52:0/4132032409 conn(0x7f20300ccec0 msgr2=0x7f20300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.020+0000 7f2038000640 1 -- 172.21.15.52:0/4132032409 shutdown_connections 2024-09-10T08:43:14.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.020+0000 7f2038000640 1 -- 172.21.15.52:0/4132032409 wait complete. 2024-09-10T08:43:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.021+0000 7f2038000640 1 Processor -- start 2024-09-10T08:43:14.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.021+0000 7f2038000640 1 -- start start 2024-09-10T08:43:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2030073890 0x7f2030072710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2030145ed0 0x7f20300aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20300b63a0 con 0x7f20300b5880 2024-09-10T08:43:14.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20300b6220 con 0x7f2030145ed0 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.022+0000 7f2038000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f20301462b0 con 0x7f2030073890 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33400/0 (socket says 172.21.15.52:33400) 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 -- 172.21.15.52:0/3078475926 learned_addr learned my addr 172.21.15.52:0/3078475926 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2035600640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2030073890 0x7f2030072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2036000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2030145ed0 0x7f20300aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 -- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2030073890 msgr2=0x7f2030072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2030073890 0x7f2030072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 -- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2030145ed0 msgr2=0x7f20300aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2030145ed0 0x7f20300aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 -- 172.21.15.52:0/3078475926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2030071670 con 0x7f20300b5880 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.023+0000 7f2034c00640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f201c00e9e0 tx=0x7f201c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.024+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c017070 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.024+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c00c9d0 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.024+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c00cdc0 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.024+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2030071950 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.024+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2030071f10 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.025+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20301424c0 con 0x7f20300b5880 2024-09-10T08:43:14.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.026+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f201c01a070 con 0x7f20300b5880 2024-09-10T08:43:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.027+0000 7f202d600640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.027+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f201c08b190 con 0x7f20300b5880 2024-09-10T08:43:14.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.027+0000 7f2035600640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.028+0000 7f2035600640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 0x7f201006e2f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2024001200 tx=0x7f2024000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.031+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20301424c0 con 0x7f20300b5880 2024-09-10T08:43:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.254+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20300b5080 con 0x7f20300b5880 2024-09-10T08:43:14.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.255+0000 7f202d600640 1 -- 172.21.15.52:0/3078475926 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f201c0594e0 con 0x7f20300b5880 2024-09-10T08:43:14.712 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:14.712 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 msgr2=0x7f201006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 0x7f201006e2f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2024001200 tx=0x7f2024000bc0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 msgr2=0x7f2030070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f201c00e9e0 tx=0x7f201c00eea0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 shutdown_connections 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f201006be30 0x7f201006e2f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2030145ed0 0x7f20300aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20300b5880 0x7f2030070f70 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 --2- 172.21.15.52:0/3078475926 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2030073890 0x7f2030072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 >> 172.21.15.52:0/3078475926 conn(0x7f20300ccec0 msgr2=0x7f2030141db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:14.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 shutdown_connections 2024-09-10T08:43:14.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.257+0000 7f2038000640 1 -- 172.21.15.52:0/3078475926 wait complete. 2024-09-10T08:43:14.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-10T08:43:14.898 INFO:teuthology.orchestra.run.smithi052.stdout:{"message":"","return_code":0} 2024-09-10T08:43:14.899 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T08:43:14.899 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-10T08:43:14.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.976+0000 7fe1a608cf40 1 Processor -- start 2024-09-10T08:43:14.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.976+0000 7fe1a608cf40 1 -- start start 2024-09-10T08:43:14.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a357f2880 0x556a35825d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a35826990 0x556a358c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a3579ab30 con 0x556a3583ba40 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a35826f80 con 0x556a35826990 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a3583e7a0 con 0x556a357f2880 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54066/0 (socket says 172.21.15.52:54066) 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a3c00640 1 -- 172.21.15.52:0/2323793763 learned_addr learned my addr 172.21.15.52:0/2323793763 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.977+0000 7fe1a2800640 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a35826990 0x556a358c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3200640 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a357f2880 0x556a35825d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 -- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a357f2880 msgr2=0x556a35825d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:14.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a357f2880 0x556a35825d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 -- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a35826990 msgr2=0x556a358c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a35826990 0x556a358c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 -- 172.21.15.52:0/2323793763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a358bd850 con 0x556a3583ba40 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe19c001600 tx=0x7fe19c001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93675f18018d27ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a1400640 1 -- 172.21.15.52:0/2323793763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c004520 con 0x556a3583ba40 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a1400640 1 -- 172.21.15.52:0/2323793763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c0046c0 con 0x556a3583ba40 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.978+0000 7fe1a1400640 1 -- 172.21.15.52:0/2323793763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c004ab0 con 0x556a3583ba40 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 -- 172.21.15.52:0/2323793763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 msgr2=0x556a358c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fe19c001600 tx=0x7fe19c001ac0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 -- 172.21.15.52:0/2323793763 shutdown_connections 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7f80 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a35826990 0x556a358c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/2323793763 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a357f2880 0x556a35825d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 -- 172.21.15.52:0/2323793763 >> 172.21.15.52:0/2323793763 conn(0x556a358234f0 msgr2=0x556a35840f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:14.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 -- 172.21.15.52:0/2323793763 shutdown_connections 2024-09-10T08:43:14.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.979+0000 7fe1a608cf40 1 -- 172.21.15.52:0/2323793763 wait complete. 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.980+0000 7fe1a608cf40 1 Processor -- start 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.980+0000 7fe1a608cf40 1 -- start start 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a357f2880 0x556a35836100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a35826990 0x556a358bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556a358c4b20 con 0x556a3583ba40 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x556a358253b0 con 0x556a357f2880 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a608cf40 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x556a358bd550 con 0x556a35826990 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54078/0 (socket says 172.21.15.52:54078) 2024-09-10T08:43:14.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 -- 172.21.15.52:0/1015312557 learned_addr learned my addr 172.21.15.52:0/1015312557 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a2800640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a35826990 0x556a358bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3200640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a357f2880 0x556a35836100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 -- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a35826990 msgr2=0x556a358bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a35826990 0x556a358bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 -- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a357f2880 msgr2=0x556a35836100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a357f2880 0x556a35836100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.981+0000 7fe1a3c00640 1 -- 172.21.15.52:0/1015312557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a35836640 con 0x556a3583ba40 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe1a3c00640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7370 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fe19c001fc0 tx=0x7fe19c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe19be00640 1 -- 172.21.15.52:0/1015312557 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c023070 con 0x556a3583ba40 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe19be00640 1 -- 172.21.15.52:0/1015312557 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c006c90 con 0x556a3583ba40 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe19be00640 1 -- 172.21.15.52:0/1015312557 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c004270 con 0x556a3583ba40 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a358bfe80 con 0x556a3583ba40 2024-09-10T08:43:14.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.982+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a358bf160 con 0x556a3583ba40 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.984+0000 7fe19be00640 1 -- 172.21.15.52:0/1015312557 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe19c01b070 con 0x556a3583ba40 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe19be00640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe18406a810 0x7fe18406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe19be00640 1 -- 172.21.15.52:0/1015312557 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7fe19c08a550 con 0x556a3583ba40 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x556a358c7d60 0x556a35837fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e195) -- 0x556a358384e0 con 0x556a358c7d60 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe1a2800640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x556a358c7d60 0x556a35837fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.985+0000 7fe1a3200640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe18406a810 0x7fe18406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a2800640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x556a358c7d60 0x556a35837fa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a3200640 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe18406a810 0x7fe18406ccd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x556a3583b590 tx=0x7fe19400e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:14.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a2800640 1 -- 172.21.15.52:0/1015312557 <== osd.1 v2:172.21.15.52:6800/2452593582 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fe19005c040 con 0x556a358c7d60 2024-09-10T08:43:14.988 INFO:teuthology.orchestra.run.smithi052.stdout:Ysixmegssubdir 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x556a358c7d60 msgr2=0x556a35837fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x556a358c7d60 0x556a35837fa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe18406a810 msgr2=0x7fe18406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe18406a810 0x7fe18406ccd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x556a3583b590 tx=0x7fe19400e040 comp rx=0 tx=0).stop 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 msgr2=0x556a358c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.986+0000 7fe1a608cf40 1 --2- 172.21.15.52:0/1015312557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556a3583ba40 0x556a358c7370 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fe19c001fc0 tx=0x7fe19c000f40 comp rx=0 tx=0).stop 2024-09-10T08:43:14.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.987+0000 7fe1a3c00640 1 -- 172.21.15.52:0/1015312557 reap_dead start 2024-09-10T08:43:14.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.987+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 shutdown_connections 2024-09-10T08:43:14.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.987+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 >> 172.21.15.52:0/1015312557 conn(0x556a358234f0 msgr2=0x556a358c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:14.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.987+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 shutdown_connections 2024-09-10T08:43:14.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:14.987+0000 7fe1a608cf40 1 -- 172.21.15.52:0/1015312557 wait complete. 2024-09-10T08:43:14.991 DEBUG:teuthology.orchestra.run.smithi052:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-10T08:43:15.128 INFO:teuthology.orchestra.run.smithi052.stderr:error: stray data at end of buffer, offset 95 2024-09-10T08:43:15.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:43:15.144 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:43:15.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:43:15.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:43:15.347 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:43:15.347 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:43:15.348 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:43:15.348 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:15.383 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:43:15.383 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:15.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:43:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.654+0000 7f2cc5e00640 1 Processor -- start 2024-09-10T08:43:15.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.654+0000 7f2cc5e00640 1 -- start start 2024-09-10T08:43:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.655+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 0x7f2cc00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.655+0000 7f2cc5e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2cc0073180 0x7f2cc00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.655+0000 7f2cc5e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc00b4020 con 0x7f2cc00b5880 2024-09-10T08:43:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.655+0000 7f2cc5e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc0073b00 con 0x7f2cc0073180 2024-09-10T08:43:15.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.655+0000 7f2cc5e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc00b42c0 con 0x7f2cc0145ed0 2024-09-10T08:43:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.656+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 0x7f2cc00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.656+0000 7f2cb6000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2cc0073180 0x7f2cc00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.656+0000 7f2cb6000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2cc0073180 0x7f2cc00735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.52:43486/0 (socket says 172.21.15.52:43486) 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.656+0000 7f2cb6000640 1 -- 172.21.15.52:0/2127974609 learned_addr learned my addr 172.21.15.52:0/2127974609 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.656+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 0x7f2cc00b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39770/0 (socket says 172.21.15.52:39770) 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.657+0000 7f2cb6000640 1 -- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 msgr2=0x7f2cc00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.657+0000 7f2cb6000640 1 --2- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 0x7f2cc00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.657+0000 7f2cb6000640 1 -- 172.21.15.52:0/2127974609 >> v1:172.21.15.176:6789/0 conn(0x7f2cc00b5880 legacy=0x7f2cc00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.657+0000 7f2cb6000640 1 -- 172.21.15.52:0/2127974609 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00b45a0 con 0x7f2cc0073180 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cb6000640 1 --2- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0073180 0x7f2cc00735c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c603391663281df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cbe000640 1 -- 172.21.15.52:0/2127974609 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8037070 con 0x7f2cc0073180 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cbe000640 1 -- 172.21.15.52:0/2127974609 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8032440 con 0x7f2cc0073180 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cbe000640 1 -- 172.21.15.52:0/2127974609 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8032810 con 0x7f2cc0073180 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cc5e00640 1 -- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0073180 msgr2=0x7f2cc00735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.658+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0073180 0x7f2cc00735c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802a250 comp rx=0 tx=0).stop 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 -- 172.21.15.52:0/2127974609 shutdown_connections 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0073180 0x7f2cc00735c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/2127974609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0145ed0 0x7f2cc00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 -- 172.21.15.52:0/2127974609 >> 172.21.15.52:0/2127974609 conn(0x7f2cc00ccec0 msgr2=0x7f2cc00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 -- 172.21.15.52:0/2127974609 shutdown_connections 2024-09-10T08:43:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.659+0000 7f2cc5e00640 1 -- 172.21.15.52:0/2127974609 wait complete. 2024-09-10T08:43:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.660+0000 7f2cc5e00640 1 Processor -- start 2024-09-10T08:43:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.660+0000 7f2cc5e00640 1 -- start start 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 0x7f2cc01401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 0x7f2cc00caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc01462b0 con 0x7f2cc00b5880 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00b4b60 con 0x7f2cc0145ed0 2024-09-10T08:43:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.661+0000 7f2cc5e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc0146430 con 0x7f2cc0073180 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54092/0 (socket says 172.21.15.52:54092) 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 -- 172.21.15.52:0/3746577959 learned_addr learned my addr 172.21.15.52:0/3746577959 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cbea00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 0x7f2cc01401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 -- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 msgr2=0x7f2cc01401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 0x7f2cc01401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cbf400640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 0x7f2cc00caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 -- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 msgr2=0x7f2cc00caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 0x7f2cc00caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 -- 172.21.15.52:0/3746577959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc01e3890 con 0x7f2cc00b5880 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cbea00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 0x7f2cc01401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cbf400640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 0x7f2cc00caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.662+0000 7f2cb6000640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.663+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8037040 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.663+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8042070 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.663+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030880 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.663+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc01e3b70 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.663+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc01e4130 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.664+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc00735c0 con 0x7f2cc00b5880 2024-09-10T08:43:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.665+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ca8030a20 con 0x7f2cc00b5880 2024-09-10T08:43:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.666+0000 7f2cb7e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 0x7f2c9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.666+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f2ca80ab740 con 0x7f2cc00b5880 2024-09-10T08:43:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.666+0000 7f2cbea00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 0x7f2c9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.667+0000 7f2cbea00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 0x7f2c9c06e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00cc520 tx=0x7f2cb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:15.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.670+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ca807a050 con 0x7f2cc00b5880 2024-09-10T08:43:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.868+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2cc00cd790 con 0x7f2cc00b5880 2024-09-10T08:43:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.868+0000 7f2cb7e00640 1 -- 172.21.15.52:0/3746577959 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v195) ==== 80+0+0 (secure 0 0 0) 0x7f2ca8079950 con 0x7f2cc00b5880 2024-09-10T08:43:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 msgr2=0x7f2c9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 0x7f2c9c06e2f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00cc520 tx=0x7f2cb0008040 comp rx=0 tx=0).stop 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 msgr2=0x7f2cc01e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca80046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 shutdown_connections 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2c9c06be30 0x7f2c9c06e2f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc0145ed0 0x7f2cc00caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc00b5880 0x7f2cc01e2f20 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3746577959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc0073180 0x7f2cc01401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 >> 172.21.15.52:0/3746577959 conn(0x7f2cc00ccec0 msgr2=0x7f2cc00cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 shutdown_connections 2024-09-10T08:43:15.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:15.870+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3746577959 wait complete. 2024-09-10T08:43:15.886 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:43:15.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:15.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:43:15.984 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:43:15.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:15.984 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:43:16.032 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:43:16.032 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:43:16.032 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:16.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:43:16.071 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:43:16.071 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:43:16.071 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:16.107 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:43:16.108 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:43:16.108 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:43:16.108 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:16.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:43:16.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.304+0000 7f2487400640 1 Processor -- start 2024-09-10T08:43:16.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.304+0000 7f2487400640 1 -- start start 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24800b2d40 0x7f248006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f248006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f248015bcf0 0x7f248015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f2480071ab0 con 0x7f24800b2d40 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2480071180 con 0x7f248015bcf0 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2487400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2480071460 con 0x7f248013eb20 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2484a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24800b2d40 0x7f248006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2484a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f24800b2d40 0x7f248006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54106/0 (socket says 172.21.15.52:54106) 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2484a00640 1 -- 172.21.15.52:0/2716534064 learned_addr learned my addr 172.21.15.52:0/2716534064 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.305+0000 7f2485400640 1 --2- 172.21.15.52:0/2716534064 >> v2:172.21.15.176:3300/0 conn(0x7f248015bcf0 0x7f248015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f247fe00640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f248006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f2484a00640 1 -- 172.21.15.52:0/2716534064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 msgr2=0x7f248006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f2484a00640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f248006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f2484a00640 1 -- 172.21.15.52:0/2716534064 >> v2:172.21.15.176:3300/0 conn(0x7f248015bcf0 msgr2=0x7f248015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f2484a00640 1 --2- 172.21.15.52:0/2716534064 >> v2:172.21.15.176:3300/0 conn(0x7f248015bcf0 0x7f248015c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.306+0000 7f2484a00640 1 -- 172.21.15.52:0/2716534064 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2480071740 con 0x7f24800b2d40 2024-09-10T08:43:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f2484a00640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f248006bc10 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f24801595c0 tx=0x7f247402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77901704cb6ff955 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f247f400640 1 -- 172.21.15.52:0/2716534064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474037070 con 0x7f24800b2d40 2024-09-10T08:43:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f247f400640 1 -- 172.21.15.52:0/2716534064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2474032440 con 0x7f24800b2d40 2024-09-10T08:43:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f247f400640 1 -- 172.21.15.52:0/2716534064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474032810 con 0x7f24800b2d40 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f2487400640 1 -- 172.21.15.52:0/2716534064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 msgr2=0x7f248006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.307+0000 7f2487400640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f248006bc10 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f24801595c0 tx=0x7f247402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 -- 172.21.15.52:0/2716534064 shutdown_connections 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 --2- 172.21.15.52:0/2716534064 >> v2:172.21.15.176:3300/0 conn(0x7f248015bcf0 0x7f248015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f248006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 --2- 172.21.15.52:0/2716534064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f248006bc10 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 -- 172.21.15.52:0/2716534064 >> 172.21.15.52:0/2716534064 conn(0x7f24800ccec0 msgr2=0x7f24800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 -- 172.21.15.52:0/2716534064 shutdown_connections 2024-09-10T08:43:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.308+0000 7f2487400640 1 -- 172.21.15.52:0/2716534064 wait complete. 2024-09-10T08:43:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.309+0000 7f2487400640 1 Processor -- start 2024-09-10T08:43:16.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.309+0000 7f2487400640 1 -- start start 2024-09-10T08:43:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f2480157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 0x7f2480158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f248015f140 con 0x7f24800b2d40 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f248015efc0 con 0x7f248015bcf0 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2487400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f248015f2c0 con 0x7f248013eb20 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.310+0000 7f2484a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54124/0 (socket says 172.21.15.52:54124) 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 -- 172.21.15.52:0/892681136 learned_addr learned my addr 172.21.15.52:0/892681136 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f247fe00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f2480157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2485400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 0x7f2480158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 -- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 msgr2=0x7f2480157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f2480157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 -- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 msgr2=0x7f2480158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 0x7f2480158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 -- 172.21.15.52:0/892681136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800b3f80 con 0x7f24800b2d40 2024-09-10T08:43:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2485400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 0x7f2480158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.311+0000 7f2484a00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f247402a220 tx=0x7f24740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.312+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474041020 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.312+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24740306c0 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.312+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24800b4260 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.312+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474037040 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.312+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24800b4820 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.313+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248015c1a0 con 0x7f24800b2d40 2024-09-10T08:43:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.314+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2474044020 con 0x7f24800b2d40 2024-09-10T08:43:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.315+0000 7f247cc00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.315+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f24740ab610 con 0x7f24800b2d40 2024-09-10T08:43:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.316+0000 7f247fe00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.316+0000 7f247fe00640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f24801592a0 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.319+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f247404b030 con 0x7f24800b2d40 2024-09-10T08:43:16.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.544+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f248006c9c0 con 0x7f24800b2d40 2024-09-10T08:43:16.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.545+0000 7f247cc00640 1 -- 172.21.15.52:0/892681136 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f2474079fc0 con 0x7f24800b2d40 2024-09-10T08:43:16.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:16.545 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:43:16.546 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:43:16.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 msgr2=0x7f246006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 0x7f246006e2f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f24801592a0 tx=0x7f246c008040 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 msgr2=0x7f2480154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f247402a220 tx=0x7f24740046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 shutdown_connections 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f246006be30 0x7f246006e2f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f248015bcf0 0x7f2480158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f248013eb20 0x7f2480157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 --2- 172.21.15.52:0/892681136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24800b2d40 0x7f2480154710 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 >> 172.21.15.52:0/892681136 conn(0x7f24800ccec0 msgr2=0x7f2480071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 shutdown_connections 2024-09-10T08:43:16.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.547+0000 7f2487400640 1 -- 172.21.15.52:0/892681136 wait complete. 2024-09-10T08:43:16.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.719+0000 7f339ca00640 1 Processor -- start 2024-09-10T08:43:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.719+0000 7f339ca00640 1 -- start start 2024-09-10T08:43:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.720+0000 7f339ca00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f33980b2d40 0x7f339806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.720+0000 7f339ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f339815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.720+0000 7f339ca00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3398071180 con 0x7f339813eb20 2024-09-10T08:43:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.720+0000 7f339ca00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f3398071ab0 con 0x7f33980b2d40 2024-09-10T08:43:16.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.720+0000 7f339ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3398071460 con 0x7f339806c150 2024-09-10T08:43:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f338fe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f339813eb20 0x7f339815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50290/0 (socket says 172.21.15.52:50290) 2024-09-10T08:43:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f338fe00640 1 -- 172.21.15.52:0/1413352746 learned_addr learned my addr 172.21.15.52:0/1413352746 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f3396800640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f339815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f3395e00640 1 --2- 172.21.15.52:0/1413352746 >> v2:172.21.15.176:3300/0 conn(0x7f33980b2d40 0x7f339806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287958511 0 0) 0x7f3398071180 con 0x7f339813eb20 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.721+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337c003520 con 0x7f339813eb20 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1638784220 0 0) 0x7f337c003520 con 0x7f339813eb20 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 msgr2=0x7f339815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f339815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 >> v2:172.21.15.176:3300/0 conn(0x7f33980b2d40 msgr2=0x7f339806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 --2- 172.21.15.52:0/1413352746 >> v2:172.21.15.176:3300/0 conn(0x7f33980b2d40 0x7f339806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3398071740 con 0x7f339813eb20 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f3380001670 con 0x7f339813eb20 2024-09-10T08:43:16.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 >> v1:172.21.15.52:6789/0 conn(0x7f339813eb20 legacy=0x7f339815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f337c0039b0 0x7f337c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f337c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3398071ab0 con 0x7f337c0039b0 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3398071460 con 0x7f337c004800 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f337c00b9c0 con 0x7f339806c150 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f337c0039b0 0x7f337c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3396800640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f337c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f338fe00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 -- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 msgr2=0x7f337c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f339806c150 0x7f337c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 -- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f337c004800 msgr2=0x7f337c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:16.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f3395e00640 1 -- 172.21.15.52:0/1413352746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c003520 con 0x7f337c0039b0 2024-09-10T08:43:16.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.722+0000 7f338fe00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f337c004800 0x7f337c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:16.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.723+0000 7f3395e00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f337c0039b0 0x7f337c003dd0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f3388009650 tx=0x7f337c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb40c3cbc4ecca3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388038070 con 0x7f337c0039b0 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3388033400 con 0x7f337c0039b0 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f3395400640 1 -- 172.21.15.52:0/1413352746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3388009690 con 0x7f337c0039b0 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 -- 172.21.15.52:0/1413352746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f337c0039b0 msgr2=0x7f337c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 --2- 172.21.15.52:0/1413352746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f337c0039b0 0x7f337c003dd0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f3388009650 tx=0x7f337c005830 comp rx=0 tx=0).stop 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f3396800640 1 -- 172.21.15.52:0/1413352746 reap_dead start 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 -- 172.21.15.52:0/1413352746 shutdown_connections 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 -- 172.21.15.52:0/1413352746 >> 172.21.15.52:0/1413352746 conn(0x7f33980ccec0 msgr2=0x7f33980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:16.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 -- 172.21.15.52:0/1413352746 shutdown_connections 2024-09-10T08:43:16.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.724+0000 7f339ca00640 1 -- 172.21.15.52:0/1413352746 wait complete. 2024-09-10T08:43:16.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.726+0000 7f339ca00640 1 Processor -- start 2024-09-10T08:43:16.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.726+0000 7f339ca00640 1 -- start start 2024-09-10T08:43:16.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f337c0039b0 0x7f3398158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f339815caf0 0x7f33980b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f339815c7d0 con 0x7f339815f340 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f339815c650 con 0x7f339815caf0 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f339ca00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3398071f40 con 0x7f337c0039b0 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f338fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f338fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54144/0 (socket says 172.21.15.52:54144) 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.727+0000 7f338fe00640 1 -- 172.21.15.52:0/1465625658 learned_addr learned my addr 172.21.15.52:0/1465625658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f3395e00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f337c0039b0 0x7f3398158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f3396800640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f339815caf0 0x7f33980b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 -- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f337c0039b0 msgr2=0x7f3398158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f337c0039b0 0x7f3398158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 -- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f339815caf0 msgr2=0x7f33980b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f339815caf0 0x7f33980b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 -- 172.21.15.52:0/1465625658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33981588e0 con 0x7f339815f340 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338fe00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f338000e7b0 tx=0x7f338000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338000c870 con 0x7f339815f340 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380018070 con 0x7f339815f340 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338000cc30 con 0x7f339815f340 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3398158320 con 0x7f339815f340 2024-09-10T08:43:16.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.728+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33980b4020 con 0x7f339815f340 2024-09-10T08:43:16.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.730+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33980b4220 con 0x7f339815f340 2024-09-10T08:43:16.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.730+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f338001d460 con 0x7f339815f340 2024-09-10T08:43:16.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.731+0000 7f338e000640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:16.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.731+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f338008ad20 con 0x7f339815f340 2024-09-10T08:43:16.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.732+0000 7f3395e00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:16.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.732+0000 7f3395e00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 0x7f337406e2f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3388035000 tx=0x7f3388008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:16.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.736+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33980b4220 con 0x7f339815f340 2024-09-10T08:43:16.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.960+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3398141020 con 0x7f339815f340 2024-09-10T08:43:16.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.961+0000 7f338e000640 1 -- 172.21.15.52:0/1465625658 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f3380059630 con 0x7f339815f340 2024-09-10T08:43:16.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:16.962 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:43:16.962 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 msgr2=0x7f337406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 0x7f337406e2f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3388035000 tx=0x7f3388008030 comp rx=0 tx=0).stop 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 msgr2=0x7f339813d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f338000e7b0 tx=0x7f338000ec70 comp rx=0 tx=0).stop 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 shutdown_connections 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f337406be30 0x7f337406e2f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f339815caf0 0x7f33980b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f339815f340 0x7f339813d070 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 --2- 172.21.15.52:0/1465625658 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f337c0039b0 0x7f3398158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:16.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 >> 172.21.15.52:0/1465625658 conn(0x7f33980ccec0 msgr2=0x7f33981595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:16.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 shutdown_connections 2024-09-10T08:43:16.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:16.963+0000 7f339ca00640 1 -- 172.21.15.52:0/1465625658 wait complete. 2024-09-10T08:43:16.980 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:43:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.135+0000 7f1caee00640 1 Processor -- start 2024-09-10T08:43:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.136+0000 7f1caee00640 1 -- start start 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1caee00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1ca80b2d40 0x7f1ca806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1caee00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1ca806c150 0x7f1ca815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1caee00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca8071180 con 0x7f1ca813eb20 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1caee00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca8071ab0 con 0x7f1ca806c150 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1caee00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca8071460 con 0x7f1ca80b2d40 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1c9f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1ca813eb20 0x7f1ca815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50294/0 (socket says 172.21.15.52:50294) 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1c9f400640 1 -- 172.21.15.52:0/1323214341 learned_addr learned my addr 172.21.15.52:0/1323214341 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1cace00640 1 --2- 172.21.15.52:0/1323214341 >> v2:172.21.15.52:3300/0 conn(0x7f1ca806c150 0x7f1ca815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.137+0000 7f1ca7e00640 1 --2- 172.21.15.52:0/1323214341 >> v2:172.21.15.176:3300/0 conn(0x7f1ca80b2d40 0x7f1ca806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.138+0000 7f1cace00640 1 -- 172.21.15.52:0/1323214341 >> v2:172.21.15.176:3300/0 conn(0x7f1ca80b2d40 msgr2=0x7f1ca806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:17.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.138+0000 7f1cace00640 1 --2- 172.21.15.52:0/1323214341 >> v2:172.21.15.176:3300/0 conn(0x7f1ca80b2d40 0x7f1ca806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.138+0000 7f1cace00640 1 -- 172.21.15.52:0/1323214341 >> v1:172.21.15.52:6789/0 conn(0x7f1ca813eb20 legacy=0x7f1ca815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.138+0000 7f1cace00640 1 -- 172.21.15.52:0/1323214341 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca8071740 con 0x7f1ca806c150 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.138+0000 7f1ca7400640 1 -- 172.21.15.52:0/1323214341 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732664859 0 0) 0x7f1ca8071180 con 0x7f1ca813eb20 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1cace00640 1 --2- 172.21.15.52:0/1323214341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815c400 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8069be0 tx=0x7f1ca002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0897b8f6204654 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1ca7400640 1 -- 172.21.15.52:0/1323214341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007740 con 0x7f1ca806c150 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1ca7400640 1 -- 172.21.15.52:0/1323214341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca00078e0 con 0x7f1ca806c150 2024-09-10T08:43:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1ca7400640 1 -- 172.21.15.52:0/1323214341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0007cb0 con 0x7f1ca806c150 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1caee00640 1 -- 172.21.15.52:0/1323214341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 msgr2=0x7f1ca815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.139+0000 7f1caee00640 1 --2- 172.21.15.52:0/1323214341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815c400 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8069be0 tx=0x7f1ca002a680 comp rx=0 tx=0).stop 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 -- 172.21.15.52:0/1323214341 shutdown_connections 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 --2- 172.21.15.52:0/1323214341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815c400 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 --2- 172.21.15.52:0/1323214341 >> v2:172.21.15.176:3300/0 conn(0x7f1ca80b2d40 0x7f1ca806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 -- 172.21.15.52:0/1323214341 >> 172.21.15.52:0/1323214341 conn(0x7f1ca80ccec0 msgr2=0x7f1ca80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 -- 172.21.15.52:0/1323214341 shutdown_connections 2024-09-10T08:43:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.140+0000 7f1caee00640 1 -- 172.21.15.52:0/1323214341 wait complete. 2024-09-10T08:43:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.141+0000 7f1caee00640 1 Processor -- start 2024-09-10T08:43:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.141+0000 7f1caee00640 1 -- start start 2024-09-10T08:43:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ca80b2d40 0x7f1ca815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ca813eb20 0x7f1ca81f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80722d0 con 0x7f1ca806c150 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca8072150 con 0x7f1ca80b2d40 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1caee00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca8072450 con 0x7f1ca813eb20 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.142+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54162/0 (socket says 172.21.15.52:54162) 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 -- 172.21.15.52:0/327995969 learned_addr learned my addr 172.21.15.52:0/327995969 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1c9f400640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ca80b2d40 0x7f1ca815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1cace00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ca813eb20 0x7f1ca81f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 -- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ca813eb20 msgr2=0x7f1ca81f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ca813eb20 0x7f1ca81f0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 -- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ca80b2d40 msgr2=0x7f1ca815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ca80b2d40 0x7f1ca815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 -- 172.21.15.52:0/327995969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca815eb70 con 0x7f1ca806c150 2024-09-10T08:43:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca7e00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e9b0 tx=0x7f1c9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.143+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98017070 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.144+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9800c9a0 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.144+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800cd90 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.144+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca815ee10 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.144+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca812d570 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.145+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca806bc10 con 0x7f1ca806c150 2024-09-10T08:43:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.146+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c9801a070 con 0x7f1ca806c150 2024-09-10T08:43:17.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.147+0000 7f1ca4c00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 0x7f1c8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.147+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f1c9808af60 con 0x7f1ca806c150 2024-09-10T08:43:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.147+0000 7f1c9f400640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 0x7f1c8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.148+0000 7f1c9f400640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 0x7f1c8406e320 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80ccb30 tx=0x7f1c90007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.151+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c98059870 con 0x7f1ca806c150 2024-09-10T08:43:17.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.338+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ca806c9c0 con 0x7f1ca806c150 2024-09-10T08:43:17.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.339+0000 7f1ca4c00640 1 -- 172.21.15.52:0/327995969 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) ==== 74+0+16755 (secure 0 0 0) 0x7f1c98059170 con 0x7f1ca806c150 2024-09-10T08:43:17.340 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:17.340 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":195,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:30.360232+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:42:26.587832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-10T08:42:27.779046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:43:17.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 msgr2=0x7f1c8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 0x7f1c8406e320 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80ccb30 tx=0x7f1c90007c00 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 msgr2=0x7f1ca815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800e9b0 tx=0x7f1c9800ee70 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 shutdown_connections 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f1c8406be60 0x7f1c8406e320 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1ca813eb20 0x7f1ca81f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1ca80b2d40 0x7f1ca815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 --2- 172.21.15.52:0/327995969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ca806c150 0x7f1ca815cac0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 >> 172.21.15.52:0/327995969 conn(0x7f1ca80ccec0 msgr2=0x7f1ca8140900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:17.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 shutdown_connections 2024-09-10T08:43:17.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.342+0000 7f1caee00640 1 -- 172.21.15.52:0/327995969 wait complete. 2024-09-10T08:43:17.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:43:17.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:17.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.516+0000 7f0019400640 1 Processor -- start 2024-09-10T08:43:17.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.516+0000 7f0019400640 1 -- start start 2024-09-10T08:43:17.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 0x7f0014070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014148260 0x7f00140714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f001406bc10 0x7f001406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f001406c5b0 con 0x7f001406bc10 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0014074200 con 0x7f0014147e80 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0019400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f00140b3e40 con 0x7f0014148260 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0013200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f001406bc10 0x7f001406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0013200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f001406bc10 0x7f001406c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54176/0 (socket says 172.21.15.52:54176) 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0013200640 1 -- 172.21.15.52:0/2295968989 learned_addr learned my addr 172.21.15.52:0/2295968989 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f0012800640 1 --2- 172.21.15.52:0/2295968989 >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 0x7f0014070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.518+0000 7f000be00640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014148260 0x7f00140714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0013200640 1 -- 172.21.15.52:0/2295968989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014148260 msgr2=0x7f00140714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0013200640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014148260 0x7f00140714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0013200640 1 -- 172.21.15.52:0/2295968989 >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 msgr2=0x7f0014070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:17.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0013200640 1 --2- 172.21.15.52:0/2295968989 >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 0x7f0014070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0013200640 1 -- 172.21.15.52:0/2295968989 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0014071b30 con 0x7f001406bc10 2024-09-10T08:43:17.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.519+0000 7f0012800640 1 --2- 172.21.15.52:0/2295968989 >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 0x7f0014070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:17.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0013200640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001406bc10 0x7f001406c070 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f00140d1500 tx=0x7f000c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d1d6158d353dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0011e00640 1 -- 172.21.15.52:0/2295968989 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036070 con 0x7f001406bc10 2024-09-10T08:43:17.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0011e00640 1 -- 172.21.15.52:0/2295968989 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031600 con 0x7f001406bc10 2024-09-10T08:43:17.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0011e00640 1 -- 172.21.15.52:0/2295968989 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0319d0 con 0x7f001406bc10 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0019400640 1 -- 172.21.15.52:0/2295968989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001406bc10 msgr2=0x7f001406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.520+0000 7f0019400640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001406bc10 0x7f001406c070 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f00140d1500 tx=0x7f000c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 -- 172.21.15.52:0/2295968989 shutdown_connections 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001406bc10 0x7f001406c070 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 --2- 172.21.15.52:0/2295968989 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014148260 0x7f00140714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 --2- 172.21.15.52:0/2295968989 >> v2:172.21.15.176:3300/0 conn(0x7f0014147e80 0x7f0014070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 -- 172.21.15.52:0/2295968989 >> 172.21.15.52:0/2295968989 conn(0x7f00140ccec0 msgr2=0x7f00140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 -- 172.21.15.52:0/2295968989 shutdown_connections 2024-09-10T08:43:17.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.521+0000 7f0019400640 1 -- 172.21.15.52:0/2295968989 wait complete. 2024-09-10T08:43:17.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.522+0000 7f0019400640 1 Processor -- start 2024-09-10T08:43:17.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.522+0000 7f0019400640 1 -- start start 2024-09-10T08:43:17.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001406bc10 0x7f00141f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014147e80 0x7f0014140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00140b3ad0 con 0x7f0014148260 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f00140b37f0 con 0x7f001406bc10 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.523+0000 7f0019400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f00141623c0 con 0x7f0014147e80 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54184/0 (socket says 172.21.15.52:54184) 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 -- 172.21.15.52:0/1418903458 learned_addr learned my addr 172.21.15.52:0/1418903458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0012800640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001406bc10 0x7f00141f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f000be00640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014147e80 0x7f0014140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 -- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014147e80 msgr2=0x7f0014140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014147e80 0x7f0014140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 -- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001406bc10 msgr2=0x7f00141f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001406bc10 0x7f00141f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.524+0000 7f0013200640 1 -- 172.21.15.52:0/1418903458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001413e1b0 con 0x7f0014148260 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f0013200640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f000c009f40 tx=0x7f000c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036050 con 0x7f0014148260 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001413e470 con 0x7f0014148260 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c042070 con 0x7f0014148260 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c009510 con 0x7f0014148260 2024-09-10T08:43:17.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.525+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001413ea30 con 0x7f0014148260 2024-09-10T08:43:17.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.526+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001406c070 con 0x7f0014148260 2024-09-10T08:43:17.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.527+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f000c007bf0 con 0x7f0014148260 2024-09-10T08:43:17.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.528+0000 7f000aa00640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 0x7efff006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.528+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f000c0abaf0 con 0x7f0014148260 2024-09-10T08:43:17.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.528+0000 7f0012800640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 0x7efff006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.529+0000 7f0012800640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 0x7efff006e320 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0004009560 tx=0x7f0004009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.532+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f000c079dc0 con 0x7f0014148260 2024-09-10T08:43:17.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.755+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00140cfbd0 con 0x7f0014148260 2024-09-10T08:43:17.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.755+0000 7f000aa00640 1 -- 172.21.15.52:0/1418903458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7f000c07e0c0 con 0x7f0014148260 2024-09-10T08:43:17.757 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:43:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.757+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 msgr2=0x7efff006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.757+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 0x7efff006e320 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0004009560 tx=0x7f0004009190 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.757+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 msgr2=0x7f0014142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.757+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f000c009f40 tx=0x7f000c004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 shutdown_connections 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7efff006be60 0x7efff006e320 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0014148260 0x7f0014142c30 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0014147e80 0x7f0014140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 --2- 172.21.15.52:0/1418903458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001406bc10 0x7f00141f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 >> 172.21.15.52:0/1418903458 conn(0x7f00140ccec0 msgr2=0x7f00140723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 shutdown_connections 2024-09-10T08:43:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.758+0000 7f0019400640 1 -- 172.21.15.52:0/1418903458 wait complete. 2024-09-10T08:43:17.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.930+0000 7faed9000640 1 Processor -- start 2024-09-10T08:43:17.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.930+0000 7faed9000640 1 -- start start 2024-09-10T08:43:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed9000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faed40b2980 0x7faed415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed9000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed415af40 con 0x7faed415ab60 2024-09-10T08:43:17.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed9000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed40b4dc0 con 0x7faed40cf4a0 2024-09-10T08:43:17.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed9000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7faed40b50a0 con 0x7faed40b2980 2024-09-10T08:43:17.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed3400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7faed415ab60 0x7faed40ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50298/0 (socket says 172.21.15.52:50298) 2024-09-10T08:43:17.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.931+0000 7faed3400640 1 -- 172.21.15.52:0/347165990 learned_addr learned my addr 172.21.15.52:0/347165990 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed3e00640 1 --2- 172.21.15.52:0/347165990 >> v2:172.21.15.176:3300/0 conn(0x7faed40b2980 0x7faed415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed2a00640 1 -- 172.21.15.52:0/347165990 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806121892 0 0) 0x7faed415af40 con 0x7faed415ab60 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed2a00640 1 -- 172.21.15.52:0/347165990 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb8003520 con 0x7faed415ab60 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed3e00640 1 -- 172.21.15.52:0/347165990 >> v1:172.21.15.176:6789/0 conn(0x7faed40cf4a0 legacy=0x7faed415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed3e00640 1 -- 172.21.15.52:0/347165990 >> v1:172.21.15.52:6789/0 conn(0x7faed415ab60 legacy=0x7faed40ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.932+0000 7faed3e00640 1 -- 172.21.15.52:0/347165990 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed40b5380 con 0x7faed40b2980 2024-09-10T08:43:17.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.933+0000 7faed3e00640 1 --2- 172.21.15.52:0/347165990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed415ba20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d90 tx=0x7faecc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e5f988212dc5cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.933+0000 7faed2a00640 1 -- 172.21.15.52:0/347165990 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc007740 con 0x7faed40b2980 2024-09-10T08:43:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.933+0000 7faed2a00640 1 -- 172.21.15.52:0/347165990 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faecc0078e0 con 0x7faed40b2980 2024-09-10T08:43:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.933+0000 7faed2a00640 1 -- 172.21.15.52:0/347165990 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc007cb0 con 0x7faed40b2980 2024-09-10T08:43:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 -- 172.21.15.52:0/347165990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 msgr2=0x7faed415ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 --2- 172.21.15.52:0/347165990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed415ba20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faecc009d90 tx=0x7faecc02a6f0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 -- 172.21.15.52:0/347165990 shutdown_connections 2024-09-10T08:43:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 --2- 172.21.15.52:0/347165990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed415ba20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 -- 172.21.15.52:0/347165990 >> 172.21.15.52:0/347165990 conn(0x7faed406c240 msgr2=0x7faed406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 -- 172.21.15.52:0/347165990 shutdown_connections 2024-09-10T08:43:17.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.934+0000 7faed9000640 1 -- 172.21.15.52:0/347165990 wait complete. 2024-09-10T08:43:17.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.936+0000 7faed9000640 1 Processor -- start 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.936+0000 7faed9000640 1 -- start start 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed4144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed40cf4a0 0x7faed40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faed40b5cb0 con 0x7faed415ab60 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faed40b4a40 con 0x7faed40b2980 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed9000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7faed40b5e30 con 0x7faed40cf4a0 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54196/0 (socket says 172.21.15.52:54196) 2024-09-10T08:43:17.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 -- 172.21.15.52:0/4189914700 learned_addr learned my addr 172.21.15.52:0/4189914700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3400640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed4144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faecaa00640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed40cf4a0 0x7faed40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 -- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed40cf4a0 msgr2=0x7faed40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed40cf4a0 0x7faed40cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 -- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 msgr2=0x7faed4144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed4144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.937+0000 7faed3e00640 1 -- 172.21.15.52:0/4189914700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed414a120 con 0x7faed415ab60 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faed3e00640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7faecc009eb0 tx=0x7faecc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc03f070 con 0x7faed415ab60 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faecc031bc0 con 0x7faed415ab60 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc009450 con 0x7faed415ab60 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed4148b40 con 0x7faed415ab60 2024-09-10T08:43:17.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.938+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed4149100 con 0x7faed415ab60 2024-09-10T08:43:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.939+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed40ced90 con 0x7faed415ab60 2024-09-10T08:43:17.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.940+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faecc03b410 con 0x7faed415ab60 2024-09-10T08:43:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.942+0000 7faecbe00640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 0x7faeb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.942+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7faecc0ac4d0 con 0x7faed415ab60 2024-09-10T08:43:17.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.942+0000 7faed3400640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 0x7faeb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:17.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.943+0000 7faed3400640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 0x7faeb006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faec40011e0 tx=0x7faec4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:17.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:17.946+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faecc07ae70 con 0x7faed415ab60 2024-09-10T08:43:18.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.165+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faed415c6a0 con 0x7faed415ab60 2024-09-10T08:43:18.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.166+0000 7faecbe00640 1 -- 172.21.15.52:0/4189914700 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) ==== 95+0+5244 (secure 0 0 0) 0x7faecc07a770 con 0x7faed415ab60 2024-09-10T08:43:18.167 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:18.167 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":149,"btime":"2024-09-10T08:42:32:375683+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:42:28.780680+0000","modified":"2024-09-10T08:42:31.798157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10566":{"gid":10566,"name":"c","rank":0,"incarnation":145,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6834/1114908011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1114908011},{"type":"v1","addr":"172.21.15.52:6834","nonce":1114908011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10566,"qdb_cluster":[10566]},"id":14}]} 2024-09-10T08:43:18.167 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 149 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 msgr2=0x7faeb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 0x7faeb006e2f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faec40011e0 tx=0x7faec4007d30 comp rx=0 tx=0).stop 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 msgr2=0x7faed415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7faecc009eb0 tx=0x7faecc004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 shutdown_connections 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7faeb006be30 0x7faeb006e2f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed415ab60 0x7faed415d310 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed40cf4a0 0x7faed40cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 --2- 172.21.15.52:0/4189914700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed40b2980 0x7faed4144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 >> 172.21.15.52:0/4189914700 conn(0x7faed406c240 msgr2=0x7faed4154100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:18.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 shutdown_connections 2024-09-10T08:43:18.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.168+0000 7faed9000640 1 -- 172.21.15.52:0/4189914700 wait complete. 2024-09-10T08:43:18.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:43:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.341+0000 7f318c200640 1 Processor -- start 2024-09-10T08:43:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.341+0000 7f318c200640 1 -- start start 2024-09-10T08:43:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318415e6d0 0x7f3184071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f318406cd20 0x7f31840b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3184070b80 0x7f31840b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f31840b77e0 con 0x7f3184070b80 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f318415eab0 con 0x7f318406cd20 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.342+0000 7f318c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f318415ed70 con 0x7f318415e6d0 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3184070b80 0x7f31840b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3184070b80 0x7f31840b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54204/0 (socket says 172.21.15.52:54204) 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 -- 172.21.15.52:0/1566244061 learned_addr learned my addr 172.21.15.52:0/1566244061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f3188e00640 1 --2- 172.21.15.52:0/1566244061 >> v2:172.21.15.176:3300/0 conn(0x7f318406cd20 0x7f31840b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f3189800640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318415e6d0 0x7f3184071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 -- 172.21.15.52:0/1566244061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318415e6d0 msgr2=0x7f3184071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318415e6d0 0x7f3184071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 -- 172.21.15.52:0/1566244061 >> v2:172.21.15.176:3300/0 conn(0x7f318406cd20 msgr2=0x7f31840b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 --2- 172.21.15.52:0/1566244061 >> v2:172.21.15.176:3300/0 conn(0x7f318406cd20 0x7f31840b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.343+0000 7f318a200640 1 -- 172.21.15.52:0/1566244061 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318415f050 con 0x7f3184070b80 2024-09-10T08:43:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.344+0000 7f318a200640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f31840b72a0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f31840d32f0 tx=0x7f317c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccb1eb7c3706ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.344+0000 7f3183e00640 1 -- 172.21.15.52:0/1566244061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c036070 con 0x7f3184070b80 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.344+0000 7f3183e00640 1 -- 172.21.15.52:0/1566244061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c031600 con 0x7f3184070b80 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.344+0000 7f3183e00640 1 -- 172.21.15.52:0/1566244061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0319d0 con 0x7f3184070b80 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 -- 172.21.15.52:0/1566244061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 msgr2=0x7f31840b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f31840b72a0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f31840d32f0 tx=0x7f317c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 -- 172.21.15.52:0/1566244061 shutdown_connections 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 --2- 172.21.15.52:0/1566244061 >> v2:172.21.15.176:3300/0 conn(0x7f318406cd20 0x7f31840b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f31840b72a0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 --2- 172.21.15.52:0/1566244061 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318415e6d0 0x7f3184071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 -- 172.21.15.52:0/1566244061 >> 172.21.15.52:0/1566244061 conn(0x7f3184067fb0 msgr2=0x7f318406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 -- 172.21.15.52:0/1566244061 shutdown_connections 2024-09-10T08:43:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.345+0000 7f318c200640 1 -- 172.21.15.52:0/1566244061 wait complete. 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.347+0000 7f318c200640 1 Processor -- start 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.347+0000 7f318c200640 1 -- start start 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318406cd20 0x7f318414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318415e6d0 0x7f3184158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f318415f8f0 con 0x7f3184070b80 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f318415f610 con 0x7f318415e6d0 2024-09-10T08:43:18.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318c200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f31840718d0 con 0x7f318406cd20 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f3188e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f3188e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54214/0 (socket says 172.21.15.52:54214) 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f3188e00640 1 -- 172.21.15.52:0/126111023 learned_addr learned my addr 172.21.15.52:0/126111023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f3189800640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318406cd20 0x7f318414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.348+0000 7f318a200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318415e6d0 0x7f3184158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 -- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318406cd20 msgr2=0x7f318414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318406cd20 0x7f318414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 -- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318415e6d0 msgr2=0x7f3184158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318415e6d0 0x7f3184158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 -- 172.21.15.52:0/126111023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318414c9f0 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3188e00640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f317000e870 tx=0x7f317000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170017070 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317000ee60 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317000cb00 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318414ccd0 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.349+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318414d570 con 0x7f3184070b80 2024-09-10T08:43:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.350+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318414cea0 con 0x7f3184070b80 2024-09-10T08:43:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.351+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f317001a070 con 0x7f3184070b80 2024-09-10T08:43:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.352+0000 7f3181600640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 0x7f316406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.352+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f317008aff0 con 0x7f3184070b80 2024-09-10T08:43:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.353+0000 7f3189800640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 0x7f316406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.353+0000 7f3189800640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 0x7f316406e2f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ac0 tx=0x7f3178009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.356+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31700592d0 con 0x7f3184070b80 2024-09-10T08:43:18.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.543+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3184071390 con 0x7f3184070b80 2024-09-10T08:43:18.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.544+0000 7f3181600640 1 -- 172.21.15.52:0/126111023 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) ==== 74+0+16755 (secure 0 0 0) 0x7f317005d5d0 con 0x7f3184070b80 2024-09-10T08:43:18.545 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:18.545 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":195,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:42:30.360232+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:42:26.587832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-10T08:42:27.779046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 msgr2=0x7f316406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 0x7f316406e2f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ac0 tx=0x7f3178009190 comp rx=0 tx=0).stop 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 msgr2=0x7f318414a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f317000e870 tx=0x7f317000ed30 comp rx=0 tx=0).stop 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 shutdown_connections 2024-09-10T08:43:18.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f316406be30 0x7f316406e2f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318415e6d0 0x7f3184158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3184070b80 0x7f318414a1b0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 --2- 172.21.15.52:0/126111023 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f318406cd20 0x7f318414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 >> 172.21.15.52:0/126111023 conn(0x7f3184067fb0 msgr2=0x7f31840b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.546+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 shutdown_connections 2024-09-10T08:43:18.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.547+0000 7f318c200640 1 -- 172.21.15.52:0/126111023 wait complete. 2024-09-10T08:43:18.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:43:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.721+0000 7f0f8a600640 1 Processor -- start 2024-09-10T08:43:18.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.721+0000 7f0f8a600640 1 -- start start 2024-09-10T08:43:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f8a600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0f840b2170 0x7f0f84072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f8a600640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0f8406f2a0 0x7f0f84073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f8a600640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f840aef80 con 0x7f0f8415e870 2024-09-10T08:43:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f8a600640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0f84071c00 con 0x7f0f8406f2a0 2024-09-10T08:43:18.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f8a600640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f0f8415f6e0 con 0x7f0f840b2170 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f89200640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0f8415e870 0x7f0f840ae870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50302/0 (socket says 172.21.15.52:50302) 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f89200640 1 -- 172.21.15.52:0/308475465 learned_addr learned my addr 172.21.15.52:0/308475465 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.722+0000 7f0f89c00640 1 --2- 172.21.15.52:0/308475465 >> v2:172.21.15.52:3300/0 conn(0x7f0f8406f2a0 0x7f0f84073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f83e00640 1 --2- 172.21.15.52:0/308475465 >> v2:172.21.15.176:3300/0 conn(0x7f0f840b2170 0x7f0f84072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f83400640 1 -- 172.21.15.52:0/308475465 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129334565 0 0) 0x7f0f840aef80 con 0x7f0f8415e870 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f83400640 1 -- 172.21.15.52:0/308475465 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6c003520 con 0x7f0f8415e870 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f89c00640 1 -- 172.21.15.52:0/308475465 >> v2:172.21.15.176:3300/0 conn(0x7f0f840b2170 msgr2=0x7f0f84072cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f89c00640 1 --2- 172.21.15.52:0/308475465 >> v2:172.21.15.176:3300/0 conn(0x7f0f840b2170 0x7f0f84072cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f89c00640 1 -- 172.21.15.52:0/308475465 >> v1:172.21.15.52:6789/0 conn(0x7f0f8415e870 legacy=0x7f0f840ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.723+0000 7f0f89c00640 1 -- 172.21.15.52:0/308475465 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8415f9c0 con 0x7f0f8406f2a0 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.724+0000 7f0f89c00640 1 --2- 172.21.15.52:0/308475465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f8406f2a0 0x7f0f84073210 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0f84075f70 tx=0x7f0f7c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba80f01fe42ba99 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.724+0000 7f0f83400640 1 -- 172.21.15.52:0/308475465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c007740 con 0x7f0f8406f2a0 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.724+0000 7f0f83400640 1 -- 172.21.15.52:0/308475465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0078e0 con 0x7f0f8406f2a0 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.724+0000 7f0f83400640 1 -- 172.21.15.52:0/308475465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c007cb0 con 0x7f0f8406f2a0 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 -- 172.21.15.52:0/308475465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f8406f2a0 msgr2=0x7f0f84073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 --2- 172.21.15.52:0/308475465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f8406f2a0 0x7f0f84073210 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0f84075f70 tx=0x7f0f7c02a560 comp rx=0 tx=0).stop 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 -- 172.21.15.52:0/308475465 shutdown_connections 2024-09-10T08:43:18.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 --2- 172.21.15.52:0/308475465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f8406f2a0 0x7f0f84073210 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 --2- 172.21.15.52:0/308475465 >> v2:172.21.15.176:3300/0 conn(0x7f0f840b2170 0x7f0f84072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 -- 172.21.15.52:0/308475465 >> 172.21.15.52:0/308475465 conn(0x7f0f840b0640 msgr2=0x7f0f840b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 -- 172.21.15.52:0/308475465 shutdown_connections 2024-09-10T08:43:18.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.725+0000 7f0f8a600640 1 -- 172.21.15.52:0/308475465 wait complete. 2024-09-10T08:43:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.726+0000 7f0f8a600640 1 Processor -- start 2024-09-10T08:43:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.726+0000 7f0f8a600640 1 -- start start 2024-09-10T08:43:18.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8406f2a0 0x7f0f841f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 0x7f0f840b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84067fa0 con 0x7f0f840b2170 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84067e20 con 0x7f0f8415d490 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.727+0000 7f0f8a600640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f0f84072090 con 0x7f0f8406f2a0 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54232/0 (socket says 172.21.15.52:54232) 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 -- 172.21.15.52:0/797812103 learned_addr learned my addr 172.21.15.52:0/797812103 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f89200640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8406f2a0 0x7f0f841f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f89c00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 0x7f0f840b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 -- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8406f2a0 msgr2=0x7f0f841f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8406f2a0 0x7f0f841f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 -- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 msgr2=0x7f0f840b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 0x7f0f840b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 -- 172.21.15.52:0/797812103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f841f75d0 con 0x7f0f840b2170 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f89c00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 0x7f0f840b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.728+0000 7f0f83e00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e9b0 tx=0x7f0f7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.729+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70017070 con 0x7f0f840b2170 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.729+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7000c9a0 con 0x7f0f840b2170 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.729+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f841f3e90 con 0x7f0f840b2170 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.729+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000cd90 con 0x7f0f840b2170 2024-09-10T08:43:18.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.729+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f841f7870 con 0x7f0f840b2170 2024-09-10T08:43:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.730+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f84072be0 con 0x7f0f840b2170 2024-09-10T08:43:18.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.731+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f7001a070 con 0x7f0f840b2170 2024-09-10T08:43:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.732+0000 7f0f80c00640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.732+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7008af40 con 0x7f0f840b2170 2024-09-10T08:43:18.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.733+0000 7f0f89200640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:18.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.733+0000 7f0f89200640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 0x7f0f6406e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0f78005880 tx=0x7f0f78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:18.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.737+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f70059850 con 0x7f0f840b2170 2024-09-10T08:43:18.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.962+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0f840b0df0 con 0x7f0f840b2170 2024-09-10T08:43:18.963 INFO:tasks.ceph.mon.a.smithi052.stderr:2024-09-10T08:43:18.963+0000 7f82aa600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:43:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.965+0000 7f0f80c00640 1 -- 172.21.15.52:0/797812103 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v150) ==== 161+0+0 (secure 0 0 0) 0x7f0f70059150 con 0x7f0f840b2170 2024-09-10T08:43:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:43:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 msgr2=0x7f0f6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 0x7f0f6406e2f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0f78005880 tx=0x7f0f78009040 comp rx=0 tx=0).stop 2024-09-10T08:43:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 msgr2=0x7f0f840b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e9b0 tx=0x7f0f7000ee70 comp rx=0 tx=0).stop 2024-09-10T08:43:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 shutdown_connections 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f0f6406be30 0x7f0f6406e2f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0f8415d490 0x7f0f840b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f840b2170 0x7f0f840b4b50 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 --2- 172.21.15.52:0/797812103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0f8406f2a0 0x7f0f841f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 >> 172.21.15.52:0/797812103 conn(0x7f0f840b0640 msgr2=0x7f0f840b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 shutdown_connections 2024-09-10T08:43:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:18.968+0000 7f0f8a600640 1 -- 172.21.15.52:0/797812103 wait complete. 2024-09-10T08:43:18.978 INFO:tasks.ceph.mds.c.smithi052.stderr: -6396> 2024-09-10T08:42:34.928+0000 7f087aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:43:18.983 INFO:tasks.ceph.mds.c.smithi052.stderr: -3207> 2024-09-10T08:42:43.228+0000 7f0875a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-10T08:42:41.849085+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={9859=0-12582912@1} caps={9859=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=9859 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5555ac6b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T08:43:18.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:43:19.032 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2024-09-10T08:43:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.145+0000 7fe628800640 1 Processor -- start 2024-09-10T08:43:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.145+0000 7fe628800640 1 -- start start 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe628800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe6200cce30 0x7fe6200cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe628800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe620071c70 0x7fe6200720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe628800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6200714b0 con 0x7fe6200732e0 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe628800640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe6200cd880 con 0x7fe620071c70 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe628800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fe6200cdb60 con 0x7fe6200cce30 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe625e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe6200732e0 0x7fe6200736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50316/0 (socket says 172.21.15.52:50316) 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe625e00640 1 -- 172.21.15.52:0/1369765267 learned_addr learned my addr 172.21.15.52:0/1369765267 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.146+0000 7fe626800640 1 --2- 172.21.15.52:0/1369765267 >> v2:172.21.15.52:3300/0 conn(0x7fe620071c70 0x7fe6200720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe625400640 1 --2- 172.21.15.52:0/1369765267 >> v2:172.21.15.176:3300/0 conn(0x7fe6200cce30 0x7fe6200cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe624a00640 1 -- 172.21.15.52:0/1369765267 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320844284 0 0) 0x7fe6200714b0 con 0x7fe6200732e0 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe624a00640 1 -- 172.21.15.52:0/1369765267 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe608003520 con 0x7fe6200732e0 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe626800640 1 -- 172.21.15.52:0/1369765267 >> v2:172.21.15.176:3300/0 conn(0x7fe6200cce30 msgr2=0x7fe6200cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe626800640 1 --2- 172.21.15.52:0/1369765267 >> v2:172.21.15.176:3300/0 conn(0x7fe6200cce30 0x7fe6200cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe626800640 1 -- 172.21.15.52:0/1369765267 >> v1:172.21.15.52:6789/0 conn(0x7fe6200732e0 legacy=0x7fe6200736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.147+0000 7fe626800640 1 -- 172.21.15.52:0/1369765267 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6200cde40 con 0x7fe620071c70 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.148+0000 7fe626800640 1 --2- 172.21.15.52:0/1369765267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe620071c70 0x7fe6200720c0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fe6200c57f0 tx=0x7fe61c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f60bbb1f21b88d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.148+0000 7fe624a00640 1 -- 172.21.15.52:0/1369765267 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007740 con 0x7fe620071c70 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.148+0000 7fe624a00640 1 -- 172.21.15.52:0/1369765267 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61c0078e0 con 0x7fe620071c70 2024-09-10T08:43:19.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.148+0000 7fe624a00640 1 -- 172.21.15.52:0/1369765267 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c007c90 con 0x7fe620071c70 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 -- 172.21.15.52:0/1369765267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe620071c70 msgr2=0x7fe6200720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 --2- 172.21.15.52:0/1369765267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe620071c70 0x7fe6200720c0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fe6200c57f0 tx=0x7fe61c02a5f0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 -- 172.21.15.52:0/1369765267 shutdown_connections 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 --2- 172.21.15.52:0/1369765267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe620071c70 0x7fe6200720c0 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 --2- 172.21.15.52:0/1369765267 >> v2:172.21.15.176:3300/0 conn(0x7fe6200cce30 0x7fe6200cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 -- 172.21.15.52:0/1369765267 >> 172.21.15.52:0/1369765267 conn(0x7fe62006d0f0 msgr2=0x7fe62006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 -- 172.21.15.52:0/1369765267 shutdown_connections 2024-09-10T08:43:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.149+0000 7fe628800640 1 -- 172.21.15.52:0/1369765267 wait complete. 2024-09-10T08:43:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.151+0000 7fe628800640 1 Processor -- start 2024-09-10T08:43:19.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.151+0000 7fe628800640 1 -- start start 2024-09-10T08:43:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.151+0000 7fe628800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe620071c70 0x7fe62014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe628800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe628800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 0x7fe620155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe628800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe62015ca50 con 0x7fe6200732e0 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe628800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe62015c8d0 con 0x7fe620071c70 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe628800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fe62015cbd0 con 0x7fe6200cce30 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54258/0 (socket says 172.21.15.52:54258) 2024-09-10T08:43:19.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 -- 172.21.15.52:0/793428176 learned_addr learned my addr 172.21.15.52:0/793428176 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625e00640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe620071c70 0x7fe62014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe626800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 0x7fe620155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 -- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 msgr2=0x7fe620155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 0x7fe620155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 -- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe620071c70 msgr2=0x7fe62014e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe620071c70 0x7fe62014e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe625400640 1 -- 172.21.15.52:0/793428176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe620154ed0 con 0x7fe6200732e0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.152+0000 7fe626800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 0x7fe620155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe625400640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fe61000e8a0 tx=0x7fe61000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610017070 con 0x7fe6200732e0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61000c940 con 0x7fe6200732e0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe620155170 con 0x7fe6200732e0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61000cd30 con 0x7fe6200732e0 2024-09-10T08:43:19.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.153+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe620155730 con 0x7fe6200732e0 2024-09-10T08:43:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.154+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6200cd2a0 con 0x7fe6200732e0 2024-09-10T08:43:19.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.155+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe61001a070 con 0x7fe6200732e0 2024-09-10T08:43:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.156+0000 7fe61a000640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:19.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.156+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5795+0+0 (secure 0 0 0) 0x7fe61008ace0 con 0x7fe6200732e0 2024-09-10T08:43:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.157+0000 7fe625e00640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.157+0000 7fe625e00640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe614005880 tx=0x7fe614009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:19.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.160+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe610058fd0 con 0x7fe6200732e0 2024-09-10T08:43:19.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.382+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe6200711f0 con 0x7fe6200732e0 2024-09-10T08:43:19.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.970+0000 7fe61a000640 1 -- 172.21.15.52:0/793428176 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v151) ==== 104+0+0 (secure 0 0 0) 0x7fe61005d2d0 con 0x7fe6200732e0 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 msgr2=0x7fe60406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe614005880 tx=0x7fe614009040 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 msgr2=0x7fe6200cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fe61000e8a0 tx=0x7fe61000ed60 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 shutdown_connections 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fe60406be30 0x7fe60406e2f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6200cce30 0x7fe620155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6200732e0 0x7fe6200cfa80 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 --2- 172.21.15.52:0/793428176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe620071c70 0x7fe62014e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 >> 172.21.15.52:0/793428176 conn(0x7fe62006d0f0 msgr2=0x7fe6200b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:19.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 shutdown_connections 2024-09-10T08:43:19.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:19.973+0000 7fe628800640 1 -- 172.21.15.52:0/793428176 wait complete. 2024-09-10T08:43:19.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:43:20.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.194+0000 7f4e76a00640 1 Processor -- start 2024-09-10T08:43:20.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.194+0000 7f4e76a00640 1 -- start start 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e76a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e7015eb90 0x7f4e700b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e76a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4e7006bff0 0x7f4e7006c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e76a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e700d2dc0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e76a00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7006c9a0 con 0x7f4e7015eb90 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e76a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700d39d0 con 0x7f4e7006bff0 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e75600640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4e7015e7b0 0x7f4e700d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50318/0 (socket says 172.21.15.52:50318) 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e75600640 1 -- 172.21.15.52:0/1955317190 learned_addr learned my addr 172.21.15.52:0/1955317190 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.195+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1955317190 >> v2:172.21.15.52:3300/0 conn(0x7f4e7015eb90 0x7f4e700b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e76000640 1 --2- 172.21.15.52:0/1955317190 >> v2:172.21.15.176:3300/0 conn(0x7f4e7006bff0 0x7f4e7006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e6fe00640 1 -- 172.21.15.52:0/1955317190 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548000458 0 0) 0x7f4e700d2dc0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e6fe00640 1 -- 172.21.15.52:0/1955317190 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e58003520 con 0x7f4e7015e7b0 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e74c00640 1 -- 172.21.15.52:0/1955317190 >> v2:172.21.15.176:3300/0 conn(0x7f4e7006bff0 msgr2=0x7f4e7006c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1955317190 >> v2:172.21.15.176:3300/0 conn(0x7f4e7006bff0 0x7f4e7006c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e74c00640 1 -- 172.21.15.52:0/1955317190 >> v1:172.21.15.52:6789/0 conn(0x7f4e7015e7b0 legacy=0x7f4e700d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.196+0000 7f4e74c00640 1 -- 172.21.15.52:0/1955317190 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700d30a0 con 0x7f4e7015eb90 2024-09-10T08:43:20.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.197+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1955317190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015eb90 0x7f4e700b9f50 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4e700cb450 tx=0x7f4e5c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538f936c1ff23d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:20.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.197+0000 7f4e6fe00640 1 -- 172.21.15.52:0/1955317190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c037070 con 0x7f4e7015eb90 2024-09-10T08:43:20.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.197+0000 7f4e6fe00640 1 -- 172.21.15.52:0/1955317190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c032440 con 0x7f4e7015eb90 2024-09-10T08:43:20.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.197+0000 7f4e6fe00640 1 -- 172.21.15.52:0/1955317190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c02ae60 con 0x7f4e7015eb90 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 -- 172.21.15.52:0/1955317190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015eb90 msgr2=0x7f4e700b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1955317190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015eb90 0x7f4e700b9f50 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4e700cb450 tx=0x7f4e5c02a110 comp rx=0 tx=0).stop 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 -- 172.21.15.52:0/1955317190 shutdown_connections 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1955317190 >> v2:172.21.15.176:3300/0 conn(0x7f4e7006bff0 0x7f4e7006c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1955317190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015eb90 0x7f4e700b9f50 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 -- 172.21.15.52:0/1955317190 >> 172.21.15.52:0/1955317190 conn(0x7f4e700b6320 msgr2=0x7f4e700b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 -- 172.21.15.52:0/1955317190 shutdown_connections 2024-09-10T08:43:20.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.198+0000 7f4e76a00640 1 -- 172.21.15.52:0/1955317190 wait complete. 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.200+0000 7f4e76a00640 1 Processor -- start 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.200+0000 7f4e76a00640 1 -- start start 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.200+0000 7f4e76a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e7006bff0 0x7f4e7015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 0x7f4e70161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700ba490 con 0x7f4e7015e7b0 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700d3660 con 0x7f4e7006bff0 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700ba610 con 0x7f4e7015eb90 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54276/0 (socket says 172.21.15.52:54276) 2024-09-10T08:43:20.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 -- 172.21.15.52:0/1739043155 learned_addr learned my addr 172.21.15.52:0/1739043155 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e75600640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e7006bff0 0x7f4e7015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76000640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 0x7f4e70161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 -- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 msgr2=0x7f4e70161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 0x7f4e70161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 -- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e7006bff0 msgr2=0x7f4e7015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e7006bff0 0x7f4e7015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e74c00640 1 -- 172.21.15.52:0/1739043155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700c84b0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.201+0000 7f4e76000640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 0x7f4e70161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:20.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e74c00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c037040 con 0x7f4e7015e7b0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c042070 con 0x7f4e7015e7b0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c030960 con 0x7f4e7015e7b0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e700cdca0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.202+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e700ce260 con 0x7f4e7015e7b0 2024-09-10T08:43:20.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.203+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70075130 con 0x7f4e7015e7b0 2024-09-10T08:43:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.204+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e5c030b00 con 0x7f4e7015e7b0 2024-09-10T08:43:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.205+0000 7f4e6d600640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 0x7f4e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:20.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.205+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5795+0+0 (secure 0 0 0) 0x7f4e5c0ab770 con 0x7f4e7015e7b0 2024-09-10T08:43:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.205+0000 7f4e75600640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 0x7f4e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:20.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.206+0000 7f4e75600640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 0x7f4e5006e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005880 tx=0x7f4e64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:20.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.209+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e5c07a1d0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.392+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e700cf650 con 0x7f4e7015e7b0 2024-09-10T08:43:20.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.972+0000 7f4e6d600640 1 -- 172.21.15.52:0/1739043155 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v197) ==== 181+0+0 (secure 0 0 0) 0x7f4e5c079ad0 con 0x7f4e7015e7b0 2024-09-10T08:43:20.973 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.976+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 msgr2=0x7f4e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.976+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 0x7f4e5006e2f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005880 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.976+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 msgr2=0x7f4e70161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.976+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 shutdown_connections 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4e5006be30 0x7f4e5006e2f0 secure :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005880 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4e7015eb90 0x7f4e70161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e7015e7b0 0x7f4e70161000 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 --2- 172.21.15.52:0/1739043155 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e7006bff0 0x7f4e7015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 >> 172.21.15.52:0/1739043155 conn(0x7f4e700b6320 msgr2=0x7f4e700b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 shutdown_connections 2024-09-10T08:43:20.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:20.977+0000 7f4e76a00640 1 -- 172.21.15.52:0/1739043155 wait complete. 2024-09-10T08:43:20.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:43:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.159+0000 7f8f25e00640 1 Processor -- start 2024-09-10T08:43:21.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.159+0000 7f8f25e00640 1 -- start start 2024-09-10T08:43:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f200d2690 0x7f8f200d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25e00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f20162040 con 0x7f8f20161c60 2024-09-10T08:43:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f8f200d5040 con 0x7f8f200d2690 2024-09-10T08:43:21.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200d5320 con 0x7f8f2006dfd0 2024-09-10T08:43:21.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f1fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f1fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:39944/0 (socket says 172.21.15.52:39944) 2024-09-10T08:43:21.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f25400640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8f200d2690 0x7f8f200d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f24a00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f8f20161c60 0x7f8f2006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:53732/0 (socket says 172.21.15.52:53732) 2024-09-10T08:43:21.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.161+0000 7f8f1fe00640 1 -- 172.21.15.52:0/427135517 learned_addr learned my addr 172.21.15.52:0/427135517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:21.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.162+0000 7f8f1f400640 1 -- 172.21.15.52:0/427135517 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54428888 0 0) 0x7f8f20162040 con 0x7f8f20161c60 2024-09-10T08:43:21.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.162+0000 7f8f1fe00640 1 -- 172.21.15.52:0/427135517 >> v2:172.21.15.176:3300/0 conn(0x7f8f200d2690 msgr2=0x7f8f200d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:21.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.162+0000 7f8f1fe00640 1 --2- 172.21.15.52:0/427135517 >> v2:172.21.15.176:3300/0 conn(0x7f8f200d2690 0x7f8f200d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.162+0000 7f8f1fe00640 1 -- 172.21.15.52:0/427135517 >> v1:172.21.15.176:6789/0 conn(0x7f8f20161c60 legacy=0x7f8f2006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.162+0000 7f8f1fe00640 1 -- 172.21.15.52:0/427135517 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200d3da0 con 0x7f8f2006dfd0 2024-09-10T08:43:21.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.163+0000 7f8f1fe00640 1 --2- 172.21.15.52:0/427135517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009870 tx=0x7f8f0c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b505710820236c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.163+0000 7f8f1f400640 1 -- 172.21.15.52:0/427135517 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c037070 con 0x7f8f2006dfd0 2024-09-10T08:43:21.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.163+0000 7f8f1f400640 1 -- 172.21.15.52:0/427135517 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c032440 con 0x7f8f2006dfd0 2024-09-10T08:43:21.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.163+0000 7f8f1f400640 1 -- 172.21.15.52:0/427135517 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c032810 con 0x7f8f2006dfd0 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 -- 172.21.15.52:0/427135517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 msgr2=0x7f8f200d2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 --2- 172.21.15.52:0/427135517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009870 tx=0x7f8f0c02a270 comp rx=0 tx=0).stop 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 -- 172.21.15.52:0/427135517 shutdown_connections 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 --2- 172.21.15.52:0/427135517 >> v2:172.21.15.176:3300/0 conn(0x7f8f200d2690 0x7f8f200d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 --2- 172.21.15.52:0/427135517 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f200d2150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 -- 172.21.15.52:0/427135517 >> 172.21.15.52:0/427135517 conn(0x7f8f200d1630 msgr2=0x7f8f200d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 -- 172.21.15.52:0/427135517 shutdown_connections 2024-09-10T08:43:21.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.164+0000 7f8f25e00640 1 -- 172.21.15.52:0/427135517 wait complete. 2024-09-10T08:43:21.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.166+0000 7f8f25e00640 1 Processor -- start 2024-09-10T08:43:21.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.166+0000 7f8f25e00640 1 -- start start 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f20156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2690 0x7f8f2015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b86c0 con 0x7f8f20161c60 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200d42c0 con 0x7f8f200d2690 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b8840 con 0x7f8f2006dfd0 2024-09-10T08:43:21.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54286/0 (socket says 172.21.15.52:54286) 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 -- 172.21.15.52:0/928822009 learned_addr learned my addr 172.21.15.52:0/928822009 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f1fe00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2690 0x7f8f2015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f24a00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f20156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 -- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 msgr2=0x7f8f20156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f20156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 -- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2690 msgr2=0x7f8f2015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2690 0x7f8f2015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.167+0000 7f8f25400640 1 -- 172.21.15.52:0/928822009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2015eb50 con 0x7f8f20161c60 2024-09-10T08:43:21.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f25400640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800efc0 tx=0x7f8f1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18018020 con 0x7f8f20161c60 2024-09-10T08:43:21.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f18014480 con 0x7f8f20161c60 2024-09-10T08:43:21.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18014870 con 0x7f8f20161c60 2024-09-10T08:43:21.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2015ab40 con 0x7f8f20161c60 2024-09-10T08:43:21.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.168+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2015b100 con 0x7f8f20161c60 2024-09-10T08:43:21.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.169+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f200c8fe0 con 0x7f8f20161c60 2024-09-10T08:43:21.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.170+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f18005d10 con 0x7f8f20161c60 2024-09-10T08:43:21.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.171+0000 7f8f1cc00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 0x7f8f0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:21.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.171+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5357+0+0 (secure 0 0 0) 0x7f8f1808b8b0 con 0x7f8f20161c60 2024-09-10T08:43:21.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.171+0000 7f8f24a00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 0x7f8f0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:21.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.172+0000 7f8f24a00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 0x7f8f0006e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000f60 tx=0x7f8f14007d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:21.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.176+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f18022070 con 0x7f8f20161c60 2024-09-10T08:43:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.361+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f200b3920 con 0x7f8f20161c60 2024-09-10T08:43:21.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.978+0000 7f8f1cc00640 1 -- 172.21.15.52:0/928822009 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v198) ==== 169+0+0 (secure 0 0 0) 0x7f8f18010040 con 0x7f8f20161c60 2024-09-10T08:43:21.978 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-10T08:43:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.982+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 msgr2=0x7f8f0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.982+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 0x7f8f0006e2f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000f60 tx=0x7f8f14007d20 comp rx=0 tx=0).stop 2024-09-10T08:43:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.982+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 msgr2=0x7f8f201567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.982+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800efc0 tx=0x7f8f1800c490 comp rx=0 tx=0).stop 2024-09-10T08:43:21.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 shutdown_connections 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f8f0006be30 0x7f8f0006e2f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20161c60 0x7f8f201567a0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f200d2690 0x7f8f2015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 --2- 172.21.15.52:0/928822009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8f2006dfd0 0x7f8f20156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.983+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 >> 172.21.15.52:0/928822009 conn(0x7f8f200d1630 msgr2=0x7f8f201576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:21.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.984+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 shutdown_connections 2024-09-10T08:43:21.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:21.984+0000 7f8f25e00640 1 -- 172.21.15.52:0/928822009 wait complete. 2024-09-10T08:43:22.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:43:22.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.170+0000 7f99bf000640 1 Processor -- start 2024-09-10T08:43:22.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.171+0000 7f99bf000640 1 -- start start 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bf000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f99b80cf8d0 0x7f99b8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bf000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99b80cfcb0 0x7f99b8071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bf000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b815f120 con 0x7f99b8144340 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bf000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f99b8141cd0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bf000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f99b815f400 con 0x7f99b80cf8d0 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99afe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99b80cfcb0 0x7f99b8071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bd000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f99b8144340 0x7f99b8144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50330/0 (socket says 172.21.15.52:50330) 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99bd000640 1 -- 172.21.15.52:0/2778577935 learned_addr learned my addr 172.21.15.52:0/2778577935 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:22.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.172+0000 7f99b7e00640 1 --2- 172.21.15.52:0/2778577935 >> v2:172.21.15.176:3300/0 conn(0x7f99b80cf8d0 0x7f99b8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.173+0000 7f99afe00640 1 -- 172.21.15.52:0/2778577935 >> v2:172.21.15.176:3300/0 conn(0x7f99b80cf8d0 msgr2=0x7f99b8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:22.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.173+0000 7f99afe00640 1 --2- 172.21.15.52:0/2778577935 >> v2:172.21.15.176:3300/0 conn(0x7f99b80cf8d0 0x7f99b8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.173+0000 7f99afe00640 1 -- 172.21.15.52:0/2778577935 >> v1:172.21.15.52:6789/0 conn(0x7f99b8144340 legacy=0x7f99b8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.173+0000 7f99afe00640 1 -- 172.21.15.52:0/2778577935 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b815f6e0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99afe00640 1 --2- 172.21.15.52:0/2778577935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b8071480 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b6700 tx=0x7f99a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90be4adab751d2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99b7400640 1 -- 172.21.15.52:0/2778577935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0037070 con 0x7f99b80cfcb0 2024-09-10T08:43:22.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99b7400640 1 -- 172.21.15.52:0/2778577935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0032440 con 0x7f99b80cfcb0 2024-09-10T08:43:22.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99b7400640 1 -- 172.21.15.52:0/2778577935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0032810 con 0x7f99b80cfcb0 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99bf000640 1 -- 172.21.15.52:0/2778577935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 msgr2=0x7f99b8071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.174+0000 7f99bf000640 1 --2- 172.21.15.52:0/2778577935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b8071480 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b6700 tx=0x7f99a002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 -- 172.21.15.52:0/2778577935 shutdown_connections 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 --2- 172.21.15.52:0/2778577935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b8071480 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 --2- 172.21.15.52:0/2778577935 >> v2:172.21.15.176:3300/0 conn(0x7f99b80cf8d0 0x7f99b8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 -- 172.21.15.52:0/2778577935 >> 172.21.15.52:0/2778577935 conn(0x7f99b806d0f0 msgr2=0x7f99b806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 -- 172.21.15.52:0/2778577935 shutdown_connections 2024-09-10T08:43:22.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.175+0000 7f99bf000640 1 -- 172.21.15.52:0/2778577935 wait complete. 2024-09-10T08:43:22.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.176+0000 7f99bf000640 1 Processor -- start 2024-09-10T08:43:22.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.176+0000 7f99bf000640 1 -- start start 2024-09-10T08:43:22.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 0x7f99b815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 0x7f99b81f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99b80ce0f0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f99b815ee30 con 0x7f99b80cf8d0 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.177+0000 7f99bf000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f99b80ce270 con 0x7f99b8144340 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54306/0 (socket says 172.21.15.52:54306) 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 -- 172.21.15.52:0/3334761068 learned_addr learned my addr 172.21.15.52:0/3334761068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99b7e00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 0x7f99b815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99bd000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 0x7f99b81f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 -- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 msgr2=0x7f99b81f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 0x7f99b81f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 -- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 msgr2=0x7f99b815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 0x7f99b815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 -- 172.21.15.52:0/3334761068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b815e060 con 0x7f99b80cfcb0 2024-09-10T08:43:22.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99bd000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 0x7f99b81f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:22.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99b7e00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 0x7f99b815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:22.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.178+0000 7f99afe00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009890 tx=0x7f99a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.179+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0037040 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.179+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0042070 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.179+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0030960 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.179+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b80ca4f0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.179+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b80caab0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.180+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b8144790 con 0x7f99b80cfcb0 2024-09-10T08:43:22.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.181+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99a0030b00 con 0x7f99b80cfcb0 2024-09-10T08:43:22.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.181+0000 7f99b4c00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 0x7f999406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.181+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f99a00ab4e0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.182+0000 7f99b7e00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 0x7f999406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.183+0000 7f99b7e00640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 0x7f999406e320 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009b90 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.185+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99a007a0f0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.370+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f99b80cdda0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.373+0000 7f99b4c00640 1 -- 172.21.15.52:0/3334761068 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f99a00799f0 con 0x7f99b80cfcb0 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 msgr2=0x7f999406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 0x7f999406e320 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009b90 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 msgr2=0x7f99b80cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009890 tx=0x7f99a00046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 shutdown_connections 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f999406be60 0x7f999406e320 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b8144340 0x7f99b81f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b80cfcb0 0x7f99b80cce20 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 --2- 172.21.15.52:0/3334761068 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b80cf8d0 0x7f99b815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 >> 172.21.15.52:0/3334761068 conn(0x7f99b806d0f0 msgr2=0x7f99b8071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 shutdown_connections 2024-09-10T08:43:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.376+0000 7f99bf000640 1 -- 172.21.15.52:0/3334761068 wait complete. 2024-09-10T08:43:22.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-10T08:43:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.549+0000 7f3ec3000640 1 Processor -- start 2024-09-10T08:43:22.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.550+0000 7f3ec3000640 1 -- start start 2024-09-10T08:43:22.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec3000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ebc0b2d40 0x7f3ebc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec3000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc071180 con 0x7f3ebc06c150 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec3000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc071460 con 0x7f3ebc13eb20 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec3000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3ebc071ab0 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ebbe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ebc0b2d40 0x7f3ebc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec1000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3ebc06c150 0x7f3ebc071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50344/0 (socket says 172.21.15.52:50344) 2024-09-10T08:43:22.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.551+0000 7f3ec1000640 1 -- 172.21.15.52:0/3105459208 learned_addr learned my addr 172.21.15.52:0/3105459208 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:22.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.552+0000 7f3ebbe00640 1 -- 172.21.15.52:0/3105459208 >> v1:172.21.15.176:6789/0 conn(0x7f3ebc13eb20 legacy=0x7f3ebc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.552+0000 7f3ebbe00640 1 -- 172.21.15.52:0/3105459208 >> v1:172.21.15.52:6789/0 conn(0x7f3ebc06c150 legacy=0x7f3ebc071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.552+0000 7f3ebbe00640 1 -- 172.21.15.52:0/3105459208 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc071740 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.552+0000 7f3ebb400640 1 -- 172.21.15.52:0/3105459208 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552940320 0 0) 0x7f3ebc071180 con 0x7f3ebc06c150 2024-09-10T08:43:22.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ebbe00640 1 --2- 172.21.15.52:0/3105459208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc0b2d40 0x7f3ebc06bc10 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097a0 tx=0x7f3eac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338f839157d034bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ebb400640 1 -- 172.21.15.52:0/3105459208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac037070 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ebb400640 1 -- 172.21.15.52:0/3105459208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eac032440 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ebb400640 1 -- 172.21.15.52:0/3105459208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eac032810 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ec3000640 1 -- 172.21.15.52:0/3105459208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc0b2d40 msgr2=0x7f3ebc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.553+0000 7f3ec3000640 1 --2- 172.21.15.52:0/3105459208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc0b2d40 0x7f3ebc06bc10 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097a0 tx=0x7f3eac02a230 comp rx=0 tx=0).stop 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.554+0000 7f3ec3000640 1 -- 172.21.15.52:0/3105459208 shutdown_connections 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.554+0000 7f3ec3000640 1 --2- 172.21.15.52:0/3105459208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc0b2d40 0x7f3ebc06bc10 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.554+0000 7f3ec3000640 1 -- 172.21.15.52:0/3105459208 >> 172.21.15.52:0/3105459208 conn(0x7f3ebc0ccec0 msgr2=0x7f3ebc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.554+0000 7f3ec3000640 1 -- 172.21.15.52:0/3105459208 shutdown_connections 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.554+0000 7f3ec3000640 1 -- 172.21.15.52:0/3105459208 wait complete. 2024-09-10T08:43:22.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.555+0000 7f3ec3000640 1 Processor -- start 2024-09-10T08:43:22.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.555+0000 7f3ec3000640 1 -- start start 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 0x7f3ebc131d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ebc0b2d40 0x7f3ebc140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc15c7d0 con 0x7f3ebc13eb20 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc15c650 con 0x7f3ebc06c150 2024-09-10T08:43:22.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.556+0000 7f3ec3000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f3ebc072650 con 0x7f3ebc0b2d40 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54330/0 (socket says 172.21.15.52:54330) 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 -- 172.21.15.52:0/2962518402 learned_addr learned my addr 172.21.15.52:0/2962518402 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ebbe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 0x7f3ebc131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3eb3400640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ebc0b2d40 0x7f3ebc140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 -- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ebc0b2d40 msgr2=0x7f3ebc140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ebc0b2d40 0x7f3ebc140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 -- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 msgr2=0x7f3ebc131d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 0x7f3ebc131d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 -- 172.21.15.52:0/2962518402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc142b30 con 0x7f3ebc13eb20 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ebbe00640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 0x7f3ebc131d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.557+0000 7f3ec1000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c7a0 tx=0x7f3eb400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.558+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4018070 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.558+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb400a640 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.558+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400aab0 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.558+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ebc142e10 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.558+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ebc1433d0 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.559+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ebc06bc10 con 0x7f3ebc13eb20 2024-09-10T08:43:22.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.560+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3eb400ac50 con 0x7f3ebc13eb20 2024-09-10T08:43:22.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.561+0000 7f3eb8c00640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 0x7f3e9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:22.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.561+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f3eb408a0f0 con 0x7f3ebc13eb20 2024-09-10T08:43:22.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.561+0000 7f3ebbe00640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 0x7f3e9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:22.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.562+0000 7f3ebbe00640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 0x7f3e9806e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3eac034000 tx=0x7f3eac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.565+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3eb4058740 con 0x7f3ebc13eb20 2024-09-10T08:43:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.816+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f3ebc0730a0 con 0x7f3ebc13eb20 2024-09-10T08:43:22.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.980+0000 7f3eb8c00640 1 -- 172.21.15.52:0/2962518402 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v681) ==== 133+0+0 (secure 0 0 0) 0x7f3eb405ca40 con 0x7f3ebc13eb20 2024-09-10T08:43:22.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 msgr2=0x7f3e9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 0x7f3e9806e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3eac034000 tx=0x7f3eac02e000 comp rx=0 tx=0).stop 2024-09-10T08:43:22.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 msgr2=0x7f3ebc156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:22.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c7a0 tx=0x7f3eb400cc60 comp rx=0 tx=0).stop 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 shutdown_connections 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f3e9806be30 0x7f3e9806e2f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ebc13eb20 0x7f3ebc156320 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3ebc0b2d40 0x7f3ebc140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 --2- 172.21.15.52:0/2962518402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3ebc06c150 0x7f3ebc131d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 >> 172.21.15.52:0/2962518402 conn(0x7f3ebc0ccec0 msgr2=0x7f3ebc0b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.982+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 shutdown_connections 2024-09-10T08:43:22.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:22.983+0000 7f3ec3000640 1 -- 172.21.15.52:0/2962518402 wait complete. 2024-09-10T08:43:23.017 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-09-10T08:43:23.017 INFO:tasks.cephfs_test_runner: 2024-09-10T08:43:23.017 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-10T08:43:23.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-10T08:43:23.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner: 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:Ran 13 tests in 847.634s 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner: 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner: 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-10T08:43:23.020 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-10T08:43:23.021 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-10T08:43:23.022 INFO:tasks.cephfs_test_runner: 2024-09-10T08:43:23.022 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:43:23.220 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=383c97baab2c41fab32dbb8d5ab5efcd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-10T08:43:23.222 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T08:43:23.232 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T08:43:23.258 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T08:43:23.258 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:43:23.258 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:23.297 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:43:23.297 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T08:43:23.297 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:23.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:43:23.374 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:43:23.374 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:23.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:43:23.414 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-10T08:43:23.414 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:43:23.491 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:43:23.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:23.492 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:43:23.528 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:43:23.528 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:43:23.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:23.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:43:23.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:23.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:43:23.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:23.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-10T08:43:24.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.177 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-10T08:43:24.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-10T08:43:24.314 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-10T08:43:24.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:43:24.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.317 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:43:24.357 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T08:43:24.359 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T08:43:24.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:43:24.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T08:43:24.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:24.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-10T08:43:25.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:25.012 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-10T08:43:25.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:43:25.050 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-10T08:43:25.150 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-10T08:43:25.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:43:25.153 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T08:43:25.745 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:43:25.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:43:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.914+0000 7fd29fe00640 1 Processor -- start 2024-09-10T08:43:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.914+0000 7fd29fe00640 1 -- start start 2024-09-10T08:43:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29fe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2a015d7c0 0x7fd2a015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29fe00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a00b6660 con 0x7fd2a01522d0 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29fe00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a015f860 con 0x7fd2a015d7c0 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a015ca90 con 0x7fd2a015eec0 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2a015d7c0 0x7fd2a015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29f400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2a015d7c0 0x7fd2a015dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49384/0 (socket says 172.21.15.52:49384) 2024-09-10T08:43:25.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.915+0000 7fd29f400640 1 -- 172.21.15.52:0/3651489432 learned_addr learned my addr 172.21.15.52:0/3651489432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:25.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd297e00640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd29f400640 1 -- 172.21.15.52:0/3651489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 msgr2=0x7fd2a015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd29f400640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd29f400640 1 -- 172.21.15.52:0/3651489432 >> v1:172.21.15.176:6789/0 conn(0x7fd2a01522d0 legacy=0x7fd2a00b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd29f400640 1 -- 172.21.15.52:0/3651489432 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a015cce0 con 0x7fd2a015d7c0 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.916+0000 7fd297e00640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.917+0000 7fd29f400640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a015d7c0 0x7fd2a015dc70 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e50 tx=0x7fd29802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea32e68fbecdf15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.917+0000 7fd29e000640 1 -- 172.21.15.52:0/3651489432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd298036070 con 0x7fd2a015d7c0 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.917+0000 7fd29e000640 1 -- 172.21.15.52:0/3651489432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd298031600 con 0x7fd2a015d7c0 2024-09-10T08:43:25.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.917+0000 7fd29e000640 1 -- 172.21.15.52:0/3651489432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2980319d0 con 0x7fd2a015d7c0 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 -- 172.21.15.52:0/3651489432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a015d7c0 msgr2=0x7fd2a015dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a015d7c0 0x7fd2a015dc70 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fd298009e50 tx=0x7fd29802a710 comp rx=0 tx=0).stop 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 -- 172.21.15.52:0/3651489432 shutdown_connections 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a015d7c0 0x7fd2a015dc70 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 --2- 172.21.15.52:0/3651489432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 -- 172.21.15.52:0/3651489432 >> 172.21.15.52:0/3651489432 conn(0x7fd2a006c240 msgr2=0x7fd2a006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:25.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 -- 172.21.15.52:0/3651489432 shutdown_connections 2024-09-10T08:43:25.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.918+0000 7fd29fe00640 1 -- 172.21.15.52:0/3651489432 wait complete. 2024-09-10T08:43:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.920+0000 7fd29fe00640 1 Processor -- start 2024-09-10T08:43:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.920+0000 7fd29fe00640 1 -- start start 2024-09-10T08:43:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a015d7c0 0x7fd2a0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a015fc80 con 0x7fd2a01522d0 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a015d2a0 con 0x7fd2a015d7c0 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29fe00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a00b62b0 con 0x7fd2a015eec0 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49388/0 (socket says 172.21.15.52:49388) 2024-09-10T08:43:25.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 -- 172.21.15.52:0/482082035 learned_addr learned my addr 172.21.15.52:0/482082035 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd297e00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a015d7c0 0x7fd2a0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29f400640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a01560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 -- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 msgr2=0x7fd2a01560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a01560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 -- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a015d7c0 msgr2=0x7fd2a0150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a015d7c0 0x7fd2a0150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.921+0000 7fd29ea00640 1 -- 172.21.15.52:0/482082035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a014fdc0 con 0x7fd2a01522d0 2024-09-10T08:43:25.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd29ea00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fd29000c430 tx=0x7fd29000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2900052d0 con 0x7fd2a01522d0 2024-09-10T08:43:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd290005490 con 0x7fd2a01522d0 2024-09-10T08:43:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290007260 con 0x7fd2a01522d0 2024-09-10T08:43:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a01500a0 con 0x7fd2a01522d0 2024-09-10T08:43:25.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.922+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a0150660 con 0x7fd2a01522d0 2024-09-10T08:43:25.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.923+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a01526b0 con 0x7fd2a01522d0 2024-09-10T08:43:25.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.924+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd290007400 con 0x7fd2a01522d0 2024-09-10T08:43:25.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.925+0000 7fd296a00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 0x7fd27c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:25.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.925+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fd29008a090 con 0x7fd2a01522d0 2024-09-10T08:43:25.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.925+0000 7fd297e00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 0x7fd27c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:25.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.926+0000 7fd297e00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 0x7fd27c06e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0155520 tx=0x7fd288008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:25.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:25.929+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd290058d30 con 0x7fd2a01522d0 2024-09-10T08:43:26.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.111+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2a015dd20 con 0x7fd27c06be30 2024-09-10T08:43:26.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.112+0000 7fd296a00640 1 -- 172.21.15.52:0/482082035 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13485 (secure 0 0 0) 0x7fd2a015dd20 con 0x7fd27c06be30 2024-09-10T08:43:26.113 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 msgr2=0x7fd27c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 0x7fd27c06e2f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0155520 tx=0x7fd288008040 comp rx=0 tx=0).stop 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 msgr2=0x7fd2a0158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fd29000c430 tx=0x7fd29000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 shutdown_connections 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd27c06be30 0x7fd27c06e2f0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2a015eec0 0x7fd2a01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2a015d7c0 0x7fd2a0150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 --2- 172.21.15.52:0/482082035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a01522d0 0x7fd2a0158be0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 >> 172.21.15.52:0/482082035 conn(0x7fd2a006c240 msgr2=0x7fd2a015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 shutdown_connections 2024-09-10T08:43:26.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.114+0000 7fd29fe00640 1 -- 172.21.15.52:0/482082035 wait complete. 2024-09-10T08:43:26.130 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-09-10T08:43:25.676943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":465844,"kb_used_data":20680,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754508876,"statfs":{"total":773094113280,"available":772617089024,"internally_reserved":0,"allocated":21176320,"data_stored":9962272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305492,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-79,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709986"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":494,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-10T08:43:22.901260+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:43:22.901260+0000","last_peered":"2024-09-10T08:43:22.901260+0000","last_clean":"2024-09-10T08:43:22.901260+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:43:22.901260+0000","last_undegraded":"2024-09-10T08:43:22.901260+0000","last_fullsized":"2024-09-10T08:43:22.901260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509621,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51676,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320164,"statfs":{"total":96636764160,"available":96583847936,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509620,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69664,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302176,"statfs":{"total":96636764160,"available":96565428224,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47520,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324320,"statfs":{"total":96636764160,"available":96588103680,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509621,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509623,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55836,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316004,"statfs":{"total":96636764160,"available":96579588096,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:43:26.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:43:26.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.286+0000 7fcf5dc00640 1 Processor -- start 2024-09-10T08:43:26.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.286+0000 7fcf5dc00640 1 -- start start 2024-09-10T08:43:26.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.287+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.287+0000 7fcf5dc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcf5813eb20 0x7fcf5806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.287+0000 7fcf5dc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf58071180 con 0x7fcf5815bcf0 2024-09-10T08:43:26.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.287+0000 7fcf5dc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fcf58071ab0 con 0x7fcf5813eb20 2024-09-10T08:43:26.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.287+0000 7fcf5dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf58071460 con 0x7fcf580b2d40 2024-09-10T08:43:26.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.52:42454/0 (socket says 172.21.15.52:42454) 2024-09-10T08:43:26.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56a00640 1 -- 172.21.15.52:0/3676033706 learned_addr learned my addr 172.21.15.52:0/3676033706 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:26.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56000640 1 --2- 172.21.15.52:0/3676033706 >> v2:172.21.15.176:3300/0 conn(0x7fcf5813eb20 0x7fcf5806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf57400640 1 --1- 172.21.15.52:0/3676033706 >> v1:172.21.15.176:6789/0 conn(0x7fcf5815bcf0 0x7fcf5815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60320/0 (socket says 172.21.15.52:60320) 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56000640 1 -- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 msgr2=0x7fcf5806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56000640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56000640 1 -- 172.21.15.52:0/3676033706 >> v1:172.21.15.176:6789/0 conn(0x7fcf5815bcf0 legacy=0x7fcf5815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56000640 1 -- 172.21.15.52:0/3676033706 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf58071740 con 0x7fcf5813eb20 2024-09-10T08:43:26.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.288+0000 7fcf56a00640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.289+0000 7fcf56000640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5813eb20 0x7fcf5806c150 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf58071c30 tx=0x7fcf4402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd62a718ba36cec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.290+0000 7fcf55600640 1 -- 172.21.15.52:0/3676033706 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44037070 con 0x7fcf5813eb20 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.290+0000 7fcf55600640 1 -- 172.21.15.52:0/3676033706 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf44032440 con 0x7fcf5813eb20 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.290+0000 7fcf55600640 1 -- 172.21.15.52:0/3676033706 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032810 con 0x7fcf5813eb20 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.290+0000 7fcf5dc00640 1 -- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5813eb20 msgr2=0x7fcf5806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.290+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5813eb20 0x7fcf5806c150 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf58071c30 tx=0x7fcf4402a180 comp rx=0 tx=0).stop 2024-09-10T08:43:26.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 -- 172.21.15.52:0/3676033706 shutdown_connections 2024-09-10T08:43:26.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf5813eb20 0x7fcf5806c150 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/3676033706 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf580b2d40 0x7fcf5806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 -- 172.21.15.52:0/3676033706 >> 172.21.15.52:0/3676033706 conn(0x7fcf580ccec0 msgr2=0x7fcf580cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:26.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 -- 172.21.15.52:0/3676033706 shutdown_connections 2024-09-10T08:43:26.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.291+0000 7fcf5dc00640 1 -- 172.21.15.52:0/3676033706 wait complete. 2024-09-10T08:43:26.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.292+0000 7fcf5dc00640 1 Processor -- start 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.292+0000 7fcf5dc00640 1 -- start start 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf580b2d40 0x7fcf58154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 0x7fcf58167670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf580722d0 con 0x7fcf5815bcf0 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf58072150 con 0x7fcf580b2d40 2024-09-10T08:43:26.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf5dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fcf58072450 con 0x7fcf5813eb20 2024-09-10T08:43:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.293+0000 7fcf57400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49398/0 (socket says 172.21.15.52:49398) 2024-09-10T08:43:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 -- 172.21.15.52:0/1305707488 learned_addr learned my addr 172.21.15.52:0/1305707488 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf56a00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf580b2d40 0x7fcf58154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf56000640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 0x7fcf58167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 -- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 msgr2=0x7fcf58167670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 0x7fcf58167670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 -- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf580b2d40 msgr2=0x7fcf58154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf580b2d40 0x7fcf58154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 -- 172.21.15.52:0/1305707488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5815e770 con 0x7fcf5815bcf0 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf56000640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 0x7fcf58167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:26.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.294+0000 7fcf57400640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c730 tx=0x7fcf5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.295+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50017070 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.295+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5000ce40 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.295+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000a840 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.295+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5815ea50 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.295+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf581556e0 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.296+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf580728e0 con 0x7fcf5815bcf0 2024-09-10T08:43:26.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.297+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf5001a070 con 0x7fcf5815bcf0 2024-09-10T08:43:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.297+0000 7fcf4ea00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.298+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fcf50089ff0 con 0x7fcf5815bcf0 2024-09-10T08:43:26.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.298+0000 7fcf56a00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.299+0000 7fcf56a00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 0x7fcf3806e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcf48006ca0 tx=0x7fcf48009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.302+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf500585f0 con 0x7fcf5815bcf0 2024-09-10T08:43:26.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.485+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf5815ef70 con 0x7fcf3806be30 2024-09-10T08:43:26.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.486+0000 7fcf4ea00640 1 -- 172.21.15.52:0/1305707488 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13485 (secure 0 0 0) 0x7fcf5815ef70 con 0x7fcf3806be30 2024-09-10T08:43:26.487 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:26.487 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:43:26.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 msgr2=0x7fcf3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 0x7fcf3806e2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fcf48006ca0 tx=0x7fcf48009240 comp rx=0 tx=0).stop 2024-09-10T08:43:26.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 msgr2=0x7fcf58167bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c730 tx=0x7fcf5000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 shutdown_connections 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf5815bcf0 0x7fcf58167bb0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf5813eb20 0x7fcf58167670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 --2- 172.21.15.52:0/1305707488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf580b2d40 0x7fcf58154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 >> 172.21.15.52:0/1305707488 conn(0x7fcf580ccec0 msgr2=0x7fcf580b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:26.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 shutdown_connections 2024-09-10T08:43:26.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.488+0000 7fcf5dc00640 1 -- 172.21.15.52:0/1305707488 wait complete. 2024-09-10T08:43:26.505 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-09-10T08:43:25.676943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":465844,"kb_used_data":20680,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754508876,"statfs":{"total":773094113280,"available":772617089024,"internally_reserved":0,"allocated":21176320,"data_stored":9962272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305492,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-79,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709986"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":494,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-10T08:43:22.901260+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:43:22.901260+0000","last_peered":"2024-09-10T08:43:22.901260+0000","last_clean":"2024-09-10T08:43:22.901260+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:43:22.901260+0000","last_undegraded":"2024-09-10T08:43:22.901260+0000","last_fullsized":"2024-09-10T08:43:22.901260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509621,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51676,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320164,"statfs":{"total":96636764160,"available":96583847936,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509620,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69664,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302176,"statfs":{"total":96636764160,"available":96565428224,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47520,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324320,"statfs":{"total":96636764160,"available":96588103680,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509621,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509623,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55836,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316004,"statfs":{"total":96636764160,"available":96579588096,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:43:26.505 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:43:26.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:43:26.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.661+0000 7fb46ba00640 1 Processor -- start 2024-09-10T08:43:26.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.661+0000 7fb46ba00640 1 -- start start 2024-09-10T08:43:26.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb4640b2d40 0x7fb46406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb46406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb46415bcf0 0x7fb46415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fb464071ab0 con 0x7fb46415bcf0 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fb464071180 con 0x7fb4640b2d40 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.662+0000 7fb46ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb464071460 con 0x7fb46413eb20 2024-09-10T08:43:26.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb46415bcf0 0x7fb46415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb46415bcf0 0x7fb46415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49402/0 (socket says 172.21.15.52:49402) 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 -- 172.21.15.52:0/812594364 learned_addr learned my addr 172.21.15.52:0/812594364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469000640 1 --2- 172.21.15.52:0/812594364 >> v2:172.21.15.176:3300/0 conn(0x7fb4640b2d40 0x7fb46406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb463e00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb46406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 -- 172.21.15.52:0/812594364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 msgr2=0x7fb46406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:26.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb46406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 -- 172.21.15.52:0/812594364 >> v2:172.21.15.176:3300/0 conn(0x7fb4640b2d40 msgr2=0x7fb46406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:26.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 --2- 172.21.15.52:0/812594364 >> v2:172.21.15.176:3300/0 conn(0x7fb4640b2d40 0x7fb46406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.663+0000 7fb469a00640 1 -- 172.21.15.52:0/812594364 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb464071740 con 0x7fb46415bcf0 2024-09-10T08:43:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.664+0000 7fb469a00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46415bcf0 0x7fb46415c1a0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb464069be0 tx=0x7fb45c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10814a4aee642d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.664+0000 7fb463400640 1 -- 172.21.15.52:0/812594364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c036070 con 0x7fb46415bcf0 2024-09-10T08:43:26.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.664+0000 7fb463400640 1 -- 172.21.15.52:0/812594364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c031600 con 0x7fb46415bcf0 2024-09-10T08:43:26.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.664+0000 7fb463400640 1 -- 172.21.15.52:0/812594364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0319d0 con 0x7fb46415bcf0 2024-09-10T08:43:26.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 -- 172.21.15.52:0/812594364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46415bcf0 msgr2=0x7fb46415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46415bcf0 0x7fb46415c1a0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb464069be0 tx=0x7fb45c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 -- 172.21.15.52:0/812594364 shutdown_connections 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46415bcf0 0x7fb46415c1a0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 --2- 172.21.15.52:0/812594364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb46406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 --2- 172.21.15.52:0/812594364 >> v2:172.21.15.176:3300/0 conn(0x7fb4640b2d40 0x7fb46406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 -- 172.21.15.52:0/812594364 >> 172.21.15.52:0/812594364 conn(0x7fb4640ccec0 msgr2=0x7fb4640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:26.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 -- 172.21.15.52:0/812594364 shutdown_connections 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.665+0000 7fb46ba00640 1 -- 172.21.15.52:0/812594364 wait complete. 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.667+0000 7fb46ba00640 1 Processor -- start 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.667+0000 7fb46ba00640 1 -- start start 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb464129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb46415bcf0 0x7fb46412a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb46415f140 con 0x7fb4640b2d40 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb46415efc0 con 0x7fb46415bcf0 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb46ba00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fb46415f2c0 con 0x7fb46413eb20 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49410/0 (socket says 172.21.15.52:49410) 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 -- 172.21.15.52:0/957909783 learned_addr learned my addr 172.21.15.52:0/957909783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb463e00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb464129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 -- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 msgr2=0x7fb464129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb464129ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469a00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb46415bcf0 0x7fb46412a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 -- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb46415bcf0 msgr2=0x7fb46412a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb46415bcf0 0x7fb46412a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb469000640 1 -- 172.21.15.52:0/957909783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46412aa70 con 0x7fb4640b2d40 2024-09-10T08:43:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.668+0000 7fb463e00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb464129ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb469000640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fb45800e890 tx=0x7fb45800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458017070 con 0x7fb4640b2d40 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45800c940 con 0x7fb4640b2d40 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45800cd10 con 0x7fb4640b2d40 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46412ad50 con 0x7fb4640b2d40 2024-09-10T08:43:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.669+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46412b310 con 0x7fb4640b2d40 2024-09-10T08:43:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.670+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46406c9c0 con 0x7fb4640b2d40 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.671+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb45801a070 con 0x7fb4640b2d40 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.672+0000 7fb460c00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 0x7fb44406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.672+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fb45808af80 con 0x7fb4640b2d40 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.673+0000 7fb463e00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 0x7fb44406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.673+0000 7fb463e00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 0x7fb44406e2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb46415c610 tx=0x7fb450008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.676+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb458059b90 con 0x7fb4640b2d40 2024-09-10T08:43:26.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.858+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb464140e50 con 0x7fb44406be30 2024-09-10T08:43:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.859+0000 7fb460c00640 1 -- 172.21.15.52:0/957909783 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13485 (secure 0 0 0) 0x7fb464140e50 con 0x7fb44406be30 2024-09-10T08:43:26.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:26.861 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:43:26.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 msgr2=0x7fb44406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 0x7fb44406e2f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb46415c610 tx=0x7fb450008040 comp rx=0 tx=0).stop 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 msgr2=0x7fb46413d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fb45800e890 tx=0x7fb45800ed50 comp rx=0 tx=0).stop 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 shutdown_connections 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fb44406be30 0x7fb44406e2f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb46415bcf0 0x7fb46412a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb46413eb20 0x7fb464129ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 --2- 172.21.15.52:0/957909783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4640b2d40 0x7fb46413d740 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:26.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 >> 172.21.15.52:0/957909783 conn(0x7fb4640ccec0 msgr2=0x7fb46415b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:26.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 shutdown_connections 2024-09-10T08:43:26.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:26.861+0000 7fb46ba00640 1 -- 172.21.15.52:0/957909783 wait complete. 2024-09-10T08:43:26.878 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-09-10T08:43:25.676943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":465844,"kb_used_data":20680,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754508876,"statfs":{"total":773094113280,"available":772617089024,"internally_reserved":0,"allocated":21176320,"data_stored":9962272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6305492,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-79,"num_write_kb":-6183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709986"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":494,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-10T08:43:22.901260+0000","last_change":"2024-09-10T08:28:37.858206+0000","last_active":"2024-09-10T08:43:22.901260+0000","last_peered":"2024-09-10T08:43:22.901260+0000","last_clean":"2024-09-10T08:43:22.901260+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:43:22.901260+0000","last_undegraded":"2024-09-10T08:43:22.901260+0000","last_fullsized":"2024-09-10T08:43:22.901260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:28:35.943823+0000","last_clean_scrub_stamp":"2024-09-10T08:28:35.943823+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:32:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509621,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51676,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320164,"statfs":{"total":96636764160,"available":96583847936,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509620,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69664,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302176,"statfs":{"total":96636764160,"available":96565428224,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47520,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324320,"statfs":{"total":96636764160,"available":96588103680,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509621,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509623,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55836,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316004,"statfs":{"total":96636764160,"available":96579588096,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:43:26.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:43:27.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.034+0000 7f78be000640 1 Processor -- start 2024-09-10T08:43:27.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.035+0000 7f78be000640 1 -- start start 2024-09-10T08:43:27.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78be000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78b806c320 0x7f78b815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78be000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f78b813eb20 0x7f78b815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78be000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b8071180 con 0x7f78b80b2d40 2024-09-10T08:43:27.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78be000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f78b8071ab0 con 0x7f78b806c320 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78be000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f78b8071460 con 0x7f78b813eb20 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78afe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78b806c320 0x7f78b815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78afe00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f78b806c320 0x7f78b815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49424/0 (socket says 172.21.15.52:49424) 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.036+0000 7f78afe00640 1 -- 172.21.15.52:0/370918822 learned_addr learned my addr 172.21.15.52:0/370918822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.037+0000 7f78b7e00640 1 --2- 172.21.15.52:0/370918822 >> v2:172.21.15.176:3300/0 conn(0x7f78b813eb20 0x7f78b815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.037+0000 7f78afe00640 1 -- 172.21.15.52:0/370918822 >> v2:172.21.15.176:3300/0 conn(0x7f78b813eb20 msgr2=0x7f78b815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.037+0000 7f78afe00640 1 --2- 172.21.15.52:0/370918822 >> v2:172.21.15.176:3300/0 conn(0x7f78b813eb20 0x7f78b815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.037+0000 7f78afe00640 1 -- 172.21.15.52:0/370918822 >> v1:172.21.15.176:6789/0 conn(0x7f78b80b2d40 legacy=0x7f78b806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.037+0000 7f78afe00640 1 -- 172.21.15.52:0/370918822 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b8071740 con 0x7f78b806c320 2024-09-10T08:43:27.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.038+0000 7f78afe00640 1 --2- 172.21.15.52:0/370918822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b806c320 0x7f78b815bcf0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f78b81595c0 tx=0x7f78a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa11a5a5d0e1a6a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:27.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.038+0000 7f78b6a00640 1 -- 172.21.15.52:0/370918822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0037070 con 0x7f78b806c320 2024-09-10T08:43:27.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.038+0000 7f78b6a00640 1 -- 172.21.15.52:0/370918822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0032440 con 0x7f78b806c320 2024-09-10T08:43:27.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.038+0000 7f78b6a00640 1 -- 172.21.15.52:0/370918822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0032810 con 0x7f78b806c320 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 -- 172.21.15.52:0/370918822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b806c320 msgr2=0x7f78b815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 --2- 172.21.15.52:0/370918822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b806c320 0x7f78b815bcf0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f78b81595c0 tx=0x7f78a002a270 comp rx=0 tx=0).stop 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 -- 172.21.15.52:0/370918822 shutdown_connections 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 --2- 172.21.15.52:0/370918822 >> v2:172.21.15.176:3300/0 conn(0x7f78b813eb20 0x7f78b815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 --2- 172.21.15.52:0/370918822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b806c320 0x7f78b815bcf0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 -- 172.21.15.52:0/370918822 >> 172.21.15.52:0/370918822 conn(0x7f78b80ccec0 msgr2=0x7f78b80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 -- 172.21.15.52:0/370918822 shutdown_connections 2024-09-10T08:43:27.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.039+0000 7f78be000640 1 -- 172.21.15.52:0/370918822 wait complete. 2024-09-10T08:43:27.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.040+0000 7f78be000640 1 Processor -- start 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.041+0000 7f78be000640 1 -- start start 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 0x7f78b80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 0x7f78b80cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78b80720c0 con 0x7f78b813eb20 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78b8071f40 con 0x7f78b806c320 2024-09-10T08:43:27.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78be000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f78b8072240 con 0x7f78b80b2d40 2024-09-10T08:43:27.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49428/0 (socket says 172.21.15.52:49428) 2024-09-10T08:43:27.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 -- 172.21.15.52:0/1061504469 learned_addr learned my addr 172.21.15.52:0/1061504469 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:27.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78afe00640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 0x7f78b80cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7400640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 0x7f78b80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 -- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 msgr2=0x7f78b80cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 0x7f78b80cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 -- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 msgr2=0x7f78b80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 0x7f78b80cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7e00640 1 -- 172.21.15.52:0/1061504469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b814e310 con 0x7f78b813eb20 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78afe00640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 0x7f78b80cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:27.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.042+0000 7f78b7400640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 0x7f78b80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78b7e00640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f78b0007e90 tx=0x7f78b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0014420 con 0x7f78b813eb20 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b0019070 con 0x7f78b813eb20 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b0014800 con 0x7f78b813eb20 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b814e5f0 con 0x7f78b813eb20 2024-09-10T08:43:27.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.043+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b814ebb0 con 0x7f78b813eb20 2024-09-10T08:43:27.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.044+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b806bc10 con 0x7f78b813eb20 2024-09-10T08:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.045+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78b00149a0 con 0x7f78b813eb20 2024-09-10T08:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.046+0000 7f78af400640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.046+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f78b008b370 con 0x7f78b813eb20 2024-09-10T08:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.046+0000 7f78b7400640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:27.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.047+0000 7f78b7400640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f78a8001680 tx=0x7f78a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:27.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.050+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78b005a010 con 0x7f78b813eb20 2024-09-10T08:43:27.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.237+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78b80ccca0 con 0x7f78b813eb20 2024-09-10T08:43:27.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.238+0000 7f78af400640 1 -- 172.21.15.52:0/1061504469 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) ==== 74+0+13054 (secure 0 0 0) 0x7f78b0059910 con 0x7f78b813eb20 2024-09-10T08:43:27.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:27.239 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":198,"fsid":"4eb61a63-2a53-4336-9780-430e4b9fd90b","created":"2024-09-10T08:28:20.562905+0000","modified":"2024-09-10T08:43:21.973603+0000","last_up_change":"2024-09-10T08:28:34.653336+0000","last_in_change":"2024-09-10T08:28:23.422237+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:28:35.506252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"71611936-9673-4c2d-b97d-5e0f36bda32a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6809","nonce":702157345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6811","nonce":702157345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6817","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6819","nonce":702157345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6813","nonce":702157345},{"type":"v1","addr":"172.21.15.52:6815","nonce":702157345}]},"public_addr":"172.21.15.52:6809/702157345","cluster_addr":"172.21.15.52:6811/702157345","heartbeat_back_addr":"172.21.15.52:6819/702157345","heartbeat_front_addr":"172.21.15.52:6815/702157345","state":["exists","up"]},{"osd":1,"uuid":"52c53592-b794-49f6-93a6-17973ccd98bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6801","nonce":2452593582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6803","nonce":2452593582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6807","nonce":2452593582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":2452593582},{"type":"v1","addr":"172.21.15.52:6805","nonce":2452593582}]},"public_addr":"172.21.15.52:6801/2452593582","cluster_addr":"172.21.15.52:6803/2452593582","heartbeat_back_addr":"172.21.15.52:6807/2452593582","heartbeat_front_addr":"172.21.15.52:6805/2452593582","state":["exists","up"]},{"osd":2,"uuid":"69446be2-2b12-4e43-925b-7fcda144509e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6825","nonce":3947975143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6827","nonce":3947975143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6831","nonce":3947975143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3947975143},{"type":"v1","addr":"172.21.15.52:6829","nonce":3947975143}]},"public_addr":"172.21.15.52:6825/3947975143","cluster_addr":"172.21.15.52:6827/3947975143","heartbeat_back_addr":"172.21.15.52:6831/3947975143","heartbeat_front_addr":"172.21.15.52:6829/3947975143","state":["exists","up"]},{"osd":3,"uuid":"6edb6ab1-d412-42e9-b66c-74e019cd481f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6814","nonce":3392514564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6818","nonce":3392514564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6823","nonce":3392514564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3392514564},{"type":"v1","addr":"172.21.15.52:6821","nonce":3392514564}]},"public_addr":"172.21.15.52:6814/3392514564","cluster_addr":"172.21.15.52:6818/3392514564","heartbeat_back_addr":"172.21.15.52:6823/3392514564","heartbeat_front_addr":"172.21.15.52:6821/3392514564","state":["exists","up"]},{"osd":4,"uuid":"e2f37f64-92fa-4e7f-b26b-629c2efc74ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6803","nonce":3190346421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6805","nonce":3190346421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6809","nonce":3190346421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3190346421},{"type":"v1","addr":"172.21.15.176:6807","nonce":3190346421}]},"public_addr":"172.21.15.176:6803/3190346421","cluster_addr":"172.21.15.176:6805/3190346421","heartbeat_back_addr":"172.21.15.176:6809/3190346421","heartbeat_front_addr":"172.21.15.176:6807/3190346421","state":["exists","up"]},{"osd":5,"uuid":"8c723a8f-71d7-4383-8719-e025137f685c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6826","nonce":1819402016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6829","nonce":1819402016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6833","nonce":1819402016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":1819402016},{"type":"v1","addr":"172.21.15.176:6831","nonce":1819402016}]},"public_addr":"172.21.15.176:6826/1819402016","cluster_addr":"172.21.15.176:6829/1819402016","heartbeat_back_addr":"172.21.15.176:6833/1819402016","heartbeat_front_addr":"172.21.15.176:6831/1819402016","state":["exists","up"]},{"osd":6,"uuid":"7988e82e-4517-4a19-8ab8-72a4fa8a8263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6819","nonce":2589759932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6821","nonce":2589759932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6825","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6827","nonce":2589759932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":2589759932},{"type":"v1","addr":"172.21.15.176:6823","nonce":2589759932}]},"public_addr":"172.21.15.176:6819/2589759932","cluster_addr":"172.21.15.176:6821/2589759932","heartbeat_back_addr":"172.21.15.176:6827/2589759932","heartbeat_front_addr":"172.21.15.176:6823/2589759932","state":["exists","up"]},{"osd":7,"uuid":"62727aea-e9e4-44d1-a44b-7f83de2b2656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6811","nonce":2943871986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6813","nonce":2943871986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6817","nonce":2943871986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2943871986},{"type":"v1","addr":"172.21.15.176:6815","nonce":2943871986}]},"public_addr":"172.21.15.176:6811/2943871986","cluster_addr":"172.21.15.176:6813/2943871986","heartbeat_back_addr":"172.21.15.176:6817/2943871986","heartbeat_front_addr":"172.21.15.176:6815/2943871986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.242287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.143609+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.185456+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.194007+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.161497+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:30.900940+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.331398+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:28:31.175259+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6834/1114908011":"2024-09-11T08:43:18.963944+0000","172.21.15.52:6833/1114908011":"2024-09-11T08:43:18.963944+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:43:27.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 msgr2=0x7f789406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 0x7f789406e2f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f78a8001680 tx=0x7f78a8009040 comp rx=0 tx=0).stop 2024-09-10T08:43:27.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 msgr2=0x7f78b815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:27.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f78b0007e90 tx=0x7f78b000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 shutdown_connections 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f789406be30 0x7f789406e2f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78b813eb20 0x7f78b815cac0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78b80b2d40 0x7f78b80cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 --2- 172.21.15.52:0/1061504469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b806c320 0x7f78b80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 >> 172.21.15.52:0/1061504469 conn(0x7f78b80ccec0 msgr2=0x7f78b8156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 shutdown_connections 2024-09-10T08:43:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:27.240+0000 7f78be000640 1 -- 172.21.15.52:0/1061504469 wait complete. 2024-09-10T08:43:28.258 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T08:43:28.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:28.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.425+0000 7f6978a00640 1 Processor -- start 2024-09-10T08:43:28.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.425+0000 7f6978a00640 1 -- start start 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6978a00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f697406bff0 0x7f697406c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6978a00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69740d2dc0 con 0x7f697415e7b0 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6978a00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69740d30a0 con 0x7f697415eb90 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6978a00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f697406c9a0 con 0x7f697406bff0 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6973400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f697415e7b0 0x7f69740d3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52592/0 (socket says 172.21.15.52:52592) 2024-09-10T08:43:28.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.426+0000 7f6973400640 1 -- 172.21.15.52:0/1920736793 learned_addr learned my addr 172.21.15.52:0/1920736793 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:28.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563875900 0 0) 0x7f69740d2dc0 con 0x7f697415e7b0 2024-09-10T08:43:28.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6958003520 con 0x7f697415e7b0 2024-09-10T08:43:28.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6973e00640 1 --2- 172.21.15.52:0/1920736793 >> v2:172.21.15.176:3300/0 conn(0x7f697406bff0 0x7f697406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3446611350 0 0) 0x7f6958003520 con 0x7f697415e7b0 2024-09-10T08:43:28.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 >> v2:172.21.15.176:3300/0 conn(0x7f697406bff0 msgr2=0x7f697406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:28.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 --2- 172.21.15.52:0/1920736793 >> v2:172.21.15.176:3300/0 conn(0x7f697406bff0 0x7f697406c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 >> v1:172.21.15.176:6789/0 conn(0x7f697415eb90 legacy=0x7f69740b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69740d3380 con 0x7f697415e7b0 2024-09-10T08:43:28.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f6964001670 con 0x7f697415e7b0 2024-09-10T08:43:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 >> v1:172.21.15.52:6789/0 conn(0x7f697415e7b0 legacy=0x7f69740d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6958003a00 0x7f6958003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958004800 0x7f6958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 0x7f695800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f697406c9a0 con 0x7f6958005210 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f695800c160 con 0x7f6958003a00 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.427+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f695800c360 con 0x7f6958004800 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 0x7f695800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973400640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6958003a00 0x7f6958003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6972a00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958004800 0x7f6958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 -- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958004800 msgr2=0x7f6958004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:28.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958004800 0x7f6958004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 -- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6958003a00 msgr2=0x7f6958003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:28.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6958003a00 0x7f6958003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.428+0000 7f6973e00640 1 -- 172.21.15.52:0/1920736793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6958003520 con 0x7f6958005210 2024-09-10T08:43:28.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.429+0000 7f6973e00640 1 -- 172.21.15.52:0/1920736793 reap_dead start 2024-09-10T08:43:28.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.429+0000 7f6973e00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 0x7f695800b9c0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f696c009f90 tx=0x7f6958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b05245f313f0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c035020 con 0x7f6958005210 2024-09-10T08:43:28.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c003b90 con 0x7f6958005210 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6972000640 1 -- 172.21.15.52:0/1920736793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c009c10 con 0x7f6958005210 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 -- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 msgr2=0x7f695800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 0x7f695800b9c0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f696c009f90 tx=0x7f6958005830 comp rx=0 tx=0).stop 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 -- 172.21.15.52:0/1920736793 shutdown_connections 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 --2- 172.21.15.52:0/1920736793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6958005210 0x7f695800b9c0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 -- 172.21.15.52:0/1920736793 >> 172.21.15.52:0/1920736793 conn(0x7f69740b6320 msgr2=0x7f69740b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 -- 172.21.15.52:0/1920736793 shutdown_connections 2024-09-10T08:43:28.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.430+0000 7f6978a00640 1 -- 172.21.15.52:0/1920736793 wait complete. 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.432+0000 7f6978a00640 1 Processor -- start 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.432+0000 7f6978a00640 1 -- start start 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958005210 0x7f6974161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f697415fff0 0x7f697415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 0x7f69740b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69740d2950 con 0x7f69740b90b0 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f69740d39d0 con 0x7f697415fff0 2024-09-10T08:43:28.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6978a00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f69740d2ad0 con 0x7f6958005210 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6973e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 0x7f69740b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6973e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 0x7f69740b9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49442/0 (socket says 172.21.15.52:49442) 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6973e00640 1 -- 172.21.15.52:0/1606629865 learned_addr learned my addr 172.21.15.52:0/1606629865 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6973400640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958005210 0x7f6974161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.433+0000 7f6972a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f697415fff0 0x7f697415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 -- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958005210 msgr2=0x7f6974161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6958005210 0x7f6974161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 -- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f697415fff0 msgr2=0x7f697415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f697415fff0 0x7f697415abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69741607b0 con 0x7f69740b90b0 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6972a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f697415fff0 0x7f697415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6973e00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 0x7f69740b9530 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f696c02aeb0 tx=0x7f696c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c035070 con 0x7f69740b90b0 2024-09-10T08:43:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c041070 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6974160a90 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c03c690 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.434+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6974161050 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.435+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f697406c4f0 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.437+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f696c005d10 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.437+0000 7f696b400640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f695406be30 0x7f695406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.437+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f696c0ac240 con 0x7f69740b90b0 2024-09-10T08:43:28.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f696b400640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f6954071cf0 0x7f6954074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f696c003b90 con 0x7f6954071cf0 2024-09-10T08:43:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f696c0ac5f0 con 0x7f69740b90b0 2024-09-10T08:43:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f6972a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f6954071cf0 0x7f6954074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f6973400640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f695406be30 0x7f695406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.438+0000 7f6972a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f6954071cf0 0x7f6954074110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.439+0000 7f6973400640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f695406be30 0x7f695406e2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6964001ab0 tx=0x7f6964001a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.439+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== osd.0 v2:172.21.15.52:6808/702157345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f696c003b90 con 0x7f6954071cf0 2024-09-10T08:43:28.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.452+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 --> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69740b68a0 con 0x7f6954071cf0 2024-09-10T08:43:28.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f696b400640 1 -- 172.21.15.52:0/1606629865 <== osd.0 v2:172.21.15.52:6808/702157345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69740b68a0 con 0x7f6954071cf0 2024-09-10T08:43:28.454 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:28.454 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:28.454 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:28.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f6954071cf0 msgr2=0x7f6954074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:6808/702157345,v1:172.21.15.52:6809/702157345] conn(0x7f6954071cf0 0x7f6954074110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f695406be30 msgr2=0x7f695406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f695406be30 0x7f695406e2f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6964001ab0 tx=0x7f6964001a40 comp rx=0 tx=0).stop 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 msgr2=0x7f69740b9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 --2- 172.21.15.52:0/1606629865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69740b90b0 0x7f69740b9530 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f696c02aeb0 tx=0x7f696c009750 comp rx=0 tx=0).stop 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6973e00640 1 -- 172.21.15.52:0/1606629865 reap_dead start 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 shutdown_connections 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.453+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 >> 172.21.15.52:0/1606629865 conn(0x7f69740b6320 msgr2=0x7f69740b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.454+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 shutdown_connections 2024-09-10T08:43:28.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.454+0000 7f6978a00640 1 -- 172.21.15.52:0/1606629865 wait complete. 2024-09-10T08:43:28.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T08:43:28.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.626+0000 7fc6a4000640 1 Processor -- start 2024-09-10T08:43:28.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.626+0000 7fc6a4000640 1 -- start start 2024-09-10T08:43:28.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.627+0000 7fc6a4000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 0x7fc69c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.627+0000 7fc6a4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.627+0000 7fc6a4000640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c0d0e70 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.627+0000 7fc6a4000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c0d41c0 con 0x7fc69c15ed20 2024-09-10T08:43:28.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.627+0000 7fc6a4000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c0d35b0 con 0x7fc69c0d23b0 2024-09-10T08:43:28.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a0c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a2000640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc69c0cf2d0 0x7fc69c0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60346/0 (socket says 172.21.15.52:60346) 2024-09-10T08:43:28.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a2000640 1 -- 172.21.15.52:0/4015037953 learned_addr learned my addr 172.21.15.52:0/4015037953 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:28.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a1600640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 0x7fc69c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a0c00640 1 -- 172.21.15.52:0/4015037953 >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 msgr2=0x7fc69c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:28.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/4015037953 >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 0x7fc69c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc69be00640 1 -- 172.21.15.52:0/4015037953 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567023853 0 0) 0x7fc694001490 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a0c00640 1 -- 172.21.15.52:0/4015037953 >> v1:172.21.15.176:6789/0 conn(0x7fc69c0cf2d0 legacy=0x7fc69c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a0c00640 1 -- 172.21.15.52:0/4015037953 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c0d3890 con 0x7fc69c0d23b0 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.628+0000 7fc6a1600640 1 --2- 172.21.15.52:0/4015037953 >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 0x7fc69c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.629+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/4015037953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0b67a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097a0 tx=0x7fc68802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4843d11f97a237d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.629+0000 7fc69be00640 1 -- 172.21.15.52:0/4015037953 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688037070 con 0x7fc69c0d23b0 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc69be00640 1 -- 172.21.15.52:0/4015037953 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688032440 con 0x7fc69c0d23b0 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc69be00640 1 -- 172.21.15.52:0/4015037953 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688032810 con 0x7fc69c0d23b0 2024-09-10T08:43:28.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 -- 172.21.15.52:0/4015037953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 msgr2=0x7fc69c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 --2- 172.21.15.52:0/4015037953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0b67a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097a0 tx=0x7fc68802a180 comp rx=0 tx=0).stop 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 -- 172.21.15.52:0/4015037953 shutdown_connections 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 --2- 172.21.15.52:0/4015037953 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0b67a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 --2- 172.21.15.52:0/4015037953 >> v2:172.21.15.176:3300/0 conn(0x7fc69c15ed20 0x7fc69c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 -- 172.21.15.52:0/4015037953 >> 172.21.15.52:0/4015037953 conn(0x7fc69c0d1260 msgr2=0x7fc69c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 -- 172.21.15.52:0/4015037953 shutdown_connections 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.630+0000 7fc6a4000640 1 -- 172.21.15.52:0/4015037953 wait complete. 2024-09-10T08:43:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.632+0000 7fc6a4000640 1 Processor -- start 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.632+0000 7fc6a4000640 1 -- start start 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 0x7fc69c158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0d32a0 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0d3e50 con 0x7fc69c15ed20 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a4000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c15f100 con 0x7fc69c0d23b0 2024-09-10T08:43:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49458/0 (socket says 172.21.15.52:49458) 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 -- 172.21.15.52:0/3796261129 learned_addr learned my addr 172.21.15.52:0/3796261129 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a2000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 0x7fc69c158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 -- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 msgr2=0x7fc69c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.633+0000 7fc6a1600640 1 -- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 msgr2=0x7fc69c158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a1600640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 0x7fc69c158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a1600640 1 -- 172.21.15.52:0/3796261129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c0cab90 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a2000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 0x7fc69c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a1600640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fc69000e990 tx=0x7fc69000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690017070 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69000c9e0 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c1597c0 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69000cdb0 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.634+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c159d80 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.635+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c15a4a0 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.637+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc69001a070 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.637+0000 7fc699600640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.637+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fc69008ab00 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.638+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.639+0000 7fc6a0c00640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc688034000 tx=0x7fc68802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.642+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc690059710 con 0x7fc69c0cf2d0 2024-09-10T08:43:28.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.825+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc69c0b7010 con 0x7fc67c06be30 2024-09-10T08:43:28.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.826+0000 7fc699600640 1 -- 172.21.15.52:0/3796261129 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc69c0b7010 con 0x7fc67c06be30 2024-09-10T08:43:28.827 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T08:43:28.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 msgr2=0x7fc67c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 0x7fc67c06e2f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc688034000 tx=0x7fc68802e000 comp rx=0 tx=0).stop 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 msgr2=0x7fc69c15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fc69000e990 tx=0x7fc69000ee50 comp rx=0 tx=0).stop 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 shutdown_connections 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc67c06be30 0x7fc67c06e2f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc69c15ed20 0x7fc69c158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc69c0d23b0 0x7fc69c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 --2- 172.21.15.52:0/3796261129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc69c0cf2d0 0x7fc69c15a860 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 >> 172.21.15.52:0/3796261129 conn(0x7fc69c0d1260 msgr2=0x7fc69c0d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 shutdown_connections 2024-09-10T08:43:28.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:28.829+0000 7fc6a4000640 1 -- 172.21.15.52:0/3796261129 wait complete. 2024-09-10T08:43:28.845 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T08:43:28.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:29.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.005+0000 7f7c74200640 1 Processor -- start 2024-09-10T08:43:29.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.005+0000 7f7c74200640 1 -- start start 2024-09-10T08:43:29.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c74200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 0x7f7c6c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c74200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7c6c0b2dc0 0x7f7c6c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c74200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6c146220 con 0x7f7c6c1454b0 2024-09-10T08:43:29.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c74200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f7c6c0b1920 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c74200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c0cf640 con 0x7f7c6c0b6000 2024-09-10T08:43:29.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c71800640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7c6c1454b0 0x7f7c6c0b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52608/0 (socket says 172.21.15.52:52608) 2024-09-10T08:43:29.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c71800640 1 -- 172.21.15.52:0/80984773 learned_addr learned my addr 172.21.15.52:0/80984773 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:29.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c72200640 1 --2- 172.21.15.52:0/80984773 >> v2:172.21.15.52:3300/0 conn(0x7f7c6c0b2dc0 0x7f7c6c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c70e00640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 0x7f7c6c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c6be00640 1 -- 172.21.15.52:0/80984773 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912620635 0 0) 0x7f7c60001110 con 0x7f7c6c1454b0 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c6be00640 1 -- 172.21.15.52:0/80984773 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c54003520 con 0x7f7c6c1454b0 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c72200640 1 -- 172.21.15.52:0/80984773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 msgr2=0x7f7c6c0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c72200640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 0x7f7c6c0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c72200640 1 -- 172.21.15.52:0/80984773 >> v1:172.21.15.52:6789/0 conn(0x7f7c6c1454b0 legacy=0x7f7c6c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c72200640 1 -- 172.21.15.52:0/80984773 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c0cf8e0 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.007+0000 7f7c70e00640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 0x7f7c6c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.008+0000 7f7c72200640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c0b2dc0 0x7f7c6c0b0380 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009d90 tx=0x7f7c6402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebac3df3438c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c6be00640 1 -- 172.21.15.52:0/80984773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64007740 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c6be00640 1 -- 172.21.15.52:0/80984773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c640078e0 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c6be00640 1 -- 172.21.15.52:0/80984773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64007c90 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 -- 172.21.15.52:0/80984773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c0b2dc0 msgr2=0x7f7c6c0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c0b2dc0 0x7f7c6c0b0380 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009d90 tx=0x7f7c6402a6f0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 -- 172.21.15.52:0/80984773 shutdown_connections 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c0b2dc0 0x7f7c6c0b0380 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 --2- 172.21.15.52:0/80984773 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b6000 0x7f7c6c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 -- 172.21.15.52:0/80984773 >> 172.21.15.52:0/80984773 conn(0x7f7c6c06c240 msgr2=0x7f7c6c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 -- 172.21.15.52:0/80984773 shutdown_connections 2024-09-10T08:43:29.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.009+0000 7f7c74200640 1 -- 172.21.15.52:0/80984773 wait complete. 2024-09-10T08:43:29.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.011+0000 7f7c74200640 1 Processor -- start 2024-09-10T08:43:29.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.011+0000 7f7c74200640 1 -- start start 2024-09-10T08:43:29.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b2dc0 0x7f7c6c13c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0b6000 0x7f7c6c13cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 0x7f7c6c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c0d0180 con 0x7f7c6c1454b0 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c0cfea0 con 0x7f7c6c0b6000 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c74200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c1459a0 con 0x7f7c6c0b2dc0 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c72200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 0x7f7c6c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c72200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 0x7f7c6c151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49484/0 (socket says 172.21.15.52:49484) 2024-09-10T08:43:29.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c72200640 1 -- 172.21.15.52:0/3408181562 learned_addr learned my addr 172.21.15.52:0/3408181562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.012+0000 7f7c71800640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b2dc0 0x7f7c6c13c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c70e00640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0b6000 0x7f7c6c13cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 -- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b2dc0 msgr2=0x7f7c6c13c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b2dc0 0x7f7c6c13c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 -- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0b6000 msgr2=0x7f7c6c13cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0b6000 0x7f7c6c13cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c13ee20 con 0x7f7c6c1454b0 2024-09-10T08:43:29.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c71800640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7c6c0b2dc0 0x7f7c6c13c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c70e00640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c6c0b6000 0x7f7c6c13cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c72200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 0x7f7c6c151360 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009d90 tx=0x7f7c64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64009450 con 0x7f7c6c1454b0 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c64004240 con 0x7f7c6c1454b0 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.013+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c13f100 con 0x7f7c6c1454b0 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.014+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004630 con 0x7f7c6c1454b0 2024-09-10T08:43:29.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.014+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c13f6c0 con 0x7f7c6c1454b0 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.015+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c6c0b58f0 con 0x7f7c6c1454b0 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.016+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c64039040 con 0x7f7c6c1454b0 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c69600640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4c06be30 0x7f7c4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f7c640abcc0 con 0x7f7c6c1454b0 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c69600640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f7c4c071cf0 0x7f7c4c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c640091a0 con 0x7f7c4c071cf0 2024-09-10T08:43:29.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f7c640ae2e0 con 0x7f7c6c1454b0 2024-09-10T08:43:29.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c71800640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4c06be30 0x7f7c4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.017+0000 7f7c70e00640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f7c4c071cf0 0x7f7c4c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.018+0000 7f7c70e00640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f7c4c071cf0 0x7f7c4c074110 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.018+0000 7f7c71800640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4c06be30 0x7f7c4c06e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007fd0 tx=0x7f7c60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.018+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== osd.1 v2:172.21.15.52:6800/2452593582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c640091a0 con 0x7f7c4c071cf0 2024-09-10T08:43:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.032+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 --> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7c6c0ccf40 con 0x7f7c4c071cf0 2024-09-10T08:43:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.032+0000 7f7c69600640 1 -- 172.21.15.52:0/3408181562 <== osd.1 v2:172.21.15.52:6800/2452593582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7c6c0ccf40 con 0x7f7c4c071cf0 2024-09-10T08:43:29.033 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:29.033 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:29.034 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.032+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f7c4c071cf0 msgr2=0x7f7c4c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.032+0000 7f7c74200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:6800/2452593582,v1:172.21.15.52:6801/2452593582] conn(0x7f7c4c071cf0 0x7f7c4c074110 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4c06be30 msgr2=0x7f7c4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f7c4c06be30 0x7f7c4c06e2f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007fd0 tx=0x7f7c60009040 comp rx=0 tx=0).stop 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 msgr2=0x7f7c6c151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 --2- 172.21.15.52:0/3408181562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c6c1454b0 0x7f7c6c151360 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009d90 tx=0x7f7c64004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c72200640 1 -- 172.21.15.52:0/3408181562 reap_dead start 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 shutdown_connections 2024-09-10T08:43:29.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 >> 172.21.15.52:0/3408181562 conn(0x7f7c6c06c240 msgr2=0x7f7c6c071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 shutdown_connections 2024-09-10T08:43:29.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.033+0000 7f7c74200640 1 -- 172.21.15.52:0/3408181562 wait complete. 2024-09-10T08:43:29.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T08:43:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.204+0000 7fd2b1400640 1 Processor -- start 2024-09-10T08:43:29.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.204+0000 7fd2b1400640 1 -- start start 2024-09-10T08:43:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac15e5b0 0x7fd2ac0d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b1400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2ac0d1050 0x7fd2ac0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b1400640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0d33c0 con 0x7fd2ac0cf880 2024-09-10T08:43:29.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b1400640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0b78c0 con 0x7fd2ac0d1050 2024-09-10T08:43:29.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac15e990 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2a3400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2ac0d1050 0x7fd2ac0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b0a00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd2ac0cf880 0x7fd2ac06c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52622/0 (socket says 172.21.15.52:52622) 2024-09-10T08:43:29.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2b0a00640 1 -- 172.21.15.52:0/1769713283 learned_addr learned my addr 172.21.15.52:0/1769713283 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:29.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2abe00640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac15e5b0 0x7fd2ac0d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2a3400640 1 -- 172.21.15.52:0/1769713283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac15e5b0 msgr2=0x7fd2ac0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:29.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2a3400640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac15e5b0 0x7fd2ac0d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.206+0000 7fd2a3400640 1 -- 172.21.15.52:0/1769713283 >> v1:172.21.15.52:6789/0 conn(0x7fd2ac0cf880 legacy=0x7fd2ac06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.207+0000 7fd2a3400640 1 -- 172.21.15.52:0/1769713283 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0d2b20 con 0x7fd2ac0d1050 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.207+0000 7fd2ab400640 1 -- 172.21.15.52:0/1769713283 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157102542 0 0) 0x7fd2ac0d33c0 con 0x7fd2ac0cf880 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.207+0000 7fd2a3400640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac0d1050 0x7fd2ac0cf340 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f751e0b2652dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2ab400640 1 -- 172.21.15.52:0/1769713283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294037070 con 0x7fd2ac0d1050 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2ab400640 1 -- 172.21.15.52:0/1769713283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294032440 con 0x7fd2ac0d1050 2024-09-10T08:43:29.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2ab400640 1 -- 172.21.15.52:0/1769713283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294032810 con 0x7fd2ac0d1050 2024-09-10T08:43:29.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 -- 172.21.15.52:0/1769713283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac0d1050 msgr2=0x7fd2ac0cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac0d1050 0x7fd2ac0cf340 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a180 comp rx=0 tx=0).stop 2024-09-10T08:43:29.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 -- 172.21.15.52:0/1769713283 shutdown_connections 2024-09-10T08:43:29.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac0d1050 0x7fd2ac0cf340 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 --2- 172.21.15.52:0/1769713283 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac15e5b0 0x7fd2ac0d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 -- 172.21.15.52:0/1769713283 >> 172.21.15.52:0/1769713283 conn(0x7fd2ac0b63c0 msgr2=0x7fd2ac0b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 -- 172.21.15.52:0/1769713283 shutdown_connections 2024-09-10T08:43:29.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.208+0000 7fd2b1400640 1 -- 172.21.15.52:0/1769713283 wait complete. 2024-09-10T08:43:29.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.210+0000 7fd2b1400640 1 Processor -- start 2024-09-10T08:43:29.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.210+0000 7fd2b1400640 1 -- start start 2024-09-10T08:43:29.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2ac0cf880 0x7fd2ac0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac0d1050 0x7fd2ac152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0b7af0 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0d30e0 con 0x7fd2ac0cf880 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b1400640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0d2780 con 0x7fd2ac0d1050 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.211+0000 7fd2b0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49496/0 (socket says 172.21.15.52:49496) 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 -- 172.21.15.52:0/2324407260 learned_addr learned my addr 172.21.15.52:0/2324407260 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2abe00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2ac0cf880 0x7fd2ac0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2a3400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac0d1050 0x7fd2ac152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 -- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac0d1050 msgr2=0x7fd2ac152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac0d1050 0x7fd2ac152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 -- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2ac0cf880 msgr2=0x7fd2ac0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2ac0cf880 0x7fd2ac0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 -- 172.21.15.52:0/2324407260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac1500a0 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.212+0000 7fd2b0a00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c7d0 tx=0x7fd2a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.213+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4018070 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.213+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a400a640 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.213+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac0cb8b0 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.213+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400aa70 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.213+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac0cbe70 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.214+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac0cf340 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.215+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2a400ac10 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.215+0000 7fd2a8c00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 0x7fd28806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.216+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fd2a408a1b0 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.216+0000 7fd2abe00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 0x7fd28806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.217+0000 7fd2abe00640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 0x7fd28806e2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac1f7ab0 tx=0x7fd29c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.220+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2a4058780 con 0x7fd2ac15e5b0 2024-09-10T08:43:29.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.402+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd2ac15bf10 con 0x7fd28806be30 2024-09-10T08:43:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.403+0000 7fd2a8c00640 1 -- 172.21.15.52:0/2324407260 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd2ac15bf10 con 0x7fd28806be30 2024-09-10T08:43:29.403 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 msgr2=0x7fd28806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 0x7fd28806e2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac1f7ab0 tx=0x7fd29c009190 comp rx=0 tx=0).stop 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 msgr2=0x7fd2ac15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400c7d0 tx=0x7fd2a400cc90 comp rx=0 tx=0).stop 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 shutdown_connections 2024-09-10T08:43:29.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fd28806be30 0x7fd28806e2f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2ac15e5b0 0x7fd2ac15ee00 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2ac0d1050 0x7fd2ac152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 --2- 172.21.15.52:0/2324407260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2ac0cf880 0x7fd2ac0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 >> 172.21.15.52:0/2324407260 conn(0x7fd2ac0b63c0 msgr2=0x7fd2ac0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 shutdown_connections 2024-09-10T08:43:29.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.405+0000 7fd2b1400640 1 -- 172.21.15.52:0/2324407260 wait complete. 2024-09-10T08:43:29.421 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T08:43:29.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:29.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.581+0000 7f7237200640 1 Processor -- start 2024-09-10T08:43:29.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.581+0000 7f7237200640 1 -- start start 2024-09-10T08:43:29.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7237200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72380b3e00 0x7f723815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7237200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72380b4370 con 0x7f72380cf5c0 2024-09-10T08:43:29.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7237200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72380b4dc0 con 0x7f72380cf9a0 2024-09-10T08:43:29.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7237200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f72380b4650 con 0x7f72380b3e00 2024-09-10T08:43:29.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7235e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f72380cf5c0 0x7f72380b36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52628/0 (socket says 172.21.15.52:52628) 2024-09-10T08:43:29.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f722d400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f72380b3e00 0x7f723815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f7235e00640 1 -- 172.21.15.52:0/3741605647 learned_addr learned my addr 172.21.15.52:0/3741605647 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:29.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f722d400640 1 -- 172.21.15.52:0/3741605647 >> v1:172.21.15.176:6789/0 conn(0x7f72380cf9a0 legacy=0x7f723815c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.583+0000 7f722d400640 1 -- 172.21.15.52:0/3741605647 >> v1:172.21.15.52:6789/0 conn(0x7f72380cf5c0 legacy=0x7f72380b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.584+0000 7f722d400640 1 -- 172.21.15.52:0/3741605647 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72380b50a0 con 0x7f72380b3e00 2024-09-10T08:43:29.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.584+0000 7f7235400640 1 -- 172.21.15.52:0/3741605647 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034806305 0 0) 0x7f72380b4370 con 0x7f72380cf5c0 2024-09-10T08:43:29.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.584+0000 7f722d400640 1 --2- 172.21.15.52:0/3741605647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f723815bfe0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f72200097a0 tx=0x7f722002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b942048cd56c42fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7235400640 1 -- 172.21.15.52:0/3741605647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220037070 con 0x7f72380b3e00 2024-09-10T08:43:29.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7235400640 1 -- 172.21.15.52:0/3741605647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722002ae50 con 0x7f72380b3e00 2024-09-10T08:43:29.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7235400640 1 -- 172.21.15.52:0/3741605647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220032660 con 0x7f72380b3e00 2024-09-10T08:43:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 -- 172.21.15.52:0/3741605647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 msgr2=0x7f723815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 --2- 172.21.15.52:0/3741605647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f723815bfe0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f72200097a0 tx=0x7f722002a100 comp rx=0 tx=0).stop 2024-09-10T08:43:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 -- 172.21.15.52:0/3741605647 shutdown_connections 2024-09-10T08:43:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 --2- 172.21.15.52:0/3741605647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f723815bfe0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 -- 172.21.15.52:0/3741605647 >> 172.21.15.52:0/3741605647 conn(0x7f723806c240 msgr2=0x7f723806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 -- 172.21.15.52:0/3741605647 shutdown_connections 2024-09-10T08:43:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.585+0000 7f7237200640 1 -- 172.21.15.52:0/3741605647 wait complete. 2024-09-10T08:43:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.587+0000 7f7237200640 1 Processor -- start 2024-09-10T08:43:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.587+0000 7f7237200640 1 -- start start 2024-09-10T08:43:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f7238153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72380cf5c0 0x7f723815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72380cf9a0 0x7f7238148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f723815cdb0 con 0x7f72380b3e00 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f723815cc30 con 0x7f72380cf5c0 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7237200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f7238167230 con 0x7f72380cf9a0 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7235e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f7238153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7235e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f7238153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49510/0 (socket says 172.21.15.52:49510) 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.588+0000 7f7235e00640 1 -- 172.21.15.52:0/726935260 learned_addr learned my addr 172.21.15.52:0/726935260 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:29.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7236800640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72380cf9a0 0x7f7238148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f722d400640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72380cf5c0 0x7f723815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 -- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72380cf9a0 msgr2=0x7f7238148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72380cf9a0 0x7f7238148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 -- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72380cf5c0 msgr2=0x7f723815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72380cf5c0 0x7f723815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72381529e0 con 0x7f72380b3e00 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f722d400640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72380cf5c0 0x7f723815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:29.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7236800640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72380cf9a0 0x7f7238148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7235e00640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f7238153780 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f722800c4a0 tx=0x7f722800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228018070 con 0x7f72380b3e00 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72280074e0 con 0x7f72380b3e00 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7238152cc0 con 0x7f72380b3e00 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.589+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228004a20 con 0x7f72380b3e00 2024-09-10T08:43:29.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.590+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7238153280 con 0x7f72380b3e00 2024-09-10T08:43:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.590+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72380b36f0 con 0x7f72380b3e00 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.592+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f722801b070 con 0x7f72380b3e00 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.592+0000 7f722ea00640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f721406be30 0x7f721406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.592+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f7228089ec0 con 0x7f72380b3e00 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f722ea00640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f7214071cf0 0x7f7214074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72140747c0 con 0x7f7214071cf0 2024-09-10T08:43:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f722808c480 con 0x7f72380b3e00 2024-09-10T08:43:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f7236800640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f7214071cf0 0x7f7214074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f722d400640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f721406be30 0x7f721406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.593+0000 7f7236800640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f7214071cf0 0x7f7214074110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.594+0000 7f722d400640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f721406be30 0x7f721406e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7220034000 tx=0x7f722002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.594+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== osd.2 v2:172.21.15.52:6824/3947975143 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72140747c0 con 0x7f7214071cf0 2024-09-10T08:43:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 --> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72380cc170 con 0x7f7214071cf0 2024-09-10T08:43:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f722ea00640 1 -- 172.21.15.52:0/726935260 <== osd.2 v2:172.21.15.52:6824/3947975143 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72380cc170 con 0x7f7214071cf0 2024-09-10T08:43:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:29.609 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f7214071cf0 msgr2=0x7f7214074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:6824/3947975143,v1:172.21.15.52:6825/3947975143] conn(0x7f7214071cf0 0x7f7214074110 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f721406be30 msgr2=0x7f721406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f721406be30 0x7f721406e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7220034000 tx=0x7f722002e000 comp rx=0 tx=0).stop 2024-09-10T08:43:29.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 msgr2=0x7f7238153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 --2- 172.21.15.52:0/726935260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72380b3e00 0x7f7238153780 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f722800c4a0 tx=0x7f722800c960 comp rx=0 tx=0).stop 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7236800640 1 -- 172.21.15.52:0/726935260 reap_dead start 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 shutdown_connections 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.608+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 >> 172.21.15.52:0/726935260 conn(0x7f723806c240 msgr2=0x7f723806e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.609+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 shutdown_connections 2024-09-10T08:43:29.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.609+0000 7f7237200640 1 -- 172.21.15.52:0/726935260 wait complete. 2024-09-10T08:43:29.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T08:43:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.782+0000 7f6399c00640 1 Processor -- start 2024-09-10T08:43:29.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.783+0000 7f6399c00640 1 -- start start 2024-09-10T08:43:29.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63940b2d40 0x7f639406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 0x7f639406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f639415bcf0 0x7f639415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6394071ab0 con 0x7f639415bcf0 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6394071180 con 0x7f639413eb20 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6399c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6394071460 con 0x7f63940b2d40 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6393400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f639415bcf0 0x7f639415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6393400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f639415bcf0 0x7f639415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49526/0 (socket says 172.21.15.52:49526) 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6393400640 1 -- 172.21.15.52:0/2803210679 learned_addr learned my addr 172.21.15.52:0/2803210679 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f638be00640 1 --2- 172.21.15.52:0/2803210679 >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 0x7f639406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.784+0000 7f6392a00640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63940b2d40 0x7f639406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f6393400640 1 -- 172.21.15.52:0/2803210679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63940b2d40 msgr2=0x7f639406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f6393400640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63940b2d40 0x7f639406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f6393400640 1 -- 172.21.15.52:0/2803210679 >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 msgr2=0x7f639406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f6393400640 1 --2- 172.21.15.52:0/2803210679 >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 0x7f639406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f6393400640 1 -- 172.21.15.52:0/2803210679 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6394071740 con 0x7f639415bcf0 2024-09-10T08:43:29.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.785+0000 7f638be00640 1 --2- 172.21.15.52:0/2803210679 >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 0x7f639406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.786+0000 7f6393400640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f639415bcf0 0x7f639415c1a0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f6394073460 tx=0x7f638c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1992caff84bc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.786+0000 7f6392000640 1 -- 172.21.15.52:0/2803210679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c00b2e0 con 0x7f639415bcf0 2024-09-10T08:43:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.786+0000 7f6392000640 1 -- 172.21.15.52:0/2803210679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c009600 con 0x7f639415bcf0 2024-09-10T08:43:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.786+0000 7f6392000640 1 -- 172.21.15.52:0/2803210679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c00b480 con 0x7f639415bcf0 2024-09-10T08:43:29.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 -- 172.21.15.52:0/2803210679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f639415bcf0 msgr2=0x7f639415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f639415bcf0 0x7f639415c1a0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f6394073460 tx=0x7f638c02c8a0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 -- 172.21.15.52:0/2803210679 shutdown_connections 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 --2- 172.21.15.52:0/2803210679 >> v2:172.21.15.176:3300/0 conn(0x7f639413eb20 0x7f639406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f639415bcf0 0x7f639415c1a0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 --2- 172.21.15.52:0/2803210679 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f63940b2d40 0x7f639406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 -- 172.21.15.52:0/2803210679 >> 172.21.15.52:0/2803210679 conn(0x7f63940ccec0 msgr2=0x7f63940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 -- 172.21.15.52:0/2803210679 shutdown_connections 2024-09-10T08:43:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.787+0000 7f6399c00640 1 -- 172.21.15.52:0/2803210679 wait complete. 2024-09-10T08:43:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.788+0000 7f6399c00640 1 Processor -- start 2024-09-10T08:43:29.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.788+0000 7f6399c00640 1 -- start start 2024-09-10T08:43:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 0x7f6394072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639415bcf0 0x7f63940b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f639415f140 con 0x7f63940b2d40 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f639415efc0 con 0x7f639415bcf0 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.789+0000 7f6399c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f639415f2c0 con 0x7f639413eb20 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49540/0 (socket says 172.21.15.52:49540) 2024-09-10T08:43:29.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 -- 172.21.15.52:0/3166854357 learned_addr learned my addr 172.21.15.52:0/3166854357 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6393400640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639415bcf0 0x7f63940b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f638be00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 0x7f6394072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 -- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 msgr2=0x7f6394072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 0x7f6394072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 -- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639415bcf0 msgr2=0x7f63940b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639415bcf0 0x7f63940b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 -- 172.21.15.52:0/3166854357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63940b5920 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f638be00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 0x7f6394072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.790+0000 7f6392a00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f638400d800 tx=0x7f638400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.791+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384018020 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.791+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63840096a0 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.791+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384009a70 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.791+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63940b5bc0 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.791+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63941f4bf0 con 0x7f63940b2d40 2024-09-10T08:43:29.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.792+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639415c1a0 con 0x7f63940b2d40 2024-09-10T08:43:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.793+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f638401b020 con 0x7f63940b2d40 2024-09-10T08:43:29.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.794+0000 7f638aa00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:29.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.794+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f638408ad00 con 0x7f63940b2d40 2024-09-10T08:43:29.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.794+0000 7f638be00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:29.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.795+0000 7f638be00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 0x7f637006e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f639413e320 tx=0x7f637c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:29.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.798+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6384022030 con 0x7f63940b2d40 2024-09-10T08:43:29.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.985+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f639406c9c0 con 0x7f637006be30 2024-09-10T08:43:29.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.985+0000 7f638aa00640 1 -- 172.21.15.52:0/3166854357 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f639406c9c0 con 0x7f637006be30 2024-09-10T08:43:29.986 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T08:43:29.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 msgr2=0x7f637006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 0x7f637006e2f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f639413e320 tx=0x7f637c008040 comp rx=0 tx=0).stop 2024-09-10T08:43:29.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 msgr2=0x7f639413dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:29.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f638400d800 tx=0x7f638400dcc0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 shutdown_connections 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f639415bcf0 0x7f63940b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f639413eb20 0x7f6394072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 --2- 172.21.15.52:0/3166854357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63940b2d40 0x7f639413dde0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 >> 172.21.15.52:0/3166854357 conn(0x7f63940ccec0 msgr2=0x7f639415cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 shutdown_connections 2024-09-10T08:43:29.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:29.988+0000 7f6399c00640 1 -- 172.21.15.52:0/3166854357 wait complete. 2024-09-10T08:43:30.005 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T08:43:30.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.164+0000 7f45ada00640 1 Processor -- start 2024-09-10T08:43:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.164+0000 7f45ada00640 1 -- start start 2024-09-10T08:43:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.165+0000 7f45ada00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a815e7b0 0x7f45a80d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ada00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f45a806bff0 0x7f45a806c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ada00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a80d2dc0 con 0x7f45a815eb90 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ada00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f45a806c9a0 con 0x7f45a806bff0 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ada00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f45a80d39d0 con 0x7f45a815e7b0 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f459f400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f45a815eb90 0x7f45a80b9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52642/0 (socket says 172.21.15.52:52642) 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f459f400640 1 -- 172.21.15.52:0/2222348783 learned_addr learned my addr 172.21.15.52:0/2222348783 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ad000640 1 --2- 172.21.15.52:0/2222348783 >> v2:172.21.15.52:3300/0 conn(0x7f45a806bff0 0x7f45a806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45a7e00640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a815e7b0 0x7f45a80d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45a7400640 1 -- 172.21.15.52:0/2222348783 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280174135 0 0) 0x7f45a80d2dc0 con 0x7f45a815eb90 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45a7400640 1 -- 172.21.15.52:0/2222348783 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f458c003520 con 0x7f45a815eb90 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ad000640 1 -- 172.21.15.52:0/2222348783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a815e7b0 msgr2=0x7f45a80d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ad000640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a815e7b0 0x7f45a80d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.166+0000 7f45ad000640 1 -- 172.21.15.52:0/2222348783 >> v1:172.21.15.52:6789/0 conn(0x7f45a815eb90 legacy=0x7f45a80b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.167+0000 7f45ad000640 1 -- 172.21.15.52:0/2222348783 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a80d30a0 con 0x7f45a806bff0 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.167+0000 7f45ad000640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a806bff0 0x7f45a806c460 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009d90 tx=0x7f45a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a176c1d671ab238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45a7400640 1 -- 172.21.15.52:0/2222348783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0007740 con 0x7f45a806bff0 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45a7400640 1 -- 172.21.15.52:0/2222348783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a00078e0 con 0x7f45a806bff0 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45a7400640 1 -- 172.21.15.52:0/2222348783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0007c90 con 0x7f45a806bff0 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 -- 172.21.15.52:0/2222348783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a806bff0 msgr2=0x7f45a806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a806bff0 0x7f45a806c460 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009d90 tx=0x7f45a002a660 comp rx=0 tx=0).stop 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 -- 172.21.15.52:0/2222348783 shutdown_connections 2024-09-10T08:43:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a806bff0 0x7f45a806c460 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 --2- 172.21.15.52:0/2222348783 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a815e7b0 0x7f45a80d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.168+0000 7f45ada00640 1 -- 172.21.15.52:0/2222348783 >> 172.21.15.52:0/2222348783 conn(0x7f45a80b6320 msgr2=0x7f45a80b6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.169+0000 7f45ada00640 1 -- 172.21.15.52:0/2222348783 shutdown_connections 2024-09-10T08:43:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.169+0000 7f45ada00640 1 -- 172.21.15.52:0/2222348783 wait complete. 2024-09-10T08:43:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.170+0000 7f45ada00640 1 Processor -- start 2024-09-10T08:43:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.170+0000 7f45ada00640 1 -- start start 2024-09-10T08:43:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a806bff0 0x7f45a815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a815e7b0 0x7f45a8161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 0x7f45a80ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45a80d43a0 con 0x7f45a815eb90 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45a80d3660 con 0x7f45a815e7b0 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ada00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f45a80d2950 con 0x7f45a806bff0 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 0x7f45a80ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ad000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 0x7f45a80ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49558/0 (socket says 172.21.15.52:49558) 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45ad000640 1 -- 172.21.15.52:0/767798341 learned_addr learned my addr 172.21.15.52:0/767798341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.171+0000 7f45a7e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a806bff0 0x7f45a815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f459f400640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a815e7b0 0x7f45a8161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 -- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a806bff0 msgr2=0x7f45a815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45a806bff0 0x7f45a815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 -- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a815e7b0 msgr2=0x7f45a8161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a815e7b0 0x7f45a8161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a8161ee0 con 0x7f45a815eb90 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f459f400640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a815e7b0 0x7f45a8161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ad000640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 0x7f45a80ca150 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f45a002a6a0 tx=0x7f45a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0009450 con 0x7f45a815eb90 2024-09-10T08:43:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0004240 con 0x7f45a815eb90 2024-09-10T08:43:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0004630 con 0x7f45a815eb90 2024-09-10T08:43:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.172+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a81f40c0 con 0x7f45a815eb90 2024-09-10T08:43:30.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.173+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a81f4360 con 0x7f45a815eb90 2024-09-10T08:43:30.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.173+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45a815e360 con 0x7f45a815eb90 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.175+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45a004c420 con 0x7f45a815eb90 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.175+0000 7f45a4c00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f458406be30 0x7f458406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f45a00abe40 con 0x7f45a815eb90 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f45a4c00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7f4584071cf0 0x7f4584074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45840747c0 con 0x7f4584071cf0 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f45a00ac1f0 con 0x7f45a815eb90 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f459f400640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7f4584071cf0 0x7f4584074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.176+0000 7f45a7e00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f458406be30 0x7f458406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.177+0000 7f459f400640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7f4584071cf0 0x7f4584074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.177+0000 7f45a7e00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f458406be30 0x7f458406e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f45a8160ad0 tx=0x7f4598009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.177+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== osd.3 v2:172.21.15.52:6812/3392514564 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45840747c0 con 0x7f4584071cf0 2024-09-10T08:43:30.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.190+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 --> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45a806c460 con 0x7f4584071cf0 2024-09-10T08:43:30.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45a4c00640 1 -- 172.21.15.52:0/767798341 <== osd.3 v2:172.21.15.52:6812/3392514564 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f45a806c460 con 0x7f4584071cf0 2024-09-10T08:43:30.192 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:30.192 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:30.192 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:30.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7f4584071cf0 msgr2=0x7f4584074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:6812/3392514564,v1:172.21.15.52:6814/3392514564] conn(0x7f4584071cf0 0x7f4584074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f458406be30 msgr2=0x7f458406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f458406be30 0x7f458406e2f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f45a8160ad0 tx=0x7f4598009190 comp rx=0 tx=0).stop 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 msgr2=0x7f45a80ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 --2- 172.21.15.52:0/767798341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45a815eb90 0x7f45a80ca150 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f45a002a6a0 tx=0x7f45a0004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ad000640 1 -- 172.21.15.52:0/767798341 reap_dead start 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 shutdown_connections 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.191+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 >> 172.21.15.52:0/767798341 conn(0x7f45a80b6320 msgr2=0x7f45a80cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.192+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 shutdown_connections 2024-09-10T08:43:30.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.192+0000 7f45ada00640 1 -- 172.21.15.52:0/767798341 wait complete. 2024-09-10T08:43:30.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T08:43:30.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.364+0000 7f691dc00640 1 Processor -- start 2024-09-10T08:43:30.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.365+0000 7f691dc00640 1 -- start start 2024-09-10T08:43:30.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f691dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 0x7f691815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f691dc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f691813eb20 0x7f691815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f691dc00640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6918071180 con 0x7f69180b2d40 2024-09-10T08:43:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f691dc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6918071ab0 con 0x7f691813eb20 2024-09-10T08:43:30.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f691dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6918071460 con 0x7f691806c320 2024-09-10T08:43:30.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f6917400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f691813eb20 0x7f691815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f6917400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f691813eb20 0x7f691815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49566/0 (socket says 172.21.15.52:49566) 2024-09-10T08:43:30.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f6917400640 1 -- 172.21.15.52:0/530162251 learned_addr learned my addr 172.21.15.52:0/530162251 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.366+0000 7f690e000640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 0x7f691815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.367+0000 7f6917400640 1 -- 172.21.15.52:0/530162251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 msgr2=0x7f691815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.367+0000 7f6917400640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 0x7f691815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.367+0000 7f6917400640 1 -- 172.21.15.52:0/530162251 >> v1:172.21.15.176:6789/0 conn(0x7f69180b2d40 legacy=0x7f691806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.367+0000 7f6917400640 1 -- 172.21.15.52:0/530162251 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6918071740 con 0x7f691813eb20 2024-09-10T08:43:30.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.367+0000 7f690e000640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 0x7f691815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:30.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f6917400640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691813eb20 0x7f691815c230 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f6910009e50 tx=0x7f691002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb81542d4183200 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f6916000640 1 -- 172.21.15.52:0/530162251 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910036070 con 0x7f691813eb20 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f6916000640 1 -- 172.21.15.52:0/530162251 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6910031600 con 0x7f691813eb20 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f6916000640 1 -- 172.21.15.52:0/530162251 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69100319d0 con 0x7f691813eb20 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 -- 172.21.15.52:0/530162251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691813eb20 msgr2=0x7f691815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691813eb20 0x7f691815c230 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f6910009e50 tx=0x7f691002a730 comp rx=0 tx=0).stop 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 -- 172.21.15.52:0/530162251 shutdown_connections 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691813eb20 0x7f691815c230 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 --2- 172.21.15.52:0/530162251 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f691806c320 0x7f691815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.368+0000 7f691dc00640 1 -- 172.21.15.52:0/530162251 >> 172.21.15.52:0/530162251 conn(0x7f69180ccec0 msgr2=0x7f69180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.369+0000 7f691dc00640 1 -- 172.21.15.52:0/530162251 shutdown_connections 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.369+0000 7f691dc00640 1 -- 172.21.15.52:0/530162251 wait complete. 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.370+0000 7f691dc00640 1 Processor -- start 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.370+0000 7f691dc00640 1 -- start start 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69180b2d40 0x7f69180cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f691813eb20 0x7f6918157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69180720c0 con 0x7f691806c320 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6918071f40 con 0x7f691813eb20 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f691dc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6918072240 con 0x7f69180b2d40 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.371+0000 7f6916a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49580/0 (socket says 172.21.15.52:49580) 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 -- 172.21.15.52:0/4137010986 learned_addr learned my addr 172.21.15.52:0/4137010986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f690e000640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69180b2d40 0x7f69180cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6917400640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f691813eb20 0x7f6918157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 -- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69180b2d40 msgr2=0x7f69180cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69180b2d40 0x7f69180cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 -- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f691813eb20 msgr2=0x7f6918157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f691813eb20 0x7f6918157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 -- 172.21.15.52:0/4137010986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69180cb600 con 0x7f691806c320 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.372+0000 7f6916a00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f690800c400 tx=0x7f690800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.373+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080052d0 con 0x7f691806c320 2024-09-10T08:43:30.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.373+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6908005490 con 0x7f691806c320 2024-09-10T08:43:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.373+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908007260 con 0x7f691806c320 2024-09-10T08:43:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.373+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69180cb8e0 con 0x7f691806c320 2024-09-10T08:43:30.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.373+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69180cbea0 con 0x7f691806c320 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.374+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691806bc10 con 0x7f691806c320 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.375+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6908007400 con 0x7f691806c320 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.376+0000 7f690f400640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 0x7f68f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.376+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f690808a090 con 0x7f691806c320 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.376+0000 7f690e000640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 0x7f68f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.377+0000 7f690e000640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 0x7f68f406e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69180b60e0 tx=0x7f6900008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.380+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6908058650 con 0x7f691806c320 2024-09-10T08:43:30.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.564+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f691815fcd0 con 0x7f68f406be30 2024-09-10T08:43:30.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.564+0000 7f690f400640 1 -- 172.21.15.52:0/4137010986 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f691815fcd0 con 0x7f68f406be30 2024-09-10T08:43:30.566 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T08:43:30.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 msgr2=0x7f68f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 0x7f68f406e2f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69180b60e0 tx=0x7f6900008040 comp rx=0 tx=0).stop 2024-09-10T08:43:30.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 msgr2=0x7f69181547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f690800c400 tx=0x7f690800c8c0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 shutdown_connections 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f68f406be30 0x7f68f406e2f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f691813eb20 0x7f6918157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f69180b2d40 0x7f69180cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 --2- 172.21.15.52:0/4137010986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f691806c320 0x7f69181547d0 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 >> 172.21.15.52:0/4137010986 conn(0x7f69180ccec0 msgr2=0x7f6918140950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.566+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 shutdown_connections 2024-09-10T08:43:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.567+0000 7f691dc00640 1 -- 172.21.15.52:0/4137010986 wait complete. 2024-09-10T08:43:30.583 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T08:43:30.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:30.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.744+0000 7f4ecbc00640 1 Processor -- start 2024-09-10T08:43:30.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.744+0000 7f4ecbc00640 1 -- start start 2024-09-10T08:43:30.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ec415ea90 0x7f4ec40d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 0x7f4ec40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec40b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec40d34c0 con 0x7f4ec415ea90 2024-09-10T08:43:30.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec40d1940 con 0x7f4ec40d40b0 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.745+0000 7f4ecbc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec40cf060 con 0x7f4ec40d1510 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ec415ea90 0x7f4ec40d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ec415ea90 0x7f4ec40d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49584/0 (socket says 172.21.15.52:49584) 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 -- 172.21.15.52:0/562647249 learned_addr learned my addr 172.21.15.52:0/562647249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/562647249 >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 0x7f4ec40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9c00640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec40b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 -- 172.21.15.52:0/562647249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 msgr2=0x7f4ec40b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec40b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 -- 172.21.15.52:0/562647249 >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 msgr2=0x7f4ec40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 --2- 172.21.15.52:0/562647249 >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 0x7f4ec40d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9200640 1 -- 172.21.15.52:0/562647249 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec40cf340 con 0x7f4ec415ea90 2024-09-10T08:43:30.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec9c00640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec40b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:30.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.746+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/562647249 >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 0x7f4ec40d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.747+0000 7f4ec9200640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40d2f80 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40d4540 tx=0x7f4eb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4147543e60a193 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.747+0000 7f4ec3400640 1 -- 172.21.15.52:0/562647249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8037070 con 0x7f4ec415ea90 2024-09-10T08:43:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.747+0000 7f4ec3400640 1 -- 172.21.15.52:0/562647249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8032440 con 0x7f4ec415ea90 2024-09-10T08:43:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.747+0000 7f4ec3400640 1 -- 172.21.15.52:0/562647249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8032810 con 0x7f4ec415ea90 2024-09-10T08:43:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 -- 172.21.15.52:0/562647249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 msgr2=0x7f4ec40d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40d2f80 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f4ec40d4540 tx=0x7f4eb802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 -- 172.21.15.52:0/562647249 shutdown_connections 2024-09-10T08:43:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/562647249 >> v2:172.21.15.176:3300/0 conn(0x7f4ec40d40b0 0x7f4ec40d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec40b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/562647249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40d2f80 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 -- 172.21.15.52:0/562647249 >> 172.21.15.52:0/562647249 conn(0x7f4ec406c0e0 msgr2=0x7f4ec406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 -- 172.21.15.52:0/562647249 shutdown_connections 2024-09-10T08:43:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.748+0000 7f4ecbc00640 1 -- 172.21.15.52:0/562647249 wait complete. 2024-09-10T08:43:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.750+0000 7f4ecbc00640 1 Processor -- start 2024-09-10T08:43:30.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.750+0000 7f4ecbc00640 1 -- start start 2024-09-10T08:43:30.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec41f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec40d40b0 0x7f4ec40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec40cfbe0 con 0x7f4ec415ea90 2024-09-10T08:43:30.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec40cf900 con 0x7f4ec40d40b0 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ecbc00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec415ee70 con 0x7f4ec40d1510 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40b9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49586/0 (socket says 172.21.15.52:49586) 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 -- 172.21.15.52:0/610571650 learned_addr learned my addr 172.21.15.52:0/610571650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9200640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec41f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec40d40b0 0x7f4ec40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 -- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 msgr2=0x7f4ec41f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4ec40d1510 0x7f4ec41f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 -- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec40d40b0 msgr2=0x7f4ec40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec40d40b0 0x7f4ec40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec9c00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec40b6460 con 0x7f4ec415ea90 2024-09-10T08:43:30.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.751+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4ec40d40b0 0x7f4ec40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:30.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ec9c00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40b9810 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007e40 tx=0x7f4ebc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc01a070 con 0x7f4ec415ea90 2024-09-10T08:43:30.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ebc003b90 con 0x7f4ec415ea90 2024-09-10T08:43:30.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec41f8290 con 0x7f4ec415ea90 2024-09-10T08:43:30.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc00de80 con 0x7f4ec415ea90 2024-09-10T08:43:30.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.752+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec41f5940 con 0x7f4ec415ea90 2024-09-10T08:43:30.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.753+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ec40d0fd0 con 0x7f4ec415ea90 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.754+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ebc01d070 con 0x7f4ec415ea90 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec0c00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ea406be30 0x7f4ea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f4ebc08ae60 con 0x7f4ec415ea90 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec0c00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f4ea4071cf0 0x7f4ea4074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ebc00be50 con 0x7f4ea4071cf0 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f4ebc08d420 con 0x7f4ec415ea90 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec9200640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ea406be30 0x7f4ea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.755+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f4ea4071cf0 0x7f4ea4074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.756+0000 7f4ec3e00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f4ea4071cf0 0x7f4ea4074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.756+0000 7f4ec9200640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ea406be30 0x7f4ea406e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8034000 tx=0x7f4eb802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.757+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== osd.4 v2:172.21.15.176:6802/3190346421 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ebc00be50 con 0x7f4ea4071cf0 2024-09-10T08:43:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.770+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 --> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ec415d420 con 0x7f4ea4071cf0 2024-09-10T08:43:30.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ec0c00640 1 -- 172.21.15.52:0/610571650 <== osd.4 v2:172.21.15.176:6802/3190346421 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ec415d420 con 0x7f4ea4071cf0 2024-09-10T08:43:30.773 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:30.774 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:30.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f4ea4071cf0 msgr2=0x7f4ea4074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6802/3190346421,v1:172.21.15.176:6803/3190346421] conn(0x7f4ea4071cf0 0x7f4ea4074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ea406be30 msgr2=0x7f4ea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f4ea406be30 0x7f4ea406e2f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8034000 tx=0x7f4eb802e000 comp rx=0 tx=0).stop 2024-09-10T08:43:30.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 msgr2=0x7f4ec40b9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ecbc00640 1 --2- 172.21.15.52:0/610571650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ec415ea90 0x7f4ec40b9810 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc007e40 tx=0x7f4ebc00d4a0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.771+0000 7f4ec9c00640 1 -- 172.21.15.52:0/610571650 reap_dead start 2024-09-10T08:43:30.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.772+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 shutdown_connections 2024-09-10T08:43:30.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.772+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 >> 172.21.15.52:0/610571650 conn(0x7f4ec406c0e0 msgr2=0x7f4ec415dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.772+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 shutdown_connections 2024-09-10T08:43:30.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.772+0000 7f4ecbc00640 1 -- 172.21.15.52:0/610571650 wait complete. 2024-09-10T08:43:30.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T08:43:30.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.943+0000 7f2685200640 1 Processor -- start 2024-09-10T08:43:30.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.943+0000 7f2685200640 1 -- start start 2024-09-10T08:43:30.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 0x7f268015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26801624b0 0x7f26800d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26800b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f26800b7070 con 0x7f26801624b0 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f268015f590 con 0x7f268015eb60 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2685200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f268015f870 con 0x7f26800b66a0 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26801624b0 0x7f26800d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f26801624b0 0x7f26800d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49590/0 (socket says 172.21.15.52:49590) 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 -- 172.21.15.52:0/1047012356 learned_addr learned my addr 172.21.15.52:0/1047012356 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f267e800640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26800b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f267de00640 1 --2- 172.21.15.52:0/1047012356 >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 0x7f268015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 -- 172.21.15.52:0/1047012356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 msgr2=0x7f26800b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26800b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 -- 172.21.15.52:0/1047012356 >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 msgr2=0x7f268015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:30.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 --2- 172.21.15.52:0/1047012356 >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 0x7f268015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f2677e00640 1 -- 172.21.15.52:0/1047012356 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268015fb50 con 0x7f26801624b0 2024-09-10T08:43:30.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.945+0000 7f267de00640 1 --2- 172.21.15.52:0/1047012356 >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 0x7f268015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:43:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.946+0000 7f2677e00640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26801624b0 0x7f26800d2c50 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f26800cb8d0 tx=0x7f266802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9859f7c813cf5fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f267d400640 1 -- 172.21.15.52:0/1047012356 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668037070 con 0x7f26801624b0 2024-09-10T08:43:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f267d400640 1 -- 172.21.15.52:0/1047012356 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266802ae00 con 0x7f26801624b0 2024-09-10T08:43:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f267d400640 1 -- 172.21.15.52:0/1047012356 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668032660 con 0x7f26801624b0 2024-09-10T08:43:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 -- 172.21.15.52:0/1047012356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26801624b0 msgr2=0x7f26800d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26801624b0 0x7f26800d2c50 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f26800cb8d0 tx=0x7f266802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 -- 172.21.15.52:0/1047012356 shutdown_connections 2024-09-10T08:43:30.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26800b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 --2- 172.21.15.52:0/1047012356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26801624b0 0x7f26800d2c50 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 --2- 172.21.15.52:0/1047012356 >> v2:172.21.15.176:3300/0 conn(0x7f268015eb60 0x7f268015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 -- 172.21.15.52:0/1047012356 >> 172.21.15.52:0/1047012356 conn(0x7f26800d16f0 msgr2=0x7f26800d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:30.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 -- 172.21.15.52:0/1047012356 shutdown_connections 2024-09-10T08:43:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.947+0000 7f2685200640 1 -- 172.21.15.52:0/1047012356 wait complete. 2024-09-10T08:43:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.949+0000 7f2685200640 1 Processor -- start 2024-09-10T08:43:30.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.949+0000 7f2685200640 1 -- start start 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26801ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26801624b0 0x7f268015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26800d3190 con 0x7f268015eb60 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26800cef40 con 0x7f26801624b0 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2685200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f26800d4480 con 0x7f26800b66a0 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2677e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2677e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49596/0 (socket says 172.21.15.52:49596) 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f2677e00640 1 -- 172.21.15.52:0/1759936337 learned_addr learned my addr 172.21.15.52:0/1759936337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f267de00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26801ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.950+0000 7f267e800640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26801624b0 0x7f268015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 -- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 msgr2=0x7f26801ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26801ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 -- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26801624b0 msgr2=0x7f268015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26801624b0 0x7f268015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:30.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 -- 172.21.15.52:0/1759936337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26801ea5b0 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2677e00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f26680090b0 tx=0x7f26680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668041070 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2668032e20 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668037040 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26801ea2d0 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.951+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26800c9110 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.952+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26800b6b30 con 0x7f268015eb60 2024-09-10T08:43:30.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.953+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f266803a070 con 0x7f268015eb60 2024-09-10T08:43:30.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.954+0000 7f2676000640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 0x7f265c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:30.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.954+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f26680aae40 con 0x7f268015eb60 2024-09-10T08:43:30.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.955+0000 7f267de00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 0x7f265c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:30.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.955+0000 7f267de00640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 0x7f265c06e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f26800cb380 tx=0x7f2670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:30.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:30.959+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2668079a50 con 0x7f268015eb60 2024-09-10T08:43:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.146+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f26800d2520 con 0x7f265c06be30 2024-09-10T08:43:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.147+0000 7f2676000640 1 -- 172.21.15.52:0/1759936337 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f26800d2520 con 0x7f265c06be30 2024-09-10T08:43:31.148 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T08:43:31.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.149+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 msgr2=0x7f265c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.149+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 0x7f265c06e2f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f26800cb380 tx=0x7f2670008040 comp rx=0 tx=0).stop 2024-09-10T08:43:31.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.149+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 msgr2=0x7f26801ead60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.149+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f26680090b0 tx=0x7f26680046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 shutdown_connections 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f265c06be30 0x7f265c06e2f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26801624b0 0x7f268015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f268015eb60 0x7f26801ead60 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 --2- 172.21.15.52:0/1759936337 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f26800b66a0 0x7f26801ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 >> 172.21.15.52:0/1759936337 conn(0x7f26800d16f0 msgr2=0x7f26800cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 shutdown_connections 2024-09-10T08:43:31.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.150+0000 7f2685200640 1 -- 172.21.15.52:0/1759936337 wait complete. 2024-09-10T08:43:31.166 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T08:43:31.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:31.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.326+0000 7f6ae9000640 1 Processor -- start 2024-09-10T08:43:31.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.326+0000 7f6ae9000640 1 -- start start 2024-09-10T08:43:31.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.327+0000 7f6ae9000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6ae4155b20 0x7f6ae40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae9000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ae40cfb30 0x7f6ae415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae9000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae40b0680 con 0x7f6ae40b21a0 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae9000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae40b01e0 con 0x7f6ae40cfb30 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae9000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae40ccf70 con 0x7f6ae4155b20 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae2800640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6ae40cfb30 0x7f6ae415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ad9400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6ae40b21a0 0x7f6ae40cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52656/0 (socket says 172.21.15.52:52656) 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ad9400640 1 -- 172.21.15.52:0/202301885 learned_addr learned my addr 172.21.15.52:0/202301885 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:31.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae1e00640 1 --2- 172.21.15.52:0/202301885 >> v2:172.21.15.176:3300/0 conn(0x7f6ae4155b20 0x7f6ae40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae2800640 1 -- 172.21.15.52:0/202301885 >> v2:172.21.15.176:3300/0 conn(0x7f6ae4155b20 msgr2=0x7f6ae40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:31.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae2800640 1 --2- 172.21.15.52:0/202301885 >> v2:172.21.15.176:3300/0 conn(0x7f6ae4155b20 0x7f6ae40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae2800640 1 -- 172.21.15.52:0/202301885 >> v1:172.21.15.52:6789/0 conn(0x7f6ae40b21a0 legacy=0x7f6ae40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.328+0000 7f6ae2800640 1 -- 172.21.15.52:0/202301885 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae40ce940 con 0x7f6ae40cfb30 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.329+0000 7f6ae2800640 1 --2- 172.21.15.52:0/202301885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae40cfb30 0x7f6ae415c3b0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f6ae406f370 tx=0x7f6adc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50b9eebc7b281b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae1400640 1 -- 172.21.15.52:0/202301885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc007740 con 0x7f6ae40cfb30 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae1400640 1 -- 172.21.15.52:0/202301885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc0078e0 con 0x7f6ae40cfb30 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae1400640 1 -- 172.21.15.52:0/202301885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc007cb0 con 0x7f6ae40cfb30 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 -- 172.21.15.52:0/202301885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae40cfb30 msgr2=0x7f6ae415c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 --2- 172.21.15.52:0/202301885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae40cfb30 0x7f6ae415c3b0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f6ae406f370 tx=0x7f6adc02a680 comp rx=0 tx=0).stop 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 -- 172.21.15.52:0/202301885 shutdown_connections 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 --2- 172.21.15.52:0/202301885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae40cfb30 0x7f6ae415c3b0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 --2- 172.21.15.52:0/202301885 >> v2:172.21.15.176:3300/0 conn(0x7f6ae4155b20 0x7f6ae40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 -- 172.21.15.52:0/202301885 >> 172.21.15.52:0/202301885 conn(0x7f6ae406c240 msgr2=0x7f6ae406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 -- 172.21.15.52:0/202301885 shutdown_connections 2024-09-10T08:43:31.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.330+0000 7f6ae9000640 1 -- 172.21.15.52:0/202301885 wait complete. 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.332+0000 7f6ae9000640 1 Processor -- start 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.332+0000 7f6ae9000640 1 -- start start 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae40b21a0 0x7f6ae40aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae40cfb30 0x7f6ae40acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 0x7f6ae414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40ce610 con 0x7f6ae4155b20 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40cef00 con 0x7f6ae40b21a0 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae9000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae40ccb20 con 0x7f6ae40cfb30 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 0x7f6ae414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae2800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 0x7f6ae414baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49622/0 (socket says 172.21.15.52:49622) 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.333+0000 7f6ae2800640 1 -- 172.21.15.52:0/420132984 learned_addr learned my addr 172.21.15.52:0/420132984 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ad9400640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae40cfb30 0x7f6ae40acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae1e00640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae40b21a0 0x7f6ae40aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 -- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae40cfb30 msgr2=0x7f6ae40acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6ae40cfb30 0x7f6ae40acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 -- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae40b21a0 msgr2=0x7f6ae40aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6ae40b21a0 0x7f6ae40aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae40ab610 con 0x7f6ae4155b20 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae2800640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 0x7f6ae414baa0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f6adc02ac70 tx=0x7f6adc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc03f070 con 0x7f6ae4155b20 2024-09-10T08:43:31.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc031bc0 con 0x7f6ae4155b20 2024-09-10T08:43:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae40ab8f0 con 0x7f6ae4155b20 2024-09-10T08:43:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.334+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc009450 con 0x7f6ae4155b20 2024-09-10T08:43:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.335+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae40abeb0 con 0x7f6ae4155b20 2024-09-10T08:43:31.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.335+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ae40b3a20 con 0x7f6ae4155b20 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.336+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6adc03b410 con 0x7f6ae4155b20 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.337+0000 7f6adaa00640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac006be30 0x7f6ac006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.337+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f6adc0ac240 con 0x7f6ae4155b20 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6adaa00640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f6ac0071cf0 0x7f6ac0074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ac00747c0 con 0x7f6ac0071cf0 2024-09-10T08:43:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f6adc0b3050 con 0x7f6ae4155b20 2024-09-10T08:43:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6ae1e00640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac006be30 0x7f6ac006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6ad9400640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f6ac0071cf0 0x7f6ac0074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.338+0000 7f6ae1e00640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac006be30 0x7f6ac006e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40af4f0 tx=0x7f6ad4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.339+0000 7f6ad9400640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f6ac0071cf0 0x7f6ac0074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.340+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== osd.5 v2:172.21.15.176:6824/1819402016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ac00747c0 con 0x7f6ac0071cf0 2024-09-10T08:43:31.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.353+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 --> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ae40cf420 con 0x7f6ac0071cf0 2024-09-10T08:43:31.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.353+0000 7f6adaa00640 1 -- 172.21.15.52:0/420132984 <== osd.5 v2:172.21.15.176:6824/1819402016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ae40cf420 con 0x7f6ac0071cf0 2024-09-10T08:43:31.354 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:31.354 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:31.354 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f6ac0071cf0 msgr2=0x7f6ac0074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6824/1819402016,v1:172.21.15.176:6826/1819402016] conn(0x7f6ac0071cf0 0x7f6ac0074110 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac006be30 msgr2=0x7f6ac006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f6ac006be30 0x7f6ac006e2f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40af4f0 tx=0x7f6ad4009190 comp rx=0 tx=0).stop 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 msgr2=0x7f6ae414baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 --2- 172.21.15.52:0/420132984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ae4155b20 0x7f6ae414baa0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f6adc02ac70 tx=0x7f6adc004a40 comp rx=0 tx=0).stop 2024-09-10T08:43:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae2800640 1 -- 172.21.15.52:0/420132984 reap_dead start 2024-09-10T08:43:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 shutdown_connections 2024-09-10T08:43:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 >> 172.21.15.52:0/420132984 conn(0x7f6ae406c240 msgr2=0x7f6ae41591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 shutdown_connections 2024-09-10T08:43:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.354+0000 7f6ae9000640 1 -- 172.21.15.52:0/420132984 wait complete. 2024-09-10T08:43:31.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T08:43:31.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.525+0000 7f80b3000640 1 Processor -- start 2024-09-10T08:43:31.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.525+0000 7f80b3000640 1 -- start start 2024-09-10T08:43:31.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.526+0000 7f80b3000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80ac162c60 0x7f80ac073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.526+0000 7f80b3000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f80ac06f730 0x7f80ac06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.526+0000 7f80b3000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ac1631c0 con 0x7f80ac15e790 2024-09-10T08:43:31.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80b3000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f80ac15eb70 con 0x7f80ac162c60 2024-09-10T08:43:31.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80b3000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f80ac0700c0 con 0x7f80ac06f730 2024-09-10T08:43:31.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80ab400640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f80ac162c60 0x7f80ac073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80abe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f80ac15e790 0x7f80ac0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52660/0 (socket says 172.21.15.52:52660) 2024-09-10T08:43:31.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80abe00640 1 -- 172.21.15.52:0/475160258 learned_addr learned my addr 172.21.15.52:0/475160258 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80b1000640 1 --2- 172.21.15.52:0/475160258 >> v2:172.21.15.176:3300/0 conn(0x7f80ac06f730 0x7f80ac06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80ab400640 1 -- 172.21.15.52:0/475160258 >> v2:172.21.15.176:3300/0 conn(0x7f80ac06f730 msgr2=0x7f80ac06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80ab400640 1 --2- 172.21.15.52:0/475160258 >> v2:172.21.15.176:3300/0 conn(0x7f80ac06f730 0x7f80ac06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80ab400640 1 -- 172.21.15.52:0/475160258 >> v1:172.21.15.52:6789/0 conn(0x7f80ac15e790 legacy=0x7f80ac0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.527+0000 7f80ab400640 1 -- 172.21.15.52:0/475160258 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac0ae9a0 con 0x7f80ac162c60 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.528+0000 7f80ab400640 1 --2- 172.21.15.52:0/475160258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac073a40 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f80ac067eb0 tx=0x7f809802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb9eb5f51313d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80aaa00640 1 -- 172.21.15.52:0/475160258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098037070 con 0x7f80ac162c60 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80aaa00640 1 -- 172.21.15.52:0/475160258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8098032440 con 0x7f80ac162c60 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80aaa00640 1 -- 172.21.15.52:0/475160258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809802ae60 con 0x7f80ac162c60 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 -- 172.21.15.52:0/475160258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 msgr2=0x7f80ac073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 --2- 172.21.15.52:0/475160258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac073a40 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f80ac067eb0 tx=0x7f809802a110 comp rx=0 tx=0).stop 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 -- 172.21.15.52:0/475160258 shutdown_connections 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 --2- 172.21.15.52:0/475160258 >> v2:172.21.15.176:3300/0 conn(0x7f80ac06f730 0x7f80ac06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 --2- 172.21.15.52:0/475160258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac073a40 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 -- 172.21.15.52:0/475160258 >> 172.21.15.52:0/475160258 conn(0x7f80ac0b0a80 msgr2=0x7f80ac0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 -- 172.21.15.52:0/475160258 shutdown_connections 2024-09-10T08:43:31.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.529+0000 7f80b3000640 1 -- 172.21.15.52:0/475160258 wait complete. 2024-09-10T08:43:31.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.531+0000 7f80b3000640 1 Processor -- start 2024-09-10T08:43:31.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.531+0000 7f80b3000640 1 -- start start 2024-09-10T08:43:31.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 0x7f80ac0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 0x7f80ac072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac0af200 con 0x7f80ac162c60 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac0aef20 con 0x7f80ac15e790 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b3000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f80ac0b5b40 con 0x7f80ac06f730 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b1000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49638/0 (socket says 172.21.15.52:49638) 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80b1000640 1 -- 172.21.15.52:0/2185055877 learned_addr learned my addr 172.21.15.52:0/2185055877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80abe00640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 0x7f80ac0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.532+0000 7f80ab400640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 0x7f80ac072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 -- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 msgr2=0x7f80ac0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 0x7f80ac0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 -- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 msgr2=0x7f80ac072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 0x7f80ac072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 -- 172.21.15.52:0/2185055877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac073640 con 0x7f80ac162c60 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80abe00640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 0x7f80ac0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80ab400640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 0x7f80ac072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:31.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b1000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f80a4007e60 tx=0x7f80a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4014420 con 0x7f80ac162c60 2024-09-10T08:43:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4019070 con 0x7f80ac162c60 2024-09-10T08:43:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4014820 con 0x7f80ac162c60 2024-09-10T08:43:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ac155dc0 con 0x7f80ac162c60 2024-09-10T08:43:31.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.533+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ac156340 con 0x7f80ac162c60 2024-09-10T08:43:31.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.534+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ac0733a0 con 0x7f80ac162c60 2024-09-10T08:43:31.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.535+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80a40149c0 con 0x7f80ac162c60 2024-09-10T08:43:31.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.536+0000 7f80a3e00640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 0x7f808c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.536+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f80a408b3b0 con 0x7f80ac162c60 2024-09-10T08:43:31.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.537+0000 7f80abe00640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 0x7f808c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.537+0000 7f80abe00640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 0x7f808c06e2f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f809c000f60 tx=0x7f809c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.540+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80a405a050 con 0x7f80ac162c60 2024-09-10T08:43:31.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.725+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f80ac15d0b0 con 0x7f808c06be30 2024-09-10T08:43:31.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.726+0000 7f80a3e00640 1 -- 172.21.15.52:0/2185055877 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80ac15d0b0 con 0x7f808c06be30 2024-09-10T08:43:31.726 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 msgr2=0x7f808c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 0x7f808c06e2f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f809c000f60 tx=0x7f809c009040 comp rx=0 tx=0).stop 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 msgr2=0x7f80ac149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f80a4007e60 tx=0x7f80a400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 shutdown_connections 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f808c06be30 0x7f808c06e2f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80ac162c60 0x7f80ac149e40 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f80ac15e790 0x7f80ac072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 --2- 172.21.15.52:0/2185055877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f80ac06f730 0x7f80ac0d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 >> 172.21.15.52:0/2185055877 conn(0x7f80ac0b0a80 msgr2=0x7f80ac15d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 shutdown_connections 2024-09-10T08:43:31.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.728+0000 7f80b3000640 1 -- 172.21.15.52:0/2185055877 wait complete. 2024-09-10T08:43:31.744 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T08:43:31.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:31.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.906+0000 7f5c94000640 1 Processor -- start 2024-09-10T08:43:31.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.906+0000 7f5c94000640 1 -- start start 2024-09-10T08:43:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.907+0000 7f5c94000640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5c8c15c470 0x7f5c8c15edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c94000640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c8c0b4750 0x7f5c8c072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c94000640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c073270 con 0x7f5c8c072e60 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c94000640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8c15c850 con 0x7f5c8c0b4750 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c94000640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8c0b4bc0 con 0x7f5c8c15c470 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c92000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5c8c072e60 0x7f5c8c1623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52668/0 (socket says 172.21.15.52:52668) 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c90c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5c8c0b4750 0x7f5c8c072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c92000640 1 -- 172.21.15.52:0/4286044282 learned_addr learned my addr 172.21.15.52:0/4286044282 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c91600640 1 --2- 172.21.15.52:0/4286044282 >> v2:172.21.15.176:3300/0 conn(0x7f5c8c15c470 0x7f5c8c15edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c90c00640 1 -- 172.21.15.52:0/4286044282 >> v2:172.21.15.176:3300/0 conn(0x7f5c8c15c470 msgr2=0x7f5c8c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c90c00640 1 --2- 172.21.15.52:0/4286044282 >> v2:172.21.15.176:3300/0 conn(0x7f5c8c15c470 0x7f5c8c15edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c90c00640 1 -- 172.21.15.52:0/4286044282 >> v1:172.21.15.52:6789/0 conn(0x7f5c8c072e60 legacy=0x7f5c8c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.908+0000 7f5c90c00640 1 -- 172.21.15.52:0/4286044282 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c073910 con 0x7f5c8c0b4750 2024-09-10T08:43:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.909+0000 7f5c90c00640 1 --2- 172.21.15.52:0/4286044282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c072920 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b6280 tx=0x7f5c7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41ee9056230f8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c8be00640 1 -- 172.21.15.52:0/4286044282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78037070 con 0x7f5c8c0b4750 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c8be00640 1 -- 172.21.15.52:0/4286044282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78032440 con 0x7f5c8c0b4750 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c8be00640 1 -- 172.21.15.52:0/4286044282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78032810 con 0x7f5c8c0b4750 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 -- 172.21.15.52:0/4286044282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c0b4750 msgr2=0x7f5c8c072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 --2- 172.21.15.52:0/4286044282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c072920 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0b6280 tx=0x7f5c7802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 -- 172.21.15.52:0/4286044282 shutdown_connections 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 --2- 172.21.15.52:0/4286044282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c072920 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 --2- 172.21.15.52:0/4286044282 >> v2:172.21.15.176:3300/0 conn(0x7f5c8c15c470 0x7f5c8c15edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 -- 172.21.15.52:0/4286044282 >> 172.21.15.52:0/4286044282 conn(0x7f5c8c06c030 msgr2=0x7f5c8c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 -- 172.21.15.52:0/4286044282 shutdown_connections 2024-09-10T08:43:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.910+0000 7f5c94000640 1 -- 172.21.15.52:0/4286044282 wait complete. 2024-09-10T08:43:31.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.912+0000 7f5c94000640 1 Processor -- start 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.912+0000 7f5c94000640 1 -- start start 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c8c072e60 0x7f5c8c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 0x7f5c8c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c0b53a0 con 0x7f5c8c15c470 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c0b50c0 con 0x7f5c8c0b4750 2024-09-10T08:43:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c94000640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8c0b5680 con 0x7f5c8c072e60 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c92000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 0x7f5c8c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c92000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 0x7f5c8c0af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49652/0 (socket says 172.21.15.52:49652) 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c92000640 1 -- 172.21.15.52:0/1187783297 learned_addr learned my addr 172.21.15.52:0/1187783297 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c90c00640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.913+0000 7f5c91600640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c8c072e60 0x7f5c8c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 -- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c8c072e60 msgr2=0x7f5c8c151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5c8c072e60 0x7f5c8c151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 -- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c8c0b4750 msgr2=0x7f5c8c0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c8c0b4750 0x7f5c8c0af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c0d07d0 con 0x7f5c8c15c470 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c92000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 0x7f5c8c0af970 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400cae0 tx=0x7f5c8400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84017070 con 0x7f5c8c15c470 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8400ac40 con 0x7f5c8c15c470 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84012400 con 0x7f5c8c15c470 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.914+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8c15ac40 con 0x7f5c8c15c470 2024-09-10T08:43:31.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.915+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8c15b200 con 0x7f5c8c15c470 2024-09-10T08:43:31.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.915+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c8c06e690 con 0x7f5c8c15c470 2024-09-10T08:43:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.916+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c8401a070 con 0x7f5c8c15c470 2024-09-10T08:43:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.917+0000 7f5c89600640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5c6c06be30 0x7f5c6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.917+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f5c8408a8e0 con 0x7f5c8c15c470 2024-09-10T08:43:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c89600640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7f5c6c071cf0 0x7f5c6c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:31.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c6c0747c0 con 0x7f5c6c071cf0 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f5c8408f2a0 con 0x7f5c8c15c470 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c91600640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5c6c06be30 0x7f5c6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c90c00640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7f5c6c071cf0 0x7f5c6c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.918+0000 7f5c91600640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5c6c06be30 0x7f5c6c06e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5c800079a0 tx=0x7f5c80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.919+0000 7f5c90c00640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7f5c6c071cf0 0x7f5c6c074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:31.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.920+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== osd.6 v2:172.21.15.176:6818/2589759932 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c6c0747c0 con 0x7f5c6c071cf0 2024-09-10T08:43:31.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.933+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 --> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5c8c15b690 con 0x7f5c6c071cf0 2024-09-10T08:43:31.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c89600640 1 -- 172.21.15.52:0/1187783297 <== osd.6 v2:172.21.15.176:6818/2589759932 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5c8c15b690 con 0x7f5c6c071cf0 2024-09-10T08:43:31.934 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:31.935 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:31.935 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7f5c6c071cf0 msgr2=0x7f5c6c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6818/2589759932,v1:172.21.15.176:6819/2589759932] conn(0x7f5c6c071cf0 0x7f5c6c074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5c6c06be30 msgr2=0x7f5c6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f5c6c06be30 0x7f5c6c06e2f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5c800079a0 tx=0x7f5c80008040 comp rx=0 tx=0).stop 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 msgr2=0x7f5c8c0af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 --2- 172.21.15.52:0/1187783297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c8c15c470 0x7f5c8c0af970 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400cae0 tx=0x7f5c8400a060 comp rx=0 tx=0).stop 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c92000640 1 -- 172.21.15.52:0/1187783297 reap_dead start 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 shutdown_connections 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.934+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 >> 172.21.15.52:0/1187783297 conn(0x7f5c8c06c030 msgr2=0x7f5c8c0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.935+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 shutdown_connections 2024-09-10T08:43:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:31.935+0000 7f5c94000640 1 -- 172.21.15.52:0/1187783297 wait complete. 2024-09-10T08:43:31.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T08:43:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.105+0000 7f13ad200640 1 Processor -- start 2024-09-10T08:43:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.105+0000 7f13ad200640 1 -- start start 2024-09-10T08:43:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.106+0000 7f13ad200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13ad200640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f13a813eb20 0x7f13a815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13ad200640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a8071180 con 0x7f13a80b2d40 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13ad200640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f13a8071ab0 con 0x7f13a813eb20 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13ad200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f13a8071460 con 0x7f13a806c320 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13a5e00640 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f13a80b2d40 0x7f13a806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.52:60376/0 (socket says 172.21.15.52:60376) 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13a5e00640 1 -- 172.21.15.52:0/3582585050 learned_addr learned my addr 172.21.15.52:0/3582585050 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f139fe00640 1 --2- 172.21.15.52:0/3582585050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13a6800640 1 --2- 172.21.15.52:0/3582585050 >> v2:172.21.15.176:3300/0 conn(0x7f13a813eb20 0x7f13a815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13a5400640 1 -- 172.21.15.52:0/3582585050 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435683106 0 0) 0x7f13a8071180 con 0x7f13a80b2d40 2024-09-10T08:43:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.107+0000 7f13a5400640 1 -- 172.21.15.52:0/3582585050 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f138c003520 con 0x7f13a80b2d40 2024-09-10T08:43:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.108+0000 7f139fe00640 1 -- 172.21.15.52:0/3582585050 >> v2:172.21.15.176:3300/0 conn(0x7f13a813eb20 msgr2=0x7f13a815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.108+0000 7f139fe00640 1 --2- 172.21.15.52:0/3582585050 >> v2:172.21.15.176:3300/0 conn(0x7f13a813eb20 0x7f13a815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.108+0000 7f139fe00640 1 -- 172.21.15.52:0/3582585050 >> v1:172.21.15.176:6789/0 conn(0x7f13a80b2d40 legacy=0x7f13a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.108+0000 7f139fe00640 1 -- 172.21.15.52:0/3582585050 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8071740 con 0x7f13a806c320 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f139fe00640 1 --2- 172.21.15.52:0/3582585050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a815bcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13900097a0 tx=0x7f139002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c495c043f4afb9cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f13a5400640 1 -- 172.21.15.52:0/3582585050 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390037070 con 0x7f13a806c320 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f13a5400640 1 -- 172.21.15.52:0/3582585050 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390032440 con 0x7f13a806c320 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f13a5400640 1 -- 172.21.15.52:0/3582585050 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390032810 con 0x7f13a806c320 2024-09-10T08:43:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f13ad200640 1 -- 172.21.15.52:0/3582585050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 msgr2=0x7f13a815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.109+0000 7f13ad200640 1 --2- 172.21.15.52:0/3582585050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a815bcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13900097a0 tx=0x7f139002a180 comp rx=0 tx=0).stop 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 -- 172.21.15.52:0/3582585050 shutdown_connections 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 --2- 172.21.15.52:0/3582585050 >> v2:172.21.15.176:3300/0 conn(0x7f13a813eb20 0x7f13a815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 --2- 172.21.15.52:0/3582585050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a815bcf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 -- 172.21.15.52:0/3582585050 >> 172.21.15.52:0/3582585050 conn(0x7f13a80ccec0 msgr2=0x7f13a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 -- 172.21.15.52:0/3582585050 shutdown_connections 2024-09-10T08:43:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.110+0000 7f13ad200640 1 -- 172.21.15.52:0/3582585050 wait complete. 2024-09-10T08:43:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.111+0000 7f13ad200640 1 Processor -- start 2024-09-10T08:43:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.111+0000 7f13ad200640 1 -- start start 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a80b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13a813eb20 0x7f13a813cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13a80720c0 con 0x7f13a80b2d40 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8071f40 con 0x7f13a813eb20 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f13ad200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f13a8072240 con 0x7f13a806c320 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.112+0000 7f139fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49664/0 (socket says 172.21.15.52:49664) 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 -- 172.21.15.52:0/3617867163 learned_addr learned my addr 172.21.15.52:0/3617867163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f13a6800640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13a813eb20 0x7f13a813cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f13a5e00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a80b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 -- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 msgr2=0x7f13a80b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a80b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 -- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13a813eb20 msgr2=0x7f13a813cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13a813eb20 0x7f13a813cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 -- 172.21.15.52:0/3617867163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a80b3ab0 con 0x7f13a80b2d40 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.113+0000 7f139fe00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f13900098c0 tx=0x7f13900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.114+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390041030 con 0x7f13a80b2d40 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.114+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139003d4e0 con 0x7f13a80b2d40 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.114+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390037040 con 0x7f13a80b2d40 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.114+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a80b4370 con 0x7f13a80b2d40 2024-09-10T08:43:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.114+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a80b4930 con 0x7f13a80b2d40 2024-09-10T08:43:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.115+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a806bc10 con 0x7f13a80b2d40 2024-09-10T08:43:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.116+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1390044070 con 0x7f13a80b2d40 2024-09-10T08:43:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.117+0000 7f139e000640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 0x7f138406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.117+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f13900ab060 con 0x7f13a80b2d40 2024-09-10T08:43:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.117+0000 7f13a5e00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 0x7f138406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.118+0000 7f13a5e00640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 0x7f138406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1398005880 tx=0x7f1398009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.121+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1390079630 con 0x7f13a80b2d40 2024-09-10T08:43:32.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.303+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f13a806c9c0 con 0x7f138406be30 2024-09-10T08:43:32.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.304+0000 7f139e000640 1 -- 172.21.15.52:0/3617867163 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13a806c9c0 con 0x7f138406be30 2024-09-10T08:43:32.307 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T08:43:32.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 msgr2=0x7f138406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 0x7f138406e2f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1398005880 tx=0x7f1398009040 comp rx=0 tx=0).stop 2024-09-10T08:43:32.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 msgr2=0x7f13a8154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f13900098c0 tx=0x7f13900046c0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 shutdown_connections 2024-09-10T08:43:32.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f138406be30 0x7f138406e2f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13a813eb20 0x7f13a813cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a80b2d40 0x7f13a8154210 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 --2- 172.21.15.52:0/3617867163 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13a806c320 0x7f13a80b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 >> 172.21.15.52:0/3617867163 conn(0x7f13a80ccec0 msgr2=0x7f13a81405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 shutdown_connections 2024-09-10T08:43:32.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.306+0000 7f13ad200640 1 -- 172.21.15.52:0/3617867163 wait complete. 2024-09-10T08:43:32.323 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T08:43:32.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:43:32.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.484+0000 7f50ea200640 1 Processor -- start 2024-09-10T08:43:32.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.484+0000 7f50ea200640 1 -- start start 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.485+0000 7f50ea200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 0x7f50e40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.485+0000 7f50ea200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f50e40b21a0 0x7f50e40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.485+0000 7f50ea200640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e40b0680 con 0x7f50e40cf960 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.485+0000 7f50ea200640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f50e40b2600 con 0x7f50e40b21a0 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.485+0000 7f50ea200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40b01e0 con 0x7f50e4155b20 2024-09-10T08:43:32.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e3e00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f50e40cf960 0x7f50e415ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52674/0 (socket says 172.21.15.52:52674) 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e3e00640 1 -- 172.21.15.52:0/603764999 learned_addr learned my addr 172.21.15.52:0/603764999 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2a00640 1 --2- 172.21.15.52:0/603764999 >> v2:172.21.15.52:3300/0 conn(0x7f50e40b21a0 0x7f50e40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e3400640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 0x7f50e40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2000640 1 -- 172.21.15.52:0/603764999 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273519745 0 0) 0x7f50e40b0680 con 0x7f50e40cf960 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2a00640 1 -- 172.21.15.52:0/603764999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 msgr2=0x7f50e40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:32.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2a00640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 0x7f50e40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2a00640 1 -- 172.21.15.52:0/603764999 >> v1:172.21.15.52:6789/0 conn(0x7f50e40cf960 legacy=0x7f50e415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e2a00640 1 -- 172.21.15.52:0/603764999 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40ccf70 con 0x7f50e40b21a0 2024-09-10T08:43:32.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.486+0000 7f50e3400640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 0x7f50e40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:32.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.487+0000 7f50e2a00640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e40b21a0 0x7f50e40cf420 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f50d00097d0 tx=0x7f50d002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f62013b58feb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.487+0000 7f50e2000640 1 -- 172.21.15.52:0/603764999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0037070 con 0x7f50e40b21a0 2024-09-10T08:43:32.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.487+0000 7f50e2000640 1 -- 172.21.15.52:0/603764999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0032440 con 0x7f50e40b21a0 2024-09-10T08:43:32.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50e2000640 1 -- 172.21.15.52:0/603764999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0032810 con 0x7f50e40b21a0 2024-09-10T08:43:32.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 -- 172.21.15.52:0/603764999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e40b21a0 msgr2=0x7f50e40cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e40b21a0 0x7f50e40cf420 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f50d00097d0 tx=0x7f50d002a1c0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 -- 172.21.15.52:0/603764999 shutdown_connections 2024-09-10T08:43:32.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e40b21a0 0x7f50e40cf420 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 --2- 172.21.15.52:0/603764999 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e4155b20 0x7f50e40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 -- 172.21.15.52:0/603764999 >> 172.21.15.52:0/603764999 conn(0x7f50e406c240 msgr2=0x7f50e406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 -- 172.21.15.52:0/603764999 shutdown_connections 2024-09-10T08:43:32.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.488+0000 7f50ea200640 1 -- 172.21.15.52:0/603764999 wait complete. 2024-09-10T08:43:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.490+0000 7f50ea200640 1 Processor -- start 2024-09-10T08:43:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.490+0000 7f50ea200640 1 -- start start 2024-09-10T08:43:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e40b21a0 0x7f50e40b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e40cf960 0x7f50e41f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 0x7f50e4147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40cef00 con 0x7f50e4155b20 2024-09-10T08:43:32.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40cec20 con 0x7f50e40b21a0 2024-09-10T08:43:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50ea200640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40cfdb0 con 0x7f50e40cf960 2024-09-10T08:43:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 0x7f50e4147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 0x7f50e4147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49690/0 (socket says 172.21.15.52:49690) 2024-09-10T08:43:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.491+0000 7f50e3e00640 1 -- 172.21.15.52:0/93255966 learned_addr learned my addr 172.21.15.52:0/93255966 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3400640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e40b21a0 0x7f50e40b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e2a00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e40cf960 0x7f50e41f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 -- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e40cf960 msgr2=0x7f50e41f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50e40cf960 0x7f50e41f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 -- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e40b21a0 msgr2=0x7f50e40b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50e40b21a0 0x7f50e40b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40b3710 con 0x7f50e4155b20 2024-09-10T08:43:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50e3e00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 0x7f50e4147e00 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00cb20 tx=0x7f50dc0021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00ac00 con 0x7f50e4155b20 2024-09-10T08:43:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc00adc0 con 0x7f50e4155b20 2024-09-10T08:43:32.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e40b39f0 con 0x7f50e4155b20 2024-09-10T08:43:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc012640 con 0x7f50e4155b20 2024-09-10T08:43:32.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.492+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e4148340 con 0x7f50e4155b20 2024-09-10T08:43:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.493+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50e40b3f40 con 0x7f50e4155b20 2024-09-10T08:43:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.494+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50dc0127e0 con 0x7f50e4155b20 2024-09-10T08:43:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.495+0000 7f50db400640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c406be30 0x7f50c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.495+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f50dc08b1a0 con 0x7f50e4155b20 2024-09-10T08:43:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.495+0000 7f50db400640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7f50c4071cf0 0x7f50c4074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.495+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50dc00de50 con 0x7f50c4071cf0 2024-09-10T08:43:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.495+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) ==== 24+0+0 (secure 0 0 0) 0x7f50dc092050 con 0x7f50e4155b20 2024-09-10T08:43:32.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.496+0000 7f50e3400640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c406be30 0x7f50c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.496+0000 7f50e2a00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7f50c4071cf0 0x7f50c4074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.496+0000 7f50e3400640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c406be30 0x7f50c406e2f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006fd0 tx=0x7f50d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.496+0000 7f50e2a00640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7f50c4071cf0 0x7f50c4074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.498+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== osd.7 v2:172.21.15.176:6810/2943871986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50dc00de50 con 0x7f50c4071cf0 2024-09-10T08:43:32.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.511+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 --> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50e40b65c0 con 0x7f50c4071cf0 2024-09-10T08:43:32.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.511+0000 7f50db400640 1 -- 172.21.15.52:0/93255966 <== osd.7 v2:172.21.15.176:6810/2943871986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50d0032540 con 0x7f50c4071cf0 2024-09-10T08:43:32.516 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T08:43:32.517 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:43:32.517 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T08:43:32.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7f50c4071cf0 msgr2=0x7f50c4074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6810/2943871986,v1:172.21.15.176:6811/2943871986] conn(0x7f50c4071cf0 0x7f50c4074110 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c406be30 msgr2=0x7f50c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f50c406be30 0x7f50c406e2f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f50d4006fd0 tx=0x7f50d4008040 comp rx=0 tx=0).stop 2024-09-10T08:43:32.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 msgr2=0x7f50e4147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 --2- 172.21.15.52:0/93255966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50e4155b20 0x7f50e4147e00 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00cb20 tx=0x7f50dc0021c0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50e3e00640 1 -- 172.21.15.52:0/93255966 reap_dead start 2024-09-10T08:43:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 shutdown_connections 2024-09-10T08:43:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 >> 172.21.15.52:0/93255966 conn(0x7f50e406c240 msgr2=0x7f50e40ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 shutdown_connections 2024-09-10T08:43:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.512+0000 7f50ea200640 1 -- 172.21.15.52:0/93255966 wait complete. 2024-09-10T08:43:32.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T08:43:32.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.684+0000 7fa538c00640 1 Processor -- start 2024-09-10T08:43:32.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.684+0000 7fa538c00640 1 -- start start 2024-09-10T08:43:32.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa538c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5340b2d40 0x7fa53406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa538c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa53406c150 0x7fa53415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa538c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa534071180 con 0x7fa53413eb20 2024-09-10T08:43:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa538c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa534071ab0 con 0x7fa5340b2d40 2024-09-10T08:43:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa538c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fa534071460 con 0x7fa53406c150 2024-09-10T08:43:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa531400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa53413eb20 0x7fa53415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52678/0 (socket says 172.21.15.52:52678) 2024-09-10T08:43:32.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa531400640 1 -- 172.21.15.52:0/519271028 learned_addr learned my addr 172.21.15.52:0/519271028 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.685+0000 7fa531e00640 1 --2- 172.21.15.52:0/519271028 >> v2:172.21.15.52:3300/0 conn(0x7fa5340b2d40 0x7fa53406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa532800640 1 --2- 172.21.15.52:0/519271028 >> v2:172.21.15.176:3300/0 conn(0x7fa53406c150 0x7fa53415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa531e00640 1 -- 172.21.15.52:0/519271028 >> v2:172.21.15.176:3300/0 conn(0x7fa53406c150 msgr2=0x7fa53415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa531e00640 1 --2- 172.21.15.52:0/519271028 >> v2:172.21.15.176:3300/0 conn(0x7fa53406c150 0x7fa53415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa531e00640 1 -- 172.21.15.52:0/519271028 >> v1:172.21.15.52:6789/0 conn(0x7fa53413eb20 legacy=0x7fa53415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa530a00640 1 -- 172.21.15.52:0/519271028 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409543548 0 0) 0x7fa534071180 con 0x7fa53413eb20 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.686+0000 7fa531e00640 1 -- 172.21.15.52:0/519271028 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa534071740 con 0x7fa5340b2d40 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.687+0000 7fa531e00640 1 --2- 172.21.15.52:0/519271028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa53406bc10 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fa534070d30 tx=0x7fa52402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ef4521718b6f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.687+0000 7fa530a00640 1 -- 172.21.15.52:0/519271028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524037070 con 0x7fa5340b2d40 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.687+0000 7fa530a00640 1 -- 172.21.15.52:0/519271028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa524032440 con 0x7fa5340b2d40 2024-09-10T08:43:32.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.687+0000 7fa530a00640 1 -- 172.21.15.52:0/519271028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524032810 con 0x7fa5340b2d40 2024-09-10T08:43:32.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 -- 172.21.15.52:0/519271028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 msgr2=0x7fa53406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 --2- 172.21.15.52:0/519271028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa53406bc10 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fa534070d30 tx=0x7fa52402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 -- 172.21.15.52:0/519271028 shutdown_connections 2024-09-10T08:43:32.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 --2- 172.21.15.52:0/519271028 >> v2:172.21.15.176:3300/0 conn(0x7fa53406c150 0x7fa53415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 --2- 172.21.15.52:0/519271028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa53406bc10 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 -- 172.21.15.52:0/519271028 >> 172.21.15.52:0/519271028 conn(0x7fa5340ccec0 msgr2=0x7fa5340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 -- 172.21.15.52:0/519271028 shutdown_connections 2024-09-10T08:43:32.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.688+0000 7fa538c00640 1 -- 172.21.15.52:0/519271028 wait complete. 2024-09-10T08:43:32.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.690+0000 7fa538c00640 1 Processor -- start 2024-09-10T08:43:32.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.690+0000 7fa538c00640 1 -- start start 2024-09-10T08:43:32.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 0x7fa53413dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 0x7fa5340c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340722d0 con 0x7fa5340b2d40 2024-09-10T08:43:32.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa534072150 con 0x7fa53406c150 2024-09-10T08:43:32.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa538c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fa534072450 con 0x7fa53413eb20 2024-09-10T08:43:32.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49696/0 (socket says 172.21.15.52:49696) 2024-09-10T08:43:32.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 -- 172.21.15.52:0/3951394853 learned_addr learned my addr 172.21.15.52:0/3951394853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:32.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531e00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 0x7fa53413dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa532800640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 0x7fa5340c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 -- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 msgr2=0x7fa5340c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 0x7fa5340c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 -- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 msgr2=0x7fa53413dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 0x7fa53413dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531400640 1 -- 172.21.15.52:0/3951394853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53413f9c0 con 0x7fa5340b2d40 2024-09-10T08:43:32.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa531e00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 0x7fa53413dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:32.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.691+0000 7fa532800640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 0x7fa5340c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:43:32.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa531400640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c410 tx=0x7fa52000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5200074e0 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5200047e0 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520004bd0 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53413fc40 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.692+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa534140200 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.693+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53406bc10 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.694+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa520011070 con 0x7fa5340b2d40 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.695+0000 7fa52a000640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:32.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.695+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fa52008a7f0 con 0x7fa5340b2d40 2024-09-10T08:43:32.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.695+0000 7fa531e00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:32.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.696+0000 7fa531e00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 0x7fa51406e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa524034000 tx=0x7fa52402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:32.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.699+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa53413f9c0 con 0x7fa5340b2d40 2024-09-10T08:43:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.885+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa53406c9c0 con 0x7fa51406be30 2024-09-10T08:43:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.886+0000 7fa52a000640 1 -- 172.21.15.52:0/3951394853 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa53406c9c0 con 0x7fa51406be30 2024-09-10T08:43:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T08:43:32.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 msgr2=0x7fa51406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 0x7fa51406e2f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa524034000 tx=0x7fa52402e000 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 msgr2=0x7fa5340c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fa52000c410 tx=0x7fa52000c8d0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 shutdown_connections 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa53413eb20 0x7fa5340c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5340b2d40 0x7fa5340c9a40 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 --2- 172.21.15.52:0/3951394853 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa53406c150 0x7fa53413dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 >> 172.21.15.52:0/3951394853 conn(0x7fa5340ccec0 msgr2=0x7fa5340b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 shutdown_connections 2024-09-10T08:43:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:32.888+0000 7fa538c00640 1 -- 172.21.15.52:0/3951394853 wait complete. 2024-09-10T08:43:32.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:43:33.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.060+0000 7fc032e00640 1 Processor -- start 2024-09-10T08:43:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.060+0000 7fc032e00640 1 -- start start 2024-09-10T08:43:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc032e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc032e00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc02c0b6710 0x7fc02c0b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc032e00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02c0d3990 con 0x7fc02c0cf450 2024-09-10T08:43:33.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc032e00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c0d3c70 con 0x7fc02c0b6710 2024-09-10T08:43:33.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc032e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0d3f50 con 0x7fc02c15e440 2024-09-10T08:43:33.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc031000640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc02c0cf450 0x7fc02c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52692/0 (socket says 172.21.15.52:52692) 2024-09-10T08:43:33.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.061+0000 7fc031000640 1 -- 172.21.15.52:0/279096307 learned_addr learned my addr 172.21.15.52:0/279096307 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:33.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc032400640 1 --2- 172.21.15.52:0/279096307 >> v2:172.21.15.176:3300/0 conn(0x7fc02c0b6710 0x7fc02c0b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc031a00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404645044 0 0) 0x7fc02c0d3990 con 0x7fc02c0cf450 2024-09-10T08:43:33.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc014003520 con 0x7fc02c0cf450 2024-09-10T08:43:33.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3015175960 0 0) 0x7fc014003520 con 0x7fc02c0cf450 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 msgr2=0x7fc02c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 >> v2:172.21.15.176:3300/0 conn(0x7fc02c0b6710 msgr2=0x7fc02c0b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 --2- 172.21.15.52:0/279096307 >> v2:172.21.15.176:3300/0 conn(0x7fc02c0b6710 0x7fc02c0b7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c0d4230 con 0x7fc02c0cf450 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7fc018001670 con 0x7fc02c0cf450 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 >> v1:172.21.15.52:6789/0 conn(0x7fc02c0cf450 legacy=0x7fc02c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0140039b0 0x7fc014003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc014004800 0x7fc014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc0140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0d3c70 con 0x7fc014004800 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0d3f50 con 0x7fc0140039b0 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.062+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc01400b9f0 con 0x7fc02c15e440 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc031000640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc014004800 0x7fc014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc0140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc031a00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0140039b0 0x7fc014003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 -- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0140039b0 msgr2=0x7fc014003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0140039b0 0x7fc014003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 -- 172.21.15.52:0/279096307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc014004800 msgr2=0x7fc014004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc014004800 0x7fc014004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.063+0000 7fc032400640 1 -- 172.21.15.52:0/279096307 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc014003520 con 0x7fc02c15e440 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.064+0000 7fc032400640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc0140051c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc024009f90 tx=0x7fc014005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ce2db91b013538 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024009c10 con 0x7fc02c15e440 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc024036070 con 0x7fc02c15e440 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc02be00640 1 -- 172.21.15.52:0/279096307 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024031880 con 0x7fc02c15e440 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 -- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 msgr2=0x7fc0140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 --2- 172.21.15.52:0/279096307 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc0140051c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc024009f90 tx=0x7fc014005830 comp rx=0 tx=0).stop 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032400640 1 -- 172.21.15.52:0/279096307 reap_dead start 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 -- 172.21.15.52:0/279096307 shutdown_connections 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 -- 172.21.15.52:0/279096307 >> 172.21.15.52:0/279096307 conn(0x7fc02c067f80 msgr2=0x7fc02c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 -- 172.21.15.52:0/279096307 shutdown_connections 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.065+0000 7fc032e00640 1 -- 172.21.15.52:0/279096307 wait complete. 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.067+0000 7fc032e00640 1 Processor -- start 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.067+0000 7fc032e00640 1 -- start start 2024-09-10T08:43:33.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0ce4e0 0x7fc02c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0b76c0 con 0x7fc02c0cb730 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c0b7540 con 0x7fc02c0ce4e0 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032e00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0d3240 con 0x7fc02c15e440 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc031000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc031000640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49718/0 (socket says 172.21.15.52:49718) 2024-09-10T08:43:33.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc031000640 1 -- 172.21.15.52:0/324935148 learned_addr learned my addr 172.21.15.52:0/324935148 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc031a00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.068+0000 7fc032400640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0ce4e0 0x7fc02c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 -- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 msgr2=0x7fc02c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 -- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0ce4e0 msgr2=0x7fc02c14d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0ce4e0 0x7fc02c14d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 -- 172.21.15.52:0/324935148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c159670 con 0x7fc02c0cb730 2024-09-10T08:43:33.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc031000640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fc018007310 tx=0x7fc018007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01800f9c0 con 0x7fc02c0cb730 2024-09-10T08:43:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc018018070 con 0x7fc02c0cb730 2024-09-10T08:43:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01800fde0 con 0x7fc02c0cb730 2024-09-10T08:43:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.069+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c0cea10 con 0x7fc02c0cb730 2024-09-10T08:43:33.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.070+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c159c10 con 0x7fc02c0cb730 2024-09-10T08:43:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.071+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c159e10 con 0x7fc02c0cb730 2024-09-10T08:43:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.072+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc01801d460 con 0x7fc02c0cb730 2024-09-10T08:43:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.072+0000 7fc029600640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.072+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fc01808abd0 con 0x7fc02c0cb730 2024-09-10T08:43:33.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.073+0000 7fc031a00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.074+0000 7fc031a00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 0x7fc00c06e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc020009bc0 tx=0x7fc020009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.077+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc02c159e10 con 0x7fc02c0cb730 2024-09-10T08:43:33.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.256+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 --> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc02c0d35c0 con 0x7fc00c06be30 2024-09-10T08:43:33.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.258+0000 7fc029600640 1 -- 172.21.15.52:0/324935148 <== mgr.4107 v2:172.21.15.176:6800/1001247372 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13402 (secure 0 0 0) 0x7fc02c0d35c0 con 0x7fc00c06be30 2024-09-10T08:43:33.259 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:33.259 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-10T08:43:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 msgr2=0x7fc00c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 0x7fc00c06e2f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc020009bc0 tx=0x7fc020009190 comp rx=0 tx=0).stop 2024-09-10T08:43:33.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 msgr2=0x7fc02c0cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fc018007310 tx=0x7fc018007710 comp rx=0 tx=0).stop 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 shutdown_connections 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fc00c06be30 0x7fc00c06e2f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc02c0ce4e0 0x7fc02c14d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc02c0cb730 0x7fc02c0cdfa0 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 --2- 172.21.15.52:0/324935148 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc02c15e440 0x7fc02c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 >> 172.21.15.52:0/324935148 conn(0x7fc02c067f80 msgr2=0x7fc02c0b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:33.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 shutdown_connections 2024-09-10T08:43:33.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.260+0000 7fc032e00640 1 -- 172.21.15.52:0/324935148 wait complete. 2024-09-10T08:43:33.276 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":640,"stamp":"2024-09-10T08:43:31.678367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":465844,"kb_used_data":20680,"kb_used_omap":12,"kb_used_meta":444979,"kb_avail":754508876,"statfs":{"total":773094113280,"available":772617089024,"internally_reserved":0,"allocated":21176320,"data_stored":9962272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":455659056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-7,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002247"},"pg_stats":[{"pgid":"1.0","version":"198'119","reported_seq":505,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-10T08:43:29.954923+0000","last_change":"2024-09-10T08:43:29.954948+0000","last_active":"2024-09-10T08:43:29.954923+0000","last_peered":"2024-09-10T08:43:29.954923+0000","last_clean":"2024-09-10T08:43:29.954923+0000","last_became_active":"2024-09-10T08:28:37.857028+0000","last_became_peered":"2024-09-10T08:28:37.857028+0000","last_unstale":"2024-09-10T08:43:29.954923+0000","last_undegraded":"2024-09-10T08:43:29.954923+0000","last_fullsized":"2024-09-10T08:43:29.954923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"198'119","last_scrub_stamp":"2024-09-10T08:43:29.954857+0000","last_deep_scrub":"198'119","last_deep_scrub_stamp":"2024-09-10T08:43:29.954857+0000","last_clean_scrub_stamp":"2024-09-10T08:43:29.954857+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:23:34.241708+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51676,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320164,"statfs":{"total":96636764160,"available":96583847936,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69664,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302176,"statfs":{"total":96636764160,"available":96565428224,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509623,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47520,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324320,"statfs":{"total":96636764160,"available":96588103680,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509622,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509624,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55836,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316004,"statfs":{"total":96636764160,"available":96579588096,"internally_reserved":0,"allocated":2498560,"data_stored":1097692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542325,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":3020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":3092480,"data_stored":1688060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:43:33.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T08:43:33.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.431+0000 7fdde3c00640 1 Processor -- start 2024-09-10T08:43:33.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.431+0000 7fdde3c00640 1 -- start start 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.432+0000 7fdde3c00640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdddc0732e0 0x7fdddc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.432+0000 7fdde3c00640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdddc0cd2a0 0x7fdddc15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.432+0000 7fdde3c00640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdddc0714b0 con 0x7fdddc0cce30 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.432+0000 7fdde3c00640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdddc073c00 con 0x7fdddc0732e0 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.432+0000 7fdde3c00640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7fdddc0cd880 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1200640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdddc0732e0 0x7fdddc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdddbe00640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdddc0cce30 0x7fdddc071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52704/0 (socket says 172.21.15.52:52704) 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdddbe00640 1 -- 172.21.15.52:0/1914967182 learned_addr learned my addr 172.21.15.52:0/1914967182 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1c00640 1 --2- 172.21.15.52:0/1914967182 >> v2:172.21.15.176:3300/0 conn(0x7fdddc0cd2a0 0x7fdddc15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1200640 1 -- 172.21.15.52:0/1914967182 >> v2:172.21.15.176:3300/0 conn(0x7fdddc0cd2a0 msgr2=0x7fdddc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1200640 1 --2- 172.21.15.52:0/1914967182 >> v2:172.21.15.176:3300/0 conn(0x7fdddc0cd2a0 0x7fdddc15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1200640 1 -- 172.21.15.52:0/1914967182 >> v1:172.21.15.52:6789/0 conn(0x7fdddc0cce30 legacy=0x7fdddc071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdde1200640 1 -- 172.21.15.52:0/1914967182 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc0cdb60 con 0x7fdddc0732e0 2024-09-10T08:43:33.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.433+0000 7fdddb400640 1 -- 172.21.15.52:0/1914967182 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593778989 0 0) 0x7fdddc0714b0 con 0x7fdddc0cce30 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.434+0000 7fdde1200640 1 --2- 172.21.15.52:0/1914967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0732e0 0x7fdddc0736c0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0c5550 tx=0x7fddd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ccd44bdbd95198 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdddb400640 1 -- 172.21.15.52:0/1914967182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0037070 con 0x7fdddc0732e0 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdddb400640 1 -- 172.21.15.52:0/1914967182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd0032440 con 0x7fdddc0732e0 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdddb400640 1 -- 172.21.15.52:0/1914967182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd002ae60 con 0x7fdddc0732e0 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 -- 172.21.15.52:0/1914967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0732e0 msgr2=0x7fdddc0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 --2- 172.21.15.52:0/1914967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0732e0 0x7fdddc0736c0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fdddc0c5550 tx=0x7fddd002a110 comp rx=0 tx=0).stop 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 -- 172.21.15.52:0/1914967182 shutdown_connections 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 --2- 172.21.15.52:0/1914967182 >> v2:172.21.15.176:3300/0 conn(0x7fdddc0cd2a0 0x7fdddc15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 --2- 172.21.15.52:0/1914967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0732e0 0x7fdddc0736c0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 -- 172.21.15.52:0/1914967182 >> 172.21.15.52:0/1914967182 conn(0x7fdddc06d0f0 msgr2=0x7fdddc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 -- 172.21.15.52:0/1914967182 shutdown_connections 2024-09-10T08:43:33.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.435+0000 7fdde3c00640 1 -- 172.21.15.52:0/1914967182 wait complete. 2024-09-10T08:43:33.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.437+0000 7fdde3c00640 1 Processor -- start 2024-09-10T08:43:33.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.437+0000 7fdde3c00640 1 -- start start 2024-09-10T08:43:33.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc0732e0 0x7fdddc14f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdddc0cce30 0x7fdddc1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc06bf70 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc06bdf0 con 0x7fdddc0732e0 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde3c00640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7fdddc072380 con 0x7fdddc0cce30 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde1c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde1c00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49742/0 (socket says 172.21.15.52:49742) 2024-09-10T08:43:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde1c00640 1 -- 172.21.15.52:0/459443395 learned_addr learned my addr 172.21.15.52:0/459443395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdde1200640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc0732e0 0x7fdddc14f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.438+0000 7fdddbe00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdddc0cce30 0x7fdddc1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 -- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdddc0cce30 msgr2=0x7fdddc1410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdddc0cce30 0x7fdddc1410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 -- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc0732e0 msgr2=0x7fdddc14f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc0732e0 0x7fdddc14f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 -- 172.21.15.52:0/459443395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc151e30 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde1c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fddd400efc0 tx=0x7fddd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4018020 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd4014480 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4014870 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdddc14fa40 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.439+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdddc153470 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.440+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdddc0736c0 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.441+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddd4005d10 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.442+0000 7fddd8c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.442+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7fddd408b620 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.443+0000 7fdde1200640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.443+0000 7fdde1200640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 0x7fddbc06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fddd0034000 tx=0x7fddd002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.447+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddd4022070 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.630+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fdddc0711f0 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.634+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7fdddc151e30 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.635+0000 7fddd8c00640 1 -- 172.21.15.52:0/459443395 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fddd4059be0 con 0x7fdddc0cd2a0 2024-09-10T08:43:33.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 msgr2=0x7fddbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 0x7fddbc06e2f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fddd0034000 tx=0x7fddd002e000 comp rx=0 tx=0).stop 2024-09-10T08:43:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 msgr2=0x7fdddc151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fddd400efc0 tx=0x7fddd400c490 comp rx=0 tx=0).stop 2024-09-10T08:43:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 shutdown_connections 2024-09-10T08:43:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7fddbc06be30 0x7fddbc06e2f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdddc0cd2a0 0x7fdddc151050 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdddc0cce30 0x7fdddc1410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 --2- 172.21.15.52:0/459443395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc0732e0 0x7fdddc14f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 >> 172.21.15.52:0/459443395 conn(0x7fdddc06d0f0 msgr2=0x7fdddc15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 shutdown_connections 2024-09-10T08:43:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.637+0000 7fdde3c00640 1 -- 172.21.15.52:0/459443395 wait complete. 2024-09-10T08:43:33.654 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:43:33.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:43:33.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.810+0000 7f2cc8800640 1 Processor -- start 2024-09-10T08:43:33.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.810+0000 7f2cc8800640 1 -- start start 2024-09-10T08:43:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.811+0000 7f2cc8800640 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2cc015e790 0x7f2cc0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.811+0000 7f2cc8800640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc01631c0 con 0x7f2cc0162c60 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.811+0000 7f2cc8800640 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc00ae9a0 con 0x7f2cc006f730 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.811+0000 7f2cc8800640 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc015eb70 con 0x7f2cc015e790 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc5400640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2cc0162c60 0x7f2cc00b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:52720/0 (socket says 172.21.15.52:52720) 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc5400640 1 -- 172.21.15.52:0/194155779 learned_addr learned my addr 172.21.15.52:0/194155779 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590637072 0 0) 0x7f2cc01631c0 con 0x7f2cc0162c60 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/194155779 >> v2:172.21.15.176:3300/0 conn(0x7f2cc015e790 0x7f2cc0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca8003520 con 0x7f2cc0162c60 2024-09-10T08:43:33.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3100355712 0 0) 0x7f2ca8003520 con 0x7f2cc0162c60 2024-09-10T08:43:33.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 >> v2:172.21.15.176:3300/0 conn(0x7f2cc015e790 msgr2=0x7f2cc0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.812+0000 7f2cc4a00640 1 --2- 172.21.15.52:0/194155779 >> v2:172.21.15.176:3300/0 conn(0x7f2cc015e790 0x7f2cc0073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 >> v1:172.21.15.176:6789/0 conn(0x7f2cc006f730 legacy=0x7f2cc006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00aec40 con 0x7f2cc0162c60 2024-09-10T08:43:33.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3809576892 0 0) 0x7f2cb0001670 con 0x7f2cc0162c60 2024-09-10T08:43:33.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 >> v1:172.21.15.52:6789/0 conn(0x7f2cc0162c60 legacy=0x7f2cc00b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca80039b0 0x7f2ca8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8004800 0x7f2ca8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2ca800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca800c180 con 0x7f2ca80052e0 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca800c330 con 0x7f2ca80039b0 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca800c530 con 0x7f2ca8004800 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc6800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2ca800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca80039b0 0x7f2ca8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc5400640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8004800 0x7f2ca8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc6800640 1 -- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8004800 msgr2=0x7f2ca8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.813+0000 7f2cc6800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2ca8004800 0x7f2ca8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.814+0000 7f2cc6800640 1 -- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca80039b0 msgr2=0x7f2ca8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.814+0000 7f2cc6800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca80039b0 0x7f2ca8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.814+0000 7f2cc6800640 1 -- 172.21.15.52:0/194155779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca8003520 con 0x7f2ca80052e0 2024-09-10T08:43:33.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.814+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ca80039b0 0x7f2ca8003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.814+0000 7f2cc6800640 1 -- 172.21.15.52:0/194155779 reap_dead start 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc6800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2ca800b9c0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc001e50 tx=0x7f2ca8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6de3d3e95b1e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4009690 con 0x7f2ca80052e0 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2cbc003970 con 0x7f2ca80052e0 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc4a00640 1 -- 172.21.15.52:0/194155779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc001a70 con 0x7f2ca80052e0 2024-09-10T08:43:33.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc8800640 1 -- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 msgr2=0x7f2ca800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc8800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2ca800b9c0 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc001e50 tx=0x7f2ca8005830 comp rx=0 tx=0).stop 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc8800640 1 -- 172.21.15.52:0/194155779 shutdown_connections 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc8800640 1 --2- 172.21.15.52:0/194155779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2ca800b9c0 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.815+0000 7f2cc8800640 1 -- 172.21.15.52:0/194155779 >> 172.21.15.52:0/194155779 conn(0x7f2cc00b0a80 msgr2=0x7f2cc00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.816+0000 7f2cc8800640 1 -- 172.21.15.52:0/194155779 shutdown_connections 2024-09-10T08:43:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.816+0000 7f2cc8800640 1 -- 172.21.15.52:0/194155779 wait complete. 2024-09-10T08:43:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.817+0000 7f2cc8800640 1 Processor -- start 2024-09-10T08:43:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.817+0000 7f2cc8800640 1 -- start start 2024-09-10T08:43:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc01f8400 0x7f2cc0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc015a030 0x7f2cc015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc006f430 con 0x7f2ca80052e0 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00af200 con 0x7f2cc01f8400 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.818+0000 7f2cc8800640 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc0073a40 con 0x7f2cc015a030 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49750/0 (socket says 172.21.15.52:49750) 2024-09-10T08:43:33.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3884441942 learned_addr learned my addr 172.21.15.52:0/3884441942 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc6800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc015a030 0x7f2cc015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5400640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc01f8400 0x7f2cc0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc015a030 msgr2=0x7f2cc015b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc015a030 0x7f2cc015b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc01f8400 msgr2=0x7f2cc0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc01f8400 0x7f2cc0159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 -- 172.21.15.52:0/3884441942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc0153440 con 0x7f2ca80052e0 2024-09-10T08:43:33.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.819+0000 7f2cc5e00640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4011960 tx=0x7f2cb4011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.820+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400f9d0 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.820+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2cb400fb70 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.820+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc0153720 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.820+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4014440 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.820+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc0153ce0 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.821+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc006fb40 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.822+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cb4012040 con 0x7f2ca80052e0 2024-09-10T08:43:33.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.823+0000 7f2cba000640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:43:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.823+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 4943+0+0 (secure 0 0 0) 0x7f2cb408b180 con 0x7f2ca80052e0 2024-09-10T08:43:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.823+0000 7f2cc5400640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:43:33.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.824+0000 7f2cc5400640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0154960 tx=0x7f2cb0000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:43:33.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:33.827+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cb4019030 con 0x7f2ca80052e0 2024-09-10T08:43:34.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.050+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cc0156450 con 0x7f2ca80052e0 2024-09-10T08:43:34.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.051+0000 7f2cba000640 1 -- 172.21.15.52:0/3884441942 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) ==== 95+0+3923 (secure 0 0 0) 0x7f2cb4059d00 con 0x7f2ca80052e0 2024-09-10T08:43:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T08:43:34.052 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":151,"btime":"2024-09-10T08:43:19:966565+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8459,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4003419078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":4003419078},{"type":"v1","addr":"172.21.15.52:6835","nonce":4003419078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":8465,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6836/3810660028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6834","nonce":3810660028},{"type":"v1","addr":"172.21.15.176:6836","nonce":3810660028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":9715,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6837/3011984529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6835","nonce":3011984529},{"type":"v1","addr":"172.21.15.176:6837","nonce":3011984529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10869,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1530543210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":1530543210},{"type":"v1","addr":"172.21.15.52:6834","nonce":1530543210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151}],"filesystems":[]} 2024-09-10T08:43:34.052 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 151 2024-09-10T08:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 msgr2=0x7f2ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 0x7f2ca406e2f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0154960 tx=0x7f2cb0000ed0 comp rx=0 tx=0).stop 2024-09-10T08:43:34.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 msgr2=0x7f2cc01487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4011960 tx=0x7f2cb4011d60 comp rx=0 tx=0).stop 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 shutdown_connections 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:6800/1001247372,v1:172.21.15.176:6801/1001247372] conn(0x7f2ca406be30 0x7f2ca406e2f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2cc015a030 0x7f2cc015b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cc01f8400 0x7f2cc0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 --2- 172.21.15.52:0/3884441942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ca80052e0 0x7f2cc01487e0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.053+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 >> 172.21.15.52:0/3884441942 conn(0x7f2cc00b0a80 msgr2=0x7f2cc0073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:43:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.054+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 shutdown_connections 2024-09-10T08:43:34.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T08:43:34.054+0000 7f2cc8800640 1 -- 172.21.15.52:0/3884441942 wait complete. 2024-09-10T08:43:34.070 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T08:43:34.070 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T08:43:34.070 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:43:34.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.085 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:43:34.085 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:43:34.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.140 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:43:34.140 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:43:34.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.156 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:43:34.156 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:43:34.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.213 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:43:34.213 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T08:43:34.213 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T08:43:34.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.275 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T08:43:34.275 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T08:43:34.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.340 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T08:43:34.340 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T08:43:34.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.408 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T08:43:34.408 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T08:43:34.408 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.472 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T08:43:34.472 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T08:43:34.472 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.521 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T08:43:34.522 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T08:43:34.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.576 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T08:43:34.577 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T08:43:34.577 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.637 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T08:43:34.637 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T08:43:34.637 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.701 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T08:43:34.701 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T08:43:34.702 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T08:43:34.702 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.766 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T08:43:34.767 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T08:43:34.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.833 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T08:43:34.834 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T08:43:34.834 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:43:34.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.856 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:43:34.856 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:43:34.856 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.874 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:43:34.875 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:43:34.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:43:34.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-10T08:43:34.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-10T08:43:34.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-10T08:43:34.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-10T08:43:34.936 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:43:34.936 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T08:43:34.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-10T08:43:35.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:43:35.020 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T08:43:35.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:43:35.304 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T08:43:35.416 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:43:35.416 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T08:43:35.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:43:35.526 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T08:43:35.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:43:35.671 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T08:43:36.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:43:36.009 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T08:43:36.135 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:43:36.136 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T08:43:36.254 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:43:36.254 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T08:43:36.389 INFO:tasks.ceph:Archiving mon data... 2024-09-10T08:43:36.391 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/data/mon.a.tgz 2024-09-10T08:43:36.391 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-10T08:43:36.429 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.wrxunXyxeF 2024-09-10T08:43:36.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wrxunXyxeF 2024-09-10T08:43:36.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.wrxunXyxeF 2024-09-10T08:43:36.743 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.wrxunXyxeF is 548KB 2024-09-10T08:43:36.836 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.wrxunXyxeF 2024-09-10T08:43:36.870 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/data/mon.b.tgz 2024-09-10T08:43:36.871 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-10T08:43:36.907 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.8SGAiHneQO 2024-09-10T08:43:36.908 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8SGAiHneQO 2024-09-10T08:43:37.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.8SGAiHneQO 2024-09-10T08:43:37.224 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.8SGAiHneQO is 569KB 2024-09-10T08:43:37.319 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.8SGAiHneQO 2024-09-10T08:43:37.354 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/data/mon.c.tgz 2024-09-10T08:43:37.355 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-10T08:43:37.430 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.ynKvd91I8Y 2024-09-10T08:43:37.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ynKvd91I8Y 2024-09-10T08:43:37.640 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.ynKvd91I8Y 2024-09-10T08:43:37.734 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.ynKvd91I8Y is 569KB 2024-09-10T08:43:37.828 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.ynKvd91I8Y 2024-09-10T08:43:37.863 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T08:43:37.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:43:37.868 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:43:37.996 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:43:38.031 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:43:38.031 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T08:43:38.036 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi052/crash 2024-09-10T08:43:38.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:43:38.095 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi176/crash 2024-09-10T08:43:38.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:43:38.150 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T08:43:38.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:38.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:38.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:38.318 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:43:38.373 INFO:tasks.ceph:Compressing logs... 2024-09-10T08:43:38.374 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:43:38.378 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:43:38.430 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T08:43:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-09-10T08:43:38.431 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95522.log 2024-09-10T08:43:38.431 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41972.log 2024-09-10T08:43:38.432 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36326.log 2024-09-10T08:43:38.433 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64672.log 2024-09-10T08:43:38.433 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-09-10T08:43:38.434 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.41972.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.3.41972.log.gz 2024-09-10T08:43:38.434 INFO:teuthology.orchestra.run.smithi176.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36235.log 2024-09-10T08:43:38.434 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36446.log 2024-09-10T08:43:38.434 INFO:teuthology.orchestra.run.smithi176.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36326.log.gz 2024-09-10T08:43:38.437 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36235.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T08:43:38.437 INFO:teuthology.orchestra.run.smithi176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36235.log.gz 2024-09-10T08:43:38.438 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41557.log 2024-09-10T08:43:38.438 INFO:teuthology.orchestra.run.smithi176.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36446.log.gz 2024-09-10T08:43:38.438 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T08:43:38.438 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.41557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41557.log.gz 2024-09-10T08:43:38.438 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36406.log 2024-09-10T08:43:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58130.log 2024-09-10T08:43:38.439 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64672.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95522.log.gz 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67385.log 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64672.log.gz 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89171.log 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58130.log.gz 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67385.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67385.log.gz 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102099.log 2024-09-10T08:43:38.440 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95438.log 2024-09-10T08:43:38.441 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89171.log.gz 2024-09-10T08:43:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57703.log 2024-09-10T08:43:38.441 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102099.log.gz 2024-09-10T08:43:38.441 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103410.log 2024-09-10T08:43:38.441 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95438.log.gz 2024-09-10T08:43:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2024-09-10T08:43:38.445 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57703.log.gz 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103410.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103410.log.gz 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59869.log 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68685.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2024-09-10T08:43:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55232.log 2024-09-10T08:43:38.447 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61216.log 2024-09-10T08:43:38.447 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59869.log.gz 2024-09-10T08:43:38.448 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T08:43:38.448 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36406.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:43:38.448 INFO:teuthology.orchestra.run.smithi176.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36406.log.gz 2024-09-10T08:43:38.448 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36155.log 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.36155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36366.log 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36155.log.gz 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36366.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36366.log.gz 2024-09-10T08:43:38.449 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.36195.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T08:43:38.450 INFO:teuthology.orchestra.run.smithi176.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz 2024-09-10T08:43:38.450 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T08:43:38.450 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:43:38.450 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T08:43:38.452 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T08:43:38.455 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60651.log 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55232.log.gz 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89255.log 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61216.log.gz 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60651.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60651.log.gz 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65534.log 2024-09-10T08:43:38.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95098.log 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89255.log.gz 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65534.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65534.log.gz 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42999.log 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95098.log.gz 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42999.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42999.log.gz 2024-09-10T08:43:38.457 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99087.log 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90372.log 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99087.log.gz 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85485.log 2024-09-10T08:43:38.458 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90372.log.gz 2024-09-10T08:43:38.463 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T08:43:38.463 INFO:teuthology.orchestra.run.smithi176.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:43:38.463 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-09-10T08:43:38.463 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36276.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-09-10T08:43:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43521.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2024-09-10T08:43:38.465 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57955.log 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99383.log 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.85485.log.gz 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57955.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57955.log.gz 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104807.log 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103714.log 2024-09-10T08:43:38.466 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99383.log.gz 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104807.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.60262.log -- replaced with /var/log/ceph/ceph-client.admin.104807.log.gz 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66144.log 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103714.log.gz 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88193.log 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60262.log.gz 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89069.log 2024-09-10T08:43:38.467 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66144.log.gz 2024-09-10T08:43:38.468 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57558.log 2024-09-10T08:43:38.468 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.88193.log.gz 2024-09-10T08:43:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83862.log 2024-09-10T08:43:38.470 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89069.log.gz 2024-09-10T08:43:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57558.log.gz 2024-09-10T08:43:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61426.log 2024-09-10T08:43:38.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61619.log 2024-09-10T08:43:38.471 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83862.log.gz 2024-09-10T08:43:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61426.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61426.log.gz 2024-09-10T08:43:38.471 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103672.log 2024-09-10T08:43:38.473 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52889.log 2024-09-10T08:43:38.473 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61619.log.gz 2024-09-10T08:43:38.473 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103672.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103672.log.gz 2024-09-10T08:43:38.473 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58607.log 2024-09-10T08:43:38.474 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103285.log 2024-09-10T08:43:38.474 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52889.log.gz 2024-09-10T08:43:38.475 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58607.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.58607.log.gz 2024-09-10T08:43:38.475 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68771.log 2024-09-10T08:43:38.475 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91031.log 2024-09-10T08:43:38.476 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.103285.log.gz 2024-09-10T08:43:38.476 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68771.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68771.log.gz 2024-09-10T08:43:38.476 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80086.log 2024-09-10T08:43:38.477 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88343.log 2024-09-10T08:43:38.477 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91031.log.gz 2024-09-10T08:43:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80086.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80086.log.gz 2024-09-10T08:43:38.478 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53244.log 2024-09-10T08:43:38.479 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64367.log 2024-09-10T08:43:38.479 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88343.log.gz 2024-09-10T08:43:38.480 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103504.log 2024-09-10T08:43:38.481 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53244.log.gz 2024-09-10T08:43:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64367.log.gz 2024-09-10T08:43:38.481 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41526.log 2024-09-10T08:43:38.482 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60346.log 2024-09-10T08:43:38.483 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103504.log.gz 2024-09-10T08:43:38.483 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41526.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41526.log.gz 2024-09-10T08:43:38.484 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79771.log 2024-09-10T08:43:38.484 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60735.log 2024-09-10T08:43:38.485 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60346.log.gz 2024-09-10T08:43:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79771.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79771.log.gz 2024-09-10T08:43:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79897.log 2024-09-10T08:43:38.486 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40107.log 2024-09-10T08:43:38.487 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60735.log.gz 2024-09-10T08:43:38.488 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79897.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79897.log.gz 2024-09-10T08:43:38.488 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93357.log 2024-09-10T08:43:38.489 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81164.log 2024-09-10T08:43:38.489 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40107.log.gz 2024-09-10T08:43:38.490 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93357.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93357.log.gz 2024-09-10T08:43:38.490 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-09-10T08:43:38.491 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54036.log 2024-09-10T08:43:38.491 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81164.log.gz 2024-09-10T08:43:38.492 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44741.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-09-10T08:43:38.492 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94899.log 2024-09-10T08:43:38.493 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58649.log 2024-09-10T08:43:38.493 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54036.log.gz 2024-09-10T08:43:38.494 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94899.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94899.log.gz 2024-09-10T08:43:38.494 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2024-09-10T08:43:38.495 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55798.log 2024-09-10T08:43:38.495 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58649.log.gz 2024-09-10T08:43:38.496 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41525.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2024-09-10T08:43:38.496 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67637.log 2024-09-10T08:43:38.497 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2024-09-10T08:43:38.498 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67637.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55798.log.gz 2024-09-10T08:43:38.499 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88511.log 2024-09-10T08:43:38.499 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67637.log.gz 2024-09-10T08:43:38.500 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63969.log 2024-09-10T08:43:38.500 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2024-09-10T08:43:38.501 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101885.log 2024-09-10T08:43:38.501 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63969.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.88511.log.gz 2024-09-10T08:43:38.502 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose 88.9% -- /var/log/ceph/ceph-client.admin.94653.log 2024-09-10T08:43:38.502 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63969.log.gz 2024-09-10T08:43:38.503 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60861.log 2024-09-10T08:43:38.503 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101885.log.gz 2024-09-10T08:43:38.504 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57787.log 2024-09-10T08:43:38.504 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94653.log.gz 2024-09-10T08:43:38.505 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60861.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60861.log.gz 2024-09-10T08:43:38.505 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62264.log 2024-09-10T08:43:38.506 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60108.log 2024-09-10T08:43:38.506 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57787.log.gz 2024-09-10T08:43:38.507 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62264.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62264.log.gz 2024-09-10T08:43:38.507 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81615.log 2024-09-10T08:43:38.508 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75910.log 2024-09-10T08:43:38.508 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60108.log.gz 2024-09-10T08:43:38.509 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81615.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81615.log.gz 2024-09-10T08:43:38.509 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64874.log 2024-09-10T08:43:38.510 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85615.log 2024-09-10T08:43:38.510 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75910.log.gz 2024-09-10T08:43:38.511 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64874.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64874.log.gz 2024-09-10T08:43:38.511 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76391.log 2024-09-10T08:43:38.512 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102520.log 2024-09-10T08:43:38.513 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85615.log.gz 2024-09-10T08:43:38.513 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76391.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76391.log.gz 2024-09-10T08:43:38.514 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61699.log 2024-09-10T08:43:38.514 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65426.log 2024-09-10T08:43:38.515 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102520.log.gz 2024-09-10T08:43:38.515 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61699.log.gz 2024-09-10T08:43:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41516.log 2024-09-10T08:43:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-09-10T08:43:38.517 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65426.log.gz 2024-09-10T08:43:38.518 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41516.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-09-10T08:43:38.518 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64832.log 2024-09-10T08:43:38.518 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103756.log 2024-09-10T08:43:38.519 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-09-10T08:43:38.520 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64832.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64832.log.gz 2024-09-10T08:43:38.520 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95140.log 2024-09-10T08:43:38.521 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104723.log 2024-09-10T08:43:38.521 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103756.log.gz 2024-09-10T08:43:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95140.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T08:43:38.522 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95140.log.gz 2024-09-10T08:43:38.523 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97768.log 2024-09-10T08:43:38.523 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104723.log.gz 2024-09-10T08:43:38.524 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T08:43:38.524 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58340.log 2024-09-10T08:43:38.525 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54902.log 2024-09-10T08:43:38.525 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.97768.log.gz 2024-09-10T08:43:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55100.log 2024-09-10T08:43:38.526 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58340.log.gz 2024-09-10T08:43:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99677.log 2024-09-10T08:43:38.528 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54902.log.gz 2024-09-10T08:43:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40800.log 2024-09-10T08:43:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99677.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55100.log.gz 2024-09-10T08:43:38.530 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99677.log.gz 2024-09-10T08:43:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89027.log 2024-09-10T08:43:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76692.log 2024-09-10T08:43:38.531 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40800.log.gz 2024-09-10T08:43:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90671.log 2024-09-10T08:43:38.532 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89027.log.gz 2024-09-10T08:43:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83988.log 2024-09-10T08:43:38.534 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76692.log.gz 2024-09-10T08:43:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90671.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90671.log.gz 2024-09-10T08:43:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98870.log 2024-09-10T08:43:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68243.log 2024-09-10T08:43:38.536 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83988.log.gz 2024-09-10T08:43:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103901.log 2024-09-10T08:43:38.537 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98870.log.gz 2024-09-10T08:43:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68243.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68243.log.gz 2024-09-10T08:43:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79404.log 2024-09-10T08:43:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97899.log 2024-09-10T08:43:38.539 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103901.log.gz 2024-09-10T08:43:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54124.log 2024-09-10T08:43:38.540 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.79404.log.gz 2024-09-10T08:43:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101321.log 2024-09-10T08:43:38.542 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.97899.log.gz 2024-09-10T08:43:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101792.log 2024-09-10T08:43:38.543 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54124.log.gz 2024-09-10T08:43:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101321.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101321.log.gz 2024-09-10T08:43:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59538.log 2024-09-10T08:43:38.545 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101792.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101792.log.gz 2024-09-10T08:43:38.545 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64493.log 2024-09-10T08:43:38.546 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76120.log 2024-09-10T08:43:38.546 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59538.log.gz 2024-09-10T08:43:38.547 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80128.log 2024-09-10T08:43:38.547 INFO:teuthology.orchestra.run.smithi052.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2024-09-10T08:43:38.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76120.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.76120.log.gz 2024-09-10T08:43:38.549 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100262.log 2024-09-10T08:43:38.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91298.log 2024-09-10T08:43:38.550 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80128.log.gz 2024-09-10T08:43:38.551 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76517.log 2024-09-10T08:43:38.552 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91298.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.100262.log.gz 2024-09-10T08:43:38.552 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91298.log.gz 2024-09-10T08:43:38.552 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85699.log 2024-09-10T08:43:38.553 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80609.log 2024-09-10T08:43:38.553 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76517.log.gz 2024-09-10T08:43:38.554 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85699.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85699.log.gz 2024-09-10T08:43:38.555 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62996.log 2024-09-10T08:43:38.555 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97631.log 2024-09-10T08:43:38.556 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80609.log.gz 2024-09-10T08:43:38.556 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80735.log 2024-09-10T08:43:38.557 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62996.log.gz 2024-09-10T08:43:38.557 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97631.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97631.log.gz 2024-09-10T08:43:38.558 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83904.log 2024-09-10T08:43:38.558 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68327.log 2024-09-10T08:43:38.559 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80735.log.gz 2024-09-10T08:43:38.559 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105057.log 2024-09-10T08:43:38.560 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83904.log.gz 2024-09-10T08:43:38.560 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68327.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68327.log.gz 2024-09-10T08:43:38.561 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65722.log 2024-09-10T08:43:38.561 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.105057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64179.log 2024-09-10T08:43:38.562 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105057.log.gz 2024-09-10T08:43:38.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.65722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65722.log.gz 2024-09-10T08:43:38.562 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100901.log 2024-09-10T08:43:38.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64179.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64179.log.gz -5 2024-09-10T08:43:38.563 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75503.log 2024-09-10T08:43:38.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100901.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100901.log.gz 2024-09-10T08:43:38.564 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102310.log 2024-09-10T08:43:38.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102910.log 2024-09-10T08:43:38.566 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75503.log.gz 2024-09-10T08:43:38.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89654.log 2024-09-10T08:43:38.567 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102310.log.gz 2024-09-10T08:43:38.568 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67427.log 2024-09-10T08:43:38.568 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102910.log.gz 2024-09-10T08:43:38.569 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89654.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89654.log.gz 2024-09-10T08:43:38.569 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56517.log 2024-09-10T08:43:38.569 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44538.log 2024-09-10T08:43:38.570 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67427.log.gz 2024-09-10T08:43:38.570 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-09-10T08:43:38.571 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56517.log.gz 2024-09-10T08:43:38.571 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54208.log 2024-09-10T08:43:38.572 INFO:teuthology.orchestra.run.smithi052.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44538.log.gz 2024-09-10T08:43:38.572 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53839.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz /var/log/ceph/ceph-client.admin.84204.log 2024-09-10T08:43:38.573 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.573 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66744.log 2024-09-10T08:43:38.573 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54208.log.gz 2024-09-10T08:43:38.574 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84204.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84204.log.gz 2024-09-10T08:43:38.574 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2024-09-10T08:43:38.575 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53549.log 2024-09-10T08:43:38.575 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66744.log.gz 2024-09-10T08:43:38.576 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41527.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2024-09-10T08:43:38.576 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/ceph-client.admin.88643.log 2024-09-10T08:43:38.577 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88685.log 2024-09-10T08:43:38.577 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53549.log.gz 2024-09-10T08:43:38.578 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88643.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88643.log.gz 2024-09-10T08:43:38.578 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94161.log 2024-09-10T08:43:38.579 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64137.log 2024-09-10T08:43:38.579 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88685.log.gz 2024-09-10T08:43:38.580 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94161.log: gzip -5 87.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.94161.log.gz -- 2024-09-10T08:43:38.580 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.40968.log 2024-09-10T08:43:38.581 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84579.log 2024-09-10T08:43:38.581 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64137.log.gz 2024-09-10T08:43:38.582 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40968.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.40968.log.gz 2024-09-10T08:43:38.582 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101748.log 2024-09-10T08:43:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2024-09-10T08:43:38.583 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84579.log.gz 2024-09-10T08:43:38.583 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101748.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101748.log.gz 2024-09-10T08:43:38.584 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2024-09-10T08:43:38.584 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101843.log 2024-09-10T08:43:38.585 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2024-09-10T08:43:38.585 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45449.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-09-10T08:43:38.585 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41853.log 2024-09-10T08:43:38.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84849.log 2024-09-10T08:43:38.587 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101843.log.gz 2024-09-10T08:43:38.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41853.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.41853.log.gz 2024-09-10T08:43:38.587 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44393.log 2024-09-10T08:43:38.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84849.log: gzip -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.84849.log.gz -- 2024-09-10T08:43:38.588 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.98412.log 2024-09-10T08:43:38.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44393.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.44393.log.gz 2024-09-10T08:43:38.589 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.41513.log 2024-09-10T08:43:38.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84747.log 2024-09-10T08:43:38.590 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98412.log.gz 2024-09-10T08:43:38.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41513.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.42492.log 2024-09-10T08:43:38.591 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41513.log.gz 2024-09-10T08:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41511.log 2024-09-10T08:43:38.592 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84747.log.gz 2024-09-10T08:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42492.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42492.log.gz 2024-09-10T08:43:38.593 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80296.log 2024-09-10T08:43:38.594 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40674.log 2024-09-10T08:43:38.594 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41511.log.gz 2024-09-10T08:43:38.595 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80296.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.80296.log.gz 2024-09-10T08:43:38.595 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104260.log 2024-09-10T08:43:38.596 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60903.log 2024-09-10T08:43:38.596 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40674.log.gz 2024-09-10T08:43:38.597 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85993.log 2024-09-10T08:43:38.597 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104260.log.gz 2024-09-10T08:43:38.598 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90587.log 2024-09-10T08:43:38.598 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60903.log.gz 2024-09-10T08:43:38.599 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85993.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.58050.log -- replaced with /var/log/ceph/ceph-client.admin.85993.log.gz 2024-09-10T08:43:38.599 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.600 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64577.log 2024-09-10T08:43:38.600 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90587.log.gz 2024-09-10T08:43:38.601 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99297.log 2024-09-10T08:43:38.601 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58050.log.gz 2024-09-10T08:43:38.602 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58565.log 2024-09-10T08:43:38.602 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64577.log.gz 2024-09-10T08:43:38.603 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99297.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99297.log.gz 2024-09-10T08:43:38.603 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90459.log 2024-09-10T08:43:38.604 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79855.log 2024-09-10T08:43:38.604 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58565.log.gz 2024-09-10T08:43:38.605 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90459.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.88577.log -- replaced with /var/log/ceph/ceph-client.admin.90459.log.gz 2024-09-10T08:43:38.605 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.606 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56418.log 2024-09-10T08:43:38.606 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79855.log.gz 2024-09-10T08:43:38.607 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93033.log 2024-09-10T08:43:38.607 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.88577.log.gz 2024-09-10T08:43:38.608 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58384.log 2024-09-10T08:43:38.608 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56418.log.gz 2024-09-10T08:43:38.609 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41864.log 2024-09-10T08:43:38.609 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93033.log.gz 2024-09-10T08:43:38.610 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58384.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58384.log.gz 2024-09-10T08:43:38.610 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65942.log 2024-09-10T08:43:38.611 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41864.log.gz 2024-09-10T08:43:38.611 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67511.log 2024-09-10T08:43:38.612 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58296.log 2024-09-10T08:43:38.612 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65942.log.gz 2024-09-10T08:43:38.613 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67511.log: gzip -5 --verbose 88.6% -- -- replaced with /var/log/ceph/ceph-client.admin.67511.log.gz 2024-09-10T08:43:38.613 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.89612.log 2024-09-10T08:43:38.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89948.log 2024-09-10T08:43:38.614 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58296.log.gz 2024-09-10T08:43:38.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89612.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.58943.log -- replaced with /var/log/ceph/ceph-client.admin.89612.log.gz 2024-09-10T08:43:38.615 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2024-09-10T08:43:38.616 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89948.log.gz 2024-09-10T08:43:38.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58943.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58943.log.gz 2024-09-10T08:43:38.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90074.log 2024-09-10T08:43:38.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67938.log 2024-09-10T08:43:38.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90074.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2024-09-10T08:43:38.619 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90074.log.gz 2024-09-10T08:43:38.619 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41858.log 2024-09-10T08:43:38.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80651.log 2024-09-10T08:43:38.620 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67938.log.gz 2024-09-10T08:43:38.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60819.log 2024-09-10T08:43:38.621 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41858.log.gz 2024-09-10T08:43:38.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104555.log 2024-09-10T08:43:38.622 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80651.log.gz 2024-09-10T08:43:38.623 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77439.log 2024-09-10T08:43:38.623 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60819.log.gz 2024-09-10T08:43:38.624 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104555.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.104555.log.gz /var/log/ceph/ceph-client.admin.85361.log 2024-09-10T08:43:38.624 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.625 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65300.log 2024-09-10T08:43:38.625 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.77439.log.gz 2024-09-10T08:43:38.626 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68813.log 2024-09-10T08:43:38.626 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85361.log.gz 2024-09-10T08:43:38.627 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93720.log 2024-09-10T08:43:38.627 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65300.log.gz 2024-09-10T08:43:38.628 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95648.log 2024-09-10T08:43:38.628 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68813.log.gz 2024-09-10T08:43:38.629 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52310.log 2024-09-10T08:43:38.629 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93720.log.gz 2024-09-10T08:43:38.630 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90169.log 2024-09-10T08:43:38.630 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.95648.log.gz 2024-09-10T08:43:38.631 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99779.log 2024-09-10T08:43:38.631 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52310.log.gz 2024-09-10T08:43:38.632 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2024-09-10T08:43:38.632 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90169.log.gz 2024-09-10T08:43:38.633 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98029.log 2024-09-10T08:43:38.633 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99779.log.gz 2024-09-10T08:43:38.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52931.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2024-09-10T08:43:38.634 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81573.log 2024-09-10T08:43:38.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-09-10T08:43:38.635 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.98029.log.gz 2024-09-10T08:43:38.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.81573.log.gz 2024-09-10T08:43:38.636 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68855.log 2024-09-10T08:43:38.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64752.log 2024-09-10T08:43:38.637 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-09-10T08:43:38.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65006.log 2024-09-10T08:43:38.638 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.68855.log.gz 2024-09-10T08:43:38.639 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76612.log 2024-09-10T08:43:38.639 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64752.log.gz 2024-09-10T08:43:38.640 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65006.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.65006.log.gz 2024-09-10T08:43:38.640 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60693.log 2024-09-10T08:43:38.641 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67553.log 2024-09-10T08:43:38.641 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76612.log.gz 2024-09-10T08:43:38.642 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61783.log 2024-09-10T08:43:38.642 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60693.log.gz 2024-09-10T08:43:38.643 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63393.log 2024-09-10T08:43:38.643 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67553.log.gz 2024-09-10T08:43:38.644 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80441.log 2024-09-10T08:43:38.644 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61783.log.gz 2024-09-10T08:43:38.645 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2024-09-10T08:43:38.645 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63393.log.gz 2024-09-10T08:43:38.651 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81657.log 2024-09-10T08:43:38.651 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80441.log.gz 2024-09-10T08:43:38.651 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55666.log 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68517.log 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.81657.log.gz 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77693.log 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55666.log.gz 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68517.log.gz 2024-09-10T08:43:38.652 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52711.log 2024-09-10T08:43:38.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.77693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77693.log.gz 2024-09-10T08:43:38.653 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-09-10T08:43:38.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52711.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52711.log.gz 2024-09-10T08:43:38.654 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102412.log 2024-09-10T08:43:38.654 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41179.log 2024-09-10T08:43:38.654 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-09-10T08:43:38.655 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102412.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.102412.log.gz 2024-09-10T08:43:38.655 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.81299.log 2024-09-10T08:43:38.656 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86331.log 2024-09-10T08:43:38.656 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41179.log.gz 2024-09-10T08:43:38.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53057.log 2024-09-10T08:43:38.657 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81299.log.gz 2024-09-10T08:43:38.657 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.86331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.86331.log.gz 2024-09-10T08:43:38.657 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-09-10T08:43:38.658 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58254.log 2024-09-10T08:43:38.658 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53057.log.gz 2024-09-10T08:43:38.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44994.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gzgzip 2024-09-10T08:43:38.659 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80567.log 2024-09-10T08:43:38.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58254.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58254.log.gz 2024-09-10T08:43:38.660 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80483.log 2024-09-10T08:43:38.660 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41183.log 2024-09-10T08:43:38.661 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80567.log.gz 2024-09-10T08:43:38.661 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80483.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80483.log.gz 2024-09-10T08:43:38.662 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68192.log 2024-09-10T08:43:38.662 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2024-09-10T08:43:38.663 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41183.log.gz 2024-09-10T08:43:38.663 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40279.log 2024-09-10T08:43:38.663 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68192.log.gz 2024-09-10T08:43:38.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2024-09-10T08:43:38.664 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2024-09-10T08:43:38.665 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40279.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40279.log.gz 2024-09-10T08:43:38.665 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76902.log 2024-09-10T08:43:38.666 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64282.log 2024-09-10T08:43:38.666 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2024-09-10T08:43:38.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76902.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.76902.log.gz 2024-09-10T08:43:38.667 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.98660.log 2024-09-10T08:43:38.668 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104387.log 2024-09-10T08:43:38.668 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64282.log.gz 2024-09-10T08:43:38.669 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89780.log 2024-09-10T08:43:38.669 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98660.log.gz 2024-09-10T08:43:38.670 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98496.log 2024-09-10T08:43:38.670 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104387.log.gz 2024-09-10T08:43:38.671 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94119.log 2024-09-10T08:43:38.671 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89780.log.gz 2024-09-10T08:43:38.672 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58523.log 2024-09-10T08:43:38.672 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98496.log.gz 2024-09-10T08:43:38.673 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94119.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.94119.log.gz 2024-09-10T08:43:38.673 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57871.log 2024-09-10T08:43:38.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-09-10T08:43:38.674 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58523.log.gz 2024-09-10T08:43:38.675 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57871.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57871.log.gz 2024-09-10T08:43:38.675 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101279.log 2024-09-10T08:43:38.676 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57516.log 2024-09-10T08:43:38.676 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-09-10T08:43:38.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101279.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:43:38.677 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101279.log.gz 2024-09-10T08:43:38.678 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84443.log 2024-09-10T08:43:38.678 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57516.log.gz 2024-09-10T08:43:38.679 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83946.log 2024-09-10T08:43:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84443.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84443.log.gz 2024-09-10T08:43:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63833.log 2024-09-10T08:43:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-09-10T08:43:38.681 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83946.log.gz 2024-09-10T08:43:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84621.log 2024-09-10T08:43:38.682 INFO:teuthology.orchestra.run.smithi052.stderr: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T08:43:38.682 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63833.log.gz 2024-09-10T08:43:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77099.log 2024-09-10T08:43:38.683 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2024-09-10T08:43:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44910.log 2024-09-10T08:43:38.684 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84621.log.gz 2024-09-10T08:43:38.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41528.log 2024-09-10T08:43:38.685 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77099.log.gz 2024-09-10T08:43:38.686 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44910.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.64962.log -- replaced with /var/log/ceph/ceph-client.admin.44910.log.gz 2024-09-10T08:43:38.686 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.687 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95606.log 2024-09-10T08:43:38.687 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-09-10T08:43:38.688 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84705.log 2024-09-10T08:43:38.688 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64962.log.gz 2024-09-10T08:43:38.689 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62138.log 2024-09-10T08:43:38.689 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95606.log.gz 2024-09-10T08:43:38.690 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99211.log 88.8% 2024-09-10T08:43:38.690 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84705.log.gz 2024-09-10T08:43:38.691 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59865.log 2024-09-10T08:43:38.691 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62138.log.gz 2024-09-10T08:43:38.692 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55732.log 2024-09-10T08:43:38.692 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99211.log.gz 2024-09-10T08:43:38.693 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99551.log 2024-09-10T08:43:38.693 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59865.log.gz 2024-09-10T08:43:38.694 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80254.log 2024-09-10T08:43:38.694 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.55732.log.gz 2024-09-10T08:43:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99551.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99551.log.gz 2024-09-10T08:43:38.695 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2024-09-10T08:43:38.696 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67114.log 2024-09-10T08:43:38.696 INFO:teuthology.orchestra.run.smithi052.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.80254.log.gz 2024-09-10T08:43:38.697 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91340.log 2024-09-10T08:43:38.697 INFO:teuthology.orchestra.run.smithi052.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2024-09-10T08:43:38.698 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57474.log 2024-09-10T08:43:38.698 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67114.log.gz 2024-09-10T08:43:38.699 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.91340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81387.log 2024-09-10T08:43:38.699 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91340.log.gz 2024-09-10T08:43:38.700 INFO:teuthology.orchestra.run.smithi176.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T08:43:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80525.log 2024-09-10T08:43:38.701 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57474.log.gz 2024-09-10T08:43:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81387.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81387.log.gz 2024-09-10T08:43:38.701 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104302.log 2024-09-10T08:43:38.702 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-09-10T08:43:38.702 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80525.log.gz 2024-09-10T08:43:38.703 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104302.log: gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.98618.log -- replaced with /var/log/ceph/ceph-client.admin.104302.log.gz 2024-09-10T08:43:38.703 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.704 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55497.log 2024-09-10T08:43:38.704 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-09-10T08:43:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98618.log.gz 2024-09-10T08:43:38.705 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-09-10T08:43:38.706 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66448.log 2024-09-10T08:43:38.706 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55497.log.gz 2024-09-10T08:43:38.707 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44087.log 2024-09-10T08:43:38.707 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-09-10T08:43:38.708 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59420.log 2024-09-10T08:43:38.708 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66448.log.gz 2024-09-10T08:43:38.709 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-09-10T08:43:38.709 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44087.log.gz 2024-09-10T08:43:38.710 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59420.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59420.log.gz 2024-09-10T08:43:38.710 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-10T08:43:38.711 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64325.log 2024-09-10T08:43:38.711 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-09-10T08:43:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44784.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-10T08:43:38.712 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102267.log 2024-09-10T08:43:38.713 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53901.log 2024-09-10T08:43:38.713 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64325.log.gz 2024-09-10T08:43:38.714 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56703.log 2024-09-10T08:43:38.714 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102267.log.gz 2024-09-10T08:43:38.715 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102225.log 2024-09-10T08:43:38.715 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53901.log.gz 2024-09-10T08:43:38.716 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61873.log 2024-09-10T08:43:38.716 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56703.log.gz 2024-09-10T08:43:38.717 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89822.log 2024-09-10T08:43:38.717 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102225.log.gz 2024-09-10T08:43:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61873.log.gz 2024-09-10T08:43:38.718 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95186.log 2024-09-10T08:43:38.719 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90503.log 2024-09-10T08:43:38.719 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89822.log.gz 2024-09-10T08:43:38.720 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95354.log 2024-09-10T08:43:38.720 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95186.log.gz 2024-09-10T08:43:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90503.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90503.log.gz 2024-09-10T08:43:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104176.log 2024-09-10T08:43:38.721 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85741.log 2024-09-10T08:43:38.722 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95354.log.gz 2024-09-10T08:43:38.723 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102953.log 2024-09-10T08:43:38.723 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104176.log.gz 2024-09-10T08:43:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85741.log.gz 2024-09-10T08:43:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103859.log 2024-09-10T08:43:38.724 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102183.log 2024-09-10T08:43:38.725 INFO:teuthology.orchestra.run.smithi052.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.102953.log.gz 2024-09-10T08:43:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63281.log 2024-09-10T08:43:38.726 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103859.log.gz 2024-09-10T08:43:38.726 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45217.log 2024-09-10T08:43:38.727 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102183.log.gz 2024-09-10T08:43:38.728 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68391.log 2024-09-10T08:43:38.728 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63281.log.gz 2024-09-10T08:43:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44496.log 2024-09-10T08:43:38.729 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45217.log.gz 2024-09-10T08:43:38.729 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68391.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68391.log.gz 2024-09-10T08:43:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80910.log 2024-09-10T08:43:38.730 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90881.log 2024-09-10T08:43:38.731 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44496.log.gz 2024-09-10T08:43:38.731 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80910.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.80910.log.gz -- 2024-09-10T08:43:38.732 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.41173.log 2024-09-10T08:43:38.732 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-09-10T08:43:38.732 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90881.log.gz 2024-09-10T08:43:38.733 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104429.log 2024-09-10T08:43:38.733 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-09-10T08:43:38.734 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40926.log 2024-09-10T08:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-09-10T08:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104429.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104429.log.gzgzip 2024-09-10T08:43:38.735 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.84306.log 2024-09-10T08:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95228.log 2024-09-10T08:43:38.736 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-09-10T08:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54968.log 2024-09-10T08:43:38.737 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84306.log.gz 2024-09-10T08:43:38.738 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64239.log 2024-09-10T08:43:38.738 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95228.log.gz 2024-09-10T08:43:38.739 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46118.log 2024-09-10T08:43:38.739 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54968.log.gz 2024-09-10T08:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64239.log.gzgzip 2024-09-10T08:43:38.740 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.89444.log 2024-09-10T08:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.46118.log: gzip -5 87.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46118.log.gz -- 2024-09-10T08:43:38.741 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.65342.log 2024-09-10T08:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100544.log 2024-09-10T08:43:38.742 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89444.log.gz 2024-09-10T08:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54376.log 2024-09-10T08:43:38.743 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65342.log.gz 2024-09-10T08:43:38.744 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65384.log 2024-09-10T08:43:38.744 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100544.log.gz 2024-09-10T08:43:38.745 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68285.log 2024-09-10T08:43:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65384.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54376.log.gz 2024-09-10T08:43:38.746 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88127.log 2024-09-10T08:43:38.746 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65384.log.gz 2024-09-10T08:43:38.747 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76433.log 2024-09-10T08:43:38.747 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68285.log.gz 2024-09-10T08:43:38.748 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-09-10T08:43:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76433.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.88127.log.gz 2024-09-10T08:43:38.749 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76433.log.gz 2024-09-10T08:43:38.749 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55166.log 2024-09-10T08:43:38.750 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.36116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89990.log 2024-09-10T08:43:38.750 INFO:teuthology.orchestra.run.smithi052.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-09-10T08:43:38.751 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101973.log 2024-09-10T08:43:38.752 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89990.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55166.log.gz 2024-09-10T08:43:38.753 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89990.log.gz 2024-09-10T08:43:38.753 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46039.log 2024-09-10T08:43:38.754 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98284.log 2024-09-10T08:43:38.754 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101973.log.gz 2024-09-10T08:43:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.46039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46039.log.gz 2024-09-10T08:43:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77271.log 2024-09-10T08:43:38.755 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98284.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98284.log.gz 2024-09-10T08:43:38.756 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62008.log 2024-09-10T08:43:38.757 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88061.log 2024-09-10T08:43:38.757 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77271.log.gz 2024-09-10T08:43:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62008.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62008.log.gz 2024-09-10T08:43:38.758 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77355.log 2024-09-10T08:43:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100985.log 2024-09-10T08:43:38.759 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77355.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.88061.log.gz 2024-09-10T08:43:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 87.9% 2024-09-10T08:43:38.760 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77355.log.gz 2024-09-10T08:43:38.761 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68148.log 2024-09-10T08:43:38.761 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100985.log.gz 2024-09-10T08:43:38.762 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80693.log 2024-09-10T08:43:38.762 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-09-10T08:43:38.763 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88901.log 2024-09-10T08:43:38.763 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68148.log.gz 2024-09-10T08:43:38.764 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68921.log 2024-09-10T08:43:38.765 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80693.log.gz 2024-09-10T08:43:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88901.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88901.log.gz 2024-09-10T08:43:38.765 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94474.log 2024-09-10T08:43:38.766 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57616.log 2024-09-10T08:43:38.766 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68921.log.gz 2024-09-10T08:43:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94474.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94474.log.gz 2024-09-10T08:43:38.767 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62998.log 2024-09-10T08:43:38.768 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81257.log 2024-09-10T08:43:38.769 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57616.log.gz 2024-09-10T08:43:38.769 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62998.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.62998.log.gz /var/log/ceph/ceph-client.admin.101538.log 2024-09-10T08:43:38.769 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98574.log 2024-09-10T08:43:38.770 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81257.log.gz 2024-09-10T08:43:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60066.log 2024-09-10T08:43:38.771 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101538.log.gz 2024-09-10T08:43:38.772 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93636.log 2024-09-10T08:43:38.772 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98574.log.gz 2024-09-10T08:43:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43303.log 2024-09-10T08:43:38.773 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60066.log.gz 2024-09-10T08:43:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76078.log 2024-09-10T08:43:38.775 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93636.log.gz 2024-09-10T08:43:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.2.43303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43303.log.gz 2024-09-10T08:43:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54836.log 2024-09-10T08:43:38.776 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63327.log 2024-09-10T08:43:38.776 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76078.log.gz 2024-09-10T08:43:38.777 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56985.log 2024-09-10T08:43:38.778 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54836.log.gz 2024-09-10T08:43:38.778 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104681.log 2024-09-10T08:43:38.779 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63327.log.gz 2024-09-10T08:43:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56985.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56985.log.gz 2024-09-10T08:43:38.779 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81471.log 2024-09-10T08:43:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88301.log 2024-09-10T08:43:38.780 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104681.log.gz 2024-09-10T08:43:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52592.log 2024-09-10T08:43:38.782 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81471.log.gz 2024-09-10T08:43:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84663.log 2024-09-10T08:43:38.783 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88301.log.gz 2024-09-10T08:43:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84789.log 2024-09-10T08:43:38.784 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52592.log.gz 2024-09-10T08:43:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79536.log 2024-09-10T08:43:38.784 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84663.log.gz 2024-09-10T08:43:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57348.log 2024-09-10T08:43:38.785 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84789.log.gz 2024-09-10T08:43:38.786 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84138.log 2024-09-10T08:43:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57348.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.79536.log.gz 2024-09-10T08:43:38.787 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57348.log.gz 2024-09-10T08:43:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89738.log 2024-09-10T08:43:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-09-10T08:43:38.789 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89738.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84138.log.gz 2024-09-10T08:43:38.790 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89738.log.gz 2024-09-10T08:43:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40884.log 2024-09-10T08:43:38.790 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66682.log 2024-09-10T08:43:38.791 INFO:teuthology.orchestra.run.smithi052.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-09-10T08:43:38.792 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40884.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40884.log.gz 2024-09-10T08:43:38.792 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99253.log 2024-09-10T08:43:38.793 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64451.log/var/log/ceph/ceph-client.admin.66682.log: 2024-09-10T08:43:38.793 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66682.log.gz 2024-09-10T08:43:38.794 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99253.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99253.log.gzgzip 2024-09-10T08:43:38.794 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40590.log 2024-09-10T08:43:38.795 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94733.log 2024-09-10T08:43:38.795 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64451.log.gz 2024-09-10T08:43:38.796 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40590.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40590.log.gz 2024-09-10T08:43:38.796 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98242.log 2024-09-10T08:43:38.797 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.94733.log: -- /var/log/ceph/ceph-client.admin.104891.log 2024-09-10T08:43:38.798 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94733.log.gz 2024-09-10T08:43:38.798 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98242.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98242.log.gz 2024-09-10T08:43:38.798 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44264.log 2024-09-10T08:43:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67595.log 2024-09-10T08:43:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104891.log: /var/log/ceph/ceph-client.admin.44264.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104891.log.gz 2024-09-10T08:43:38.801 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44264.log.gz 2024-09-10T08:43:38.801 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53711.log 2024-09-10T08:43:38.801 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67679.log 2024-09-10T08:43:38.802 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67595.log: /var/log/ceph/ceph-client.admin.53711.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67595.log.gz 2024-09-10T08:43:38.803 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53711.log.gz 2024-09-10T08:43:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60196.log 2024-09-10T08:43:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67679.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67679.log.gz 2024-09-10T08:43:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T08:43:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57745.log 2024-09-10T08:43:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.a.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.60196.log.gz 2024-09-10T08:43:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88859.log 2024-09-10T08:43:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58859.log 2024-09-10T08:43:38.808 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57745.log.gz 2024-09-10T08:43:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61174.log 2024-09-10T08:43:38.809 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88859.log.gz 2024-09-10T08:43:38.810 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100075.log 2024-09-10T08:43:38.810 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58859.log.gz 2024-09-10T08:43:38.811 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61174.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61174.log.gz 2024-09-10T08:43:38.811 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98786.log 2024-09-10T08:43:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.100075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95270.log 2024-09-10T08:43:38.812 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100075.log.gz 2024-09-10T08:43:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86143.log 2024-09-10T08:43:38.813 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98786.log.gz 2024-09-10T08:43:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95270.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85102.log 2024-09-10T08:43:38.815 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95270.log.gz 2024-09-10T08:43:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.86143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62054.log 2024-09-10T08:43:38.816 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86143.log.gz 2024-09-10T08:43:38.817 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89213.log 2024-09-10T08:43:38.817 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85102.log.gz 2024-09-10T08:43:38.819 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56769.log 2024-09-10T08:43:38.819 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62054.log.gz 2024-09-10T08:43:38.820 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76856.log 2024-09-10T08:43:38.820 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89213.log.gz 2024-09-10T08:43:38.821 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59299.log 2024-09-10T08:43:38.822 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56769.log.gz 2024-09-10T08:43:38.822 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90249.log 2024-09-10T08:43:38.823 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76856.log.gz 2024-09-10T08:43:38.823 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.59299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59299.log.gz 2024-09-10T08:43:38.823 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58435.log 2024-09-10T08:43:38.825 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41175.log 2024-09-10T08:43:38.825 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90249.log.gz 2024-09-10T08:43:38.826 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79620.log 2024-09-10T08:43:38.826 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58435.log.gz 2024-09-10T08:43:38.827 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103242.log 2024-09-10T08:43:38.828 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41175.log.gz 2024-09-10T08:43:38.829 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54334.log 2024-09-10T08:43:38.829 INFO:teuthology.orchestra.run.smithi052.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.79620.log.gz 2024-09-10T08:43:38.830 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90414.log 2024-09-10T08:43:38.830 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103242.log.gz 2024-09-10T08:43:38.831 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101027.log 2024-09-10T08:43:38.831 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54334.log.gz 2024-09-10T08:43:38.832 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63927.log 2024-09-10T08:43:38.833 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90414.log.gz 2024-09-10T08:43:38.834 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59462.log 2024-09-10T08:43:38.834 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101027.log.gz 2024-09-10T08:43:38.835 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93993.log 2024-09-10T08:43:38.835 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63927.log.gz 2024-09-10T08:43:38.836 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101153.log 2024-09-10T08:43:38.836 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59462.log.gz 2024-09-10T08:43:38.837 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66145.log 2024-09-10T08:43:38.838 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93993.log.gz 2024-09-10T08:43:38.839 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53328.log 2024-09-10T08:43:38.839 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101153.log.gz 2024-09-10T08:43:38.840 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89350.log 2024-09-10T08:43:38.840 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66145.log.gz 2024-09-10T08:43:38.841 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59743.log 2024-09-10T08:43:38.841 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53328.log.gz 2024-09-10T08:43:38.843 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-09-10T08:43:38.843 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89350.log.gz 2024-09-10T08:43:38.844 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104975.log 2024-09-10T08:43:38.844 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59743.log.gz 2024-09-10T08:43:38.845 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65468.log 2024-09-10T08:43:38.845 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-09-10T08:43:38.846 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95902.log 2024-09-10T08:43:38.847 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104975.log.gz 2024-09-10T08:43:38.847 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101458.log 2024-09-10T08:43:38.848 INFO:teuthology.orchestra.run.smithi052.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65468.log.gz 2024-09-10T08:43:38.849 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.95902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95902.log.gz 2024-09-10T08:43:38.849 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54771.log 2024-09-10T08:43:38.850 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90330.log 2024-09-10T08:43:38.850 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101458.log.gz 2024-09-10T08:43:38.851 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41190.log 2024-09-10T08:43:38.852 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0%/var/log/ceph/ceph-client.admin.90330.log: -- replaced with /var/log/ceph/ceph-client.admin.54771.log.gz 2024-09-10T08:43:38.853 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66402.log 2024-09-10T08:43:38.853 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90330.log.gz 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68475.log 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41190.log.gz 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66402.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66402.log.gz 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99007.log 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2024-09-10T08:43:38.858 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68475.log.gz 2024-09-10T08:43:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65258.log 2024-09-10T08:43:38.859 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99007.log.gz 2024-09-10T08:43:38.859 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64011.log 2024-09-10T08:43:38.860 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2024-09-10T08:43:38.861 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65835.log 2024-09-10T08:43:38.861 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65258.log.gz 2024-09-10T08:43:38.862 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69109.log 2024-09-10T08:43:38.863 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64011.log.gz 2024-09-10T08:43:38.863 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-09-10T08:43:38.863 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65835.log.gz 2024-09-10T08:43:38.864 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.69109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69109.log.gz 2024-09-10T08:43:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95714.log 2024-09-10T08:43:38.866 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81215.log 2024-09-10T08:43:38.866 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-09-10T08:43:38.867 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94558.log 2024-09-10T08:43:38.867 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95714.log.gz 2024-09-10T08:43:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67858.log 2024-09-10T08:43:38.869 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81215.log.gz 2024-09-10T08:43:38.870 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100154.log 2024-09-10T08:43:38.870 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94558.log.gz 2024-09-10T08:43:38.871 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85527.log 2024-09-10T08:43:38.871 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67858.log.gz 2024-09-10T08:43:38.873 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98912.log 2024-09-10T08:43:38.873 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.100154.log.gz 2024-09-10T08:43:38.874 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75655.log 2024-09-10T08:43:38.874 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.85527.log.gz 2024-09-10T08:43:38.875 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2024-09-10T08:43:38.876 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98912.log.gz 2024-09-10T08:43:38.876 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66141.log 2024-09-10T08:43:38.877 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75655.log.gz 2024-09-10T08:43:38.878 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80398.log 2024-09-10T08:43:38.878 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2024-09-10T08:43:38.879 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61966.log 2024-09-10T08:43:38.879 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66141.log.gz 2024-09-10T08:43:38.880 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61258.log 2024-09-10T08:43:38.880 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80398.log.gz 2024-09-10T08:43:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-10T08:43:38.882 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61966.log.gz 2024-09-10T08:43:38.882 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99467.log 2024-09-10T08:43:38.883 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61258.log.gz 2024-09-10T08:43:38.884 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76964.log 2024-09-10T08:43:38.884 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-10T08:43:38.885 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41862.log 2024-09-10T08:43:38.886 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99467.log.gz 2024-09-10T08:43:38.886 INFO:teuthology.orchestra.run.smithi176.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T08:43:38.887 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41010.log 2024-09-10T08:43:38.887 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76964.log.gz 2024-09-10T08:43:38.888 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62306.log 2024-09-10T08:43:38.888 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41862.log.gz 2024-09-10T08:43:38.889 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64535.log 2024-09-10T08:43:38.889 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41010.log.gz 2024-09-10T08:43:38.890 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80338.log 2024-09-10T08:43:38.890 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62306.log.gz 2024-09-10T08:43:38.891 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80170.log 2024-09-10T08:43:38.892 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64535.log.gz 2024-09-10T08:43:38.893 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100859.log 2024-09-10T08:43:38.893 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80338.log.gz 2024-09-10T08:43:38.894 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61521.log 2024-09-10T08:43:38.894 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80170.log.gz 2024-09-10T08:43:38.895 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56919.log 2024-09-10T08:43:38.895 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100859.log.gz 2024-09-10T08:43:38.896 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62222.log 2024-09-10T08:43:38.897 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61521.log.gz 2024-09-10T08:43:38.898 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95564.log 2024-09-10T08:43:38.898 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56919.log.gz 2024-09-10T08:43:38.899 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62222.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62222.log.gz 2024-09-10T08:43:38.900 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76814.log 2024-09-10T08:43:38.901 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95564.log.gz 2024-09-10T08:43:38.901 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62999.log 2024-09-10T08:43:38.903 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101704.log 2024-09-10T08:43:38.903 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76814.log.gz 2024-09-10T08:43:38.905 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105017.log 2024-09-10T08:43:38.905 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62999.log.gz 2024-09-10T08:43:38.905 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101704.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T08:43:38.906 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101704.log.gz 2024-09-10T08:43:38.906 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.105017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105017.log.gz 2024-09-10T08:43:38.909 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84892.log 2024-09-10T08:43:38.910 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40548.log 2024-09-10T08:43:38.911 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97673.log 2024-09-10T08:43:38.912 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84892.log.gz 2024-09-10T08:43:38.913 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90923.log 2024-09-10T08:43:38.913 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40548.log.gz 2024-09-10T08:43:38.914 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94221.log 2024-09-10T08:43:38.915 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97673.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97673.log.gz 2024-09-10T08:43:38.916 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90923.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90923.log.gz 2024-09-10T08:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94221.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94221.log.gz 2024-09-10T08:43:38.918 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40323.log 2024-09-10T08:43:38.919 INFO:teuthology.orchestra.run.smithi176.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T08:43:38.920 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101111.log 2024-09-10T08:43:38.921 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40323.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40323.log.gz 2024-09-10T08:43:38.922 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103546.log 2024-09-10T08:43:38.922 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101111.log.gz 2024-09-10T08:43:38.923 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101662.log 2024-09-10T08:43:38.925 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103546.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103546.log.gz 2024-09-10T08:43:38.926 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80991.log 2024-09-10T08:43:38.926 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101662.log.gz 2024-09-10T08:43:38.927 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68559.log 2024-09-10T08:43:38.929 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80991.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80991.log.gz 2024-09-10T08:43:38.930 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-09-10T08:43:38.931 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68559.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68559.log.gz 2024-09-10T08:43:38.931 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60536.log 2024-09-10T08:43:38.932 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.35837.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-09-10T08:43:38.932 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-09-10T08:43:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60536.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40367.log 2024-09-10T08:43:38.934 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60536.log.gz 2024-09-10T08:43:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52442.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-09-10T08:43:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40367.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40367.log.gz 2024-09-10T08:43:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61300.log 2024-09-10T08:43:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98369.log 2024-09-10T08:43:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61300.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61300.log.gz 2024-09-10T08:43:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102454.log 2024-09-10T08:43:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98369.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98369.log.gz 2024-09-10T08:43:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67030.log 2024-09-10T08:43:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102454.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.102454.log.gz 2024-09-10T08:43:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.67030.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77505.log 2024-09-10T08:43:38.945 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67030.log.gz 2024-09-10T08:43:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94306.log 2024-09-10T08:43:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77505.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77505.log.gz 2024-09-10T08:43:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53795.log/var/log/ceph/ceph-client.admin.94306.log: 2024-09-10T08:43:38.949 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94306.log.gz 2024-09-10T08:43:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100817.log 2024-09-10T08:43:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53795.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53795.log.gz 2024-09-10T08:43:38.952 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59867.log/var/log/ceph/ceph-client.admin.100817.log: 2024-09-10T08:43:38.953 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100817.log.gz 2024-09-10T08:43:38.953 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-09-10T08:43:38.954 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59867.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59867.log.gz 2024-09-10T08:43:38.955 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57212.log 2024-09-10T08:43:38.956 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45701.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-09-10T08:43:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67240.log 2024-09-10T08:43:38.957 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57212.log.gz 2024-09-10T08:43:38.958 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54082.log 2024-09-10T08:43:38.960 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67240.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67240.log.gz 2024-09-10T08:43:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58733.log 2024-09-10T08:43:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54082.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54082.log.gz 2024-09-10T08:43:38.961 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85909.log 2024-09-10T08:43:38.963 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88793.log 2024-09-10T08:43:38.963 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58733.log.gz 2024-09-10T08:43:38.964 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85909.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85909.log.gz 2024-09-10T08:43:38.965 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103159.log 2024-09-10T08:43:38.966 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93273.log 2024-09-10T08:43:38.966 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.88793.log.gz 2024-09-10T08:43:38.967 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63239.log 2024-09-10T08:43:38.968 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93273.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.103159.log.gz 2024-09-10T08:43:38.969 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.93273.log.gz 2024-09-10T08:43:38.969 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57661.log 2024-09-10T08:43:38.970 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63239.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63239.log.gz 2024-09-10T08:43:38.970 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53160.log 2024-09-10T08:43:38.972 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100775.log 2024-09-10T08:43:38.972 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57661.log.gz 2024-09-10T08:43:38.973 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90629.log 2024-09-10T08:43:38.973 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53160.log.gz 2024-09-10T08:43:38.975 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98828.log 2024-09-10T08:43:38.975 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100775.log.gz 2024-09-10T08:43:38.976 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90629.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77313.log 2024-09-10T08:43:38.977 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90629.log.gz 2024-09-10T08:43:38.977 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98828.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98828.log.gz 2024-09-10T08:43:38.978 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65174.log 2024-09-10T08:43:38.979 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77313.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77313.log.gz 2024-09-10T08:43:38.979 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81033.log 2024-09-10T08:43:38.980 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65174.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65174.log.gz 2024-09-10T08:43:38.980 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76036.log 2024-09-10T08:43:38.982 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81033.log.gz 2024-09-10T08:43:38.982 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53952.log 2024-09-10T08:43:38.983 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77187.log 2024-09-10T08:43:38.983 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76036.log.gz 2024-09-10T08:43:38.984 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76772.log 2024-09-10T08:43:38.984 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53952.log.gz 2024-09-10T08:43:38.985 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77187.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77187.log.gz 2024-09-10T08:43:38.985 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84072.log 2024-09-10T08:43:38.987 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95312.log 2024-09-10T08:43:38.987 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76772.log.gz 2024-09-10T08:43:38.988 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98454.log 2024-09-10T08:43:38.989 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84072.log.gz 2024-09-10T08:43:38.989 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88469.log 2024-09-10T08:43:38.989 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95312.log.gz 2024-09-10T08:43:38.990 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104597.log 2024-09-10T08:43:38.991 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98454.log.gz 2024-09-10T08:43:38.992 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88469.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88469.log.gz 2024-09-10T08:43:38.992 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75774.log 2024-09-10T08:43:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104597.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104597.log.gz 2024-09-10T08:43:38.993 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81911.log 2024-09-10T08:43:38.995 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75774.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-09-10T08:43:38.995 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75774.log.gz 2024-09-10T08:43:38.996 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.81911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81911.log.gz 2024-09-10T08:43:38.996 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67198.log 2024-09-10T08:43:38.997 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.43563.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85144.log 2024-09-10T08:43:38.998 INFO:teuthology.orchestra.run.smithi052.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-09-10T08:43:38.999 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T08:43:38.999 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67198.log.gz 2024-09-10T08:43:39.000 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85144.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85144.log.gz 2024-09-10T08:43:39.000 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90713.log 2024-09-10T08:43:39.001 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81531.log 2024-09-10T08:43:39.004 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90713.log.gz 2024-09-10T08:43:39.004 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95396.log 2024-09-10T08:43:39.004 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81531.log.gz 2024-09-10T08:43:39.005 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29721.log 2024-09-10T08:43:39.006 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95396.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95396.log.gz 2024-09-10T08:43:39.007 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.29721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53370.log 2024-09-10T08:43:39.008 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29721.log.gz 2024-09-10T08:43:39.009 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65090.log 2024-09-10T08:43:39.010 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53370.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53370.log.gz 2024-09-10T08:43:39.011 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.65090.log: /var/log/ceph/ceph-client.admin.42228.log 2024-09-10T08:43:39.011 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65090.log.gz 2024-09-10T08:43:39.012 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101363.log 2024-09-10T08:43:39.014 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2024-09-10T08:43:39.015 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43920.log 2024-09-10T08:43:39.017 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57913.log 2024-09-10T08:43:39.017 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101363.log.gz 2024-09-10T08:43:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85186.log 2024-09-10T08:43:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57913.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43920.log.gz 2024-09-10T08:43:39.020 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57913.log.gz 2024-09-10T08:43:39.021 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64053.log 2024-09-10T08:43:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85186.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85186.log.gz 2024-09-10T08:43:39.023 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.64053.log: --verbose -- /var/log/ceph/ceph-client.admin.84934.log 2024-09-10T08:43:39.023 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64053.log.gz 2024-09-10T08:43:39.024 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59378.log 2024-09-10T08:43:39.026 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84934.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84934.log.gz 2024-09-10T08:43:39.027 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59378.log: -- /var/log/ceph/ceph-client.admin.44215.log 2024-09-10T08:43:39.027 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59378.log.gz 2024-09-10T08:43:39.028 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85443.log 2024-09-10T08:43:39.030 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44215.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2024-09-10T08:43:39.031 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.85443.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.80212.log 2024-09-10T08:43:39.031 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.85443.log.gz 2024-09-10T08:43:39.032 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62348.log 2024-09-10T08:43:39.034 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.80212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.80212.log.gz 2024-09-10T08:43:39.035 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62348.log: /var/log/ceph/ceph-client.admin.84030.log 2024-09-10T08:43:39.036 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62348.log.gz 2024-09-10T08:43:39.037 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66640.log 2024-09-10T08:43:39.038 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84030.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84030.log.gz 2024-09-10T08:43:39.039 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61342.log 2024-09-10T08:43:39.040 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66640.log.gz 2024-09-10T08:43:39.041 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41856.log 2024-09-10T08:43:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61342.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61342.log.gz 2024-09-10T08:43:39.043 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60474.log 2024-09-10T08:43:39.043 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41856.log.gz 2024-09-10T08:43:39.044 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83688.log 2024-09-10T08:43:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60474.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60474.log.gz 2024-09-10T08:43:39.045 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2024-09-10T08:43:39.046 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42846.log 2024-09-10T08:43:39.047 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45659.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83688.log.gz 2024-09-10T08:43:39.048 INFO:teuthology.orchestra.run.smithi052.stderr:gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2024-09-10T08:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2024-09-10T08:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.42846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42846.log.gz 2024-09-10T08:43:39.049 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66810.log 2024-09-10T08:43:39.050 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57390.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99509.log 2024-09-10T08:43:39.051 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2024-09-10T08:43:39.052 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67072.log 2024-09-10T08:43:39.052 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66810.log.gz 2024-09-10T08:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99509.log: /var/log/ceph/ceph-client.admin.67072.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99509.log.gz 2024-09-10T08:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67072.log.gz 2024-09-10T08:43:39.055 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79813.log 2024-09-10T08:43:39.058 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41850.log 2024-09-10T08:43:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79813.log.gz 2024-09-10T08:43:39.060 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97834.log 2024-09-10T08:43:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41850.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41850.log.gz 2024-09-10T08:43:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88985.log 2024-09-10T08:43:39.063 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97834.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.97834.log.gz 2024-09-10T08:43:39.064 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81075.log 2024-09-10T08:43:39.065 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88985.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88985.log.gz 2024-09-10T08:43:39.066 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-09-10T08:43:39.067 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81075.log.gz 2024-09-10T08:43:39.068 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95056.log 2024-09-10T08:43:39.069 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45575.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-09-10T08:43:39.070 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.95056.log: -- /var/log/ceph/ceph-client.admin.85867.log 2024-09-10T08:43:39.071 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95056.log.gz 2024-09-10T08:43:39.071 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58691.log 2024-09-10T08:43:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85867.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85867.log.gz 2024-09-10T08:43:39.073 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55544.log 2024-09-10T08:43:39.074 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58691.log.gz 2024-09-10T08:43:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T08:43:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55544.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55544.log.gz 2024-09-10T08:43:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55414.log 2024-09-10T08:43:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.55414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2024-09-10T08:43:39.081 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55414.log.gz 2024-09-10T08:43:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75371.log 2024-09-10T08:43:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.75994.log 2024-09-10T08:43:39.086 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75371.log: -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2024-09-10T08:43:39.087 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75371.log.gz 2024-09-10T08:43:39.089 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93678.log 2024-09-10T08:43:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93678.log: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T08:43:39.092 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75994.log.gz 2024-09-10T08:43:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2024-09-10T08:43:39.094 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93678.log.gz 2024-09-10T08:43:39.094 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2024-09-10T08:43:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60777.log 2024-09-10T08:43:39.096 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2024-09-10T08:43:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62180.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz 2024-09-10T08:43:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60777.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60777.log.gz 2024-09-10T08:43:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53015.log 2024-09-10T08:43:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56269.log 2024-09-10T08:43:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53015.log.gz 2024-09-10T08:43:39.104 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81345.log 2024-09-10T08:43:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56269.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56269.log.gz 2024-09-10T08:43:39.106 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57306.log 2024-09-10T08:43:39.109 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81345.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81345.log.gz 2024-09-10T08:43:39.109 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67763.log 2024-09-10T08:43:39.109 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57306.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57306.log.gz 2024-09-10T08:43:39.110 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77145.log 2024-09-10T08:43:39.111 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67763.log.gz 2024-09-10T08:43:39.112 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77145.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77145.log.gz 2024-09-10T08:43:39.113 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65216.log 2024-09-10T08:43:39.114 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90839.log 2024-09-10T08:43:39.115 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65216.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65216.log.gz 2024-09-10T08:43:39.116 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69188.log 2024-09-10T08:43:39.117 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90839.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90839.log.gz 2024-09-10T08:43:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90545.log 2024-09-10T08:43:39.119 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.69188.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69188.log.gz 2024-09-10T08:43:39.120 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-09-10T08:43:39.120 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90545.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.90545.log.gz 2024-09-10T08:43:39.121 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2024-09-10T08:43:39.123 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42312.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101927.log 2024-09-10T08:43:39.123 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-09-10T08:43:39.126 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45785.log: gzip 91.2% -5 --verbose --/var/log/ceph/ceph-client.admin.101927.log: /var/log/ceph/ceph-client.admin.89906.log 2024-09-10T08:43:39.126 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2024-09-10T08:43:39.126 INFO:teuthology.orchestra.run.smithi052.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101927.log.gz 2024-09-10T08:43:39.128 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68433.log 2024-09-10T08:43:39.129 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63000.log 2024-09-10T08:43:39.129 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89906.log.gz 2024-09-10T08:43:39.131 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68433.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68433.log.gz 2024-09-10T08:43:39.132 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93315.log 2024-09-10T08:43:39.132 INFO:teuthology.orchestra.run.smithi052.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63000.log.gz 2024-09-10T08:43:39.133 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:43:39.135 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93315.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93315.log.gz 2024-09-10T08:43:39.136 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93909.log 2024-09-10T08:43:39.139 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-09-10T08:43:39.140 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93909.log.gz 2024-09-10T08:43:39.141 INFO:teuthology.orchestra.run.smithi052.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:43:39.141 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2024-09-10T08:43:39.143 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44308.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-09-10T08:43:39.143 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104345.log 2024-09-10T08:43:39.144 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58775.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2024-09-10T08:43:39.145 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99821.log 2024-09-10T08:43:39.146 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104345.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104345.log.gz 2024-09-10T08:43:39.147 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60304.log 2024-09-10T08:43:39.149 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77229.log 2024-09-10T08:43:39.149 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.99821.log.gz 2024-09-10T08:43:39.151 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.60304.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66873.log 2024-09-10T08:43:39.151 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60304.log.gz/var/log/ceph/ceph-client.admin.77229.log: 2024-09-10T08:43:39.152 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77229.log.gz 2024-09-10T08:43:39.153 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53202.log 2024-09-10T08:43:39.154 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66873.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66873.log.gz 2024-09-10T08:43:39.155 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62764.log 2024-09-10T08:43:39.156 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53202.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53202.log.gz 2024-09-10T08:43:39.157 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62764.log: /var/log/ceph/ceph-client.admin.88727.log 2024-09-10T08:43:39.158 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62764.log.gz 2024-09-10T08:43:39.159 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93815.log 2024-09-10T08:43:39.161 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88727.log: /var/log/ceph/ceph-client.admin.93815.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88727.log.gz 2024-09-10T08:43:39.162 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62096.log 2024-09-10T08:43:39.162 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93815.log.gz 2024-09-10T08:43:39.163 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84348.log 2024-09-10T08:43:39.164 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62096.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62096.log.gz 2024-09-10T08:43:39.165 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.84348.log: --verbose -- /var/log/ceph/ceph-client.admin.103588.log 2024-09-10T08:43:39.166 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84348.log.gz 2024-09-10T08:43:39.168 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103588.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103588.log.gz 2024-09-10T08:43:39.168 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40195.log 2024-09-10T08:43:39.170 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59093.log 2024-09-10T08:43:39.171 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40195.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2024-09-10T08:43:39.172 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85951.log 2024-09-10T08:43:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59093.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59093.log.gz 2024-09-10T08:43:39.173 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60963.log 2024-09-10T08:43:39.175 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85951.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85951.log.gz 2024-09-10T08:43:39.176 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.60963.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95480.log 2024-09-10T08:43:39.176 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60963.log.gz 2024-09-10T08:43:39.178 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102057.log 2024-09-10T08:43:39.179 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91219.log 2024-09-10T08:43:39.179 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95480.log.gz 2024-09-10T08:43:39.181 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102057.log.gz 2024-09-10T08:43:39.181 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94348.log 2024-09-10T08:43:39.182 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.91219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.91219.log.gz 2024-09-10T08:43:39.183 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104639.log 2024-09-10T08:43:39.184 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94348.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94348.log.gz 2024-09-10T08:43:39.185 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42144.log 2024-09-10T08:43:39.186 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104639.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104639.log.gz 2024-09-10T08:43:39.187 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42144.log: /var/log/ceph/ceph-client.admin.94857.log 2024-09-10T08:43:39.188 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42144.log.gz 2024-09-10T08:43:39.189 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76475.log 2024-09-10T08:43:39.191 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94857.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94857.log.gz 2024-09-10T08:43:39.191 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.76475.log: --verbose -- /var/log/ceph/ceph-client.admin.90965.log 2024-09-10T08:43:39.193 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76475.log.gz 2024-09-10T08:43:39.193 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88385.log 2024-09-10T08:43:39.195 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90965.log: 91.0%/var/log/ceph/ceph-client.admin.88385.log: -- replaced with /var/log/ceph/ceph-client.admin.90965.log.gz 2024-09-10T08:43:39.196 INFO:teuthology.orchestra.run.smithi052.stderr:gzip 87.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.85571.log 2024-09-10T08:43:39.196 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88385.log.gz 2024-09-10T08:43:39.197 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98147.log 2024-09-10T08:43:39.199 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85571.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85571.log.gz 2024-09-10T08:43:39.200 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101620.log 2024-09-10T08:43:39.200 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98147.log.gz 2024-09-10T08:43:39.201 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63581.log 2024-09-10T08:43:39.203 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101620.log.gz 2024-09-10T08:43:39.203 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.63581.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93535.log 2024-09-10T08:43:39.204 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.0.63581.log.gz 2024-09-10T08:43:39.205 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94077.log 2024-09-10T08:43:39.206 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93535.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93535.log.gz 2024-09-10T08:43:39.207 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103943.log 2024-09-10T08:43:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94077.log.gz 2024-09-10T08:43:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81120.log 2024-09-10T08:43:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103943.log.gz 2024-09-10T08:43:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57093.log 2024-09-10T08:43:39.212 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81120.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81120.log.gz 2024-09-10T08:43:39.213 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65132.log 2024-09-10T08:43:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57093.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57093.log.gz 2024-09-10T08:43:39.215 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-09-10T08:43:39.216 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.65132.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65132.log.gz 2024-09-10T08:43:39.217 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39568.log 2024-09-10T08:43:39.218 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42186.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-09-10T08:43:39.219 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57432.log 2024-09-10T08:43:39.220 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.39568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39568.log.gz 2024-09-10T08:43:39.221 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79992.log 2024-09-10T08:43:39.222 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57432.log.gz 2024-09-10T08:43:39.222 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60154.log 2024-09-10T08:43:39.224 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79992.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79992.log.gz 2024-09-10T08:43:39.225 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60154.log: -- /var/log/ceph/ceph-client.admin.44952.log 2024-09-10T08:43:39.225 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60154.log.gz 2024-09-10T08:43:39.226 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84537.log 2024-09-10T08:43:39.228 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44952.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2024-09-10T08:43:39.229 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.84537.log: -- /var/log/ceph/ceph-client.admin.85783.log 2024-09-10T08:43:39.229 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84537.log.gz 2024-09-10T08:43:39.230 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56600.log 2024-09-10T08:43:39.232 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85783.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85783.log.gz 2024-09-10T08:43:39.233 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56600.log: -- /var/log/ceph/ceph-client.admin.57829.log 2024-09-10T08:43:39.234 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56600.log.gz 2024-09-10T08:43:39.235 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2024-09-10T08:43:39.236 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.57829.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57829.log.gz 2024-09-10T08:43:39.237 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.44826.log: --verbose -- /var/log/ceph/ceph-client.admin.85825.log 2024-09-10T08:43:39.237 INFO:teuthology.orchestra.run.smithi052.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2024-09-10T08:43:39.239 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98702.log 2024-09-10T08:43:39.240 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85825.log.gz 2024-09-10T08:43:39.241 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-09-10T08:43:39.241 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98702.log.gz 2024-09-10T08:43:39.242 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60408.log 2024-09-10T08:43:39.244 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45365.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-09-10T08:43:39.245 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.60408.log: /var/log/ceph/ceph-client.admin.99593.log 2024-09-10T08:43:39.246 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60408.log.gz 2024-09-10T08:43:39.246 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61741.log 2024-09-10T08:43:39.248 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99593.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99593.log.gz 2024-09-10T08:43:39.248 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.61741.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.81429.log 2024-09-10T08:43:39.249 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61741.log.gz 2024-09-10T08:43:39.250 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76349.log 2024-09-10T08:43:39.252 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81429.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81429.log.gz 2024-09-10T08:43:39.253 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103630.log 2024-09-10T08:43:39.253 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76349.log.gz 2024-09-10T08:43:39.254 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55972.log 2024-09-10T08:43:39.256 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103630.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103630.log.gz 2024-09-10T08:43:39.257 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.55972.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58481.log 2024-09-10T08:43:39.258 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55972.log.gz 2024-09-10T08:43:39.258 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77057.log 2024-09-10T08:43:39.260 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58481.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58481.log.gz 2024-09-10T08:43:39.261 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103816.log 2024-09-10T08:43:39.261 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77057.log.gz 2024-09-10T08:43:39.266 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-10T08:43:39.266 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103816.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103816.log.gz 2024-09-10T08:43:39.266 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43731.log: -- /var/log/ceph/ceph-client.admin.94516.log 2024-09-10T08:43:39.266 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-10T08:43:39.267 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68643.log 2024-09-10T08:43:39.268 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94516.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94516.log.gz 2024-09-10T08:43:39.269 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44351.log 2024-09-10T08:43:39.270 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68643.log.gz 2024-09-10T08:43:39.270 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58985.log 2024-09-10T08:43:39.272 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44351.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44351.log.gz 2024-09-10T08:43:39.273 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.58985.log: -- /var/log/ceph/ceph-client.admin.61384.log 2024-09-10T08:43:39.273 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58985.log.gz 2024-09-10T08:43:39.275 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76176.log 2024-09-10T08:43:39.276 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61384.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61384.log.gz 2024-09-10T08:43:39.277 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.76176.log: --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-09-10T08:43:39.278 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76176.log.gz 2024-09-10T08:43:39.279 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-09-10T08:43:39.280 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41187.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-09-10T08:43:39.281 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.43842.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.98744.log 2024-09-10T08:43:39.281 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-09-10T08:43:39.282 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42060.log 2024-09-10T08:43:39.284 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.98744.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98744.log.gz 2024-09-10T08:43:39.285 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.42060.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104218.log 2024-09-10T08:43:39.285 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42060.log.gz 2024-09-10T08:43:39.287 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85018.log 2024-09-10T08:43:39.288 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104218.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104218.log.gz 2024-09-10T08:43:39.289 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84976.log 2024-09-10T08:43:39.290 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85018.log.gz 2024-09-10T08:43:39.290 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40418.log 2024-09-10T08:43:39.293 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84976.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84976.log.gz 2024-09-10T08:43:39.293 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.40418.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99887.log 2024-09-10T08:43:39.294 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40418.log.gz 2024-09-10T08:43:39.295 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80830.log 2024-09-10T08:43:39.296 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99887.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99887.log.gz 2024-09-10T08:43:39.297 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.80830.log: --verbose -- /var/log/ceph/ceph-client.admin.100220.log 2024-09-10T08:43:39.297 INFO:teuthology.orchestra.run.smithi052.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.80830.log.gz 2024-09-10T08:43:39.299 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44453.log 2024-09-10T08:43:39.300 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100220.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100220.log.gz 2024-09-10T08:43:39.301 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.44453.log: --verbose -- /var/log/ceph/ceph-client.admin.59868.log 2024-09-10T08:43:39.302 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44453.log.gz 2024-09-10T08:43:39.303 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86035.log 2024-09-10T08:43:39.304 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59868.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59868.log.gz 2024-09-10T08:43:39.305 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.86035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68601.log 2024-09-10T08:43:39.306 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86035.log.gz 2024-09-10T08:43:39.306 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-09-10T08:43:39.308 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68601.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68601.log.gz 2024-09-10T08:43:39.309 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101237.log 2024-09-10T08:43:39.309 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-09-10T08:43:39.311 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79686.log 2024-09-10T08:43:39.312 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101237.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101237.log.gz 2024-09-10T08:43:39.313 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.79686.log: -- /var/log/ceph/ceph-client.admin.41192.log 2024-09-10T08:43:39.314 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79686.log.gz 2024-09-10T08:43:39.315 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68020.log 2024-09-10T08:43:39.316 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-09-10T08:43:39.317 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101069.log 2024-09-10T08:43:39.317 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68020.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68020.log.gz 2024-09-10T08:43:39.318 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83820.log 2024-09-10T08:43:39.320 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101069.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101069.log.gz 2024-09-10T08:43:39.321 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.83820.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-09-10T08:43:39.321 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83820.log.gz 2024-09-10T08:43:39.323 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75437.log 2024-09-10T08:43:39.324 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44129.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-09-10T08:43:39.325 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56647.log 2024-09-10T08:43:39.326 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75437.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.75437.log.gz 2024-09-10T08:43:39.327 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55034.log 2024-09-10T08:43:39.328 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56647.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56647.log.gz 2024-09-10T08:43:39.330 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67469.log 2024-09-10T08:43:39.330 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55034.log.gz 2024-09-10T08:43:39.331 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67469.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67469.log.gz 2024-09-10T08:43:39.332 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64916.log 2024-09-10T08:43:39.333 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52973.log 2024-09-10T08:43:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64916.log.gz 2024-09-10T08:43:39.335 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-09-10T08:43:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52973.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52973.log.gz 2024-09-10T08:43:39.337 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68728.log 2024-09-10T08:43:39.339 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83754.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-09-10T08:43:39.339 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:39.341 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68728.log.gz 2024-09-10T08:43:39.342 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.83754.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56853.log 2024-09-10T08:43:39.342 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83754.log.gz 2024-09-10T08:43:39.343 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53994.log 2024-09-10T08:43:39.345 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56853.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56853.log.gz 2024-09-10T08:43:39.346 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53994.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2024-09-10T08:43:39.347 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68104.log 2024-09-10T08:43:39.349 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77015.log 2024-09-10T08:43:39.350 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68104.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68104.log.gz 2024-09-10T08:43:39.351 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89864.log 2024-09-10T08:43:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77015.log.gz 2024-09-10T08:43:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89864.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89864.log.gz 2024-09-10T08:43:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66598.log 2024-09-10T08:43:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75589.log 2024-09-10T08:43:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66598.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66598.log.gz 2024-09-10T08:43:39.357 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89696.log 2024-09-10T08:43:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75589.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75589.log.gz 2024-09-10T08:43:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58901.log 2024-09-10T08:43:39.360 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89696.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89696.log.gz 2024-09-10T08:43:39.361 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94815.log 2024-09-10T08:43:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58901.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58901.log.gz 2024-09-10T08:43:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100943.log 2024-09-10T08:43:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94815.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94815.log.gz 2024-09-10T08:43:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.100943.log: -- /var/log/ceph/ceph-client.admin.100412.log 2024-09-10T08:43:39.365 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100943.log.gz 2024-09-10T08:43:39.367 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66019.log 2024-09-10T08:43:39.369 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100412.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.100412.log.gz 2024-09-10T08:43:39.370 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105099.log 2024-09-10T08:43:39.370 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66019.log.gz 2024-09-10T08:43:39.371 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81723.log 2024-09-10T08:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.105099.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105099.log.gz 2024-09-10T08:43:39.373 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.81723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62414.log 2024-09-10T08:43:39.374 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81723.log.gz 2024-09-10T08:43:39.375 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76223.log 2024-09-10T08:43:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62414.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62414.log.gz 2024-09-10T08:43:39.377 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.76223.log: -- /var/log/ceph/ceph-client.admin.104471.log 2024-09-10T08:43:39.378 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76223.log.gz 2024-09-10T08:43:39.379 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79728.log 2024-09-10T08:43:39.380 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104471.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104471.log.gz 2024-09-10T08:43:39.381 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99737.log 2024-09-10T08:43:39.382 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79728.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79728.log.gz 2024-09-10T08:43:39.383 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52526.log 2024-09-10T08:43:39.384 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99737.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99737.log.gz 2024-09-10T08:43:39.385 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.52526.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-10T08:43:39.386 INFO:teuthology.orchestra.run.smithi052.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52526.log.gz 2024-09-10T08:43:39.387 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58212.log 2024-09-10T08:43:39.388 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43689.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-10T08:43:39.390 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.58212.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54250.log 2024-09-10T08:43:39.390 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58212.log.gz 2024-09-10T08:43:39.391 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93165.log 2024-09-10T08:43:39.392 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54250.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54250.log.gz 2024-09-10T08:43:39.393 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.93165.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104933.log 2024-09-10T08:43:39.395 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93165.log.gz 2024-09-10T08:43:39.395 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61132.log 2024-09-10T08:43:39.397 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104933.log.gz 2024-09-10T08:43:39.397 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77397.log 2024-09-10T08:43:39.398 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61132.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61132.log.gz 2024-09-10T08:43:39.399 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-09-10T08:43:39.400 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.77397.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77397.log.gz 2024-09-10T08:43:39.402 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.40460.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-09-10T08:43:39.402 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-09-10T08:43:39.403 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59665.log 2024-09-10T08:43:39.404 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40632.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-09-10T08:43:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.59665.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68062.log 2024-09-10T08:43:39.406 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59665.log.gz 2024-09-10T08:43:39.407 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66988.log 2024-09-10T08:43:39.409 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.68062.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68062.log.gz 2024-09-10T08:43:39.410 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.66988.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104513.log 2024-09-10T08:43:39.410 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66988.log.gz 2024-09-10T08:43:39.411 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54630.log 2024-09-10T08:43:39.413 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104513.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104513.log.gz 2024-09-10T08:43:39.414 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103075.log 2024-09-10T08:43:39.414 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.54630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54630.log.gz 2024-09-10T08:43:39.417 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103075.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.103075.log.gz 2024-09-10T08:43:39.417 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94035.log 2024-09-10T08:43:39.418 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90755.log 2024-09-10T08:43:39.420 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94035.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94035.log.gz 2024-09-10T08:43:39.421 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54292.log 2024-09-10T08:43:39.421 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90755.log.gz 2024-09-10T08:43:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53115.log 2024-09-10T08:43:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54292.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54292.log.gz 2024-09-10T08:43:39.425 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53115.log: /var/log/ceph/ceph-client.admin.66556.log 2024-09-10T08:43:39.425 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53115.log.gz 2024-09-10T08:43:39.426 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64095.log 2024-09-10T08:43:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66556.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66556.log.gz 2024-09-10T08:43:39.429 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64095.log: -- /var/log/ceph/ceph-client.admin.94264.log 2024-09-10T08:43:39.429 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64095.log.gz 2024-09-10T08:43:39.430 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98327.log 2024-09-10T08:43:39.432 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94264.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94264.log.gz 2024-09-10T08:43:39.433 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.98327.log: --verbose -- /var/log/ceph/ceph-client.admin.93421.log 2024-09-10T08:43:39.433 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98327.log.gz 2024-09-10T08:43:39.434 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57027.log 2024-09-10T08:43:39.435 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93421.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93421.log.gz 2024-09-10T08:43:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93951.log/var/log/ceph/ceph-client.admin.57027.log: 2024-09-10T08:43:39.438 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57027.log.gz 2024-09-10T08:43:39.438 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61048.log 2024-09-10T08:43:39.439 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93951.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93951.log.gz 2024-09-10T08:43:39.441 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61048.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61048.log.gz 2024-09-10T08:43:39.441 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63677.log 2024-09-10T08:43:39.443 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99169.log 2024-09-10T08:43:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63677.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63677.log.gz 2024-09-10T08:43:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.99169.log: --verbose -- /var/log/ceph/ceph-client.admin.89486.log 2024-09-10T08:43:39.446 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99169.log.gz 2024-09-10T08:43:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55600.log 2024-09-10T08:43:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89486.log.gz 2024-09-10T08:43:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.55600.log: --verbose -- /var/log/ceph/ceph-client.admin.93589.log 2024-09-10T08:43:39.450 INFO:teuthology.orchestra.run.smithi052.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55600.log.gz 2024-09-10T08:43:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84264.log 2024-09-10T08:43:39.452 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93589.log.gz 2024-09-10T08:43:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99425.log 2024-09-10T08:43:39.454 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.84264.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84264.log.gz 2024-09-10T08:43:39.455 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88943.log 2024-09-10T08:43:39.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99425.log.gz 2024-09-10T08:43:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83622.log 2024-09-10T08:43:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88943.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88943.log.gz 2024-09-10T08:43:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102370.log 2024-09-10T08:43:39.461 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.83622.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.83622.log.gz 2024-09-10T08:43:39.462 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.102370.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.88259.log 2024-09-10T08:43:39.462 INFO:teuthology.orchestra.run.smithi052.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102370.log.gz 2024-09-10T08:43:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65048.log 2024-09-10T08:43:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88259.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88259.log.gz 2024-09-10T08:43:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.65048.log: --verbose -- /var/log/ceph/ceph-client.admin.100478.log 2024-09-10T08:43:39.466 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65048.log.gz 2024-09-10T08:43:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56137.log 2024-09-10T08:43:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100478.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.100478.log.gz 2024-09-10T08:43:39.470 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40009.log 2024-09-10T08:43:39.470 INFO:teuthology.orchestra.run.smithi052.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56137.log.gz 2024-09-10T08:43:39.472 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75868.log 2024-09-10T08:43:39.473 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40009.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40009.log.gz 2024-09-10T08:43:39.474 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.75868.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55864.log 2024-09-10T08:43:39.474 INFO:teuthology.orchestra.run.smithi052.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75868.log.gz 2024-09-10T08:43:39.475 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66140.log 2024-09-10T08:43:39.477 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55864.log.gz 2024-09-10T08:43:39.478 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.66140.log: -- /var/log/ceph/ceph-client.admin.103009.log 2024-09-10T08:43:39.478 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66140.log.gz 2024-09-10T08:43:39.479 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67156.log 2024-09-10T08:43:39.481 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103009.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.103009.log.gz 2024-09-10T08:43:39.483 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94943.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67156.log.gz 2024-09-10T08:43:39.483 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:43:39.484 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93231.log 2024-09-10T08:43:39.485 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94943.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94943.log.gz 2024-09-10T08:43:39.486 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94432.log 2024-09-10T08:43:39.487 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93231.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93231.log.gz 2024-09-10T08:43:39.488 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52847.log 2024-09-10T08:43:39.489 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94432.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94432.log.gz 2024-09-10T08:43:39.490 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-09-10T08:43:39.491 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52847.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52847.log.gz 2024-09-10T08:43:39.492 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62841.log 2024-09-10T08:43:39.493 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45080.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2024-09-10T08:43:39.494 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62841.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62841.log.gz 2024-09-10T08:43:39.495 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79470.log 2024-09-10T08:43:39.496 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53286.log 2024-09-10T08:43:39.498 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.79470.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.79470.log.gz 2024-09-10T08:43:39.498 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97726.log 2024-09-10T08:43:39.499 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53286.log.gz 2024-09-10T08:43:39.500 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89528.log 2024-09-10T08:43:39.501 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97726.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.97726.log.gz 2024-09-10T08:43:39.502 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40237.log 2024-09-10T08:43:39.503 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89528.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89528.log.gz 2024-09-10T08:43:39.504 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63148.log 2024-09-10T08:43:39.505 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.40237.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40237.log.gz 2024-09-10T08:43:39.506 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56203.log 2024-09-10T08:43:39.507 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.63148.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63148.log.gz 2024-09-10T08:43:39.508 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85281.log 2024-09-10T08:43:39.509 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56203.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56203.log.gz 2024-09-10T08:43:39.510 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.85281.log: -- /var/log/ceph/ceph-client.admin.75952.log 2024-09-10T08:43:39.511 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85281.log.gz 2024-09-10T08:43:39.512 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58817.log 2024-09-10T08:43:39.513 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.75952.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75952.log.gz 2024-09-10T08:43:39.514 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104849.log 2024-09-10T08:43:39.515 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.58817.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58817.log.gz 2024-09-10T08:43:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2024-09-10T08:43:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104849.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104849.log.gz 2024-09-10T08:43:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89570.log 2024-09-10T08:43:39.519 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53753.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2024-09-10T08:43:39.520 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102141.log/var/log/ceph/ceph-client.admin.89570.log: 2024-09-10T08:43:39.521 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89570.log.gz 2024-09-10T08:43:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90032.log 2024-09-10T08:43:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102141.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102141.log.gz 2024-09-10T08:43:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.90032.log: --verbose -- /var/log/ceph/ceph-client.admin.53412.log 2024-09-10T08:43:39.525 INFO:teuthology.orchestra.run.smithi052.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90032.log.gz 2024-09-10T08:43:39.526 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66322.log 2024-09-10T08:43:39.527 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53412.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53412.log.gz 2024-09-10T08:43:39.528 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.66322.log: -- /var/log/ceph/ceph-client.admin.61090.log 2024-09-10T08:43:39.528 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66322.log.gz 2024-09-10T08:43:39.530 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101195.log 2024-09-10T08:43:39.531 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61090.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61090.log.gz 2024-09-10T08:43:39.531 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.101195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100733.log 2024-09-10T08:43:39.533 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101195.log.gz 2024-09-10T08:43:39.534 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76307.log 2024-09-10T08:43:39.535 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100733.log.gz 2024-09-10T08:43:39.537 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99341.log 2024-09-10T08:43:39.540 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.76307.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76307.log.gz 2024-09-10T08:43:39.540 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.99341.log: --verbose -- /var/log/ceph/ceph-client.admin.95005.log 2024-09-10T08:43:39.540 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99341.log.gz 2024-09-10T08:43:39.542 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67300.log 2024-09-10T08:43:39.543 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.95005.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95005.log.gz 2024-09-10T08:43:39.544 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62602.log 2024-09-10T08:43:39.545 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67300.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67300.log.gz 2024-09-10T08:43:39.547 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88427.log 2024-09-10T08:43:39.547 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.62602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62602.log.gz 2024-09-10T08:43:39.549 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-09-10T08:43:39.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.88427.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88427.log.gz 2024-09-10T08:43:39.552 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89129.log 2024-09-10T08:43:39.553 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.43605.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-09-10T08:43:39.554 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85060.log 2024-09-10T08:43:39.555 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.89129.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89129.log.gz 2024-09-10T08:43:39.557 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2024-09-10T08:43:39.558 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85060.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85060.log.gz 2024-09-10T08:43:39.560 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2024-09-10T08:43:39.561 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.44699.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2024-09-10T08:43:39.562 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102708.log 2024-09-10T08:43:39.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.53629.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2024-09-10T08:43:39.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.102708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102708.log.gz 2024-09-10T08:43:39.564 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102015.log 2024-09-10T08:43:39.566 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T08:43:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.102015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102015.log.gz 2024-09-10T08:43:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76265.log 2024-09-10T08:43:39.570 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.76265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61006.log 2024-09-10T08:43:39.571 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76265.log.gz 2024-09-10T08:43:39.572 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99635.log 2024-09-10T08:43:39.573 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61006.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61006.log.gz 2024-09-10T08:43:39.575 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.99635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56072.log 2024-09-10T08:43:39.576 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99635.log.gz 2024-09-10T08:43:39.577 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54166.log 2024-09-10T08:43:39.579 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.56072.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56072.log.gz 2024-09-10T08:43:39.579 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67721.log 2024-09-10T08:43:39.581 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54166.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54166.log.gz 2024-09-10T08:43:39.582 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52805.log 2024-09-10T08:43:39.583 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67721.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67721.log.gz 2024-09-10T08:43:39.585 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.52805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54442.log 2024-09-10T08:43:39.586 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52805.log.gz 2024-09-10T08:43:39.589 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2024-09-10T08:43:39.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.54442.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54442.log.gz 2024-09-10T08:43:39.594 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.41191.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T08:43:39.595 INFO:teuthology.orchestra.run.smithi052.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2024-09-10T08:43:39.597 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93464.log 2024-09-10T08:43:39.600 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.93464.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93464.log.gz 2024-09-10T08:43:39.602 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100639.log 2024-09-10T08:43:39.604 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61829.log 2024-09-10T08:43:39.607 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59027.log 2024-09-10T08:43:39.608 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61829.log: /var/log/ceph/ceph-client.admin.100639.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61829.log.gz 2024-09-10T08:43:39.609 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100639.log.gz 2024-09-10T08:43:39.610 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.59027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104765.log 2024-09-10T08:43:39.610 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59027.log.gz 2024-09-10T08:43:39.614 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62884.log 2024-09-10T08:43:39.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.104765.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104765.log.gz 2024-09-10T08:43:39.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.62884.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.62884.log.gz 2024-09-10T08:43:39.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85657.log 2024-09-10T08:43:39.623 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2024-09-10T08:43:39.624 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.85657.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85657.log.gz 2024-09-10T08:43:39.626 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2024-09-10T08:43:39.627 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45743.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2024-09-10T08:43:39.628 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64409.log 2024-09-10T08:43:39.630 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.45175.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2024-09-10T08:43:39.631 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67343.log 2024-09-10T08:43:39.632 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.64409.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64409.log.gz 2024-09-10T08:43:39.635 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86077.log 2024-09-10T08:43:39.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.67343.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67343.log.gz 2024-09-10T08:43:39.642 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.86077.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.86077.log.gz 2024-09-10T08:43:39.643 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94390.log 2024-09-10T08:43:39.648 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66490.log 2024-09-10T08:43:39.649 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.94390.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94390.log.gz 2024-09-10T08:43:39.651 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90797.log 2024-09-10T08:43:39.653 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.66490.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66490.log.gz 2024-09-10T08:43:39.654 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100328.log 2024-09-10T08:43:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.90797.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90797.log.gz 2024-09-10T08:43:39.659 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42354.log 2024-09-10T08:43:39.660 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.100328.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.100328.log.gz 2024-09-10T08:43:39.662 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61924.log 2024-09-10T08:43:39.664 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.42354.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42354.log.gz 2024-09-10T08:43:39.666 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103985.log 2024-09-10T08:43:39.667 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.61924.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61924.log.gz 2024-09-10T08:43:39.674 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.103985.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103985.log.gz 2024-09-10T08:43:39.675 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97964.log 2024-09-10T08:43:39.675 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93099.log 2024-09-10T08:43:39.677 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.97964.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.97964.log.gz 2024-09-10T08:43:39.678 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55906.log 2024-09-10T08:43:39.680 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.93099.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93099.log.gz 2024-09-10T08:43:39.685 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.55906.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55906.log.gz 2024-09-10T08:43:39.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-10T08:43:39.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-10T08:43:39.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-10T08:43:39.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-10T08:43:40.266 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T08:43:40.288 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T08:43:40.587 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T08:43:40.650 INFO:teuthology.orchestra.run.smithi176.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T08:43:40.722 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T08:43:41.042 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T08:43:41.233 INFO:teuthology.orchestra.run.smithi176.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T08:43:41.235 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-10T08:43:41.236 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m2.825s 2024-09-10T08:43:41.236 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m11.815s 2024-09-10T08:43:41.236 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m1.030s 2024-09-10T08:43:41.415 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T08:43:41.988 INFO:teuthology.orchestra.run.smithi052.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T08:43:42.139 INFO:teuthology.orchestra.run.smithi052.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T08:44:04.560 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T08:44:06.375 INFO:teuthology.orchestra.run.smithi052.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T08:44:06.378 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T08:44:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m27.971s 2024-09-10T08:44:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m59.955s 2024-09-10T08:44:06.378 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m6.971s 2024-09-10T08:44:06.380 INFO:tasks.ceph:Archiving logs... 2024-09-10T08:44:06.380 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi052/log 2024-09-10T08:44:06.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:44:14.693 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi176/log 2024-09-10T08:44:14.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:44:16.127 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T08:44:16.135 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T08:44:16.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:44:16.140 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:44:16.248 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T08:44:16.257 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T08:44:16.257 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:44:16.264 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:44:16.293 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:44:16.297 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:44:16.300 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:44:16.301 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-10T08:44:16.301 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +965us[ +955us] +/- 50ms 2024-09-10T08:44:16.301 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 32 +1761us[+1751us] +/- 56ms 2024-09-10T08:44:16.301 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -4523us[-4523us] +/- 82ms 2024-09-10T08:44:16.302 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:44:16.304 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:44:16.305 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-10T08:44:16.305 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +929us[ +972us] +/- 50ms 2024-09-10T08:44:16.305 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 +1674us[+1717us] +/- 56ms 2024-09-10T08:44:16.306 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -4568us[-4525us] +/- 82ms 2024-09-10T08:44:16.306 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:44:16.308 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T08:44:16.323 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T08:44:16.323 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T08:44:16.350 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:44:16.498 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:44:16.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:44:16.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:44:16.678 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:44:16.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:44:16.738 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T08:44:16.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T08:44:16.775 INFO:teuthology.task.internal:Duration was 1421.057522 seconds 2024-09-10T08:44:16.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T08:44:16.824 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T08:44:16.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:44:16.829 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:44:16.913 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:44:16.915 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:44:17.427 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T08:44:17.427 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T08:44:17.427 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:44:17.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-10T08:44:17.479 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:44:17.529 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T08:44:17.529 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:44:17.533 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:44:17.593 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T08:44:17.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:44:17.597 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:44:17.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T08:44:17.790 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T08:44:17.790 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:44:17.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:44:17.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T08:44:17.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:44:17.918 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:44:17.984 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-10T08:44:17.988 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-10T08:44:18.017 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:44:18.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:44:18.051 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:44:18.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:44:18.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T08:44:18.095 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T08:44:18.096 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi052 2024-09-10T08:44:18.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:44:18.162 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898916/remote/smithi176 2024-09-10T08:44:18.162 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:44:18.225 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T08:44:18.226 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:44:18.230 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:44:18.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T08:44:18.276 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T08:44:18.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T08:44:18.300 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T08:44:18.301 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:44:18.305 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:44:18.336 INFO:teuthology.orchestra.run.smithi052.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:44 /home/ubuntu/cephtest 2024-09-10T08:44:18.339 INFO:teuthology.orchestra.run.smithi176.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:44 /home/ubuntu/cephtest 2024-09-10T08:44:18.342 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T08:44:18.351 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T08:44:18.455 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 1421.0575218200684 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=383c97baab2c41fab32dbb8d5ab5efcd status: fail success: false 2024-09-10T08:44:18.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:44:18.536 INFO:teuthology.run:FAIL